[go: up one dir, main page]

WO2015065260A1 - Système et méthode de reconnaissance de produit - Google Patents

Système et méthode de reconnaissance de produit Download PDF

Info

Publication number
WO2015065260A1
WO2015065260A1 PCT/SE2014/000129 SE2014000129W WO2015065260A1 WO 2015065260 A1 WO2015065260 A1 WO 2015065260A1 SE 2014000129 W SE2014000129 W SE 2014000129W WO 2015065260 A1 WO2015065260 A1 WO 2015065260A1
Authority
WO
WIPO (PCT)
Prior art keywords
product
cellular device
information
user
application program
Prior art date
Application number
PCT/SE2014/000129
Other languages
English (en)
Inventor
Josep Maria NOLLA PUERTAS
Original Assignee
Reve AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/139,965 external-priority patent/US20150127490A1/en
Application filed by Reve AB filed Critical Reve AB
Publication of WO2015065260A1 publication Critical patent/WO2015065260A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation

Definitions

  • the present invention pertains to a system and a method adapted to recognize a physical product through a cellular device, having a geographic positioning signaling means, utilized by a user of it.
  • Smartphones have revolutionized the way we interact with the society. They have become an important tool of our daily lives and people are depending a lot on their smartphones and apps to manage their daily tasks.
  • the smart phone has introduced its users to numerous application programs (apps) which perform tasks that no one fifteen years ago thought were possible to accomplish with a phone.
  • the phone is utilized in business, for amusement, games/gambling, shopping, tickets, character recognition, payments, and in a lot more of technical fields. But there are still applications for the smart phone not yet invented.
  • Object recognition and computer vision are commonly utilized in this technical field.
  • the computer vision field has developed extraordinarily during the last years.
  • One of the typical computer vision tasks is to determine whether or not the image data contains some specific object, feature, or activity, i.e. recognition.
  • recognition techniques There are different varieties of recognition techniques: object recognition, image recognition, content-based image retrieval, optical character encoding (OCR) or 2D code scanning, i.e. barcodes or QR codes.
  • OCR optical character encoding
  • 2D code scanning i.e. barcodes or QR codes.
  • Some of these techniques, such as 2D code scanning are widely adopted and available to most mobile devices while others like object and image recognition are starting to be tested with mass consumers, i.e. Google Goggles, Google Glass, RedLaser, and others.
  • Retailers are undergoing a digital transformation.
  • retail giant Debenhams has launched a new big data initiative to create a more personalized, multi- channeled marketing strategy.
  • the UK-based company - founded in 1778 - has
  • One aim among others of the present invention is to significantly improve the consumers' shopping experience.
  • a system has been developed, and a method to recognize and interact with commercial products via cellular devices, the "mobile application” or the “app”, which allows its users to have high engagement levels with the products they like in accordance with the present invention.
  • the mobile application brings the digital world benefits to assist the consumers during their physical retail experience.
  • the present invention sets forth a system adapted to recognize a product through a cellular device, having a geographic positioning signaling means, utilized by a user of it.
  • the invention thus comprises:
  • a product database wherein the extracted digital signals of the product information are indexed, categorized and stored in a catalogue file for the retailer, and the retailers' physical outlets geographical positioning coordinate signals are stored in the database;
  • recognized digital signals of the product information are stored in a file created by the user by online signaling of authorization to utilize the file;
  • At least one digital signaling application program interface adapted for a retailer to connect to the product database catalogue file to update the digital signals of product information
  • a digitally stored application program in the cellular device, providing the cellular device user to read a price tag with coded information regarding a product from the product in real time in a retailers' physical outlet;
  • a location source in proximity to the user of the cellular device utilized to provide geographic positioning coordinate signals (GPS), whose position is accurately pinpointed through its geographic position, thus geographically locating the cellular device user and the retailers' physical outlet, which obtains the users' current location by initiating an asynchronous request to detect the user's position, and queries the positioning hardware in the cellular device to get up-to-date information from the location sources, being utilized to derive correction information in the cellular device by the application program about geographic positioning coordinate signals receivers, wherein the application program starts the location sources correction when the user has read the price tag with the digital signaling application program, the application program prompted by the user transmitting the read price tag information to the product database to be digitally stored in the created file; a searching means analyzing the product database for the digital signals of the read product price tag to match the stored digital product signals with the transmitted read price tag information; and
  • GPS geographic positioning coordinate signals
  • the present invention comprises to be adapted to interact with product information through said application program via electronic means, including the visualization, creation and edition of comments, reviews and ratings; related to the physical products recognized through said cellular device.
  • Another embodiment provides that it is adapted to share product information through said application program and via electronic means, including social media communications, in-app messaging, and electronic mail services, related to the physical product recognized through said cellular device, such product information being sharable via electronic means, and including at least some of the following information:
  • a further embodiment provides that it is adapted to visualize, find, search, follow, create, access, organize, and edit and add products to an electronic list through the application program related to the physical products recognized through said cellular device, and such electronic lists include as many products recognized through a cellular device determined by said user of it.
  • Yet one embodiment provides that it is adapted to visualize, access and organize geographical content via geographically-specific data including but not limited to addresses, place names, or latitude and longitude coordinates through said application program, related to the physical products recognized through said cellular device.
  • Yet another embodiment provides that it is adapted to purchase the physical products recognized through said cellular device via electronic payment means, including but not limited to credit and debit cards, electronic wallets and accounts, net banking and invoicing solutions; and within the application program installed in said cellular device.
  • electronic payment means including but not limited to credit and debit cards, electronic wallets and accounts, net banking and invoicing solutions
  • Yet another embodiment provides that it is adapted to include, access, edit and organize the retailers loyalty programs through said application program, and manage and synchronize the loyalty programs in connection with the physical products recognized through said cellular device, including but not limited to redemption of points, rewards and other loyalty benefits.
  • the present invention sets forth a method adapted to recognize a product through a cellular device, having a geographic positioning signaling means, utilized by a user of it.
  • the method thus comprises:
  • recognized digital signals of the product information is stored in a file created by the user by online signaling of authorization to utilize the file;
  • a digital application program in the cellular device, providing the cellular device user to read a price tag with coded information regarding a product from the product in real time in a retailers outlet;
  • location sources whose position is accurately pin-pointed through its geographic position, thus geographically locating the cellular device user and the retailer's physical outlet, which obtains the user's current location by initiating an asynchronous request to detect the user's position, and queries the positioning hardware in the cellular device to get up-to-date information from the location sources, the location sources being utilized to derive correction information about nearby geographic positioning coordinate signals receivers, wherein the application program starts the location sources correction when the user has read the price tag with the digital signaling application program, the application program prompted by the user transmitting the read price tag information to the product database to be digitally stored in the created file; searching to investigate the product database for the digital signals of the read product price tag to match the stored digital product signals with the transmitted read price tag information; and
  • Fig. 1 schematically illustrates one embodiment of a system in accordance with the present invention.
  • the present invention relates to significantly improve a consumers shopping experience by introducing a system, and a method for that purpose.
  • a product in the sense of the present invention could be any product equipped with a price tag.
  • a cellular/mobile device could be any smart phone running an iOS ®, Android operating system or the like with an embedded camera, with or without autofocus, and a GPS receiver in accordance with the present invention.
  • An application program utilizes computer vision technologies to allow consumers to identify the products of their choice. Users just need to open the app in their cellular device, point the camera of their cellular device towards the price tag of the product they like and scan the product price tag or focus on barcode or QR code 2D, bulls eye code, and analogous codes, which are all utilized on a price tag in accordance with the present invention.
  • the system recognizes the product, and the app is provided real time information about that product including at least some of the following information; product name, price, product images, product definition, features, availability information (colors, sizes, etc.), ratings, and the like, and comments from other users and theirs. Users can share the products they've recognized with the app with other users and also via the usual social media channels. They are also able to rate the product and provide their feedback about it in one embodiment of the present invention. Moreover, users can add the products they've recognized with the app into lists, which in turn they can share and edit.
  • the app is designed to project a 3-D visualization of the product, virtual content, on the cellular device screen against the video feed, the area captured by the cellular device camera, thus seemingly locking it to the real world.
  • the mobile app is at the center of this invention.
  • the app allows customers to interact with the products they like in the physical world adding the benefits from the digital channels.
  • the mobile app distributed through the main ecosystems digital touch points like the Apple ® Store, Google ® Play, and the like. Consumers that download the app embody a version of the system in accordance with the present invention.
  • FIG. 1 schematically illustrate electronic digitally modulated signaling between means in the system through the web/cloud.
  • Fig. 1 depicts a cellular device 10, which communicates with a product database (DB) 12, users of the cellular device database (DB) 14, merchants 1-6, 16 providing price-tagged goods to the product DB 12, a cellular device mobile base station (MBS) 18, providing accurate positioning coordinates in itself to be utilized to pin-point a corrected position of the GPS cellular device and its user.
  • DB product database
  • DB cellular device database
  • MBS cellular device mobile base station
  • the user's current location is obtained by initiating an asynchronous request to detect the user's position, and queries the positioning hardware to get up-to-date information from the underlying location information sources which can include location inferred from network signals such as IP address, RFID, Wi-Fi and Bluetooth MAC addresses, and GSM/CDMA cell IDs, as well as user input.
  • Fig. 1 depicts price tag 20 bearing coded information about the product it is attached to in a physical retailer's outlet 22.
  • the cellular device 10 in accordance with the present invention is equipped with a GPS receiver, a camera, or other device known to be able to read external codes for instance radio frequency identification codes (RFID) near field communication means (NFC), and others known to be utilized by a smart phone cellular device to read external codes. It is appreciated that at least three base stations 18 can be utilized to triangulate the position of the cellular device 10.
  • RFID radio frequency identification codes
  • NFC near field communication means
  • Web scraping is a computer software technique of extracting information from websites. Web scraping is closely related to web indexing, which indexes information on the web using a bot or a web crawler, and it is a universal technique adopted by most search engines. The system scrapes retailers' websites and imports certain digital data fields of product information towards its database 12.
  • the web/cloud is like an ever-growing public library with billions of products and no central filing system.
  • the system essentially gathers the webpages during the scraping process and then creates a database 12, so to know exactly how to look things up.
  • the system database 12 organizes the imported information by indexing, categorizing and storing it.
  • the system specifies how the system's product database 12 should interact with the retailer's product catalogue database/s.
  • the system's product database API provides a standard abstraction layer for accessing the retailers' database servers 1-6 and extract a standard dataset composed of: product code (following the global GS1 specification which bases on international standards -such as UPC or ⁇ - or following other bar code symbolizes and other article number systems), product name, images and sub-images, price (possibly in multiple currencies), product description, sizes, available colors, retailer logo, retailer name, retailer URL, product URL, raw data, retailers' physical outlets locations and geo-coordinates, and other possible product information.
  • the system When a customer opens the mobile application in their cellular device 10, the system will geographically locate the user via the cellular device GPS system and alternatively signaling towards the in proximity wireless mobile base station 18.
  • Base stations are GPS receivers at an accurately known fixed location which is used to derive correction information for nearby portable GPS receivers comprised in cellular devices 10.
  • This correction data allows propagation and other effects to be corrected out of the position data obtained by the mobile stations 18, which gives greatly increased location precision and accuracy over the results obtained by uncorrected GPS receivers.
  • the system can use the users' cellular device GPS system and also Wi-Fi access point information, which is similar to the base stations 18 functioning.
  • the users' current location is obtained by initiating an asynchronous request to detect the user's position, and queries the positioning hardware to get up-to-date information from the underlying location information sources which can include location inferred from network signals such as IP address, RFID, Wi-Fi and Bluetooth MAC addresses, and GSM/CDMA cell IDs, as well as user input.
  • location information sources can include location inferred from network signals such as IP address, RFID, Wi-Fi and Bluetooth MAC addresses, and GSM/CDMA cell IDs, as well as user input.
  • a user that has opened the mobile application points the camera towards physical retailer's outlet 22 products price tag 20 and the mobile application will automatically scan the barcode or QR code in the price tag 20.
  • the system decodes the information contained in that barcode and QR code and queries the decoded output data towards' the system product database 12. If there is a match in the database 12, the system will send back the correspondent product information, which will be automatically displayed in the cellular device 10 mobile program application, app.
  • the system could not scan the barcode or QR code in the price tag 20, the system would alternatively scan the whole price tag via optical character recognition software ("OCR"), which is the electronic conversion of scanned images of printed text into machine-encoded text.
  • OCR optical character recognition software
  • the system decodes the printed text in that price tag 20 and the related digital data output would be queried against the system product database 12. If there is a match in the database 12, the system sends back the correspondent product information, which will be automatically displayed in the mobile application on the cellular device 10 display screen.
  • the system did not find a match in its database 12 either via barcode/QR code scanning or OCR, the system would return an error message which in turn would inform the user via a displayed message in the mobile application that that product is not in the system's product database 12.
  • the system determines the right match in the database and therefore, the right product information to provide to the user via product information display in the mobile application, based on the user's geographical position which has been cached and stored in the system's user database 14.
  • the system's product database 12 crosses the results with the system's user database 14, so that a higher accuracy match based on the user's physical location close to a certain retail outlet can be provided.
  • Fig. 1 illustrates a system adapted to recognize a product through a cellular device 10, having a geographic positioning signaling means, utilized by a user of it.
  • a web scraping means to extract digital signals of product information from merchants' 16 public websites.
  • It also comprises a product database 12, wherein the extracted digital signals of the product information are indexed and stored in a catalogue file for the retailer, and the retailers physical outlets 22 geographical positioning coordinate signals being stored in the database 12;
  • the system comprises a user database 14, wherein recognized digital signals of the product information are stored in a file created by the user by online signaling of authorization to utilize the file.
  • Retailers 22 have at least one digital signaling application program interface (API) adapted for a retailer 22 to connect to the product database 12 catalogue file to update the digital signals of product information.
  • the cellular device 10 is provided a digitally stored application program (app), enabling the cellular device 10 user to read a price tag 20 with coded information regarding a product from the product in real time in a retailer's physical outlet 22.
  • the system utilizes for instance, or other location sources as mentioned above, the cellular device GPS system and alternatively the cellular network base station 18 in proximity to the user of the cellular device utilized to signal geographic positioning coordinate signals, whose position is accurately pin-pointed through its geographic position, thus geographically locating the cellular device 10 user and the retailers outlet 22, which obtains the user's current location by initiating an asynchronous request to detect the user's position, and queries the positioning hardware in the cellular device 10 to get up-to-date information from the location sources, the location source 18, being utilized to derive correction information, by means for that in the application program (app) together with the cellular device 10 GPS hardware, about nearby geographic positioning coordinate signals receivers signaling their exact positions, wherein the application program starts the base station 18 point signaling when the user has read the price tag 20 with the digital signaling application program, the application program prompted by the user transmitting the read price tag information to the product database 12 to be digitally stored in the created file.
  • the application program starts the base station 18 point signaling when the user has read
  • the system provides a searching means analyzing the product database 12 for the digital signals of the read product price tag 20 to match the stored digital product signals with the transmitted read price tag information, and means utilizing the geographical coordinate positioning signals locating the user, and the retailer's physical outlet 22 to distinguish the read price tag 20 information when multiple products with similar digital signal information are found by the searching means, whereby the read price tag 20 signaling is stored in the created user file, when determined to belong to the correct retailer's 22 outlet.
  • the attached set of claims determines other possible embodiments of the present invention to a person skilled in the art of the present technical field.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un système et une méthode conçus pour reconnaître un produit physique dans un point de vente physique d'un vendeur (22) par l'intermédiaire d'un dispositif cellulaire (10), ayant un moyen de signalisation de localisation géographique, utilisé par un utilisateur de celui-ci. Des étiquettes de prix de produit (20) sont lues, décodées, et les données de sortie font l'objet d'une requête dans une base de données de produits (12) afin de rechercher des correspondances de produit. S'il y a plusieurs correspondances, des coordonnées de localisation géographique du GPS du dispositif cellulaire, de stations de base (18) ou de points d'accès WiFi sont utilisées pour choisir les informations de produit correctes dans la base de données (12), qui sont ensuite stockées dans une base de données d'utilisateurs (14).
PCT/SE2014/000129 2013-11-01 2014-10-13 Système et méthode de reconnaissance de produit WO2015065260A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE1300684 2013-11-01
SE1300684-6 2013-11-01
US14/139,965 US20150127490A1 (en) 2013-11-01 2013-12-24 System and a method to recognize a product
US14/139,965 2013-12-24

Publications (1)

Publication Number Publication Date
WO2015065260A1 true WO2015065260A1 (fr) 2015-05-07

Family

ID=53004709

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2014/000129 WO2015065260A1 (fr) 2013-11-01 2014-10-13 Système et méthode de reconnaissance de produit

Country Status (1)

Country Link
WO (1) WO2015065260A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10896158B2 (en) 2017-04-19 2021-01-19 Walmart Apollo, Llc Systems and methods for managing and updating an internal product catalog
US10929384B2 (en) 2017-08-16 2021-02-23 Walmart Apollo, Llc Systems and methods for distributed data validation
US11429642B2 (en) 2017-11-01 2022-08-30 Walmart Apollo, Llc Systems and methods for dynamic hierarchical metadata storage and retrieval
CN117440337A (zh) * 2023-12-19 2024-01-23 汉朔科技股份有限公司 电子价签的门店归属管理方法、装置及系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020002504A1 (en) * 2000-05-05 2002-01-03 Andrew Engel Mobile shopping assistant system and device
US20050091124A1 (en) * 1999-11-23 2005-04-28 White Phillip A. Product purchase decision making and information device
US20130134213A1 (en) * 2011-11-29 2013-05-30 Barnesandnoble.Com Llc System and method for providing product information

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050091124A1 (en) * 1999-11-23 2005-04-28 White Phillip A. Product purchase decision making and information device
US20020002504A1 (en) * 2000-05-05 2002-01-03 Andrew Engel Mobile shopping assistant system and device
US20130134213A1 (en) * 2011-11-29 2013-05-30 Barnesandnoble.Com Llc System and method for providing product information

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10896158B2 (en) 2017-04-19 2021-01-19 Walmart Apollo, Llc Systems and methods for managing and updating an internal product catalog
US10929384B2 (en) 2017-08-16 2021-02-23 Walmart Apollo, Llc Systems and methods for distributed data validation
US11429642B2 (en) 2017-11-01 2022-08-30 Walmart Apollo, Llc Systems and methods for dynamic hierarchical metadata storage and retrieval
CN117440337A (zh) * 2023-12-19 2024-01-23 汉朔科技股份有限公司 电子价签的门店归属管理方法、装置及系统
CN117440337B (zh) * 2023-12-19 2024-03-08 汉朔科技股份有限公司 电子价签的门店归属管理方法、装置及系统

Similar Documents

Publication Publication Date Title
US20150127490A1 (en) System and a method to recognize a product
US11823138B2 (en) System, method, and computer program product for conducting a payment transaction involving payment on delivery
TWI730524B (zh) 身份認證方法、裝置和系統
AU2013305688B2 (en) Detecting items of interest within local shops
US8584931B2 (en) Systems and methods for an augmented experience of products and marketing materials using barcodes
US20130290106A1 (en) System and method for providing directions to items of interest
US20130110624A1 (en) Methods and systems for assessing excessive accessory listings in search results
US20160019629A1 (en) Context rich consent controlled food purchase management
US20230018081A1 (en) Method, System, and Computer Program Product for Determining Relationships of Entities Associated with Interactions
US9600840B1 (en) Proximity based recommendations
CN110163724A (zh) 信息推送方法、装置、服务端及系统
US20130262231A1 (en) Targeted incentive actions based on the number of people within a geographic locale
CN109074543A (zh) 促进购物的系统和方法
CN103093261A (zh) 基于标签的社会化物联网系统
KR20130082966A (ko) 매장정보를 자동으로 제공하는 스마트 매장
WO2015065260A1 (fr) Système et méthode de reconnaissance de produit
TWI778335B (zh) 資訊推薦方法、行動裝置及電腦程式產品
CN111787042B (zh) 用于推送信息的方法和装置
Zbuchea et al. M-commerce–Facts and Forecasts. A Comparative Analysis within a Triad Framework: India, Romania, and the United States
US11475079B2 (en) System and method for efficient multi stage statistical website indexing
Ho et al. Leveraging NFC and LBS technologies to improve user experiences
KR20180058525A (ko) 매장내 상품 정보 제공 시스템 및 방법
US20150254700A1 (en) Incentivize Reviews Using Purchase Proof Based on Mobile Payment Data
KR20130027893A (ko) 푸시 기반 상품 구매 지원 시스템 및 그 제어방법과 상품 구매 서비스 제공 방법
US20220188862A1 (en) Method, system, and computer program product for matching card transaction data to mobile application usage

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14858736

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 08/07/2016)

122 Ep: pct application non-entry in european phase

Ref document number: 14858736

Country of ref document: EP

Kind code of ref document: A1