TWI606412B - Autonomic shopping system for visually impaired - Google Patents

Description

Visually impaired self-employed shopping system

The present invention relates to a system, especially a system that can assist a visually impaired person to self-shop.

According to statistics, there are about 285 million visually impaired people in the world, of which 13.7% suffer from blindness and 86.3% are amblyopia. Because vision is the most direct channel for human beings to perceive external things, it is not only impossible to visually perceive external things, but also many things in life, relying on others, whether it is a visually impaired person with congenital visual impairment or acquired vision loss. assist. In the case of shopping, when the visually impaired person purchases, since it is impossible to confirm the position of the required goods on the store shelves, it is often necessary to have other people accompanying the peers to assist the visually impaired to find goods, inform the product information and conduct checkout actions. . Therefore, visually impaired persons need to wait for family members or friends to have free time or to make appointments with visually impaired guides to purchase. In addition, visually impaired persons usually cannot know the shelf life of purchased products, so only a small amount of goods can be purchased for each purchase. It is necessary to rely on others to assist in shopping, so that visually impaired people cannot meet their own needs.

In order to assist the visually impaired to solve daily life problems, the Republic of China Announcement No. I304954 discloses a "commercial system and portable device that can recognize and read tags and apply identifiable read tags", which will be unified. The identifiable read label of the specification agreement is fixed on at least one store, street intersection, public facilities, transportation, public use advertisement or commodity, business card and other participating entities, and has a special standard on the identifiable read label. Chapters and at least one can represent the corresponding entities involved The content tag of the content material, and the participating physical object, the content material and the identifiable read tag are integrated into the system database for the portable device to read the tag content, link to the database, and display in the portable The device or the content of the tag data can be played through the sound module, which can be used for the visually impaired and provide a guide function.

In addition, the Republic of China Announcement No. M482779 discloses an "item information inquiry system" which includes an item database, an information extractor and a query service software, and is provided with an induction unit in the item and stored in the item database. The detailed information of the item allows the user to read the information in the item sensing unit through the information extractor and analyze it and output it to the query service software in a variety of forms for the user with dyslexia to understand the item information.

In view of the fact that the conventional system can achieve the effect of guiding blindness and querying information, but it is unable to integrate navigation and shopping procedures, there is still a lack of improvement.

Therefore, the object of the present invention is to connect with a store having a Beacon proximity system through a wearing device and a mobile device, and to obtain navigation by assisting the visually impaired person to purchase and understand the product by reading the tag information of the store product. The effectiveness of information.

In order to achieve the foregoing, the present invention provides a visually impaired self-purchasing system, the system comprising: at least one store, a Beacon (beacon) proximity system on the shelf of the store, and a label for each product; The wearing device is adapted to be worn on the head of the visually impaired person, and comprises: a reader for reading the label information of the product; and a first transmitting and receiving module for receiving the Beacon a message transmitted by a neighboring system and a mobile device; a sound hole; a lens that transmits a signal to the voice module after sensing the obstacle; and a voice module coupled to the voice module Picker, The first transmitting and receiving module, the sounding hole and the lens, and capable of receiving the received message through the sound hole after receiving the signal of the reader and the first transmitting and receiving module and the signal of the lens; and a touch area An option for operating the mobile device when the wearing device is coupled to the mobile device; and a mobile device comprising a GPS positioning system and a second transmitting and receiving module coupled to the wearing device And the mobile device is installed with the application software. The application software includes: a setting module for visually impaired user account, credit card data and device connection setting; a shopping list module for visually impaired persons to establish A list of shopping items; a shopping module for the visually impaired to use the GPS positioning system to plan the route or receive the location information provided by the Beacon proximity system for outdoor navigation or internal navigation of the store after selecting the store or importing the list of shopping items. And after arriving at the location of the shopping item, select or cancel the shopping option through the touch area of the wearing device, and then borrow the letter of the setting module. Card information to complete the checkout action to form a line and send to the store.

Based on the above, through the Beacon proximity system on the store shelves and the labeling of each product, the visually impaired can use the mobile device to plan the route for outdoor navigation and sense the obstacle through the lens of the wearing device after using the wearing device. The object is used to remind the visually impaired to dodge, and when arriving at the store, the mobile device can be used to receive the location information provided by the Beacon proximity system of the store shelf to navigate the visually impaired to the shopping item according to the list of shopping items set by the visually impaired person. Position, at this time, the visually impaired can read the product label by the reader of the wearing device to obtain the product information, and select and confirm whether to purchase through the touch area, and complete the credit card information of the setting module of the mobile device. The checkout action, whereby the visually impaired can complete the shopping process autonomously without the assistance of others.

this invention:

1‧‧‧ system

2‧‧‧Store

21‧‧‧ Shelf

211‧‧‧Beacon proximity system

22‧‧‧Commodities

221‧‧‧ label

23‧‧‧Beacon Proximity System

3‧‧‧ wearing device

31‧‧‧Reader

32‧‧‧First transmission and receiving module

33‧‧‧Sound hole

34‧‧‧ lens

35‧‧‧Voice Module

36‧‧‧ Touch area

4‧‧‧Mobile devices

41‧‧‧GPS Positioning System

42‧‧‧Second transmission and receiving module

43‧‧‧Application Software

431‧‧‧Setting module

432‧‧‧ shopping list module

433‧‧‧Shopping module

434‧‧‧History Module

5‧‧‧ Logistics

Figure 1 is a schematic diagram of the linkage of the system of the present invention.

Figure 2 is a perspective view of the wearing device of the present invention.

Figure 3 is a flow chart of the system of the present invention.

Figure 4 is a schematic illustration of the system of the present invention for outdoor navigation.

Figure 5 is a schematic diagram of the system of the present invention for in-store navigation.

Figure 6 is a schematic illustration of the system of the present invention for shopping.

In order to make the reviewers aware of the techniques, means and effects of the present invention in order to achieve the objectives, the following is a description of a preferred embodiment and a detailed description of the following: First, please refer to Figures 1~2 The visually impaired self-purchasing system 1 includes at least one store 2, a wearing device 3, a mobile device 4, and at least one logistics 5; the shelf 21 of the store 2 is provided with a Beacon proximity system 211, and can be worn When the device 3 approaches, the product information on the shelf 21 and the product 22 special message are automatically pushed, and a tag 221 is provided for each product 22. Preferably, the tag 221 is an RFID tag and includes at least product shelf life information.

The wearing device 3 is mounted on the head of the visually impaired person, and includes a reader 31, a first transmitting and receiving module 32, a sounding hole 33, a lens 34, a voice module 35, and a touch. The control unit 36 is configured to read the label 221 information of the product 22. Preferably, the reader 31 is an RFID reader; the first transmitting and receiving module 32 is configured to receive the Beacon proximity system 211. Preferably, the first transmitting and receiving module 32 is Bluetooth, and the message 221 read by the reader 31 can be transmitted and stored in the mobile device 4; The lens 34 transmits a signal to the voice module 35 after sensing the obstacle; the voice module 35 is coupled to the reader 31, the first transmitting and receiving module 32, the sound hole 33 and the lens 34, and After receiving the message from the reader 31 and the first transmitting and receiving module 32 and the signal of the lens 34, the received message is played through the sound hole 33. The touch area 36 is used to connect the mobile device 3 to the mobile device. At 4 o'clock, the option of the mobile device 4 is controlled.

The mobile device 4 includes a GPS positioning system 41 and a second transmitting and receiving module 42 to be coupled to the wearing device 3. Preferably, the second transmitting and receiving module 42 is Bluetooth, and the mobile device 4 is installed. There is an application software 43. The application software 43 includes a setting module 431, a shopping list module 432, a shopping module 433, and a history module 434. The setting module 431 is used by the visually impaired. The setting of the account account, the credit card information and the device connection; the shopping list module 432 is for the visually impaired to establish a shopping item list; the shopping module 433 is for the visually impaired to use after selecting the store 2 or importing the shopping item list The GPS positioning system 41 plans a route or receives location information provided by the Beacon proximity system 211 (23) for outdoor navigation or store 2 internal navigation, and after reaching the location of the shopping item, selects through the touch area 36 of the wearing device 3. Confirming or canceling the shopping option, and then performing the checkout action by the credit card information of the setting module 431 to form an order and transmitting to the store 2, and the logistics 5 can perform the delivery action after receiving the order of the store 2; , Clicking touch area through line 36 as a confirmation of the operation instruction and cancel instruction through a sliding action of; the history module 434 to store for later recording of historical data for the visually impaired.

In an embodiment of the present invention, a Beacon proximity system 23 is provided in the house or store 2 to enable the wearing device 3 or the mobile device 4 to pass through the first transmitting and receiving module 32 or the second transmitting and receiving module. 42 receives the message pushed by the Beacon proximity system 23 for the visually impaired to confirm whether the direction of travel is correct or to know the instant push message of the store 2.

Secondly, please refer to Figures 1~2 and in conjunction with Figure 3, when the visually impaired wants to make a purchase through System 1, the credit card information is set before the setting module 431 of the mobile device 4, and The shopping list module 432 creates a shopping item list data. Then, after selecting the store 2 by the shopping module 433, the mobile device 4 uses the GPS positioning system 41 to plan the route and perform outdoor navigation. At this time, the visually impaired can use the matching. Wearing device 3 (with reference to Figure 4), and receiving the location information provided by the Beacon proximity system 23 provided in the house or store 2 card number along the way by the first transmitting and receiving module 32, for the visually impaired to confirm the direction of travel Is it correct, and can also receive the instant sale information of the Beacon proximity system 23 of the store 2, and sense whether there is an obstacle in front by the lens 34 of the wearing device 3, and the lens 34 can sense the obstacle A signal is transmitted to the voice module 35 to play the obstacle message by the sound hole 33 to remind the visually impaired.

When the visually impaired person arrives at the store 2 (with reference to Figure 5), the mobile device 4 can plan the route and carry out the store 2 according to the Beacon proximity system 211 located on the shelf 2 of the store 2 according to the list of shopping items established by the visually impaired person. Navigation, when the visually impaired person arrives in front of the shelf 22 of the item 22 in the shopping item list, the Beacon proximity system 211 provided on the shelf 21 will sequentially push the information of each item 22 from top to bottom, and the item 22 information can The voice module 35 is played by the sound hole 33, so that the visually impaired can quickly understand the contents of the product 22 placed on the shelf 21, and can immediately broadcast the sale or new product information of the same type of goods 22 to the visually impaired. There are more diverse options. When the visually impaired person takes the product 22, the wearing device 3 can read the label 221 information of the product 22 by the reader 31 (refer to FIG. 6), and transmit the read content to the voice module 35. The visually impaired person can listen to the complete product 22 message through the sound hole 33, and can transmit and store the product 22 message in the mobile device 4 by using the first transmitting and receiving module 32, so that the visually impaired can always know the shelf life of the product 22, In order to control the quantity of the purchase of the product 22, and the touch area 36 of the pointing or sliding wearing device 3 can be used to confirm the purchase or cancel the purchase of the product 22, and after the purchase confirmation is completed, the checkout counter at the store 2 is used. The obstacle is performed on the credit card data set in advance by the setting module 431 of the mobile device 4. Checkout to set up an order and transfer it to the store 2, so that the store 2 can deliver the goods through the logistics 5 after the goods 22 are prepared, so as to avoid the inconvenience of the visually impaired person to carry the goods 22 by themselves, and can store the purchase record in the store. The history module 434 of the mobile device 4 serves as a reference for the next time a list of shopping items is created.

Thereby, through the store 2 and the shelf 21 provided with the Beacon proximity system 23 (211), the article 22 provided with the tag 221, the wearing device 3, and the mobile device 4, the outdoor navigation, the navigation within the store 2, and the provision of the goods 22 are integrated. Information, checkout and logistics 5 distribution shopping procedures, allowing visually impaired people to go to the store 2 to purchase the required goods 22 without the assistance of others, and can fully understand the information of the goods 22, and then achieve the purpose of independent shopping.

The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. All changes and modifications that do not depart from the technical spirit of the present invention are covered by the scope of the present invention.

In summary, the present invention has indeed broken through the tradition and has improved and innovative creation content and can be specifically implemented, which should meet the statutory requirements of the invention patent, and file a patent application according to law, and invite the examination committee of the bureau to grant legal patent rights. Creation, to the sense of virtue.

1‧‧‧ system

2‧‧‧Store

21‧‧‧ Shelf

211‧‧‧Beacon proximity system

22‧‧‧Commodities

221‧‧‧ label

23‧‧‧Beacon Proximity System

3‧‧‧ wearing device

4‧‧‧Mobile devices

41‧‧‧GPS Positioning System

42‧‧‧Second transmission and receiving module

43‧‧‧Application Software

431‧‧‧Setting module

432‧‧‧ shopping list module

433‧‧‧Shopping module

434‧‧‧History Module

5‧‧‧ Logistics

Claims (10)

A visually impaired self-purchasing system comprising: at least one store, a Beacon (beacon) proximity system on the shelf of the store, and a label for each product; a wearing device for wearing the device The visually impaired person's head includes: a reader for reading the tag information of the product; a first transmitting and receiving module for receiving the message and linking action of the Beacon neighboring system a sound hole; a lens that transmits a signal to the voice module after sensing the obstacle; a voice module coupled to the reader, the first transmitting and receiving module And the sound receiving hole and the lens, and after receiving the message of the reader and the first transmitting and receiving module and the signal of the lens, playing the received message through the sound hole; and a touch area, An option for controlling the mobile device when the wearing device is coupled to the mobile device; and a mobile device comprising a GPS positioning system and a second transmitting and receiving module coupled to the wearing device And the mobile device Installed with application software, the application software includes: a setting module for visually impaired user account, credit card information and device connection settings; a shopping list module for visually impaired persons to create a list of shopping items ; a shopping module for the visually impaired to use the GPS positioning system to plan a route or receive location information provided by the Beacon proximity system for outdoor navigation or in-store navigation after selecting a store or importing the list of shopping items, and After arriving at the location of the shopping item, the confirmation or cancel shopping option is selected through the touch area of the wearing device, and the credit card information of the setting module is used to complete the checkout action to form an order and transmit to the store. The visually impaired self-purchasing system of claim 1, wherein the outdoor navigation system is provided with a Beacon proximity system to enable the wearing device or the mobile device to pass through the first transmitting and receiving module or the second transmission and The receiving module receives the message pushed by the Beacon neighboring system, so that the visually impaired person can confirm whether the traveling direction is correct or know the real-time push message of the store. The visually impaired self-purchasing system of claim 1 or 2, wherein the system further comprises at least one logistics, and is capable of performing a delivery action after receiving an order of the store. The visually impaired self-purchasing system of claim 1 or 2, wherein the tag information can be transmitted through the first transmitting and receiving module and stored in the mobile device. The visually impaired self-purchasing system of claim 1 or 2, wherein the tag information includes item retention period information. The visually impaired self-purchasing system of claim 1 or 2, wherein the first transmitting and receiving module and the second transmitting and receiving module are Bluetooth. The visually impaired self-purchasing system of claim 1 or 2, wherein the tag is an RFID tag. The visually impaired self-purchasing system of claim 1 or 2, wherein the touch area is a confirmation command through a click operation and a cancellation command by a sliding action. The visually impaired self-purchasing system of claim 1 or 2, wherein the application software further comprises a history recording module for storing the purchase history data of the visually impaired person. The visually impaired self-purchasing system of claim 1 or 2, wherein the Beacon proximity system provided by the shelf automatically pushes the product information when the wearing device approaches.