TWI872400B - Virtual shopping commodity identification system - Google Patents

Abstract

A virtual shopping commodity identification system, which is operated through an application on a terminal device connected to a head-mounted display and a controller, includes a database, a virtual module, a selection module, and a processing module. The virtual module obtains the virtual spatial map of the shopping mall from the database to be displayed through the head-mounted display. The selection module is used to select virtual commodity in the virtual spatial map of the shopping mall through the controller. The processing module carries out an image detection analysis and color tone tests of the selected virtual commodity to obtain color values thereof, based on which the processing module obtains the color tags and corresponding tag information from the database. The tag information contains price information of the virtual commodity, based on which the processing module calculates the consumption amount and provides the payment.

Description

Virtual Shopping Product Recognition System

The present invention relates to an online shopping related field, and more particularly to a virtual shopping product identification system.

With the rapid development of global information technology, the future will be an information age with the Internet and knowledge economy at its core. Modern people's lifestyles tend to be networked and intelligent. The way of shopping has gradually changed from the previous single on-site shopping to a combination of physical experience and online shopping. To buy the items you need, you no longer need to go to shopping malls or hypermarkets to select them one by one. Instead, online shopping is the current mainstream of consumption. Online shopping is to connect a computer or smart mobile device to a terminal and log in to the shopping website to select products that meet your needs, and the goods can be delivered to your home in a short time. The consumption model of being able to quickly shop and receive goods without going out provides modern people with a very convenient shopping environment.

In order to increase the realism of online shopping, some related technologies use virtual reality to simulate a three-dimensional, high-fidelity virtual shopping 3D space with computer technology. When users wear special display devices (VR glasses) to enter the virtual shopping 3D space, they can use handheld controllers to shuttle or interact in the virtual shopping 3D space environment.

However, virtual products in the 3D virtual shopping space are simulated using computer technology, so there is still a gap between them and real products. Therefore, when checking out virtual products, it is difficult to accurately identify virtual products unless a large number of image algorithms are used. As a result, users need to repeatedly identify virtual products to complete the checkout process, causing inconvenience.

To solve the above problems, the present invention provides a virtual shopping product recognition system that recognizes virtual products through image processing and uses color as a label of the virtual products, thereby quickly and accurately recognizing virtual products and providing a convenient virtual shopping effect.

An embodiment of the present invention provides a virtual shopping commodity recognition system, which is set up on a server and runs on a terminal device with an application program. The terminal device is connected to a head-mounted display and a controller. The head-mounted display is worn on the user's head, and the controller is for the user to hold and control. The virtual shopping commodity recognition system includes: a database, which stores a scene image of a virtual space of a shopping mall and a plurality of virtual commodities, wherein each Virtual products are placed in a virtual space scene map of a shopping mall. Each virtual product has a label information, which includes a color label, a product name information, and a product price information. A virtual module is coupled to a database. The virtual module reads the virtual space scene map of the shopping mall from the database and presents the virtual space scene map of the shopping mall to a terminal device and displays it through a head-mounted display. A positioning module is coupled to the virtual module. The positioning module uses the positioning sensing function of the terminal device to perform positioning and import the virtual space scene map of the shopping mall. As the user controls the controller, the position of the virtual space scene map of the shopping mall changes; a selection module is coupled with the controller and the virtual module. The selection module can feedback control the selection of the virtual product in the virtual space scene map of the shopping mall through the controller; and a processing module is connected to the database and the selection module. The processing module performs image detection and analysis and multiple color tone tests on the selected virtual product to obtain a color value of the virtual product. The processing module obtains a matching color label from a database according to the color value, obtains corresponding label information from the color label, and the label information records the product price information of the corresponding virtual product. The processing module calculates a consumption amount according to the product price information and provides payment for the consumption amount.

Through the above, the present invention recognizes virtual products through image processing, analyzes the main color characteristics of virtual products, and uses color as a virtual product label, so that the products can be quickly and accurately identified during the subsequent checkout operation, thereby improving the shortcomings of the conventional method that requires a large amount of image processing but still results in incorrect identification, thereby reducing the computational burden of image processing, improving accuracy and fast checkout efficiency, and providing a convenient virtual shopping effect.

Furthermore, the present invention uses intelligent image recognition to recognize the color characteristics of the product, and can achieve a 99% recognition rate even if the product is tilted at a certain angle; thereby greatly reducing the probability of error and shortening the checkout time of virtual products.

In order to facilitate the description of the central idea of the present invention in the above invention content column, specific embodiments are used for illustration. Various objects in the embodiments are depicted according to the proportions, sizes, deformations or displacements suitable for the description, rather than being drawn according to the proportions of the actual components.

The directional terms mentioned in the present invention, such as "upper", "lower", "front", "back", "left", "right", "inner", "outer", "side", etc., are merely directions of the drawings; therefore, the directional terms used are used to illustrate and understand the present invention, rather than to limit the present invention, and it is necessary to explain them in advance.

Please refer to Figures 1 to 5. The present invention provides a virtual shopping item recognition system 100, which is set up on a server and operates on a terminal device 1 with an application. The terminal device 1 is connected to a head-mounted display 2 and a controller 3. The head-mounted display 2 is worn on the head of a user 4, and the controller 3 is for the user 4 to hold and control. As shown in Figure 2, in the embodiment of the present invention, the terminal device 1 is a smart mobile device.

The virtual shopping commodity identification system 100 of the present invention comprises:

A database 10 stores a shopping mall virtual space scene image M and a plurality of virtual products P. The shopping mall virtual space scene image M has a product area M1 and a checkout area M2. The product area M1 is provided with virtual products P, as shown in FIGS. 2 and 3 . Each virtual product P has a label information, and the label information includes a color label, a product name information, and a product price information. The color label is used to represent the characteristic representative color of the appearance of the virtual product P.

A virtual module 20 is coupled to the database 10. The virtual module 20 reads the shopping mall virtual space scene map M from the database 10, and presents the shopping mall virtual space scene map M to the terminal device 1 and displays it through the head mounted display 2.

A positioning module 30 is coupled to the virtual module 20. The positioning module 30 uses the positioning sensing function of the terminal device 1 to perform positioning and import the shopping mall virtual space scene image M. As the user 4 controls the controller 3, the location of the shopping mall virtual space scene image M changes.

A selection module 40 is coupled to the controller 3 and the virtual module 20. The selection module 40 can feedback and control the selection of the virtual product P in the shopping mall virtual space scene M through the controller 3.

A processing module 50 is coupled to the database 10 and the selection module 40. The processing module 50 is disposed in the checkout area M2, as shown in FIG. 1 and FIG. 4. The processing module 50 performs analysis and processing on the selected virtual product P located in the checkout area M2.

The processing module 50 has an analysis unit 51 and a financial unit 52 coupled to each other. The analysis unit 51 can perform image detection analysis and multiple color tone tests on the selected virtual product P to obtain a color value C of the virtual product P, as shown in FIG5 . The processing module 50 obtains a matching color label from the database 10 according to the color value C, and obtains corresponding label information from the color label, and the label information records the product price information corresponding to the virtual product P.

In the embodiment of the present invention, the analysis unit 51 captures the image of the virtual product P. When the analysis unit 51 obtains the image of the virtual product P, the color values C generated by analyzing the image of the same virtual product P may be different due to the different ambient lighting and angles of the shopping mall virtual space scene image M. Therefore, through different color tone tests, it is possible to ensure that the image of the same virtual product P still maintains accurate recognition in different environments. Among them, each color tone test uses one of red, blue or green or a combination of the tones as a color recognition test.

Furthermore, the color value C of the virtual product P can represent the characteristic representative color of the appearance of the virtual product P. The color value C of the virtual product P is an HSV value, that is, each color value C of the virtual product P includes hue, saturation and brightness, and the color value C can describe the color of the appearance of the virtual product P at a point in the cylindrical coordinate system.

In addition, when the analysis unit 51 of the processing module 50 cannot identify the virtual product P, the analysis unit 51 will perform color and brightness correction image processing on the image of the virtual product P. The processing module 50 will analyze the corrected image of the virtual product P again to obtain the color value C of the virtual product P.

The financial unit 52 can receive the commodity price information obtained by the analysis unit 51, calculate a consumption amount according to the commodity price information, and provide payment of the consumption amount.

In the embodiment of the present invention, the user 4 can select a plurality of virtual products P through the selection module 40, and the analysis unit 51 of the processing module 50 can analyze each virtual product P and sequentially analyze and obtain a plurality of corresponding product price information, and the financial unit 52 can accumulate and calculate the price information of each product to generate a consumption amount.

In summary, the present invention can achieve the following effects:

1. The virtual shopping product recognition system 100 of the present invention recognizes virtual products P through image processing, analyzes the main color characteristics of virtual products P, and uses color as a label of virtual products P, so that products can be quickly and accurately recognized during subsequent checkout operations, thereby reducing the computational burden of image processing, improving accuracy and fast checkout efficiency, and providing a convenient virtual shopping effect.

2. The virtual shopping product recognition system 100 of the present invention uses intelligent image recognition to recognize the color characteristics of the product. Even if the product is tilted at a certain angle, it can still achieve a recognition rate of 99%. This greatly reduces the probability of error and shortens the checkout time of the virtual product P.

3. The virtual shopping product recognition system 100 of the present invention uses color as the main recognition judgment. When the analysis unit 51 obtains the image of the virtual product P with shadows, reflected light, tilt, bend, etc., it can still be recognized normally. Even when the images of several virtual products P are stacked and only the main color features of the images of some virtual products P are exposed, it can still be compared from the images of the fragmented virtual products P.

The above embodiments are only used to illustrate the present invention and are not intended to limit the scope of the present invention. Any modifications or changes that do not violate the spirit of the present invention are within the scope of protection of the present invention.

1: Terminal device 2: Head-mounted display 3: Controller 4: User 100: Virtual shopping product recognition system 10: Database 20: Virtual module 30: Positioning module 40: Selection module 50: Processing module 51: Analysis unit 52: Financial unit M: Virtual space scene map of shopping mall M1: Product area M2: Checkout area P: Virtual product C: Color value

Figure 1 is a block diagram of the system architecture of the present invention. Figure 2 is a schematic diagram of an embodiment of the present invention (I), showing the connection between the terminal device and the head-mounted display and the controller. Figure 3 is a schematic diagram of an embodiment of the present invention (II), showing the selection of virtual goods. Figure 4 is a schematic diagram of an embodiment of the present invention (III), showing the virtual goods to the checkout area. Figure 5 is a schematic diagram of an embodiment of the present invention (IV), showing that the virtual goods are analyzed to generate color values.

1: Terminal device

2: Head-mounted display

3: Controller

100: Virtual shopping product identification system

10: Database

20: Virtual module

30: Positioning module

40: Select module

50: Processing module

51:Analysis unit

52: Financial unit

Claims (6)

A virtual shopping commodity recognition system is set up on a server and runs on a terminal device with an application. The terminal device is connected to a head-mounted display and a controller. The head-mounted display is worn on the user's head and the controller is held and controlled by the user. The virtual shopping commodity recognition system includes: a database storing a shopping mall virtual space scene image and a plurality of virtual commodities, wherein each virtual commodity is set in the shopping mall virtual space scene image, and each virtual commodity has a label information, and the label information includes a color a label, a product name message and a product price message; a virtual module coupled to the database, the virtual module reads the shopping mall virtual space scene map from the database, and presents the shopping mall virtual space scene map to the terminal device, and displays it through the head-mounted display; a positioning module coupled to the virtual module, the positioning module uses the positioning sensing function of the terminal device to perform positioning, and imports the shopping mall virtual space scene map, and changes the location of the virtual space scene map of the shopping mall as the user manipulates the controller. a selection module coupled to the controller and the virtual module, the selection module can feedback control the selection of the virtual product in the virtual space scene diagram of the shopping mall through the controller; and a processing module coupled to the database and the selection module, the processing module performs image detection analysis and multiple color tone tests on the selected virtual product, each of the color tone tests uses one of red, blue or green or a combination of the colors as a color recognition test to obtain a color value of the virtual product. The color value can represent the characteristic representative color of the appearance of the virtual product. The color value of the virtual product is an HSV value. The color value of the virtual product includes hue, saturation and brightness. The processing module obtains the matching color label from the database according to the color value, obtains the corresponding label information from the color label, and the label information records the product price information corresponding to the virtual product. The processing module calculates a consumption amount according to the product price information and provides payment for the consumption amount. As described in claim 1, the virtual shopping product recognition system, wherein when the processing module cannot recognize the virtual product, the processing module performs color and brightness correction image processing on the virtual product, and the processing module re-analyzes the corrected virtual product to obtain the color value of the virtual product. As described in claim 1, the virtual shopping commodity recognition system, wherein the shopping mall virtual space scene image has a commodity area and a checkout area, and the commodity area is provided with each virtual commodity; the processing module is provided in the checkout area, and the processing module performs analysis and processing on the selected virtual commodity located in the checkout area. A virtual shopping product recognition system as described in claim 1 or 3, wherein the processing module has an analysis unit, which performs image detection analysis and multiple color tone tests on the selected virtual product to obtain the color value of the virtual product, and obtains the matching color label and the corresponding label information from the database, and the analysis unit can obtain the corresponding product price information from the obtained label information. As described in claim 4, the virtual shopping commodity identification system, wherein the processing module further has a financial unit coupled to the analysis unit, the financial unit can receive the commodity price information obtained by the analysis unit, the financial unit calculates the consumption amount according to the commodity price information, and provides payment for the consumption amount. As described in claim 5, the virtual shopping product recognition system, wherein the selection module can select a plurality of virtual products, the analysis unit can analyze each of the virtual products and sequentially analyze and obtain a plurality of corresponding product price information, and the financial unit can accumulate and calculate the price information of each product to generate the consumption amount.

Images