JP7579395B1 - Recycle determination system, recycle determination device, recycle determination method, and program - Google Patents

Abstract

[Problem] To efficiently collect items subject to collection.
[Solution] The recycling determination system includes a memory unit that stores information regarding recycling target items that are to be recycled, an acquisition unit that acquires a recycling target item image that represents an image of the recycling target item to be recycled, and a determination unit that determines whether the recycling target item is a recycling target item based on the information regarding the recycling target item and the recycling target item image.
[Selected figure] Figure 2

Description

The present invention relates to a recovery determination system, a recovery determination device, a recovery determination method, and a program.

In order to create a circular society, 3R (reduce, reuse, recycle) initiatives are being promoted comprehensively.
For example, Patent Document 1 discloses a container sorting and recovery device for sorting and recovering used plastic packaging containers, the device comprising an input port for inputting used packaging containers, a foreign object determination means for determining whether the object input from the input port is a container to be recovered or another foreign object, a material determination means for determining the material of the object input from the input port, a determination area in which the input object is retained for a predetermined period of time and the properties of the input object are determined by the foreign object determination means and the material determination means, a plurality of container receptacles provided for each property of the input object, and a determination means for determining whether the input object is a container to be sorted and recovered by the foreign object determination means. A container sorting and recovery device is disclosed that has an input item sorting means for sorting the input item to one of a plurality of container housings depending on the properties of the input item, the input item sorting means being provided in a flow path arranged between the judgment area and the plurality of container housings, and comprising an induction member that switches the flow path through which the input item flows depending on the discrimination result by the material discrimination means, and an input item sending out mechanism that discharges the input item from the discrimination area and sends it out into the flow path by utilizing gravity after the flow path is switched by the induction member, and the sending out of the input item is achieved by driving the stage on which the input item is placed to open.

For example, Patent Document 2 discloses a waste product processing system that creates a processing procedure for a waste product, the system having a readout means for reading out information about the waste product attached to the waste product, a storage means for storing a database of information required for processing the waste product, a processing procedure creation means for creating a processing procedure for the waste product by referring to information for processing the waste product stored in the database stored in the storage means based on the information about the waste product read out by the readout means, and a detection means for detecting whether the work according to the created procedure was or can be actually performed, and the processing procedure creation means, when the detection means detects that the created processing procedure cannot be performed according to the procedure, extracts an alternative work by referring to the information for processing the waste product stored in the database, and creates a new processing procedure.

Patent No. 5065847 Patent No. 3508349

However, the technology described in Patent Document 1 targets used products, and although it can determine whether or not a foreign object is a foreign object when collecting the foreign object in a collection box, etc., there is a problem in that it cannot determine whether or not the foreign object is a collection target, for example, when the foreign object resembles a collection item or when there are multiple used items. Also, the technology described in Patent Document 2 obtains information about the waste product, such as a barcode attached to the waste product, but has a problem in that it cannot collect the collection item if a barcode, etc. is not attached to the collection item.
Thus, there has been a problem in that items subject to collection cannot be collected efficiently.

The present invention was made in consideration of the above circumstances, and its purpose is to provide a collection determination system, a collection determination device, a collection determination method, and a program that can efficiently collect items that are subject to collection.

In order to solve the above-mentioned problems, one aspect of the present invention is a collection determination system that includes a storage unit that stores information about a collection target item to be collected, an acquisition unit that acquires a collection target item image that represents an image of the collection target item to be collected, and a determination unit that determines whether the collection target item is a collection target item based on the information about the collection target item and the collection target item image.

Another aspect of the present invention is a collection determination device that includes a storage unit that stores information about a collection target item to be collected, an acquisition unit that acquires a collection target item image that represents an image of the collection target item to be collected, and a determination unit that determines whether the collection target item is the collection target item based on the information about the collection target item and the collection target item image.

Another aspect of the present invention is a collection determination method executed by a computer of a collection determination device, the collection determination method including a storage step of storing information about a collection target item to be collected, an acquisition step of acquiring a collection target item image representing an image of the collection target item to be collected, and a determination step of determining whether the collection target item is the collection target item based on the information about the collection target item and the collection target item image.

Another aspect of the present invention is a program that causes a computer of a collection determination device to execute a storage step of storing information about a collection item to be collected, an acquisition step of acquiring a collection item image representing an image of the collection item to be collected, and a determination step of determining whether the collection item is a collection item based on the information about the collection item and the collection item image.

As described above, one aspect of the present invention allows for efficient collection of items subject to collection.

1 is a system configuration diagram showing an example of the configuration of a collection determination system according to a first embodiment of the present invention. 1 is a block diagram showing an example of a configuration of a collection determination device according to an embodiment of the present invention; 10 is a flowchart illustrating an example of a collection request process in the user terminal device according to the embodiment. 5 is a flowchart showing an example of a collection determination process in the collection determination device according to the present embodiment. FIG. 4 is a diagram showing an example of a display screen in a user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device according to the embodiment. FIG. 2 is a diagram showing an example of a display screen in the collection determination device according to the present embodiment. 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. FIG. 11 is a block diagram showing an example of the configuration of a collection determination device according to a second embodiment of the present invention. 10 is a flowchart showing an example of an output process in the collection determination device according to the present embodiment. FIG. 2 is a diagram showing an example of a display screen in the collection determination device according to the present embodiment.

First Embodiment
A first embodiment of the present invention will now be described with reference to the drawings.
FIG. 1 is a system configuration diagram showing an example of the configuration of a collection determination system SYS according to a first embodiment of the present invention.
The recycling determination system SYS of the present invention includes a recycling determination device 100 and a user terminal device 200.
The collection determination device 100 and the user terminal device 200 are connected via a network so as to be able to communicate with each other.

The recall determination system SYS is a system that stores information about recalled items, acquires recalled item images that represent images of the recalled items, and determines whether or not the recalled items are recalled items based on the information about the recalled items and the recalled item images.

Products to be collected include products that are subject to recycling, reuse, recall, voluntary recall, and collection of used products. In this embodiment, an example in which the products to be collected are cosmetics will be described. Products to be collected may be any product, such as automobiles, electrical appliances, stationery, furniture, consumables, and food.

Information about recalled items is information that identifies the recalled items, and is information that associates the JAN code, product name, model number, color, manufacturer name, and image of the recalled item with each recalled item. Information about recalled items may be information about the stock keeping unit (SKU) that is subdivided by product size, design, color, etc., the condition of the recalled items, such as the presence and degree of dirt or damage, and information about the remaining contents of the recalled items.

The images of the recalled items include at least one of images of the recalled items in an unused state, images of the recalled items in a state of being in use (also referred to as a state in which use has been discontinued or a state in which the recalled items have been partially used), and images of the recalled items in a used state. The images of the recalled items may be images that include part or all of the recalled items, images of the recalled items photographed from different angles, images of the recalled items depending on the status of the recalled items, such as the presence and degree of dirt or damage, images of the recalled items including remaining contents, etc.

A recalled product is a product that is about to be recalled, i.e., a product that is in the possession of a user and will be recalled in the future. In other words, a recalled product is a product that may be about to be recalled, i.e., a product that is in the possession of a user and will be determined to be a recalled product or not.

The collected item image is an image of the collected item photographed (scanned) by the user. The collected item image may be a still image or a moving image.

The user terminal device 200 is a terminal device such as a smartphone or a tablet terminal. The user terminal device 200 launches an application or connects to a website by reading a two-dimensional code such as a QR code (registered trademark) attached to a collection kit KIT distributed to or purchased by a user. The user terminal device 200 also takes an image of the collection item, and if the collection item corresponds to a collection target item, inputs additional information and a questionnaire. The additional information is the user's gender, date of birth, email address, etc. The additional information may be the user's age, address, name, telephone number, identification document, etc.

The collection determination device 100 accepts a collection request for a collection item when the two-dimensional code is read by the user terminal device 200. Specifically, the collection determination device 100 acquires an image of the collection item from the user terminal device 200. The collection determination device 100 refers to information about the collection item stored in the device to determine whether or not the collection item in the collection item image is a collection item. If the collection item is a collection item, the collection determination device 100 accepts a collection request for the collection item by having the user input additional information.

In this way, the collection determination system SYS can efficiently collect items that are subject to collection. It can also determine whether an item is subject to collection before it is collected. Even if the item does not have a JAN code or the like attached, it can determine whether the item is subject to collection, thereby improving user convenience.

Next, the configuration of the collection determination device 100 will be explained.

FIG. 2 is a block diagram showing an example of the configuration of the collection determination device 100 according to this embodiment.
The collection determination device 100 is configured to include a communication unit 11, a storage unit 12, an input unit 13, an output unit 14, and a control unit 15.
The communication unit 11 has a function of communicating with the user terminal device 200 via wired or wireless communication. The communication unit 11 outputs various information received from the user terminal device 200 to the control unit 15. The communication unit 11 also transmits various information output from the control unit 15 to the user terminal device 200.

The storage unit 12 is configured with a storage medium, for example, a hard disk drive (HDD), a flash memory, an electrically erasable programmable read only memory (EEPROM), a random access read/write memory (RAM), a read only memory (ROM), or any combination of these storage media.
The storage unit 12 may be, for example, a non-volatile memory.

The memory unit 12 stores various data. For example, the memory unit 12 stores recall target item data 121, recall request data 122, questionnaire data 123, and a learning model 124.

Recovery item data 121 is information about items that are subject to recovery.

Collection request data 122 is information on a collection request. The information on a collection request includes an image of a collection item, additional information, a collection list, and judgment information. The judgment information is information in which an image of a collection item, a collection item candidate, a flag, and a selection result are associated with each other. The collection list, collection item candidate, flag, and selection result will be described later.

The survey data is for each item to be recalled. The survey data includes information such as the connection destination of the survey response site and the survey items. The survey data may also be for each classification such as the type or manufacturer of the item to be recalled.

The learning model 124 is a learning model that is generated by learning the correspondence between images of recalled items and information indicating whether the item is recalled or not. When an image of a recalled item is input, the learning model 124 outputs information indicating whether the item is recalled or not.

The input unit 13 is an input device such as a mouse or keyboard that is connected to the collection determination device 100. The input unit 13 accepts operation input input from the outside. The input unit 13 outputs an operation signal corresponding to the operation input to the control unit 15.

The output unit 14 is an output device such as a display device. The output unit 14 outputs the presentation information output from the control unit 15 to the output device or to another device such as the user terminal device 200.

The control unit 15 has a function of controlling each part of the collection determination device 100 .
The control unit 15 includes a collection request acquisition unit 151 , a target product determination unit 152 , a questionnaire presentation unit 153 , and a learning unit 154 .

When the two-dimensional code is read by the user terminal device 200, the collection request acquisition unit 151 accepts a connection to its own device by performing user authentication, such as logging in or, if not registered, registering an account.

The target item determination unit 152 determines whether or not a collection item is a collection item.
The target product determining unit 152 will be described more specifically.
The target product determining unit 152 includes an image acquiring unit 1521 , a candidate extracting unit 1522 , a candidate presenting unit 1523 , and a collection receiving unit 1524 .

The image acquisition unit 1521 acquires collected item images from the user terminal device 200. The image acquisition unit 1521 outputs the acquired collected item images to the candidate extraction unit 1522.

When a recovery product image is input, the candidate extraction unit 1522 determines whether the recovery product image is appropriate. Specifically, the candidate extraction unit 1522 determines whether the recovery product image is appropriate based on whether the recovery product image is of a quality that meets or exceeds a predetermined condition. The predetermined condition is a condition for determining whether the recovery product image can be used to determine whether the recovery product image is a recovery product, such as the resolution and image quality of the recovery product image. If the recovery product image is below the predetermined condition, the candidate extraction unit 1522 causes the image acquisition unit 1521 to reacquire the recovery product image. On the other hand, if the recovery product image meets or exceeds the predetermined condition, the candidate extraction unit 1522 uses the recovery product image to extract candidates for recovery products corresponding to the recovery product. Specifically, the candidate extraction unit 1522 inputs the recovery product image into the learning model 124 stored in the memory unit 12 to extract one or more candidates for recovery products corresponding to the recovery product. The candidate extraction unit 1522 outputs information on the extracted one or more candidates for collection items to the candidate presentation unit 1523. On the other hand, if the candidate extraction unit 1522 cannot extract one or more candidates for collection items corresponding to the collection item, it obtains information on the collection item from the collection item data stored in the storage unit 12 and outputs the information to the candidate presentation unit 1523. The information on the collection item is, for example, information such as the product name, manufacturer name, color, and model number of the collection item.

When the candidate presentation unit 1523 receives information on one or more candidate collection items from the candidate extraction unit 1522, it generates a presentation image that presents images of one or more collection items included in the information on the one or more candidate collection items in order of highest degree of match, and outputs the image to the user terminal device 200. When the candidate presentation unit 1523 receives information on collection items from the candidate extraction unit 1522, it generates a presentation image that prompts the user to reacquire the collection item image or to select which collection item is to be collected from the information on the collection item, and outputs the image to the user terminal device 200. The candidate presentation unit 1523 receives from the user terminal device 200 the user's selection result for the presentation image that prompts the user to select which collection item is to be collected from the information on the collection item. The candidate presentation unit 1523 outputs the selection result to the collection reception unit 1524.

The collection reception unit 1524 generates a collection list that associates the collection item image with the collection item data of the selected collection item candidate based on the selection of one or more collection item candidates corresponding to the collection item as the collection item, and stores the collection list in the storage unit 12 as collection request data. The collection reception unit 1524 also acquires additional information from the user terminal device 200, associates the additional information with the collection list, and stores the collection list in the storage unit 12 as collection request data.

The collection reception unit 1524 presents one or more candidate items for collection, and based on the user's reacquisition of the collection item image, associates the image of the collection item before reacquisition with information on one or more candidate items for collection, and a reacquisition flag, and stores them as collection request data in the memory unit 12.

The collection reception unit 1524 presents one or more candidates for collection items, and based on the user's selection of which item is to be collected from the information of the collection items, associates an image of the collection item with the selection result and a no candidate flag, and stores them in the storage unit 12 as collection request data, and generates a collection list that associates the image of the collection item with the selection result, and stores it in the storage unit 12 as collection request data. The collection reception unit 1524 also obtains additional information from the user terminal device 200, associates the additional information with the collection list, and stores it in the storage unit 12 as collection request data.

When a collection item image is determined to be inappropriate a predetermined number of times, for example, multiple times, for example, three or more times, and the user selects which item is to be collected from the information of the items to be collected, the collection reception unit 1524 associates the latest inappropriate collection item image with the selection result and an inappropriate collection item image flag, and stores them as collection request data in the storage unit 12, and generates a collection list that associates the latest inappropriate collection item image with the selection result, and stores them as collection request data in the storage unit 12. The collection reception unit 1524 also acquires additional information from the user terminal device 200, associates the additional information with the collection list, and stores them as collection request data in the storage unit 12.

The questionnaire presentation unit 153 reads out the questionnaire data from the storage unit 12 and generates a presentation image that prompts the user to answer the questionnaire based on the fact that the target product determination unit 152 has accepted the collection request, i.e., based on the fact that the collection list has been generated and the accompanying information has been acquired. The questionnaire presentation unit 153 outputs the generated presentation image to the user terminal device 200.

The learning unit 154 generates a learning model by learning the correspondence between images of collection items and information indicating whether the item is collection item, using the images of collection items and information indicating whether the item is collection item as a data set. The learning unit 154 stores the generated learning model in the storage unit 12. Here, when an image of a collection item is input, the learning model generated by the learning unit 154 outputs information indicating whether the item is collection item.
In addition, the learning unit 154 reinforces learning of the learning model 124 stored in the memory unit 12 based on collection request data in which the latest inappropriate collection item image stored in the memory unit 12 is associated with the selection result and an inappropriate collection item image flag, collection request data in which the collection item image is associated with the selection result and a no candidate flag, and collection request data in which the collection item image before re-acquisition is associated with information on one or more candidate collection items and a re-acquisition flag.

Next, we will explain the collection request processing in the user terminal device 200.

FIG. 3 is a flowchart showing an example of a collection request process in the user terminal device 200 according to this embodiment.
In step S101, the user terminal device 200 acquires a two-dimensional code attached to a collection kit by having the user read the two-dimensional code when the user receives the collection kit. Then, the user terminal device 200 executes the process of step S102.

In step S102, the user terminal device 200 launches a web application based on the two-dimensional code. The user terminal device 200 then executes the process of step S103.

In step S103, the user terminal device 200 connects to the collection determination device 100 and performs user authentication by having the user create an account or log in. The user terminal device 200 then executes the process of step S104.

In step S104, the user terminal device 200 prompts the user to request collection of the collected items. The user terminal device 200 then executes the process of step S105.

In step S105, the user terminal device 200, based on the completion of the collection request for the collection items, for example, places the collection items in the collection kit and causes the collection kit (collection items) to be shipped to the user. After that, the user terminal device 200 ends the collection request process in FIG. 3.
In addition, the user may send the collected items without using the collection kit distributed to or purchased by the user, and may use any means by which collected items can be sent, such as mail, courier service, etc.

Next, we will explain the collection determination process in the collection determination device 100.

FIG. 4 is a flowchart showing an example of the collection determination process in the collection determination device 100 according to this embodiment.
In step S201, the collection determination device 100 acquires a collection item image from the user terminal device 200. After that, the collection determination device 100 executes the process of step S202.

In step S202, the collection determination device 100 determines whether the collected item image is appropriate. Specifically, the collection determination device 100 determines whether the collected item image is of a quality that meets or exceeds a predetermined condition. If the collected item image meets or exceeds the predetermined condition (step S202 YES), the collection determination device 100 executes the process of step S203. On the other hand, if the collected item image is of a quality that falls below the predetermined condition (step S202 NO), the collection determination device 100 executes the process of step S213.

In step S203, the recycling determination device 100 extracts one or more candidates for recycling items that correspond to the recycling item image. The recycling determination device 100 causes the user terminal device 200 to present to the user one or more candidates for recycling items that correspond to the extracted recycling item image.

In step S204, the collection determination device 100 determines whether or not the user's selection result for one or more collection candidate items corresponding to the collection image has been acquired from the user terminal device 200. If the user's selection result for one or more collection candidate items corresponding to the collection image has been acquired from the user terminal device 200, i.e., if a collection candidate item has been selected (step S204 YES), the collection determination device 100 executes the process of step S205. On the other hand, if the user's selection result for one or more collection candidate items corresponding to the collection image has not been acquired from the user terminal device 200, i.e., if a collection candidate item has not been selected (step S204 NO), the collection determination device 100 executes the process of step S208.

In step S205, the collection determination device 100 generates a collection list that associates the collection item image with the user's selection results for one or more collection item candidates that correspond to the collection item image. The collection determination device 100 then executes the process of step S206.

In step S206, the collection determination device 100 acquires additional information from the user terminal device 200. After that, the collection determination device 100 executes the process of step S207.

In step S207, the recycling determination device 100 completes the receipt of the recycling request and ends the recycling determination process shown in FIG. 4.

In step S208, the collection determination device 100 accepts a selection according to a user operation as to whether or not to reacquire the collected item image. If the user selects to reacquire the collected item image (step S208 YES), the collection determination device 100 executes the process of step S209. On the other hand, if the user does not select to reacquire the collected item image (step S208 NO), or if the user selects which item is the collected item from the information of the item to be collected, the collection determination device 100 executes the process of step S210.

In step S209, the collection determination device 100 stores the collection item image, one or more collection item candidates corresponding to the collection item image, and a reacquisition flag in the memory unit 12. After that, the collection determination device 100 executes the process of step S201.

In step S210, the recycling determination device 100 generates a presentation image that allows the user to select, for example in a pull-down format, which of the items is to be recycled based on the information on the items to be recycled, and allows the user to select it via the user terminal device 200. After that, the recycling determination device 100 executes the process of step S211.

In step S211, the collection determination device 100 determines whether or not a selection result indicating that the user has selected which item is to be collected from the information on the collection items has been acquired. If the user has selected which item is to be collected from the information on the collection items (step S211 YES), the collection determination device 100 executes the process of step S212. On the other hand, if the user has not selected which item is to be collected from the information on the collection items (step S211 NO), the collection determination device 100 ends the collection determination process shown in FIG. 4.

In step S212, the collection determination device 100 stores in the memory unit 12 the collection item image, a selection result indicating which item is selected by the user from the information of the collection target items, and a no candidate flag. The collection determination device 100 then executes the process of step S205.

In step S213, the collection determination device 100 determines whether the number of times the collection item image has been determined to be inappropriate is three or more. If the number of times the collection item image has been determined to be inappropriate is three or more (step S213 YES), the collection determination device 100 executes the process of step S214. On the other hand, if the number of times the collection item image has been determined to be inappropriate is less than three (step S213 NO), the collection determination device 100 executes the process of step S201.

In step S214, the recycling determination device 100 generates a presentation image that allows the user to select, for example in a pull-down format, which of the items is to be recycled based on the information on the items to be recycled, and allows the user to select it via the user terminal device 200. After that, the recycling determination device 100 executes the process of step S215.

In step S215, the collection determination device 100 determines whether or not a selection result indicating that the user has selected which item is to be collected from the information on the collection items has been acquired. If the user has selected which item is to be collected from the information on the collection items (step S215 YES), the collection determination device 100 executes the process of step S216. On the other hand, if the user has not selected which item is to be collected from the information on the collection items (step S215 NO), the collection determination device 100 ends the collection determination process shown in FIG. 4.

In step S216, the collection determination device 100 stores in the memory unit 12 the latest inappropriate (inappropriate) collection item image, a selection result indicating which item is selected by the user from the information of the collection items, and an inappropriate (inappropriate) collection item image flag. The collection determination device 100 then executes the process of step S205.

Next, we will explain examples of images displayed on the user terminal device 200.

FIG. 5 is a diagram showing an example of a display screen in the user terminal device 200 according to this embodiment. FIG. 6 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 7 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 8 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 9 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 10 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 11 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 12 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 13 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 14 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment. FIG. 15 is a diagram showing another example of a display screen in the user terminal device 200 according to this embodiment.

The example shown in FIG. 5 is an example of a presentation image displayed on the user terminal device 200 when the user reads the two-dimensional code attached to the collection kit with the user terminal device 200 and logs in/registers an account. In the example shown, a "request collection" operator and an "inquiry" operator are displayed as selectable controls. In the example shown, when the "request collection" operator is selected by the user, a transition to the example display image shown in FIG. 6 is displayed. Also, in the example shown, when the "inquiry" operator is selected by the user, a transition to the example display screen shown in FIG. 15 is displayed.

The example shown in FIG. 6 is displayed when the "Request collection" operator is operated in FIG. 5. In the illustrated example, a message instructing the user to "Register collection item", the "+Register collection item" operator, and the "Proceed to basic information input" operator are displayed. Note that in the illustrated example, since no collection items have been registered, the "Proceed to basic information input" operator is displayed as unselectable. In the illustrated example, when the "+Register collection item" operator is selected, the display transitions to the example display screen shown in FIG. 7.

The example shown in FIG. 7 is displayed when the "+ Register collection item" operator is selected in FIG. 6. In the example shown, an icon encouraging image capture, a warning message "Caution - Products not subject to collection cannot be determined. - Even if a product is subject to collection, automatic determination may fail. If the determination is unsuccessful, please scan again. - If scanning fails three consecutive times, it will switch to manual registration," a "Cancel" operator, and a "Scan" operator are displayed. In the example shown, when the "Cancel" operator is selected, the display screen example shown in FIG. 6 is displayed. In the example shown, when the "Scan" operator is selected, a scanned (photographed) image of the collection item is displayed in the display area of the icon encouraging image capture.

If the "Scan" button is selected and the image of the item being collected is not appropriate, a notification message stating "Determination failed. Please scan again" will be displayed in the display area of the icon that prompts you to obtain an image, as shown in Figure 8.

Here, when the "scan" operator is selected, if the collected item image is appropriate, the scanned (photographed) collected item image is displayed in the display area of the icon that prompts image acquisition, as shown in FIG. 9. Also, in the example shown in FIG. 9, one or more candidates for collected items corresponding to the collected item image are displayed in the display area of the "candidate list". In the illustrated example, one or more candidates for collected items corresponding to the collected item image are displayed in order of the degree of match from the left. Also, in the illustrated example, for example, the candidate for collected items with the highest degree of match is displayed in a provisionally selected state in the "candidate list". Also, in the illustrated example, the "product name" corresponding to the provisionally selected candidate for collected items is displayed as "XXX eye shadow △□△□". In the illustrated example, the provisional selection can be changed by selecting any image of the candidate for collected items. Here, when the "add to list" operator is selected, the provisionally selected candidate for collected items is confirmed and registered in the collected item list as shown in FIG. 11. Also, when the "If there is no corresponding product in the candidates>" operator is selected, the display screen example shown in FIG. 10 is displayed. When the "Rescan" control is selected, the display screen changes to the example shown in Figure 7.

The example shown in FIG. 10 is an example of a display screen that is displayed when the "If no corresponding product is found in the candidates>" operator is selected. The example shown is an example of a display screen that allows the user to manually select, for example in a pull-down format, which item is to be collected from the information on the item to be collected. "Product name" displays the product name of the collected item in a pull-down format so that the information on the item to be collected can be selected in the selection window. "Color" displays the color of the collected item that corresponds to the "product name" of the collected item in a pull-down format so that the information on the item to be collected can be selected in the selection window. The area at the bottom of the "Color" selection window displays an image of the collected item that corresponds to the "product name" and "color" selected by the user in the selection window.

The example shown in FIG. 11 is an example of when a list of collected items is displayed. In the illustrated example, for example, in the examples shown in FIG. 9 and FIG. 10, an "Add to list" operator is selected to add collected items to the list shown in FIG. 11. Here, in the illustrated example, operators that allow each item to be edited, for example, an icon for deleting collected items registered in the collection list, are displayed. Also, in the illustrated example, a "+ Register collected item" operator and a "Proceed to basic information input" operator are displayed as selectable operators. When the "+ Register collected item" operator is selected, the display screen transitions to the example shown in FIG. 7. When the "Proceed to basic information input" operator is selected, the display screen transitions to the example shown in FIG. 12.

The example shown in FIG. 12 is an example of a display screen that is displayed when the "Proceed to basic information input" operator is selected in FIG. 11. This display screen example is an example of a display screen that allows the user to input basic information (additional information). In the example shown, a selection window in which "gender" can be selected, a selection window in which "age" can be selected, an input window for inputting an "email address", and an input window for "email address (confirmation)" for confirming and inputting the "email address" are displayed. Also, in the example shown, a "Back" operator and a "Proceed to confirmation screen" operator are displayed as selectable operators. When the "Back" operator is selected, the display screen example shown in FIG. 11 is displayed. When the "Proceed to confirmation screen" operator is selected, the display screen example shown in FIG. 13 is displayed.

The example shown in FIG. 13 is an example of a display screen that is displayed when the "Proceed to confirmation screen" operator is selected in the example shown in FIG. 12. In the example shown, the basic information entered in FIG. 12 and the list of collected items shown in FIG. 11 are displayed so that they can be confirmed. In the example shown, a "Back" operator and an "Apply with the above details" operator are displayed so that they can be selected. When the "Back" operator is selected, the display screen transitions to the example shown in FIG. 12. When the "Apply with the above details" operator is selected, the display screen transitions to the example shown in FIG. 14.

The example shown in FIG. 14 is an example of a display screen that is displayed when the "Apply with the above details" operator is selected in FIG. 13. In the example shown, a message is displayed indicating completion of the application, stating "Your application has been completed. Please check the completion email that you have received. Please answer the questionnaire." Also, in the example shown, the "Survey (external site)" operator and the "Return to TOP" operator are displayed as selectable operators. When the "Survey (external site)" operator is selected, the screen transitions to the survey response site. When the "Return to TOP" operator is selected, the screen transitions to the example display screen shown in FIG. 5.

The example shown in FIG. 15 is an example of a display screen that is displayed when the "Inquiry" operator is selected in FIG. 5. In the illustrated example, an "Email address" input window, a "Category" selection window that indicates the category of the inquiry, and an "Inquiry content" input window are displayed. In the illustrated example, the "Send" operator is also displayed as selectable. When the "Send" operator is selected, the input/selected content is sent to the collection assessment device 100.

Next, we will explain an example of the display screen of the collection assessment device 100.

Fig. 16 is a diagram showing an example of a display screen in the collection determination device 100 according to this embodiment. Fig. 17 is a diagram showing another example of a display screen in the collection determination device 100 according to this embodiment. Fig. 18 is a diagram showing another example of a display screen in the collection determination device 100 according to this embodiment. Fig. 19 is a diagram showing another example of a display screen in the collection determination device 100 according to this embodiment. Fig. 20 is a diagram showing another example of a display screen in the collection determination device 100 according to this embodiment.

16 shows an example of a display screen that can be confirmed by the administrator of the collection assessment device 100 in the collection assessment device 100. The example shown is an example of a display screen in which collection requests for collection items received by the collection assessment device 100 from the user terminal device 200 are displayed in a list. Each record in the list display is generated by the user terminal device 200 making a collection request for collection items as in the examples shown in FIGS. 5 to 14. In the example shown, the "application date", "application ID", "quantity" of collection items, "received status" of collection items, "receipt registration date" of collection items, "gender" of the user, "age" of the user, and the like are displayed. The "application date" is the date on which the collection request for collection items was generated. The "application ID" is identification information that identifies the collection request for collection items. The "received status" is information that indicates whether the collection request for collection items is "unreceived" or "received". In the example shown, when each record is selected, the display screen transitions to an example of a display screen in which the collection request for collection items corresponding to the record is displayed in detail.

The example shown in FIG. 17 is an example of a detailed display screen that is displayed by selecting the records "Application Date" "YYYY/MM/DD", "Application ID" "123456789", "Quantity" "5", "Receipt Status" "Not received", "Receipt Registration Date" "-", "Gender" "Male", and "Age" "24" in the list display shown in FIG. 16. The display area for "Basic Information" includes display areas for "Application Date", "Application ID", "Receipt Status", "Gender", "Age", and "Receipt Registration Date". The display area for "Receipt Registration Image" displays an image of the received collection item, an image of the received collection kit, and the like. Here, the "Receipt Registration Image" is, for example, an image obtained by photographing at least one of the collection item and the collection kit received by the administrator when the administrator receives the collection item placed in the collection kit dispatched by the user. The display area for "Collection Item List" displays the collection items registered in the collection request. The display area for the "Collected Goods List" includes display areas for "No.", which is identification information for identifying the collected item; "Registered Image," which is an image of the collected item; "Category" of the collected item; "Item Name" of the collected item; "Color" of the collected item; and "Material," which is the main material of the collected item. The display area for the "Collected Goods List" may also display the contents and material of each component that makes up the collected item. For example, if the collected item is eye shadow, in addition to the contents (colorant) of the eye shadow, the specifications of each component such as the case, lid, plate, brush, etc. (ABS resin, stainless steel, paper, etc.) may be displayed.

The example shown in FIG. 18 is an example of a display screen for reading a two-dimensional code attached to a collection kit received from a user. In the example shown, the administrator selects the "code reading" operator, which starts reading the two-dimensional code. In addition, in the example shown, when the two-dimensional code is read, the display screen shown in FIG. 17 is displayed, and a display image including the character string "Do you want to register receipt?" and a "Yes" operator and a "No" operator is displayed in a pop-up depending on a user operation, such as a selection operation, for the "receipt registration" operator on the display screen shown in FIG. 17. When the "Yes" operator is selected in the pop-up display, the "receipt status" in the example display screen shown in FIG. 18 is changed to "received", and the "date" on which the administrator read the two-dimensional code is entered in the "receipt registration date".

The example shown in FIG. 19 is an example of a display screen that displays items eligible for recall that are registered in the recall item data.

The example shown in FIG. 20 is an example of a display screen on which the administrator can confirm collection request data in which the latest inappropriate collection item image stored in the memory unit 12 is associated with the selection result and an inappropriate collection item image flag, collection request data in which the collection item image is associated with the selection result and a no candidate flag, and collection request data in which the collection item image before reacquisition is associated with information on one or more candidate items to be collected and a reacquisition flag. In this example of the display screen, the administrator confirms and modifies each collection request data, and the confirmed and modified collection request data is used for reinforcement learning.

As described above, the collection judgment system SYS according to this embodiment includes a memory unit 12 that stores information about collection items to be collected, an acquisition unit (image acquisition unit 1521) that acquires collection item images that represent images of the collection items to be collected, and a judgment unit (collection reception unit 1524) that judges whether or not a collection item is a collection item based on the information about the collection item and the collection item image.

In this way, the collection determination system SYS can efficiently collect items that are subject to collection. It can also determine whether an item is subject to collection before it is collected. Even if the item does not have a JAN code or the like attached, it can determine whether the item is subject to collection, thereby improving user convenience.

In addition, in the above-mentioned recycling determination system SYS, the information regarding the recycling target item includes at least one of an image showing the recycling target item in a used state and an image showing the recycling target item in a state where use has been discontinued.

In this way, the collection determination system SYS can determine whether a collection item is eligible for collection based on images of the item in an unused state, an image of the item in a state in which it is in use (also referred to as a state in which it has ceased use or is partially used), an image of the item in a used state, and an image of the collection item, thereby improving the accuracy of the determination.

In addition, in the above-mentioned recall judgment system SYS, the judgment unit (recall reception unit 1524) judges whether or not an item is a recall item by inputting the recall item image into a learning model 124 that has learned the correspondence between at least one of an image showing a used state of a recall item and an image showing a state in which the use of a recall item has been discontinued, and information indicating whether or not the item is a recall item.

In this way, the recycling determination system SYS can accurately determine whether or not a recycling item is eligible for recycling.

The recycling determination device 100 according to this embodiment also includes a memory unit 12 that stores information about the recycling target items to be recycled, an acquisition unit (image acquisition unit 1521) that acquires a recycling target item image that represents an image of the recycling target item to be recycled, and a determination unit (recycling reception unit 1524) that determines whether or not the recycling target item is a recycling target item based on the information about the recycling target item and the recycling target item image.

In this way, the recycling determination device 100 can efficiently collect items to be recycled. It can also determine whether an item to be recycled is an item to be recycled before it is recycled. Even if the item to be recycled does not have a JAN code or the like attached, it can determine whether the item to be recycled is an item to be recycled, thereby improving user convenience.

Second Embodiment
A second embodiment of the present invention will now be described with reference to the drawings.
In the second embodiment, an example of visualizing the collection status in the collection of a collection target product will be described. In the second embodiment, the difference from the first embodiment will be mainly described, and the description of the other parts will be omitted by citing the description of the first embodiment. Here, the collection determination device 100 according to the second embodiment is suitable for the case where the collection product is used for reuse or recycling, but is not limited thereto.

FIG. 21 is a block diagram showing an example of the configuration of a collection determination device 100 according to the second embodiment of the present invention.
The collection determination device 100 is configured to include a communication unit 11, a storage unit 12, an input unit 13, an output unit 14, and a control unit 15.
The control unit 15 includes a collection request acquisition unit 151, a target product determination unit 152, a questionnaire presentation unit 153, a learning unit 154, and an output information generation unit 155. The target product determination unit 152 includes an image acquisition unit 1521, a candidate extraction unit 1522, a candidate presentation unit 1523, and a collection acceptance unit 1524.

The output information generating unit 155 generates output information at a predetermined cycle, for example. The predetermined cycle may be every two hours, every day, every week, every month, or every time a receipt of a collection item is registered. Specifically, the output information generating unit 155 compiles statistics on the amount of collection items that have been collected or are scheduled to be collected for each predetermined category, and the amount of collection items that have been collected or are scheduled to be collected for each material of the collection items, based on the collection request data 122 stored in the storage unit 12. The predetermined category may be, for example, for each item to be collected, for each category of items to be collected, for each manufacturer of items to be collected, for each age of the user who has requested collection, or for each gender of the user who has requested collection. The predetermined category may be selectable by the administrator. The output information generating unit 155 generates output information using the statistical results.

The output information generating unit 155 may refer to the collection item data corresponding to the collection items to generate output information used to separate the collection items, such as the sorting method for the collection items, and output information presenting the location and collection location of the collection items from when they are received by the user until they are sent in a collection kit and sorted, or output information presenting the amount of carbon dioxide reduction that would result from the collection items being reused or recycled instead of discarded, taking into account the materials and amounts of the materials to be collected.

Next, we will explain the output process in the collection determination device 100.

FIG. 22 is a flowchart showing an example of an output process in the collection determination device 100 according to this embodiment.
In step S301, the administrator of the collection determination device 100 receives the collected item. After that, the administrator reads the two-dimensional code attached to the collection kit of the collected item, and the collection determination device 100 executes the process of step S302.

In step S302, the collection determination device 100 acquires the two-dimensional code based on the administrator reading the two-dimensional code on the collection kit, and executes receipt registration of the collection item based on the two-dimensional code. After that, the collection determination device 100 executes the process of step S303.

In step S303, the collection determination device 100 generates output information by referring to the collection request data stored in the storage unit 12. Then, the output process in FIG. 22 is terminated.

Next, we will explain an example of the output information display screen.

FIG. 23 is a diagram showing an example of a display screen in the collection determination device 100 according to this embodiment.
In the illustrated example, a display area for "Collection amount (daily cumulative)", a display area for "Collection amount (monthly cumulative)", a display area for "Collection amount (cumulative)", a display area for "Gender", and a display area for "Amount of cosmetics collected per age group" are displayed.
In the display area of "Collected amount (daily cumulative)", the collected amount of each material of the collected items is displayed for each day for a predetermined period.
The "collection amount (monthly cumulative)" display area displays the quantity of collected items for the specified month for each material of the items requested to be collected. The "collection amount (monthly cumulative)" display area may also display the quantity of collected items relative to the quantity of items scheduled to be collected for the specified month.
The "collection amount (cumulative)" display area displays the quantity of collected items for each material of the items requested to be collected during the entire period. The "collection amount (cumulative)" display area may display the quantity of collected items relative to the quantity of items scheduled to be collected during the entire period.
The "gender" display area displays the gender ratio of users who have made collection requests.
The display area for "amount of collected cosmetics per age group" displays the amount of collected products by category of collected products for each age group of users who have made collection requests.

In addition to the above-mentioned "amount collected" and "gender," the display screen of the recycling assessment device 100 may also display, for example, location information and collection locations of collected items from the time the user accepts the collected items until they are sent in a collection kit and sorted, or may display the amount of carbon dioxide reduction that would result from the collected items being reused or recycled rather than discarded, taking into account the material and amount of the collected items.

As described above, the collection judgment system SYS according to this embodiment includes a memory unit 12 that stores information about collection items to be collected, an acquisition unit (image acquisition unit 1521) that acquires collection item images that represent images of the collection items to be collected, and a judgment unit (collection reception unit 1524) that judges whether or not a collection item is a collection item based on the information about the collection item and the collection item image.

In this way, the recycling determination system SYS can efficiently collect items subject to recycling. It can also determine whether an item is subject to recycling before it is collected. Even if the item does not have a JAN code or the like attached, it can be determined whether the item is subject to recycling, improving user convenience. It can also prevent secondary distribution of cosmetics and other items subject to recycling at auctions, flea markets, and the like, thereby preventing skin problems caused by the use of partially used cosmetics and the like.

In addition, in the above-mentioned recycling determination system SYS, the information regarding the recycling target item includes at least one of an image showing the recycling target item in a used state and an image showing the recycling target item in a state where use has been discontinued.

In this way, the collection determination system SYS can determine whether a collection item is eligible for collection based on images of the item in an unused state, an image of the item in a state in which it is in use (also referred to as a state in which it has ceased use or is partially used), an image of the item in a used state, and an image of the collection item, thereby improving the accuracy of the determination.

In addition, in the above-mentioned recall judgment system SYS, the judgment unit (recall reception unit 1524) judges whether or not an item is a recall item by inputting the recall item image into a learning model 124 that has learned the correspondence between at least one of an image showing a used state of a recall item and an image showing a state in which the use of a recall item has been discontinued, and information indicating whether or not the item is a recall item.

In this way, the recycling determination system SYS can accurately determine whether or not a recycling item is eligible for recycling.

The recycling determination device 100 according to this embodiment also includes a memory unit 12 that stores information about the recycling target items to be recycled, an acquisition unit (image acquisition unit 1521) that acquires a recycling target item image that represents an image of the recycling target item to be recycled, and a determination unit (recycling reception unit 1524) that determines whether or not the recycling target item is a recycling target item based on the information about the recycling target item and the recycling target item image.

In this way, the recycling determination device 100 can efficiently collect items to be recycled. It can also determine whether an item to be recycled is an item to be recycled before it is recycled. Even if the item to be recycled does not have a JAN code or the like attached, it can determine whether the item to be recycled is an item to be recycled, thereby improving user convenience.

The above describes in detail an embodiment of the present invention with reference to the drawings, but the specific configuration is not limited to the above, and various design changes can be made without departing from the spirit of the present invention.

For example, the recycling determination device 100 may provide an incentive to the user based on the user's acquisition of the collected product image and the subsequent shipping of the collected product. The type of incentive may be, for example, points, coupons, prizes, etc. that can be used when purchasing a product related to the collected product. The calculation of the incentive to be provided, such as points, may be based on, for example, the quantity of collected products or the amount of materials of the collected products, or may be calculated by any means.
The progress status information regarding the collection of the collected items may include, for example, the timing of the awarding of incentives, such as the scheduled delivery date of the prize, and may be made visible to the user by notifying the user.
In this way, by providing incentives to users, for example, it is possible to prevent the disposal of discontinued or partially used products and to increase the collection rate of such products, thereby contributing to the formation of a recycling-oriented society.

For example, in the above-described embodiment, an example configured with the collection determination device 100 has been described, but one aspect of the present invention may be realized by multiple devices including other devices that can realize part of the collection determination device 100.

The program that runs on the recovery determination device 100 in one aspect of the present invention may be a program that controls one or more processors such as a CPU (Central Processing Unit) to realize the functions shown in the above-mentioned embodiments and modified examples related to one aspect of the present invention (a program that makes a computer function). The computer here also includes a quantum computer. The information handled by each of these devices is temporarily stored in a RAM (Random Access Memory) during processing, and then stored in various storage devices such as a flash memory or a HDD (Hard Disk Drive), and may be read, modified, and written by the CPU, etc. as necessary.

In addition, a part or all of the collection determination device 100 in each of the above-mentioned embodiments and variations may be realized by a computer having one or more processors. In that case, the program for realizing this control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to realize the control function.

The "computer system" referred to here is the computer system built into the collection assessment device 100, and includes hardware such as the OS and peripheral devices. Also, the "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into the computer system.

Furthermore, "computer-readable recording medium" may also include something that dynamically holds a program for a short period of time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, or something that holds a program for a certain period of time, such as volatile memory inside a computer system that serves as a server or client in such a case. The above program may also be one that realizes part of the functions described above, or one that can realize the functions described above in combination with a program already recorded in the computer system.

In addition, part or all of the recycling determination device 100 in each of the above-mentioned embodiments and modifications may be realized as an LSI, which is typically an integrated circuit, or may be realized as a chip set. Furthermore, each functional block of the recycling determination device 100 in each of the above-mentioned embodiments and modifications may be individually formed into a chip, or part or all may be integrated into a chip. Furthermore, the integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit and/or a general-purpose processor. Furthermore, if an integrated circuit technology that can replace LSI appears due to advances in semiconductor technology, it is also possible to use an integrated circuit based on that technology.

Although the above describes in detail each embodiment and modification as one aspect of this invention with reference to the drawings, the specific configuration is not limited to each embodiment and modification, and also includes design changes within the scope of the gist of this invention. Furthermore, various modifications of one aspect of the present invention are possible within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Also included are configurations in which elements described in the above embodiments and modifications are substituted with elements that have the same effect.

Reference Signs List 100 Recycling determination device 11 Communication unit 12 Storage unit 121 Recycling target product data 122 Recycling request data 123 Questionnaire data 124 Learning model 13 Input unit 14 Output unit 15 Control unit 151 Recycling request acquisition unit 152 Target product determination unit 153 Questionnaire presentation unit 154 Learning unit 155 Output information generation unit 1521 Image acquisition unit 1522 Candidate extraction unit 1523 Candidate presentation unit 1524 Recycling reception unit 200 User terminal device SYS Recycling determination system

Claims (6)

A storage unit that stores information regarding a plurality of types of products that may be subject to collection;
An acquisition unit that acquires a collection item image representing an image of a collection item to be collected;
a determination unit that determines whether the collection item is a collection item based on information about the collection item and the collection item image;
Equipped with
The recalled products include products with residual contents ,
The determination unit is
determining whether the item is a recalled item by inputting the recalled item image into a learning model that has learned a correspondence between at least one of an image showing a used state of the recalled item and an image showing a state in which the use of the recalled item has been discontinued and information showing whether the item is a recalled item;
Recovery assessment system. The information on the recalled product includes at least one of an image showing a used state of the recalled product and an image showing a state where use of the recalled product has been discontinued.
The recovery determination system according to claim 1 . The information on the recalled product includes at least one of the product name, model number, and manufacturer name of the recalled product.
The recovery determination system according to claim 1 . A storage unit that stores information regarding a plurality of types of products that may be subject to collection;
An acquisition unit that acquires a collection item image representing an image of a collection item to be collected;
a determination unit that determines whether the collection item is a collection item based on information about the collection item and the collection item image;
Equipped with
The recalled products include products with residual contents ,
The determination unit is
determining whether the item is a recalled item by inputting the recalled item image into a learning model that has learned a correspondence between at least one of an image showing a used state of the recalled item and an image showing a state in which the use of the recalled item has been discontinued and information showing whether the item is a recalled item;
Recovery determination device. A recycling determination method executed by a computer of a recycling determination device,
A storage step of storing information regarding a plurality of types of products that may be subject to collection;
An acquisition step of acquiring a collection item image representing an image of the collection item to be collected;
a determination step of determining whether the collection item is the collection item based on information about the collection item and the collection item image;
having
The recalled products include products with residual contents ,
In the determining step,
determining whether the item is a recalled item by inputting the recalled item image into a learning model that has learned a correspondence between at least one of an image showing a used state of the recalled item and an image showing a state in which the use of the recalled item has been discontinued and information showing whether the item is a recalled item;
Recovery determination method. The computer of the recovery determination device
A storage step of storing information regarding a plurality of types of products that may be subject to collection;
An acquisition step of acquiring a collection item image representing an image of the collection item to be collected;
a determination step of determining whether the collection item is the collection item based on information about the collection item and the collection item image;
Run the command,
The recalled products include products with residual contents ,
In the determining step,
determining whether the item is a recalled item by inputting the recalled item image into a learning model that has learned a correspondence between at least one of an image showing a used state of the recalled item and an image showing a state in which the use of the recalled item has been discontinued and information showing whether the item is a recalled item;
program.

Images