WO2025052671A1 - Management device, management method, and recording medium - Google Patents

Abstract

The management device comprises an antenna control unit, a reading unit, a status identification unit, and an output unit. The antenna control unit controls movement of antennas that can individually move on a rail attached to a shelf. The reading unit uses the antennas to read an RFID tag attached to an article and including information that can identify the article. The status identification unit identifies information indicating the display status of the article on the shelf on the basis of position information of the antenna and the information read from the RFID tag. The output unit outputs information indicating the display status.

Description

Management device, management method, and recording medium

This disclosure relates to a management device, etc.

In recent years, items with RFID (Radio Frequency Identification) tags attached are often stored or displayed on shelves. An RFID reader uses an antenna to manage the storage status, such as the number of items stored on the shelf.

Patent document 1 describes how a scanner including multiple antennas and readers for each shelf level is installed on the shelf, and the scanner moves laterally across the shelf to read the RFID tags attached to the items on each shelf level.

Special Publication No. 2015-510479

By the way, when placing items with RFID tags attached on a shelf to manage the status of the items on the shelf, many antennas may be required.

One example of the objective of this disclosure is to provide a management device or the like that reduces the number of antennas.

In one aspect of the present disclosure, a management device includes:
an antenna control means for controlling movement of antennas which are individually movable on rails attached to the shelf;
A reading means for reading an RFID tag attached to an article, the RFID tag including information capable of identifying the article, by using the antenna;
a situation identification means for identifying information representing a display situation of the items on the shelf based on position information of the antenna and the information read from the RFID tag;
an output means for outputting information representing the display status;
Equipped with.

In one aspect of the present disclosure, a management method includes:
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an item is read, the RFID tag including information that can identify the item;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
Information representing the display status is output.

In one aspect of the present disclosure, a program is provided that includes:
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an item is read, the RFID tag including information that can identify the item;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
Execute the process.

Each program may be stored on a non-transitory computer-readable recording medium.

This disclosure makes it possible to reduce the number of antennas.

FIG. 2 is a first block diagram illustrating a configuration example of a management device according to the present disclosure. This is an example of a shelf. FIG. 13 is an explanatory diagram showing an example in which an antenna is included in a moving part having wheels. FIG. 13 is an explanatory diagram showing an example of a moving part including a rail and an antenna attached to a shelf. 10 is a flowchart illustrating an example of an operation of a management device according to the present disclosure. FIG. 2 is an explanatory diagram showing an example of a connection between a management device and other devices. FIG. 13 is an explanatory diagram showing an example of attaching a position tag. 13 is an explanatory diagram showing an example of attaching a position tag when the antenna is moved in the depth direction of the shelf. FIG. FIG. 2 is an explanatory diagram showing an example of installation of an imaging device. FIG. 11 is an explanatory diagram showing an example in which the imaging device is included in a moving part having wheels. FIG. 11 is an explanatory diagram showing an example in which an antenna and an imaging device are included in a moving part having wheels. FIG. 2 is a second block diagram illustrating a configuration example of a management device according to the present disclosure. FIG. 2 is an explanatory diagram illustrating an example of a shelf allocation DB. FIG. 2 is an explanatory diagram illustrating an example of an antenna DB. FIG. 2 is an explanatory diagram illustrating an example of a position tag DB. FIG. 2 is an explanatory diagram illustrating an example of a product DB. 13 is an explanatory diagram showing an example in which an image of a shelf is displayed together with a notification of detection of a foreign object; FIG. FIG. 11 is an explanatory diagram showing an example of sensor installation. 10 is a flowchart showing an example of the operation of a management device that controls the movement of an antenna in accordance with a detection result by a sensor. 10 is a flowchart showing an example of the operation of a management device that controls an imaging device according to a reading state. FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of a computer.

Below, with reference to the drawings, an embodiment of the management device, management method, program, and non-transitory recording medium for recording the program according to the present disclosure will be described in detail. The disclosed technology is not limited to this embodiment.

In each embodiment, shelves are used as an example of a means for placing items, but this is not limited to shelves. Also, because products are used as an example of items, the status of items on the shelves is referred to as the display status of the items, but this may also be rephrased as the storage status, placement status, etc. For example, the number of items on display may also be rephrased as the number stored, the number placed, etc. Also, the types of items are not particularly limited and may include food, daily necessities, clothing, various materials, etc. Also, although the shelves are described using store shelves as an example, they may also be shelves in a logistics warehouse, etc.

(First embodiment)
1 is a first block diagram showing a configuration example of a management device according to the present disclosure. The management device 10 includes an antenna control unit 101, a reading unit 102, a situation identifying unit 103, and an output unit 104.

The antenna control unit 101 is an example of an antenna control means that controls the movement of an antenna that can move independently on a rail attached to a shelf.

FIG. 2 shows an example of a shelf. The type of shelf is not particularly limited. The shelf may have multiple tiers, for example.

For example, the shelf may be fitted with rails that allow the antenna 11 to move laterally across the shelf. For example, if the antenna 11 is movable laterally, the rails may be attached to the shelf steps. The number of shelves may be one or more. Thus, rails may be attached across multiple shelves, allowing the antenna 11 to move.

Furthermore, for example, a rail may be attached to the shelf, allowing the antenna 11 to move in the depth direction of the shelf.Furthermore, for example, a rail may be attached to the shelf, allowing the antenna 11 to move in the height direction of the shelf.

For example, items with RFID tags attached are placed on shelves. Let's take products as an example of items. There are various methods for attaching RFID tags to products, such as attaching the RFID tag to an accessory of the product, such as the product's price tag, or attaching the RFID tag to the product itself. Here, the RFID tag attached to a product may be called a product tag.

The antenna 11 is also connected to an RFID reader 12 via a cable or the like. The management device 10 is connected to the reader 12 via a communication network or the like. When the management device 10 transmits a read instruction to the reader 12, the reader 12 can read the product tag via the antenna 11. The reader 12 acquires information stored in the RFID tag using radio waves transmitted from the antenna 11 and radio waves transmitted to the antenna 11, and transmits the information to the management device 10. More specifically, the RFID tag may communicate by reflecting a carrier wave from the antenna 11 controlled by the reader 12. The information stored in the RFID tag is carried on this reflected wave. The management device 10 can then read the information stored in the RFID tag by receiving the information stored in the RFID tag.

Here, the type of antenna 11 is not particularly limited, but as long as the antenna 11 is movable, an antenna 11 with a narrow reading range can be used. For example, the antenna 11 may be capable of reading product tags of the same type of product. For example, when there are multiple rows on each level of a shelf, the antenna 11 may be capable of reading product tags of multiple rows in which the same product is displayed. For example, in FIG. 2, multiple rows on each level of a shelf means that there are multiple rows in the horizontal direction.

For example, the antenna 11 may be attached to a moving part that can move on a rail, or the antenna 11 may be integrated into the moving part that can move on a rail as the same device.

FIG. 3 is an explanatory diagram showing an example in which the antenna 11 is included in a moving unit having wheels. The moving unit 13 may have wheels, for example. There is no particular limit to the number of wheels, but in FIG. 3, the moving unit 13 has two wheels. The moving unit 13 can move by rotating the wheels. For example, the moving unit 13 may rotate the wheels by controlling a motor.

In this way, the antenna control unit 101 may control the movement of the antenna 11 by controlling the movement of the moving unit 13 equipped with the antenna 11, which is placed on a rail attached to a shelf.

FIG. 4 is an explanatory diagram showing an example of a moving unit 13 equipped with a rail and an antenna 11 attached to a shelf. A rail is attached to the shelf. The moving unit 13 is attached to the rail. The moving unit 13 moves on the rail. The moving unit 13 is equipped with an antenna 11, and the antenna 11 is connected to a reader 12 by a cable.

For example, if rails are attached to the shelves, the price tags may be attached to the rails so as to hide the moving part 13. Products are displayed on the shelves. Product tags are attached to the products.

The reading unit 102 is an example of a reading means that uses the antenna 11 to read an RFID tag attached to a product that contains information that can identify the product. The product tag may store a product ID (identifier). The product tag ID is an example of product tag identification information that identifies the product tag attached to the product. The product tag may also store product information such as the product name and price.

As a specific reading method, the reading unit 102 reads the information stored in the product tag and transmits a read instruction to the reader 12. The reader 12 then reads the information stored in the product tag via the antenna 11.

The situation identification unit 103 is an example of an identification means that identifies information that represents the display situation of products on a shelf based on the position information of the antenna 11 and information read from the product tag. The position information of the antenna 11 may be estimated based on the amount of movement of the antenna 11, or may be identified by reading an RFID tag to identify the position.

As an example of identifying information representing a display situation, the situation identification unit 103 may identify the number of products displayed on a shelf. Furthermore, for example, the situation identification unit 103 may detect a shortage in which the number of products displayed falls below a predetermined number. For example, the situation identification unit 103 may detect a situation in which the number of products displayed at the front of a shelf falls below a predetermined number.

As another example of identifying information representing the display situation, the situation identification unit 103 may identify that a product different from the shelf allocation is displayed on the shelf. That is, the situation identification unit 103 may determine whether the product assigned to be displayed at the position indicated by the position information of the moved antenna 11 and its surrounding positions is the same as the product identified by the information read from the product tag. For example, if they are different, the situation identification unit 103 can identify that a product different from the shelf allocation is displayed. Also, for example, the situation identification unit 103 may identify product information on the shelf. Product information may be the product name, product expiration date, etc. Product expiration dates include a use-by date, best-before date, and expiry date.

As another example of identifying information representing the display situation, the situation identification unit 103 may identify whether the product to be searched for is located at the position indicated by the position information of the antenna 11 and its surrounding positions, based on the position information of the antenna 11 and information read from the product tag.

The output unit 104 is an example of an output means that outputs information representing the display situation. For example, the output unit 104 may output information representing the display situation when there is a change in the display situation. For example, the output unit 104 may output information representing the display situation when there is an abnormality in the display situation. Examples of cases where there is an abnormality in the display situation include when a product different from the shelf allocation is displayed, when the number of products displayed is below a predetermined number, etc.

Furthermore, for example, the output unit 104 may output time information indicating the reading time in association with information indicating the display status. The output destination of the output unit 104 is not limited to a storage device such as a database, a terminal device, a display device, an audio output device, a lighting device, etc. The terminal device may have a display device, an audio output device, a lighting device, etc. For example, the output unit 104 may display information indicating the display status on a user's terminal device. The user is not limited to a store clerk, a customer, etc. For example, if the output is an instruction to put out products, etc., the user may be a store clerk. For example, if the output is the number of products on display, etc., the user may be a store clerk or a customer.

(flowchart)
5 is a flowchart showing an example of an operation of the management device 10 according to the present disclosure. The antenna control unit 101 controls the movement of the antenna 11 on the rail (step S101). The reading unit 102 reads the product tag (step S102). For example, the situation identification unit 103 identifies information representing the display situation of the products on the shelf (step S103). The output unit 104 outputs the information representing the display situation (step S104).

As described above, rails along which the antennas 11 can move are attached to the shelves, and the management device 10 moves the antennas 11 to read the RFID tags attached to the items placed on the shelves. The management device 10 then manages the display status of the shelves. This makes it possible to reduce the number of antennas 11.

Furthermore, for example, when multiple antennas are moved simultaneously and reading is performed from each of the multiple antennas, the reader switches between reading from the multiple antennas, which may result in reduced reading accuracy. For this reason, if the antenna 11 can be moved independently, the reduction in reading accuracy can be suppressed. However, a configuration in which multiple antennas 11 can be moved simultaneously may also be used.

Second Embodiment
Next, the second embodiment will be described in detail with reference to the drawings. In the second embodiment, an example of identifying the position of the antenna, an example of the timing of moving the antenna, and an example of combining the antenna with other devices will be described. Below, the description of the second embodiment will be omitted to the extent that it does not become unclear.

FIG. 6 is an explanatory diagram showing an example of a connection between a management device and other devices. Here, the management device 20 may be an edge terminal device installed in a store, or may be a server.

For example, the management device 20 is connected to an RFID reader 22 via a communication network. The reader 22 is connected to one or more antennas 21. The reader 22 may be installed as appropriate depending on the size of the store and the performance of the reader 22. The reader 22 may be a dedicated reader or a reader/writer. The antenna 21 and the reader 22 are connected using a cable. Figure 6 shows multiple antennas 21-1 to 21-n. For example, n is an integer equal to or greater than 2. As in the example described in the first embodiment, the antenna 21 may be provided in, for example, the mobile unit 23. Therefore, Figure 6 shows multiple mobile units 23-1 to 23-n.

For example, the management device 20 is connected to the imaging device 24 via a communication network. For example, the management device 20 may be capable of controlling the imaging device 24.

The imaging device 24 may also be installed on, for example, the ceiling of a store. For example, the imaging device 24 may be installed in a position where it can image the shelf. For example, the imaging device 24 may be installed in a position where it can image the shelf from the front. The imaging device 24 may be capable of imaging the shelf by controlling the position, orientation, angle of view, etc., through control by the management device 20. Furthermore, for example, the imaging device 24 may be movable through control by the management device 20. For example, the imaging device 24 may be movable on a rail attached to the facing shelf. This allows the imaging device 24 to image the front of the shelf as seen from the facing shelf side. Also, for example, the imaging device 24 may be movable on a rail attached to the ceiling.

The imaging device 24 may also be installed in a position where it can capture an image of a person standing in front of the shelf. The position, orientation, angle of view, etc. of the imaging device 24 may be controlled by the management device 20, making it possible to capture an image of a person standing in front of the shelf. Furthermore, for example, the imaging device 24 may be movable by the control of the management device 20.

Here, the imaging device 24 capable of capturing an image of the shelf and the imaging device 24 capable of capturing an image of a person standing in front of the shelf may be the same imaging device or may be different imaging devices. Therefore, multiple imaging devices 24 may be installed in the store.

Furthermore, for example, the management device 20 is connected to a terminal device 25 via a communication network. The terminal device 25 is an example of a destination of a notification from the management device 20, and the device to which the notification is sent is not particularly limited. For example, the terminal device 25 may be a user's terminal device 25, or may be a terminal device 25 fixedly installed in a store, and is not particularly limited.

FIG. 7 is an explanatory diagram showing an example of attaching a position tag. In FIG. 7, each of the antennas 21 is an example that can move laterally across three shelves. Here, an RFID tag may be attached to the shelf to identify the position information of the antenna 21. An RFID tag attached to a shelf is also called a position tag. For example, the position tag may be attached in a position where it is easy for the antenna 21 to read. For example, the position tag may be attached near a rail. For example, a proximity tag may be used as the position tag. In FIG. 7, multiple position tags may be attached. The number of position tags is not particularly limited, but may be provided for each row of shelf levels, or may be such that the display position of the product can be identified.

FIG. 8 is an explanatory diagram showing an example of attaching a position tag when moving the shelf in the depth direction. For example, the position tag may be attached above the product. Rails may be attached above the product on the shelf, and the antenna 21 may be movable on the rails and capable of reading the tag in the depth direction. This makes it possible to reduce the number of antennas 21.

Here, for example, the position tag may store a position tag ID for identifying the position tag. Or, for example, the position tag may store position information representing a shelf and a position on the shelf.

FIG. 9 is an explanatory diagram showing an example of the installation of the imaging device 24. For example, the imaging device 24 may be movable on a rail attached near the ceiling. For example, the imaging device 24 may be able to capture images of at least a portion of a plurality of shelves by moving on the rail. In FIG. 9, the imaging device 24 captures an image of, for example, the second shelf from the top of the leftmost shelf, as shown by the dotted line.

FIG. 10 is an explanatory diagram showing an example in which the imaging device 24 is included in a moving unit having wheels. The function of the moving unit 26 may be the same as that of the moving unit 13 shown in FIG. 3, and the moving unit 26 has the imaging device 24. For example, to capture an image of a first shelf of two facing shelves, a rail may be attached to the second shelf of the two shelves, and the imaging device 24 may capture an image of a predetermined range of the first shelf by moving the moving unit 26 on the rail attached to the second shelf. The first shelf is one of the two facing shelves, and the second shelf is the shelf of the two shelves that faces the first shelf.

FIG. 11 is an explanatory diagram showing an example in which the antenna 21 and the imaging device 24 are included in a moving unit 23 having wheels. In FIG. 11, when rails are attached to each of a plurality of shelves, the moving unit 23 may have the antenna 21 and the imaging device 24. The moving unit 23 moves on the rails attached to the shelves, the antenna 21 can read the product tags of the shelves, and the imaging device 24 can capture an image of the facing shelf.

FIG. 12 is a second block diagram showing an example configuration of a management device 20 according to the present disclosure. In FIG. 12, the management device 20 includes an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, a reception unit 205, a position identification unit 206, an imaging device control unit 207, a person detection unit 208, an item detection unit 209, and a determination unit 210.

The antenna control unit 201 may have the function of the antenna control unit 101 shown in FIG. 1 as a basic function. The reading unit 202 may have the function of the reading unit 102 shown in FIG. 1 as a basic function. The situation identification unit 203 may have the function of the situation identification unit 103 shown in FIG. 1 as a basic function. The output unit 204 may have the function of the output unit 104 shown in FIG. 1 as a basic function.

The management device 20 may also have a shelf allocation DB (database) 2001, an antenna DB 2002, a location tag DB 2003, and a product DB 2004.

FIG. 13 is an explanatory diagram showing an example of a shelf allocation DB 2001. The shelf allocation DB 2001 is shelf allocation information related to the display of products on shelves. Specifically, for example, the shelf allocation DB 2001 stores display position information indicating the position of the shelf in association with a product ID that identifies the product. The product ID is an example of product identification information that identifies the product. According to FIG. 13, a product with a product ID of product P01 is displayed on the first level of shelf s1.

For ease of explanation, an example in which identical products are displayed on different levels has been given here, but the same products may be displayed on different shelves, or on different rows of shelves, and there are no particular limitations on the specific examples of shelf layout.

FIG. 14 is an explanatory diagram showing an example of an antenna DB 2002. The antenna DB 2002 is information representing the position of each antenna 21. Specifically, for example, the antenna DB 2002 stores an antenna ID in association with movement range information representing the range within which the antenna 21 identified by the antenna ID can move. For example, the antenna ID is an example of antenna identification information for identifying the antenna 21, and may be an antenna number, etc. The movement range information may be information representing a shelf and a shelf level, etc. In FIG. 14, the movement range is a range in which products on the first level of shelves s1 and s2 can be read.

The antenna DB 2002 may further include initial position information indicating the initial position of the antenna 21. For example, the position of the antenna 21 may be determined based on the amount of movement of the antenna 21 with respect to the initial position.

FIG. 15 is an explanatory diagram showing an example of a position tag DB 2003. The position tag DB 2003 is information related to the attachment position of each position tag. Specifically, for example, the position tag DB 2003 stores a position tag ID in association with information on the position where the position tag is attached. The position tag ID is an example of position tag identification information that identifies the position tag. The position tag ID may be, for example, the serial number of the RFID tag, and is not particularly limited.

For example, the position tag stores a position tag ID that identifies the position tag. The management device 20 can read the position tag ID from the position tag via the antenna 21 and identify the position of the antenna 21 based on the position information associated with the position tag ID.

According to FIG. 15, the position tag identified by position tag T01 is attached to the first level of shelf s1, near the first to second rows.

Figure 16 is an explanatory diagram showing an example of product DB 2004. Product DB 2004 is information related to products. Product tags are attached to individual products. For this reason, product DB 2004 stores product information such as product IDs and product names for each product tag. Specifically, for example, product DB 2004 stores product tag IDs in association with product information such as product IDs and product names. The product tag ID is an example of product tag identification information that identifies the product tag attached to the product. The product ID is an example of product identification information that identifies the product. The product name is the name of the product.

According to FIG. 16, a tag with a product tag ID of tag PT01 is attached to a product with a product ID of product P01. The product name of the product with the product ID of product P01 is xx Cookie.

In addition, the product DB 2004 may also include other product information such as tag information identified by a product tag ID, the price of a product identified by a product ID, the type of product, the expiration date of the product, and the manufacturer of the product.

Here, the product tag may be a tag that corresponds to the material of the product. For example, an RFID tag may communicate by reflecting a carrier wave from an antenna 21 controlled by an RFID reader 22. The information stored in the RFID tag is carried on this reflected wave. Metal or liquid becomes an obstacle to the carrier wave, and radio waves are reflected by such obstacles. For this reason, the reflected wave from the RFID tag and the reflected wave from the obstacle may interfere with each other, making it difficult or easy for the antenna 21 to read the reflected wave from the RFID tag. In this way, an obstacle may cause an abnormal reading. Therefore, for example, a tag with a general frequency adjustment may be used for products that do not become obstacles. For products that contain metal as part of their material, such as canned drinks and canned goods, a metal tag may be used. For example, a metal tag is a tag that is adjusted to have a general frequency when attached to metal. A water tag may be used for products that contain liquid as part of their material, such as plastic bottles and paper cartons that contain liquid. For example, a water tag is a tag whose frequency characteristics are adjusted so that RFID tags can transmit and receive when they are in close proximity to liquids such as water. In order to attach product tags to products, shelf allocation may be performed taking into account the material of the products, etc.

Next, we will explain each functional part in detail.

The antenna control unit 201 controls the movement of the antenna 21, which is movable on a rail attached to a shelf. The movement method is as described in the first embodiment. There is no particular limitation on the timing at which the antenna control unit 201 moves the position of the antenna 21.

The reading unit 202 also reads the product tag using the antenna 21. For example, the reading unit 202 may read the RFID tag while the antenna control unit 201 moves the position of the antenna 21. The reading unit 202 may perform reading continuously or may perform reading one-off. Therefore, the order of the processing by the antenna control unit 201 and the processing by the reading unit 202 is not particularly limited.

As mentioned above, if a position tag is near or attached to the rail, the reading unit 202 further reads the position tag. Specifically, the reading unit 202 transmits an instruction to read the RFID tag to the reader 22, which then reads RFID tags, such as at least one of product tags and position tags, within the reading range of the antenna 21 via the antenna 21. The situation determination unit 203 then determines the display situation of products on the shelf based on the information read from the position tag and the information read from the product tag. Here, an example in which the position of the antenna 21 is determined by the position tag will be described. First, for example, a case will be described in which a position tag ID is stored as information capable of determining the position on the shelf stored in the position tag. When the position tag stores a position tag ID, the position determination unit 206 is an example of a position determination means that determines the position information of the antenna based on the information read from the position tag. For example, if the position tag stores a position tag ID, the position identification unit 206 acquires position information associated with the read position tag ID from the position tag DB 2003. For example, the position identification unit 206 may identify the acquired position information as position information indicating the position of the antenna 21. Here, if multiple position tag IDs are read, the position tag ID read from the position tag with the strongest signal strength may be used.

If the position tag stores the position information itself, indicating the position where the position tag is attached, as information that can identify the position on the shelf, the position information of the antenna can be the position information of the position tag, so there is no need for the position identification unit 206 to perform processing to obtain position information from the position tag DB 2003. Note that if multiple pieces of position information are read, the position information read from the position tag with the strongest signal strength can be used as the position information of the antenna.

Furthermore, an example in which the position of the antenna 21 is identified by the amount of movement of the antenna 21 will be described. The position identification unit 206 is an example of a position identification means that identifies antenna position information from control information for the movement of the antenna 21 by the antenna control unit 201. More specifically, the position identification unit 206 identifies the amount of movement of the antenna 21 in each direction from control information for the movement of the antenna 21 by the antenna control unit 201. For example, the position identification unit 206 may identify position information representing the current position of the antenna 21 based on position information representing the initial position stored in the antenna DB 2002 and the identified amount of movement. The antenna DB 2002 may further store the position information before the movement, and the position identification unit 206 may identify the position information after the movement based on the position information before the movement and the new amount of movement.

For example, when the user moves the antenna 21 to a desired position, if the position of the antenna 21 is specified by a position tag, the reading unit 202 reads the tag while moving the antenna using the antenna control unit 201. On the other hand, if the position of the antenna 21 is specified by the amount of movement of the antenna 21, the reading unit 202 may read the tag after moving the antenna to the desired position, or may read the tag while moving the antenna.

Next, the situation identification unit 203 will be described. As described in the first embodiment, the situation identification unit 203 identifies information representing the display status of products on the shelf based on the position information of the antenna 21 and the information read from the product tag. Specifically, for example, the situation identification unit 203 identifies information representing the display status of products at the position on the shelf indicated by the position information of the antenna 21 based on the position information of the antenna 21 and the information read from the product tag. Note that the position of the antenna 21 also includes positions near the antenna 21. If the product tag stores a product tag ID, the situation identification unit 203 obtains at least one of the product ID and product information associated with the product tag ID from the product DB 2004. This allows the situation identification unit 203 to identify the product displayed at the position of the antenna 21.

Then, the output unit 204 outputs information representing the display status. The output destination and output method of the output unit 204 are as described in the first embodiment.

Next, the processing of the situation determination unit 203 and the output unit 204 will be explained in more detail using the display situation as an example. As explained in the first embodiment, the display situation may be the number of products on display, whether there are any out-of-stock items, whether there are products displayed differently from the shelf layout, or where the product to be searched is displayed. In more detail, the display situation may be whether products are displayed at the back of the shelf and not at the front. In more detail, the display situation may be the expiration date status of the products on display.

First, an example in which the number of displayed items is identified will be described. For example, the situation identification unit 203 may identify the number of displayed items based on the number of item tags that store item tag IDs associated with the same item ID in the item DB 2004. The output unit 204 may then output position information indicating the position of the antenna 21 in association with the number of displayed items. For example, the output unit 204 may superimpose the number of displayed items around the position of the antenna 21 on the shelf image. The shelf image may be an image prepared in advance, or may be a newly captured image as described below. Furthermore, the output unit 204 may output an instruction to put items out when the number of displayed items is equal to or less than a predetermined number. The output unit 204 may output the instruction to put items out together with item information such as the name of the item.

Next, an example in which it is determined that a product different from the shelf allocation is displayed will be described. For example, the situation determination unit 203 may obtain, from the shelf allocation DB 2001, a product ID associated with location information indicating a location that is the same as or close to the location of the antenna 21. The location close to the location of the antenna 21 may be a location within a predetermined range from the location indicated by the location information of the antenna 21. The situation determination unit 203 may compare the product ID determined from the read product tag with the product ID in the shelf allocation. In this way, when the product ID determined from the read product tag does not match the product ID in the shelf allocation, the situation determination unit 203 can determine that a product different from the shelf allocation is displayed. When the product ID determined from the read product tag does not match the product ID in the shelf allocation, the output unit 204 may notify that a product different from the shelf allocation is displayed. In other words, the output unit 204 may output a notification of foreign object detection.

Next, an example in which it is determined that a product is on display in a product search instruction will be described. In the case of product search, the antenna control unit 201 moves the antenna 21 while the reading unit 202 reads via the antenna 21. Then, based on the position information of the antenna 11 and the information read from the product tag, the situation identification unit 203 may determine whether the product to be searched for is located at the position indicated by the position information of the antenna 11 and its surrounding positions. Note that a method for receiving a product search instruction by the reception unit 205 will be described later. A product tag ID may be specified as the search target, or a product ID may be specified. More specifically, as a series of processes for product search, the product tag stores the product tag ID, and when the product tag ID is specified by the user as the product to be searched for, the situation identification unit 203 may determine whether the read product tag ID matches the product tag ID of the product to be searched for. Then, when the product for which a search was instructed is found, i.e., when the read product tag ID matches the product tag ID of the product being searched for, the output unit 204 outputs the location information at the time the product tag ID was read.

The imaging device control unit 207 is an example of an imaging device control means that controls the imaging device 24 that can capture an image of the movement range of the antenna 21 on the shelf. For example, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24 in response to the reading of product information by the antenna 21 to cause the imaging device 24 to capture an image of the shelf. For example, when the situation identification unit 203 identifies the display situation, the imaging device control unit 207 may use the imaging device 24 to capture an image of the shelf. Alternatively, for example, if there is an abnormality in the reading of the product tag by the antenna 21, the imaging device control unit 207 may use the imaging device 24 to capture an image of the shelf. An abnormality in the reading of the product tag by the antenna 21 may be, for example, an abnormality in the display situation as described above.

The imaging device control unit 207 may also move the imaging device 24 to a position where an image of the product can be captured according to the expiration date of the product specified by the information capable of identifying the product read from the product tag by the antenna 21, and use the imaging device 24 to capture an image of the shelf including the product. As an example of capturing an image according to the expiration date of a product, the imaging device control unit 207 may capture an image of the shelf when there is a product whose expiration date is approaching. An item's expiration date is approaching when the difference between the current date and time and the expiration date of the item is within a specified number of days or time. For example, if it is a few days before or on the day of the expiration date of the item, the imaging device control unit 207 captures an image of the shelf including the item using the imaging device 24. This allows the output unit 204 to notify the image of the shelf along with instructions to put the item out, to put it forward, to give a discount or to reduce the price, to check the expiration date, etc. This makes it easier for the store clerk to check the display situation.

Furthermore, an example will be described in which the imaging device 24 is movable on rails attached to a shelf. Note that even if the imaging device 24 is movable on rails, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24.

For example, in response to reading information from a product tag by the antenna 21, the imaging device control unit 207 moves the imaging device 24 to a position where it can capture an image of the product identified by the read information. The imaging device control unit 207 may then use the imaging device 24 to capture an image that includes the product.

Also, for example, if there is an abnormality in reading information from a product tag by the antenna 21, the imaging device control unit 207 moves the imaging device 24 to a position where it can capture an image of the display situation at the display position where the abnormality was detected. Then, the imaging device control unit 207 captures an image of the display situation at the display position on the shelf where the abnormality was detected using the imaging device 24. Capturing an image of the display situation at the display position on the shelf where the abnormality was detected means capturing an image of the shelf so that it includes the display position where the abnormality was detected.

The imaging device control unit 207 moves the imaging device 24 to a position where it can capture an image of the product, depending on the expiration date of the product specified by the information capable of identifying the product read by the antenna 21. The imaging device control unit 207 then uses the imaging device 24 to capture an image that includes the product.

The output unit 204 may output the captured image in association with information indicating the display status. For example, the output unit 204 may output a notification according to the display status together with the captured image.

FIG. 17 is an explanatory diagram showing an example in which an image of a shelf is displayed together with a notification of foreign object detection. For example, the output unit 204 displays the notification of foreign object detection on the terminal device 25. The screen includes the notification of foreign object detection and an image of the shelf. This allows the user to visually check the display status of the shelf.

<Timing of Antenna 21 Movement and Reading>
The antenna control unit 201 and the reading unit 202 may perform each process according to a user's instruction. For example, the antenna control unit 201 may move the antenna 21 according to a user's instruction. Specifically, for example, the reception unit 205 is an example of a reception means for receiving an instruction from a user. For example, the reception unit 205 receives a reading instruction via the terminal device 25 by the user's operation. Then, when the user's instruction is received, the antenna control unit 201 moves the antenna 21. Also, for example, the reading unit 202 may output an RFID tag reading instruction to the reader 22 according to the user's instruction. When the instruction from the user is an instruction to search for a product, the instruction from the user may include a product ID that identifies the product to be searched for. Also, when the instruction from the user is an instruction to search for an individual product, the instruction from the user may include a product tag ID that identifies a product tag attached to the product to be searched for or a product ID that identifies the product. Note that, when the instruction is an instruction to search for a product, the antenna control unit 201 may stop moving the antenna or return it to its initial position when the product is found.

The antenna control unit 201 may also control the movement of the antenna 21 depending on the results of sales analysis. For example, when a predetermined number or more of the same product are purchased, the antenna control unit 201 may move the antenna 21 to a position that includes the position where the product is displayed in its reading range.

The antenna control unit 201 may also move the antenna 21 depending on the detection result by the sensor. For example, the determination unit 210 is an example of a determination means that determines whether the detection result by the sensor attached to the shelf satisfies a predetermined condition. The sensor may be at least one of a weight sensor, a vibration sensor, a sound detection sensor, a human presence sensor, and an imaging device 24. The type of human presence sensor is not particularly limited, and may include infrared, ultrasonic, visible light, etc. The sensors may be used in combination. For example, the determination unit 210 obtains the detection result from the sensor. Then, the determination unit 210 determines whether the detection result satisfies a predetermined condition. Then, the antenna control unit 201 may control the movement of the antenna 21 when the detection result by the sensor attached to the shelf satisfies the predetermined condition.

FIG. 18 is an explanatory diagram showing an example of sensor installation. In FIG. 18, multiple sensors 30-11 to 30-13, 30-21 to 30-23, and 30-31 to 30-33 are shown. Here, they are simply referred to as sensors 30. For example, the sensors 30 are not particularly limited as long as they are installed so as to be able to detect changes in the display status of products. For example, the sensors 30 may be installed on each row of shelves on which products are displayed as shown in FIG. 18, or may be installed on each shelf level, and are not particularly limited. Also, for example, depending on the type of sensor 30, the sensor 30 may be installed above the product. For example, if the sensor 30 is a human presence sensor, the human presence sensor may be installed above the product and detect the entry of a hand into the product display area.

Using FIG. 18 as an example, the antenna control unit 201 may move the antenna 21 to a position that includes within its reading range at least a part of the row of shelves to which the sensor 30 whose detection result satisfies a predetermined condition is attached. This position is, for example, a position where a position tag at or near the position of the antenna 21 can be read. For example, the antenna control unit 201 may move the antenna 21 while the reading unit 202 is reading the position tag. Then, the antenna control unit 201 may stop the movement of the antenna 21 when the position specified by the position tag is at or near the position of the antenna 21. Or, for example, the antenna control unit 201 may calculate the amount of movement required from the current position of the antenna 21 to the position where the sensor 30 is attached. Then, the antenna control unit 201 may move the antenna 21 based on the amount of movement.

For example, if the sensor 30 is a weight sensor, the detection result is the detection result of a change in weight by the weight sensor. For example, the specified condition may be that a change in weight has been detected. A change in weight can be an increase in weight or a decrease in weight. For example, the specified condition may be that an increase in weight has been detected. Examples of cases in which weight increases include when a store clerk puts a new product on the shelves, when a customer returns a product that they had previously acquired, and when a customer places a product different from the shelf allocation. For example, the specified condition may be that a decrease in weight has been detected. Examples of cases in which weight decreases include when a customer acquires a product.

Also, for example, the predetermined condition may be a weight change in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. If the weight change satisfies this condition, it is highly likely that a product different from the shelf allocation has been placed. For example, if the weight of the product assigned to the position where the weight sensor is attached is 300 grams, but the weight change is an increase of 500 grams, it is highly likely that a product other than the product assigned to the position where the weight sensor is attached has been placed. More specifically, for example, the predetermined condition may be a detection of an increase in weight in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. It is possible to determine whether a product different from the shelf allocation has been placed by both detection by the weight sensor and reading by the antenna 21. Therefore, the management device 20 can detect foreign objects with greater accuracy. Also, the predetermined condition may be a predetermined weight change being detected by the weight sensor a predetermined number of times or more. The predetermined number of times may be determined based on the number of products that can be displayed.

If the sensor 30 is a vibration sensor, the detection result is the result of vibration detection by the vibration sensor. For example, the specified condition may be that vibration occurs at the position where the vibration sensor is attached. For example, the specified condition may be that the vibration occurring at the position where the vibration sensor is attached is within a specified range. The specified range may be the range of vibration that may occur when placing a product to be displayed in the planogram, or the range of vibration that may occur when a product to be displayed in the planogram is obtained. Furthermore, the specified condition may be that a specific vibration is detected by the vibration sensor a specified number of times or more. The specified number may be determined based on the number of products that can be displayed.

For example, the vibrations generated when an item is placed on a shelf vary depending on the weight and shape of the item. If the vibrations differ from those generated when arranging or acquiring items displayed in the planogram, it is expected that an item other than the items displayed in the planogram has been displayed. For example, the specified condition may be that the vibrations exceed a specified range. By both detection by the weight sensor and reading by the antenna 21, it becomes possible to determine whether an item other than the item displayed in the planogram has been placed. Therefore, the management device 20 can detect foreign objects with greater accuracy.

If the sensor 30 is a sound detection sensor, the detection result is the result of sound detection by the sound detection sensor. For example, the predetermined condition may be that a specific sound is detected at the position where the sound detection sensor is attached. More specifically, for example, the predetermined condition may be that the sound generated at the position where the sound detection sensor is attached is within a predetermined range. The predetermined range may be the range of sounds that may be generated when placing a product to be displayed in the shelf allocation, or the range of sounds that may be generated when a product to be displayed in the shelf allocation is obtained. The predetermined range may be the sound of a door closing or opening in a shelf with a door. In other words, the predetermined condition may be that a sound that is estimated to indicate a change in the display situation is generated. The predetermined condition may also be that a specific sound is detected by the sound detection sensor a predetermined number of times or more. The predetermined number of times may be determined based on the number of products that can be displayed.

If the sensor 30 is a human presence sensor, the detection result is the detection result of a person by the human presence sensor. For example, the specified condition may be that a person is detected in an area detectable by the human presence sensor. For example, when a person takes a product from a shelf or places a product on a shelf, the person places his or her hand in the product display area. Therefore, if the area detectable by the human presence sensor is the product display area, the human presence sensor detects the person's hand when the person places his or her hand in the display area. This makes it possible to move the antenna when there is a high possibility that there has been a change in the display situation on the shelf. The specified condition may also be that a hand is detected in the area detectable by the human presence sensor a specified number of times or more. The specified number may be determined based on the number of products that can be displayed.

The output unit 204 may also output the detection results from the sensor 30 in association with information indicating the display status.

The antenna control unit 201 may also control the movement of the antenna 21 in accordance with the image captured by the imaging device 24.

The person detection unit 208 is an example of a person detection means that detects the behavior of a person from an image captured by the imaging device 24 capable of capturing an image of a person in front of a shelf. The behavior of a person may be, for example, a person obtaining a product from a shelf, a person reaching out to a shelf, or a person placing a product on a shelf, and is not limited to this. Examples of people include customers and store clerks.

Then, the antenna control unit 201 moves the antenna 21 to a position whose reading range includes the vicinity of the position where the person was detected, depending on the person's behavior. For example, the vicinity of the position where the person was detected may be the shelf level in front of the person where the person was detected. Also, for example, the position where the person was detected may be the shelf level where the person reached out, and the vicinity of the position where the person was detected may be the shelf level where the person reached out. Specifically, for example, the antenna control unit 201 moves the antenna 21 to a position where it can read the product tag of a product displayed at the shelf level where the person reached out.

For example, the person detection unit 208 may detect that a person has taken a product from a shelf from an image captured by the imaging device 24. When the antenna control unit 201 detects that a person has taken a product from a shelf, it moves the antenna 21 to a position where it can read an RFID tag located at the position where the product is displayed on the shelf. For example, the antenna control unit 201 moves the antenna 21 to a position where it can read a position tag located at the position where the product is displayed or in the vicinity of that position. Also, for example, the antenna control unit 201 may move the antenna 21 while the reading unit 202 reads the position tag. Then, when the position specified by the position tag is the position where the product is displayed or in the vicinity of that position, the antenna control unit 201 may stop moving the antenna 21.

Also, for example, the person detection unit 208 may detect that a person has placed a product on a shelf based on an image captured by the imaging device 24. Then, when the antenna control unit 201 detects that a person has placed a product on the shelf, it moves the antenna 21 to a position where it can read the RFID tag located at the position where the product is displayed on the shelf.

The item detection unit 209 is an example of a detection means for detecting an item included in an image captured by the imaging device 24 capable of capturing an image of the movement range of the antenna 21 on the shelf. The antenna control unit 201 moves the antenna 21 to a position whose reading range includes the position where the item included in the image is placed. If the antenna control unit 201 does not detect an item from the image, it moves the antenna 21 to a position whose reading range includes the position where the item included in the image is placed.

(flowchart)
19 is a flowchart showing an example of the operation of the management device 20 that controls the movement of the antenna 21 according to the detection result by the sensor 30. The antenna control unit 201 controls the movement of the antenna 21 on a rail attached to a shelf (step S201). The reading unit 202 reads the product tag and the position tag (step S202). Note that steps S201 and S202 may be performed simultaneously. That is, the management device 20 may read the product tag and the position tag while moving the antenna 21.

The situation identification unit 203 identifies the display situation of the products on the shelf (step S203). The situation identification unit 203 may then determine whether there is an abnormality in the display situation (step S204). If there is no abnormality in the display situation (step S204: No), the management device 20 may end the process. If there is an abnormality in the display situation (step S204: Yes), the imaging device control unit 207 controls the imaging device 24 to capture an image including the part of the shelf where there is an abnormality (step S205). In step S205, the imaging device control unit 207 may control at least one of the orientation, position, and angle of view of the imaging device 24 so that the imaging device 24 captures an image including the part of the shelf where there is an abnormality. Also, in step S205, the imaging device control unit 207 may move the imaging device 24 so that the imaging device 24 captures an image including the part of the shelf where there is an abnormality.

The output unit 204 outputs the information representing the display status in association with the image (step S206). Then, the management device 20 ends the series of processes.

FIG. 20 is a flowchart showing an example of the operation of the management device 20 that controls the imaging device 24 depending on the reading state. The determination unit 210 may determine whether the detection result of the sensor 30 attached to the shelf satisfies a predetermined condition (step S211). If the detection result of the sensor 30 attached to the shelf does not satisfy the predetermined condition (step S211: No), the determination unit 210 returns to step S211.

On the other hand, if the detection result of the sensor 30 attached to the shelf satisfies the predetermined condition (step S211: Yes), the antenna control unit 201 moves the antenna 21 to a position whose reading range includes the display position corresponding to the sensor 30 whose detection result satisfies the predetermined condition (step S212). The reading unit 20 reads the product tag and the position tag (step S213). Note that steps S212 and S213 may be performed simultaneously. That is, the management device 20 may read the product tag and the position tag while moving the antenna 21. In this way, when the position of the antenna 21 is identified using the position tag, the antenna 21 can be moved to a position whose reading range includes the display position corresponding to the sensor 30 whose detection result satisfies the predetermined condition.

Then, the situation identification unit 203 identifies the display situation (step S214). The output unit 204 associates information indicating the display situation with the detection result of the sensor 30 and outputs the information (step S215). Then, the management device 20 ends the series of processes.

As described above, in the second embodiment, position tags containing information capable of identifying a position on the shelf are attached to each position on the shelf near the rails. The management device 20 further reads the position tags, and identifies the display status of products on the shelf using the read information capable of identifying the position and the read information capable of identifying the item. This makes it possible to accurately identify the position of the antenna 21 using the position tags. Furthermore, the antenna 21 may be movable on the shelf in at least one of the horizontal, vertical, and depth directions. Therefore, it is sufficient that rails along which the antenna 21 can move are attached to the shelf, etc. This makes it possible to reduce the number of antennas 21.

The management device 20 also identifies the position information of the antenna 21 from the control information for the movement of the antenna 21. The management device 20 then identifies the display status of the products on the shelf based on the identified position information of the antenna 21 and the product information read from the product tag. This allows the position of the antenna 21 to be identified with high accuracy using the control information of the antenna 21.

In addition, the management device 20 controls at least one of the orientation, position, and angle of view of the imaging device 24, which can capture the movement range of the antenna 21 on the shelf, in response to the reading of information capable of identifying an item by the antenna 21, and causes the imaging device 24 to capture an image of the shelf. This makes it possible to manage the status of items on the shelf by combining the RFID tag and the imaging device 24.

The imaging devices 24 may also be movable on rails attached to the shelves, and the management device 20 may control the movement of the imaging devices 24 to positions where they can capture an image of the item in response to the reading of information by the antenna 21 that can identify the item. This makes it possible to reduce the number of imaging devices 24, and ultimately to reduce the costs associated with installing the imaging devices 24.

The imaging device 24 may be placed on the rail where the antenna 21 is placed. In this way, by sharing the rail for the imaging device 24 and the antenna 21, the cost of installing the rail can be reduced.

Furthermore, if there is an abnormality in the reading of the information by the antenna 21 that can identify an item, the management device 20 moves the imaging device 24 to a position where it can capture an image of the display situation at the position where the abnormality was detected. Furthermore, the management device 20 moves the imaging device 24 to a position where it can capture an image of the item according to the expiration date of the item specified by the information that can identify the item by the antenna 21, and captures an image of the shelf so that the item is included. The management device 20 then notifies the user of the captured image together with information indicating the display situation, making it easier for the user to check the display situation. In this way, the management device can capture images only when it is necessary to notify the user.

The management device 20 also controls the movement of the antenna 21 when the detection result by the sensor 30 attached to the shelf meets a predetermined condition. For example, the sensor 30 is at least one of a weight sensor, a vibration sensor, and a sound detection sensor. This allows the antenna 21 to be moved when a change in the display situation is detected. Therefore, it is possible to avoid moving the antenna 21. For example, if the sensor 30 is a weight sensor, the predetermined condition may be a weight change in a unit of weight different from the weight of the product assigned to the position where the weight sensor is attached. This allows the antenna 21 to be moved when it is expected that a foreign object has been placed on the shelf. Therefore, it is possible to identify abnormalities in the display situation with greater accuracy.

The management device 20 also detects the behavior of a person from images captured by an imaging device 24 capable of capturing images of the movement range of the antenna 21 on the shelf. The management device 20 then moves the antenna 21 to the vicinity of the position where the person was detected, depending on the person's behavior. This makes it possible to move the antenna when a change in the display situation may have occurred due to a person such as a customer or store clerk.

Specifically, for example, the management device 20 detects that a person has taken a product from a shelf from an image captured by the imaging device 24. When the management device 20 detects that a person has taken a product from a shelf, it moves the antenna 21 to a position whose reading range includes the position where the product is displayed on the shelf. This makes it possible to move the antenna when there is a high possibility that the number of products on display has been reduced by a person such as a customer or store clerk.

For example, the management device 20 detects that a person has placed an item on a shelf based on an image captured by the imaging device 24. When the management device 20 detects that a person has placed an item on a shelf, it moves the antenna 21 to a position whose reading range includes the position on the shelf where the item is displayed. This allows the antenna to be moved when there is a high possibility that the number of items on display has increased due to a person such as a customer or store clerk.

The management device 20 also detects products included in an image captured by an imaging device 24 capable of capturing an image of the movement range of the antenna 21 on the shelf. The management device 20 then causes the antenna control unit 201 to move the antenna 21 to a position whose reading range includes the position where the product in the image is placed.

This concludes the explanation of each embodiment. Each embodiment may be modified for use. Modifications are described below.

<Modification>
In the above example, the moving unit 23 and the moving unit 26 have wheels and move by rotating the wheels. For example, the moving unit 23 and the moving unit 26 may have a structure similar to a general camera slider. More specifically, for example, the moving unit 23 and the moving unit 26 may have a structure similar to a slider with bearings or a plastic camera slider.

This completes the explanation of the modified examples. Also, each embodiment and modified example may be combined. Also, the management devices 10 and 20 may be configured to include each functional unit and part of the information. For example, the management device 20 may be configured to include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and a reception unit 205. For example, the management device 20 may be configured to include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and a person detection unit 208. For example, the management device 20 may be configured to include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and an item detection unit 209. For example, the management device 20 may be configured to include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and an object detection unit 209. For example, the management device 20 may be configured to include an antenna control unit 201, a reading unit 202, a situation identification unit 203, an output unit 204, and an image capture device control unit 207. In this way, the functional units included in the management device 20 are not particularly limited. In addition, the management device 20 may have other functional units that are not shown.

Furthermore, each embodiment is not limited to the above-mentioned examples, and various modifications are possible. Furthermore, the configuration of the management devices 10, 20 is not particularly limited. For example, the functional units of the management devices 10, 20 may be realized by a single device. Or, for example, each functional unit or DB of the management devices 10, 20 may be realized by a different device and configured as a system. For example, each functional unit of the management device 20 may be configured by multiple servers and realized as a system. For example, it may be realized by a database server including each DB and a server having each functional unit.

Furthermore, in the embodiment, each DB may include a portion of the above-mentioned information. Furthermore, each piece of information may include information other than the above-mentioned information. Furthermore, for example, for ease of explanation, a distinction is made between a position tag ID and a product tag ID, but a tag ID that can simply identify an RFID tag may be used. As the tag ID, for example, the manufacturing number of the tag may be used.

The process of generating information to be displayed on the terminal device 25 may be performed by the output unit 204. This process may also be performed by the terminal device 25. That is, the terminal device 25 generates information for a screen to be displayed on the terminal device 25 based on data received from the management devices 10 and 20, and displays the screen.

(Example of computer hardware configuration)
Next, an example of a hardware configuration in which each of the management devices 10 and 20, the terminal device 25, and the like is realized by a computer will be described.

FIG. 21 is an explanatory diagram showing an example of a computer hardware configuration. For example, some or all of the devices can be realized using any combination of a computer 80 and a program as shown in FIG. 21.

The computer 80 has, for example, a processor 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, and a storage device 804. The computer 80 also has a communication interface 805 and an input/output interface 806. Each component is connected to the other components, for example, via a bus 807. Note that the number of each component is not particularly limited, and there may be one or more of each component.

The processor 801 controls the entire computer 80. The processor 801 may be, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), a GPU (Graphics Processing Unit), a PPU (Physics Processing Unit), a TPU (Tensor Processing Unit), a quantum processor, or a combination of these, and is not particularly limited.

The computer 80 also has a ROM 802, a RAM 803, and a storage device 804. Examples of the storage device 804 include semiconductor memory such as a flash memory, a hard disk drive (HDD), and a solid state drive (SSD). For example, the storage device 804 stores an operating system (OS) program, application programs, and programs related to the embodiments. Alternatively, the ROM 802 stores application programs and programs related to the embodiments. The RAM 803 is used as a work area for the processor 801.

The processor 801 also loads programs stored in the storage device 804, ROM 802, etc. The processor 801 then executes each process coded in the program. The processor 801 may also download various programs via the communications network NT. The processor 801 also functions as a part or all of the computer 80. The processor 801 may then execute the processes or instructions in the illustrated flowchart based on the program.

The communication interface 805 is connected to a communication network NT, such as a LAN (Local Area Network) or a WAN (Wide Area Network), via a wireless or wired communication line. The communication network NT may be composed of multiple communication networks NT. As a result, the computer 80 is connected to an external device or an external computer 80 via the communication network NT. The communication interface 805 serves as an interface between the communication network NT and the inside of the computer 80. The communication interface 805 also controls the input and output of data from the external device or the external computer 80.

The input/output interface 806 is connected to at least one of an input device, an output device, and an input/output device. The connection method may be wireless or wired. Examples of the input device include a keyboard, a mouse, and a microphone. Examples of the output device include a display device, a lighting device, and an audio output device that outputs audio. Examples of the input/output device include a touch panel display. The input device, output device, and input/output device may be built into the computer 80 or may be external.

The hardware configuration of the computer 80 is an example. The computer 80 may have some of the components shown in FIG. 21. The computer 80 may have components other than those shown in FIG. 21. For example, the computer 80 may have a drive device or the like. The processor 801 may read out programs and data stored in a recording medium attached to the drive device or the like to the RAM 803. Examples of non-transient tangible recording media include optical disks, flexible disks, magnetic optical disks, and USB (Universal Serial Bus) memories. As described above, for example, the computer 80 may have input devices such as a keyboard and a mouse. The computer 80 may have an output device such as a display. The computer 80 may also have an input device, an output device, and an input/output device.

The computer 80 may also have various sensors (not shown). The type of sensor is not particularly limited. The computer 80 may also have an imaging device capable of capturing images and videos.

This concludes the explanation of the hardware configuration of each device. There are also various variations in the method of implementing each device. For example, each device may be implemented by any combination of a different computer and program for each component. Furthermore, multiple components of each device may be implemented by any combination of a single computer and program.

Furthermore, some or all of the components of each device may be realized by circuits for specific applications. Further, some or all of the components of each device may be realized by general-purpose circuits such as an FPGA (Field Programmable Gate Array). Further, some or all of the components of each device may be realized by a combination of circuits for specific applications and general-purpose circuits. Further, these circuits may be a single integrated circuit. Alternatively, these circuits may be divided into multiple integrated circuits. Furthermore, the multiple integrated circuits may be configured by being connected via a bus or the like.

In addition, if some or all of the components of each device are realized by multiple computers, circuits, etc., the multiple computers, circuits, etc. may be centralized or distributed.

The management method described in the embodiment may be implemented by a computer such as the management device 10 or 20.

Each program, such as the formulation program and optimization program described in the embodiment, is recorded on a computer-readable recording medium, such as an HDD, SSD, flexible disk, optical disk, magneto-optical disk, or USB memory. Each program is then executed by being read from the recording medium by the computer. Each program may also be distributed via the communications network NT.

The functions of each of the components of management device 10 and management device 20 described above may be realized by dedicated hardware, such as a computer. Alternatively, each component may be realized by software. Alternatively, each component may be realized by a combination of hardware and software.

Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. The configuration and details of each of the present disclosures may include embodiments to which various modifications that a person skilled in the art may understand within the scope of the present disclosure are applied. The present disclosure may include embodiments in which the matters described in this specification are appropriately combined or substituted as necessary. For example, matters described using a specific embodiment may also be applied to other embodiments to the extent that no contradiction occurs. For example, although multiple operations are described in order in the form of a flowchart, the order of description does not limit the order in which the multiple operations are performed. Therefore, when implementing the embodiments, the order of the multiple operations may be changed to the extent that the content is not impaired.

A part or all of the above-described embodiments can also be described as follows. However, a part or all of the above-described embodiments is not limited to the following.

(Appendix 1)
an antenna control means for controlling movement of antennas which are individually movable on rails attached to the shelf;
A reading means for reading an RFID tag attached to an article, the RFID tag including information capable of identifying the article, by using the antenna;
a situation identification means for identifying information representing a display situation of the items on the shelf based on position information of the antenna and the information read from the RFID tag;
an output means for outputting information representing the display status;
A management device comprising:

(Appendix 2)
an RFID tag including information that can identify a position on the shelf is attached to each position near the rail;
The reading means further reads the RFID tag including the information capable of identifying the location,
the situation identification means identifies the display situation based on the information capable of identifying the read position and the information capable of identifying the read item.
2. The management device of claim 1.

(Appendix 3)
a position specifying means for specifying position information of the antenna from control information of the movement of the antenna by the antenna control means,
The situation identification means identifies the display situation based on the position information of the antenna and the information capable of identifying the read item.
The management device according to claim 1 .

(Appendix 4)
an imaging device control means for controlling an imaging device capable of imaging the moving range of the antenna on the shelf;
Equipped with
the imaging device control means controls at least one of an orientation, a position, and an angle of view of the imaging device in response to reading of the information capable of identifying the item by the antenna, to cause the imaging device to capture an image of the shelf;
4. The management device according to claim 1 ,

(Appendix 5)
the imaging device is movable on a rail attached to the shelf;
the imaging device control means controls movement of the imaging device to a position where an image of the article can be captured in response to reading of the information capable of identifying the article by the antenna;
5. The management device of claim 4.

(Appendix 6)
The imaging device is placed on the rail on which the antenna is placed.
6. The management device according to claim 5.

(Appendix 7)
the imaging device control means, when an abnormality is detected in the reading of the information capable of identifying the item by the antenna, moves the imaging device to a position where the imaging device can capture an image of the display situation at the position where the abnormality is detected.
7. The management device according to claim 5 or 6.

(Appendix 8)
the imaging device control means moves the imaging device to a position where the imaging device can capture an image of the article in accordance with a deadline of the article specified by the information capable of identifying the article by the antenna;
8. The management device according to claim 5,

(Appendix 9)
the antenna control means controls movement of the antenna when a detection result by a sensor attached to the shelf satisfies a predetermined condition.
9. The management device according to any one of Supplementary Note 5 to Supplementary Note 8.

(Appendix 10)
The sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.
10. The management device of claim 9.

(Appendix 11)
the sensor is a weight sensor;
the detection result is a detection result of a change in weight by the weight sensor,
The predetermined condition is a weight change in a unit of weight different from the weight of the item assigned to the position where the weight sensor is attached.
10. The management device of claim 9.

(Appendix 12)
a person detection means for detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person;
Equipped with
the antenna control means moves the antenna to a position near the position where the person is detected in response to the person's behavior.
12. The management device according to any one of claims 1 to 11.

(Appendix 13)
The person detection means detects, from an image captured by the imaging device, that the person has acquired an item from the shelf;
when it is detected that the person has acquired an item from the shelf, the antenna control means moves the antenna to a position on the shelf that includes the position where the item is placed within a reading range.
13. The management device of claim 12.

(Appendix 14)
The person detection means detects that the person has placed the item on the shelf based on an image captured by the imaging device,
when it is detected that the person has placed the item on the shelf, the antenna control means moves the antenna to a position on the shelf that includes the position where the item is placed within a reading range.
14. The management device according to claim 12 or 13.

(Appendix 15)
an article detection unit that detects an article included in an image captured by an imaging device capable of capturing an image of a moving range of the antenna on the shelf;
the antenna control means moves the antenna to a position on the shelf that includes within a reading range a position at which the article included in the image is placed;
15. The management device according to any one of claims 1 to 14.

(Appendix 16)
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an article is read, the RFID tag including information that can identify the article;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
How to manage it.

(Appendix 17)
an RFID tag including information that can identify a position on the shelf is attached to each position near the rail;
The reading further includes reading the RFID tag including the information capable of identifying the location;
In the identification of the information representing the display situation, the display situation is identified based on the information capable of identifying the read position and the information capable of identifying the read item.
The management method described in Appendix 16.

(Appendix 18)
Identifying position information of the antenna from control information of the movement of the antenna;
In the identification of the information representing the display situation, the display situation is identified based on position information of the antenna and the information capable of identifying the read item.
The management method described in Appendix 16.

(Appendix 19)
Controlling an imaging device capable of imaging the moving range of the antenna on the shelf;
In the control of the imaging device, at least one of a direction, a position, and an angle of view of the imaging device is controlled in response to reading of the information capable of identifying the item by the antenna, thereby causing the imaging device to capture an image of the shelf.
19. The management method according to any one of appendices 16 to 18.

(Appendix 20)
the imaging device is movable on a rail attached to the shelf;
In the control of the imaging device, a movement of the imaging device is controlled to a position where an image of the article can be captured in response to reading of the information capable of identifying the article by the antenna.
The management method described in Appendix 19.

(Appendix 21)
The imaging device is placed on the rail on which the antenna is placed.
The management method according to claim 20.

(Appendix 22)
In the control of the imaging device, when an abnormality is detected in the reading of the information capable of identifying the item by the antenna, the imaging device is moved to a position where the imaging device can capture an image of the display situation at the position where the abnormality is detected.
The management method according to claim 20 or 21.

(Appendix 23)
In the control of the imaging device, the imaging device is moved to a position where the image of the article can be captured according to a deadline of the article specified by the information that can identify the article by the antenna.
23. The management method according to any one of appendices 20 to 22.

(Appendix 24)
In controlling the antenna, when a detection result by a sensor attached to the shelf satisfies a predetermined condition, the movement of the antenna is controlled.
24. The management method according to any one of claims 20 to 23.

(Appendix 25)
The sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.
The management method described in Appendix 24.

(Appendix 26)
the sensor is a weight sensor;
the detection result is a detection result of a change in weight by the weight sensor,
The predetermined condition is a weight change in a unit different from the weight of the item assigned to the position where the weight sensor is attached.
The management method described in Appendix 24.

(Appendix 27)
detecting a behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person;
In the control of the antenna, the antenna is moved to a position near the position where the person is detected in response to the behavior of the person.
27. The management method according to any one of claims 16 to 26.

(Appendix 28)
detecting, from an image captured by the imaging device, that the person has acquired an item from the shelf;
When it is detected in the control of the antenna that the person has acquired an item from the shelf, the antenna is moved to a position on the shelf that includes the position where the item is placed within a reading range.
The management method described in Appendix 27.

(Appendix 29)
In the detection of the behavior of the person, it is detected that the person has placed the item on the shelf based on an image captured by the imaging device;
When it is detected in the control of the antenna that the person has placed the item on the shelf, the antenna is moved to a position on the shelf that includes the position where the item is placed within a reading range.
The management method according to claim 27 or 28.

(Appendix 30)
Detecting an article included in an image captured by an imaging device capable of capturing an image of a moving range of the antenna on the shelf;
In the control of the antenna, the antenna is moved to a position on the shelf that includes within a reading range a position at which the article included in the image is placed.
29. The management method according to any one of claims 16 to 29.

(Appendix 31)
On the computer,
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an article is read, the RFID tag including information that can identify the article;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
A non-transitory recording medium readable by the computer, which records a program for executing a process.

(Appendix 32)
an RFID tag including information that can identify a position on the shelf is attached to each position near the rail;
The reading process further includes reading the RFID tag including the information capable of identifying the location;
In the process of identifying the information representing the display situation, the display situation is identified based on the information capable of identifying the read position and the information capable of identifying the read item.
32. The recording medium according to claim 31.

(Appendix 33)
The computer includes:
Identifying position information of the antenna from control information of the movement of the antenna;
Execute the process,
In the process of identifying the information representing the display situation, the display situation is identified based on position information of the antenna and the information capable of identifying the read item.
32. The recording medium according to claim 31.

(Appendix 34)
The computer includes:
Controlling an imaging device capable of imaging the moving range of the antenna on the shelf;
Execute the process,
In the process of controlling the imaging device, at least one of a direction, a position, and an angle of view of the imaging device is controlled in response to reading of the information capable of identifying the item by the antenna, so that the imaging device captures an image of the shelf.
34. A recording medium according to any one of claims 31 to 33.

(Appendix 35)
the imaging device is movable on a rail attached to the shelf;
and in the process of controlling the imaging device, in response to reading of the information capable of identifying the article by the antenna, controlling movement of the imaging device to a position capable of capturing an image of the article.
35. The recording medium according to claim 34.

(Appendix 36)
The imaging device is placed on the rail on which the antenna is placed.
36. The recording medium according to claim 35.

(Appendix 37)
In the process of controlling the imaging device, when an abnormality is detected in the reading of the information capable of identifying the item by the antenna, the imaging device is moved to a position where the imaging device can capture an image of the display situation at the position where the abnormality is detected.
37. The recording medium according to claim 35 or 36.

(Appendix 38)
In the process of controlling the imaging device, the imaging device is moved to a position where the image of the article can be captured, in accordance with a deadline of the article specified by the information that can identify the article by the antenna.
38. A recording medium according to any one of claims 35 to 37.

(Appendix 39)
In the process of controlling the antenna, when a detection result by a sensor attached to the shelf satisfies a predetermined condition, movement of the antenna is controlled.
39. A recording medium according to any one of appendices 35 to 38.

(Appendix 40)
The sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.
40. The recording medium according to claim 39.

(Appendix 41)
the sensor is a weight sensor;
the detection result is a detection result of a change in weight by the weight sensor,
The predetermined condition is a weight change in a unit of weight different from the weight of the item assigned to the position where the weight sensor is attached.
40. The recording medium according to claim 39.

(Appendix 42)
The computer includes:
detecting a behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person;
Execute the process,
In the process of controlling the antenna, the antenna is moved to a position near the position where the person is detected in response to the behavior of the person.
42. A recording medium according to any one of claims 31 to 41.

(Appendix 43)
The computer includes:
detecting, from the image captured by the imaging device, that the person has acquired an item from the shelf;
Execute the process,
In the process of controlling the antenna, when it is detected that the person has acquired an item from the shelf, the antenna is moved to a position on the shelf that includes the position where the item is placed within a reading range.
43. The recording medium according to claim 42.

(Appendix 44)
In the process of detecting the behavior of the person, it is detected that the person has placed the item on the shelf based on an image captured by the imaging device;
In the process of controlling the antenna, when it is detected that the person has placed the item on the shelf, the antenna is moved to a position on the shelf that includes the position where the item is placed within a reading range.
44. The recording medium according to claim 42 or 43.

(Appendix 45)
The computer includes:
detecting an article included in an image captured by an imaging device capable of capturing an image of a moving range of the antenna on the shelf;
Execute the process,
In the process of controlling the antenna, the antenna is moved to a position that includes within a reading range a position at which the article is placed and that is included in the image.
A recording medium according to any one of claims 31 to 44.

(Appendix 31)
On the computer,
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an article is read, the RFID tag including information that can identify the article;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
A program that executes a process.

10, 20 Management device 11, 21, 21-1 to 21-n Antenna 13, 23, 23-1 to 23-n Moving unit 22 Reader 24 Imaging device 25 Terminal device 26 Moving unit 30 Sensor 80 Computer 101, 201 Antenna control unit 102, 202 Reading unit 103, 203 Situation identification unit 104, 204 Output unit 205 Reception unit 206 Position identification unit 207 Imaging device control unit 208 Person detection unit 209 Article detection unit 210 Determination unit 801 Processor 802 ROM
803 RAM
804 Storage device 805 Communication interface 806 Input/output interface 807 Bus 2001 Shelf allocation DB
2002 Antenna DB
2003 Location Tag DB
2004 Product DB
NT Communication Network

Claims (15)

an antenna control means for controlling movement of antennas which are individually movable on rails attached to the shelf;
a reading means for reading an RFID (Radio Frequency Identification) tag attached to an article, the RFID tag including information capable of identifying the article, by using the antenna;
a situation identification means for identifying information representing a display situation of the items on the shelf based on position information of the antenna and the information read from the RFID tag;
an output means for outputting information representing the display status;
A management device comprising: an RFID tag including information that can identify a position on the shelf is attached to each position near the rail;
The reading means further reads the RFID tag including the information capable of identifying the location,
the situation identification means identifies the display situation based on the information capable of identifying the read position and the information capable of identifying the read item.
The management device according to claim 1 . a position specifying means for specifying position information of the antenna from control information of the movement of the antenna by the antenna control means,
The situation identification means identifies the display situation based on the position information of the antenna and the information capable of identifying the read item.
The management device according to claim 1 . an imaging device control means for controlling an imaging device capable of imaging the moving range of the antenna on the shelf;
Equipped with
the imaging device control means controls at least one of an orientation, a position, and an angle of view of the imaging device in response to reading of the information capable of identifying the item, to cause the imaging device to capture an image of the shelf;
The management device according to any one of claims 1 to 3. the imaging device is movable on a rail attached to the shelf;
the imaging device control means controls movement of the imaging device to a position where an image of the article can be captured in response to reading of the information capable of identifying the article by the antenna;
The management device according to claim 4. The imaging device is placed on the rail on which the antenna is placed.
The management device according to claim 5 . the imaging device control means, when an abnormality is detected in the reading of the information capable of identifying the item by the antenna, moves the imaging device to a position where the imaging device can capture an image of the display situation at the position where the abnormality is detected.
The management device according to claim 5 or 6. the imaging device control means moves the imaging device to a position where the imaging device can capture an image of the article in accordance with a deadline of the article specified by the information capable of identifying the article by the antenna;
The management device according to any one of claims 5 to 7. the antenna control means controls movement of the antenna when a detection result by a sensor attached to the shelf satisfies a predetermined condition.
The management device according to any one of claims 5 to 8. The sensor is at least one of a weight sensor, a vibration sensor, a sound detection sensor, and a human presence sensor.
The management device according to claim 9. the sensor is a weight sensor;
the detection result is a detection result of a change in weight by the weight sensor,
The predetermined condition is a weight change in a unit of weight different from the weight of the item assigned to the position where the weight sensor is attached.
The management device according to claim 9. a person detection means for detecting the behavior of a person standing in front of the shelf from an image captured by an imaging device capable of capturing an image of the person;
Equipped with
the antenna control means moves the antenna to a position near the position where the person is detected in response to the person's behavior.
The management device according to any one of claims 1 to 11. The person detection means detects, from an image captured by the imaging device, that the person has acquired an item from the shelf;
when it is detected that the person has acquired an item from the shelf, the antenna control means moves the antenna to a position on the shelf that includes the position where the item is placed within a reading range.
The management device according to claim 12. It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an article is read, the RFID tag including information that can identify the article;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
How to manage it. On the computer,
It controls the movement of antennas that can be moved individually on rails attached to the shelf,
Using the antenna, an RFID tag attached to an article is read, the RFID tag including information that can identify the article;
Identifying information representing a display status of the item on the shelf based on the position information of the antenna and the information read from the RFID tag;
outputting information representing the display status;
A non-transitory recording medium readable by the computer, which records a program for executing a process.

Images