JP2014178920A - Face recognition system and face recognition method - Google Patents

Abstract

Provided are a face recognition system and a face recognition method capable of improving the accuracy of recognizing a person's face when the position where an imaging unit can be arranged is limited.
A display unit, a display control unit that displays display information for guiding a person's line of sight on the display unit, a photographing unit that is provided near an outer edge of the display unit, and acquires an image; A recognition unit for recognizing a person's face captured in the image acquired at a timing when display information is displayed in the vicinity of the photographing unit. 1

Description

  The present invention relates to a face recognition system and a face recognition method.

  In recent years, with the development of image analysis technology, the person's face captured in the image is recognized, and the person's gender and age are estimated based on the recognized face image. Techniques for estimating what is present have been put into practical use.

  For example, in Patent Literature 1, an image of a person's face captured in an image is analyzed to identify the direction of the person's line of sight, thereby estimating an advertisement that the person is paying attention to. A technique for measuring the effect of the above is described.

JP 2008-112401 A

  On the other hand, the position where an apparatus for capturing a human image (hereinafter referred to as “photographing unit”) can be limited. For example, when displaying an advertisement on a large screen and recognizing the face of a customer who is viewing the advertisement, a photographing unit may be arranged at the top of the screen to photograph a customer located in front of the screen. is there. In such a case, since the image is taken so as to look down at the customer, the customer's face cannot be photographed from the front, and it is difficult to accurately recognize the customer's face.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to improve the accuracy of recognizing a person's face when the position where the photographing unit can be arranged is limited. It is an object of the present invention to provide a new and improved face recognition system and face recognition method.

  In order to solve the above problems, according to an aspect of the present invention, a display unit, a display control unit that displays display information for guiding a person's line of sight on the display unit, and the vicinity of an outer edge of the display unit An imaging unit that acquires an image, and a recognition unit that recognizes the face of a person captured in the image acquired at a timing when the display information is displayed in the vicinity of the imaging unit. A face recognition system is provided.

  The display control unit may guide a person's line of sight by displaying the display information so as to move along a predetermined route.

  The imaging unit may acquire the image in synchronization with a process in which the display control unit displays the display information.

  A plurality of the photographing units are provided, and the recognizing unit captures each of the plurality of photographing units in the image acquired by the photographing unit at a timing when the display information is displayed in the vicinity of the photographing unit. A person's face may be recognized.

  In order to solve the above-described problem, according to another aspect of the present invention, a step of displaying display information for guiding a person's line of sight on a display unit, and a photographing unit provided in the vicinity of an edge of the display unit And a step of recognizing a face of a person imaged in the image acquired at a timing when the display information is displayed in the vicinity of the photographing unit. The

  As described above, according to the present invention, it is possible to provide a face recognition system and a face recognition method capable of improving the accuracy of recognizing a person's face when the position where the photographing unit can be arranged is limited. Is possible.

It is the schematic which showed the external appearance of the face recognition system which concerns on embodiment of this invention. It is the block diagram which showed the structure of the face recognition system which concerns on embodiment of this invention. It is a figure for demonstrating operation | movement of the face recognition system which concerns on embodiment of this invention. It is a figure for demonstrating operation | movement of the face recognition system which concerns on embodiment of this invention. It is the flowchart which showed a series of operation | movement of the face recognition system which concerns on embodiment of this invention. It is the block diagram which showed the structure of the face recognition system which concerns on the modification of this invention. It is a figure for demonstrating operation | movement of the face recognition system which concerns on the modification of this invention.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

[Overview]
First, the outline of the face recognition system 1 according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic diagram illustrating an appearance of a face recognition system 1 according to the present embodiment. As shown in FIG. 1, the face recognition system 1 includes a display unit 200 having a display surface 201 that displays an image such as an advertisement, and a photographing unit 301 that captures an area in front of the display surface 201.

  Further, it is assumed that the person located in front of the display surface 201 includes a person u1 who is paying attention to the video v100 displayed on the display surface 201 and a person u2 who is not paying attention to the video v100. Is done. The face recognition system 1 according to the present embodiment captures the face of the person u1 who is paying attention to the video v100 among the persons located in front of the display surface 201, that is, the face of the person who is looking at the display surface 201 side. Recognition is performed based on the image acquired in step 301. In this way, by recognizing the face of the person who is looking at the display surface 201 side, the face recognition system 1 identifies the person u1 who is paying attention to the video v100 and the other person u2, or the video v100. The gender and age of the person u1 of interest is estimated.

  The photographing unit 301 is disposed in the vicinity of the outer frame of the display unit 200. For example, in the example illustrated in FIG. 1, the imaging unit 301 is disposed on the upper side of the display unit 200 and at the end in the horizontal direction. By providing the photographing unit 301 at such a position, it is possible to photograph the area in front of the display surface 201 without obstructing the field of view of the person u1 when the person u1 is looking at the display surface 201 side. Become.

  On the other hand, when the photographing unit 301 is disposed near the outer frame of the display unit 200, the face of the person u1 may not be photographed from the front. For example, as shown in FIG. 1, when the photographing unit 301 is arranged in the vicinity of the upper end of the display unit 200, photographing is performed so that the person u1 is looked down. May decrease.

  Thus, in the face recognition system 1 according to the present embodiment, the line of sight (face orientation) of the person u1 who is paying attention to the video displayed on the display surface 201 of the display unit 200 is guided, and the person u1 The image for face recognition (hereinafter, referred to as “face recognition image”) is acquired at the timing facing. Thereby, the face recognition system 1 can acquire an image obtained by photographing the face of the person u1 from the front, and can recognize the face of the person u1 with high accuracy without being limited to the arrangement position of the photographing unit 301. It becomes.

[Constitution]
Next, the configuration of the face recognition system 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing the configuration of the face recognition system 1 according to the present embodiment. As illustrated in FIG. 2, the face recognition system 1 according to the present embodiment includes a display unit 200, a display control unit 210, a photographing unit 301, a synchronization control unit 100, and an analysis unit 400. The analysis unit 400 includes a face recognition unit 401 and a recognition result processing unit 402.

  The display unit 200 includes a display surface 201 for displaying predetermined display information (for example, display information v100). Examples of the predetermined display information include advertisements and guidance.

  The display control unit 210 displays predetermined display information (for example, display information v100) on the display surface 201 of the display unit 200.

  Further, the display control unit 210 displays predetermined display information v500 for guiding the line of sight based on an instruction from the synchronization control unit 100 described later so as to move along a predetermined route r500 on the display surface 201. .

  The display information v500 is desirably displayed in a display mode that can guide the line of sight of the person u1 who is paying attention to the display information displayed on the display surface 201. As a specific example, the display control unit 210 may display, as the display information v500, an advertisement that attracts the interest of the person u1 who is paying attention to the display information displayed on the display surface 201. The display control unit 210 guides the line of sight of the person u1 to the display information v500 by not displaying other display information (for example, display information v100) on the display surface 201 while the display information v500 is being displayed. May be. Moreover, the content displayed as the display information v500 is not limited as long as the line of sight of the person u1 can be guided. For example, the information displayed as the display information v500 may be a figure such as a picture, a photograph, or a logo, or may be a phrase (character information) that attracts the person u1.

  A route r500 for moving the display information v500 is determined in advance so as to pass through an area located in the vicinity of the photographing unit 301 on the display surface 201. In this way, the display control unit 210 displays the display information v500 so as to move along the predetermined route r500, so that the line of sight of the person u1 who is paying attention to the information displayed on the display surface 201 is displayed on the route r500. To guide along. At this time, the route r500 is set so as to pass through the vicinity of the photographing unit 301, and thus the display control unit 210 can guide the line of sight of the person u1 toward the photographing unit 301.

  The imaging unit 301 is installed in the vicinity of the outer frame of the display unit 200 and acquires an image of an area located in front of the display surface 201. The imaging unit 301 outputs the acquired image to the synchronization control unit 100 described later based on an instruction from the synchronization control unit 100 described later. The image acquired by the imaging unit 301 is transmitted to the face recognition unit 401 through the synchronization control unit 100, and the face recognition unit 401 performs image analysis to recognize the face of the person captured in the acquired image. The That is, the photographing unit 301 outputs a face recognition image to the synchronization control unit 100 based on an instruction from the synchronization control unit 100.

  In addition, as the imaging | photography part 301, what image | photographs a still image (for example, camera) may be used, and what image | photographs a moving image (for example, video camera) may be used. In the case where an image capturing unit 301 that captures a still image is used, the image capturing unit 301 releases the shutter based on an instruction from the synchronization control unit 100 and outputs the acquired image to the synchronization control unit 100. In addition, in the case where an image capturing unit 301 that captures a moving image is used, for example, when the capturing unit 301 sequentially captures a moving image and receives an instruction from the synchronization control unit 100, an image at the timing at which the instruction is received, Cut out as a still image or a moving image of a predetermined period, and output the cut out image to the synchronization control unit 100.

  The synchronization control unit 100 synchronizes the process related to the display of the display information v500 for line-of-sight guidance by the display control unit 210 and the process related to the acquisition of the face recognition image by the imaging unit 301. Specifically, the synchronization control unit 100 causes the display control unit 210 to display the display information v500 so that the line of sight of the person u1 who is paying attention to the information displayed on the display surface 201 is directed toward the photographing unit 301. Induce. Then, the synchronization control unit 100 causes the photographing unit 301 to acquire a face recognition image at the timing when the line of sight (face orientation) of the person u1 faces the direction of the photographing unit 301. The synchronization control unit 100 outputs the face recognition image acquired by the photographing unit 301 to the face recognition unit 401. Note that details of a series of operations for obtaining the face recognition image by guiding the line of sight of the person u1 in the direction of the photographing unit 301 by the synchronization control unit 100, the display control unit 210, and the photographing unit 301 are described in “Gaze Line”. The details of guidance and image acquisition ”will be described later.

  The face recognition unit 401 acquires the face recognition image acquired by the photographing unit 301 from the synchronization control unit 100. The face recognition unit 401 performs analysis processing on the face recognition image acquired from the synchronization control unit 100 and recognizes the face of a person captured in the acquired face recognition image. As a specific example, the face recognizing unit 401 detects features of shapes such as relative positions and sizes of facial parts, eyes, nose, cheekbones, chins, and the like, and determines a facial region from the image based on the detection result. It may be specified. Note that the content of analysis processing for face recognition is not limited as long as the face of a person captured in the acquired image can be recognized. For example, the face recognition unit 401 may recognize a person's face by detecting a part with a characteristic shadow, such as around the eyes or around the nose.

  The face recognition unit 401 recognizes the face recognition image acquired by the imaging unit 301 and the information indicating the face area of each person captured in the face recognition image acquired by the imaging unit 301. The data is output to the processing unit 402.

  The recognition result processing unit 402 displays the face recognition image acquired by the shooting unit 301 and information indicating the face area of each person captured in the face recognition image acquired by the shooting unit 301. Obtained from the recognition unit 401. The recognition result processing unit 402 extracts each person's face from the acquired face recognition image based on the information indicating the face area. The recognition result processing unit 402 analyzes the extracted facial features and estimates the gender and age of the person corresponding to the face. The recognition result processing unit 402 classifies each person captured in the image based on the estimation result according to gender and age, and totals the number of persons corresponding to each classification. In this manner, by classifying the persons whose faces are recognized and counting the number of persons for each classification, for example, the display information displayed on the display surface 201 at the timing when the face recognition image is acquired is displayed. It becomes possible to analyze the tendency of the person who has focused.

[Details of gaze guidance and image acquisition]
Next, referring to FIGS. 3 and 4, the synchronization control unit 100, the display control unit 210, and the imaging unit 301 guide the line of sight of the person u <b> 1 in the direction of the imaging unit 301 to acquire a face recognition image. Details of the series of operations will be described. 3 and 4 are diagrams for explaining the operation of the face recognition system 1 according to the present embodiment.

  First, referring to FIG. The synchronization control unit 100 instructs the display control unit 210 to display the display information v500 for guiding the line of sight of a person located in front of the display surface 201 at a predetermined timing. Upon receiving an instruction from the synchronization control unit 100, the display control unit 210 displays the display information v500 at a predetermined position on the display surface 201 as shown in FIG.

  When the display information v500 is displayed on the display surface 201, the display control unit 210 moves the display information v500 along a predetermined route r500 on the display surface 201. At this time, the display control unit 210 may display the display information v500 so as to continuously move, or may cause the display information v500 to be displayed so as to move intermittently while repeating display and non-display. . In this way, the display control unit 210 displays the display information v500 so as to move along the predetermined route r500, so that the line of sight of the person u1 who is paying attention to the information displayed on the display surface 201 is displayed on the route r500. To guide along.

  The display control unit 210 moves the display information v500 along the predetermined route r500 to at least a predetermined region located in the vicinity of the photographing unit 301 on the display surface 201.

  Reference is now made to FIG. FIG. 4 shows a state in which the display information v500 is displayed in the vicinity of the position on the display surface 201 where the imaging unit 301 is installed. As illustrated in FIG. 4, the synchronization control unit 100 causes the photographing unit 301 to acquire a face recognition image at the timing when the display information v <b> 500 is displayed in the vicinity of the photographing unit 301.

  The method is not limited as long as the synchronization control unit 100 can recognize the timing at which the display information v500 is displayed in the vicinity of the photographing unit 301. For example, the display control unit 210 may notify the synchronization control unit 100 that the display information v500 is displayed in the vicinity of the photographing unit 301 at the timing when the display information v500 is displayed in the vicinity of the photographing unit 301. In this case, the synchronization control unit 100 may cause the photographing unit 301 to acquire an image at the timing when the notification is received from the display control unit 210.

  As another example, the synchronization control unit 100 may time-synchronize the process of displaying the display information v500 by the display control unit 210 and the image acquisition process by the imaging unit 301. In this case, the synchronization control unit 100 notifies the display control unit 210 and the imaging unit 301 of the timing for displaying the display information v500 in the vicinity of the imaging unit 301. The display control unit 210 may control the movement of the display information v500 so that the display information v500 is displayed in the vicinity of the photographing unit 301 at the timing notified from the synchronization control unit 100. Further, the photographing unit 301 may acquire an image at the timing notified from the synchronization control unit 100.

  When the display information v500 is displayed in the vicinity of the imaging unit 301, the person u1 whose line of sight is guided by the display information v500 is facing the direction of the imaging unit 301. In other words, the person u1 who is paying attention to the display information displayed on the display surface 201 is in a state where the line of sight is guided by the display information v500 and is directed toward the photographing unit 301. Similarly, the person u2 whose latitude line is not guided by the display information v500, that is, the person u2 not paying attention to the display information displayed on the display surface 201 does not face the direction of the photographing unit 301.

  Note that the display mode of the display information displayed on the display surface 201 is not limited as long as the line of sight of the person u1 who is paying attention to the display information displayed on the display surface 201 can be guided. For example, the display control unit 210 may display the display information v500 for guiding the line of sight and other display information v100 on the display surface 201. In this case, the display control unit 210 may guide the line of sight of the person u1 toward the display information v500 instead of the display information v100 by highlighting the display information v500 by highlighting the display information v500.

  Further, the display control unit 210 may display the display information v500 that is related to the display information v100 and that attracts the interest of the person u1. For example, when displaying an advertisement for a certain product as the display information v100, the display control unit 210 displays information that attracts the interest of the person u1, such as the release date and price of the product displayed in the display information v100. You may display as display information v500.

  As described above, in the face recognition system 1 according to the present embodiment, the line of sight of the person u1 who is paying attention to the display information displayed on the display surface 201 is guided in the direction of the photographing unit 301, and the photographing unit 301 To get. At this time, in the face recognition image acquired by the imaging unit 301, the face of the person facing the imaging unit 301 is captured in a state of facing the front. Therefore, the face of the person u1 who is paying attention to the display information displayed on the display surface 201 can be recognized with high accuracy.

  In addition, there is a high possibility that the face of the person u2 whose line of sight has not been guided is captured in a state in which the face is directed in a direction other than the front. Therefore, the face of the person u1 who is not paying attention to the display information, that is, the face of the person u1 who is not paying attention to the display information displayed on the display surface 201 is recognized with higher accuracy. Is done. Thereby, the face recognition system 1 according to the present embodiment estimates that a person with a high recognition rate of the face imaged in the image is a person who is paying attention to the display information displayed on the display surface 201. Is possible.

[processing]
Next, a series of operations of the face recognition system 1 according to the present embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing a series of operations of the face recognition system 1 according to the present embodiment.

(Step S101)
The synchronization control unit 100 instructs the display control unit 210 to display the display information v500 for guiding the line of sight of a person located in front of the display surface 201 at a predetermined timing. Upon receiving an instruction from the synchronization control unit 100, the display control unit 210 displays the display information v500 at a predetermined position on the display surface 201 (see FIG. 3).

(Step S102)
When the display information v500 is displayed on the display surface 201, the display control unit 210 moves the display information v500 along a predetermined route r500 on the display surface 201. At this time, the display control unit 210 may display the display information v500 so as to continuously move, or may cause the display information v500 to be displayed so as to move intermittently while repeating display and non-display. .

(Step S103)
In this way, the display control unit 210 displays the display information v500 so as to move along the predetermined route r500, so that the line of sight of the person u1 who is paying attention to the information displayed on the display surface 201 is displayed on the route r500. To guide along. The display control unit 210 moves the display information v500 along the predetermined route r500 to at least a predetermined area located in the vicinity of the photographing unit 301 on the display surface 201 (step S103, N).

(Step S104)
When the display information v500 is displayed near the photographing unit 301 (step S103, Y), the synchronization control unit 100 causes the photographing unit 301 to acquire a face recognition image.

  The method is not limited as long as the synchronization control unit 100 can recognize the timing at which the display information v500 is displayed in the vicinity of the photographing unit 301. For example, the display control unit 210 may notify the synchronization control unit 100 that the display information v500 is displayed in the vicinity of the photographing unit 301 at the timing when the display information v500 is displayed in the vicinity of the photographing unit 301. In this case, the synchronization control unit 100 may cause the photographing unit 301 to acquire an image at the timing when the notification is received from the display control unit 210.

  As another example, the synchronization control unit 100 may time-synchronize the process of displaying the display information v500 by the display control unit 210 and the image acquisition process by the imaging unit 301. In this case, the synchronization control unit 100 notifies the display control unit 210 and the imaging unit 301 of the timing for displaying the display information v500 in the vicinity of the imaging unit 301. The display control unit 210 may control the movement of the display information v500 so that the display information v500 is displayed in the vicinity of the photographing unit 301 at the timing notified from the synchronization control unit 100. Further, the photographing unit 301 may acquire an image at the timing notified from the synchronization control unit 100.

  The synchronization control unit 100 outputs the face recognition image acquired by the photographing unit 301 to the face recognition unit 401.

(Step S105)
The face recognition unit 401 acquires the face recognition image acquired by the photographing unit 301 from the synchronization control unit 100. The face recognition unit 401 performs analysis processing on the face recognition image acquired from the synchronization control unit 100 and recognizes the face of a person captured in the acquired face recognition image.

  The face recognition unit 401 recognizes the face recognition image acquired by the imaging unit 301 and the information indicating the face area of each person captured in the face recognition image acquired by the imaging unit 301. The data is output to the processing unit 402.

  The recognition result processing unit 402 displays the face recognition image acquired by the shooting unit 301 and information indicating the face area of each person captured in the face recognition image acquired by the shooting unit 301. Obtained from the recognition unit 401. The recognition result processing unit 402 extracts each person's face from the acquired face recognition image based on the information indicating the face area. The recognition result processing unit 402 analyzes the extracted facial features and estimates the gender and age of the person corresponding to the face. The recognition result processing unit 402 classifies each person captured in the image based on the estimation result according to gender and age, and totals the number of persons corresponding to each classification. In this manner, by classifying the persons whose faces are recognized and counting the number of persons for each classification, for example, the display information displayed on the display surface 201 at the timing when the face recognition image is acquired is displayed. It becomes possible to analyze the tendency of the person who has focused.

  As described above, in the face recognition system 1 according to this embodiment, the line of sight of the person u1 who is paying attention to the display information displayed on the display surface 201 is guided in the direction of the photographing unit 301, and the face is captured by the photographing unit 301. Acquire an image for recognition. Accordingly, the face recognition system 1 according to the present embodiment increases the face of the person u1 who is paying attention to the display information displayed on the display surface 201 even if the position where the photographing unit 301 can be arranged is limited. It becomes possible to recognize with accuracy.

  In addition, there is a high possibility that the face of the person u2 whose line of sight has not been guided is captured in a state in which the face is directed in a direction other than the front. Therefore, the face of the person u1 who is not paying attention to the display information, that is, the face of the person u1 who is not paying attention to the display information displayed on the display surface 201 is recognized with higher accuracy. Is done. Thereby, the face recognition system 1 according to the present embodiment estimates that a person with a high recognition rate of the face imaged in the image is a person who is paying attention to the display information displayed on the display surface 201. Is possible.

  The series of operations described above can be configured by a program for causing the CPU of a device that operates each component of the face recognition system 1 to function. This program may be configured to be executed via an OS (Operating System) installed in the apparatus. In addition, the position of the program is not limited as long as the apparatus including the configuration for executing the above-described processing can be read. For example, the program may be stored in a recording medium connected from the outside of the apparatus. In this case, it is preferable to connect the recording medium storing the program to the apparatus so that the CPU of the apparatus executes the program.

[Modification]
Next, a face recognition system 1a according to a modification of the present invention will be described. In the face recognition system 1 according to the above-described embodiment, the face recognition of the person u1 is performed based on the image acquired by the single photographing unit 301. The face recognition system 1a according to the modification includes a plurality of photographing units 301, and based on the face recognition images acquired by each photographing unit 301, the person u1 who is paying attention to the display information displayed on the display surface 201 is displayed. It is different from the face recognition system 1 according to the above-described embodiment in that the face is recognized.

  Hereinafter, with reference to FIG. 6, the configuration of the face recognition system 1 a according to the modification will be described by focusing on portions different from the face recognition system 1 according to the above-described embodiment. FIG. 6 is a block diagram showing a configuration of a face recognition system 1a according to a modification. A detailed description of the configuration that operates in the same manner as the face recognition system 1 according to the above-described embodiment will be omitted.

  As illustrated in FIG. 6, the face recognition system 1 a includes photographing units 301 a to 301 c as a plurality of photographing units 301. In addition, when it is not necessary to particularly distinguish the imaging units 301a to 301c, the imaging units 301a to 301c are simply described as “imaging unit 301”. In the example illustrated in FIG. 6, the imaging units 301 a to 301 c are arranged at different positions near the outer edge of the display unit 200, and each captures an area on the front surface of the display surface 201 from different directions.

  Next, referring to FIG. 7, a series of operations for acquiring a face recognition image by guiding the line of sight of the person u1 toward the photographing unit 301 by the synchronization control unit 100, the display control unit 210, and the photographing unit 301. Details will be described. FIG. 7 is a diagram for explaining the operation of the face recognition system 1a according to the modification.

  As shown in FIG. 7, in the face recognition system 1a according to the modification, a route r500 for moving the display information v500 is set in advance so as to pass in the vicinity of each of the imaging units 301a to 301c. For example, in the example illustrated in FIG. 7, the display control unit 210 displays the display information v500 along a route r500 set in advance so as to pass through the vicinity of each imaging unit 301 in the order of the imaging units 301a, 301b, and 301c. Will be moved.

  Hereinafter, the case shown in FIG. 7 will be described in detail. The synchronization control unit 100 instructs the display control unit 210 to display the display information v500 for guiding the line of sight of a person located in front of the display surface 201 at a predetermined timing. When receiving an instruction from the synchronization control unit 100, the display control unit 210 displays the display information v <b> 500 at a predetermined position on the display surface 201.

  When the display information v500 is displayed on the display surface 201, the display control unit 210 moves the display information v500 along a predetermined route r500 on the display surface 201. The operation so far is the same as that of the face recognition system 1 according to the above-described embodiment.

  When the display information v500 is displayed at a position v500a in the vicinity of the photographing unit 301a on the display surface 201, the synchronization control unit 100 causes the photographing unit 301a to acquire a face recognition image. The imaging unit 301a outputs the acquired face recognition image to the synchronization control unit 100.

  Similarly, when the display information v500 is displayed at a position v500b in the vicinity of the photographing unit 301b on the display surface 201, the synchronization control unit 100 causes the photographing unit 301b to acquire a face recognition image. Further, when the display information v500 is displayed at a position v500c in the vicinity of the photographing unit 301b on the display surface 201, the synchronization control unit 100 causes the photographing unit 301c to acquire a face recognition image. Each of the imaging unit 301 b and the imaging unit 301 c outputs the acquired face recognition image to the synchronization control unit 100.

  The synchronization control unit 100 outputs the face recognition images acquired by the photographing units 301 a to 301 c to the face recognition unit 401. The face recognition unit 401 performs analysis processing on the face recognition images acquired by the photographing units 301a to 301c, and recognizes the face of a person captured in the acquired face recognition images. The subsequent processing is the same as in the above-described embodiment.

  As described above, the face recognition system 1a according to the modification example includes a plurality of photographing units 301, and pays attention to display information displayed on the display surface 201 based on the face recognition images acquired by the photographing units 301. The face of the person u1 is recognized. As described above, the face recognition system 1a according to the modified example uses a plurality of photographing units 301, and even when each photographing unit 301 cannot photograph the entire area in front of the display surface 201, a plurality of photographing units. It is possible to share the area to be imaged in 301 and acquire an image of each area.

  Further, even when the face of the person u1 to whom the line of sight is guided is recognized, it is possible to acquire face recognition images by the plurality of photographing units 301, respectively. Therefore, for example, by recognizing the face of the person u1 based on the face recognition image acquired by the photographing unit 301 closest to the person u1, the face of the person u1 can be recognized with higher accuracy. .

  It is also possible to arrange each photographing unit 301 so as to acquire a face recognition image from a different angle. Therefore, the face recognition system 1a is based on the face recognition image captured by each capturing unit 301, and a specific person u1 in the image has a line of sight guided in each image, that is, displayed on the display surface 201. It is possible to determine whether attention is paid to the displayed information. Thus, the face recognition system 1a can distinguish between a person who happens to be in the direction of the photographing unit 301 and a person whose line of sight is guided by the display information v500. That is, by using a plurality of imaging units 301, the face recognition system 1a pays attention to display information displayed on the display surface 201 with higher accuracy than the face recognition system 1 according to the above-described embodiment. A person can be estimated.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

1, 1a Face recognition system 100 Synchronization control unit 200 Display unit 201 Display surface 210 Display control unit 301, 301a, 301b, 301c Imaging unit 400 Analysis unit 401 Face recognition unit 402 Recognition result processing unit

Claims (5)

A display unit;
A display control unit for displaying display information for guiding a person's line of sight on the display unit;
An imaging unit that is provided near the outer edge of the display unit and acquires an image;
A recognition unit for recognizing a person's face captured in the image acquired at a timing when the display information is displayed in the vicinity of the photographing unit;
A face recognition system characterized by comprising:   The face recognition system according to claim 1, wherein the display control unit guides a person's line of sight by displaying the display information so as to move along a predetermined route.   The face recognition system according to claim 1, wherein the photographing unit acquires the image in synchronization with a process in which the display control unit displays the display information. A plurality of the photographing units are provided,
The recognizing unit recognizes the face of a person captured in the image acquired by the photographing unit at a timing when the display information is displayed in the vicinity of the photographing unit for each of the plurality of photographing units. The face recognition system as described in any one of Claims 1-3 characterized by these. Displaying display information for guiding a person's line of sight on the display unit;
Acquiring an image by a photographing unit provided in the vicinity of an edge of the display unit;
Recognizing the face of a person captured in the image acquired at a timing when the display information is displayed in the vicinity of the photographing unit;
A face recognition method comprising:

Images