CN107832745A - Face authentication method, Intelligent mirror and storage medium - Google Patents

Abstract

The present invention provides a face authentication method, which is applied to a smart mirror, the smart mirror includes the mirror display, the mirror display includes at least one camera device, a mirror display unit and a mirror, and the mirror display unit passes through the The first part of the mirror displays information, the second part of the mirror is used for imaging, and the at least one camera device is embedded in the second part, when it is detected that a user is looking at the mirror, through the at least one A camera shoots the user and obtains the picture taken; determines the face image of the user from the picture taken; authenticates the face image of the user; when the face image of the user When the authentication is successful, record the user; and display information associated with the user on the mirror display unit. The invention also provides a smart mirror and a storage medium. The present invention provides users with personalized customization functions and improves user experience.

Description

Face authentication method, smart mirror and storage medium

technical field

The invention relates to the technical field of artificial intelligence, in particular to a face authentication method, a smart mirror and a storage medium.

Background technique

When the current mirror display has people in front, the mirror display displays a video image. When there is no one in front of the mirror display, the mirror display unit of the mirror display is turned off, and the mirror display unit of the mirror display can be used as a mirror for grooming. Although the mirror display in the prior art can also realize the function of grooming in addition to displaying images, it cannot realize the personalized customization function, and the user experience is relatively simple.

Contents of the invention

In view of the above, it is necessary to provide a face authentication method, which can realize the user's personalized customization function through the mirror display, and improve the user experience.

A face authentication method applied in a smart mirror, the smart mirror includes the mirror display, the mirror display includes at least one camera device, a mirror display unit, and a mirror, and the mirror display unit passes through the mirror's first A part displays information, the second part of the mirror is used for imaging, and the at least one camera is embedded in the second part, the method includes:

When it is detected that a user is looking at the mirror, the user is photographed by the at least one camera device, and the photographed picture is obtained;

determining the face image of the user from the captured picture;

Authenticate the user's face image;

When the face image authentication of the user is successful, record the user;

Information associated with the user is displayed on a mirror display unit of the mirror display.

According to a preferred embodiment of the present invention, there are multiple at least one camera, and different cameras have different camera ranges. When it is detected that a user is looking at the mirror, the at least one camera will The user mentioned above takes pictures, and the captured pictures include:

When it is detected that a user is looking at the mirror, calculate the height of the user;

According to the corresponding relationship between the height and the imaging range of the imaging device, determine the target imaging range corresponding to the height of the user, and determine the target imaging device to which the target imaging range belongs;

The user is photographed by the target photographing device to obtain photographed pictures.

According to a preferred embodiment of the present invention, when it is detected that a user is looking at the mirror, calculating the height of the user includes:

When it is detected that a user is looking at the mirror, an image is acquired through the at least one camera device;

When the user image in the acquired image has a whole-body image, determine the camera that acquires the whole-body image from the at least one camera;

Determining the distance between the user and the lens of the determined camera device;

Obtaining the distance between the lens of the determined camera device and the image sensor of the determined camera device and the imaging height of the user on the image sensor of the determined camera device;

According to the distance between the user and the lens of the determined camera device, the distance between the lens of the determined camera device and the image sensor of the determined camera device, and the distance between the user and the image sensor of the determined camera device Calculate the height of the user based on the imaging height above.

According to a preferred embodiment of the present invention, when the user's face image authentication is successful, recording the user includes one or more of the following combinations:

When the face image authentication of the user is successful, obtain the current time, record the current time and the information of the user;

When the user's face image authentication is successful, a control command is sent to the access control device communicating with the smart mirror to control the access control device to open.

According to a preferred embodiment of the present invention, the displaying the information associated with the user on the mirror display unit of the mirror display includes one or more of the following combinations:

displaying the reminder information of the user on the mirror display unit of the mirror display;

When the current time matches the user's blessing date, the blessing information is displayed on the mirror display unit of the mirror display.

According to a preferred embodiment of the present invention, the method further includes:

When it is detected that the user leaves the monitoring area of the smart mirror, the mirror display unit is turned off, and the mirror display unit forms a complete mirror through the first part and the second part of the mirror;

When the trigger signal of the switch of the mirror display unit is obtained, and the trigger switch of the mirror display unit is in the closed state, the mirror display unit is turned off, and the mirror display unit passes through the first part and the mirror. The second part makes up the complete mirror.

According to a preferred embodiment of the present invention, the method further includes:

Get interactive signals;

The information associated with the user is displayed on the mirror display unit of the mirror display through the interaction signal.

According to a preferred embodiment of the present invention, the interaction signal includes a voice signal, a gesture signal, and a touch signal.

A smart mirror, the smart mirror includes the mirror display, memory and processor, the mirror display includes at least one camera, a mirror display unit and a mirror, the mirror display unit displays information through the first part of the mirror , the second part of the mirror is used for imaging, and the at least one camera is embedded in the second part, the memory is used to store at least one instruction, and the processor is used to execute the at least one instruction to Realize the face authentication method described in any one of any embodiment.

A computer-readable storage medium, the computer-readable storage medium stores at least one instruction, and when the at least one instruction is executed by a processor, it implements any one of the face authentication methods in any implementation.

It can be seen from the above technical solutions that when the present invention detects that a user enters the monitoring area of the smart mirror, the user is photographed by the at least one camera device to obtain photographed pictures; from the photographed pictures Determine the face image of the user; authenticate the user's face image; when the user's face image authentication is successful, record the user; display on the mirror display unit of the mirror display and Information associated with the user. The present invention can realize authentication-related applications through the mirror display, and enable users to pay attention to their own appearance, and at the same time provide users with personalized customization functions, provide users with item reminders and provide humanistic care information, in addition, it can be applied to all users and improve user experience.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.

Fig. 1 is a schematic plan view of a preferred embodiment of the smart mirror of the present invention.

Fig. 2 is a flowchart of a preferred embodiment of the face authentication method of the present invention.

Fig. 3 is a functional block diagram of a preferred embodiment of the face authentication device of the present invention.

Fig. 4 is another structural schematic diagram of the smart mirror in at least one example of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

In order to enable those skilled in the art to better understand the solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

The terms "first", "second" and "third" in the specification and claims of the present invention and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the term "comprise", as well as any variations thereof, is intended to cover a non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or apparatuses.

As shown in FIG. 1 , it is a schematic plan view of a preferred embodiment of the smart mirror of the present invention.

As shown in FIG. 1 , the smart mirror 1 includes, but is not limited to, a casing and a mirror display 11 . The casing and the mirror display 11 are installed in combination, so that a closed accommodation space is formed between the casing and the mirror display 11 .

The mirror display 11 includes, but is not limited to: at least one camera device 110 , a mirror display unit 111 and a mirror 112 . The components included in the smart mirror 1 are not limited to the above-mentioned ones.

The mirror display unit 111 is disposed in the receiving space.

The mirror 112 is composed of a first part and a second part. The first part corresponds to the mirror display unit 111 . The back side of the first part of the mirror 112 does not have a metal film, but serves as a plane mirror. The front side of the second part of the mirror 112 can be imaged. When the mirror display unit 111 is in the working state, the mirror display unit 111 is used to display information through the first part; when the mirror display unit 111 is in the closed state, the mirror display unit 111 can display information through the first part One part forms a complete mirror surface with the second part.

The camera device 110 is rotatably embedded in the second portion of the mirror 112 .

Preferably, the at least one camera device 110 is a camera. A camera with a small size can be selected, such as a pinhole camera, which is conducive to the concealment of the camera and does not affect the overall appearance of the mirror 112 .

Because different users have different heights, in order to capture face pictures of all users. Preferably, there are multiple at least one camera device 100 , and each camera device 110 has a different installation height, so different camera devices 100 have different camera ranges.

For example, it includes a first camera and a second camera, the camera range of the first camera is used to shoot users with a height of 1.4 to 1.5 meters, and the camera range of the second camera is used to shoot users with a height of 1 meter. Users of meters 5 to 1.6 meters and so on.

Further, when the users of the application scene are known, the average height, the minimum height, and the maximum height of the users can be calculated in advance. According to the user's average height, minimum height, and maximum height, the installation height of each camera device is pre-configured. For example, the application scenario is used for the certification of the college entrance examination examination room, and the average height, minimum height, and maximum height of candidates can be counted in advance, and the installation height of each camera device can be configured.

Preferably, the mirror display unit 111 is a liquid crystal display.

As shown in FIG. 2 , it is a flowchart of a preferred embodiment of the face authentication method of the present invention. According to different requirements, the order of the steps in the flowchart can be changed, and some steps can be omitted.

S10, when it is detected that a user is looking at the mirror 112, the smart mirror 1 uses the at least one camera device 110 to take a picture of the user, and obtain a picture taken.

Preferably, when a user is detected to be in the monitoring area of the smart mirror 1 and a user is detected to be looking at the mirror 112, that is, the mirror 112 can mirror the user's face. The at least one camera device 110 may take a picture of the user, and the picture taken has the user's face.

It should be noted that in specific occasions where grooming is more important, or in workplaces where designated clothing is required, a mirror needs to be installed for grooming. In this embodiment, the camera 110 is rotatably embedded in the mirror 112 , and when the user looks at the mirror 112 , the camera 110 can take pictures of the user. The picture has a human face.

In the present invention, there are many ways to detect that a user enters the monitoring area of the smart mirror 1 . It is not limited to the manner described below.

Preferably, the at least one camera 110 is multiple, and the monitoring area of the smart mirror 1 is captured by the at least one camera 110, and whether there are pedestrians is judged from the captured pictures. When there are pedestrians, the smart mirror 1 detects that a user enters the monitoring area of the smart mirror 1; within the surveillance area.

Optionally, the smart mirror 1 communicates with a pedestrian detection sensor, and the pedestrian detection sensor is used to detect whether there are people in the monitoring area of the smart mirror 1, and the smart mirror 1 obtains the pedestrian detection sensor's Test results. For example, the pedestrian detection sensors include, but are not limited to: ultrasonic-based pedestrian detection sensors, far-infrared-based pedestrian detection sensors, laser scanning pedestrian detectors, and the like.

In the present invention, there are many ways to monitor whether the user is looking at the mirror 112 . It is not limited to the manner described below.

Preferably, the at least one camera 110 is multiple, and the monitoring area of the smart mirror 1 is captured by the at least one camera 110, and whether there is a frontal portrait is judged from the captured picture. When there is a frontal portrait, the smart mirror 1 detects that a user is looking at the mirror 112; when there is no frontal portrait in the captured picture, the smart mirror 1 detects that the user is not looking at the mirror 112.

In the present invention, when it is detected that a user enters the monitoring area of the smart mirror 1, the smart mirror 1 needs to call a suitable camera device 110 to take pictures of the user, so as to obtain a face image of the user.

Therefore, the smart mirror 1 takes pictures of the user through the at least one camera 110, and obtaining the pictures taken includes:

(a1) When it is detected that a user is looking at the mirror 112, calculate the height of the user.

Optionally, the calculating the height of the user includes:

(a11) When it is detected that a user is looking at the mirror 112, the at least one camera device 110 is used to acquire an image.

(a12) When the user image in the captured image has a whole-body image, determine the camera device that captures the whole-body image from the at least one camera device 110; determine the distance between the user and the lens of the determined camera device.

(a13) Obtain the distance between the lens of the determined camera device and the image sensor of the determined camera device and the imaging height of the user on the image sensor of the determined camera device.

(a14) According to the distance between the user and the lens of the determined camera device, the distance between the lens of the determined camera device and the image sensor of the determined camera device, and the distance between the user and the lens of the determined camera device The imaging height on the image sensor is used to calculate the user's height.

Further, there are many ways to determine the distance between the user and the determined lens of the camera device, for example, a ranging method based on binocular matching, etc., which are not limited in the present invention.

(a2) Determine the target imaging range corresponding to the user's height according to the correspondence between the height and the imaging range of the imaging device 110, and determine the target imaging device to which the target imaging range belongs.

(a3) Using the target imaging device to photograph the user, and obtain photographed pictures.

Through the above implementation manners, the present invention can acquire face images of users of different heights. For example, three cameras are arranged on the mirror display, a first camera, a second camera and a second camera, each camera has a different installation height, and each camera has a different camera range. The imaging range of the first imaging device is used to photograph users whose height is 1.2 to 1.5 meters, the imaging range of the second imaging device is used to photograph users whose height is 1.5 to 1.8 meters, and the third The camera range of the camera device is used to shoot users whose height is between 18 meters and 2 meters. When a user enters the monitoring area of the smart mirror, the user's height is calculated as 1.65, and the second camera is called to take pictures of the user to capture the user's face image. In this way, users of different heights can be captured, and the users do not need to cooperate with the camera device. The present invention can identify the features of users of different heights, and at the same time facilitates the display of subsequent personalized information and the like.

S11, the smart mirror 1 determines the face image of the user from the captured picture.

In the embodiment of the present invention, a face detection method is used to determine the user's face image from the captured pictures. The face detection method is a prior art, and the present invention does not impose any limitation thereon.

S12, the smart mirror 1 authenticates the face image of the user.

In an optional embodiment of the present invention, the smart mirror 1 reads a pre-stored face data set, and matches the user's face image with the face data in the pre-stored face data set, Judging whether the face image of the user belongs to the face data in the pre-stored face data set. For example, the pre-stored face data set may be the face data of all employees of a certain company, the face data of members of a certain shop, and so on.

When the similarity between the user's face image and one face data in the pre-stored face data set is greater than or equal to a similarity threshold, it is determined that the user's face image authentication is successful.

When there is no face data in the pre-stored face data set whose similarity with the user's face image is greater than or equal to the similarity threshold, it is determined that the user's face image authentication has failed, and the The unit is mirrored and an authentication failure message is displayed.

S13. When the user's face image authentication is successful, the smart mirror records the user.

In an optional embodiment of the invention, when the user's face image authentication is successful, recording the user includes one or more of the following combinations:

(b1) When the user's face image authentication is successful, obtain the current time, and record the current time and the information of the user. In this way, the smart mirror can be used for checking attendance, registering entrances and exits, and the like.

(b2) When the user's face image authentication is successful, send a control command to the access control device communicating with the smart mirror 1 to control the access control device to open. In this way, the smart mirror 1 can be used as an access control monitoring device, etc., to automatically open the door for the authenticated user.

S14, the smart mirror 1 displays information associated with the user on the mirror display unit 111 of the mirror display 11 .

In an optional implementation of the present invention, the displaying the information associated with the user on the mirror display unit 111 of the mirror display 11 includes one or a combination of the following: The user's reminder information is displayed on the unit 111 ; when the current time matches the user's blessing date, the blessing information is displayed on the mirror display unit 111 of the mirror display 11 . In this way, personalized information push is realized according to the identity of the user.

Further, the reminder information includes one or more combinations of the following, but not limited to: schedule reminders, task reminders, meeting reminders, to-do item reminders, notification reminders, and the like. This allows for personalized reminders of things to remember.

For example, if the smart mirror 1 is installed at the company's access control position, when the company's employees are looking at the mirror 112, the employees will be identified and authenticated, and counted in attendance, so as to realize the automatic attendance function, and enable the employees to check the attendance according to the The mirror 112 pays attention to one's own grooming. In addition, when an employee is identified, the employee's schedule, meetings, to-do items, etc. are displayed on the mirror display unit 111 to remind the employee of work items that need to be followed up in time. Since the camera device embedded in the mirror is relatively small, personalized information related to the user can also be pushed while not affecting the user looking in the mirror.

For example, if the smart mirror 1 is installed at the entrance of the community, when the owner is looking at the mirror 112, it will automatically identify and authenticate, and close the door for the owner, and at the same time display the owner’s unfinished business on the mirror display unit 111, Remind the owner to handle in time, and at the same time, when the owner goes in and out of the door every day, he also pays attention to his appearance according to the mirror 112, so that his daily life is more energetic and so on.

Further, the blessing dates include, but are not limited to: birthday dates, wedding anniversaries and other important holiday dates. For example, if the smart mirror is installed at the company's access control position, when the company's employees walk into the monitoring area of the smart mirror, the employees will be identified and authenticated, and counted in attendance, so as to realize the automatic attendance function, and on the employee's birthday At the same time, give blessings to employees as soon as they enter the company, embody humanistic care, make employees more pleasantly surprised, etc.

In an optional embodiment of the present invention, the method further includes: acquiring an interaction signal; and operating the information associated with the user displayed on the mirror display unit 111 through the interaction signal. In this way, interactive functions can be added to facilitate users to view advertisement information.

Further, the interaction signal includes, but is not limited to: voice signal, gesture signal, touch signal and so on. In this way, interactive functions can be added to facilitate users to view advertisement information.

Further, the mirror display 11 includes: a speech recognition component, a gesture recognition component, and a touch recognition component.

The smart mirror 1 recognizes the voice signal through the voice recognition component, and the user can interact with the mirror display 11 through voice. The smart mirror recognizes gesture signals through the gesture recognition component, and the user can interact with the mirror display 11 through gestures. The smart mirror 1 recognizes the touch signal through the touch recognition component, and the user can interact with the mirror display 11 through touch.

For example, it is displayed on the mirror display unit 111 that the user has an urgent task, and the user can input the voice of "open task", and the voice recognition component recognizes the voice, and displays the urgent task on the mirror display unit 111. , so that users can deal with urgent matters in a timely manner.

In an optional embodiment of the present invention, when it is detected that the user leaves the monitoring area of the smart mirror 1, the smart mirror 1 turns off the mirror display unit 111, and the mirror display unit 111 can pass the The first part and the second part form a complete mirror surface. In this way, when no one is in front of the mirror, a complete mirror is presented, which is convenient for the user to look at the mirror.

In an optional embodiment of the present invention, when the trigger signal of the switch of the mirror display unit 111 is obtained and the switch triggering the mirror display unit 111 is in the off state, the mirror display unit is turned off, and the mirror The display unit 111 can form a complete mirror through the first part and the second part. In this way, when no one is in front of the mirror, a complete mirror is presented, which is convenient for the user to look at the mirror.

The trigger signal includes, but is not limited to: voice signal, gesture signal, touch signal and so on.

For example, the user inputs a voice "turn off the switch of the mirror display", and the voice recognition component triggers the voice to turn off the switch of the mirror display unit 111 . For example, the user inputs a gesture of waving to the left, and the gesture recognition component recognizes the gesture of waving to the left, and triggers the switch of the mirror display unit 111 to be in an off state. Touching the switch of the mirror display unit 111 on the mirror display unit 111 makes the mirror display unit 111 in an off state and so on.

In the present invention, the application of the smart mirror 1 is not limited to the above-mentioned application examples, and can also be applied to other scenarios, for example, entrances and exits of conferences, entrances and exits of examination rooms, and so on. The present invention does not impose any limitation on the application scenarios of the smart mirror.

In the present invention, the smart mirror includes the mirror display, the mirror display includes at least one camera device, a mirror display unit and a mirror, the first part of the mirror corresponds to the mirror display unit, and the mirror display unit passes through the The first section displays information. When it is detected that a user is looking at the mirror, the user is photographed by the at least one camera device, and the photographed picture is acquired; the face image of the user is determined from the photographed picture; The user's face image is authenticated; when the user's face image is successfully authenticated, the user is recorded; and the information associated with the user is displayed on the mirror display unit of the mirror display. The present invention can realize authentication-related applications through the mirror display, and enable users to pay attention to their own appearance, and at the same time provide users with personalized customization functions, provide user-related reminders and humanistic care information, and can be applied to all users. When the user appears in the monitoring area of the mirror display, the user can be authenticated without cooperating with the mirror display, thereby improving user experience.

As shown in FIG. 3 , the functional block diagram of a preferred embodiment of the face authentication device of the present invention. The face authentication device 31 includes an acquisition module 300 , a determination module 301 , an authentication module 302 , a record module 303 , a display module 304 , an interaction module 305 and a control module 306 . The unit referred to in the present invention refers to a series of computer program segments that can be executed by the processor of the face authentication device 31 and can complete fixed functions, which are stored in the memory. In this embodiment, the functions of each unit will be described in detail in subsequent embodiments.

When it is detected that a user is looking at the mirror 112 , the acquiring module 300 takes a picture of the user through the at least one camera device 110 and acquires the picture taken.

Preferably, when the acquisition module 300 detects that a user is in the monitoring area of the smart mirror 1 and detects that a user is looking at the mirror 112, that is, the mirror 112 can mirror the user's face Time. The at least one camera device 110 may take a picture of the user, and the picture taken has the user's face.

It should be noted that in specific occasions where grooming is more important, or in workplaces where designated clothing is required, a mirror needs to be installed for grooming. In this embodiment, the camera 110 is rotatably embedded in the mirror 112 , and when the user looks at the mirror 112 , the camera 110 can take pictures of the user. The picture has a human face.

In the present invention, there are many ways for the acquisition module 300 to detect that a user enters the monitoring area of the smart mirror 1 . It is not limited to the manner described below.

Preferably, there are multiple at least one camera device 110, and the acquisition module 300 captures the monitoring area of the smart mirror 1 through the at least one camera device 110, and judges whether there are pedestrians from the captured pictures. When there are pedestrians in the captured picture, the smart mirror 1 detects that a user enters the monitoring area of the smart mirror 1; when there is no pedestrian in the captured picture, the smart mirror 1 detects that no user is watching The mirror 112 .

Optionally, the smart mirror 1 communicates with a pedestrian detection sensor, and the pedestrian detection sensor is used to detect whether there are people in the monitoring area of the smart mirror 1, and the smart mirror 1 obtains the pedestrian detection sensor's Test results. For example, the pedestrian detection sensors include, but are not limited to: ultrasonic-based pedestrian detection sensors, far-infrared-based pedestrian detection sensors, laser scanning pedestrian detectors, and the like.

In the present invention, there are many ways for the acquisition module 300 to monitor whether the user is looking at the mirror 112 . It is not limited to the manner described below.

Preferably, there are multiple at least one camera device 110, and the acquisition module 300 captures the monitoring area of the smart mirror 1 through the at least one camera device 110, and judges whether there is a frontal portrait from the captured picture, When there is a frontal portrait in the captured picture, the smart mirror 1 detects that a user is looking at the mirror 112; Mirror 112.

In the present invention, when the acquisition module 300 detects that a user enters the monitoring area of the smart mirror 1, the smart mirror 1 needs to call a suitable camera device 110 to take pictures of the user, so as to obtain the face images.

Therefore, the acquiring module 300 photographs the user through the at least one camera 110, and acquiring the photographed pictures includes:

(a1) When it is detected that a user is looking at the mirror 112, calculate the height of the user.

Optionally, the calculating the height of the user includes:

(a11) When it is detected that a user is looking at the mirror 112, the at least one camera device 110 is used to acquire an image.

(a12) When the user image in the captured image has a whole-body image, determine the camera device that captures the whole-body image from the at least one camera device 110; determine the distance between the user and the lens of the determined camera device.

(a13) Obtain the distance between the lens of the determined camera device and the image sensor of the determined camera device and the imaging height of the user on the image sensor of the determined camera device.

(a14) According to the distance between the user and the lens of the determined camera device, the distance between the lens of the determined camera device and the image sensor of the determined camera device, and the distance between the user and the lens of the determined camera device The imaging height on the image sensor is used to calculate the user's height.

Further, there are many ways to determine the distance between the user and the determined lens of the camera device, for example, a ranging method based on binocular matching, etc., which are not limited in the present invention.

(a2) Determine the target imaging range corresponding to the user's height according to the correspondence between the height and the imaging range of the imaging device 110, and determine the target imaging device to which the target imaging range belongs.

(a3) Using the target imaging device to photograph the user, and obtain photographed pictures.

Through the above implementation manners, the present invention can acquire face images of users of different heights. For example, three cameras are arranged on the mirror display, a first camera, a second camera and a second camera, each camera has a different installation height, and each camera has a different camera range. The imaging range of the first imaging device is used to photograph users whose height is 1.2 to 1.5 meters, the imaging range of the second imaging device is used to photograph users whose height is 1.5 to 1.8 meters, and the third The camera range of the camera device is used to shoot users whose height is between 18 meters and 2 meters. When a user enters the monitoring area of the smart mirror, the user's height is calculated as 1.65, and the second camera is called to take pictures of the user to capture the user's face image. In this way, users of different heights can be captured, and the users do not need to cooperate with the camera device. The present invention can identify the features of users of different heights, and at the same time facilitates the display of subsequent personalized information and the like.

The determining module 301 determines the face image of the user from the captured picture.

In the embodiment of the present invention, the determination module 301 determines the user's face image from the captured picture by using a face detection method. The face detection method is a prior art, and the present invention does not impose any limitation thereon.

The authentication module 302 authenticates the user's face image.

In an optional embodiment of the present invention, the authentication module 302 reads a pre-stored face data set, and matches the user's face image with the face data in the pre-stored face data set, Judging whether the face image of the user belongs to the face data in the pre-stored face data set. For example, the pre-stored face data set may be the face data of all employees of a certain company, the face data of members of a certain shop, and so on.

When the similarity between the user's face image and a face data in the pre-stored face data set is greater than or equal to a similarity threshold, the authentication module 302 determines that the authentication of the user's face image is successful.

When the similarity between the face data in the pre-stored face data set and the user's face image is greater than or equal to the similarity threshold, the authentication module 302 determines that the user's face image authentication fails , light up the mirror display unit, and display authentication failure information.

When the face image authentication of the user succeeds, the recording module 303 records the user.

In an optional embodiment of the invention, when the user's face image authentication is successful, the record module 303 records that the user includes one or more of the following combinations:

(b1) When the user's face image authentication is successful, obtain the current time, and record the current time and the information of the user. In this way, the smart mirror can be used for checking attendance, registering entrances and exits, and the like.

(b2) When the user's face image authentication is successful, send a control command to the access control device communicating with the smart mirror 1 to control the access control device to open. In this way, the smart mirror 1 can be used as an access control monitoring device, etc., to automatically open the door for the authenticated user.

The display module 304 displays information associated with the user on the mirror display unit 111 of the mirror display 11 .

In an optional implementation of the present invention, the display module 304 displaying information associated with the user on the mirror display unit 111 of the mirror display 11 includes one or a combination of the following: on the mirror display 11 The user's reminder information is displayed on the mirror display unit 111 of the mirror display unit 111; when the current time matches the user's blessing date, the blessing information is displayed on the mirror display unit 111 of the mirror display unit 11. In this way, personalized information push is realized according to the identity of the user.

Further, the reminder information includes one or more combinations of the following, but not limited to: schedule reminders, task reminders, meeting reminders, to-do item reminders, notification reminders, and the like. This allows for personalized reminders of things to remember.

For example, if the smart mirror 1 is installed at the company's access control position, when the company's employees are looking at the mirror 112, the employees will be identified and authenticated, and counted in attendance, so as to realize the automatic attendance function, and enable the employees to check the attendance according to the The mirror 112 pays attention to one's own grooming. In addition, when an employee is identified, the employee's schedule, meetings, to-do items, etc. are displayed on the mirror display unit 111 to remind the employee of work items that need to be followed up in time. Since the camera device embedded in the mirror is relatively small, personalized information related to the user can also be pushed while not affecting the user looking in the mirror.

For example, if the smart mirror 1 is installed at the entrance of the community, when the owner is looking at the mirror 112, it will automatically identify and authenticate, and close the door for the owner, and at the same time display the owner’s unfinished business on the mirror display unit 111, Remind the owner to handle in time, and at the same time, when the owner goes in and out of the door every day, he also pays attention to his appearance according to the mirror 112, so that his daily life is more energetic and so on.

Further, the blessing dates include, but are not limited to: birthday dates, wedding anniversaries and other important holiday dates. For example, if the smart mirror is installed at the company's access control position, when the company's employees walk into the monitoring area of the smart mirror, the employees will be identified and authenticated, and counted in attendance, so as to realize the automatic attendance function, and on the employee's birthday At the same time, give blessings to employees as soon as they enter the company, embody humanistic care, make employees more pleasantly surprised, etc.

In an optional embodiment of the present invention, the interaction module 305 is configured to: obtain an interaction signal; and operate the information associated with the user displayed on the mirror display unit 111 through the interaction signal.

Further, the interaction signal includes, but is not limited to: voice signal, gesture signal, touch signal and so on.

Further, the mirror display 11 includes: a speech recognition component, a gesture recognition component, and a touch recognition component.

The interaction module 305 recognizes the voice signal through the voice recognition component, and the user can interact with the mirror display 11 through voice. The interaction module 305 recognizes the gesture signal through the gesture recognition component, and the user can interact with the mirror display 11 through the gesture. The interaction module 305 recognizes the touch signal through the touch recognition component, and the user can interact with the mirror display 11 through touch.

For example, it is displayed on the mirror display unit 111 that the user has an urgent task, and the user can input the voice of "open task", and the voice recognition component recognizes the voice, and displays the urgent task on the mirror display unit 111. , so that users can deal with urgent matters in a timely manner.

In an optional embodiment of the present invention, when it is detected that the user leaves the monitoring area of the smart mirror 1, the control module 306 turns off the mirror display unit 111, and the mirror display unit 111 can pass the The first part and the second part form a complete mirror surface.

In an optional embodiment of the present invention, when the trigger signal of the switch of the mirror display unit 111 is obtained, and the trigger switch of the mirror display unit 111 is in the off state, the control module 306 turns off the mirror display unit, the mirror display unit 111 can form a complete mirror through the first part and the second part.

The trigger signal includes, but is not limited to: voice signal, gesture signal, touch signal and so on.

For example, the user inputs a voice "turn off the switch of the mirror display", and the voice recognition component triggers the voice to turn off the switch of the mirror display unit 111 . For example, the user inputs a gesture of waving to the left, and the gesture recognition component recognizes the gesture of waving to the left, and triggers the switch of the mirror display unit 111 to be in an off state. Touching the switch of the mirror display unit 111 on the mirror display unit 111 makes the mirror display unit 111 in an off state and so on.

In the present invention, the application of the smart mirror 1 is not limited to the above-mentioned application examples, and can also be applied to other scenarios, for example, entrances and exits of conferences, entrances and exits of examination rooms, and so on. The present invention does not impose any limitation on the application scenarios of the smart mirror.

In the present invention, the smart mirror includes the mirror display, the mirror display includes at least one camera device, a mirror display unit and a mirror, the first part of the mirror corresponds to the mirror display unit, and the mirror display unit passes through the The first section displays information. When it is detected that a user is looking at the mirror, the user is photographed by the at least one camera device, and the photographed picture is acquired; the face image of the user is determined from the photographed picture; The user's face image is authenticated; when the user's face image is successfully authenticated, the user is recorded; and the information associated with the user is displayed on the mirror display unit of the mirror display. The present invention can realize authentication-related applications through the mirror display, and enable users to pay attention to their own appearance, and at the same time provide users with personalized customization functions, provide user-related reminders and humanistic care information, and can be applied to all users. When the user appears in the monitoring area of the mirror display, the user can be authenticated without cooperating with the mirror display, thereby improving user experience.

The above-mentioned integrated units implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) execute the method described in each embodiment of the present invention part of the steps.

As shown in FIG. 4 , it is another structural schematic frame diagram of the smart mirror of the present invention. The smart mirror 1 also includes at least one sending device 41 , at least one memory 42 , at least one processor 43 , at least one receiving device 44 and at least one communication bus. Wherein, the communication bus is used to realize connection and communication between these components.

The smart mirror 1 is a device that can automatically perform numerical calculations and/or information processing according to preset or stored instructions, and its hardware includes but is not limited to microprocessors, application specific integrated circuits (Application Specific Integrated Circuit, ASIC) , Programmable gate array (Field-Programmable Gate Array, FPGA), digital processor (Digital Signal Processor, DSP), embedded devices, etc. The smart mirror 1 can also be integrated with electronic equipment, and the electronic equipment includes network equipment and/or user equipment. Wherein, the network device includes but is not limited to a single network server, a server group composed of multiple network servers, or a cloud based on cloud computing (Cloud Computing) composed of a large number of hosts or network servers, wherein cloud computing is distributed computing A super virtual computer consisting of a group of loosely coupled computer sets.

The smart mirror 1 can be, but is not limited to, any electronic product that can interact with the user through keyboards, touch pads, or voice-activated devices. The electronic device may be, but not limited to, any electronic product capable of man-machine interaction with the user through keyboards, touch pads, or voice-activated devices. For example, terminals such as a tablet computer, a smart phone, a personal digital assistant (Personal Digital Assistant, PDA), a smart wearable device, a camera device, a monitoring device, and a display device.

The smart mirror 1 and the network where the electronic device is located include, but are not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (Virtual Private Network, VPN) and the like.

Wherein, the receiving device 44 and the sending device 41 may be wired sending ports, or may be wireless devices, such as including antenna devices, for performing data communication with other devices.

The memory 42 is used to store program codes. The memory 42 may be a circuit with a storage function that has no physical form in an integrated circuit, such as RAM (Random-Access Memory, random access memory), FIFO (First InFirst Out,) and the like. Or, the memory 42 can also be a memory with a physical form, such as a memory stick, a TF card (Trans-flash Card), a smart media card (smart media card), a secure digital card (secure digital card), a flash memory card ( flash card) and other storage devices, etc.

The processor 43 may include one or more microprocessors and digital processors. The processor 43 can call the program codes stored in the memory 42 to execute related functions. For example, each unit described in FIG. 3 is a program code stored in the memory 42 and executed by the processor 43 to implement a face authentication method. The processor 43 is also called a central processing unit (CPU, Central Processing Unit), which is a very large-scale integrated circuit, and is a computing core (Core) and a control core (Control Unit).

The embodiment of the present invention also provides a computer-readable storage medium, on which computer instructions are stored, and when the instructions are executed by the smart mirror 1 including one or more processors, the smart mirror 1 can perform the above-mentioned method embodiment. The described face authentication method.

1 and 2, the smart mirror 1 includes the mirror display 11, the mirror display 11 includes at least one camera 110, a mirror display unit 111 and a mirror 112, and the mirror display unit passes through the mirror The first part of the mirror displays information, the second part of the mirror is used for imaging, and the at least one camera device is embedded in the second part. The memory 42 in the smart mirror 1 stores multiple instructions to implement a product recommendation method, and the processor 43 can execute the multiple instructions to achieve: when it is detected that a user is looking at the mirror, The user is photographed by the at least one camera device, and the photographed picture is obtained; the facial image of the user is determined from the photographed photograph; the facial image of the user is authenticated; when the user When the face image authentication of the user is successful, the user is recorded; and the information associated with the user is displayed on the mirror display unit of the mirror display.

In an optional embodiment of the present invention, there are multiple at least one camera, and different camera devices have different camera ranges. When it is detected that a user is looking at the mirror, the at least one camera The device shoots the user, and obtaining the captured pictures includes:

When it is detected that a user is looking at the mirror, calculate the height of the user;

According to the corresponding relationship between the height and the imaging range of the imaging device, determine the target imaging range corresponding to the height of the user, and determine the target imaging device to which the target imaging range belongs;

The user is photographed by the target photographing device to obtain photographed pictures.

In an optional embodiment of the present invention, when it is detected that a user enters the preset range of the smart mirror, calculating the height of the user includes:

When it is detected that a user is looking at the mirror, an image is acquired through the at least one camera device;

When the user image in the acquired image has a whole-body image, determine the camera that acquires the whole-body image from the at least one camera;

Determining the distance between the user and the lens of the determined camera device;

Obtaining the distance between the lens of the determined camera device and the image sensor of the determined camera device and the imaging height of the user on the image sensor of the determined camera device;

According to the distance between the user and the lens of the determined camera device, the distance between the lens of the determined camera device and the image sensor of the determined camera device, and the distance between the user and the image sensor of the determined camera device Calculate the height of the user based on the imaging height above.

In an optional embodiment of the present invention, when the user's face image authentication is successful, recording the user includes one or more of the following combinations:

When the face image authentication of the user is successful, obtain the current time, record the current time and the information of the user;

When the user's face image authentication is successful, a control command is sent to the access control device communicating with the smart mirror to control the access control device to open.

In an optional embodiment of the present invention, the displaying the information associated with the user on the mirror display unit of the mirror display includes one or more of the following combinations:

displaying a reminder message for the user on a mirror display unit of the mirror display; or

When the current time matches the user's blessing date, the blessing information is displayed on the mirror display unit of the mirror display.

In an optional embodiment of the present invention, the multiple instructions executed by the processor 43 further include:

When it is detected that the user leaves the monitoring area of the smart mirror, the mirror display unit forms a complete mirror through the first part and the second part of the mirror;

When the trigger signal of the switch of the mirror display unit is obtained, and the trigger switch of the mirror display unit is in the closed state, the mirror display unit is turned off, and the mirror display unit passes through the first part and the mirror. The second part makes up the complete mirror.

In an optional embodiment of the present invention, the multiple instructions executed by the processor 43 further include:

Get interactive signals;

The information associated with the user is displayed on the mirror display unit of the mirror display through the interaction signal.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence. Because of the present invention, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or can be Integrate into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes. .

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions recorded in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. A face authentication method, applied in a smart mirror, characterized in that, the smart mirror includes the mirror display, the mirror display includes at least one camera, a mirror display unit and a mirror, and the mirror display unit Information is displayed through the first part of the mirror, the second part of the mirror is used for imaging, and the at least one camera device is embedded in the second part, the method includes: When it is detected that a user is looking at the mirror, the user is photographed by the at least one camera device, and the photographed picture is obtained; determining the face image of the user from the captured picture; Authenticate the user's face image; When the face image authentication of the user is successful, record the user; Information associated with the user is displayed on a mirror display unit of the mirror display. 2. The face authentication method according to claim 1, wherein the at least one camera is multiple, and the camera ranges of different camera devices are different, and when it is detected that a user is looking at the When using the mirror, the user is photographed by the at least one camera device, and obtaining the photographed pictures includes: When it is detected that a user is looking at the mirror, calculate the height of the user; According to the corresponding relationship between the height and the imaging range of the imaging device, determine the target imaging range corresponding to the height of the user, and determine the target imaging device to which the target imaging range belongs; The user is photographed by the target photographing device to obtain photographed pictures. 3. The face authentication method according to claim 2, wherein when it is detected that a user is looking at the mirror, calculating the height of the user comprises: When it is detected that a user is looking at the mirror, an image is acquired through the at least one camera device; When the user image in the acquired image has a whole-body image, determine the camera that acquires the whole-body image from the at least one camera; Determining the distance between the user and the lens of the determined camera device; Obtaining the distance between the lens of the determined camera device and the image sensor of the determined camera device and the imaging height of the user on the image sensor of the determined camera device; According to the distance between the user and the lens of the determined camera device, the distance between the lens of the determined camera device and the image sensor of the determined camera device, and the distance between the user and the image sensor of the determined camera device Calculate the height of the user based on the imaging height above. 4. The face authentication method according to any one of claims 1 to 3, wherein when the user's face image authentication is successful, recording the user includes one or more of the following combination: When the face image authentication of the user is successful, obtain the current time, record the current time and the information of the user; When the user's face image authentication is successful, a control command is sent to the access control device communicating with the smart mirror to control the access control device to open. 5. The face authentication method according to any one of claims 1 to 3, wherein the displaying information associated with the user on the mirror display unit of the mirror display includes one or more of the following Combination of species: displaying the reminder information of the user on the mirror display unit of the mirror display; When the current time matches the user's blessing date, the blessing information is displayed on the mirror display unit of the mirror display. 6. The face authentication method according to any one of claims 1 to 3, wherein the method further comprises: When it is detected that the user leaves the monitoring area of the camera device on the smart mirror, the mirror display unit is turned off, and the mirror display unit forms a complete mirror through the first part and the second part of the mirror ; When the trigger signal of the switch of the mirror display unit is obtained, and the trigger switch of the mirror display unit is in the closed state, the mirror display unit is turned off, and the mirror display unit passes through the first part and the mirror. The second part makes up the complete mirror. 7. The face authentication method according to any one of claims 1 to 3, wherein the method further comprises: Get interactive signals; The information associated with the user is displayed on the mirror display unit of the mirror display through the interaction signal. 8. The face authentication method according to claim 7, wherein the interaction signal comprises a voice signal, a gesture signal, and a touch signal. 9. A smart mirror, characterized in that, the smart mirror includes the mirror display, memory and processor, the mirror display includes at least one camera, a mirror display unit and a mirror, and the mirror display unit passes through the The first part of the mirror displays information, the second part of the mirror is used for imaging, and the at least one camera device is embedded in the second part, and the smart mirror also includes a memory and a processor, and the memory is used for At least one instruction is stored, and the processor is used to execute the at least one instruction to implement the face authentication method according to any one of claims 1-8. 10. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores at least one instruction, and when the at least one instruction is executed by a processor, it realizes any one of claims 1 to 8. Face authentication method.