WO2019105411A1 - Information recommending method, intelligent mirror, and computer readable storage medium - Google Patents

Abstract

An information recommending method. The method comprises: photographing a user by means of a photographing means to obtain a photographed video when it is monitored that the user enters a preset range of an intelligent mirror; identifying the photographed video to obtain a three-dimensional stereoscopic model of the user; displaying the three-dimensional stereoscopic model by means of a displayer; and recommending a clothes type and a hairstyle suitable for the three-dimensional stereoscopic model to the user. According to the present invention, a clothes type and hairstyle suitable for a user can be recommended to the user. Disclosed in the present invention are a living body detection method, a computer apparatus, and a computer readable storage medium.

Description

Information recommendation method, smart mirror and computer readable storage medium

This application claims priority to Chinese Patent Application No. 201711241174.7, entitled "Information Recommendation Method, Smart Mirror, and Computer Readable Storage Media", filed on November 30, 2017, the entire contents of which are hereby incorporated by reference. Combined in this application.

Technical field

The present invention relates to the field of information processing technologies, and in particular, to an information recommendation method, a smart mirror, and a computer readable storage medium.

Background technique

With the development of society and the improvement of people's material living standards, people pay more and more attention to the external appearance of the individual on many occasions. For example, couples usually dress up before dating, for example, some special occupations (banks) , hotel) all need specific clothing and hair styles.

However, most of the users are ignorant of dressing, and they don't have much time to study what kind of dressing suits their temperament. It can be seen that how to recommend the user's clothing type and hairstyle to the user is a technical problem to be solved.

Summary of the invention

In view of the above, it is necessary to provide an information recommendation method, a smart mirror, and a computer readable storage medium, which are capable of recommending a user's clothing type and hairstyle to the user.

An information recommendation method is applied to a smart mirror, the smart mirror comprising a mirror display, the mirror display comprising at least one camera device, a mirror display unit and a mirror, the mirror display unit displaying information through the first portion of the mirror, a second portion of the mirror is used for imaging, and the at least one camera device is embedded in the second portion, the method comprising:

When it is detected that a user enters the preset range of the smart mirror, the user is photographed by using the camera device to obtain a shooting video;

Identifying the captured video to obtain a three-dimensional model of the user;

Displaying the three-dimensional model by means of the display;

A clothing type and a hairstyle conforming to the three-dimensional model are recommended to the user.

In a possible implementation manner, the plurality of imaging devices are different, and different imaging ranges of the different imaging devices are different, and when the user is detected to enter the preset range of the smart mirror, the imaging is used. The device captures the user, and obtaining the captured video includes:

Obtaining the height of the user when it is detected that a user enters the preset range of the smart mirror;

Determining, according to a correspondence relationship between the height and the imaging range of the imaging device, a target imaging range corresponding to the height of the user, and determining a target imaging device to which the target imaging range belongs;

The user is photographed using the target imaging device to obtain a captured video.

In a possible implementation manner, the image capturing apparatus includes a front camera device and a rear camera device, and when the user enters a preset range of the smart mirror, the user is used to the user Shooting and getting the video taken include:

When the user is detected to enter the preset range of the smart mirror, the front camera is used to capture the front video of the user, and the back camera is used to capture the back video of the user;

The front video and the back video are combined to obtain a captured video.

In a possible implementation manner, the method further includes:

Receiving a personalized request for a clothing type and a hairstyle input by the user on the display;

Obtaining environment information of the current user, where the environment information includes weather information, light information, and geographic location information;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and a hairstyle conforming to the personalization requirement, the environmental information, and the three-dimensional model are recommended to the user.

In a possible implementation manner, the method further includes:

Performing face recognition on the user to obtain a recognition result;

And querying, according to the identification result, the identity information of the user, where the identity information includes the gender, age, skin color, occupation, and personal dressing habits of the user;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and hairstyle conforming to the user's identity information and conforming to the three-dimensional model are recommended to the user.

In a possible implementation manner, the displaying, by using the display, the three-dimensional stereo model includes:

Displaying a plurality of said three-dimensional models by means of said display;

The method further includes:

Obtaining a popular dressing style of a plurality of network celebrities on a network platform within a preset time, the dressing style including a clothing type and a hairstyle;

Performing an analog display on each of the three-dimensional models according to the dressing style;

Determining the matching degree between the personal dressing temperament of the simulated display and the dressing temperament of the online celebrity;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A dressing style with a matching degree greater than a preset matching degree threshold and conforming to the three-dimensional model is recommended to the user.

In a possible implementation manner, the method further includes:

Identifying the captured video to obtain a behavioral operation of the user;

If the behavior operation belongs to a preset prohibition operation, displaying the warning information by means of the display;

The captured video is sent to a loss prevention device that is bound to the smart mirror.

In a possible implementation manner, the method further includes:

Intercepting an image of the user in the captured video;

Finding whether there is an image including the user from a list of images of the forbidden persons pre-stored in the database;

If present, the user is prohibited from entering the area to which the smart mirror belongs.

A smart mirror comprising a mirror display comprising at least one camera device, a mirror display unit and a mirror, the mirror display unit displaying information through a first portion of the mirror, the second of the mirror Partially for imaging, and the at least one camera device is embedded in the second portion, the smart mirror further comprising a memory and a processor,

The processor is configured to execute a computer program stored in the memory to implement the information recommendation method.

A computer readable storage medium storing at least one instruction that, when executed by a processor, implements the information recommendation method.

According to the above technical solution, in the present invention, the smart mirror includes a camera device, a display, and a mirror, wherein the display is mounted on the mirror, and information is displayed through the mirror, when a user is detected to enter When the smart mirror is within a preset range, the user is photographed using the camera device to obtain a captured video; the captured video is recognized to obtain a three-dimensional model of the user; and the three-dimensional model is obtained by the display The model is displayed; the clothing type and hairstyle conforming to the three-dimensional model are recommended to the user. It can be seen that, by the embodiment of the present invention, when the user is within the preset range of the smart mirror, the smart mirror can recognize the captured video captured by the camera and obtain a three-dimensional model of the user, and intelligently present to the user according to the three-dimensional model of the user. Recommended clothing types and hairstyles, without the need for the user to study how to dress to suit their temperament, so that they can intelligently recommend the user's clothing type and hairstyle to meet the user's needs for dressing.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can obtain other drawings according to the provided drawings without any creative work.

1 is a schematic view of a smart mirror disclosed in the present invention.

2 is a flow chart of a preferred embodiment of an information recommendation method disclosed by the present invention.

3 is a flow chart of a preferred embodiment of another information recommendation method disclosed by the present invention.

4 is a flow chart of a preferred embodiment of another information recommendation method disclosed by the present invention.

FIG. 5 is a functional block diagram of a preferred embodiment of an information recommendation apparatus disclosed by the present invention.

FIG. 6 is a functional block diagram of a preferred embodiment of another information recommendation apparatus disclosed in the present invention.

FIG. 7 is a schematic structural diagram of a smart mirror according to a preferred embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The present invention will be further described in detail with reference to the accompanying drawings and specific embodiments.

Please refer to FIG. 1. FIG. 1 is a schematic structural view of a smart mirror disclosed by the present invention. Wherein the smart mirror comprises a housing and a mirror display, the housing being mounted in combination with the mirror display to form a closed receiving space between the housing and the mirror display. As shown in FIG. 1, the specular display includes at least one camera, display, and mirror. Among them, the present invention is mainly applied to a scene requiring a mirror such as a clothing store, a home environment, or the like, and is applied to a scene such as a supermarket that stores a large amount of merchandise and needs to monitor the state of the merchandise in real time. In these scenarios, a smart mirror can be installed to recommend a suitable type of clothing and hairstyle for the user, or to prevent damage to the product.

Wherein, the smart mirror includes, but is not limited to, a housing and a mirror display. The housing is mounted in combination with the mirror display such that a closed receiving space is formed between the housing and the mirror display.

The specular display includes, but is not limited to, at least one camera, display, and mirror. The components included in the smart mirror are not limited to the above list.

The display is disposed in the receiving space.

The mirror is composed of a first portion and a second portion. The first portion corresponds to the display. The back side of the first portion of the mirror does not have a metal film but acts as a flat mirror. The front side of the second portion of the mirror can be imaged (as shown in Figure 1). The display is configured to display information through the first portion when the display is in an active state (as indicated by a line on the display in FIG. 1); when the display is in a closed state, the display may pass the first A portion and the second portion form a complete mirror. The mirror may include, but is not limited to, an etiquette mirror, a steering mirror, a dance mirror, and the like.

The camera device is rotatably embedded in the second portion of the mirror.

It should be noted that, in the smart mirror shown in FIG. 1, the imaging device is embedded in the second portion of the mirror, and the position where the imaging device is disposed is concealed and the imaging device is not blocked. Here, one imaging device is shown in FIG. 1, but the present invention is not limited to one imaging device, and may further include a plurality of imaging devices. Optionally, there may be multiple camera devices on the smart mirror, each camera device is disposed at different positions of the mirror, and each camera device has concealment, and different camera devices have different imaging ranges. Optionally, the camera device on the smart mirror can be divided into a front camera device and a rear camera device, wherein the front camera device is disposed on the front side of the mirror and has concealability, and the rear camera device is disposed in a space opposite to the mirror. Position, the rear camera and the front camera cooperate to shoot.

Among them, the display is mainly used to realize the input and output functions of the smart mirror, such as sending and receiving input digital or character information, or displaying information input by the user or information provided to the user and various menus set by the smart mirror. In the smart mirror shown in Figure 1, the display is mounted on the back of the mirror and can be displayed through the mirror (as shown by the lines on the display in Figure 1). Optionally, the display may be a touch panel, which is also called a touch screen, and can collect touch operations on or near the user (such as a user using a finger, a stylus, or the like) The operation is performed on the touch panel or in the vicinity of the touch panel, and the corresponding connection device is driven according to a preset program. Optionally, the touch panel may include a display panel, and the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

In the smart mirror shown in FIG. 1, when it is detected that a user enters the preset range of the smart mirror, the mirror can display the entire body shape of the user, and at the same time, the smart mirror can use the camera device. The user performs shooting to obtain a shooting video; further, the smart mirror can use the built-in chip to identify the captured video to obtain a three-dimensional model of the user, and further, the display can display the three-dimensional model. And recommending to the user the type of clothing and hairstyle that conforms to the three-dimensional model.

Referring to FIG. 2, FIG. 2 is a flowchart of a preferred embodiment of an information recommendation method disclosed by the present invention. The order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.

S21. When it is detected that a user enters the preset range of the smart mirror, the smart mirror uses the camera to photograph the user to obtain a captured video.

The preset range may be a range in which the camera device on the smart mirror can capture the whole body image of the user, and the preset range may be determined by multiple tests in advance. Optionally, there may be multiple camera devices on the smart mirror, each camera device is disposed at different positions of the mirror, and each camera device has concealment, and different camera devices have different imaging ranges. Optionally, the camera device on the smart mirror can be divided into a front camera device and a rear camera device, wherein the front camera device is disposed on the front side of the mirror and has concealability, and the rear camera device is disposed in a space opposite to the mirror. Position, the rear camera and the front camera cooperate to shoot. The mirror may include, but is not limited to, a clothing store fitting mirror, a home mirror, and the like.

Optionally, the plurality of imaging devices are different, and different imaging ranges of the different imaging devices are different. When the user enters a preset range of the smart mirror, the user is used to the user. Shooting and getting the video taken include:

Obtaining the height of the user when it is detected that a user enters the preset range of the smart mirror;

Determining, according to a correspondence relationship between the height and the imaging range of the imaging device, a target imaging range corresponding to the height of the user, and determining a target imaging device to which the target imaging range belongs;

The user is photographed using the target imaging device to obtain a captured video.

In this optional embodiment, when it is detected that a user enters the preset range of the smart mirror, the whole body image of the user may be acquired by using any camera device, and the user and the camera device are acquired by the ranging sensor. The distance between the lenses (ie, the object distance in the optical imaging system); the distance between the user and the lens of the camera, the distance from the lens of the camera to the image sensor, and the user's camera The height of the image on the image sensor of the device calculates the height of the user. The ranging sensor may include, but is not limited to, an infrared ranging sensor, an ultrasonic ranging sensor, or a laser ranging sensor. Further, the smart mirror may determine a target imaging range corresponding to the height of the user according to the correspondence between the height and the imaging range of the imaging device, thereby determining a target imaging device to which the target imaging range belongs; and using the target imaging device The user is photographed to obtain a shooting video. Among them, the correspondence between the height and the imaging range of the imaging device can be obtained in advance through a plurality of tests.

Optionally, the camera device includes a front camera device and a rear camera device, and when the user is detected to enter the preset range of the smart mirror, the user is photographed using the camera device to obtain a shooting. The video includes:

When the user is detected to enter the preset range of the smart mirror, the front camera is used to capture the front video of the user, and the back camera is used to capture the back video of the user;

The front video and the back video are combined to obtain a captured video.

In this optional embodiment, when it is detected that a user enters the preset range of the smart mirror, since the front camera device and the rear camera device are in opposite spatial positions, the user is interposed between the front camera device and the rear camera device. Between the first camera, the front video of the user can be captured, and the back video of the user can be captured using the rear camera. Further, the smart mirror can use the built-in chip to view the front video and the camera. The back video is synthesized to obtain a captured video.

S22. The smart mirror identifies the captured video to obtain a three-dimensional model of the user.

In the present invention, the smart mirror can recognize the shape of the user in the captured video, and establish a three-dimensional model of the user through the built-in 3D software. Among them, the three-dimensional model is a polygon representation of the user. 3D software can include but is limited to CAD, Maya, 3ds Max, Poser.

S23. The smart mirror displays the three-dimensional stereo model by means of the display.

In the present invention, after the smart mirror obtains the three-dimensional model of the user, the three-dimensional model can be displayed by means of the display and through the mirror.

S24. The smart mirror recommends to the user a clothing type and a hairstyle conforming to the three-dimensional model.

In the present invention, the type of clothing may have different styles according to different classification forms. Clothing types can be classified by season, such as spring, summer, autumn, and winter; they can also be classified by gender, such as men's, women's, and neutral clothing; they can also be classified by material, such as knitting. Styles, cotton styles and polyester styles; can also be classified by style, such as lively styles, ladies styles and professional styles.

Among them, hair style refers to the length, color and shape of hair, and is usually divided into five types, namely, straight hair, splashing hair, curly hair, wool-like curls and small spiral hair. The smart mirror can reasonably determine the user's hairstyle based on the user's face type and the user's clothing type.

As an optional implementation manner, the method further includes:

Receiving a personalized request for a clothing type and a hairstyle input by the user on the display;

Obtaining environment information of the current user, where the environment information includes weather information, light information, and geographic location information;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and a hairstyle conforming to the personalization requirement, the environmental information, and the three-dimensional model are recommended to the user.

Among them, the optional embodiment is suitable for the home environment, and the user needs a smart mirror to recommend his or her own clothing type and hairstyle before going out. Among them, all the clothes, accessories, and the like of the user can be stored in the database of the smart mirror in advance.

In this optional embodiment, when the user stands in front of the smart mirror, the user can input personalized requirements for the type of clothing and the hairstyle on the display according to his own needs. For example, the user likes to design some small accessories on the clothing. Or the user likes a very classic hairstyle. In addition, the smart mirror can use the built-in sensor class to get the environmental information of the user, such as current weather information (including temperature, humidity, wind direction), and light information (ie, the intensity of light). ) and the user's geographic location information (such as the South, North). Different weather, different light and different geographical locations will affect the type of clothing and hairstyle recommended by Smart Mirror.

Further, the smart mirror may determine a plurality of matching clothing and hairstyle selections from existing clothes and accessories stored in the database, and recommend to the user the personalization requirements, the environmental information, and the three-dimensional model. Clothing type and hairstyle.

As another optional implementation manner, the method further includes:

Performing face recognition on the user to obtain a recognition result;

Determining identity information of the user according to the identification result, where the identity information includes gender, age, skin color, occupation, and personal dressing habits of the user;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and hairstyle conforming to the user's identity information and conforming to the three-dimensional model are recommended to the user.

Among them, the optional embodiment is suitable for the clothing store environment. When the user goes to the clothing store to purchase clothes, the user needs to continuously select and try, and the smart mirror can recommend the user's clothing type and hairstyle to the user. Among them, for each store in the store, if the user enters the store for the first time, the user's personal identity information database (including the user's gender, age, skin color, occupation, and personal dressing habits) can be established on the smart mirror. Etc.), when the user enters the store again, the smart mirror can perform face recognition on the user to obtain the recognition result; and directly call the personal identity information of the user according to the face feature in the recognition result. The library obtains identity information of the user, and then recommends to the user the identity information and hairstyle conforming to the identity information of the user and conforming to the three-dimensional model. In this way, each user can be recommended in a targeted manner, thereby improving the user's shopping experience.

It should be noted that the optional embodiment defaults that the user's personal identity information database has been pre-stored in the database of the smart mirror before the user enters the store.

In the method flow described in FIG. 2, when a user is detected to enter the preset range of the smart mirror, the user is photographed using the camera to obtain a captured video; the captured video is recognized and obtained. a three-dimensional model of the user; displaying the three-dimensional model by means of the display; recommending a clothing type and a hairstyle conforming to the three-dimensional model to the user. It can be seen that, by the embodiment of the present invention, when the user is within the preset range of the smart mirror, the smart mirror can recognize the captured video captured by the camera and obtain a three-dimensional model of the user, and intelligently present to the user according to the three-dimensional model of the user. Recommended clothing types and hairstyles, without the need for the user to study how to dress to suit their temperament, so that they can intelligently recommend the user's clothing type and hairstyle to meet the user's needs for dressing.

Referring to FIG. 3, FIG. 3 is a flowchart of a preferred embodiment of another information recommendation method disclosed by the present invention. The order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.

S31. When it is detected that a user enters the preset range of the smart mirror, the smart mirror uses the camera to photograph the user to obtain a captured video.

S32. The smart mirror identifies the captured video to obtain a three-dimensional model of the user.

S33. The smart mirror displays a plurality of the three-dimensional models by means of the display.

S34, the smart mirror acquires the popular dressing style of multiple network celebrities on the network platform within a preset time.

Wherein, the dressing style includes a clothing type and a hairstyle. The preset time may be some time before the current time. For example, in the last week, the network celebrities are usually some famous stars and network reds on the network.

In the present invention, the network platform stores a large number of user data, especially related data of network celebrities, such as data related to the dressing style of the network celebrities. Ordinary users usually compare online celebrities, and then learn the style of online celebrity dressing, so that they are closer to online celebrities.

Specifically, smart mirrors can determine multiple network celebrities according to the popularity of online celebrities in the recent period. For example, according to the popularity of online celebrities in the past week, the top 5 online celebrities are determined, and then the popularity of online celebrities is determined. Dress up style.

S35. The smart mirror performs an analog display on each of the three-dimensional models according to the dressing style.

In the present invention, after determining the dressing style of the network celebrity, the smart mirror can simulate the dressing style of the network celebrity on each of the three-dimensional models, and simulate the dressing of the user according to the network celebrity. The effect of dressing style after dressing up, that is, personal dressing temperament.

S36. The smart mirror determines the matching degree between the personal dressing temperament of the simulated display and the dressing temperament of the online celebrity.

In the present invention, for each dress on the simulated three-dimensional model, the smart mirror can compare the personal dressing temperament of the simulated display with the dressing temperament of the network celebrity, and determine the match between the two. Degree, the more similar the dressing temperament between the two, the higher the matching.

S37. The smart mirror recommends the dressing style that matches the threshold of the preset matching degree and conforms to the three-dimensional model to the user.

Wherein, a preset matching degree threshold, such as 80%, may be preset.

In the present invention, since each dressing style is simulated on the user's three-dimensional model, the smart mirror only needs to determine the dressing style with the matching degree greater than the preset matching threshold, and it can be determined that the matching degree is greater than The preset matching degree threshold is in turn conforms to the dressing style of the three-dimensional model, and can be recommended to the user.

In the method flow described in FIG. 3, the dressing style matching the temperament of the network celebrity can be recommended to the user through the data on the network platform, which can meet the needs of the user following the network celebrity and improve the user experience.

Referring to FIG. 4, FIG. 4 is a flowchart of a preferred embodiment of another information recommendation method disclosed by the present invention. The order of the steps in the flowchart may be changed according to different requirements, and some steps may be omitted.

S41. When it is detected that a user enters the preset range of the smart mirror, the smart mirror uses the camera to photograph the user to obtain a captured video.

S42. The smart mirror identifies the captured video to obtain a three-dimensional model of the user.

S43. The smart mirror displays the three-dimensional model by means of the display.

S44. The smart mirror recommends to the user a clothing type and a hairstyle conforming to the three-dimensional model.

S45. The smart mirror identifies the captured video to obtain a behavioral operation of the user.

The application scenario of the embodiment of the present invention mainly has a place for displaying goods, such as a supermarket. Smart mirrors can be mounted on a suitable display rack or at both ends of the merchandise display.

When the user enters the preset range of the smart mirror, the smart mirror can use the camera to capture the user's behavioral operations, such as: the user takes the merchandise from the shelf, and the user puts the merchandise back on the shelf.

S46. If the behavior operation belongs to a preset prohibition operation, the smart mirror displays the warning information by means of the display.

In the present invention, the smart mirror can pre-store some behaviors that prohibit the user's behavior (ie, prohibit operation), such as: stealing goods, stealing food, destroying goods, and the like. After the smart mirror acquires the user's behavioral operation, the smart mirror can identify and analyze the behavioral operation, or the smart mirror can also send the behavioral operation to the background server, and the background server can identify and analyze the behavioral operation. And return the recognition result to the smart mirror. When the smart mirror determines that the behavioral operation belongs to a preset inhibiting operation, the smart mirror can display the warning information by means of the display.

S47. The smart mirror sends the captured video to a loss prevention device bound to the smart mirror.

In the present invention, the loss prevention device is used to store data information of users who need special monitoring, such as theft video of the user, and the loss prevention personnel can view the loss prevention device in real time to monitor the user who enters the preset range of the smart mirror. Once the operation is found to be prohibited, the loss prevention personnel can take timely measures, such as an alarm.

As an optional implementation manner, the method further includes:

Intercepting an image of the user in the captured video;

Finding whether there is an image including the user from a list of images of the forbidden persons pre-stored in the database;

If present, the user is prohibited from entering the area to which the smart mirror belongs.

In this optional embodiment, the smart mirror can also intercept the image of the user in the captured video, and find out from the database whether the user exists in the image list of the forbidden person, and if so, indicate the user A person who is not allowed to enter, the smart mirror can prohibit the user from entering the area to which the smart mirror belongs. Among them, the forbidden person is a person who has entered the area to which the smart mirror belongs before the current time and has a bad influence on the person or thing in the area, such as stealing personnel, destroying personnel, causing troubles, and the like.

In the method flow described in FIG. 4, the smart mirror can judge the legality of the behavior operation according to the user's behavior operation. If the behavior operation is prohibited operation, the smart mirror can take measures to warn, so that the illegal user can be timely Behave in a way that avoids the loss of property.

Referring to FIG. 5, FIG. 5 is a functional block diagram of a preferred embodiment of an information recommendation apparatus according to the present invention. The information recommendation device described in FIG. 5 is used to perform some or all of the steps in the information recommendation method described in FIG. 2 . For details, refer to the related steps in FIG. 2 , and details are not described herein again. Herein, a unit referred to in the present invention refers to a series of computer program segments that can be executed by a processor and capable of performing a fixed function, which are stored in a memory. In the present embodiment, the functions of the respective units will be described in detail in the subsequent embodiments.

The information recommendation device described in FIG. 5 includes:

The photographing unit 101 is configured to: when the user enters the preset range of the smart mirror, use the camera to photograph the user to obtain a photographed video;

The identifying unit 102 is configured to identify the captured video to obtain a three-dimensional model of the user;

a display unit 103, configured to display the three-dimensional stereo model by using the display;

The recommendation unit 104 is configured to recommend, to the user, a clothing type and a hairstyle conforming to the three-dimensional model.

Optionally, the plurality of imaging devices are different, and different imaging ranges of the different imaging devices are different. When the user enters a preset range of the smart mirror, the imaging unit 101 uses the imaging. The device captures the user, and obtaining the captured video includes:

Obtaining the height of the user when it is detected that a user enters the preset range of the smart mirror;

Determining, according to a correspondence relationship between the height and the imaging range of the imaging device, a target imaging range corresponding to the height of the user, and determining a target imaging device to which the target imaging range belongs;

The user is photographed using the target imaging device to obtain a captured video.

Optionally, the camera device includes a front camera device and a rear camera device, and the camera unit 101 uses the camera device to the user when the user enters a preset range of the smart mirror. Shooting and getting the video taken include:

When the user is detected to enter the preset range of the smart mirror, the front camera is used to capture the front video of the user, and the back camera is used to capture the back video of the user;

The front video and the back video are combined to obtain a captured video.

In the information recommendation device described in FIG. 5, when the user is within the preset range of the smart mirror, the smart mirror can recognize the captured video captured by the camera and obtain a three-dimensional model of the user, intelligently according to the three-dimensional model of the user. Recommending the type of clothing and hairstyle to the user, without the user having to study how to dress and dress to suit their own temperament, so as to intelligently recommend the type and hairstyle of the user to meet the user's need for dressing.

Please refer to FIG. 6. FIG. 6 is a functional block diagram of another preferred embodiment of the information recommendation apparatus according to the present invention. The information recommendation device described in FIG. 6 is used to perform some or all of the steps in the information recommendation method described in FIG. 3 or FIG. 4 . For details, refer to the related steps in FIG. 3 or FIG. 4 , and details are not described herein again. The information recommendation device described in FIG. 6 is further optimized on the basis of FIG. 5, and the information recommendation device described in FIG. 6 further includes:

The receiving unit 105 is configured to receive a personalized requirement for a clothing type and a hairstyle input by the user on the display;

The obtaining unit 106 is configured to obtain environment information that the current user is located, where the environment information includes weather information, light information, and geographic location information;

The recommendation unit 104 recommending to the user the clothing type and hairstyle conforming to the three-dimensional model include:

A clothing type and a hairstyle conforming to the personalization requirement, the environmental information, and the three-dimensional model are recommended to the user.

The identifying unit 102 is configured to perform face recognition on the user to obtain a recognition result;

The query unit 107 is configured to query identity information of the user according to the recognition result, where the identity information includes gender, age, skin color, occupation, and personal dressing habits of the user;

The recommendation unit 104 recommends to the user the clothing type and hair style that conform to the three-dimensional model:

A clothing type and hairstyle conforming to the user's identity information and conforming to the three-dimensional model are recommended to the user.

The displaying, by the display unit 103, the three-dimensional model by using the display includes:

Displaying a plurality of said three-dimensional models by means of said display;

The obtaining unit 106 is further configured to acquire a popular dressing style of a plurality of network celebrities on the network platform within a preset time, the dressing style including a clothing type and a hairstyle;

The display unit 103 is further configured to perform an analog display on each of the three-dimensional stereo models according to the dressing style;

a determining unit 108, configured to determine a matching degree between the personal dressing temperament of the simulated display and the dressing temperament of the network celebrity;

The recommendation unit 104 recommending to the user the clothing type and hairstyle conforming to the three-dimensional model include:

A dressing style with a matching degree greater than a preset matching degree threshold and conforming to the three-dimensional model is recommended to the user.

The identification unit 102 is further configured to identify the captured video to obtain a behavior operation of the user;

The display unit 103 is further configured to display the warning information by using the display if the behavior operation belongs to a preset prohibition operation;

The sending unit 109 is configured to send the captured video to a loss prevention device bound to the smart mirror.

The intercepting unit 110 is configured to intercept an image of the user in the captured video;

The query unit 107 is further configured to: search for an image including the user from a list of images of the forbidden personnel pre-stored in the database;

The prohibition unit 111 is configured to, if present, prohibit the user from entering an area to which the smart mirror belongs.

In the information recommendation device described in FIG. 6, the appropriate clothing type and hairstyle can be recommended for the user according to the user's personalized requirements, environmental information, user identity information, and network celebrity dressing style. In addition, the user's behavioral operation and the user's image may be identified. If the behavioral operation is prohibited or the user belongs to a forbidden person, the user may be alerted or prohibited from entering the user.

The above-described integrated unit implemented in the form of a software function module can be stored in a computer readable storage medium. Wherein, the computer readable storage medium can store a computer program, which when executed by the processor, can implement the steps of the various method embodiments described above. Wherein, the computer program comprises computer program code, which may be in the form of source code, object code form, executable file or some intermediate form. The computer readable storage medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read only memory (ROM, Read-Only Memory). ), random access memory (RAM), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable storage medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable The medium does not include electrical carrier signals and telecommunication signals.

As shown in FIG. 7, FIG. 7 is a schematic structural diagram of a smart mirror according to a preferred embodiment of the present invention. The smart mirror 1 includes a memory 12, a processor 13, a housing 14 and a mirror display 15, which includes a mirror 151, an imaging device 152, and a display 153. It will be understood by those skilled in the art that the schematic diagram shown in FIG. 7 is merely an example of the smart mirror 1 and does not constitute a limitation on the smart mirror 1, and may include more or less components than those illustrated, or a combination of certain Components, or different components, such as the smart mirror 1 may also include network access devices, buses, and the like.

The memory 12 optionally includes one or more computer readable storage media for storing a program of information recommendation methods and various data, and implementing high speed, automatic completion of program or data access during operation. . The memory 12 optionally includes a high speed random access memory, and optionally also a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices.

The processor 13, also known as a central processing unit (CPU), is a very large-scale integrated circuit, which is a computing core (Core) and a control unit of the smart mirror 1. The processor 13 can execute an operating system of the smart mirror 1 and various types of installed applications, program codes, and the like, such as the information recommendation device 11.

The housing 14 is mounted in combination with the mirror display 15 to form a closed receiving space between the housing 14 and the mirror display 15.

The mirror 151 is composed of a first portion and a second portion. The first portion corresponds to the display 153. The back surface of the first portion of the mirror 151 does not have a metal film but serves as a plane mirror. The front side of the second portion of the mirror 151 can be imaged. The display 153 is configured to display information through the first portion when the display 153 is in an active state; the display 153 may be formed by the first portion and the second portion when the display 153 is in a closed state Complete mirror. The mirror 151 may include, but is not limited to, an etiquette mirror, a steering mirror, a dance mirror, and the like.

The camera device 152 is rotatably embedded in the second portion of the mirror 151. The imaging device embeds 152 in the second portion of the mirror 151, the position where the imaging device is disposed is concealed and the imaging device is not blocked. Optionally, the imaging device 152 on the smart mirror 1 may be multiple, each of the imaging devices 152 is disposed at different positions of the mirror, and each of the imaging devices 152 has concealability, and the imaging ranges of different imaging devices 152 are different. Optionally, the camera device 152 on the smart mirror 1 can be divided into a front camera device and a rear camera device, wherein the front camera device is disposed on the front side of the mirror and has concealability, and the rear camera device is disposed in the space opposite to the mirror. At a certain position, the rear camera and the front camera cooperate to shoot.

The display 153 is disposed in the receiving space. The display 153 is mainly used to implement an input/output function of the smart mirror 1, such as transceiving input digital or character information, or displaying information input by a user or information provided to a user and various menus of the smart mirror 1. Optionally, the display 153 can be a touch panel, which is also called a touch screen, and can collect touch operations on or near the user (such as a user using a finger, a stylus, or the like) or The accessory is operated on or near the touch panel, and the corresponding connecting device is driven according to a preset program. Optionally, the touch panel may include a display panel, and the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 13 to determine the type of touch event, and then the processor 13 provides a corresponding visual output on the display panel according to the type of touch event.

Referring to FIG. 1, FIG. 2, FIG. 3 or FIG. 4, the memory 12 in the smart mirror 1 stores a plurality of instructions to implement an information recommendation method, and the processor 13 can execute the plurality of instructions to implement :

When it is detected that a user enters the preset range of the smart mirror, the user is photographed by using the camera device to obtain a shooting video;

Identifying the captured video to obtain a three-dimensional model of the user;

Displaying the three-dimensional model by means of the display;

A clothing type and a hairstyle conforming to the three-dimensional model are recommended to the user.

In an optional implementation manner, the plurality of image capturing devices are different, and different imaging ranges of the different camera devices are different, and when the user is detected to enter the preset range of the smart mirror, the The camera device captures the user, and obtaining the captured video includes:

Obtaining the height of the user when it is detected that a user enters the preset range of the smart mirror;

Determining, according to a correspondence relationship between the height and the imaging range of the imaging device, a target imaging range corresponding to the height of the user, and determining a target imaging device to which the target imaging range belongs;

The user is photographed using the target imaging device to obtain a captured video.

In an optional implementation manner, the image capturing apparatus includes a front camera device and a rear camera device, and when the user is detected to enter a preset range of the smart mirror, the camera device is used to The user takes a picture and gets a video of the shot including:

When the user is detected to enter the preset range of the smart mirror, the front camera is used to capture the front video of the user, and the back camera is used to capture the back video of the user;

The front video and the back video are combined to obtain a captured video.

In an optional implementation manner, the processor 13 may execute the multiple instructions to implement:

Receiving a personalized request for a clothing type and a hairstyle input by the user on the display;

Obtaining environment information of the current user, where the environment information includes weather information, light information, and geographic location information;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and a hairstyle conforming to the personalization requirement, the environmental information, and the three-dimensional model are recommended to the user.

In an optional implementation manner, the processor 13 may execute the multiple instructions to implement:

Performing face recognition on the user to obtain a recognition result;

Determining identity information of the user according to the identification result, where the identity information includes gender, age, skin color, occupation, and personal dressing habits of the user;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A clothing type and hairstyle conforming to the user's identity information and conforming to the three-dimensional model are recommended to the user.

In an optional implementation manner, the displaying, by using the display, the three-dimensional stereo model includes:

Displaying a plurality of said three-dimensional models by means of said display;

The processor 13 can execute the plurality of instructions to implement:

Obtaining a popular dressing style of a plurality of network celebrities on a network platform within a preset time, the dressing style including a clothing type and a hairstyle;

Performing an analog display on each of the three-dimensional models according to the dressing style;

Determining the matching degree between the personal dressing temperament of the simulated display and the dressing temperament of the online celebrity;

The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes:

A dressing style with a matching degree greater than a preset matching degree threshold and conforming to the three-dimensional model is recommended to the user.

In an optional implementation manner, the processor 13 may execute the multiple instructions to implement:

Identifying the captured video to obtain a behavioral operation of the user;

If the behavior operation belongs to a preset prohibition operation, displaying the warning information by means of the display;

The captured video is sent to a loss prevention device that is bound to the smart mirror.

In an optional implementation manner, the processor 13 may execute the multiple instructions to implement:

Intercepting an image of the user in the captured video;

Finding whether there is an image including the user from a list of images of the forbidden persons pre-stored in the database;

If present, the user is prohibited from entering the area to which the smart mirror belongs.

For details, refer to the description of the related steps in the corresponding embodiment of FIG. 1, FIG. 2, FIG. 3 or FIG. 4, and the details are not described here.

In the smart mirror depicted in FIG. 7, when it is detected that a user enters the preset range of the smart mirror, the user is photographed using the camera to obtain a captured video; the captured video is recognized and obtained. a three-dimensional model of the user; displaying the three-dimensional model by means of the display; recommending a clothing type and a hairstyle conforming to the three-dimensional model to the user. It can be seen that, by the embodiment of the present invention, when the user is within the preset range of the smart mirror, the smart mirror can recognize the captured video captured by the camera and obtain a three-dimensional model of the user, and intelligently present to the user according to the three-dimensional model of the user. Recommended clothing types and hairstyles, without the need for the user to study how to dress to suit their temperament, so that they can intelligently recommend the user's clothing type and hairstyle to meet the user's needs for dressing.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division, and the actual implementation may have another division manner.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software function modules.

It is apparent to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims instead All changes in the meaning and scope of equivalent elements are included in the present invention. Any accompanying drawings in the claims should not be construed as limiting the claim. In addition, it is to be understood that the word "comprising" does not exclude other elements or steps. The plurality of units or devices recited in the system claims can also be implemented by a unit or device by software or hardware. The second word is used to denote the name and does not denote any particular order.

It should be noted that the above embodiments are only for explaining the technical solutions of the present invention and are not intended to be limiting, and the present invention will be described in detail with reference to the preferred embodiments. Modifications or equivalents are made without departing from the spirit and scope of the invention.

Claims (10)

An information recommendation method, which is characterized in that it is applied to a smart mirror, the smart mirror includes a mirror display, the mirror display includes at least one camera device, a mirror display unit, and a mirror, and the mirror display unit passes through the mirror A portion of the information is displayed, a second portion of the mirror is used for imaging, and the at least one camera device is embedded in the second portion, the method comprising: When it is detected that a user enters the preset range of the smart mirror, the user is photographed by using the camera device to obtain a shooting video; Identifying the captured video to obtain a three-dimensional model of the user; Displaying the three-dimensional model by means of the display; A clothing type and a hairstyle conforming to the three-dimensional model are recommended to the user. The method according to claim 1, wherein the plurality of imaging devices are different, and different imaging ranges of the different imaging devices are different, when the user is detected to enter the preset range of the smart mirror, The user is photographed by using the camera device, and obtaining a captured video includes: Obtaining the height of the user when it is detected that a user enters the preset range of the smart mirror; Determining, according to a correspondence relationship between the height and the imaging range of the imaging device, a target imaging range corresponding to the height of the user, and determining a target imaging device to which the target imaging range belongs; The user is photographed using the target imaging device to obtain a captured video. The method according to claim 1, wherein said image pickup device comprises a front camera device and a rear camera device, said camera device being used when it is detected that a user enters a predetermined range of said smart mirror Shooting the user and obtaining the captured video includes: When the user is detected to enter the preset range of the smart mirror, the front camera is used to capture the front video of the user, and the back camera is used to capture the back video of the user; The front video and the back video are combined to obtain a captured video. The method according to any one of claims 1 to 3, wherein the method further comprises: Receiving a personalized request for a clothing type and a hairstyle input by the user on the display; Obtaining environment information of the current user, where the environment information includes weather information, light information, and geographic location information; The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes: A clothing type and a hairstyle conforming to the personalization requirement, the environmental information, and the three-dimensional model are recommended to the user. The method according to any one of claims 1 to 3, wherein the method further comprises: Performing face recognition on the user to obtain a recognition result; Determining identity information of the user according to the identification result, where the identity information includes gender, age, skin color, occupation, and personal dressing habits of the user; The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes: A clothing type and hairstyle conforming to the user's identity information and conforming to the three-dimensional model are recommended to the user. The method according to any one of claims 1 to 3, wherein the displaying the three-dimensional model by means of the display comprises: Displaying a plurality of said three-dimensional models by means of said display; The method further includes: Obtaining a popular dressing style of a plurality of network celebrities on a network platform within a preset time, the dressing style including a clothing type and a hairstyle; Performing an analog display on each of the three-dimensional models according to the dressing style; Determining the matching degree between the personal dressing temperament of the simulated display and the dressing temperament of the online celebrity; The recommending the type of clothing and hairstyle conforming to the three-dimensional model to the user includes: A dressing style with a matching degree greater than a preset matching degree threshold and conforming to the three-dimensional model is recommended to the user. The method according to any one of claims 1 to 3, wherein the method further comprises: Identifying the captured video to obtain a behavioral operation of the user; If the behavior operation belongs to a preset prohibition operation, displaying the warning information by means of the display; The captured video is sent to a loss prevention device that is bound to the smart mirror. The method of claim 7, wherein the method further comprises: Intercepting an image of the user in the captured video; Finding whether there is an image including the user from a list of images of the forbidden persons pre-stored in the database; If present, the user is prohibited from entering the area to which the smart mirror belongs. A smart mirror, comprising: a mirror display comprising at least one camera device, a mirror display unit and a mirror, the mirror display unit displaying information through a first portion of the mirror, a second portion of the mirror is used for imaging, and the at least one camera device is embedded in the second portion, the smart mirror further comprising a memory and a processor, The processor is configured to execute a computer program stored in the memory to implement the information recommendation method according to any one of claims 1 to 8. A computer readable storage medium, wherein the computer readable storage medium stores at least one instruction, the at least one instruction being executed by a processor to implement the information recommendation according to any one of claims 1 to 8. method.

Images