KR20170071967A - Method for recommending glass in online shopping mall - Google Patents

Abstract

The present invention relates to a method of recommending glasses of an eyeglasses online sales system, which receives and analyzes a user's face photograph provided by a user, detects a user's face area, eye area, pupil area, ear area, Determining a photographing time point; Generating a user's face model by performing an image projection operation on a previously registered three-dimensional face model based on the user photographing time point; Estimating the real size of the user's face model based on the manually input dynamic distance value from the user after adjusting the display time of the user's face model to the frontal view point and calculating and storing the user's face size information; And comparing and analyzing the user's face size information and the size information of the user's selected glasses to confirm whether or not the user's selected glasses can be worn.

Description

{METHOD FOR RECOMMENDING GLASS IN ONLINE SHOPPING MALL}

The present invention relates to a method for recommending glasses in an on-line sales system for glasses, and more particularly, to a method for recommending glasses in an on-line sales system for glasses that allows a user to recommend and purchase the best eyeglasses only with a minimum of information input operation.

Recently, as the e - commerce market exponentially grows and grows, the kinds of things that are sold online are becoming more diverse.

According to this atmosphere, in order to purchase such glasses in the past, most of the users went to the store and bought various kinds of eyeglass frames directly to purchase eyeglasses, and as the electronic commerce increases, In the case of sunglasses, goggles and goggles that are not directly related to eyesight, the need for specialists such as doctors and opticians is not needed, so the proportion of sales through e-commerce Is rapidly increasing.

However, when purchasing eyeglasses by glasses only through the Internet, it is less satisfactory than when they are actually worn and purchased, and by creating a virtual wearing eyeglass using computer image synthesis technology, Various virtual wearing methods are emerging.

For example, in Japanese Patent Application Laid-Open No. 60-80222, a method has been proposed in which a person is photographed with a video camera, an eyeglass wearing area is designated on the person, and an eyeglass frame is superposed on the designated area. It is troublesome to provide the face to the optician after taking the video, and since the wearer information must be derived based on the result of the plurality of video images, the image processing capacity is also considerably large.

In addition, this sets the optician's point as the main object of the proposal, creates the wearer's information by opting for the wearer who has visited the wearer's eyeglass, and manages detailed information such as eyeglass material, lens type, frequency, It is not necessary to provide a lens in terms of the medical aspect because it is necessary, and it is difficult to apply it to an e-commerce type retail store where the system must be operated by the wearer directly.

In order to solve the above-mentioned problems, the present invention provides a new type of eyeglass-on-line sales system for eyeglasses, which allows a user to input only minimum information and receive an optimal eyeglass on an online shopping mall Recommendation method.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.

As a means for solving the above problems, the eyeglass recommendation method of the eyeglass online sales system according to an embodiment of the present invention includes receiving and analyzing a user's face photograph provided from a user, Detecting a user's photographing time point by detecting the ear area and analyzing the positional relationship; Generating a user's face model by performing an image projection operation on a previously registered three-dimensional face model based on the user photographing time point; Estimating the real size of the user's face model based on the manually input dynamic distance value from the user after adjusting the display time of the user's face model to the frontal view point and calculating and storing the user's face size information; And comparing and analyzing the user's face size information and the size information of the user's selected glasses to confirm whether or not the user's selected glasses can be worn.

The step of grasping the user's photographing time may include grasping the user's photographing time based on the left-eye distance between the left and right eyes, the ratio between the right-eye and the ear, distance between the centers of the two pupils, .

Wherein the step of generating the user's face model includes adjusting the display time of the user's face model to coincide with the user's photographing time point and then performing an image projection operation on the three- Thereby generating a user face model.

The method may further include the step of comparing and analyzing the dimension information of each of the plurality of glasses and the user's face size information when a plurality of glasses are simultaneously selected and then aligning and guiding the plurality of glasses in order of size agreement ratio .

The present invention enables a user to perform only a minimum information input operation for inputting a face image and a spatial distance information, thereby maximizing user's convenience. In addition, it is possible to estimate the user's facial size by considering the user's photographing time point from the user's facial photograph, and thereby it is possible to stably perform the glasses recommending operation based on the user's facial size even if the user can not provide the photograph .

FIG. 1 is a diagram illustrating a spectacles online sales system according to an embodiment of the present invention.
2 to 4 are views for explaining a method of recommending glasses of the eyeglass-on-line sale system according to an embodiment of the present invention.
5 is a view for explaining a method of recommending glasses of the eyeglass-on-line sales system according to another embodiment of the present invention.

Hereinafter, embodiments and examples of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art to which the present invention pertains.

It should be understood, however, that the present invention may be embodied in many different forms and is not limited to the embodiments and examples described herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout this specification, when an element is referred to as "including " an element, it is understood that the element may include other elements as well, without departing from the other elements unless specifically stated otherwise.

As used herein, the terms "about," " substantially, "and the like are used herein to refer to or approximate the numerical value of manufacturing and material tolerances inherent in the stated sense, Accurate or absolute numbers are used to prevent unauthorized exploitation by unauthorized intruders of the mentioned disclosure. Also, throughout the present specification, the phrase " step "or" step "does not mean" step for.

Throughout this specification, the term "combination thereof" included in the expression of the machine form means one or more combinations or combinations selected from the group consisting of the constituents described in the expression of the machine form, And the like.

Throughout this specification, the description of "A and / or B" means "A or B, or A and B".

FIG. 1 is a diagram illustrating a spectacles online sales system according to an embodiment of the present invention.

1, the eyeglasses online sales system 100 according to an embodiment of the present invention includes an online shopping mall management unit 110, a user's face size calculation unit 120, a spectacle wearing simulation unit 130, A recommendation unit 140, and the like, and the spectacles at this time can be used to collect spectacles, sunglasses, goggles, and the like coupled with the lens.

The online shopping mall operating unit 110 configures and operates a web page for online sales of eyeglasses, and its operation method is based on a general online mall home page operating method, and a detailed description thereof will be omitted.

However, the online shopping mall managing unit 110 of the present invention may further provide a glasses wear menu and a glasses recommendation menu, and may allow the user to determine whether the glasses he / she wants to purchase have a size suitable for his / Make sure that you are informed of which glasses are best for you.

The user facial dimension calculating unit 120 retrieves previously registered user information and acquires and outputs face dimension information of a user when a spectacle wearing or a suggestion operation is requested by the user. However, if the user face information is not registered in the user information, the user terminal 200 requests the user terminal 200 to transmit the face image, and the user terminal 200 acquires and analyzes the face image transmitted in response thereto, .

For reference, in order to accurately calculate the facial dimension based on the user's face photograph, it is necessary that the user should shoot a photograph looking at the front side away from the camera by a set distance, but it is realistic that all the users exactly observe such photographing conditions There is an impossible problem. Accordingly, the user facial feature calculating unit 120 of the present invention detects the feature points contained in the face time of the user, grasps the user's photographing time based on the positional relationship between them, corrects the user facial photographing result By calculating the face dimensions, even if the user provides a photograph which does not comply with the above-mentioned conditions, the glasses recommendation operation of the present invention can be performed without problems.

The spectacle wearing simulation unit 130 determines and notifies whether the user can wear the glasses selected by the user by comparing and analyzing the user's facial size and the glasses size selected by the user. In addition, after generating an avatar reflecting the user's face shape based on the user's facial size, a screen in which the glasses selected by the user are overlaid on the eyes of the avatar, that is, an image wearing glasses is generated and further provided as a reference screen, Make sure that you are able to grasp even the feeling of wearing glasses.

The eyeglass recommending unit 140 inquires of the user about search conditions such as a brand, a style, a color, a price range and the like, and acquires face size information through the user's face size calculating unit 120 . Then, the glasses of the user 's taste are firstly filtered based on the user search condition, and the glasses which can be worn by the user based on the user' s face dimensions are second filtered and then cataloged. That is, the user can selectively receive only the glasses optimized for his / her physical condition, thereby minimizing the failure probability of purchasing the glasses.

Hereinafter, referring to FIGS. 2 to 4, a method for recommending glasses of the eyeglass-on-line sale system according to an embodiment of the present invention will be described in detail.

First, when the user accesses the online shopping mall main page, the online shopping mall operating unit 110 catalogs and sells the glasses that are being sold through the online shopping mall through the main page. When the user selects one particular eyeglass through the eyeglass list, the user is provided with a sale page of the eyeglasses, and a glasses wearing menu is additionally provided through a partial screen of the sales page as shown in FIG.

If the user clicks the eyeglass wearing menu, the user facial dimension calculating unit 120 searches user information to determine whether or not the user facial dimension information is registered. If the user's face size information is in an unregistered state, the user requests the user terminal 200 to send a face photograph, thereby allowing the user to acquire and transmit a photograph of his face. Once the face image of the user is obtained, one of the conventional facial recognition algorithms widely used as shown in FIG. 3 is employed to detect the user's face area, eye area, pupil area, ear area, Dimensional face model to generate a user face model.

4, when the user takes a picture in a state in which the user looks at the front side, the distance between the left eye and the ear (D1) and the distance between the right eye and the ear (D2) When the user takes a photograph while looking at the left side (right side), the left (right) eye and the ear distance D1 have a smaller value than the right (left) eye and the ear distance D2 And the difference between the two distances will increase in proportion to the angle of rotation of the user's face. In addition, the inclination of the lines connecting the center points of the two pupils changes according to the inclination of the face when photographing.

Accordingly, in the present invention, the face of a plurality of users is photographed and analyzed at various photographing time points, and the statistical value is calculated. The distance between the left eye and the ear, the ratio between the right eye and the ear, and the tilt direction and angle And stores and manages it as a user shooting time reference value. Based on this, the position of the user's photographing is analyzed by analyzing the positional relationship of the eye area, the pupil area, and the ear area obtained through the face recognition process, and the display time of the face standard model is adjusted so as to coincide with the user photographing time. In other words, the user's face model is generated by performing an image projection operation on the face standard model having the corresponding display point with two pupil regions as reference points. At this time, the user photographing time corresponds to the three-dimensional viewpoint determined by the face rotation direction and angle, the face inclination direction and the angle, and accordingly, the display time of the face standard model can also be three-dimensionally adjusted. That is, by moving the display time of the face standard model on the basis of the front view point by the face rotation direction and angle, face inclination direction and angle corresponding to the user photographing time point, the face standard model having the display time coinciding with the user photographing time point is obtained .

Then, by adjusting the viewing point of the user's face model back to the frontal viewpoint, the ratio of the left-eye distance to the right-eye distance between the left eye and the right eye projected on the user's face model becomes 1: 1, Let the slope be "0.".

Then, the user inputs the dynamic distance value, and estimates the real size of the user's face model based on the dynamic distance value input in response thereto, and calculates and stores the user's face size based on the real size. At this time, the user's facial size may be the distance between the two ears (d1), the distance of the same space (d2), the distance between the left eye and the ear (d3), and the distance between the right eye and the ear (d4).

 When the face size of the user is thus obtained, the spectacle wearing simulation unit 130 compares and analyzes the user's face size with the user's selected eyeglass size, thereby confirming whether or not the user-selected glasses can be worn and guiding the user. The user guidance operation may be performed in a manner of notifying only whether or not it is possible to wear it, but it may be accompanied by additional information such as a size matching ratio between the user's face size and the size of the glasses, a shot wearing glasses using the avatar corresponding to the user's face It might be.

In the above description, the case where only one eyeglass selected by the user is guided is described. However, if necessary, as shown in FIG. 5, the user may simultaneously select a plurality of glasses, You can also recommend glasses.

Hereinafter, referring to FIG. 5, the eyeglass recommending method of the eyeglass online sales system according to another embodiment of the present invention will be described in detail.

First, the online shopping mall managing unit 110 provides a glasses recommending window, allowing the user to set search conditions such as a desired brand, style, color, and price range. If the user selects the glasses recommendation menu after selecting all the search conditions, the glasses recommendation unit 140 searches the eyeglass database based on the user search condition to select the glasses that satisfy the user's preference.

Then, size information for each of the selected spectacles is additionally acquired and compared with the user's face dimensions, thereby calculating the size coincidence rate for each of the selected spectacles. , Allowing users to more easily and quickly search and purchase glasses that are best suited to them.

It will be understood by those of ordinary skill in the art that the foregoing description of the embodiments is for illustrative purposes and that those skilled in the art can easily modify the invention without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be interpreted as being included in the scope of the present invention .

Claims (4)

A method for recommending a spectacle of a spectacle online sales system,
Receiving and analyzing a user's face photograph provided by a user, detecting user's face area, eye area, pupil area, ear area, and analyzing the positional relationship to grasp a user's photographing time point;
Generating a user's face model by performing an image projection operation on a previously registered three-dimensional face model based on the user photographing time point;
Estimating the real size of the user's face model based on the dynamic distance value manually inputted from the user after adjusting the display time of the user's face model to the frontal view point and calculating and storing the user's face size information; And
And comparing and analyzing the user's face size information and the dimension information of the user's selected glasses to confirm whether or not the user's selected glasses can be worn. The method according to claim 1, wherein the step
Wherein a user's photographing time point is determined based on a left eye-to-ear distance, a right eye-to-ear distance ratio, and a tilt direction and an angle of a line connecting two center points of the pupil detected from the user's face photograph. 3. The method of claim 2, wherein generating the user's face model comprises:
The user's face model is generated by performing an image projection operation on the three-dimensional face model with two pupil regions as reference points after adjusting the display time of the user's face model to coincide with the user photographing time point How to recommend glasses. The method according to claim 1,
And comparing and analyzing the dimension information of each of the plurality of glasses and the user's face size information when a plurality of glasses are simultaneously selected and arranging and guiding the plurality of glasses in order of size agreement ratio How to recommend glasses.

Images