WO2011085727A1

WO2011085727A1 - Advice information system

Info

Publication number: WO2011085727A1
Application number: PCT/DK2010/000007
Authority: WO
Inventors: Tim Schyberg
Original assignee: Individual
Current assignee: Individual
Priority date: 2009-01-15
Filing date: 2010-01-15
Publication date: 2011-07-21
Anticipated expiration: 2012-07-15
Also published as: WO2011085727A8

Abstract

This invention relates to the makeup advice information system which can be used for easily assessing image data and subsequent supplying information about the makeup method or makeup product suitable for a human in need of such advice or information.

Description

ADVICE INFORMATION SYSTEM

FIELD OF INVENTION

This invention relates to a makeup advice information system which can be used for easily assessing image data and subsequent supplying information about a makeup method or makeup product suitable for a human in need of such advice or information. The invention also relates to a method for providing such advice or information.

BACKGROUND OF INVENTION

Over the years, it has become increasingly difficult for a consumer to choose a beauty product. There has been an increase in both the number of beauty products and the number of brands for those products, thus making it difficult to choose the right beauty product. Moreover, a consumer may want to select a beauty product based on several personal factors. In some cases, a consumer may become overwhelmed by the sheer number of choices and depend on professional advice provided by a beauty consultant in order to select an appropriate product. While beauty consultants are often very helpful in making product recommendations, a number of modern techniques for marketing and sales of beauty products are unable to provide for such a personal advisor. For example, discount stores, on-line purchase arrangements, telephone ordering, and mail-in product purchases often lack any significant communication exchange other than that absolutely necessary to consummate a product sale. For many customers of cosmetics or other appearance related products, making a purchase decision is difficult due to the wide variety of variables involved in the purchase decision and the wide range of cosmetics products from which the customer can choose. As a result, there are hundreds of cosmetics products in shades which complement or contrast the user's natural complexion color. Additionally, makeup styles change seasonally, and the time of day and location where the user will be may also affect the user's decision regarding which product will be worn. For example, a user may want to present a different appearance during the day at an office than at night at a casual event. Hence, the cosmetics may need to be adjusted based upon the user's intended use.

Thus, many customers desire advice to help them come to a decision regarding cosmetics purchases. However, many retail stores only provide display space for cosmetics, but do not provide trained personnel who help the customer come to a decision regarding cosmetics purchases. Additionally, the ambient lighting at many retail stores can distort the customer's skin coloration, thus giving the customer a false impression of how the cosmetics look on their skin. For example, many retail stores use fluorescent lighting which radiates light with a slightly bluish tint. Also, some stores use coatings on their windows which filter natural sunlight in a particular range of the visible spectrum. Thus, many customers are making a "best guess" as to whether the cosmetics product is acceptable when worn by that particular user. As a result, customers often purchase cosmetics based upon how they look in the store only to find that they do not like how the cosmetics look when they get home. Additionally, for some types of cosmetics products (e.g., lipstick), the customer is not allowed to sample the product before purchase due to health concerns.

Another disadvantage with some retail stores is that the manufacturer is not able to develop a relationship with the customer. The personnel at these stores typically have little interest in whether the customer purchases cosmetics or if the customer is satisfied with their purchase decision. Thus, these employees have little interest in representing a particular cosmetics brand in a manner which will persuade the customer to purchase that brand again. However, many manufacturers would like to provide some consultation service for customers, that would result in greater customer satisfaction, which in turn would result in more sales.

Alternatively, many high-end cosmetics manufacturers operate their own proprietary retail space, also known as "makeup counters," within retail stores. These makeup counters are staffed with trained representatives who can provide advice to the customer as to which cosmetic shades are complementary to the skin coloration of that particular customer as well as current styles among which the customer may choose. Thus, the customer is presented with a smaller range of products from which to choose, but which are more suited for that customer based upon her needs. Additionally, the representatives can recommend other products which may complement the purchase being made by the customer and provide advice regarding current fashion trends.

At very high end retail spaces, the manufacturer may provide a controlled environment in which the lighting is carefully calibrated to provide the customer an accurate impression of what the cosmetics will look like when the customer leaves the store. Unfortunately, the cosmetics products sold by these manufacturers are typically much more expensive than those sold at the retail stores which do not provide any consultation. Additionally, some customers are intimidated by the trained representatives and/or do not want to discuss something as personal as their appearance with a stranger. Again, the end result is that some customers who may benefit from receiving a cosmetics consultation do not receive the advice they seek.

SUMMARY OF INVENTION

The problem to be solved by the present invention is how to make advice information accessible to all potential clients. Thus, an objective of the present invention is to provide makeup advice efficiently and economically.

The present inventor has invented an apparatus (system) and a method which, in addition to meet to the above objection, has the additional advantage that the makeup advice can provided by the makeup artist and received by the client without any restrictions in time or place.

An exemplary apparatus of the present invention comprises:

a) an image data reception means for receiving image data transmitted by a remote located human, e.g. via an electronic network;

b) an imaging means for visually displaying the image data; c) an image assessing means for determining a makeup method and/or makeup solution suitable for imaged person, said image assessing means generating makeup advice; d) an advice transmitting means for transmitting advice information about said

makeup method or solution determined by said image assessing means to said remote located human.

An aspect of the invention relates to system for determining and/or identifying makeup advice. The makeup advice may include a recommended product. The recommended product may be any makeup product, such as a cosmetic product (e.g., makeup or care product or service). In one embodiment, the identification of a recommended product may also be based on product characteristics, user preferences, populational data, or expert advice. The recommended product may also be chosen based on either aesthetic, ethical, physical, physiological, and/or biological compatibility.

In an exemplary embodiment, the new method for providing make-up or cosmetic advice consists of the following steps: A) The requester of advice uploads a facial picturejOr a picture on with the face is visible, to a homepage which is connected to the computer belonging to the advice provider. B) The picture is displayed on a monitor screen at the advice providers location. C) The advice provider assesses the picture and based on the providers experience, determines which makeup methods and/or makeup products are suitable for the requester. D) The advice information is transmitted to the requester. DETAILED DISCLOSURE

In a first aspect, the present invention relates to a makeup advice system which comprises: a) an image data reception means for receiving image data transmitted by a remote

located human/user/subject/person (these terms may be used interchangeably), e.g. via network, such as an electronic network;

b) an imaging means for visually displaying the image data;

c) an image assessing means for determining a makeup method and/or makeup solution suitable for imaged person, said image assessing means generating makeup advice; d) an advice transmitting means for transmitting advice information about said

The system may further include a database comprising a plurality of data selected from the group consisting of a makeup method (e.g. makeup guidance) and/or a makeup solution (e.g. makeup product). The makeup solution may be a makeup product, such a product selected from of blushes, mascaras, eyeliners, brow kits, brow liner, brow color, lip liners, lipsticks, lip glosses, lip cream, lip cure, lip balm, lip plummer, eyebrow liners, eyebrow fix, eyebrow kits, eye shadows, nail polishes, foundations, concealers, primers, cealer/fix, eyegrease®, powders, combinations products like lip, chick and eye powders, cleansers, makeup tools, makeup removers, mineral makeup and other forms of makeup; the makeup method may be a method for application of a makeup solution; and the image assessing means may be a human being, e.g. a make up artist or make-up consultant, or an image comparing software, said software optionally comprising an artificial intelligence engine, or said comparing software is used for assistance of the human being. In an interesting embodiment, the image assessing means compares the image data with a model image. The advice transmitting means may be a telephone, or it may be a computer connected to a computer at the location near the remote located human via a network. In it presently preferred that the system of the invention is capable of (a) performing image processing to produce a plurality of images of imagined post- makeup faces based on the image data, with a different mixing ratio by mixing an image of said desirable face with an image of a face of a subject person/human; (b) displaying said plurality of images of imagined post-makeup faces, prepared in said step (a), on a monitor screen and selectively determining from said displayed imagined post-makeup faces an ideal post-makeup face said subject person/human desires; and (c) deriving a makeup method from an image of said ideal post-makeup face, determined in said step (b).

The present invention further relates to a system for providing makeup advice, the system comprising

- a data structure (or data bank) containing information selected from the group consisting of: a plurality makeup advice, a plurality of makeup products, and information about suitability of combining at least some of the plurality of makeup products with other of the plurality of makeup products;

- an engine, such as software, configured to receive and process the information, such as an image and/or user-specific information;

- an interface for allowing a user to assess the information, in order to identify makeup advice or makeup method; and

- an interface for conveying the identified makeup advice or method to the user.

In an embodiment, the user-specific information includes personal information of at least one of skin type, skin tone, hair style, hair color, cosmetic color and product preferences, allergy information, demographic information, climate information, lifestyle information, fashion preferences, prior purchases, prior expressed interest, and prior browsing patterns.

The interface may be a network interface configured to receive user-specific information via a network and in at least one location remote from the user, and to transmit the makeup advice to a user located remote. The makeup advice may include a product recommendation.

In interesting embodiment, the system of the invention further comprises a purchase engine for offering the user an opportunity to purchase the product.

The information characterizing a plurality of makeup products may include information about inter-makeup product compatibility, and/or the information about suitability of using is based on expert advice.

In an interesting embodiment, the product is a makeup product chosen from at least one of tangible merchandise, services, diagnostics, makeup regimen, and advice.

The invention may be used to aid consumers in obtaining makeup advice. That is, based on user-specific information, the invention may provide a consumer makeup advice, such as recommended products. T e recommended products may complement (physically, ethically, physiologically, biologically, and/or aesthetically) a user-selected product(s). So, for example, based on a selection of ABC company's Ruby Red lipstick shade, and knowledge of the consumer's facial features, facial skin tone, hair and eye color and lifestyle information, a method consistent with the invention may identify a recommended lipliner and blush.

Reception of the user-specific information may be performed using one or more of a network (described below), oral communication, visual communication, written communication, physical data carrier (described below), and/or any other means capable of conveying makeup advice. Networks may include a local area network, a wide area network, a virtual private network, a dedicated intranet, the Internet, the Ethernet, a radio network, a telephony-based network, a cellular network, a wireless network, or any other mechanism enabling

communication between two or more nodes or locations. Examples of a physical data carrier may include one or more of paper stock, an electronic data carrier, and a computer screen. The user-specific information may be organized into categories, such as personal information, identifications of user-specified products, etc. Personal information may include demographics, skin and body conditions (e.g. skin type, skin texture, skin tone, wrinkles, hair color, hair style, hair condition, eye color, etc.), age, facial features, purchase history, cosmetic color, allergy information, climate information, lifestyle information, product preferences, fashion preferences, prior purchases, prior expressed interest, and/or prior browsing patterns. It should be noted that the term "user-specific information" is not necessarily related to any particular user. In this regard, the present document uses the term subject-specific information interchangeably with the term user-specific information and neither term is necessarily tied to a particular individual engaging in a particular activity.

A data structure may include a read-only memory (ROM) device, random access memory (RAM) device, tape, disk drive, optical storage device, magnetic storage device, redundant array of inexpensive disks (RAID), organic storage media, computer code, constructs derived from computer code, and/or any other mechanism capable of containing information.

In one embodiment, the identification of a recommended product may also be based on product characteristics, user preferences, populational data, and/or expert advice. T e populational data may include preference information of a host of individuals with varying attributes, demographics, or other characteristics. Thus, populational trends may be identified and used in the recommendation process. The recommended product may also be chosen based on aesthetic, physiological, biological, ethical, and/or physical compatibility.

An exemplary system environment in which the invention may be implemented:

The system preferably comprises and input module, a storage device and an output module. It may also comprise a database, such as a user profile database. The system may be contained in a stand-alone device (e.g., a computer) or may be distributed over a network.

User profile database may contain personal information about the user. The database of the invention may contain a variety of information for analysis. For example, database may contain information about products and services as well as expert advice. Input module may be implemented with a wide variety of devices for receiving information, and may include an input device, a storage device, and a network interface. Input device may be, for example, a keyboard, a mouse, a disk drive, a telephone, a scanner, a microphone, a web cam, and/or any other suitable input mechanism for conveying information to the assessing means.

Likewise, storage device may be implemented with a wide variety of systems, subsystems, and/or devices for providing memory or storage, including one or more of the following: readonly memory (ROM) device, random access memory (RAM) device, tape, disk drive, optical storage device, magnetic storage device, redundant array of inexpensive disks (RAID), organic storage media, and/or any other mechanism capable of providing storage or memory.

Network interface may facilitate an exchange of data between user and advice supplier.

Output module (or imaging means) may be implemented with a wide variety of devices for providing information, and may include a display, a storage device, and a network interface. Display may be any output device, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), and/or a printing device. Storage device may be similar to storage device. In further aspects, the invention relates to a method of providing makeup advice, which method includes the following steps:

(a) uploading an image of the face of the person/human onto a computer;

(b) transmitting the image data via an electronic network to another computer, said computer having a means for visually displaying the image;

(c) visually assessing the displayed image for determining eg. color balance data; and

(d) transmitting makeup advice to the computer used for uploading image; and to a method of providing makeup advice, which method includes the following steps:

(a) uploading an image of the face of the person/human onto a homepage;

(a) receiving an image of the face of the person/human which has been transmitted via an electronic network;

(b) displaying the image on a monitor screen;

(d) transmitting makeup advice via an electronic network.

Advantageously, the method comprises receiving information specific for the

person/human/user/subject. The user-specific information may include personal information of at least one of skin type, skin tone, hair style, hair color, cosmetic color and product preferences, allergy information, demographic information, climate information, lifestyle information, fashion preferences, prior purchases, prior expressed interest, and prior browsing patterns. It is presently preferred that the method is conducted, at least in part, in a network environment, wherein receiving user-specific information occurs via a network and in at least one location remote from the user, and wherein providing occurs via the network.

The makeup advice may include a product recommendation. Also, the method of the invention may further comprise providing the user with an option to indicate an interest in purchasing the product. It is preferred that recommendation of a plurality of makeup products includes information about inter-makeup product compatibility. In an embodiment, the method may further comprise maintaining personal information about the user, said information comprising a makeup products selected for the user, and at least some of the advice of use information. In is convenient that the method is conducted, at least in part, in a network environment, wherein receiving the user selection occurs via a network and in at least one location remote from the user, and wherein notifying occurs via the network.

In an interesting embodiment, the category of makeup products is at least one of mascaras, eye shadows, eye liners, foundations, concealers, blushes, lip sticks, lip glosses, liners, hair treatments, and hair colorings. The method of the invention may enable a display of a simulation of the makeup product applied on the facial image, such as wherein the facial image is a facial image of the subject. The term maintaining information about suitability of use comprises: maintaining information about suitability of use of at least some of the plurality of makeup products with other of the plurality of makeup products, the information about suitability of use being derived from an expert.

Further, the user may be presented with an opportunity to purchase the recommended product. Expert advice may be provided by an expert makeup consultant and/or specialist, either based on their expertise and/or based on data gathered from user surveys and/or questionnaires. Expert advice may include, for example, relationships between products (e.g. inter-product compatibility), relationships between products and physical human attributes, recommended treatments for certain makeup conditions, and/or color compatibility tips.

Expert advice is not limited to the afore-mentioned examples and may include other opinions and/or recommendations of persons with makeup knowledge.

User profile may include personal and/or demographic information of the user such as one or more of name, age, body conditions (e.g., skin type, skin texture, skin tone, wrinkles, hair color, hair style, hair condition, eye color, allergy, and/or other special conditions), physical characteristics (e.g., facial features), demographics (e.g., region, climate, and/or lifestyle), user preferences (e.g., preferred types of products, cosmetic color, apparel color, types of accessories, brands, and/or products), and/or purchase history.

The user may have the option of buying the selected product. A plurality of selected products may be displayed simultaneously in full on the users monitor screen, and/or a list of the selected products may be displayed, with the option for the user to more fully display information on any selected product.

Information on recommended product may be displayed in full for one or more of

recommended products. If the user elects to buy the selected product or recommended product, merchant may charge the user's registered account, bill the user later, and/or request payment information from the user. For a registered user, merchant may simply access pre-stored payment information of the user.

However, in its broadest sense, features and principles of the present invention do not necessarily require a visual simulation of a selected product and/or recommended product. Information regarding the application of the selected or recommended product may be provided visually, textually, audibly, and/or in any other manner with or without visual simulation.

A facial image may be accessed. Accessing may include obtaining a facial image from a network, data structure, and/or storage medium. Examples of a network, data structure, and storage medium are previously described. Accessing may also include processing the facial image to permit simulated application of makeup product to a selected portion of the facial image as described later herein. Accessing may further include receiving the facial image. Receiving may be performed using any mechanism or method described above for«reception of user-specific information.

During or after receiving the facial image, the facial image may be displayed. While the term "displaying" may include a direct act of presenting content, in a broader sense, the invention is not so limited. Specifically, as used herein, forms of the word "displaying" may include indirect acts such as providing content for transmission over a network to a display unit, regardless of whether the display unit is in the custody and/or control of the sender. "Displaying" may further include preparing content for delivery to an intermediate carrier which may then transmit the content to an end user for presentation of the content on an end user's display device. Thus, any entity in a chain of delivering information for display performs an act of "displaying" within the context of this patent. This also includes parties involved in the provision of software to facilitate facial image display. Software may include computer programs, routines, and/or any instructions implementable by computer or electronic devices. As previously described, a display may include a CRT, LCD, printing device, and/or any other information output device.

A method consistent with the invention may include receiving from the user a selection of at least one makeup product for simulated application to the facial image. For example, the user may select a product for simulated application to a facial image. The product selection may be received by verbal communication, written communication, visual communication, electronic communication, and/or through previously described mechanisms such as those discussed in connection with input device. As used herein, the term "simulating" may include an act of image processing to cause an application of a makeup product to appear on a facial image. In a broader sense, the term "simulating" may also include any act that facilitates presentation of a simulated makeup application. Such acts may include providing image processing software either physically, electronically, and/or through association with a third party who performs image processing functions. Image processing functions may include image processing techniques referred to in one or more of a series of concurrently filed applications incorporated herein by reference. Consistent with the invention, a method may additionally include simulating at least one recommended makeup product on a facial image. Simulation of a recommended product(s) may include modifying a facial image such that a user may obtain knowledge of how user- selected product(s) and recommended product(s) may appear when worn together or separately. Simulation on facial images may include modifying (or creating) a photograph of a model, a graphical representation of a model, a user's photograph, a graphical representation of a user, a 3-D projection of a model, a 3-D projection of a user, and/or any other representation of a user or a model. Regardless of the format, simulation may be performed on any selected portion and/or all of the facial image.

In one embodiment, a list of recommended products may be provided to the user and the user may select one or more products from the list. Upon selection, recommended may be simulated on facial image. By way of example, the list may be derived from one or more of the following: advice of makeup experts, user preference data, populational data, and/or user purchase history.

As used herein the term "query" refers to a question or prompt in any form that may be presented to a subject to encourage a response from the subject. The query could be presented in any manner enabling the subject to perceive it. For example, the query could be presented in a visual form (e.g., text or image) or audio form.

In one exemplary embodiment, the query may prompt the subject to input personal information such as physical attributes, lifestyle information, type of look, or personal preferences. Examples of lifestyles might include, but are not limited to: free spirited, adventurous, partier, alternative, and religious. Examples of looks include, but are not limited to, conservative, modern, hot, cool, chic, and retro.

Once a subject is presented with one or more acceptable products, the subject may be provided with purchasing information. Such purchasing information may include, but is not limited to, pricing information, at least one location of a store selling the product, a link to a website selling the product, and/or information enabling a product purchase.

This application may discuss makeup products in connection with use by women. However, it is to be understood that such discussions are for exemplary purposes only. It is to be understood that the invention is equally applicable to all genders, and is not necessarily limited to the makeup industry- It is also to be understood that any functional aspect of the invention can be implemented via any location in the system or network, and data software may be resident at any location either in a network, at a stand-alone site, or on media in the custody and control of a user or subject.

It is to be further understood that the physical mechanisms (e.g. hardware, software, networks, systems) for implementing the methods of the invention are many. Networks, hardware and systems can be configured in a host of ways with software and hardware functionality residing at many alternative locations. In addition, systems other than the exemplary systems disclosed might be used to implement the invention. Therefore, it is to be understood that the methods of the invention are not limited to any particular structure. In another aspect, the invention relates to a system for providing makeup advice, said system being adapted for a method of the invention. In further aspects, the invention relates to a combination (e.g. a kit of parts) of makeup products, obtainable by a method of the invention; and to a combination (e.g. a kit of parts) of makeup products, resulting from an advice generated by a method or system of the invention. The combination of the invention may be in intangible form. In yet an aspect, the invention relates to makeup advice, information, method or solution, generated by a method or system of the invention.

DEFINITIONS

To the extent not inconsistent with the invention defined herein, definitions and terminology usage in the above-mentioned concurrently filed applications, the above-mentioned priority applications, and the following global definitions are to be considered in interpreting the language of this patent and the claims herein. Where multiple definitions are provided, they should be considered as a single cumulative definition.

In the present context, the term "color balance data" comprises the term skin tone analysis, eg. the hue, the gradation of the skin color. The tone means eg the shade or tint of a color. The term warm hue include gradations of colors having a golden tint. The term cool hue means a gradation of skin color having a majority presence of red undertones. Cool hue include gradations of colors having a pinky-blue tint.

In the present context, "picture" is used interchangeably with "photo", "photograph" and "image". Especially digital photos are suitable for the present invention.

The term "image" may include one or more of two-dimensional and three-dimensional representations. Depending on the embodiment, the term "image" may include either a visually perceptible image or electronic image data that may be either used to construct a visually perceptible image or to derive information about the subject. The image may represent, for example, the subject's entire face, or a portion of the subject's face. The image may be a detailed picture (e.g., a digital image or a photograph) of a portion of the subject's body and/or a topological plot mapping contours of a portion of subject's body. The image may be an actual or a simulated image. Simulated images may include wholly or partially generated computer images, images based on existing images, and images based on stored features of a subject.

The term "image capture device", similar terms, and terms representing structures with similar functions may include one or more of a digital camera, webcam, film camera, analog camera, digital video camera, scanner, facsimile machine, copy machine, infrared imager, ultra-sound imaging device, or any other mechanism for acquiring an image of a subject's external body condition, an image of the subject's countenance, an/or an image of„the subject's skin. An ultrasonic device might provide skin thickness information, or it might create a map on an area of the external location. Thus, the term "image" as used herein may be broader than a picture. Combinations of image capture devices may be used. For example, an image captured on photographic paper using a film camera might then be scanned»on a flat bed scanner to create another image.

The term "capturing (an image)", or any form thereof, refers to the use of an image capture device to acquire an image. "Capturing" may refer to the direct act of using the image capture device to acquire the image. It may also include indirect acts to promote acquisition. To this end, "capturing" may include the indirect acts of providing access to hardware, or to at least one of a client-based algorithm and a server-based algorithm for causing the image capture device to capture an image. This may be accomplished by providing a user with software to aid in the image capture process, or providing the user with access to a network location at which the software resides. Also consistent with certain embodiments of the invention, capturing may include at least one of receiving an instruction from the subject to capture an image, indicating to the subject before the image is captured, and indicating to the subject when the image is captured.

The term "image processing technique" or similar terms, may include a software program, computer, application specific integrated circuit, electronic device and/or a processor designed to identify in an image one or more characteristics, such as a skin condition. Such techniques may involve binarization, image partitioning, Fourier transforms, fast Fourier transforms (FFTs), and/or discrete cosine transforms may be performed on all or part of the image, resulting in coefficients. Based on the coefficients, conditions may be located, as known in the art. Artificial intelligence, such as fuzzy logic, neural networks, genetic programming and decision tree programming, may also be used to identify conditions. Alternatively, one or more digital filters may be passed through the image for locating specific conditions. These examples are provided for illustrative purposes with the understanding that any image processing technique may be used.

The term "network interface" or similar terms refer to any mechanism for aiding

communications between various nodes or locations in a network. A network interface may include, for example a bus, a modem, or any other input/output structure. A network interface may permit a connection to any network capable of being connected to an input and/or output module located within at least one or more of the following exemplary networks: an Ethernet network, an Internet Protocol network, a telephone network, a radio network, a cellular network, or any mechanism for permitting communication between two or more modes or remote locations. In some invention embodiments, a network interface might also include a user interface.

The term "user interface" may include at least one component such as a keyboard, key pad, mouse, track ball, telephone, scanner, microphone, touch screen, web cam, interactive voice response system (IVR), voice recognition system or any other suitable input mechanism for conveying information. A user interface may also include an input port connected by a wired, . optical, or wireless connection for electromagnetic transmissions. In some embodiments, a user interface may include connections to other computer systems to receive the input commands and data therefrom. User interface may further include a data reading device such as a disk drive for receiving input data from and writing data to storage media such as magnetic and optical disks.

As used herein terms such as "external body condition", "skin condition", and "actual condition" refer to conditions of at least one of the skin, teeth, hair, eyebrows, eyelashes, body hair, facial hair, fingernails, and/or toenails, or any other externality. Examples of skin conditions may include elasticity, dryness, cellulitis, sweating, aging, wrinkles, melanoma, exfoliation, desquamation, homogeneity of color, creases, liver spots, clarity, lines, microcirculation, shininess, softness, smoothness, tone, texture, matitty, hydration, sag, suppleness, stress, springiness, firmness, sebum production, cleanliness, translucency, luminosity, irritation, redness, vasocolation, vasomotion, vasodilation, vasoconstriction, pigmentation, freckles, blemishes, oiliness, pore distribution, pore size, moles, birthmarks, acne, blackheads, whiteheads, pockmarks, warts, pustules, boils, blisters, marks, smudges, specks, psoriasis and other characteristics associated with the subject's skin. Examples of hair conditions may include keratin plug, length, dryness, oiliness, dandruff, pigmentation, thickness, density, root conditions, split ends, hair loss, hair thinning, scales, staging, cleanliness and other properties related to the subject's hair. Examples of fingernail and toenail conditions may include onychomycosis, split nails, delaminating, psoriasis, brilliancy, lines, spots, coloration, gloss, strength, brittleness, thickness, hangnail, length, disease, and other characteristics related to the subject's nails. Other conditions may include, for example, size and proportion of facial features, teeth discoloration, and any other aesthetic-related or physical, physiological, or biological conditions of the user.

"Enabling", "facilitating", and "causing" an action refer to one or more of a direct act of performing the action, and any indirect act of encouraging or being an accessory to the action. Thus, the terms include partnering or cooperating with an entity who performs the action and/or referring commerce to or having commerce referred from an entity who performs the action. Other examples of indirect activity encompassed within the definitions of "enabling", "facilitating", and "causing" may include providing a subject with one or more of tools to knowingly aid in performing the action, providing instructions on how to perform the action, providing prompts or cues to perform the action, or expressly encouraging performance of the action. Indirect activity may also include cooperating with an entity who either directly performs the action or who helps another perform the action. Tools may include software, hardware, or access (either directly, through hyperlink, or some other type of cooperation or partnering) to a network location (e.g., web site) providing tools to aid in performing the action. Thus, phrases such as "enabling access" and "enabling display" do not necessary require that the actor actually access or display anything. For example, the actor may perform the enabling function by affiliating with an entity who performs the action, or by providing instructions, tools, or encouragement for another to do the accessing and displaying.

Forms of the word "displaying", "imaging" and like terms may also include indirect acts such as providing content for transmission over a network to a display device, regardless of whether the display device is in the custody or control of the sender. Any entity in a chain of delivering information for display performs an act of "displaying", as the term is used herein. Likewise, the term "providing" includes direct and indirect activities. For example, providing access to a computer program may include at least one of providing access over a network to the computer program, and creating or distributing to the subject a computer program configured to run on the subject's workstation or computer. For example, a first party may direct network traffic to (either through electronic links or through encouragement to visit) a server or web site run by a second party. If the second party maintains a particular piece of software thereon, then it is to be understood that within the meaning of "providing access" as used herein, the first party is said to provide access to the particular software. Or if the first party directs a subject to a second party who in turn ships the particular software to the user, the first party is said to provide the user with access to the particular software. (Of course, in both of the above instances, the second party would also be providing access within the meaning of the phrase as used herein.)

"Receiving" may include at least one of acquisition via a network, via verbally communication, via electronic transmission, via telephone transmission, in hard-copy form, or through any other mechanism enabling reception. In addition, "receiving" may occur either directly or indirectly. For example, receipt may occur through a third patty acting on another party's behalf, as an agent of another, or in concert with another. Regardless, all such indirect and direct actions are intended to be covered by the term "receiving" as used herein. A received request, for example, may take one of many forms. It may simply be a checked box, clicked button, submitted form or oral affirmation. Or it might be a typed or handwritten textual request. Receiving may occur through an on-line interest form, e-mail, facsimile, telephone, interactive voice response system, or file transfer protocol transmitted electronically over a network at a web site, an internet protocol address, or a network account. A request may be received from a subject for whom information is sought, or an entity acting on the subject's behalf. "Receiving" may involve receipt directly or indirectly through one or more networks and/or storage mediums. Receipt may occur physically such as in hard copy form, via mail delivery or other courier delivery. Forms of the word "maintain" are used broadly to include gathering, storing, accessing, providing access to, or making something available for access, either directly or indirectly. For example, those who maintain information include entities who provide a link to a site of a third party where the information is stored.

Consistent with the concepts set forth above, all other recited actions such as, for example, obtaining, determining, generating, selecting, applying, simulating, presenting, etc, are inclusive of direct and indirect actions. Thus, for purposes of interpreting the following claims, an entity performs a recited action through either direct or indirect activity. Further examples of indirect activity include sending signals, providing software, providing instructions, cooperating with an entity to have the entity perform the action, outsourcing direct or indirect actions, or serving in any way as an accessory to the specified action. T e term "product" is used to generically refer to tangible merchandise, goods, services, and actions performed. A "makeup product," "makeup care product," "cosmetic product" or similar terms, refer to products (as defined above) for effecting one or more external body conditions, such as conditions of the skin, hair and nails. Examples of tangible merchandise forms of makeup products include cosmetic goods, such as treatment products, personal cleansing products, and makeup products, in any form (e.g., ointments, creams, gels, sprays, supplement, ingesta, inhalants, lotions, cakes, liquids, and powders). Thus, the term "makeup product" and the like generally refers to any product that may be used for affecting one or more external body conditions of a subject. Such products may include, but are not limited to, anti-aging compounds, elasticity enhancers, hair coloring products, moisturizers, tanners, anti- wrinkle agents, blushes, mascaras, eyeliners, brow kits, brow liner, brow color, lip liners, lipsticks, lip glosses, lip cream, lip cure, lip balm, lip plummer, eyebrow liners, eyebrow fix, eyebrow kits, eye shadows, nail polishes, foundations, concealers, primers, cealer/fix, eyegrease®, powders, combinations products like lip, chick and eye powders, cleansers, makeup tools, makeup removers, mineral makeup, skin tonics, scrups, creams, serums, masks, blemish control, pure control®, acne/rosacea treatment products, sun protection products, sun primer®, dental whitening products, cellulite reduction products, shampoos, conditioners, hair straightners and curlers, lash curlers, brushes, sponges, weight reduction products, and any other product that affects a subject's appearance. Moreover, as used herein, the term "makeup product" may include merchandise, beauty services, such as those performed in salons, spas, and other beauty facilities, and beauty actions such as treatments, therapies, exercises, etc. Examples of service forms of makeup products include hair styling, hair cutting, hair coloring, hair removal, skin treatment, make-up application, and any other offering for aesthetic enhancement. Examples of other actions performed include massages, facial rubs, deep cleansings, applications of makeup product, exercise, therapy, or any other action effecting the external body condition whether performed by a professional, the subject, or an acquaintance of the subject.

The following is exemplary and non-exhaustive listing of a few makeup products: scrubs, rinses, washes, moisturizers, wrinkle removers, exfoliates, toners, cleansers, conditioners, shampoos, cuticle creams, oils, and anti-fungal substances, anti-aging products, anti-wrinkle products, anti-freckle products, skin conditioners, skin toners, skin coloring agents]; tanners, bronzers, skin lighteners, hair coloring, hair cleansing, hair styling, elasticity enhancing products, agents, blushes, mascaras, eyeliners, lip liners, lipsticks, lip glosses, eyebrow liners, eye shadows, nail polishes, foundations, concealers, dental whitening products, cellulite reduction products, hair straighteners and curlers, and weight reduction products. A makeup care treatment regimen may involve the administration of one or more products, as defined above.

The terms "makeup advice", "makeup care treatment", "makeup method", "makeup artistry advice" and similar terms are used interchangeably to refer to the provision of makeup related information to a subject. Advice or guidance includes one or more of makeup product recommendations (e.g., cosmetic product recommendations for products to treat conditions the subject is prompted to evaluate), remedial measures, preventative measures, predictions, prognoses, price and availability information, application and use information, lifestyle or dietary recommendations, or any other information intended to aid a subject in a course of future conduct, to aid a subject in understanding past occurrences, to reflect information about some future occurrences related to the subject's makeup or to aid a subject in understanding makeup products, as defined above. The present invention also relates to professional makeup artistry advice for facial and body improvements to either remove, change or influence an aesthetic issue (e.g., unattractive facial or body feature) or enhance an existing facial or body feature through the most effective use/application of blushes, mascaras, eyeliners, brow kits, brow liner, brow color, lip liners, lipsticks, lip glosses, lip cream, lip cure, lip balm, lip plummer, eyebrow liners, eyebrow fix, eyebrow kits, eye shadows, nail polishes, foundations, concealers, primers, cealer/fix, eyegrease®, powders, combinations products like lip, chick and eye powders, cleansers, makeup tools, makeup removers, mineral makeup and other forms of makeup.

The term "network" may include a public network such as the Internet or a telephony network, a private network, a virtual private network, or any other mechanism for enabling

communication between two or more nodes or locations. The network may include one or more of wired and wireless connections. Wireless communications may include radio transmission via the airwaves, however, those of ordinary skill in the art will appreciate that various other communication techniques can be used to provide wireless transmission including infrared line of sight, cellular, microwave, satellite, blue-tooth packet radio and spread spectrum radio. Wireless data may include, but is not limited to, paging, text messaging, e-mail, Internet access and other specialized data applications specifically excluding or including voice transmission. In some instances consistent with the invention, a network may include a courier network (e.g. postal service, United Parcel Service, Federal Express, etc.). Other types of networks that are to be considered within the scope of the invention include local area networks, metropolitan area networks, wide area networks, ad hoc networks, or any mechanism for facilitating communication between two nodes or remote locations.

"Artificial intelligence" (AI) is used herein to broadly describe any computationally intelligent systems that combine knowledge, techniques, and methodologies. An AI engine may be any system configured to apply knowledge and that can adapt itself and learn to do better in changing environments. Thus, the AI engine may employ any one or combination of the following computational techniques: neural network, constraint program, fuzzy logic, classification, conventional artificial intelligence, symbolic manipulation, fuzzy set theory, evolutionary computation, cybernetics, data mining, approximate reasoning, derivative-free optimization, decision trees, or soft computing. Employing any computationally intelligent techniques, the AI engine may learn to adapt to unknown or changing environment for better performance. AI engines may be implemented or provided with a wide variety of components or systems, including one or more of the following: central processing units, co-processors, memories, registers, or other data processing devices and subsystems. AI engines may be trained based on input such as product information, expert advice, user profile, or data based on sensory perceptions. Using input an AI engine may implement an iterative training process. Training may be based on a wide variety of learning rules or training algorithms. For example, the learning rules may include one or more of the following: back-propagation, real-time recurrent learning, pattern-by-pattern learning, supervised learning, interpolation, weighted sum, reinforced learning, temporal difference learning, unsupervised learning, or recording learning. As a result of the training, AI engine may learn to modify its behavior in response to its environment, and obtain knowledge. Knowledge may represent any information upon which AI engine may determine an appropriate response to new data or situations. Knowledge may represent, for example, relationship information between two or more products. Knowledge may be stored in any form at any convenient location, such as a database. Since AI engine may learn to modify its behavior, information describing relationships for a universe of all combinations of products may not need to be maintained by the AI engine or any other component of the system.

"Personal information", "subject specific information", "user specific information", "user Profile", "personal characteristics", "personal attributes", "profile information", and like terms (collectively referred to in this section as "personal information") may broadly encompass any information about the subject or user. Such information may, for example, fall within categories such as physical characteristics, fashion preferences, demographics, nutritional information, cosmetic usage information, medical history information, environmental information, makeup product usage information, lifestyle, and may include information such as name; age; birth date; height; weight; ethnicity; eating habits; vacation patterns; geographic location of the individual's residence, location, or work; work habits; sleep habits; toiletries used; exercise habits; relaxation habits; makeup care habits; smoking and drinking habits; sun exposure habits; use of sunscreen; propensity to tan; number of sunburns and serious sunburns; dietary restrictions; dietary supplements or vitamins used; diagnosed conditions affecting the external body, such as melanoma; an image, such as a picture or a multimedia file of the subject; facial feature characteristics; family history information such as physical characteristics information about relatives of the subject (e.g., premature balding, graying, wrinkles, etc.); external body condition (as defined previously); color preferences, clothing style preferences, travel habits; entertainment preferences; fitness information; adverse reactions to products, compounds, or elements (e.g., sun exposure); body chemistry, use of prior makeup care products and their effectiveness; purchasing, shopping, and browsing habits; hobbies; marital status; whether the subject is a parent; country of residence; region of residence; birth country and region; religious affiliation; political affiliation; whether the subject is an urban dweller, suburban dweller or rural area dweller; size of urban area in which the subject lives; whether the subject is retired; annual income, sexual preference, or any other information reflecting habits, preferences, or affiliations of the subject. Personal information may also include information electronically gleaned by tracking the subject's electronic browsing or purchasing habits, or as the result of cookies maintained on the subject's computer, responses to surveys, or any other mechanism providing information related to the subject. In addition, personal information may be gathered through non- electronic mechanisms such as hard copy surveys, personal interviews, or consumer preference polls.

As used herein, the words "may" and "may be" are to be interpreted in an open-ended, non- restrictive manner. At minimum, "may" and "may be" are to be interpreted as definitively including structure or acts recited. Further, the word "or" is to be interpreted in the conjunctive and the disjunctive. The use of the terms "a" and "an" and "the" and similar referents in the context of describing the invention (especially in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. T e terms "comprising", "having", "including" and "containing" are to be construed as open-ended terms (i.e., meaning

"including, but not limited to,") unless otherwise noted. Recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. All methods described herein can be performed in any suitable order unless otherwise indicated' herein or otherwise clearly contradicted by context. The use of any and all examples, or exemplary language (e.g., "such as") provided herein, is intended merely to better illuminate the invention and does not pose a limitation on the scope of the invention unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the invention. EXAMPLES

Example 1 :

A user sends a facial photograph via e-mail to the e-mail address of the advice provider, being a human being. The advice provider assesses the photograph, and concludes that the user would benefit from using a black mascara from the brand Estee Lauder, and a red lipstick from the brand L'Oreal. This information is e-mailed back to the user with information on how to apply the makeup.

Example 2: A user uploads a facial photograph on an internet homepage placed on a server. The server software forwards the photograph to an advice provider. The advice provider, an makeup artist, concludes that the user would benefit from using the makeup product rouge. This advice is transmitted to the user via the server, and displayed on the user's personal profile on the homepage.

Example 3: A user sends a facial photograph via e-mail to the e-mail address of the internet homepage picturetoperfect.com. Based on the professional assessment of the facial photograph, the professional makeup artist advice and select a product from the make upproduct range of the brand Tromborg, and information are send back to the user.

Example 4: A user sends a facial photograph via e-mail to the e-mail address of the internet homepage picturetoperfect.com. Based on the professional assessment of the facial photograph, the professional makeup artist advice and select a mineral makeup product from the makeup product range of the brand Tromborg, and information are e-mailed back to the user.

Example 5: A user sends a facial photograph via e-mail to the e-mail address of the internet homepage picturetoperfect.com. Based on the professional assessment of the facial photograph, the professional makeup artist advice and select an Eyegrease® from the makeup product range of the brand Tromborg, and information are e-mailed back to the user with information on how to apply the makeup and with tips and techniques based on facial color and shape.

Example 6: A user sends a facial photograph via e-mail to the e-mail address of the internet homepage picturetoperfect.com. Based on the professional assessment of the facial photograph, the professional makeup artist advice how to transform a "daily look" to a "party look" and how to do it advice and the information are e-mailed back to the user together with product suggestions.

Example 7: A user sends a facial photograph via e-mail to the e-mail address of the internet homepage picturetoperfect.com. Based on the professional assessment of the facial photograph, the user is chosen among other users of being "picture to perfect®" of the month and awarded a makeover and a photo session.

Preferred embodiments of this invention are described herein, including the best nritode known to the inventors for carrying out the invention . Variations of those preferred embodiments may become apparent to those of ordinary skill in the art upon reading the foregoing description. The inventors expect skilled artisans to employ such variations as appropriate, and the inventors intend for the invention to be practiced otherwise than as specifically described herein. Accordingly, this invention includes all modifications and equivalents of the subject matter recited in the claims appended hereto as permitted by applicable law. Moreover, any combination of the above-described elements in all possible variations thereof is encompassed by the invention unless otherwise indicated herein or otherwise clearly contradicted by context.

REFERENCES US2004239689A, US6719565B, US2003062058A, US2007047761A, US2005251463A, FR2861177A1, DE10142526, JP 2002092132

All references cited in this patent document are hereby incorporated herein in their entirety by reference.

Claims

1. A makeup advice system which comprises:

a) an image data reception means for receiving image data transmitted by a remote located user, e.g. via network, such as an electronic network;

b) an imaging means for visually displaying the image data;

2. The system of claim 1, which further includes a database comprising a plurality of data selected from the group consisting of a makeup method (e.g. makeup guidance) and/or a makeup solution (e.g. makeup product).

3. The system of any preceding claim, wherein the makeup solution is a makeup product, such a product selected from of blushes, mascaras, eyeliners, brow kits, brow liner, brow color, lip liners, lipsticks, lip glosses, lip cream, lip cure, lip balm, lip plummer, eyebrow liners, eyebrow fix, eyebrow kits, eye shadows, nail polishes, foundations, concealers, primers, cealer/fix, eyegrease®, powders, combinations products like lip, chick and eye powders, cleansers, makeup tools, makeup removers, mineral makeup and other forms of makeup.

4. The system of any preceding claim, wherein the makeup method is a method for application of a makeup solution.

5. The system of any preceding claim, wherein the image assessing means is a human being, e.g. a make up artist or make-up consultant.

6. The system of any preceding claim, wherein the image assessing means is an image comparing software, said software optionally comprising an artificial intelligence engine, or said comparing software is used for assistance of the human being.

7. The system of any preceding claim, wherein the image assessing means compares the image data with a model image.

8. The system of any preceding claim, wherein the advice transmitting means is a telephone, or a computer connected to a computer at the location near the remote located human via a network.

9. The system of any preceding claim, which includes (a) performing image processing to produce a plurality of images of imagined post-makeup faces based on the image data, with a different mixing ratio by mixing an image of said desirable face with an image of a face of a subject person/human; (b) displaying said plurality of images of imagined post-makeup faces, 5 prepared in said step (a), on a monitor screen and selectively determining from said displayed imagined post-makeup faces an ideal post-makeup face said subject person/human desires; and (c) deriving a makeup method from an image of said ideal post-makeup face, determined in said step (b).

10 10. A method of providing makeup advice, which method includes the following steps:

(a) uploading an image of the face of the person/human onto a computer;

(c) visually assessing the displayed image for determining eg. color balance data; and 15 (d) transmitting makeup advice to the computer used for uploading image.

11. A method of providing makeup advice, which method includes the following steps:

(a) uploading an image of the face of the person/human onto a homepage;

(b) transmitting the image data via an electronic network to another computer, said computer 20 having a means for visually displaying the image;

(d) transmitting makeup advice to the computer used for uploading image.

12. A method of providing makeup advice, which method includes the following steps:

25 (a) receiving an image of the face of the person/human which has been transmitted via an electronic network;

(b) displaying the image on a monitor screen;

(d) transmitting makeup advice via an electronic network.

30

13. A method of any preceding claim, the method comprising receiving information specific for the person/human/user/subject.

14. The method of any preceding claim, wherein the user-specific information includes

35 personal information of at least one of skin type, skin tone, hair style, hair color, cosmetic color and product preferences, allergy information, demographic information, climate information, lifestyle information, fashion preferences, prior purchases, prior expressed interest, and prior browsing patterns.

15. The method of any preceding claim, which is conducted, at least in part, in a network environment, wherein receiving user-specific information occurs via a network and in at least one location remote from the user, and wherein providing occurs via the network.

5 16. The method of any preceding claim, wherein the makeup advice includes a product recommendation.

17. The method of any preceding claim, further comprising providing the user with an option to indicate an interest in purchasing the product.

10

18. The method of any preceding claim, wherein the recommendation of a plurality of makeup products includes information about inter-makeup product compatibility.

19. The method of any claim, further comprising maintaining personal information about the 15 user, said information comprising a makeup products selected for the user, and at least some of the advice of use information.

20. The method of any preceding claim conducted, at least in part, in a network environment, wherein receiving the user selection occurs via a network and in at least one location remote

20 from the user, and wherein notifying occurs via the network.

21. The method of any preceding claim, wherein the category of makeup products is at least one of mascaras, eye shadows, eye liners, foundations, concealers, blushes, lip sticks, lip glosses, liners, hair treatments, and hair colorings.

25

22. The method of any preceding claim, enabling a display of a simulation of the makeup product applied on the facial image.

23. The method of any preceding claim, wherein the facial image is a facial image of the 30 subject.

24. The method of any preceding claim, wherein maintaining information about suitability of use comprises: maintaining information about suitability of use of at least some of the plurality of makeup products with other of the plurality of makeup products, the information about

35 suitability of use being derived from an expert.

25. A system for providing makeup advice, said system being adapted for a method of any preceding claim.

40 26. A system for providing makeup advice, the system comprising - a data structure (or data bank) containing information selected from the group consisting of: a plurality makeup advice, a plurality of makeup products, and information about suitability of combining at least some of the plurality of makeup products with other of the plurality of makeup products;

5 - an engine, such as software, configured to receive and process the information, such as an image and/or user-specific information;

10

27. The system of any preceding claim, wherein the user-specific information includes personal information of at least one of skin type, skin tone, hair style, hair color, cosmetic color and product preferences, allergy information, demographic information, climate information, lifestyle information, fashion preferences, prior purchases, prior expressed interest, and prior

15 browsing patterns.

28. The system of any preceding claim, wherein the interface is a network interface configured to receive user-specific information via a network and in at least one location remote from the user, and to transmit the makeup advice to a user located remote.

20

29. The system of any preceding claim, wherein the makeup advice includes a product recommendation.

30. The system of any preceding claim, further comprising a purchase engine for offering the 25 user an opportunity to purchase the product.

31. The system of any preceding claim, wherein information characterizing a plurality of makeup products includes information about inter-makeup product compatibility.

30 32. The system of any preceding claim, wherein the information about suitability of using is based on expert advice.

33. T e system of any preceding claim, wherein the product is a makeup product chosen from at least one of tangible merchandise, services, diagnostics, makeup regimen, and advice.

35

34. A combination (e.g. a kit of parts) of makeup products, obtainable by a method of any preceding method claim.

35. A combination (e.g. a kit of parts) of makeup products, resulting from an advice generated 40 by a method or system of any preceding claim.

36. A combination of any preceding claim, which is in intangible form.

35. Makeup advice, information, method or solution, generated by a method or system of any preceding claim.

36. A method substantially as described in the specification or claims.

37. A system substantially as described in the specification or claims.