RU2844703C2 - Device and method of applying cosmetic compositions using end effector with grid - Google Patents

Abstract

FIELD: medicine.

SUBSTANCE: group of inventions relates to medical equipment, specifically to a hand-held device and a method for applying a composition to the skin of a user. Device comprises an end effector comprising a main portion and a protruding portion extending distally from the main portion. Extending portion has a distal opening. Device has a detector assembly configured to obtain image data for an image of the skin region through the distal opening of the end effector. Device includes an applicator unit configured to apply the composition in place within the skin area. Device comprises a processing unit configured to receive image data from the detector unit, analyse the image data to determine whether the applicator unit is directed so that application of the composition on the skin area is safe, and whether the fraxel within the skin area matches the skin artefact. Processing unit is configured to analyse image data and determine that the applicator unit is directed such that application of the composition on the skin area is safe when the image data correspond to an area on the face of the user at a predetermined distance from the face of the user. Treatment unit is configured to direct the applicator unit for applying the composition to the fraxel when it is determined by the treatment unit that the applicator unit is directed in such a way that application of the composition to the skin area is safe, and a skin artifact is detected from the fraxel, and controlling the applicator unit to stop applying the composition to the skin when it is determined that the applicator unit is directed such that applying the composition to the skin area is unsafe. Method includes obtaining image data for the image of the skin area above which the device is located, using the detector assembly. Method includes analysis of image data by a processing unit to determine inclination of device relative to skin area. Method includes analysing image data by a processing unit to identify locations within the skin region corresponding to skin artefacts. Method comprises applying the composition by the applicator assembly to the identified locations only when it is determined that the applicator assembly is directed so that it is safe to apply the composition to the skin area, and terminating the application of the composition to the skin when it is determined that the applicator assembly is directed such that application of the composition to the skin area is unsafe.

EFFECT: increased safety of use in close proximity to nostrils and mouth.

17 cl, 7 dwg

Description

CLAIM TO PRIORITY

[0001] This application claims priority to U.S. Provisional Patent Application No. 62/888,025, filed August 16, 2019, the contents of which are incorporated herein by reference in their entirety.

PREREQUISITES FOR THE CREATION OF THE INVENTION

[0002] Cosmetic compositions can be applied by manually distributing the composition onto the skin of the face using fingers, brushes, or sponges. In an alternative embodiment, certain specialized liquid cosmetic compositions can be applied to the skin using a spray device that applies a pressurized spray cosmetic onto the skin of a subject. The user essentially manually directs these spray devices to areas of the skin of the subject, which may include sensitive areas (e.g. , the eyes, nostrils, and/or mouth) that may be irritated or damaged by the application of such a pressurized spray cosmetic. The use of a pressurized spray cosmetic sprayer may be unsafe in close proximity to the eyes of a subject, since it may be impossible for the user to control the spray device with sufficient precision to avoid accidentally spraying the pressurized spray cosmetic onto the eye, which may result in irritation or even damage to the delicate tissue of the eye. In addition, cosmetic compositions often include particulate materials suspended in a liquid formulation. Although such particulate materials may be safe when applied topically, they may be unsafe when inhaled, ingested, or applied to mucous membranes. For example, commonly used particulate cosmetic materials, such as micronized particles, may be safe for use in liquid formulations for topical application such as lotions and/or creams, but may be hazardous when sprayed, where they are inhaled through the nostrils or ingested through the mouth. Because the user cannot control the spray device with sufficient precision to avoid accidentally spraying the pressurized spray cosmetic into the nostrils or mouth, these devices may pose a health risk when used in close proximity to the nostrils and mouth.

SUMMARY OF THE INVENTION

[0003]One embodiment of the present invention relates to a hand-held device for applying a composition to the skin of a user's face. The device comprises an end effector comprising a main portion and a projecting portion extending distally from the main portion, wherein the projecting portion has a distal opening. The device also comprises a detector unit configured to obtain image data corresponding to an image of a skin region through the distal opening of the end effector. The device further comprises an applicator unit configured to apply the composition to a location within the skin region. In some embodiments, the applicator unit comprises a nozzle configured to dispense a portion of the composition under pressure from a reservoir to form a thin layer of the composition on the skin. For example, the composition may be a cosmetic composition comprising particles of a reflectivity-altering agent (e.g., titanium dioxide) in the form of a liquid suspension. In addition, the device comprises a processing unit configured to receive image data from the detector unit, analyze the image data to determine whether the applicator unit is directed in such a way that the application of the composition to the skin area is safe, and whether the frexel within the skin area corresponds to a skin artifact, and also direct the applicator unit to selectively apply the composition to the frexel when the applicator unit is directed in such a way that the application of the composition to the skin area is safe, and the skin artifact is detected from the frexel. In some embodiments, the processing unit can determine whether the skin artifact is detected from the frexel, based on the reflectivity of the skin area determined from the image.

[0004] In some embodiments, the processing unit of the hand-held device may be configured to control the applicator unit to stop applying the composition to the skin when the applicator unit is directed such that it is unsafe to apply the composition to the skin area. The processing unit may analyze the image data analysis and determine that the applicator unit is directed such that it is safe to apply the composition to the skin area when the image data corresponds to an area on the user's face located at least a predetermined distance from at least one of the eyes, nostrils and mouth of the user's face. In addition, the processing unit may analyze the image data to determine the tilt of the device. In particular, the processing unit may determine that the applicator unit is directed such that it is safe to apply the composition to the skin area when the tilt of the device is less than a predetermined threshold value, and determine that the applicator unit is directed such that it is unsafe to apply the composition to the skin area when the tilt of the device exceeds a predetermined threshold value.

[0005] The projecting portion of the end effector may further comprise a plurality of grating strips extending through the distal opening, and the image data corresponds to an image of the skin region onto which the image of the plurality of grating strips is superimposed. The processing unit may be configured to analyze the image data to identify a shadow of at least one of the grating strips in the image and to determine the length of the shadow based on the image data. The processing unit may be further configured to determine that the applicator unit is directed such that application of the composition to the skin region is safe when the length of the shadow is less than a predetermined threshold value, and to determine that the applicator unit is directed such that application of the composition to the skin region is unsafe when the length of the shadow exceeds a predetermined threshold value. The processing unit may also be configured to correct the image data by replacing the data in the image regions corresponding to the grating strips with data generated by the processing unit that provide a high similarity to the skin located under the grating strips, and to analyze the corrected image data to identify locations within the skin region corresponding to skin artifacts.

[0006] Furthermore, a method of applying a composition to the skin of the face of a user is provided. The method includes obtaining image data corresponding to an image of a skin region over which a device is positioned using a detector unit. For example, the image data corresponds to an image of a skin region on which an image of a plurality of grating stripes of an end effector of the device is superimposed, wherein the grating stripes extend over the entire skin region. The method also includes analyzing the image data using a processing unit to determine a tilt of the device relative to the skin region. The method further includes determining, by the processing unit, whether the applicator unit is directed such that application of the composition to the skin region is safe, based on the tilt of the device. The method further includes analyzing the image data by the processing unit to identify locations within the skin region that correspond to skin artifacts, and selectively applying the composition by the applicator unit to the identified locations only when it is determined that the applicator unit is directed such that application of the composition to the skin region is safe. In some embodiments, the processing unit identifies locations within the skin region that correspond to skin artifacts based on the reflectivity of the skin region determined from the image.

[0007] In some embodiments, the processing unit may determine that the applicator unit is directed such that it is safe to apply the composition to the skin area when the tilt value of the device is less than a predetermined threshold value, and determine that the applicator unit is directed such that it is unsafe to apply the composition to the skin area when the tilt value of the device exceeds a predetermined threshold value. For example, the processing unit is configured to determine the tilt of the device by analyzing image data to identify a shadow from at least one of the lattice bands in the image and analyzing the shadow to determine a three-dimensional vector corresponding to the tilt. In addition, the processing unit may adjust the image data to replace data in areas of the image corresponding to the lattice bands with data generated by the processing unit that have a greater resemblance to the skin located under the lattice bands, and analyze the adjusted image data to identify locations within the skin area corresponding to skin artifacts.

[0008] These and other aspects of the invention will become apparent to those skilled in the art upon reading the following detailed description of the invention, including the figures and the appended claims.

BRIEF DESCRIPTION OF GRAPHIC MATERIALS

[0009] Fig. 1 is a perspective view of a device for applying a composition to the skin of a user in accordance with an example of the present application.

[0010] Fig. 2 is a block diagram of an illustrative device for applying a composition to the skin of a user, as shown in Fig. 1.

[0011] Fig. 3 shows an example of the implementation of the end effector of the device for applying a composition to the user's skin in accordance with an example of the implementation of the present application.

[0012] Fig. 4 shows an example of the embodiment of a protruding portion of the end effector of a device for applying a composition to the user's skin in accordance with an example of the embodiment of the present application.

[0013] Fig. 5 shows an example of a method for applying a cosmetic composition to the skin of a user in accordance with an example of the present application.

[0014] Fig. 6 shows an example of an embodiment (from the inside view) of a protruding portion of the effector of the device in the distal direction towards the user's skin in accordance with an example of an embodiment of the present application.

[0015] Fig. 7a shows another example of the embodiment of a protruding portion of the end effector of a device for applying a composition to the user's skin.

[0016] Fig. 7b shows an example of an embodiment of a protruding portion of the end effector of the device shown in Fig. 7a, in an inclined configuration.

DETAILED DESCRIPTION OF THE INVENTION

[0017]The present invention relates to devices and methods for applying a composition to the skin, in particular the facial skin of a mammal or a human. More particularly, the invention relates to devices and methods for selectively applying a composition for topical application to facial skin, for example to improve the aesthetic appearance of the skin and to provide increased safety when working near sensitive areas (e.g. eyes, nostrils, and/or mouth) on the face of a mammal or human.

[0018] The present description may be better understood by reference to the following description and the accompanying drawings, in which like elements are designated by like reference numerals. It should be noted that the terms "proximal" and "distal" as used herein are intended to denote a (proximal) direction toward the user of the device and a (distal) direction away from the user.

[0019] As used herein, the term "frexel" refers to a small pixel-like region of skin that corresponds to one large pixel or a small number of pixels in a digitally acquired image. For example, a frexel may correspond to an area of skin having an average diameter of about 1/15 to about 1/5 inch.

[0020]The term "mid-spatial frequencies" as used herein is further explained below. For example, image data corresponding to an image of skin may capture light reflections that span a range of spatial frequencies, thereby measuring the level of image detail at a distance along the skin as detected by a detector (e.g., camera) that generates the image data. Spatial frequency can be measured by a series of periodic elements, such as described as a periodic sinusoidal pattern corresponding to a cyclic repetition of patterns of alternating dark and light bands, within the image at a distance along the skin captured by the detector. The spatial frequency of the image can be calibrated and/or normalized based on the distance from which the detector acquires the skin image. It should be noted that the term "spatial frequency" as used herein does not refer to a measurement of the wavelength or color of light, but rather to the wavelength in the spatial structure of the skin features captured by the detector in the image. Data corresponding to the image in the spatial domain (e.g., (i.e., in the form of pixels or frexels) can be processed by a computer processor using a Fourier transform function to obtain spatial frequency domain data for an image. This spatial frequency domain refers to the optical resolution of the image being captured, which is different from the wavelength or color of the light. As will be understood by those skilled in the art, the spatial frequency components of an image can be essentially divided into three different categories, including (1) high spatial frequencies, (2) mid spatial frequencies, and (3) low spatial frequencies, using any suitable image analysis techniques, such as Fourier transform, filtering, etc. As will be understood by those skilled in the art, the spatial frequency components with high spatial frequencies correspond to light reflections in the image that provide sharp edges and fine details within the image. For example, for an image of skin, the spatial frequency components with high spatial frequencies correspond to features that are small-sized natural variations in the skin, such as variations due to the human genetic code, such as pores, hair, follicles, cells, iris, etc. Low spatial frequencies correspond to light reflection in the image, which provide broad visual elements, such as, for example, the color of larger elements, such as, for example, the nose, cheeks, etc. The remaining spatial frequency components in the range between low and high spatial frequencies are called mid-spatial frequencies.

[0021] The range of average spatial frequencies may be determined relative to the image being captured. For example, the range of average spatial frequencies for a region of facial skin may differ from the range of average spatial frequencies for a region of skin on a leg. The range of average spatial frequencies may also depend on the base tone of the skin whose image is being captured. In one example, the average spatial frequencies for human skin may be in the range of about 0.03 cycles/mm to about 1.5 cycles/mm, or more specifically from about 0.05 cycles/mm to about 1.0 cycles/mm, and even more specifically from about 0.07 cycles/mm to about 0.5 cycles/mm.

[0022]The present application provides a device and method for selectively applying a composition to the skin, in particular the facial skin of a subject (e.g., mammal or human), while ensuring increased safety when working near sensitive areas (e.g. eyes, nostrils and/or mouth) that may otherwise be unsafe and/or unacceptable for application of the composition. More particularly, the present application provides a device and method for selectively applying a composition for topical application to the skin of the face while taking precautions that ensure safe application of the composition to such sensitive areas. As described above, some compositions may be acceptable for topical application, but may not be acceptable for direct application to sensitive areas such as the eyes, nose and/or mouth. Therefore, operation of the device according to the present application near such sensitive areas (e.g., within a predetermined range corresponding to the boundary of the sensitive area) is limited to enhance the safety of use of the device near such sensitive areas. As another example, if a composition acceptable for topical application is not acceptable for inhalation, operation of the device near respiratory system inlets (i.e..nose and mouth) may be limited. For example, the device and method according to embodiments of the present application analyzes data corresponding to an image or one or more frames of an image of an area of skin near which the device is positioned to determine whether the applicator assembly is directed such that it is safe to apply the composition to the area of skin (e.g., whether the applicator unit is directed such that the composition will be applied outside a predetermined range corresponding to the boundary of the sensitive area), and upon determining that the applicator unit is directed such that application of the composition to the skin area is safe, further analysis of the image data is performed to selectively apply the composition to selected areas of the skin to eliminate skin artifacts (e.g., scars, wrinkles, freckles, sun damage, age spots, etc.) that the user wishes to minimize or eliminate in order to improve the overall aesthetic appearance of the skin. The device prevents the application of the composition by the applicator unit when it is determined that the applicator unit is directed in such a way that the application of the composition is unsafe (e.g., in the area of skin that is within a preset range corresponding to the boundary of the sensitive area).

[0023]Fig. 1 and 2 show an example of the implementation of a device 100 for applying a composition (for example, cosmetic or medical composition) onto the skin. The device 100 of this embodiment has the size and shape of a hand-held device 100 configured to be held in the palm of a user. The device 100 of this embodiment comprises a head 102 and a handle 104. The handle 104 of the device 100 has an elongated shape defining a cavity for accommodating components therein. In some embodiments, the handle 104 has the size and shape to be held in the palm of a user. In other embodiments, the handle 104 has the size and shape to allow the user to hold it with his fingers.

[0024]The head 102 of the device 100 according to this embodiment includes an end effector 110 that is removably attached to the housing 108 of the head 102. The end effector 110 includes inner surfaces that form a cavity through which light can pass and through which an image of the skin region can be captured by the detector assembly. In certain embodiments, the inner surfaces of the end effector 110, in particular the inner surfaces of the protruding portion 114, are modified (e.g., have a textured finish provided by moulding) and/or are treated by applying a surface coating (e.g. light-absorbing coating) to reduce light reflectivity by means of modified or treated surfaces. In the exemplary embodiment shown in Figs. 1 and 2, the end effector 110 comprises a main portion 112 that is releasably attached to the housing 108 and a projecting portion 114 that extends distally from the main portion 112. In certain embodiments, the main portion 112 and the projecting portion 114 of the end effector 110 may be formed as a single component, such as molded as a single piece of plastic. In some embodiments, the end effector 110 may be a disposable component that can be replaced after a use session or at the user's discretion. The main portion 112 of the end effector 110 shown in Fig. 1 and 2, extends from a proximal end 111, which is releasably attached to the housing 108, to a distal end 113, connected to the projecting portion 114. As shown in the embodiment example in Fig. 1, the main portion 112 can have a conical shape such that its proximal end 111 is wider (for example, has a larger cross-sectional area) than its distal end 113. In particular, the conical shape of the main portion 112 may be a funnel-shaped shape or a truncated cone shape. The proximal end 111 of the main portion 112 may comprise any suitable engagement mechanism for releasably engaging and disengaging relative to the housing 108, which will be obvious to those skilled in the art. For example, the proximal end 111 of the main portion 112 and the housing 108 may comprise complementary threads for releasably engaging and disengaging them with each other. In another example, the proximal end 111 of the main portion 112 may be configured to be frictionally attached to the housing 108. In a further embodiment, the proximal end 111 of the main portion 112 and the housing 108 may include complementary locking mechanisms that can be moved together when the end effector 110 is frictionally engaged and disengaged relative to the housing 108. Furthermore, in some embodiments, the main portion 112 may have a circular cross-sectional shape and may be configured to rotate about a longitudinal axis extending from its proximal end 111 to its distal end 113 for releasably engaging and disengaging relative to the housing 108. In other embodiments, the main portion 112 is fixed without the possibility of rotation relative to the housing 108 when the main portion 112 is fixedly attached to the housing 108.

[0025] The projecting portion 114 of the end effector 110 extends from the proximal end 115, which is connected to the main portion 112, to the distal end 116, at which the distal opening 117 of the end effector 110 is formed. In one embodiment, the projecting portion 114 extends from its proximal end 115 to its distal end 116 along a longitudinal axis that is perpendicular or substantially perpendicular to a plane passing through the proximal end 111 of the main portion 112 of the end effector 110. The projecting portion 114 may also have a conical shape in which the proximal end 115 is wider than the distal end 116. As shown in Fig. 1 and 2, the proximal and distal ends 115, 116 of the projecting portion 114 may have elongated, in particular oval, cross-sectional shapes. However, it is assumed that the proximal and distal ends 115, 116 of the projecting portion 114 may have any shape suitable for visualization and selective application of the composition through them to the skin area, as will be further described below.

[0026] In some embodiments, additional features may be included on the surface of the protruding portion 114 of the end effector 110. In one embodiment, the distal end 116 of the end effector 110 comprises a plurality of ridges or projections extending in a distal direction such that when the end effector 110 is held on the skin, only the projections extending in a distal direction from the distal end 116 of the end effector 110 contact the skin. These projections reduce the overall contact area of the device 100 with the skin, and thus it is possible, for example, to avoid smearing of a previously applied composition, to increase comfort and/or to reduce the formation of a “cushion” on the skin surface that may otherwise occur if a user presses an end effector that does not have such projections against the skin.

[0027] In one particular embodiment shown in Fig. 3, the distal end 116 of the end effector 110 includes a plurality of grid strips 118 (which are shown in the drawings by solid arrows) extending across the entire width of the distal opening 117 of the end effector 110. The grid strips 118 divide the distal opening 117 of the end effector 110 into a plurality of distal opening segments 117a, wherein the applicator assembly 140 includes at least one nozzle 142 associated with each segment 117a. Thus, each segment 117a can be independently analyzed to identify areas of the skin to which a composition is to be applied, and based on this analysis, the nozzle 142 associated with the corresponding segment 117a can be activated. Each of the distal opening segments 117a shown in Fig. 3, includes a point illustrating the alignment of at least one nozzle 142 of the applicator assembly 140 within each segment 117a of the distal opening. As can be seen in Fig. 3, the grid strips 118 extend in a distal direction from the distal end 116 of the end effector 110 so that when the end effector 110 is held on the skin, only the grid strips 118 contact the skin. In this embodiment, all of the plurality of grid strips 118 extend in the distal direction from the distal end 116 at the same distance so that all of the grid strips 118 lie in a plane parallel or substantially parallel to the distal opening 117 of the end effector 110. In another embodiment, the grid strips 118 are aligned along the same plane as the distal opening 117 so that when the end effector 110 is held on the skin, both the grid strips 118 and the distal end 116 of the end effector 110 contact the skin. As shown in Fig. 3, the grid strips 118 are parallel or substantially parallel to each other. The plurality of grid strips 118 in this embodiment are located at the same distance or substantially the same distance from each other. In addition, the grid strips 118 in some embodiments are a surface treated or modified to reduce friction when they are moved along the skin. For example, the friction between the grid strips 118 and the skin can be reduced by applying a friction-reducing coating to the grid strips 118, such as, for example, perfluoropolyether (PFPE), polytetrafluoroethylene (PTFE), nylon, Acetel, polyester, polyimide, polyetheretherketone (PEEK), etc. In an alternative embodiment, the grid strips 118 can be made of a material having a reduced coefficient of friction, such as the materials mentioned above.

[0028] Furthermore, the distal end 116 of the end effector 110 according to this embodiment further comprises a pair of pins 191, 192 for creating shadow guides (two pins are shown in Fig. 4, but more than two fonts may be used) extending along the same plane as the stripes 118 of the grid. The first pin 191 is perpendicular or substantially perpendicular to the second pin 192. Said pair of pins 191, 192 for creating shadow guides cast bidirectional shadows on the area of skin covered by the distal opening 117 when this area of skin is illuminated by the light source(s) 120, 121, 122 from the housing 108 of the head 102. Subsequently, the bidirectional shadows can be captured in an image or in one or more image frames using the detector assembly 130. In particular, the bidirectional shadows cast by the pins 191, 192 to create shadow guides that are captured in the image(s) can be used to determine two of the three axes in a three-dimensional coordinate space to determine the orientation of the device 100 and/or the tilt of at least a portion of the device 100. The tilt can be defined as a directional vector in three-dimensional space having a length indicating the amount of deviation from the orientation of the skin surface.

[0029]The housing 108 of the head 102 according to this embodiment comprises at least one light source 120, 121, 122 for supplying light (e.g. visible light) through the distal opening 117 of the end effector 110 onto the skin area. The at least one light source 120, 121, 122 may comprise any suitable light emitting device for illuminating the skin area, such as one or more light emitting diodes. The at least one light source 120, 121, 122 may also be selected and positioned to provide an illumination level on the skin area sufficient to detect the light reflectivity of the skin and/or measure the degree of light reflectivity of the skin. In embodiments in which a plurality of grating strips 118 extend through the distal opening 117 of the end effector 110, as shown in Fig. 3, a portion of the skin area may be obscured by the grating strips 118, while the light source(s) 120, 121, 122 provide(s) a substantially uniform light distribution on the remaining portion of the skin area. In certain embodiments, a portion of the skin region may also be shadowed by the outer edges of the protruding portion 114 of the end effector 110, in particular along the length of the protruding portion 114, while the light source(s) 120, 121, 122 provide(s) a substantially uniform distribution of light to the remaining portion of the skin region.

[0030] Preferably, the light source(s) 120, 121, 122 are arranged to deliver light through the distal opening 117 of the end effector 110 to the skin area, wherein the interior of the end effector 110 is illuminated to a small extent. For example, the light source(s) 120 may be positioned perpendicular to the distal opening 117 of the end effector 110. More particularly, the light source(s) 120 may be positioned perpendicular or substantially perpendicular to regions of interest within the region of skin encompassed by the distal opening 117 of the end effector 110 during use of the device 100. As another example, the light source(s) 121, 122 may be positioned at an angle to direct light through the distal opening 117 while minimizing the amount of light directed toward the interior surfaces of the end effector 110. In particular, the light source(s) 122 may be positioned at an angle to direct light within the radial cone 204 (shown dotted lines in Fig. 4) through the distal opening 117 onto the region of interest 202 on the skin within the region of skin over which the distal opening 117 is located. It is envisaged that additional physical barriers and/or reflectors 190 may also be provided in the housing 108 of the head 102 to direct light from the light source(s) 121 or 122 to the desired regions of interest, while minimizing the reflectivity of light from the internal surfaces of the end effector 110.

[0031]In some embodiments, the housing 108 of the head 102 contains at least two different light sources 121, 122 for delivering light at two different wavelengths, which can be turned on sequentially or simultaneously. At least two different light sources 121, 122 can be used simultaneously to provide different functionalities. Different wavelengths can be selected to minimize mutual interference of illumination from these two different light sources 121, 122. For example, the housing 108 can contain a first light source 121 providing light having a first color (e.g., blue light), and a second light source 122 providing light having a second color (e.g., green light). The first and second light sources 121, 122 can be used in the device 100 for illuminating the skin region for imaging and analysis to establish various properties of the visualized region. For example, the first light source 121 can be used by the device 100 for illuminating the skin region for imaging and analysis to determine the tilt or location of the device 100 relative to the orientation of the skin surface, for example determining whether the outer edges of the projecting portion 114 of the end effector 110 or the strip 118 of the grid located adjacent to each segment 117a of the distal opening contact the skin surface. In particular, the first light source 121 can be selected to provide illumination for casting shadows and maximizing the contrast of the shadows. The second light source 122 can, for example, be used to illuminate an area of the skin for subsequent visualization and analysis for identifying skin artifacts. In one embodiment, the second light source 122 can create diffuse illumination suitable for image analysis and subsequent detection of skin artifacts corresponding to locations that significantly affect the average spatial frequencies of the image. The first and second light sources 121, 122 can be operatively connected to the processing unit 150 for selectively turning on and operating the first and second light sources 121, 122, as will be described in more detail below.

[0032]The housing 108 of the head 102 also comprises a detector assembly 130 for obtaining image data corresponding to an image or one or more image frames of a skin region obtained through the distal opening 117 of the end effector 110. In embodiments in which a plurality of grid stripes 118 pass through the distal opening 117 of the end effector 110, as shown in Fig. 3, the image data may correspond to an image or one or more image frames of a skin region over which the distal opening 117 is located, with the grid stripes 118 superimposed. The detector assembly 130 comprises at least one sensor configured to detect light reflected from the skin region and/or the grid strip 118. As will be apparent to those skilled in the art, the sensor(s) may comprise any suitable components for detecting the reflectivity of light. For example, the sensor(s) may be sensitive to the amount of reflected light at one or more wavelengths. As will be apparent to those skilled in the art, suitable sensors may, for example, include still or video cameras (which may include lenses of various types), photodiodes, and/or phototransistors. In one embodiment, the sensor(s) of the detector assembly 130 may also comprise an RGB camera configured to detect light in the red, green, and blue channels of the camera. In some embodiments, the detector assembly 130 may further comprise a color filter array (e.g., Bayer filter) to obtain image data corresponding to images at different wavelengths (e.g. with different colors), using two or more light sources 121, 122, each of which has a different wavelength.

[0033]The light source(s) 120, 121, 122 and the detector unit 130 are operatively connected to the processing unit 150 that executes the instructions stored on the machine-readable medium 160. The processing unit 150 in this embodiment controls the light source(s) 120, 121, 122, and also receives and analyzes the image data received from the detector unit 130. It is contemplated that the processing unit 150 and the machine-readable medium 160 can be located anywhere inside or outside the device 100. In one embodiment, as shown in Fig. 1, the processing unit 150 and the machine-readable medium 160 are located within the handle 104. The processing unit 150 in this embodiment also controls the applicator unit 140 to selectively apply the composition to desired frexels within the skin areas when the processing unit 150 determines that the applicator unit 140 is directed in such a way that it is safe to apply the composition to the skin area. The processing unit 150 may be, for example, in whole or in part, or may include, without limitation, a computer/processor, which may include, for example, one or more microprocessors, and uses instructions stored on a machine-readable medium 160 (e.g., a storage device). The computer-readable medium 160 may be, for example, a non-transitory computer-readable medium containing executable instructions. A data storage unit may be provided separately from the computer-readable medium 160, which can transmit instructions to the processing unit 150 for configuring the processing unit 150 to execute certain examples of procedures, processes, and methods.

[0034]As shown in Fig. 2, the applicator unit 140 according to this embodiment is an integral part of the housing 108 of the head 102. The applicator unit 140 according to this embodiment selectively applies the composition to the skin areas under the control of the processing unit 150 based on the image data from the detector unit 130. The applicator unit 140 according to this embodiment comprises at least one suitable application device for applying the composition for topical application (e.g., cosmetic composition) onto one or more frexels on which artifacts have been identified. An example of a device for applying a cosmetic in this embodiment includes, for example, a sprayer (e.g., an electronic atomizer or an air atomizer), a controlled droplet application device, or any other suitable device for applying the composition in the form of small droplets to the identified frexels, as will be apparent to those skilled in the art. In one embodiment, the applicator assembly 140 comprises one or more nozzles 142 for applying a liquid or viscous composition under pressure as a shot or a pressurized aerosol to the skin to form a thin layer of cosmetic coating on the identified frexel. The nozzle(s) 142 apply(s) the composition in the form of droplets of the shot or aerosol to the surface of the skin and thereby form(s) a thin continuous or discontinuous layer of the composition on the skin. In certain embodiments, the applicator assembly 140 comprises a plurality of nozzles 142, such as an array of nozzles, arranged in any desired configuration. By using a plurality of nozzles 142, the overall speed at which the device 100 can apply the composition to the frexels is increased, thereby reducing the overall amount of time that the user must move the device 100 over the target skin area until the desired level of artifact treatment is achieved. For example, the applicator assembly 140 can include 3 to 8 nozzles or 4 to 6 nozzles, wherein each nozzle has different directions, so that the composition can be applied to a plurality of frexels or to different parts of a frexel at the same time. In one embodiment, the applicator assembly 140 includes 5 nozzles. In embodiments in which a plurality of grid strips 118 extend through the distal opening 117 of the end effector 110, as shown in Fig. 3, the applicator assembly 140 can comprise one or more nozzles 142 directed to apply the composition to each segment 117a of the distal opening.

[0035]The nozzle 142 may be any suitable device for applying a thin layer of a cosmetic composition to the skin. In one embodiment, the nozzle 142 comprises dual chambers, wherein the first chamber contains a liquid or viscous composition, and the second chamber contains a propellant gas (e.g., compressed air or nitrogen gas) that exerts pressure on, but is not mixed with, the composition when a portion of the composition is dispensed onto the frexel. In yet another example, the nozzle 142 comprises a first chamber containing a liquid or viscous composition and a second chamber containing a propellant that is mixed with the cosmetic composition when the portion of the composition is applied to the frexel. Although two exemplary embodiments of the nozzle 142 have been described above, it is understood that the apparatus of the present application may include any suitable nozzle(s) 142 for applying droplets of composition under pressure, as will be apparent to those skilled in the art.

[0036] The applicator assembly 140 is operatively connected to a reservoir 170 containing a cosmetic composition applied to the skin. In particular, the applicator assembly 140 is fluidly connected to the reservoir 170 via a plurality of channels, valves and/or pressure sources. It is understood that the reservoir 170 can be located anywhere within the device 100. In one embodiment, as shown in Fig. 2, the reservoir 170 is located inside the handle 104 of the device 100. The composition located inside the reservoir 170 is transferred from the reservoir 170 to the applicator assembly 140 for applying the composition. In some embodiments, the reservoir 170 is a removable container that can be replaced after its contents are expended. For example, the reservoir 170 can be a pressurized canister containing a composition applied to the skin.

[0037]The composition applied to the skin may contain, for example, any suitable cosmetic ingredients for changing the appearance of the skin, such as, for example, an opaque substance, a foundation cosmetic, or any other appropriate cosmetic compositions for improving the appearance of the skin. The composition may also contain ingredients such as a humectant for hydration, a carrier or a beneficial agent. (e.g., a preferred compound/composition/extract or active ingredient) for the treatment and/or alleviation of a skin pathology, for example, acne, hyperpigmentation, eczema, allergic rash, vitiligo, psoriasis, rosacea, warts, lichen, herpes, pigmentation and toning, redness/oxidative irritation of the skin, wrinkles, lightening, sagging/elasticity, etc. An example of a composition in this embodiment is a cosmetic composition applied to the skin to change or minimize the appearance of an artifact based on image data output by the detector unit 130. Examples of embodiments of beneficial agents that can be included in the composition are further described below.

[0038]A non-limiting list of moisturizing active beneficial agents used includes hyaluronic acid and humectants. Hyaluronic acid can be linear, cross-linked, or a mixture of linear and cross-linked hyaluronic acid. It can be in the form of a salt, such as sodium hyaluronate. A humectant is a compound designed to increase the water content of the upper layers of the skin. (e.g., hygroscopic compounds). Examples of suitable humectants include, but are not limited to, glycerin, sorbitol, or trehalose or a salt or ester thereof.

[0039] A non-limiting list of useful anti-acne agents includes benzoyl peroxide, retinoids including retinol, retinal, retinoic acid, retinyl acetate and retinyl palmitate, hydroxy acids including, but not limited to, glycolic acid, lactic acid, malic acid, salicylic acid, citric acid and tartaric acid, sulfur, Zn PCA (zinc pyroglutamic acid), allantoin (5-ureidohydantoin), rosemary, 4-hexylresorcinol, N-acetyl glucosamine, gluconolactone, niacinamide, azelaic acid and resveratrol.

[0040]A non-limiting list of active beneficial agents used to treat pigmentation include resorcinols such as niacinamide, 4-hexylresorcinol, curcuminoids (such as Sabiwhite (tetrahydrocurcumin)), phytic acid, resveratrol, soybean glycine oil, gluconolactone, azelaic acid, and retinoids including retinol, retinal, retinoic acid, retinyl acetate, and retinyl palmitate, enzymes such as laccase, tyrosinase inhibitors, melanin degradation agents, melanosome transfer inhibitors including PAR-2 antagonists, scrubs, sunscreens, retinoids, antioxidants, tranexamic acid, tranexamic acid cetyl ester hydrochloride, skin whitening agents, linoleic acid, disodium adenosine monophosphate, chamomile extract, allantoin, opacifiers, talcs and silicon dioxides, zinc salts, etc. Examples of suitable tyrosinase inhibitors include, but are not limited to, vitamin C and its derivatives, vitamin E and its derivatives, kojic acid, arbutin, resorcinols, hydroquinone, flavones, for example, licorice flavonoids, licorice root extract, mulberry root extract, Dioscorea coposita root extract, saxifrage extract, etc., ellagic acid, salicylates and their derivatives, glucosamine and its derivatives, fullerene, hinokitiol, dioic acid, acetylglucosamine, 5,5'-dipropylbiphenyl-2,2'-diol (magnolignan), 4-(4-hydroxyphenyl)-2-butanol (4-HPB), combinations of two or more thereof, etc. Examples of vitamin C derivatives include, but are not limited to, ascorbic acid and salts, ascorbic acid 2-glucoside, sodium ascorbyl phosphate, magnesium ascorbyl phosphate, and natural extract enriched with vitamin C. Examples of vitamin E derivatives include, but are not limited to, alpha-tocopherol, beta-tocopherol, gamma-tocopherol, delta-tocopherol, alpha-tocotrienol, beta-tocotrienol, gamma-tocotrienol, delta-tocotrienol and mixtures thereof, tocopherol acetate, tocopherol phosphate and natural extracts enriched with vitamin E derivatives. Examples of resorcinol derivatives include, but are not limited to, resorcinol, 4-substituted resorcinols such as 4-alkylresorcinols such as 4-butylresorcinol (rucinol), 4-hexylresorcinol, phenylethylresorcinol, 1-(2,4-dihydroxyphenyl)-3-(2,4-dimethoxy-3-methylphenyl)-propane and the like, and natural extracts enriched with resorcinols. Examples of salicylates include, but are not limited to, potassium 4-methoxysalicylate, salicylic acid, acetylsalicylic acid, 4-methoxysalicylic acid, and salts thereof. In certain preferred embodiments, tyrosinase inhibitors include 4-substituted resorcinol, a vitamin C derivative, or a vitamin E derivative.

[0041]A non-limiting list of redness-relieving/antioxidant active beneficial agents used includes water-soluble antioxidants such as sulfhydryl compounds and their derivatives (eg sodium metabisulfite and N-acetylcysteine), lipoic acid and dihydrolipoic acid, resveratrol, lactoferrin, as well as ascorbic acid and ascorbic acid derivatives (e.g., ascorbyl palmitate and ascorbyl polypeptide). Oil-soluble antioxidants suitable for use in the compositions of the present invention include, but are not limited to, butylated hydroxytoluene, retinoids (eg retinol and retinyl palmitate), tocopherols (e.g., tocopherol acetate), tocotrienols, and ubiquinone. Natural extracts containing antioxidants suitable for use in the compositions of the present invention include, but are not limited to, extracts containing flavonoids and isoflavonoids, as well as derivatives thereof (e.g., genistein and diadzein), extracts containing resveratrol, etc. Examples of such natural extracts include grape seed, green tea, pine bark, propolis, and feverfew extracts. "Feverfew extracts" refers to extracts of the plant Tanacetum parthenium, with one particularly useful feverfew extract being commercially available as about 20% active feverfew.

[0042] A non-limiting list of useful wrinkle-reducing active beneficial agents includes N-acetyl glucosamine, 2-dimethylaminoethanol, copper salts such as copper chloride, peptides such as argireline, Syn-ake and copper-containing coenzyme Q10, fennel, blackberry, imperial tree, Picia anomala and chicory, resorcinols such as 4-hexylresorcinol, curcuminoids and retinoids including retinol, retinal, retinoic acid, retinyl acetate and retinyl palmitate, hydroxy acids including, but not limited to, glycolic acid, lactic acid, malic acid, salicylic acid, citric acid and tartaric acid.

[0043] A non-limiting list of useful brightening active beneficial agents includes vitamin C and its derivatives such as ascorbic acid 2-glucoside, alpha hydroxy acids such as lactic acid, glycolic acid, malic acid, tartaric acid, citric acid or any combination of any of the above, beta hydroxy acids such as salicylic acid, polyhydroxy acids such as lactobionic acid and gluconic acid.

[0044] A non-limiting list of useful agents used to treat sagging skin includes blackberry extracts, smoke tree extracts, feverfew extracts, Phyllanthus niruri extracts, and bimetallic complexes containing copper and/or zinc components. The bimetallic complex containing copper and/or zinc constituents can be, for example, copper zinc citrate, copper zinc oxalate, copper zinc tartrate, copper zinc malate, copper zinc succinate, copper zinc malonate, copper zinc maleate, copper zinc aspartate, copper zinc glutamate, copper zinc glutarate, copper zinc fumarate, copper zinc glucarate, copper zinc polyacrylate, copper zinc adipate, copper zinc pimelate, copper zinc suberate, copper zinc azealate, copper zinc sebacate, copper zinc dodecanoate, or combinations thereof.

[0045] Additional beneficial agents or active substances for improving skin condition may include the active substances listed in the following paragraphs. Although some of these active substances may be listed above, they are included below to provide a more complete list.

[0046] Examples of suitable additional benefit agents include: skin lightening agents, darkening agents, anti-aging agents, tropoelastin stimulators, collagen stimulators, anti-acne agents, shine regulating agents, antimicrobial agents such as anti-yeast agents, antifungal and antibacterial agents, anti-inflammatory agents, antiparasitic agents, external analgesics, sunscreens, photoprotectors, antioxidants, keratolytic agents, cleansers/surfactants, humectants, nutrients, vitamins, energy enhancing agents, antiperspirants, astringents, deodorants, hair removers, hair growth enhancing agents, hair growth inhibiting agents, thickeners, hydration enhancers, performance enhancers, anti-callus agents, skin conditioning agents, anti-cellulite agents, fluorides, teeth whitening agents, antiplaque agents and plaque dissolving agents, odor control agents such as odor masking agents or pH modifying agents, etc. Examples of various suitable additional cosmetically acceptable active substances include UV filters including, but not limited to, avobenzone (Parsol 1789), bisdisulizole disodium (Neo Heliopan AP), diethylaminohydroxybenzoylhexyl benzoate (Uvinul A Plus), ecamsule (Mexoryl SX), methyl anthranilate, 4-aminobenzoic acid (PABA), cinoxate, ethylhexyl triazone (Uvinul T 150), homosalate, 4-methylbenzylidene camphor (Parsol 5000), octyl methoxycinnamate (Octinoxate), octyl salicylate (Octisalate), padimate O (Escalol 507), phenylbenzimidazole sulfonic acid (Ensulizole), polysilicone-15 (Parsol SLX), trolamine salicylate, bemotrizinol (Tinosorb S), benzophenones 1-12, dioxybenzone, drometrizole trisiloxane (Mexoryl XL), iscotrizinol (Uvasorb HEB), octocrylene, oxybenzone (Eusolex 4360), sulisobenzone, bisoctrizole (Tinosorb M), titanium dioxide, zinc oxide, carotenoids, free radical scavenger, spin traps, retinoids and retinoid precursors such as retinol, retinoic acid and retinyl palmitate, ceramides, polyunsaturated fatty acids, essential fatty acids, enzymes, enzyme inhibitors, minerals, hormones such as estrogens, steroids such as such as hydrocortisone, 2-dimethylaminoethanol, copper salts such as copper chloride, copper-containing peptides such as Cu:Gly-His-Lys, coenzyme Q10, amino acids such as proline, vitamins, lactobionic acid, acetyl coenzyme A, niacin, riboflavin, thiamine, ribose, electron carriers such as NADH and FADH2, and other plant extracts such as oat extract, aloe vera, feverfew, soybean, shiitake mushroom, derivatives and mixtures thereof.

[0047] Examples of suitable skin lightening agents include, but are not limited to, tyrosinase inhibitors, melanin degradation stimulating agents, melanosome transfer inhibiting agents including PAR-2 antagonists, scrubs, sunscreens, retinoids, antioxidants, tranexamic acid, tranexamic acid cetyl ester hydrochloride, skin whitening agents, linoleic acid, disodium adenosine monophosphate, chamomile extract, allantoin, opacifiers, talcs and silicas, zinc salts, and the like.

[0048] Examples of suitable tyrosinase inhibitors include, but are not limited to, vitamin C and its derivatives, vitamin E and its derivatives, kojic acid, arbutin, resorcinols, hydroquinone, flavones such as licorice flavonoids, licorice root extract, mulberry root extract, Dioscorea coposita root extract, saxifrage extract, and the like, ellagic acid, salicylates and their derivatives, glucosamine and its derivatives, fullerene, hinokitiol, dioic acid, acetylglucosamine, 5,5'-dipropylbiphenyl-2,2'-diol (magnolignan), 4-(4-hydroxyphenyl)-2-butanol (4-HPB), combinations of two or more thereof, and the like. Examples of vitamin C derivatives include, but are not limited to, ascorbic acid and salts, 2-ascorbic acid glucoside, sodium ascorbyl phosphate, magnesium ascorbyl phosphate and natural extract enriched with vitamin C. Examples of vitamin E derivatives include, but are not limited to, alpha-tocopherol, beta-tocopherol, gamma-tocopherol, delta-tocopherol, alpha-tocotrienol, beta-tocotrienol, gamma-tocotrienol, delta-tocotrienol and mixtures thereof, tocopherol acetate, tocopherol phosphate and natural extracts enriched with vitamin E derivatives. Examples of resorcinol derivatives include, but are not limited to, resorcinol, 4-substituted resorcinols such as 4-alkylresorcinols such as 4-butylresorcinol (rucinol), 4-hexylresorcinol (Synovea HR, Sytheon), phenylethylresorcinol (Symwhite, Symrise), 1-(2,4-dihydroxyphenyl)-3-(2,4-dimethoxy-3-methylphenyl)-propane (nivitol, Unigen), etc., as well as natural extracts enriched with resorcinols. Examples of salicylates include, but are not limited to, potassium 4-methoxysalicylate, salicylic acid, acetylsalicylic acid, 4-methoxysalicylic acid, and salts thereof. In certain preferred embodiments, tyrosinase inhibitors include 4-substituted resorcinol, a vitamin C derivative, or a vitamin E derivative. In more preferred embodiments, the tyrosinase inhibitor comprises phenylethylresorcinol, 4-hexylresorcinol, or ascorbyl-2-glucoside.

[0049] Examples of suitable melanin degradation promoting agents include, but are not limited to, peroxides and enzymes such as peroxidases and ligninases. In certain preferred embodiments, the melanin inhibiting agents comprise a peroxide or ligninase.

[0050] Examples of suitable melanosome transfer inhibiting agents include PAR-2 antagonists such as soybean trypsin inhibitor or Bowman-Birk inhibitor, vitamin B3 and derivatives such as niacinamide, soybean essence, whole soybean, soybean extract. In certain preferred embodiments, the melanosome transfer inhibiting agents include soybean extract or niacinamide.

[0051] Examples of scrubs include, but are not limited to, alpha hydroxy acids such as lactic acid, glycolic acid, malic acid, tartaric acid, citric acid, or any combination of any of the foregoing, beta hydroxy acids such as salicylic acid, polyhydroxy acids such as lactobionic acid and gluconic acid, and mechanical exfoliants such as microdermabrasion agents. In certain preferred embodiments, the scrub includes glycolic acid or salicylic acid.

[0052] Examples of sunscreens include, but are not limited to, avobenzone (Parsol 1789), bisdisulizole disodium (Neo Heliopan AP), diethylaminohydroxybenzoylhexyl benzoate (Uvinul A Plus), ecamsule (Mexoryl SX), methyl anthranilate, 4-aminobenzoic acid (PABA), cinoxate, ethylhexyl triazone (Uvinul T 150), homosalate, 4-methylbenzylidene camphor (Parsol 5000), octyl methoxycinnamate (Octinoxate), octyl salicylate (Octisalate), padimate O (Escalol 507), phenylbenzimidazole sulfonic acid (Ensulizole), polysilicone-15 (Parsol SLX), trolamine salicylate, bemotrizinol (Tinosorb S), benzophenones 1-12, dioxybenzone, drometrizole trisiloxane (Mexoryl XL), iscotrizinol (Uvasorb HEB), octocrylene, oxybenzone (Eusolex 4360), sulisobenzone, bisoctrizol (Tinosorb M), titanium dioxide, zinc oxide, etc.

[0053] Examples of retinoids include, but are not limited to, retinol (an alcohol form of vitamin A), retinal (an aldehyde form of vitamin A), retinyl acetate, retinyl propionate, retinyl linoleate, retinoic acid, retinyl palmitate, isotretinoin, tazarotene, bexarotene, adapalene, combinations of two or more thereof, and the like. In certain preferred embodiments, the retinoid is selected from the group consisting of retinol, retinal, retinyl acetate, retinyl propionate, retinyl linoleate, and combinations of two or more thereof. In certain more preferred embodiments, the retinoid is retinol.

[0054]Examples of antioxidants include, but are not limited to, water-soluble antioxidants such as sulfhydryl compounds and their derivatives (e.g., sodium metabisulfite and N-acetylcysteine, glutathione), lipoic acid and dihydrolipoic acid, stilbenoids such as resveratrol and its derivatives, lactoferrin, iron and copper chelating agents, as well as ascorbic acid and ascorbic acid derivatives (e.g. ascorbyl-2-glucoside, ascorbyl palmitate and ascorbyl polypeptide). Oil-soluble antioxidants suitable for use in the compositions of the present invention include, but are not limited to, butylated hydroxytoluene, retinoids (e.g., retinol and retinyl palmitate), tocopherols (e.g. tocopherol acetate), tocotrienols and ubiquinones. Natural extracts containing antioxidants suitable for use in the compositions of the present invention include, but are not limited to, extracts containing flavonoids and isoflavonoids, as well as derivatives thereof (e.g., genistein and diadzein), extracts containing resveratrol, etc. Examples of such natural extracts include grape seed extract, green tea, black tea, white tea, pine bark extract, feverfew, parthenolide-free feverfew extract, oat extract, blackberry extract, smoke tree extract, soybean extract, pomelo extract, wheat germ extract, hesperidin, grape extract, purslane extract, licochalcone, chalcone, 2,2'-dihydroxychalcone, evening primrose extract, propolis, etc.

[0055] In some preferred embodiments, useful anti-acne agents include, but are not limited to, salicylic acid, Zn PCA (zinc pyroglutamic acid), allantoin (5-ureidohydantoin), rosemary, 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0056] In some preferred embodiments, the list of active beneficial agents used to eliminate pigmentation includes tetrahydrocurcumin, phytic acid, resveratrol, soybean glycine oil, gluconolactone, laccase, 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid, and resveratrol.

[0057] In some preferred embodiments, the list of active beneficial agents used for the simultaneous treatment of acne and removal of pigmentation includes 4-hexylresorcinol, N-acetylglucosamine, gluconolactone, niacinamide, azelaic acid and resveratrol.

[0058]In one particular embodiment, the composition comprises one or more reflectance modifying agents (RMAs) (any component used to modify the reflectivity of skin). For example, suitable RMAs may include inks, dyes, pigments, bleaching agents, chemically altering agents, or other substances that can be used to modify the reflectivity of skin. Some suitable RMAs may include a transparent RMA, such as a dye or a diluted pigment. Other suitable RMAs may include an opaque RMA that has high refractive index particles. In particular, high refractive index particles may include particles that have a refractive index of 2.0 or higher. In one particular example, the RMA may include titanium dioxide particles. For example, the RMAs may include titanium dioxide particles with an average diameter of about 0.35 μm to about 1.35 μm, about 0.5 μm to about 1.0 μm, or about 0.6 μm to about 0.8 μm. In particular, titanium dioxide particles can be uniformly distributed and/or suspended in a cosmetic composition (e.g., liquid suspension).

[0059] The device 100 according to this embodiment further comprises a power source 180 that provides electrical power for controlling the device 100 and interacting with it. It is understood that the power source 180 may be located anywhere within the device 100 or may, in an alternative embodiment, be located outside the device 100. In one embodiment, as shown in Fig. 2, the power source 180, which is located within the handle 104 of the device 100, is operatively connected to the light source(s) 120, 121, 122, the detector unit 130, the applicator unit 140 and/or the processing unit 150. Those skilled in the art will understand that various known suitable power sources can be used. For example, the power source 180 may comprise a battery or a connection to an external power source. In particular, the power source 180 may comprise a device such as a rechargeable battery.

[0060] In use, the head 102 is positioned over the area of the skin to be treated. In particular, the distal opening 117 of the end effector 110 is positioned on the skin to define an area to be visualized by the detector assembly 130 and selectively treated by the applicator assembly 140 under the control of the processing assembly 150. During use of the device 100, images of a plurality of different areas of the skin are obtained. For example, as the head 102 moves over the surface of the skin, the device 100 provides continuous or sequential visualization of different areas of the skin to obtain image data and analyze the image data to identify selected frexels to which the composition is applied. More specifically, as the user moves the head 102 back and forth over the surface of the skin, making multiple passes, the device 100 repeatedly passes through previously treated areas to detect artifacts that were missed or incompletely treated and to apply the composition to the identified artifacts on the skin (i.e., to the selected frexels). If a plurality of grid strips 118 pass through the distal opening 117 of the end effector 110, the user may prefer to move the device 100 along a path parallel or substantially parallel to the grid strips 118, as shown by the dashed lines in Fig. 3.

[0061]The present application also includes a method for determining whether at least a portion of the applicator assembly 140 of the device 100 is safely positioned and directed to a target area of skin for selective application of a composition (e.g., cosmetic composition) to places (for example, frexels) within a skin area. Application by the application unit 140 (or certain nozzles of the application unit 140) is permitted only when it is determined that the applicator unit 140 or certain of its nozzles are directed to a safe location, and is not permitted (the applicator unit 140 is disabled) when it is determined that the applicator unit 140 is directed in such a way that application of the composition will be unsafe or potentially unsafe. An example of a method 300 is shown in Fig. 5. In step 302, a user begins to apply the device 100 by positioning the distal end 106 of the end effector 110 of the device 100 on a skin surface, such as on the skin of the face. The distal opening 117 of the end effector 110 defines a region of the skin that will be visualized and analyzed by the device 100. In some embodiments, as described above, the distal opening 117 can be divided by a plurality of grid strips 118 into a plurality of segments 117a of the distal opening, wherein at least one nozzle 142 of the applicator assembly 140 is directed with the possibility of applying a cosmetic to the region of the skin over which each segment 117a of the distal opening is located. As indicated in step 304, the detector assembly 130 visualizes the region through the distal opening 117 to obtain image data for the region of the skin.

[0062] At steps 306 and 308, the image data is analyzed in the processing unit 150 to first determine whether the nozzle(s) 142 associated with each segment 117a of the distal opening is directed in a manner that is safe to apply the composition to the skin. Each nozzle 142 in this embodiment can be evaluated and controlled independently of the other nozzles. The nozzles 142 that are determined to be unsafe to apply the composition from are turned off, while the remaining nozzles 142 of the applicator unit 140 continue to operate. These determinations can be made using any number of suitable methods, as will be described in more detail below.

[0063]For example, the processing unit 150 is configured to perform an analysis of the image data to determine whether the image data for the area of skin over which the distal aperture segment 117a is located corresponds to an area on the user's face located beyond a predetermined distance or radius relative to one or more sensitive areas (e.g., eyes, nostrils and/or mouth). If the skin area is outside a predetermined distance or radius relative to one or more sensitive areas, the processing unit 150 in this embodiment determines that the nozzle(s) 142 associated with that distal opening segment 117a is directed to safely apply the composition to the skin. In an alternative embodiment, if the skin area is within a sensitive area or within a predetermined distance or radius relative to a sensitive area (i.e., in a region located near one or more sensitive regions or including it), the processing unit 150 determines that the direction of the nozzle(s) 142 associated with the distal opening segment 117a does not allow for the composition to be safely dispensed. In particular, the processing unit 150 according to this embodiment compares image data for the skin region over which the distal opening segment 117a is located with a database of previously obtained image data associated with regions of the user's face to identify the facial region corresponding to this image data, and determines whether this region contains a sensitive region or a skin region located at a distance less than a predetermined distance from the sensitive region. In this embodiment, when the processing unit 150 determines that the nozzle 142 is directed in such a way that it is unsafe to apply the composition therethrough, the processing unit 150 disables the unsafely directed nozzle 142. The processing unit 150 may subsequently re-enable the disabled nozzle(s) 142 if the device 100 is moved to a different position on the skin and if the processing unit 150 subsequently determines that in the new location the previously disabled nozzle(s) 142 can safely dispense the composition onto the skin.

[0064] In another embodiment, the processing unit 150 may analyze the image data to determine whether the nozzle(s) 142 are directed at the area of skin over which the distal opening segment 117a is located, with the ability to safely apply the composition to the skin. Each distal opening segment 117a may be evaluated independently of the other segments, and each nozzle(s) 142 associated with the corresponding distal opening segment 117a may be controlled separately. In particular, the processing unit 150 may analyze a portion of the image data corresponding to the area of skin over which the distal opening segment 117a is located to determine whether a portion of the outer edges of the protruding portion 114 of the end effector 110 and/or whether the grid strips 118 located near the distal opening segment 117a contact the skin surface. If the portion of the outer edge of the protruding portion 114 or the strip 118 of the grid located near the segment 117a of the distal opening does not contact the skin surface, the processing unit 150 subsequently determines that the nozzle(s) 142 associated with the analyzed segment 117a of the distal opening are directed in such a way that the application of the composition to the skin area is unsafe, and turns off the unsafely located nozzle(s) 142.

[0065] It should be noted that the contours of the human face are very curved around certain sensitive areas, such as, for example, the areas surrounding the nose and adjacent to the eyes, nostrils and mouth. When the user attempts to act on these areas, the skin surface may curve away from the outer edge areas of the protruding portion 114 of the end effector 110 and/or the strips 118 of the grid, when the device 100 is located over these sensitive areas. Detection of a shadow cast by at least a portion of the outer edges of the protruding portion 114 of the end effector 110 and/or one or more of the grid strips 118 located near the distal opening segment 117a in the image data may indicate that the portion of the outer edges of the protruding portion 114 of the end effector 110 and/or one or more of the grid strips 118 are not in full contact with the skin surface, which indicates that the distal opening segment 117a may be located above the sensitive area or within a predetermined distance or radius relative to the sensitive area. For example, the processing unit 150 can turn off the nozzle 142 of the applicator unit 140 when the shadow(s) of the outer edges of the protruding portion 114 and/or one or more stripes 118 of the grid are detected in the portion of the captured image corresponding to the segment 117a of the distal opening associated with the nozzle 142. Thus, the processing unit 150 is configured to determine that if the image data indicate such a close location of the nozzle 142 to the sensitive area, the nozzle 142 is directed in such a way that the application of the composition will be unsafe. The processing unit 150 may be further configured to analyze the direction and/or length of the shadow(s) cast by the outer edges of the protruding portion 114 and/or one or more grid strips 118 located near the distal opening segment 117a to determine whether the nozzle(s) 142 associated with a particular distal opening segment 117a is directed so as to safely apply the composition to the skin. In particular, the direction and/or length of the shadows can be used to determine whether the outer edges of the protruding portion 114 and/or one or more of the grid strips 118 located near the segment 117a of the distal opening are separated from the skin surface by a distance exceeding a certain predetermined tolerance (in any direction and/or along any shadow length), to initiate the shutdown by the processing unit 150 of the nozzle(s) 142 associated with a particular segment 117a of the distal opening, to prevent the application of the composition near or onto sensitive areas. In one embodiment, the processing unit 150 is configured to determine that the nozzle 142 is directed such that it is safe to apply the composition to the skin area when the shadow length determined by it is less than a predetermined threshold, and to determine that the nozzle 142 is directed such that it is unsafe to apply the composition when the shadow length exceeds the predetermined threshold.

[0066] In a further embodiment, the processing unit 150 may determine the tilt of the device 100 relative to the skin by analyzing the image data. Based on the tilt of the device, the processing unit 150 determines whether the nozzles 142 of the applicator unit 140 are directed in a manner that is capable of safely applying the composition to the skin. When the user attempts to act on these areas, the device 100 may have a tilt that exceeds a threshold level, which increases the risk that when applying the composition, the end point of application of this composition will be determined less accurately, and since the device 100 in such circumstances is often located near sensitive areas, detection of a tilt that exceeds a certain predetermined level leads to the shutdown of the applicator unit 140 by the processing unit 150 to prevent the composition from reaching the sensitive areas. The processing unit 150 may also take into account the direction of the tilt when determining whether the applicator unit 140 is directed unsafely relative to a sensitive area. For example, the processing unit 150 can disable the applicator unit 140 when 1) the image data indicates that the device 100 is tilted in a direction that corresponds to the contours of the sensitive area; 2) the device 100 is tilted at an angle that is outside a predetermined threshold; and/or has a tilt vector magnitude that exceeds a predetermined threshold. Thus, the processing unit 150 can determine that the image data indicating such proximity to the sensitive area indicate that the nozzles 142 of the applicator unit 140 are directed in such a way that applying the composition will be unsafe. In one embodiment, the processing unit 150 can determine that the applicator unit 140 is directed in such a way that applying the composition to the skin area is safe when the tilt vector magnitude of the device is less than a predetermined threshold, and can determine that the applicator unit 140 is directed in such a way that applying the composition is unsafe when the tilt vector magnitude of the device exceeds a predetermined threshold.

[0067]In addition, the processing unit 150 may also determine that the applicator unit 140 is directed such that application of the composition is unsafe when the image data indicates that the nozzle(s) 142 of the applicator unit 140 is(are) misaligned (e.g., separated from the skin surface or tilted beyond a particular configuration) such that the nozzle(s) 142 is(are) not accurately directed for application of the composition - i.e., when the position on the skin to which the composition will be directed by the nozzle 142 cannot be determined within a desired tolerance relative to the target locations (e.g., frexels). The processing unit 150 may disable the nozzle(s) 142 when it determines a potential deviation in the application of the composition relative to the target locations that exceeds a desired tolerance, since higher tolerance values may result in unsafe application of the composition to sensitive areas. Thus, the processing unit 150 may disable the nozzle(s) 142 when the image data indicates that the nozzle(s) 142 is offset by an angle that is outside a predetermined threshold and/or when the magnitude of the vector tilt exceeds a predetermined threshold, which may result in erroneous application of the composition to non-target locations.

[0068]At step 308, the processing unit 150 evaluates whether at least one nozzle 142 of the applicator unit 140 is directed with the ability to safely apply the composition to the skin area, after which the method 300 proceeds to step 310, at which further analysis of the image data is performed to identify locations within the skin area where the composition should be applied (e.g., frexels in which skin artifacts are detected) to change the appearance of the skin. If the processing unit 150 determines based on the image data that the nozzle(s) 142 is(are) directed in such a way that it is unsafe to apply the composition, then the composition is prevented from being applied from this(these) nozzle(s) 142 until this condition is changed, thereby increasing the safety of using the device 100 near the eyes, nostrils and/or mouth. More specifically, if the processing unit 150 determines that the nozzle(s) 142 is(are) directed in such a way that it would be unsafe to use, the processing unit 150 controls the nozzle(s) 142 to prevent the composition from being applied to the skin until the device is moved to align the nozzle(s) 142 to a position that safely applies the composition to the target skin area, for example, directed to a location away from sensitive areas and/or installed at a lower angle.

[0069]At step 310, the processing unit 150 analyzes the image data to determine whether the locations (e.g., frexels), if any, within the rendered skin region to skin artifacts. In particular, the processing unit 150 analyzes the image data and identifies those locations using the rendered skin region that correspond to skin artifacts. More specifically, the processing unit 150 analyzes the image data to determine whether the frexels within the rendered skin region contain skin artifacts of a magnitude sufficient to permit application of the cosmetic composition (i.e., As will be apparent to those skilled in the art, the processing unit 150 is configured to perform an analysis of the image data using any suitable methods to identify skin artifacts. For example, the image data may be analyzed by the processing unit 150 to identify frexel(s), if any, within the rendered region that represent skin artifacts whose appearance is to be altered by comparing reflectance values corresponding to the frexels captured by the detector unit 130 to an average reflectance of the entire skin region. In one embodiment of step 310, a frexel identified as having a reflectance that deviates significantly from the average reflectance of the entire associated rendered region is determined to correspond to a skin artifact. In another embodiment, at least one frexel within the rendered region of skin is analyzed by processing unit 150 to determine whether the image data corresponding to the frexel includes spectral components within the mid-spatial frequency range for the entire rendered frame of skin (i.e., of the image obtained by the detector unit in step 304) that have increased intensity relative to the image balance. The locations where the intensity at the mid-spatial frequencies is above a threshold level are identified as artifacts to be composited. The range of mid-spatial frequencies is preferably determined for each skin region based on the reflectivity of the entire visualized facial skin region.

[0070]Those frexels that significantly affect the average spatial frequencies of the image may, for example, include artifacts whose appearance the user may wish to modify or minimize. The influence of average spatial frequencies on the overall spatial frequency of the skin image and/or the visual perception of skin is considered to be small (e.g. about 5%). However, it is believed that the spatial frequency components within the mid-spatial frequencies have a particular visual prominence and therefore exert a disproportionately large influence on the perceived aesthetic appearance of the skin. It is therefore believed that changing the appearance or minimizing the poor condition of the skin by selectively applying a cosmetic composition to those frexels that correspond to elements of the skin image within the mid-spatial frequency range will provide an aesthetically favorable effect on the appearance of the skin. In order to provide a visually noticeable aesthetic change in the appearance of the skin, it may be particularly useful to selectively change or minimize the prominence of only those frexels that correspond to mid-spatial frequencies, thereby modifying only a limited number of frexels on the skin. In this way, a reduced amount of cosmetic composition can be applied to the skin while achieving an aesthetically noticeable improvement in the appearance of the skin. Additional apparatuses and methods for detecting artifacts using reflectivity and average spatial frequency analysis are described, for example, in U.S. Patent No. 8,007,062, U.S. Patent No. 9,020,184, and U.S. Patent No. 10,092,082, the disclosures of which are incorporated herein by reference.

[0071] If a skin artifact is detected at step 312, the method proceeds to step 314. At step 314, the processing unit 150 directs the selected nozzle(s) 142 of the application applicator unit 140 to apply a composition to the sites or frexels of the artifact(s) identified within the imaged skin region. The selected nozzle(s) 142 are(are) the nozzle(s) that the processing unit 150 has determined to be directed such that it is safe to apply the composition to the skin region. At step 312, the composition is applied to the sites or frexels in which skin artifacts are detected only when the processing unit 150 has determined that the corresponding nozzle(s) 142 is(are) directed such that it is safe to apply the composition to the skin region. When the processing unit 150 determines that the nozzle(s) 142 are directed in such a way that it is unsafe to apply the composition to the skin area, the processing unit 150 controls the nozzle(s) 142 to stop applying the composition. If no skin artifact is detected at step 312, according to the method 300, the composition is not applied to any location within the visualized skin area and the method 300 proceeds to step 316.

[0072] In step 316, the user moves the device 100 to a new frame or region of the skin, and the process is repeated. Such movement can be detected by the device 100 by any suitable means, for example, using an accelerometer or image analysis. Subsequently, the method 300 returns to step 304 and the method 300 continues on a new region of the skin in the same manner as described above. It should be noted that the user can interrupt and terminate the execution of the method 300 before any of the steps 304 to 316 by performing any suitable action, such as, for example, removing the device 100 from the skin or turning off the device 100, in particular the power source 180 of the device.

[0073] In a further embodiment, the device 100 comprises an end effector 110 having a plurality of grid strips 118 extending through a distal opening 117 of the end effector 110, such as shown in Fig. 3. The grid strips 118 of the end effector 110 provide visual guides within the image(s) captured by the detector assembly 130 that are used to determine the tilt of the device 100 relative to the skin, which data can then be used in image analysis to determine whether the applicator assembly 140 is aimed so as to safely apply the composition to the target area of the skin (steps 306 and 308). In particular, the device 100 in this embodiment analyzes image data corresponding to an image or one or more frames of images of an area of skin obtained through the end effector 110 with a grid to determine whether the applicator unit 140 is directed in such a way that it is safe to apply the composition to the imaged area of skin. More specifically, the image data obtained by the detector unit 130 in this embodiment corresponds to an image or one or more frames of an image of an area of skin over which the distal opening 117 is located, onto which the stripes 118 of the grid are also applied. The processing unit 150 analyzes the image data to determine whether the nozzle(s) 142 of the applicator unit 140 are directed with the possibility of safely applying the composition to the skin. For example, the processing unit 150 in this embodiment analyzes the image data to identify at least one shadow cast by at least one of the grid strips 118 and/or the outer edge of the projecting portion 114 of the end effector 110, and determines the tilt of the nozzle(s) 142 relative to the skin surface based on the length, width and/or shape of this shadow. In one embodiment, the tilt can be quantitatively measured using the length of the shadow. In particular, if the length of the shadow exceeds a predetermined threshold, it is determined that the applicator unit 140 is directed such that it is unsafe to apply the composition to the skin area. If the length of the shadow is less than the predetermined threshold, it is determined that the applicator unit 140 is directed such that it is safe to apply the composition to the skin area. In yet another embodiment, the tilt of the nozzle(s) relative to the skin surface can be quantitatively measured using a ratio for two different shadows, as will be described in more detail below.

[0074]As described above, the inclination of each of the nozzles or the device as a whole can also be defined as a directional vector in three-dimensional space having a length indicating the amount of deviation from the skin surface. The directional vector can consist of directional components in each of the x, y and z directions, as shown in Fig. 6. Fig. 6 is a view from the inside of the head 102 of the device 100 in the distal direction through the distal opening 117 of the end effector 110, including a plurality of points illustrating the alignment of the plurality of nozzles 142 of the applicator assembly 140 in the distal direction. As shown in Fig. 6, the axis in the x direction extends along the width of the distal opening 117, horizontally in the view shown in Fig. 6. The axis in the y direction extends along the length of the distal opening 117, vertically in the view shown in Fig. 6. The axis in the z direction extends toward the view shown in Fig. 6 and from it. The processing unit 150 analyzes the image data to identify at least one shadow cast by the strips 118 of the grating and/or the outer edges of the projecting portion 114 of the end effector 110. The processing unit 150 further analyzes the length, width, and/or shape of the shadow to determine each directional component (e.g.,in the x, y and z directions, as shown in Fig. 6) to tilt the device 100. In particular, in this embodiment, tilt relative to the y-axis will be detected when the shadow becomes larger on one side along the x-axis (e.g. left side in the view shown in Fig. 6) compared to the opposite side of the x-axis (e.g. right side in the view shown in Fig. 6). A tilt relative to the x-axis can be detected when the shadow becomes wider on one side along the y-axis (e.g. towards the bottom in the view shown in Fig. 6) compared to the opposite side of the y-axis (e.g. towards the top in the view shown in Fig. 6). The size of the shadow can be further analyzed, for example, length and/or width, to determine the parallel distance of the device from the skin surface, for example distance from the skin surface in the z direction. The size of the shadow becomes larger when the device is located further from the skin surface. In addition, the device may provide the user with feedback indicating a corrective movement to reduce the tilt. The feedback may include a direction and angle corresponding to a vector opposite to the tilt vector of the device.

[0075] Fig. 6 shows two separate illustrative examples of shadows 402, 404 cast by the outer edges of the protruding portion 114 of the end effector 110. It should be noted that the shadows 402, 404 are shown together in Fig. 6 for illustrative purposes only. During use of the device, the shadows 402, 404 are detected by the processing unit 150 in the image data corresponding to the individual images that reflect different directions and angles of inclination of the device 100, as described below. The shadow 402 shown on the left side does not have a tilt component in the x-axis direction or in the y-axis direction. However, the length and width of the shadow 402 can be analyzed by the processing unit 150 to determine the distance in the z-direction between the device and the skin surface. The shadow 404 shown on the right side has a tilt component in the z-direction relative to the x-axis. As can be seen in Fig. 6, the upper portion of the shadow 404 is narrower than the lower portion of the shadow 404, and this indicates that the device is tilted toward the skin in the upward direction along the y-axis and away from the skin in the downward direction along the y-axis.

[0076] In addition, the grid strips 118 divide the distal opening 117 into a plurality of opening segments 117a, wherein each portion of the skin region defined by each of the opening segments 117a can be independently analyzed by the processing unit 150 to determine, with respect to each segment 117a, whether the corresponding skin region is suitable for applying the composition. For example, the processing unit 150 analyzes the image data to identify and determine the inclination of each opening segment 117a based on at least one shadow cast by an adjacent grid strip 118 and/or an outer edge of the projecting portion 114 of the end effector 110, as described above. The processing unit 150 identifies and measures the shadows to independently determine whether the nozzle 142 aligned with each segment 117a of the aperture is directed in such a way that the application of the composition to the skin area within the segment 117a of the aperture is safe, and controls the operation of the applicator unit 140 in such a way as to apply the composition to the skin only through the nozzles 142 that are directed in such a way that the application of the composition through their corresponding segments 117a of the aperture is safe. And on the contrary, through the nozzles 142 that are directed through the said segments 117 of the aperture in such a way that the application of the composition to the skin is unsafe, which were determined using the data on the inclination of each segment 117a of the aperture, the application of the composition to the skin was temporarily limited to further improve the safety of the operation of each nozzle 142. This embodiment is further illustrated in example I below.

[0077]In an alternative embodiment shown in Fig. 7a and 7b, the processing unit 150 analyzes the image data to identify a pair of shadows 510a, 510b cast by at least two of the grid strips 118 and/or the outer edge of the protruding portion 114 of the end effector 110, and determines the tilt of the device 100 or the nozzle(s) 142 relative to the surface of the skin 500 based on the ratio of the length and/or width of the shadows 510a, 510b. Fig. 7a and 7b show a side view of the interior of the head 104 of the device 100. As shown in Fig. 7a and 7b, at least one light source 120 is positioned proximally with respect to the sensor of the detector assembly 130, wherein the light source(s) 120 and the detector assembly 130 are positioned at or near the midpoint between the opposite outer edges of the protruding portion 114 of the end effector 110. The light source(s) 120 and/or the detector assembly 130 may be positioned anywhere within the head 104 of the device 100 and may be positioned closer to one outer edge (e.g., from the left side) than to the opposite outer edge (for example, on the right side), or vice versa. The light source(s) 120 may illuminate the interior of the protruding portion 114 of the end effector 110. As can be seen in Fig. 7a and 7b, when the distal end 116 of the end effector 110 is not in direct contact with the surface of the skin 500, each of the opposite outer edges of the protruding portion 114 casts a shadow 510a, 510b onto the surface of the skin 500. The processing unit 150 further analyzes the image data to determine the length and/or width of each of the shadows 510a, 510b to determine the ratio of the length or width of the shadows cast by the opposite outer edges of the protruding portion 114. For example, it determines the ratio between the length or width of the shadow 510a and the length or width of the shadow 510b. When the ratio is within a predetermined range, it is determined that the applicator unit 140 (not shown in Fig. 7a and 7b) is directed such that the application of the composition to the skin surface 500 is safe. When the ratio of the length or width of the shadows 510a, 510b is outside the predetermined range, it is determined that the applicator unit 140 is directed such that the application is unsafe. More specifically, if the ratio of the length or width for the shadow 510a and the shadow 510b is within a predetermined range, it is determined that the inclination of the device 100 is within the permissible error for the inclination of the distal end 116 relative to the skin surface 500. For example, as shown in Fig. 7a, a ratio of the length of the shadow 510a and the shadow 510b equal to 1:1 or close to it indicates that the distal end 116 is parallel or substantially parallel to the skin surface 500 - i.e. is not substantially inclined. Thus, in the present specific embodiment, if the ratio of the lengths of the shadows cast by the opposite outer edges of the protruding portion 114 is close to the ratio of 1:1 or is within the desired tolerance therefor, it is determined that the applicator unit 140 is directed in such a way that the application of the composition to the skin surface 500 is safe. As can be seen in Fig. 7b, the device 100 is strongly inclined relative to the skin surface 500 so that the shadow 510a is significantly shorter than the shadow 510b. Thus, the ratio of the length of the shadow 510a and the length of the shadow 510b deviates significantly from the ratio of 1:1 shown in Fig. 7a, and this means that the distal end 116 is located at a significant angle to the skin surface 500, and it is determined that the device 100 is directed in such a way that the application of the composition is unsafe.

[0078] Although the embodiment shown in Figs. 7a and 7b has been described with respect to shadows cast by opposing outer edges of the raised portion 114, it is contemplated that the processing unit 150 may similarly analyze the image data to identify shadows cast by opposing lattice bands 118 defining a segment 117a of the distal opening 117 to determine the inclination of the nozzle(s) 142 corresponding to the opening segment 117a relative to the surface of the skin 500. Each portion of the skin region defined by each of the opening segments 117a may be independently analyzed by the processing unit 150 to determine, for each segment 117a, a ratio of shadows cast by the opposing lattice bands 118 defining the opening segment 117 to determine whether the device 100 is oriented to safely apply a composition to the corresponding portion of the skin.

[0079] Although Fig. 7a and 7b show a flat skin area 500, the ratio of the length and/or width values of the shadows 510a, 510b cast by the opposite outer edges of the raised area 114, as described above, can be used to determine the tilt of the device 100 or the nozzle(s) 142 relative to the skin surface 500 for skin of any contour. In particular, as described above, the contours of the face are substantially curved around certain sensitive areas, and thus, when the user tries to act on these areas, the skin surface may curve away from the outer edges of the raised portion 114. Thus, when the ratio of the lengths of the shadows 510a, 510b is outside the predetermined range, the processing unit 150 may determine that the device 100 is too tilted relative to the skin surface 500 or that the device 100 is near or above one of the sensitive areas, where both can be used as a basis for determining that the applicator unit 140 is directed in such a way that the application of the composition is unsafe.

[0080]As described above, if it is determined that the applicator unit 140 is directed to safely apply the composition to the skin, the method 300 proceeds to step 310, where the image data is further analyzed to identify locations within the skin region to which the composition is to be applied. In this particular embodiment, the image data corresponds to an image or one or more frames of images of the skin region obtained through the end effector 110 with the array, and therefore, the image data corresponds to the skin regions between the array bands 118 that are visible on the detector unit 130, and not to the skin located under the array bands 118. Thus, in one embodiment of step 310, the image data can be adjusted such that the portions of the image data corresponding to the array bands 118 are changed by the processing unit 150, and the adjusted image data is further analyzed by the processing unit 150 to identify locations within the skin region to which the composition is to be applied. Such adjustment of the image data is particularly advantageous for analysis methods that use an average or overall profile of the data of a rendered area of skin to identify skin artifacts, since portions of the image data corresponding to the lattice bands 118 that are visually significantly different from the skin would otherwise introduce distortions into the results of such analysis methods. Thus, the processing unit 150 in this embodiment adjusts the image data by replacing the data corresponding to the image portions including the lattice bands 118 with data that have a high resemblance to the skin portions not covered by the lattice bands 118 in the captured image. For example, the processing unit 150 may adjust the image data such that the data for the image portions corresponding to the lattice bands 118 are replaced with average values, for example, the average reflectivity of the remaining image areas. In yet another example, the processing unit 150 may correct the image data such that the data for the image areas corresponding to the lattice bands 118 are replaced with extrapolated values generated based on adjacent areas of the captured image. In a further example, the processing unit 150 corrects the image data using a database of previously obtained image data associated with areas of the user's face, wherein the data for the image areas corresponding to the lattice bands 118 are replaced with previously obtained image data corresponding to areas of the face covered by the lattice bands 118 in the captured image.

EXAMPLE

Example I

[0081] In example I, the illustrative device 100, which is described above and shown in Fig. 4, includes two separate green LEDs as its first and second light sources 121, 122. The processing unit 150 independently and separately controls the first and second light sources 121, 122 to turn them on and off independently of each other. In the present example, the device 100 determines whether a nozzle (not shown) is directed so as to safely apply a composition to the area of the skin over which the first segment 206 of the opening is located. Each of the first and second light sources 121, 122 may have a different wavelength, and they can both be turned on at the same time. In an alternative embodiment, the first light source 121 may be turned on, while the other light source(s) 120, 122 are(are) turned off for a predetermined period of time. The detector unit 130 captures one or more image frames covering the skin area defined by the first aperture segment 206 for a specified period of time (for example , for 100 frames) to generate image data. The processing unit 150 analyzes the image data to identify the first shadow 208 cast on the skin area defined by the first aperture segment 206, the adjacent strip 118 of the grid, and to determine the length of the first shadow 208. If the length of the first shadow 208 exceeds a predetermined threshold, the processing unit 150 determines that the nozzle is directed in such a way that the application of the composition to the skin area over which the first aperture segment 206 is located is unsafe. If the length of the first shadow 208 is less than a predetermined threshold, the processing unit 150 determines that the nozzle is directed in such a way that the application of the composition to the area of the skin over which the first segment 206 of the opening is located is safe and allows the device 100 to continue identifying and applying the composition to the frexel(s) within the first segment 206 of the opening in which skin artifacts are detected.

[0082]In the present example, the device 100 also determines whether the skin area over which the second aperture segment 210 is located is safe and/or acceptable for application of the composition, independently of the above-described visualization and analysis of the first aperture segment 206. In a preferred embodiment, the first and second light sources 121, 122 have different wavelengths, and each of them is used to simultaneously illuminate the skin area. In an alternative embodiment, the first light source 121 can be turned off and the second light source 122 is turned on for another predetermined period of time. The detector unit 130 captures a separate image (set of images) covering the skin area defining the second aperture segment 210 during this second period of time (e.g., for 100 frames) to generate a second set of image data. The processing unit 150 analyzes the second set of image data to identify and determine the length of the second shadow 212 using a method similar to that described above for the first shadow 208. If the length of the second shadow 212 exceeds a predetermined threshold, the processing unit 150 determines that the other nozzle (not shown) is directed such that it is unsafe to apply the composition to the area of the skin defined by the second aperture segment 210. If the length of the second shadow 212 is less than a predetermined threshold, the processing unit 150 determines that the other nozzle is directed such that it is safe to apply the composition to the area of the skin over which the second aperture segment 210 is located, and allows the device 100 to further continue identifying and selectively applying the composition to the frexel(s) within the second aperture segment 210 in which skin artifacts are detected.

[0083] Although Example I describes independent rendering and analysis of two opening segments, it is contemplated that each of the opening segments 117a may be separately rendered and analyzed by the device 100 as described above.

[0084] The invention described and claimed herein should not be limited to the specific embodiments described herein, since these embodiments are intended to illustrate several aspects of the invention. Any equivalent embodiments are intended to be within the scope of the invention. Indeed, various modifications of the invention in addition to those shown and described herein will be apparent to those skilled in the art from the foregoing description. Such modifications are also intended to be included within the scope of the appended claims. All publications cited herein are incorporated herein by reference in their entirety.

Claims (27)

1. A hand-held device for applying a composition to the user's facial skin, comprising: an end effector comprising a main portion and a projecting portion extending distally from the main portion, wherein the projecting portion has a distal opening; a detector assembly configured to obtain image data for imaging a region of skin through a distal opening of the end effector; an applicator unit configured to apply the composition to a location within an area of skin; and a processing unit configured to receive image data from a detector unit, analyze the image data to determine whether the applicator unit is directed such that application of the composition to the skin area is safe and whether the frexel within the skin area corresponds to a skin artifact selected from the group consisting of scars, wrinkles, scars, freckles, sun damage sites and age spots, wherein the processing unit is configured to analyze the image data and determine that the applicator unit is directed such that application of the composition to the skin area is safe when the image data corresponds to an area on the user's face located at least a predetermined distance from at least one of the eyes, nostrils and mouth of the user's face, direct the applicator unit to apply the composition to the frexel when the processing unit determines that the applicator unit is directed such that application of the composition to the skin area is safe and a skin artifact is detected from the frexel, and control the applicator unit to stop applying the composition to the skin when it is determined that the applicator unit is directed such that Applying the composition to the skin area is unsafe. 2. The device according to claim 1, wherein the processing unit is configured to analyze image data to determine the tilt of the device. 3. The device according to claim 2, in which the processing unit is configured to determine that the applicator unit is directed in such a way that application of the composition to the skin area is safe when the tilt value of the device is less than a predetermined threshold, and to determine that the applicator unit is directed in such a way that application of the composition to the skin area is unsafe when the tilt value of the device is greater than a predetermined threshold. 4. The device according to any one of claims 1-3, in which the projecting portion of the end effector comprises more than one grid strip passing through the distal opening, and the image data corresponds to an image of the area of skin on which the grid strips are applied. 5. The device according to claim 4, wherein the processing unit is configured to analyze image data to identify a shadow of at least one of the grating stripes in the image and to determine the length of the shadow based on the image data. 6. The device of claim 5, wherein the processing unit is configured to determine that the applicator unit is directed such that application of the composition to the skin area is safe when the shadow length is less than a predetermined threshold, and to determine that the applicator unit is directed such that application of the composition to the skin area is unsafe when the shadow length is greater than a predetermined threshold. 7. The device according to any one of claims 4-6, in which the processing unit is configured to correct the image data by replacing the data for the image sections of the grating stripes with data generated by the processing unit for the skin located under the grating stripes, and to analyze the corrected image data to identify locations within the skin region corresponding to skin artifacts. 8. The device according to any one of claims 1-7, in which the processing unit is configured to determine whether a frexel skin artifact is detected based on the reflectivity of the skin region determined from the image. 9. The device according to claim 8, wherein the applicator unit comprises a nozzle configured to dispense a portion of the composition under pressure from the reservoir to form a layer of the composition on the skin. 10. The device of claim 11, wherein the composition is a cosmetic composition containing a reflectivity-modifying agent in the form of a liquid suspension. 11. The device of claim 10, wherein the reflectivity-modifying agent is titanium dioxide. 12. A method for applying a composition to the user's facial skin, comprising: obtaining image data for imaging an area of skin over which the device is positioned using a detector unit; analyzing the image data by the processing unit to determine the tilt of the device relative to the skin area; analyzing the image data by the processing node to identify locations within the skin region corresponding to skin artifacts; determining, by the processing unit, whether the applicator unit is directed such that application of the composition to the skin area is safe, based on the tilt of the device, wherein the processing unit determines that the applicator unit is directed such that application of the composition to the skin area is safe when the tilt of the device is less than a predetermined threshold, and determines that the applicator unit is directed such that application of the composition to the skin area is unsafe when the tilt of the device is greater than a predetermined threshold; applying the composition with the applicator unit to the identified locations only when it is determined that the applicator unit is directed in such a way that application of the composition to the skin area is safe; and stopping application of the composition to the skin when it is determined that the applicator unit is directed in such a way that application of the composition to the skin area is unsafe. 13. The method of claim 12, wherein the image data corresponds to an image of a skin area onto which one or more grid strips of the end effector of the device are applied, wherein the grid strips extend over the entire skin area. 14. The method according to claim 13, wherein the processing unit determines the tilt of the device by analyzing image data to identify a shadow of at least one of the grating stripes in the image and analyzing the shadow to determine a three-dimensional tilt vector. 15. The method according to claim 13 or 14, wherein the processing unit corrects the image data by replacing the data for the image areas of the grating stripes with data generated by the processing unit for the skin located under the grating stripes, and analyzes the corrected image data to identify locations within the skin area corresponding to skin artifacts. 16. The method according to any one of claims 12-15, wherein the processing unit identifies locations within the skin region that correspond to skin artifacts based on the reflectivity of the skin region determined from the image. 17. The method according to claim 12, wherein the composition comprises a reflectivity-modifying agent in the form of a liquid suspension.