JP7208153B2 - Information processing device, client device, information processing method, and program - Google Patents

Description

The present invention relates to an information processing device, a client device, and a program.

In general, cosmetics used for skin care are preferably selected according to skin conditions. At a cosmetic store, a salesperson with skin expertise identifies the physical characteristics of a customer's skin (eg, skin roughness and hardness) by directly touching the customer's skin. The salesperson proposes advice (for example, skin care methods and cosmetics to be used for skin care) according to the specified skin condition to the customer. The customer purchases cosmetics according to his or her skin condition according to the salesperson's suggestion.

For example, Patent Literature 1 discloses a technique for determining a skin condition according to palpation results in order to specify the skin condition based on the feel of the skin.

Japanese Patent No. 5357363

However, the skin palpation result of Patent Document 1 depends on the degree of expertise or experience of the palpator who palpates. Therefore, the determination result varies from person to person. Therefore, when the technique of Patent Document 1 is used at a cosmetics store, the advice provided by the salesperson may not be suitable for the subject's skin.

An object of the present invention is to prevent variations in skin condition determination results based on skin tactile sensations.

One aspect of the present invention is
comprising means for obtaining tactile information indicating physical properties relating to the tactile sensation of the user's skin;
means for presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of pieces of tactile information; prepare
It is an information processing device.

According to the present invention, it is possible to prevent variations in skin condition determination results based on skin tactile sensations.

1 is a block diagram showing the configuration of an information processing system according to an embodiment; FIG. FIG. 2 is a schematic diagram showing the configuration of the tactile sensor of FIG. 1; BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an explanatory diagram of the outline of this embodiment; It is a figure which shows the data structure of the user information database of this embodiment. It is a figure which shows the data structure of the tactile log information database of this embodiment. It is a figure which shows the data structure of the action log information database of this embodiment. FIG. 4 is a diagram showing the data structure of the mind-body log information database of the present embodiment; It is a figure which shows the data structure of the skin evaluation log information database of this embodiment. It is a figure which shows the data structure of the content matching table of this embodiment. It is a figure which shows the data structure of the task information database of this embodiment. FIG. 4 is a sequence diagram of content presentation processing according to the present embodiment; FIG. 12 is a diagram showing an example of a screen displayed in the information processing of FIG. 11; FIG. 12 is a diagram showing an example of a screen displayed in the information processing of FIG. 11; FIG. 12 is a diagram showing an example of a screen displayed in the information processing of FIG. 11; FIG. 10 is a sequence diagram of task update processing according to the embodiment; 16 is a diagram showing an example of a screen displayed in the information processing of FIG. 15; FIG. 7 is a flowchart of processing for correcting an estimation formula according to the present embodiment; FIG. 11 is a schematic diagram showing the configuration of a tactile sensor of modification 6;

An embodiment of the present invention will be described in detail below with reference to the drawings. In the drawings for describing the embodiments, in principle, the same constituent elements are denoted by the same reference numerals, and repeated description thereof will be omitted.

(1) Configuration of information processing system The configuration of the information processing system will be described. FIG. 1 is a block diagram showing the configuration of the information processing system of this embodiment.

As shown in FIG. 1, the information processing system 1 includes a client device 10, a server 30, a tactile sensor 40, a log device 50, and a prediction information providing server .
The client device 10, the server 30, and the prediction information providing server 70 are connected via a network (for example, the Internet or an intranet) NW.

The client device 10 is an example of an information processing device that transmits requests to the server 30 . The client device 10 is, for example, a smart phone, a tablet terminal, or a personal computer.

The server 30 is an example of an information processing device that provides the client device 10 with a response in response to a request transmitted from the client device 10 . Server 30 is, for example, a web server.

The tactile sensor 40 is configured to measure information regarding physical properties related to the tactile sensation of human skin.

The log device 50 acquires at least one of environment information about the environment in which the user spent time, behavior information about the behavior of the user, and mind-body information about the mind and body of the user. The log device 50 is, for example, a wearable device that can be worn by the user. The log device 50 is connected to the client device 10 by wire or wirelessly.

The prediction information providing server 70 is an example of an information processing device that provides prediction information indicating future prediction. The prediction information providing server 70 provides, for example, the following information.
・Tactile sensation prediction information indicating a prediction of the user’s skin tactile sensation in the future ・Behavior prediction information indicating a prediction of the user’s future behavior (for example, schedule) ・Prediction of the user’s future mental and physical health (for example, the predicted day of the estrous cycle) mind-body prediction information indicating

(1-1) Configuration of Client Apparatus The configuration of the client apparatus 10 will be described with reference to FIG.

As shown in FIG. 1, the client device 10 includes a storage device 11, a processor 12, an input/output interface 13, a communication interface 14, and a GPS module 15. FIG.

Storage device 11 is configured to store programs and data. The storage device 11 is, for example, a combination of ROM (Read Only Memory), RAM (Random Access Memory), and storage (eg, flash memory or hard disk).

Programs include, for example, the following programs.
・OS (Operating System) program ・Application (for example, web browser) program that executes information processing

The data includes, for example, the following data.
・Databases referenced in information processing ・Data obtained by executing information processing (that is, execution results of information processing)

The processor 12 is configured to implement the functions of the client device 10 by activating programs stored in the storage device 11 . Processor 12 is an example of a computer.

The input/output interface 13 is configured to receive user instructions from an input device connected to the client device 10, acquire information from the tactile sensor 40, and output information to an output device connected to the client device 10. be done.
Input devices are, for example, keyboards, pointing devices, touch panels, or combinations thereof.
An output device is, for example, a display.

Communication interface 14 is configured to control communications between client device 10 and server 30 .

The GPS module 15 is configured to acquire location information of the client device 10 by communicating with GPS (Global Positioning System) satellites.

(1-2) Configuration of Server The configuration of the server 30 will be described with reference to FIG.

As shown in FIG. 1, the server 30 includes a storage device 31, a processor 32, and a communication interface .

Storage device 31 is configured to store programs and data. Storage device 31 is, for example, a combination of ROM, RAM, and storage (eg, flash memory or hard disk).

Programs include, for example, the following programs.
・OS program ・Application program that executes information processing

The data includes, for example, the following data.
・Databases referenced in information processing ・Execution results of information processing

The processor 32 is configured to implement the functions of the server 30 by activating programs stored in the storage device 31 . Processor 32 is an example of a computer.

The input/output interface 33 is configured to receive user instructions from an input device connected to the server 30 and output information to an output device connected to the server 30 .
Input devices are, for example, keyboards, pointing devices, touch panels, or combinations thereof.
An output device is, for example, a display.

Communication interface 34 is configured to control communications between server 30 and client device 10 .

(1-3) Configuration of Tactile Sensor The configuration of the tactile sensor 40 of the present embodiment will be described. FIG. 2 is a schematic diagram showing the configuration of the tactile sensor of FIG.

As shown in FIG. 2, the first example of the tactile sensor 40 includes a sensor unit 40a, a base portion 40b, and a controller 40c. The sensor unit 40a can be worn on the user's finger FIN.

The sensor unit 40a includes an acceleration sensor 40aa and a pair of strain gauges 40ab.

The acceleration sensor 40aa is configured, for example, to measure at least one of the following characteristics.
・Skin vibration characteristics (vibration frequency as an example)
・Unevenness characteristics of the skin (as an example, a value estimated from the vibration frequency)

A pair of strain gauges 40ab is applied by a user's finger FIN to the base portion 40b in a predetermined direction (for example, downward (Y-direction) pressing force or lateral (X-direction) shearing force). Sometimes configured to measure skin properties. The skin properties that are measured include, for example, at least one of the following.
・Skin contact characteristics ・Skin deformation characteristics ・Skin friction characteristics

The controller 40c is configured to calculate skin frictional characteristics by applying the skin deformation characteristics measured by the strain gauge 40ab to a predetermined estimation formula.

(1-4) Overview of this embodiment An overview of this embodiment will be described. FIG. 3 is an explanatory diagram of the outline of this embodiment.

The tactile sensor 40 acquires tactile information indicating physical characteristics related to the tactile sensation of the user's U skin. The tactile information is information indicating physical characteristics related to the tactile sensation of the user's U skin.

The client device 10 acquires tactile information from the tactile sensor 40 and transmits the tactile information to the server 30 .

The server 30 estimates the skin condition based on the tactile information acquired from the client device 10 . The skin condition is the condition of the skin estimated from the physical characteristics related to the tactile sensation of the user's U skin.

The client device 10 acquires the skin condition estimation result by the server 30, and two types of information based on the skin condition estimation result (real-time information (an example of “first information”) and one-time information (“second An example of "information"))) is presented to the user U.

According to this embodiment, the skin condition estimation result is obtained based on the tactile information acquired by the tactile sensor 40 . As a result, it is possible to prevent variations in skin condition determination results based on skin tactile sensations. As a result, information more suitable for the skin condition of the user U can be provided.

(2) Database The database of this embodiment will be described. The following databases are stored in the storage device 31.

(2-1) User Information Database The user information database of this embodiment will be described. FIG. 4 is a diagram showing the data structure of the user information database of this embodiment.

The user information database shown in FIG. 4 stores information about users (hereinafter referred to as "user information").
The user information database includes a "user ID" field, a "user name" field, a "user attribute" field, and an "estimation formula" field. Each field is associated with each other.

A user ID for identifying a user is stored in the "user ID" field.

The “user name” field stores information (for example, text) indicating the user name.

The "user attribute" field stores information about user attributes (hereinafter referred to as "user attribute information"). The user attribute information is information arbitrarily determined by the user. The "user attribute" field includes a "gender" field and an "age" field.
The "gender" field stores information indicating the gender of the user.
The "age" field stores information indicating the age of the user.

The "estimation formula" field stores an estimation formula for estimating the user's skin condition. The estimation formula includes a coefficient for each factor (for example, tactile information acquired by the tactile sensor 40) that affects the user's skin.

An estimation formula is prepared for each user's skin condition index (hereinafter referred to as "skin index"). That is, the coefficients included in the estimation formula are different for each skin index. A skin index is a quantitative value representing the condition of the user's skin. The skin index is, for example, at least one of the following.
・Skin texture ・Skin color ・Skin dryness ・Skin smoothness ・Skin transparency softness of the skin

(2-2) Tactile Log Information Database The tactile log information database of this embodiment will be described. FIG. 5 is a diagram showing the data structure of the tactile log information database of this embodiment.

The tactile log information database in FIG. 5 stores tactile log information. The tactile log information is information relating to the history of tactile information acquired from the tactile sensor 40 .
The tactile log information database includes a 'tactile log ID' field, a 'date and time' field, and a 'tactile information' field. Each field is associated with each other. The tactile log information database is associated with the user ID.

The “tactile log ID” field stores a tactile log ID that identifies tactile information constituting the tactile log information.

The "date and time" field stores information indicating the date and time when the tactile information was acquired.

The 'tactile information' field includes a 'vibration' field, an 'unevenness' field, a 'contact' field, a 'deformation' field, and a 'friction' field.

The "vibration" field stores vibration characteristic information (for example, vibration frequency measured by the acceleration sensor 40aa) regarding the vibration characteristic of the skin.

The "unevenness" field stores unevenness characteristic information on the unevenness characteristic of the skin (for example, a value estimated from the vibration frequency measured by the acceleration sensor 40aa).

The "contact" field stores contact characteristic information (for example, values measured by the strain gauge 40ab) regarding the contact characteristic of the skin.

The "deformation" field stores deformation characteristic information (for example, the amount of deformation measured by the strain gauge 40ab) regarding the deformation characteristic of the skin.

The "friction" field stores friction characteristic information (for example, the frictional force calculated by the base portion 40b) regarding the friction characteristic of the skin.

(2-3) Action Log Information Database The action log information database of this embodiment will be described. FIG. 6 is a diagram showing the data structure of the action log information database of this embodiment.

The action log information database of FIG. 6 stores information indicating the history of action information (hereinafter referred to as "action log information"). The action log information is information acquired from the log device 50, information determined according to user instructions (for example, user's answers to questionnaires or user's voluntary input), or a combination thereof.
The action log information database includes an "action log ID" field, a "date and time" field, an "action" field, a "start time" field, an "end time" field, a "calorie change" field, and a "location information" field. ' field and an 'environmental information' field. Each field is associated with each other. The action log information database is associated with the user ID.

The “action log ID” field stores an action log ID that identifies action information constituting the action log information.

The "date and time" field stores information indicating the date and time when the behavior information was acquired.

The "behavior" field stores information about the user's behavior.
User actions include at least one of the following:
・Meal (for example, the contents of the meal)
・Exercise (for example, the type of exercise)
・Sleep (for example, the number of times you toss and turn during sleep)
・Care behavior (for example, information on whether or not morning cleansing was performed, whether or not skin care was performed, details of care, and products used for care)

The "start time" field stores information indicating the action start time.

Information indicating the end time of the action is stored in the "end time" field.

The "calorie change" field stores information indicating calorie intake or calorie consumption according to behavior.

The “location information” field stores the location information acquired by the GPS module 15 .

The "environmental information" field stores environmental information about the environment at the position indicated by the positional information. Environmental information includes at least one of the following:
・Temperature, humidity, UV exposure

(2-4) Mind-Body Log Information Database The mind-body log information database of this embodiment will be described. FIG. 7 is a diagram showing the data structure of the psychosomatic log information database of this embodiment.

The mind-body log information database in FIG. 7 stores information indicating the history of the mind-body information of the user (hereinafter referred to as "mind-body log information"). The mind-body log information is information obtained from the log device 50, user instructions (for example, user's answers to questionnaires), or information determined according to a combination thereof.
The mind-body log information database includes a "mind-body log ID" field, a "date and time" field, a "pulse rate" field, an "estrous cycle" field, and a "stress" field. Each field is associated with each other. The mind-body log information database is associated with a user ID.

The “mind-body log ID” field stores a mind-body log ID that identifies the mind-body information that constitutes the mind-body log information.

The "date and time" field stores information indicating the date and time when the psychosomatic information was obtained.

A user's pulse value is stored in the "pulse value" field. The pulse value is information acquired from the log device 50, for example.

The “estrous cycle” field stores information indicating the estrous cycle (an example of hormone balance information).

The “stress” field stores stress information indicating an index of stress. The stress information indicates, for example, intensity of stress, factor of stress, type of stress, or a combination thereof. The stress information depends on the pulse value, estrous cycle, or a combination thereof.

(2-5) Skin Evaluation Log Information Database The skin evaluation log information database of this embodiment will be described. FIG. 8 is a diagram showing the data structure of the skin evaluation log information database of this embodiment.

The skin evaluation log information database in FIG. 8 stores information (hereinafter referred to as "skin evaluation log information") indicating the history of qualitative evaluations (hereinafter referred to as "skin evaluations") regarding skin conditions.
The skin evaluation log information database includes a "skin evaluation log ID" field, a "date and time" field, and a "skin score" field. Each field is associated with each other. The skin evaluation log information database is associated with the user ID.

The “skin evaluation log ID” field stores a skin evaluation log ID that identifies skin evaluations that constitute skin evaluation log information.

The "date and time" field stores information indicating the date and time when the skin evaluation was generated.

The "skin score" field stores the skin score obtained from the tactile information and the estimation formula. The "skin score" field includes a "first skin score" field and a "second skin score" field.
The "first skin score" field stores a first skin score (an example of a first skin index). The first skin score indicates the current skin condition (for example, when the tactile information was acquired) estimated from the tactile log information.
The "second skin score" field stores a second skin score (an example of a second skin index). The second skin score indicates the skin condition in the future (for example, one week after the day on which the tactile information was obtained) estimated from the tactile log information and the tactile prediction information.

(2-6) Content Matching Table The content matching table of this embodiment will be described. FIG. 9 is a diagram showing the data structure of the content matching table of this embodiment.

The content matching table in FIG. 9 has a data structure showing the relationship between the skin evaluation and the content of two types of information (real-time information and one-time information) to be presented to the user.
The content matching table includes a 'reference score' field, a 'real-time content' field, and a 'one-time content' field.

The "reference score" field stores a reference score for identifying real-time content or one-time content.

The "real-time content" field stores a content ID that identifies real-time content that constitutes real-time information. Real-time content is, for example, text, images, audio, URLs (Uniform Resource Locators), or combinations thereof.
Real-time content includes, for example:
・Messages prompting immediate care ・Advice on care methods that should be taken immediately ・Advice on products suitable for care (for example, the URL of the website for purchasing the product)
・The first skin score that indicates the past skin condition

The "one-time content" field stores a content ID that identifies one-time content that constitutes one-time information. One-time content is, for example, text, images, audio, URLs, or combinations thereof.
One-time content includes, for example:
・Messages that encourage care actions before going to bed ・Advice on care methods that should be performed before going to bed ・Advice on products suitable for care (for example, the URL of the website for purchasing the product)
・Secondary skin score that indicates future skin condition

(2-7) Task Information Database The task information database of this embodiment will be described. FIG. 10 is a diagram showing the data structure of the task information database of this embodiment.

The task information database shown in FIG. 10 stores information (hereinafter referred to as "task information") regarding care actions to be performed by the user.
The task information database includes a "task ID" field, a "reference content" field, a "registration date and time" field, and an "end date and time" field. Each field is associated with each other. A task information database is associated with a user ID.

The "task ID" field stores a task ID that identifies task information.

The "reference content" field stores a content ID that identifies reference content (real-time content or one-time content) that serves as a reference for care behavior.

The "registration date and time" field stores information indicating the date and time when the task information was registered in the task information database.

The "end date and time" field stores information indicating the date and time when the care action corresponding to the task information ended. A code "NOT" means that the care action has not ended.

(3) Information processing Information processing according to the present embodiment will be described.

(3-1) Content Presentation Processing Content presentation processing according to the present embodiment will be described. FIG. 11 is a sequence diagram of content presentation processing according to the present embodiment. 12 to 14 are diagrams showing examples of screens displayed in the information processing of FIG. 11. FIG.

As shown in FIG. 11, the client device 10 acquires tactile information (S100).
Specifically, the processor 12 acquires tactile information from the tactile sensor 40 at regular intervals.
The processor 12 associates the tactile information with information indicating the execution date and time of step S100 (that is, the date and time when the tactile information was acquired) and stores them in the storage device 11 .
Processor 12 displays screen P100 (FIG. 12) on the display.

As shown in FIG. 12, a screen P100 includes a display object A100 and a button object B100.
The display object A100 displays tactile information acquired from the tactile sensor 40 (for example, vibration frequency, amount of unevenness, contact force, amount of deformation, and estimated value of friction).
The button object B100 is an object that receives a user instruction for starting a content request (S101).

After step S100, the client device 10 executes a content request (S101).
Specifically, when the user operates button object B<b>100 , processor 12 transmits content request data to server 30 .
Content request data includes the following information.
・User ID
- The tactile information acquired in step S100 (that is, the tactile information included in the display object A100)
・Information indicating the execution date and time of step S100

After step S101, the server 30 updates the database (S300) based on the content request data.

Specifically, processor 32 adds a new record to the tactile log information database (FIG. 5) associated with the user ID included in the content request data.
Each field in the new record contains the following information:
・“Tactile Log ID” field…New tactile log ID
・“Date and time” field: information indicating the execution date and time of step S100 included in the content request data ・“Vibration” field: vibration characteristic information included in the content request data ・“Unevenness” field: unevenness characteristic information included in the content request data・"Contact" field: Contact characteristic information included in the content request data ・"Deformation" field: Deformation characteristic information included in the content request data ・"Friction" field: Friction characteristic information included in the content request data ・"Adhesion" field . . . Adhesion characteristic information included in the content request data By this, the tactile information acquired in step S100 is recorded in the server 30. FIG.

After step S300, the server 30 performs skin condition estimation (S301).
Specifically, the processor 32 refers to the user information database (FIG. 4) to identify the estimation formula associated with the user ID included in the content request data.

The processor 32 determines whether the value of the "date and time" field in the record of the tactile log information stored in the tactile log information database updated in step S300 is included in a certain period (for example, one week) from the execution date of step S100. Identify a record (hereinafter referred to as a “tactile reference record”) that is
The processor 32 averages the values of the subfields (the "vibration" field, the "unevenness" field, the "contact" field, the "deformation" field, and the "friction" field) of the "tactile information" field of the tactile reference record. Calculate
The processor 32 calculates the first skin score by applying the calculated average value to the specified estimation formula.

The first skin score is calculated for each index below.
・Skin score for stratum corneum moisture content ・Skin texture score ・Skin color score ・Skin qualitative condition skin score ・Rough skin score ・Inflammation level skin score・Skin softness

The processor 32 acquires tactile sensation prediction information from the prediction information providing server 70 .
The processor 32 calculates the second skin score by applying the average value of the subfield values of the "tactile information" field of the tactile reference record and the tactile prediction information to the specified estimation formula. The second skin score is calculated for each index similar to the first skin score.

Processor 32 adds a new record to the skin evaluation log information database (FIG. 8) associated with the user ID included in the content request data.
Each field in the new record contains the following information:
・“Skin evaluation log ID”…New skin evaluation log ID
・“Date and time” field…Information indicating the execution date and time of step S100 ・“First skin score” field…First skin score ・“Second skin score” field…Second skin score

After step S301, the server 30 executes content selection (S302).
Specifically, processor 32 identifies the content ID corresponding to the first skin score calculated in step S301 by referring to the "reference score" field of the content matching table (FIG. 9). For example, in the case of the first skin score "30", the content ID "REAL001" associated with the reference score "20-39" is specified.
Processor 32 identifies the content ID corresponding to the second skin score calculated in step S301 by referring to the "reference score" field. For example, in the case of the second skin score "60", the content ID "ONE003" associated with the reference score "60-89" is identified.

After step S302, the server 30 executes a content response (S303).
Specifically, the processor 32 transmits content response data to the client device 10 .
The content response data contains the following information.
- The first skin score and the second skin score calculated in step S301 - The tactile information referred to in order to calculate the first skin score in step S301 - The information referred to in order to calculate the second skin score in step S301 Tactile log information Content ID specified in step S302 and content identified by the content ID (real-time content or one-time content)

After step S303, the client device 10 presents content (S102) based on the content response data.
Specifically, the processor 12 displays the screen P102 (FIG. 13) on the display.

The screen P102 includes display objects A102a-A102b and button objects B102a-B102d.

The display object A 102a displays a graph corresponding to at least part of the tactile log information included in the content response data (for example, a graph showing temporal changes in vibration characteristics, unevenness characteristics, contact characteristics, and deformation characteristics). .
The display object A102b displays the first skin score and the second skin score included in the content response data.

The button object B102a is an object that receives a user instruction for displaying the real-time content screen P104a (FIG. 14A).
The button object B102b is an object that receives a user instruction for displaying the one-time content screen P104b (FIG. 14B).
The button object B102c is an object that receives a user instruction to present a task (S111 in FIG. 15).
The button object B102d is an object that accepts user instructions for accessing a shopping site for purchasing care items that are useful when performing care according to real-time content or one-time content.

When the user designates button object B102a, processor 12 displays screen P104a (FIG. 14A) on the display.
The screen P104a includes a display object A104a and a button object B104a.

The display object A 104a displays the real-time content identified by the content ID included in the content response data.

The button object B104a is an object that receives a user instruction for notifying the server 30 that the care indicated by the real-time content displayed on the display object A104a has ended.

When the user designates button object B102b, processor 12 displays screen P104b (FIG. 14B) on the display.
The screen P104b includes a display object A104b and a button object B104b.

The display object A 104b displays the one-time content identified by the content ID included in the content response data.

The button object B104b is an object that receives a user instruction for notifying the server 30 that the care indicated by the one-time content displayed on the display object A104b has ended.

After step S102, the client device 10 executes the task update request (S103).

As a first example, when the user designates button object B 104 a ( FIG. 14A ), processor 12 transmits task update request data to server 30 .
The task update request data contains the following information.
・User ID
・Content ID of the real-time content displayed in the display object A 104a ・Information indicating the execution date and time of step S103

As a second example, when the user designates button object B 104b (FIG. 14B), processor 12 transmits task update request data to server 30 .
The task update request data contains the following information.
・User ID
- Content ID of one-time content displayed in display object A 104b
・Information indicating the execution date and time of step S103

After step S103, the server 30 updates the database (S304).
Specifically, processor 32 adds a new record to the task information database (FIG. 10) associated with the user ID included in the task update request data.
Each field in the new record contains the following information:
・"Task ID" field ... new task ID
・“Content ID” field: Content ID included in task update request data
・“Registration date and time” field: information indicating the execution date and time of step S103 included in the task update request data ・“End date and time” field: code “NOT”
As a result, the task specified by the user on the screen P104a or P104b (FIG. 14) is recorded in the server 30. FIG.

(3-2) Task Update Processing The task update processing of this embodiment will be described. FIG. 15 is a sequence diagram of task update processing according to the present embodiment. 16 is a diagram showing an example of a screen displayed in the information processing of FIG. 15. FIG.

As shown in FIG. 15, the client device 10 executes a task presentation request (S110).
Specifically, when the user designates the button object B 102 c ( FIG. 13 ), the processor 12 transmits task presentation request data to the server 30 .
The task presentation request data includes a user ID.

After step S110, the server 30 executes a task presentation response (S310).
Specifically, the processor 32 refers to the task information database (FIG. 10) associated with the user ID included in the task presentation request data, and searches for records in which the code "NOT" is stored in the "end date and time" field. Identify the task ID and content ID of (that is, a record in which task information about an unfinished task is stored).

The processor 32 transmits task presentation response data to the client device 10 .
The task presentation response data contains the following information.
・Task ID of unfinished task
- The content ID associated with the task ID of the unfinished task

After step S310, the client device 10 presents the task (S111).
Specifically, the processor 12 displays a screen P110 (FIG. 16) on the display based on the task presentation response data.

The screen P110 includes display objects A110a-A110b and button objects B110a-B110b.

The display objects A110a and A110b display the content identified by the content ID included in the task presentation response data.

The button objects B110a-B110b are objects that receive user instructions for notifying the server 30 of the end of the task corresponding to the content displayed in the display objects A110a-A110b, respectively. The button objects B110a-B110b are assigned task IDs associated with the content IDs that identify the content displayed on the display objects A110a-A110b, respectively.

After step S111, the client device 10 executes the task update request (S112).
Specifically, when the user designates the button object B 110 a ( FIG. 16 ), the processor 12 transmits task update request data to the server 30 .
The task update request data contains the following information.
・User ID
- Task ID assigned to the button object B110a specified by the user
・Information indicating the execution date and time of step S112

After step S112, the server 30 updates the database (S311).

Specifically, processor 32 identifies the task information database (FIG. 10) associated with the user ID included in the task update request data.
The processor 32 identifies a record including the task ID included in the task update request data from the identified task information database.
The processor 32 stores information indicating the execution date and time of step S112 included in the task update request data in the "end date and time" field of the specified record.

Processor 32 identifies the action log information database (FIG. 6) associated with the user ID included in the task update request data.
Processor 32 adds a new record to the identified action log information database.
Each field in the new record contains the following information:
・“Action log ID” field…New action log ID
・“Date and time” field: information indicating the execution date and time of step S112 included in task update request data ・“Action” field: task ID included in task update request data

As a result, the server 30 records the end of the task designated by the user on the screen P110 (FIG. 16) and the care action performed to end the task.

(3-3) Estimation Expression Correction Processing The estimation expression correction processing of the present embodiment will be described. FIG. 17 is a flowchart of processing for correcting an estimation formula according to this embodiment.

The process of FIG. 17 is executed after the user's user ID is registered in a dedicated measuring device (for example, a device located at a cosmetic store).

As shown in FIG. 17, the server 30 acquires measurement results (S320).
Specifically, when the user measures the reference value REF related to the skin condition using a dedicated measuring device (for example, a device located at a cosmetics store), the processor 32 obtains the user ID from the measuring device, A reference value REF is obtained.

After step S320, the server 30 uses Equation 1 to calculate a difference value (hereinafter referred to as "divergence value") D between the reference value REF and the skin score f (S321).
(Formula 1) D = |REF-f|

If the divergence value D calculated in step S321 is less than the predetermined threshold value Th (S322-NO), the process of FIG. 17 ends.

If the divergence value D calculated in step S321 is equal to or greater than the predetermined threshold value Th (S322-YES), the server 30 corrects the estimation formula (S323).
Specifically, the processor 32 changes the coefficients of the estimation formula (FIG. 4) associated with the user ID acquired in step S320 so that the divergence value D is less than the predetermined threshold Th.
Thereby, the estimation formula is adjusted for each user.

The processing of FIG. 17 is executed for each skin index.

(4) Modification A modification of the present embodiment will be described.

(4-1) Modification 1
Modification 1 will be described. Modification 1 is an example in which content presentation processing (FIG. 11) is executed using a combination of tactile log information (FIG. 5) and action log information (FIG. 6).

Specifically, the estimation formula of Modification 1 includes coefficients of user behavior and parameters determined according to behavior information.

In step S301 (FIG. 11), the processor 32 determines that the value of the "date and time" field in the record of the action log information database (FIG. 6) associated with the user ID included in the content request data is from the execution date of step S100. Records (hereinafter referred to as "behavior reference records") included in a certain period of time (for example, one week) are identified.
The processor 32 calculates from at least one of the "action" field, "start time" field, "end time" field, "calorie change amount" field, and "location information" field of the action reference record and the tactile sensation reference record. The first skin score is calculated by applying the average value to the estimation formula. The first skin score indicates the current skin condition estimated from the tactile log information and action log information.

The processor 32 acquires behavior prediction information from the prediction information providing server 70 .
The processor 32 calculates from at least one information of the “action” field, “start time” field, “end time” field, “calorie change” field, and “location information” field of the action reference record and the tactile sensation reference record. The second skin score is calculated by applying the calculated average value and the behavior prediction information to the estimation formula. The second skin score indicates the future skin condition estimated from the tactile log information, action log information, and action prediction information.

Real-time content and one-time content also include advice on user behavior.

According to Modification 1, the skin condition is estimated based on the tactile log information and the action log information. As a result, it is possible to provide content corresponding to a combination of the physical characteristics related to the tactile sensation of the user's skin and the user's behavior.

(4-2) Modification 2
Modification 2 will be described. Modification 2 is an example in which content presentation processing (FIG. 11) is executed using a combination of tactile log information (FIG. 5) and mind-body log information (FIG. 7).

Specifically, the estimation formula of Modification 2 includes the user's psychosomatic coefficients and parameters determined according to the psychosomatic log information.

In step S301 (FIG. 11), the processor 32 determines that the value of the "date and time" field in the record of the psychosomatic log information database (FIG. 7) associated with the user ID included in the content request data is from the execution date of step S100. A record (hereinafter referred to as a "mind-body reference record") included in a certain period of time (for example, one week) is identified.
The processor 32 applies at least one of the “pulse value” field, the “estrous cycle” field, and the “stress” field of the mind-body reference record and the average value calculated from the tactile reference record to the estimation formula, 1 Calculate the skin score. The first skin score indicates the current skin condition estimated from the tactile log information and the psychosomatic log information.

The processor 32 acquires the mind-body prediction information from the prediction information providing server 70 .
The processor 32 estimates at least one information of the “pulse value” field, the “estrous cycle” field, and the “stress” field of the mind-body reference record, the average value calculated from the tactile sensation reference record, and the mind-body prediction information. A second skin score is calculated by applying the formula. The second skin score indicates a future skin condition estimated from the tactile log information, the mind-body log information, and the mind-body prediction information.

Real-time content and one-time content also include the following information.
・Advice on the user's hormone balance ・Advice on the user's stress

According to Modification 2, the skin condition is estimated based on the combination of the tactile log information and the psychosomatic log information. As a result, it is possible to provide content according to the combination of the physical characteristics of the user's skin and the combination of the user's mind and body.

(4-3) Modification 3
Modification 3 will be described. Modification 3 is an example of estimating the future skin condition in consideration of the user's care behavior.

Specifically, the estimation formula of Modification 3 includes coefficients of user's care behavior and parameters determined according to task information.

In step S301 (FIG. 11), after calculating the average value, the processor 32 refers to the task information database (FIG. 10) associated with the user ID included in the content request data, and refers to the task information database (FIG. 10) within a certain period of time (for example, step A record (hereinafter referred to as "reference record") of one week before the execution date of S301 is specified.
The processor 32 calculates the second skin score by applying the information of the specified reference record (that is, the information on the care behavior within a certain period of time) and the calculated average value to the estimation formula.

According to Modification 3, the future skin condition is estimated in consideration of the user's care action history. This makes it possible to present a future skin condition suitable for each user.

(4-4) Modification 4
Modification 4 will be described. Modification 4 is an example of outputting the skin score to an external device other than the client device 10 .

Specifically, the server 30 is connected to a cosmetics production device that produces cosmetics based on the skin score. A plurality of cartridges are arranged in the cosmetics production device. Each cartridge contains a raw material or a mixture of a plurality of raw materials (hereinafter referred to as "cosmetics") that is a component of cosmetics. Raw materials are, for example, liquids, powders, solids, or combinations thereof.

At step S301 (FIG. 11), the processor 32 sends the first skin score and the second skin score to the cosmetic production device.

Based on at least one of the first skin score and the second skin score transmitted from the server 30, the cosmetics production device determines the amount of raw materials or cosmetics contained in each cartridge to be used.
The cosmetics production device extracts the determined usage amount of raw materials or cosmetics from each cartridge and provides them to the user.

According to Modified Example 4, it is possible to provide the user with cosmetics produced using raw materials or cosmetics according to the physical characteristics of the user's skin texture.

(4-5) Modification 5
Modification 5 will be described. Modification 5 is a modification of advice included in at least one of real-time content and one-time content.

At least one of the real-time content and the one-time content of Modification 5 further includes advice based on skin condition.

Specifically, the server 30 further estimates the skin condition in step S301 (FIG. 11). In this case, the server 30 further calculates a first skin score and a second skin score regarding the skin condition index.
The skin condition is, for example, skin balance. Skin balance is an indicator of skin health. Skin balance is derived from measurements of skin conditions (eg, stratum corneum, epidermis, dermis, and blood flow conditions).

The server 30 further selects content according to the skin condition in step S302. The skin-condition-based content includes skin-condition-based advice.

The client device 10 further presents the user U with advice based on the skin condition in step S102.

According to Modification 5, it is possible to provide the user with information according to the skin condition.

(4-6) Modification 6
Modification 6 will be described. Modification 6 is a modification of the tactile sensor 40 . FIG. 18 is a schematic diagram showing the configuration of a tactile sensor according to Modification 6. As shown in FIG.

A first example of the tactile sensor 40 of Modified Example 6 is the adhesive sensor 41 of FIG. 18A. The stickiness sensor 41 includes a base member 41a and a plurality of contacts 41b.

Each contact 41b can be extended and contracted with respect to the base member 41a. The plurality of contacts 41b are arranged in a matrix on the base member 41a. An adhesive substance may be applied to the surfaces of the plurality of contacts 41b. The plurality of contactors 41b are configured to detect the physical quantity of the skin SK with which they are in contact.

When the user's skin SK applies a downward (Y-direction) pressing force to the plurality of contacts 41b, the stickiness sensor 41 detects at least one of the following parameters based on the physical quantity detected by the contacts 41b. to generate an electrical signal indicative of
- Adhesive force of the skin (for example, a value estimated from spatiotemporal changes in the force generated when the skin SK is separated from the contactor 41b)
- Distribution of contact force (for example, distribution of contact force generated when the contactor 41b presses the skin SK)
- Contact area (for example, a value estimated from the number of contacts 41b that come into contact when the contact 41b presses the skin SK)

A second example of the tactile sensor 40 of Modified Example 6 is the softness sensor 42 of FIG. 18B. The softness sensor 42 includes a piezo vibrator 42a and a load cell 42b.

The piezo oscillator 42a acquires the following biological information when pressed against the user's skin SK.
Skin viscoelasticity (for example, a value estimated from the amount of pushing into the skin SK measured by the piezo oscillator 42a, the pushing speed, and the reaction force)
・An index of the flexibility of the surface of the skin SK (as an example, the frequency change amount of the surface of the skin SK measured by the piezo oscillator 42a)

The load cell 42b is configured to measure contact characteristics when the piezoelectric transducer 42a is pressed against the skin SK. The measured contact properties are an indicator of the overall flexibility of the skin SK. Contact forces include, for example, at least one of the following:
・Maximum value of contact force ・Hysteresis ・Stress relaxation ・Waveform characteristics

In addition, in the second example of the modification 6, the piezo vibrator 42a can be omitted. In this case, the load cell 42b is configured to measure the contact force when pressed directly against the skin SK.

A third example of the tactile sensor 40 of Modification 6 is a temperature sensor (not shown).
The temperature sensor is configured to measure skin temperature.

(4-7) Modification 7
Modification 7 will be described. Modification 7 is an example of a method of generating tactile prediction information by the prediction information providing server 70 .

The predictive information providing server 70 in FIG. 1 stores formulas for calculating the predictive value of the tactile sensation. This formula is a function of at least one of the following information:
・Tactile log information ・Action log information ・Body and mind log information

When the prediction information providing server 70 acquires the user ID from the client device 10 or the server 30, it refers to at least one of the following databases associated with the user ID.
・Tactile log information database (Fig. 5)
・Action log information database (Fig. 6)
・Mind-body log information database (Fig. 7)

The prediction information providing server 70 calculates the prediction value of the tactile sensation by applying the information of the referenced database to the calculation formula.

(5) Summary of this embodiment This embodiment will be summarized.

The first aspect of this embodiment is
A means for acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin (for example, a processor 32 that executes the processing of step S300),
Means (e.g., step A processor 32) that executes the process of S303,
It is an information processing device.

According to the first aspect, the condition of the skin is determined based on the physical properties related to the tactile sensation of the skin. As a result, it is possible to prevent variations in determination results that occur when a palpator determines the skin condition by palpation. As a result, the user can receive advice suitable for the skin through content (for example, at least one of real-time content and one-time content).

A second aspect of the present embodiment is
At least one of the first information and the second information includes advice on the user's skin care method, advice on products suitable for the user's skin care, advice on the user's hormone balance, and advice on the user's stress. An information processing apparatus including at least one.

According to the second aspect, at least one of advice regarding at least one of skin care methods, products suitable for skin care, hormone balance, and stress is presented. This allows the user to perform skin care according to more detailed advice.

The third aspect of this embodiment is
means for estimating the skin index of the user's skin condition based on the tactile log information (for example, the processor 32 that executes the process of step S301);
means for presenting the estimated skin index (for example, the processor 32 that executes the process of step S303);
It is an information processing device.

According to the third aspect, the skin index of the skin condition is presented based on the physical properties related to the tactile sensation of the skin. This allows the user to know an accurate skin condition.

The fourth aspect of this embodiment is
A means for acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin (for example, a processor 32 that executes the processing of step S300),
means for estimating a skin index of a skin condition based on tactile log information including a plurality of pieces of tactile information (for example, a processor 32 that executes the process of step S301);
means for presenting the estimated skin index (for example, the processor 32 that executes the process of step S303);
It is an information processing device.

According to the fourth aspect, a skin index is presented based on physical characteristics related to the tactile sensation of the skin. This allows the user to know an accurate skin condition.

The fifth aspect of this embodiment is
A means for acquiring action log information indicating a history of action information related to user actions,
The estimating means is an information processing device that estimates the skin index based on the tactile log information and the action log information.

According to the fifth aspect, a skin index based on a combination of physical characteristics related to skin tactile sensation and action logs is presented. As a result, the user can know the skin condition based on both the physical characteristics related to the tactile sensation of his/her own skin and his/her behavior.

A sixth aspect of the present embodiment is
Provided with means for acquiring mind-body log information related to the user's mind and body,
The estimating means is an information processing device that estimates the skin index based on the tactile sensation log information and the mind/body log information.

According to the sixth aspect, a skin index based on a combination of physical characteristics related to skin tactile sensation and mind-body log is presented. As a result, the user can know the physical characteristics related to the tactile sensation of his/her own skin and the skin condition based on both his/her mind and body.

The seventh aspect of this embodiment is
comprising means for obtaining tactile prediction information indicative of physical properties of future skin tactile sensation;
The estimating means is an information processing device that estimates the skin index based on the tactile sensation log information and the tactile sensation prediction information.

According to the seventh aspect, a skin condition based on a log and prediction of physical properties related to skin tactile sensation is presented. Thereby, the user can know the condition of the skin based on the past and future conditions of the physical properties related to the tactile sensation of the user's own skin.

The eighth aspect of the present embodiment is
the acquiring means acquires tactile information from a tactile sensor 40 configured to measure tactile information;
It is an information processing device.

A ninth aspect of the present embodiment is
The tactile information includes at least one of skin vibration characteristics, unevenness characteristics, contact characteristics, deformation characteristics, temperature, and skin friction characteristics.
It is an information processing device.

According to the tenth aspect of the present embodiment,
A client device 10 connectable to an information processing device (for example, a server 30),
equipped with a display
means for displaying the first information and the second information presented by the information processing device (e.g., server 30) on the display (e.g., processor 12 that executes the process of step S102);
It is a client device.

According to the eleventh aspect of the present embodiment,
It is a program for causing a computer (for example, processor 12 or 32) to function as each means described above.

(6) Other Modifications Other modifications will be described.

The storage device 11 may be connected to the client device 10 via the network NW. Storage device 31 may be connected to server 30 via network NW.

Each step of the information processing described above can be executed by either the client device 10 or the server 30 .

The tactile log information and the action log information may be acquired by modules built into the client device 10 .
The tactile log information, action log information, and mind/body log information may be acquired from an external server different from the server 30 .

In step S301, estimation of one of the first skin score and the second skin score can be omitted.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above embodiments. Also, the above embodiments can be modified and modified in various ways without departing from the gist of the present invention. Also, the above embodiments and modifications can be combined.

1: Information processing system 10 : Client device 11 : Storage device 12 : Processor 13 : Input/output interface 14 : Communication interface 15 : GPS module 30 : Server 31 : Storage device 32 : Processor 33 : Input/output interface 34 : Communication interface 40 : Tactile sensor 41 : Sticky sensor 42 : Softness sensor 50 : Log device 70 : Forecast information providing server

Claims (17)

comprising means for obtaining tactile information indicating physical properties relating to the tactile sensation of the user's skin;
means for presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of pieces of tactile information; prepared,
comprising means for estimating a skin index of the user's skin condition based on the tactile log information;
comprising means for presenting the estimated skin index;
comprising means for acquiring action log information indicating a history of action information related to the actions of the user;
the means for estimating estimates the skin index based on the tactile log information and the action log information;
Information processing equipment. At least one of the first information and the second information includes advice on the user's skin care method, advice on products suitable for the user's skin care, advice on the user's hormone balance, advice on the user's The information processing apparatus according to claim 1, comprising at least one of advice on stress and advice based on the user's skin condition. comprising means for obtaining tactile information indicating physical properties relating to the tactile sensation of the user's skin;
comprising means for estimating a skin index of skin condition based on tactile log information including a plurality of pieces of tactile information;
comprising means for presenting the estimated skin index;
comprising means for acquiring action log information indicating a history of action information related to the actions of the user;
the means for estimating estimates the skin index based on the tactile log information and the action log information;
Information processing equipment. comprising means for obtaining tactile information indicating physical properties relating to the tactile sensation of the user's skin;
means for presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of pieces of tactile information; prepared,
comprising means for estimating a skin index of the user's skin condition based on the tactile log information;
comprising means for presenting the estimated skin index;
comprising means for acquiring mind-body log information related to the user's mind and body,
The information processing apparatus, wherein the means for estimating estimates the skin index based on the tactile log information and the psychosomatic log information. comprising means for obtaining tactile information indicating physical properties relating to the tactile sensation of the user's skin;
comprising means for estimating a skin index of skin condition based on tactile log information including a plurality of pieces of tactile information;
comprising means for presenting the estimated skin index;
comprising means for acquiring mind-body log information related to the user's mind and body,
the means for estimating estimates the skin index based on the tactile log information and the psychosomatic log information;
Information processing equipment. comprising means for obtaining tactile prediction information indicative of physical properties of future skin tactile sensation;
6. The information processing apparatus according to claim 1, wherein said estimating means estimates said skin index based on said tactile sensation log information and said tactile sensation prediction information. 7. The information processing apparatus according to claim 1, wherein said acquiring means acquires said tactile information from a tactile sensor configured to measure said tactile information. The information according to any one of claims 1 to 7, wherein the tactile information includes at least one of vibration characteristics, unevenness characteristics, contact characteristics, deformation characteristics, adhesion characteristics, temperature, and friction characteristics of the skin. processing equipment. A client device connectable to the information processing device according to any one of claims 1 to 8,
equipped with a display
A client device comprising means for displaying on the display first information and second information presented by the information processing device. An information processing method using a computer,
obtaining tactile information indicative of physical properties of the tactile sensation of the user's skin;
a step of presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of pieces of tactile information; prepared,
estimating a skin index of the user's skin condition based on the tactile log information;
presenting the estimated skin index;
Acquiring action log information indicating a history of action information related to actions of the user;
The estimating step estimates the skin index based on the tactile log information and the action log information.
Information processing methods. An information processing method using a computer,
obtaining tactile information indicative of physical properties of the tactile sensation of the user's skin;
estimating a skin index of skin condition based on tactile log information including a plurality of tactile information;
presenting the estimated skin index;
Acquiring action log information indicating a history of action information related to actions of the user;
The estimating step estimates the skin index based on the tactile log information and the action log information.
Information processing methods. An information processing method using a computer,
obtaining tactile information indicative of physical properties of the tactile sensation of the user's skin;
a step of presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of pieces of tactile information; prepared,
estimating a skin index of the user's skin condition based on the tactile log information;
presenting the estimated skin index;
Obtaining mind-body log information about the user's mind and body,
The information processing method, wherein the estimating step estimates the skin index based on the tactile sensation log information and the mind-body log information. An information processing method using a computer,
obtaining tactile information indicative of physical properties of the tactile sensation of the user's skin;
estimating a skin index of skin condition based on tactile log information including a plurality of tactile information;
presenting the estimated skin index;
Obtaining mind-body log information about the user's mind and body,
The estimating step estimates the skin index based on the tactile log information and the mind-body log information.
Information processing methods. the computer,
Functioning as a means of acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin,
means for presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of tactile information; make it work,
function as means for estimating a skin index of the user's skin condition based on the tactile log information;
function as means for presenting the estimated skin index,
A program for functioning as means for acquiring action log information indicating a history of action information related to actions of the user,
the means for estimating estimates the skin index based on the tactile log information and the action log information;
program. the computer,
Functioning as a means of acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin,
Functioning as a means for estimating a skin index of a skin condition based on tactile log information including a plurality of tactile information,
function as means for presenting the estimated skin index,
A program for functioning as means for acquiring action log information indicating a history of action information related to actions of the user,
the means for estimating estimates the skin index based on the tactile log information and the action log information;
program. the computer,
Functioning as a means of acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin,
means for presenting at least one of first information relating to the user's skin condition based on the tactile information and second information relating to the user's skin condition based on tactile log information including a plurality of tactile information; make it work,
function as means for estimating a skin index of the user's skin condition based on the tactile log information;
function as means for presenting the estimated skin index,
A program for functioning as means for acquiring mind-body log information related to the user's mind and body,
A program in which the means for estimating estimates the skin index based on the tactile sensation log information and the psychosomatic log information. the computer,
Functioning as a means of acquiring tactile information indicating physical characteristics related to the tactile sensation of the user's skin,
Functioning as a means for estimating a skin index of a skin condition based on tactile log information including a plurality of tactile information,
function as means for presenting the estimated skin index,
A program for functioning as a means for acquiring mind-body log information related to the user's mind and body,
the means for estimating estimates the skin index based on the tactile log information and the psychosomatic log information;
program.

Images