WO2022118955A1 - Solution providing system - Google Patents

Abstract

This solution providing system comprises: a storing unit for storing information on multiple solutions for improving a user condition which is one or both of the emotion and fatigue condition of a user; a user information acquisition unit that acquires user information including information obtained from the body or motion of the user; a user condition information generation unit that generates user condition information on the basis of the information acquired from the body or motion; a solution determination unit that determines, out of the multiple solutions, a solution according to the user condition information; and a solution provision unit that provides the determined solution to the user.

Description

Solution provision system

The present invention relates to a system for providing a solution for improving a user's emotional or fatigued state.

Conventionally, a biological measuring device and a mental and physical state guidance device are known (see Patent Document 1 and Patent Document 2).

Japanese Unexamined Patent Publication No. 2018-197910 Japanese Unexamined Patent Publication No. 2020-62282

According to the invention of Patent Document 1, the state of the user is determined based on the pulse wave information obtained from the face image of the user taken by using near-infrared light, and a predetermined alarm is issued according to the state of the user. be able to.

Further, according to the invention of Patent Document 2, it is possible to specify the physical condition of the user from the biological information of the user and emit a stimulus for inducing a respiratory rhythm according to the physical condition.

It is conceivable to apply these techniques to a system that analyzes the user's emotions or fatigue, provides an appropriate solution according to the user's condition, and improves the user's condition.

The content of the solution that should be provided to the user in order to improve the user's condition greatly differs depending on the user's condition. Therefore, if a solution that is not suitable for the user's condition is provided, it may not be useful for improving the user's condition, but may even worsen it.

However, the technique of Patent Document 1 can only issue a predetermined alarm to the user, and the technique of Patent Document 2 can only issue a stimulus for adjusting the rhythm of breathing. Therefore, there is no mechanism that can provide an appropriate solution according to the user's emotions or fatigue.

Therefore, an object of the present invention is to provide a solution providing system that can analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

The solution providing system of the present invention is
A storage unit that stores information of multiple solutions that can be provided to the user to improve the user's emotional and / or fatigued state.
A user information acquisition unit that acquires user information including information obtained from the user's body or movement, and
A user state information generation unit that generates user state information indicating the user state of the user based on information acquired from the body or movement acquired by the user information acquisition unit.
A solution decision unit that determines a solution according to the user status information from the plurality of solutions,
It is characterized by comprising a solution providing unit that provides the determined solution to the user.

According to the present invention, the user information acquisition unit acquires user information including information obtained from the user's body or movement, and the user state information generation unit obtains the user's information based on the information acquired from the body or movement. User status information indicating the user status is generated.

Then, the solution decision department decides the solution according to the user status information from multiple solutions, and the solution provision department provides the decided solution to the user.

According to the present invention, a user can easily receive a solution according to his / her emotional or fatigue state only by having the system acquire information obtained from his / her body or movement.

In the solution providing system of the present invention
The solution providing system consists of a mobile terminal that can be carried by the user.
The mobile terminal preferably includes the user information acquisition unit, the solution providing unit, the storage unit, the user state information generation unit, and the solution determination unit.

There are various timings when users want to be provided with solutions to improve their own condition. Therefore, it is desirable to acquire the user's status using a portable terminal and easily receive the solution via the terminal.

According to the present invention, the user information acquisition unit of the mobile terminal acquires user information including information obtained from the user's body or movement, and the user state information generation unit obtains the information acquired from the body or movement. User status information indicating the user status of the user is generated.

Then, the solution determination department determines the solution according to the user status information from multiple solutions, and the solution provision department provides the determined solution to the user from the mobile terminal.

As described above, according to the present invention, it is possible to analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

In the solution providing system of the present invention
The solution providing system is configured to include a mobile terminal that can be carried by the user and a server.
The mobile terminal includes the user information acquisition unit and the solution providing unit.
The server includes the storage unit, the user state information generation unit, and the solution determination unit.
The user information acquisition unit acquires user information including information obtained from the user's body or movement, and transmits the user information to the server.
It is preferable that the solution determination unit determines a solution according to the user state information from the plurality of solutions and transmits the solution to the mobile terminal.

According to the present invention, the user information acquisition unit of the mobile terminal acquires user information including information obtained from the user's body or movement, and the user state information generation unit obtains the information acquired from the body or movement. User status information indicating the user status of the user is generated.

Then, the solution determination department determines the solution according to the user status information from multiple solutions, and the solution provision department provides the determined solution to the user from the mobile terminal.

Furthermore, since the analysis of user information and the decision of the solution are performed on the server, the load for processing on the mobile terminal can be reduced accordingly.

As described above, according to the present invention, it is possible to analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

In the solution providing system of the present invention
The mobile terminal includes a history storage unit that stores the solution provided to the user for a predetermined period or a predetermined number of times.
When the determined solution is stored in the history storage unit, the solution determination unit does not send the determined solution to the mobile terminal.
When the solution determined by the solution determination unit is stored in the history storage unit, the solution providing unit acquires the determined solution from the history storage unit and provides the solution to the user. Is preferable.

The user status is expected to improve gradually rather than rapidly. Therefore, in the last few times, it is expected that the solution provided to the user will be the same solution. According to the present invention, the information of the solution provided to the user is stored in the history storage unit of the mobile terminal for a predetermined period or a predetermined number of times.

If the solution determined by the solution determination unit is stored in the history storage unit, the solution determination unit does not send the solution to the mobile terminal, and the solution provider acquires the solution from the history storage unit. Since it is provided to the user, the amount of communication between the mobile terminal and the server is reduced, and the solution is promptly provided to the user.

In the solution providing system of the present invention
The user information acquisition unit acquires the user information again after the solution is provided to the user.
The user state information generation unit regenerates the user state information based on the information including the user information acquired after the solution is provided to the user.
It is preferable that the solution determination unit determines a solution according to the regenerated user state information.

As a result of providing the solution, it is expected that the user's emotional or fatigued state will change due to other reasons such as the passage of time. According to the present invention, after the solution is provided to the user, the user information is acquired again by the user information acquisition unit.

Then, the user state information is regenerated by the user state information generator based on the information including the user information acquired after the solution is provided to the user, and the solution decision unit responds to the regenerated user state information. The solution is decided.

According to the present invention, there is an increased possibility that an individualized solution according to a change in a user's emotion or fatigue state can be determined and provided to the user.

In the solution providing system of the present invention
The mobile terminal includes a display unit and has a display unit.
The solution determined by the solution determination unit includes display information including information for promoting a predetermined operation or an image for improving the user state according to the user state information.
It is preferable that the solution providing unit provides the display information to the user via the display unit.

Taking a predetermined action or viewing an image to improve the user's condition has the effect of relieving a person's tension and relieving fatigue, or activating the sympathetic nerve function to activate a person's tension. It has the effect of enhancing the feeling. It will be more effective if these are provided appropriately according to the user's condition.

According to the present invention, the solution determined by the solution determination unit includes information that promotes a predetermined operation or display information including an image for improving the user state according to the user state information, and thus the user's emotions. Alternatively, the fatigue state can be effectively improved.

In the solution providing system of the present invention
The user information acquisition unit acquires user information including an image of the user's skin as information obtained from the user's body or movement, and obtains user information.
It is equipped with a skin image analysis unit that analyzes the skin image included in the user information.
It is preferable that the user state information generation unit generates user state information indicating the user state of the user based on the result of analysis by the skin image analysis unit.

A person's emotions or fatigue also affect the condition of the skin. Therefore, by acquiring and analyzing the skin condition, it is possible to know the emotional or fatigued state of a person.

According to the present invention, a user can easily receive a solution according to his / her emotional or fatigue state simply by having the system acquire an image of the skin.

In the solution providing system of the present invention
The solution providing system consists of a mobile terminal that can be carried by the user.
The mobile terminal is equipped with an imaging unit and has an imaging unit.
It is preferable that the user information acquisition unit acquires user information including an image of the user's face via the imaging unit.

Since it is easy to acquire a face image, the user's resistance to acquiring the image is low. According to the present invention, a user can easily receive a solution according to his / her emotional or fatigue state by having a mobile terminal acquire an image of his / her face.

In the solution providing system of the present invention
A situation in which the user recognizes whether the user information acquisition unit is in the first situation to acquire the image of the skin of the user's finger or the second situation to acquire the image of the skin of the user's face. Equipped with a recognition unit
The user information acquisition unit acquires the user information including the image of the skin of the finger of the user when the user is in the first situation, and the user when the user is in the second situation. Acquire the user information including the image of the skin of the face of
The skin image analysis unit analyzes the image of the finger included in the user information when the user is in the first situation, and includes the user information when the user is in the second situation. It is preferable to analyze the image of the face.

There are various situations in which users who want to use the solution provision system are placed. For example, if you need to get an image of your skin, in some situations you may not want the user to get an image of your face, or you may want to get an image of your face but it is not in the right situation. Conceivable.

In such a case, according to the present invention, the user's emotion or fatigue state is accurately analyzed while changing the information to be acquired according to the user's situation, and the user's emotion or fatigue state is determined according to the user's emotion or fatigue state. It is possible to easily provide an appropriate solution.

In the solution providing system of the present invention
It is preferable that the situational awareness unit recognizes whether the user is in the first situation or the second situation based on the current time zone.

As a result, for example, a person who works in the daytime can use the image of the skin of the fingers at work during the daytime, and the image of the skin of the face at home during the nighttime before going to bed. You can know your feelings and fatigue.

As described above, according to the present invention, the user's emotion or fatigue state is accurately analyzed while changing the information to be acquired according to the time zone, and an appropriate solution according to the user's emotion or fatigue state can be easily obtained. Can be provided.

In the solution providing system of the present invention
The user information acquisition unit accepts input of user information including linguistic information which is one or both of characters and voice by the user as information obtained from the body or movement of the user.
It is equipped with a language information analysis unit that analyzes the language information included in the user information.
It is preferable that the user state information generation unit generates user state information indicating the user state of the user based on the result of analysis by the language information analysis unit.

A person's emotions or fatigue also affect their tendency to choose words. Therefore, the emotional or fatigued state of a person can be known by acquiring and analyzing the characters input by the person into the system and the voice emitted by the person.

According to the present invention, a user can easily receive a solution according to his / her emotional or fatigue state simply by inputting linguistic information which is one or both of characters and voice.

In the solution providing system of the present invention
The linguistic information analysis unit acquires information on the characteristics of the user information from the linguistic information, and obtains information about the characteristics of the user information.
It is provided with an autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit.
It is preferable that the user state information generation unit generates the user state information of the user based on the autonomic nerve balance information.

According to the present invention, user state information indicating one or both of the user's emotional state and fatigue state is generated based on the autonomic nervous balance based on the information naturally generated by the user, such as characters or voices input by the user. Therefore, it is more likely that the user state information indicates the user's natural state.

In the solution providing system of the present invention
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the user's autonomic nerve balance based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit is provided.
It is preferable that the user state information generation unit generates the user state information of the user based on the autonomic nerve balance information.

According to the present invention, since the user state information is generated based on the objective information of the autonomic nerve balance based on the information on the user's heartbeat, the reliability of the user state information is enhanced.

In the solution providing system of the present invention
The linguistic information analysis unit acquires characteristic words and phrases contained in the linguistic information as information related to the characteristics of the user information.
The user state information generation unit uses one or both of a dictionary corresponding to the phrase and the user state acquired by the language information analysis unit and a determination model that inputs the phrase and outputs the user state. Therefore, it is preferable that the user state information is configured to generate the autonomic nerve balance information of the user.

According to the present invention, characteristic words included in characters or voices input by the user are acquired by the language information analysis unit as information regarding the characteristics of the user information.

In the solution providing system of the present invention
When the user information includes voice, the language information analysis unit acquires the intonation of the voice as information regarding the characteristics of the user information.
The user state information generation unit uses one or both of a dictionary corresponding to the intonation and the user state acquired by the language information analysis unit and a determination model in which the intonation is input and the user state is output. Therefore, it is preferable that the user state information is configured to generate the autonomic nerve balance information of the user.

According to the present invention, the intonation of the voice input by the user by the language information analysis unit is acquired as information regarding the characteristics of the user information.

Then, one of the dictionary corresponding to one or both of the inflection and the user's emotion and fatigue state by the autonomic nerve balance acquisition unit, and one of the judgment models in which the inflection is input and one or both of the user's emotion and fatigue state are output. User status information is generated using or both.

According to the present invention, the user state information is generated by using the inflection of the voice emitted by the user himself, the correspondence dictionary between the inflection and the emotion, and / or the specific means of the judgment model of the emotion, etc. based on the inflection. Therefore, the accuracy of the user status information is improved.

In the solution providing system of the present invention
The linguistic information analysis unit acquires negative words and phrases contained in the linguistic information as information regarding the characteristics of the user information.
The solution determination unit is a corresponding dictionary of the negative phrase acquired by the language information analysis unit and a positive paraphrase phrase of the phrase or a paraphrase phrase having a lower degree of negativeness than the phrase. And, using one or both of the conversion models that input the negative phrase and output the positive paraphrase phrase of the phrase or the paraphrase phrase with a lower degree of negativeness than the phrase, the negative It is preferable to determine as the solution a positive paraphrase corresponding to a certain phrase or a phrase candidate for a paraphrase having a lower degree of negativeness than the phrase.

People who are depressed or tired tend to say negative words. Many negative words include positive paraphrases or paraphrases that are less negative than the words. If the user can be informed that there is such a paraphrase in a timely manner, the user can get into the habit of thinking positively, and the effect of improving the user's emotional or fatigue state can be expected.

According to the present invention, negative words included in the linguistic information input by the user by the linguistic information analysis unit are acquired as information regarding the characteristics of the user information.

Then, the solution determination unit inputs a corresponding dictionary of negative words and positive paraphrase words of words or paraphrase words with a lower degree of negativeness than the words, and positive words by inputting negative words. Use one or both of the conversion models that output a paraphrase word or a paraphrase word that is less negative than the word, and compare it to a positive paraphrase corresponding to the negative word or the word. Paraphrasing word candidates with a low degree of negativeness are determined as a solution.

According to the present invention, it is possible to inform the user in a timely manner that the negative words uttered by the user himself include positive paraphrases or paraphrases that are less negative than the words. , The effect of improving the user's emotions or fatigue can be expected.

In the solution providing system of the present invention
An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user using the user information, and an autonomic nerve balance acquisition unit.
A fatigue state information acquisition unit that acquires fatigue state information indicating the fatigue state of the user using the user information, and a fatigue state information acquisition unit.
Further prepare
It is preferable that the user state information generation unit generates the user state information of the user based on the combination of the autonomic nerve balance information and the fatigue state information.

According to the present invention, the user state information is generated based on the combination of the autonomic nerve balance information indicating the user's autonomic nerve balance and the fatigue state information indicating the user's fatigue state, so that the reliability of the user state information is reliable. Can be improved.

In the solution providing system of the present invention
The user information includes an image of the user's skin.
A skin image analysis unit that analyzes the skin image included in the user information,
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
Further prepare
The autonomic nerve balance acquisition unit acquires the autonomic nerve balance information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.
It is preferable that the fatigue state information acquisition unit acquires the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.

A person's fatigue condition also affects the condition of the skin. Therefore, by acquiring and analyzing the skin condition, it is possible to appropriately acquire information on the fatigue condition of a person. In addition, it is possible to acquire objective information called autonomic nerve balance based on the information on the user's heartbeat. Then, since the user state information is generated based on the combination of the autonomic nerve balance information and the fatigue state information, the reliability of the user state information can be further improved.

In the solution providing system of the present invention
The user information includes linguistic information that is one or both of characters and voice by the user and an image of the user's skin.
A language information analysis unit that analyzes the language information included in the user information,
A skin image analysis unit that analyzes the skin image included in the user information,
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
Further prepare
The autonomic nerve balance acquisition unit acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit.
It is preferable that the fatigue state information acquisition unit acquires the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.

It is possible to acquire objective information called autonomic nerve balance based on the information naturally generated by the user, such as characters or voices entered by the user himself / herself. A person's fatigue condition also affects the condition of the skin. Therefore, by acquiring and analyzing the skin condition, it is possible to appropriately acquire information on the fatigue condition of a person. Then, since the user state information is generated based on the combination of the autonomic nerve balance information and the fatigue state information, the reliability of the user state information can be further improved.

In the solution providing system of the present invention
It is preferable that the solution determination unit is configured to determine the solution that induces the user state into a relaxed state, a calm state, or an awakened state according to the user state information.

According to the present invention, the solution determination unit determines a solution that guides the user state to a relaxed state, a calm state, or an awakened state according to the user state information.

Thereby, according to the present invention, the user can be effectively guided to a relaxed state, a calm state, or an awakened state.

Thus, according to the present invention, there is an appropriate solution for analyzing a user's emotion or fatigue state and inducing a relaxed state, a calm state, or an awake state according to the user's emotion or fatigue state. Can be provided easily.

In the solution providing system of the present invention
A desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided.
It is preferable that the solution determination unit is configured to determine the solution that guides the user state toward the state indicated by the desired state information based on the user state information and the desired state information.

According to the present invention, it is possible to effectively induce a state of emotion desired by the user or a state of recovery from fatigue.

In the solution providing system of the present invention
The solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state.
It is preferable that the solution determination unit is configured to determine the vibration cycle based on the user state information and the desired state information.

The predetermined periodic vibration has the effect of inducing a person's emotions to a calm state or in a direction of recovering from a fatigued state.

According to the present invention, it is possible to provide an effective solution including periodic vibration that can effectively induce the emotion or fatigue state desired by the user.

In the solution providing system of the present invention
A desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided.
The solution determined by the solution determination unit includes a predetermined periodic vibration.
The solution determination unit determines the cycle at the start of the vibration based on the information on the heartbeat, and the pattern of change of one or both of the cycle and the intensity after the start of the vibration based on the desired state information. It is preferable that it is configured to determine.

The predetermined periodic vibration has the effect of inducing a person's emotions to a calm state or in a direction of recovering from a fatigued state. In particular, it is more effective to change the cycle at the start of vibration and the cycle and intensity of vibration after the start of vibration according to the state of a person's heartbeat.

According to the present invention, it is possible to effectively induce the emotion or fatigue state desired by the user according to the heartbeat of the user.

In the solution providing system of the present invention
The storage unit stores reference state information indicating a reference of a state in which one or both of the user's emotional or fatigue states are improved.
It is preferable that the solution determination unit is configured to determine the solution that guides the user state toward the state indicated by the reference state information based on the user state and the reference state information.

According to the present invention, the user can be effectively guided to the emotional or fatigued state indicated by the reference state information.

In the solution providing system of the present invention
The solution determined by the solution determination unit is preferably a passive stimulus to the user's sense of touch, hearing or smell.

If the solution provided by the system is a solution that requires the user to take active action, it causes the effort associated with receiving the solution from the user, and rather causes emotional offense and accumulation of fatigue. It is not desirable because it will end up.

As described above, according to the present invention, it is possible to easily provide a solution that analyzes a user's emotion or fatigue state and is appropriate according to the user's emotion or fatigue state and does not cause labor to the user.

In the solution providing system of the present invention
The solution determined by the solution determination unit is preferably a stimulus of music, reading voice, and vibration.

Reading voice and predetermined periodic vibration have the effect of activating the function of the parasympathetic nerve, relieving the tension of the person, and relieving fatigue. In addition, music has the effect of relieving a person's tension or activating the function of the sympathetic nerve to increase the person's tension. Proper combination of these will be more effective.

According to the present invention, the solution determined by the solution determination unit is a stimulus of music, reading voice, or any or a combination of vibrations.

According to the present invention, by providing the solution to the user as a stimulus of music, reading voice, or any or combination of vibrations, the user's emotional or fatigued state can be more effectively improved.

In the solution providing system of the present invention
The mobile terminal includes a vibration generating unit, and the solution determined by the solution determining unit includes vibration according to the user state information.
It is preferable that the solution providing unit provides the vibration to the user via the vibration generating unit.

Vibration with a predetermined cycle has the effect of relieving a person's tension and relieving fatigue.

According to the present invention, since the solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state of the user, the emotional or fatigue state of the user can be effectively improved. ..

In the solution providing system of the present invention
The mobile terminal includes a scent generator and has a scent generator.
The solution determined by the solution determination unit contains a predetermined scent according to the user status information.
It is preferable that the solution providing unit provides the predetermined scent to the user via the scent generating unit.

The prescribed scent has the effect of relieving a person's tension and relieving fatigue.

According to the present invention, the solution determined by the solution determination unit contains a predetermined scent according to the user state of the user, so that the emotional state or fatigue state of the user can be effectively improved.

In the solution providing system of the present invention
The mobile terminal includes an audio reproduction unit and has an audio reproduction unit.
The solution determined by the solution determination unit includes a human voice, a natural sound, or a voice including music according to the user state information.
It is preferable that the solution providing unit provides the voice to the user via the voice reproducing unit.

Human voices and natural sounds have the effect of activating the function of the parasympathetic nerves, relieving the tension of the person, and relieving fatigue. In addition, music has the effect of relieving a person's tension or activating the function of the sympathetic nerve to increase the person's tension. It will be more effective if these are provided in an appropriate combination according to the user's condition.

According to the present invention, abundant voice solutions can be appropriately combined according to the user's condition to more effectively improve the user's emotional or fatigued state.

In the solution providing system of the present invention
The user information acquisition unit acquires information indicating the heartbeat of the user as the user information, and obtains information indicating the heartbeat of the user.
The user state information generation unit has a heartbeat recognition unit that recognizes the tempo of the user's heartbeat as the user state information from the information indicating the user's heartbeat.
The solution determination unit has a stimulus content determination unit that determines a tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit as the solution, which is the tempo of the stimulus provided to the user. Ori,
As the solution, the solution providing unit preferably has a stimulus generating unit that generates the stimulus at a tempo determined by the stimulating content determining unit toward the user.

According to the research of the inventor, it was found that the effect of improving the physical and mental condition of the user is high by generating a stimulus consisting of a tempo vibration synchronized with the tempo of the user's heartbeat toward the user. In particular, the effect of improving the work efficiency of the user, the fatigue state, and the ease of introducing sleep (hereinafter referred to as "user state") is high.

According to the present invention, since a stimulus consisting of a tempo vibration synchronized with the tempo of the user's heartbeat is generated toward the user, it is possible to effectively improve the physical and mental condition of the user.

In the solution providing system of the present invention
The stimulus generated by the stimulus generator consists of a combination of vibration and sound.
The sound is a human voice, natural sound or music,
It is preferable that the stimulus content determining unit determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit as the tempo of the vibration and the sound included in the stimulus provided to the user. ..

According to the research of the inventor, it was found that the user condition can be improved more effectively by providing the combination of vibration and sound as a stimulus, which has a tempo synchronized with the tempo of the heartbeat.

According to the present invention, the stimulus generated by the stimulus generator consists of a combination of vibration and sound, and the tempo of the vibration and sound is synchronized with the tempo of the heartbeat, so that the user state can be improved more effectively.

In the solution providing system of the present invention
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve, the tempo changes so as to be delayed from the start time to the end time of the stimulus. It is preferable that it is configured to determine.

Alternatively, in the solution providing system of the present invention.
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. It is preferable that it is configured to determine.

According to the inventor's research, the stimulus is started at a tempo that is synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to slow down if the user is in a predominant state of the sympathetic nerve, or the user. It was found that when the sympathetic nerve is in a predominant state, changing the tempo of the stimulus so as to increase the tempo of the stimulus has a high effect of improving the user state.

According to the present invention, the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower when the user is in a predominant state of the sympathetic nerve, or the user When the parasympathetic nerve is in a predominant state, the tempo of the stimulus is changed to be faster, so that the user state can be effectively improved.

In the solution providing system of the present invention
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in a balanced state, it determines that the tempo is maintained from the start time to the end time of the stimulus. It is preferable that it is configured as such.

According to the inventor's research, when the user's autonomic nervous system is in a balanced and moderate state, the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the stimulation is continued at the same tempo. It turned out that the effect of improving the user condition is high.

According to the present invention, the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then, if the state of the user's autonomic nerves is in a balanced state, the stimulation is continued at the same tempo. The user condition can be effectively improved.

In the solution providing system of the present invention
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is a predominant state of the parasympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. Is preferable.

Alternatively, in the solution providing system of the present invention.
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is a predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be faster from the start time to the end time of the stimulus. Is preferable.

According to the research of the inventor, the stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo is changed to be faster, so that the user is easily guided to the state where the sympathetic nerve is dominant, and the user state is improved. It turned out to be more effective.

In addition, by starting the stimulus at a tempo synchronized with the tempo of the user's heartbeat and then changing the tempo so as to slow down, the user can be easily guided to a state in which the parasympathetic nerve is dominant, and the effect of improving the user state is enhanced. I found out.

According to the present invention, if the desired state specified by the user is a state in which the sympathetic nerve is dominant, a stimulus that starts at a tempo synchronized with the tempo of the user's heartbeat and then changes so as to become faster is a stimulus. Since it is generated toward, the user can be effectively guided to a state in which the sympathetic nerve is dominant. Alternatively, if the desired state specified by the user is a state in which the parasympathetic nerve is dominant, a stimulus that changes so as to slow down the tempo after the start is generated toward the user, so that the user is in a state in which the parasympathetic nerve is dominant. It can be effectively induced.

Therefore, it is possible to induce the user to the desired state and effectively improve the user state.

In the solution providing system of the present invention
The user status information generation unit is
The desired state receiving unit that accepts the designation of the desired state indicating the state desired by the user by the user, and the desired state receiving unit.
The autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve,
Have and
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
The desired state received by the desired state receiving unit is a state in which work efficiency is high or fatigue is recovered.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. Decide,
When the state of the user's autonomic nerve is recognized as the predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. It is preferable to have.

According to the research of the inventor, the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower when the sympathetic nerve is dominant, so that the parasympathetic nerve is dominant. In some cases, changing the tempo of the stimulus to a higher speed was found to be highly effective in improving the physical and mental condition of the user, especially in improving work efficiency and fatigue.

According to the present invention, when a state of high work efficiency or a state of recovery from fatigue is specified as a desired state, stimulation is started at a tempo synchronized with the tempo of the user's heartbeat, and then the user has a predominance of sympathetic nerves. When the user is in a state of predominance of parasympathetic nerves, the tempo of the stimulus is changed to be slower, and when the user is in a predominant state of the parasympathetic nerve, the tempo of the stimulus is changed to be faster. Can be improved.

In the solution providing system of the present invention
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is in a state in which sleep is easily introduced, the tempo change is determined so as to be delayed from the start time to the end time of the stimulus. It is preferable to have.

The inventor's research found that starting the stimulus at a tempo synchronized with the tempo of the user's heartbeat and then changing the stimulus tempo to slow down is highly effective in inducing sleep. ..

According to the present invention, when a state in which sleep is easily introduced is specified as a desired state, the stimulus is started at a tempo synchronized with the tempo of the user's heartbeat, and then the tempo of the stimulus is changed to be slower. It can effectively make it easier for users to introduce sleep.

In the solution providing system of the present invention
The stimulus content determination unit
When determining the change so that the tempo becomes slower from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or higher than the predetermined lower limit value is the tempo at the end time of the stimulus. It is preferably configured to determine.

Alternatively, in the solution providing system of the present invention.
The stimulus content determination unit
When determining the change so that the tempo becomes faster from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or less than the predetermined upper limit value is the tempo at the end time of the stimulus. It is preferably configured to determine.

According to the research of the inventor, it was found that there is a lower limit to the tempo change that can effectively improve the user's condition when the vibration tempo is changed to be slower than the user's heartbeat tempo.

Similarly, even when the tempo of vibration is changed to be faster than the tempo of the user's heartbeat, it was found that there is an upper limit to the tempo change that can effectively improve the user's condition.

According to the present invention, when the tempo is changed to be slower, the tempo at a speed equal to or higher than the lower limit is set as the tempo at the end of the stimulus, or when the tempo is changed to be faster, the tempo is equal to or less than the upper limit. Since the tempo of speed is set as the tempo at the end of the stimulus, the user condition can be effectively improved.

In the solution providing system of the present invention
The desired state includes a state in which sleep is easily introduced and a state in which work efficiency is high or fatigue is recovered.
The stimulus content determination unit
The length of the stimulus when the desired state received by the desired state receiving unit is a state in which sleep is easily introduced, rather than the length of the stimulus when the desired state is a state with high work efficiency or a state in which fatigue is recovered. It is preferable to determine the length of the stimulus so that the stimulus is long.

According to the research of the inventor, the length of the stimulus to make the user work efficiently or recover from fatigue is effective in a relatively short time of about 2 minutes, and it is easy to introduce the user to sleep. It was found that it is more effective to give a stimulus for a longer period of time than the stimulus for achieving a state of high work efficiency or a state of recovery from fatigue.

According to the present invention, the length of the stimulus when the desired state is a state where the work efficiency is high or the state where the fatigue is recovered is larger than the length of the stimulus when the state where sleep is easily introduced is determined by the stimulus content determining unit. Since the length of the stimulus is determined to be longer, it is possible to make the user more effective in introducing sleep.

In the solution providing system of the present invention
The stimulus content determination unit
The change in tempo was determined so as to be gradually delayed from the start time to the end time of the stimulus.
Moreover, the length of time for generating the stimulus at the tempo at the end of the stimulus is longer than the length of the time for generating the stimulus at the tempo of each stage before changing to the tempo at the end of the stimulus. , It is preferable to determine the change in the tempo.

According to the research of the inventor, the tempo of the stimulus is gradually slowed down from the start point to the end point, and the stimulus is generated at the tempo of each stage before the tempo is changed to the tempo at the end point of the stimulus. It was found that increasing the length of time during which the stimulus is generated at the tempo at the end of the time rather than the length of each time makes it easier for the user to introduce sleep more effectively.

According to the present invention, the stimulus content determination unit determines the tempo change so that the tempo gradually slows down from the start point to the end point of the stimulus, and before the tempo is changed to the tempo at the end point of the stimulus. The tempo change is determined so that the length of time to generate the stimulus at the end tempo is longer than the length of each time to generate the stimulus at the step tempo. Therefore, it is possible to make the user more effective in introducing sleep.

In the solution providing system of the present invention
The user information acquisition unit has an input unit that accepts information input by the user, and acquires the user information via the input unit.
It is preferable that the user state information generation unit generates the user state information based on the user information acquired by the user information acquisition unit.

According to the present invention, the user information is acquired as the information input by the user himself / herself, and the user status information is generated based on the user information, so that the user status can be appropriately grasped.

In the solution providing system of the present invention
The user information acquisition unit
A display unit that displays information and
An image pickup unit that captures an image of the user's face,
The image of the user's face captured by the imaging unit is displayed on the display unit, and information on a question regarding the state of a predetermined portion of the user's face displayed on the display unit and information on the user's face are displayed. An output control unit that displays on the display unit information that prompts the input of emotional information indicating the content of the emotion that the user has for the image.
An input receiving unit that receives information on answers to the question and input of the emotional information via the input unit while the image of the user's face captured by the imaging unit is displayed on the display unit. Has more,
The user state information generation unit acquires, as the user state information, a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotion information. It is preferable to have a subjective fatigue state information acquisition unit.

According to the present invention, a predetermined user's face displayed on the display unit via the input unit while the image of the user's face captured by the imaging unit is displayed on the display unit by the input receiving unit. Information on the answer to the question regarding the state of the part of the user and emotional information indicating the content of the emotion that the user has with respect to the image of the user's face are accepted.

The user's face clearly shows the user's fatigue. Therefore, as in the present invention, the solution providing system effectively grasps the user's understanding of the fatigue state by letting the user input the answer to the question about the state of a predetermined part of the face while showing his / her face. be able to.

Then, the subjective fatigue state information acquisition unit acquires a value indicating the degree of the subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotional information.

As a result, not only the answer to the question about the state of a predetermined part of the face, but also the emotional information indicating the content of the emotion that the user has with respect to the image of the user's face is taken into consideration, and the subjective feeling of the user is taken into consideration. It is possible to obtain the analysis result of the degree of fatigue. Therefore, it is possible to enhance the user's satisfaction with the analysis result of the fatigue state.

Furthermore, these actions provide the user with an experience of getting a bird's-eye view of the fatigue state from various angles including self-awareness while looking at his / her face, which in turn improves the consciousness of taking care of himself (self-care consciousness). Can also be brought.

In this way, we have improved the conventional system that analyzes the user's fatigue state by using the answers to the questions about the facial condition, and provided emotional information that shows the content of the emotion that the user has with respect to the image of the user's face. By controlling the computer to analyze the user's fatigue state using the above, it was possible to improve the system so that the analysis result of the value indicating the degree of fatigue state that is highly convincing to the user can be obtained. This is the effect of the present invention.

According to the research by the inventors, as information for prompting the input of emotional information, words of encouragement or comfort suitable for improving the fatigue state recognized by the user himself / herself are used for the user displayed on the display unit. It was found that by analyzing the user's subjective fatigue state by using the information of the words that the user wants to say as emotional information, there is an effect of increasing the user's conviction with the analysis result of the fatigue state.

Therefore, in the solution providing system of the present invention,
The output control unit is a word of encouragement or comfort that is suitable for improving the fatigue state that the user himself / herself is aware of for the user displayed on the display unit as information for prompting the input of the emotion information. It is preferable that the display unit is configured to display information prompting the input of information.

According to the present invention, as information for prompting the input of emotional information, information of words of encouragement or comfort suitable for improving the fatigue state recognized by the user himself / herself to the user displayed on the display unit can be input. The fatigue state that gives the user a higher sense of conviction because the information of the word is used (the emotional information about the fatigue state that the user himself / herself is aware of) to analyze the user's subjective fatigue state. The analysis result of can be surely obtained.

In the solution providing system of the present invention
The solution determination unit causes the user to recognize the information obtained by combining the value indicating the degree of the user's subjective fatigue state and the emotional information, and the user's subjective fatigue state, or the user's subjective state. A decision unit that determines the fatigue recognition improvement information corresponding to the combined information as the solution by referring to the information indicating the correspondence between the fatigue recognition improvement information consisting of the information for improving the fatigue state and the information indicating the correspondence relationship. Have and
It is preferable that the output control unit is configured to output the fatigue recognition improvement information to the user as the solution.

According to the present invention, the determination unit determines fatigue recognition improvement information, which is information consisting of information for making the user recognize the user's subjective fatigue state or improving the user's subjective fatigue state. The output control unit outputs the determined fatigue recognition improvement information to the user.

As in the present invention, the degree of subjective fatigue is determined from the information of the question regarding the state of a predetermined part of the face and the emotional information indicating the content of the emotion that the user has with respect to the image of the user's face. Multifaceted analysis of the indicated values has the advantage of being able to accurately recognize the user's subjective fatigue state.

On the other hand, if the accuracy of the user's recognition of the fatigue state is increased, the emotional information cannot be directly reflected in the determination of the fatigue recognition improvement information, and the user is satisfied with the fatigue recognition improvement information provided to the user. You may not get a good feeling.

Therefore, the determination unit is configured to combine emotional information with a value indicating the degree of the user's subjective fatigue state to determine fatigue recognition improvement information corresponding to the combination.

That is, even if the value indicating the degree of subjective fatigue state felt by the user is the same, different fatigue recognition is performed depending on the content of the input emotion information (for example, positive content, pessimistic content, etc.). Improvement information can be determined.

This makes it possible to determine fatigue recognition improvement information that is close to the user's feelings and is highly convincing to the user, without impairing the advantage of being able to accurately recognize the user's subjective fatigue state.

In the solution providing system of the present invention
The determination unit includes a first comment including information on a combination of a value indicating the degree of the user's subjective fatigue state and the emotional information, and verbal information indicating the user's subjective fatigue state. The first comment corresponding to the information of the combination is determined as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of the above.
It is preferable that the output control unit is configured to output the first comment determined by the determination unit to the user.

According to the present invention, the determination unit determines the first comment indicating the user's subjective fatigue state, and the output control unit outputs the first comment to the user.

It should be noted that acquiring multiple pieces of information on the user's subjectivity and analyzing them from various angles has the advantage of being able to accurately recognize the user's subjective fatigue state.

On the other hand, the emotional information cannot be directly reflected in the decision of the first comment only by increasing the accuracy of the user's recognition of the fatigue state, and the user is convinced of the first comment provided to the user. You may not get a good feeling.

Therefore, the determination unit further combines emotional information with a value indicating the degree of subjective fatigue of the user, and determines the first comment according to the combination.

As a result, even if the subjective fatigue level value felt by the user is the same, a different first comment can be determined according to the content of the input emotion information, so that the user's feelings can be determined. It is possible to reliably obtain comments that are close to each other and give the user a high level of conviction.

Even when the subjective fatigue state is low, it is possible that the objective fatigue state is high. Or conversely, it is possible that the subjective fatigue is high, but the objective fatigue is not. Therefore, it is more desirable to be able to analyze not only the subjective fatigue state but also the objective fatigue state and present both analysis results to the user.

Therefore, in the solution providing system of the present invention,
The user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of objective fatigue of the user as the user state information, which is calculated by a predetermined method.
The determination unit refers to information indicating a correspondence relationship between a value indicating the degree of objective fatigue of the user and a second comment consisting of verbal information indicating the objective fatigue state of the user. , The second comment corresponding to the value indicating the objective degree of fatigue of the user is configured to be determined as the fatigue recognition improvement information.
It is preferable that the output control unit is configured to output the second comment determined by the determination unit to the user.

According to the present invention, not only the subjective fatigue state but also the objective fatigue state can be analyzed and both analysis results can be presented to the user, so that the user can present his / her own subjective fatigue state. And an objective fatigue state can be recognized at the same time.

The state of the user's heart rate is closely related to the state of the user's objective fatigue, and in particular, the autonomic nervous balance obtained from the state of the heart rate is the state of the user's objective fatigue. It really appears.

Therefore, in the solution providing system of the present invention,
The objective fatigue state information acquisition unit acquires information on the user's heart rate by a predetermined method, and the heart rate state information indicating the state of the user's heart rate derived from the information on the heart rate and the autonomic nerve of the user. The autonomic nerve balance information indicating the balance is acquired, and the value indicating the objective degree of fatigue of the user is acquired based on the heart rate state information and the autonomic nerve balance information.
The determination unit includes a second comment consisting of information on a combination of a value indicating the degree of objective fatigue of the user and the autonomic nerve balance information, and information on words indicating the objective fatigue state of the user. It is configured to determine the second comment corresponding to the information of the combination as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of.
It is preferable that the output control unit is configured to output the second comment determined by the determination unit to the user.

According to the present invention, a second comment indicating an objective fatigue state of the user is determined by the determination unit, and is output to the user by the output control unit.

As in the present invention, a plurality of information regarding the user's objective fatigue state, such as heart rate state information indicating the user's heart rate state and autonomic nerve balance information indicating the user's autonomic nerve balance, is acquired from various angles. The analysis has the advantage that the user's objective fatigue state can be accurately recognized.

On the other hand, if the accuracy of the user's objective recognition of the fatigue state is increased, the autonomic nerve balance information cannot be directly reflected in the decision of the second comment, and is provided to the user. There is a possibility that you will not be fully satisfied with the comment in 2.

Therefore, the decision-making unit decides the second comment according to the combination of the value indicating the degree of objective fatigue of the user and the autonomic nervous balance.

That is, even if the user's objective fatigue level is the same, a different second comment can be determined according to the state of the autonomic nervous balance in which the user's objective fatigue state clearly appears.

This makes it possible to reliably obtain comments that give the user a high sense of conviction, which was obtained by emphasizing the autonomic nervous balance based on specific information such as the user's heart rate.

In the solution providing system of the present invention
The user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of the user's objective fatigue state as the user state information, which is calculated by a predetermined method.
The storage unit stores a plurality of improved contents, which are information for improving the subjective fatigue state and the objective fatigue state of the user, as the plurality of solutions.
The determination unit is information indicating a correspondence relationship between the combination information of a value indicating the degree of subjective fatigue state of the user and a value indicating the degree of objective fatigue state of the user and the improved content. With reference to, the improvement content corresponding to the information of the combination is determined as the fatigue recognition improvement information.
It is preferable that the output control unit is configured to output the improved content determined by the determination unit to the user.

According to the present invention, the determination unit determines the improvement content, which is information for improving the user's subjective and objective fatigue state, and outputs it to the user, so that the user's fatigue state is effective. Can be improved.

In addition, the improvement content acquires a plurality of information related to the user's subjectivity, such as question information regarding the state of a predetermined part of the face and emotional information indicating the content of the emotion that the user has with respect to the image of the user's face. A value indicating the degree of the user's subjective fatigue state recognized by multifaceted analysis, heartbeat state information, and autonomic nerve balance information, which are multiple pieces of information regarding the user's objective fatigue state, are acquired. Since it is determined according to the combination with the value indicating the degree of the user's objective fatigue state recognized by the multifaceted analysis, it is possible to surely determine the improved content that gives the user a high sense of conviction. can.

In the solution providing system of the present invention
The improved content consists of a combination of vibration and / or sound and verbal information.
The sound is a human voice, natural sound or music,
The decision-making part
When the value indicating the degree of the user's subjective fatigue state indicates that the user's subjective fatigue state is worse than the predetermined first criterion, the user's subjective fatigue state. Determine the information of the above words to improve,
When the value indicating the degree of the user's objective fatigue state indicates that the user's objective fatigue state is worse than the predetermined second criterion, the user's objective fatigue state. It is preferable that it is configured to determine the information of the above-mentioned words for improving.

According to the present invention, the improved content determined according to the combination of the value indicating the degree of subjective fatigue state of the user and the value indicating the degree of objective fatigue state is one or both of vibration and sound. It consists of a combination with verbal information.

As a result, the improvement content consists of abundant information rather than the improvement content consisting of only one or both of the vibration and the sound. Therefore, it is possible to provide the user with the improvement content capable of more effectively improving the user's fatigue state. can.

Further, in the solution providing system of the present invention,
The decision-making part
By referring to the information indicating the correspondence between the emotional information and the information of words for improving the subjective fatigue state of the user, the subjective fatigue state of the user corresponding to the emotional information is improved. Determine the verbal information to do,
Correspondence between the autonomic nerve balance information indicating the autonomic nerve balance of the user derived from the information on the heartbeat of the user acquired by a predetermined method and the information of words for improving the objective fatigue state of the user. It is preferable that the information indicating the relationship is referred to to determine the verbal information for improving the objective fatigue state of the user corresponding to the autonomic nerve balance information.

According to the present invention, even when the determination unit determines the information of words that determine the user's fatigue state to be worse than a predetermined criterion, even if the degree of the user's fatigue state is the same. Information in different words can be reliably determined according to the content of emotional information or autonomic nerve balance information.

In the solution providing system of the present invention
The mobile terminal includes an image pickup unit, a display control unit, a display unit, a response reception unit, and an input unit.
The user information acquisition unit acquires user information including an image of the user's face via the imaging unit.
The display control unit displays an image of the user's face captured by the imaging unit on the display unit, and correlates with the emotion or fatigue state appearing on the user's face displayed on the display unit. Display a question about the condition of the face on the display,
The input unit is arranged at a position where the user can operate while looking at the image of the user's face displayed on the display unit and the question.
The answer receiving unit receives the input of the answer by the user to the question about the face condition of the user via the input unit in a state where the image of the face is displayed on the display unit.
It is preferable that the user state information generation unit generates the user state information based on the information including the answer.

The user's emotions and fatigue are clearly shown on the user's face.

According to the present invention, since the user answers the question about the condition of the face while looking at his / her own face, the answer is easy. The question is a question that has a correlation with the emotion or fatigue state appearing on the user's face. In addition, since you will have the opportunity to calmly look back on your facial condition, you will be promoted to be aware of the facial condition that is closely related to your emotions or fatigue, and you may be able to answer your facial condition accurately. It will increase.

Further, according to the present invention, the user can easily receive an individualized solution according to his / her emotional or fatigued state by getting the answer regarding the facial image and the facial condition.

As described above, according to the present invention, it is possible to analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

<Details of test results>
The following shows the test results of the improvement effect of the user's mental and physical condition (work efficiency, fatigue state, ease of sleep introduction) when the solution providing system of the present invention is used.

<Effect of improving work efficiency and fatigue>
The test contents and results regarding the work efficiency and the effect of improving the fatigue state are as follows.

<First test on work efficiency and fatigue condition improvement effect>
・ Outline of the test Create a state of fatigue and stress due to mental workload.
Indexes related to fatigue and stress (fatigue feeling, work efficiency, cortisol value) in that state were measured.
After the measurement, one of the four conditions was experienced, and after the experience, the same index as before the mental workload was measured.
Calculate the amount of change in each index after the mental work load (before the vibration experience) and after the vibration experience (-when the value decreases after the vibration experience than after the mental work load, and when it increases, it becomes a + value). The effect of vibration on the fatigue state was confirmed by comparing the average of the responses regarding the degree of fatigue under condition 1 (without vibration presentation) and the average of the responses under condition 2 or 3 or 4.

・ Flow of the test The flow of actions on the day is as follows.
(1) Visit the test site and spend 10 minutes at rest.
(2) Perform mental work load for 45 minutes.
(3) Collect 0.5 mL of saliva for cortisol measurement, respond to fatigue caused by VAS, and carry out work efficiency evaluation tasks.
(4) Experience vibration under any of the conditions 1 to 4 for 2 minutes.
The subjects are divided into 4 groups, and each group is made to experience one of the conditions 1 to 4.
(5) After spending 10 minutes at rest, 0.5 mL of saliva for cortisol measurement was collected, and a response to fatigue caused by VAS and a task for evaluating work efficiency were carried out.

・ Conditions for vibration experience Hold the vibration device with both hands for 2 minutes and experience one of the following 4 conditions.
Condition 1 Vibration is not presented = Comparison target.
Condition 2 A bpm heartbeat-like vibration synchronized with the heartbeat is presented.
Condition 3 A bpm heartbeat-like vibration obtained by adding 50 bpm to the heartbeat is presented.
Condition 4 A bpm heartbeat-like vibration obtained by subtracting 20 bpm from the heartbeat is presented.

・ Test participants 60 men in their 30s and 40s Divide into 4 groups of 15 people each and experience one of the test conditions 1 to 4.

・ Exclusion conditions for participation in the test It is difficult to hold the device with both hands due to finger injuries.

-Specific method of mental workload 2-back task 30 minutes + ATMT (R task) 15 minutes for a total of 45 minutes.
(2-back task)
A short-term memory task in which alphabets are randomly displayed on the computer screen every 3 seconds, and if the currently displayed alphabet and the alphabet displayed two before are the same, right-click, and if they are different, left-click.
(ATTM (R task))
A simple visual search reaction task in which 25 letters of the alphabet from A to Z are randomly displayed on the computer screen, the arrangement is changed each time the "R" is clicked, and the "R" is quickly clicked.

・ Specific measurement method for fatigue, work efficiency, and cortisol (fatigue)
The subjective feeling of fatigue was measured by the VAS (Visual Analog Scale) method.
The position of the current fatigue is checked with the left end as no fatigue (0) and the right end as the maximum fatigue (100) that has never been felt before. The checked position is measured as a numerical value from 0 to 100.
(Measurement of work efficiency)
Three sets (about 10 minutes) of ATMT (ABC task) are performed, and the number of errors in C task is used for evaluation.
(ATMT (ABC task))
Task A: The task of pressing the numbers 11 to 35 fixed on the screen in order.
Problem B: The arrangement does not change, and when the target number is pressed, the number disappears and a new number appears at an arbitrary position (eg, when 11 is pressed, 11 disappears and 36 appears).
Task C: The task of pressing the numbers in order, changing the arrangement of all the numbers each time the target number is pressed.
(Measurement of cortisol)
Collect using a saliva collection kit (Saripet (Sarstedt Co., Ltd.).
Put the sponge in the kit in your mouth, soak it in saliva, and collect the sponge in a tube. Collect saliva by centrifugation.
The amount of cortisol collected from the collected saliva will be measured at the inspection contractor.

 
　（作業能率）
　図１４は、条件１～４のＣ課題のエラー数の変化量の平均値を対したグラフであり、表２は、条件１～４のＣ課題のエラー数の変化量の分析結果である。条件１と比較して条件２で有意にエラー数の減少が見られ、作業能率の向上効果が確認された。

 
　（コルチゾール）
　図１５は、条件１～４のコルチゾールの変化量の平均値を対したグラフであり、表３は、条件１～４のコルチゾールの変化量の分析結果である。条件1と比較して条件２で有意にコルチゾールの減少が見られ、ストレス・疲労減少効果が確認された。

  ・ Test results (feeling tired)
FIG. 13 is a graph comparing the average values of the changes in the fatigue scores under the conditions 1 to 4, and Table 1 shows the analysis results of the changes in the fatigue scores under the conditions 1 to 4. It was confirmed that the feeling of fatigue was significantly reduced under the condition 2 as compared with the condition 1. (The "*" on the side of the table indicates that *** p <0.001, ** p <0.01, * p <0.05. The same shall apply hereinafter.)

(Work efficiency)
FIG. 14 is a graph showing the average value of the change amount of the error number of the C task of the conditions 1 to 4, and Table 2 is the analysis result of the change amount of the error number of the C task of the conditions 1 to 4. A significant decrease in the number of errors was observed under condition 2 as compared with condition 1, confirming the effect of improving work efficiency.

(Cortisol)
FIG. 15 is a graph showing the average value of changes in cortisol under conditions 1 to 4, and Table 3 shows the analysis results of changes in cortisol under conditions 1 to 4. A significant decrease in cortisol was observed under condition 2 as compared with condition 1, confirming the effect of reducing stress and fatigue.

<Second test on work efficiency and improvement effect of fatigue state>
・ Outline of the test The state of the autonomic nerve was measured, and it was determined whether the state was sympathetic dominant, parasympathetic dominant, or balanced, depending on the autonomic nerve balance.
After that, the indexes (fatigue feeling, work efficiency, cortisol value) related to fatigue and stress during normal times (before the vibration experience) were measured.
In consideration of the autonomic nervous balance state, the vibration of any one of the four conditions was experienced, and the same index as in the normal time (before the vibration experience) was measured after the experience.
Calculate the amount of change in each index during normal times (before the vibration experience) and after the vibration experience, and calculate the average of the answers regarding the degree of fatigue under condition 1 (without vibration presentation) and the average of the answers under condition 2 or 3 or 4. By comparing, we confirmed the effect of experiencing suitable vibration depending on the autonomic nervous state.

・ Flow of the test The flow of actions on the day is as follows.
(1) Visit the test site and measure for 2 minutes with an acceleration pulse wave meter to measure the autonomic nerve balance.
(2) Collect 0.5 mL of saliva for cortisol measurement.
(3) Answering fatigue by VAS and carrying out work efficiency evaluation tasks.
(4) Experience the vibration of any of the conditions 1 to 4 for 2 minutes.
The subjects are divided into 4 groups, and each group experiences one of the conditions 1 to 4.
(5) After spending 10 minutes at rest, 0.5 mL of saliva for cortisol measurement was collected.
Answering fatigue by VAS and implementing tasks for work efficiency evaluation.

・ Conditions for vibration experience (1)
Divide into 4 groups according to the result of autonomic balance.
A: Sympathetic dominance, parasympathetic dominance, balanced type, all humans are evenly included B: Sympathetic dominance humans C: Parasympathetic dominance humans D: Balanced humans-Conditions for vibration experience (2)
Hold the vibrating device with both hands for 2 minutes and experience according to each group.
Condition 1 Subject: Group A Vibration is not presented = Comparison target.
Condition 2 Subject: Group B A heartbeat-like vibration is presented, starting from bpm synchronized with the heartbeat and decreasing bpm over 2 minutes up to 50 bpm.
Condition 3 Subject: Group C A heartbeat-like vibration is presented, starting from bpm synchronized with the heartbeat and increasing to 1.5 times bpm over 2 minutes.
Condition 4 Subject: Group D A heartbeat-like vibration of bpm synchronized with the heartbeat is presented for 2 minutes in a fixed manner.

・ Test participants 60 men in their 30s and 40s Divide into 4 groups of 15 people each and experience one of the test conditions 1 to 4.

・ Exclusion conditions for participation in the test It is difficult to hold the device with both hands due to finger injuries.

-Specific method of grouping by autonomic nerve balance Measure the acceleration pulse wave with the acceleration pulse wave measurement system (Altet Co., Ltd.).
LF (low frequency component) / HF (high frequency component) is calculated by frequency analysis at intervals aa.
When the LF / HF value is 2 or more, it is determined to be sympathetic dominant, when it is less than 0.8, it is determined to be parasympathetic dominant, and when it is 0.8 or more and less than 2, it is determined to be balanced type, and grouping is performed.

・ Specific measurement method for fatigue, work efficiency, and cortisol (fatigue)
Subjective fatigue is measured by the VAS (Visual Analog Scale) method.
Check the current position of fatigue, with the left end as no fatigue (0) and the right end as the maximum fatigue (100) that you have never felt before. The checked position is measured as a numerical value from 0 to 100.
(Measurement of work efficiency)
Three sets (about 10 minutes) of ATMT (ABC task) are performed, and the number of errors in C task is used for evaluation.
(ATMT (ABC task))
A task: Pushing numbers 11 to 35 fixed on the screen in order B task: The arrangement does not change, and when you press the target number, that number disappears and a new number appears at any position ( Example: When you press 11, 11 disappears and 36 appears)
Task C: Each time you press the target number, the arrangement of all the numbers changes, and the task of pressing the numbers in order (measurement of cortisol)
Collect using a saliva collection kit (Saripet (Sarstedt Co., Ltd.).
Put the sponge in the kit in your mouth, soak it in saliva, and collect the sponge in a tube.
Collect saliva by centrifugation.
The amount of cortisol collected from the collected saliva will be measured at the inspection contractor.

 
　（作業能率）
　図１７は、条件１～４のＣ課題のエラー数の変化量の平均値を対したグラフであり、表５は、条件１～４のＣ課題のエラー数の変化量の分析結果である。振動なしの状態と比較し、各人の自律神経状態に合わせた振動刺激の条件２，３，４で有意なエラー数の低下が確認され、作業能率の改善効果が確認できた。

 
　（コルチゾール）
　図１８は、条件１～４のコルチゾールの変化量の平均値を対したグラフであり、表６は、条件１～４のコルチゾールの変化量の分析結果である。振動なしの状態と比較し、各人の自律神経状態に合わせた振動刺激の条件２，３，４で有意なコルチゾールの低下が見られ、ストレス・疲労の減少効果が確認された。

  ・ Test results (feeling tired)
FIG. 16 is a graph comparing the average values of the changes in the fatigue scores under the conditions 1 to 4, and Table 4 shows the analysis results of the changes in the fatigue scores under the conditions 1 to 4. It was confirmed that the feeling of fatigue was significantly reduced under the vibration stimulation conditions 2, 3 and 4 according to each person's autonomic nervous state as compared with the state without vibration.

(Work efficiency)
FIG. 17 is a graph with respect to the average value of the change amount of the error number of the C task of the conditions 1 to 4, and Table 5 is the analysis result of the change amount of the error number of the C task of the conditions 1 to 4. Compared with the state without vibration, a significant decrease in the number of errors was confirmed under the vibration stimulation conditions 2, 3 and 4 according to each person's autonomic nervous state, and the effect of improving work efficiency was confirmed.

(Cortisol)
FIG. 18 is a graph showing the average value of changes in cortisol under conditions 1 to 4, and Table 6 shows the analysis results of changes in cortisol under conditions 1 to 4. Compared with the state without vibration, a significant decrease in cortisol was observed under the vibration stimulation conditions 2, 3 and 4 according to each person's autonomic nervous state, and the effect of reducing stress and fatigue was confirmed.

<Test on the effect of improving the ease of introducing sleep>
・ Outline of the test Before going to bed, hold the device that presents heart rate-like vibration for 2 minutes by hand, and go to bed after experiencing vibration of any one of the three conditions.
After waking up, we evaluated the subjective feeling of sleep using the St. Mary's Hospital Sleep Questionnaire.
The effect of vibration on falling asleep was confirmed by comparing the average of the answers of condition 1 (no vibration presentation) and the average of the answers of conditions 2 and 3 to be compared.

・ Flow of the test The flow of actions on the day is as follows.
(1) Come to the test site by 19:00.
(2) Have eaten, bathed, and changed clothes by 21:00.
(3) Stay calm until 22:45.
(4) Wear a heart rate measurement device by 23:00 and experience heart rate measurement and vibration.
The vibration experience divides the subject into three groups and experiences one of the conditions 1 to 3 respectively.
(5) Go to bed at 23:00 and turn off the lights.
(6) Wake up at 6:30 the next morning and evaluate the subjective feeling of sleep from 6:45.

・ Evaluation of subjective sleep sensation Ask questions about sleep onset from the St. Mary's Hospital sleep questionnaire and ask them to answer.
(Question about feeling of falling asleep)
How difficult was it to fall asleep last night?
Score 1: It wasn't difficult at all or almost.
2: It was a little difficult.
3: It was quite difficult.
4: It was extremely difficult.

・ Conditions for vibration experience Hold the vibration device with both hands for 2 minutes and experience one of the following three conditions.
Condition 1 Vibration is not presented = comparison target.
Condition 2 A bpm heartbeat-like vibration synchronized with the heartbeat is presented.
Condition 3 A vibration is presented that starts with a heartbeat-like vibration of bpm synchronized with the heartbeat and decreases bpm over 2 minutes up to 50 bpm.

・ Test participants 30-40 men 30 people Divide into 3 groups of 10 people and experience one of the test conditions 1 to 3.

・ Exclusion conditions for participation in the test Those who are treated by a doctor for sleep.
Those taking over-the-counter sleep-inducing or improving medications or supplements.
It is difficult to hold the device with both hands due to finger injuries.

-Specific presentation method of test conditions The vibration device is connected to the PC.
In the PC, the subject experiences the vibration through the holding vibration device by operating the program such that the vibration according to the condition 2 or 3 is presented.
The heart rate required to present condition 2 or 3 is measured as follows.
Wear a heart rate measuring device 10 minutes before the vibration experience, and measure the average heart rate (bpm) for 3 minutes after spending 5 minutes in a resting position.

  -Test result FIG. 19 is a graph comparing the average values of the scores of the conditions 1 to 3, and Table 7 is the analysis result of the scores of the conditions 1 to 3.
The score was improved by the heart rate synchronization stimulus of the condition 2 with respect to the condition 1, and the stimulus decreased from the heart rate synchronization vibration of the condition 3 was the most effective. From these facts, it was confirmed that the stimulus synchronized with the heart rate, more preferably the stimulus synchronized with the heart rate and further lowering the frequency, has the effect of inducing sleep onset.

<Test of stress / fatigue reduction effect by stimulation of combination of vibration and sound>
-Outline of the test A state of fatigue and stress was created by the mental work load, and the index (VAS, fatigue symptom investigation, cortisol value) related to the fatigue and stress in that state was measured.
Then, after experiencing the stimulus of music alone or the stimulus of the combination of music and vibration, the changes in these indicators were compared.

・ Flow of the test The flow of actions on the day is as follows.
(1) Visit the test site and spend 10 minutes at rest.
(2) Conduct indicators related to fatigue and stress (VAS, fatigue symptom investigation), and use this as "pre-load" data.
(3) Perform mental work load for 14 minutes.
(4) Collect 0.5 mL of saliva for post-loading cortisol measurement, and use this as "post-loading" data.
(5) Experience the stimulus under any of the following conditions for 4 minutes.
* In the vibration experience, the subjects are divided into 3 groups, and the dates are changed for each group to experience all of conditions 1 to 3.
(6) After stimulation, VAS and fatigue symptom investigation will be performed, and this will be used as "post-stimulation" data.
(7) After a 10-minute break, 0.5 mL of saliva for cortisol measurement is collected, VAS, and fatigue symptom investigation are performed, and this is used as "after break" data.
(VAS, fatigue symptom investigation acquired 3 times, saliva acquired 2 times)
(8) Compare the changes in each item in 3 groups.

・ Conditions for vibration experience Hold the vibration device with both hands for 2 minutes and experience one of the following 3 conditions Condition 1 Music only (same music as condition 2)
Condition 2 Vibration that changes from heartbeat-like vibration synchronized with the subject's heartbeat to 50 bpm over 4 minutes + Music synchronized with the tempo of the frequency shown on the left Condition 3 No stimulation

・ Test participants 36 men in their 30s and 40s Divide into 3 groups of 12 people and experience one of the test conditions 1 to 3.

・ Exclusion conditions for participation in the test It is difficult to hold the device with both hands due to finger injuries.

-Specific method of mental workload 3 sets of ATMT (ABC task, targets 1 to 35), 5 minutes for 2-back task, 14 minutes in total.
(ATMT (ABC task, targets 1-35))
Task A: The task of pressing the numbers 11 to 35 fixed on the screen in order.
Problem B: The placement does not change, and when you press the target number, that number disappears and a new number appears at an arbitrary position (when you press 11, 11 disappears and 36 appears, and when you press 12, 12 disappears. 37 appears) Challenge.
Task C: A task in which the arrangement of all numbers changes each time the target number is pressed.
(2-back task)
A short-term memory task in which alphabets are randomly displayed on the computer screen every 3 seconds, and if the currently displayed alphabet and the alphabet displayed two before are the same, right-click, and if they are different, left-click.

・ VAS, fatigue symptom investigation, specific measurement method of cortisol (measurement of VAS)
Subjective evaluation of stress, tension, and irritability was conducted by the VAS (Visual Analog Scale) method.
Check the current position with the left end as none (0) and the right end as the maximum (100) that you have never felt before. The checked position is measured as a numerical value from 0 to 100.
(Investigation of fatigue symptoms)
Conducted subjective surveys on four categories: emotional fatigue, head fatigue, body fatigue, and eye fatigue in order to understand the state of fatigue associated with work.
There are 5 questions in each category, which are scored in 5 steps from 1 "not applicable at all" to 5 "very well applicable", and the average score is calculated in each category.
The categories and corresponding questions are as follows.
Feeling tired: Feeling uneasy, feeling depressed, feeling uncomfortable, irritated, hard to get together.
Head fatigue: I have a headache, a headache, a feeling of illness, a dull head, and dizziness.
Body fatigue: Dull arms, low back, dull hands and fingers, dull legs, stiff shoulders.
Eye fatigue: Eyes are dull, eye-catching, eye-worn, eye-dry, and blurred.
(Measurement of cortisol)
Collect using a saliva collection kit (Saripet (Sarstedt Co., Ltd.).
Put the sponge in the kit in your mouth, soak it in saliva, and collect the sponge in a tube.
Collect saliva by centrifugation.
The amount of cortisol collected from the collected saliva will be measured at the inspection contractor.

 
　表９は、負荷前と刺激後、負荷前と休憩後の、疲労症状調べの結果の変化を群間比較した結果である。条件３と条件２との比較でのみ有意差を確認した(網掛け部)。条件２のみ疲労症状調べでの効果が確認できた。

 
　表１０は、負荷後と休憩後の唾液中コルチゾール量の変化を群間比較した結果である。条件３と条件２との間でのみ有意差が認められた。

  -Test results Table 8 shows the results of comparing the changes in VAS between groups before and after loading, and before and after resting. If the value is- (minus), it means that the condition has improved (the same applies hereinafter).
In the former, a significant difference from condition 3 can be seen in both conditions 1 and 2. In the latter case, a significant difference was confirmed only in the comparison between condition 3 and condition 2 (shaded part). From this, it can be said that the effect of condition 2 on stress lasts longer than that of condition 1.

Table 9 shows the results of comparing the changes in the results of fatigue symptom examination before and after loading, and before and after resting between groups. A significant difference was confirmed only by comparing condition 3 and condition 2 (shaded part). Only condition 2 was able to confirm the effect of the fatigue symptom investigation.

Table 10 shows the results of comparing the changes in the amount of cortisol in saliva after loading and after resting between the groups. A significant difference was found only between condition 3 and condition 2.

The block diagram which shows the whole image of the solution providing system which concerns on 1st Embodiment of this invention. The figure which shows the content of the data used for processing by the solution provision system of 1st Embodiment. The flowchart which shows the processing content of the solution provision system of 1st Embodiment. The flowchart which shows the processing content of the solution provision system of 1st Embodiment. The flowchart which shows the processing content of the solution provision system of 1st Embodiment. The image diagram which shows the processing content of the solution provision system of 1st Embodiment. The figure which shows the content of the data used for processing by the solution provision system of 1st Embodiment. The block diagram which shows the whole picture of the solution provision system of 2nd Embodiment. The flowchart which shows the processing content of the solution provision system of 2nd Embodiment. The flowchart which shows the processing content of the solution provision system of 2nd Embodiment. The flowchart which shows the processing content of the solution provision system of 2nd Embodiment. The block diagram which shows an example of the modification embodiment of the solution provision system. A graph showing the test results of improving user status. A graph showing the test results of improving user status. A graph showing the test results of improving user status. A graph showing the test results of improving user status. A graph showing the test results of improving user status. A graph showing the test results of improving user status. A graph showing the test results of improving user status. The block diagram which shows the whole picture of the solution provision system of 3rd Embodiment. The flowchart which shows the processing content of the solution provision system of 3rd Embodiment. The flowchart which shows the solution provision system processing contents of 3rd Embodiment. The flowchart which shows the solution provision system processing contents of 3rd Embodiment. The figure which shows the content of the data used for processing by the solution provision system of 3rd Embodiment. The flowchart which shows the solution provision system processing contents of 3rd Embodiment. The flowchart which shows the solution provision system processing contents of 3rd Embodiment. The flowchart which shows the solution provision system processing contents of 3rd Embodiment. The flowchart which shows the change example of the solution provision system processing contents of 3rd Embodiment. The block diagram which shows an example of the whole image of the solution provision system of 4th Embodiment. The block diagram which shows the other example of the whole image of the solution provision system of 4th Embodiment. The flowchart which shows an example of the processing content of the solution provision system of 4th Embodiment. The figure which shows an example of the output content of the solution provision system of 4th Embodiment. The flowchart which shows an example of the processing content of the solution provision system of 4th Embodiment. The flowchart which shows an example of the processing content of the solution provision system of 4th Embodiment. The flowchart which shows an example of the content of the information used for processing by the solution provision system of 4th Embodiment. The flowchart which shows an example of the content of the information used for processing by the solution provision system of 4th Embodiment.

<Structure of the first embodiment>
First, the configuration of the solution providing system according to the first embodiment of the present embodiment will be described with reference to FIG. The same components may be designated by the same reference numerals and description thereof may be omitted.

The solution providing system of the present embodiment includes a mobile terminal 10 and a server 30. The mobile terminal 10 and the server 30 are connected to each other so as to be able to communicate with each other by a communication network 90 such as a mobile phone network. The number of mobile terminals 10 and the number of servers 30 may be plural.

The mobile terminal 10 is a general-purpose terminal such as a smartphone or a tablet terminal, which includes a mobile terminal control unit 110, an input unit 130, and an output unit 150. Alternatively, the mobile terminal 10 may be a dedicated terminal that can be carried by the user.

The mobile terminal control unit 110 is composed of an arithmetic processing unit such as a CPU (Central Processing Unit), a memory, an I / O (Input / Output) device, and the like. The mobile terminal control unit 110 functions as, for example, a user information acquisition unit 111 and a solution provision unit 113 by reading and executing a predetermined program, or further, a desired state reception unit 115, a skin image analysis unit 117, and a situation recognition unit. Functions as 119.

The user information acquisition unit 111 acquires user information including information obtained from the user's body or movement.

The information obtained from the user's body or movement acquired by the user information acquisition unit 111 is, for example, at least one of information about the user's heartbeat, an image of the user's skin, and one or both of the characters and voices input by the user. Two pieces of information.

The user information acquisition unit 111 acquires the user's heartbeat via, for example, a heart rate monitor which is an input unit 130.

Alternatively, the user information acquisition unit 111 acquires a moving image of the user's skin or a still image in which the user's skin is continuously captured as user information via, for example, a camera which is an input unit 130. The skin image is, for example, an image of the skin of the user's face or an image of the skin of the fingers, but may be an image of the skin of other parts.

Then, the user information acquisition unit 111 accepts the input of user information including language information which is one or both of characters and voice by the user, for example, via a touch panel, a microphone, or the like which is an input unit 130.

The solution providing unit 113 provides the solution determined by the solution determining unit 313 to the user via the output unit 150.

The desired state receiving unit 115 receives input of desired state information indicating one or both of the user's desired emotional state or fatigue state via the input unit 130.

The skin image analysis unit 117 analyzes the skin image included in the user information.

The situational awareness unit 119 determines whether the user is in the first situation of having the user information acquisition unit 111 acquire the image of the skin of the user's finger or the second situation of causing the user information acquisition unit 111 to acquire the image of the skin of the user's face. recognize. The situational awareness unit 119, for example, accepts the input of the user's own selection of whether it is in the first situation or the second situation, and the user determines the first situation and the second situation according to the accepted selection content. Recognize which situation you are in. Alternatively, for example, the situational awareness unit 119 may recognize whether the user is in the first situation or the second situation based on the current time zone.

The input unit 130 is, for example, a video acquisition means such as a camera, an input mechanism for characters such as a touch panel and a keyboard, and a selection result, or a voice input mechanism such as a microphone.

The output unit 150 includes, for example, a vibration generation unit 151 such as a vibrator, a display unit 153 such as a liquid crystal display, a voice reproduction unit 155 such as a speaker, and a scent generation unit 157 that generates a scent. A part of the output unit 150 may be an external device.

That is, for example, when the vibration generating unit 151 is provided with an external device having a vibration generating function in place of or in addition to the vibrator provided in the mobile terminal 10, the mobile terminal 10 and the external device are provided. The devices are communicably connected to each other, for example by wireless or wired communication. Then, the external device receives a signal for providing the vibration solution from, for example, the mobile terminal 10, and provides the vibration solution to the user according to the signal.

The server 30 is, for example, a computer configured to include a server control unit 310 and a server storage unit 330.

The server control unit 310 is composed of an arithmetic processing unit such as a CPU, a memory, an I / O device, and the like. The server control unit 310 functions as, for example, a user state information generation unit 311 and a solution determination unit 313 by reading and executing a predetermined program, or further, a heart rate information acquisition unit 315, an autonomic nerve balance acquisition unit 317, and a language information analysis. It functions as a unit 319.

The user state information generation unit 311 generates user state information indicating the user state of the user based on the information acquired from the body or movement performed by the user information acquisition unit 111.

That is, for example, the user state information generation unit 311 is based on the information on the heartbeat included in the user information, the analysis result by the skin image analysis unit 117, the analysis result by the language information analysis unit 319, and the autonomic nerve balance information. To generate.

The solution determination unit 313 determines a solution according to user status information from a plurality of solutions.

Then, the heart rate information acquisition unit 315 acquires information on the user's heart rate from the skin image.

The autonomic nerve balance acquisition unit 317 acquires autonomic nerve balance information indicating the user's autonomic nerve balance based on the information on the heartbeat included in the user information or the information on the heartbeat acquired by the heartbeat information acquisition unit 315.

Alternatively, for example, the autonomic nerve balance acquisition unit 317 acquires the user's autonomic nerve balance information based on the information regarding the characteristics of the language information acquired by the language information analysis unit 319.

The language information analysis unit 319 analyzes the language information included in the user information. For example, the language information analysis unit 319 acquires information on the characteristics of user information from the language information.

More specifically, for example, the linguistic information analysis unit 319 uses characteristic words (negative words, etc.) contained in the linguistic information, or, for example, when the user information contains voice, the inflection of the voice is used for the user information. Obtained as information about features.

The server storage unit 330 is composed of storage devices such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an HDD (Hard Disk Drive). The server storage unit 330 stores information on a plurality of solutions for improving the user's emotional and / or fatigued states that can be provided to the user, or further, a corresponding dictionary 331, a determination model. In addition to 333, the conversion model 335, and the reference state information 337, the processing result of the solution providing system of the present embodiment and the data necessary for the processing are stored.

The solution information stored in the server storage unit 330 may be digital data itself such as music, voice, video, a predetermined periodic vibration pattern, or code information such as an ID that identifies a predetermined scent. It may be there. By providing these solutions to the user alone or in combination, for example, a solution that induces the user state to be relaxed, calm, or awake, and a state in which the desired state information indicates the user state. It functions as a solution that guides the user state toward the state indicated by the reference state information 337, and the like.

Further, the solution stored in the server storage unit 330 includes, for example, a passive stimulus to the user's sense of touch, hearing or smell, and more specifically, a predetermined periodic vibration, music, reading voice, a predetermined scent. , Positive paraphrases corresponding to negative words, or word candidates for paraphrases with a lower degree of negativeness than words. Alternatively, the solution may be, for example, information that encourages the user to breathe or meditate in a predetermined manner.

The user's emotions include so-called psychological states such as emotions and negative states, as well as the state of autonomic nervous balance as one of the indicators of whether the person is in an excited state or a relaxed state, and awakening and rest. It is a concept that includes the state of self-awareness by the user such as, calmness, and liberation.

The corresponding dictionary 331 associates a characteristic phrase such as a negative phrase included in the linguistic information with, for example, the degree of the user state, which is one or both of the user's emotional and fatigue states, as shown in FIG. It may be a memorized correspondence table, or may be stored in association with a positive paraphrase of a phrase or a paraphrase with a lower degree of negativeness than the phrase. Alternatively, the correspondence dictionary 331 is a correspondence table that stores the intonation of voice and the user state in association with each other.

These corresponding dictionaries 331 are used when the user state information generation unit 311 generates the user state information or when the solution determination unit 313 determines the solution.

The determination model 333 is, for example, a determination model that inputs a characteristic phrase included in linguistic information and outputs a user state, or a determination model that inputs voice intonation and outputs a user state, and is a user state information generation unit 311. Is used to generate user state information.

The conversion model 335 is a conversion model in which a negative phrase is input and a positive paraphrase of the phrase or a paraphrase with a lower degree of negativeness than the phrase is output, and the solution determination unit 313 determines the solution. It is used when doing.

The reference state information 337 is information indicating a reference of a state in which one or both of the user's emotions or fatigue states are improved, and is, for example, a heartbeat as a reference of a state in which one or both of the user's emotions or fatigue states are improved. The number, heart rate interval, autonomic balance, and emotional or fatigue index values obtained from these data are stored for each user characteristic such as age and gender, or for each time zone such as day and night. ..

<Outline of processing>
Next, the processing contents of the solution providing system of the present embodiment will be described with reference to FIGS. 3 to 7.

<Desired state reception process>
When a series of processes are started, first, if necessary, the desired state receiving unit 115 of the mobile terminal 10 accepts the input of desired state information indicating one or both of the user's desired emotional state or fatigue state, and the server 30 receives the input. (Fig. 3 / S110).

The desired state receiving unit 115 displays, for example, a plurality of emotion and / or fatigue state options desired by the user on the display of the mobile terminal 10, and allows the user to select the desired state information input. The options displayed by the desired state reception unit 115 may be abstract ones such as "I want to improve my motivation for work" and "I want to improve my resilience and get rid of fatigue", "I want to feel cheerful", and "Relax". It may be more specific, such as "I want to feel good", "I want to be calm", "I want to be awake", and "I want to balance the autonomic nerves".

Then, the server 30 receives the desired state information and stores it in the server storage unit 330 (FIG. 3 / S130).

At this time, the situation recognition unit 119 displays, for example, a selection button for selecting whether the user is in the first situation or the second situation on the display of the mobile terminal 10 and causes the user to select the user. Recognize whether the situation is in the first situation or the second situation.

<User information acquisition process>
After that, the user information acquisition unit 111 of the mobile terminal 10 acquires the user information and transmits it to the server 30 (FIG. 3 / S150).

More specifically, for example, as shown in FIG. 4, the user information acquisition unit 111 acquires an image of the user's skin via the camera included in the mobile terminal 10 (FIG. 4 / S151), and the touch panel included in the mobile terminal 10. The input of the selection result of characters and options via the camera, or the input of the voice via the microphone is accepted as linguistic information (FIG. 4 / S153).

When the user information acquisition unit 111 acquires the skin image, the user information acquisition unit 111 is in the first situation in which the user acquires the skin image of the user's fingers based on the recognition result by the situation recognition unit 119. The image of the skin of the fingers is acquired, and the image of the skin of the user's face is acquired when the user is in the second situation of acquiring the image of the skin of the face.

Then, the user information acquisition unit 111 acquires information necessary for acquiring information on the heartbeat from the skin image, for example, by using the function of the skin image analysis unit 117 (FIG. 4 / S155).

When the skin image analysis unit 117 acquires the information necessary for acquiring the information related to the heartbeat, the skin image analysis unit 117 is based on the recognition result by the situation recognition unit 119, and when the user is in the first situation, the skin of the user's finger. The image is analyzed to acquire the information necessary for acquiring the information related to the heartbeat, and in the second situation, the image of the skin of the user's face is analyzed to acquire the information.

Various known methods may be used as a method for the skin image analysis unit 117 to acquire information necessary for acquiring information on the heartbeat from the skin image, and the skin image analysis unit 117 is, for example, an image of the skin. Information on changes in the brightness of each color component of RGB is acquired from a moving image or a still image continuously captured.

Then, the user information acquisition unit 111 transmits the information necessary for acquiring the language information and the heartbeat information acquired in this way to the server 30 as user information (FIG. 4 / S157).

<User information analysis processing>
Then, the user status information generation unit 311 of the server 30 receives the user information (FIG. 3 / S210) and analyzes the information included in the user information such as the information necessary for acquiring the information related to the heartbeat and the language information. (FIG. 3 / S230).

More specifically, as shown in FIG. 5, for example, the user state information generation unit 311 acquires heartbeat-related information from information necessary for acquiring heartbeat-related information via the heartbeat information acquisition unit 315 (FIG. 5 /. S231).

Various known methods may be used as a method for the heart rate information acquisition unit 315 to acquire information on the user's heart rate from the information necessary for acquiring information on the heart rate, and the heart rate information acquisition unit 315 may use, for example, each color of RGB. The user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of the component using a predetermined algorithm.

Further, the heart rate information acquisition unit 315 calculates and acquires index values such as CVR-R and CCVTP from the user's heart rate, for example, heart rate, heart rate interval, or these information.

Then, the heart rate information acquisition unit 315 calculates a fatigue degree score indicating the user's fatigue state in 0.1 increments between 0 and 10 using a predetermined algorithm from index values such as CVR-R and CCVTP. In this case, the heart rate information acquisition unit 315 corresponds to the fatigue state acquisition unit, and the fatigue degree score corresponds to the fatigue state information.

Further, the user status information generation unit 311 uses the function of the language information analysis unit 319 to acquire information on the characteristics of the language information included in the user information (FIG. 5 / S233).

The linguistic information analysis unit 319 acquires, for example, characteristic words and phrases (negative words and phrases, etc.) included in the linguistic information as information regarding the characteristics of the linguistic information. Alternatively, for example, when the user information includes voice, the language information analysis unit 319 acquires the intonation of the voice as information regarding the characteristics of the user information.

Various methods may be used as the method for the language information analysis unit 319 to acquire information regarding the characteristics of the language information. That is, for example, the language information analysis unit 319 refers to a dictionary of negative words and phrases stored in advance in the server storage unit 330, extracts negative words and phrases included in the words and phrases input or selected by the user, and extracts the negative words and phrases. Obtained as information on the characteristics of language information.

Alternatively, for example, the language information analysis unit 319 divides the voice data included in the user information into syllables, analyzes each syllable, acquires the intonation pattern, and stores the voice data in the server storage unit 330 in advance. By referring to the correspondence table that associates the intonation pattern with emotions, fatigue states, autonomic balance, etc., characteristic (for example, frequently occurring) intonation patterns are extracted from the voice data included in the user information. The intonation pattern is acquired as information related to the characteristics of linguistic information.

After that, the user state information generation unit 311 acquires the autonomic nerve balance information based on the information on the heartbeat and / or the information on the feature acquired from the linguistic information by using the function of the autonomic nerve balance acquisition unit 317 (FIG. 5). / S235).

Various methods may be used as the method for the autonomic nerve balance acquisition unit 317 to acquire the autonomic nerve balance information. That is, for example, the autonomic nerve balance acquisition unit 317 analyzes the fluctuation of the heartbeat by frequency, and the ratio (LF / HF) of LF (Low Frequency), which is a low frequency component of the fluctuation of the heartbeat, and HF (High Frequency), which is a high frequency component. Value) is acquired as autonomic nerve balance information.

Then, the autonomic nerve balance acquisition unit 317 calculates an autonomic nerve balance score indicating the balance of the user's autonomic nerve in 0.1 increments between 0 and 10 using a predetermined algorithm from the autonomic nerve balance information.

<User status information generation process>
Then, the user state information generation unit 311 of the server 30 generates user state information indicating the user state of the user based on the analysis result in the user information analysis process (FIG. 3 / S250).

For example, the user state information generation unit 311 generates user state information based on the fatigue degree score and the autonomic nerve balance score obtained above.

Then, the user state information generation unit 311 uses a matrix table with the fatigue level as the vertical axis and the autonomic nerve balance as the horizontal axis, as shown in FIG. 6, for example, to combine the user fatigue level and the autonomic nerve balance. Information indicating where the matrix table is located is acquired, and the acquired information is used as user status information. Alternatively, for example, the user state information generation unit 311 may use the information indicating where in the matrix table thus acquired and the information obtained by combining the fatigue degree score and the autonomic nerve balance score as the user state information.

That is, for example, as shown in FIG. 6, on the vertical axis, the higher the degree of fatigue, the higher the degree of fatigue, and the lower the degree, the lower the degree of fatigue. On the horizontal axis, the sympathetic nerve is dominant toward the right, that is, the autonomic nerve balance is in a state where the mind is tense, and the parasympathetic nerve is dominant toward the left, that is, the autonomic nerve balance is in a relaxed state.

In FIG. 6, if the autonomic nerve score is 0 to 3.3, the parasympathetic nerve is predominant, and if the autonomic nerve score is 3.4 to 6.6, the autonomic nerve balance is in a well-balanced state, and 6.7. If it is ~ 10.0, the sympathetic nerve is in a dominant state. If the fatigue score is 0 to 3.3, the fatigue level is low, if it is 3.4 to 6.6, the fatigue level is medium, and if it is 6.7 to 10.0, the fatigue level is high. And.

When the parasympathetic nerve is dominant and the fatigue level is moderate to low, it is an excessively relaxed state (over-relax), and when the sympathetic nerve is dominant and the fatigue level is medium to low. If it is, it is an excessive-active state, and if the degree of fatigue is high, it is a dangerous state (dangerous). Among them, if the autonomic nerves are balanced, it is a state of caution (caution).

On the other hand, when the degree of fatigue is moderate and the autonomic nerves are balanced, it is in a normal state (me-normal), and when the degree of fatigue is low and the autonomic nerves are balanced, it is in a full state (me-fullness). Become. FIG. 6 shows that the user state is the “caution” state.

<Solution decision process>
Then, the solution determination unit 313 of the server 30 determines the solution according to the user state information and transmits it to the mobile terminal 10 (FIG. 3 / S270).

More specifically, for example, as shown in FIG. 7, the combination of the degree of fatigue and the autonomic nerve balance and the correspondence table with the solution are stored in advance in the server storage unit 330, and the solution determination unit 313 performs the correspondence. With reference to the table, a solution or a combination of solutions corresponding to the combination of the fatigue degree obtained as described above and the autonomic nerve balance is obtained.

That is, for example, in the above example, since the user state is a "music" state in which the autonomic nerves are well-balanced but the degree of fatigue is high, the solution determination unit 313 is a combination of vibration and voice. As for the voice, the combination of the 6-minute solution in which the narration (reading voice) is played first and then the music is played is determined as the solution according to the user status information.

It first provides a combination of vibration and narration that has the effect of relieving fatigue for users with a high degree of fatigue, and then replaces the voice with music that maintains the balance of the autonomic nerves. The combination is intended to effectively reduce fatigue and maintain autonomic balance. Also, if the user's emotions or fatigue are in good condition, the solution time is relatively short, and if the user's emotions or fatigue is not in good condition, the solution time is within a reasonable range for the user. It is set relatively long.

At this time, when the desired state information of the user is stored in the server storage unit 330, the solution determination unit 313 guides the user's emotional or fatigue state toward the state indicated by the desired state information. decide. That is, for example, if the user state is "caution" and the user's desired state information is "to improve resilience and relieve fatigue", the user state can be guided toward "me-normal" or "me-fullness". The solution to be provided to the user is determined by selecting the solution from the solutions stored in the server storage unit 330.

Alternatively, when the user's desired state information is not stored in the server storage unit 330, the solution determination unit 313, for example, moves the user state to a relaxed state, that is, a state in which the current autonomic nerve balance becomes more parasympathetic-dominant. It may be configured to determine the solution to guide.

Alternatively, the solution determination unit 313 induces the user state to move toward a calm state, that is, a state in which the current autonomic balance is more parasympathetic-dominant, at a speed higher than that of a solution that induces a relaxed state. It may be configured to determine the solution, or it may be configured to determine the solution that induces the user's state to be awake, that is, the current autonomic balance towards a more sympathetic predominant state. good.

Alternatively, if reference state information 337 indicating a reference of a state in which one or both of the user's emotions and fatigue states are improved is stored in the server storage unit 330, the solution determination unit 313 uses the user state and reference state information. Based on 337, it may be configured to determine a solution that guides the user state towards the state indicated by the reference state information 337.

That is, for example, the solution determination unit 313 refers to the reference state information 337 when determining the solution. If, for example, "fatigue degree = 0 to 3.3" is specified as the reference state information 337, the solution determination unit 313 stores the solution for inducing the fatigue degree to 3.3 or less in the server storage unit 330. Determine which solution to offer to your users by choosing from the available solutions.

<Determination of paraphrase word candidates>
The solution determined by the solution determination unit 313 may be a positive paraphrase corresponding to a negative phrase or a paraphrase candidate having a lower degree of negativeness than the phrase.

That is, for example, the solution determination unit 313 uses a corresponding dictionary of negative words and phrases contained in linguistic information and words and phrases that are positive paraphrases of words and phrases or paraphrase words that are less negative than words and phrases. A positive paraphrase corresponding to a common phrase or a paraphrase candidate with a lower degree of negativeness than the phrase is determined as a solution.

More specifically, when the linguistic information contains the phrase "sad", the solution determination unit 313 refers to the corresponding dictionary as shown in FIG. 2, and the degree of emotion of the phrase "sad". Recognizes that at the point "-99", the corresponding paraphrase phrase is "painful" or "inviting tears". Then, the solution determination unit 313 recognizes that, for example, if the phrase "sad" appears multiple times in the linguistic information, it is highly necessary to lower the degree of emotion, and the "-28" point, which has a lower degree of emotion, is "-28". Select "Invite tears" as a paraphrase candidate with a low degree of negativeness, and decide it as a solution.

Alternatively, if the linguistic information contains the phrase "gutari", the solution determination unit 313 refers to the corresponding dictionary as shown in FIG. 2 and uses the positive paraphrase phrase "gutari" corresponding to "gutari" as "gutari". Recognize that there are things such as "it is fulfilling" and "it is a place to show your arms". Then, depending on the content of the linguistic information, words and phrases are appropriately selected from these and determined as a solution.

For example, the solution determination unit 313 executes the above process each time a user inputs characters via the input unit 130 of the mobile terminal 10 and performs a character conversion operation, and transmits the selected phrase as a solution to the mobile terminal 10. do.

Then, the solution providing unit 113 of the mobile terminal 10 displays, for example, the selected phrase at the top of the list of conversion candidates in the solution providing process described later.

In addition to or in place of the above-mentioned corresponding dictionary, the solution determination unit 313 inputs a negative phrase and outputs a positive paraphrase of the phrase or a paraphrase with a lower degree of negativeness than the phrase. A transformation model may be used to determine paraphrase word candidates.

<Solution provision process>
Then, the solution providing unit 113 of the mobile terminal 10 receives the solution (FIG. 3 / S310) and provides the received solution to the user (FIG. 3 / S330).

More specifically, the solution providing unit 113 has a predetermined periodic period via the vibration generating unit 151, the display unit 153, the voice reproduction unit 155, and the scent generating unit 157, depending on the content of the solution received from the server 30. For tactile stimuli such as vibration, auditory stimuli such as music, reading voice, natural sounds (bird's voice, babbling of streams, etc.), passive stimuli such as olfactory stimuli such as predetermined scents, and negative phrases. Provide users with corresponding positive paraphrases or paraphrase candidates that are less negative than the phrase.

That is, for example, if the received solution is digital data of music, the solution providing unit 113 causes the voice reproduction unit 155 to play the music. Alternatively, for example, if the received solution has an ID that specifies a predetermined scent, the solution providing unit 113 generates the scent corresponding to the ID in the scent generating unit 157.

The solution provided by the solution providing unit 113 may be configured to be a stimulus of any or a combination of music, reading voice, and vibration. Further, the solution providing system of the present embodiment may be configured to repeat these series of processes periodically or irregularly.

That is, for example, the user information acquisition unit 111 acquires user information again after the solution is provided to the user, and the user status information generation unit 311 acquires the user information based on the information including the user information acquired after the solution is provided to the user. The state information may be regenerated, and the solution determination unit 313 may be configured to determine a solution according to the regenerated user state information.

As described above, according to the present invention, it is possible to analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

The first embodiment of the present invention has been described above, but the present invention is not limited thereto. Various changes can be made without departing from the spirit of the present invention.

<Example of implementation of solution providing system>
An example of implementation of the solution providing system is described below.

<Combination with mobile>
The solution providing system of the present invention may be mounted and used on a moving body such as an automobile.

In this case, for example, the user information acquisition unit 111 relates to an image of the face of the driver or passenger of the automobile, an image of the skin of the fingers, and the heartbeat, for example, via one or both of a camera and a heart rate monitor installed in the automobile. Get user information including information. Further, the user state information generation unit 311 generates user state information of the driver or a passenger based on the acquired information.

Then, the solution determined by the solution determination unit 313 is information according to the user state, for example, information for urging the user to take a break, predetermined periodic vibration according to the user state, or a combination thereof.

Further, the solution providing unit 113 provides the driver or a passenger with a predetermined periodic vibration according to the user state via, for example, a vibration generating unit installed on one or both of the steering wheel portion and the seat of the automobile. .. The vibration generating portion may be built in the handle portion or the seat, or may be a retrofit device.

Alternatively, or in addition to this, a scent according to the user's condition may be provided as a solution.

According to the present invention, break instructions can be appropriately given according to emotional states such as stress and fatigue of the driver or passenger, and vibration is transmitted from the handle or seat during breaks to recover from stress and fatigue. Prompted. Especially for the driver, the decrease in concentration due to stress and fatigue associated with driving is prevented.

<Use at medical institutions>
The solution providing system of the present invention may be used in a medical institution such as a hospital or a dental clinic.

In this case, for example, the user information acquisition unit 111 relates to the image of the face of the user who is the patient, the image of the skin of the fingers, and the heartbeat, for example, via one or both of the camera and the heart rate monitor installed in the examination room of the medical institution. Get user information including information.

Then, the user condition information generation unit 311 generates the patient user condition information based on the acquired information, and the solution providing unit 113 uses the vibration generation unit installed on the examination table of the medical institution to generate the patient's user condition information. It provides the patient with a predetermined periodic vibration according to the user status information.

The cycle at the start of a predetermined periodic vibration according to the user state is, for example, substantially synchronized with the patient's heartbeat, and then the vibration of the vibration pattern in which the cycle is gradually lengthened is determined as a solution.

This is intended to reduce the user's heart rate and reduce the user's anxiety and tension by using the pull-in effect that synchronizes the heart rate cycle with the vibration provided to the user. Is.

According to the present invention, treatment in a medical institution becomes easier by reducing anxiety and tension. It can also be expected that the pain felt by the patient due to the treatment will be alleviated by reducing the tension.

<Use in educational institutions>
The solution providing system of the present invention may be used in an educational institution such as a school.

In this case, for example, the user information acquisition unit 111 may use one or both of the camera and the heart rate monitor provided in the tablet terminal used for school students, etc., to image the face of each student, the skin of the fingers, and the heart rate. Get user information, including information about.

Further, the user status information generation unit 311 generates user status information of the student or the like based on the acquired information, and the solution providing unit 113 uses the tablet terminal and the vibration generation unit installed in the seat where the student is seated. Through, a predetermined periodic vibration according to the user status information of the student or the like is provided to the patient.

Alternatively, the autonomic nerve balance acquisition unit may analyze the autonomic nerve state of each person based on the user information.

In this case, the solution determination unit 313 gives different stimuli to the sympathetic-dominant student and the parasympathetic-dominant student according to the analysis result of the autonomic nerve, and all the students have the sympathetic nerve and the parasympathetic nerve. Determine a predetermined periodic vibration solution to induce a balanced state of the.

Then, the solution providing unit 113 provides the student with a predetermined periodic vibration according to the user status information of the student via the tablet terminal and the vibration generating unit installed in the seat where the student is seated.

According to the present invention, it can be expected that a confused state in which sympathetic-dominant students and parasympathetic-dominant students are mixed and it is difficult to control the students can be resolved.

<Use in office buildings, etc.>
The solution providing system of the present invention may be used in a rest spot of an office building or the like.

In this case, for example, the user information acquisition unit 111 is provided in a terminal installed in a break spot of an office building, and acquires user information of a person who works in the office building.

The solution determination unit 313 determines the solution according to the user's condition and provides it to the user via the solution provision unit 113 installed in the rest spot of the office building.

The solution determined by the solution determination unit 313 includes, for example, music, audio, video, scent, vibration, brightness and color of lighting provided in the rest spot.

Further, even if the user information acquired by the user information acquisition unit 111 and the user status information generated by the user status information generation unit 311 are accumulated and transmitted to the manager of the office of the person who works in the office building at any time. good.

According to the present invention, it is possible to effectively improve the stress state and the fatigue state during the break time in the rest spot according to the stress state and the fatigue state of the person working in the office building, and these persons. It is convenient for the manager of our office because it can visualize the stress state and fatigue state of the worker.

<Application to electrical equipment with vibration function>
For example, in order for office workers to refresh themselves during breaks, it is conceivable to relax the stiffness of facial muscles with a facial device having a vibration function. It is effective to relax once to maintain concentration, but it is even better if you can change your mind after using the facial equipment so that you can start working immediately.

Therefore, the solution providing system of the present invention may be used together with an electric device such as a facial device having a vibration function.

In this case, the solution provision system is linked with the timer of the facial equipment, and provides a solution to guide the user to a relaxed state (a state in which the parasympathetic nerve is dominant) in the first half stage such as vibration for facial treatment. However, in the latter half of the stage, such as vibration for facial beauty, it is configured to provide a solution for guiding the user to an awake state (a state in which the sympathetic nerve is dominant).

According to the present invention, the user can be temporarily relaxed, and at the same time, he / she can switch his / her feelings to the awake state for the work after the break so that he / she can start the work immediately.

<Use at accommodation facilities>
The solution providing system of the present invention may be used together with services in accommodation facilities such as hotels and inns.

In this case, for example, the user information acquisition unit 111 is provided in a terminal installed at the front of an accommodation facility such as a hotel or an inn, and acquires user information of the facility user such as a guest.

The solution determined by the solution determination unit 313 includes the scent provided in the guest room used by the user, the bath salt, the accommodation facility service content including the content of the meal, and the like.

The decision result of the solution decision unit 313 is sent to the person in charge of customer service at the hotel or inn, and is reflected in the service content to the user.

According to the present invention, it is possible to provide a more comfortable stay experience to the user of the facility and effectively guide the user to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue.

<Use for sightseeing and passenger services>
The solution providing system of the present invention may be used together with tourism and passenger services.

In this case, for example, the user information acquisition unit 111 is provided with a means of transportation used by the traveler during the trip, and acquires the user information of the traveler.

The solution determined by the solution determination unit 313 includes, for example, music, audio, video, scent, vibration, brightness and color of lighting provided in the cabin of a means of transportation or in a seat.

According to the present invention, it is possible to provide a more comfortable travel experience for the traveler and effectively guide the user to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue.

<Use at event venues such as planetariums, aquariums, and movie theaters>
The solution providing system of the present invention may be used at an indoor / outdoor event venue such as a planetarium, an aquarium, a movie theater, or a museum or an amusement park.

In this case, the user information acquisition unit 111 is provided, for example, via a camera and a heart rate monitor provided in a device installed in the event venue or a portable device, or a camera and a heart rate monitor provided in the user's mobile terminal 10. Get user information, including information about the user's face, skin images of fingers, and heartbeat.

Then, the user state information generation unit 311 generates the user state information based on the acquired information, and the solution providing unit 113 is provided in, for example, a device installed in the event venue or a portable device, or a user. Through the vibration generation unit included in the mobile terminal 10 of the above, a predetermined periodic vibration according to the user state information is provided to the user.

For example, the cycle at the start of a predetermined periodic vibration according to the user state is almost synchronized with the user's heartbeat, and then the vibration pattern vibration that gradually increases or decreases the cycle is solved. To be determined as.

This is intended to make the user more relaxed or activated by utilizing the pulling effect that the heartbeat cycle is synchronized with the vibration provided to the user. This allows the user to watch with a more relaxed feeling, for example, in a planetarium or an aquarium, or can induce the user's feeling to be activated with the image of an action movie, for example, in a state including the user's mood. You can make changes. In this way, by enabling the solution providing system to be used in combination with a realistic experience, the user's condition can be relaxed, calm, excited, or recovered from fatigue. Can be effectively induced.

According to the present invention, according to the content of the event, the experience of the event is made more impressive and good, and the user is effectively guided to a relaxed state, a calm state, an awake state, or a state of recovery from fatigue. be able to.

The examples of the mounting method of the present invention have been described above, but it goes without saying that these are merely examples of the assumed mounting methods and may be applied to other mounting methods related to or derived from them. Further, various changes can be made without departing from the spirit of the present invention.

For example, the autonomic nerve balance acquisition unit 317 refers to a correspondence table in which the above-mentioned pattern of intonation of a person's speech and the autonomic nerve balance are associated with each other, and a characteristic intonation pattern extracted from voice data included in user information. The autonomic nerve balance associated with may be acquired as the autonomic nerve balance information.

Alternatively, for example, the autonomic nerve balance acquisition unit 317 is output by inputting a characteristic phrase included in the linguistic information into a model that inputs a characteristic phrase included in the linguistic information and outputs the autonomic nervous balance. The autonomic nerve balance may be acquired as the autonomic nerve balance information.

Alternatively, for example, the user state information generation unit 311 may use one or both of a dictionary corresponding to a word and a user state and a determination model in which the word is input and the user state is output, based on the characteristic words and phrases contained in the language information. May be used to acquire the user's emotional or fatigued state.

In this case, the user state information generation unit 311 refers to, for example, a dictionary of correspondence between words and phrases and emotions or fatigue states, and sets an index value indicating the user's emotions or fatigue states corresponding to the characteristic words and phrases contained in the language information. get.

Alternatively, for example, the user state information generation unit 311 may use one or both of a dictionary corresponding to the intonation and the user state and a determination model in which the intonation is input and the user state is output, based on the characteristic intonation contained in the linguistic information. May be used to obtain an index value indicating a user's emotional or fatigued state.

In this case, the user state information generation unit 311 inputs, for example, a characteristic intonation included in the language information into the determination model and acquires an index value indicating the user's emotional or fatigue state output.

Alternatively, for example, in the above, an example in which a negative phrase and a user state are stored in association with each other in the corresponding dictionary 331 has been described, but the present invention is not limited to this. That is, for example, a positive phrase indicating joy or enjoyment, or a phrase indicating relaxation or excitement may be stored in association with the user state.

Alternatively, for example, the user information acquisition unit 111 acquires a moving image of the user's face or a still image in which the user's face is continuously captured as user information via a camera, and the language information analysis unit 319 obtains a moving image of the face. The user's emotion score is calculated by acquiring the type and intensity of the user's emotion as characteristic information from the shape and angle of the eyebrows, eyes, nose or mouth included in the image or still image, and the user state information generation unit 311 , May be configured to generate user status information using the emotion score.

Alternatively, for example, the solution determination unit 313 may be configured to determine the vibration cycle based on the user state information and the desired state information.

More specifically, for example, the solution determination unit 313 determines the vibration cycle so that the cycle at the start of the vibration is substantially synchronized with the user's current heartbeat based on the information regarding the heartbeat.

Then, the solution determination unit 313 determines, for example, a pattern of change in one or both of the period and the intensity after the start of vibration based on the desired state information.

That is, for example, when the solution determination unit 313 should induce a state in which the user's tension is relaxed, such as a relaxed state or a calm state, based on the desired state information, the cycle is gradually set after the start of vibration. Determine the solution to change the cycle to be longer. This induces the user to move the current autonomic balance toward a more parasympathetic-dominant state, resulting in a relaxed and calm state.

Alternatively, for example, the solution determination unit 313 gradually shortens the vibration cycle after the start of the vibration, or replaces or additionally, when the user should be guided to the awake state based on the desired state information. Determine the solution to change the cycle so that the strength of the is stronger. As a result, the user is awakened by inducing the current autonomic balance toward a more sympathetic-dominant state.

Alternatively, for example, the solution determination unit 313 changes the vibration cycle and intensity so as to guide the user state toward the state indicated by the reference state information based on the reference state information when there is no input of the desired state. Determine the vibration pattern as a solution.

Alternatively, in the above, the skin image analysis unit 117 of the mobile terminal 10 acquires the information necessary for acquiring the information related to the heartbeat from the skin image, and the heartbeat information acquisition unit 315 of the user of the server 30 acquires the information related to the heartbeat. Although the configuration for acquiring information on the heart rate based on the information required for the above has been described, the present invention is not limited to this.

That is, for example, the skin image analysis unit 117 or the heartbeat information acquisition unit 315 may acquire information on the heartbeat from the skin image. In that case, one of the skin image analysis unit 117 and the heart rate information acquisition unit 315 is omitted.

Alternatively, for example, the user information acquisition unit 111 may acquire the answer to the question about the facial condition, which has a correlation with the emotion or fatigue condition appearing on the user's face, as the user status information.

More specifically, the user information acquisition unit 111 first displays a moving image of the user's face captured by the camera, which is the input unit 130, or a still image of the user's face continuously captured on the display unit 153. , A question about the facial condition, which correlates with the emotion or fatigue condition appearing on the user's face displayed on the display unit 153, is displayed on the display unit 153.

Then, the user information acquisition unit 111 accepts the input of the answer by the user to the question via the input unit 130 in a state where the face image is displayed on the display unit 153. In this case, the input unit 130 is arranged at a position where the operation can be performed while looking at the question.

The answer to the question about the condition of the face may be input by voice or text, or may be input by, for example, letting the user select which of the five grades it corresponds to. Further, the question may be one or more.

Alternatively, for example, the user information acquisition unit 111 inputs an answer to the question by the user while showing the image of the user's face reflected in the mirror unit that reflects the user's face, instead of displaying the image of the face on the display unit 153. It may be configured to accept.

In this case, the display unit 153 is arranged at a position where the user can see the user's face reflected in the mirror unit at the same time, and the input unit 130 operates while looking at the user's face reflected in the mirror unit and the question displayed on the display unit. Is placed in a position where you can do.

<Structure of the second embodiment>
Next, the configuration of the solution providing system according to the second embodiment of the present invention will be described with reference to FIG.

The solution providing system of this embodiment is a computer system including a mobile terminal 10 and a server 30. The mobile terminal 10 and the server 30 are connected to each other so as to be able to communicate with each other by a communication network 90 such as a mobile phone network. The number of mobile terminals 10 and the number of servers 30 may be plural.

The mobile terminal 10 includes a mobile terminal control unit 1110 and an output unit 1130, or further includes an imaging unit 1150, an input unit 1170, and a history storage unit 1190, for example, a smartphone, a tablet terminal, or the like. It is a general-purpose terminal. Alternatively, the mobile terminal 10 may be a dedicated terminal that can be carried by the user.

The mobile terminal control unit 1110 is composed of an arithmetic processing device such as a CPU, a memory, an I / O device, and the like. The mobile terminal control unit 1110 functions as, for example, a user information acquisition unit 1111 and a solution providing unit 1113, or further as a display control unit 1115 and a response receiving unit 1117 by reading and executing a predetermined program.

The user information acquisition unit 1111 acquires user information including information obtained from the user's body or movement via, for example, the image pickup unit 1150 and the input unit 1170.

The solution providing unit 1113 provides the solution determined by the solution determining unit 1313 to the user via the output unit 1130.

The display control unit 1115 displays the image of the user's face imaged by the image pickup unit 1150 on the display unit 1133, and displays a question about the state of the user's face displayed on the display unit 1133 on the display unit 1133. To control. The question is a question that has a correlation with the emotion or fatigue state appearing on the user's face.

The answer reception unit 1117 accepts the input of the answer by the user to the question about the user's facial condition via the input unit 1170 in a state where the face image is displayed on the display unit 1133.

The output unit 1130 includes, for example, a vibration generation unit 1131, a display unit 1133, a voice reproduction unit 1135, and a scent generation unit 1137, and provides a solution to the user under the control of the solution provision unit 1113 and the like. ..

The vibration generation unit 1131 is, for example, a vibrator that provides the user with a predetermined periodic vibration when the solution determined by the solution determination unit 1313 includes a predetermined periodic vibration according to the user state information. ..

The display unit 1133 is a display that displays the display information and provides it to the user when the display information including information for promoting a predetermined operation or an image for improving the user state is included according to the user state information. ..

The voice reproduction unit 1135 is a speaker that reproduces the voice and provides it to the user when the solution includes a human voice, a natural sound, or a voice including music according to the user status information.

The scent generation unit 1137 generates a scent and provides it to the user when a predetermined scent according to the user status information is included in the solution.

The image pickup unit 1150 is, for example, a camera, and acquires an image of the user's face.

The input unit 1170 is, for example, an input mechanism for characters such as a touch panel and a keyboard and selection results, and is used when the answer reception unit 1117 accepts an input of an answer by a user to a question about a user's facial condition. The input unit 1170 is arranged at a position where the operation can be performed while looking at the image of the user's face displayed on the display unit 1133 and the question about the state of the face.

The history storage unit 1190 is composed of storage devices such as ROM, RAM, and HDD. The history storage unit 1190 stores the information of the solution provided to the user for a predetermined period or a predetermined number of times, and also stores the information necessary for the processing of the mobile terminal, the processing result of the mobile terminal, and the like. ..

The history storage unit 1190 is configured not to store the face image and the user status information included in the user information, for example.

The server 30 is, for example, a computer configured to include a server control unit 1310 and a solution storage unit 1330.

The server control unit 1310 is composed of an arithmetic processing unit such as a CPU, a memory, an I / O device, and the like. The server control unit 1310 functions as, for example, a user state information generation unit 1311 and a solution determination unit 1313 by reading and executing a predetermined program.

The user state information generation unit 1311 generates user state information indicating the user state of the user based on the information acquired from the body or movement acquired by the user information acquisition unit 1111.

The solution determination unit 1313 determines a solution according to the user status information from a plurality of solutions stored in the solution storage unit 1330.

The solution storage unit 1330 is composed of storage devices such as ROM, RAM, and HDD. The solution storage unit 1330 contains information on a plurality of solutions that can be provided to the user in order to improve the user condition, which is one or both of the user's emotional and fatigue states, as well as information and solutions necessary for processing the solution providing system. It stores the processing results of the provided system.

The solution information stored in the solution storage unit 1330 may be digital data itself such as music, voice, video, a predetermined periodic vibration pattern, or code information such as an ID that identifies a predetermined scent. It may be there. When these solutions are provided to the user alone or in combination, they function as a solution for improving the user's emotional and / or fatigued state.

The user's emotions include so-called psychological states such as emotions and negative states, as well as the state of autonomic nervous balance as one of the indicators of whether the person is in an excited state or a relaxed state, and awakening and rest. It is a concept that includes the state of self-awareness by the user such as, calmness, and liberation.

<Outline of processing>
Next, the processing contents of the solution providing system of this embodiment will be described. First, a series of processes by the solution providing system will be described with reference to FIG.

<User information acquisition process>
When a series of processes are started, first, the user information acquisition unit 1111 of the mobile terminal 10 acquires the user information and transmits it to the server 30 (FIG. 9 / S1110).

More specifically, for example, as shown in FIG. 10, the user information acquisition unit 1111 acquires an image of the user's face via the image pickup unit 1150 (FIG. 10 / S1111).

Then, the display control unit 1115 displays the image of the user's face imaged by the image pickup unit 1150 on the display unit 1133, and displays a question about the state of the user's face displayed on the display unit 1133 on the display unit 1133. (FIG. 10 / S1113).

The answer reception unit 1117 accepts the input of the user's answer to the question about the user's face condition via the input unit 1170 with the face image displayed on the display unit 1133. (FIG. 10 / S1115).

The answer reception unit 1117 displays, for example, a plurality of questions about the condition of the user's face and answer options in order for each question, and accepts the options selected by the user as answers to the question.

The user information acquisition unit 1111 acquires the answer to the question about the facial condition received in this way as the user status information.

The answer to the question about the condition of the face may be input by, for example, letting the user select which of the five grades it corresponds to, or may be input by voice or text. Further, the question may be one or more.

Then, the user information acquisition unit 1111 analyzes the facial image (FIG. 10 / S1117). That is, for example, the user information acquisition unit 1111 acquires information necessary for acquiring information on the heartbeat from the face image as an analysis result of the face image.

Various known methods may be used as a method for the user information acquisition unit 1111 to acquire information necessary for acquiring information related to the heartbeat from the face image, and the user information acquisition unit 1111 is, for example, a face image. Information on changes in the brightness of each color component of RGB is acquired from a moving image or a continuously captured still image.

Then, the user information acquisition unit 1111 responds to the question about the facial condition of the user who has received the input in this way, and the analysis result of the facial image (for example, RGB which is information necessary for acquiring information about the heartbeat). Information on changes in the brightness of each color component of the above) and is transmitted to the server 30 as user information (FIG. 10 / S1119).

<User information analysis processing>
Then, the user state information generation unit 1311 of the server 30 receives the user information (FIG. 9 / S1210), and the user information such as the answer by the user to the question about the user's face state and the analysis result of the face image. The information contained in is analyzed (FIG. 9 / S1230).

More specifically, for example, the user state information generation unit 1311 acquires information on the user's heartbeat from the information on the change in the luminance of each color component of RGB, which is the information necessary for acquiring the information on the heartbeat (FIG. 11 / S1231). ).

As a method for the user state information generation unit 1311 to acquire information on the user's heartbeat from the information necessary for acquiring the information on the heartbeat, various known methods may be used, and the user state information generation unit 1311 is, for example, RGB. The user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of each color component in the above using a predetermined algorithm.

Further, the user status information generation unit 1311 calculates and acquires index values such as CVR-R and CCVTP from the user's heart rate, for example, heart rate, heart rate interval, or these information.

Then, the user state information generation unit 1311 uses a predetermined algorithm from index values such as CVR-R and CCVTP to indicate a fatigue state based on the user's heartbeat in 0.1 increments between 0 and 10. Is calculated.

After that, the user status information generation unit 1311 acquires the autonomic nerve balance information based on the information related to the heartbeat (FIG. 11 / S1233).

Various methods may be used as the method for the user state information generation unit 1311 to acquire the autonomic nerve balance information. That is, for example, the user state information generation unit 1311 analyzes the fluctuation of the heartbeat by frequency, and obtains the ratio (LF / HF value) of the low frequency component LF and the high frequency component HF of the heartbeat fluctuation to the autonomic nerve balance information. Get as.

Then, the user state information generation unit 1311 calculates an autonomic nerve balance score indicating the balance of the user's autonomic nerve in 0.1 increments between 0 and 10 using a predetermined algorithm from the autonomic nerve balance information.

Then, the user status information generation unit 1311 analyzes the user's answer to the question about the user's facial condition included in the user status information (FIG. 11 / S1235).

More specifically, the user state information generation unit 1311 obtains, for example, a value obtained by adding the values associated with each option selected by the user for each question about the state of the user's face.
The signs of fatigue appearing on the user's face are quantified as a quantified fatigue sign score, and the fatigue sign score is determined as an analysis result.

<User status information generation process>
Then, the user state information generation unit 1311 generates user state information indicating the user state of the user based on the analysis result in the user information analysis process (FIG. 9 / S1250).

For example, the user state information generation unit 1311 uses the combination of the fatigue degree score based on the heartbeat, the autonomic nerve balance score, and the fatigue sign score obtained above as the user state information.

<Solution decision process>
Then, the solution determination unit 1313 determines a solution according to the user status information and transmits it to the mobile terminal 10 (FIG. 9 / S1270).

More specifically, for example, a combination of a fatigue degree score based on a heartbeat, an autonomic nerve balance score, and a fatigue sign score and a correspondence table with the solution are stored in advance in the solution storage unit 1330, and the solution determination unit 1313 , A solution provided to the user by recognizing a solution corresponding to the combination of the fatigue degree score, the autonomic nervous balance score, and the fatigue sign score obtained as described above by referring to the corresponding table. To decide.

That is, for example, if the fatigue score based on the heartbeat or the sign of fatigue score is high, a predetermined periodic vibration having an effect of lowering the fatigue, a human voice, a voice including natural sound or music, a predetermined scent, and a predetermined. The information that promotes the operation or the image for improving the user condition is determined alone or a combination thereof according to the user condition as a solution to be provided to the user.

Alternatively, when the autonomic nerve balance score indicates a state in which the autonomic nerve balance is not well-balanced, for example, the sympathetic nerve or the parasympathetic nerve is excessively dominant, a predetermined periodic period having an effect of adjusting the autonomic nerve balance is obtained. Vibration and the like are determined alone or a combination of these according to the user's condition as a solution to be provided to the user.

<Solution provision process>
Then, the solution providing unit 1113 receives the solution from the server 30 (FIG. 9 / S1310) and provides the received solution to the user (FIG. 9 / S1330).

More specifically, the solution providing unit 1113 has a predetermined periodic period via the vibration generating unit 1131, the display unit 1133, the voice reproducing unit 1135, and the scent generating unit 1137, depending on the content of the solution received from the server 30. Tactile stimuli such as vibrations, human voices, natural sounds (bird's voice, stream babbling, etc.) or auditory stimuli such as voice including music, olfactory stimuli such as predetermined scents, to improve user status It provides users with passive stimuli such as visual stimuli such as images, and active stimuli containing information that encourages the user to perform predetermined actions.

That is, for example, if the received solution is digital data of music, the solution providing unit 1113 causes the voice reproduction unit 1135 to play the music. Alternatively, for example, if the received solution has an ID that specifies a predetermined scent, the solution providing unit 1113 generates a scent corresponding to the ID in the scent generating unit 1137. Or, for example, if the received solution is information that encourages the user to perform a given action, then change at regular intervals, "Let's do a simple mindfulness meditation while feeling the vibration", "Stretch your spine and correct your posture. The display unit 1133 displays a combination of sentences that encourage breathing or meditation in a predetermined motion or in a predetermined manner, such as "Let's relax your shoulders and breathe slowly through your nose", or the voice playback unit 1135. Played by.

As described above, according to the present invention, it is possible to analyze a user's emotion or fatigue state and easily provide an appropriate solution according to the user's emotion or fatigue state.

The embodiments of the present invention have been described above, but the present invention is not limited thereto. Various changes can be made without departing from the spirit of the present invention.

That is, for example, the user status is considered to improve gradually rather than rapidly. Therefore, it is expected that the solutions of the last few times or the last period will be the same solution.

Therefore, for example, the mobile terminal 10 may be configured to store the solution provided to the user in the history storage unit 1190 for a predetermined period or a predetermined number of times.

In this case, the solution determination unit 1313 is configured not to transmit the determined solution to the mobile terminal 10 when the determined solution is stored in the history storage unit 1190.

Then, when the solution determined by the solution determination unit 1313 is stored in the history storage unit 1190, the solution provision unit 1113 acquires the determined solution from the history storage unit 1190 and provides the solution to the user. It is composed.

Various methods may be adopted as a method for the solution determination unit 1313 to determine whether or not the determined solution is stored in the history storage unit 1190 of the mobile terminal 10.

That is, for example, the solution determination unit 1313 stores information specifying a solution determined in the past in the solution storage unit 1330 for a predetermined period or a predetermined number of times. The predetermined period or the predetermined number of times is the same as the period or the number of times stored in the history storage unit 1190 of the mobile terminal 10.

Then, the solution determination unit 1313 determines whether or not the solution determined this time matches any of the solutions stored in the solution storage unit 1330, and when the matching solution is stored in the solution storage unit 1330. In addition, it is determined that the determined solution is stored in the history storage unit 1190 of the mobile terminal 10.

In this case, the solution determination unit 1313 does not send the determined solution to the mobile terminal 10, and instead, the information that identifies which solution the determined solution is stored in the history storage unit 1190. Is transmitted to the mobile terminal 10.

Then, the solution providing unit 1113 receives information from the server 30 that identifies which solution is stored in the history storage unit 1190, and transfers the corresponding solution from the history storage unit 1190. Get it and provide it to the user.

Alternatively, for example, as shown in FIG. 12, the server 30 may be omitted, and all the functions described above that the server 30 has may be provided in the mobile terminal 10. That is, the mobile terminal 10 includes a user state information generation unit 1311A, a solution determination unit 1313A, and a solution storage unit 1330A, which are the same as the user state information generation unit 1311, the solution determination unit 1313, and the solution storage unit 1330 described above. It is composed of.

Alternatively, for example, the user information acquisition unit 1111 inputs an answer to the question by the user while showing the image of the user's face reflected in the mirror unit that reflects the user's face, instead of displaying the image of the face on the display unit 1133. It may be configured to accept.

In this case, the display unit 1133 is arranged at a position where the user can see the user's face reflected in the mirror unit at the same time, and the input unit 1170 looks at the user's face reflected in the mirror unit and the question displayed on the display unit 1133. It is placed in a position where it can be operated.

Alternatively, for example, the user information acquisition unit 1111 recognizes whether the user is in the first situation where the image of the skin of the fingers should be acquired or the second situation where the image of the skin of the face should be acquired. When the user is in the first situation, the user information including the image of the skin of the finger of the user is acquired, and when the user is in the second situation, the user information including the image of the skin of the user's face is acquired. It may be configured as follows.

In this case, the user state information generation unit 1311A generates user state information based on the image of the user's face acquired by the user information acquisition unit 1111 when the user is in the first situation, and the user is in the second situation. In the case of, the user state information is generated based on the image of the user's face acquired by the user information acquisition unit 1111.

For example, the user information acquisition unit 1111 displays a selection button for selecting whether the user is in the first situation or the second situation on the display of the mobile terminal 10 and causes the user to select the first situation. Recognize whether you are in the 1st situation or the 2nd situation. Alternatively, for example, the user information acquisition unit 1111 may recognize whether the user is in the first situation or the second situation based on the current time zone. That is, for example, the user information acquisition unit 1111 recognizes that it is the first situation in the daytime time zone and the second situation in the night time zone before going to bed.

<Structure of the third embodiment>
Next, the solution providing system of the third embodiment will be described with reference to FIG. The solution providing system of this embodiment has a function as a state improving device.

This state improving device is for giving a vibration stimulus to the user to improve the user's mental and physical condition, and more specifically, providing a vibration stimulus to be the user's mental and physical state, for example. It is a device that promotes improvement of the user's work efficiency, fatigue state, and ease of introducing sleep (hereinafter referred to as "user state").

The condition improvement device will be described below. The state improving device includes a device control unit 2010, a storage unit 2020, and a stimulus generation unit 2030, or further includes an image pickup unit 2050, a display unit 2070, and an input unit 2090. As the main body of the state improving device, a general-purpose device such as a smartphone or a tablet may be used, but a dedicated terminal may be used. Further, for example, a part of the mechanism constituting the state improving device such as the stimulus generation unit 2030 may be provided as an external device separated from the main body of the state improving device.

The device control unit 2010 is composed of an arithmetic processing device such as a CPU, a memory, an I / O device, and the like. The device control unit 2010 of the present embodiment functions as, for example, a heartbeat recognition unit 2110 and a stimulus content determination unit 2130 by reading and executing a predetermined program, or further, an autonomic nerve state recognition unit 2150 and a desired state reception unit 2170. , The answer reception unit 2190, the user status information acquisition unit 2210, and the mode reception unit 2230.

Further, the state improving device of the present embodiment has functions as a user information acquisition unit, a user state information generation unit, a solution determination unit, and a solution provision unit. The user information acquisition unit acquires information indicating the user's heartbeat as user information, and has a function as the autonomic nerve state recognition unit 2150.

Further, the user state information generation unit generates user state information based on the user information, and has functions as the heart rate recognition unit 2110 and the desired state reception unit 2170. The user state information generation unit may be configured to further have a function as an autonomic nerve state recognition unit 2150.

On the other hand, the solution determination unit determines the solution to be provided to the user, and has a function as the stimulus content determination unit 2130. Further, the solution providing unit provides the solution to the user and has a function as the stimulus generating unit 2030.

The heartbeat recognition unit 2110 acquires information indicating the user's heartbeat and recognizes the tempo of the user's heartbeat from the information indicating the heartbeat. The heartbeat recognition unit 2110 recognizes information indicating the user's heartbeat based on, for example, an image of the skin of the user's face or fingers imaged by the image pickup unit 2050.

The stimulus content determination unit 2130 determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 as the stimulus provided to the user, for example, the tempo of vibration and sound. Alternatively, the stimulus content determination unit 2130 determines the content of the stimulus based on the information indicating the user's heartbeat, the sign information included in the user status information acquired by the user status information acquisition unit 2210, or the information regarding the LF / HF value.

Further, the stimulus content determination unit 2130 determines the content of information or scent of, for example, sound, characters or images to be provided to the user in combination with vibration which is a stimulus provided to the user.

The autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve. The autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve based on the information indicating the user's heartbeat acquired by the heartbeat recognition unit 2110, for example. Alternatively, for example, the autonomic nerve state recognition unit 2150 may recognize the state of the user's autonomic nerve based on information indicating the user's respiration, blood pressure, body temperature, sweating, urination, and other states.

The desired state reception unit 2170 accepts the user's designation of the desired state indicating the user's desired state, for example, via the input unit 2090.

The answer reception unit 2190 accepts the input of the answer by the user to the question regarding the user's facial condition displayed on the display unit 2070, for example, via the input unit 2090.

The user status information acquisition unit 2210 acquires user status information including sign information indicating the user status appearing on the user's face based on the response received by the response reception unit 2190. Alternatively, the user status information acquisition unit 2210 acquires user status information including information on the user's LF / HF value based on the information indicating the user's heart rate recognized by the heart rate recognition unit 2110.

The mode reception unit 2230 recognizes the user's heart rate based on the image of the skin of the user's face and the second mode of recognizing the heart rate of the user based on the image of the skin of the user's fingers. And, the user's designation of the operation mode including, is accepted, for example, via the input unit 2090.

The storage unit 2020 is composed of a storage device such as a ROM, a RAM, or an HDD.

The storage unit 2020 is, for example, a vibration, or even a sound, a character, for improving the mental and physical state of the user, such as work efficiency, fatigue state, and ease of introducing sleep (hereinafter referred to as "user state"). In addition to storing stimulus information consisting of image and scent information, it also stores the processing results of the state improving device and the information necessary for processing the state improving device. The sound is, for example, a human voice, music, a natural sound (including a wave, a wind sound, or a synthetic sound imitating these).

The stimulus generation unit 2030 is a mechanism for generating a stimulus at a tempo determined by the stimulus content determination unit 2130 toward the user, and is configured to include a vibration unit 2310 such as a vibrator that generates vibration, or further emits a scent. It is configured to include a scent generating unit 2350 to be generated.

Alternatively, when the stimulus provided to the user includes sound, the sound reproduction unit 2040 such as a speaker is used, and when characters and images (still image or moving image, etc.) are included, the display unit 2070 is used as the stimulus generation unit 2030. Function.

The image pickup unit 2050 is, for example, a camera that acquires an image of the user's face, an image of the face or the skin of the fingers.

The display unit 2070 is, for example, a display, and displays an image of the user's face imaged by the image pickup unit 2050. Further, the display unit 2070 functions as an output unit that outputs the question to the user when the question regarding the state of the user's face displayed on the display unit 2070 is output as characters or images.

When a question regarding the state of the user's face displayed on the display unit 2070 is output by voice, the sound reproduction unit 2040 functions as an output unit.

The input unit 2090 is, for example, a touch panel that receives input from the user to the state improving device, but may be configured by an input mechanism that is a keyboard, a mouse, or other pointing device.

<Outline of processing>
Next, the processing contents of the state improving apparatus of this embodiment will be described with reference to FIGS. 21 to 28. FIG. 21 shows the contents of the overall processing of the state improving device of the present embodiment.

In the state improving device of the present embodiment, when the process is started, the desired state receiving unit 2170 first receives the user's designation of the desired state indicating the user's desired state (FIG. 21 / S2011).

The desired states indicating the user's desired states are, for example, "sympathetic nerve dominant state", "parasympathetic nerve dominant state", "work efficiency state", "fatigue recovery state", and "sleep introduction". Although it is "easy to do", other mental and physical conditions of the user may be adopted as appropriate.

After that, the imaging unit 2050 acquires an image of the user's face (FIG. 21 / S2031), and the answer receiving unit 2190 accepts the input of the user's answer to the question regarding the user's facial condition (FIG. 21 / S2033).

More specifically, the display unit 2070 displays the image of the user's face captured by the image pickup unit 2050, and outputs a question regarding the state of the user's face displayed on the display unit 2070 to the user. .. Then, the answer reception unit 2190 accepts the input of the answer by the user to the question regarding the condition of the user's face via the input unit 2090.

The question is a question that has a correlation with the mental and physical conditions such as the user's work efficiency, fatigue state, and sleep quality appearing on the user's face. , "Darkness of bears around the eyes", "Acne or pimples", "Rising or lowering of the corners of the mouth", "Moisturizing lips".

Subsequently, the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat (FIG. 21 / S2035). For example, the heartbeat recognition unit 2110 acquires information indicating the user's heartbeat based on the image of the skin of the user's face imaged by the image pickup unit 2050. The image of the skin of the user's face may be captured in the process of S2031, and may be captured again at the start of the process of S2035, for example.

Various known methods may be used as a method for the heartbeat recognition unit 2110 to acquire information indicating the user's heartbeat from an image of the skin of the user's face. The heartbeat recognition unit 2110 may use, for example, the skin of the user's face. Information indicating the user's heartbeat is acquired by analyzing the change in the brightness of a specific color component (for example, G (green)) included in the information on the change in the brightness of each RGB color component of the image using a predetermined algorithm. do.

Then, the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat from the information indicating the heartbeat acquired as described above. The heart rate recognition unit 2110 recognizes, for example, the heart rate per minute (bpm) as the tempo of the user's heartbeat.

After that, the user status information acquisition unit 2210 executes a process of acquiring the user status information (FIG. 21 / S2037) as necessary, and the details of the process will be described later.

Then, the stimulus content determination unit 2130 determines the tempo of the stimulus to be provided to the user based on the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 (FIG. 21 / S2050), and further determines the content of the stimulus as necessary. Is determined (FIG. 21 / S2080). Details of the process for determining the tempo and content of the stimulus will be described later.

Then, the stimulus generation unit 2030, for example, the vibration unit 2310 or the sound reproduction unit 2040, generates a stimulus at a tempo determined by the stimulus content determination unit 2130 toward the user (FIG. 21 / S2091). A series of processes of the state improving device of the above is completed.

<Process to acquire user status information>
A process of acquiring user status information will be described with reference to FIG. 22.

When the process is started, the autonomic nerve state recognition unit 2150 recognizes the state of the user's autonomic nerve (FIG. 22 / S2039).

Various methods may be used as a method for the autonomic nerve state recognition unit 2150 to recognize the state of the user's autonomic nerve. That is, for example, the user status information acquisition unit 2210 frequency-analyzes the fluctuation of the heartbeat based on the information indicating the heartbeat of the user acquired by the heartbeat recognition unit 2110, and uses the LF and the high-frequency component, which are low-frequency components of the fluctuation of the heartbeat. The ratio (LF / HF value) with a certain HF is acquired as autonomic nerve balance information.

Then, the user status information acquisition unit 2210 recognizes the sign information indicating the user's condition appearing on the user's face based on the response received by the response reception unit 2190 (FIG. 22 / S2041).

More specifically, for example, the user status information acquisition unit 2210 outputs a value obtained by adding the values associated with each option selected by the user to each question about the user's face condition on the user's face. It is calculated as the score of the sign of the user status, and the score is recognized as the sign information.

Further, the user status information acquisition unit 2210 recognizes information regarding the user's LF / HF value based on the information indicating the user's heart rate recognized by the heart rate recognition unit 2110 (FIG. 22 / S2043).

More specifically, for example, the user state information acquisition unit 2210 recognizes the LF / HF value recognized by the autonomic nerve state recognition unit 2150 as the state of the user's autonomic nerve in S2039.

Further, the user status information acquisition unit 2210 determines the autonomic nerve balance score, which is an index of the LF / HF value by a score between 1 and 10. For example, it is determined that the more predominant the sympathetic nerve is, the closer the score is to 1, and the more predominant the parasympathetic nerve is, the closer the score is to 10.

Then, the user state information acquisition unit 2210 acquires the score of the sign of the user state and the autonomic nerve balance score recognized in this way as the user state information (FIG. 22 / S2045), and ends the process of acquiring the user state information. do.

<Stimulation tempo determination process>
First, with reference to FIG. 23, a case where the desired state received by the desired state receiving unit 2170 is the “dominant state of the sympathetic nerve” and the “dominant state of the parasympathetic nerve” will be described.

When the process is started, the stimulus content determination unit 2130 first determines the tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 as the tempo at the start of the vibration that is the stimulus (FIG. 23 / S2051).

Note that "tempo synchronized with the tempo of the user's heartbeat" does not mean only that it completely matches the tempo of the user's heartbeat. That is, for example, when the tempo of the user's heartbeat is 85 to 89 bpm, 85 bpm is determined as the stimulus tempo. , The recognized tempo may be configured to be determined as the tempo of the stimulus.

After that, the stimulus content determination unit 2130 determines the desired state received by the desired state reception unit 2170 (FIG. 23 / S2053).

When the desired state received by the desired state receiving unit 2170 is a "dominant state of the sympathetic nerve", the stimulus content determining unit 2130 is set to increase the speed stepwise, for example, from the start time to the end time of the stimulus. Determine the change in tempo (FIG. 23 / S2055).

More specifically, for example, the stimulus content determination unit 2130 refers to a table as shown in FIG. 24, which is stored in advance in the storage unit 2020, so that the tempo becomes faster from the start time to the end time of the stimulus. Recognize that the tempo at the end is "150% of the tempo of the user's heartbeat" when determining the change.

Then, for example, when the tempo of the user's heartbeat (that is, the tempo at the start of the stimulus) is 55 bpm, 55 bpm × 150% = 82.5 bpm is determined as the tempo at the end of the stimulus.

On the other hand, when the desired state received by the desired state receiving unit 2170 is a "predominant state of the parasympathetic nerve", the stimulus content determining unit 2130 is gradually delayed from the start time to the end time of the stimulus, for example. The change in tempo is determined as follows (FIG. 23 / S2057).

More specifically, for example, the stimulus content determination unit 2130 refers to a table as shown in FIG. 24, which is stored in advance in the storage unit 2020, so that the tempo becomes slower from the start time to the end time of the stimulus. Recognize that the tempo at the end is "80% of the tempo of the user's heartbeat" when determining the change.

Then, for example, when the tempo of the user's heartbeat (that is, the tempo at the start of the stimulus) is 75 bpm, the stimulus content determination unit 2130 determines 75 bpm × 80% = 60 bpm as the tempo at the end of the stimulus.

In this way, when the stimulus content determination unit 2130 determines the change so that the tempo becomes slower from the start time to the end time of the stimulus, the stimulus content determination unit 2130 determines a predetermined degree from the tempo of the user's heartbeat recognized by the heart rate recognition unit 2110. When the change is determined so that the slow tempo is the tempo at the end of the stimulus and the change is determined so that the tempo becomes faster from the start point to the end point of the stimulus, the user recognized by the heart rate recognition unit 2110. The change is determined so that the tempo at the end of the stimulus is a tempo that is predetermined to be faster than the tempo of the heartbeat.

When the stimulus content determination unit 2130 determines, for example, a change stored in the storage unit 2020 in advance so that the tempo becomes faster from the start time to the end time of the stimulus with reference to a table as shown in FIG. 24. Recognizing the upper limit of (or the lower limit when determining the change so that the tempo becomes slower from the start to the end of the stimulus), the speed below the predetermined upper limit (or the speed above the lower limit) It may be configured to determine the change so that the tempo of is the tempo at the end of the stimulus.

Then, the stimulus content determination unit 2130 determines the tempo at the start and end of the stimulus, and also determines how to change the tempo from the tempo at the start to the end of the stimulus.

That is, for example, when the tempo at the start of the stimulus is 65 bpm and the tempo at the end is 55 bpm, the stimulus content determination unit 2130 performs the stimulus with a tempo of 65 bpm for 20 seconds and the stimulus with a tempo of 60 bpm for 20 seconds. It is determined that a stimulus with a tempo of 55 bpm is generated for 80 seconds. The length of the stimulus in this case is 120 seconds.

Alternatively, when the tempo at the start of the stimulus is 70 bpm and the tempo at the end is 55 bpm, the stimulus content determination unit 2130 performs a stimulus with a tempo of 70 bpm for 10 seconds and a stimulus with a tempo of 65 bpm for 20 seconds. It is determined that a stimulus with a tempo of 60 bpm is generated for 20 seconds and a stimulus with a tempo of 55 bpm is generated for 70 seconds. The length of the stimulus in this case is also 120 seconds.

Alternatively, for example, when the tempo at the start of the stimulus is 90 bpm and the tempo at the end is 55 bpm, the stimulus content determination unit 2130 performs a stimulus with a tempo of 90 bpm for 10 seconds and a stimulus with a tempo of 85 bpm for 10 seconds. , 80 bpm tempo stimulus for 10 seconds, 75 bpm tempo stimulus for 10 seconds, 70 bpm tempo stimulus for 10 seconds, 65 bpm tempo stimulus for 20 seconds, 60 bpm tempo stimulus for 20 seconds, 55 bpm tempo stimulus It is determined that the stimulus is generated for 60 seconds. The length of the stimulus in this case is 150 seconds.

In this way, the stimulus content determination unit 2130 may determine the length of the stimulus to be different according to the tempo of the user's heartbeat (that is, the tempo at the start of the stimulus).

The stimulus content determination unit 2130 may, for example, store the tempo of the user's heartbeat (or the tempo at the start of the stimulus) stored in the storage unit 2020 in advance, how to change the tempo as described above, the length of the stimulus, and the like. With reference to the information indicating the correspondence with ,, how to change from the tempo at the start of the stimulus to the tempo at the end of the stimulus is determined.

Next, with reference to FIG. 25, a case where the desired state received by the desired state receiving unit 2170 is "a state in which sleep is easily introduced", "a state in which work efficiency is high", and "a state in which fatigue is recovered" will be described.

In this case, after the processing of S2051, the stimulus content determining unit 2130 determines the desired state received by the desired state receiving unit 2170 (FIG. 25 / S2053), and the desired state received by the desired state receiving unit 2170 is determined. , In the case of "a state in which sleep is easily introduced", the tempo change is determined so as to be delayed from the start time to the end time of the stimulus (FIG. 25 / S2059), and the tempo determination process is terminated.

That is, for example, when the stimulus content determination unit 2130 has a tempo of 65 bpm at the start of the stimulus and the tempo of the end point is 50 bpm, the stimulus content determination unit 2130 performs a stimulus with a tempo of 65 bpm for 30 seconds, 60 bpm. It is determined that the tempo stimulus is generated for 32 seconds, the 55 bpm tempo stimulus is generated for 35 seconds, and the 50 bpm tempo stimulus is generated for 130 seconds. The length of the stimulus in the present embodiment is determined to be about 4 minutes, which is longer than the case where the desired state is "a state with high power efficiency" or "a state in which fatigue is recovered" (described later). Then, the time at which the stimulus is generated at the tempo (65 bpm to 55 bpm) before the tempo at the end of the stimulus (50 bpm in the above case) is longer than the length (30 seconds to 35 seconds) of each stage. The change in tempo is determined so that the length of time (130 seconds) for generating the stimulus at the tempo of is longer. Also, the time during which the stimulus is being provided at the end tempo (130 seconds) is determined to be longer than the sum of the previous times (97 seconds). The magnitude of the change in tempo between each stage, the length of each stage, and the length of the entire stimulus may be appropriately set (the same shall apply hereinafter).

On the other hand, when the desired state received by the desired state receiving unit 2170 is a "state with high work efficiency" or a "state in which fatigue has recovered", the stimulus content determining unit 2130 further determines the autonomic nervous state of the user. Judgment (FIG. 25 / S2061).

That is, for example, when the autonomic nerve state recognition unit 2150 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve, the stimulus content determination unit 2130 is delayed from the start time to the end time of the stimulus. The change of the tempo is determined so as to be (FIG. 25 / S2063), and the tempo determination process is terminated.

More specifically, for example, the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve when the user's LF / HF value is 2.0 or more. When the tempo at the start of the stimulus is 65 bpm and the tempo at the end is 50 bpm, the stimulus content determination unit 2130 starts the stimulus at a tempo of 65 bpm, and then the time is 2 minutes. It is determined that the tempo is linearly slowed down to 50 bpm with the same deceleration (that is, negative acceleration) to stop the stimulation with the progress of.

On the other hand, when the autonomic nerve state recognition unit 2150 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo is changed so as to be faster from the start time to the end time of the stimulus. After the determination (FIG. 25 / S2065), the temp determination process is completed.

That is, for example, the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve when the user's LF / HF value is less than 0.8. When the tempo at the start of the stimulus is 50 bpm and the tempo at the end is 75 bpm, the stimulus content determination unit 2130 performs a stimulus with a tempo of 50 bpm for 24 seconds and a stimulus with a tempo of 56.3 bpm. 24 seconds, 62.5 bpm tempo stimulus for 24 seconds, 68.75 bpm tempo stimulus for 24 seconds, 75 bpm tempo stimulus for 24 seconds, that is, increasing the tempo step by step. And decide to stop the stimulation.

Subsequently, with reference to FIG. 26, a case where the change in the tempo of the stimulus is determined according to the autonomic nervous state will be described.

In this case, after the processing of S2051, the stimulus content determination unit 2130 determines the autonomic nervous state of the user (FIG. 26 / S2067).

That is, for example, when the autonomic nerve state recognition unit 2150 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve, the stimulus content determination unit 2130 is delayed from the start time to the end time of the stimulus. The change in the tempo is determined so as to be (FIG. 26 / S2069), and the tempo determination process is terminated.

Alternatively, for example, the stimulus content determination unit 2130 sets the tempo from the start time to the end time of the stimulus when the autonomic nerve state recognition unit 2150 recognizes that the user's autonomic nerve state is in a balanced state. It is decided to maintain (FIG. 26 / S2071), and the tempo determination process is terminated.

Then, for example, when the autonomic nerve state recognition unit 2150 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the stimulus content determination unit 2130 accelerates from the start time to the end time of the stimulus. The change in the tempo is determined so as to be (FIG. 26 / S2073), and the tempo determination process is terminated.

More specifically, for example, the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve when the user's LF / HF value is 2.0 or more. The content of determining the tempo of the stimulus in this case is, for example, the same as in the case of FIG. 25 / S2063 described above.

Alternatively, for example, the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in a balanced state when the user's LF / HF value is 0.8 or more and less than 2.0. Then, it is determined that the stimulus at the tempo at the start of the stimulus (for example, 60 bpm) is generated for 120 seconds.

Further, for example, the stimulus content determination unit 2130 recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve when the user's LF / HF value is less than 0.8. The content of determining the tempo of the stimulus in this case is, for example, the same as in the case of FIG. 25 / S2065 described above.

In any of the above cases, when the stimulus generated toward the user consists of a combination of vibration and sound, the stimulus content determination unit 2130 determines the tempo of the vibration and sound included in the stimulus provided to the user. Determine the tempo so that they synchronize with each other.

That is, for example, if the vibration and the sound start at the same time and end at the same time, the tempo at the start of the vibration and the sound is synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110, and the end of the vibration and the sound. Both tempos at the time points are the same tempo determined by the stimulus content determination unit 2130.

Alternatively, for example, when the vibration included in the stimulus is started first and the sound is started in the middle, the tempo at the start of the sound is the same as the tempo of the vibration at the time when the sound is started. It is determined by the determination unit 2130. Similarly, when one of the vibration and the sound ends first and the other ends later, these tempos are determined by the stimulus content determination unit 2130 so that the tempo of the vibration and the sound are synchronized.

<Determining the content of the stimulus>
The process of determining the content of the stimulus will be described with reference to FIG. 27.

When the process is started, the stimulus content determination unit 2130 determines whether or not one or both of the sign information and the autonomic nerve state information included in the user state information is in a predetermined state (FIG. 27 / S2083), and the user When one or both of the sign information and the autonomic nerve state information included in the state information are in a predetermined state, it is a predetermined action to be performed during the generation of the stimulus, and the user's work efficiency is improved, the fatigue state is improved, and so on. Information that encourages the user to take actions that have an effect of improving the physical and mental condition of the user, such as promoting sleep, is determined (FIG. 27 / S2085).

The stimulus content determination unit 2130 is, for example, when the autonomic nerve balance score included in the user state information is 4 or less and the score of the sign of the user state is 6 or more (that is, the user whose sympathetic nerve is dominant and appears on the face). When the condition is good in view of the signs of the condition), it is determined that the user is in the predetermined condition, and in other cases, it is determined that the user is not in the predetermined condition.

The stimulus content determination unit 2130 refers to, for example, information previously stored in the storage unit 2020 indicating the correspondence between one or both of the autonomic nerve balance score and the user state sign score and whether or not the user is in a predetermined state. Then, it is determined whether or not the user is in a predetermined state.

"Information that encourages the user to take certain actions that have the effect of improving the physical and mental condition of the user" is, for example, "Let's do a simple mindfulness meditation while feeling the vibration" that changes at regular intervals. , "Let's stretch your back and correct your posture", "Let's relax your shoulders and breathe slowly through your nose", etc.

In this way, the stimulus content determination unit 2130 determines the content of the stimulus based on one or both of the sign information and the autonomic nervous system state information included in the user state information.

On the other hand, the stimulus content determination unit 2130 provides information that prompts the user to perform a predetermined action during the generation of the stimulus when one or both of the symptom information and the autonomic nervous state information included in the user state information are not in a predetermined state. Do not execute the process to determine.

Then, when the information for prompting the user to perform a predetermined action during the generation of the stimulus is determined by the stimulus content determination unit 2130, the vibration unit 2310 (and the sound reproduction unit 2040) generates the stimulus toward the user. The information determined by the stimulus content determination unit 2130 is output over all or part of the time.

That is, for example, when a sentence urging breathing or meditation in a predetermined action or a predetermined method is determined by the stimulus content determination unit 2130 as character or image information, the display unit 2070 displays the character or image and the character or image is concerned. When the sentence is determined as a voice, the sound reproduction unit 2040 outputs the voice by reproducing the voice.

Then, the stimulus content determination unit 2130 determines the image information or the content of the scent to be provided to the user in combination with the vibration stimulus, based on the information indicating the user's heartbeat acquired by the heartbeat recognition unit 2110 as needed. FIG. 27 / S2087).

The image information or scent provided to the user in combination with the stimulus is, for example, an image or scent corresponding to the desired state received by the desired state receiving unit 2170. That is, for example, when the desired state is the predominant state of the sympathetic nerve, the image or scent that can image the predominant state of the sympathetic nerve is determined from the list of images or scents stored in advance in the storage unit 2020. Selected by unit 2130.

The embodiments of the present invention have been described above, but the present invention is not limited thereto. Various changes can be made without departing from the spirit of the present invention.

That is, for example, the imaging unit 2050 is configured to capture an image of the skin of the fingers in addition to or in place of the image of the skin of the user's face, and the heartbeat recognition unit 2110 is the image of the user's fingers imaged by the imaging unit 2050. It may be configured to recognize information indicating the user's heartbeat based on an image of the skin.

There are various situations in which users who want to use the condition improvement device are placed. For example, if you use the condition improvement device before going to bed at home at night or when the user is alone, there is not much resistance to taking the image of the face and acquiring the user's heartbeat from the image of the skin of the face. It is thought that it will not occur. However, if the condition improving device is used in a public place such as a workplace or a place where the person is out in the daytime, he / she may be reluctant to take an image of the face and hesitate to use the condition improving device.

According to the present embodiment, the user can specify whether to acquire the image of the skin of the face or the image of the skin of the finger, so that the state improving device according to the situation in which the user is placed can be used. You can choose how to use it, which is convenient.

The flow of processing by the state improving device of the embodiment will be described with reference to FIG. 28. In the present embodiment, when the process is started, the desired state receiving unit 2170 accepts the designation of the desired state (FIG. 28 / S2011), and then the mode receiving unit 2230 accepts the designation of the operation mode (FIG. 28 / S2013).

The operation mode is a first mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's face, and a second mode that recognizes the tempo of the user's heartbeat based on the image of the skin of the user's fingers. The mode.

Then, the mode reception unit 2230 determines whether the designated mode is the first mode or the second mode (FIG. 28 / S2015). When the designated mode is the first mode, the processing after S2031 is executed. Since the content of the process is the same as that in FIG. 21, the description thereof will be omitted.

On the other hand, when the designated mode is the second mode, the image pickup unit 2050 first acquires an image of the skin of the user's finger (FIG. 28 / S2131), and the heart rate recognition unit 2110 images the image with the image pickup unit 2050. Information indicating the user's heartbeat is acquired based on the image of the skin of the user's finger (FIG. 28 / S2133).

The heartbeat recognition unit 2110 acquires information indicating the user's heartbeat from the image of the skin of the user's fingers by the same method as the method of acquiring the information indicating the user's heartbeat from the image of the skin of the user's face, for example.

Then, the heartbeat recognition unit 2110 recognizes the tempo of the user's heartbeat from the information indicating the heartbeat acquired as described above (FIG. 28 / S2135), and the user state information acquisition unit 2210 acquires the user state information (FIG. 28 / S2135). FIG. 28 / S2137).

Then, the stimulus content determination unit 2130 determines the tempo of the stimulus to be provided to the user based on the tempo of the user's heartbeat recognized by the heartbeat recognition unit 2110 (FIG. 28 / S2150), and further determines the content of the stimulus as necessary. Is determined (FIG. 28 / S2180).

The contents of the processes of S2135 to S2180 are almost the same except that the process of accepting the input of the answer by the user to the question regarding the state of the user's face (FIG. 21 / S2033, FIG. 28 / S2033) is not performed. , The explanation is omitted.

Then, when the stimulus generation unit 2030 generates a stimulus at the tempo determined by the stimulus content determination unit 2130 toward the user (FIG. 28 / S2091), a series of processes of the state improving device of the present embodiment is completed.

<Structure of the fourth embodiment>
Next, the configuration of the solution providing system of the fourth embodiment will be described. The solution providing system of the present embodiment has a function as an analysis system for analyzing a user's fatigue state, and the configuration of this analysis system will be described below with reference to FIG. 29.

As shown in FIG. 29, for example, the analysis system of the present embodiment is a computer system composed of a user terminal 3001 and a server 3002, and between the user terminal 3001 and the server 3002, for example, wirelessly or wiredly. It is connected by the communication network NW of. Although only one user terminal 3001 and one server 3002 are shown in FIG. 29, a plurality of user terminals 3001 and servers 3002 may be provided.

The user terminal 3001 is, for example, a smartphone, a tablet or other computer including a display unit 3010, an input unit 3030, an image pickup unit 3050, and a terminal control unit 3070a. The user terminal 3001 may further include a speaker 3110 that outputs sound information and a vibrator 3130 that generates vibration.

The display unit 3010 is, for example, a display for the user terminal 3001 to display information toward the user.

The input unit 3030 is, for example, a touch panel for receiving input of information such as operation contents by the user, but may be a keyboard, a mouse, or other pointing device.

The image pickup unit 3050 is a camera that captures an image of the user's face.

The terminal control unit 3070a is composed of a CPU, a memory, an I / O device, and the like. The arithmetic processing unit (processor) of the terminal control unit 3070a functions as, for example, an output control unit 3710 and an input reception unit 3730 by reading and executing a predetermined program.

The output control unit 3710 displays the image of the user's face imaged by the image pickup unit 3050 on the display unit 3010, and also contains information on a question regarding the state of a predetermined portion of the user's face displayed on the display unit 3010 and the user. Information prompting the input of emotional information indicating the content of the emotion held by the user himself / herself with respect to the image of the face of the user is output to the display unit 3010.

The input reception unit 3730 is in a state where the image of the user's face captured by the image pickup unit 3050 is displayed on the display unit 3010 by the output control unit 3710, and the information of the answer to the question and the emotional information are displayed via the input unit 3030. Accept input.

Further, the user terminal 3001 of the present embodiment has a function as a user information acquisition unit. This user information acquisition unit acquires user information as user information, and has functions as the display unit 3010, the input unit 3030, the image pickup unit 3050, the output control unit 3710, and the input reception unit 3730 described above. There is.

The server 3002 is a computer including a server control unit 3070b and a storage unit 3090.

The server control unit 3070b is composed of an arithmetic processing unit (processor) such as a CPU, a memory, an I / O device, and the like. The server control unit 3070b functions as, for example, a subjective fatigue state information acquisition unit 3750 by the arithmetic processing device reading and executing a predetermined program, or further, as an objective fatigue state information acquisition unit 3770 and a determination unit 3790. Function.

The subjective fatigue state information acquisition unit 3750 is predetermined from the information of the answer to the question and the emotional information indicating the content of the emotion that the user has with respect to the image of the user's face, which is received by the input reception unit 3730 of the user terminal 3001. Obtain a value that indicates the degree of subjective fatigue that the user feels, which is calculated by the method.

The objective fatigue state information acquisition unit 3770 acquires information on the user's heart rate by a predetermined means, and the heart rate state information indicating the state of the user's heart rate calculated by a predetermined method from the information on the heart rate and the user's autonomic state. The autonomic nerve balance information indicating the nerve balance is acquired, and the user's objective fatigue level information is acquired based on the heartbeat state information and the autonomic nerve balance information.

The determination unit 3790 makes the user recognize the user's subjective fatigue state or improves the user's subjective fatigue state with the information combining the value indicating the degree of the user's subjective fatigue state and the emotional information. The fatigue recognition improvement information corresponding to the combined information is determined with reference to the fatigue recognition improvement information consisting of the information for the purpose and the information indicating the correspondence relationship.

The fatigue recognition improvement information is, for example, a first comment consisting of word information indicating the user's subjective fatigue state, a second comment consisting of word information indicating the user's objective fatigue state, and user subjectivity. It is improvement content which is information for improving a general fatigue state and an objective fatigue state.

The storage unit 3090 is composed of a storage device such as a ROM, RAM, or HDD. The storage unit 3090 stores information necessary for processing of the analysis system, processing results of the analysis system, and the like, in addition to the content database (DB) 3910 that stores a plurality of improved contents.

Further, the server 3002 has a function as a user status information generation unit and a solution determination unit. This user state information generation unit generates user state information based on the user information, and has functions as the subjective fatigue state information acquisition unit 3750 and the objective fatigue state information acquisition unit 3770 described above. Further, the solution determination unit determines the solution to be provided to the user, and has the function as the determination unit 3790 described above.

FIG. 30 shows an embodiment when the above configuration is provided in the user terminal 3001. As shown in FIG. 30, in the analysis system of the present invention, the server 3002 may be omitted and only the user terminal 3001 may be configured.

<Outline of processing>
Next, the processing contents of the analysis system of this embodiment will be described. First, a series of processes by the analysis system will be described with reference to FIG. 31. In the following, a case where the analysis system is composed of the user terminal 3001 and the server 3002 will be described.

When the process is started, the image pickup unit 3050 of the user terminal 3001 captures an image of the user's face (FIG. 31 / S3011).

Then, the output control unit 3710 of the user terminal 3001 displays the image of the user's face imaged by the image pickup unit 3050 on the display unit 3010, and asks a question regarding the state of a predetermined portion of the user's face displayed on the display unit 3010. Information is displayed on the display unit 3010 (FIG. 31 / S3013).

The information in the question about the condition of a given part of the user's face is, for example, whether they look tired eyes, whether they look like their mouth corners are down, and they feel their complexion is dull. It contains information asking about the condition of the face, which correlates with the fatigue condition appearing on the user's face displayed on the display unit 3010, such as whether the face is stiff and difficult to move. ..

The output control unit 3710 displays the information of these questions in order on the display unit 3010, for example, and the input reception unit 3730 sequentially receives the information of the answers to these questions (FIG. 31 / S3015).

The input reception unit 3730 accepts the information of the answers to these questions, for example, by letting the user select the magnitude of the degree to which he / she feels that it applies to the state asked in each question from the five-grade evaluation of 1 to 5. The magnitude of the degree indicates that, for example, 1 is the smallest and 5 is the largest.

Next, the output control unit 3710 displays the image of the user's face captured by the image pickup unit 3050 on the display unit 3010, and the user's own emotions toward the image of the user's face displayed on the display unit 3010. Information indicating the content of the above is displayed on the display unit 3010 (FIG. 31 / S3017), and the input reception unit 3730 accepts the input of the emotion information (FIG. 31 / S3019).

Information that prompts the input of emotional information that indicates the content of the emotion that the user has on the image of the user's face is, for example, a display such as "What kind of words do you say when you look at your face?" This is information that prompts the user displayed in the unit 3010 to input information of words that the user himself / herself wants to say, such as words of encouragement or comfort that are suitable for improving the fatigue state that the user himself / herself is aware of.

For example, the input reception unit 3730 says "I did my best!", "It was a good day", "Let's do my best tomorrow", "I'm tired ...", "It was painful ..."・ By letting the user select from among, the input of emotional information is accepted.

The input receiving unit 3730 receives input of answer information and emotion information to a question via the input unit 3030 in a state where the image of the user's face captured by the imaging unit 3050 is displayed on the display unit 3010. ..

After that, the input reception unit 3730 of the user terminal 3001 transmits the answer information and the emotion information to the question to the server 3002 via, for example, the communication network NW.

In the server 3002, which receives the answer information and the emotional information to the question from the user terminal 3001, the subjective fatigue state information acquisition process (FIG. 31 / S3030) for acquiring a value indicating the degree of the subjective fatigue state felt by the user. The objective fatigue state information acquisition process (FIG. 31 / S3050) for acquiring a value indicating the degree of the user's objective fatigue state and the determination process (FIG. 31 / S3070) for determining the fatigue recognition improvement information are executed. The contents of these processes will be described later.

Then, for example, the subjective fatigue state information acquisition unit 3750, the objective fatigue state information acquisition unit 3770, and the determination unit 3790 of the server 3002 acquire and determine the subjective fatigue state information, the objective fatigue state information, and the fatigue recognition improvement information in the user terminal 3001. Send to.

The output control unit 3710 of the user terminal 3001 outputs the subjective fatigue state information and the objective fatigue state information received from the server 3002 by displaying them on the display unit 3010 (FIG. 31 / S3091), and also outputs the fatigue recognition received from the server 3002. The improvement information is provided to the user (FIG. 31 / S3093), and the series of processes is completed.

FIG. 32 is an output image of a screen for displaying subjective fatigue state information and objective fatigue state information and providing fatigue recognition improvement information to the user. In the following, an embodiment in which the user's subjective fatigue level is output as "mental health level" and the user's objective fatigue level is output as "physical health level" will be described.

As shown in FIG. 32, for example, the subjective fatigue state information is a display showing how many points out of a maximum of 10 points as a mental health SF, and a display showing the points depending on how much the heart mark is satisfied. It is converted to and displayed. In addition, the objective fatigue state information is converted into a display showing how many points out of 10 points are given as the physical health OF, and a display showing the points depending on how much the humanoid mark is satisfied. Is displayed.

Below that, there is a first comment Com1 consisting of verbal information indicating the user's subjective fatigue state and a second comment Com2 consisting of verbal information indicating the user's objective fatigue state, respectively. It is displayed. Or, in addition, the information of the comprehensive comment Com3 that comprehensively evaluates the subjective and objective fatigue state as shown at the top of the screen (for example, "I am in a state where I do not have to worry that my mind and body are satisfied", "The body is I'm a little tired, but my heart is a little tired and I should be careful. " Further, one of the first comment Com1 and the second comment Com2 may be displayed.

And below that, a button B1 for providing the improved content determined by the determination unit 3790 is displayed. For example, as shown in FIG. 32, in order to provide content having a short required time (short), content having a long required time (deep), and content promoting sleep (sleep) according to the convenience of the user. Button B1 may be prepared.

When the operation of pressing any of the buttons B1 by the user is accepted, the output control unit 3710 displays the character information included in the fatigue recognition improvement information on the display unit 3010, and the sound information is transmitted via the speaker 3110. The vibration information is provided to the user by generating the vibration via the vibrator.

Alternatively, as displayed at the bottom, a button B2 for displaying a more detailed analysis result or the like may be displayed. Specifically, for example, the autonomic nerve balance, the LF / HF value, the CVR-R (coefficient of variation R-R interval) value, and the like.

<Subjective fatigue state information acquisition processing>
When the process is started, the subjective fatigue state information acquisition unit 3750, for example, scores the answer information and the emotional information for the question received from the user terminal 3001 as the user's subjective fatigue level by a predetermined method.

That is, for example, the subjective fatigue state information acquisition unit 3750 uses a value obtained by calculating the total value (5 to 20) of the five-grade evaluations for which input is accepted as the degree of feeling that it applies to the state asked in each question as an answer to the question. The score is based on the score, and for emotional information, the score associated with the word selected by the user in advance (for example, "I did my best!" Is 10 points, "It was a good day" is 8 points, and so on.・ ・ ”Is 0 points, etc.) as a score (0 to 10) based on emotional information.

The balance between the weighting of the score related to the answer to the question and the score related to the emotional information and the score associated with each word selected by the user were determined by the inventors during the development of the analysis system of the present invention. In the experiment conducted, the balance and the score, which were highly convinced by the user, were adopted and set, so that the setting has a certain degree of reproducibility with respect to the convincing feeling of the user.

Specifically, the contents of the experiment are (1) a value obtained by dividing the score based on the answer to the question by 0.2 and converting it to 100 points, and (2) the score based on the answer to the question and the score based on the emotional information. The score obtained by dividing the total score of and was divided by 0.3 and converted to 100 points, both of which were presented to 100 subjects as "mental health", and they were asked to answer which score was more convincing. ..

As a result, 89 subjects answered that (2) was more convincing, and 11 subjects answered that (1) was more convincing. Therefore, it was confirmed that (2) was more convincing.

Then, in the present embodiment, the subjective fatigue state information acquisition unit 3750 evaluates the score obtained by adding the score based on the answer to the question and the score based on the emotional information on a 10-point scale by a predetermined algorithm, and 10 The information of the user's "mental health" indicating how many points are in the points is acquired as the value of the subjective fatigue level. The higher the value of "mental health", the higher the mental health (= lower subjective fatigue), and the smaller the value, the lower the mental health (= high subjective fatigue).

The subjective fatigue state information acquisition unit 3750 transmits the value of the “mental health” acquired in this way to the user terminal 3001 as the value of the user's subjective fatigue degree, and ends the subjective fatigue state information acquisition process. do.

<Objective fatigue state information acquisition process>
The content of the objective fatigue state information acquisition process will be described with reference to FIG. 33.

When the process is started, the objective fatigue state information acquisition unit 3770 acquires information on the user's heartbeat (FIG. 33 / S3051). As a method for acquiring information on the user's heartbeat, various well-known methods may be arbitrarily adopted. For example, in the present embodiment, the user's face image captured by the image pickup unit 3050 of the user terminal 3001 may be used. Get information about your heartbeat.

More specifically, for example, the change in the luminance of each color component of RGB is obtained from a plurality of still images or moving images of faces continuously captured by the input receiving unit 3730 for a certain period of time (for example, for 30 seconds) by the input receiving unit 3730. Get information. Then, the input reception unit 3730 transmits information on the change in luminance of each color component of RGB based on the acquired image of the user's face to the server 3002. Alternatively, for example, the information transmitted by the input reception unit 3730 to the server 3002 may be information on the change in the luminance of the color component of a specific color (for example, G) based on the image of the user's face.

Upon receiving the information, the objective fatigue state information acquisition unit 3770 acquires the user's heart rate during a certain period as information on the user's heart rate from the information on the change in the brightness of each color component of RGB based on the image of the user's face. ..

After that, the objective fatigue state information acquisition unit 3770 acquires heart rate state information indicating the user's heart rate state from the user's heart rate information (FIG. 33 / S3053).

The objective fatigue state information acquisition unit 3770 acquires, for example, CVR-R, which is information on the fluctuation of the user's heartbeat, as heartbeat state information. This is because the fluctuation of the heartbeat is closely related to the user's objective fatigue state.

Further, the objective fatigue state information acquisition unit 3770 acquires the autonomic nerve balance information indicating the user's autonomic nerve balance from the information of the user's heart rate (FIG. 33 / S3055).

For example, the objective fatigue state information acquisition unit 3770 autonomously determines the ratio (LF / HF value) of LF, which is a low-frequency component of heartbeat fluctuation, and HF, which is a high-frequency component, obtained by frequency analysis of heartbeat fluctuation. Obtained as nerve balance information.

After that, the objective fatigue state information acquisition unit 3770 acquires objective fatigue degree information by a predetermined method from the CVR-R which is the heartbeat state information and the LF / HF value which is the autonomic nerve balance information (Fig.). 33 / S3057).

That is, for example, the objective fatigue state information acquisition unit 3770 evaluates the CVR-R value and the LF / HF value on a 10-point scale by a predetermined algorithm, and calculates how many points each of the 10 points is. , The sum of these values is divided by 2 to obtain an average value, and the average value is defined as "physical health". The objective fatigue state information acquisition unit 3770 acquires the value of the “body health” calculated in this way as the value of the objective fatigue. As for "body health", the larger the value, the higher the physical health (= lower objective fatigue), and the smaller the value, the lower the physical health (= high objective fatigue).

The objective fatigue state information acquisition unit 3770 transmits the value of "body health" acquired based on the heart rate state information and the autonomic nerve balance information to the user terminal 3001 as an objective fatigue state value. Then, the process of acquiring the objective fatigue state information is completed.

<Decision processing>
The content of the determination process will be described with reference to FIGS. 34 to 36. When the process is started, the determination unit 3790 sequentially performs the following processes.

-Determining the first comment First, the determination unit 3790 determines the first comment corresponding to the state of the combination of the subjective fatigue degree information and the emotional information (FIG. 34 / S3071).

More specifically, the determination unit 3790 includes information on the combination of the user's subjective fatigue level value and emotional information, as shown in FIG. 35, which is stored in the storage unit 3090 in advance, and the user's information. The first comment corresponding to the combination information is determined with reference to the information indicating the correspondence between the first comment consisting of the information of words indicating the subjective fatigue state and the information indicating the correspondence.

FIG. 35 shows a part of the information showing the correspondence relationship. The determination unit 3790 refers to the information and identifies the first comment corresponding to the combination of the subjective fatigue score and the emotional information.

In this embodiment, the first comment corresponding to the combination of the subjective fatigue level of 〇〇 points and the emotional information “I did my best!” Is “I feel satisfied by myself, but in the analysis, "A big burden is appearing in my heart ...", and the first comment corresponding to the combination of the same subjective degree of fatigue and the emotional information "I'm tired ..." is "I feel like I'm switching myself." So that you may be aware that you have spent your time without being able to do it ... ".

In this way, even if the subjective fatigue score is the same, the first comment will be different depending on the emotional information.

-Determining the second comment Subsequently, the determination unit 3790 determines the second comment corresponding to the state of the combination of the objective fatigue degree information and the autonomic nerve balance information (FIG. 34 / S3073).

More specifically, the determination unit 3790 includes, for example, information on the combination of the user's objective fatigue level value and the autonomic nerve balance information stored in advance in the storage unit 3090, and the user's objective fatigue state. The second comment corresponding to the combination information is determined with reference to the information indicating the correspondence between the second comment consisting of the information of the words indicating.

The image of the information showing the correspondence is the same as the image shown in FIG. 35. That is, for example, in the above-mentioned objective fatigue state information acquisition process, the "body health degree" acquired as an objective fatigue degree value from the CVR-R which is the heartbeat state information and the LF / HF value which is the autonomic nerve balance information. And the state of the LF / HF value which is the autonomic nerve balance information (for example, the first state which is the best state when the LF / HF value is less than 0.8, ... When the LF / HF value is 5 or more. The second comment corresponding to each combination of (such as the fourth state, which is the worst state) is stored in the information indicating the corresponding relationship.

By deciding the second comment with reference to such information, even if the value of "body health" is the same, the second comment depends on the state of the LF / HF value which is the autonomic nerve balance information. Will be different.

-Determining the improvement content Subsequently, the determination unit 3790 determines the vibration and sound corresponding to the state of the combination of the user's subjective fatigue degree information and the objective fatigue degree information (FIG. 34 / S3075).

For example, the determination unit 3790 determines the mental health score (out of 10 points) acquired in the subjective fatigue status information acquisition process, the physical health score (out of 10 points) acquired in the objective fatigue status information acquisition process, and the like. Refer to the matrix table as shown in FIG. 36, which is divided into 3 groups according to their scores, and which of A to C3 the combination of the user's mental health and physical health corresponds to. Identify.

The matrix table of FIG. 36 shows that the state "A" in which both the mental health level and the physical health level of the user are high is the best state.

And C1 to C3 indicate that either the mental health level or the physical health level of the user is low, and among them, "C3", in which both are low, is the worst state.

The determination unit 3790 determines the vibration and sound previously associated with each combination of the user's mental health and physical health identified in this way as the improvement content.

For example, the determination unit 3790 relatively shortens the length of vibration included in the improved content if the combination is A. If the combination is B, the vibration length is slightly lengthened, and if it is C1 to C3, the vibration length is the longest. This is because the longer the time for providing the vibration stimulus to a certain extent is, the higher the effect of improving the fatigue state of the user is higher than the case where the length of the time for providing the vibration stimulus is short.

Further, the determination unit 3790 changes the content of the sound included in the improved content according to the combination. That is, for example, if the combination is A, the determination unit 3790 considers the content of the sound to be music. If the combination is B, the content of the sound is a combination of music and environmental sounds (bird chirping, river babbling, etc.), or a combination of music and reading voice. This is because it is more effective to improve the user's fatigue state by providing not only music but also environmental sounds and reading voices in combination.

Alternatively, when the combination is C1, that is, when the mental health is low and the physical health is medium or high, the determination unit 3790 determines the content of the sound and the music having the effect of improving the mental health. And. When the combination is C2, that is, when the physical health is low and the mental health is medium or high, the determination unit 3790 determines the content of the sound and the music having the effect of improving the physical health. do.

Then, when the combination is C3, that is, when both the mental health and the physical health are low, the determination unit 3790 sets the content of the sound as music having the effect of improving the mental and physical health. The content of the sound is not limited to the above, and may be a human voice, natural sound, or music.

-Determining the information of words included in the improved content Next, the determination unit 3790 determines the user's subjective fatigue when the user's subjective fatigue state is worse than the predetermined first criterion (Fig. 34 / S3077: Yes). When the verbal information for improving the fatigue state is determined (Fig. 34 / S3079) and the user's objective fatigue state is worse than the predetermined second criterion (Fig. 34 / S3081: Yes), the user's objective fatigue state is determined. Determine verbal information to improve objective fatigue (Fig. 34 / S3083). This is because, especially when in a high fatigue state, it is better to provide specific verbal information to improve the fatigue state than to provide such verbal information. This is because the improvement effect is high.

More specifically, for example, the determination unit 3790 is a case where the mental health is less than 3, and the physical health is 3 or more, that is, a combination of the mental health and the physical health. Is C1, it is determined that the user's subjective fatigue state is worse than the predetermined first criterion, and the verbal information for improving the user's mental health (subjective fatigue state) is determined. ..

Verbal information for improving the user's mental health (subjective fatigue) is, for example, voice-guided or written words that recognize oneself and have self-friendly emotions, so-called self-compassion. Information.

The decision unit 3790 refers to the information indicating the correspondence between the emotional information and the verbal information for improving the mental health (subjective fatigue state), and determines the mental health corresponding to the emotional information. Determine verbal information for improvement.

Specifically, the decision unit 3790 determines the information of words that have a particularly high effect of improving the mental health (subjective fatigue state) if the emotional information is "It was painful ...", and the emotional information is obtained. If "I'm tired ...", determine the information of words that have a high improvement effect, and if the emotional information is "I did my best!", "It was a good day", "Let's do my best tomorrow", the improvement effect is moderate. Determine the information in the following words:

Then, for example, the determination unit 3790 is when the physical health is less than 3, and the mental health is 3 or more, that is, when the combination of the physical health and the mental health is C2. , It is determined that the user's objective fatigue state is worse than the predetermined second criterion, and the verbal information for improving the user's physical health (objective fatigue state) is determined.

Verbal information for improving the user's physical health (objective fatigue) is, for example, audio guide or written verbal information that recognizes and relaxes the tension of one's body, which encourages so-called self-release. Information.

The decision unit 3790 refers to the information indicating the correspondence between the autonomic nerve balance information and the information of words for improving the health of the body (objective fatigue state), and the body corresponding to the autonomic nerve balance information. Determine verbal information to improve your health (objective fatigue).

Specifically, the determination unit 3790 determines the information of words that have a particularly high effect of improving the health of the body (objective fatigue state) if the LF / HF value, which is the autonomic nerve balance information, is 5 or more. If the LF / HF value is 2 or more and less than 5, the information of words having a high improvement effect is determined, and if the LF / HF value is less than 2, the information of words having a moderate improvement effect or less is determined.

Alternatively, for example, the determination unit 3790 is user-subjective when both mental and physical health are less than 3, that is, when the combination of physical and mental health is C3. Judging that both the fatigue state and the objective fatigue state are worse than the predetermined standard, the user's physical health (objective fatigue state) and mental health (subjective fatigue state) are determined. Determine information in words that are particularly effective in both improvements.

In this way, the combination of physical health (objective fatigue) and mental health (subjective fatigue), the combination of physical health and autonomic balance information, and mental health. The storage unit 3090 contains a plurality of improved contents having different contents, the first, so that the combination with the emotional information, the improved content, the first comment, and the second comment can be determined and provided to the user. The comment and the second comment are stored.

Although the analysis system of the present embodiment has been described above, the embodiment of the present invention is not limited to this. Various changes can be made without departing from the spirit of the present invention.

For example, either the subjective fatigue state information acquisition process or the objective fatigue state information acquisition process may be performed first. Further, in the objective fatigue state information acquisition process, the information transmitted by the input reception unit 3730 to the server 3002 is a plurality of still images or moving images of a plurality of faces captured by the image pickup unit 3050, and the image is converted into an image of the user's face. The process of acquiring the information on the change in the luminance of each color component (or the color component of a specific color) of RGB based on the image may be performed by the objective fatigue state information acquisition unit 3770.

Or, for example, the improvement content may be vibration only, sound only, or verbal information only. Alternatively, part or all of the fatigue recognition improvement information determined by the determination unit in the determination process may be omitted. In this case, if the speaker 3110 and the vibrator 3130 are unnecessary, they may be omitted.

Alternatively, for example, a part or all of the objective fatigue state information acquisition process may be omitted. When the entire objective fatigue state information acquisition process is omitted, the objective fatigue state information acquisition unit 3770 is also omitted, and the information output to the user is a value indicating the degree of the user's subjective fatigue state, and the user is informed of the degree of the user's subjective fatigue state. The fatigue recognition improvement information provided to the user is information for making the user recognize the user's subjective fatigue state or improving the user's subjective fatigue state.

Further, the analysis system of the present embodiment may be configured to acquire user information via an input unit and generate user state information based on this user information.

10 ... Mobile terminal, 30,3002 ... Server, 110,1110 ... Mobile terminal control unit, 111,1111 ... User information acquisition unit, 113,1113 ... Solution provision unit, 115,2170 ... Desired state reception unit 117 ... Skin image Analysis unit 119 ... Situation recognition unit, 130,1170, 2090, 3030 ... Input unit, 150,1130 ... Output unit, 151,1131 ... Vibration generation unit, 153,113,2070, 3010 ... Display unit, 155,1135 ... Voice reproduction unit, 157, 1137, 2350 ... Fragrance generation unit, 310, 1310, 3070b ... Server control unit, 311, 1311, 1311A ... User status information generation unit, 313, 131, 1313A ... Solution determination unit, 315 ... Heart rate information Acquisition unit, 317 ... Autonomous nerve balance acquisition unit, 319 ... Language information analysis unit, 330 ... Server storage unit, 331 ... Corresponding dictionary, 333 ... Judgment model, 335 ... Conversion model, 337 ... Reference state information, 1115 ... Display control unit , 1117, 2190 ... Answer reception unit, 1150, 2050, 3050 ... Imaging unit, 1190 ... History storage unit, 1330, 1330A ... Solution storage unit, 2010 ... Device control unit, 2020, 3090 ... Storage unit, 2030 ... Stimulation generation unit , 2040 ... Sound reproduction unit, 2110 ... Heart rate recognition unit, 2130 ... Stimulation content determination unit, 2150 ... Autonomous nerve state recognition unit, 2210 ... User status information acquisition unit, 2230 ... Mode reception unit, 2310 ... Vibration unit, 3001 ... User Terminal, 3070a ... Terminal control unit, 3110 ... Speaker, 3130 ... Vibrator, 3710 ... Output control unit, 3730 ... Input reception unit, 3750 ... Subjective fatigue state information acquisition unit, 3770 ... Objective fatigue state information acquisition unit, 3790 ... Determination unit , 3910 ... Content DB.

Claims (53)

A storage unit that stores information on multiple solutions that can be provided to the user to improve the user's emotional and / or fatigued state.
A user information acquisition unit that acquires user information including information obtained from the user's body or movement, and
A user state information generation unit that generates user state information indicating the user state of the user based on information acquired from the body or movement acquired by the user information acquisition unit.
A solution decision unit that determines a solution according to the user status information from the plurality of solutions,
A solution providing system including a solution providing unit that provides the determined solution to the user. In the solution providing system according to claim 1,
The solution providing system consists of a mobile terminal that can be carried by the user.
The mobile terminal is a solution providing system including the user information acquisition unit, the solution providing unit, the storage unit, the user state information generation unit, and the solution determining unit. In the solution providing system according to claim 1,
The solution providing system is configured to include a mobile terminal that can be carried by the user and a server.
The mobile terminal includes the user information acquisition unit and the solution providing unit.
The server includes the storage unit, the user state information generation unit, and the solution determination unit.
The user information acquisition unit acquires user information including information obtained from the user's body or movement, and transmits the user information to the server.
The solution determination unit is a solution providing system characterized in that a solution according to the user status information is determined from the plurality of solutions and transmitted to the mobile terminal. In the solution providing system according to claim 2 or 3.
The mobile terminal includes a history storage unit that stores the solution provided to the user for a predetermined period or a predetermined number of times.
When the determined solution is stored in the history storage unit, the solution determination unit does not send the determined solution to the mobile terminal.
When the solution determined by the solution determination unit is stored in the history storage unit, the solution providing unit acquires the determined solution from the history storage unit and provides the solution to the user. A solution providing system featuring. In the solution providing system according to any one of claims 1 to 4.
The user information acquisition unit acquires the user information again after the solution is provided to the user.
The user state information generation unit regenerates the user state information based on the information including the user information acquired after the solution is provided to the user.
The solution determination unit is a solution providing system characterized by determining a solution according to the regenerated user state information. In the solution providing system according to claim 2 or 3.
The mobile terminal includes a display unit and has a display unit.
The solution determined by the solution determination unit includes display information including information for promoting a predetermined operation or an image for improving the user state according to the user state information.
The solution providing unit is a solution providing system characterized in that the display information is provided to the user via the display unit. In the solution providing system according to claim 1,
The user information acquisition unit acquires user information including an image of the user's skin as information obtained from the user's body or movement, and obtains user information.
It is equipped with a skin image analysis unit that analyzes the skin image included in the user information.
The user state information generation unit is a solution providing system characterized by generating user state information indicating the user state of the user based on the result of analysis by the skin image analysis unit. In the solution providing system according to claim 5,
The solution providing system consists of a mobile terminal that can be carried by the user.
The mobile terminal is equipped with an imaging unit and has an imaging unit.
The user information acquisition unit is a solution providing system characterized by acquiring user information including an image of the user's face via the image pickup unit. In the solution providing system according to claim 7,
A situation in which the user recognizes whether the user information acquisition unit is in the first situation to acquire the image of the skin of the user's finger or the second situation to acquire the image of the skin of the user's face. Equipped with a recognition unit
The user information acquisition unit acquires the user information including the image of the skin of the finger of the user when the user is in the first situation, and the user when the user is in the second situation. Acquire the user information including the image of the skin of the face of
The skin image analysis unit analyzes the image of the finger included in the user information when the user is in the first situation, and includes the user information when the user is in the second situation. A solution providing system characterized by analyzing the image of the face. In the solution providing system according to claim 9,
The situation awareness unit is a solution providing system characterized by recognizing whether the user is in the first situation or the second situation based on the current time zone. In the solution providing system according to claim 1,
The user information acquisition unit accepts input of user information including linguistic information which is one or both of characters and voice by the user as information obtained from the body or movement of the user.
It is equipped with a language information analysis unit that analyzes the language information included in the user information.
The user state information generation unit is a solution providing system characterized by generating user state information indicating the user state of the user based on the result of analysis by the language information analysis unit. In the solution providing system according to claim 11,
The linguistic information analysis unit acquires information on the characteristics of the user information from the linguistic information, and obtains information about the characteristics of the user information.
It is provided with an autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit.
The user state information generation unit is a solution providing system characterized by generating the user state information of the user based on the autonomic nerve balance information. In the solution providing system according to claim 7,
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the user's autonomic nerve balance based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit is provided.
The user state information generation unit is a solution providing system characterized by generating the user state information of the user based on the autonomic nerve balance information. In the solution providing system according to claim 11,
The linguistic information analysis unit acquires characteristic words and phrases contained in the linguistic information as information related to the characteristics of the user information.
The user state information generation unit uses one or both of a dictionary corresponding to the phrase and the user state acquired by the language information analysis unit and a determination model that inputs the phrase and outputs the user state. The solution providing system is configured to generate the autonomic nerve balance information of the user as the user state information. In the solution providing system according to claim 11,
When the user information includes voice, the language information analysis unit acquires the intonation of the voice as information regarding the characteristics of the user information.
The user state information generation unit uses one or both of a dictionary corresponding to the intonation and the user state acquired by the language information analysis unit and a determination model in which the intonation is input and the user state is output. The solution providing system is configured to generate the autonomic nerve balance information of the user as the user state information. In the solution providing system according to claim 11,
The linguistic information analysis unit acquires negative words and phrases contained in the linguistic information as information regarding the characteristics of the user information.
The solution determination unit is a corresponding dictionary of the negative phrase acquired by the language information analysis unit and a positive paraphrase phrase of the phrase or a paraphrase phrase having a lower degree of negativeness than the phrase. And, using one or both of the conversion models that input the negative phrase and output the positive paraphrase phrase of the phrase or the paraphrase phrase with a lower degree of negativeness than the phrase, the negative A solution providing system characterized in that a positive paraphrase corresponding to a phrase or a phrase candidate of a paraphrase having a lower degree of negativeness than the phrase is determined as the solution. In the solution providing system according to claim 1,
An autonomic nerve balance acquisition unit that acquires autonomic nerve balance information indicating the autonomic nerve balance of the user using the user information, and an autonomic nerve balance acquisition unit.
A fatigue state information acquisition unit that acquires fatigue state information indicating the fatigue state of the user using the user information, and a fatigue state information acquisition unit.
Further prepare
The user state information generation unit is a solution providing system characterized in that the user state information of the user is generated based on a combination of the autonomic nerve balance information and the fatigue state information. In the solution providing system according to claim 17,
The user information includes an image of the user's skin.
A skin image analysis unit that analyzes the skin image included in the user information,
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
Further prepare
The autonomic nerve balance acquisition unit acquires the autonomic nerve balance information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit.
The fatigue state information acquisition unit is a solution providing system characterized by acquiring the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit. In the solution providing system according to claim 17,
The user information includes linguistic information that is one or both of characters and voice by the user and an image of the user's skin.
A language information analysis unit that analyzes the language information included in the user information,
A skin image analysis unit that analyzes the skin image included in the user information,
A heartbeat information acquisition unit that acquires information on the user's heartbeat based on the results of analysis by the skin image analysis unit, and a heartbeat information acquisition unit.
Further prepare
The autonomic nerve balance acquisition unit acquires autonomic nerve balance information indicating the autonomic nerve balance of the user based on the information regarding the feature acquired by the language information analysis unit.
The fatigue state information acquisition unit is a solution providing system characterized by acquiring the fatigue state information based on the information regarding the heartbeat acquired by the heartbeat information acquisition unit. In the solution providing system according to any one of claims 1 to 19.
The solution determination unit is configured to determine the solution that guides the user state to a relaxed state, a calm state, or an awakened state according to the user state information. Offering system. In the solution providing system according to any one of claims 1 to 20,
A desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided.
The solution determination unit is characterized in that it is configured to determine the solution that guides the user state toward the state indicated by the desired state information based on the user state information and the desired state information. Solution providing system. In the solution providing system according to claim 21,
The solution determined by the solution determination unit includes a predetermined periodic vibration according to the user state.
The solution providing system is characterized in that the solution determining unit is configured to determine the vibration cycle based on the user state information and the desired state information. In the solution providing system according to claim 13,
A desired state reception unit that accepts input of desired state information indicating one or both of the user's emotions or fatigue states desired by the user is provided.
The solution determined by the solution determination unit includes a predetermined periodic vibration.
The solution determination unit determines the cycle at the start of the vibration based on the information about the heartbeat, and the pattern of change of one or both of the cycle and the intensity after the start of the vibration based on the desired state information. A solution delivery system characterized by being configured to determine. In the solution providing system according to any one of claims 1 to 23.
The storage unit stores reference state information indicating a reference of a state in which one or both of the user's emotional or fatigue states are improved.
The solution determination unit is configured to determine the solution that guides the user state toward the state indicated by the reference state information based on the user state and the reference state information. Solution provision system. In the solution providing system according to any one of claims 1 to 24,
The solution providing system determined by the solution determination unit is a solution providing system characterized by being a passive stimulus to the user's sense of touch, hearing or smell. In the solution providing system according to any one of claims 1 to 25,
The solution provided by the solution determination unit is a solution providing system characterized by being a stimulus of music, reading voice, or any or a combination of vibrations. In the solution providing system according to claim 2 or 3.
The mobile terminal includes a vibration generating unit, and the solution determined by the solution determining unit includes vibration according to the user state information.
The solution providing unit is a solution providing system characterized in that the vibration is provided to the user via the vibration generating unit. In the solution providing system according to claim 2 or 3.
The mobile terminal includes a scent generator and has a scent generator.
The solution determined by the solution determination unit contains a predetermined scent according to the user status information.
The solution providing unit is a solution providing system characterized in that the predetermined scent is provided to the user via the scent generating unit. In the solution providing system according to claim 2 or 3.
The mobile terminal includes an audio reproduction unit and has an audio reproduction unit.
The solution determined by the solution determination unit includes a human voice, a natural sound, or a voice including music according to the user state information.
The solution providing unit is a solution providing system characterized in that the voice is provided to the user via the voice reproducing unit. In the solution providing system according to claim 26.
The user information acquisition unit acquires information indicating the heartbeat of the user as the user information, and obtains information indicating the heartbeat of the user.
The user state information generation unit has a heartbeat recognition unit that recognizes the tempo of the user's heartbeat as the user state information from the information indicating the user's heartbeat.
The solution determination unit has a stimulus content determination unit that determines a tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit as the solution, which is the tempo of the stimulus provided to the user. Ori,
The solution providing unit is characterized in that, as the solution, the solution providing unit has a stimulus generating unit that generates the stimulus at a tempo determined by the stimulating content determining unit toward the user. In the solution providing system according to claim 30,
The stimulus generated by the stimulus generator consists of a combination of vibration and sound.
The sound is a human voice, natural sound or music,
The stimulus content determination unit is characterized in that a tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo of the vibration and the sound included in the stimulus provided to the user. Solution provision system. In the solution providing system according to claim 30,
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the sympathetic nerve, the tempo changes so as to be delayed from the start time to the end time of the stimulus. A solution delivery system characterized by being configured to determine. In the solution providing system according to claim 30,
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. A solution delivery system characterized by being configured to determine. In the solution providing system according to claim 30,
The user information acquisition unit has an autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in a balanced state, it determines that the tempo is maintained from the start time to the end time of the stimulus. A solution-providing system characterized by being configured in such a way. In the solution providing system according to claim 30,
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is a predominant state of the parasympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. A solution providing system characterized by being. In the solution providing system according to claim 30,
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is a predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be faster from the start time to the end time of the stimulus. A solution providing system characterized by being. In the solution providing system according to claim 30,
The user status information generation unit is
The desired state receiving unit that accepts the designation of the desired state indicating the state desired by the user by the user, and the desired state receiving unit.
The autonomic nerve state recognition unit that recognizes the state of the user's autonomic nerve,
Have and
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
The desired state received by the desired state receiving unit is a state in which work efficiency is high or fatigue is recovered.
When the autonomic nerve state recognition unit recognizes that the state of the user's autonomic nerve is in the predominant state of the parasympathetic nerve, the tempo changes so as to increase from the start time to the end time of the stimulus. Decide,
When the state of the user's autonomic nerve is recognized as the predominant state of the sympathetic nerve, it is configured to determine the change in tempo so as to be delayed from the start time to the end time of the stimulus. A solution providing system characterized by being present. In the solution providing system according to claim 30,
The user state information generation unit has a desired state reception unit that receives the designation of a desired state indicating the state desired by the user by the user.
The stimulus content determination unit
The tempo synchronized with the tempo of the user's heartbeat recognized by the heartbeat recognition unit is determined as the tempo at the start of the stimulus, and is also determined.
When the desired state received by the desired state receiving unit is in a state in which sleep is easily introduced, the tempo change is determined so as to be delayed from the start time to the end time of the stimulus. A solution providing system characterized by being. In the solution providing system according to any one of claims 32, 35, 37 and 38.
The stimulus content determination unit
When determining the change so that the tempo becomes slower from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or higher than the predetermined lower limit value is the tempo at the end time of the stimulus. A solution delivery system characterized by being configured to determine. In the solution providing system according to any one of claims 33 and 36 to 38.
The stimulus content determination unit
When determining the change so that the tempo becomes faster from the start time to the end time of the stimulus, the change is made so that the tempo at a speed equal to or less than the predetermined upper limit value is the tempo at the end time of the stimulus. A solution delivery system characterized by being configured to determine. In the solution providing system according to claim 35 or 36.
The desired state includes a state in which sleep is easily introduced and a state in which work efficiency is high or fatigue is recovered.
The stimulus content determination unit
The length of the stimulus when the desired state received by the desired state receiving unit is a state in which sleep is easily introduced, rather than the length of the stimulus when the desired state is a state with high work efficiency or a state in which fatigue is recovered. A solution providing system characterized by determining the length of the stimulus so that the stimulus becomes longer. In the solution providing system according to claim 38 or 41.
The stimulus content determination unit
The change in tempo was determined so as to be gradually delayed from the start time to the end time of the stimulus.
Moreover, the length of time for generating the stimulus at the tempo at the end of the stimulus is longer than the length of the time for generating the stimulus at the tempo of each stage before changing to the tempo at the end of the stimulus. , A solution providing system characterized by determining the change in the tempo. In the solution providing system according to claim 1,
The user information acquisition unit has an input unit that accepts information input by the user, and acquires the user information via the input unit.
The user state information generation unit is a solution providing system characterized in that the user state information is generated based on the user information acquired by the user information acquisition unit. In the solution providing system according to claim 43.
The user information acquisition unit
A display unit that displays information and
An image pickup unit that captures an image of the user's face,
The image of the user's face captured by the imaging unit is displayed on the display unit, and information on a question regarding the state of a predetermined portion of the user's face displayed on the display unit and information on the user's face are displayed. An output control unit that displays on the display unit information that prompts the input of emotional information indicating the content of the emotion that the user has for the image.
An input receiving unit that receives information on answers to the question and input of the emotional information via the input unit while the image of the user's face captured by the imaging unit is displayed on the display unit. Has more,
The user state information generation unit acquires, as the user state information, a value indicating the degree of subjective fatigue state felt by the user, which is calculated by a predetermined method from the information of the answer to the question and the emotion information. A solution providing system characterized by having a subjective fatigue state information acquisition unit. In the solution providing system according to claim 44.
The output control unit is a word of encouragement or comfort that is suitable for improving the fatigue state that the user himself / herself is aware of for the user displayed on the display unit as information for prompting the input of the emotion information. A solution providing system characterized in that information prompting the input of information is displayed on the display unit. In the solution providing system according to claim 44 or 45.
The solution determination unit causes the user to recognize the information obtained by combining the value indicating the degree of the user's subjective fatigue state and the emotional information, and the user's subjective fatigue state, or the user's subjective state. A decision unit that determines the fatigue recognition improvement information corresponding to the combined information as the solution by referring to the information indicating the correspondence between the fatigue recognition improvement information consisting of the information for improving the fatigue state and the information indicating the correspondence relationship. Have and
The output control unit is a solution providing system characterized in that the fatigue recognition improvement information is configured to be output to the user as the solution. In the solution providing system according to claim 46.
The determination unit includes a first comment including information on a combination of a value indicating the degree of the user's subjective fatigue state and the emotional information, and verbal information indicating the user's subjective fatigue state. The first comment corresponding to the information of the combination is determined as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of the above.
The output control unit is a solution providing system characterized in that the output control unit is configured to output the first comment determined by the determination unit to the user. In the solution providing system according to claim 46 or 47.
The user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of objective fatigue of the user as the user state information, which is calculated by a predetermined method.
The determination unit refers to information indicating a correspondence relationship between a value indicating the degree of objective fatigue of the user and a second comment consisting of verbal information indicating the objective fatigue state of the user. , The second comment corresponding to the value indicating the objective degree of fatigue of the user is configured to be determined as the fatigue recognition improvement information.
The output control unit is a solution providing system characterized in that the output control unit is configured to output the second comment determined by the determination unit to the user. In the solution providing system according to claim 48.
The objective fatigue state information acquisition unit acquires information on the user's heart rate by a predetermined method, and the heart rate state information indicating the state of the user's heart rate derived from the information on the heart rate and the autonomic nerve of the user. The autonomic nerve balance information indicating the balance is acquired, and the value indicating the objective degree of fatigue of the user is acquired based on the heart rate state information and the autonomic nerve balance information.
The determination unit includes a second comment consisting of information on a combination of a value indicating the degree of objective fatigue of the user and the autonomic nerve balance information, and information on words indicating the objective fatigue state of the user. It is configured to determine the second comment corresponding to the information of the combination as the fatigue recognition improvement information by referring to the information indicating the correspondence relationship of.
The output control unit is a solution providing system characterized in that the output control unit is configured to output the second comment determined by the determination unit to the user. In the solution providing system according to any one of claims 46 to 49.
The user state information generation unit includes an objective fatigue state information acquisition unit that acquires a value indicating the degree of the user's objective fatigue state as the user state information, which is calculated by a predetermined method.
The storage unit stores a plurality of improved contents, which are information for improving the subjective fatigue state and the objective fatigue state of the user, as the plurality of solutions.
The determination unit is information indicating a correspondence relationship between the combination information of a value indicating the degree of subjective fatigue state of the user and a value indicating the degree of objective fatigue state of the user and the improved content. With reference to, the improvement content corresponding to the information of the combination is determined as the fatigue recognition improvement information.
The output control unit is a solution providing system characterized in that it is configured to output the improved content determined by the determination unit to the user. In the solution providing system according to claim 50.
The improved content consists of a combination of vibration and / or sound and verbal information.
The sound is a human voice, natural sound or music,
The decision-making part
When the value indicating the degree of the user's subjective fatigue state indicates that the user's subjective fatigue state is worse than the predetermined first criterion, the user's subjective fatigue state. Determine the information of the above words to improve,
When the value indicating the degree of the user's objective fatigue state indicates that the user's objective fatigue state is worse than the predetermined second criterion, the user's objective fatigue state. A solution providing system characterized in that it is configured to determine the information of the above term for improving. In the solution providing system according to claim 51.
The decision-making part
By referring to the information indicating the correspondence between the emotional information and the information of words for improving the subjective fatigue state of the user, the subjective fatigue state of the user corresponding to the emotional information is improved. Determine the verbal information to do,
Correspondence between the autonomic nerve balance information indicating the autonomic nerve balance of the user derived from the information on the heartbeat of the user acquired by a predetermined method and the information of words for improving the objective fatigue state of the user. A solution providing system characterized in that it is configured to determine verbal information for improving the objective fatigue state of the user corresponding to the autonomic nervous balance information by referring to the information indicating the relationship. .. In the solution providing system according to claim 2 or 3.
The mobile terminal includes an image pickup unit, a display control unit, a display unit, a response reception unit, and an input unit.
The user information acquisition unit acquires user information including an image of the user's face via the imaging unit.
The display control unit displays an image of the user's face captured by the imaging unit on the display unit, and correlates with the emotion or fatigue state appearing on the user's face displayed on the display unit. Display a question about the condition of the face on the display,
The input unit is arranged at a position where the user can operate while looking at the image of the user's face displayed on the display unit and the question.
The answer receiving unit receives the input of the answer by the user to the question about the face condition of the user via the input unit in a state where the image of the face is displayed on the display unit.
The user state information generation unit is a solution providing system characterized in that the user state information is generated based on the information including the answer.

Images