[go: up one dir, main page]

WO2019146767A1 - Système d'analyse émotionnelle - Google Patents

Système d'analyse émotionnelle Download PDF

Info

Publication number
WO2019146767A1
WO2019146767A1 PCT/JP2019/002570 JP2019002570W WO2019146767A1 WO 2019146767 A1 WO2019146767 A1 WO 2019146767A1 JP 2019002570 W JP2019002570 W JP 2019002570W WO 2019146767 A1 WO2019146767 A1 WO 2019146767A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
emotion
unit
message
analysis system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/002570
Other languages
English (en)
Japanese (ja)
Inventor
久和 正岡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2019146767A1 publication Critical patent/WO2019146767A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state

Definitions

  • the present disclosure relates to a system for analyzing a subject's emotions.
  • Patent Document 1 and Patent Document 2 disclose techniques for estimating a subject's emotion.
  • the purpose of this disclosure is to provide an emotion analysis system that analyzes and reports the subject's emotions. Another object of the present disclosure is to provide an emotion analysis system that intuitively reports subject's emotions in a form that can be understood by anyone. Yet another object of the present disclosure is to provide an emotion analysis system that supports the improvement of the subject's emotions. Another object of the present disclosure is to provide an emotion analysis system that modifies a subsequent improvement based on the subject's emotion and the change in emotion after the improvement of the emotion provided for the emotion. It is.
  • the present disclosure includes the following configurations.
  • a detection unit for detecting the heart rate and body temperature of the subject an acquisition unit for acquiring the heart rate and body temperature detected by the detection unit and analyzing the emotion of the subject, and the emotion analyzed by the acquisition unit Emotion analysis system provided with a notification unit for giving notification.
  • the notification unit classifies the emotions analyzed by the acquisition unit into a plurality of categories, and uses the classified emotions as visual information including at least one of color, numbers, characters, symbols, pictures, and patterns. At least one of a display unit to be displayed, a sound output unit outputting by auditory information including at least one of sound, voice, and music, or a tactile sensation output unit outputting by tactile information including vibration, shape, and surface roughness Equipped with
  • the notification unit notifies an improvement measure for improving the emotion analyzed by the acquisition unit.
  • the notification unit notifies a maintenance measure for maintaining the emotion analyzed by the acquisition unit.
  • the acquisition unit analyzes the subject's emotion based on the Russell circle, and the notification unit determines from the left half side the right half when it is determined that the discomfort area is the left half of the Russell circle. And output at least one of visual information, auditory information, and tactile information that changes the subject's emotion to the pleasure area of the subject.
  • the acquisition unit analyzes the subject's emotion based on the Russell circle
  • the notification unit is visual information or auditory information that changes the subject's emotion toward the radial center of the Russell circle.
  • Output at least one of dynamic information and tactile information.
  • the notification unit outputs a message prompting a change from the subject's current action to a different action when improving the feeling, and / or directly to the subject when maintaining the feeling or
  • An emotion analysis system that outputs messages that give awards indirectly.
  • An acquisition unit for acquiring the body temperature and analyzing the emotion, and a display unit for displaying the analyzed emotion are provided.
  • the wearable terminal includes the detection unit and the display unit, and the portable terminal includes the acquisition unit and the display unit
  • the emotion analysis system further includes a communication unit on which the wearable terminal and the portable terminal communicate by either wireless communication or wired communication.
  • the portable terminal is provided with a plurality of verbal messages representing emotions, and among the messages, ones according to the emotion are automatically visually displayed on the display unit of the wearable terminal and the portable terminal, And / or an emotion analysis system including a sound output unit that outputs a message by voice.
  • the subject can input a subject message of a reply or a reply from the terminal in response to the message displayed on either the wearable terminal or the portable terminal, or both, and another separated display means.
  • An emotion analysis system comprising: a conversation providing unit which enables the portable terminal to send a reply to the subject message.
  • the emotion analysis system 10 includes a detection unit 11 (DET), an acquisition unit 12 (ACC), and a notification unit 13 (NOT).
  • DET detection unit 11
  • ACC acquisition unit 12
  • NOT notification unit 13
  • the detection unit 11 for detecting the heart rate and the body temperature of the subject can be provided by the wearable terminal 1a worn on the subject or the wearable measurement instrument 1b worn on the subject.
  • the wearable terminal 1a can be provided, for example, by a detachable watch-type terminal.
  • the wearable measuring instrument 1b can be provided, for example, by a terminal taped to the skin, or an implant implanted subcutaneously.
  • the detection unit 11 accumulates the subject's heart rate and body temperature over a fixed period of time. Such data storage is realized by a non-transitional tangible memory device.
  • the acquisition unit 12 can be provided by a so-called computer system.
  • the computer systems can be arranged centrally or decentrally.
  • the acquisition unit 12 can be provided, for example, on the wearable terminal 1a worn on the subject.
  • the acquisition unit 12 can be provided on the wearable terminal 1a and various terminal devices 2a, 2b, and 3a (see FIGS. 6 and 9) disclosed in the embodiments described later.
  • the acquisition unit 12 may be provided in a device different from the subsequent notification unit 13.
  • one or more acquisition units 12 may be provided for one subject.
  • the acquisition unit 12 can be provided in a terminal device available to the user.
  • the notification unit 13 classifies and reports the emotions analyzed by the acquisition unit 12 into a plurality.
  • the notification unit 13 can be provided in the wearable terminal 1a.
  • the notification unit 13 can be provided to the wearable terminal 1a and various terminal devices 2a, 2b, and 3a disclosed in the embodiments described later.
  • One or more notification units 13 may be provided for one subject.
  • the notification unit 13 can be provided in a terminal device available to the user.
  • the notification unit 13 can include a display unit that displays classified emotions using visual information including at least one of color, numbers, characters, symbols, pictures, and patterns.
  • the notification unit 13 can include a sound output unit that outputs classified emotions as auditory information including at least one of sound, voice, and music.
  • the notification unit 13 can include a tactile sensation output unit that outputs classified emotions as tactile information including vibration, shape, and surface roughness.
  • the notification unit 13 can include at least one of a display unit, a sound output unit, and a tactile sensation output unit.
  • the notification unit 13 preferably includes at least a display unit. Furthermore, in this embodiment, it is desirable to provide a display that can assign different emotions to different colors and display emotions in color in order to intuitively intelligibly convey emotions. Furthermore, the notification unit 13 may notify of an improvement measure for improving the emotion analyzed by the acquisition unit 12. The notification unit 13 may provide a message for supporting improvement in the subject's emotion by the display unit, the sound output unit, or the tactile sensation output unit.
  • This embodiment has a wearable terminal 1a provided with a display unit 1c for displaying the analyzed emotion.
  • the detection unit 11 may be worn apart from the wearable terminal 1a as the wearable measurement device 1b and apart from the wearable terminal 1a and worn on the skin of the subject's body, for example, the heart.
  • the wearable terminal 1a and the wearable measurement device 1b can be connected by any communication means, for example, wireless communication, so that heart rate and body temperature data can be transmitted and received mutually.
  • the communication means is provided by the communication unit 1d provided in the wearable terminal 1a and the communication unit 1e provided in the wearable measurement instrument 1b.
  • the emotion analysis method is performed, for example, as follows.
  • the wearable terminal 1 a or the wearable measurement device 1 b functions as the detection unit 11.
  • the detection unit 11 measures the heart rate and the skin temperature of the subject.
  • the acquisition unit 12 analyzes the subject's emotion based on the chart of FIG. 2 from the measured heart rate and skin temperature. In this embodiment, analysis is performed by the computer system of the wearable terminal 1a.
  • the notification unit 13 displays the emotion analyzed by the acquisition unit 12 on the display unit 1 c of the wearable terminal 1 a.
  • the display unit 1c may be a light emitter such as an LED, or may be a screen using liquid crystal or the like.
  • An aspect of the display is a number, a symbol, a character or the like indicating an emotion with a color corresponding to the emotion as a basic element.
  • the wearable terminal 1a also has a tactile sensation output unit provided by a motor called a vibrator.
  • a vibrator When the subject's emotion enters the caution zone and the danger zone shown in FIG. 2, the notification unit 13 of the wearable terminal 1a vibrates in small steps in each pattern to intuitively indicate to the subject the transition to the caution zone and the danger zone. Also has the ability to
  • the color of emotion in the area is continuously turned on by the notification unit 13, and when it enters the danger zone, it is blinked and displayed intermittently.
  • the subject can objectively know his / her own emotion by himself, and a person who looks at the informing unit 13 such as a supporter of the subject can know the subject's emotion.
  • the wearable type refers to a type in which data such as heart rate and body temperature can be detected without the intention of measurement while the subject's body is constantly touched.
  • the emotion analysis system 10 includes the detection unit 11 (DET), the acquisition unit 12 (ACC), and the notification unit 13 (NOT).
  • the detection unit 11 measures the heartbeat and the temperature of the subject 31 (EXP).
  • the acquisition unit 12 is analyzed by a Russell circle calculation unit 14 (CAL) that calculates coordinates on the Russell circle, and an analysis unit 15 (ANA) that analyzes emotions using the coordinates on the Russell circle as main elements.
  • CAL Russell circle calculation unit 14
  • ANA analysis unit 15
  • ANA analysis unit 15
  • CRE notification data generation unit 16
  • the notification data generation unit 16 generates notification data for notifying the analyzed emotion in a color that is easy for anyone to understand.
  • the emotion analysis system also includes an advice generation unit 17 (ADV) for functioning as an emotion analysis improvement system.
  • the advice generation unit 17 generates a visual or audio message to improve emotions. That is, the advice generation unit 17 generates a message that is effective to move the current coordinates on the Russell's ring close to the origin of the ring radial direction. If there is a current coordinate in the annoyance area of the left half of the torus, then generate a message that is validated to move it to the side of the pleasure area of the torn right half.
  • These messages inform the subject's feelings at that time and encourage them to take some other action, such as the following. "Now I feel like I'm unstable.” "Let's go away from where you are, take three deep breaths.” "Let's stop what you are doing and take three deep breaths.”
  • the advice generation unit 17 maintains the state in that area, and further, a direction closer to the origin in the ring radial direction. Generate a message that is validated for transfer to These messages inform the subject's emotions at that time, acknowledge the emotion maintenance efforts so far, and encourage their continuation. For example: “I have been feeling calm for over two hours so far.” “This is the third longest record of maintaining your emotions. We have achieved great results.” "How about taking your favorite treat? "Let's take three deep breaths to keep this feeling as long as possible.”
  • the notification unit 13 not only indicates the analyzed emotion of the subject 31 but also notifies a message.
  • this message includes an action change message and / or a reward message. Additionally, the message may additionally include a recommendation action message.
  • the notification unit 13 outputs an action change message prompting a change from the current action of the subject 31 to another different action.
  • the action change message is given to the subject 31 directly or indirectly.
  • the action change message may be given to the supporter 32.
  • the supporter 32 having received the action change message can work on the subject 31 to change the action of the subject 31.
  • the notification unit 13 outputs a reward message that directly or indirectly gives a reward to the subject 31.
  • the reward message may be given directly to the subject 31. Further, the reward message may be given to the supporter 32. In this case, a reward may be given to the subject 31 from the supporter 32.
  • the award includes at least one of a word that compliments the subject 31, a favorite item that the subject 31 likes, an article that the subject 31 likes, an image, and the like.
  • the notification unit 13 may output a recommended action message indicating an action of the subject 31 effective to improve the feeling.
  • reporting part 13 may output the recommendation action message which shows the test subject's 31 action effective in order to maintain an emotion, when maintaining an emotion.
  • the recommended action message is exemplified by, for example, "deep breathing".
  • the messages are preset and stored in the storage device. For example, a plurality of messages for returning anger's emotions to calm emotions are stored in advance.
  • the advice generation unit 17 generates a message so as to increase the strength in order according to the strength data set in advance for each message.
  • the advice generation unit 17 uses the data calculated by the Russell circle calculation unit 14 to generate a message.
  • the advice generation unit 17 uses the notification unit 13 to notify a user of a subject including the subject and the supporter.
  • this emotion analysis system comprises a learning unit 18 (LEA).
  • the learning unit 18 evaluates the effect (effect) of the generated old message based on the feedback information, and changes the subsequently generated new message.
  • the change of the message based on such feedback information is called learning control.
  • the change or change of the message is performed by selecting a previously stored message.
  • the change or change of the message is given by, for example, a change of the end word strength.
  • the change or change of the message may be implemented by the additional storage of a new message obtained by data integration with another emotion analysis system and the use of the new message. Alternatively, the change or change of the message may be implemented by storing a new message obtained by data integration with another emotion analysis system and switching to the new message.
  • One piece of feedback information can be obtained from changes in the coordinates of the most recent emotion on the Russell circle after the old message. The effectiveness of the old message is evaluated depending on whether the change from the old coordinate to the new coordinate is the approach to the target coordinate or the separation from the target coordinate.
  • the learning unit 18 obtains coordinate information from the Russell circular calculation unit 14.
  • One piece of feedback information is obtained from the subject's declaration, ie, input to the system.
  • One piece of feedback information is obtained by a declaration from the supporter 32 (SUP), that is, an input to the system. By making the declaration from the supporter 32 one of feedback information, objective learning becomes possible.
  • the declaration from the user including the subject 31 or the supporter 32 is input from the teaching unit 19 (TEA) to the learning unit 18.
  • the emotion improvement function by providing a message can be adapted to the individuality of the subject. Specifically, the message is adjusted so that emotion can be more easily improved. Also, by providing such a learning control function, the message is adjusted so that the desired change in emotion occurs.
  • a part or the whole of the notification unit 13 may be provided by artificial intelligence 20 (ATI).
  • the emotion analysis system provides analysis of emotions, selection and display of messages, and transmission and reception of messages by a server system equipped with an artificial intelligence 20.
  • This server system may be placed in independent hardware or may be placed on the cloud.
  • the history information including the message provided from the artificial intelligence 20 to the subject 31 and the feedback information corresponding to the message are all recorded in the artificial intelligence 20.
  • the effect of the message maintaining the emotion in the safe zone, or the effect of the message returning the emotion in the attention zone or the danger zone to the safe zone is automatically accumulated.
  • the artificial intelligence 20 integrates learning data of a plurality of emotion analysis systems 21 (EANAS) regarding a plurality of subjects 33 (EXPA).
  • EANAS emotion analysis systems 21
  • EXPA subjects 33
  • the answer from the artificial intelligence to a certain subject is selected from learning data collected for a specific subject 33 and learning data collected from other subjects. This will make the more relevant linguistic messages faster to create and send.
  • the artificial intelligence 20 includes an environment detection unit 22 (EDET) that detects an environment in which the subject 31 is placed.
  • the environment detection unit 22 detects information of the environment in which the subject 31 is placed.
  • the environmental information includes at least one of date and time, temperature, humidity, barometric pressure, ambient noise level and sound quality, ambient people, and ambient brightness.
  • the artificial intelligence 20 providing the learning unit 18 relates the change in coordinates, that is, the change in emotion, to the environment by monitoring the change in coordinates on the Russell's circle and the environment. Thereby, the change in emotion is predicted from the change in environment, and the predicted change in emotion is notified to the subject. As a result, it is possible to prevent excessive swings of emotions in advance. Furthermore, artificial intelligence 20 may automatically generate a new message by correlating the change of emotion with the change of environment.
  • each normal value is calculated as a normal value STD from the data of heart rate and body temperature detected from the subject.
  • the numerical value of the state in which the subject is at rest may be used as a normal value, for example, if it is the body temperature, the numerical value at the time of awakening may be used.
  • the maximum and minimum values of the subject's heart rate and body temperature are measured.
  • the maximum and minimum values are the maximum and minimum heart rate or temperature in the daily life of the subject. For example, it refers to the maximum or minimum value recorded during daily measurements. These numerical values are regarded as temporary maximum and minimum values, and from the next day, if there is a value exceeding these temporary maximum and temporary minimum values, the previous maximum value or minimum value is updated. If there is no value exceeding, use the maximum and minimum values up to the previous day without updating.
  • the normal value and the maximum and minimum values may be given as initial values. Then, from the following equation, the ratio of the current measurement value to the maximum value and the minimum value can be obtained for each of the heart rate and the temperature based on the normal value.
  • the proportions thus determined are plotted on a graph with the heart rate on the vertical axis and the body temperature on the horizontal axis. Furthermore, the graph is superimposed on Russell's ring model.
  • Russell's circle model human emotions are (1) awakening ARS, (2) pain DST, (3) sadness MIS, (4) depressive DEP, (5) sleepiness SLP, (6) satisfied CNT, (7 ) 8 types of pleasure PLS, (8) excitement EXC.
  • These emotions are arranged in 45-degree steps on a circle: 0 degrees: pleasure, 45 degrees: excitement, 90 degrees: awakening, 135 degrees: pain, 180 degrees: sadness, 225 degrees: melancholy, 270 degrees: sleepiness, 315 degrees: Satisfied.
  • the position of the plot on the toric model indicates one of eight emotions. Therefore, in this embodiment, the emotion of the subject is analyzed as one of a plurality of categories based on the intersection of the subject's heart rate and body temperature on Russell's ring model.
  • the radius of the disk is divided, for example, into three in accordance with the ratio of heart rate and body temperature measurements to the maximum value MAX and the minimum value MIN. That is, for example, 0% to 25% is a safety zone STB, 25% to 70% is a caution zone CAT, and 70% or more is a danger zone WAR.
  • the division ratio and the number of divisions may be changed to, for example, four divisions according to the subject's psychological physical condition.
  • each emotion may be assigned a number, and the category may be displayed as a percentage (for example, 65%). However, the safe zone is displayed in the color of "pleasure" regardless of emotion.
  • FIG. 3 shows a flow of processing S161 for analyzing and improving emotions.
  • the emotion analysis system detects biological information of the subject, such as heart rate, body temperature, blood oxygen concentration, and facial expression.
  • the emotion analysis system analyzes the subject's emotion using the detected biological information.
  • the emotion analysis system determines whether the analyzed emotion is bad or good. Judgment here is judged based on the coordinate which the test subject's living body information on a Russell circle shows. The emotion analysis system notifies in step S165 or step S167 that the subject can recognize his or her own objective emotion.
  • the emotion analysis system provides a message to improve the emotion into a good emotion in step S166. That is, if the subject's emotion is shown in the left half of the Russell's circle, a message is provided to move the subject's emotion to the right in the Russell's circle.
  • the emotion analysis system provides a message to the subject to maintain a good emotion in step S168 if the analyzed emotion is a good emotion such as pleasure or satisfaction. That is, if the subject's emotion is shown in the right half area of the Russell circle, a message is provided to maintain the subject's emotion in the right half area of the Russell circle.
  • the provided message can be said to be a positive response to subjects who are not merely informed.
  • the notification in step S165 or step S167 and the provision of the message in step S166 or step S168 are performed by the notification unit 13.
  • FIG. 4 shows the process from S162 to S167 in more detail.
  • the system inputs the subject's heart rate and body temperature.
  • the system accumulates heart rate and body temperature in step S152.
  • the system calculates the above-described normal value and the maximum and minimum values.
  • the system analyzes the subject's current emotion from the heart rate and the temperature in step S154.
  • step S155 The system reports the subject's emotion in step S155.
  • step S156 the system identifies a color pre-assigned to the current emotion.
  • the system displays the specified color on the notification unit 13 in step S157.
  • the notification unit 13 may display not only the color of the analyzed emotion but also Russell's ring model. Furthermore, the notification unit 13 may display a plot based on the subject's heart rate and body temperature. Specifically, the notification unit 13 displays a Russell ring model as a line drawing, displays a plot as a point, and further displays a color indicating an emotion at that time as a background color. In step S158, the system selects and switches between continuous lighting and blinking lighting of the background color according to the plot position on Russell's ring model. Processing for such an emotion analysis method is repeatedly performed.
  • the subject 31 can objectively grasp his / her emotion and the degree thereof. In particular, anyone can intuitively grasp emotions by the color of the notification unit 13. Therefore, when the subject 31 is ASD (Autism Spectrum Disorder), it is possible to objectively recognize changes in one's emotions. In a notable case, the subject 31 can take an action to objectively recognize changes in his / her emotions before the emotions become difficult to control, and to prevent the emotions from becoming difficult to control. When the subject 31 is a typical developing person, it can be dealt with before his or her degree of stress rises. As a result, the emotion analysis system can reduce the psychological and mental burden on the subject 31 in daily life.
  • ASD Application Spectrum Disorder
  • the emotion analysis system analyzes emotions, displays them objectively by visual information including color, and makes the subject 31 or the supporter 32 recognize. Furthermore, the emotion analysis system not only informs the analyzed emotions, but causes the subjects 31 and the supporter 32 to recognize the deterioration of the emotions.
  • the emotion analysis system not only makes the emotions recognized but also provides additional information to maintain good emotions and / or additional information to improve the deteriorated emotions.
  • the provision of the additional information may store a plurality of additional information in advance in a storage medium such as a semiconductor memory, and select and reproduce the plurality of additional information stored. Also, the additional information may be learned in actual use. Also, additional information may be added by the user. Also, the additional information may be added via the network such as the Internet or selected on the network.
  • the additional information is provided as information that can be understood by the user, such as text and voice.
  • the additional information may be in the form of an aid to draw the user's attention.
  • the additional information may include, for example, text and / or voice presented with a pictorial image such as a cartoon character that is subject to the subject's 31 attention.
  • a pictorial image such as a cartoon character can draw the attention of the subject 31 even when the subject's 31 emotion is getting worse.
  • the supporter 32 can also grasp the emotion of the subject 31.
  • the supporter 32 includes a guardian of the subject 31, a helper of the subject 31, or an employee of a support organization. Therefore, it is possible to provide effective support and assistance that are in line with the feelings of the subject 31 and that are not wasted.
  • the second embodiment includes, in addition to the first embodiment, a portable terminal 2a such as a smartphone or a tablet.
  • the wearable terminal 1a, the wearable measuring instrument 1b, and the portable terminal 2a are connected by any communication means, for example, wireless communication, and can transmit and receive heart rate and body temperature data to each other.
  • FIG. 1c1 An example of the wearable terminal 1a or the portable terminal and its display unit 1c is shown in FIG.
  • a circular portion 1c1 is present at the top of the display unit 1c, and the analyzed emotion is displayed in color here.
  • a message to the subject for the purpose of feeling improvement or feeling maintenance is displayed in the subject-oriented message column 1c2.
  • the input message of the reaction from the subject to it is displayed in 1c3.
  • the circular portion 1c1 may display the Russell's ring model of FIG. 2 to which a heart rate and a temperature index are added.
  • FIG. 8 shows an example in which the detection unit 11 and the display unit 1c are mounted on the wearable terminal 1a in the second embodiment.
  • the wired communication means 41 is, for example, a USB cable.
  • one example of the operation is to analyze the subject's emotion also with the portable terminal 2a.
  • the heart rate and skin temperature of the subject are measured by the wearable terminal 1a or the wearable measurement device 1b.
  • the emotion of the subject is analyzed by the portable terminal 2a based on the concept of FIG.
  • the analyzed emotion is displayed on both the portable terminal 2a and the wearable terminal 1a, or one of these display units.
  • Yet another operation example is to use another device 2b such as a screen of a personal computer or a television monitor instead of the portable terminal 2a or in addition to the portable terminal 2a.
  • the emotion analyzed by the portable terminal 2a is also displayed on another device 2b such as a screen of a personal computer or a television monitor. This enables the supporters around the subject to confirm the subject's emotions.
  • the color of the subject's emotion displayed on the portable terminal 2a or another device 2b such as a screen of a personal computer or a television monitor is red, orange, purple, yellow, Blue, light blue (light blue), pink, including green.
  • the emotion of the present subject is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor. It displays messages in the indicated language.
  • the portable terminal 2a is provided with an audio output unit, and has a function of outputting a language message as an audio. For example, if the emotion of the subject analyzed is "pain, 50%", a message such as "Now you are experiencing moderate pain" is displayed. A plurality of these messages are stored in advance in the portable terminal 2a, and an appropriate one is automatically selected and transmitted in the portable terminal 2a according to the analyzed emotion. These messages may be displayed differently each time at fixed time intervals, for example, every 10 minutes. In addition to the language message, a picture message may be displayed. Also, the language message may be transmitted to the subject by voice through the voice output unit.
  • a message is provided to prompt an action to maintain the state.
  • the message includes a language message or a picture message.
  • the message is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor.
  • a message for returning the emotion to the safe zone is provided.
  • the message includes a language message or a picture message.
  • the message is displayed on the wearable terminal 1a, the portable terminal 2a, or another device 2b such as a screen of a personal computer or a television monitor. For example, if the subject's emotion was analyzed as "pain, 50%", "It's about time to take action to get rid of the pain. A message such as These messages may be displayed differently each time at certain time intervals until the subject's emotions enter the safe zone.
  • the system continuously obtains heart rate and body temperature and continuously judges emotions, thereby quantifying whether the displayed message has an effect on the improvement of the subject's emotions, and to what extent. Can be measured.
  • the system memorizes the displayed message and its effect, and then the message with higher emotion improvement effect is better It can be displayed in a short time. This will be called “learning" in this embodiment.
  • the notification unit 13 notifies of an improvement measure for improving the emotion analyzed by the acquisition unit 12. Not only the emotions are displayed, but the improvement measures are informed. This allows the user including the subject and / or the supporter to improve the subject's emotions.
  • the wording of the message can be selected and changed, or the character to which the message is transmitted can be selected and changed according to the preference of the subject. For example, for children, adults, elderly people, men, women, close friendliness, elder tone, grandson tone, servant tone, teacher tone, etc.
  • the conditions of these messages are stored in advance in the notification unit 13. The user selects the tone of the message, for example, by the operation unit of the portable terminal 2a.
  • the subject can input the subject message of the reply and the answer.
  • the wearable terminal 1a worn by the subject or the portable terminal 2a carried by the subject has a voice input function or a text input function.
  • the voice input function can be provided, for example, by a microphone and a voice recognition device.
  • Text input functionality can be provided by the keyboard.
  • the portable terminal 2a can further send a message (reply) to the subject message.
  • the portable terminal 2a has a conversation providing unit for generating a reply to the subject message.
  • the conversation providing unit provides a reply in which the subject feels as if he or she is in conversation with a human.
  • the conversation providing unit can use a variety of devices, from bot devices that only select one of a plurality of prepared responses, to a device called artificial intelligence, according to the degree of conversation provided by itself. It is. This causes the subject to send and receive messages as if they were in conversation with a human being.
  • the conversation providing unit may be a communication line communicably connecting the subject and the operator.
  • the ninth embodiment A ninth embodiment is shown in FIG.
  • the analysis of emotions, the selection of messages and the display in the second to eighth embodiments are performed by the server system 3a equipped with artificial intelligence.
  • This server system may be located in independent hardware, but may be located on the cloud.
  • the artificial intelligence learns the message of the appropriate length, the degree of abstraction, the expression, the wording to the individual subject. , To allow artificial intelligence to create messages.
  • artificial intelligence learning data for a plurality of subjects is integrated.
  • the training data is collected via a network and made available as a set of data available to a particular subject.
  • the answer to a subject is selected as artificial intelligence from among learning data collected from a plurality of other subjects.
  • the use of the emotion analysis system by a plurality of subjects, the integration of the plurality of learning data, and the action of utilizing the integrated learning data for a specific subject are included. This makes it possible to create and send more appropriate linguistic messages faster.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Hospice & Palliative Care (AREA)
  • Pathology (AREA)
  • Developmental Disabilities (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • Physics & Mathematics (AREA)
  • Child & Adolescent Psychology (AREA)
  • Biophysics (AREA)
  • Educational Technology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un système d'analyse émotionnelle qui analyse les émotions d'un sujet et effectue ensuite une notification concernant les émotions. Le système d'analyse émotionnelle (10) comprend une unité de détection (11) qui détecte la fréquence cardiaque et la température du sujet. Le système d'analyse émotionnelle (10) comprend une unité d'acquisition (12) qui acquiert la fréquence cardiaque et la température détectées par l'unité de détection (11), et analyse les émotions du sujet. Le système d'analyse émotionnelle (10) comprend une unité de notification (13) qui catégorise les émotions obtenues suite à l'analyse par l'unité d'acquisition (12) en une pluralité de catégories, et effectue une notification concernant les émotions. L'unité de notification (13) comprend une unité d'affichage. Les émotions sont classées en une pluralité de catégories. La pluralité d'émotions sont attribuées à une pluralité de couleurs différentes. L'unité de notification (13) utilise l'unité d'affichage pour afficher les couleurs correspondant aux émotions.
PCT/JP2019/002570 2018-01-26 2019-01-25 Système d'analyse émotionnelle Ceased WO2019146767A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-011827 2018-01-26
JP2018011827A JP2021052812A (ja) 2018-01-26 2018-01-26 感情分析システム

Publications (1)

Publication Number Publication Date
WO2019146767A1 true WO2019146767A1 (fr) 2019-08-01

Family

ID=67394988

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/002570 Ceased WO2019146767A1 (fr) 2018-01-26 2019-01-25 Système d'analyse émotionnelle

Country Status (2)

Country Link
JP (1) JP2021052812A (fr)
WO (1) WO2019146767A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021250730A1 (fr) * 2020-06-08 2021-12-16 日本電信電話株式会社 Dispositif de génération de message, dispositif de présentation de message, procédé de génération de message et programme de génération de message
WO2021250731A1 (fr) * 2020-06-08 2021-12-16 日本電信電話株式会社 Dispositif, procédé et programme de sélection de message, et dispositif de présentation de message
JP2022097269A (ja) * 2020-12-18 2022-06-30 ユニ・チャーム株式会社 情報処理装置、情報処理方法及び情報処理プログラム
WO2024004440A1 (fr) * 2022-06-30 2024-01-04 ソニーグループ株式会社 Dispositif de génération, procédé de génération, dispositif de reproduction et procédé de reproduction
EP4113425A4 (fr) * 2020-02-28 2024-05-29 Astellas Pharma Inc. Appareil habitronique, dispositif de traitement d'informations, système de traitement d'informations, et programme

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023080019A1 (fr) * 2021-11-04 2023-05-11 オムロン株式会社 Dispositif de traitement de bioinformations, procédé de traitement de bioinformations et programme
WO2023203961A1 (fr) * 2022-04-18 2023-10-26 パナソニックＩｐマネジメント株式会社 Système d'affichage d'état psychologique
WO2024172066A1 (fr) * 2023-02-15 2024-08-22 ヤマハ発動機株式会社 Dispositif de traitement d'émotion estimée, son procédé de fabrication, programme de traitement d'émotion estimée et support d'enregistrement

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130023738A1 (en) * 2011-07-22 2013-01-24 Hon Hai Precision Industry Co., Ltd. Mobile phone for health inspection and method using same
CN104905803A (zh) * 2015-07-01 2015-09-16 京东方科技集团股份有限公司 可穿戴电子设备及其情绪监控方法
JP2016036500A (ja) * 2014-08-07 2016-03-22 シャープ株式会社 音声出力装置、ネットワークシステム、音声出力方法、および音声出力プログラム
JP2017182530A (ja) * 2016-03-31 2017-10-05 大日本印刷株式会社 検索システム、検索方法、サーバ、およびプログラム

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130023738A1 (en) * 2011-07-22 2013-01-24 Hon Hai Precision Industry Co., Ltd. Mobile phone for health inspection and method using same
JP2016036500A (ja) * 2014-08-07 2016-03-22 シャープ株式会社 音声出力装置、ネットワークシステム、音声出力方法、および音声出力プログラム
CN104905803A (zh) * 2015-07-01 2015-09-16 京东方科技集团股份有限公司 可穿戴电子设备及其情绪监控方法
JP2017182530A (ja) * 2016-03-31 2017-10-05 大日本印刷株式会社 検索システム、検索方法、サーバ、およびプログラム

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4113425A4 (fr) * 2020-02-28 2024-05-29 Astellas Pharma Inc. Appareil habitronique, dispositif de traitement d'informations, système de traitement d'informations, et programme
WO2021250730A1 (fr) * 2020-06-08 2021-12-16 日本電信電話株式会社 Dispositif de génération de message, dispositif de présentation de message, procédé de génération de message et programme de génération de message
WO2021250731A1 (fr) * 2020-06-08 2021-12-16 日本電信電話株式会社 Dispositif, procédé et programme de sélection de message, et dispositif de présentation de message
JPWO2021250731A1 (fr) * 2020-06-08 2021-12-16
JPWO2021250730A1 (fr) * 2020-06-08 2021-12-16
JP7400968B2 (ja) 2020-06-08 2023-12-19 日本電信電話株式会社 メッセージ生成装置、メッセージ提示装置、メッセージ生成方法及びメッセージ生成プログラム
JP7435768B2 (ja) 2020-06-08 2024-02-21 日本電信電話株式会社 メッセージ選択装置、メッセージ提示装置、メッセージ選択方法及びメッセージ選択プログラム
JP2022097269A (ja) * 2020-12-18 2022-06-30 ユニ・チャーム株式会社 情報処理装置、情報処理方法及び情報処理プログラム
WO2024004440A1 (fr) * 2022-06-30 2024-01-04 ソニーグループ株式会社 Dispositif de génération, procédé de génération, dispositif de reproduction et procédé de reproduction

Also Published As

Publication number Publication date
JP2021052812A (ja) 2021-04-08

Similar Documents

Publication Publication Date Title
WO2019146767A1 (fr) Système d'analyse émotionnelle
RU2613580C2 (ru) Способ и система для оказания помощи пациенту
US20240407688A1 (en) System and Method for Patient Monitoring
KR20170087834A (ko) 마음 상태를 결정하고 피험자에게 감각기관을 통한 대응책을 제공하기 위한 컴퓨터 시스템
US11779275B2 (en) Multi-sensory, assistive wearable technology, and method of providing sensory relief using same
US12208213B2 (en) Multi-sensory, assistive wearable technology, and method of providing sensory relief using same
JPWO2019220745A1 (ja) 情報処理システム、情報処理方法、および記録媒体
JP2018517995A (ja) 集約幼児測定データの分析、幼児睡眠パターンの予想、幼児データに関連した観察に基づく幼児モデルの導出、推測を用いた幼児モデルの作成、及び幼児発達モデルの導出
Pryss et al. A personalized sensor support tool for the training of mindful walking
Li et al. Rethinking pain communication of patients with Alzheimer’s disease through E-textile interaction design
WO2023034347A1 (fr) Technologie portable multi-sensorielle d'assistance, et procédé de fourniture d'un soulagement sensoriel à l'aide de celle-ci
JP5987238B2 (ja) マルチモーダル型トラッキングシステム及びそのプログラム
CN116419778A (zh) 具有交互辅助特征的训练系统、训练装置和训练
Alhassan et al. Admemento: a prototype of activity reminder and assessment tools for patients with alzheimer’s disease
WO2019155010A1 (fr) Procédé, appareil et système pour fournir une mesure afin de résoudre un état physiologique inconfortable ou non souhaité d'une personne
WO2023199422A1 (fr) Dispositif d'inférence d'état interne, procédé d'inférence d'état interne et support de stockage
Sumathi et al. BCI Based Ambient Assisted Living with Music Therapy For Lock-In Syndrome
Villarroel et al. Wireless smart environment in Ambient Assisted Living for people that suffer from cognitive disabilities
Zhang et al. Peripheral display for conveying real-time pain condition of persons with severe intellectual disabilities to their caregivers
Attard Mental state examination
Bouchard et al. Challenges in Developing Smart Homes: Human Perspective
Freitas et al. Wearable Devices in Dementia Monitoring: A Systematic Review of Technologies, Design, and Future Directions
JP2025048925A (ja) システム
JP2025048978A (ja) システム
WO2025186299A1 (fr) Système et procédé

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19743966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19743966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP

NENP Non-entry into the national phase

Ref country code: JP