[go: up one dir, main page]

WO2023167061A1 - Procédé, dispositif et système de traitement d'informations - Google Patents

Procédé, dispositif et système de traitement d'informations Download PDF

Info

Publication number
WO2023167061A1
WO2023167061A1 PCT/JP2023/006321 JP2023006321W WO2023167061A1 WO 2023167061 A1 WO2023167061 A1 WO 2023167061A1 JP 2023006321 W JP2023006321 W JP 2023006321W WO 2023167061 A1 WO2023167061 A1 WO 2023167061A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
information processing
work
mental state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/006321
Other languages
English (en)
Japanese (ja)
Inventor
健人 中田
乃愛 金子
拓 田中
律子 金野
咲湖 安川
能宏 脇田
健治 山根
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Priority to JP2024504637A priority Critical patent/JPWO2023167061A1/ja
Publication of WO2023167061A1 publication Critical patent/WO2023167061A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations

Definitions

  • the present disclosure relates to an information processing method, an information processing device, and an information processing system.
  • an information processing method and an information processing apparatus that can change behavior to improve the situation by accurately grasping the mental state and providing a specific proposal based on the grasp. and propose an information processing system.
  • an information processing device acquires information on a user's mental state based on sensing data from a biological information sensor, acquires information on the user's work, and the user's mental state. and estimating a relationship between information related to the user's work and information related to the user's work, and outputting an estimation result related to the user's work or mental state estimated based on the relationship to an information processing terminal.
  • a method is provided.
  • a mental state information acquisition unit that acquires information on the user's mental state based on sensing data from a biological information sensor, a business information acquisition unit that acquires information on the user's business, and an estimating unit for estimating a relationship between information about a user's mental state and information about the user's work; and an information output unit for outputting an estimation result regarding the user's work or mental state estimated based on the relationship to an information processing terminal.
  • An information processing device is provided.
  • a first information processing device that acquires information about a user's mental state based on sensing data from a biological information sensor, and a second information processing device that stores information about the user's work and a third information processing device that determines information related to work recommended to the user, wherein the third information processing device receives from the first information processing device the user's acquiring information on a mental state, acquiring information on the user's work from the second information processing device, estimating a relationship between the information on the user's mental state and the information on the user's work, and An information processing system is provided for outputting an estimation result related to the user's work or mental state estimated based on to an information processing terminal.
  • FIG. 1 is a system diagram showing a schematic functional configuration of an information processing system 10 according to a first embodiment of the present disclosure
  • FIG. It is a block diagram showing an example of functional composition of wearable device 100 concerning a 1st embodiment of this indication.
  • 1 is an explanatory diagram showing an example of the appearance of a wearable device 100a according to the first embodiment of the present disclosure
  • FIG. 1 is an explanatory diagram showing an example of the appearance of a wearable device 100b according to the first embodiment of the present disclosure
  • FIG. 2 is a block diagram showing an example of a functional configuration of a user terminal 200 according to the first embodiment of the present disclosure
  • FIG. 3 is a block diagram showing an example of a functional configuration of a server 300 according to the first embodiment of the present disclosure
  • FIG. 2 is a block diagram showing an example of a functional configuration of an attendance management server 400 according to the first embodiment of the present disclosure
  • FIG. 1 is a sequence diagram of an information processing method according to the first embodiment of the present disclosure
  • FIG. 4 is a flowchart of an information processing method according to the first embodiment of the present disclosure
  • FIG. 3 is an explanatory diagram (part 1) showing an example of display on the user terminal 200 according to the first embodiment of the present disclosure
  • FIG. 2 is an explanatory diagram (part 2) showing an example of display on the user terminal 200 according to the first embodiment of the present disclosure
  • FIG. 3 is an explanatory diagram (part 3) showing an example of display on the user terminal 200 according to the first embodiment of the present disclosure
  • FIG. 1 is a sequence diagram of an information processing method according to the first embodiment of the present disclosure
  • FIG. 4 is a flowchart of an information processing method according to the first embodiment of the present disclosure
  • FIG. 3 is an explanatory diagram (part 1) showing an example of display on the user terminal 200 according
  • FIG. 4 is an explanatory diagram showing an example of display on the server 300 according to the first embodiment of the present disclosure
  • FIG. FIG. 3 is a system diagram showing a schematic functional configuration of an information processing system 10a according to a second embodiment of the present disclosure
  • FIG. FIG. 11 is a block diagram showing an example of a functional configuration of a server 300a according to the second embodiment of the present disclosure
  • FIG. FIG. 11 is a block diagram showing an example of a functional configuration of a management server 500 according to the second embodiment of the present disclosure
  • FIG. FIG. 10 is a sequence diagram of an information processing method according to the second embodiment of the present disclosure
  • FIG. 11 is an explanatory diagram showing an example of display on a management server 500 according to the second embodiment of the present disclosure
  • FIG. 11 is a system diagram showing a schematic functional configuration of an information processing system 10b according to a third embodiment of the present disclosure
  • FIG. FIG. 12 is a block diagram showing an example of a functional configuration of a mail/chat management server 600 according to the third embodiment of the present disclosure
  • FIG. 8 is a flowchart of an information processing method according to a third embodiment of the present disclosure
  • 3 is a block diagram showing an example of hardware configuration
  • the present inventors have come to create the embodiments of the present disclosure described below.
  • the mental state of the employee is grasped based on the biometric information of the employee during work execution. Furthermore, in the embodiment of the present disclosure, it is possible to estimate the relationship between the grasped mental state and the work at that time, and perform in the current mental state or predicted future mental state based on the estimated result. Estimate possible work content, work volume, and deadlines. Furthermore, in the embodiment of the present disclosure, recommendations such as alerts and work adjustments are made to individual employees and managers based on such estimation.
  • FIG. 1 is a system diagram showing a schematic functional configuration of an information processing system 10 according to this embodiment.
  • an information processing system 10 includes a user terminal (first information processing device) 200 communicably connected to a wearable device 100, and a server (third information processing device). 300 and an attendance management server (second information processing apparatus) 400, which are connected to each other via a network 700 so as to be able to communicate with each other.
  • the user terminal 200, the server 300, and the attendance management server 400 are connected to the network 700 via a base station (for example, a mobile phone base station, a wireless LAN (Local Area network) access point, etc.) (not shown). be done.
  • a base station for example, a mobile phone base station, a wireless LAN (Local Area network) access point, etc.
  • any communication method whether wired or wireless (for example, WiFi (registered trademark), Bluetooth (registered trademark), etc.) can be applied as the communication method used in the network 700, but stable operation is maintained. It is desirable to use a communication method that can Below, an outline of each device included in the information processing system 10 according to the present embodiment will be described.
  • Wearable device 100 can be a device that can be worn on a user's body part (face, earlobe, neck, arm, wrist, ankle, etc.). More specifically, the wearable device 100 is a head mounted display (HMD) type, eyeglass type, ear device type, anklet type, bracelet (wristband) type, collar type, eyewear type, pad type, batch type, clothes It can be a wearable device of various types such as a type, a hat type, and a mask type.
  • HMD head mounted display
  • eyeglass type eyeglass type
  • ear device type anklet type
  • bracelet bracelet
  • collar type eyewear type
  • pad type a wearable device of various types
  • clothes can be a wearable device of various types such as a type, a hat type, and a mask type.
  • the wearable device 100 is equipped with a sensor unit 140 (see FIG. 2), which is a non-invasive sensor device capable of acquiring various types of user's biological information (sensing data).
  • the sensor unit 140 includes, for example, a blood flow sensor that detects the user's pulse, heart rate, blood flow, intermittent oxygen, etc., an ECG (Electrocardiogram) sensor that detects the user's electrocardiogram, a blood pressure sensor that detects the user's blood pressure, a user A perspiration sensor that detects the perspiration of the user, an electroencephalogram sensor that detects the user's electroencephalogram (and can indirectly detect the user's state of sleep, relaxation, etc.
  • ECG Electrocardiogram
  • a body temperature sensor that detects the user's body temperature
  • a user's A myoelectric potential sensor that detects the tension state of muscles
  • a respiration sensor that detects the user's respiration rate and respiration volume, and the like may be provided.
  • the sensor unit 140 may also include a motion sensor for detecting the user's posture and movement, that is, the state of exercise and the state of activity.
  • the motion sensor for example, acquires sensing data indicating changes in acceleration that occur with the motion of the user, and performs analysis processing as necessary to determine the user's exercise state, posture, number of steps, distance traveled, and amount of activity. , sleep state, sleep time, energy consumption, basal metabolic energy consumption, and the like can be detected.
  • the sensor unit 140 includes an imaging device (not shown) that captures the user's expression, face, line of sight, and pupil movement, and a microphone that acquires the user's voice (hereinafter referred to as a microphone). (illustration omitted) etc. may be included. Details of the wearable device 100 will be described later.
  • the sensor unit 140 described above may be provided in the user terminal 200 described later.
  • the sensor unit 140 is, for example, an imaging device (not shown) mounted on a display provided in the user terminal 200 or provided separately from the user terminal 200 as the output unit 220 of the user terminal 200.
  • the sensor unit 140 may be, for example, a pressure sensor mounted on a chair on which the user sits. That is, in the present embodiment, the sensor unit 140 may be mounted on various articles used by the user on a daily basis.
  • the user terminal 200 is a terminal that the user uses on a daily basis, and is capable of receiving various types of biological information (sensing data) from the wearable device 100. Based on the biological information received, the user's mental state can be determined. can be analyzed. Furthermore, the user terminal 200 can transmit information on the user's mental state obtained by analysis to the server 300 described later, and can receive various types of information from the server 300 . More specifically, the user terminal 200, for example, analyzes various biological information (sensing data) from the wearable device 100, and determines characteristics indicating the mental state of the user, such as the user's exercise amount, sleep state, concentration level, and the like. A quantity can be obtained and sent to the server 300 . Furthermore, the user terminal 200 can receive various types of user information and recommended business information obtained by the server 300 and display them to the user.
  • the user terminal 200 is an information processing terminal owned by the user or provided to the user by a company/organization to which the user belongs or a company that provides stress check services for workers.
  • the user terminal 200 can be, for example, a device such as a tablet, a smart phone, a mobile phone, a laptop PC (Personal Computer), a desktop PC, or an HMD.
  • the user terminal 200 may be integrated with the wearable device 100 described above, or may incorporate the sensor unit 140 (see FIG. 2) of the wearable device 100. . Details of the user terminal 200 will be described later.
  • the server 300 can use the user's mental state information obtained from the user terminal 200 and the user's business status information obtained from the attendance management server 400 (to be described later) to associate these pieces of information.
  • the server 300 estimates the future mental state of the user in the event that the user performs the work according to the current work schedule, However, it is possible to estimate the work content and work volume that can be accomplished within a unit time in a certain mental state.
  • the server 300 can determine whether the current user's work (task) is achievable, the user's work status, recommended work content for the user, work volume, and the like.
  • the server 300 can transmit the determined information to the user terminal 200 or the like.
  • the server 300 is configured by a computer or the like, for example. A detailed configuration of the server 300 will be described later.
  • the attendance management server 400 is a server that manages the attendance status and task achievement status of an individual user or an organization to which the user belongs. In this embodiment, it is assumed that the user uses such an attendance management server 400 managed by the organization that employs the user in order to manage and record information regarding his or her work and work.
  • the attendance management server 400 for example, the user's individual working hours (attendance status), work contents of each hour (assigned task contents, actual work contents and work hours, progress (achievement rate), meetings, business trips, guidance, etc.).
  • the attendance management server 400 manages scheduled meeting time, meeting content, free work time, etc., individual business content (eg, ToDo list), business goals, achievement rates (eg, Gantt chart, etc.), etc. .
  • the attendance management server 400 is configured by, for example, a computer. A detailed configuration of the attendance management server 400 will be described later.
  • FIG. 1 shows the information processing system 10 according to the present embodiment as including a pair of wearable device 100 and user terminal 200
  • the present embodiment is not limited to this. do not have.
  • the information processing system 10 according to the present embodiment may include one or more pairs of multiple wearable devices 100 and one or multiple user terminals 200 .
  • the information processing system 10 according to the present embodiment may include other communication devices such as relay devices for transmitting and receiving information, for example.
  • FIG. 2 is a block diagram showing an example of the functional configuration of the wearable device 100 according to this embodiment.
  • the wearable device 100 mainly includes an input unit 110, an output unit 120, a control unit 130, a sensor unit 140, a communication unit 150, and a storage unit 160, as shown in FIG. Details of each functional unit of the wearable device 100 will be described below.
  • the input unit 110 receives input of data and commands from the user to the wearable device 100 . More specifically, the input unit 110 is implemented by a touch panel, buttons, a microphone, and the like.
  • the output unit 120 is a device for presenting information to the user, and for example, outputs various information to the user using images, sounds, lights, vibrations, or the like. More specifically, the output unit 120 can display information provided from the user terminal 200 and the server 300, which will be described later, on the screen.
  • the output unit 120 is implemented by a display, a speaker, earphones, a light-emitting element (for example, a Light Emitting Diode (LED)), a vibration module, and the like. Note that part of the functions of the output unit 120 may be provided by the user terminal 200 .
  • control unit 130 The control unit 130 is provided in the wearable device 100, controls each functional unit of the wearable device 100, acquires sensing data (biological information) output from the sensor unit 140 described later, and processes the sensing data.
  • the control unit 130 is realized by hardware such as a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. Note that part of the functions of the control unit 130 may be provided by the user terminal 200, which will be described later.
  • the sensor unit 140 is provided in the wearable device 100 attached to the user's body, and has various sensors that detect the user's biological information.
  • the sensor unit 140 is, for example, a PPG sensor (pulse sensor) (not shown) that detects the pulse or heartbeat of the user and acquires time-series data of the heartbeat or pulse, or a sensor that detects the movement of the user. It has a motion sensor (not shown) and the like.
  • the PPG sensor is a biological information sensor worn on a part of the body such as the user's skin (for example, both arms, wrists, ankles, etc.) in order to detect the user's pulse wave signal.
  • the pulse wave signal refers to the contraction of the heart muscle at a constant rhythm (pulsation, the number of heart beats per unit time is called the heart rate), and blood is sent throughout the body through the arteries.
  • a change in pressure occurs on the inner wall of the artery, and it is a waveform due to the pulsation of the artery that appears on the body surface.
  • the PPG sensor In order to acquire a pulse wave signal, the PPG sensor irradiates light on the blood vessels in the measurement site of the user, such as a hand, arm, leg, etc. Detect scattered light. Since the irradiated light is absorbed by red blood cells in the blood vessel, the amount of light absorption is proportional to the amount of blood flowing through the blood vessel in the measurement site. Therefore, the PPG sensor can detect changes in the amount of flowing blood by detecting the intensity of the scattered light. Furthermore, a pulsation waveform, that is, a pulse wave signal can be detected from this change in blood flow. Such a method is called PhotoPlethysmoGraphy (PPG) method.
  • PPG PhotoPlethysmoGraphy
  • the PPG sensor incorporates a small laser, LED (not shown), etc. that can irradiate coherent light, and irradiates light with a predetermined wavelength such as around 850 nm, for example.
  • the wavelength of the light emitted by the PPG can be selected as appropriate.
  • the PPG sensor incorporates, for example, a photodiode (Photo Detector: PD), and acquires a pulse wave signal by converting the intensity of the detected light into an electrical signal.
  • the PPG sensor may incorporate a CCD (Charge Coupled Devices) type sensor, a CMOS (Complementary Metal Oxide Semiconductor) type sensor, or the like instead of the PD.
  • the PPG sensor may also include optical mechanisms such as lenses and filters to detect light from the user's measurement site.
  • the PPG sensor can detect the pulse wave signal as time-series data having multiple peaks.
  • a plurality of peaks appearing in a pulse wave signal and peak intervals are called a pulse rate interval (PPI).
  • PPI pulse rate interval
  • the PPI value can be obtained by processing the pulse wave signal detected by the PPG sensor. It is known that each PPI value fluctuates over time, but is approximately normally distributed while the user's state is maintained constant. Therefore, by statistically processing the PPI value data group (for example, calculating the standard deviation of the PPI values), various HRV (Heart Rate Variability) indices that serve as indicators of the user's mental state (for example, stress state) can be calculated. Therefore, time-series data of heartbeat or pulse can serve as an indicator of the user's mental state.
  • HRV Heart Rate Variability
  • the present embodiment is not limited to obtaining pulse wave signals using the PPG method described above, and pulse wave signals may be obtained by other methods.
  • the sensor unit 140 may detect pulse waves using a laser Doppler blood flow measurement method.
  • the laser Doppler blood flow measurement method is a method of measuring blood flow using the following phenomena. Specifically, when the user's measurement site is irradiated with laser light, scattering substances (mainly red blood cells) present in the user's blood vessels move, causing scattered light with a Doppler shift. . Then, the scattered light accompanied by the Doppler shift interferes with the scattered light from non-moving tissue present in the measurement site of the user, and a beat-like intensity change is observed. Therefore, the laser Doppler blood flow measurement method can measure blood flow by analyzing the intensity and frequency of the beat signal.
  • an ECG sensor that detects the electrocardiogram of the target user via electrodes (not shown) attached to the user's body may be provided.
  • the RR interval which is the interval between heart beats
  • the HRV index which is an index indicating the mental state of the user
  • the sensor unit 140 may be provided with a perspiration sensor (not shown).
  • a perspiration sensor (not shown).
  • thermal perspiration is sweating that is done to regulate body temperature.
  • mental sweating is sweating caused by human emotions such as tension and emotions. It is sweating that occurs instantaneously and in a small amount on the palms and soles of the feet at room temperature compared to thermal sweating.
  • mental sweating is sweating caused by tension when giving a presentation.
  • Such mental sweating is known to occur frequently when the sympathetic nervous system is dominant, and is generally considered to be an indicator of mental state.
  • the perspiration sensor is attached to the user's skin and detects the voltage or resistance between two points on the skin that changes due to perspiration.
  • information such as the amount of perspiration, the frequency of perspiration, and changes in the amount of perspiration is obtained based on the sensing data detected by the perspiration sensor, thereby obtaining one index indicating the mental state of the user. be able to.
  • the sensor unit 140 may include other various biological information sensors (not shown).
  • the various biological information sensors include one or more sensors that are directly or indirectly attached to a part of the user's body and measure the target user's brain waves, respiration, myoelectric potential, skin temperature, etc. can be done. More specifically, in the present embodiment, for example, sensing data obtained by an electroencephalogram sensor unit (not shown) that measures the electroencephalogram of the user is analyzed to determine the type of electroencephalogram (e.g., alpha waves, beta waves, etc.), it is possible to obtain an index indicating the mental state of the user (for example, the degree of relaxation of the user, etc.).
  • the type of electroencephalogram e.g., alpha waves, beta waves, etc.
  • the sensor unit 140 may include an imaging device (not shown) that captures the user's facial expression, as described above.
  • the imaging device detects, for example, the user's eye movement, pupil diameter, gaze time, and the like. It is said that the muscle that controls the human pupil diameter is influenced by the sympathetic/parasympathetic nerves. Therefore, in this embodiment, by detecting the user's pupil diameter with the imaging device, it is possible to obtain one index indicating the user's mental state, such as the user's sympathetic/parasympathetic state. .
  • the sensor unit 140 may also include a motion sensor for detecting the user's posture and movement, that is, the motion state.
  • the motion sensor detects the motion state of the user by acquiring sensing data indicating changes in acceleration that occur with the motion of the user.
  • the user's exercise state acquired by the motion sensor can be used when estimating the user's emotion.
  • the posture affects the depth of breathing and the like, and furthermore, the depth of breathing is said to be highly related to the state of tension (degree of tension) of a person. Therefore, in the present embodiment, it is possible to detect the user's posture and obtain one index indicating the user's mental state from the detected posture.
  • the motion sensor includes an acceleration sensor, a gyro sensor, a geomagnetic sensor (not shown), and the like.
  • the motion sensor may be an imaging device (not shown) that captures an image of the user.
  • the motion sensor may include an infrared sensor, an ultrasonic sensor, or the like (not shown) capable of detecting user motion. Note that such an imaging device, an infrared sensor, and the like may be installed around the user as separate devices from the wearable device 100 .
  • the sensor unit 140 may include a positioning sensor (not shown) together with the motion sensor.
  • the positioning sensor is a sensor that detects the position of the user wearing the wearable device 100, and specifically can be a GNSS (Global Navigation Satellite System) receiver or the like.
  • the positioning sensor can generate sensing data indicating the latitude and longitude of the user's current location based on signals from GNSS satellites.
  • RFID Radio Frequency Identification
  • Wi-Fi since it is possible to detect the relative positional relationship of the user from the information of the wireless base station, such It is also possible to use a communication device as the positioning sensor.
  • the sensor unit 140 may include a microphone (not shown) that detects the user's uttered voice.
  • a microphone not shown
  • the result obtained by extracting a specific voice (for example, a specific phrase uttered by the user) from the sound detected by the microphone is used as one index indicating the mental state of the user. can be obtained as
  • the sensor unit 140 can include various sensors. Furthermore, the sensor unit 140 may incorporate a clock mechanism (not shown) for grasping accurate time, and associate the acquired sensing data (biological information) with the time at which the sensing data was acquired. Further, as described above, the various sensors may not be provided in the sensor unit 140 of the wearable device 100. For example, they may be provided separately from the wearable device 100. may be provided in a device or the like used by
  • various biometric information may be acquired not only during working hours but also outside working hours.
  • sleep time and sleep quality are highly correlated with mental state. preferably obtained.
  • Information such as sleep time can be acquired based on sensing data from the motion sensor, the PPG sensor, or the like.
  • the communication unit 150 is provided within the wearable device 100 and can transmit and receive information to and from an external device such as the user terminal 200 .
  • the communication unit 150 can be said to be a communication interface having a function of transmitting and receiving data.
  • the communication unit 150 is implemented by communication devices such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 160 is provided in the wearable device 100 and stores programs, information, etc. for the above-described control unit 130 to execute various processes, and information obtained by the processes.
  • the storage unit 160 is realized by, for example, a nonvolatile memory such as a flash memory.
  • the wearable device 100 various types of wearable devices such as a bracelet type, an ear device type, an HMD type, and a smart glasses type can be adopted.
  • 3 and 4 show an example of the appearance of the wearable device 100 according to this embodiment.
  • the wearable device 100 can be a bracelet type wearable device worn on the user's wrist.
  • the wearable device 100 has a belt-shaped band portion 170 and a control unit 180 .
  • the band part 170 is worn around the user's wrist, it is made of a soft material such as silicone gel so as to have a ring-like shape that matches the shape of the wrist.
  • the control unit 180 is a portion where the above-described control section 130, sensor section 140, and the like are provided.
  • the sensor unit 140 is provided at a position such that when the wearable device 100 is worn on a part of the user's body, it contacts or faces the user's body.
  • the wearable device 100b may be an ear device type wearable device worn on the user's ear.
  • the wearable device 100b mainly includes left and right body portions 190L and 190R, and a band portion 192 connecting the body portions 190L and 190R.
  • the body sections 190L and 190R incorporate at least a part of, for example, the control section 130, the sensor section 140, the communication section 150, and the storage section 160 of FIG.
  • speakers (not shown) functioning as the output unit 120 are built in the main units 190L and 190, and the user can listen to audio information and the like by wearing the speakers on both ears.
  • wearable device 100 is not limited to the configuration example shown in FIG. 2 or the appearance shown in FIGS. may
  • FIG. 5 is a block diagram showing an example of the functional configuration of the user terminal 200 according to this embodiment.
  • the user terminal 200 according to this embodiment mainly includes an input unit 210, an output unit 220, a processing unit 230, a communication unit 250, and a storage unit 260, as shown in FIG.
  • Each functional unit of the user terminal 200 will be described below.
  • the input unit 210 can accept input of data and commands to the user terminal 200 . More specifically, the input unit 210 is implemented by a touch panel, keyboard, microphone, or the like.
  • the output unit 220 is composed of, for example, a display, a speaker, a lamp, a video output terminal, an audio output terminal, etc., and can output various information to the user by means of images, flashes, sounds, and the like.
  • the processing unit 230 is provided in the user terminal 200, and can control each functional unit of the user terminal 200, acquire various types of biological information (sensing data) from the wearable device 100, and analyze them. .
  • the processing unit 230 is implemented by, for example, a CPU, ROM, RAM, and the like. Further, since the processing unit 230 performs analysis processing on sensing data from the wearable device 100, the processing unit 230 may have the following functional blocks.
  • Sensing data acquisition unit 232 acquires sensing data, which are various types of biological information transmitted from the wearable device 100, by linking them to information on the time when they were measured, and performs preprocessing such as combining a plurality of sensing data. be able to. Furthermore, the sensing data acquisition unit 232 can output the acquired sensing data or the preprocessed sensing data to the sensing data analysis unit 234, which will be described later.
  • the user terminal 200 conducts a questionnaire such as a stress check to the user, and asks the user to input answers to the questionnaire, thereby obtaining subjective evaluation information of the user's own mental state. may be obtained. Then, the user terminal 200 may analyze and score such questionnaire results by the sensing data analysis unit 234, which will be described later, and transmit the result to the server 300 as information regarding the mental state of the user.
  • a questionnaire such as a stress check
  • the sensing data analysis unit 234 which will be described later
  • Sensing data analysis unit 234 analyzes, for example, various biological information (sensing data) from the wearable device 100 and the subjective evaluation information of the user's own mental state described above, and analyzes the user's exercise amount, sleep state, and concentration level. It is possible to acquire a feature amount indicating the mental state of the user, such as.
  • the sensing data analysis unit 234 may acquire feature amounts using a model obtained in advance by machine learning, and further score the acquired feature amounts as necessary. good too. Then, the sensing data analysis unit 234 can output the information of the feature amount obtained by the analysis to the server 300 via the communication unit 250 which will be described later.
  • the sensing data analysis unit 234 may be provided in the wearable device 100, the server 300 described later, or the like.
  • the sensing data analysis unit 234 may be provided in the server 300, the sensing data from the wearable device 100 may be transmitted to the server 300 via the user terminal 200 without being analyzed.
  • the communication unit 250 can transmit and receive information to and from external devices such as the wearable device 100 and the server 300 .
  • the communication unit 250 can be said to be a communication interface having a function of transmitting and receiving data.
  • the communication unit 250 is implemented by communication devices such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 260 can store programs, information, and the like for the processing unit 230 to execute various types of processing, and information obtained by the processing.
  • the storage unit 260 is realized by, for example, a magnetic recording medium such as a hard disk (HD), a nonvolatile memory such as a flash memory, or the like.
  • the user terminal 200 according to the present embodiment is not limited to the configuration example shown in FIG. 5, and may further include other functional units, for example.
  • FIG. 6 is a block diagram showing an example of the functional configuration of the server 300 according to this embodiment.
  • the server 300 mainly includes an input unit 310, an output unit 320, a processing unit 330, a communication unit 350, and a storage unit 360, as shown in FIG.
  • Each functional unit of the server 300 will be described below.
  • the input unit 310 can accept input of data and commands to the server 300 . More specifically, the input unit 310 is implemented by a touch panel, keyboard, or the like.
  • the output unit 320 is configured by, for example, a display or the like, and can output various information in the form of images or the like.
  • the processing unit 330 can control each functional unit of the server 300 .
  • the processing unit 330 is realized by hardware such as CPU, ROM, and RAM, for example.
  • the processing unit 330 uses information on the mental state of the user acquired from the user terminal 200 and information on the work status of the user acquired from the attendance management server 400, which will be described later, so that the user can perform the work according to the current work schedule. It is possible to estimate the future mental state when the user performs a task, or to estimate the content and amount of work that the user can perform in a given mental state within a unit time.
  • the processing unit 330 can determine whether or not the current work (task) of the user is achievable, the work status of the user, the content of work recommended for the user, the amount of work, etc., based on the estimation. .
  • the processing unit 330 includes a task analysis unit (business information acquisition unit) 332, a mental state information acquisition unit 334, a relationship estimation unit (estimation unit) 336, and a future transition estimation unit 336 in order to realize these functions described above. It functions as a section (information output section) 338 .
  • the processing unit 330 may also perform analysis processing on sensing data from the wearable device 100 . Details of these functions of the processing unit 330 according to the present embodiment will be described below.
  • the task analysis unit 332 acquires information on the user's work status (working hours, work content, progress, achievement rate, etc.) transmitted from the attendance management server 400, which will be described later. By analyzing the content and its achievement rate, it is possible to obtain information on the job type and its achievement rate for each hour. Furthermore, the task analysis unit 332 can output the acquired information to the relationship estimation unit 336, which will be described later.
  • the mental state information acquisition unit 334 acquires the user's mental state for each predetermined unit of time based on information on the user's mental state (a characteristic value related to the mental state, the time of the state, etc.) transmitted from the user terminal 200, which will be described later. Information can be obtained. Furthermore, the mental state information acquisition unit 334 can output the acquired information to the relationship estimation unit 336, which will be described later. As described above, in the present embodiment, the mental state information acquisition unit 334 analyzes the sensing data transmitted via the user terminal 200, acquires the feature amount indicating the mental state of the user, good too.
  • the relationship estimating unit 336 exchanges the information on the task type and achievement rate for each hour obtained from the task analysis unit 332 and the information on the mental state for each hour obtained from the mental state information acquiring unit 334 as information. related based on the attached time. Furthermore, the relationship estimating unit 336 uses, for example, statistical methods, multivariate analysis, and other methods, estimators generated by machine learning models, etc., for the information related by time, and uses specific mental In addition to estimating the work content that is strongly related to the state, the relationship of the achievement rate of work (task) in a specific mental state is estimated.
  • the information (algorithm) obtained by the estimation as described above is used for estimation in the future transition estimation unit 338, which will be described later, and is also stored in the storage unit 360, which will be described later.
  • the future transition estimation unit 338 estimates the future mental state of the individual user based on the information (algorithm) obtained by the relationship estimation unit 336, estimates the degree of task achievement, and the like.
  • the future transition estimating unit 338 estimates the transition of the mental state when the task is performed as planned, and the user or a member of the group to which the user belongs uses the estimated mental state according to the estimated mental state. An alarm is sent to a device (for example, the user terminal 200 or the like) that
  • the future transition estimation unit 338 estimates the possibility or achievement rate of task achievement while maintaining a specific mental state, and determines whether the user or the group to which the user belongs, according to the estimated achievement possibility.
  • the future transition estimation unit 338 provides information such as work content, work volume, deadline, etc. that are recommended to be assigned to the user, and advice to the user. You may transmit to the device which the member of the group to which a user belongs, etc. use.
  • the communication unit 350 can transmit and receive information to and from external devices such as the user terminal 200 and the attendance management server 400 .
  • the communication unit 350 can be said to be a communication interface having a function of transmitting and receiving data, and is specifically realized by a communication device such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 360 can store programs, information, and the like for the processing unit 330 described above to execute various types of processing, and information obtained by the processing.
  • the storage unit 360 is implemented by, for example, a magnetic recording medium such as a hard disk, or a non-volatile memory such as a flash memory.
  • the storage unit 360 stores the organization information to which the user belongs, as well as the information for estimation obtained by the relationship estimation unit 336 (specifically, the mental state, work content, and work of each user for each hour). (algorithms, estimation models, etc.) that indicate the achievement rate and their relationship. Since the above-mentioned information includes information related to user privacy, in the present embodiment, information processing (for example, instead of a user name, a simple character string such as using different identification information) may be applied.
  • the server 300 is not limited to the configuration example shown in FIG. 6, and may further include other functional units, for example. Furthermore, the server 300 may be composed of a plurality of information processing devices communicably connected to each other via the network 700 . At least part of the functions of the server 300 may be executed by the user terminal 200 described above, or the server 300 may be configured as a device integrated with the user terminal 200 or the attendance management server 400. .
  • FIG. 7 is a block diagram showing an example of the functional configuration of the attendance management server 400 according to this embodiment.
  • the attendance management server 400 mainly includes an input unit 410, an output unit 420, a processing unit 430, a communication unit 450, and a storage unit 460, as shown in FIG.
  • Each functional unit of the attendance management server 400 will be described below.
  • the input unit 410 can accept input of data and commands to the attendance management server 400 . More specifically, the input unit 410 is implemented by a touch panel, keyboard, or the like.
  • the output unit 420 is configured by, for example, a display and the like, and can output various information in the form of images and the like.
  • the processing unit 430 can control each functional unit of the attendance management server 400 .
  • the processing unit 430 is implemented by hardware such as a CPU, ROM, and RAM, for example.
  • the communication unit 450 can transmit and receive information to and from an external device such as the server 300 or the like.
  • the communication unit 450 can be said to be a communication interface having a function of transmitting and receiving data, and is specifically realized by a communication device such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 460 can store programs, information, and the like for the processing unit 430 to execute various types of processing, and information obtained by the processing.
  • the storage unit 460 is implemented by, for example, a magnetic recording medium such as a hard disk, or a non-volatile memory such as a flash memory.
  • the storage unit 460 includes work data 462 including information on the actual working hours and work details of each user, and information on each user's schedule (meetings, business trips, etc.). It stores task management data 466 including schedule data 464, information on the organization and group to which each user belongs, business content, business progress, achievement rate, priority (importance), and due date information.
  • the information stored in the storage unit 460 described above includes information related to user privacy, in the present embodiment, when this information is transmitted to the server 300, individual users cannot be specified. information processing (for example, using identification information consisting of a simple character string instead of the user's name) may be applied.
  • the attendance management server 400 is not limited to the configuration example shown in FIG. 7, and may further include other functional units, for example. Furthermore, the attendance management server 400 may be composed of a plurality of information processing devices that are communicably connected to each other via the network 700 . At least part of the functions of the attendance management server 400 may be executed by the server 300 described above, or the attendance management server 400 may be configured as a device integrated with the server 300 .
  • FIG. 8 is a sequence diagram of the information processing method according to this embodiment
  • FIG. 9 is a flowchart of the information processing method according to this embodiment.
  • the information processing method performed by the information processing system 10 according to the present embodiment will be described.
  • the information processing method according to this embodiment includes a plurality of steps from step S100 to step S900. Details of each step included in the information processing method according to the present embodiment will be described below.
  • the user terminal 200 acquires sensing data from the wearable device 100 and analyzes it to acquire information about the mental state of the user (specifically, feature values obtained from the sensing data), and transmits the information to the server 300. (Step S100).
  • the user terminal 200 conducts a questionnaire such as a stress check for the user, obtains the subjective evaluation of the user's response to the questionnaire, analyzes the subjective evaluation, Information regarding the mental state of the user may be obtained. Details of step S100 executed by the user terminal 200 will be described later.
  • the server 300 receives information about the mental state of the user from the user terminal 200 (more specifically, the feature value indicating the mental state of the user, which is linked to the information of the time when the wearable device 100 acquired the sensing data). (Step S200).
  • the information received from the user terminal 200 is assumed to include feature amount information indicating the mental state of the user obtained from the sensing data.
  • the server 300 analyzes the sensing data transmitted from the user terminal 200 in this step, and calculates the feature amount indicating the mental state of the user. may
  • the attendance management server 400 stores the user's individual working hours (attendance status, business hours), work contents of each hour (assigned task contents, work priority (importance), due date, actual work contents and work hours, Information such as the progress (achievement rate), schedule (meeting, business trip, guidance, etc.) is transmitted to the server 300 (step S300).
  • the server 300 receives from the attendance management server 400 the working hours of the user (attendance status, work hours), work contents of each hour (assigned task contents, work priority (importance), due date, actual time, etc.). (step S400).
  • the server 300 analyzes the user's work status information (working hours, work content, progress status, etc.) transmitted from the attendance management server 400, calculates the work content and its achievement rate for each fixed time, Information on the type of work and the achievement rate is acquired (step S500).
  • Server 300 combines the information on the job type and achievement rate for each hour obtained in step S500 described above and the information on the mental state of the user obtained in step S200 described above based on the time attached to the information. related to Furthermore, the server 300 uses, for example, statistical methods, multivariate analysis methods, estimators generated by machine learning models, etc., for information related by time, and is strongly affected by a specific mental state. In addition to estimating the content of related work, etc., the relationship of the achievement rate of work (task) in a specific mental state is estimated (step S600).
  • the server 300 estimates the user's individual future mental state and the degree of task achievement (step S700). Specifically, the server 300 estimates the transition of the mental state when the current work (task) is performed as planned, and generates alarm information to be sent to the user or the like according to the estimated mental state. . In addition, the server 300 estimates the possibility and achievement rate of the task while maintaining a specific mental state, and generates alarm information to be sent to the user etc. according to the estimated achievement possibility. do. Furthermore, based on the above estimation, the server 300 generates information such as work content, work volume, time limit, schedule, etc., which is recommended to be assigned to the user, and advice to the user.
  • the server 300 transmits the result estimated in step S700 described above and the alarm and advice information to the user terminal 200 (step S800).
  • the user terminal 200 receives the estimation result transmitted from the server 300 in step S800 described above, alarms related to work, advice on the work content recommended to the user, work execution period, etc., and displays (outputs) to the user. ) (step S900). Note that details such as display in the present embodiment will be described later.
  • the information processing method performed by the user terminal 200 in step S100 described above will be described with reference to FIG.
  • the information processing method includes a plurality of steps from step S101 to step S104. Details of each step included in the information processing method will be described below.
  • the user terminal 200 receives sensing data, which are various types of biological information transmitted from the wearable device 100, together with information on the time when the sensing data was acquired by the wearable device 100, and further performs preprocessing such as combining a plurality of sensing data. (step S101).
  • the user terminal 200 analyzes the sensing data preprocessed in step S101 described above, and acquires feature amounts indicating the mental state of the user, such as the user's exercise amount, sleep state, concentration level, etc. (step S102).
  • the user terminal 200 scores the feature amount obtained in step S102 described above using a technique such as normalization as necessary (step S103).
  • the user terminal 200 transmits the score obtained in step S103 described above to the server 300 (step S104).
  • FIG. 10 to 12 are explanatory diagrams showing examples of display on the user terminal 200 according to this embodiment
  • FIG. 13 is an explanatory diagram showing one example of display on the server 300 according to this embodiment.
  • the user terminal 200 displays the user's mental state, behavior, schedule (business content, private schedule) and advice for each unit time.
  • the user terminal 200 may display the sensing data acquired from the various sensor units 140 or the transition of the feature amount obtained from the sensing data, as in the display 800 of FIG. 10 .
  • the user terminal 200 may indicate the transition of the user's mental state for each unit time, and additionally, as in the display 806, it displays advice sentences for the user's mental state.
  • the user terminal 200 may display personal schedules and action history, as well as schedules that are estimated to be achievable on the current day and schedules that are recommended to be carried out.
  • the user terminal 200 displays the user's mental state, behavior, schedule (work content), and advice for each unit time. good too.
  • the user terminal 200 may indicate the mental state by unit period (specifically, the mental state is indicated by hatching in the bar graph).
  • the user terminal 200 may indicate, for each task type, the amount of work that is estimated to be achievable in the user's mental state for a predetermined period. A mental state for each type and an advice sentence therefor may be displayed.
  • the user terminal 200 may display the mental state of the user in units of a certain time such as day, week, month (specifically, the mental state is indicated by hatching the date). ing). Furthermore, as in the display 818, the user terminal 200 may indicate a schedule that is estimated to be achievable on the current day, as well as a schedule of tasks and a history of task performance.
  • the user terminal 200 may display the user's schedule (work content) to the user. Furthermore, as shown in display 822, the user terminal 200 displays the work schedule and work execution history, and displays an alarm regarding the work schedule judged to be difficult to complete within the due date given the combination of the current schedule and mental state. good too.
  • the server 300 estimates the optimal time frame for performing each task based on the user's estimated future mental state and the task content assigned to the user. good too.
  • user terminal 200 may display the optimal time slot for performing each task.
  • the user terminal 200 recommends rearrangement as shown in the displays 822 and 824.
  • a button display 826 for consulting with a superior may be displayed along with displaying an alarm or an advice message. For example, by pressing the button display 826, the user can automatically send a chat or an e-mail to the superior for consultation about the work schedule or reorganization of the contents.
  • each user's mental state for each unit time, Actions, schedules, and advice may be displayed.
  • the server 300 displays the mental state, schedule, and advice of each member (user) belonging to the team to the members of the team to which the user belongs.
  • the server 300 displays the work schedule and work performance history of each member, and presents the work currently being performed estimated based on the combination of the current work schedule and mental state. and the due date of the task may be displayed.
  • the server 300 may indicate the degree of achievability of each task while each member maintains the current state of mind. may display an alarm.
  • the server 300 may display the future transition of the state of mind when the work content is carried out as planned and the advice accompanying it.
  • the relationship between the mental state of the user during work execution based on the biological information and the like and the work at that time is estimated, and based on the estimation result, the current mental state or the predicted future state is estimated.
  • the user's "executable work content and work volume estimated from the mental state" are visualized, and a specific proposal is made as to how the work should be adjusted. Therefore, the user or the like can correct the work content or work volume.
  • FIG. 14 is a system diagram showing a schematic functional configuration of the information processing system 10a according to this embodiment.
  • the information processing system 10a includes a user terminal 200 communicatively connected to the wearable device 100, a server 300a, an attendance management server 400, and a management server 500. Included in the present embodiment, the wearable device 100, the user terminal 200, and the attendance management server 400 are the same as those in the first embodiment described above. An outline of the included server 300a and management server 500 will be described.
  • server 300a uses the user's mental state information obtained from the user terminal 200 and the user's business status information obtained from the attendance management server 400 described later to These pieces of information can be related.
  • server 300a estimates the future mental state of the user in the event that the user performs the work according to the current work schedule, However, it is possible to estimate the work content and work volume that can be accomplished within a unit time in a certain mental state.
  • the server 300a integrates information such as job content, achievement rate, and mental state in the organizational unit to which the user belongs, using individual user information. Estimate transitions, etc.
  • the server 300a is also configured by, for example, a computer or the like. A detailed configuration of the server 300a will be described later.
  • the management server 500 is an information processing terminal used by the administrator of the organization to which the user belongs, and can transmit and receive information to and from the server 300a via the network 700.
  • the management server 500 is not limited to being an information processing terminal used by an administrator, and may be an information processing terminal used by an industrial physician or the like who supports the company. good.
  • the industrial physician can refer to the results displayed by the management server 500 to propose measures for improving the workplace environment to the company, or recommend each user or organization to undergo a medical examination.
  • the management server 500 can be a device such as a tablet, smart phone, mobile phone, laptop PC, or desktop PC. In the following description, the management server 500 is assumed to be a desktop PC. Details of the management server 500 will be described later.
  • the information processing system 10a may include other communication devices such as a relay device for transmitting and receiving information, for example.
  • FIG. 15 is a block diagram showing an example of the functional configuration of the server 300a according to this embodiment.
  • the server 300 mainly includes an input unit 310, an output unit 320, a processing unit 330a, a communication unit 350, and a storage unit 360, as shown in FIG.
  • the input unit 310, the output unit 320, the communication unit 350, and the storage unit 360 are the same as those in the above-described first embodiment, so descriptions thereof will be omitted and the server 300a according to this embodiment will be described.
  • the processing unit 330a included in the will be described.
  • the processing unit 330 can control each functional unit of the server 300a. Further, as shown in FIG. 15, the processing unit 330a not only functions as a task analysis unit 332, a mental state information acquisition unit 334, a relationship estimation unit 336, and a future transition estimation unit 338, but also functions as a hierarchical analysis unit 340. also works. In this embodiment, the task analysis unit 332, the mental state information acquisition unit 334, the relationship estimation unit 336, and the future transition estimation unit 338 are the same as those in the above-described first embodiment, so descriptions thereof will be omitted. , only the hierarchical analysis unit 340 will be described.
  • the stratified analysis unit 340 aggregates and integrates the information on individual user units into information such as work content, achievement rate, mental state, etc. on an organizational basis. It is possible to estimate the transition of the mental state of the person and the task achievement rate. Furthermore, based on the information obtained by such aggregation or estimation, the hierarchical analysis unit 340 transmits information such as the current organizational situation, recommended work content, and work execution period to the management server 500. can be done.
  • server 300a is not limited to the configuration example shown in FIG. 15, and may further include other functional units, for example.
  • FIG. 16 is a block diagram showing an example of the functional configuration of the management server 500 according to this embodiment.
  • the management server 500 mainly includes an input unit 510, an output unit 520, a processing unit 530, a communication unit 550, and a storage unit 560, as shown in FIG.
  • Each functional unit of the management server 500 will be described below.
  • the input unit 510 can accept input of data and commands to the management server 500 . More specifically, the input unit 510 is implemented by a touch panel, keyboard, or the like.
  • the output unit 520 is configured by, for example, a display or the like, and can output various kinds of information in the form of images or the like.
  • the processing unit 530 can control each functional unit of the management server 500, and is realized by hardware such as CPU, ROM, and RAM, for example.
  • the communication unit 550 can transmit and receive information to and from an external device such as the server 300a.
  • the communication unit 550 can be said to be a communication interface having a function of transmitting and receiving data, and is specifically realized by a communication device such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 560 can store programs, information, and the like for the processing unit 530 to execute various types of processing, and information obtained by the processing.
  • the storage unit 560 is realized by, for example, a magnetic recording medium such as a hard disk, or a non-volatile memory such as a flash memory.
  • the management server 500 is not limited to the configuration example shown in FIG. 16, and may further include other functional units, for example.
  • FIG. 17 is a sequence diagram of the information processing method according to this embodiment
  • FIG. 18 is an explanatory diagram showing an example of display on the management server 500 according to this embodiment.
  • the information processing method according to this embodiment includes a plurality of steps from step S1100 to step S2200. Details of each step included in the information processing method according to this embodiment will be described below. Since they are the same, the description of these steps is omitted.
  • the server 300a integrates information for each organization according to each management hierarchy based on the information of each user that has already been analyzed and estimated up to step S1700 (step S1800). Further, the server 300a performs a stratified analysis of organizational units according to the authority of the administrator. For example, the server 300a calculates averages and variations in mental states and task achievement rates of members in a predetermined team, integrates them, and calculates a score corresponding to workplace soundness.
  • server 300a extracts other teams similar to the corresponding team (organization) in terms of members, organization size, business content, member background, experience, schedule, etc., and Calculate the average and variance of the mental state and task achievement rate of the members of the team and compare it with the corresponding team. Furthermore, the server 300a extracts a team with a high score corresponding to workplace soundness from among similar teams, finds points different from the corresponding team, gives advice to improve the workplace soundness, and recommends to the corresponding team. Information on business content and business volume may be generated.
  • the server 300 processes the information obtained in step S1800 according to the authority of the administrator, and transmits the information to the management server 500 (step S1900).
  • the management server 500 receives the information transmitted from the server 300 in step S1900 described above, and displays (outputs) it for the administrator (step S2000).
  • the management server 500 displays the mental state of members in a predetermined team and the average and variance of the task achievement rate, as shown in displays 840 and 844, In addition, a score corresponding to workplace soundness obtained by integrating these may be displayed. Also, as shown in display 842, management server 500 may display the workplace health of teams similar to the current team. Furthermore, as shown in displays 846 and 848, the management server 500 displays elements that are strongly related to the task achievement rate and mental state score for each team, or displays a higher mental state score while maintaining the same amount of work. Advice (adjustment of goals, work contents, work volume, deadlines, etc.) for improving the performance may be displayed.
  • Management server 500 While referring to the results displayed on the management server 500, the administrator adjusts each individual's goals, work volume, work details, deadlines, etc. Management server 500 then transmits the adjustment result to attendance management server 400 (step S2100).
  • the attendance management server 400 receives the information transmitted from the management server 500 in step S2100 described above, and updates each user's individual goals, work volume, work details, deadlines, etc. (step S2200).
  • the relationship between the mental state of each user who is performing work and the work at that time is estimated based on the biological information of each user, and based on the estimation result, the current mental state or the future prediction is performed.
  • the user's mental state information was acquired based on the biometric information and the answers to the questionnaires, but the present disclosure is not limited to this.
  • e-mail, chat, or other information may be used.
  • emotional expressions such as sadness and anger may be included in emails and chats, or the number of such expressions may increase. Therefore, in the present embodiment, the user's mental state can be grasped more accurately and easily by using information such as e-mails and chats.
  • FIG. 19 is a system diagram showing a schematic functional configuration of an information processing system 10b according to this embodiment.
  • an information processing system 10b includes a user terminal 200 communicably connected to a wearable device 100, a server 300, an attendance management server 400, and an email/chat management server. 600 mainly included.
  • the wearable device 100, the user terminal 200, the server 300, and the attendance management server 400 are the same as those in the above-described first embodiment, so descriptions thereof are omitted, and information processing according to this embodiment is omitted.
  • An outline of the mail/chat management server 600 included in the system 10b will be described.
  • the mail/chat management server 600 is a server for managing mails and chats inside and outside the organization to which the user belongs. can be stored and transmitted to the user terminal 200, the server 300, or the like.
  • the mail/chat management server 600 is composed of, for example, a computer. A detailed configuration of the mail/chat management server 600 will be described later.
  • the information processing system 10b may include other communication devices such as relay devices for transmitting and receiving information, for example.
  • FIG. 20 is a block diagram showing an example of the functional configuration of the mail/chat management server 600 according to this embodiment.
  • the mail/chat management server 600 mainly has an input unit 610, an output unit 620, a control unit 630, a communication unit 650, and a storage unit 660, as shown in FIG.
  • Each functional unit of the mail/chat management server 600 will be described below.
  • the input unit 610 can accept input of data and commands to the mail/chat management server 600 . More specifically, the input unit 610 is implemented by a touch panel, keyboard, or the like.
  • the output unit 620 is configured by, for example, a display or the like, and can output various kinds of information in the form of images or the like.
  • control unit 630 can control each functional unit of the mail/chat management server 600 .
  • the control unit 630 is implemented by hardware such as CPU, ROM, and RAM, for example.
  • the communication unit 650 can transmit and receive information to and from an external device such as the server 300 or the like.
  • the communication unit 650 can be said to be a communication interface having a function of transmitting and receiving data, and is specifically realized by a communication device such as a communication antenna, a transmission/reception circuit, and a port.
  • the storage unit 660 can store programs, information, etc. for the above-described control unit 630 to execute various processes, and information obtained by the processes.
  • the storage unit 660 is implemented by, for example, a magnetic recording medium such as a hard disk, or a non-volatile memory such as a flash memory.
  • the storage unit 660 stores chat data 662 including chat transmission/reception information and chat content information of each user, and mail transmission/reception information and mail content information of each user. and store mail data 664 and the like.
  • mail/chat management server 600 is not limited to the configuration example shown in FIG. 20, and may further include other functional units, for example.
  • FIG. 21 is a flowchart of an information processing method according to this embodiment.
  • the information processing method according to this embodiment includes a plurality of steps from step S501 to step S503. Details of each step included in the information processing method according to the present embodiment will be described below.
  • the server 300 acquires mail/chat information (character information) sent and received by the user from the mail/chat management server 600 (step S501).
  • the server 300 extracts predetermined parameters for estimating the mental state of the user from the information obtained in step S501 (step S502). For example, the server 300 extracts predetermined words expressing emotions and their number. The server 300 may also extract information such as the number of characters in emails or chats, the number of times of transmission/reception or the number of responses, and the destination of transmission as parameters.
  • the server 300 converts the parameters obtained in step S502 described above into scores as necessary, and uses them as feature quantities indicating the mental state of the user (step S503).
  • the server 300 can easily grasp the user's mental state using information such as emails and chats.
  • the relationship between the mental state of the user during work execution based on the biological information and the like and the work at that time is estimated, and based on the estimation result, the current mental state Or, in the mental state predicted in the future, it is possible to estimate the work content, work volume, and deadline that can be performed. Furthermore, in the present embodiment, it is possible to make recommendations such as alerts and work adjustments to users based on such estimation.
  • the user's "executable work content and work volume estimated from the mental state" are visualized, and a specific proposal is made as to how the work should be adjusted. Therefore, the user or the like can correct the work content or work volume.
  • the information processing system 10 is managed and operated by an industrial physician who provides health advice to companies or the like, or by a service provider that dispatches or consults the industrial physician.
  • a service provider that dispatches or consults the industrial physician.
  • information is processed so as not to be disclosed to the above-mentioned industrial physician and the above-mentioned service provider (for example, the user's It is preferable that identification information consisting of a simple character string is used instead of a name).
  • FIG. 22 is a block diagram showing an example of hardware configuration.
  • the server 300 will be described below as an example.
  • the user terminal 200, the attendance management server 400, the management server 500, and the mail/chat management server 600 can be explained in the same way.
  • Various types of processing by the server 300 are implemented by cooperation of software and hardware described below.
  • the server 300 has a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, and a host bus 904a.
  • the server 300 also has a bridge 904 , an external bus 904 b , an interface 905 , an input device 906 , an output device 907 , a storage device 908 , a drive 909 , a connection port 911 and a communication device 913 .
  • the server 300 may have a processing circuit such as a DSP (Digital Signal Processor) or an ASIC (Application Specific Integrated Circuit) in place of or in addition to the CPU 901 .
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • the CPU 901 functions as an arithmetic processing device and a control device, and controls overall operations within the server 300 according to various programs.
  • the CPU 901 may be a microprocessor.
  • the ROM 902 stores programs, calculation parameters, and the like used by the CPU 901 .
  • the RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like.
  • the CPU 901 can embody the processing unit 330 of the server 300, for example.
  • the CPU 901, ROM 902 and RAM 903 are interconnected by a host bus 904a including a CPU bus and the like.
  • the host bus 904a is connected via a bridge 904 to an external bus 904b such as a PCI (Peripheral Component Interconnect/Interface) bus.
  • PCI Peripheral Component Interconnect/Interface
  • host bus 904a, bridge 904 and external bus 904b need not necessarily have separate configurations from each other and may be implemented in a single configuration (eg, one bus).
  • the input device 906 is implemented by a device such as a mouse, keyboard, touch panel, button, microphone, switch, lever, etc., through which information is input by the practitioner.
  • the input device 906 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device such as a mobile phone or PDA (Personal Digital Assistant) compatible with the operation of the server 300.
  • the input device 906 may include, for example, an input control circuit that generates an input signal based on information input by the practitioner using the above input means and outputs the signal to the CPU 901 . By operating the input device 906, the practitioner can input various data to the server 300 and instruct processing operations.
  • the output device 907 is formed by a device capable of visually or audibly notifying the practitioner of the acquired information.
  • Such devices include display devices such as CRT (Cathode Ray Tube) display devices, liquid crystal display devices, plasma display devices, EL (Electro Luminescent) display devices and lamps, acoustic output devices such as speakers and headphones, and printer devices. etc.
  • the storage device 908 is a device for storing data.
  • the storage device 908 is realized by, for example, a magnetic storage device such as a HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.
  • the storage device 908 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like.
  • the storage device 908 stores programs executed by the CPU 901, various data, and various data acquired from the outside.
  • the storage device 908 can embody the storage unit 360 of the server 300, for example.
  • the drive 909 is a reader/writer for storage media, and is either built into the server 300 or externally attached.
  • the drive 909 reads information recorded on a removable storage medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 903 .
  • Drive 909 can also write information to a removable storage medium.
  • connection port 911 is an interface connected to an external device, and is a connection port with an external device capable of data transmission by, for example, USB (Universal Serial Bus).
  • USB Universal Serial Bus
  • the communication device 913 is, for example, a communication interface formed by a communication device or the like for connecting to the network 920 .
  • the communication device 913 is, for example, a communication card for wired or wireless LAN (Local Area Network), LTE (Long Term Evolution), Bluetooth (registered trademark), or WUSB (Wireless USB).
  • the communication device 913 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various types of communication, or the like.
  • the communication device 913 can transmit and receive signals to and from the Internet and other communication devices in accordance with a predetermined protocol such as TCP/IP (Transmission Control Protocol/Internet Protocol).
  • the communication device 913 can embody the communication unit 350 of the server 300, for example.
  • the network 920 is a wired or wireless transmission path for information transmitted from devices connected to the network 920 .
  • the network 920 may include a public network such as the Internet, a telephone network, a satellite communication network, various LANs (Local Area Networks) including Ethernet (registered trademark), WANs (Wide Area Networks), and the like.
  • Network 920 may also include a dedicated line network such as IP-VPN (Internet Protocol-Virtual Private Network).
  • the above-described embodiments of the present disclosure include, for example, an information processing method executed by an information processing apparatus or an information processing system as described above, a program for operating the information processing apparatus, and a program in which the program is recorded. may include non-transitory tangible media that have been processed. Also, the program may be distributed via a communication line (including wireless communication) such as the Internet.
  • each step in the information processing method according to the embodiment of the present disclosure described above does not necessarily have to be processed in the described order.
  • each step may be processed in an appropriately changed order.
  • each step may be partially processed in parallel or individually instead of being processed in chronological order.
  • the processing of each step does not necessarily have to be processed in accordance with the described method, and may be processed by another method by another functional unit, for example.
  • each component of each device illustrated is functionally conceptual and does not necessarily need to be physically configured as illustrated.
  • the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured.
  • the present technology can also take the following configuration.
  • the information processing device Acquiring information about the user's mental state based on sensing data from a biometric sensor; obtaining information about the user's business; estimating a relationship between information about the user's mental state and information about the user's work; outputting to an information processing terminal an estimation result regarding the work or mental state of the user estimated based on the relationship;
  • a method of processing information comprising: (2) The information processing method according to (1) above, wherein the information on the mental state of the user includes information on a feature amount indicating the mental state of the user obtained from the sensing data.
  • the biological information sensor is a non-invasive sensor device.
  • the noninvasive sensor device detects the user's heartbeat, pulse, blood flow, blood pressure, perspiration, electroencephalogram, respiration, respiration volume, myoelectric potential, skin temperature, posture, motion state, number of steps, amount of activity, sleep state, and sleep time. , calorie consumption, facial expression, voice, and line of sight are detected.
  • the information processing device further includes obtaining subjective evaluation information regarding the user's mental state input by the user as the information regarding the user's mental state.
  • Information processing method 1.
  • the information processing device analyzes the character information, and selects the number of characters of the character information, the number of responses, and a predetermined wording extracted from the character information as a feature quantity indicating the mental state of the user.
  • the information about the user's work includes at least one selected from the group consisting of the user's work hours, schedule, work content, and work achievement rate
  • the information processing device correlates the information on the task type and achievement rate for each hour and the information on the mental state for each hour based on the time attached to each piece of information, and determines the strength of the relationship.
  • the information processing device further includes estimating work content strongly related to a predetermined mental state.
  • the information processing device Acquiring information about the mental states of the plurality of users based on sensing data from the biometric information sensor; Acquiring information about the work of the plurality of users; estimating the relationship between the information on the mental state of each user and the information on the work of each user; Integrating estimation results regarding the work or mental state of each user estimated based on the relationship and outputting them to the information processing terminal;
  • the information processing method according to any one of (1) to (15) above, further comprising: (17) The information processing device Comparing the information about the mental state and the information about the work between the organization to which the user belongs and another organization similar to the organization; further comprising outputting advice to an administrator of the organization to which the user belongs based on the comparison result; The information processing method according to (16) above.
  • a mental state information acquisition unit that acquires information on the user's mental state based on sensing data from the biological information sensor; a business information acquisition unit that acquires information about the user's business; an estimation unit for estimating a relationship between information on the mental state of the user and information on the work of the user; an information output unit for outputting an estimation result regarding the work or mental state of the user estimated based on the relationship to an information processing terminal; An information processing device.
  • a first information processing device that acquires information about a user's mental state based on sensing data from a biological information sensor; a second information processing device that stores information about the user's work; a third information processing device that determines information related to work recommended to the user;
  • An information processing system comprising The third information processing device is Acquiring information about the mental state of the user from the first information processing device; Acquiring information about the user's work from the second information processing device; estimating a relationship between information about the user's mental state and information about the user's work; outputting to an information processing terminal an estimation result regarding the user's work or mental state estimated based on the relationship; Information processing system.
  • 10, 10a, 10b information processing system 100 100a, 100b wearable device 110, 210, 310, 410, 510, 610 input section 120, 220, 320, 420, 520, 620 output section 130, 630 control section 140 sensor section 150 , 250, 350, 450, 550, 650 Communication unit 160, 260, 360, 460, 560, 660 Storage unit 170, 192 Band unit 180 Control unit 190L, 190R Main unit 200 User terminal 230, 330, 330a, 430, 530 Processing unit 232 sensing data acquisition unit 234 sensing data analysis unit 300, 300a server 332 task analysis unit 334 mental state information acquisition unit 336 relationship estimation unit 338 future transition estimation unit 340 stratified analysis unit 400 attendance management server 462 work data 464 schedule data 466 task management data 500 management server 600 mail/chat management server 662 chat data 664 mail data 700 network 832, 834, 836, 840, 842, 844, 846, 848 display

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention concerne un procédé de traitement d'informations, comprenant un dispositif (300) de traitement d'informations qui acquiert des informations liées à l'état psychologique d'un utilisateur d'après des données de détection provenant d'un capteur d'informations biométriques, acquiert des informations se rapportant au travail de l'utilisateur, estime la relation entre les informations se rapportant au travail de l'utilisateur et les informations se rapportant à l'état psychologique de l'utilisateur, et délivre, à un terminal (200) de traitement d'informations, des résultats d'estimation se rapportant au travail ou à l'état psychologique de l'utilisateur estimés sur la base de la relation.
PCT/JP2023/006321 2022-03-01 2023-02-21 Procédé, dispositif et système de traitement d'informations Ceased WO2023167061A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024504637A JPWO2023167061A1 (fr) 2022-03-01 2023-02-21

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022030682 2022-03-01
JP2022-030682 2022-03-01

Publications (1)

Publication Number Publication Date
WO2023167061A1 true WO2023167061A1 (fr) 2023-09-07

Family

ID=87883552

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/006321 Ceased WO2023167061A1 (fr) 2022-03-01 2023-02-21 Procédé, dispositif et système de traitement d'informations

Country Status (2)

Country Link
JP (1) JPWO2023167061A1 (fr)
WO (1) WO2023167061A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009110308A (ja) * 2007-10-30 2009-05-21 Nec Corp 緊張度解析装置、方法、プログラム及び携帯電話機
WO2020183570A1 (fr) * 2019-03-11 2020-09-17 三菱電機株式会社 Dispositif d'attribution de travail, système d'attribution de travail et programme d'attribution de travail
JP2020181577A (ja) * 2019-04-23 2020-11-05 株式会社アトラエ 情報分析装置、情報分析方法、情報分析プログラム及び学習モデル生成方法
JP2022001115A (ja) * 2020-06-19 2022-01-06 富士通株式会社 情報処理プログラム、情報処理方法、および情報処理装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009110308A (ja) * 2007-10-30 2009-05-21 Nec Corp 緊張度解析装置、方法、プログラム及び携帯電話機
WO2020183570A1 (fr) * 2019-03-11 2020-09-17 三菱電機株式会社 Dispositif d'attribution de travail, système d'attribution de travail et programme d'attribution de travail
JP2020181577A (ja) * 2019-04-23 2020-11-05 株式会社アトラエ 情報分析装置、情報分析方法、情報分析プログラム及び学習モデル生成方法
JP2022001115A (ja) * 2020-06-19 2022-01-06 富士通株式会社 情報処理プログラム、情報処理方法、および情報処理装置

Also Published As

Publication number Publication date
JPWO2023167061A1 (fr) 2023-09-07

Similar Documents

Publication Publication Date Title
US11839473B2 (en) Systems and methods for estimating and predicting emotional states and affects and providing real time feedback
US12257054B2 (en) Systems and methods for estimating and predicting emotional states and affects and providing real time feedback
KR101970077B1 (ko) 데이터 태깅
US20210161482A1 (en) Information processing device, information processing method, and computer program
US20180184959A1 (en) Information processing device, control method, and program
CN109147928A (zh) 通过增强现实显示为雇员提供健康信息的系统、计算机介质和计算机实现方法
KR101686070B1 (ko) 바이오피드백 가능하도록 웰니스 지수를 모니터링하는 헬스 케어 방법 및 이를 수행하는 홈 헬스 미러-웨어러블 연동 시스템
US11687849B2 (en) Information processing apparatus, information processing method, and program
Xue et al. Understanding how group workers reflect on organizational stress with a shared, anonymous heart rate variability data visualization
US20230050179A1 (en) Biological measurement device, pulse wave sensor, sphygmomanometer, and meeting support system
AU2018267284A1 (en) A system and method for monitoring human performance
CN110139599A (zh) 用户终端
US20210202078A1 (en) Patient-Observer Monitoring
US20170071468A1 (en) Motion tracking method for sonographer
Akbulut et al. e-Vital: a wrist-worn wearable sensor device for measuring vital parameters
Labus et al. An IoT system for healthcare in the smart city
US20210290131A1 (en) Wearable repetitive behavior awareness device and method
WO2023167061A1 (fr) Procédé, dispositif et système de traitement d'informations
US20230107691A1 (en) Closed Loop System Using In-ear Infrasonic Hemodynography and Method Therefor
JP7395423B2 (ja) 食事と睡眠・運動に係る情報を提供可能な生活モニタ装置、システム、プログラム及び方法
US20220167931A1 (en) Wearable detection & treating device
US20230080356A1 (en) Telehealth and medical iot communication and alerts
Umamageswaran et al. Intelligent technique for stress level management for it employees in the work from home environment using iot technology
WO2023157596A1 (fr) Procédé de traitement d'informations, dispositif de traitement d'informations, programme, et système de traitement d'informations
Manjuladevi et al. 7 IoT in Healthcare

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23763320

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2024504637

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23763320

Country of ref document: EP

Kind code of ref document: A1