WO2024228581A1 - Mental healthcare device having electrode contact structure - Google Patents

Abstract

A mental healthcare device having an electrode contact structure, according to embodiments of the present invention, comprises: a housing including a first body unit including a brainwave sensor unit and a PPG sensor unit, a second body unit that is connected to the first body unit and has a first band hole formed at one end of the opposite side to a portion where the second body unit is connected to the first body unit, a third body unit that is connected to the first body unit and has a second band hole formed at one end of the opposite side to a portion where the third body unit is connected to the first body unit, and a processor that controls the brainwave sensor unit and the PPG sensor unit; and a band that is coupled to the first and second band holes and is adjustable in length.

Description

Mental healthcare device with electrode contact structure

The present invention relates to a mental healthcare device including EEG and PPG sensors. More specifically, the present invention relates to a mental healthcare device having a structure for more accurately sensing bio-data including brain waves of a user.

Due to rapid social changes and rapid economic growth, the number of people complaining of mental health problems such as depression, stress, and dementia is increasing. In addition, much research is being conducted on ways to accurately diagnose and assess mental health conditions using certain electronic devices.

For this purpose, a device that measures brain waves was invented, and a technology was disclosed that uses the device to determine the mental health level of the user, thereby providing objective results on the user's mental health and certain content for the development of the user's mental health.

However, according to the above-mentioned conventional technologies and the technologies introduced so far, only the mental health status is diagnosed using bio-signal data or only the mental health status is diagnosed using the questionnaire data, and the mental health of the user cannot be diagnosed by organically integrating the bio-signal data and the questionnaire data.

In addition, there were limitations in providing comprehensive mental healthcare services by obtaining users' bio-data other than brain waves through measuring devices, rather than simply providing programs or content that utilize the brain waves after measuring the users' brain waves.

Accordingly, there is an increasing need to propose a mental healthcare device that can accurately measure a user's brain waves in order to provide a brainwave-based customized program.

Meanwhile, brain waves, which are generally measured by electrodes attached to the subject's scalp included in the brain wave measuring device, are physical values that reflect the human state of consciousness, mainly as waves with a frequency of 0.5 to 40 Hz.

The above brain waves can be divided into several types according to their frequency. When classifying brain wave signals by frequency, brain waves with a frequency of 0.5 to 4 Hz are delta (δ) waves, which mainly appear in normal sleep states or in newborns, and brain waves with a frequency of 8 Hz, theta (θ) waves, which typically appear in emotionally unstable states or in adolescents with learning disabilities who are distracted by their surroundings.

On the other hand, alpha (α) waves with a frequency of 8-13 Hz are clearly visible when one is mentally stable, has one's eyes closed, and is concentrating, and finally, beta (β) waves with a frequency of 14 Hz or higher are visible during mental activity or when one is in a state of tension.

Among the brainwave signals described above, brainwaves in the alpha (α) wave region are known to be psychologically stable and increase concentration, so research is actively being conducted to increase the appearance rate of alpha waves, and in particular, research on neurofeedback training using alpha waves and devices supporting this theory have been actively developed in various fields.

However, conventional brain wave measurement devices have a problem in that they cannot remove noise caused by the sensor's close contact, the subject's movement, the sensor's operation, etc., and thus, they use brain waves containing noise to determine the subject's mental indicators, resulting in low accuracy.

In addition, there is no disclosure at all regarding a technology for extracting a single integrated mental index by simultaneously using the acquired first bio-data and second bio-data, while extracting separate mental indicators from each of the first bio-data and second bio-data acquired through an EEG measuring device.

In addition, since only sensing data on the subject's current state obtained through the brainwave measuring device is provided, and prediction data on what will happen in the future is not provided, an invention to solve this problem is urgently needed.

The present invention has been made to solve the problems of the prior art as described above, and its purpose is to provide a mental healthcare device having an electrode contact structure.

In addition, the present invention seeks to provide a mental healthcare device having an electrode contact structure combined with a length-adjustable band.

In addition, the present invention seeks to provide a mental healthcare device having an electrode-contact structure that simultaneously measures and acquires EEG data and PPG data.

In addition, the present invention seeks to provide a mental healthcare device having an electrode contact structure in which the EEG electrode has a structure for close contact with the user's body.

In addition, the present invention aims to provide a method and system for deriving a mental index based on composite data of EEG and PPG by simultaneously obtaining EEG and PPG data based on a mental healthcare device mounted on the user's head.

In addition, the present invention seeks to provide a method and system for deriving a mental index based on composite data of EEG and PPG, which corrects a basic mental index based on PPG data.

In addition, the present invention seeks to provide a method and system for deriving a mental index based on composite data of EEG and PPG, which derives multiple mental indexes from only one composite data.

In addition, the present invention aims to provide a method and system for deriving a mental index based on composite data of EEG and PPG that identifies a long-term trend of changes in a user's sensing data for one mental index.

However, the technical problems to be solved by the present invention and embodiments of the present invention are not limited to the technical problems described above, and other technical problems may exist.

A mental healthcare device having an electrode contact structure according to an embodiment of the present invention comprises: a first body part including a brainwave sensor part and a PPG sensor part; a second body part connected to the first body part and having a first band hole formed at one end opposite the portion connected to the first body part; a third body part connected to the first body part and having a second band hole formed at one end opposite the portion connected to the first body part; a housing including a processor that controls the brainwave sensor part and the PPG sensor part; and a band connected to the first and second band holes and having an adjustable length.

In addition, the curvature of the first body part is formed to be greater than the curvatures of the second body part and the third body part, and the housing has an oval structure with one side open, with the long axis being in the normal direction from the PPG sensor part and the short axis being in the left and right directions.

In addition, the PPG sensor unit is positioned at the inner center of the first body unit, and the brainwave sensor unit includes a first EEG electrode positioned to the left of the PPG sensor unit and a second EEG electrode positioned to the right.

In addition, the first EEG electrode and the second EEG electrode protrude in the inner body direction from the inner body surface of the first body part by a predetermined length and are connected to a substrate included in the housing by a spring.

In addition, the first EEG electrode and the second EEG electrode have a structure in which, when worn by a user, the first EEG electrode and the second EEG electrode are pressed toward a substrate included inside the housing of the first body part due to elasticity of the spring, and the surfaces of the first EEG electrode and the second EEG electrode are in close contact with the user's body.

Additionally, the surfaces of the first EEG electrode and the second EEG electrode are formed in a convex structure opposite to the inner body curvature of the first body portion.

In addition, the PPG sensor unit includes a light emitting unit that outputs light, a glass unit for passing reflected light output from the light emitting unit, and a light receiving unit that senses the reflected light.

Additionally, the glass portion is positioned at a location corresponding to the center of the user's forehead when worn by the user.

In addition, the second body part and the third body part are structured so that when the band is tightened according to length adjustment, the first base electrode arranged in the second body part and the second base electrode arranged in the third body part are rotated inwardly at a predetermined angle so as to be in close contact with the user's head.

In addition, the mental healthcare device having the electrode contact structure further includes a noise detection sensor located inside the housing and connected to the brainwave sensor unit and the PPG sensor unit, and the processor stops measuring EEG data sensed by the brainwave sensor unit and PPG data sensed by the PPG sensor unit when noise is detected in the spring connected to the first and second EEG electrodes based on the noise detection sensor.

A mental healthcare device having an electrode contact structure according to an embodiment of the present invention is combined with a band whose length can be adjusted, thereby improving aesthetics and wearing convenience by adjusting the band to fit the size of the user's head.

In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of reducing the error rate due to changes in the measurement environment by simultaneously measuring and obtaining EEG data and PPG data.

In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of minimizing the occurrence of noise due to movement of the electrode while increasing the accuracy of EEG data by having a structure for the EEG electrode to be in close contact with the user's body.

Meanwhile, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention are based on a mental healthcare device mounted on the user's head, thereby simultaneously obtaining EEG data and PPG data with a single device without separately wearing a device for measuring brain waves (EEG) and a device for measuring pulse waves (PPG), and the separate data transmission and reception procedure is simplified, thereby greatly increasing physical and procedural efficiency.

In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention calculates a mental index by comprehensively considering PPG data as well as EEG data, by correcting a basic mental index based on PPG data, so that the accuracy of the user's mental index is improved.

In addition, the method and system for deriving mental indices based on composite data of EEG and PPG according to an embodiment of the present invention has the effect of improving the utility of using a mental healthcare device and user satisfaction by deriving multiple mental indices using only one composite data.

In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention have the effect of providing a program that immediately stabilizes the mental state of a user by identifying a long-term trend of changes in the user's sensing data for one mental index, and furthermore, providing a more effective program in which feedback is applied to more accurately identify the mental state of the user by considering the long-term mental changes of the user and further improve the identified mental state of the user.

However, the effects obtainable from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood from the description below.

Figure 1 is a conceptual diagram of a mental healthcare service providing system according to an embodiment of the present invention.

Figure 2 is an internal block diagram of a device according to an embodiment of the present invention.

Figure 3 is a perspective view showing the structure and shape of a device according to an embodiment of the present invention.

FIG. 4 is a cross-sectional view illustrating the EEG electrode structure of the brainwave sensor unit according to an embodiment of the present invention.

FIG. 5 is an example for explaining a device and band combined according to an embodiment of the present invention.

FIG. 6 is an example for explaining a band coupled to a device according to an embodiment of the present invention.

Figure 7 is a conceptual diagram of a PPG sensor unit according to an embodiment of the present invention.

FIG. 8 is a cross-sectional view for explaining the structure of a PPG sensor unit according to an embodiment of the present invention.

FIG. 9 is an example for explaining corresponding positions of third and fourth EEG electrodes included in a device according to another embodiment of the present invention.

Figure 10 is an internal block diagram of a user terminal according to an embodiment of the present invention.

FIG. 11 is a flowchart illustrating a method for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention.

FIG. 12 is a flowchart illustrating a method for providing service feedback based on accumulated composite data according to an embodiment of the present invention.

FIG. 13 is an example of a drawing for explaining mental data according to an embodiment of the present invention.

FIG. 14 is an example of a drawing for explaining n-th composite data measured over time in an embodiment of the present invention.

Figure 15 is an example of visual content that accumulates mental indicators according to an embodiment of the present invention.

The present invention can be modified in various ways and has various embodiments, and thus specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention and the methods for achieving them will become clear with reference to the embodiments described in detail below together with the drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various forms. In the following embodiments, the terms first, second, etc. are not used in a limiting sense, but are used for the purpose of distinguishing one component from another component. In addition, the singular expression includes the plural expression unless the context clearly indicates otherwise. In addition, the terms include or have mean that the features or components described in the specification are present, and do not preemptively exclude the possibility that one or more other features or components may be added. In addition, the sizes of the components in the drawings may be exaggerated or reduced for the convenience of explanation. For example, the sizes and thicknesses of each component shown in the drawings are arbitrarily shown for the convenience of explanation, and therefore the present invention is not necessarily limited to what is shown.

Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. When describing with reference to the drawings, identical or corresponding components are given the same drawing reference numerals and redundant descriptions thereof are omitted.

Figure 1 is a conceptual diagram of a mental healthcare service providing system according to an embodiment of the present invention.

Referring to FIG. 1, a mental healthcare service providing system (hereinafter, “service providing system”) according to an embodiment of the present invention can provide a mental healthcare service (hereinafter, “mental healthcare service”) that derives a mental index based on composite data of EEG and PPG.

Here, the mental indicator according to the embodiment may be an indicator representing the mental state of the user. In detail, the mental indicator according to the embodiment may be a dimension representing the degree of concentration (Attention), brain activity (Brain Activity), stress (Stress), mood (Mood), condition (Condition), and cognition (Cognitive), or information determining whether it corresponds to depression (Depression), ADHD, etc.

In an embodiment, the service providing system can provide customized mental healthcare content and/or programs to a mental healthcare device (100) and/or a user terminal (200) by deriving a mental index from the user's sensing data measured based on the mental healthcare device (100).

In an embodiment, a service providing system implementing the mental healthcare service as described above may be connected through a mental healthcare device (100), a user terminal (200), a service providing server (300), and a network (10: Network).

Here, the network (10) according to the embodiment means a connection structure in which information can be exchanged between each node, such as the mental healthcare device (100), the user terminal (200), and/or the service providing server (300), and examples of such a network (10) include, but are not limited to, a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a WIMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a DMB (Digital Multimedia Broadcasting) network, etc.

Hereinafter, a mental healthcare device (100), a user terminal (200), and a service provision server (300) that implement a service provision system will be described in detail with reference to the attached drawings.

- Mental Health Care Device (100: Mental Health Care Device)

A mental healthcare device (100) according to an embodiment of the present invention may be an electronic device that can be linked with a user-customized content provision application (hereinafter, “application”) that provides a user-customized content provision service installed on a user terminal, and that simultaneously measures predetermined brain waves and PPG linked to the user’s mental state.

In detail, from a hardware perspective, the mental healthcare device (100) may be a wired and/or wireless brainwave measuring device, which is distinguished by the presence or absence of a wire connected to an external terminal. In addition, it may be an electronic device including a scalp electrode, a sphenoidal electrode, and/or a nasophryngeal electrode, which are distinguished by the characteristics of the electrode.

In the embodiment of the present invention, the mental healthcare device (100) (hereinafter, device (100)) that is linked to provide a user-tailored content provision service will be described as a wireless brainwave measuring device including scalp electrodes for convenience of explanation, but any device that is linked to a user terminal and can be worn on the head of a user to measure the user's brainwaves may be implemented.

A device (100) according to an embodiment of the present invention may include an EEG sensor unit (150) and a PPG sensor unit (160) including at least one electrode within a housing.

Figure 2 is an internal block diagram of a device according to an embodiment of the present invention.

Referring to FIG. 2, from a functional perspective, the device (100) may include a memory (110), a processor (120), a communication processor (130), an interface module (140), an EEG sensor unit (150), a PPG sensor unit (160), and/or an input/output system (170). These components may be configured to be included within the housing of the device (100).

The memory (110) can store one or more of various data and commands for providing a user-customized content provision service environment.

The processor (120) may include at least one processor capable of executing commands of an application stored in the memory (110) to perform various tasks for creating a user-customized content provision service environment.

In an embodiment, the processor (120) can control the overall operation of the components to provide a user-customized content provision service.

This processor (120) may be a microcontroller (MCU) suitable for the device (100), and may execute commands and data stored in the memory (110) and control each component mounted on the device (100).

In addition, the processor (120) may communicate internally with each component via a system bus and may include one or more predetermined bus structures including a local bus.

Additionally, the processor (120) may be implemented by including at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

The communication processor (130) may include one or more devices for communicating with external devices. The communication processor (130) may communicate via a wireless network.

In detail, the communication processor (130) can communicate with a terminal that stores a content source for implementing a user-customized content provision service environment.

In an embodiment, the communication processor (130) can transmit and receive various data related to a user-customized content provision service to and from another terminal and/or an external server.

These communication processors (130) can wirelessly transmit and receive data with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI, BLE) or short-range communication methods.

In an embodiment, the communication processor (130) may be a BLE chip. The communication processor (130) may receive a signal for controlling the device (100) from a predetermined terminal.

The interface module (140) can communicatively connect the device (100) to one or more other devices. In detail, the interface module (140) can include wired and/or wireless communication devices compatible with one or more different communication protocols.

Through these interface modules (140), the device (100) can be connected to multiple input/output devices.

For example, the interface module (140) can be connected to an audio output device, such as a headset port or speaker, to output audio.

Although the audio output device has been described as being connected via an interface module (140) as an example, an embodiment in which it is installed inside the device (100) may also be included.

These interface modules (140) may be configured to include at least one of a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.

In an embodiment, the interface module (140) may be implemented as a receptacle for connecting a predetermined charging terminal.

The brainwave sensor unit (150) is a sensor that measures brainwaves (Electroencephalography, EEG) from the human brain. It can measure the potential difference between electrodes by attaching or closely contacting electrodes to the outside of the skull, i.e., the forehead, on the user's head.

In detail, the brainwave sensor unit (150) may include a sensing electrode, a reference electrode, and a ground electrode.

In an embodiment, the sensing electrode of the brainwave sensor unit (150) may be placed in the device (100) at a location corresponding to a predetermined measurement location on the user's head.

Additionally, the reference electrode and the ground electrode may be placed in the device (100) within a distance capable of transmitting and receiving a predetermined signal from the sensing electrode.

In detail, in the embodiment, the reference electrode and ground electrode of the brainwave sensor unit (160) can be connected to the sensing electrode based on a flexible substrate inside the housing (H) of the device (100).

This brainwave sensor unit (150) may include an EEG IC chip (signal amplification unit, AD conversion unit, and/or signal transmission unit).

In addition, in the embodiment, the brainwave sensor unit (150) can obtain a signal (1 Hz to 50 Hz, size of approximately ±1 mVpp) including a potential change that occurs according to the activity state of the human brain through a predetermined electrode.

Additionally, in the embodiment, the brainwave sensor unit (150) may include a signal amplifier unit that amplifies the acquired signal.

In addition, in the embodiment, the brainwave sensor unit (150) may include an AD converter unit that converts the signal amplified by the signal amplifier unit into a digital signal and outputs it.

In detail, the above AD converter can convert analog brainwave signals into digital brainwave signals and output them through Op-amps, a low-noise amplifier circuit, a channel multiplexer, and a 12-bit ADC (256Hz sampling) circuit.

In addition, in the embodiment, the brainwave sensor unit (150) may include a signal transmitter that wirelessly transmits the digital brainwave signal output from the AD converter unit.

Additionally, in the embodiment, the brainwave sensor unit (150) can transmit the digital brainwave signal to the processor (120).

The PPG sensor unit (160) may be a sensor unit that measures the amount of blood flowing in peripheral blood vessels by irradiating red light to the earphone user's ear using a red light source and measuring the user's pulse or pulse wave (Photoplethysmogram, PPG) using a light sensor from the light transmitted or reflected therefrom.

In an embodiment, the light emitting unit and light receiving unit of the PPG sensor unit (160) may be installed at a position corresponding to a predetermined measurement position on the user's head.

This PPG sensor unit (160) may include a PPG IC chip (signal amplification unit, AD conversion unit, and/or signal transmission unit).

In detail, the PPG sensor unit (160) can use a photoplethysmography method that reflects light (LED) into the arterioles in the subcutaneous layer of the forehead and detects how much light is absorbed using a photodetector (photo diode).

In addition, in the embodiment, the PPG sensor unit (160) can obtain an analog heart rate signal including a potential change that occurs according to a human pulse activity state through a light emitting unit and a light receiving unit using the photoplethysmography method.

In addition, the above analog heart rate signal can be transmitted to the PPC IC chip, converted into a digital heart rate signal through algorithm analysis and digital filtering processes, and then output.

In addition, in the embodiment, the PPG sensor unit (160) can transmit the digital heart rate signal to the processor (120) based on a signal transmitter that wirelessly transmits the converted and output digital heart rate signal.

In an embodiment, the device (100) may further include various sensors such as a position sensor (IMU), an audio sensor, a distance sensor, a proximity sensor, a contact sensor, etc., in addition to the brainwave sensor unit (150) and the PPG sensor unit (160) described above.

The input/output system (170) can detect user input (e.g., voice commands, button operations, or other types of input) related to a user-customized content provision service.

In detail, the input/output system (170) may include predetermined buttons and/or touch sensors, etc. In an embodiment, the input/output system (170) may include a control button (171).

Additionally, the input/output system (170) can be connected to an external controller through an interface module (140) to receive user input.

Additionally, the input/output system (170) may include a display unit for outputting a predetermined light. In an embodiment, this display unit may be an LED (173).

In addition, the input/output system (170) can output a predetermined light based on the LED (173) when it detects a state preset by the processor (120) (e.g., charging required, charging complete, brain wave measurement in progress, brain wave measurement error, etc.).

The device (100) including the above-described components can store user sensing data including at least one EEG data, PPG data, left and right brain balance data, auditory data, etc. in the memory (110) according to an embodiment.

Hereinafter, the device (100) will be briefly described as performing the operation of at least one processor to execute the instructions of the application.

The brainwave sensor unit (150) according to the embodiment can amplify and convert an analog brainwave signal (e.g., brainwave with a frequency of 1 to 30 Hz) generated in the user's brain measured by the electrode into a digital signal so that it can be analyzed.

In addition, the PPG sensor unit (160) according to the embodiment can amplify an analog pulse signal generated from the user's artery measured by the light receiving unit and convert it into a digital signal so that the pulse signal can be analyzed.

Additionally, in the embodiment, the device (100) can transmit a converted digital signal to a predetermined terminal using short-range wireless communication.

Meanwhile, the device (100) including the components described above to provide a user-customized content provision service in the embodiment may be implemented in a hairband type in terms of hardware.

FIGS. 3 to 5 are examples for explaining the external appearance of a device (100) according to an embodiment of the present invention. FIG. 3 is a perspective view showing the structure and shape of a device (100) according to an embodiment, FIG. 4 is a cross-sectional view for explaining the EEG electrode structure of a brainwave sensor unit (150) according to an embodiment of the present invention, and FIG. 5 is an example for explaining the appearance of a device (100) and a band (1000) combined according to an embodiment of the present invention.

Referring to FIG. 3, in an embodiment, the device (100) may be implemented as a housing (H) with a curved structure having a curvature optimized for a human head.

In addition, in the embodiment, the device (100) may include an EEG sensor unit (150) including first and second EEG electrodes (151, 152), a PPG sensor unit (160), a control button (171), and an LED (173) within a housing (H).

In detail, the housing (H) may have an oval shape with the long axis in the normal direction from the PPG sensor unit (160) and the short axis in the left and right directions, and may have a structure with one side open.

Bands (1000) are coupled to both ends of the housing, so that one open side of the device (100) can form an oval-shaped structure closed by the bands (1000), as shown in FIG. 5.

Here, in the embodiment, the band (1000) has an elastic structure and is adjustable in length, and the combined form of the device (100) and the band (1000) may be variable depending on whether the length is adjusted. That is, the structure of the device (100) and the band (1000) may be a structure that fits the head shape of a user using the band (1000) whose length is adjustable.

In addition, the housing (H) can be divided into first to third body parts (B1, B2, B3). In addition, the first to third body parts (B1, B2, B3) can define an area in the direction of contact with the user's head as an inner body (B11, B21, B31), and an area symmetrical to the inner body as an outer body (B12, B22, B32).

Additionally, the first and second body parts (B1, B2) may be connected but may be separated by a first boundary part (C1), and the first and third body parts (B1, B3) may be connected but may be separated by a second boundary part (C2).

In addition, the housing (H) may have a curvature of the first body part (B1) greater than that of the second and third body parts (B2, B3) in terms of curvature, which indicates the degree of bending. However, when the length of the band (1000) is shortened and tightened, the second and third body parts (B2, B3), which have a relatively higher tension than the first body part (B1), bend more, thereby increasing the curvature, and may be deformed to have the same or greater curvature than that of the first body part (B1).

Since the relative curvature difference and tension difference of the first to third body parts (B1, B2, B3) cause a change in the relative curvature according to the tightening of the band part (1000), the sensors of the first body part (B1) are in close contact with the user, and at the same time, the user is provided with a comfortable feeling of wearing.

Additionally, the first inner body (B11) of the first body (B1) may include an EEG sensor unit (150) and a PPG sensor unit (160).

At this time, the wire connected to the brain wave sensor unit (150) and the wire connected to the PPG sensor unit (160) can be separated from each other and placed inside the housing (H).

In addition, the brainwave sensor unit (150) includes first and second EEG electrodes (151, 152), and a PPG sensor unit (160) may be positioned between the first and second EEG electrodes (151, 152).

In detail, a PPG sensor unit (160) may be placed in the inner center of the first body unit (B1), a first EEG electrode (151) may be placed on the left side symmetrically to the left and a second EEG electrode (152) may be placed on the right side centered on the PPG sensor unit (160).

The PPG sensor unit (160) measures the pulse using light emission, so it may generate noise, and when worn, it may measure the distance from the user's forehead.

Accordingly, since noise caused by the PPG sensor unit (160) is equally introduced into the first EEG electrode (151) and the second EEG electrode (152) which have the same relative distance, the EEG IC can easily remove noise caused by the PPG sensor unit (160) by including a common noise removal filter caused by the PPG sensor unit (160) introduced into both electrodes.

In addition, the PPG sensor unit (160) measures the distance to detect whether or not it is being worn. When the close contact is adjusted to the distance measured by the PPG sensor unit (160), the first EEG electrode (151) and the second EEG electrode (152) will be symmetrical to each other and close to the same degree, so that the intensity of the user's left and right brain waves can be sensed in the same amount.

Referring to FIG. 4, the first and second EEG electrodes (151, 152) are sensing electrodes for measuring the user's brain waves and can be placed at a location corresponding to a body part (e.g., forehead).

At this time, in order to ensure close contact with the user's body, the electrode surfaces (151-SF, 152-SF) of the first and second EEG electrodes (151, 152) may protrude from the surface (B1-SF) of the first inner body (B1) toward the inner body part by a predetermined length.

In addition, the first and second EEG electrodes (151, 152) may be connected to a substrate (S) included inside the housing (H) by combining with a predetermined spring (155). At this time, in the embodiment, the substrate (S) may be a flexible printed circuit board (FPCB).

Accordingly, if a user wears the device (100) on his/her head, the first and second EEG electrodes (151, 152) can move a predetermined length toward the substrate (S) included inside the housing (H) due to elasticity through the spring.

In addition, the first and second EEG electrodes (151, 152) may have a convex structure opposite to the curvature of the first body part (B1). Accordingly, the first and second EEG electrodes (151, 152) may be in closer contact with the user's body.

In addition, a first base electrode (153) may be arranged on the lower side of the second body part (B2) where the second inner body (B21) and the second outer body (B22) of the second body part (B2) are in contact. In addition, a second base electrode (154) may be arranged on the lower side of the third body part (B3) where the third inner body (B31) and the third outer body (B32) of the third body part (B3) are in contact.

In addition, according to the arranged first and second base electrodes (153, 154), a predetermined step may be formed along the outer surface of the second and third outer bodies (B22, B32) of the second and third body parts (B2, B3).

Additionally, in the embodiment, the first base electrode (153) may have a shape whose width increases from the first boundary portion (C1) toward the first band hole (BH-1).

Similarly, in the embodiment, the second base electrode (154) may have a shape whose width increases from the second boundary portion (C2) toward the second band hole (BH-2).

Since the first and second base electrodes (153, 154) have the above shape, the area in contact with the user's skin can be increased regardless of the user's different head shapes, thereby having the effect of sensing more accurate EEG data.

In addition, in the embodiment, the second body part (B2) including the first base electrode (153) and the third body part (B3) including the second base electrode (154) can rotate at a predetermined angle in the direction of the first and second base electrodes (153, 154) with the first boundary part (C1) and the second boundary part (C2) as a reference axis.

The rotation of the second and third body parts (B2, B3) can occur simultaneously when the user tightens the band (1000) to press the device (100) against the head.

In detail, the first connecting portion between the second body portion (B2) and the first body portion (B1) may be composed of a rotational axis connecting the second body portion (B2) and the first body portion (B1), and a return spring moving the rotational axis to a reference position. At this time, the axial direction of the rotational axis may be a longitudinal direction extending from the first body portion (B1) to the second body portion (B2).

The above first coupling part can rotate the second body part (B2) so that the first base electrode (153) arranged in the second body part (B2) faces inward (towards the user's head) when a force is applied to pull the second body part (B2) due to the tightening of the band (100).

Accordingly, the lower side area of the first base electrode (153) arranged to surround the lower part of the second body part (B2) is directed toward the user's skin side and comes into close contact with each other, so that the bonding area is improved and the degree of adhesion can be increased.

When the user releases the band (100) for removal, the tightening force applied to the second body part (B2) is removed, and depending on the elasticity of the return spring of the second body part (B2), the second body part (B2) can be returned and positioned so that its reference position (reference axis) coincides with that of the first body part (B1).

A second joint may be arranged between the first body part (B1) and the third body part (B3) so as to be arranged symmetrically with the same structure as the first joint part. The description of the second joint part will be replaced with the description of the first joint part.

In this way, since the first and second base electrodes (153, 154) have a predetermined shape and the body portion including the plurality of electrodes rotates at a predetermined angle, the first and second base electrodes (153, 154) can increase the area of contact with the user's skin regardless of the user's different head shapes and can make the electrodes more closely adhere, thereby having the effect of sensing more accurate EEG data.

At this time, the first and second base electrodes (153, 154) may be electrodes formed by, for example, gold plating using an ABS material injection molding method.

In detail, in the embodiment, the first and second base electrodes (153, 154) may be a reference electrode and/or a ground electrode.

In an embodiment, the first base electrode (153) may be a reference electrode, and the second base electrode (154) may be a ground electrode. This is merely an example, and in another embodiment, the first base electrode (153) may be a ground electrode, and the second base electrode (154) may be a reference electrode. Hereinafter, these may be collectively referred to as electrodes.

That is, in the embodiment, the second base electrode (154), which is a ground electrode, can measure the potential difference between the first and second EEG electrodes (151, 152), which are sensing electrodes, and the first base electrode (153), which is a reference electrode.

Accordingly, in the embodiment, the device (100) can obtain EEG data measuring the user's brain waves based on the brainwave sensing unit (150).

Additionally, a control button (171) and an LED (173) may be included on the upper side of the third body part (B3) where the third inner body (B31) and the third outer body (B23) of the third body part (B3) come into contact.

In an embodiment, the control button (171) may be placed in a location that is easy to control with the user's hand.

Additionally, in the embodiment, the control button (171) can detect a predetermined input for controlling the device (100).

Additionally, in the embodiment, the control button (171) may include a predetermined pressure sensor and/or touch sensor.

In this embodiment, the LED (173) may be placed on one side of the control button (171).

Additionally, in the embodiment, the LED (173) can emit light under the control of a terminal and/or server including the device (100).

Additionally, first and second band holes (BH-1, BH-2) can be formed at both ends of the second and third body parts (B2, B3).

Accordingly, in the embodiment, the band (1000) can be coupled to the second and second band holes (BH-1, BH-2).

FIG. 6 is an example for explaining a band (1000) coupled to a device (100) according to an embodiment of the present invention.

Referring to FIG. 6, the band (1000) in the embodiment may be an elastic band for length adjustment. For example, the band (1000) may be composed of a rubber material including a predetermined ABS material and/or a fabric material including velcro. Hereinafter, for convenience of explanation, the band (1000) according to the embodiment will be described based on the fact that it is made of a fabric material.

In an embodiment, the band (1000) may include a loop (1100), a hook (1200), and a closing piece (1300).

Additionally, in the embodiment, the loop (1100) may be a horizontally long bar-shaped string made of fabric material.

In addition, for example, the horizontal length of the loop (1100) may be approximately 350 mm so as to be adjusted to the user's head size. In addition, for example, the vertical length of the loop (1100) may be approximately 24 mm so as to be similar to the vertical length of the device (100).

Additionally, in the embodiment, the hook (1200) may be a slim Velcro having a vertically long shape.

In addition, at least one or more hooks (1200) may be placed at each end of the loop (1100). As shown in FIG. 6, four hooks (1200) are placed at each end area of the loop (1100).

At this time, the first hook assembly (1210) positioned at one end of the loop (1100) and the second hook assembly (1220) positioned at the opposite end may be composed of different materials so that the male and female Velcro can be distinguished.

Accordingly, the first hook assembly (1210) and the second hook assembly (1220) can be fixed in a contact state when they come into contact with each other. That is, the user can wear the device (100) by adjusting the length of the loop (1100) to fit the head size using the hook (1200).

Additionally, in an embodiment, the finishing piece (1300) may be placed at each horizontal edge of the loop (1100). This may be for aesthetic reasons and/or to smooth the edge finish of the loop (1100).

At this time, for example, the closing piece (1300) may be made of a rigid material and/or a fabric material.

Returning again, a PPG sensor unit (160) may be positioned between the first and second EEG electrodes (151, 152) arranged in the first inner body (B11) of the first body unit (B1).

In detail, in the embodiment, the location where the PPG sensor unit (160) is placed may be a location corresponding to a body part for measuring pulse on the user's head. In the embodiment, the location may mean the exact center of the user's forehead.

In other words, the first and second EEG electrodes (151, 152) can be arranged symmetrically on the left and right at a predetermined distance from the PPG sensor unit (160) positioned at a location corresponding to the center of the user's forehead.

Figure 7 is a conceptual diagram of a PPG sensor unit (160) according to an embodiment of the present invention.

Referring to FIG. 7, in the embodiment, the PPG sensor unit (160) may include a light emitting unit (3000), a light receiving unit (3100), and an optical diffuser (3200).

The light emitting unit (3000) is a unit that outputs light and may be composed of a Visual RGB color LED (VCSEL) that generates light with a wavelength of about 400 nm to 700 nm and an infrared (NIR) LED (VCSEL) that generates light with a wavelength of about 850 nm to 1050 nm.

In addition, the light receiving unit (3100) is an area that senses scattered or reflected light and may be composed of an optic module having a photo diode, a photo transistor, and a photo detector attached thereto.

The light receiving unit (3100) may include, in an embodiment, an optical sensor for sensing reflected light and an optical filter coated on the optical sensor.

In addition, the optical diffuser (3200) may be a part that is positioned adjacent to the light emitting unit (3000) and light receiving unit (3100) to increase the light emitting and light receiving areas.

In an embodiment, light (L) output from the light emitting unit (3000) may be reflected by a predetermined blood vessel (2) included in the user's body (1), and the reflected light (RL), which is the reflected light, may enter the light receiving unit (3100).

In addition, the light emitting area, which is the area of light output from the light emitting unit (3000), and the light receiving area, which is the area that can receive light from the light receiving unit (3100), may correspond to the sizes of the light emitting unit (3000) and the light receiving unit (3100), respectively.

However, the optical diffuser (3200) according to the embodiment can increase the sensitivity of the PPG sensor unit (160) by increasing the light-emitting area (A1) and the light-receiving area (A2) and reduce the deviation of the user's heart rate (PPG) data measured by the PPG sensor unit (160).

In other words, the light (L) output from the light emitting unit (3000) can be diffused by the light emitting area (A1) by passing through the optical diffuser (3200), and the reflected light (RL) reflected by a predetermined blood vessel (2) included in the user's body (1) can be received by the light receiving unit (3100) by passing through the optical diffuser (3200) again and entering the increased light receiving area (A2).

To this end, the PPG sensor unit (160) including the optical diffuser (3200) according to the embodiment can be implemented with a predetermined structure.

Figure 8 is a cross-sectional view for explaining the structure of a PPG sensor unit (160) according to an embodiment of the present invention.

Referring to FIG. 8, in the embodiment, the PPG sensor unit (160) may be placed on the substrate (S) of the device (100) that supports the light emitting unit (3000) and the light receiving unit (3100) placed next to the light emitting unit (3000).

Additionally, in the embodiment, the PPG sensor unit (160) may include a partition (B) arranged between the light-emitting unit (3000) and the light-receiving unit (3100).

The above-mentioned partition (B) may be arranged to prevent light (L) emitted from the light emitting unit (3000) from being reflected inside the housing (H) rather than the blood vessels (2) of the user's body (1) and being received by the light receiving unit (3100).

In addition, in the embodiment, the optical diffuser (3200) may include a first lens (3210) that diffuses light (L) output from the light emitting unit (3000) and a second lens (3220) that receives reflected light (RL) toward the light receiving unit (3100).

In detail, the first lens (3210) may be formed and placed at a position spaced apart from the light-emitting portion (3000) in the optical diffuser (3200), and the second lens (3220) may be formed and placed at a position spaced apart from the light-receiving portion (3100) in the optical diffuser (3200).

In addition, in the embodiment, the light receiving unit (3100) may include an optical filter having a predetermined structure to transmit only reflected light (RL) incident at a predetermined location in the light receiving unit (3100).

Additionally, in the embodiment, the PPG sensor unit (160) may further include an optical plate (3200-P) that supports the first lens (3210) and the second lens (3220).

Additionally, in the embodiment, the PPG sensor unit (160) may include a glass unit (3300) for allowing light to pass through the optical plate (3200-P).

At this time, the glass part (3300) is placed on the first inner body (B11) of the first body part (B1) of the device (100) and can directly contact the user's head (e.g., forehead) when worn.

Accordingly, in the embodiment, the device (100) can obtain PPG data measuring the user's pulse based on the PPG sensor unit (160) having the structure described above.

That is, in the embodiment, the device (100) can simultaneously obtain EEG data and/or PPG data when a user wears the device (100).

Meanwhile, when the user wears the device (100), a certain amount of noise may be generated as the spring (155) connected to the first and second EEG electrodes (151, 152) moves.

To this end, in the embodiment, the device (100) may further include a noise detection sensor in an area extending from the brainwave sensor unit (150) and/or the PPG sensor unit (160).

Additionally, in an embodiment, the device (100) may stop measuring EEG data and/or PPG data if noise is detected in at least one spring (155) connected to the first and second EEG electrodes (151, 152) based on a noise detection sensor.

In addition, in the embodiment, the device (100) can detect whether the user is wearing it by setting a predetermined length by which the first and second EEG electrodes (151, 152) move toward the surface (B1-SF) of the first inner body (B1) by the plurality of springs (155).

At this time, if the first and second EEG electrodes (151, 152) move in the direction of the surface (B1-SF) of the first inner body (B1) by a predetermined length or more, the device (100) in the embodiment can be determined to be in a state where the user is wearing it.

Additionally, if it is determined that the user is wearing the device and there is no noise data sensed by the noise detection sensor for a preset period of time, the device (100) in the embodiment can start measuring EEG data and/or PPG data.

That is, in the embodiment, the device (100) can simultaneously remove noise included in EEG data and/or PPG data acquired based on a noise detection sensor.

Additionally, in another embodiment, the device (100) can remove noise included in EEG data and/or PPG data when noise is generated by a plurality of springs (155) connected to the first and second EEG electrodes (151, 152).

In addition, in the embodiment, the device (100) can separately remove only the noise included in the EEG data by removing the EOG (Electrooculogram) generated by the movement of the user's eyes.

Additionally, in an embodiment, the device (100) can synchronize acquired EEG data and/or PPG data.

Additionally, in an embodiment, the device (100) can transmit the noise-free and synchronized EEG data and/or PPG data to a predetermined terminal.

In more detail, the device (100) can set the noise bias to be proportional to the shortened length of the spring if the length of the spring measured by the noise detection sensor is within a predetermined threshold.

And the device (100) can remove noise caused by the spring based on the set noise bias, noise characteristics caused by the spring in the first EEG electrode and the second EEG electrode, and noise characteristics caused by symmetry in the measured EEG raw data of both electrodes.

In more detail, the device (100) stores a pattern of noise characteristics generated by the movement of a spring, and when the first EEG electrode and the second EEG electrode, which are arranged symmetrically at equal intervals on the left and right sides, simultaneously generate the previously stored noise characteristics, by synchronizing the EEG raw data on both sides, a signal pattern having a predetermined matching rate or higher with the previously stored noise characteristic pattern can be detected as noise in both EEG raw data.

Similarly, the device (100) can store noise patterns caused by light emission from the PPG sensor and noise patterns caused by eye movements of the user, respectively.

As with the removal by the spring noise pattern, the device (100) can simultaneously detect and remove a signal pattern having a predetermined coincidence rate with the noise characteristic pattern after synchronizing the stored noise characteristic pattern and the EEG raw data measured from both EEG electrodes.

Meanwhile, in another embodiment, the device (100) may further include third and fourth EEG electrodes. That is, in another embodiment, the device (100) may be a device including four-channel electrodes since it additionally includes third and fourth EEG electrodes in addition to the first and second EEG electrodes (151, 152).

At this time, the third and fourth EEG electrodes may be additionally installed as sensing electrodes to collect the user's bio-data and may be placed at locations corresponding to the user's temporal lobes.

FIG. 9 is an example for explaining the corresponding positions of the third and fourth EEG electrodes included in a device (100) according to another embodiment of the present invention.

Referring to FIG. 9, in another embodiment, the third and fourth EEG electrodes included in the device (100) may be placed at positions corresponding to the first temporal lobe (T3) and the second temporal lobe (T4) on the user's head (10). In yet another embodiment, the third and fourth EEG electrodes included in the device (100) may be placed at positions corresponding to the first ear ground (A1) and the second ear ground (A2) on the user's head (10).

Additionally, in another embodiment, the third and fourth EEG electrodes may further include a micro needle array on their surfaces to increase the measurement accuracy of sensing data.

In addition, in another embodiment, the device (100) may include a first base electrode (153) as a reference electrode and a second base electrode (154) as a ground electrode. Since the contents thereof are the same as those in the above-described embodiment, they are omitted.

A device (100) according to another embodiment can obtain not only EEG data but also left and right brain balance data and auditory data by including additional third and fourth EEG electrodes. In particular, an auditory test based on left and right sounds can be performed using the device (100) according to another embodiment.

Accordingly, based on the device (100) according to various embodiments of the present invention, it is possible to obtain user sensing data including PPG data, left and right brain balance data, and auditory data, rather than simply measuring brain waves, and to provide user-customized biofeedback and/or user-customized content through the obtained user sensing data.

- User Terminal (200: User Terminal)

A user terminal (200) according to an embodiment of the present invention may be a computing device having a mental healthcare application (hereinafter, “application”) installed that provides mental healthcare services.

In detail, from a hardware perspective, the user terminal (200) may include a mobile type computing device and/or a desktop type computing device on which an application is installed.

Here, the mobile type computing device may be a mobile device such as a smart phone or tablet PC on which an application is installed.

For example, mobile type computing devices may include smart phones, mobile phones, digital broadcasting devices, personal digital assistants (PDAs), portable multimedia players (PMPs), tablet PCs, etc.

In addition, desktop type computing devices may include devices installed with programs for executing mental healthcare services based on wired/wireless communication, such as personal computers such as fixed desktop PCs, laptop computers, and ultrabooks on which applications are installed.

Additionally, according to an embodiment, the user terminal (200) may further include a server computing device that provides a mental healthcare service environment.

Figure 10 is an internal block diagram of a user terminal according to an embodiment of the present invention.

Referring to FIG. 10, from a functional perspective, the user terminal (200) may include a storage unit (210), a control unit (220), a communication unit (230), an interface unit (240), an input unit (250), a sensor system (260), and a display system (270). These components may be configured to be included within the housing of the user terminal (200).

In detail, in the storage unit (210), an application (211) is stored, and the application (211) can store one or more of various application programs, data, and commands for providing a mental healthcare service environment.

That is, the storage unit (210) can store commands and data that can be used to create a mental healthcare service environment.

Additionally, the storage unit (210) may include a program area and a data area.

Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the user terminal (200) and functional elements, and the data area may store data generated according to the use of the user terminal (200).

Additionally, the storage unit (210) may include at least one non-transitory computer-readable storage medium and one or more temporary computer-readable storage medium.

For example, the storage (210) may be various storage devices such as ROM, EPROM, flash drive, hard drive, etc., and may include web storage that performs the storage function of the storage (210) on the Internet.

The control unit (220) may include at least one processor capable of executing commands of an application (211) stored in the storage unit (210) to perform various tasks for creating a mental healthcare service environment.

In an embodiment, the control unit (220) can control the overall operation of the components through the application (211) of the storage unit (210) to provide mental healthcare services.

This control unit (220) may be a system on chip (SOC) suitable for a user terminal (200) including a central processing unit (CPU) and/or a graphic processing unit (GPU), and may execute an operating system (OS) and/or application programs stored in a storage unit (210) and control each component loaded in the user terminal (200).

In addition, the control unit (220) can communicate internally with each component via a system bus and can include one or more predetermined bus structures including a local bus.

In addition, the control unit (220) may be implemented by including at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

The communication unit (230) may include one or more devices for communicating with external devices. The communication unit (230) may communicate via a wireless network.

In detail, the communication unit (230) can communicate with a user terminal (200) that stores a content source for implementing a mental healthcare service environment, and can communicate with various user input components such as a controller that receives user input.

In an embodiment, the communication unit (230) can transmit and receive various data related to mental healthcare services to and from other user terminals (200) and/or external servers.

This communication unit (230) can wirelessly transmit and receive data with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI) or short-range communication methods.

The interface unit (240) can connect the user terminal (200) to one or more other devices so that they can communicate with each other. In detail, the interface unit (240) can include wired and/or wireless communication devices that are compatible with one or more different communication protocols.

Through this interface unit (240), the user terminal (200) can be connected to multiple input/output devices.

For example, the interface unit (240) can be connected to an audio output device, such as a headset port or speaker, to output audio.

As an example, the audio output device is described as being connected through the interface unit (240), but an embodiment in which it is installed inside the user terminal (200) may also be included.

Additionally, for example, the interface unit (240) may be connected to an input device such as a keyboard and/or mouse to obtain user input.

This interface unit (240) may be configured to include at least one of a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.

The input unit (250) can detect user input (e.g., gestures, voice commands, button operations, or other types of input) related to mental healthcare services.

In detail, the input unit (250) may include a predetermined button, a touch sensor, and/or an image sensor (261) that receives user motion input.

Additionally, the input unit (250) can be connected to an external controller through the interface unit (240) to receive user input.

The sensor system (260) may include various sensors such as an image sensor (261), a position sensor (IMU, 263), an audio sensor (265), a distance sensor, a proximity sensor, and a contact sensor.

Here, the image sensor (261) can capture images and/or videos of the physical space around the user terminal (200).

In an embodiment, the image sensor (261) can capture and acquire various images and/or videos related to mental healthcare services.

In addition, the image sensor (261) can capture an image by photographing the direction in which it is positioned and located on the front or/and the back of the user terminal (200), and can capture a physical space through a camera positioned toward the outside of the user terminal (200).

The image sensor (261) may include an image sensor device and an image processing module. In detail, the image sensor (261) may process still images or moving images obtained by an image sensor device (e.g., CMOS or CCD).

In addition, the image sensor (261) can process still images or moving images acquired through the image sensor device using an image recognition process (e.g., OCR, etc.) and/or an image processing module to extract necessary information and transmit the extracted information to the processor.

The image sensor (261) may be a camera assembly including at least one camera. The camera assembly may include a general camera that photographs a visible light band, and may further include a special camera such as an infrared camera or a stereo camera.

In addition, the image sensor (261) as described above may be included in the user terminal (200) and operated according to an embodiment, or may be included in an external device (e.g., an external server, etc.) and operated through linkage based on the communication unit (230) and/or interface unit (240) described above.

The position sensor (IMU, 263) can detect at least one of the movement and acceleration of the user terminal (200). For example, it can be formed by a combination of various position sensors such as an accelerometer, a gyroscope, and a magnetometer.

In addition, the position sensor (IMU, 263) can recognize spatial information about the physical space around the user terminal (200) by linking with a position communication unit (230) such as the GPS of the communication unit (230).

The audio sensor (265) can recognize sounds around the user terminal (200).

In detail, the audio sensor (265) may include a microphone capable of detecting a voice input of a user using the user terminal (200).

In an embodiment, the audio sensor (265) can receive voice data required for mental healthcare services from a user.

The display system (270) can output various information related to mental healthcare services as graphic images.

As an example, the display system (270) can display various user interfaces for mental healthcare services.

Such displays may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

The above components may be arranged within the housing of the user terminal (200), and the user interface may include a touch sensor (273) on a display (271) configured to receive user touch input.

In detail, the display system (270) may include a display (271) that outputs an image and a touch sensor (273) that detects a user's touch input.

For example, the display (271) may be implemented as a touch screen by forming a mutual layer structure with the touch sensor (273) or forming an integral structure. Such a touch screen may function as a user input unit that provides an input interface between the user terminal (200) and the user, and at the same time, provide an output interface between the user terminal (200) and the user.

The user terminal (200) including the above-described components can store user sensing data including at least one EEG data, PPG data, left and right brain balance data, auditory data, etc. in the storage unit (210) according to an embodiment.

Meanwhile, according to an embodiment, the user terminal (200) may further perform at least some of the functional operations performed by the service providing server (300) described below.

- Service Providing Server (300: Service Providing Server)

Meanwhile, the service providing server (300) according to an embodiment of the present invention can perform a series of processes for providing mental healthcare services.

In detail, in the embodiment, the service providing server (300) can provide the mental healthcare service by exchanging data necessary to drive the mental healthcare service process with an external device, such as a user terminal (200).

In more detail, in an embodiment, a service providing server (300) may provide an environment in which an application (211) can operate on an external device (in an embodiment, a mobile type computing device and/or a desktop type computing device, etc.).

To this end, the service providing server (300) may include application programs, data and/or commands for the application (211) to operate, and may transmit and receive various data based thereon with the external device.

In addition, in the embodiment, the service providing server (300) can perform various deep learning for mental healthcare services in conjunction with a deep-learning neural network.

Here, the deep learning neural network according to the embodiment may include a convolutional neural network (CNN), an R-CNN (Regions with CNN features), a Fast R-CNN, a Faster R-CNN, a Mask R-CNN, etc., and may include any deep learning neural network that includes an algorithm capable of performing the embodiment described below, and the embodiment of the present invention does not limit or restrict such deep learning neural network itself.

At this time, depending on the embodiment, the deep learning neural network may be installed directly in the service providing server (300) or may operate as a device separate from the service providing server (300) to perform deep learning for the mental healthcare service.

In the following examples, an example is described in which a deep learning neural network is directly installed on a service providing server (300) to perform deep learning.

In addition, in the embodiment, the service providing server (300) can read out a predetermined deep learning neural network driving program constructed to perform the deep learning from the memory and perform the deep learning described below according to the read out predetermined deep learning neural network system.

In addition, in the embodiment, the service providing server (300) can store and manage various application programs, commands, and/or data for implementing mental healthcare services.

As an example, the service providing server (300) can store and manage user sensing data and/or user interface, etc.

However, the functional operations that the service providing server (300) can perform in the embodiment of the present invention are not limited to those described above, and other functional operations can be performed.

Meanwhile, referring further to FIG. 1, the service providing server (300) as described above in the embodiment may be implemented as a computing device including at least one processor module (310: Processor Module) for data processing, at least one communication module (320: Communication Module) for data exchange with an external device, and at least one memory module (330: Memory Module) for storing various application programs, data, and/or commands for providing mental healthcare services.

Here, the memory module (330) can store one or more of an operating system (OS), various application programs, data, and commands for providing mental healthcare services.

Additionally, the memory module (330) may include a program area and a data area.

Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the server and the functional elements, and the data area may store data generated according to the use of the server.

In an embodiment, the memory module (230) may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc., and may also be web storage that performs the storage function of the memory module (330) on the internet.

Additionally, the memory module (330) may be a removable recording medium on the server.

Meanwhile, the processor module (310) can control the overall operation of each unit described above to implement a mental healthcare service.

This processor module (310) may be a system on chip (SOC) suitable for a server including a central processing unit (CPU) and/or a graphics processing unit (GPU), and may execute an operating system (OS) and/or application programs stored in a memory module (330) and control each component mounted on the server.

In addition, the processor module (310) may communicate internally with each component via a system bus and may include one or more predetermined bus structures including a local bus.

Additionally, the processor module (310) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

In the above description, it has been described that the service providing server (300) according to the embodiment of the present invention performs the functional operation as described above. However, depending on the embodiment, at least a part of the functional operation performed by the service providing server (300) may be performed by an external device (e.g., a user terminal (200), etc.), and at least a part of the functional operation performed by the external device may be further performed by the service providing server (300), and various other embodiments may be possible.

- Method for deriving mental indicators based on composite data of EEG and PPG

Hereinafter, a method for deriving a mental index based on composite data of EEG and PPG to provide a mental healthcare service by an application (211) executed by at least one processor of a user terminal (200) according to an embodiment of the present invention is described in detail with reference to the attached FIG. 11.

In an embodiment of the present invention, at least one processor of the user terminal (200) can execute at least one application (211) stored in at least one storage unit (210) or operate it in a background state.

Hereinafter, the method of deriving a mental index based on the composite data of EEG and PPG described above by operating at least one processor to execute a command of the application (211) is briefly described as performed by the application (211).

FIG. 11 is a flowchart illustrating a method for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention.

Referring to Fig. 11, in the embodiment, the user terminal (200) can obtain EEG data and PPG data based on the device (100). (S101)

Here, the composite data according to the embodiment may refer to data encompassing the acquired EEG data and PPG data.

In detail, in the embodiment, the user terminal (200) can obtain EEG data sensed by the brainwave sensor unit (150) equipped in the device (100) and PPG data sensed by the PPG sensor unit (160).

In more detail, in the embodiment, the user terminal (200) can obtain first EEG data sensed by the first EEG electrode (151) included in the brainwave sensor unit (150) of the device (100), second EEG data sensed by the second EEG electrode (152), and PPG data sensed by the PPG sensor unit (160).

At this time, since the first EEG data and the second EEG data have different sensing locations, the sensing values contained in each data may be different. Here, the first EEG data may include a sensing value measured from the user's first frontal lobe (Fp1), and the second EEG data may include a sensing value measured from the user's second frontal lobe (Fp2).

In addition, the first EEG data and the second EEG data may be composed of values sensed by frequency domain (band), such as theta waves, alpha waves, beta waves, gamma waves, and SMR (Sensorimotor Rhythm) (brain waves having a frequency between alpha waves and beta waves).

In addition, in the embodiment, the user terminal (200) may calculate a specific frequency value including SEF50 (Spectral Edge Frequency 50) (a specific frequency value in which the area from the left side of the frequency side to a specific frequency value in a power spectrum graph occupies 50% of the area for the entire frequency range) based on the first EEG data and the second EEG data.

Additionally, the PPG data can be composed of waveform values according to the user's pulse.

Additionally, in the embodiment, the user terminal (200) may calculate a specific value including a ratio of LF (sympathetic frequency) and HF (parasympathetic frequency) and/or HRV (Heart Rate Variability).

In addition, in the embodiment, the user terminal (200) can calculate a basic mental index for the first mental index based on the acquired EEG data. (S103)

Here, mental indicators according to the embodiment may include Attention, Brain Activity, Stress, Mood, Condition, Cognitive, etc.

In addition, the basic mental index according to the embodiment is an index that calculates the value for each mental index described above, and the frequency band and/or formula required for this may be different for each mental index.

For example, the frequency bands required for a concentration mental index may be theta waves, beta waves, and SMR, and the user terminal (200) may match a predetermined formula for deriving a concentration mental index using the corresponding frequency bands.

Similarly, the frequency band required for brain activity mental indicators may be the SEF50 brainwave.

Additionally, the frequency bands required for stress mental indicators can be theta waves, alpha waves (High), beta waves (Low/High), and gamma waves (Low).

Additionally, the frequency band required for mood mental indicators may be alpha waves.

Additionally, the frequency band required in the condition mental index and short-term (long-term) stress mental index may be the sympathetic nerve frequency (LF) and/or parasympathetic nerve frequency (HF) of the HRV (heart rate variability) data derived based on the PPG data.

Additionally, in the embodiment, the user terminal (200) can match the required frequency band and/or formula for each mental indicator.

In the embodiment, the formula for calculating the basic mental index for each mental indicator is expressed as a formula as follows.

[Formula 1]

Attention (Attention_original_score) = ( LN( smAtt ( Left EEG 90s ) ) + LN( smAtt ( Right EEG 90s ) ) ) /2, Attention_score = 50 + 10 x ( m_attention - Attention_original_score ) / sd_attention

[Formula 2]

Brain activity (Activity_original_score) = ( LN( smAct( Left EEG 90s ) ) + LN( smAct( Right EEG 90s ) ) ) /2, Activity_score = 50 + 10 x ( m_activity - Activity_original_score ) / sd_activity

[Formula 3]

Stress(Stress_original_score) = ( LN( smStr( Left EEG 90s ) ) + LN( smStr( Right EEG 90s ) ) ) /2, Stress_score = 50 + 10 x ( m_stress - Stress_original_score ) / sd_stress

[Formula 4]

ShortStr_original_score) = LN( smShortStr( HRV 90s ) ), ShortStr_score = 50 + 10 x ( m_ShortStr - ShortStr_original_score ) / sd_ShortStr

[Formula 5]

Mood (Mood_original_score) = smMood ( Left EEG 90s , Right EEG 90s ), Mood_score = 50 + 10 x ( m_mood - Mood_original_score ) / sd_mood

[Formula 6]

condition (Cond_original_score) = ArcTan ( smCond ( HRV 90s , tau ) ), Cond_score = 50 + 10 x ( m_cond - Cond_original_score ) / sd_cond

That is, in the embodiment, the user terminal (200) can calculate the basic mental index for each mental index based on the plurality of formulas.

In addition, in the embodiment, the user terminal (200) can correct the basic mental index calculated based on the acquired PPG data. (S105)

In detail, in the embodiment, the user terminal (200) can correct the basic mental index for the calculated first mental index according to the value of the acquired PPG data. Hereinafter, the correction of the basic mental index by the user terminal (200) can be referred to as basic correction.

The reason for performing the correction is that, assuming that the first mental index is a stress mental index, the basic mental index is measured high as a result of calculation by substituting the values of the required frequency band in the brain waves, and thus the stress index is determined to be high. However, the stress index is determined to be low as a result of calculation based on the acquired PPG data, and thus confusion may occur in the final determination of the stress index.

To this end, in the embodiment, the user terminal (200) can match the PPG average value to the calculated basic mental index for each mental index.

For example, in the first mental index, the basic mental index may be 100 and the PPG average value matched to it may be 10. In other words, if the basic mental index of the first mental index calculated based on the user's EEG data is 100, it may mean that the PPG data measured on average from users whose basic mental index is 100 is about 10.

That is, in the embodiment, the user terminal (200) can compare the obtained PPG data and the PPG average value matched to the basic mental index of the calculated first mental index.

At this time, in the embodiment, the user terminal (200) can correct the result value by multiplying the basic mental index by a predetermined value based on the comparison result of the matched PPG average value and the acquired PPG data.

In detail, in the embodiment, if the acquired PPG data is equal to or greater than the matched PPG average value, the user terminal (200) can perform a correction to maintain or increase the result value by multiplying the basic mental index by a predetermined value of 1 or greater.

For example, if the acquired PPG data is 12 and the previously matched PPG average is 10, the acquired data is greater than the average, so a correction can be performed to increase the result value by multiplying the basic mental index by 1.2. In this case, the result value of the basic mental index increases as a result, so the stress index can increase further.

Conversely, in the embodiment, if the acquired PPG data is lower than the matched PPG average value, the user terminal (200) can perform a correction to maintain or lower the result value by multiplying the basic mental index by a predetermined value of 1 or lower.

For example, if the acquired PPG data is 8 and the previously matched PPG average is 10, the acquired data is smaller than the average, so a correction can be performed to lower the result value by multiplying the basic mental index by 0.8. In this case, since the result value of the basic mental index is reduced as a result, the stress index can be further reduced.

In addition, in the embodiment, the user terminal (200) can determine the corrected basic mental index as the first mental index for the first mental index. (S107)

At this time, in the embodiment, the mental index may mean the final result value determined for the mental index.

In addition, the mental index according to the embodiment may be expressed as a predetermined value and/or level (e.g., low-normal-high, etc.). In the following, for convenience of explanation, the mental index will be explained based on the fact that it is expressed as a three-classified level of low-normal-high.

To this end, in the embodiment, the user terminal (200) can pre-set a predetermined level for each mental index and pre-allocate a predetermined mental index parameter to each level.

For example, the user terminal (200) may preset mental index parameters for the first mental index, which is the concentration mental index, such that a 'low' level mental index is 100 or less, a 'normal' level mental index is more than 100 and less than 150, and a 'high' level mental index is 150 or more. Accordingly, if the first mental index of the first mental index is determined to be 120, the user's concentration mental index may be determined to be at a 'normal' level.

In addition, in the embodiment, the user terminal (200) can determine the nth mental index for the nth mental index using the same EEG and PPG data. (S109)

In detail, in the embodiment, the user terminal (200) can obtain and determine the nth mental index of multiple nth mental indices other than the first mental index of the first mental index determined with the same EEG and PPG data.

In order to determine a mental index for a concentration mental index according to an embodiment, SMR waves, theta waves, and beta waves can be extracted from brain waves (EEG data). At this time, the higher the concentration, the lower the theta waves and the higher the SMR waves and mid beta waves can appear. Accordingly, by performing correction according to PPG data, the user terminal (200) in the embodiment can determine a mental index for a concentration mental index.

In order to determine a mental index for a brain activity mental index according to an embodiment, SEF50 waves can be extracted from brain waves (EEG data). At this time, the lower the brain activity, the lower the SEF50 brain waves can appear. Accordingly, by performing correction according to PPG data, the user terminal (200) in the embodiment can determine a mental index for a brain activity mental index.

In order to determine a mental index for a stress mental indicator according to an embodiment, (High) alpha waves, (High) beta waves, (Low) beta waves, and (Low) gamma waves can be extracted from brain waves (EEG data), and HRV (heart rate variability) can be extracted from pulse waves (PPG data). At this time, as stress increases, (High) alpha waves may appear lower, (High) beta waves may appear higher, and HRV may appear higher. In this way, the user terminal (200) in the embodiment can determine a mental index for a stress mental indicator.

According to another embodiment, based on a 4-channel electrode mental healthcare device, in order to determine a mental index for a mood mental index, the first and second alpha waves of each of the regions (e.g., F7 and F8) that acquire frontal lobe brain waves may be extracted. At this time, if characteristic anxiety is induced, the asymmetry index of the first and second alpha waves may increase. In detail, the first alpha wave of the right frontal lobe may decrease, and the second alpha wave of the left frontal lobe may increase. In this way, the user terminal (200) in the embodiment may determine a mental index for a mood mental index.

In order to determine a mental index for a condition mental indicator according to an embodiment, HRV can be extracted from PPG data. At this time, the worse the condition, the greater the HRV may appear. In this way, the user terminal (200) in the embodiment can determine a mental index for a condition mental indicator.

In order to determine the mental index for the cognitive mental index according to the embodiment, (Pre) alpha waves and beta waves can be extracted from brain waves (EEG data). At this time, the higher the cognitive impairment, the higher the (Pre) alpha waves and the lower the beta waves.

In the embodiment, the user terminal (200) can determine the cognitive mental index by using only the average value of each preset frequency without performing formula input and correction, unlike the multiple mental indices described above, for the cognitive mental index. In addition, the user terminal (200) in the embodiment can provide a user-customized mental healthcare service including neurofeedback training, thereby providing the user with cognitive ability enhancement exercise.

Accordingly, in the embodiment, the user terminal (200) can generate comprehensive result content including mental indices for all mental indicators of the determined user.

For example, the comprehensive results content may be displayed including text, images, and/or videos containing content such as 'low concentration, low brain activity, high stress'.

In addition, in the embodiment, the user terminal (200) may provide a user-customized mental healthcare service to restore the user's mental health based on the generated comprehensive result content.

For example, the user terminal (200) can provide a user-customized mental healthcare service including meditation music, neurofeedback, etc. to recover from a mental illness of a user with ADHD.

Meanwhile, the above comprehensive result content may include a mental care graph that visualizes the accumulated composite data measured multiple times by the user based on the device (100).

In addition, in the embodiment, the user terminal (200) can change or update the user-customized mental healthcare service provided by reflecting the generated mental care graph.

To this end, in the embodiment, the user terminal (200) can generate a mental care graph, which is a visual content that accumulates and displays mental indicators measured multiple times over a predetermined period of time at preset specific times, and provide service feedback for changing and updating a user-customized mental healthcare service already provided based on the generated mental care graph.

- How to provide service feedback based on accumulated composite data

FIG. 12 is a flowchart illustrating a method for providing service feedback based on accumulated composite data according to an embodiment of the present invention.

Referring to Fig. 12, in the embodiment, the user terminal (200) can obtain the first composite data at the first reference time. (S301)

Here, the first composite data according to the embodiment may include EEG data and PPG data acquired at the first reference time.

These first composite data can be reflected in identifying changes in long-term mental indicators, and a detailed explanation of this will be provided later.

Additionally, the first reference time according to the embodiment may mean a specific time zone set in advance to check a long-term change trend for at least one mental indicator of the user over n days.

This nth reference time can be set as a standard for determining the average range for a specific mental indicator of a user. In other words, it can be a fixed specific time regardless of the execution time of a dynamic mental healthcare program.

In addition, the first reference time may be at least one based on 24 hours a day. In addition, the first reference time may be set at the start time of the day according to the user's daily routine, and the second reference time may be set at the end time of the day. This may be to determine how the mental indicator changes for one day, one week, or one month according to the schedule the user performed during the day.

For example, the first reference time may be 06:00 AM, and the second reference time may be 21:00 PM. In the following, for convenience of explanation, the first reference time is assumed to be set in the morning time zone, and the second reference time is assumed to be set in the evening time zone.

In an embodiment, this first reference time can be preset automatically by the own process and/or manually by user input.

In the embodiment, the user terminal (200) may consider composite data measured within a predetermined time before and after a preset first reference time as being measured at the first reference time.

In addition, in the embodiment, if the user terminal (200) measures the first composite data at the first reference time but does not execute the mental healthcare service after a predetermined time, the composite data may not be reflected in the short-term measurement results and may only be reflected in the long-term measurement results. In the embodiment, the mental healthcare service may include a provided mental healthcare program and may be referred to as a mental healthcare program hereinafter.

Here, the short-term measurement results according to the embodiment may be measurement results for clearly identifying the immediate before and after effects of executing a mental healthcare program based on the user's composite data collected in real time.

In addition, the long-term measurement results according to the embodiment may be measurement results for confirming long-term changes in mental indicators (e.g., stress) that are difficult to immediately identify from the short-term measurement results based on composite data of multiple users accumulated over a long period of time, and for identifying trends of improvement by consistently performing a mental healthcare program over a long period of time.

In other words, in the embodiment, if the user terminal (200) measures the first composite data at the first reference time, the first composite data can be accumulated over several days and reflected in the long-term measurement results.

In addition, in the embodiment, the user terminal (200) can calculate a mental index for the first mental index based on the first composite data. (S303)

In detail, in the embodiment, the user terminal (200) can calculate a mental index (hereinafter, the first mental index) for the first mental index among the nth mental indices calculated for the first composite data using the steps S101 to S107 described above.

At this time, the nth mental index according to the embodiment may include 1) a mental index derived from only EEG data, 2) a mental index derived from only PPG data, and 3) a mental index derived by combining EEG data and PPG data.

For example, 1) mental indicators derived from only EEG data may include concentration, brain activity, stress, and mood mental indicators, and 2) mental indicators derived from only PPG data may include short-term stress and condition mental indicators.

Here, 3) as a mental index derived by combining EEG data and PPG data, a representative example of the mental index is a stress mental index. In the following, for the convenience of explanation, the description is based on the first mental index being a stress mental index.

In an embodiment, the user terminal (200) can perform basic correction that reflects the amount of change in PPG data by a first weight based on EEG data included in the first composite data.

Hereinafter, the new indicator generated by performing the above basic correction may be referred to as mental data.

FIG. 13 is an example of a drawing for explaining mental data according to an embodiment of the present invention.

Referring to FIG. 13, according to an embodiment, a graph (20) of EEG data included in composite data (hereinafter, EEG graph) may have a smaller rate of change than a graph (21) of PPG data (hereinafter, PPG graph) as illustrated.

Therefore, in the embodiment, the user terminal (200) can generate mental data by reflecting the weight of the PPG graph (21) as the first weight based on the EEG graph (20).

That is, the graph (22) of the generated mental data (hereinafter, mental graph) may have a change rate intermediate between that of the EEG graph (20) and the PPG graph (21), as illustrated.

In other words, in the embodiment, the user terminal (200) can generate mental data that performs basic correction to reflect the amount of change in PPG data based on EEG data in the first composite data by the first weight.

The mental data generated above may be EEG data to which basic correction has been applied.

The reason for generating mental data according to the embodiment is that EEG data has the characteristic of changing over a long period of time, and PPG data has the characteristic of changing immediately over a short period of time, so the amount of change in EEG data may be minimal when viewed over a short period of time, but the amount of change in PPG data may be significant, so it may be to reflect the amount of change in PPG data in EEG data. If such mental data is accumulated, it is possible to grasp the change trend of EEG data over a long period of time.

Additionally, in the embodiment, the user terminal (200) can calculate a first mental index for the first mental index using the mental data.

In detail, in the embodiment, the user terminal (200) can calculate the first mental index by substituting the mental data into a formula for calculating the mental index for the first mental index.

In addition, in the embodiment, if the PPG data included in the first composite data is greater than a predetermined value, the user terminal (200) may perform re-measurement or recommend a predetermined mental healthcare program.

That is, through the above-described S303 step, the user terminal (200) in the embodiment can acquire and accumulate composite data at the first and second reference times over several days.

In addition, in the embodiment, the user terminal (200) can execute a mental healthcare program and measure second composite data. (S305)

Here, the mental healthcare program according to the embodiment may be a program provided to improve areas in need of improvement identified based on measured composite data.

For example, a mental healthcare program may include meditation music and neurofeedback (a treatment method that uses brain wave information generated in the brain to train specific brain waves useful for treatment) to help users with ADHD recover from that mental illness.

FIG. 14 is an example of a drawing for explaining n-th composite data measured over time in an embodiment of the present invention.

Referring to FIG. 14, in the embodiment, the user terminal (200) can measure and obtain first composite data at a first reference time (510).

In addition, in the embodiment, the user terminal (200) can measure and obtain second composite data at the time of executing the mental healthcare program (hereinafter, execution time (520)).

In addition, in the embodiment, the user terminal (200) can measure and obtain third composite data at the time of termination of the mental healthcare program (hereinafter, the termination time (530)).

Additionally, in the embodiment, the user terminal (200) can measure and obtain the fourth composite data at the second reference time (540).

In detail, in the embodiment, the user terminal (200) can utilize the first composite data measured at the first reference time (510) and the fourth composite data measured at the second reference time (540) when calculating long-term measurement results.

In addition, in the embodiment, the user terminal (200) can utilize the second composite data measured at the execution time (520) and the third composite data measured at the end time (530) when calculating short-term measurement results.

The reason why the user terminal (200) in the embodiment calculates the short-term measurement results and long-term measurement results separately is that the EEG data included in the composite data does not change immediately but changes gradually over a predetermined period of time, and the PPG data changes immediately, so that the user can determine how much influence the mental healthcare program has had on the user's mental health as the user proceeds with the mental healthcare program multiple times.

To summarize, in the embodiment, the user terminal (200) can obtain composite data a total of four times, including once at the first reference time (510) per day, once each before and after measuring the mental healthcare program (520, 530), and once at the second reference time (540).

In addition, in the embodiment, the user terminal (200) can analyze the change trend of the user's mental indicator by accumulating the first composite data acquired at the first reference time (510) and the fourth composite data acquired at the second reference time (540) among the acquired composite data over multiple days.

Then, the EEG data included in the measured user's composite data can gradually change according to the user's mental state over time.

That is, in the embodiment, the second composite data may be composite data about a user before executing the mental healthcare program.

In this way, in the embodiment, the user terminal (200) can obtain the third composite data at the time of termination of the mental healthcare program (530). (S307)

In the embodiment, the user terminal (200) may perform application correction that reflects the amount of change in PPG data based on the EEG data included in the second and third composite data as much as the second weight. Hereinafter, an index generated by performing the application correction may also be referred to as mental data, similar to the basic correction described above.

In the embodiment, even when the mental healthcare program is executed, the rate of change in the PPG graph (21) can be measured to be greater than the rate of change in the EEG graph (20), as in the case of Fig. 13.

If there is a difference, the rate of change of the PPG graph (21) in the second and third composite data may be greater than the rate of change in the first composite data measured at the first reference time, as it is a rate of change affected by the effect of the mental healthcare program.

Therefore, in the embodiment, the user terminal (200) can generate mental data by reflecting the weight of the PPG graph (21) as the second weight based on the EEG graph (20).

That is, the second weight may be greater than the first weight.

Additionally, the second weight may be set as a default value in the system until composite data measured at the nth reference time is accumulated.

Additionally, in the embodiment, the user terminal (200) can provide short-term measurement results for the mental healthcare program at the end point (530) of the mental healthcare program.

In addition, in the embodiment, the user terminal (200) can obtain the fourth composite data at the second reference time. (S309)

In the embodiment, the user terminal (200) can generate mental data by performing basic correction that reflects the amount of change in PPG data by the first weight based on EEG data included in the fourth composite data, similar to the step S303 described above.

Accordingly, in the embodiment, the user terminal (200) can accumulate and store the nth composite data measured at the nth reference time or measured before and after the mental healthcare program.

In this way, in the embodiment, the user terminal (200) can obtain composite data once a day at the first reference time, once before and after the mental healthcare program is executed, and once at the second reference time. In addition, by obtaining multiple composite data acquired within a day multiple times over n days, composite data for the first mental indicator can be accumulated.

In addition, in the embodiment, the user terminal (200) can accumulate the first to fourth composite data and provide a mental healthcare service according to the change in the first mental indicator. (S311)

In detail, in the embodiment, the user terminal (200) may accumulate the basic corrected first and fourth composite data and the application corrected second and third composite data over multiple days, provide visual content indicating a change in the first mental indicator based on the accumulated nth composite data, and provide a mental healthcare service including providing feedback on a mental healthcare program according to a change in the first mental indicator.

In the embodiment, the user terminal (200) can determine the immediate change rate of the user's first mental indicator according to the performance of the mental healthcare program based on accumulated short-term measurement results.

The above instantaneous rate of change can be determined by accumulating and analyzing the second and third composite data acquired.

In addition, in the embodiment, the user terminal (200) can determine the long-term change rate of the user's first mental indicator according to long-term performance of the mental healthcare program based on accumulated long-term measurement results.

The above long-term change rate can be identified by accumulating and analyzing the first and fourth composite data acquired above.

As a result, in the embodiment, the user terminal (200) can provide a mental healthcare service including visual content indicating changes in the first mental indicator and feedback for adjusting the difficulty level of a mental healthcare program being provided to the user based on accumulated short-term and long-term measurement results. At this time, the visual content can be provided based on short-term measurement results and long-term measurement results, but the mental healthcare program feedback can be provided based only on long-term measurement results.

Figure 15 is an example of visual content that accumulates mental indicators according to an embodiment of the present invention.

Referring to FIG. 15, in the embodiment, the user terminal (200) can accumulate the first mental indicator and provide visual content (CO).

At this time, the visual content (CO) according to the embodiment may include text, images and/or videos that can indicate changes in the user's mental indicators. In the following, for the convenience of explanation, it is described based on the visual content being a graph.

In the embodiment, the user terminal (200) may provide visual content (CO) including daily results and/or cumulative results for the first mental indicator. In the following, for convenience of explanation, it is described based on the user measuring composite data at a standard time every day for one month and proceeding with a mental healthcare program.

Additionally, in the embodiment, the user terminal (200) can provide different graphs (GR) for each mental indicator.

In addition, in the embodiment, the user terminal (200) can display an accumulated result corresponding to a predetermined parameter based on a user input as a graph (GR). At this time, the predetermined parameter may be a month and/or mental indicator set by the user. Taking FIG. 12 as an example, the user selects a first icon (710) corresponding to October and a second icon (720) corresponding to a stress mental indicator, and accordingly, the user terminal (200) can display an accumulated result corresponding to the corresponding parameter as a graph (GR).

At this time, the graph (GR) according to the embodiment may include at least one or more markers. In addition, when a user selects one marker, a value corresponding to the marker may be displayed as a number.

In addition, a mark included in a graph (GR) according to an embodiment may correspond to 1 day. At this time, the mark may be a mental index calculated based on the first composite data first measured at the first reference time during 1 day and/or an average mental index of the composite data measured on the corresponding day.

Returning again, in the embodiment, the user terminal (200) can provide mental healthcare program feedback (hereinafter, “feedback”) according to changes in the first mental indicator.

Here, feedback according to the embodiment can be performed based on at least one of the following methods: 1) changing the type of the provided mental healthcare program, 2) changing the frequency, 3) changing the time required, or 4) changing the difficulty level.

The reason why the user terminal (200) according to the embodiment provides feedback may be to promote improvement in the user's first mental indicator by providing a more suitable program to the user according to the user's characteristics analyzed based on long-term data accumulation, rather than the previously provided program.

To this end, in the embodiment, the user terminal (200) can analyze the accumulated nth composite data to check the change trend of the user's first mental indicator.

In the embodiment, if the change trend of the confirmed first mental indicator is an improvement trend, the user terminal (200) can reduce the frequency of the mental healthcare program, reduce the time required, or lower the difficulty level.

Conversely, in the embodiment, if the change trend of the confirmed first mental indicator is a worsening trend, the user terminal (200) can increase the frequency of the mental healthcare program, increase the required time, or increase the difficulty.

Additionally, in the embodiment, the user terminal (200) can provide different mental healthcare programs according to mental indicators.

For example, in the case of ADHD, where the mental index of the concentration mental index is low, a concentration improvement program can be provided. Also, in the case of polar stress, where the mental index of the stress mental index is high, a stress relief meditation program can be provided.

Accordingly, the user terminal (200) has the effect of enabling not only short-term improvement of mental indicators but also long-term improvement through provision of mental healthcare programs and feedback on various mental indicators.

Above, the mental healthcare device having an electrode contact structure according to an embodiment of the present invention is combined with a band whose length can be adjusted, thereby improving aesthetics and wearing convenience by adjusting the band to fit the size of the user's head.

In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of reducing the error rate due to changes in the measurement environment by simultaneously measuring and obtaining EEG data and PPG data.

In addition, a mental healthcare device having an electrode contact structure according to an embodiment of the present invention has the effect of minimizing the occurrence of noise due to movement of the electrode while increasing the accuracy of EEG data by having a structure for the EEG electrode to be in close contact with the user's body.

Meanwhile, the method and system for deriving mental indicators based on composite data of EEG and PPG according to an embodiment of the present invention are based on a mental healthcare device mounted on the user's head, thereby simultaneously obtaining EEG data and PPG data with a single device without separately wearing a device for measuring brain waves (EEG) and a device for measuring pulse waves (PPG), and the separate data transmission and reception procedure is simplified, thereby greatly increasing physical and procedural efficiency.

In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention calculates the mental index by comprehensively considering PPG data as well as simply calculating the mental index using EEG data by correcting the basic mental index based on PPG data, thereby improving the accuracy of the user's mental index.

In addition, the method and system for deriving mental indices based on composite data of EEG and PPG according to an embodiment of the present invention has the effect of improving the utility of using a mental healthcare device and user satisfaction by deriving multiple mental indices using only one composite data.

In addition, the method and system for deriving a mental index based on composite data of EEG and PPG according to an embodiment of the present invention have the effect of providing a program that immediately stabilizes a user's mental state by identifying a long-term trend of changes in the user's sensing data for one mental index, and furthermore, providing a more effective program in which feedback is applied to more accurately identify the user's mental state by considering the long-term mental changes of the user and further improve the identified mental state of the user.

The embodiments of the present invention described above may be implemented in the form of program commands that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the computer-readable recording medium may be those specially designed and configured for the present invention or those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of the program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The hardware devices may be changed into one or more software modules to perform processing according to the present invention, and vice versa.

The specific implementations described in the present invention are only exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connections or lack of connections of lines between components illustrated in the drawings are merely exemplary of functional connections and/or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, if there is no specific mention such as “essential,” “important,” etc., it may not be a component absolutely necessary for the application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art or having common knowledge in the art that various modifications and changes can be made to the present invention without departing from the spirit and technical scope of the present invention as described in the claims below. Accordingly, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

The present invention has industrial applicability in that it provides a mental healthcare device that includes a structure capable of accurately measuring a user's brain waves by having an electrode contact structure combined with a length-adjustable band, and can simultaneously measure EEG data and PPG data to derive precise mental indicators for the user based on composite data of EEG and PPG.

In addition, the present invention has industrial applicability in that it provides a mental index with improved accuracy based on composite data including EEG data and PPG data by utilizing a healthcare device capable of simultaneously acquiring EEG data and PPG data, and provides a feedback service for further improving the mental state of a user by considering the long-term mental changes of the user by identifying a long-term trend of changes in the user's sensing data related to one mental index.

Claims (10)

A housing including a first body part including a brainwave sensor part and a PPG sensor part, a second body part connected to the first body part and having a first band hole formed at one end opposite the portion connected to the first body part, a third body part connected to the first body part and having a second band hole formed at one end opposite the portion connected to the first body part, and a processor that controls the brainwave sensor part and the PPG sensor part; and A band coupled to the first and second band holes and having an adjustable length; A mental scare device with an electrode contact structure. In the first paragraph, The curvature of the first body part is formed to be greater than the curvatures of the second body part and the third body part, The above housing has an oval-shaped structure with one side open, with the long axis in the normal direction from the PPG sensor unit and the short axis in the left and right directions. A mental healthcare device with an electrode contact structure. In the first paragraph, The above PPG sensor part is placed at the inner center of the first body part, The above brain wave sensor unit includes a first EEG electrode positioned on the left side and a second EEG electrode positioned on the right side based on the PPG sensor unit. A mental healthcare device with an electrode contact structure. In the third paragraph, The first EEG electrode and the second EEG electrode, Protrudes in the inner body direction from the inner body surface of the first body part by a predetermined length, The substrate and spring connected inside the housing above A mental healthcare device with an electrode contact structure. In the fourth paragraph, The first EEG electrode and the second EEG electrode, When worn by a user, the spring is elastic and is pressed toward the substrate included inside the housing of the first body part. The surfaces of the first EEG electrode and the second EEG electrode have a structure that is in close contact with the user's body. A mental healthcare device with an electrode contact structure. In clause 5, The surfaces of the first EEG electrode and the second EEG electrode are formed in a convex structure opposite to the inner body curvature of the first body portion. A mental healthcare device with an electrode contact structure. In the first paragraph, The above PPG sensor part, A light emitting part that outputs light, A glass part for passing the reflected light output from the above light emitting part, Including a light receiving unit that senses the reflected light A mental healthcare device with an electrode contact structure. In Article 7, The above glass part, When worn by a user, it is placed at a location corresponding to the center of the user's forehead. A mental healthcare device with an electrode contact structure. In the first paragraph, The above second body part and the above third body part, When the above band is tightened according to the length adjustment, the first base electrode placed in the second body part and the second base electrode placed in the third body part are structured to rotate inwardly at a predetermined angle so as to be in close contact with the user's head. A mental healthcare device with an electrode contact structure. In the first paragraph, Further comprising a noise detection sensor located inside the housing and connected to the brainwave sensor unit and the PPG sensor unit, The above processor, When noise is detected from the springs connected to the first and second EEG electrodes based on the above noise detection sensor, measurement of EEG data sensed by the brainwave sensor unit and PPG data sensed by the PPG sensor unit is stopped. A mental healthcare device with an electrode contact structure.

Images