[go: up one dir, main page]

WO2024161639A1 - Procédé de traitement d'informations, programme, dispositif de communication - Google Patents

Procédé de traitement d'informations, programme, dispositif de communication Download PDF

Info

Publication number
WO2024161639A1
WO2024161639A1 PCT/JP2023/003626 JP2023003626W WO2024161639A1 WO 2024161639 A1 WO2024161639 A1 WO 2024161639A1 JP 2023003626 W JP2023003626 W JP 2023003626W WO 2024161639 A1 WO2024161639 A1 WO 2024161639A1
Authority
WO
WIPO (PCT)
Prior art keywords
biosignal
feature data
biological signal
similarity
earpiece
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2023/003626
Other languages
English (en)
Japanese (ja)
Inventor
泰彦 今村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vie Inc
Original Assignee
Vie Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vie Inc filed Critical Vie Inc
Priority to PCT/JP2023/003626 priority Critical patent/WO2024161639A1/fr
Priority to JP2024547830A priority patent/JP7573206B1/ja
Publication of WO2024161639A1 publication Critical patent/WO2024161639A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/25—Bioelectric electrodes therefor
    • A61B5/251—Means for maintaining electrode contact with the body
    • A61B5/256—Wearable electrodes, e.g. having straps or bands
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/372—Analysis of electroencephalograms
    • A61B5/374—Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves

Definitions

  • the present invention relates to an information processing method, a program, and a communication device.
  • Patent Document 1 discloses a technology in which wireless earphones worn on the left and right ears transmit biosignals acquired by the sensors to a cradle.
  • the disclosed technology was developed in light of these circumstances, and aims to provide technology that enables a communications terminal to properly synchronize left and right biosignals received from wireless earphones.
  • An information processing method that is one aspect of the disclosed technology is an information processing method executed by a communication device, and executes the following steps: acquire a first biosignal from a first earpiece equipped with a biosensor; acquire a second biosignal from a second earpiece equipped with a biosensor; divide the first biosignal and the second biosignal at predetermined time intervals; determine a similarity between first feature data based on the first biosignal of the divided predetermined section and second feature data based on the second biosignal of a predetermined time shifted in time with respect to the first feature data of the predetermined section; and perform a synchronization process to synchronize the first biosignal and the second biosignal based on the similarity.
  • a program includes a first acquisition step of acquiring a first biosignal from a first earpiece having a biosensor, a second acquisition step of acquiring a second biosignal from a second earpiece having a biosensor, a division step of dividing the first biosignal and the second biosignal at predetermined time intervals, a determination step of determining a similarity between first feature data based on the first biosignal of the divided predetermined interval and second feature data based on the second biosignal of a predetermined interval shifted in time with respect to the first feature data of the predetermined interval, and a synchronization step of synchronizing the first biosignal and the second biosignal based on the similarity.
  • a communication device includes a first acquisition unit that acquires a first biosignal from a first earpiece equipped with a biosensor, a second acquisition unit that acquires a second biosignal from a second earpiece equipped with a biosensor, a division unit that divides the first biosignal and the second biosignal at predetermined time intervals, a determination unit that determines the similarity between first feature data based on the first biosignal of the divided predetermined section and second feature data based on the second biosignal of a predetermined time shifted in time with reference to the first feature data of the predetermined section, and a synchronization unit that synchronizes the first biosignal and the second biosignal based on the similarity.
  • the communication terminal can properly synchronize the left and right biosignals received from the wireless earphones.
  • FIG. 1 is a diagram for explaining an overview of the present embodiment.
  • FIG. 2 is a block diagram showing the configuration of an earpiece according to the present embodiment.
  • FIG. 2 is a diagram showing the external shape of an earpiece according to the present embodiment.
  • 4 is a cross-sectional view showing the IV-IV cross section of the earpiece according to the present embodiment.
  • FIG. 2 is a block diagram showing a configuration of a communication terminal according to the present embodiment.
  • FIG. FIG. 13 is a diagram showing fluctuations in ⁇ waves of subject A.
  • FIG. 2 shows the power spectral density for a given 4 second period when the subject had both eyes closed.
  • FIG. 7 is a diagram showing a matrix of correlation coefficients between EP-L, EP-R, and EP-Diff shown in FIG.
  • FIGS. 11A and 11B are diagrams illustrating examples of a first biological signal and a second biological signal before synchronization processing by a synchronization unit.
  • 11 is a diagram showing an example in which a determination unit determines a similarity between a first envelope and a second envelope;
  • FIG. 11 is a diagram illustrating an example of a synchronization process performed by a synchronization unit.
  • 11 is a flowchart showing an example of processing of a communication terminal M according to the embodiment.
  • 10 is a flowchart relating to a process of a feature data extraction unit according to the present embodiment.
  • FIG. 2 is a diagram illustrating a hardware configuration according to the present embodiment.
  • the earphone 2 includes a first earpiece 2R and a second earpiece 2L.
  • the first earpiece 2R is worn on one ear of the user H.
  • the second earpiece 2L is worn on the other ear of the user H.
  • the first earpiece 2R and the second earpiece 2L are configured to be capable of communicating with a smartphone.
  • the smartphone is an example of a communication terminal M.
  • the earphone 2 includes a first earpiece 2R and a second earpiece 2L.
  • the first earpiece 2R includes, as components, a main sensor 271 (first sensor), a reference sensor 272 (third sensor), a ground sensor 273 (fifth sensor), a first A/D conversion unit 274, and a first transmission unit 275.
  • the main sensor 271 is provided at a position where it can acquire the first biometric information of the user H as an electrical signal. The position of the main sensor 271 will be described later.
  • the main sensor 271 outputs the sensed first biometric information to the first A/D conversion unit 274.
  • the reference sensor 272 is provided at a position where the third biometric information of the user H can be acquired as an electrical signal. The position of the reference sensor 272 will be described later.
  • the reference sensor 272 outputs the sensed third biometric information to the first A/D conversion unit 274.
  • the first biometric information and the third biometric information are, for example, information relating to the brain waves of user H.
  • brain waves include a number of types of frequency bands, such as alpha waves (8-13 Hz), beta waves (14-25 Hz), theta waves (4-7 Hz), delta waves (1-3 Hz), and gamma waves (30 Hz or higher). Therefore, the first biometric information and the third biometric information may include brain waves in a number of frequency bands.
  • the ground sensor 273 is a sensor that acquires ground potential information as an electrical signal. The placement position of the ground sensor 273 will be described later.
  • the ground sensor 273 outputs the sensed ground potential information to the first A/D conversion unit 274.
  • the first A/D conversion unit 274 converts each piece of information from analog information to digital information.
  • the first A/D conversion unit 274 also outputs each piece of converted information to the first transmission unit 275.
  • the first transmission unit 275 transmits the first bioinformation output from the main sensor 271 and the third bioinformation output from the reference sensor 272, which are acquired from the first A/D conversion unit 274, to the communication terminal M.
  • the first transmission unit 275 may also transmit the ground potential information output from the ground sensor 273, which is acquired from the first A/D conversion unit 274, to the communication terminal M.
  • the first transmission unit 275 may generate first difference information, which is the difference between the first bioinformation output from the main sensor 271 and the ground potential information output from the ground sensor 273, which are acquired from the first A/D conversion unit 274, and transmit it to the communication terminal M.
  • the first transmission unit 275 may generate third difference information, which is the difference between the third bioinformation output from the reference sensor 272 and the ground potential information output from the ground sensor 273, which are acquired from the first A/D conversion unit 274, and transmit it to the communication terminal M.
  • the first transmission unit 275 transmits the first biometric information or the first differential information to the communication terminal M on the first channel.
  • the first transmission unit 275 also transmits the third biometric information or the third differential information to the communication terminal M on the third channel.
  • the third channel may be the same channel as the first channel or a different channel.
  • Each of the above biometric information or ground potential information includes information sampled by the first A/D conversion unit 274.
  • the second earpiece 2L includes as its components a main sensor 281 (second sensor), a reference sensor 282 (fourth sensor), a ground sensor 283 (sixth sensor), a second A/D conversion unit 284, and a second transmission unit 285.
  • the main sensor 281 is provided at a position where it can acquire the second biometric information of the user H as an electrical signal. The position of the main sensor 281 will be described later.
  • the main sensor 281 outputs the sensed second biometric information to the second A/D conversion unit 284.
  • the reference sensor 282 is provided at a position where the fourth biometric information of the user H can be acquired as an electrical signal. The position of the reference sensor 282 will be described later.
  • the reference sensor 282 outputs the sensed fourth biometric information to the second A/D conversion unit 284.
  • the second biometric information and the fourth biometric information are, for example, information regarding the brain waves of user H. Like the first biometric information and the third biometric information, the second biometric information and the fourth biometric information may include brain waves in multiple frequency bands.
  • the ground sensor 283 is a sensor that acquires ground potential information as an electrical signal. The placement position of the ground sensor 283 will be described later.
  • the ground sensor 283 outputs the sensed ground potential information to the second A/D conversion unit 284.
  • the second A/D conversion unit 284 converts each piece of information from analog information to digital information.
  • the second A/D conversion unit 284 also outputs each piece of converted information to the second transmission unit 285.
  • the second transmission unit 285 transmits the second bioinformation output from the main sensor 281 and the fourth bioinformation output from the reference sensor 282, which are acquired from the second A/D conversion unit 284, to the communication terminal M.
  • the second transmission unit 285 may also transmit the ground potential information output from the ground sensor 283, which is acquired from the second A/D conversion unit 284, to the communication terminal M.
  • the second transmission unit 285 may generate second difference information, which is the difference between the second bioinformation output from the main sensor 281 and the ground potential information output from the ground sensor 283, which are acquired from the second A/D conversion unit 284, and transmit it to the communication terminal M.
  • the second transmission unit 285 may generate fourth difference information, which is the difference between the fourth bioinformation output from the reference sensor 282 and the ground potential information output from the ground sensor 283, which are acquired from the second A/D conversion unit 284, and transmit it to the communication terminal M.
  • the second transmission unit 285 transmits the second biometric information or the second differential information to the communication terminal M on the second channel.
  • the second transmission unit 285 also transmits the fourth biometric information or the fourth differential information to the communication terminal M on the fourth channel.
  • the fourth channel may be the same channel as the second channel or a different channel.
  • each of the above biometric information or ground potential information includes information sampled by the second A/D conversion unit 284.
  • Figure 3 is a diagram showing the external shape of the earpiece
  • Figure 4 is a cross-sectional view showing the IV-IV section of the earpiece.
  • the first earpiece 2R and the second earpiece 2L have the same basic structure and differ only in the shape suitable for insertion into the left and right ears, so the first earpiece 2R will be used as an example for the description.
  • the first earpiece 2R comprises a housing 21, an ear tip 22, and a wing 23.
  • the housing 21 is a member having a cavity inside, and this cavity contains a speaker 24 and a battery 25.
  • the ear tip 22 is attached to a nozzle 26 that protrudes from the housing 21.
  • the nozzle 26 has a shape like a flange formed on one end of a cylindrical member. Specifically, the nozzle 26 has a cylindrical portion 31 that is positioned in the wearer's ear canal when the first earpiece 2R is attached, a flange portion 32 that is fixed to the housing 21, and a sound guide portion 33 that connects the interiors of the cylindrical portion 31 and the flange portion 32 in the first direction X.
  • the cylindrical portion 31 extends in the first direction X so as to protrude from the housing 21, and a locking protrusion 35 is formed on the tip side of the cylindrical portion 31 for detachably locking the ear tip 22.
  • the flange portion 32 is formed on the base end side of the cylindrical portion 31.
  • the sound guide portion 33 functions as a passage through which sound from the speaker 24 passes.
  • Such a nozzle 26 is formed as a rigid body. As long as it has this characteristic, the material from which the nozzle 26 is formed is not limited, but one example is hard ABS resin.
  • the housing 21 includes a nozzle fixing portion 40 to which the flange portion 32 of the nozzle 26 is fixed, and an expansion portion 42 that extends from the nozzle fixing portion 40 to the opposite side of the nozzle 26 and is larger than the nozzle fixing portion 40.
  • the nozzle fixing portion 40 has an opening 50 through which the tubular portion 31 of the nozzle 26 is inserted, a restricting portion 52 that abuts against the flange portion 32 of the nozzle 26 to restrict the nozzle 26 from falling out of the opening 50, and an enclosing portion 54 that connects the restricting portion 52 and the expansion portion 42 and surrounds the flange portion 32.
  • the nozzle 26 can be fixed to the nozzle fixing portion 40 by, for example, fitting the flange portion 32 into the enclosing portion 54, or by bonding the flange portion 32 to the restricting portion 52 or the enclosing portion 54.
  • the extension section 42 is formed so that it gradually expands as it moves away from the nozzle fixing section 40. Inside the extension section 42, the speaker 24 is housed on the nozzle 26 side, and the battery 25 is housed in an area that is larger than the speaker 24 housing.
  • the extension section 42 also has an opening 60 for wiring at the end 42a where the expansion ends.
  • the speaker 24 and battery 25 are wired and connected to the board 70 through this opening 60.
  • the opening 60 is also used to place the speaker 24 and battery 25 into the housing 21 when assembling the first earpiece 2R.
  • the extension section 42 has an end surface 42b where the extension ends, which is formed as a flat surface.
  • a plate 72 to which a substrate 70 is fixed is placed on the end surface 42b, and a cover 74 that covers the substrate 70 and the plate 72 is attached.
  • the substrate 70 is provided with an antenna for wireless communication.
  • the antenna is compatible with wireless communication standards such as Bluetooth (registered trademark). Therefore, the first earpiece 2R is configured as a wireless earphone, and is wirelessly connected to devices such as mobile terminals and laptops, and communicates data such as sound with these devices.
  • the substrate 70 is provided with a first A/D conversion unit 274 and a first transmission unit 275.
  • the wing 23 comprises an annular attachment portion 80 that fits into the peripheral surface of the cover 74, and an earmuff portion 82 that protrudes from the attachment portion 80.
  • the earmuff portion 82 protrudes from the attachment portion 80 in a roughly U-shape toward the ear tip 22.
  • the earmuff portion 82 mainly functions to hook onto the wearer's outer ear when the first earpiece 2R is worn, and supports the first earpiece 2R to prevent it from falling off the wearer's concha.
  • the wing 23 can be formed from a material that is elastic and flexible, similar to the housing 21.
  • the ear tip 22 is formed of a first member 22A and a second member 22B, both of which are conductive.
  • the first member 22A and the second member 22B are formed of different materials, and each is detachable.
  • the shape of the first member 22A is not limited to the examples shown in Figures 3 and 4, and it is sufficient that the first member 22A has a portion that contacts the inner wall of the wearer's ear canal and that this contact portion is configured to contact the ear canal appropriately. It is also preferable that the surface area of this contact portion is large.
  • the ear tip 22 includes a first member 22A located on the eardrum side and a second member 22B located on the housing 21 side.
  • the first member 22A is made of, for example, conductive rubber, and this conductive rubber contains silver or silver chloride.
  • the conductive rubber contains silver or silver chloride in a predetermined mass percent or more of the conductive material contained in the conductive rubber.
  • the first member 22A may be formed from a silicon material containing a metal-based filler.
  • the first member 22A can be made into a highly conductive material by appropriately mixing metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • the second member 22B is preferably made of an inexpensive non-conductive elastic material (such as silicone rubber).
  • the housing 21 is made of, for example, conductive rubber, which contains silver or silver chloride.
  • the conductive rubber contains silver or silver chloride at a predetermined mass percent or more of the conductive material contained in the conductive rubber.
  • the housing 21 may be formed from a silicon material containing a metal-based filler.
  • the first member 22A can be made into a highly conductive material by appropriately mixing metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • the earmuffs 82 are made of, for example, conductive rubber, which contains silver or silver chloride.
  • the conductive rubber contains silver or silver chloride at a predetermined mass percent or more of the conductive material contained therein.
  • the earmuffs 82 may be made of a silicon material containing a metal-based filler.
  • the first member 22A can be made into a highly conductive material by appropriately mixing metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • metal-based fillers such as silver, copper, gold, aluminum, zinc, and nickel into the silicon material.
  • the first member 22A, the housing 21, and the earmuff 82 of the ear tip 22 are conductive.
  • the first member 22A is used as the main sensor 271
  • the housing 21 is used as the ground sensor 273
  • the earmuff 82 is used as the reference sensor 272, but this example is not limited to this.
  • the conductive material of the housing 21, the conductive material of the first member 22A, and the conductive material of the earmuff 82 may be the same or different.
  • the conductivity of the first member 22A may be higher than the conductivity of the housing 21 and the earmuff 82.
  • the above-mentioned earpiece is an example of the disclosed technology, and the disclosed technology can be applied to at least two biological information measuring devices that can acquire biological information and communicate independently.
  • FIG. 5 is a block diagram showing the configuration of a communication terminal M according to this embodiment.
  • the communication terminal M includes an information processing unit 251 and a storage unit 261.
  • the information processing unit 251 includes, for example, a first acquisition unit 252, a second acquisition unit 253, a division unit 254, a feature data extraction unit 255, a determination unit 259, and a synchronization unit 260.
  • the storage unit 261 stores, for example, a first biosignal 262, a second biosignal 263, a first feature data 264, a second feature data 265, and a correction value 266.
  • the storage unit 261 corresponds to the memory 330 shown in FIG. 13.
  • the first biosignal 262 is a biosignal of the user H acquired from the first earpiece 2R.
  • the first biosignal 262 includes at least one of the first bioinformation, the third bioinformation, the ground potential information, the first difference information, and the third difference information.
  • the second biosignal 263 is a biosignal of the user H acquired from the second earpiece 2L.
  • the second biosignal 263 includes at least one of the second bioinformation, the fourth bioinformation, the ground potential information, the second difference information, and the fourth difference information.
  • the first feature data 264 is feature data related to the first biosignal 262.
  • the first feature data 264 includes, for example, feature data of the time component of the first biosignal 262, or feature data of the frequency component.
  • the first feature data 264 may include at least one of the peak value of the first biosignal 262, the first power spectrum after frequency conversion of the first biosignal 262, the first power spectrum of a predetermined frequency band, and the first envelope based on the first power spectrum.
  • the second feature data 265 is feature data related to the second biosignal 263.
  • the second feature data 265 includes, for example, feature data of the time component of the second biosignal 263, or feature data of the frequency component.
  • the second feature data 265 may include at least one of a peak value, a second power spectrum after frequency conversion of the second biosignal 263, a second power spectrum in a predetermined frequency band, and a second envelope based on the second power spectrum.
  • the correction value 266 is a correction value used when synchronizing the first biosignal 262 and the second biosignal 263.
  • the correction value 266 includes a shift value used to shift at least one of the biosignals, and the details thereof will be described later.
  • the first acquisition unit 252 acquires the first biosignal 262 from the first earpiece 2R.
  • the first acquisition unit 252 acquires the first biosignal 262 from the communication terminal M by communication using Bluetooth (registered trademark).
  • Communication using Bluetooth is realized by the network communication interface 320 shown in FIG. 14.
  • the second acquisition unit 253 acquires the second biosignal 263 from the second earpiece 2L.
  • the second acquisition unit 253 acquires the second biosignal 263 from the communication terminal M by communication using Bluetooth (registered trademark).
  • the division unit 254 divides the biosignal acquired sequentially by the first acquisition unit 252 or the second acquisition unit 253 into a predetermined time interval. For example, if the predetermined time is 10 seconds, the division unit 254 divides the biosignal acquired sequentially by the first acquisition unit 252 or the second acquisition unit 253 into 10-second intervals.
  • the predetermined time interval for division can be set arbitrarily.
  • the determination unit 259 determines the similarity between first feature data 264 based on the first biosignal 262 of a divided predetermined time (also called a predetermined section) and second feature data 265 based on the second biosignal 263 of a predetermined time shifted in time with reference to the first feature data of the predetermined section.
  • a divided predetermined time also called a predetermined section
  • second feature data 265 based on the second biosignal 263 of a predetermined time shifted in time with reference to the first feature data of the predetermined section.
  • An example of the processing by the determination unit 259 will be described later using Figures 9 and 10.
  • the predetermined section is shifted by a set time from -2 seconds to +2 seconds.
  • the synchronization unit 260 synchronizes the first biosignal 262 and the second biosignal 263 based on the similarity between the first feature data 264 and the second feature data 265 determined by the determination unit 259. For example, the synchronization unit 260 uses a time shift amount (correction value) between the first biosignal 262 and the second biosignal 263, which is calculated from the point in time when the correlation value, which is one of the indices of similarity determined by the determination unit 259, is highest, to shift one of the biosignals in time by the correction value, thereby synchronizing the first biosignal 262 and the second biosignal 263. In this way, the left and right biosignals received by the communication terminal M from the earpieces can be appropriately synchronized.
  • the communication terminal M may include a feature data extraction unit 255.
  • the feature data extraction unit 255 extracts first feature data 264 and second feature data 265 from the first biosignal 262 and the second biosignal 263, respectively.
  • the feature data extraction unit 255 may include, for example, a frequency conversion unit 256.
  • the frequency conversion unit 256 performs frequency conversion on the first biosignal 262 and the second biosignal 263.
  • the frequency conversion unit 256 applies FFT (Fast Fourier Transform) processing, wavelet transformation, etc. to the first biosignal 262 and the second biosignal 263, which include brain waves in multiple frequency bands such as alpha waves, beta waves, theta waves, delta waves, and gamma waves, to calculate frequency components (e.g., power spectrum).
  • FFT Fast Fourier Transform
  • the determination unit 259 may determine the similarity between a first power spectrum after frequency conversion of the first biological signal 262 included in the first feature data 264 and a second power spectrum after frequency conversion of the second biological signal 263 included in the second feature data 265.
  • the determination unit 259 may determine, for example, the similarity between the first power spectrum of a predetermined interval of frequency components and the second power spectrum of a predetermined interval of frequency components shifted by a set time. As described above, by using frequency components in which features are likely to appear as feature data, it is possible to easily determine the similarity.
  • the feature data extraction unit 255 may further include, for example, a frequency band extraction unit 257.
  • the frequency band extraction unit 257 extracts a predetermined frequency band after frequency conversion.
  • the frequency band extraction unit 257 applies a band pass filter to the frequency components calculated by the frequency conversion unit 256 to extract the power spectrum of alpha waves.
  • the determination unit 259 may determine the similarity using a first power spectrum of a predetermined frequency band among the frequency components for a predetermined section, and a second power spectrum of a predetermined frequency band among the frequency components for a predetermined section shifted by a set time.
  • the determination unit 259 may determine the similarity between the first power spectrum of alpha waves and the second power spectrum of alpha waves, for example. As a result, it is possible to set a predetermined frequency band in which a wavy shape that can be used as a feature is likely to be formed, and determine the similarity based on the power spectrum of this predetermined frequency band.
  • the feature data extraction unit 255 may further include, for example, an envelope calculation unit 258.
  • the envelope calculation unit 258 calculates a first envelope based on the first power spectrum and a second envelope based on the second power spectrum.
  • the envelope calculation unit 258 may, for example, apply a Hilbert transform to the first power spectrum and the second power spectrum of a plurality of frequency bands to calculate the first envelope and the second envelope.
  • the envelope calculation unit 258 may also apply a Hilbert transform to the first power spectrum and the second power spectrum of a predetermined frequency band to calculate the first envelope and the second envelope.
  • the envelope calculation unit 258 applies a Hilbert transform to the first power spectrum of ⁇ waves and the second power spectrum of ⁇ waves to calculate the first envelope and the second envelope. By performing the Hilbert transform, it is possible to calculate the first envelope and the second envelope that are not dependent on the difference in power values of the first power spectrum and the second power spectrum.
  • the determination unit 259 may determine the similarity between the first envelope included in the first feature data 264 for a specified section and the second envelope included in the second feature data 265 for a specified section shifted by a set time. For example, the determination unit 259 may determine, for each specified section, the time at which the correlation value between the first envelope and the second envelope shifted by the set time is highest. As described above, by using an envelope that is not dependent on the difference in power values between the left and right as feature data, a more appropriate determination of similarity can be made.
  • the above-mentioned determination unit 259 may determine the similarity between the first feature data based on the first biosignal of the divided predetermined section and the second feature data based on the second biosignal of a predetermined time shifted in sequence with respect to the predetermined section of the first feature data. For example, when the division unit 254 divides the first biosignal 262 and the second biosignal 263 at 10-second intervals, the determination unit 259 shifts the second biosignal 263 of 10 seconds corresponding to the first biosignal 262 of the predetermined section in time with respect to the first biosignal 262 of the predetermined section.
  • the determination unit 259 calculates a correlation value between the first feature data 264 of the first biosignal 262 of the predetermined section and the second feature data 265 of the section in which the second biosignal 263 is shifted in time.
  • an objective correlation value is used as the similarity between the first feature data 264 and the second feature data 265, so that the accuracy of similarity determination can be improved and the synchronization process between the first biosignal and the second biosignal can be more appropriately performed.
  • the above-mentioned determination unit 259 may calculate the similarity between the amplitude value indicating the first feature data 264 and the amplitude value indicating the second feature data 265.
  • the determination unit 259 may calculate the similarity between the amplitude value of the first power spectrum in a predetermined section and the amplitude value of the second power spectrum in a predetermined section shifted by a set time. This makes it possible to calculate the similarity using the amplitude value, making it easier to determine the similarity and reducing the processing load, thereby enabling synchronization processing between the first biosignal 262 and the second biosignal 263.
  • the subject's electroencephalogram signals as reference values are acquired using an electroencephalogram meter, Polymate Mini (registered trademark), manufactured by Miyuki Giken Co., Ltd.
  • the subject's electroencephalogram signals are acquired from both ears using earpieces similar to the first earpiece 2R and the second earpiece 2L.
  • Electrodes were attached to the subject's head at T7 (left middle temporal region), Cz (median center), and T8 (right middle temporal region) according to the International 10/20 method using the above-mentioned electroencephalograph, and the above-mentioned earpieces were attached to the subject's left and right ears.
  • the subject repeatedly opened and closed both eyes every 15 seconds, and electroencephalogram signals were obtained from the above-mentioned electroencephalograph and earpieces for at least 120 seconds (4 cycles, assuming that opening and closing is one cycle).
  • Each electroencephalogram signal acquired by the electroencephalogram meter and the electroencephalogram signal acquired by the left earpiece are transmitted to a first personal computer.
  • the electroencephalogram signal acquired by the right earpiece is transmitted to a second personal computer different from the first personal computer.
  • the second personal computer transmits the electroencephalogram signal received from the right earpiece to the first personal computer.
  • the first personal computer executes the above-mentioned synchronization process for each electroencephalogram signal.
  • the first personal computer generates a difference signal between the electroencephalogram signal acquired by the left earpiece and the electroencephalogram signal acquired by the right earpiece after the synchronization process.
  • frequency conversion and a bandpass filter are applied to each electroencephalogram signal including the difference signal, the left and right electroencephalogram signals, and the electroencephalogram signal acquired by the electroencephalogram meter, and the power spectrum of alpha waves is extracted.
  • the indices used to evaluate the similarity of each extracted EEG signal were the alpha wave power obtained from the left ear EEG signal, the alpha wave power obtained from the right ear EEG signal, and the correlation coefficients (correlation values) between the alpha wave power of the differential signal between the left ear EEG signal and the right ear EEG signal, and the alpha wave power obtained from the EEG meter.
  • FIG. 6 is a diagram showing the fluctuation of the power of alpha waves of subject A.
  • FIG. 6 is a diagram showing the 4-second time window for each of the electroencephalogram signals acquired by the electroencephalograph and the earpiece after the above-mentioned synchronization processing, in which the 4-second time window is slid by 0.5 seconds, and the power of the alpha waves is calculated and plotted in chronological order by applying frequency conversion and bandpass filtering to the electroencephalogram signals of each time window.
  • the power shown in FIG. 6 indicates the peak value of the power of the alpha waves.
  • EP-L, EP-R, and EP-Diff respectively represent the power of the alpha waves obtained from the electroencephalogram signal of the left ear, the power of the alpha waves obtained from the electroencephalogram signal of the right ear, and the power of the alpha waves of the difference signal between the electroencephalogram signal of the left ear and the electroencephalogram signal of the right ear.
  • EP-Diff is the difference signal after the synchronization processing between the electroencephalogram signal of the left ear and the electroencephalogram signal of the right ear.
  • PM-T7, PM-Cz, and PM-T8 represent the alpha wave power obtained from the electroencephalographs attached to T7, Cz, and T8, respectively.
  • each EEG signal tends to decrease when the subject has both eyes open, and tends to increase when both eyes are closed.
  • Alpha waves are said to occur in a relaxed state, and it is believed that by relaxing with the eyes closed, more alpha waves are generated than when the eyes are open. This means that each EEG signal can be said to be appropriately extracted from each device.
  • Figure 7 shows the power spectral density for a given 4-second period when the subject had both eyes closed.
  • EP-L, EP-R, and EP-Diff in Figure 7 respectively represent the power spectral density of the EEG signal at the left ear, the power spectral density of the EEG signal at the right ear, and the power spectral density of the differential signal between the EEG signals at the left and right ears.
  • PM-T7, PM-Cz, and PM-T8 respectively represent the power spectral density of the EEG signal obtained from the EEG monitors attached to T7, Cz, and T8.
  • the power spectral density of alpha waves which is in the 8-13 Hz frequency band, peaks at around 10 Hz for both EEG signals.
  • both the EEG and earpieces can adequately extract the characteristics of the subject's brain state (e.g., alpha waves). It can also be said that the earpieces can extract the peak value of alpha waves in the same way as the EEG.
  • Figure 8 shows the matrix of correlation coefficients between EP-L, EP-R, and EP-Diff shown in Figure 6 and PM-T7, PM-Cz, and PM-T8.
  • an electroencephalograph acquires EEG signals from the scalp at a specified position on the head, whereas an earpiece acquires EEG signals from the ear. In other words, the acquisition position of the EEG signal is different for each device.
  • This experiment was conducted under the assumption that the EEG signals acquired by the electroencephalograph and those acquired from the earpiece will not have exactly the same waveforms due to differences in the acquisition position of the EEG signal and differences in the acquisition device. Therefore, in this experiment, if the correlation coefficient is 0.3 or more, it can be evaluated that the similarity between the power value of the alpha waves acquired by the electroencephalograph and the power value of the alpha waves acquired from the earpiece is high.
  • FIG. 9 is a diagram showing an example of the first biological signal 262 and the second biological signal 263 before synchronization processing by the synchronization unit 260.
  • the solid line R represents the electroencephalogram signal itself for a given 1 second acquired from the first earpiece 2R
  • the dashed line L represents the electroencephalogram signal itself for 1 second acquired from the second earpiece 2L in the same time period.
  • FIG. 10 is a diagram showing an example in which the determination unit 259 determines the similarity between the first envelope of the first biosignal 262 shown in FIG. 9 and the second envelope of the second biosignal 263.
  • the determination unit 259 calculates the correlation value between the first envelope and each of the second envelopes of the second biosignal 263 for 1 second, which are shifted by 1 data point (e.g., 1/600 second) from -2.5 seconds to +2.5 seconds based on the first envelope, and displays a graph showing the fluctuation of the correlation value.
  • the correlation value becomes highest by shifting the second biosignal 263 forward in time by 254 data points.
  • FIG. 11 is a diagram showing an example of synchronization processing by the synchronization unit 260.
  • the synchronization unit 260 shifts the one-second EEG signal acquired from the second earpiece 2L forward in time by 254 data points in accordance with the highest correlation value among the correlation values calculated by the determination unit 259. This makes it possible to synchronize the one-second EEG signal acquired from the first earpiece 2R with the one-second EEG signal acquired from the second earpiece 2L during the same time period.
  • Fig. 12 is a flowchart showing an example of a process of the communication terminal M according to the embodiment.
  • step S11 the first acquisition unit 252 acquires a first biosignal 262 from the first earpiece 2R that is equipped with a biosensor.
  • step S12 the second acquisition unit 253 acquires a second biosignal 263 from the second earpiece 2L that is equipped with a biosensor.
  • step S13 when a predetermined time has elapsed since acquiring the first biosignal 262 or the second biosignal 263, the division unit 254 divides the first biosignal 262 and the second biosignal 263 at predetermined time intervals.
  • step S14 the feature data extraction unit 255 extracts first feature data 264 based on the first biosignal 262 of the divided specific section and second feature data 265 based on the second biosignal 263 of the divided specific section.
  • step S15 the determination unit 259 determines the similarity between the first feature data 264 based on the first biosignal 262 of the divided specified section and the second feature data 265 based on the second biosignal 263 of a specified time shifted in time with respect to the specified section.
  • step S16 the synchronization unit 260 synchronizes the first biosignal 262 and the second biosignal 263 based on the similarity.
  • FIG. 13 is a flowchart relating to the processing of the feature data extraction unit 255 according to this embodiment.
  • the frequency conversion unit 256 performs frequency conversion into a first biosignal 262 and a second biosignal 263.
  • step S22 the frequency band extraction unit 257 extracts a predetermined frequency band after frequency conversion.
  • step S23 the envelope calculation unit 258 applies the Hilbert transform to the first power spectrum to calculate the first envelope, and applies the Hilbert transform to the second power spectrum to calculate the second envelope.
  • step S15 shown in FIG. 12 the similarity is determined using each envelope as feature data.
  • the feature data extraction unit 255 may include only the frequency conversion unit 256 and the envelope calculation unit 258, and may not include the frequency band extraction unit 257.
  • the envelope calculation unit 258 calculates the first envelope and the second envelope based on the first power spectrum and the second power spectrum of the frequency components calculated by the frequency conversion unit 256.
  • the envelope calculation unit 258 calculates the first envelope and the second envelope by applying a Hilbert transform to the first power spectrum and the second power spectrum of the frequency components including multiple frequency bands such as alpha waves, beta waves, theta waves, delta waves, and gamma waves calculated by the frequency conversion unit 256, for example.
  • examples of the characteristic data of the biosignal include the peak value of the biosignal, the power spectrum after frequency conversion of the biosignal, the power spectrum of a specific frequency band, and an envelope based on the power spectrum, but the present invention is not limited to these.
  • Characteristic noise contained in the biosignal may also be used as the characteristic data of the biosignal. By aligning the position where this noise occurs, it is possible to synchronize at least two biosignals.
  • the frequency band extraction unit 257 extracts the power spectrum of alpha waves, but this is not limiting.
  • the frequency band extraction unit 257 may extract the power spectrum of frequency bands other than alpha waves, such as beta waves, theta waves, delta waves, and gamma waves.
  • the synchronization unit 260 described above may apply the correction value 266 used in the synchronization process for a specific section to another section to perform the synchronization process.
  • the synchronization unit 260 may apply the correction value 266 used in the synchronization process for a certain section to the synchronization process for a subsequent predetermined section. This makes it possible to omit processes such as extraction of feature data and determination of similarity for the predetermined section, thereby reducing the processing load of the synchronization process. When the predetermined section has elapsed, extraction of feature data, etc. is performed again.
  • the communication terminal M may be provided with a post-processing unit that executes a predetermined process on the first biosignal 262 and the second biosignal 263 after the synchronization process.
  • the post-processing unit may, for example, calculate a differential signal between the first biosignal 262 and the second biosignal 263. This makes it possible to cancel out common noise contained in the first biosignal 262 and the second biosignal 263, and obtain a biosignal of good quality.
  • the post-processing unit may also perform cross-reference processing to increase the signal components or increase the potential difference by performing cross-processing such as processing the first bioinformation and the fourth bioinformation as the main bioinformation and the reference bioinformation, respectively, and processing the second bioinformation and the third bioinformation as the main bioinformation and the reference bioinformation, respectively.
  • the post-processing unit may also extract brain waves of a predetermined frequency band from the biosignal after synchronization processing, for example.
  • the post-processing unit can check, for example, whether user H is in a relaxed state by extracting alpha waves.
  • the post-processing unit can check, for example, whether user H is in an irritated state by extracting beta waves.
  • the post-processing unit can check, for example, whether user H is in a light sleep state by extracting theta waves.
  • the post-processing unit can check, for example, whether user H is in a deep sleep state by extracting delta waves.
  • the post-processing unit can check, for example, whether user H is in a focused state by extracting gamma waves.
  • the post-processing unit may extract a frequency band different from the predetermined frequency band used when extracting feature data, depending on the user's settings, etc.
  • the communication terminal M is configured by an information processing device, and is, for example, a mobile terminal (such as a smartphone), a computer, a tablet terminal, etc.
  • the communication terminal M is also referred to as a communication terminal 300.
  • the communication terminal 300 includes one or more processors (e.g., CPUs) 310, one or more network communication interfaces 320, memory 330, a user interface 350, and one or more communication buses 370 for interconnecting these components.
  • processors e.g., CPUs
  • the user interface 350 includes a display 351 and an input device (such as a keyboard and/or a mouse or some other pointing device) 352.
  • the user interface 350 may also be a touch panel.
  • Memory 330 may be, for example, a high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid-state storage device, or may be non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • a high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid-state storage device
  • non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.
  • memory 330 examples include one or more storage devices located remotely from processor 310. In one embodiment, memory 330 stores the following programs, modules, and data structures, or a subset thereof. Memory 330 may also be a computer-readable non-transitory storage medium.
  • the one or more processors 310 read and execute a program from the memory 330 as necessary. For example, the one or more processors 310 execute a program stored in the memory 330 to perform the processing of the information processing unit 251.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

Selon la présente invention, un procédé de traitement d'informations qui doit être exécuté par un dispositif de communication consiste à acquérir un premier biosignal à partir d'un premier écouteur qui comprend un biocapteur, à acquérir un second biosignal à partir d'un second écouteur qui comprend un biocapteur, à diviser le premier biosignal et le second biosignal d'une période de temps prédéterminée, à déterminer la similarité entre des premières données de caractéristique qui sont basées sur une section prédéterminée du premier biosignal divisé et des secondes données de caractéristique qui sont basées sur le second biosignal pendant la période de temps prédéterminée telle que décalée séquentiellement dans le temps par rapport à la section prédéterminée, et à effectuer un traitement de synchronisation qui synchronise le premier biosignal et le second biosignal sur la base de la similarité.
PCT/JP2023/003626 2023-02-03 2023-02-03 Procédé de traitement d'informations, programme, dispositif de communication Ceased WO2024161639A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2023/003626 WO2024161639A1 (fr) 2023-02-03 2023-02-03 Procédé de traitement d'informations, programme, dispositif de communication
JP2024547830A JP7573206B1 (ja) 2023-02-03 2023-02-03 情報処理方法、プログラム、通信装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2023/003626 WO2024161639A1 (fr) 2023-02-03 2023-02-03 Procédé de traitement d'informations, programme, dispositif de communication

Publications (1)

Publication Number Publication Date
WO2024161639A1 true WO2024161639A1 (fr) 2024-08-08

Family

ID=92146013

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/003626 Ceased WO2024161639A1 (fr) 2023-02-03 2023-02-03 Procédé de traitement d'informations, programme, dispositif de communication

Country Status (2)

Country Link
JP (1) JP7573206B1 (fr)
WO (1) WO2024161639A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014507992A (ja) * 2011-02-09 2014-04-03 オルサン メディカル テクノロジーズ リミテッド 脳血液動態状態を監視するための装置および方法
JP2018068511A (ja) * 2016-10-26 2018-05-10 株式会社日本総合研究所 刺激付与装置及びプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014507992A (ja) * 2011-02-09 2014-04-03 オルサン メディカル テクノロジーズ リミテッド 脳血液動態状態を監視するための装置および方法
JP2018068511A (ja) * 2016-10-26 2018-05-10 株式会社日本総合研究所 刺激付与装置及びプログラム

Also Published As

Publication number Publication date
JP7573206B1 (ja) 2024-10-25
JPWO2024161639A1 (fr) 2024-08-08

Similar Documents

Publication Publication Date Title
US11583215B2 (en) Generic ear device with electrodes
EP2229882B1 (fr) Unité adapté au canal oriculaire et appareil de mesure d'un signal biologique
CN101933805B (zh) 耳廓安装设备和生物信号测量装置
EP2717597B1 (fr) Dispositif d'aide auditive avec un traitement audio dépendant des ondes cérébrales
US20110004089A1 (en) Ear-worn eeg monitoring device
Pisha et al. A wearable, extensible, open-source platform for hearing healthcare research
WO2019241645A1 (fr) Dispositif de surveillance des activités de vie quotidienne et des paramètres physiologiques pour déterminer un état et un diagnostic du cerveau et du corps humains
US20220015703A1 (en) Modular auricular sensing system
US20240122526A1 (en) Minimal material ear sensor system
Guermandi et al. A wireless system for EEG acquisition and processing in an earbud form factor with 600 hours battery lifetime
JP7573206B1 (ja) 情報処理方法、プログラム、通信装置
US12419577B2 (en) Multi-body earpiece
AU2020401575A1 (en) In-ear and around-the-ear electroencephalography system with floating electrodes and method thereof
JP2019201995A (ja) 生体信号取得用電極及び生体信号測定システム
JP2024035728A (ja) 生体情報計測装置
US20240342431A1 (en) Wearable dual-function eeg integrated bone conduction audio device
JP2025087937A (ja) ヘッドセット
US12490918B2 (en) Spectro-temporal modulation test unit
Lam et al. Wireless And Portable Daily Soundscape Monitoring System For Auditory Profiling: Diagnostic Tool For Alzheimer’s Disease
KR20250071864A (ko) 웨어러블 뇌파 수집 장치 및 웨어러블 뇌파 수집 장치의 뇌파 수집 방법
CN120857024A (zh) 基于耳机形态的耳道多模态声信号采集装置及方法
CN120051244A (zh) 心率推定装置以及耳机系统
Paul In-Ear Electrophysiology for Unobtrusive Auditory Brain-Machine Interfaces
WO2023062669A1 (fr) Écouteurs et dispositif de mesure d'informations biométriques

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2024547830

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23919776

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE