[go: up one dir, main page]

WO2024263156A1 - Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable - Google Patents

Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable Download PDF

Info

Publication number
WO2024263156A1
WO2024263156A1 PCT/US2023/025720 US2023025720W WO2024263156A1 WO 2024263156 A1 WO2024263156 A1 WO 2024263156A1 US 2023025720 W US2023025720 W US 2023025720W WO 2024263156 A1 WO2024263156 A1 WO 2024263156A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
computing device
wearable computing
data
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/US2023/025720
Other languages
English (en)
Inventor
Lindsey Michelle Sunden
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to PCT/US2023/025720 priority Critical patent/WO2024263156A1/fr
Publication of WO2024263156A1 publication Critical patent/WO2024263156A1/fr
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
    • A61B5/053—Measuring electrical impedance or conductance of a portion of the body
    • A61B5/0531—Measuring skin impedance
    • A61B5/0533—Measuring galvanic skin response
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1123—Discriminating type of movement, e.g. walking or running
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0219—Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A61B5/02405—Determining heart rate variability
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/681—Wristwatch-type devices

Definitions

  • the present disclosure relates generally to wearable computing devices, and more particularly, to passive tracking of low-inertia exercises using multimodal sensor inputs of a wearable computing device.
  • biometric monitoring devices such as fitness trackers and smart watches, are able to determine information relating to the pulse or motion of a person wearing the device.
  • Certain biometric monitoring devices include a variety of sensors for measuring multiple biological parameters that can be beneficial to a user of the device, such as a heart rate sensor, multi-purpose electrical sensors compatible with electrocardiogram (ECG) and electrodermal activity (EDA) applications, infrared sensors, a gyroscope, an altimeter, an accelerometer, a temperature sensor, an ambient light sensor, Wi-Fi, GPS, a vibration sensor, a speaker, and a microphone, among others.
  • ECG electrocardiogram
  • EDA electrodermal activity
  • High inertial data generally includes high cardio activities, such as running, walking, swimming, stair climbing jumping rope, hiking, boxing, rowing, jumping jacks, etc.
  • high cardio activities such as running, walking, swimming, stair climbing jumping rope, hiking, boxing, rowing, jumping jacks, etc.
  • low-inertia activities such as yoga, Pilates, weightlifting, spinning, strength training, etc.
  • AHA American Heart Association
  • the present disclosure is directed to a method of passively tracking low-inertia exercises of a user of a wearable computing device.
  • the method includes receiving, via a processor communicatively coupled to the wearable computing device, a plurality of time-series data inputs from a plurality of biometric sensor electrodes of the wearable computing device.
  • the plurality of time-series data includes continuous electrodermal activity (cEDA) data of the user and at least one additional biometric parameter of the user.
  • the method also includes processing, via the processor, the plurality of time-series data inputs using at least one computer- implemented model. Further, the method includes determining, via the processor, an indicator of a physiological response of the user using the at least one computer- implemented model.
  • the method includes passively tracking, via the processor, the physiological response of the user when the indicator of the physiological response indicates a low-inertia exercise activity is being performed by the user.
  • the present disclosure is directed to a wearable computing device that includes an electronic display, a plurality of biometric sensor electrodes for sensing a plurality of time-senes data inputs relating to biometrics of a user of the wearable computing device, and at least one processor communicatively coupled to the plurality of biometric sensor electrodes.
  • the processor(s) is configured to perform a plurality of operations, including but not limited to receiving a plurality of time-series data inputs from a plurality of biometric sensor electrodes of the wearable computing device, the plurality of time-series data including continuous electrodermal activity (cEDA) data of the user and at least one additional biometric parameter of the user, processing the plurality of time-series data inputs using at least one computer-implemented model programmed in the at least one processor, determining an indicator of a physiological response of the user using the at least one computer-implemented model, and passively tracking the physiological response of the user when the indicator of the physiological response indicates a low-inertia exercise activity is being performed by the user.
  • cEDA continuous electrodermal activity
  • the present disclosure is directed to a method of passively tracking low-inertia exercises of a user of a wearable computing device.
  • the method includes receiving, via a processor communicatively coupled to the wearable computing device, a plurality of time-series data inputs from a plurality of biometric sensor electrodes of the wearable computing device.
  • the plurality of timeseries data includes continuous electrodermal activity (cEDA) data of the user and at least one additional biometric parameter of the user.
  • the method also includes determining, via the processor, a type of low-inertia exercise activity being performed by the user based, at least in part, on the plurality of time-series data inputs using at least one computer-implemented model. Further, the method includes automatically tracking, via the processor, the low-inertia exercise activity of the user.
  • FIG. 1 provides a graphical representation of electrodermal activity (EDA) amplitude (y-axis) versus time (x-axis) according to one embodiment of the present disclosure
  • FIG. 2 provides a perspective view of a wearable computing device on a wrist of a user according to one embodiment of the present disclosure
  • FIG. 3 provides a front perspective view of a wearable computing device according to one embodiment of the present disclosure
  • FIG. 4 provides a rear perspective view of the wearable computing device of FIG. 3;
  • FIG. 5 provides an exploded view of the display of the wearable computing device of FIG. 3;
  • FIG. 6 provides a schematic diagram of an example set of devices that are able to communicate according to one embodiment of the present disclosure
  • FIG. 7 illustrates various controller components of an example system that can be utilized according to one embodiment of the present disclosure
  • FIG. 8 illustrates a flow diagram of an embodiment of a method of passively tracking low-inertia exercises of a user of a wearable computing device according to the present disclosure
  • FIG. 9 illustrates a schematic diagram of an embodiment of a system for passively tracking low-mertia exercises of a user of a wearable computing device according to the present disclosure.
  • FIG. 10 illustrates a flow diagram of another embodiment of a method of passively tracking low-inertia exercises of a user of a wearable computing device according to the present disclosure.
  • biometric monitoring devices such as fitness trackers and smart watches, are able to determine information relating to the pulse or motion of a person wearing the device.
  • Certain biometric monitoring devices include a variety of sensors for measuring multiple biological parameters that can be beneficial to a user of the device, such as a heart rate sensor, multi-purpose electrical sensors compatible with electrocardiogram (ECG) and electrodermal activity (EDA) applications, infrared sensors, a gyroscope, an altimeter, an accelerometer, a temperature sensor, an ambient light sensor, Wi-Fi, GPS, a vibration sensor, a speaker, and a microphone, among others.
  • ECG electrocardiogram
  • EDA electrodermal activity
  • Typical EDA responses can be measured using at least two electrodes, wherein skin conductance is calculated using the measured electrical impedance.
  • EDA responses are represented as the phasic component of skin conductance - skin conductance responses (SCRs) - and are detected by identifying momentary spikes to skin conductance in comparison to a background tonic measurement, the skin conductance level (SCL). More particularly, in terms of timing, the primary difference between SCL and SCR is that SCRs occur on the scale of seconds, whereas SCL is evaluated across seconds, minutes, hours, and/or days.
  • FIG. 1 illustrates a graphical representation 10 of EDA amplitude versus time.
  • the graph provides a comparison of the phasic skin conductance component (SCRs) 12 represented as peaks 16 to the tonic skin conductance component (SCL) 14.
  • SCRs phasic skin conductance component
  • SCL tonic skin conductance component
  • accurately detecting changes to SCL needs to be continuously measured (over seconds/minutes/hours/days, etc.).
  • cEDA continuous electrodermal activity
  • SCL can be used to observe certain biological events such as the body’s sweat response to certain activities.
  • Passive detection of exercise generally refers to automatically tracking activity via a wearable device, such as a smart watch or similar, without a user having to manually enter the activity.
  • High inertial data generally includes high cardio activities, such as running, walking, swimming, stair climbing, jumping rope, hiking, boxing, rowing, jumping jacks, etc.
  • low-inertia activities such as yoga, Pilates, weightlifting, spinning, etc.
  • AHA American Heart Association
  • the present disclosure is directed to a wearable computing device that includes passive tracking of low-inertia exercises using multimodal sensor inputs of the wearable computing device.
  • FIGS. 2-5 illustrate perspective views of a wearable computing device 100 according to the present disclosure.
  • the wearable computing device 100 may be worn on a user's forearm 102 like a wristwatch.
  • the wearable computing device 100 may include a wristband 103 for securing the w earable computing device 100 to the user's forearm 102.
  • the wearable computing device 100 has an outer covering 105 and a housing 104 that contains the electronics associated with the wearable computing device 100.
  • the outer covering 105 may be constructed of glass, polycarbonate, acrylic, or similar.
  • the wearable computing device 100 includes an electronic display 106 arranged within the housing 104 and viewable through the outer covering 105. Moreover, as shown, the wearable computing device 100 may also include one or more buttons 108 that may be implemented to provide a mechanism to activate various sensors of the wearing computing device 100 to collect certain health data of the user. Moreover, in an embodiment, the electronic display 106 may cover an electronics package (not shown), which may also be housed within the housing 104.
  • the housing 104 of the wearable computing device 100 further includes a dorsal wrist-side face 110 configured to sit against a dorsal wrist of a user when being worn by the user and a plurality of sensor electrodes 112 positioned on the dorsal wrist-side face 110 of the housing 104 so as to maintain skin contact with the user when being worn on the wrist by the user.
  • each of the sensor electrodes 112 continuously measure, at least, electrical impedance of the user at a location of the skin contact on the dorsal wrist.
  • one or more (or all) of the plurality of sensor electrodes 112 may be cEDA sensor electrodes.
  • the wearable computing device 100 may also include at least one additional biometric sensor electrode in addition to the cEDA sensor electrodes.
  • the additional biometric sensor electrode may include one or more temperature sensors (such as an ambient temperature sensor or a skin temperature sensor), a humidity sensor, a light sensor, a pressure sensor, a microphone, an optical sensor, or a photoplethysmography (PPG) sensor.
  • the sensor electrodes 112 described herein may be constructed of any suitable material.
  • the sensor electrodes 112 descnbed herein may be constructed of stainless steel, graphene, or any other matenal having a suitable conductivity and/or corrosion resistance and may have an optional PVD coating, that may be 1 -micrometer thick titanium nitride.
  • the PVD coating may provide a desired color to the sensor electrodes 112, thereby preventing oxidation beyond what the stainless steel already provides, and also increases durability.
  • PVD and surface finish can be used to increase/decrease moisture retention, which affects the cEDA signal and user comfort.
  • the sensor electrodes 112 may be formed of an alloy of tin and nickel (TiN) with a shiny or mirror surface finish.
  • the sensor electrodes 112 may be constructed of a hydrophobic material or a transparent material.
  • the system 200 may also include at least one controller 202 communicatively coupled to the plurality of sensor electrodes 112.
  • the controller(s) 202 may be a central processing unit (CPU) or graphics processing unit (GPU) for executing instructions that can be stored in a memory device 204, such as flash memory or DRAM, among other such options.
  • the memory device 204 may include RAM, ROM, FEASH memory, or other non-transitory digital data storage, and may include a control program having sequences of instructions which, when loaded from the memory device 204 and executed using the controller(s) 202, cause the controller(s) 202 to perform the functions that are described herein.
  • the system 200 can include many types of memory, data storage, or computer-readable media, such as data storage for program instructions for execution by the controller or any suitable processor. The same or separate storage can be used for images or data, a removable memory can be available for sharing information with other devices, and any number of communication approaches can be available for sharing with other devices.
  • the system 200 includes any suitable display 206, such as a touch screen, organic light emitting diode (OLED), or liquid crystal display (LCD), although devices might convey information via other means, such as through audio speakers, projectors, or casting the display or streaming data to another device, such as a mobile phone, wherein an application on the mobile phone displays the data.
  • the system 200 may also include one or more wireless components 212 operable to communicate with one or more electronic devices within a communication range of the particular wireless channel.
  • the wireless channel can be any appropriate channel used to enable devices to communicate wirelessly, such as Bluetooth, cellular, NFC, Ultra-Wideband (UWB), or Wi-Fi channels. It should be understood that the system 200 can have one or more conventional wired communications connections as known in the art.
  • the system 200 also includes one or more power components 208, such as may include a battery operable to be recharged through conventional plug-in approaches, or through other approaches such as capacitive charging through proximity with a power mat or other such device.
  • the system 200 can also include at least one additional I/O device 210 able to receive conventional input from a user.
  • This conventional input can include, for example, a push button, touch pad, touch screen, wheel, joystick, keyboard, mouse, keypad, or any other such device or element whereby a user can input a command to the system 200.
  • the I/O device(s) 210 may be connected by a wireless infrared or Bluetooth or other link as well in some embodiments.
  • the system 200 may also include a microphone or other audio capture element that accepts voice or other audio commands.
  • the system 200 may not include any buttons at all, but might be controlled only through a combination of visual and audio commands, such that a user can control the wearable computing device 100 without having to be in contact therewith.
  • the I/O elements 210 may also include one or more of the sensor electrodes 112 described herein, optical sensors, barometric sensors (e.g., altimeter, etc.), and the like.
  • the system 200 may also include a driver 214 and at least some combination of one or more emitters 216 and one or more detectors 218 (referred to herein as an optics package 215) for measuring data for one or more metrics of a human body, such as for a person wearing the wearable computing device 100.
  • the optics package 215 may be arranged within the housing 104 and at least partially exposed through the dorsal wrist-side face 110 of the housing 104.
  • the sensor electrodes 112 may be positioned around the optics package 215 on the wrist-side face 110 of the housing 104.
  • the various components of the optics package 215 may be positioned around the sensor electrodes 112 and/or in another other suitable configuration such as adjacent to, interspersed with, surrounded by, or on top of the optics package 215.
  • the sensor electrodes 112 may be arranged atop the optics package 215.
  • the system 200 may include at least one imaging element, such as one or more cameras that are able to capture images of the surrounding environment and that are able to image a user, people, or objects in the vicinity of the device.
  • the imaging element can include any appropriate technology, such as a CCD image capture element having a sufficient resolution, focal range, and viewable area to capture an image of the user when the user is operating the device. Further image capture elements may also include depth sensors. Methods for capturing images using a camera element with a computing device are well known in the art and will not be discussed herein in detail. It should be understood that image capture can be performed using a single image, multiple images, periodic imaging, continuous image capturing, image streaming, etc. Further, the system 200 can include the ability to start and/or stop image capture, such as when receiving a command from a user, application, or other device.
  • the emitters 216 and detectors 218 of FIG. 6 may also be capable of being used, in one example, for obtaining optical PPG measurements.
  • Some PPG technologies rely on detecting light at a single spatial location, adding signals taken from two or more spatial locations, or an algorithmic combination thereof. Both of these approaches result in a single spatial measurement from which the heart rate (HR) estimate (or other physiological metrics) can be determined.
  • HR heart rate
  • a PPG device employs a single light source coupled to a single detector (i. e. , a single light path).
  • a PPG device may employ multiple light sources coupled to a single detector or multiple detectors (i.e. , two or more light paths).
  • a PPG device employs multiple detectors coupled to a single light source or multiple light sources (i.e., two or more light paths).
  • the light source(s) may be configured to emit one or more of green, red, infrared (IR) light, as well as any other suitable wavelengths in the spectrum (such as long IR for metabolic monitoring).
  • a PPG device may employ a single light source and two or more light detectors each configured to detect a specific wavelength or wavelength range. In some cases, each detector is configured to detect a different wavelength or wavelength range from one another. In other cases, two or more detectors are configured to detect the same wavelength or wavelength range.
  • the PPG device may determine an average of the signals resulting from the multiple light paths before determining an HR estimate or other physiological metrics.
  • the emitters 216 and detectors 218 may be coupled to the controller 202 directly or indirectly using driver circuitry by which the controller 202 may drive the emitters 216 and obtain signals from the detectors 218.
  • the host computer 222 can communicate with the wireless networking components 212 via the one or more networks 220, which may include one or more local area networks, wide area networks, UWB, and/or internetworks using any of terrestrial or satellite links.
  • the host computer 222 executes control programs and/or application programs that are configured to perform some of the functions described herein.
  • FIG. 7 a schematic diagram of an environment 300 in which aspects of various embodiments can be implemented is illustrated.
  • a user might have a number of different devices that are able to communicate using at least one wireless communication protocol.
  • the user might have a smartwatch 302 or fitness tracker (such as wearable computing device 100), which the user would like to be able to communicate with a smartphone 304 and a tablet computer 306.
  • the ability to communicate with multiple devices can enable a user to obtain information from the smartwatch 302. e.g., data captured using a sensor on the smartwatch 302, using an application installed on either the smartphone 304 or the tablet computer 306.
  • the user may also want the smartwatch 302 to be able to communicate with a service provider 308, or other such entity, that is able to obtain and process data from the smartwatch and provide functionality that may not otherwise be available on the smartwatch or the applications installed on the individual devices.
  • the smartwatch 302 may be able to communicate with the service provider 308 through at least one network 220, such as the Internet or a cellular network, or may communicate over a wireless connection such as Bluetooth® to one of the individual devices, which can then communicate over the at least one network.
  • a network 220 such as the Internet or a cellular network
  • Bluetooth® wireless connection
  • a user may also want the devices to be able to communicate in a number of ways or with certain aspects.
  • the user may want communications between the devices to be secure, particularly where the data may include personal health data or other such communications.
  • the device or application providers may also be required to secure this information in at least some situations.
  • the user may want the devices to be able to communicate with each other concurrently, rather than sequentially. This may be particularly true where pairing may be required, as the user may prefer that each device be paired at most once, such that no manual pairing is required.
  • the user may also desire the communications to be as standards-based as possible, not only so that little manual intervention is required on the part of the user but also so that the devices can communicate with as many other types of devices as possible, which is often not the case for various proprietary formats.
  • a user may thus desire to be able to walk in a room with one device and have such device automatically communicate with another target device with little to no effort on the part of the user.
  • a device will utilize a communication technology such as Wi-Fi to communicate with other devices using wireless local area networking (WLAN).
  • WLAN wireless local area networking
  • Smaller or lower capacity devices, such as many Internet of Things (loT) devices instead utilize a communication technology such as Bluetooth®, and in particular Bluetooth Low Energy (BLE) which has very low power consumption.
  • the environment 300 illustrated in FIG. 7 enables data to be captured, processed, and displayed in a number of different ways.
  • data may be captured using sensors on the smartwatch 302, but due to limited resources on the smartwatch 302, the data may be transferred to the smartphone 304 or the service provider 308 (or a cloud resource) for processing, and results of that processing may then be presented back to that user on the smartwatch 302, smartphone 304, and/or another such device associated with that user, such as the tablet computer 306.
  • a user may also be able to provide input such as health data using an interface on any of these devices, which can then be considered when making that determination.
  • the wearable computing device may be any suitable wearable computing device, such as the wearable computing device 100 described herein with reference to FIGS. 1-7.
  • the low-inertia exercise activity may include, for example, yoga, Pilates, weightlifting, spinning, strength training, or similar.
  • the method 400 is described herein with reference to the wearable computing device 100 of FIGS. 1-7. However, it should be appreciated that the disclosed method 400 may be implemented with any other suitable wearable computing device having any other suitable configurations.
  • FIG. 1-7 the wearable computing device having any other suitable configurations.
  • the method 400 includes receiving, via a processor communicatively coupled to the wearable computing device 100, a plurality of timeseries data inputs from a plurality of biometric sensor electrodes of the wearable computing device 100.
  • the plurality of timeseries data may include cEDA data of the user as well as at least one additional biometric parameter of the user, such as heart rate data of the user, skin temperature data of the user, heart rate variability (HRV) data of the user, accelerometer data, gyroscope data, altimeter data, and/or combinations thereof.
  • the cEDA data may include skin conductance response (SCR), skin conductance level (SCL), a slope or change in the SCR or the SCL, an indication of individual sweat glands of the user being activated, or combinations thereof, of similar.
  • SCR skin conductance response
  • SCL skin conductance level
  • a slope or change in the SCR or the SCL an indication of individual sweat glands of the user being activated, or combinations thereof, of similar.
  • the method 400 includes processing, via the processor, the plurality of time-series data inputs using at least one computer-implemented model.
  • processing the plurality of time-series data inputs may include filtering the cEDA data of the user, e.g., using a high-pass filter for SCR, a low-pass filter for SCL, a median filter to erase glitches, and/or any other type of filter as needed.
  • processing the plurality of time-series data inputs may include updating a certain time frame cache with a plurality of data inputs (i.e., updating a cache storing data inputs relating to time frame / time window of predetermined length), determining whether a time-series data input from the plurality of time-series data inputs indicate one of a plurality of modes of the wearable computing device relating to undesirable motion (e.g., from stress or any other nonexercise related activity) and, if so, eliminating the time-series data input from the plurality of time-series data inputs.
  • undesirable motion e.g., from stress or any other nonexercise related activity
  • processing the plurality of time-series data inputs may include imputing one or more data points into the plurality of time-series data inputs if a minimum number of data points are missing from the plurality of time-series data inputs or dropping the plurality of timesenes data inputs if a certain number of data points are missing from the plurality of time-series data inputs, or normalizing the plurality of time-series data inputs using one or more normalization factors.
  • the normalization factor(s) may include a mean, a median, a mode, or a standard deviation, and/or transforming each of the plurality of time-series data inputs into a single value.
  • the method 400 includes determining, via the processor, an indicator of a physiological response of the user using the computer-implemented model(s).
  • the method 400 may also include post-processing the indicator of the physiological response.
  • post-processing the indicator of the physiological response may include ensuring that the physiological response includes a duration above a certain threshold, grouping multiple physiological responses together if the multiple physiological responses occur within a certain time frame of each other, and/or any other post-processing to improve accuracy of the data.
  • the method 400 includes passively tracking, via the processor, the physiological response of the user when the indicator of the physiological response indicates a low-inertia exercise activity is being performed by the user.
  • the method 400 described herein can be implemented by the wearable computing device 100 (and/or any linked smart device) to passively track low-inertia exercise activity of the user without the user having to manually log the activity.
  • the method 400 may also include identifying one or more repetitions of the low-inertia exercise activity and passively tracking, via the processor, the one or more repetitions of the low-inertia exercise activity.
  • cEDA data generally responds to changes in contact area (i.e., the contact area between a wrist side face of the wearable computing device 100 and skin of the user), which happens naturally as the user participates in low-inertia exercise activities (such as lifting weights), which in addition to bulk sweat (e.g., skin conductance level) may also assist with recognizing the type of activity being performed by the user and potentially contribute to repetition counting.
  • contact area i.e., the contact area between a wrist side face of the wearable computing device 100 and skin of the user
  • low-inertia exercise activities such as lifting weights
  • bulk sweat e.g., skin conductance level
  • the method 400 includes controlling a display of the wearable computing device and providing the indicator of the physiological response to the user via the display when the indicator of the physiological response indicates the low-inertia exercise activity is being performed by the user. More specifically, in an embodiment, the method 400 may include sending a notification to the user indicating at least one of an occurrence of the indicator of the physiological response exceeding a threshold, a graphical representation of physiological responses over time, and a summary of physiological responses over time (such as daily, weekly, monthly, etc.). Moreover, in an embodiment, the method 400 may also include probing the user to respond to the notification via the display (such as the display 206). For example, the user may be prompted to confirm the physiological response, record participation in a presenbed low-inertia exercise activity, and/or any other suitable response.
  • a function of the wearable computing device may be controlled when the indicator of the low-inertia exercise activity exceeds a threshold.
  • a function of the wearable computing device may be a function of the display 206 of wearable computing device 100, for example, resulting in that the indicator of the low-inertia exercise activity is displayed at the display 206 when the indicator of the low-inertia exercise activity exceeds the threshold.
  • the function of a wearable computing device 100 controlled by the calculated indicator of the low-inertia exercise activity exceeding the threshold may include generating and sending a notification, e.g., to a user of the wearable computing device, and/or triggering a user interaction process via the wearable computing device 100 in which the user of the wearable computing device 100 has to actively confirm notification of the low-inertia exercise activity.
  • a technique and a wearable computing device 100 may be provided for passively tracking low- inertia exercise activity of a user and providing such tracking to the user.
  • a system 500 for passively (e.g., automatically) tracking low-inertia exercises of a user of a wearable computing device is provided. More specifically, as shown, the system 500 includes a processor 502 having at least one computer-implemented model 504 programmed therein. In an embodiment, the processor 502 may be part of the wearable computing device 100 or a separate mobile device. Further, as shown in FIG. 9, the computer-implemented model 504 may be a machine learning model configured to implement one or more machine learning algorithms.
  • various machine learning algorithms may be employed in the systems and methods of the present disclosure to iteratively refine the logic and/or the model-based simulations or estimators, virtual representations or simulations, models, sub-models, and/or estimators of the system 500 described herein, thereby increasing accuracy in the predictions that are based on such estimates.
  • the machine learning algorithm(s) may receive feedback from the processor(s) 502 and train the feedback.
  • the machine learning algorithm(s) may be a trained neural network, a simple linear regression model, a random forest regression model, a support vector machine, or any suitable type of a supervised learning model based on the quality and quantity of the data received.
  • the system 500 may include an embedded reinforcement learning technique in the machine learning algorithm.
  • the computer-implemented model 504 receives time-series data 506, such as cEDA data, heart rate data, skin temperature data, HRV data, accelerometer data, gyroscope data, altimeter data, and/or combinations thereof.
  • time-series data 506 such as cEDA data, heart rate data, skin temperature data, HRV data, accelerometer data, gyroscope data, altimeter data, and/or combinations thereof.
  • the computer-implemented model 504 is configured to determine when a user is participating in a low-inertia exercise activity 508 based on, at least, the cEDA data and one or more of the additional biometric parameters.
  • the cEDA data will include changes in a skin conductance level of the user that are indicative of sweat production, and the additional biometric parameters (such as a low heart rate and/or increase in skin temperature) can distinguish the low-inertia exercise activity 508 from other activities that cause increases in cEDA data (such as stress, as an example).
  • the system 500 can passively track 510 the low-inertia exercise activity 508 without the user having to manually log the activity.
  • the time-series data 506 may also include hydration data.
  • the computer-implemented model 504 is configured to receive the hydration data and relate a magnitude of the cEDA data to the hydration data. Accordingly, the processor 502 is configured to notify a user should the user become dehydrated.
  • the wearable computing device may be any suitable wearable computing device, such as the wearable computing device 100 described herein with reference to FIGS. 1-7.
  • the method 600 is described herein with reference to the wearable computing device 100 of FIGS. 1-7.
  • the disclosed method 600 may be implemented with any other suitable wearable computing device having any other suitable configurations.
  • FIG. 10 depicts steps performed in a particular order for purposes of illustration and discussion, the methods discussed herein are not limited to any particular order or arrangement.
  • the method 600 includes receiving, via a processor communicatively coupled to the wearable computing device, a plurality of time-series data inputs from a plurality of biometric sensor electrodes of the wearable computing device.
  • the plurality of time-series data may include cEDA data of the user as well as at least one additional biometric parameter of the user, such as heart rate data of the user, skin temperature data of the user, heart rate variability (HRV) data of the user, accelerometer data, gyroscope data, altimeter data, and/or combinations thereof.
  • cEDA data of the user as well as at least one additional biometric parameter of the user, such as heart rate data of the user, skin temperature data of the user, heart rate variability (HRV) data of the user, accelerometer data, gyroscope data, altimeter data, and/or combinations thereof.
  • HRV heart rate variability
  • the method 600 includes determining, via the processor, a type of low-inertia exercise activity being performed by the user based, at least in part, on the plurality of time-series data inputs using at least one computer- implemented model. As shown at (606), the method 600 includes automatically tracking, via the processor, the low-inertia exercise activity of the user. In further embodiments, the method 600 may also include identifying one or more repetitions of the low-inertia exercise activity and passively tracking, via the processor, the one or more repetitions of the low-inertia exercise activity.
  • a user may be provided with controls allowing the user to make an election as to both if and when systems, programs, or features described herein may enable collection of user information (e.g., information about a user’s social network, social actions, or activities, profession, a user’s preferences, or a user’s current location), and if the user is sent content or communications from a server.
  • user information e.g., information about a user’s social network, social actions, or activities, profession, a user’s preferences, or a user’s current location
  • certain data may be treated in one or more ways before it is stored or used, so that personally identifiable information is removed.
  • a user’s identity may be treated so that no personally identifiable information can be determined for the user, or a user’s geographic location may be generalized where location information is obtained (such as to a city, ZIP code, or state level), so that a particular location of a user cannot be determined.
  • location information such as to a city, ZIP code, or state level
  • the user may have control over what information is collected about the user, how that information is used, and what information is provided to the user.
  • any information collected as described herein relating to the user will be kept private and confidential and will not be improperly used or published.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Physiology (AREA)
  • Dermatology (AREA)
  • Evolutionary Computation (AREA)
  • Dentistry (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

L'invention concerne un procédé de suivi passif d'exercices à faible inertie d'un utilisateur d'un dispositif informatique vestimentaire consistant à recevoir, par l'intermédiaire d'un processeur couplé en communication au dispositif informatique portable, une pluralité d'entrées de données chronologiques à partir d'une pluralité d'électrodes de capteur biométrique du dispositif informatique portable. La pluralité de données chronologiques comprend des données d'activité électrodermique continue (cEDA) de l'utilisateur et au moins un paramètre biométrique supplémentaire de l'utilisateur. Le procédé comprend également le traitement, par l'intermédiaire du processeur, de la pluralité d'entrées de données chronologiques à l'aide d'au moins un modèle mis en œuvre par ordinateur. En outre, le procédé comprend la détermination, par l'intermédiaire du processeur, d'un indicateur d'une réponse physiologique de l'utilisateur à l'aide du ou des modèles mis en œuvre par ordinateur. De plus, le procédé comprend le suivi passif, par l'intermédiaire du processeur, de la réponse physiologique de l'utilisateur lorsque l'indicateur de la réponse physiologique indique qu'une activité d'exercice à faible inertie est effectuée par l'utilisateur.
PCT/US2023/025720 2023-06-20 2023-06-20 Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable Pending WO2024263156A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2023/025720 WO2024263156A1 (fr) 2023-06-20 2023-06-20 Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2023/025720 WO2024263156A1 (fr) 2023-06-20 2023-06-20 Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable

Publications (1)

Publication Number Publication Date
WO2024263156A1 true WO2024263156A1 (fr) 2024-12-26

Family

ID=87201954

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/025720 Pending WO2024263156A1 (fr) 2023-06-20 2023-06-20 Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable

Country Status (1)

Country Link
WO (1) WO2024263156A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140213856A1 (en) * 2002-10-09 2014-07-31 Bodymedia, Inc. System for automatic journaling of a user's context
US20150122018A1 (en) * 2012-06-22 2015-05-07 Fitbit, Inc. Fitness monitoring device with altimeter and gesture recognition
US20150317515A1 (en) * 2013-05-30 2015-11-05 Atlas Wearables, Inc. Portable computing device and analyses of personal data captured therefrom
WO2023027685A1 (fr) * 2021-08-23 2023-03-02 Fitbit Llc Agencement d'électrodes d'activité électrodermique continues côté poignet sur un dispositif habitronique pour détecter des événements de stress

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140213856A1 (en) * 2002-10-09 2014-07-31 Bodymedia, Inc. System for automatic journaling of a user's context
US20150122018A1 (en) * 2012-06-22 2015-05-07 Fitbit, Inc. Fitness monitoring device with altimeter and gesture recognition
US20150317515A1 (en) * 2013-05-30 2015-11-05 Atlas Wearables, Inc. Portable computing device and analyses of personal data captured therefrom
WO2023027685A1 (fr) * 2021-08-23 2023-03-02 Fitbit Llc Agencement d'électrodes d'activité électrodermique continues côté poignet sur un dispositif habitronique pour détecter des événements de stress

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ALAM MOHAMMAD ARIF UL ET AL: "AutoCogniSys: IoT Assisted Context-Aware Automatic Cognitive Health Assessment", 2020 THE 9TH INTERNATIONAL CONFERENCE ON NETWORKS, COMMUNICATION AND COMPUTING, ACMPUB27, NEW YORK, NY, USA, 7 December 2020 (2020-12-07), pages 184 - 195, XP058655307, ISBN: 978-1-4503-8961-7, DOI: 10.1145/3448891.3448945 *
WONG JOHNNY CHUN YIU ET AL: "Activity Recognition and Stress Detection via Wristband", PROCEEDINGS OF THE 31ST AUSTRALIAN CONFERENCE ON HUMAN-COMPUTER-INTERACTION, ACMPUB27, NEW YORK, NY, USA, 2 December 2019 (2019-12-02), pages 102 - 106, XP058875437, ISBN: 978-1-4503-8899-3, DOI: 10.1145/3365921.3365950 *

Similar Documents

Publication Publication Date Title
US12257024B1 (en) Wearable stress testing device
US11872041B1 (en) Determining mental health and cognitive state through physiological and other non-invasively obtained data
CN107256329B (zh) 用于检测用户的移动数据的整体式装置和非瞬时计算机可读介质
US10264971B1 (en) System and methods for integrating feedback from multiple wearable sensors
US11699524B2 (en) System for continuous detection and monitoring of symptoms of Parkinson's disease
EP4192333B1 (fr) Techniques de détermination et de gestion de stress
US20160113551A1 (en) Fall detection system and method
US20160081627A1 (en) System method for assessing fitness state via a mobile device
US20240090806A1 (en) Arrangement of Wrist-Side Continuous Electrodermal Activity Electrodes on a Wearable Device for Detecting Stress Events
WO2020196093A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
WO2024263156A1 (fr) Suivi passif d'exercices à faible inertie à l'aide d'entrées de capteur multimodales d'un dispositif informatique portable
JP2025527513A (ja) ウェアラブルコンピューティングデバイスのための瞬間的ストレスアルゴリズム
US20250387077A1 (en) Snore detection system
WO2025128111A1 (fr) Système et procédé de détermination d'entrées d'utilisateur sur un dispositif informatique porté sur soi
EP4573569A1 (fr) Techniques de détermination et de gestion de score de fatigue de condition physique
EP4612706A1 (fr) Application informatique pour une sélection, une surveillance et des recommandations d'objectif de comportement en matière de santé
CN119947640A (zh) 肌肉骨骼负担
KR20250066825A (ko) 사용자의 생체 정보를 이용한 운동 추천 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23739770

Country of ref document: EP

Kind code of ref document: A1