WO2013141667A1 - Daily health information providing system and daily health information providing method - Google Patents

Description

Routine Health Information System and How to Provide Routine Health Information

The present invention relates to a system for measuring and providing health information of users, and more particularly, a daily health information providing system and daily health information that can effectively measure and provide health information of the users by monitoring the daily lives of the users. It is about a provision method.

Recording an individual's lifestyle is essential for optimal health care for the individual. This is even more important for people with chronic diseases such as diabetes, kidney and heart disease. Accumulation of a person's health information over time can provide an efficient way to determine a person's current health status. In particular, you can see if your health improves or worsens, and you can choose the most appropriate option, whether you want to continue your current health habits or take new action.

To this end, conventionally, wearable sensor devices capable of measuring health information such as daily activities and the like have been used.

However, these types of sensor devices can measure health information only when the user is always wearing them, and the sensor device cannot be worn in a specific situation such as taking a shower, and the battery needs to be periodically charged.

Accordingly, an object of the present invention is to provide a daily health information providing system that can effectively measure and provide health information according to the user's daily behavior without using a sensor attached to the user's body.

Another object of the present invention is to provide a method for providing daily health information that can effectively measure and provide health information according to a user's daily behavior without using a sensor attached to a user's body.

In order to achieve the above object of the present invention, the daily health information providing system according to an embodiment of the present invention includes a daily health information measuring device, mobile terminals and a cloud server. The daily health information measuring device is installed in a space where a plurality of users live, monitors the daily behavior of the plurality of users to generate image data and sound data, analyze the image data and the sound data to analyze the plurality of Generate and transmit behavior data including a user ID of each of the users, a behavior pattern corresponding to each of the plurality of users, a start time and an end time of the operation corresponding to the behavior pattern. The mobile terminals are possessed by the plurality of users and each stores a user ID of a corresponding user. The cloud server transmits the behavior data received from the everyday health information measuring device to a mobile terminal of a user corresponding to the user ID included in the behavior data, and the modified behavior in which the behavior data is partially modified from the mobile terminal. Receiving the inquiry user ID and the inquiry period, and receiving the inquiry user ID and the inquiry period, and calculating the total amount of calories consumed during the inquiry period by the inquiry user corresponding to the inquiry user ID based on the behavior data and the corrected behavior data. Calculate and print

In one embodiment, the cloud server, the receiving unit for receiving the behavior data from the first health information database, the second health information database, the everyday health information measuring device and stores the behavior data in the first health information database Reading the behavior data stored in the first health information database, transmitting the behavior data to a mobile terminal of a user corresponding to a user ID included in the behavior data, and receiving the approval signal from the mobile terminal. A confirmation unit that stores the behavioral data in the second health information database and stores the corrected behavioral data in the second health information database when receiving the corrected behavioral data from the mobile terminal; and the inquiry user ID and the inquiry. Receive the lookup period Retrieve behavior patterns of the inquiry user and durations of the behavior patterns corresponding to the inquiry user ID from the second health information database, and based on the retrieved behavior patterns and durations; The user may include an inquiry unit for calculating and outputting a total calorie amount consumed during the inquiry period.

When the confirmation unit receives a data request signal including a user ID from the mobile terminal, the identification unit may read behavior data including the user ID included in the data request signal from the first health information database and transmit the behavior data to the mobile terminal. .

The identification unit may periodically read the behavior data stored in the first health information database and transmit the read behavior data to a mobile terminal corresponding to a user ID included in each of the read behavior data.

Each of the mobile terminals displays a user ID, a behavior pattern, a start time, and an end time included in the behavior data when receiving the behavior data from the confirmation unit, and outputs the approval signal in response to a user's approval command. And provide the corrected behavior data by modifying at least one of a user ID, a behavior pattern, a start time, and an end time included in the behavior data in response to a user's corrective command. have.

When each of the mobile terminals receives the behavior data from the identification unit, each of the mobile terminals displays an avatar shaped as a character and displays a user ID, behavior pattern, start time, and end time included in the behavior data through the avatar. The user's ID, the behavior pattern, the start time and the end time of the approval command and the user ID, the behavior pattern, and the start time are analyzed by analyzing a voice of a user who is talking with the avatar and outputting a voice. And the modification command for at least one of the end time.

The inquiry unit may include a calorie database for storing calorie consumption amount per unit time for each of a plurality of behavior patterns, the inquiry user ID and the inquiry period from an external device, and the inquiry during the inquiry period from the second health information database. Search for behavior patterns of the inquiry user corresponding to a user ID and start and end times of the behavior patterns, and generate durations of the behavior patterns using the searched start and end times to generate the behavior patterns and A search circuit using the search circuit for outputting the durations and the amount of calories burned per unit time for each of the retrieved behavior patterns, the durations and the retrieved behavior patterns read from the calorie database, the query user With the total knife consumed It is possible to calculate the amount to include a calculation circuit provided in the external apparatus.

In one embodiment, each of the mobile terminals provides the inquiry user ID and the inquiry period to the everyday health information measuring device, and the inquiry user corresponding to the inquiry user ID from the everyday health information measuring device provides the inquiry period. You can receive the total amount of calories burned.

In one embodiment, the medical institution server provides the inquiry user ID and the inquiry period to the everyday health information measuring device, and the inquiry user corresponding to the inquiry user ID from the everyday health information measuring device is consumed during the inquiry period. One total calorie amount can be received.

In one embodiment, the daily health information measuring device, the plurality of cameras are distributed and installed in a space in which the plurality of users living, each of which provides the image data, are installed adjacent to the plurality of cameras Generate the user ID by identifying the plurality of users based on the plurality of microphones each providing the sound data, the video data and the sound data received from the camera and microphone respectively installed adjacent to each other, An analysis unit for generating the behavior pattern by analyzing the identified user's motion and generating a start time and an end time of the motion corresponding to the behavior pattern, and the user ID, the behavior pattern, the start time, and the end time Generate and transmit the behavior data including the cloud server May include a communication unit.

The analyzing unit analyzes the image data to identify the plurality of users, generates a first user ID and a first user matching rate, and analyzes the identified user's motions to analyze the first behavior pattern and the first behavior pattern matching rate. An image data analyzer configured to analyze the sound data to identify the plurality of users to generate a second user ID and a second user matching rate, and to infer the identified user's behavior to generate a second behavior pattern and a second behavior. A sound data analysis unit generating a behavior pattern matching rate, and selecting one of the first user ID and the second user ID based on the first user matching rate and the second user matching rate to generate the user ID And select one of the first behavior pattern and the second behavior pattern based on the first behavior pattern matching ratio and the second behavior pattern matching ratio. And a determination unit for generating the behavior pattern and generating the start time at which the behavior pattern is initially generated and the end time at which the behavior pattern is changed to a different pattern with respect to the user ID.

The image data analysis unit may include: a first user database storing body images of each of the plurality of users, and comparing the body images included in the image data with body images of the plurality of users stored in the first user database; A first user identification circuit for outputting the user's ID and the highest matching rate as the first user ID and the first user matching rate, respectively, corresponding to a plurality of behavior patterns A reference image database for storing a reference image associated with each of the plurality of behavior patterns, and reference images corresponding to each of the plurality of behavior patterns stored in the reference image database of a motion of a body included in the image data. Row corresponding to the reference image with the highest matching rate compared to Patterns, and may include a first behavior pattern analysis circuit for each of the first behavior pattern and output as the ratio of the first behavior pattern matching the highest matching rate.

The sound data analyzing unit may include a sound separation circuit that separates the sound data into human voice data and background sound data, a second user database storing voice samples of each of the plurality of users, and the voice data into the second user. Outputting the user ID and the highest matching rate corresponding to the voice sample having the highest matching rate as compared with the voice samples of the plurality of users stored in the database as the second user ID and the second user matching rate, respectively. 2 a user identification circuit, a reference sound database for storing reference background sounds corresponding to each of a plurality of behavior patterns in association with each of the plurality of behavior patterns, and the plurality of actions stored in the reference sound database. Compared to the reference background sounds corresponding to each of the patterns And a second behavior pattern analysis circuit configured to output the behavior pattern corresponding to the reference background sound having the highest matching rate and the highest matching rate as the second behavior pattern and the second behavior pattern matching ratio, respectively.

The sound data analysis unit may include: a reference word database configured to store voice samples for reference words associated with each of a plurality of behavior patterns in association with each of the plurality of behavior patterns, and to store the voice data in the reference word database. Comparing the voice samples for the reference words associated with each of the plurality of behavior patterns to output a behavior pattern most related to the matching reference words as a third behavior pattern, and associated with the third behavior pattern The apparatus may further include a third behavior pattern analysis circuit configured to output, as a third behavior pattern matching ratio, a ratio of matching words among all the reference words.

The determination unit outputs the first user ID as the user ID when the first user matching rate is greater than the second user matching rate, and when the second user matching rate is greater than the first user matching rate. A user determination circuit that outputs a second user ID as the user ID, and outputs the first behavior pattern as the behavior pattern when the first behavior pattern matching ratio is greater than the second behavior pattern matching ratio, and the second behavior A behavior pattern determination circuit that outputs the second behavior pattern as the behavior pattern when the pattern matching ratio is greater than the first behavior pattern matching ratio, and receives the user ID and the behavior pattern, and the behavior for the user ID The time at which the pattern was first generated is output as the start time, and the time at which the behavior pattern is changed to a different pattern for the user ID is displayed. End may include a time generator circuit for outputting a time.

The apparatus for measuring everyday health information further includes a plurality of thermal imaging cameras installed in a space where the plurality of users live and each providing thermal image data to the analyzing unit. The apparatus for measuring everyday health information includes the camera and The body temperature of the identified user is measured based on the thermal image data received from the thermal imaging camera installed adjacent to the microphone, and the measured body temperature, the user ID, the behavior pattern, the start time and the end time are measured. The behavior data may be transmitted to the cloud server, and the cloud server may provide a temperature change of the inquiry user during the inquiry period based on the behavior data.

In order to achieve the above object of the present invention, in the method for providing daily health information according to an embodiment of the present invention, the image data is generated by photographing a space where a plurality of users live, and the plurality of users living The sound generated from the space is detected to generate sound data, and the everyday health information measuring device identifies the plurality of users based on the image data and the sound data to generate the user ID, and the operation of the identified user. Generate the behavioral pattern corresponding to the behavioral pattern, generate the start time and the end time of the motion corresponding to the behavioral pattern, and include the user ID, the behavioral pattern, the start time, and the end time. To the cloud server, and the cloud server sends the behavioral data to Send to the terminal, receive from the mobile terminal one of the modified behavior data and the acknowledgment signal in which the behavior data has been partially modified, and the cloud server makes an inquiry corresponding to the inquiry user ID based on the behavior data and the modified behavior data The total calorie amount consumed by the user during the inquiry period can be calculated and provided.

In one embodiment, the cloud server transmits the behavioral data to the user's mobile terminal, and receiving one of the modified behavioral data and the approval signal in which the behavioral data is partially modified from the mobile terminal, the cloud server; Receiving the behavior data from the routine health information measuring device and storing the behavior data in a first health information database, reading the behavior data stored in the first health information database, and including a user ID in the behavior data Transmitting the behavioral data to a mobile terminal of a user corresponding to the data, storing the behavioral data in a second health information database when receiving the approval signal from the mobile terminal, and correcting behavioral data from the mobile terminal. If you receive And storing the corrected behavioral data in the second health information database.

When the mobile terminal receives the behavior data from the cloud server, the mobile terminal displays a user ID, a behavior pattern, a start time, and an end time included in the behavior data, and sends the approval signal in response to a user's approval command. And modifying at least one of a user ID, a behavior pattern, a start time, and an end time included in the behavior data in response to a user's corrective command to generate the corrective behavior data and provide it to the cloud server.

When the mobile terminal receives the behavior data from the cloud server, the mobile terminal displays an avatar shaped as a character and voices a user ID, behavior pattern, start time, and end time included in the behavior data through the avatar. Outputs and analyzes a voice of a user who is talking to the avatar, the approval command and the user ID, the behavior pattern, the start time, and the user ID, the behavior pattern, the start time, and the end time. One of the modification commands may be generated for at least one of the end times.

The system for providing daily health information and the method for providing daily health information according to embodiments of the present invention can effectively measure and provide calorie consumption according to daily actions of a plurality of users without using a sensor attached to the body. Therefore, a user can easily grasp his / her health information without a direct action such as living with a sensor device attached to a body to measure his / her health information or inputting data on a specific activity into the measuring device.

1 is a block diagram showing a system for providing daily health information according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of an apparatus for measuring everyday health information included in the everyday health information providing system of FIG. 1.

3 is a diagram illustrating an example in which the apparatus for measuring everyday health information of FIG. 2 is applied.

4 is a block diagram illustrating an example of an analysis unit included in the apparatus for measuring everyday health information of FIG. 2.

5 is a block diagram illustrating an example of an image data analyzer included in the analyzer of FIG. 4.

6 is a block diagram illustrating an example of a sound data analyzer included in the analyzer of FIG. 4.

7 is a block diagram illustrating another example of a sound data analyzer included in the analyzer of FIG. 4.

8 is a block diagram illustrating an example of a determination unit included in the analysis unit of FIG. 4.

9 is a block diagram illustrating an example of a cloud server included in the daily health information providing system of FIG. 1.

10 and 11 are diagrams for describing examples of an operation of a mobile terminal included in the daily health information providing system of FIG. 1.

12 is a block diagram illustrating an example of an inquiry unit included in a cloud server of FIG. 9.

FIG. 13 is a diagram illustrating an example of a calorie database included in an inquiry unit of FIG. 12.

14 is a block diagram illustrating another example of an apparatus for measuring everyday health information included in the everyday health information providing system of FIG. 1.

FIG. 15 is a block diagram illustrating another example of a cloud server included in the daily health information providing system of FIG. 1.

16 is a flowchart illustrating a method of providing daily health information according to an embodiment of the present invention.

FIG. 17 is a flowchart illustrating in detail a step in which the cloud server of FIG. 16 transmits behavior data to a user's mobile terminal and receives one of modified behavior data and an acknowledgment signal in which the behavior data is partially modified from the mobile terminal.

With respect to the embodiments of the present invention disclosed in the text, specific structural to functional descriptions are merely illustrated for the purpose of describing embodiments of the present invention, embodiments of the present invention may be implemented in various forms and It should not be construed as limited to the embodiments described in.

As the inventive concept allows for various changes and numerous modifications, particular embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to a specific disclosed form, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms may be used for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

When a component is said to be "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that another component may be present in the middle. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between. Other expressions describing the relationship between the components, such as "between" and "immediately between" or "neighboring to" and "directly neighboring", should be interpreted as well.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "having" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof that is described, and that one or more other features or numbers are present. It should be understood that it does not exclude in advance the possibility of the presence or addition of steps, actions, components, parts or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. .

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. The same reference numerals are used for the same elements in the drawings, and duplicate descriptions of the same elements are omitted.

1 is a block diagram showing a system for providing daily health information according to an embodiment of the present invention.

1, the daily health information providing system 10000 includes a daily health information measuring device 10, a cloud server 20, and a plurality of mobile terminals 30. It includes.

The everyday health information measuring device 10 is installed in an indoor space where a plurality of users live. A unique user ID is assigned to each of the plurality of users, and the user ID assigned to each of the plurality of users is stored in advance in the daily health information measuring apparatus 10.

The everyday health information measuring apparatus 10 monitors the daily behaviors of the plurality of users to generate image data MD and sound data SD, and analyzes the image data MD and sound data SD to analyze the plurality of users. Identify users of the user to generate a user ID (UID) representing the identified user, generate a behavior pattern (APTN) corresponding to the behavior of the identified user, and start time of the operation corresponding to the behavior pattern (APTN) (ST) and end time (FT) are generated. Thereafter, the daily health information measuring apparatus 10 generates the behavior data AD including the user ID UID, the behavior pattern APTN, the start time ST, and the end time FT, thereby providing the cloud server 20. To transmit.

A plurality of mobile terminals 30 are carried by the plurality of users. Each of the plurality of mobile terminals 30 stores a user ID of a corresponding user.

The cloud server 20 receives the behavioral data AD from the daily health information measuring device 10 and transmits the behavioral data to the user's mobile terminal 30 corresponding to the user ID UID included in the behavioral data AD. Send (AD).

When each of the plurality of mobile terminals 30 receives the behavior data AD from the cloud server 20, the user ID UID, the behavior pattern APTN, and the start time ST included in the behavior data AD ) And the end time (FT), and transmits an approval signal (CS) for the behavioral data (AD) to the cloud server 20 based on the user's command (UID) included in the behavioral data (AD) ), At least one of the behavior pattern APTN, the start time ST, and the end time FT is modified to generate corrective behavior data CAD and transmit the modified behavior data CAD to the cloud server 20.

The cloud server 20 receives the inquiry user ID S_UID and the inquiry period S_DR from an external device, the behavior data AD received from the routine health information measuring device 10, and the plurality of mobile terminals 30. The total calorie amount C_CAL consumed by the inquiry user corresponding to the inquiry user ID S_UID during the inquiry period S_DR is calculated and output to the external device based on the corrected behavior data CAD received from the user.

In one embodiment, as shown in FIG. 1, the external device may be a medical institution server 40 installed in a medical institution such as a hospital or a pharmacy.

In another embodiment, although not shown in FIG. 1, the external device may be mobile terminals 30 possessed by the plurality of users.

FIG. 2 is a block diagram illustrating an example of an apparatus for measuring everyday health information included in the everyday health information providing system of FIG. 1.

Referring to FIG. 2, the apparatus for measuring health information 10 may include a user server 1000, a plurality of cameras 2000, and a plurality of microphones 3000.

The plurality of cameras 2000 may be distributed and installed in an indoor space in which the plurality of users live, and may generate and provide image data MD of the indoor space to the user server 1000.

Each of the plurality of microphones 3000 may be installed adjacent to each of the plurality of cameras 2000 and generate sound data SD corresponding to the sound detected in the indoor space and provide the generated sound data SD to the user server 1000. .

The user server 1000 analyzes the image data MD and the sound data SD provided from the camera 2000 and the microphone 3000 installed adjacent to each other to identify the plurality of users and identify the identified users. Behavioral data AD including a user ID (UID) indicating, behavioral pattern APTN corresponding to the identified user's motion, start time ST and end time FT of the motion corresponding to behavioral pattern APTN ) May be generated and transmitted to the cloud server 20.

3 is a diagram illustrating an example in which the apparatus for measuring everyday health information of FIG. 2 is applied.

FIG. 3 illustrates a case in which the everyday health information measuring device of FIG. 2 is installed in an indoor space of a general home.

As shown in FIG. 3, the indoor space of a general home may be composed of a plurality of spaces including two rooms ROOM1 and ROOM2, a bathroom BATHROOM, a kitchen KITCHEN, and a living room. .

The plurality of cameras 2000 may be installed in each of the plurality of spaces to generate image data MD photographing all regions of the indoor space and provide the image data MD to the user server 1000.

Each of the plurality of microphones 3000 is installed adjacent to each of the plurality of cameras 2000 to generate sound data SD corresponding to sound detected in all areas of the indoor space and provide the same to the user server 1000. can do.

According to an embodiment, the user server 1000 may be installed inside the indoor space or may be installed outside the indoor space. The user server 1000 may receive image data MD and audio data SD from the plurality of cameras 2000 and the plurality of microphones 3000 through wired / wireless communication, respectively.

Referring back to FIG. 2, the user server 1000 may include a communication unit 1100 and an analysis unit 1200.

A unique user ID is assigned to each of the plurality of users living in the indoor space where the daily health information measuring device 10 is installed, and the user ID assigned to each of the plurality of users is stored in the analysis unit 1200. do.

The analyzer 1200 identifies the plurality of users by identifying the plurality of users based on the image data MD and the sound data SD respectively received from the camera 2000 and the microphone 3000 installed adjacent to each other. A user ID (UID) indicating can be generated.

The analysis unit 1200 may have a behavior pattern corresponding to the identified user's motion based on the image data MD and the sound data SD respectively received from the camera 2000 and the microphone 3000 installed adjacent to each other. APTN) can be generated. For example, the analyzer 1200 may predefine standardized behaviors including a plurality of behavior patterns, including bathing, watching TV, washing, ironing, cleaning, moving up and down stairs, walking, washing dishes, and the like. The behavior may be analyzed and one of the standardized behaviors may be selected and output as an behavior pattern (APTN).

The analyzer 1200 may generate a start time ST at which an operation corresponding to the behavior pattern APTN starts and an end time FT at which an operation corresponding to the behavior pattern APTN ends.

The analysis unit 1200 may provide the generated user ID UID, behavior pattern APTN, start time ST, and end time FT to the communication unit 1100.

The communication unit 1100 generates behavior data (AD) including a user ID (UID), a behavior pattern (APTN), a start time (ST), and an end time (FT) by using a wired or wireless communication to the cloud server 20. Can transmit

4 is a block diagram illustrating an example of an analysis unit included in the apparatus for measuring everyday health information of FIG. 2.

Referring to FIG. 4, the analyzer 1200 may include a MOVIE DATA ANALYSIS UNIT 1210, a SOUND DATA ANALYSIS UNIT 1220, and a DETERMINATION UNIT 1230. It may include.

The image data analyzer 1210 may analyze the image data MD to identify the plurality of users, and the first user ID UID1 representing the identified user and the user photographed in the image data MD may be the first user. A first user matching rate UID_MR1 indicating a probability of matching the user corresponding to the ID UID1 may be generated.

In addition, the image data analyzer 1210 analyzes the motion of the identified user so that the motion of the user captured in the first behavior pattern APTN1 and the image data MD representing the identified user's motion is the first behavior. A first behavior pattern matching ratio APTN_MR1 indicating a probability of matching the pattern APTN1 may be generated.

5 is a block diagram illustrating an example of an image data analyzer included in the analyzer of FIG. 4.

Referring to FIG. 5, the image data analyzer 1210 may include a first user identification circuit 1212, a first user database 1213, and a first behavior pattern analysis circuit 12. ANALYSIS CIRCUIT 1) 1214 and a REFERENCE MOVIE DB 1215.

The first user database 1213 may store body images of each of the plurality of users. For example, the first user database 1213 may include a face image, a whole body shape image, and the like of each of the plurality of users.

The first user identification circuit 1212 compares an image of a body included in the image data MD with body images of the plurality of users stored in the first user database 1213 to correspond to the body image having the highest matching rate. The user's ID and the highest matching rate may be output as a first user ID UID1 and a first user matching rate UID_MR1, respectively.

Reference image database 1215 pre-defined standardized behaviors including bathing, watching TV, washing, ironing, cleaning, moving up and down stairs, walking, washing dishes, etc. as a plurality of behavior patterns and corresponding to each of the plurality of behavior patterns. The reference image may be stored in association with each of the plurality of behavior patterns. For example, the reference image database 1215 may store a video photographing the standardized behavior as the reference image.

The first behavior pattern analysis circuit 1214 compares the motion of the body included in the image data MD with a reference image corresponding to each of the plurality of behavior patterns stored in the reference image database 1215 and has the highest matching rate. The behavior pattern corresponding to the reference image and the highest matching rate may be output as a first behavior pattern APTN1 and a first behavior pattern matching rate APTN_MR1, respectively.

Referring back to FIG. 4, the sound data analyzer 1220 analyzes the sound data SD to identify the plurality of users, and to the second user ID UID2 and the sound data SD representing the identified user. A second user matching rate UID_MR2 indicating a probability that the voice of the included user matches the voice of the user corresponding to the second user ID UID2 may be generated.

Also, the sound data analyzer 1220 infers the identified user's behavior from the sound data SD to generate a second behavior pattern APTN2 and a second behavior pattern matching ratio APTN_MR2 indicating the accuracy of the inference. can do.

6 is a block diagram illustrating an example of a sound data analyzer included in the analyzer of FIG. 4.

Referring to FIG. 6, the sound data analyzer 1220 may include a sound separation circuit 1221, a second user identification circuit 1222, and a second user database USER DB2 ( 1223), a second behavior pattern analysis circuit (ACTIVITY PATTERN ANALYSIS CIRCUIT 2) 1224, and a REFERENCE SOUND DB 1225.

The sound separation circuit 1221 may separate sound data SD into human voice data VSD and background sound data BSD.

The second user database 1223 may store voice samples of each of the plurality of users.

The second user identification circuit 1222 compares the voice data VSD with voice samples of the plurality of users stored in the second user database 1223 to identify the ID of the user corresponding to the voice sample having the highest matching rate and the voice sample. The highest matching rate may be output as the second user ID UID2 and the second user matching rate UID_MR2, respectively.

The reference sound database 1225 pre-defined standardized behaviors, including bathing, watching TV, washing, ironing, cleaning, climbing up and down the stairs, walking, washing dishes, and the like, followed by each of the plurality of behavioral patterns. The reference background sound may be stored in association with each of the plurality of behavior patterns. For example, the reference sound database 1225 may store a sound source that records background sounds generated during the standardized behavior as the reference background sound. For example, the sound of water generated during the bathing process is associated with a behavior pattern corresponding to the bath, and the sound generated by the vacuum cleaner is stored as a reference background sound in the reference sound database 1225 in association with the behavior pattern corresponding to the cleaning. Can be.

The second behavior pattern analysis circuit 1224 compares the background sound data BSD with reference background sounds corresponding to each of the plurality of behavior patterns stored in the reference sound database 1225, so that the reference background sound with the highest matching rate is obtained. The behavior pattern corresponding to and the highest matching rate may be output as the second behavior pattern APTN2 and the second behavior pattern matching rate APTN_MR2, respectively.

7 is a block diagram illustrating another example of a sound data analyzer included in the analyzer of FIG. 4.

Referring to FIG. 7, the sound data analyzer 1220-1 may include a sound separation circuit 1221, a second user identification circuit 1222, and a second user database USER DB2. 1223, ACTIVITY PATTERN ANALYSIS CIRCUIT 2 1224, REFERENCE SOUND DB 1225, ACTIVITY PATTERN ANALYSIS CIRCUIT 3 1226 And REFERENCE WORD DB 1227.

When the sound data analyzer 1220-1 of FIG. 7 is compared with the sound data analyzer 1220 of FIG. 6, the sound data analyzer 1220-1 of FIG. 7 includes a third behavior pattern analysis circuit 1226. It is the same as the sound data analyzer 1220 of FIG. 6 except that the reference word database 1227 is further included. Therefore, a description overlapping with the sound data analyzer 1220 of FIG. 6 except for the third behavior pattern analysis circuit 1226 and the reference word database 1227 will be omitted.

The reference word database 1227 pre-defined standardized behaviors, including bathing, watching TV, washing, ironing, cleaning, moving up and down stairs, walking, washing dishes, and the like, associating with each of the plurality of behavioral patterns. Speech samples for the reference words to be stored may be stored in association with each of the plurality of behavior patterns. For example, the reference word database 1227 may store a sound source recording words that can be spoken in the standardized behavior process as sound source samples for the reference words. For example, sound samples for the words soap, shampoo, warm, cool, etc. that can be spoken in the bathing process are associated with a bath-like behavioral pattern, and words such as spoon, chopsticks, bowl, pot, loofah, etc. Sound source samples for may be stored in the reference word database 1227 in association with the behavioral pattern corresponding to the dishes.

The third behavior pattern analysis circuit 1226 compares the speech data VSD with speech samples for reference words corresponding to each of the plurality of behavior patterns stored in the reference word database 1227 to match the reference words. Outputs the behavior pattern that is most related to the third behavior pattern APTN3, and the ratio of the matching words among the entire reference words associated with the third behavior pattern APTN3 accounts for the third behavior pattern matching ratio APTN_MR3. Can be output as

Referring back to FIG. 4, the determination unit 1230 may select one of the first user ID UID1 and the second user ID UID2 based on the first user matching rate UID_MR1 and the second user matching rate UID_MR2. Select to create a user ID (UID).

The determination unit 1230 selects one of the first behavior pattern APTN1 and the second behavior pattern APTN2 based on the first behavior pattern matching ratio APTN_MR1 and the second behavior pattern matching ratio APTN_MR2. (APTN) can be generated.

The determination unit 1230 may include a start time ST in which the behavior pattern APTN is first generated for the user ID UID, and an end time in which the behavior pattern APTN corresponding to the user ID UID is changed to a different pattern. FT) can be generated.

8 is a block diagram illustrating an example of a determination unit included in the analysis unit of FIG. 4.

Referring to FIG. 8, the determination unit 1230 may include a user determination circuit 1231, an behavior pattern determination circuit 1232, and a time generation circuit 1233.

The user determination circuit 1231 receives the first user matching rate UID_MR1 and the second user matching rate UID_MR2 as control signals, and receives the first user ID UID1 and the second user ID UID2 as input signals. Can be received. The user determination circuit 1231 outputs the first user ID UID1 as the user ID UID when the first user matching rate UID_MR1 is greater than the second user matching rate UID_MR2, and the second user matching rate UID_MR1. When the UID_MR2 is larger than the first user matching rate UID_MR1, the second user ID UID2 may be output as the user ID UID. Meanwhile, when the first user matching rate UID_MR1 and the second user matching rate UID_MR2 are the same, the user determination circuit 1231 may select any one of the first user ID UID1 and the second user ID UID2. It can be output as a user ID (UID).

As such, the analysis unit 1200 has a higher matching rate than the first user ID UID1 identified by analyzing the image data MD and the second user ID UID2 analyzed and identified by analyzing the sound data SD. By outputting a user ID, the identification rate for the plurality of users can be improved.

The behavior pattern determination circuit 1232 receives the first behavior pattern matching ratio APTN_MR1 and the second behavior pattern matching ratio APTN_MR2 as control signals, and receives the first behavior pattern APTN1 and the second behavior pattern APTN2. It can be received as an input signal. The behavior pattern determination circuit 1232 outputs the first behavior pattern APTN1 as the behavior pattern APTN when the first behavior pattern matching ratio APTN_MR1 is greater than the second behavior pattern matching ratio APTN_MR2, and the second behavior When the pattern matching ratio APTN_MR2 is greater than the first behavior pattern matching ratio APTN_MR1, the second behavior pattern APTN2 may be output as the behavior pattern APTN. On the other hand, when the first behavior pattern matching ratio APTN_MR1 and the second behavior pattern matching ratio APTN_MR2 are the same, the behavior pattern determination circuit 1232 may randomly select one of the first behavior pattern APTN1 and the second behavior pattern APTN2. Can be output as the behavior pattern APTN.

As described above, the analysis unit 1200 has a higher matching rate among the first behavior pattern APTN1 determined by analyzing the image data MD and the second behavior pattern APTN2 determined by analyzing the sound data SD. By outputting the user's behavior can be more accurately determined.

Meanwhile, when the analyzer 1200 includes the sound data analyzer 1220-1 illustrated in FIG. 7, the behavior pattern determination circuit 1232 may include the first behavior pattern matching ratio APTN_MR1 and the second behavior. The pattern matching ratio APTN_MR2 and the third behavior pattern matching ratio APTN_MR3 are received as control signals, and the first behavior pattern APTN1, the second behavior pattern APTN2, and the third behavior pattern APTN3 are input signals. Can be received. In this case, the behavior pattern determination circuit 1232 may determine the first behavior pattern APTN1 when the first behavior pattern matching ratio APTN_MR1 is greater than the second behavior pattern matching ratio APTN_MR2 and the third behavior pattern matching ratio APTN_MR3. Is output as the behavior pattern APTN, and when the second behavior pattern matching ratio APTN_MR2 is greater than the first behavior pattern matching ratio APTN_MR1 and the third behavior pattern matching ratio APTN_MR3, the second behavior pattern APTN2 is obtained. Output as the behavior pattern APTN, and when the third behavior pattern matching ratio APTN_MR3 is greater than the first behavior pattern matching ratio APTN_MR1 and the second behavior pattern matching ratio APTN_MR2, the third behavior pattern APTN3 It can output as a pattern APTN.

As such, the analysis unit 1200 may analyze the first behavior pattern APTN1 determined by analyzing the image data MD, the second behavior pattern APTN2 determined by analyzing the background sound data BSD, and the voice data VSD. The behavior of the plurality of users may be determined more accurately by outputting a behavior pattern having a higher matching rate among the third behavior patterns APTN3 determined by analyzing.

The time generation circuit 1233 receives the user ID UID and the behavior pattern APTN, outputs the time at which the behavior pattern APTN was first generated for the user ID UID as the start time ST, and the user. The time at which the behavior pattern APTN corresponding to the ID UID is changed to a different pattern may be output as the end time FT.

As described above, the daily health information measuring device 10 included in the daily health information providing system 10000 according to the present invention is a plurality of cameras 2000 and a plurality of microphones without using a sensor attached to the body. Using only 3000, a behavior pattern according to daily behaviors of a plurality of users may be identified and provided to the cloud server 20. Therefore, the user using the daily health information providing system 10000 does not directly act, such as living with a sensor device attached to the body to measure his or her health information, or inputting data on a specific activity into the measuring device. Without knowing the behavior pattern according to their daily behavior can be provided to the cloud server 20.

9 is a block diagram illustrating an example of a cloud server included in the daily health information providing system of FIG. 1.

Referring to FIG. 9, the cloud server 20 may include a receiver unit 5100, a first health information database 1200, a verification unit 5200, and a second health information database. (HEALTH INFORMATION DB2) 5400 and INQUIRY UNIT (5500).

The receiver 5100 may receive the behavioral data AD from the everyday health information measuring device 10 and store the behavior data AD in the first health information database 5200. That is, the receiver 5100 associates the user ID UID, the behavior pattern APTN, the start time ST, and the end time FT included in the behavior data AD with the first health information database 5200. Can be stored in Accordingly, the first health information database 5200 may accumulate and store behavior data AD representing the daily actions of the plurality of users provided from the daily health information measuring device 10.

The identification unit 5300 reads the behavior data AD stored in the first health information database 5200, and the user's mobile terminal corresponding to the user ID UID included in each of the read behavior data AD. 30 may transmit the read behavior data (AD).

In one embodiment, each of the mobile terminal 30 of the plurality of users transmits a data request signal (REQ) including the user ID of the corresponding user to the confirmation unit 5300, the confirmation unit 5300 is In response to the data request signal REQ, the movement of reading the behavior data AD including the user ID included in the data request signal REQ from the first health information database 5200 and transmitting the data request signal REQ. It may transmit to the terminal 30.

In another embodiment, the verification unit 5300 periodically reads behavior data AD stored in the first health information database 5200 and corresponds to a user ID included in each of the read behavior data AD. The read behavior data AD may be transmitted to the mobile terminal 30.

Each of the mobile terminals 30 receives the user data UID, the behavior pattern APTN, the start time ST, and the end time included in the behavior data AD when receiving the behavior data AD from the confirmation unit 5300. When the time FT is provided to the user, and in response thereto, an acknowledgment command for the behavior data AD is received from the user, the acknowledgment signal CS is transmitted to the confirmation unit 5300, and the behavior data AD is received from the user. When receiving a correction command for the correcting at least one of the user ID (UID), behavior pattern (APTN), start time (ST) and end time (FT) included in the behavior data (AD) based on the correction command The modified behavior data CAD may be generated and transmitted to the verification unit 5300.

FIG. 10 is a diagram for describing an example of an operation of a mobile terminal included in the daily health information providing system of FIG. 1.

As illustrated in FIG. 10, each of the mobile terminals 30 may receive a user ID UID and a behavior pattern APTN included in the behavior data AD when receiving the behavior data AD from the confirmation unit 5300. , The start time ST and the end time FT can be displayed on the screen.

The user of the mobile terminal 30 may check the contents of the behavior data AD displayed on the screen, and select the approval button 31 when the contents of the behavior data AD coincide with his / her past behavior. . The mobile terminal 30 may generate the approval command in response thereto. On the other hand, if the contents of the behavioral data AD do not coincide with the actual behavior of the past, the user of the mobile terminal 30 has a user ID (UID), behavior pattern (APTN), start time (ST) and end time ( At least one of the FT) may be modified and the correct button 32 may be selected. The mobile terminal 30 may generate the modification command in response thereto.

When the approval command is generated, the mobile terminal 30 may transmit an approval signal CS for the behavior data AD to the confirmation unit 5300. On the other hand, the mobile terminal 30 is the user ID (UID), behavior pattern (APTN), start time (ST) and end time included in the behavior data (AD) based on the user input when the correction command is generated At least one of the FT may generate the modified corrected behavior data CAD and transmit the modified behavior data CAD to the verification unit 5300.

FIG. 11 is a diagram for describing another example of an operation of a mobile terminal included in the daily health information providing system of FIG. 1.

As illustrated in FIG. 11, each of the mobile terminals 30 displays an avatar 33 shaped as a character on the screen when receiving the behavior data AD from the identification unit 5300. 33) the user ID UID, the behavior pattern APTN, the start time ST, and the end time FT included in the behavior data AD may be output as voice.

The user of the mobile terminal 30 informs the avatar 33 that the avatar 33 approves the behavioral data AD in a conversational form when the contents of the behavioral data AD spoken by the avatar 33 correspond to his or her past behavior. The user ID (UID), behavior pattern (APTN), and start time included in the behavior data AD when the contents of the behavior data AD expressed by the avatar 33 do not correspond to their past behaviors. Modifications to at least one of the ST) and the end time FT may be expressed in an interactive form.

The mobile terminal 30 analyzes the voice of the user who is talking to the avatar 33 to analyze the user ID (UID), behavior pattern (APTN), start time (ST), and end time (ST) included in the behavior data AD. Generate the correction command for at least one of a user ID (UID), a behavior pattern (APTN), a start time (ST), and an end time (FT) included in the approval command or behavior data (AD) for the FT). Can be.

When the approval command is generated, the mobile terminal 30 may transmit an approval signal CS for the behavior data AD to the confirmation unit 5300. On the other hand, the mobile terminal 30 is the user ID (UID), behavior pattern (APTN), start time (ST) and end included in the behavior data (AD) based on the contents of the user's conversation when the correction command is generated At least one of the time FT may generate the corrected corrective behavior data CAD and transmit the modified behavior data CAD to the verification unit 5300.

9, when the confirmation unit 5300 receives the approval signal CS for the behavioral data AD from the mobile terminal 30, the verification unit 5300 transmits the behavioral data AD to the second health information database 5400. Can be stored. On the other hand, when receiving corrected behavioral data CAD from the mobile terminal 30, the verification unit 5300 may store the modified behavioral data CAD in the second health information database 5400. Thereafter, the identification unit 5300 may delete the behavior data AD transmitted to the mobile terminal 30 from the first health information database 5200.

As described above, the daily health information measuring apparatus 10 included in the daily health information providing system 10000 according to the present invention uses a plurality of cameras 2000 and a plurality of microphones 3000 to provide a plurality of users. The behavior pattern according to their daily behaviors are grasped to provide behavior data (AD) to the cloud server 20. Therefore, the behavior data AD generated by the everyday health information measuring device 10 may be misrecognized by the user or may not match the actual behavior of the user. However, the cloud server 20 included in the everyday health information providing system 10000 according to the present invention may prepare behavior data AD representing the daily actions of the plurality of users received from the everyday health information measuring device 10. 1 accumulates and stores in the health information database 5200 and transmits the behavioral data (AD) stored in the first health information database 5200 to the mobile terminal 30 of the corresponding user to be approved or modified by the user and approved. The adjusted behavior data AD or the modified corrected behavior data CAD are accumulated and stored in the second health information database 5400. In this way, the user's approval and correction process for the behavior data (AD) generated by the everyday health information measuring device 10, the daily health information providing system 10000 according to the present invention is the daily behavior of the plurality of users Can be identified more accurately.

Referring back to FIG. 9, the inquiry unit 5500 receives an inquiry user ID S_UID and an inquiry period S_DR from an external device. The inquiry period S_DR may include an inquiry start time and an inquiry end time. The inquiring unit 5500 may perform the behavior patterns ATPNs and durations of the behavior patterns APTNs of the inquiry user corresponding to the inquiry user ID S_UID during the inquiry period S_DR from the second health information database 5400. (TMs), and calculates the total calorie amount (C_CAL) consumed by the inquiry user during the inquiry period (S_DR) based on the found behavior patterns (APTNs) and durations (TMs) to the external device. Can provide.

12 is a block diagram illustrating an example of an inquiry unit included in a cloud server of FIG. 9.

Referring to FIG. 12, the search unit 5500 may include a search circuit SEARCH CIRCUIT 5510, a calculation circuit CALCUIT 5520, and a calorie database 5530.

The calorie database 5530 defines predefined behaviors, including bathing, watching TV, laundry, ironing, cleaning, moving up and down stairs, walking, washing dishes, and the like, as a plurality of behavior patterns and a unit for each of the plurality of behavior patterns. You can save calories burned per hour.

FIG. 13 is a diagram illustrating an example of a calorie database included in an inquiry unit of FIG. 12.

Referring to FIG. 13, the calorie database 5530 may include a behavior pattern field APTN_F and a calorie field CAL_F.

The behavior pattern field APTN_F stores a plurality of behavior patterns representing standardized behaviors including bathing, watching TV, washing, ironing, cleaning, moving up and down stairs, walking, washing dishes, etc., and the calorie field CAL_F corresponds to a corresponding pattern. When performing the behavior pattern (APTN) it is possible to store the amount of calories consumed on average for a unit time (eg 1 minute).

Referring back to FIG. 12, the search circuit 5510 receives the inquiry user ID S_UID and the inquiry period S_DR from the external device, and the inquiry user for the inquiry period S_DR from the second health information database 5400. Search for the start time ST and end time FT of the behavior patterns APTNs and behavior patterns APTNs of the inquiry user corresponding to the ID S_UID, and the retrieved start time ST and end time FT ) May be used to generate the durations TMs of each of the behavior patterns APTNs.

The calculation circuit 5520 reads the calories burned per unit time for each of the behavior patterns APTNs received from the retrieval circuit 5510 from the calorie database 5530, the behavior patterns APTNs, and the behavior patterns APTNs. ) Total calories burned by the inquiry user corresponding to the inquiry user ID (S_UID) during the inquiry period (S_DR) using the amount of calories burned per unit time for each of the durations (TMs) and behavior patterns (APTNs) (C_CAL) may be calculated and provided to the external device.

In one embodiment, as shown in FIG. 1, the external device may be a medical institution server 40 installed in a medical institution such as a hospital or a pharmacy. In this case, the medical institution server 40 transmits the user ID S_UID and the period S_DR of the patient to be queried to the cloud server 20 and the patient to be queried from the cloud server 20 is inquiries. The total calorie amount C_CAL consumed during (S_DR) may be received. As such, the medical institution can easily check the health status of the patient because the medical institution can effectively receive the total calorie amount (C_CAL) consumed by the patient for a certain period of time using the daily health information providing system 10000 according to the present invention. It can be used to determine the content of prescriptions for patients.

In another embodiment, although not shown in FIG. 1, the external device may be mobile terminals 30 possessed by the plurality of users. In this case, a user who uses the daily health information providing system 10000 according to the present invention lives with the sensor device attached to the body to measure his or her health information or inputs data on a specific activity into the measuring device. You can easily grasp your health information through your mobile terminal anytime and anywhere without having to act directly.

As described above, the daily health information providing system 10000 according to the present invention uses only a plurality of cameras 2000 and a plurality of microphones 3000 without using a sensor attached to a body, and thus provides the daily life of a plurality of users. Effective calorie consumption can be measured and provided. Therefore, the user using the daily health information providing system 10000 according to the present invention, such as living with the sensor device attached to the body in order to measure their health information, or inputting data on a specific activity into the measuring device, etc. You can easily access your health information anywhere, anytime, without taking direct action.

FIG. 14 is a block diagram illustrating another example of an apparatus for measuring everyday health information included in the everyday health information providing system of FIG. 1, and FIG. 15 is a block illustrating another example of a cloud server included in the everyday health information providing system of FIG. 1. It is also.

Referring to FIG. 14, the routine health information measuring apparatus 10-1 may include a user server 1000-1, a plurality of cameras 2000, a plurality of microphones 3000, and a plurality of thermal imaging cameras 4000. It may include. The user server 1000-1 may include a communication unit 1100-1 and an analysis unit 1200-1.

When comparing the everyday health information measuring device 10-1 of FIG. 14 and the everyday health information measuring device 10 of FIG. 2, the everyday health information measuring device 10-1 of FIG. 14 includes a plurality of thermal imaging cameras ( And a user server 1000-1, except that the user server 1000-1 additionally performs a function of processing the thermal image data TMD provided from the plurality of thermal cameras 4000. It is the same as the health information measuring device 10. Therefore, the description overlapping with the routine health information measuring apparatus 10 of FIG. 2 except for the matters associated with the plurality of thermal imaging cameras 4000 will be omitted.

In addition, when comparing the cloud server 20-1 of FIG. 15 and the cloud server 20 of FIG. 9, the cloud server 20-1 of FIG. 15 is obtained from the everyday health information measuring apparatus 10-1 of FIG. 14. It is the same as the cloud server 20 of FIG. 9 except that the function of processing the received thermal image data TMD is additionally performed. Therefore, descriptions overlapping with the cloud server 20 of FIG. 9 except for the matters related to the processing of the thermal image data TMD are omitted.

Each of the plurality of thermal imaging cameras 4000 is installed adjacent to each of the plurality of cameras 2000, and infrared imaging of the indoor space is performed to generate thermal image data TMD to the analysis unit 1200-1. to provide.

The analyzer 1200-1 analyzes the image data MD, the sound data SD, and the thermal image data TMD from the camera 2000, the microphone 3000, and the thermal imaging camera 4000, which are installed adjacent to each other. Receive. The analysis unit 1200-1 analyzes the image data MD and the sound data SD, and displays a user ID (UID) indicating a user identified among the plurality of users, the identified user's behavior pattern (APTN), A start time ST and an end time FT of the behavior pattern APTN are generated. In addition, the analysis unit 1200-1 measures the body temperature of the identified user based on the thermal image data TMD, and measures the measured body temperature TEMP as a user ID (UID), behavior pattern (APTN), and start time. To the communication unit 1100-1 together with ST and end time FT.

The communication unit 1100-1 generates behavior data (AD) including a user ID (UID), a behavior pattern (APTN), a start time (ST), an end time (FT), and a body temperature (TEMP) using wired or wireless communication. Can be transmitted to the cloud server 20.

As described above, the behavior data AD received from the routine health information measuring apparatus 10-1 is combined with the user ID UID, behavior pattern APTN, start time ST, and end time FT. It also includes the user's temperature (TEMP), which corresponds to the ID (UID). In addition, since the cloud server 20-1 and the mobile terminal 30 perform operations as described with reference to FIGS. 9 to 13, the second health information database 5400 includes a user ID (UID) and a behavior pattern (APTN). The start time (ST), end time (FT), and body temperature (TEMP) are accumulated and stored.

Referring to FIG. 15, the inquiry unit 5500-1 receives an inquiry user ID S_UID and an inquiry period S_DR from an external device. The inquiry period S_DR may include an inquiry start time and an inquiry end time. The inquiring unit 5500-1 starts the behavior patterns ATPNs and behavior patterns APTNs of the inquiry user corresponding to the inquiry user ID S_UID during the inquiry period S_DR from the second health information database 5400. Retrieve time ST, end time FT and body temperature TEMP, and generate durations TMs of each of behavior patterns APTNs using retrieved start time ST and end time FT can do. The inquiry unit 5500-1 calculates the total calorie amount C_CAL consumed by the inquiry user during the inquiry period S_DR based on the searched behavior patterns APTNs and durations TMs and the external device. The change in the body temperature (TEMP_VA) of the inquiry user may be provided to the external device in the form of a graph during the inquiry period S_DR based on the retrieved body temperature TEMP.

As described above, the daily health information providing system 10000 according to the present invention is provided with a plurality of cameras 2000, a plurality of microphones 3000, and a plurality of thermal imaging cameras without using a sensor attached to a body. Using only 4000) it is possible to effectively measure and provide calorie consumption and body temperature change according to the daily behavior of a plurality of users. Therefore, the user using the daily health information providing system 10000 according to the present invention, such as living with the sensor device attached to the body in order to measure their health information, or inputting data on a specific activity into the measuring device, etc. You can easily access your health information anywhere, anytime, without taking direct action.

16 is a flowchart illustrating a method of providing daily health information according to an embodiment of the present invention.

Referring to FIG. 16, image data of the indoor space is generated through a plurality of cameras distributed and installed in an indoor space in which a plurality of users live (step S100). In addition, the sound generated in the indoor space is detected through a plurality of microphones installed adjacent to the plurality of cameras to generate sound data (step S200). Generating the image data (S100) and generating the sound data (S200) are performed at the same time.

The apparatus for measuring everyday health information identifies the plurality of users based on the image data and the sound data respectively received from cameras and microphones installed adjacent to each other, and generates a user ID indicating the identified user. Generating a behavior pattern corresponding to a user's action, generating a start time at which an operation corresponding to the behavior pattern starts and an end time at which an operation corresponding to the behavior pattern ends, thereby generating the generated user ID, behavior pattern, The behavior data including the start time and the end time is transmitted to the cloud server (step S300).

The cloud server transmits the behavioral data to the user's mobile terminal, and receives one of the corrected behavioral data and the approval signal in which the behavioral data has been partially modified from the mobile terminal (step S400).

The cloud server receives the inquiry user ID and the inquiry period from an external device, and the behavior patterns and the behavior patterns of the inquiry user corresponding to the inquiry user ID during the inquiry period based on the behavior data and the corrected behavior data. The respective durations are searched, and the total calorie amount consumed by the inquiry user during the inquiry period is calculated and provided to the external device based on the found behavior patterns and the durations (step S500).

FIG. 17 is a flowchart illustrating in detail a step in which the cloud server of FIG. 16 transmits behavior data to a user's mobile terminal and receives one of modified behavior data and an acknowledgment signal in which the behavior data is partially modified from the mobile terminal.

Referring to FIG. 17, the cloud server receives the behavioral data from the everyday health information measurement device, stores the behavioral data in a first health information database (step S410), and accumulates and stores it in the first health information database. The behavior data may be read and the behavior data may be transmitted to the mobile terminal of the user corresponding to the user ID included in the behavior data (step S420).

When the cloud server receives the approval signal from the mobile terminal, the cloud server stores the behavior data in a second health information database (step S430), and when receiving the corrected behavior data from the mobile terminal, the corrected behavior data. It may be stored in the second health information database (step S440).

Thereafter, the cloud server receives an inquiry user ID and an inquiry period from the external device, and durations of behavior patterns and behavior patterns of the inquiry user corresponding to the inquiry user ID during the inquiry period from the second health information database. The total calorie amount consumed by the inquiry user during the inquiry period may be provided to the external device based on the found behavior patterns and durations.

The routine health information providing method of FIG. 16 may be performed by the routine health information providing system 10000 of FIG. 1. Since the configuration and operation of the daily health information providing system 10000 illustrated in FIG. 1 have been described in detail with reference to FIGS. 1 to 15, detailed descriptions of the steps included in the daily health information providing method of FIG. 16 are omitted. do.

 As described above, the method for providing daily health information according to the present invention effectively measures calorie consumption according to daily actions of a plurality of users by using only a plurality of cameras and a plurality of microphones without using a sensor attached to the body. Can provide. Therefore, through the method of measuring the daily health information according to the present invention, the user does not perform direct actions such as living with the sensor device attached to the body or inputting data on a specific activity into the measuring device in order to measure his health information. You can easily find your health information anywhere, anytime.

The system for providing daily health information and the method for providing daily health information according to embodiments of the present invention are applied to a specific space where a plurality of users live to effectively measure and provide health information related to the daily life habits of the plurality of users. It can be usefully used.

As described above, the present invention has been described with reference to a preferred embodiment of the present invention, but those skilled in the art may vary the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. It will be understood that modifications and changes can be made.

Claims (20)

It is installed in a space where a plurality of users living, monitors the daily behavior of the plurality of users to generate image data and sound data, analyze the image data and the sound data to the user ID of each of the plurality of users, A daily health information measuring device for generating and transmitting behavior data including a behavior pattern corresponding to each operation of the plurality of users, a start time and an end time of the operation corresponding to the behavior pattern; Mobile terminals possessed by the plurality of users and each storing a user ID of a corresponding user; And The behavior data received from the daily health information measuring device is transmitted to the mobile terminal of the user corresponding to the user ID included in the behavior data, wherein the behavior data from the mobile terminal is partially modified corrected behavior data and the approval signal Receiving one, receiving the inquiry user ID and the inquiry period, the cloud to calculate and output the total amount of calories consumed during the inquiry period by the inquiry user corresponding to the inquiry user ID based on the behavior data and the corrected behavior data Daily health information providing system comprising a server. The method of claim 1, wherein the cloud server, A first health information database and a second health information database; A receiving unit which receives the behavioral data from the everyday health information measuring device and stores the behavioral data in the first health information database; Reading the behavior data stored in the first health information database, transmitting the behavior data to a mobile terminal of a user corresponding to a user ID included in the behavior data, and receiving the approval signal from the mobile terminal; A confirmation unit storing behavioral data in the second health information database and storing the corrected behavioral data in the second health information database when receiving the corrected behavioral data from the mobile terminal; And Receive the inquiry user ID and the inquiry period to retrieve behavior patterns of the inquiry user and durations of the behavior patterns corresponding to the inquiry user ID from the second health information database during the inquiry period, and the retrieved behavior And an inquiry unit for calculating and outputting the total calorie amount consumed by the inquiry user during the inquiry period based on patterns and durations. The method of claim 2, wherein the confirmation unit reads behavior data including a user ID included in the data request signal from the first health information database when the data request signal including a user ID is received from the mobile terminal. Daily health information providing system, characterized in that the transmission to the mobile terminal. The mobile terminal of claim 2, wherein the verification unit periodically reads behavior data stored in the first health information database and transmits the read behavior data to a mobile terminal corresponding to a user ID included in each of the read behavior data. Daily health information providing system, characterized in that. The mobile terminal of claim 2, wherein each of the mobile terminals displays a user ID, a behavior pattern, a start time, and an end time included in the behavior data when receiving the behavior data from the confirmation unit, and respond to a user's approval command. Provide the approval signal to the confirmation unit, modify the at least one of a user ID, a behavior pattern, a start time, and an end time included in the behavior data in response to a user's corrective command to generate the corrected behavior data; Daily health information providing system, characterized in that provided to the identification unit. The method of claim 5, wherein each of the mobile terminals displays an avatar shaped as a character when receiving the behavior data from the identification unit, and includes a user ID, a behavior pattern, and the like included in the behavior data through the avatar. Outputs a start time and an end time by voice, analyzes a voice of a user who is talking with the avatar, and receives the approval command and the user ID for the user ID, the behavior pattern, the start time, and the end time; And generating one of the modification commands for at least one of a behavior pattern, the start time, and the end time. The method of claim 2, wherein the inquiry unit, A calorie database that stores calories burned per unit time for each of the plurality of behavior patterns; Receiving the inquiry user ID and the inquiry period from an external device, and starting and ending times of the behavior patterns of the inquiry user and the behavior patterns corresponding to the inquiry user ID during the inquiry period from the second health information database. A search circuit for searching and generating durations of the behavior patterns using the retrieved start time and end time to output the behavior patterns and the durations; And The total calorie amount consumed by the inquiry user during the inquiry period is calculated by using the calories burned per unit time for each of the found behavior patterns, the durations, and the retrieved behavior patterns read from the calorie database. Everyday health information providing system comprising a calculation circuit for providing to an external device. The inquiry period of claim 1, wherein each of the mobile terminals provides the inquiry user ID and the inquiry period to the everyday health information measuring device, and the inquiry user corresponding to the inquiry user ID from the everyday health information measuring device. Daily health information providing system, characterized in that receiving the total amount of calories consumed during. The medical institution server according to claim 1, wherein the medical institution server provides the inquiry user ID and the inquiry period to the everyday health information measuring device, and the inquiry user corresponding to the inquiry user ID from the everyday health information measuring device is consumed during the inquiry period. Daily health information providing system, characterized in that receiving the total amount of calories. According to claim 1, The daily health information measuring device, A plurality of cameras distributed in spaces in which the plurality of users live and each providing the image data; A plurality of microphones installed adjacent to the plurality of cameras, each of which provides the sound data; Generate the user ID by identifying the plurality of users based on the image data and the sound data received from cameras and microphones installed adjacent to each other, and analyze the motion of the identified user to generate the behavior pattern. An analysis unit generating a start time and an end time of an operation corresponding to the behavior pattern; And And a communicator configured to generate the behavior data including the user ID, the behavior pattern, the start time, and the end time, and transmit the generated behavior data to the cloud server. The method of claim 10, wherein the analysis unit, An image of analyzing the image data to identify the plurality of users to generate a first user ID and a first user matching rate, and analyzing the identified user's motion to generate a first behavior pattern and a first behavior pattern matching rate Data analysis unit; A sound for analyzing the sound data to identify the plurality of users to generate a second user ID and a second user matching rate, and to infer the identified user's behavior to generate a second behavior pattern and a second behavior pattern matching rate Data analysis unit; And Select one of the first user ID and the second user ID to generate the user ID based on the first user matching rate and the second user matching rate, and generate the first behavior pattern matching rate and the second user ID. Select one of the first behavior pattern and the second behavior pattern based on a behavior pattern matching rate to generate the behavior pattern, and the start time and the behavior pattern at which the behavior pattern was first generated for the user ID And a determination unit for generating the end time changed to a different pattern. The method of claim 11, wherein the image data analyzer, A first user database storing body images of each of the plurality of users; The image of the body included in the image data is compared with the body images of the plurality of users stored in the first user database, and the ID and the highest matching rate of the user corresponding to the body image having the highest matching rate are respectively determined. A first user identification circuit outputting a first user ID and the first user matching rate; A reference image database storing a reference image corresponding to each of a plurality of behavior patterns in association with each of the plurality of behavior patterns; And The motion pattern corresponding to the reference image having the highest matching rate and the highest matching rate by comparing the motion of the body included in the image data with reference images corresponding to each of the plurality of behavior patterns stored in the reference image database. And a first behavior pattern analysis circuit for outputting the first behavior pattern and the first behavior pattern matching ratio, respectively. The method of claim 11, wherein the sound data analysis unit, A sound separation circuit for separating the sound data into human voice data and background sound data; A second user database for storing voice samples of each of the plurality of users; The voice data is compared with voice samples of the plurality of users stored in the second user database, and the ID of the user corresponding to the voice sample with the highest matching rate and the highest matching rate are respectively determined by the second user ID and the first value. A second user identification circuit outputting as a two user matching rate; A reference sound database for storing reference background sounds corresponding to each of a plurality of behavior patterns in association with each of the plurality of behavior patterns; And The background sound data is compared with reference background sounds corresponding to each of the plurality of behavior patterns stored in the reference sound database, and the behavior pattern corresponding to the reference background sound having the highest matching rate and the highest matching rate are respectively determined. And a second behavior pattern analysis circuit output as a second behavior pattern and the second behavior pattern matching ratio. The method of claim 13, wherein the sound data analysis unit, A reference word database for storing speech samples for reference words associated with each of a plurality of behavior patterns in association with each of the plurality of behavior patterns; And Compare the speech data with speech samples for reference words associated with each of the plurality of behavior patterns stored in the reference word database to output a behavior pattern that is most associated with matching reference words as a third behavior pattern. And a third behavior pattern analysis circuit for outputting, as a third behavior pattern matching ratio, a ratio of matching words among all reference words associated with the third behavior pattern. . The method of claim 11, wherein the determination unit, The first user ID is output as the user ID when the first user matching rate is greater than the second user matching rate, and the second user ID when the second user matching rate is greater than the first user matching rate. A user determination circuit which outputs a as the user ID; Outputting the first behavior pattern as the behavior pattern when the first behavior pattern matching ratio is greater than the second behavior pattern matching ratio, and when the second behavior pattern matching ratio is greater than the first behavior pattern matching ratio A behavior pattern determination circuit that outputs a second behavior pattern as the behavior pattern; And Receiving the user ID and the behavior pattern, outputting a time at which the behavior pattern is first generated for the user ID as the start time, and ending the time when the behavior pattern is changed to a different pattern for the user ID And a time generation circuit for outputting as time. The apparatus of claim 10, further comprising a plurality of thermal imaging cameras installed in a space where the plurality of users live and each providing thermal image data to the analysis unit. The everyday health information measuring device measures the body temperature of the identified user based on the thermal image data received from the thermal imaging camera installed adjacent to the camera and the microphone, and measures the measured body temperature, the user ID, and the behavior. Transmit the behavior data including the pattern, the start time and the end time to the cloud server, And the cloud server provides a change in temperature of the inquiry user during the inquiry period based on the behavior data. Generating image data by photographing a space where a plurality of users live; Detecting sound generated in a space where the plurality of users live and generating sound data; The apparatus for measuring everyday health information identifies the plurality of users based on the image data and the sound data to generate the user ID, generates the behavior pattern corresponding to the identified user's motion, and generates the behavior pattern. Generating the start time and the end time of a corresponding action, and transmitting the behavior data including the user ID, the behavior pattern, the start time and the end time to a cloud server; Transmitting, by the cloud server, the behavioral data to a user's mobile terminal, and receiving, from the mobile terminal, one of the modified behavioral data and the approval signal in which the behavioral data is partially modified; And And calculating, by the cloud server, the total calorie amount consumed during the inquiry period by the inquiry user corresponding to the inquiry user ID based on the behavior data and the corrected behavior data. The method of claim 17, wherein the cloud server transmits the behavioral data to a user's mobile terminal, and receives one of the modified behavioral data and the approval signal from which the behavioral data is partially modified from the mobile terminal. Receiving, by the cloud server, the behavioral data from the everyday health information measuring device and storing the behavioral data in a first health information database; Reading the behavior data stored in the first health information database and transmitting the behavior data to a mobile terminal of a user corresponding to a user ID included in the behavior data; Storing the behavioral data in a second health information database when receiving the approval signal from the mobile terminal; And And storing the corrected behavioral data in the second health information database when receiving the corrected behavioral data from the mobile terminal. The mobile terminal of claim 18, wherein when the mobile terminal receives the behavior data from the cloud server, the mobile terminal displays a user ID, a behavior pattern, a start time, and an end time included in the behavior data, and in response to a user's approval command. Providing an approval signal to the confirmation unit, in response to a user's corrective command to modify at least one of the user ID, behavior pattern, start time and end time included in the behavior data to generate the corrective behavior data to the cloud server Daily health information providing method, characterized in that provided to. The mobile terminal of claim 19, wherein the mobile terminal displays an avatar shaped as a character when receiving the behavior data from the cloud server, and includes a user ID, a behavior pattern, and a start time included in the behavior data through the avatar. And outputting an end time as a voice and analyzing a voice of a user who is talking with the avatar, and confirming the user ID, the behavior pattern, the start time and the end time, the approval command and the user ID, and the behavior pattern. And generating one of the correction commands for at least one of the start time and the end time.

Images