JP7622841B2 - Behavior determination device, method, and program - Google Patents

Description

One aspect of the present invention relates to an action determination device that determines the state of an action, for example when two people perform an action that includes physical contact, and an action determination method and program executed by the device.

In recent years, body-to-body communication technology has been attracting attention as one type of short-range wireless communication technology. Body-to-body communication technology is a communication technology that uses the human body as a transmission path, and when people carrying terminals come into contact with each other, information is transmitted between the terminals via each person's body (see, for example, Patent Document 1, Non-Patent Document 2 or 3).

Using this technology, for example, when a person shakes hands in a social setting such as an office or event venue, this action can be recorded in a behavioral history, or when an action involving contact takes place between a medical professional or caregiver and a patient or person being cared for in a medical or nursing care setting, this action can be recorded in a work log, etc.

Japanese Patent No. 4069061

Yuichi Kado, Mitsuru Shinagawa, "RedTacton: Near-Body Electric Field Communication Technology and Its Applications," NTT Journal, January 2010, Internet <URL; https://www.ntt.co.jp/journal/1001/files/jn201001016.pdf> Mitsuru Shinagawa, "Communication Technology Using the Human Body as a Transmission Path," Journal of the Institute of Image Information and Television Engineers, Vol. 63, No. 11, pp. 1525-1530, 2009

However, while body-to-body communication technology can detect who has come into contact with whom, it cannot detect who attempted to make contact first. For this reason, when an action involving contact is carried out between people, it is difficult to obtain a more detailed understanding of the circumstances of that action.

This invention was made in light of the above-mentioned circumstances, and aims to provide technology that enables a more detailed understanding of the circumstances of actions, including contact between people.

In order to solve the above problem, a first aspect of the action determination device or method according to the present invention is to, when a device for determining an action including contact between a first subject and a second subject is executed, detect a first body movement of the first subject and the second subject that is a precursor of the action and a second body movement at the time of the action, respectively, and store the detection times. Then, when the contact due to the action occurs between the first subject and the second subject, the detection times of the first body movement and the second body movement are transmitted between the terminals respectively held by the first subject and the second subject, the transmitted detection times of the first body movement and the detection times of the second body movement are compared, and the start order of the action between the first subject and the second subject is determined based on the comparison result, and action determination information including information representing the determined start order of the action is generated and stored.

In order to solve the above problem, a second aspect of the action determination device or method according to the present invention is to determine an action including contact between a first subject and a second subject by using human body communication between the first subject and the second subject, by first detecting a first body movement that is a precursor of the action and a second body movement at the time of the action in the first subject and the second subject, respectively, and storing the detection times. Then, when the contact due to the action occurs between the first subject and the second subject, the detection times of the first body movement and the second body movement are transmitted between the first subject and the second subject using the human body communication, the transmitted detection times of the first body movement and the second body movement are compared, and the start order of the action between the first subject and the second subject is determined based on the comparison result, and action determination information including the determination result is generated.

According to the first and second aspects of the present invention, for example, when an action involving contact between people occurs, it is possible to determine not only whether or not contact occurred, but also the start order of the action, which makes it possible to later check the situation in more detail when an unexpected action such as a violent act occurs. Also, when ordinary actions such as shaking hands or exchanging business cards are performed, the start order of the action at that time can be recorded, making it possible to later look back on the situation in detail.

In other words, according to each aspect of the present invention, it is possible to provide technology that enables a more detailed understanding of the circumstances of actions, including contact between people.

FIG. 1 is a diagram showing an example of the configuration of an action management system including an action determination device according to an embodiment of the present invention. FIG. 2 is a block diagram showing an example of a hardware configuration of an action determination device according to an embodiment of the present invention. FIG. 3 is a block diagram showing an example of a software configuration of the action determination device according to an embodiment of the present invention. FIG. 4 is a flowchart showing the procedure and contents of the action determination process executed by the action determination device shown in FIGS. FIG. 5 is a diagram for explaining an example of the operation of the action determination device when an action including contact is performed between users. FIG. 6 is a diagram showing an example of action determination information obtained by the action determination device shown in FIG.

Below, an embodiment of the present invention is described with reference to the drawings.

[One embodiment]
In one embodiment of the present invention, an example is given of a case where an action including contact is performed between a caregiver and a person being cared for in a care setting, and this action is determined using a communication terminal of a human body communication system as an action determination device.

(Configuration example)
(1) System FIG. 1 is a diagram showing an example of the overall configuration of an action management system including an action determination device according to an embodiment of the present invention.

The system of one embodiment utilizes a human body communication system HC. When a contact action occurs between the caregiver U1 and the care recipient U2, the human body communication system HC transmits a communication signal between the communication terminals _Tu1 and _Tu2 carried by each of them while in contact with their bodies, using each of the human bodies as a transmission path. In this embodiment, the communication terminals _Tu1 and _Tu2 function as the action determination device according to the present invention. The communication terminals _Tu1 and _Tu2 determine the situation of the contact action that occurred between the caregiver U1 and the care recipient U2, and transmit action determination information representing the determination result to the management terminal WT.

The management terminal WT may be, for example, a personal computer, and may be managed by, for example, a nursing care facility. The management terminal WT may also be a mobile information terminal such as a smartphone or tablet terminal carried by the caregiver U1.

The management terminal WT receives the activity determination information transmitted from the communication terminals _Tu1 and _Tu2 of the human body communication system, and records the received activity determination information in the activity history database. When an output request for the activity determination information is input, the management terminal WT reads out the activity determination information from the activity history database and displays it on the display of the management terminal WT, or transmits it to a terminal used by the family of the care recipient, for example.

The system according to one embodiment includes a server device SV. The server device SV is, for example, a server computer provided on the cloud or the Web, and is used to download application programs required for the action determination process to the management terminal WT or the communication terminals _Tu1 and _Tu2 of the human body communication system, and to receive and collectively manage action determination information transferred from a plurality of management terminals WT.

The action determination information transmitted from the communication terminals _Tu1 and _Tu2 of the human body communication system may be configured to be transmitted directly to the server device SV without passing through the administrator terminal WT.

The network NW is composed of a wide area network including, for example, the Internet, and an access network for accessing this wide area network. As the access network, a wired or wireless LAN (Local Area Network) or a wired or wireless public network is used, but other communication lines such as CATV lines may also be used.

(2) Communication terminals _Tu1 and _Tu2
2 and 3 are block diagrams showing an example of the hardware configuration and the software configuration of the communication terminals _Tu1 and _Tu2 each having a function as an action determination device according to an embodiment of the present invention.

The communication terminals _Tu1 and _Tu2 each include a control unit 1 using a hardware processor such as a central processing unit (CPU). A storage unit having a program storage unit 2 and a data storage unit 3, a sensor interface (hereinafter, the interface will be abbreviated as I/F) unit 4, and a communication I/F unit 5 are connected to the control unit 1 via a bus 6.

A motion sensor 7 and a clock 8 are connected to the sensor I/F unit 4. The motion sensor 7 is, for example, a vibration sensor or an acceleration sensor, and detects vibrations caused by sudden movements of the arms or legs of the caregiver U1 or the care recipient U2. The sensor I/F unit 4 converts the detection signal of the vibration detected by the motion sensor 7 into digital data and inputs it to the control unit 1. The clock 8 measures the current time and outputs the measured data, and is used by the control unit 1 to obtain the detection time of the vibration. The clock 8 can be substituted by a software timer of the control unit 1. A position sensor using a GPS (Global Positioning System) or the like may also be connected to the sensor I/F unit 4. The parts to be detected when detecting the body movements of the caregiver U1 or the care recipient U2 are not limited to the arms and legs, but may be any part of the head or torso.

The communication I/F unit 5 has an interface for inter-body communication and a communication interface that adopts a short-range wireless data communication standard such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), etc. These communication interfaces are used to transmit and receive inter-body signals between the communication terminals _Tu1 and _Tu2 , and to transmit and receive information to and from the management terminal WT.

The program storage unit 2 is configured, for example, by combining a non-volatile memory such as a HDD (Hard Disk Drive) or SSD (Solid State Drive) as a storage medium that can be written to and read from at any time, and a non-volatile memory such as a ROM (Read Only Memory), and stores application programs necessary for executing various control processes according to one embodiment of the present invention, in addition to middleware such as an OS (Operating System).

The data storage unit 3 is, for example, a combination of a non-volatile memory such as an HDD or SSD, which can be written to and read from at any time, as a storage medium, and a volatile memory such as a RAM (Random Access Memory), and includes a vibration model storage unit 31, a specific vibration information storage unit 32, a user information storage unit 33, and an action determination information storage unit 34 as the main storage units in one embodiment of the present invention.

The vibration model memory unit 31 stores learned data of a vibration model that has been generated in advance, for example, by CNN (Convolutional Neural Network) machine learning.

The specific vibration information memory unit 32 is used to store detection information of a specific vibration pattern associated with sudden movements of the arms or legs of the care recipient U2 detected by the control unit 1.

The user information storage unit 33 stores the identification information (user ID) of the caregiver U1 and the care recipient U2 or the identification information (terminal ID) of their communication terminals _Tu1 and _Tu2 .

The action determination information storage unit 34 is used to store the action determination information generated by the control unit 1.

The control unit 1 includes, as processing functions according to one embodiment of the present invention, a vibration data acquisition processing unit 11, a specific vibration detection processing unit 12, a user information mutual transmission processing unit 13, an action determination processing unit 14, and an action determination information output processing unit 15. All of these processing units 11 to 15 are realized by causing a hardware processor of the control unit 1 to execute a program stored in the program storage unit 2.

The vibration data acquisition processing unit 11 constantly receives the vibration detection signal output from the motion sensor 7 via the sensor I/F unit 4, and passes the received vibration detection signal to the specific vibration detection processing unit 12.

The specific vibration detection processing unit 12 analyzes the vibration pattern included in the vibration detection signal passed from the vibration data acquisition processing unit 11 based on the learned data of the vibration model stored in the vibration model storage unit 31. Then, it detects a specific vibration pattern associated with a sudden movement of the arm or leg, and generates specific vibration detection information representing the detection result. At the same time, the specific vibration detection processing unit 12 acquires detection time data of the specific vibration pattern from the clock 8, includes the acquired detection time data in the specific vibration detection information, and stores this specific vibration detection information in the specific vibration information storage unit 32.

When contact between the caregiver U1 and the care recipient U2 enables human body communication between the other communication terminals _Tu2 , _Tu1 , the user information mutual transmission processing unit 13 reads the user ID or terminal ID from the user information storage unit 33, and transmits the read ID together with the detection time data of the above-mentioned specific vibration pattern stored in the specific vibration information storage unit 32 from the communication I/F unit 5 to the other communication terminals _Tu2 , _Tu1 .

At the same time, the user information mutual transmission processing unit 13 receives the other party's ID and detection time data of the specific vibration pattern, which are similarly transmitted from the other party's communication terminals _Tu2 and _Tu1 , via the communication I/F unit 5, and performs processing to store the received other party's ID and detection time data of the specific vibration pattern in the user information storage unit 33.

The action determination processing unit 14 compares the detection time data of the specific vibration pattern in the own communication terminal _Tu1 , _Tu2 stored in the specific vibration information storage unit 32 with the detection time data of the specific vibration pattern notified from the communication terminal _Tu2 , _Tu1 of the other party at the time of contact stored in the user information storage unit 33. Then, based on the comparison result, it determines the detection order of the specific vibration pattern, that is, which of the caregiver U1 and the care recipient U2 started the action that caused the occurrence of the specific vibration pattern first. In other words, it determines the start order of the actions between the caregiver U1 and the care recipient U2.

The action determination processing unit 14 also generates action determination information for each action, including an identification number of the action, information indicating the start order of the action, and information indicating the time of occurrence of the action, and stores the generated action determination information in the action determination information storage unit 34. As information indicating the start order of the action, for example, the ID of the performer who starts the action and the ID of the performe who receives the action are used.

When behavior determination information is stored in the behavior determination information storage unit 34, the behavior determination information output processing unit 15 reads out this behavior determination information in real time or in batches for a certain period of time or a certain quantity, and transmits the read behavior determination information from the communication I/F unit 5 to the management terminal WT.

(Example of operation)
Next, an example of the operation of the communication terminals _Tu1 and _Tu2 configured as above will be described.

Fig. 4 is a flowchart showing the procedure and contents of the behavior determination process executed by the control unit 1 of the communication terminals _Tu1 and _Tu2 . Fig. 5 is a diagram for explaining an example of the operation of the communication terminals _Tu1 and _Tu2 , and shows a case where a care recipient U2 suffering from dementia or the like commits a violent behavior against a caregiver U1.
Hereinafter, the operation of the communication terminal _Tu2 used by the care recipient U2 who is the initiator of the above action will be described as an example.

(1) Operation before performing an action (1-1) Acquisition of vibration detection signal In step S10, the control unit 1 of the communication terminal _Tu2 constantly acquires a vibration detection signal output from the motion sensor 7 via the sensor I/F unit 4 under the control of the vibration data acquisition processing unit 11. Then, the control unit 1 passes the vibration detection signal to the specific vibration detection processing unit 12. Note that the acquisition process of the vibration detection signal may be performed intermittently as long as it does not affect the detection of the vibration pattern.

(1-2) Detection of specific vibrations Next, in step S11, the control unit 1 of the communication terminal T _u2 , under the control of the specific vibration detection processing unit 12, analyzes the vibration pattern of the vibration detection signal passed from the vibration data acquisition processing unit 11 based on the learned data of the vibration model stored in the vibration model memory unit 31, thereby detecting a specific vibration pattern associated with, for example, a sudden movement of the arm or leg of the care recipient U2.

This detection process detects a specific vibration pattern that occurs when the care recipient U2 raises his/her hand, as shown in Fig. 5. Note that the specific vibration pattern to be detected is not limited to the raising of the hand, but may be a pattern corresponding to other movements such as sticking out the hand or kicking the foot.

The specific vibration detection processing unit 12 determines whether the specific vibration pattern is detected in step S12. If the specific vibration pattern is detected, the specific vibration detection processing unit 12 subsequently acquires time data representing the detection time T of the specific vibration pattern from the clock 8 via the sensor I/F unit 4 in step S13. The acquired time data representing the detection time T is stored in the specific vibration information storage unit 32 as specific vibration detection information together with the detection result of the specific vibration pattern, i.e., information representing the type of the detected specific vibration pattern.

The control unit 1 of the communication terminal _Tu2 repeats the process of detecting the specific vibration pattern in steps S10 to S13 until contact between the caregiver U1 and the care recipient U2 is detected.

(2) Actions during and after the execution of an action (2-1) Mutual transmission of user information In step S14, the control unit 1 of the communication terminal _Tu2 monitors contact between the care recipient U2 and the caregiver U1. This contact monitoring is performed, for example, by checking whether or not there is a human body communication signal flowing between the communication terminals _Tu1 and _Tu2 .

In this state, for example, suppose that the hand of the care recipient U2 touches the body of the caregiver U1 at time t as shown in Fig. 5. Then, the control unit 1 of the communication terminal _Tu2 activates the user information mutual transmission processing unit 13 using the body contact as a trigger, and under the control of the user information mutual transmission processing unit 13, first in step S15, the time data indicating the detection time T of the specific vibration pattern stored in the specific vibration information storage unit 32 and the care recipient ID or the terminal ID of the communication terminal _Tu2 stored in the user information storage unit 33 are transmitted as the user information on the own side from the communication I/F unit 5 to the communication terminal _Tu1 of the caregiver U1 by human body communication.

At the same time, in step S16, the user information mutual transmission processing unit 13 receives the other user information transmitted from the communication terminal _Tu1 of the caregiver U1 by human body communication in the same manner via the communication I/F unit 5. Then, the received other user information is temporarily stored in the user information storage unit 33. The other user information includes the detection time t of a specific vibration pattern when the hand of the care recipient U2 touches the body of the caregiver U1, and the ID of the caregiver U1 or the terminal ID of the communication terminal _Tu1 .

In addition, the process of transmitting one's own user information in step S15 and the process of receiving the other party's user information in step S16 may be performed in such a way that step S16 precedes step S15.

(2-2) Determination of Action When the transmission of user information between the communication terminals _Tu1 and _Tu2 is completed, the control unit 1 of the communication terminal _Tu2 next determines the status of the action in step S17 under the control of the action determination processing unit 14. The procedure and contents of the determination process are described below.

That is, the action determination processing unit 14 reads from the specific vibration information storage unit 32 time data indicating the detection time T of the specific vibration pattern detected by the own communication terminal _Tu2 before the contact, and also reads from the user information storage unit 33 time data of the detection time t of the specific vibration pattern detected at the time of the contact transmitted from the other communication terminal _Tu1 . Then, the action determination processing unit 14 compares both times T and t to determine which comes first.

As a result of this determination, in the situation shown in Figure 5, the detection time T of the specific vibration pattern on the care recipient U2 side is earlier than the detection time t of the specific vibration pattern on the caregiver U1 side, so the care recipient U2 is determined to be the performer who started the action, and the caregiver U1 is determined to be the performed side who received the action. In other words, the start order of the actions between the caregiver U1 and the care recipient U2 is determined.

The behavior determination processing unit 14 links the identification number of the behavior with the time of occurrence of the behavior, the ID of the person who performed the behavior, and the ID of the person on whom the behavior was performed, and thereby generates behavior determination information. The generated behavior determination information is then temporarily stored in the behavior determination information storage unit 34.

In addition, when a position sensor is connected to the sensor I/F unit 4, the action determination processing unit 14 may acquire position data of the communication terminal _Tu2 at the time when the action occurred from the position sensor, and further include the acquired position data in the action determination information. In this case, latitude and longitude are used as the position data.

Furthermore, the type of action, such as "hitting," "poking," "pushing," "kicking," "touching," etc., may be determined based on the analysis results of the specific vibration pattern, and the determined type of action may be included in the action determination information.

(2-3) Transmission of Activity Determination Information Next, in step S18, the control unit 1 of the communication terminal T _u2 , under the control of the activity determination information output processing unit 15, reads out the activity determination information from the activity determination information storage unit 34, and transmits the read out activity determination information to the management terminal WT from the communication I/F unit 5. Note that in the process of transmitting the activity determination information, the activity determination information may be transmitted in real time each time it is obtained, or a certain period of time or a certain amount of activity determination information may be transmitted collectively.

Thereafter, the control unit 1 of the communication terminal _Tu2 repeatedly executes the action determination process of steps S10 to S18.

(3) Management of action history information in the management terminal WT The management terminal WT receives and stores the action determination information transmitted from each of the communication terminals _Tu1 and _Tu2 . Then, for each action, it compares the received action determination information to determine whether the contents match, and generates one integrated action determination information by deleting the other and leaving only one of the overlapping information elements. Then, it stores the integrated action determination information in the action history database as action history information.

In addition, when generating the integrated activity determination information, the management terminal WT performs the following processing. For example, the performer ID and the performed person ID or terminal ID included in the activity determination information are converted into the name of the care recipient U2 and the name of the caregiver U1 based on information in the personal information database managed by the server device SV. Also, for example, when the activity determination information includes location data, the latitude and longitude indicating this location data are converted into a location name, such as a facility name, floor name, room name, etc. Figure 6 shows an example of the activity history information.

Furthermore, the management terminal WT displays the action judgment information of the actions stored in the action history database on the display of the management terminal WT, for example, in response to an operation by the caregiver U1 who is the owner of the management terminal WT. The management terminal WT also periodically transmits the action judgment information stored in the action history database to the server device SV, for example. The server device SV acquires the action judgment information from all the management terminals WT and manages it collectively.

It is possible that both U1 and U2 are care recipients. In that case, the care recipients do not have a management terminal WT. Therefore, in this case, for example, an access point may be installed at any position in the facility, and the behavior determination information transmitted from the communication terminals _Tu1 and _Tu2 may be transmitted to the server device SV via the access point. Also, if the communication terminals _Tu1 and _Tu2 have a communication interface for directly transmitting data to the server device SV via the network NW, the behavior determination information may be transmitted directly to the server device SV.

(Action and Effects)
As described above, in one embodiment, before an action including contact is performed between the caregiver U1 and the care recipient U2, the communication terminals _Tu1 and _Tu2 of the human body communication system HC detect a specific vibration pattern associated with the movement of the hands or feet that is a precursor of the action based on the detection signal of the motion sensor 7, and obtain and store the detection time T of the detected specific vibration pattern from the clock 8. Then, when contact between the caregiver U1 and the care recipient U2 is detected, the specific vibration pattern at this time is detected and the detection time t is obtained, and the detection time t of the specific vibration pattern detected at the time of contact and the detection time T of the specific vibration pattern detected before the contact are transmitted between the communication terminals _Tu1 and _Tu2 by human body communication. Then, the transmitted detection time T and detection time t are compared, and based on the comparison result, which of the caregiver U1 and the care recipient U2 started the action first, that is, the start order of the actions is determined, and action determination information including the start order of the actions is generated.

Therefore, according to one embodiment, when an action involving contact occurs between a caregiver U1 and a care recipient U2, it is possible to determine not only whether or not contact occurred, but also the start order of the action, which makes it possible to later check the situation in more detail when an unexpected action such as a violent act occurs. Also, when a normal action such as a handshake or an exchange of business cards is performed, the start order of the action at that time is recorded, making it possible to later look back on the situation in detail.

In addition to the start order of the actions, by including in the action determination information information indicating the location where the action occurred, which is identified based on latitude and longitude data detected by the position sensor, and information indicating the type of action, which is identified from the specific vibration pattern detected, it is possible to grasp the situation of the action in more detail.

Furthermore, in one embodiment, the following effects are also achieved. That is, as a means for transmitting user information, for example, a general wireless communication means such as Wi-Fi may be used to periodically transmit user information. However, when such a wireless communication means is used, wireless transmission is performed periodically whether or not body movement is detected, which leads to an increase in power consumption due to communication and a large consumption of the terminal battery. In contrast, in one embodiment, human body contact is used as a trigger to transmit user information including the detection result of body vibration detected and stored up to that point between the communication terminals _Tu1 and _Tu2 . That is, human body communication is used, and user information is transmitted only when necessary. Therefore, unnecessary power consumption for communication by the communication terminals _Tu1 and _Tu2 can be suppressed, and the battery life can be extended.

[Other embodiments]
In the above embodiment, the case where all the functions of the action determination device according to the present invention are provided in the communication terminals _Tu1 and _Tu2 of the human body communication system HC has been described as an example. However, the present invention is not limited to this, and some of the functions of the action determination device may be provided in the management terminal WT.

In this case, the communication terminals _Tu1 , _Tu2 of the human body communication system HC are provided with a motion sensor 7 and a clock 8 in addition to the human body communication function. The communication terminals _Tu1 , _Tu2 store the vibration detection signal output from the motion sensor 7 together with the time of its generation, and when contact is detected, transmit the vibration detection signal and its time stamp to the management terminal WT together with the terminal ID transmitted between the communication terminals. The management terminal WT executes a series of processes from the detection of specific vibrations to the determination of the start order of actions and _the generation and storage of action determination information based on the vibration detection signal and its time stamp sent from the communication terminals _Tu1 , Tu2.

In this way, the process of detecting a specific vibration pattern and the process of determining an action, which have a large processing load, can be carried out by the management terminal, thereby simplifying the configuration of the communication terminals _Tu1 and _Tu2 and significantly reducing the processing load.

In the embodiment described above, the case has been described as an example in which the communication terminals _Tu1 and _Tu2 transmit user information including the vibration detection time and the terminal ID between each other, and the communication terminals _Tu1 and _Tu2 each perform the action determination. However, the present invention is not limited to this, and one of the communication terminals _Tu1 and _Tu2 may transmit user information to the other, and the communication terminal that receives the user information may perform the action determination.

In the above embodiment, the case where the communication terminals _Tu1 and _Tu2 transmit user information using human body communication has been described as an example. However, the present invention is not limited to this. The communication terminals _Tu1 and Tu2 may transmit user information using a wireless interface that adopts a low-power wireless data transmission standard such as Bluetooth. In this case, contact between the human bodies is determined by, for example, detecting that the bodies of the users _U1 and U2 have come close to each other to a distance equivalent to contact using a proximity sensor, or detecting vibrations indicating contact using an acceleration sensor, and the user information is transmitted between the communication terminals _Tu1 and _Tu2 using the contact determination result as a trigger.

In addition, the functional configuration of the action determination device, the type of action, the processing procedures and processing contents of each process from the specific vibration detection process to the process of determining the action start order and the process of generating action determination information can be modified in various ways without departing from the gist of this invention.

Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, in implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.

In short, this invention is not limited to the above-described embodiment as it is, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention. Furthermore, various inventions can be formed by appropriate combinations of multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all of the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined.

U1...caregiver U2...care recipient HC...human body communication system _Tu1 , _Tu2 ...communication terminal WT...management terminal NW...network SV...server device 1...control unit 2...program storage unit 3...data storage unit 4...sensor I/F unit 5...communication I/F unit 6...bus 11...vibration data acquisition processing unit 12...specific vibration detection processing unit 13...user information mutual transmission processing unit 14...action determination processing unit 15...action determination information output processing unit 31...vibration model storage unit 32...specific vibration information storage unit 33...user information storage unit 34...action determination information storage unit

Claims (8)

An action determination device for determining an action including contact between a first subject and a second subject,
a motion detection processing unit that detects a first body motion of the first subject and a second body motion of the second subject at the time of occurrence of the action, and stores the detection times of the first body motion and the second body motion at the time of occurrence of the action;
a transmission processing unit that transmits a detection time of the first body movement and a detection time of the second body movement between a terminal carried by the first subject and a terminal carried by the second subject when the contact due to the action occurs between the first subject and the second subject;
a determination processing unit that compares the transmitted detection time of the first body movement with the detection time of the second body movement and determines the start order of the action between the first subject and the second subject based on the comparison result;
and an action determination information generation processing unit that generates and stores action determination information including information that indicates a start order of the determined actions. 1. An action determination device that determines an action including contact between a first subject and a second subject by using human body-to-human body communication between the first subject and the second subject,
a motion detection processing unit that detects a first body motion of the first subject and a second body motion of the second subject at the time of occurrence of the action, and stores the detection times of the first body motion and the second body motion at the time of occurrence of the action;
a transmission processing unit that transmits, when the contact due to the action occurs between the first subject and the second subject, a detection time of the first body movement and a detection time of the second body movement between the first subject and the second subject by using the human body communication;
a determination processing unit that compares the transmitted detection time of the first body movement with the detection time of the second body movement and determines the start order of the action between the first subject and the second subject based on the comparison result;
and an action determination information generation processing unit that generates and stores action determination information including information that indicates a start order of the determined actions. The action determination device according to claim 1 or 2, wherein the action determination information generation processing unit generates and stores action determination information including identification information of the first subject or the second subject who will initiate the action, and identification information of the first subject or the second subject who will be subjected to the action, as information representing the start order of the action. An action determination device as described in any one of claims 1 to 3, wherein the action determination information generation processing unit generates and stores action determination information including information representing the start order of the action and the action occurrence time represented by the detection time of the second body movement. The action determination device described in claim 1 or 2, wherein the movement detection processing unit acquires in advance specific vibration patterns corresponding to the first body movement and the second body movement to be detected and stores them as a vibration model, detects vibrations generated in association with the first body movement and the second body movement, and detects the first body movement and the second body movement by comparing the detected vibrations with the specific vibration patterns stored in the vibration model. 1. An activity determination method performed by a device for determining an activity including contact between a first subject and a second subject, comprising:
detecting a first body movement of the first subject and a second body movement of the second subject at the time of occurrence of the action, respectively, and storing the detection times;
When the contact due to the action occurs between the first subject and the second subject, transmitting a detection time of the first body movement and a detection time of the second body movement between terminals carried by the first subject and the second subject, respectively;
a step of comparing the transmitted detection time of the first body movement with the detection time of the second body movement, and determining the start order of the action between the first subject and the second subject based on the comparison result;
generating and storing action determination information including information indicating a start order of the determined actions. 1. An activity determination method executed by a device that determines an activity including contact between a first subject and a second subject by using human body-to-human body communication between the first subject and the second subject, comprising:
detecting a first body movement of the first subject and a second body movement of the second subject at the time of occurrence of the action, respectively, and storing the detection times;
transmitting, when the contact due to the action occurs between the first subject and the second subject, a detection time of the first body movement and a detection time of the second body movement between the first subject and the second subject by using the body-to-body communication;
a step of comparing the transmitted detection time of the first body movement with the detection time of the second body movement, and determining the start order of the action between the first subject and the second subject based on the comparison result;
generating and storing action determination information including information indicating a start order of the determined actions. A program that causes a processor provided in the action determination device to execute processing by each of the processing units provided in the action determination device described in any one of claims 1 to 5.

Images