JP2021082013A - Watching system, watching method, watching device, and watching program - Google Patents

Abstract

To provide a system in which safety is confirmed by analyzing actions while supporting a life of the elderly with an electronic apparatus utilized in an extension of conventional services without introducing a special device.SOLUTION: The present invention relates to a watching system for detecting an abnormality of a user by recording and analyzing actions of the user. The watching system comprises: voice instruction information input means for receiving voice instruction information, based on voices generated by the user, inputted via an input/output device; voice instruction information storage means which stores the inputted voice instruction information in a storage unit; abnormal state determination means for analyzing whether or not an input frequency of the voice instruction information is settled within a reference range during a preset period and, in the case where the frequency is out of the reference range, determining that an abnormal state happens upon the user; and notification means which notifies the system of the abnormal state in response to output of the abnormal state.SELECTED DRAWING: Figure 1

Description

The present invention relates to a monitoring system that detects a user's abnormality by recording and analyzing the user's behavior.

Conventionally, in a home separated from the elderly, a watching service has been provided in which the behavior of the elderly is detected by a sensor or an operation of an electronic device by the elderly, and the safety of the elderly is notified to the family by e-mail or the like. On the other hand, these notifications alone did not reveal details about the behavior of the elderly (for example, the status of taking medications), and did not provide sufficient reassurance for the family. In addition, there is a problem that abnormalities in the elderly cannot be detected until they become serious.

In view of such a situation, as in Patent Document 1, it is determined whether or not there is a minor abnormality that is a sign that the user becomes a serious condition due to a decrease in the conversation recognition rate of the user, and the optimum according to the user's request. The technology related to robots that make various responses is known.

Further, as in Patent Document 2, there is known a technique related to an electronic device that learns a user's lifestyle through dialogue with the user and notifies the user of a drug administration time or the like by voice or screen display.

Japanese Patent No. 6420514 Japanese Unexamined Patent Publication No. 2019-45769

On the other hand, Patent Document 1 does not describe a function of notifying a watcher such as a family member. Further, in Patent Document 2, although the determination for notifying the user's emergency state from the utterance is disclosed, the function for detecting an abnormality that interferes with daily life such as cognitive impairment but is not highly urgent is described. Absent.

The present invention has been made in view of the above circumstances, and it is an object to be solved to provide a novel determination method for detecting an abnormality that is not highly urgent.

In order to solve the above-mentioned problems, the present invention is a monitoring system that detects an abnormality of a user by recording and analyzing the behavior of the user, and is issued by the user input via an input / output device. The voice instruction information input means for receiving the voice instruction information based on the voice to be input, the voice instruction information storage means for storing the input voice instruction information in the storage unit, and the input of the voice instruction information in a set period of time. It analyzes whether or not the frequency is within the reference range, and if it is outside the reference range, the abnormal state determining means for determining that an abnormal state has occurred in the user, and the abnormal state according to the output of the abnormal state. It is provided with a notification means for notifying.

With such a configuration, the user can easily operate the input / output device by inputting voice and receive support related to daily life. Further, when the user is found to be in an abnormal state based on the input frequency of those voices, the user's family and the like can be notified.

In a preferred embodiment of the present invention, the voice instruction information storage means classifies the voice instruction information based on a specific word or a combination of words indicated by the voice instruction information, stores the voice instruction information in a storage unit, and determines the abnormal state. The means analyzes whether or not the input frequency of the voice instruction information including the word or the combination of the words is within the reference range in a set period, and if it is out of the reference range, the user is in an abnormal state. Is determined to have occurred.
With such a configuration, it is possible to determine the abnormal state of the user by duplicating the contents of questions from the user.

In a preferred embodiment of the present invention, the abnormal state determining means accepts the setting of different reference ranges depending on the word or the combination of the words.
With such a configuration, it is possible to determine the abnormal state of the user according to different determination criteria according to the content of the inquiry from the user.

In a preferred embodiment of the present invention, the monitoring system receives input of drug information including a name, a number of drugs used, an image of the drug, and a usage time of the drug used by the user, and stores the drug information in a storage unit. Based on the drug information, the guidance means for outputting at least one of an image, a character, or a sound as a drug usage guide to the input / output device and an input indicating that the usage guide has been confirmed are input / output. It includes a confirmation means that receives via the device, and a confirmation information storage means that stores the input by the confirmation means in association with the drug information in the storage unit.
With such a configuration, it is possible to prevent the user from forgetting to take the medicine and further record the usage history.

In a preferred embodiment of the present invention, the guidance means outputs the usage guidance to the input / output device again when the input by the confirmation means is not made within the first predetermined time.
With such a configuration, it is possible to more reliably prevent the user from forgetting to take the medicine.

In a preferred embodiment of the present invention, the abnormal state determination means is described when the input by the confirmation means is not made within the second predetermined time or when the output of the usage guidance by the guidance means becomes a predetermined number of times or more. Determine that an error has occurred in the user.
With such a configuration, if the user does not input that the usage guide has been confirmed, it is considered that the user has not taken the medicine, and it is determined that the user has an abnormal state, and the user's You can notify your family.

In a preferred embodiment of the present invention, the monitoring system displays an emergency button and receives an input of emergency information via the emergency button display means for displaying the display processing result and outputting the display processing result to the input / output device and the emergency button. Emergency means and emergency information that acquires the user's position information by GPS in response to the input of the emergency information and notifies the emergency information to the communication terminal device that can notify within a predetermined range centered on the position information. It is provided with a notification means.
With such a configuration, the user can promptly notify a nearby person of an emergency in an emergency.

The present invention is a monitoring method executed by a monitoring system for detecting a user's abnormality by recording and analyzing a user's behavior, wherein the monitoring system is input via an input / output device. The process of receiving the voice instruction information based on the voice emitted by the user, the process of storing the input voice instruction information in the storage unit, and the input frequency of the voice instruction information within the reference range within a set period of time. It analyzes whether or not there is, and if it is out of the reference range, executes a process of determining that an abnormal state has occurred in the user and a process of notifying the abnormal state according to the output of the abnormal state. ..

Voice instruction information that is a monitoring device that detects an abnormality of the user by recording and analyzing the user's actions, and receives voice instruction information based on the voice emitted by the user input via the input / output device. The input means, the voice instruction information storage means for storing the input voice instruction information in the storage unit, and whether or not the input frequency of the voice instruction information is within the reference range in a set period of time are analyzed. If the user is out of the reference range, the user is provided with an abnormal state determining means for determining that an abnormal state has occurred, and a notification means for notifying the abnormal state according to the output of the abnormal state.

It is a monitoring program that detects anomalies of the user by recording and analyzing the user's actions, and accepts voice instruction information based on the voice emitted by the user input via the input / output device to the computer. Whether or not the input frequency of the voice instruction information is within the reference range in the voice instruction information input means, the voice instruction information storage means for storing the input voice instruction information in the storage unit, and a set period of time. Is analyzed, and when it is out of the reference range, it functions as an abnormal state determining means for determining that an abnormal state has occurred in the user and a notification means for notifying the abnormal state according to the output of the abnormal state. ..

According to the present invention, there is a system capable of analyzing the behavior and confirming the safety of the elderly while supporting the lives of the elderly by using electronic devices used as an extension of the conventional service without introducing a special device. Can be provided.

It is a figure which shows the system structure of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the hardware configuration of the terminal apparatus of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the hardware configuration of the server apparatus of the monitoring system which concerns on one Embodiment of this invention, and the functional configuration example of a system server. It is a figure which shows the flowchart about the process which determines the abnormal state from the inquiry of the user of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the flowchart about the process which executes the use guidance of the medicine of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the use guidance screen of the medicine of the monitoring system which concerns on one Embodiment of this invention. It is a figure which shows the flowchart about the process which executes the emergency notification of the monitoring system which concerns on one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The embodiments shown below are examples of the present invention, and the present invention is not limited to the following embodiments, and can be implemented in many different embodiments.

For example, in the present embodiment, the configuration, operation, and the like of the monitoring system will be described, but a monitoring method, a monitoring device, a monitoring program, a recording medium, and the like having the same configuration can also exert the same effects. Further, the program may be stored in a recording medium. Using this recording medium, for example, the program can be installed on a computer. Here, the recording medium in which the program is stored may be a non-transient recording medium such as a CD-ROM.

With reference to FIG. 1, which shows an outline of the system in the present embodiment, the watching system is embodied as the watching system 1. The watching system 1 includes an input / output device 2, a watching device 3, a watching person terminal device 4, a language processing server 5, an emergency terminal device 6, and a communication network NW. The communication network NW is composed of an IP (Internet Protocol) network such as the Internet. The terminal device TE (input / output device 2, watcher terminal device 4, emergency terminal device 6) and the server device SE (language processing server 5, watcher device 3) are configured to be able to communicate via the communication network NW. In the following description, the intervention of the communication network NW will be omitted unless it becomes unclear. Further, in FIG. 1, one terminal device TE is shown, but a plurality of these may be present.

The input / output device 2 is a device including at least a hardware configuration having a function of receiving a voice input of a user to be monitored and a function of data communication with a server or a terminal via a communication network NW. In the present embodiment, a case where an electronic device equipped with an artificial intelligence speaker and a touch display (so-called smart display) is used as the input / output device 2 will be described. For example, an artificial intelligence speaker, a smartphone terminal, a tablet terminal, a mobile phone, etc. It may be a computer terminal such as a personal computer. The user performs an operation such as requesting an inquiry about life from the input / output device 2 by voice input.

When the voice input by the input / output device 2 includes a predetermined wake word (for example, the name of an application), the language processing server 5 acquires the voice, analyzes the content of the voice, and describes the above. Output as voice instruction information for requesting information related to the inquiry. Further, regarding the response to the inquiry described later, a process of synthesizing voice is performed, and the process result is transmitted to the input / output device 2. The language processing server 5 may be a server provided by an existing service.

The monitoring device 3 acquires voice instruction information, outputs a response to an inquiry, records and analyzes the voice instruction information, and determines an abnormal state of the user. As a result, the input / output device 2 can acquire a response to the inquiry and output a voice or a screen display to the user.

In the present embodiment, an example in which processing such as speech recognition, analysis, and synthesis for output is performed by the language processing server 5 will be described, but some or all of these processing are performed by the input / output device 2. It may be performed by the watching device 3 or other device connected to the communication network NW.

The watcher terminal device 4 is a terminal device owned by a watcher such as a user's family or spouse, and includes a computer terminal (including a personal computer, a tablet terminal, and a smartphone terminal) as long as it has a hardware configuration having a data communication function. ) Can be adopted as a single configuration or a composite configuration including at least one of the above. When an abnormality occurs in the user, the watcher terminal device 4 receives a notification by a mail, a chat function, a voice / video call function, or a function of the watch system application.

The storage unit of the watch device 3 stores the contact information such as an ID or an e-mail address that identifies the input / output device 2 and the watcher terminal device 4 in association with each other. As a result, when an abnormality occurs in the user who owns the input / output device 2, the watching device 3 can transmit a notification to the watching person terminal device 4 associated with the input / output device 2. Further, the watching device 3 can output to the input / output device 2 based on the settings and information input by the watching person terminal device 4.

The emergency terminal device 6 is a communication terminal device owned by a third party in which a monitoring system is installed as an application program, and if it has a configuration having a data communication function, a computer terminal (personal computer, tablet terminal, and smartphone terminal) can be used. A single configuration or a composite configuration including at least one of (including) can be adopted. As an example of the emergency terminal device 6, there are an input / output device 2 and a watcher terminal device 4 that are not associated with each other in the storage unit of the watching device 3. The emergency terminal device 6 receives emergency information in the event of a user's emergency by an email, a chat function, a voice / video call function, or a function of a watching system application. Further, when the emergency information includes alert information, the emergency terminal device 6 may output an alert based on the alert information.

FIG. 2A is a diagram showing an example of the hardware configuration of the input / output device 2 in the present embodiment. The input / output device 2 includes an arithmetic unit (CPU (Central Processing Unit) 21) 21 as a hardware component and a main storage device (RAM (Random Access Memory) 22) as a working memory.

The input / output device 2 includes a communication unit 23 including a communication interface (IF) such as a NIC (Network Interface Card) and a communication control device that controls transmission / reception of data, an OS (Operating System), an application program, and various information (data). Auxiliary storage device 24 such as HDD, SSD, flash memory, etc. that rewritably stores), information input / designation unit 25 such as touch panel, physical key, keyboard, mouse, display unit 26 including display, etc. A microphone 27 for receiving voice input, a speaker 28 for voice output, and the like are provided. In this embodiment, the communication unit 23 may have a GPS communication function for transmitting and receiving position information by GPS communication.

FIG. 2B is a diagram showing an example of the hardware configuration of the watcher terminal device 4 and the emergency terminal device 6 in the present embodiment. The watcher terminal device 4 and the emergency terminal device 6 include an arithmetic unit (CPU (Central Processing Unit)) 41 and a main storage device (RAM (Random Access Memory)) 42 as work memory as hardware components. Be prepared.

The watcher terminal device 4 and the emergency terminal device 6 include a communication unit 43 including a communication interface (IF) such as a NIC (Network Interface Card) and a communication control device for controlling data transmission / reception, an OS (Operating System), and an application program. , And auxiliary storage devices 44 such as HDDs, SSDs, and flash memories that rewritably store various information (including data), information input / designation units 45 such as touch panels, physical keys, keyboards, and mice, and displays. It is provided with at least a display unit 46 including the display unit 46 and the like. The communication unit 43 may be provided with a GPS communication function for transmitting and receiving position information by GPS communication.

In order to logically realize the functions described in detail later in the input / output device 2, the monitoring system terminal program is installed as an application program in the auxiliary storage device 24. Then, in the input / output device 2, the arithmetic unit (CPU) 21 expands and executes the application program in the main storage device (RAM) 22 when the power is turned on or an instruction by the user (user) is given.

FIG. 3 shows the hardware configuration of the server device SE (watching device 3, language processing server 5) and the functional configuration of the watching device 3 in the present embodiment. The server device SE has a data communication function, and includes hardware and functional components as shown in FIG. 3A. That is, the server device SE includes a computing device (CPU) 31 and a main storage device (RAM) 32 as a working memory as hardware components.

The server device SE includes an auxiliary storage device 33 such as an HDD, SSD, or flash memory that rewritably stores an OS (Operating System), an application program, and various information (including data), a communication control unit 34, and a NIC (NIC). A communication interface (IF) unit 35 or the like such as a Network Interface Card) is further provided.

As shown in FIG. 3B, the auxiliary storage device 33 of the monitoring device 3 has the voice instruction information input means 301, the voice instruction information storage means 302, and the abnormal state determination means 303 as functional components to be described in detail later. , Notification means 304, drug information registration means 305, guidance means 306, confirmation means 307, confirmation information storage means 308, emergency button display means 309, emergency means 310, emergency information notification means 311 and so on. A storage unit 312 is provided.

In order to logically realize the above-mentioned functional components in the monitoring device 3, the monitoring program, the terminal control program, the server control program, and the like are installed as application programs in the auxiliary storage device 33. Then, in the monitoring device 3, the arithmetic unit (CPU) 31 expands and executes this processing program in the main storage device (RAM) 32 when the power is turned on or an instruction is given by the server administrator.

The auxiliary storage device 33 of the language processing server 5 is suitable for a language processing function that recognizes and analyzes the received voice, a reply function for determining a reply voice suitable for the received voice, and an output of the reply voice. It is equipped with functions for realizing a voice dialogue service, such as an information request function for acquiring information and a voice synthesis function for synthesizing voice to be output based on received text information.

<Abnormality judgment and notification>
Hereinafter, the processing in the first embodiment of the monitoring system 1 will be described in detail with reference to FIG. FIG. 4 is a diagram showing a flowchart relating to a process of determining an abnormal state from a user inquiry.

First, the application program of the monitoring system is started in the input / output device 2. In the present embodiment, the language processing server 5 and the watching device 3 cooperate with each other by the voice input to the input / output device 2 to realize the watching system 1. The microphone 27 of the input / output device 2 receives the voice emitted by the user. Here, the user can freely send various inquiries about life, reports on the latest situation to watchers such as spouse, family, relatives, and friends, and chats to the input / output device 2. Examples of inquiries include "Tell me the recommended menu for lunch", "How long is the medicine time?", "Tell me your family address." Examples of the latter include "I ate lunch", "I will be away from shopping today", and "Call a friend". In addition to that, for example, operations such as operation of home appliances and playback of news, radio, and music may be performed by voice.

In the present embodiment, the voice input by the microphone 27 is digitally converted and transmitted to the language processing server 5 as voice instruction information. The voice instruction information may include at least a user ID for specifying the source of the voice instruction information, and may include a destination ID and a transmission time for specifying the destination of the voice instruction information. In the present embodiment, the destination specified by the destination ID is the watching device 3. The language processing server 5 that has received the voice instruction information analyzes the content of the voice instruction information and further transmits it to the monitoring device 3. Here, by analyzing the contents of the voice instruction information, for example, the specific words "lunch", "recommended" and "menu" are extracted from the contents of the inquiry such as the voice instruction information "Tell me the recommended menu for lunch." And may be transmitted to the watching device 3. When the voice instruction information does not include the above-mentioned destination ID, the voice instruction information is monitored and transmitted to the device 3 based on the specific word included in the voice instruction information. Further, the language processing server 5 monitors information on "recommended menu for lunch" based on specific words "lunch", "recommended", and "menu", and the language processing server 5 or an external server. It may be acquired from the auxiliary storage device 33 (not shown), the response voice may be synthesized, and output to the input / output device 2. The external server searches for the information requested by the function of the search engine, for example, and performs a process of transmitting the corresponding information to the language processing server 5.

In S101 of FIG. 4, the voice instruction information input means 301 of the monitoring device 3 receives the input of the voice instruction information transmitted from the language processing server 5.

In S102, the voice instruction information storage means 302 classifies and processes the voice instruction information based on a specific word included in the voice instruction information and stores it in the storage unit 312. As an example of the classification process of the voice instruction information, the voice instruction information including words related to "meal" such as "rice", "lunch", and "supper" is classified and stored in the storage unit 312. The words included in the classification are not limited, such as further classifying the voice instruction information including the words related to "lunch" such as "lunch", "lunch", and "lunch" and storing them in the storage unit 312. In the present embodiment, some classifications are predefined in the watching device 3, but new classifications may be generated in response to input of voice instruction information.

Further, in S102, the voice instruction information storage means 302 classifies and stores the voice instruction information in the storage unit 312 based on the combination of specific words included in the voice instruction information. As an example of the classification process based on the combination of words, the first word group "medicine", "cough suppressant", "wetcloth", etc., and the second word group "time", "when", "yet" , Etc., are classified as a combination of specific words related to "drug use time" by voice instruction information including both words of the first word group and the second word group, and stored in the storage unit 312. Therefore, the content of the inquiry from the user indicated by the voice instruction information is classified by the classification process of the specific word or the combination of the specific words.

In S103 and S104, the abnormal state determining means 303 determines whether or not the user has an abnormal state based on the voice instruction information stored in the storage unit 312. In the present embodiment, the abnormal state determining means 303 determines the abnormal state by using the voice instruction information aggregated in a predetermined period such as one day or one week. In addition, different periods may be set according to a specific word or word combination. These periods are stored in advance in the storage unit 312, but may be changed to any period via the input / output device 2 or the watcher terminal device 4.

In S103, the abnormal state determining means 303 analyzes whether or not the input of voice instruction information including a specific word or word combination is duplicated in a set period of time. For example, when the aggregation period of the voice instruction information related to "meal" is set to one day and the voice instruction information related to "meal" is input twice or more a day, the abnormal state determination means 303 duplicates the contents of the inquiry. (YES in S103).

When it is determined in S103 that the contents of the inquiry are duplicated, the abnormal state determining means 303 analyzes in the subsequent S104 whether or not the input frequency of the duplicated voice instruction information is within the reference range. For example, when the reference range 2 to 4 times is set for the aggregation period of the voice instruction information regarding the classification of "meal", the number of times of inputting the voice instruction information regarding the classification of "meal" is 0 times, 1 time, or In the case of 5 times or more, the abnormal state determination means 303 determines that the input frequency is out of the reference range (YES in S104).

In the present embodiment, the abnormal state determination means 303 accepts different reference range settings according to a specific word or word combination, that is, according to the content of an inquiry from a user. These reference ranges are stored in advance in the storage unit 312 in the initial state, but may be changed to any reference range via the input / output device 2 or the watcher terminal device 4. Further, the reference range may be automatically set by the average value of the input frequency of the voice instruction information in the set period. The average value of the input frequency is calculated for each inquiry content and aggregation period.

Further, the abnormal state determining means 303 in the present embodiment can execute the process of S104 for the total number of times of inputting the voice instruction information including all inquiries and chats. Also in this case, for example, the determination process is performed based on the average number of times of input of voice instruction information from the user per day and an arbitrary reference range.

When it is determined in S104 that the input frequency is out of the reference range, the abnormal state determining means 303 determines that an abnormal state has occurred in the user and outputs the output. Further, in the subsequent S105, the notification means 304 notifies the watcher terminal device 4 of the abnormal state in response to the output of the user's abnormal state by the abnormal state determining means 303. The watcher terminal device 4, which is the notification destination, registers the e-mail address, telephone number, chat application ID, etc. of the watcher terminal device 4 in the storage unit 312 in advance via the input / output device 2 or the watcher terminal device 4. It is identified by keeping it. As an example of this embodiment, the notification means 304 creates a message to the effect that an abnormal state has occurred in the user, and transmits the message to the watcher terminal device 4 registered as the notification destination.

In S102, when the voice instruction information is stored in the storage unit 312, the monitoring device 3 performs a reply process for outputting the reply information which is a reply to the inquiry from the user in S106. In the present embodiment, the response process generates text information for synthesizing the response voice according to a specific word or word combination included in the voice instruction information. For example, when "how long is the medicine time" is input as voice instruction information, text information such as "30 minutes until the medicine time is left" is generated based on the registered medicine information described later. ..

When the text information for the reply is generated in S106, the watching device 3 outputs the generated text information to the language processing server 5 in S107. When the watching device 3 synthesizes the response voice, the watching device 3 may output the synthesized reply voice to the input / output device 2.

The language processing server 5 receives the text information output in S107, synthesizes the response voice based on the text information, and outputs the response voice to the input / output device 2. When the input / output device 2 watches over the response voice and receives it from the device 3 or the language processing server 5, the input / output device 2 outputs the synthesized response voice from the speaker 28. This allows the user to receive replies to inquiries about life. An external language processing server (not shown) may cooperate with the language processing server 5 to synthesize a response voice based on the received text information and output it to the input / output device 2.

The watching device 3 aggregates and analyzes the voice instruction information stored in the storage unit 312, displays the aggregated analysis processing result in response to the request from the watching person terminal device 4, and monitors the display processing result. May be sent to. As an example of the embodiment, voice instruction information for a certain period (for example, one month) is aggregated by classification and displayed as a graph by period or classification.

<Drug usage guide>
Hereinafter, the processing in the second embodiment of the monitoring system 1 will be described in detail with reference to FIGS. 5 and 6. FIG. 5 is a diagram showing a flowchart of a process for executing a drug usage guide to the user.

First, the drug information registration means 305 accepts input of drug information including the name, the number of drugs used, the image of the drug, and the usage time of the drug used by the user via the input / output device 2 or the watcher terminal device 4. It is stored in the storage unit 312. The drug information is transmitted from the input / output device 2 or the watcher terminal device 4 to the watcher device 3 by form input, mail, chat function, or the like. As shown in FIG. 6A, the drug information in the present embodiment includes a drug ID, a user ID, a watcher ID, a drug name, the number of uses, a usage time, a drug image, and a usage status. The drug ID is an ID uniquely associated with one drug used by one user. The user ID is an ID for identifying the input / output device 2 owned by the user. The watcher ID is an ID for identifying the watcher terminal device 4 owned by the watcher. As the user ID and the watcher ID, an e-mail address, an ID of a chat application, or the like may be stored. In addition to storing a specific time, the usage time may store the time before and after the user's daily activities such as before meals or after meals or before going to bed. The drug information may be stored in the auxiliary storage device 24 of the input / output device 2.

In S201 of FIG. 5, when the time corresponding to the usage time of the drug information stored in the storage unit 312 is reached, the guidance means 306 provides the drug usage guidance based on the drug name, the number of uses, the usage time, and the image of the drug. , Output processing is performed for the input / output device 2 specified by the user ID. FIG. 6B is a screen display example of the guidance screen W1 for displaying the drug usage guidance. The guidance screen W1 has a name display unit W11 for displaying the name of the medicine, a usage number display unit W12 for displaying the number of medicines used, a usage time display unit W13 for displaying the usage time of the medicine, and an image display for displaying the image of the medicine. The unit W14 includes at least a confirmation button W15 among the confirmation buttons W15 for receiving an input from the user that the drug usage guidance has been confirmed. The guidance means 306 displays and processes the guidance screen W1 based on the drug information, and transmits the processing result to the input / output device 2. Upon receiving the processing result, the input / output device 2 displays the guidance screen W1 on the display unit 26. When the medicine information is stored in the auxiliary storage device 24 of the input / output device 2, the guidance means 306 transmits a display command of the guidance screen W1 to the input / output device 2 based on the usage time of the medicine information. When the input / output device 2 receives the display command, the input / output device 2 displays the guidance screen W1 based on the drug information stored in the auxiliary storage device 24, and displays the processing result on the display unit 26.

Further, in S201, the guidance means 306 transmits a notification sound output command to the input / output device 2. The speaker 28 of the input / output device 2 outputs a notification sound in response to an output command. Further, the guidance means 306 may synthesize voice guidance via the language processing server 5 and output it to the speaker 28 of the input / output device 2. The voice guidance synthesizes voice based on the drug information stored as text data by the drug information registration means 305 such as the name of the drug and the number of drugs used. In the present embodiment, the guidance means 306 outputs at least one of the above-mentioned guidance screen W1 and the sound usage guidance to the input / output device 2.

Further, the guidance screen W1 may be configured to include at least one of a name display unit W11, a usage number display unit W12, a usage time display unit W13, and an image display unit W14. In that case, the guidance means 306 includes a confirmation screen W2 (confirmation button W15) that receives an input that the user has confirmed the drug usage guidance after a certain period of time from the display processing of the guidance screen W1 or by touch input of the guidance screen W1. (Not shown) is output processed to the input / output device 2.

The input / output device 2 indicates that the user has confirmed the drug usage guidance when the confirmation button W15 displayed on the display unit 26 in S201 is pressed, and at least the drug information used for the output processing of the guidance screen W1. It is output to the monitoring device 3 together with the drug ID. The confirmation means 307 of the monitoring device 3 receives an input indicating that the usage guide has been confirmed and an input of the drug ID via the input / output device 2.

When the confirmation means 307 accepts the confirmation input (YES in S202), in the subsequent S203, the confirmation information storage means 308 corresponds to the input that the usage guide input by the confirmation means 307 has been confirmed, corresponding to the drug ID. It is stored in the storage unit 312 as the usage status of the drug information. The confirmation information storage means 308 may add information regarding the date and time to the usage status. The watching device 3 monitors the drug information including the usage status, performs display processing in response to a request from the watching person terminal device 4, and transmits the display processing result to the watching person terminal device 4.

If the confirmation input is not made within the first predetermined time (NO in S202), the confirmation means 307 requests the guidance means 306 to re-guide. The guidance means 306 outputs the drug usage guidance to the input / output device 2 by performing the processing of S201 again in response to the request for re-guidance. In the case of re-guidance, the guidance means 306 may output a display screen or voice different from the initial usage guidance. Further, the confirmation means 307 performs the same process as S202 and accepts the confirmation input. The processing of S201 and S202 may be repeated many times when the confirmation input is not accepted by the confirmation means 307.

The confirmation means 307 is an abnormal state determination means 303 when the confirmation input is not made within the second predetermined time, or when the number of times the guide means 306 performs the output processing of the drug use guidance exceeds the predetermined number of times. (YES in S204). The second predetermined time is set to an arbitrary time equal to or higher than the first predetermined time. The confirmation means 307 performs the process of S201 when the second predetermined time does not elapse from the first drug use notification or when the number of times the drug use guidance output process by the guide means 306 is performed is less than or equal to the predetermined number of times. Do it again (NO in S204).

If YES in S204, the abnormality state determining means 303 in S205 determines that an abnormality has occurred in the user in response to the determination request, and outputs the result. In S204, the confirmation means 307 requests the abnormal state determination means 303 to make a determination each time the output processing of the drug use guide is performed, and the abnormal state determination means 303 performs the output process of the drug use guide the number of times. When the number of times exceeds a predetermined number, it may be determined that an abnormality has occurred in the user and output. The notification means 304 notifies the watcher terminal device 4 of the abnormal state according to the output of the determination of the abnormal state of the user by the abnormal state determining means 303. The watcher terminal device 4 which is the notification destination is specified by the watcher ID stored in the drug information, the e-mail address, the telephone number, the ID of the chat application, etc. stored in advance in the storage unit 312.

<Urgent notification>
Hereinafter, the process in the third embodiment of the monitoring system 1 will be described in detail with reference to FIG. 7. FIG. 7 is a diagram showing a flowchart regarding a process in which the monitoring system 1 executes an emergency notification.

In the present embodiment, the user notifies the input / output device 2 of the emergency situation that has occurred by himself / herself by utterance. For example, when the user inputs a voice related to an emergency such as "I want you to help me immediately" or "an emergency has occurred" to the input / output device 2, the same processing as in S101 and S102 in FIG. 4 is executed. Then, the voice instruction information regarding the user's emergency situation is classified and processed, and stored in the storage unit 312.

In S301, the emergency button display means 309 displays the emergency button when the voice instruction information regarding the emergency situation is stored in the storage unit 312, and outputs the display processing result to the input / output device 2. The display unit 26 of the input / output device 2 displays an emergency button based on the display processing result.

In S302, the emergency means 310 receives an input by an operation such as a touch from the user via the emergency button. The emergency means 310 processes the input in S302 as emergency information indicating that an emergency has occurred to the user. In the present embodiment, in the following S303, the emergency means 310 acquires the position information (longitude, latitude) of the input / output device 2 by the GPS communication function of the communication unit 23, and notifies within a predetermined range centered on the position information. The possible emergency terminal device 6 is searched by GPS communication. The emergency means 310 may acquire the position information of the input / output device 2 from an address or the like stored in advance in the storage unit 312.

The emergency terminal device 6 searched by GPS communication in S303 can switch ON / OFF of the function of receiving emergency information. When the function for receiving emergency information is ON (YES in S304), the emergency information notification means 311 in S305 transmits the position information and the emergency information to the searched emergency terminal device 6 and the watcher terminal device 4. When the function for receiving the emergency information is OFF (NO in S304), the emergency information notification means 311 in S306 transmits the emergency information to the watcher terminal device 4. As a result, the emergency information is received by the emergency terminal device 6 or the watcher terminal device 4. The emergency information notification means 311 may further add alert information to the emergency information, and the watcher terminal device 4 may output an alert by an output unit such as a speaker based on the alert information.

1 Watching system 2 Input / output device 3 Watching device 4 Watching person terminal device 5 Language processing server 6 Emergency terminal device 21 Arithmetic logic unit (CPU)
22 Main memory (RAM)
23 Communication unit 24 Auxiliary storage device 25 Information input / designation unit 26 Display unit 27 Microphone 28 Speaker 31 Computational device (CPU)
32 Main memory (RAM)
33 Auxiliary storage device 34 Communication control unit 35 Communication IF unit 41 Arithmetic logic unit (CPU)
42 Main memory (RAM)
43 Communication unit 44 Auxiliary storage device 45 Information input / designation unit 46 Display unit 301 Voice instruction information input means 302 Voice instruction information storage means 303 Abnormal state determination means 304 Notification means 305 Drug information registration means 306 Guidance means 307 Confirmation means 308 Confirmation information Storage means 309 Emergency button display means 310 Emergency means 311 Emergency information notification means W1 Guidance screen W11 Name display unit W12 Number of uses display unit W13 Usage time display unit W14 Image display unit W15 Confirmation button

Claims (10)

A monitoring system that detects user abnormalities by recording and analyzing user behavior.
A voice instruction information input means for receiving voice instruction information based on the voice emitted by the user input via the input / output device, and a voice instruction information input means.
A voice instruction information storage means for storing the input voice instruction information in the storage unit, and
An abnormal state determining means for analyzing whether or not the input frequency of the voice instruction information is within the reference range in a set period of time, and if it is out of the reference range, determining that an abnormal state has occurred in the user. When,
A monitoring system including a notification means for notifying the abnormal state according to the output of the abnormal state. The voice instruction information storage means classifies and stores the voice instruction information based on a specific word or a combination of words indicated by the voice instruction information, and stores the voice instruction information in the storage unit.
The abnormal state determining means analyzes whether or not the input frequency of the voice instruction information including the word or the combination of the words is within the reference range in a set period, and if it is outside the reference range, the above-mentioned The monitoring system according to claim 1, wherein it is determined that an abnormal state has occurred in the user. The monitoring system according to claim 2, wherein the abnormal state determining means accepts settings of different reference ranges depending on the word or a combination of the words. The monitoring system is a drug information registration means that accepts input of drug information including a name, the number of drugs used, an image of the drug, and a usage time of the drug used by the user and stores it in a storage unit.
A guidance means for outputting and processing at least one of an image, a character, or a sound as a drug usage guide to the input / output device based on the drug information.
A confirmation means for receiving an input indicating that the usage guide has been confirmed via the input / output device, and
The monitoring system according to any one of claims 1 to 3, further comprising a confirmation information storage means for storing the input by the confirmation means in the storage unit in association with the drug information. The monitoring system according to claim 4, wherein the guidance means outputs the usage guidance to the input / output device again when the input by the confirmation means is not made within the first predetermined time. In the abnormal state determination means, when the input by the confirmation means is not made within the second predetermined time, or when the output of the usage guidance by the guidance means exceeds a predetermined number of times, an abnormality has occurred in the user. The monitoring system according to claim 5. The monitoring system includes an emergency button display means that displays an emergency button and outputs a display processing result to the input / output device.
An emergency measure that accepts input of emergency information via the emergency button,
An emergency information notification means that acquires the user's position information by GPS in response to the input of the emergency information and notifies the communication terminal device capable of notifying within a predetermined range centered on the position information. The monitoring system according to any one of claims 1 to 5. It is a monitoring method executed by the monitoring system that monitors the process of detecting an abnormality of the user by recording and analyzing the user's behavior.
A process in which the monitoring system receives voice instruction information based on the voice emitted by the user input via the input / output device.
A process of storing the input voice instruction information in the storage unit, and
A process of analyzing whether or not the input frequency of the voice instruction information is within the reference range in a set period of time, and determining that an abnormal state has occurred in the user if it is outside the reference range.
A monitoring method for executing a process of notifying the abnormal state according to the output of the abnormal state. A monitoring device that detects user abnormalities by recording and analyzing user behavior.
A voice instruction information input means for receiving voice instruction information based on the voice emitted by the user input via the input / output device, and a voice instruction information input means.
A voice instruction information storage means for storing the input voice instruction information in the storage unit, and
An abnormal state determining means for analyzing whether or not the input frequency of the voice instruction information is within the reference range in a set period of time, and if it is out of the reference range, determining that an abnormal state has occurred in the user. When,
A monitoring device including a notification means for notifying the abnormal state according to the output of the abnormal state. A monitoring program that detects user abnormalities by recording and analyzing user behavior.
A computer is provided with a voice instruction information input means for receiving voice instruction information based on the voice emitted by the user, which is input via an input / output device.
A voice instruction information storage means for storing the input voice instruction information in the storage unit, and
An abnormal state determining means for analyzing whether or not the input frequency of the voice instruction information is within the reference range in a set period of time, and if it is out of the reference range, determining that an abnormal state has occurred in the user. When,
A monitoring program that functions as a notification means for notifying the abnormal state according to the output of the abnormal state.

Images