CN117409538A - Wireless anti-fall alarm system and method for nursing care - Google Patents
Wireless anti-fall alarm system and method for nursing care Download PDFInfo
- Publication number
- CN117409538A CN117409538A CN202311706765.2A CN202311706765A CN117409538A CN 117409538 A CN117409538 A CN 117409538A CN 202311706765 A CN202311706765 A CN 202311706765A CN 117409538 A CN117409538 A CN 117409538A
- Authority
- CN
- China
- Prior art keywords
- behavior
- behavioral
- elderly
- sequence
- fall
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
- G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
- G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
- G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/62—Extraction of image or video features relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Social Psychology (AREA)
- Medical Informatics (AREA)
- Psychiatry (AREA)
- Human Computer Interaction (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Psychology (AREA)
- Emergency Alarm Devices (AREA)
- Alarm Systems (AREA)
Abstract
本发明公开了一种用于护理的无线防跌倒报警系统及方法,涉及智能化报警技术领域,其利用摄像头采集老年人的行为视频,并通过无线传输模块将视频传输至后台防跌服务器。更具体地,在后台防跌服务器中,采用基于深度学习的人工智能技术对行为监控视频进行处理与分析,以识别老人的行为特征,并智能化地判断是否产生防跌倒报警提示。这样,在监测到老人行为可能存在跌倒风险时,及时通过呼叫装置产生预警提示,以通知相关人员进行救助或干预。
The invention discloses a wireless anti-fall alarm system and method for nursing care, and relates to the field of intelligent alarm technology. It uses a camera to collect behavioral videos of the elderly and transmits the videos to a background anti-fall server through a wireless transmission module. More specifically, in the background anti-fall server, artificial intelligence technology based on deep learning is used to process and analyze behavioral monitoring videos to identify the behavioral characteristics of the elderly and intelligently determine whether to generate anti-fall alarm prompts. In this way, when it is detected that the elderly person's behavior may pose a risk of falling, an early warning prompt will be generated through the calling device in time to notify relevant personnel for rescue or intervention.
Description
技术领域Technical field
本发明涉及智能化报警技术领域,尤其涉及一种用于护理的无线防跌倒报警系统及方法。The present invention relates to the field of intelligent alarm technology, and in particular to a wireless anti-fall alarm system and method for nursing care.
背景技术Background technique
随着人口老龄化的趋势,老年人的健康和安全问题日益受到社会的关注。老年人由于身体机能的退化,容易发生跌倒等意外事故,可能会给自身和家庭带来巨大的负担。With the trend of population aging, the health and safety issues of the elderly have received increasing attention from society. Due to the degradation of physical functions, the elderly are prone to accidents such as falls, which may bring a huge burden to themselves and their families.
目前,市场上存在一些用于防跌倒的产品,如跌倒检测器。这些产品通常需要老年人佩戴或携带特定的设备,如手环、腰带、手表等。然而,这些设备存在一些缺点,如佩戴不舒适、电池续航时间短、误报率高等。Currently, there are some products on the market for fall prevention, such as fall detectors. These products usually require the elderly to wear or carry specific equipment, such as bracelets, belts, watches, etc. However, these devices have some shortcomings, such as uncomfortable wearing, short battery life, and high false alarm rate.
因此,期待一种优化的方案。Therefore, an optimized solution is expected.
发明内容Contents of the invention
本发明实施例提供一种用于护理的无线防跌倒报警系统及方法,其利用摄像头采集老年人的行为视频,并通过无线传输模块将视频传输至后台防跌服务器。更具体地,在后台防跌服务器中,采用基于深度学习的人工智能技术对行为监控视频进行处理与分析,以识别老人的行为特征,并智能化地判断是否产生防跌倒报警提示。这样,在监测到老人行为可能存在跌倒风险时,及时通过呼叫装置产生预警提示,以通知相关人员进行救助或干预。Embodiments of the present invention provide a wireless anti-fall alarm system and method for nursing care, which uses a camera to collect behavioral videos of the elderly and transmits the videos to a background anti-fall server through a wireless transmission module. More specifically, in the background anti-fall server, artificial intelligence technology based on deep learning is used to process and analyze behavioral monitoring videos to identify the behavioral characteristics of the elderly and intelligently determine whether to generate anti-fall alarm prompts. In this way, when it is detected that the elderly person's behavior may pose a risk of falling, an early warning prompt will be generated through the calling device in time to notify relevant personnel for rescue or intervention.
本发明实施例还提供了一种用于护理的无线防跌倒报警方法,其包括:An embodiment of the present invention also provides a wireless anti-fall alarm method for nursing, which includes:
获取由摄像头采集的被监控老年对象的行为监控视频;Obtain behavioral monitoring videos of elderly subjects being monitored collected by cameras;
将所述行为监控视频通过无线传输模块传输至后台防跌服务器;Transmit the behavior monitoring video to the backend anti-fall server through the wireless transmission module;
在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示;In the background anti-fall server, the behavior monitoring video is analyzed and processed to determine whether an anti-fall alarm prompt is generated;
响应于产生防跌倒报警提示,通过呼叫装置产生预警提示;In response to generating an anti-fall alarm prompt, an early warning prompt is generated through the calling device;
其中,在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示,包括:Among them, in the background anti-fall server, the behavior monitoring video is analyzed and processed to determine whether an anti-fall alarm prompt is generated, including:
对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列;Perform data preprocessing on the behavioral monitoring video to obtain a sequence of trimmed behavioral key frames;
提取所述剪裁后行为关键帧的序列中的老人行为时序特征以得到老人行为时序变化特征向量;Extract the timing characteristics of the elderly behavior in the sequence of clipped behavioral key frames to obtain the timing change feature vector of the behavior of the elderly;
基于所述老人行为时序变化特征向量,确定是否产生防跌倒报警提示;Based on the time-series change feature vector of the elderly person's behavior, determine whether to generate an anti-fall alarm prompt;
其中,对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列,包括:Wherein, data preprocessing is performed on the behavioral monitoring video to obtain a sequence of trimmed behavioral key frames, including:
对所述行为监控视频进行离散化采样处理以得到行为监控关键帧的序列;Perform discrete sampling processing on the behavior monitoring video to obtain a sequence of behavior monitoring key frames;
对所述行为监控关键帧的序列进行随机剪裁以得到所述剪裁后行为关键帧的序列。The sequence of behavioral monitoring key frames is randomly trimmed to obtain the sequence of trimmed behavioral key frames.
本发明实施例还提供了一种用于护理的无线防跌倒报警系统,其包括:An embodiment of the present invention also provides a wireless anti-fall alarm system for nursing care, which includes:
监控视频采集模块,用于获取由摄像头采集的被监控老年对象的行为监控视频;Surveillance video collection module, used to obtain behavioral surveillance videos of elderly subjects being monitored collected by cameras;
视频传输模块,用于将所述行为监控视频通过无线传输模块传输至后台防跌服务器;A video transmission module, used to transmit the behavior monitoring video to the background anti-fall server through the wireless transmission module;
分析和处理模块,用于在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示;An analysis and processing module, used in the background anti-fall server to analyze and process the behavior monitoring video to determine whether an anti-fall alarm prompt is generated;
预警提示生成模块,用于响应于产生防跌倒报警提示,通过呼叫装置产生预警提示;An early warning prompt generation module is used to generate an early warning prompt through the calling device in response to generating an anti-fall alarm prompt;
其中,所述预警提示生成模块,包括:Among them, the early warning prompt generation module includes:
对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列;Perform data preprocessing on the behavioral monitoring video to obtain a sequence of trimmed behavioral key frames;
提取所述剪裁后行为关键帧的序列中的老人行为时序特征以得到老人行为时序变化特征向量;Extract the timing characteristics of the elderly behavior in the sequence of clipped behavioral key frames to obtain the timing change feature vector of the behavior of the elderly;
基于所述老人行为时序变化特征向量,确定是否产生防跌倒报警提示;Based on the time-series change feature vector of the elderly person's behavior, determine whether to generate an anti-fall alarm prompt;
其中,对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列,包括:Wherein, data preprocessing is performed on the behavioral monitoring video to obtain a sequence of trimmed behavioral key frames, including:
对所述行为监控视频进行离散化采样处理以得到行为监控关键帧的序列;Perform discrete sampling processing on the behavior monitoring video to obtain a sequence of behavior monitoring key frames;
对所述行为监控关键帧的序列进行随机剪裁以得到所述剪裁后行为关键帧的序列。The sequence of behavioral monitoring key frames is randomly trimmed to obtain the sequence of trimmed behavioral key frames.
本发明的有益效果:Beneficial effects of the present invention:
利用摄像头采集老年人的行为视频,并通过无线传输模块将视频传输至后台防跌服务器,在后台防跌服务器中,采用基于深度学习的人工智能技术对行为监控视频进行处理与分析,以识别老人的行为特征,并智能化地判断是否产生防跌倒报警提示,这样,在监测到老人行为可能存在跌倒风险时,及时通过呼叫装置产生预警提示,以通知相关人员进行救助或干预。Use cameras to collect behavioral videos of the elderly, and transmit the videos to the backend anti-fall server through the wireless transmission module. In the backend anti-fall server, artificial intelligence technology based on deep learning is used to process and analyze the behavioral monitoring videos to identify the elderly. Behavioral characteristics, and intelligently determine whether to generate an anti-fall alarm prompt. In this way, when it is detected that the elderly person's behavior may pose a risk of falling, an early warning prompt is generated through the calling device in a timely manner to notify relevant personnel for rescue or intervention.
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts. In the attached picture:
图1为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的流程图。Figure 1 is a flow chart of a wireless anti-fall alarm method for nursing provided in an embodiment of the present invention.
图2为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的系统架构的示意图。FIG. 2 is a schematic diagram of the system architecture of a wireless anti-fall alarm method for nursing provided in an embodiment of the present invention.
图3为本发明实施例中提供的一种用于护理的无线防跌倒报警系统的框图。Figure 3 is a block diagram of a wireless anti-fall alarm system for nursing provided in an embodiment of the present invention.
图4为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的应用场景图。Figure 4 is an application scenario diagram of a wireless anti-fall alarm method for nursing provided in an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚明白,下面结合附图对本发明实施例做进一步详细说明。在此,本发明的示意性实施例及其说明用于解释本发明,但并不作为对本发明的限定。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not used to limit the present invention.
除非另有说明,本申请实施例所使用的所有技术和科学术语与本申请的技术领域的技术人员通常理解的含义相同。本申请中所使用的术语只是为了描述具体的实施例的目的,不是旨在限制本申请的范围。Unless otherwise stated, all technical and scientific terms used in the embodiments of this application have the same meanings as commonly understood by those skilled in the technical field of this application. The terminology used in this application is for the purpose of describing specific embodiments only and is not intended to limit the scope of this application.
在本申请实施例记载中,需要说明的是,除非另有说明和限定,术语“连接”应做广义理解,例如,可以是电连接,也可以是两个元件内部的连通,可以是直接相连,也可以通过中间媒介间接相连,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。In the description of the embodiments of this application, it should be noted that, unless otherwise stated and limited, the term "connection" should be understood in a broad sense. For example, it can be an electrical connection, or it can be an internal connection between two elements, or it can be a direct connection. , or can be indirectly connected through an intermediate medium. For those of ordinary skill in the art, the specific meaning of the above terms can be understood according to the specific circumstances.
需要说明的是,本申请实施例所涉及的术语“第一\第二\第三”仅仅只是区别类似的对象,不代表针对对象的特定排序,可以理解地,“第一\第二\第三”在允许的情况下可以互换特定的顺序或先后次序。应该理解“第一\第二\第三”区分的对象在适当情况下可以互换,以使这里描述的本申请的实施例可以除了在这里图示或描述的那些以外的顺序实施。It should be noted that the terms "first\second\third" involved in the embodiments of this application are only used to distinguish similar objects and do not represent a specific ordering of objects. It is understandable that "first\second\third" Three" may interchange specific order or precedence where permitted. It is to be understood that the "first\second\third" distinction may be interchanged under appropriate circumstances so that the embodiments of the present application described herein may be practiced in sequences other than those illustrated or described herein.
随着人口老龄化的趋势,老年人的健康和安全问题日益受到社会的关注,老年人由于身体机能的退化,容易发生跌倒等意外事故,可能会给自身和家庭带来巨大的负担。首先,老年人的健康和安全问题对个人和家庭都具有重要意义,老年人身体机能的退化使得他们更容易受伤,特别是跌倒成为一个常见的意外事故,跌倒可能导致骨折、内出血等严重后果,甚至危及生命。此外,老年人的康复过程也较为缓慢,可能需要长时间的护理和康复治疗,这不仅对老年人自身造成身体和心理上的负担,也给家庭带来了经济和时间上的压力。With the trend of population aging, the health and safety issues of the elderly have received increasing attention from society. Due to the degradation of physical functions, the elderly are prone to accidents such as falls, which may bring a huge burden to themselves and their families. First of all, the health and safety issues of the elderly are of great significance to both individuals and families. The deterioration of the body functions of the elderly makes them more susceptible to injury. In particular, falls have become a common accident. Falls may lead to serious consequences such as fractures and internal bleeding. Even life-threatening. In addition, the recovery process of the elderly is also relatively slow and may require long-term care and rehabilitation treatment. This not only puts a physical and psychological burden on the elderly themselves, but also puts economic and time pressure on their families.
为了解决老年人健康和安全问题,市场上出现了许多需要老年人佩戴或携带特定设备的产品,如手环、腰带、手表等。然而,这些设备存在一些缺点,例如:一些老年人可能觉得这些设备佩戴不舒适,特别是对于那些有关节炎或皮肤敏感的人来说,不适合的佩戴方式可能导致磨损、划伤或过敏等问题,从而降低了老年人使用这些设备的意愿和能力。许多设备需要定期充电,而老年人可能会因为记忆力减退或操作困难而忘记充电。此外,一些设备的电池续航时间相对较短,需要频繁充电,这也给老年人带来了不便。由于技术限制或传感器的不准确性,一些设备可能存在误报的问题,这意味着设备可能会错误地触发警报或通知,导致老年人和家人产生不必要的恐慌和困扰。In order to solve the health and safety problems of the elderly, many products have appeared on the market that require the elderly to wear or carry specific equipment, such as bracelets, belts, watches, etc. However, there are some disadvantages to these devices, such as: some older people may find these devices uncomfortable to wear, especially for those with arthritis or sensitive skin, and inappropriate wearing methods may cause wear, scratches, or allergies. problems, thereby reducing the willingness and ability of older adults to use these devices. Many devices require regular charging, and older adults may forget to do so due to memory loss or difficulty operating them. In addition, the battery life of some devices is relatively short and requires frequent charging, which also brings inconvenience to the elderly. Due to technical limitations or sensor inaccuracies, some devices may have false alarm issues, meaning the device may mistakenly trigger alarms or notifications, causing unnecessary panic and distress to seniors and family members.
针对这些问题,技术和设计方面的改进可以提高老年人使用这些设备的体验和效果,例如,可以优化设备的佩戴方式,采用柔软、透气的材质,确保舒适性和皮肤友好性。同时,延长电池续航时间,优化充电方式,例如使用便携式充电器或无线充电技术,以减少老年人的充电负担。此外,不断改进传感器技术和算法,减少误报率,提高设备的准确性和可靠性。To address these issues, improvements in technology and design can improve the experience and effectiveness of these devices for the elderly. For example, the wearing method of the devices can be optimized and soft, breathable materials can be used to ensure comfort and skin-friendliness. At the same time, extend battery life and optimize charging methods, such as using portable chargers or wireless charging technology, to reduce the charging burden on the elderly. In addition, sensor technology and algorithms are continuously improved to reduce false alarm rates and improve equipment accuracy and reliability.
除了改进设备本身,还可以通过其他方式提供老年人的健康和安全监测。例如,可以利用智能家居技术,安装传感器和摄像头来监测老年人的活动和行为,以及提供远程监护和紧急救援,这种无需佩戴特定设备的解决方案可能更加方便和可接受,同时也可以减少老年人的不适感和隐私顾虑。In addition to improving the devices themselves, there are other ways to provide health and safety monitoring for older adults. For example, smart home technology can be used to install sensors and cameras to monitor the activities and behaviors of the elderly, as well as provide remote monitoring and emergency rescue. This solution that does not require the wearing of specific equipment may be more convenient and acceptable, and can also reduce the risk of elderly people. Human discomfort and privacy concerns.
在本发明的一个实施例中,图1为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的流程图。图2为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的系统架构的示意图。如图1和图2所示,本发明实施例的用于护理的无线防跌倒报警方法,包括:110,获取由摄像头采集的被监控老年对象的行为监控视频;120,将所述行为监控视频通过无线传输模块传输至后台防跌服务器;130,在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示;以及,140,响应于产生防跌倒报警提示,通过呼叫装置产生预警提示。In one embodiment of the present invention, FIG. 1 is a flow chart of a wireless anti-fall alarm method for nursing provided in the embodiment of the present invention. FIG. 2 is a schematic diagram of the system architecture of a wireless anti-fall alarm method for nursing provided in an embodiment of the present invention. As shown in Figures 1 and 2, the wireless anti-fall alarm method for nursing care according to the embodiment of the present invention includes: 110, obtaining the behavior monitoring video of the monitored elderly subject collected by the camera; 120, converting the behavior monitoring video Transmitted to the background anti-fall server through the wireless transmission module; 130, in the background anti-fall server, analyze and process the behavior monitoring video to determine whether an anti-fall alarm prompt is generated; and, 140, in response to the generation of an anti-fall alarm Prompt, generate early warning prompt through calling device.
在步骤110中,获取由摄像头采集的被监控老年对象的行为监控视频。在设置摄像头时,确保其位置和角度能够全面覆盖被监控老年人的活动区域,以获取准确的行为监控视频。同时,要尊重老年人的隐私权,确保摄像头的设置不侵犯其个人隐私。通过获取行为监控视频,可以实时观察老年人的活动和行为,及时发现潜在的危险情况,如跌倒、失去平衡等。In step 110, the behavior monitoring video of the monitored elderly subject collected by the camera is obtained. When setting up the camera, ensure that its position and angle can fully cover the activity area of the monitored elderly person to obtain accurate behavioral monitoring video. At the same time, we must respect the privacy rights of the elderly and ensure that the camera settings do not infringe on their personal privacy. By obtaining behavioral monitoring videos, the activities and behaviors of the elderly can be observed in real time and potentially dangerous situations, such as falls and loss of balance, can be detected in a timely manner.
在步骤120中,将所述行为监控视频通过无线传输模块传输至后台防跌服务器。在进行无线传输时,确保传输的稳定性和安全性,以避免视频数据的丢失或被未授权的人访问。同时,要选择适合的无线传输技术和设备,以确保传输的效果和速度。通过无线传输行为监控视频至后台防跌服务器,可以实现实时监测和数据存储,方便后续的分析和处理。In step 120, the behavior monitoring video is transmitted to the background anti-fall server through the wireless transmission module. When performing wireless transmission, ensure the stability and security of the transmission to avoid loss of video data or access by unauthorized persons. At the same time, appropriate wireless transmission technology and equipment must be selected to ensure transmission effect and speed. By wirelessly transmitting behavioral monitoring videos to the backend anti-fall server, real-time monitoring and data storage can be achieved to facilitate subsequent analysis and processing.
在步骤130中,在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示。在进行行为监控视频的分析和处理时,使用先进的图像处理和计算机视觉算法,以准确识别老年人的行为和动作,并判断是否存在跌倒的风险。同时,要确保系统的准确性和稳定性,尽量降低误报的概率。通过对行为监控视频进行分析和处理,可以实时监测老年人的行为特征,如跌倒、摔倒、突然停止活动等,及时发出预警,提高防跌倒的准确性和效果。In step 130, the background anti-fall server analyzes and processes the behavior monitoring video to determine whether an anti-fall alarm prompt is generated. When analyzing and processing behavioral monitoring videos, advanced image processing and computer vision algorithms are used to accurately identify the behavior and movements of the elderly and determine whether there is a risk of falling. At the same time, it is necessary to ensure the accuracy and stability of the system and minimize the probability of false alarms. By analyzing and processing behavioral monitoring videos, the behavioral characteristics of the elderly, such as falling, falling, sudden cessation of activities, etc., can be monitored in real time, and early warnings can be issued in a timely manner to improve the accuracy and effectiveness of fall prevention.
在步骤140中,响应于产生防跌倒报警提示,通过呼叫装置产生预警提示。在响应防跌倒报警提示时,确保呼叫装置的设置和操作简单易用,以方便老年人及时发出求助信号。同时,要建立有效的报警响应机制,确保相关人员能够及时接收和响应预警提示。通过呼叫装置产生预警提示,可以迅速通知相关人员,如家人、护理人员或医护人员,以便他们及时采取行动,提供紧急援助和护理,减少跌倒事故的发生和严重后果。In step 140, in response to generating an anti-fall alarm prompt, a pre-warning prompt is generated by calling the device. When responding to the anti-fall alarm prompt, ensure that the setting and operation of the calling device are simple and easy to use, so that the elderly can send a signal for help in a timely manner. At the same time, an effective alarm response mechanism must be established to ensure that relevant personnel can receive and respond to early warning prompts in a timely manner. The early warning prompt generated by the calling device can quickly notify relevant personnel, such as family members, caregivers or medical staff, so that they can take timely action to provide emergency assistance and care, and reduce the occurrence and serious consequences of fall accidents.
以上步骤在老年人健康和安全监测中起到重要作用,在实施过程中,注意设备的设置和操作,保障数据的安全和隐私,以及建立有效的报警响应机制。这样,可以实时监测老年人的行为、准确判断跌倒风险、及时发出预警提示,从而提高老年人的安全性和健康状况。The above steps play an important role in monitoring the health and safety of the elderly. During the implementation process, pay attention to the setting and operation of the equipment, ensure the security and privacy of the data, and establish an effective alarm response mechanism. In this way, the behavior of the elderly can be monitored in real time, the risk of falls can be accurately determined, and early warning prompts can be issued in a timely manner, thereby improving the safety and health of the elderly.
针对上述技术问题,本申请的技术构思是利用摄像头采集老年人的行为视频,并通过无线传输模块将视频传输至后台防跌服务器。更具体地,在后台防跌服务器中,采用基于深度学习的人工智能技术对行为监控视频进行处理与分析,以识别老人的行为特征,并智能化地判断是否产生防跌倒报警提示。这样,在监测到老人行为可能存在跌倒风险时,及时通过呼叫装置产生预警提示,以通知相关人员进行救助或干预。In response to the above technical problems, the technical concept of this application is to use a camera to collect behavioral videos of the elderly and transmit the videos to the background anti-fall server through a wireless transmission module. More specifically, in the background anti-fall server, artificial intelligence technology based on deep learning is used to process and analyze behavioral monitoring videos to identify the behavioral characteristics of the elderly and intelligently determine whether to generate anti-fall alarm prompts. In this way, when it is detected that the elderly person's behavior may pose a risk of falling, an early warning prompt will be generated through the calling device in time to notify relevant personnel for rescue or intervention.
基于此,在本申请的技术方案中,首先获取由摄像头采集的被监控老年对象的行为监控视频;并将所述行为监控视频通过无线传输模块传输至后台防跌服务器。也就是,通过视频数据来了解老年人的行为模式和动态变化。应可以理解,视频可以提供直观、详细、连续的信息,包括老年人的姿势、动作、步态等,有助于分析和判断老年人的行为状态。其中,将采集的所述行为监控视频传输至后台防跌服务器中可以集中管理和存储大量的监控数据,避免了在设备端进行大规模数据存储的问题。Based on this, in the technical solution of this application, the behavior monitoring video of the monitored elderly subject collected by the camera is first obtained; and the behavior monitoring video is transmitted to the background anti-fall server through the wireless transmission module. That is, using video data to understand the behavioral patterns and dynamic changes of the elderly. It should be understood that videos can provide intuitive, detailed, and continuous information, including the elderly's posture, movements, gait, etc., which can help analyze and judge the behavioral status of the elderly. Among them, transmitting the collected behavioral monitoring videos to the background anti-fall server can centrally manage and store a large amount of monitoring data, avoiding the problem of large-scale data storage on the device side.
接着,在所述后台防跌服务器,对所述行为监控视频进行离散化采样处理以得到行为监控关键帧的序列;并对所述行为监控关键帧的序列进行随机剪裁以得到剪裁后行为关键帧的序列。这里,行为监控视频通常是连续的视频流,其中包含大量的冗余信息。为了降低计算和存储的成本,并减少后续处理的复杂性,在本申请的技术方案中,对其进行离散化采样处理,以提取视频中的关键信息。此外,对各个行为监控关键帧进行随机剪裁,可以减少噪声、遮挡和其他环境变化的影响。Next, in the background anti-fall server, the behavior monitoring video is discretized and sampled to obtain a sequence of behavior monitoring key frames; and the sequence of behavior monitoring key frames is randomly trimmed to obtain the trimmed behavior key frames. the sequence of. Here, behavioral monitoring videos are usually continuous video streams, which contain a large amount of redundant information. In order to reduce the cost of calculation and storage, and reduce the complexity of subsequent processing, in the technical solution of this application, discrete sampling processing is performed to extract key information in the video. In addition, random clipping of individual behavioral monitoring keyframes can reduce the effects of noise, occlusion, and other environmental changes.
在本申请的一个具体实施例中,在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示,包括:对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列;提取所述剪裁后行为关键帧的序列中的老人行为时序特征以得到老人行为时序变化特征向量;以及,基于所述老人行为时序变化特征向量,确定是否产生防跌倒报警提示。In a specific embodiment of the present application, in the background anti-fall server, the behavior monitoring video is analyzed and processed to determine whether an anti-fall alarm prompt is generated, including: performing data preprocessing on the behavior monitoring video to Obtain a sequence of clipped behavioral key frames; extract the timing characteristics of the elderly behavior in the sequence of clipped behavioral key frames to obtain a timing change feature vector of the behavior of the elderly; and, based on the timing variation feature vector of the behavior of the elderly, determine whether an anti-prevention event occurs. Fall alarm prompt.
其中,通过数据预处理和剪裁,可以从行为监控视频中提取出关键帧序列,即包含重要动作和行为的图像帧,这样做可以减少数据量,提高后续分析的效率,并且关注重点行为,从而更准确地判断老人的行为变化。Among them, through data preprocessing and clipping, key frame sequences can be extracted from behavioral monitoring videos, that is, image frames containing important actions and behaviors. This can reduce the amount of data, improve the efficiency of subsequent analysis, and focus on key behaviors, thereby Determine behavioral changes of the elderly more accurately.
然后,通过提取剪裁后行为关键帧序列中的老人行为时序特征,可以捕捉到老人行为的演变和变化模式,这些特征可以包括步态、姿势、活动频率、动作幅度等信息。通过将这些特征组合成特征向量,可以更好地描述老人的行为状态和变化趋势,为后续的分析和决策提供有用的信息。Then, by extracting the timing features of the elderly behavior in the clipped behavioral key frame sequence, the evolution and change patterns of the elderly behavior can be captured. These features can include information such as gait, posture, activity frequency, and movement amplitude. By combining these features into feature vectors, the behavioral status and changing trends of the elderly can be better described, providing useful information for subsequent analysis and decision-making.
接着,通过基于老人行为时序变化特征向量的分析,可以判断老人是否存在跌倒的风险。例如,可以建立模型或使用机器学习算法来识别异常行为模式,如突然停顿、不规则的步态等,以及与跌倒相关的特征。当监测到这些异常行为时,系统可以产生防跌倒报警提示,及时通知相关人员采取必要的救援措施,从而降低跌倒事故的发生率。Then, through analysis based on the time-series change feature vector of the elderly's behavior, it can be determined whether the elderly is at risk of falling. For example, models or machine learning algorithms can be built to identify abnormal behavioral patterns, such as sudden pauses, irregular gaits, etc., as well as characteristics associated with falls. When these abnormal behaviors are detected, the system can generate anti-fall alarm prompts and promptly notify relevant personnel to take necessary rescue measures, thereby reducing the incidence of fall accidents.
通过对行为监控视频的预处理和剪裁,提取老人行为时序特征,以及基于这些特征来判断是否产生防跌倒报警提示,可以提高老人健康和安全监测系统的准确性和效果。By preprocessing and tailoring behavioral monitoring videos, extracting the timing characteristics of the elderly's behavior, and judging whether to generate anti-fall alarm prompts based on these characteristics, the accuracy and effectiveness of the elderly health and safety monitoring system can be improved.
进一步地,在本申请的一个具体实施例中,对所述行为监控视频进行数据预处理以得到剪裁后行为关键帧的序列,包括:对所述行为监控视频进行离散化采样处理以得到行为监控关键帧的序列;以及,对所述行为监控关键帧的序列进行随机剪裁以得到所述剪裁后行为关键帧的序列。Further, in a specific embodiment of the present application, performing data preprocessing on the behavior monitoring video to obtain a sequence of trimmed behavior key frames includes: performing discretization sampling processing on the behavior monitoring video to obtain the behavior monitoring A sequence of key frames; and, randomly trimming the sequence of behavioral monitoring key frames to obtain the sequence of trimmed behavioral key frames.
其中,离散化采样处理可以将连续的行为监控视频转化为一系列离散的关键帧,通过选择关键帧进行处理和分析,可以减少数据量和计算负载,提高系统的效率。关键帧通常包含重要的动作和行为信息,因此可以更集中地关注和分析老人的关键行为,从而更准确地判断是否产生防跌倒报警提示。Among them, discrete sampling processing can convert continuous behavioral monitoring videos into a series of discrete key frames. By selecting key frames for processing and analysis, the amount of data and computing load can be reduced, and the efficiency of the system can be improved. Key frames usually contain important action and behavior information, so the key behaviors of the elderly can be more focused and analyzed to more accurately determine whether to generate an anti-fall alarm prompt.
随机剪裁可以从行为监控关键帧的序列中选择不同的时间段和视角进行剪裁,以获得多样化的行为关键帧,这样可以增加数据的多样性,提高模型的泛化能力和鲁棒性。通过剪裁后的行为关键帧序列,可以更全面地捕捉老人行为的不同方面和变化模式,从而更准确地提取行为特征和判断是否产生防跌倒报警提示。Random clipping can select different time periods and perspectives from the sequence of behavioral monitoring key frames to obtain diverse behavioral key frames, which can increase the diversity of data and improve the generalization ability and robustness of the model. Through the tailored behavioral key frame sequence, different aspects and changing patterns of the elderly's behavior can be captured more comprehensively, thereby more accurately extracting behavioral characteristics and determining whether to generate anti-fall alarm prompts.
对行为监控视频进行离散化采样处理以得到行为监控关键帧的序列,并对关键帧序列进行随机剪裁以得到剪裁后行为关键帧的序列,可以提高系统的效率、减少计算负载,并增加数据的多样性和泛化能力,这样可以更准确地捕捉老人行为的关键信息和变化模式,为后续的特征提取和分类分析提供更有用的数据基础。Perform discrete sampling processing on behavior monitoring videos to obtain a sequence of behavior monitoring key frames, and randomly trim the key frame sequence to obtain a sequence of trimmed behavior key frames, which can improve system efficiency, reduce computing load, and increase data efficiency. Diversity and generalization capabilities can more accurately capture the key information and changing patterns of the elderly's behavior, providing a more useful data basis for subsequent feature extraction and classification analysis.
在本申请的一个具体示例中,对所述行为监控关键帧的序列进行基于老人感兴趣区域的随机剪裁,也就是,若老人所在的区域占剪裁区域的80%以上则保留。通过这样的方式能够一定程度的去除背景带来的影响,让模型专注老人区域的行为模式的学习。In a specific example of this application, the sequence of behavior monitoring key frames is randomly clipped based on the area of interest of the elderly. That is, if the area where the elderly is located accounts for more than 80% of the clipping area, it is retained. In this way, the influence of the background can be removed to a certain extent, allowing the model to focus on learning the behavioral patterns of the elderly area.
然后,将所述剪裁后行为关键帧的序列通过基于卷积神经网络模型的行为特征提取器以得到老人行为特征向量的序列。也就是,利用卷积神经网络模型来构建所述行为特征提取器,以捕捉老年人的行为模式和时序动态变化。Then, the sequence of clipped behavioral key frames is passed through a behavioral feature extractor based on a convolutional neural network model to obtain a sequence of behavioral feature vectors of the elderly. That is, a convolutional neural network model is used to construct the behavioral feature extractor to capture the behavioral patterns and temporal dynamic changes of the elderly.
在本申请的一个具体实施例中,提取所述剪裁后行为关键帧的序列中的老人行为时序特征以得到老人行为时序变化特征向量,包括:利用深度学习网络模型提取所述剪裁后行为关键帧的序列中的老人行为特征以得到老人行为特征向量的序列;以及,分别计算所述老人行为特征向量的序列中前N-1个老人行为特征向量和第N个老人行为特征向量之间的相关度以得到由多个相关度组成的所述老人行为时序变化特征向量。N为所述老人行为特征向量的序列中所述老人行为特征向量的个数。In a specific embodiment of the present application, extracting the elderly behavior temporal characteristics in the sequence of clipped behavioral key frames to obtain the elderly behavior temporal change feature vector includes: using a deep learning network model to extract the clipped behavioral key frames The behavioral characteristics of the elderly in the sequence to obtain the sequence of behavioral characteristic vectors of the elderly; and, calculate the correlation between the first N-1 elderly behavioral characteristic vectors and the Nth elderly behavioral characteristic vector in the sequence of the elderly behavioral characteristic vectors. degree to obtain the time-series change feature vector of the elderly behavior composed of multiple correlation degrees. N is the number of the elderly behavior feature vectors in the sequence of the elderly behavior feature vectors.
利用深度学习网络模型提取所述剪裁后行为关键帧的序列中的老人行为特征以得到老人行为特征向量的序列。其中,使用深度学习网络模型可以学习和提取剪裁后行为关键帧中的丰富特征表示,深度学习模型能够自动学习和捕捉图像中的语义信息和上下文关系,从而更准确地表征老人的行为。通过提取老人行为特征向量的序列,可以将行为转化为计算机可处理的形式,为后续的时序分析提供基础。A deep learning network model is used to extract the behavioral features of the elderly in the sequence of clipped behavioral key frames to obtain a sequence of behavioral feature vectors of the elderly. Among them, the deep learning network model can be used to learn and extract rich feature representations in the clipped behavioral key frames. The deep learning model can automatically learn and capture the semantic information and contextual relationships in the image, thereby more accurately characterizing the behavior of the elderly. By extracting the sequence of the elderly's behavior feature vectors, the behavior can be converted into a computer-processable form, providing a basis for subsequent time series analysis.
分别计算所述老人行为特征向量的序列中前N-1个老人行为特征向量和第N个老人行为特征向量之间的相关度以得到由多个相关度组成的所述老人行为时序变化特征向量。通过计算行为特征向量序列中相邻向量之间的相关度,可以捕捉到老人行为的时序变化模式。相关度反映了相邻行为特征向量之间的相似性和变化趋势,可以用于判断老人行为的稳定性和异常情况。通过将多个相关度组成的时序变化特征向量,可以更全面地描述老人行为的动态变化,提供更多信息用于判断是否产生防跌倒报警提示。Calculate the correlation between the first N-1 elderly behavior feature vectors and the Nth elderly behavior feature vector in the sequence of the elderly's behavior feature vectors to obtain the time-series change feature vector of the elderly's behavior composed of multiple correlations. . By calculating the correlation between adjacent vectors in the behavioral feature vector sequence, the temporal change pattern of the elderly behavior can be captured. The correlation reflects the similarity and changing trend between adjacent behavioral feature vectors, and can be used to judge the stability and abnormality of the elderly's behavior. By combining multiple correlation degrees into a time-series changing feature vector, the dynamic changes in the elderly's behavior can be described more comprehensively, and more information can be provided to determine whether to generate an anti-fall alarm prompt.
利用深度学习网络模型提取老人行为特征向量的序列,并计算相关度以得到老人行为时序变化特征向量,可以提高对老人行为变化的敏感性和准确性。这样,可以提取丰富的行为特征表示、捕捉行为的时序变化模式,以及提供更多信息用于判断老人行为的稳定性和异常情况,以进一步提升老年人健康和安全监测系统的性能和效果。Using the deep learning network model to extract the sequence of the elderly's behavioral feature vectors and calculating the correlation to obtain the temporal change feature vectors of the elderly's behavior can improve the sensitivity and accuracy of the changes in the elderly's behavior. In this way, rich behavioral feature representations can be extracted, the temporal change patterns of behavior can be captured, and more information can be provided to judge the stability and abnormality of the elderly's behavior to further improve the performance and effectiveness of the elderly health and safety monitoring system.
其中,所述深度学习网络模型为基于卷积神经网络模型的行为特征提取器;其中,所述基于卷积神经网络模型的行为特征提取器,包括:输入层、卷积层、池化层、激活层和输出层。Wherein, the deep learning network model is a behavioral feature extractor based on a convolutional neural network model; wherein the behavioral feature extractor based on a convolutional neural network model includes: an input layer, a convolution layer, a pooling layer, Activation layer and output layer.
具体地,利用深度学习网络模型提取所述剪裁后行为关键帧的序列中的老人行为特征以得到老人行为特征向量的序列,包括:将所述剪裁后行为关键帧的序列通过所述基于卷积神经网络模型的行为特征提取器以得到所述老人行为特征向量的序列。Specifically, using a deep learning network model to extract the behavioral features of the elderly in the sequence of clipped behavioral key frames to obtain a sequence of behavioral feature vectors of the elderly includes: passing the sequence of clipped behavioral key frames through the convolution-based The behavioral feature extractor of the neural network model is used to obtain the sequence of behavioral feature vectors of the elderly.
卷积神经网络是一种强大的深度学习模型,擅长从图像数据中提取高级特征,通过将剪裁后的行为关键帧序列输入卷积神经网络模型,可以自动学习和提取与老人行为相关的抽象特征,这些特征可以捕捉到行为的空间和时间结构,包括姿势、动作模式、速度等方面的信息,从而更全面地描述老人的行为特征。The convolutional neural network is a powerful deep learning model that is good at extracting high-level features from image data. By inputting the clipped behavioral key frame sequence into the convolutional neural network model, it can automatically learn and extract abstract features related to the behavior of the elderly. , these features can capture the spatial and temporal structure of behavior, including information on posture, action patterns, speed, etc., thereby more comprehensively describing the behavioral characteristics of the elderly.
通过将行为关键帧序列输入卷积神经网络模型,可以捕捉到行为的时序变化模式,卷积神经网络模型在处理序列数据时可以利用卷积和池化等操作来提取时序相关的特征。这样可以更好地理解老人行为的动态变化,包括行为的持续时间、速度变化、行为序列的顺序等方面的信息,时序变化建模有助于更准确地判断是否产生防跌倒报警提示,以及对老人行为状态的持续监测和分析。By inputting the behavioral key frame sequence into the convolutional neural network model, the temporal change pattern of the behavior can be captured. The convolutional neural network model can use operations such as convolution and pooling to extract timing-related features when processing sequence data. This can better understand the dynamic changes in the elderly's behavior, including the duration of behavior, speed changes, the order of behavior sequences, etc. Time series change modeling helps to more accurately determine whether to generate anti-fall alarm prompts, and to Continuous monitoring and analysis of the elderly’s behavioral status.
通过使用基于卷积神经网络模型的行为特征提取器,可以实现自动化的特征提取过程。传统的特征提取方法需要手动定义和提取特征,而基于卷积神经网络的特征提取器可以自动学习和提取与任务相关的特征,这样可以减少人工特征工程的工作量和主观性,提高特征的准确性和表达能力。By using a behavioral feature extractor based on a convolutional neural network model, the feature extraction process can be automated. Traditional feature extraction methods require manual definition and extraction of features, while feature extractors based on convolutional neural networks can automatically learn and extract task-related features, which can reduce the workload and subjectivity of manual feature engineering and improve the accuracy of features. sexuality and expressiveness.
随后,分别计算所述老人行为特征向量的序列中前N-1个老人行为特征向量和第N个老人行为特征向量之间的相关度以得到由多个相关度组成的老人行为时序变化特征向量,其中,N为所述老人行为特征向量的序列中所述老人行为特征向量的个数。应可以理解,老年人的行为通常具有一定的时序变化特征,通过计算相邻特征向量之间的相关度,可以捕捉到行为随时间的变化趋势。这有助于了解老年人的日常活动模式、行为习惯以及可能存在的异常行为。具体来说,如果相关度值较低,可能意味着老年人的行为发生了不寻常的变化,例如跌倒、昏迷或其他紧急情况。Subsequently, the correlation degree between the first N-1 elderly behavior feature vectors and the Nth elderly behavior feature vector in the sequence of the elderly behavior feature vectors is calculated respectively to obtain the elderly behavior time series change feature vector composed of multiple correlation degrees. , where N is the number of the elderly behavior feature vectors in the sequence of the elderly behavior feature vectors. It should be understood that the behavior of the elderly usually has certain temporal change characteristics, and by calculating the correlation between adjacent feature vectors, the behavior change trend over time can be captured. This helps to understand the daily activity patterns, behavioral habits and possible abnormal behaviors of the elderly. Specifically, a low correlation value may mean that an older person has experienced unusual changes in behavior, such as a fall, coma, or other emergency.
进一步地,将所述老人行为时序变化特征向量通过分类器以得到分类结果,所述分类结果用于表示是否产生防跌倒报警提示;并响应于所述分类结果为产生防跌倒报警提示,通过呼叫装置产生预警提示。其中,呼叫装置通常用于向他人发送紧急请求或呼叫信号以获取帮助或支援。呼叫装置常见于医疗机构、护理院、安全中心、家庭环境等需要及时响应紧急情况的场所。它们可以为老年人、病患、残障人士等提供一种便捷的方式来寻求帮助,并在紧急情况下提供及时的援助。这里,呼叫装置产生预警提示之后,相关护理人员能够及时采取相应的措施以防止老人发生意外事故。Further, the time-series change feature vector of the elderly person's behavior is passed through a classifier to obtain a classification result, and the classification result is used to indicate whether an anti-fall alarm prompt is generated; and in response to the classification result indicating that an anti-fall alarm prompt is generated, by calling The device generates an early warning prompt. Among them, the calling device is usually used to send emergency requests or calling signals to others to obtain help or support. Calling devices are commonly found in medical institutions, nursing homes, security centers, home environments and other places where timely response to emergencies is required. They can provide a convenient way for the elderly, sick, disabled, etc. to seek help and provide timely assistance in emergencies. Here, after the calling device generates an early warning prompt, the relevant nursing staff can take corresponding measures in time to prevent the elderly from accidents.
在本申请的一个具体实施例中,基于所述老人行为时序变化特征向量,确定是否产生防跌倒报警提示,包括:将所述老人行为时序变化特征向量通过分类器以得到分类结果,所述分类结果用于表示是否产生防跌倒报警提示。In a specific embodiment of the present application, determining whether to generate an anti-fall alarm prompt based on the time-series change feature vector of the elderly person's behavior includes: passing the time-series change feature vector of the old man's behavior through a classifier to obtain a classification result, and the classification The result is used to indicate whether an anti-fall alarm prompt is generated.
通过将老人行为时序变化特征向量输入分类器进行分类,可以实时地监测老人的行为状态,分类器可以根据预先训练好的模型和标记数据,判断当前的行为特征向量是否属于跌倒或其他危险行为的范畴,如果分类结果表明可能发生跌倒或其他危险情况,系统可以立即产生防跌倒报警提示,以便及时采取必要的救援措施。通过使用分类器对老人行为时序变化特征向量进行分类,可以实现自动化的决策过程,分类器可以基于模式和规则,自动判断老人的行为状态,并根据需要触发相应的报警提示,这样可以减轻人工监测的负担,提高监测系统的效率和准确性。By inputting the time-series change feature vector of the elderly's behavior into the classifier for classification, the behavioral status of the elderly can be monitored in real time. The classifier can determine whether the current behavioral feature vector belongs to a fall or other dangerous behavior based on the pre-trained model and labeled data. category, if the classification results indicate that a fall or other dangerous situation may occur, the system can immediately generate an anti-fall alarm prompt so that necessary rescue measures can be taken in a timely manner. By using a classifier to classify the time-series change feature vectors of the elderly's behavior, an automated decision-making process can be realized. The classifier can automatically determine the behavior status of the elderly based on patterns and rules, and trigger corresponding alarm prompts as needed, which can alleviate manual monitoring. burden and improve the efficiency and accuracy of the monitoring system.
分类器可以根据不同老人的行为特征和需求进行个性化适应,通过分类器使用多样化的数据和特征,可以使分类器更好地适应不同老人的行为模式和习惯,这样可以提高系统的灵活性和适应性,更准确地判断是否产生防跌倒报警提示,并减少误报和漏报的情况。将老人行为时序变化特征向量通过分类器进行分类,以得到分类结果来表示是否产生防跌倒报警提示,可以实现实时预警、自动化决策和个性化适应的有益效果,以提高老年人健康和安全监测系统的准确性、效率和用户体验。The classifier can be personalized according to the behavioral characteristics and needs of different elderly people. By using diversified data and features through the classifier, the classifier can better adapt to the behavioral patterns and habits of different elderly people, which can improve the flexibility of the system. and adaptability, more accurately determine whether to generate an anti-fall alarm prompt, and reduce false alarms and false negatives. Classify the time-series change feature vector of the elderly's behavior through a classifier to obtain the classification result to indicate whether an anti-fall alarm prompt is generated. This can achieve the beneficial effects of real-time warning, automated decision-making and personalized adaptation to improve the health and safety monitoring system for the elderly. accuracy, efficiency and user experience.
在本申请的一个实施例中,所述用于护理的无线防跌倒报警方法,还包括训练步骤:对所述基于卷积神经网络模型的行为特征提取器和所述分类器进行训练;其中,所述训练步骤,包括:获取训练数据,所述训练数据包括训练行为监控视频,以及,是否产生防跌倒报警提示的真实值;在所述后台防跌服务器,对所述训练行为监控视频进行离散化采样处理以得到训练行为监控关键帧的序列;对所述训练行为监控关键帧的序列进行随机剪裁以得到训练剪裁后行为关键帧的序列;将所述训练剪裁后行为关键帧的序列通过所述基于卷积神经网络模型的行为特征提取器以得到训练老人行为特征向量的序列;分别计算所述训练老人行为特征向量的序列中前N-1个训练老人行为特征向量和第N个训练老人行为特征向量之间的相关度以得到由多个相关度组成的训练老人行为时序变化特征向量,其中,N为所述训练老人行为特征向量的序列中所述训练老人行为特征向量的个数;将所述训练老人行为时序变化特征向量通过所述分类器以得到分类损失函数值;以及,以所述分类损失函数值对所述基于卷积神经网络模型的行为特征提取器和所述分类器进行训练,其中,在所述训练的每一轮迭代中,对所述训练老人行为时序变化特征向量进行训练优化。In one embodiment of the present application, the wireless anti-fall alarm method for nursing also includes a training step: training the behavioral feature extractor and the classifier based on the convolutional neural network model; wherein, The training step includes: obtaining training data, the training data including training behavior monitoring video, and whether the true value of the anti-fall alarm prompt is generated; in the background anti-fall server, discretely performing the training behavior monitoring video Sampling processing is performed to obtain a sequence of training behavior monitoring key frames; the sequence of training behavior monitoring key frames is randomly trimmed to obtain a sequence of training behavior monitoring key frames; and the sequence of training behavior monitoring key frames is passed through the Describe the behavioral feature extractor based on the convolutional neural network model to obtain the sequence of training old man behavior feature vectors; calculate the first N-1 training old man behavior feature vectors and the Nth training old man behavior feature vector in the sequence of training old man behavior feature vectors. The correlation between the behavior feature vectors is used to obtain the time-series change feature vector of the trained old man's behavior composed of multiple correlation degrees, where N is the number of the trained old man's behavior feature vector in the sequence of the trained old man's behavior feature vector; Pass the time-series change feature vector of the trained elderly person's behavior through the classifier to obtain a classification loss function value; and use the classification loss function value to compare the behavioral feature extractor based on the convolutional neural network model and the classifier Training is performed, wherein in each iteration of the training, training optimization is performed on the temporal change feature vector of the trained elderly person's behavior.
在上述技术方案中,所述训练老人行为特征向量的序列中的每个训练老人行为特征向量表示相应的剪裁后行为关键帧的图像语义特征,这里,考虑到在对所述训练行为采集视频进行离散化采样处理以得到训练行为监控关键帧的序列,并对所述训练行为监控关键帧的序列进行随机剪裁以得到剪裁后行为关键帧的序列的情况下,虽然可以提升源图像语义的时序方向表达随机性,从而提升了特征回归泛化性能,但也显著加大了由于源图像语义随机分布差异导致的图像语义特征分布不均衡,使得分别计算所述训练老人行为特征向量的序列中前N-1个训练老人行为特征向量和第N个训练老人行为特征向量之间的相关度得到的由多个相关度组成的所述训练老人行为时序变化特征向量也会具有整体特征分布的较为显著的不一致和不稳定,从而影响其通过分类器进行分类训练的稳定性。In the above technical solution, each training old man behavior feature vector in the sequence of training old man behavior feature vectors represents the image semantic feature of the corresponding clipped behavioral key frame. Here, considering that the training behavior collection video is processed In the case of discrete sampling processing to obtain a sequence of training behavior monitoring key frames, and randomly trimming the sequence of training behavior monitoring key frames to obtain a sequence of trimmed behavior key frames, although the temporal direction of the source image semantics can be improved Express randomness, thereby improving the generalization performance of feature regression, but it also significantly increases the uneven distribution of image semantic features caused by the difference in the random distribution of source image semantics, making the top N of the sequence of the training elderly behavior feature vectors separately calculated -The correlation degree between the 1 training old man's behavior feature vector and the Nth training old man's behavior feature vector. The training old man's behavior temporal change feature vector composed of multiple correlation degrees will also have a more significant overall characteristic distribution. Inconsistent and unstable, thus affecting the stability of its classification training through the classifier.
基于此,本申请的申请人在将所述训练老人行为时序变化特征向量通过分类器进行分类训练时,在每次迭代时对所述训练老人行为时序变化特征向量进行训练优化,具体表示为:以如下优化公式在所述训练的每一轮迭代中,对所述训练老人行为时序变化特征向量进行训练优化以得到优化训练老人行为时序变化特征向量;其中,所述优化公式为:Based on this, the applicant of this application performs training and optimization on the temporal change feature vector of the trained elderly person's behavior in each iteration when classifying and training the temporal change feature vector of the trained elderly person's behavior through a classifier, which is specifically expressed as: In each iteration of the training, the following optimization formula is used to perform training optimization on the behavioral temporal change feature vector of the trained elderly person to obtain the optimal trained elderly behavioral temporal variation feature vector; wherein, the optimization formula is:
; ;
其中,是所述训练老人行为时序变化特征向量/>的特征值,/>和/>分别是所述训练老人行为时序变化特征向量/>的1范数和2范数,/>是所述训练老人行为时序变化特征向量/>的长度,且/>是与/>相关的权重超参数,/>是所述优化训练老人行为时序变化特征向量的特征值,/>表示计算以数值为幂的自然指数函数值。in, is the time-series change feature vector of the trained elderly person’s behavior/> eigenvalues,/> and/> They are respectively the time series change feature vectors of the trained elderly people’s behavior/> The 1 norm and 2 norm of ,/> is the time-series change feature vector of the trained elderly person’s behavior/> The length of , and/> Yes and/> Relevant weight hyperparameters, /> is the eigenvalue of the time-series change eigenvector of the elderly’s behavior in the optimized training,/> Represents the calculation of the value of a natural exponential function raised to a numerical power.
这里,通过所述训练老人行为时序变化特征向量的整体特征分布分别在绝对距离的刚性结构和空间距离的非刚性结构下的结构一致性和稳定性表示,来使得所述训练老人行为时序变化特征向量/>的全局特征分布对于局部模式变化具有一定重复性,以在所述训练老人行为时序变化特征向量/>通过分类器进行分类时,对于全局特征分布经由分类器的权重矩阵的尺度和旋转变化具有鲁棒性,提升分类训练的稳定性。Here, through the training of the elderly behavior temporal change feature vector The overall feature distribution is represented by the structural consistency and stability under the rigid structure of absolute distance and the non-rigid structure of spatial distance respectively, so as to make the time-series change feature vector of the behavior of the trained elderly/> The global feature distribution has a certain degree of repeatability for local pattern changes, so that the feature vector changes in the time series of the trained elderly person's behavior/> When classifying through a classifier, it is robust to changes in the scale and rotation of the global feature distribution through the weight matrix of the classifier, improving the stability of classification training.
综上,基于本发明实施例的用于护理的无线防跌倒报警方法被阐明,其在监测到老人行为可能存在跌倒风险时,及时通过呼叫装置产生预警提示,以通知相关人员进行救助或干预。In summary, the wireless anti-fall alarm method for nursing care based on the embodiment of the present invention has been clarified. When it detects that the elderly person's behavior may pose a risk of falling, it will promptly generate an early warning prompt through the calling device to notify relevant personnel for rescue or intervention.
图3为本发明实施例中提供的一种用于护理的无线防跌倒报警系统的框图。如图3所示,所述用于护理的无线防跌倒报警系统200,包括:监控视频采集模块210,用于获取由摄像头采集的被监控老年对象的行为监控视频;视频传输模块220,用于将所述行为监控视频通过无线传输模块传输至后台防跌服务器;分析和处理模块230,用于在所述后台防跌服务器,对所述行为监控视频进行分析和处理以确定是否产生防跌倒报警提示;以及,预警提示生成模块240,用于响应于产生防跌倒报警提示,通过呼叫装置产生预警提示。Figure 3 is a block diagram of a wireless anti-fall alarm system for nursing provided in an embodiment of the present invention. As shown in Figure 3, the wireless anti-fall alarm system 200 for nursing includes: a surveillance video collection module 210, used to obtain the behavior surveillance video of the monitored elderly subject collected by the camera; a video transmission module 220, used to The behavior monitoring video is transmitted to the background anti-fall server through the wireless transmission module; the analysis and processing module 230 is used in the background anti-fall server to analyze and process the behavior monitoring video to determine whether to generate an anti-fall alarm. Prompt; and, the early warning prompt generation module 240 is used to generate an early warning prompt by calling the device in response to generating an anti-fall alarm prompt.
本领域技术人员可以理解,上述用于护理的无线防跌倒报警系统中的各个步骤的具体操作已经在上面图1与图2的用于护理的无线防跌倒报警方法的描述中得到了详细介绍,并因此,将省略其重复描述。Those skilled in the art can understand that the specific operations of each step in the wireless anti-fall alarm system for nursing care have been described in detail in the description of the wireless anti-fall alarm method for nursing care in Figures 1 and 2 above. And therefore, repeated description thereof will be omitted.
如上所述,根据本发明实施例的用于护理的无线防跌倒报警系统200可以实现在各种终端设备中,例如用于护理的无线防跌倒报警的服务器等。在一个示例中,根据本发明实施例的用于护理的无线防跌倒报警系统200可以作为一个软件模块和/或硬件模块而集成到终端设备中。例如,该用于护理的无线防跌倒报警系统200可以是该终端设备的操作系统中的一个软件模块,或者可以是针对于该终端设备所开发的一个应用程序;当然,该用于护理的无线防跌倒报警系统200同样可以是该终端设备的众多硬件模块之一。As mentioned above, the wireless anti-fall alarm system 200 for nursing care according to the embodiment of the present invention can be implemented in various terminal devices, such as a server for wireless anti-fall alarm for nursing care, etc. In one example, the wireless anti-fall alarm system 200 for nursing care according to an embodiment of the present invention can be integrated into a terminal device as a software module and/or a hardware module. For example, the wireless anti-fall alarm system 200 for nursing can be a software module in the operating system of the terminal device, or can be an application developed for the terminal device; of course, the wireless anti-fall alarm system 200 for nursing The anti-fall alarm system 200 can also be one of many hardware modules of the terminal device.
替换地,在另一示例中,该用于护理的无线防跌倒报警系统200与该终端设备也可以是分立的设备,并且该用于护理的无线防跌倒报警系统200可以通过有线和/或无线网络连接到该终端设备,并且按照约定的数据格式来传输交互信息。Alternatively, in another example, the wireless anti-fall alarm system 200 for nursing and the terminal device may also be separate devices, and the wireless anti-fall alarm system 200 for nursing may be connected via wired and/or wireless devices. The network is connected to the terminal device and transmits interactive information according to the agreed data format.
图4为本发明实施例中提供的一种用于护理的无线防跌倒报警方法的应用场景图。如图4所示,在该应用场景中,首先,获取由摄像头采集的被监控老年对象(例如,如图4中所示意的M)的行为监控视频(例如,如图4中所示意的C);然后,将获取的行为监控视频输入至部署有用于护理的无线防跌倒报警算法的服务器(例如,如图4中所示意的S)中,其中所述服务器能够基于用于护理的无线防跌倒报警算法对所述行为监控视频进行处理,以通过呼叫装置产生预警提示。Figure 4 is an application scenario diagram of a wireless anti-fall alarm method for nursing provided in an embodiment of the present invention. As shown in Figure 4, in this application scenario, first, obtain the behavior monitoring video (for example, C shown in Figure 4) of the monitored elderly subject (for example, M shown in Figure 4) collected by the camera. ); then, input the acquired behavior monitoring video into a server (for example, S as shown in Figure 4) deployed with a wireless anti-fall alarm algorithm for nursing, where the server can be based on the wireless anti-fall alarm algorithm for nursing. The fall alarm algorithm processes the behavioral monitoring video to generate an early warning prompt through the calling device.
以上所述的具体实施例,对本发明的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施例而已,并不用于限定本发明的保护范围,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The specific embodiments described above further describe the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific embodiments of the present invention and are not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311706765.2A CN117409538A (en) | 2023-12-13 | 2023-12-13 | Wireless anti-fall alarm system and method for nursing care |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311706765.2A CN117409538A (en) | 2023-12-13 | 2023-12-13 | Wireless anti-fall alarm system and method for nursing care |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117409538A true CN117409538A (en) | 2024-01-16 |
Family
ID=89491134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311706765.2A Pending CN117409538A (en) | 2023-12-13 | 2023-12-13 | Wireless anti-fall alarm system and method for nursing care |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117409538A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118015785A (en) * | 2024-04-07 | 2024-05-10 | 吉林大学 | Remote monitoring nursing system and method thereof |
| CN118470905A (en) * | 2024-07-15 | 2024-08-09 | 无锡顶视科技有限公司 | Personnel falling monitoring system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060053342A1 (en) * | 2004-09-09 | 2006-03-09 | Bazakos Michael E | Unsupervised learning of events in a video sequence |
| CN106529418A (en) * | 2016-10-19 | 2017-03-22 | 中国科学院计算技术研究所 | Fall detection and alarm method |
| CN113111842A (en) * | 2021-04-26 | 2021-07-13 | 浙江商汤科技开发有限公司 | Action recognition method, device, equipment and computer readable storage medium |
| CN115937975A (en) * | 2022-12-08 | 2023-04-07 | 哈尔滨工业大学(深圳) | An action recognition method and system based on multimodal sequence fusion |
| CN116416545A (en) * | 2021-12-31 | 2023-07-11 | 武汉Tcl集团工业研究院有限公司 | Behavior detection method, apparatus, device and computer readable storage medium |
-
2023
- 2023-12-13 CN CN202311706765.2A patent/CN117409538A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060053342A1 (en) * | 2004-09-09 | 2006-03-09 | Bazakos Michael E | Unsupervised learning of events in a video sequence |
| CN106529418A (en) * | 2016-10-19 | 2017-03-22 | 中国科学院计算技术研究所 | Fall detection and alarm method |
| CN113111842A (en) * | 2021-04-26 | 2021-07-13 | 浙江商汤科技开发有限公司 | Action recognition method, device, equipment and computer readable storage medium |
| CN116416545A (en) * | 2021-12-31 | 2023-07-11 | 武汉Tcl集团工业研究院有限公司 | Behavior detection method, apparatus, device and computer readable storage medium |
| CN115937975A (en) * | 2022-12-08 | 2023-04-07 | 哈尔滨工业大学(深圳) | An action recognition method and system based on multimodal sequence fusion |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118015785A (en) * | 2024-04-07 | 2024-05-10 | 吉林大学 | Remote monitoring nursing system and method thereof |
| CN118015785B (en) * | 2024-04-07 | 2024-06-07 | 吉林大学 | Remote monitoring nursing system and method thereof |
| CN118470905A (en) * | 2024-07-15 | 2024-08-09 | 无锡顶视科技有限公司 | Personnel falling monitoring system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7559391B2 (en) | Systems and methods, computer-implemented methods, programs, and processors for event prevention and prediction - Patents.com | |
| Doukas et al. | Emergency fall incidents detection in assisted living environments utilizing motion, sound, and visual perceptual components | |
| Khan et al. | Review of fall detection techniques: A data availability perspective | |
| Cheffena | Fall detection using smartphone audio features | |
| Igual et al. | Challenges, issues and trends in fall detection systems | |
| US20210063214A1 (en) | Activity Monitoring Systems And Methods | |
| US20210065891A1 (en) | Privacy-Preserving Activity Monitoring Systems And Methods | |
| CN110852382A (en) | A behavior recognition system based on spatiotemporal multi-feature extraction and its working method | |
| Yazici et al. | A smart e-health framework for monitoring the health of the elderly and disabled | |
| CN117409538A (en) | Wireless anti-fall alarm system and method for nursing care | |
| López-Cuevas et al. | FiToViz: A visualisation approach for real-time risk situation awareness | |
| Chiu et al. | A convolutional neural networks approach with infrared array sensor for bed-exit detection | |
| Fayad et al. | Fall detection application for the elderly in the family heroes system | |
| Vi et al. | Efficient real-time devices based on accelerometer using machine learning for har on low-performance microcontrollers | |
| Warunsin et al. | Wristband fall detection system using deep learning | |
| Dai | Vision-based 3d human motion analysis for fall detection and bed-exiting | |
| Chen et al. | Improve the Accuracy of Fall Detection Based on Artificial Intelligence Algorithm. | |
| Javed et al. | Cognitive health assessment of decentralized smart home activities using federated learning | |
| Soman et al. | A novel fall detection system using Mediapipe | |
| Begum et al. | Ambient-Assisted Senior Living with Disabilities in an Intelligent House using CNN Behavior Prediction | |
| Gao | Abnormal behavior detection and warning based on deep intelligent video analysis for geriatric patients | |
| Sathya | Federated Learning Based Elderly Fall Detection Using Edge Computing | |
| Doukas et al. | Advanced classification and rules-based evaluation of motion, visual and biosignal data for patient fall incident detection | |
| Al Duhayyim | Automated Disabled People Fall Detection Using Cuckoo Search with Mobile Networks. | |
| AU2021106380A4 (en) | An novel method -intelligent safe home system for the elderly people. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20240116 |