[go: up one dir, main page]

HK40020128B - A system and method for detecting inactive objects - Google Patents

A system and method for detecting inactive objects Download PDF

Info

Publication number
HK40020128B
HK40020128B HK42020009818.4A HK42020009818A HK40020128B HK 40020128 B HK40020128 B HK 40020128B HK 42020009818 A HK42020009818 A HK 42020009818A HK 40020128 B HK40020128 B HK 40020128B
Authority
HK
Hong Kong
Prior art keywords
thermal
active object
image stream
acquired
thermal image
Prior art date
Application number
HK42020009818.4A
Other languages
Chinese (zh)
Other versions
HK40020128A (en
Inventor
陈鸿群
唐志鸿
吴家文
关景康
Original Assignee
物流及供应链多元技术研发中心有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 物流及供应链多元技术研发中心有限公司 filed Critical 物流及供应链多元技术研发中心有限公司
Publication of HK40020128A publication Critical patent/HK40020128A/en
Publication of HK40020128B publication Critical patent/HK40020128B/en

Links

Description

用于检测非活动对象的系统和方法Systems and methods for detecting inactive objects

技术领域Technical Field

本发明涉及一种用于检测非活动对象的系统和方法,并且具体地但非排他性地涉及无活动或丧失能力的人类对象。The present invention relates to a system and method for detecting inactive objects, and specifically, but not exclusively, to inactive or incapacitated human objects.

背景技术Background Technology

在健康护理行业,大量资源用于监控受护理的个人。通常,这是雇用额外的工作人员来监督受照顾的人,包括老年人或有医疗条件或身体残疾的人。In the healthcare industry, significant resources are dedicated to monitoring individuals receiving care. This typically involves hiring additional staff to supervise those being cared for, including the elderly or those with medical conditions or physical disabilities.

已经发明了电子设备来辅助监控过程,包括使用个人警报和设备。最近,随着可穿戴设备的发展,当设备检测到任何异常时,用户现在能够佩戴可穿戴设备来监控他们的移动并且与护理人员一起发出警报。Electronic devices have been invented to assist in the monitoring process, including the use of personal alarms and devices. More recently, with the development of wearable devices, users are now able to wear wearable devices to monitor their movements and issue alerts in conjunction with caregivers when the device detects any anomalies.

然而,尽管在这方面取得了进展,但某些人并不总是想要携带可穿戴设备。对于不习惯可穿戴技术或发现此类设备侵入其日常生活的老年人尤其如此。在其他情况下,某些活动也可能意味着可穿戴设备在其需要操作的环境下不适合。因此,尽管这些装置通常会向使用者提供帮助,但老年人或其他需要护理的人可能会选择不使用它们,从而导致这些使用者的监督和护理存在差距。However, despite progress in this area, some people do not always want to carry wearable devices. This is especially true for older adults who are not accustomed to wearable technology or find such devices intrusive in their daily lives. In other cases, certain activities may also mean that wearable devices are unsuitable for the environments in which they are required to operate. Therefore, although these devices can often be helpful to users, older adults or others who require care may choose not to use them, resulting in gaps in the supervision and care of these users.

发明内容Summary of the Invention

根据本发明的第一方面,提供了一种用于检测非活动对象的系统,包括:According to a first aspect of the present invention, a system for detecting inactive objects is provided, comprising:

-热成像装置,其被配置获取活动对象的热特征;- A thermal imaging device configured to acquire the thermal characteristics of a moving object;

-移动检测处理器,其被配置处理所述活动对象的热特征以监视所述活动对象的任何运动,并且当热特征显示所述活动对象的运动低于移动阈值时,确定所述活动对象是非活动的。- A motion detection processor is configured to process the thermal features of the active object to monitor any movement of the active object, and to determine that the active object is inactive when the thermal features indicate that the movement of the active object is below a movement threshold.

在第一方面的实施例中,所述移动检测处理器在检测阶段连续地获取并处理所述活动对象的热特征。In an embodiment of the first aspect, the motion detection processor continuously acquires and processes the thermal features of the active object during the detection phase.

在第一方面的实施例中,所述被获取的热特征分成多个部分,每个所述部分还被处理以确定每个部分是动态或静态。In an embodiment of the first aspect, the acquired thermal features are divided into multiple parts, each of which is further processed to determine whether each part is dynamic or static.

在第一方面的实施例中,当所述热特征的动态部分的数量低于预定移动阈值时,与所述热特征相关联的所述活动对象将被确定为非活动。In an embodiment of the first aspect, when the number of dynamic portions of the thermal feature is below a predetermined movement threshold, the active object associated with the thermal feature will be determined to be inactive.

在第一方面的实施例中,通过测量所述部分中的任何方差率,确定所述多个部分中的每一个是动态的或静态的。In an embodiment of the first aspect, each of the plurality of portions is determined to be either dynamic or static by measuring any variance rate in the portions.

在第一方面的实施例中,如果所述方差率在预定时间段内超过预定方差率,则确定所述多个部分中的每一个是动态的。In an embodiment of the first aspect, if the variance rate exceeds a predetermined variance rate within a predetermined time period, then each of the plurality of portions is determined to be dynamic.

在第一方面的实施例中,所述热特征是由热光学设备获取的图像或图像流。In an embodiment of the first aspect, the thermal feature is an image or image stream acquired by a thermal optical device.

在第一方面的实施例中,所述多个部份包括图像或图像流的一个或多个像素。In an embodiment of the first aspect, the plurality of portions includes one or more pixels of an image or image stream.

在第一方面的实施例中,所述移动检测处理器处理热图像流以建立所述活动对象的存在。In an embodiment of the first aspect, the motion detection processor processes a thermal image stream to establish the presence of the active object.

在第一方面的实施例中,所述移动检测处理器跟踪所述热图像流的每个图像内的所述活动对象,并在一时间段内获取所述活动对象的新热特征。In an embodiment of the first aspect, the motion detection processor tracks the active object within each image of the thermal image stream and acquires new thermal features of the active object over a time period.

在第一方面的实施例中,当在所述热图像流内首次获取所述活动对象时,开始检测阶段。In an embodiment of the first aspect, the detection phase begins when the active object is first acquired within the thermal image stream.

在第一方面的实施例中,通过比较热图像流内较早的热图像以及随后的热图像,在所述热图像流内首次获取所述活动对象。In an embodiment of the first aspect, the active object is first acquired within the thermal image stream by comparing earlier thermal images with subsequent thermal images.

在第一方面的实施例中,当检测到所述活动对象离开所述热图像流时,终止所述检测阶段。In an embodiment of the first aspect, the detection phase is terminated when the active object is detected to have left the thermal image stream.

在第一方面的实施例中,通过比较热图像流内的较早的热图像和随后的热图像,检测所述活动对象离开所述热图像流。In an embodiment of the first aspect, the departure of the active object from the thermal image stream is detected by comparing an earlier thermal image with a subsequent thermal image within the thermal image stream.

在第一方面的实施例中,所述热光学设备是低分辨率热像仪In the first aspect of the embodiment, the thermal optical device is a low-resolution thermal imager.

在第一方面的实施例中,所述低分辨率热像仪被配置成获取对象的轮廓,所述轮廓具有所述对象的最小细节。In an embodiment of the first aspect, the low-resolution thermal imager is configured to acquire the outline of an object having minimal detail of the object.

在第一方面的实施例中,所述热光学设备被配置于工作区域上方。In an embodiment of the first aspect, the thermal optical device is positioned above the working area.

在第一方面的实施例中,所述工作区域包括一个或多个热源。In an embodiment of the first aspect, the working area includes one or more heat sources.

根据本发明的第二方面,提供了一种用于检测非活动对象的方法,包括以下步骤:According to a second aspect of the present invention, a method for detecting inactive objects is provided, comprising the following steps:

-获取活动对象的热特征;- Obtain the thermal characteristics of the active object;

-处理所述活动对象的热特征以监视所述活动对象的任何运动,并且当热特征显示所述活动对象的运动低于移动阈值时,确定所述活动对象是非活动的。- Process the thermal characteristics of the active object to monitor any movement of the active object, and determine that the active object is inactive when the thermal characteristics show that the movement of the active object is below a movement threshold.

在第二方面的实施例中,处理热特征以监控所述活动对象的任何运动的步骤包括在检测阶段连续获取和处理所述活动对象的所述热特征。In an embodiment of the second aspect, the step of processing thermal features to monitor any movement of the moving object includes continuously acquiring and processing the thermal features of the moving object during a detection phase.

在第二方面的实施例中,所述被获取的热特征分成多个部分,所述多个部份的每一个还被处理以确定所述多个部份的每一个是动态或静态。In an embodiment of the second aspect, the acquired thermal features are divided into multiple parts, each of which is further processed to determine whether each of the multiple parts is dynamic or static.

在第二方面的实施例中,当所述热特征的动态部分的数量低于预定阈值时,与所述热特征相关联的所述活动对象将被确定为非活动。In a second aspect embodiment, when the number of dynamic portions of the thermal feature is below a predetermined threshold, the active object associated with the thermal feature will be determined as inactive.

在第二方面的实施例中,通过测量所述部分中的任何方差率,确定所述多个部分中的每一个是动态的或静态的。In an embodiment of the second aspect, each of the plurality of portions is determined to be either dynamic or static by measuring any variance rate in the portions.

在第二方面的实施例中,如果所述方差率在预定时间段内超过预定方差率,则确定所述多个部分中的每一个是动态的。In an embodiment of the second aspect, if the variance rate exceeds a predetermined variance rate within a predetermined time period, then each of the plurality of portions is determined to be dynamic.

在第二方面的实施例中,所述热特征是由热光学设备获取的图像或图像流。In an embodiment of the second aspect, the thermal feature is an image or image stream acquired by a thermal optical device.

在第二方面的实施例中,所述多个部份包括图像或图像流的一个或多个像素。In an embodiment of the second aspect, the plurality of portions includes one or more pixels of an image or image stream.

在第二方面的实施例中,获取所述热特征的步骤包括处理热图像流以建立所述活动对象的存在。In a second aspect embodiment, the step of acquiring the thermal features includes processing a thermal image stream to establish the presence of the active object.

在第二方面的实施例中,所述获取所述热特征的步骤还包括跟踪所述热图像流的每个图像内的所述活动对象,并在一时间段内获取所述活动对象的新热特征。In a second aspect embodiment, the step of acquiring the thermal features further includes tracking the active object within each image of the thermal image stream and acquiring new thermal features of the active object over a time period.

在第二方面的实施例中,当在所述热图像流内首次获取所述活动对象时,开始检测阶段。In an embodiment of the second aspect, the detection phase begins when the active object is first acquired within the thermal image stream.

在第二方面的实施例中,通过比较热图像流内较早的热图像以及随后的热图像,在所述热图像流内首次获取所述活动对象。In a second aspect embodiment, the active object is first acquired within the thermal image stream by comparing earlier thermal images with subsequent thermal images.

在第二方面的实施例中,当检测到所述活动对象离开所述热图像流时,终止所述检测阶段。In a second aspect embodiment, the detection phase is terminated when the active object is detected to have left the thermal image stream.

在第二方面的实施例中,通过比较热图像流内的较早的热图像和随后的热图像,检测所述活动对象离开所述热图像流。In a second aspect embodiment, the departure of the active object from the thermal image stream is detected by comparing earlier thermal images and subsequent thermal images within the thermal image stream.

在第二方面的实施例中,所述热光学设备是低分辨率热像仪In a second aspect embodiment, the thermal optical device is a low-resolution thermal imager.

在第二方面的实施例中,所述低分辨率热像仪被配置成获取对象的轮廓,所述轮廓具有所述对象的最小细节。In an embodiment of the second aspect, the low-resolution thermal imager is configured to acquire the outline of an object having minimal detail of the object.

在第二方面的实施例中,所述热光学设备被配置于工作区域上方。In a second aspect embodiment, the thermo-optical device is positioned above the working area.

在第二方面的实施例中,所述工作区域包括一个或多个热源。In an embodiment of the second aspect, the working area includes one or more heat sources.

附图说明Attached Figure Description

附图说明现在将参考附图通过示例描述本发明的实施例,附图中:The embodiments of the invention will now be described by way of example with reference to the accompanying drawings, in which:

图1所示为用于检测非活动对象的系统的示例实施例的框图;Figure 1 shows a block diagram of an example embodiment of a system for detecting inactive objects;

图2A所示为图1系统在淋浴室中的示例部署的示意图;Figure 2A shows a schematic diagram of an example deployment of the system in Figure 1 in a shower room;

图2B所示为图1系统在淋浴室中的另一示例部署的示意图;Figure 2B shows a schematic diagram of another example deployment of the system in Figure 1 in a shower room;

图3所示为用于检测非活动事件的检测窗口示例操作的时间线;Figure 3 shows a timeline of an example operation of the detection window used to detect inactive events;

图4A所示为由图1系统获取活动对象的原始热特征示例;Figure 4A shows an example of obtaining the original thermal features of an active object using the system in Figure 1;

图4B所示为经处理的图4A原始热特征;以及Figure 4B shows the processed original thermal characteristics of Figure 4A; and

图5所示为图1系统示例操作的流程图;Figure 5 shows a flowchart of the example operation of the system in Figure 1;

具体实施方式Detailed Implementation

参考图1,所示为一种用于检测非活动对象100的系统的框图,包括热成像装置104,其被配置获取活动对象的热特征116;以及,移动检测处理器106,其被配置处理所述活动对象的热特征以监视所述活动对象的任何运动,并且当热特征显示所述活动对象的运动低于移动阈值时,确定所述活动对象是非活动的。Referring to Figure 1, a block diagram of a system for detecting an inactive object 100 is shown, including a thermal imaging device 104 configured to acquire thermal features 116 of an active object; and a motion detection processor 106 configured to process the thermal features of the active object to monitor any movement of the active object, and to determine that the active object is inactive when the thermal features indicate that the movement of the active object is below a motion threshold.

在该示例性实施例中,用于检测非活动对象100的系统可以由操作员操作,作为诸如老年人或身体残疾或移动困难的各种用户的跌倒检测系统。系统100可以被配置运行以便检测用户116是否已经在特定工作空间中跌倒,并且进而警告任何护理人员第一助手或能够提供帮助的任何其他人。In this exemplary embodiment, the system for detecting inactive objects 100 can be operated by an operator as a fall detection system for various users such as the elderly, those with physical disabilities, or those with mobility difficulties. System 100 can be configured to operate to detect whether user 116 has fallen in a particular workspace and thereby alert any caregiver, first aide, or anyone else who can provide assistance.

如该示例实施例中所示,系统100包括热成像装置104,其可以是配置成获取热图像的热像仪。该热成像设备然后可以与电子或计算设备106通信,该电子或计算设备106被配置为处理由热成像设备获取的热图像,以确定是否有任何非活动的用户,并因此指示该用户可能已经跌倒或以其他方式变为非活动。通过处理热图像,电子计算设备106又可以作为移动检测处理器106运行,该移动检测处理器106被配置为检测热图像中获取的对象是否正在移动或不移动。As shown in this example embodiment, system 100 includes a thermal imaging device 104, which may be a thermal imager configured to acquire thermal images. The thermal imaging device can then communicate with an electronic or computing device 106 configured to process the thermal images acquired by the thermal imaging device to determine if there are any inactive users, and thus indicate that the user may have fallen or otherwise become inactive. By processing the thermal images, the electronic computing device 106 can also function as a motion detection processor 106 configured to detect whether an object acquired in the thermal image is moving or not.

如图所示,移动检测处理器106可以内置在单个设备102中,该单个设备102还包括热成像设备104,或者可选地,移动检测处理器106也可以实现为单独的设备,其被配置成彼此通信并且与一个或多个热成像设备104通信。计算机服务器108还可以连接到热成像设备104或移动检测处理器106,以从热成像设备104和/或移动检测处理器106收集数据。如本领域技术人员将理解的,还可以将移动检测处理器106实现为服务器108的软件,其中由热成像设备104获取的原始热图像被传输到服务器108以进行处理,视具体实施要求而定。As shown in the figure, the motion detection processor 106 can be integrated into a single device 102, which also includes a thermal imaging device 104. Alternatively, the motion detection processor 106 can be implemented as a separate device configured to communicate with each other and with one or more thermal imaging devices 104. A computer server 108 can also be connected to the thermal imaging device 104 or the motion detection processor 106 to collect data from the thermal imaging device 104 and/or the motion detection processor 106. As those skilled in the art will understand, the motion detection processor 106 can also be implemented as software of the server 108, wherein raw thermal images acquired by the thermal imaging device 104 are transmitted to the server 108 for processing, depending on specific implementation requirements.

优选地,热成像设备104由嵌入式计算设备106连接和控制,嵌入式计算设备106利用热成像设备104作为单个单元102实现,用于部署为移动检测设备。热成像装置104被配置为获取用户116可能在其中的工作区域114的热图像流。这样的工作区域可以包括例如厕所、休息区域、淋浴区域、厨房、洗衣房、桑拿房、蒸汽房或需要监控人员的任何其他区域。当热成像设备104获取热图像流时,这些图像接着由在嵌入式计算设备106内以硬件、软件或两者的组合实现的移动检测处理器106进行处理。反而言之,单个设备102可以被称为移动检测器设备102,并且可以如下面将要解释的那样被用作为跌倒检测设备102,该跌倒检测设备102被配置成检测人员116是否已经在工作区域114中跌倒并需要协助。这可以基于已经跌倒的人员116变为非活动并且需要帮助的基础来执行,因此跌倒但是可以在短时间段内由跌倒到站起的用户116可能不一定被系统100视为跌倒事件。Preferably, the thermal imaging device 104 is connected to and controlled by an embedded computing device 106, which utilizes the thermal imaging device 104 as a single unit 102 for deployment as a motion detection device. The thermal imaging device 104 is configured to acquire a stream of thermal images of a work area 114 in which the user 116 may be located. Such a work area may include, for example, a toilet, rest area, shower area, kitchen, laundry room, sauna, steam room, or any other area requiring personnel monitoring. As the thermal imaging device 104 acquires the thermal image stream, these images are then processed by a motion detection processor 106 implemented in hardware, software, or a combination of both within the embedded computing device 106. Conversely, the single device 102 may be referred to as a motion detector device 102 and may be used as a fall detection device 102, as explained below, configured to detect whether the person 116 has fallen in the work area 114 and requires assistance. This can be implemented based on the premise that a person 116 who has fallen has become inactive and needs assistance. Therefore, a user 116 who has fallen but can get up within a short period of time may not necessarily be considered a fall event by the system 100.

一旦获取热图像并将其传输到移动检测处理器106进行处理,移动检测处理器106就可以继续确定特定的感兴趣对象是否已进入热图像流并继续监视该特定对象的热特征。在用于监控老年人的系统100的示例中,特定对象将是当人员116进入热成像设备104的视野时,将出现在热图像流内的人员116。一旦人员116进入热成像设备104的视野,而人员116将辐射热量并因此得以让热像仪104获取人员116的特征,移动检测处理器106将确定存在人员116的热特征。Once a thermal image is acquired and transmitted to the motion detection processor 106 for processing, the motion detection processor 106 can then determine whether a specific object of interest has entered the thermal image stream and continue monitoring the thermal characteristics of that specific object. In the example of the system 100 for monitoring elderly people, the specific object would be person 116, who would appear in the thermal image stream when person 116 enters the field of view of the thermal imaging device 104. Once person 116 enters the field of view of the thermal imaging device 104, and person 116 radiates heat, thus allowing the thermal imager 104 to acquire the characteristics of person 116, the motion detection processor 106 will determine the presence of the thermal characteristics of person 116.

一旦在第一热图像中首先检测到人员116的热特征,则移动检测处理器106可以在热图像流后续的帧中继续追踪该特征,其中每个帧显示出某种形式的运动或人员116的移动。一旦通过比较当前图像与热图像流内先前图像之间的变化,确定人员116或对象正在移动或运动,则与该人员116或对象相关联的热特征将继续被移动检测处理器106监控或追踪,并且被认为是活动对象,直到该人员离开热成像设备104的视野为止。作为示例,当被追踪的对象不在热图像流内时,确定人员116已离开工作区域114。活动的人员116或对象热特征的追踪过程于存在多个发热源118的环境114中特别有用,例如在淋浴间、桑拿房、厨房和蒸汽房之中。在这些环境中,非活动热源也可以散发热量并因此具有其自身的热特征,但是通过追踪仅活动的特征,该活动特征可能遵循人员或其他感兴趣对象的特定特征,系统100可以仅发布与需要警报相关的热特征,从而减少错误警报并最小化监督者或护理人员的努力。Once the thermal features of person 116 are first detected in the first thermal image, the motion detection processor 106 can continue to track that feature in subsequent frames of the thermal image stream, where each frame shows some form of motion or movement of person 116. Once it is determined that person 116 or object is moving or in motion by comparing the changes between the current image and previous images within the thermal image stream, the thermal features associated with that person 116 or object will continue to be monitored or tracked by the motion detection processor 106 and considered an active object until the person leaves the field of view of the thermal imaging device 104. As an example, when the tracked object is no longer within the thermal image stream, it is determined that person 116 has left the work area 114. The process of tracking the thermal features of active person 116 or object is particularly useful in environments 114 where multiple heat sources 118 exist, such as in shower rooms, saunas, kitchens, and steam rooms. In these environments, inactive heat sources can also emit heat and thus have their own thermal characteristics, but by tracking only active characteristics, which may follow specific characteristics of people or other objects of interest, system 100 can issue only the thermal characteristics that are relevant to the need for an alert, thereby reducing false alarms and minimizing the effort of supervisors or caregivers.

在该监控或追踪过程期间,连续处理活动对象116的热特征,其中每个热特征与随后的热特征进行比较。如果比较表明在特定时间差上的热特征之间存在变化并且这些变化满足最小阈值,则当对象在一段时间内移动时,活动对象被认为是活动的。然而,如果在特定时间段内两个热特征的比较表明特征之间没有变化或仅有最小变化(低于阈值),那么它可以表示对象116已变为非活动,并且因此警报或者可以通过与服务器108或其他外部设备112通信来发出警报,以便呼叫其他方的帮助。During this monitoring or tracking process, the thermal characteristics of the active object 116 are continuously processed, with each thermal characteristic compared to the subsequent thermal characteristics. If the comparison shows a change between thermal characteristics at a specific time difference and these changes meet a minimum threshold, the active object is considered active when the object has moved over a period of time. However, if the comparison of two thermal characteristics within a specific time period shows no change or only a minimal change (below the threshold), it can indicate that the object 116 has become inactive, and therefore an alarm can be triggered, either by communicating with server 108 or other external device 112, to call for assistance from other parties.

如该示例性实施例所示,诸如老年护理之家中各种设施的工作区域114可以具有中央服务器108或计算机系统,其可以与安装在整个老年护理设施中的多个移动检测设备102通信。这些设备102中的每一个可以与可以记录任何图像的服务器108通信(如果在某些部署中隐私可能不是显著关注,或者如果隐私可能是个问题的话,则优选地使用低分辨率热像仪作为设备102)和从这些设备获得的任何数据到数据库110中以用于记录或警报目的。服务器108也可由其他计算设备112访问,或者在服务器108附近或从服务器108的远程访问服务器108上的信息以及监控移动检测设备102的运行。As illustrated in this exemplary embodiment, a work area 114, such as various facilities within an aged care home, may have a central server 108 or computer system that can communicate with multiple motion detection devices 102 installed throughout the aged care facility. Each of these devices 102 can communicate with the server 108, which can record any images (preferably a low-resolution thermal imager as device 102 if privacy may not be a significant concern in some deployments, or if privacy may be an issue), and any data obtained from these devices into a database 110 for logging or alerting purposes. The server 108 may also be accessed by other computing devices 112, either near or remotely from the server 108, for access to information on the server 108 and for monitoring the operation of the motion detection devices 102.

在人员116已经倒下的事件中,例如在淋浴设施中,移动检测设备102将识别出人员116突然变为非活动,因为人员116已经倒下并且不能移动。在该示例中,然后可以将信号传输到服务器108,服务器108将依次记录该信号以及触发护理者携带的用户界面112(扬声器、灯)或智能设备112的警报,以使其意识到跌倒以便向已经倒下的用户传唤援助。In the event that person 116 has fallen, such as in a shower facility, motion detection device 102 will recognize that person 116 has suddenly become inactive because person 116 has fallen and cannot move. In this example, a signal can then be transmitted to server 108, which will record the signal and trigger an alarm on the caregiver's user interface 112 (speaker, light) or smart device 112 to alert them to the fall and call for assistance from the fallen user.

在用于检测非活动对象100的系统的另一示例实施例中,其中系统100用于检测一个或多个特定空间内倒下的用户116。该系统可以被部署为包括一个或多个移动检测设备102,每个移动检测设备102作为跌倒检测器,用于检测用户116是否已经跌倒或者在一个或多个空间中变为非活动。优选地,跌倒检测器102应该使用具有低分辨率(例如,不超过40×30像素)的热像仪104和嵌入式计算设备106,以在将信号发送到服务器108之前由热像仪104处理所获取的数据。In another example embodiment of the system for detecting inactive objects 100, the system 100 is used to detect a user 116 who has fallen within one or more specific spaces. The system can be deployed to include one or more motion detection devices 102, each acting as a fall detector to detect whether the user 116 has fallen or become inactive in one or more spaces. Preferably, the fall detector 102 should use a thermal imager 104 with low resolution (e.g., no more than 40 × 30 pixels) and an embedded computing device 106 to process the acquired data by the thermal imager 104 before sending the signal to a server 108.

如各种示例中所述,数据的处理可以包括非活动识别以检测用户经历的跌倒事件。数据的处理还可以包括环境感知检测过程,以将人员与其他热或发热对象区分以减少误报警报。这是特别有用的,因为热像仪的使用也可以获取其他发热的非人类物体,例如淋浴喷头、蒸汽喷射器或锅炉等,但其活动不受关注,因此通过使用环境感知检测过程,这些物体的非活动不会引发必要的警报。下面参考图3进一步描述环境感知检测过程的示例。As illustrated in various examples, data processing can include inactivity identification to detect fall events experienced by a user. Data processing can also include an environmental perception detection process to distinguish people from other hot or heat-generating objects to reduce false alarms. This is particularly useful because thermal imagers can also capture other heat-generating non-human objects, such as shower heads, steam jets, or boilers, whose activity is not a concern; therefore, by using an environmental perception detection process, the inactivity of these objects will not trigger necessary alarms. An example of an environmental perception detection process is further described below with reference to Figure 3.

反而言之,处理结果,例如指示跌倒事件的信号,与其他信息(例如跌倒检测器的位置、时间和其他信息)一起通过诸如有线/无线网络的通信网络发送到服务器108。Conversely, the processing results, such as signals indicating a fall event, are sent to server 108 along with other information (such as the location, time, and other information of the fall detector) via a communication network such as a wired/wireless network.

在一些示例中,由热像仪获取的图像也可以不由跌倒检测器102发出,以通过任何手段防止隐私敏感图像被存储或传输。这在系统100用于淋浴室中跌倒检测的部署中是特别有利的,其中用户116可能裸体或以其他方式进行私人事务。低分辨率热像仪104以及图像的正确处理和不传输有助于确保不违反用户的隐私或个人空间。In some examples, images acquired by the thermal imager may not be emitted by the fall detector 102 to prevent privacy-sensitive images from being stored or transmitted by any means. This is particularly advantageous in the deployment of system 100 for fall detection in a shower room, where user 116 may be naked or otherwise engaging in private activities. The low-resolution thermal imager 104, along with the proper handling and non-transmission of the images, helps ensure that the user's privacy or personal space is not violated.

反而言之,每个跌倒检测器102还可以与服务器108连接,以便进一步与其他用户便携式设备112(例如,智能电话、由护理人员持有的平板电脑)或用户界面112(其可以包括但不限于音频警报,可视警报,发送到寻呼机、智能手机或计算机的警报,安全警报等)通信。该服务器108还可以集成到每个跌倒检测器102中,从而允许每个设备102作为服务器108运行以与其他跌倒检测器设备102或用户便携式设备112通信。尽管优选地,在多个部署中,服务器108可以是由诸如医院或护理机构的建立管理的单独网络服务器108。Conversely, each fall detector 102 can also connect to a server 108 to further communicate with other user portable devices 112 (e.g., smartphones, tablets held by caregivers) or user interfaces 112 (which may include, but are not limited to, audio alarms, visual alarms, alarms sent to pagers, smartphones, or computers, security alarms, etc.). The server 108 can also be integrated into each fall detector 102, allowing each device 102 to operate as a server 108 to communicate with other fall detector devices 102 or user portable devices 112. Although preferably, in multiple deployments, the server 108 may be a separate network server 108 established and managed by a facility such as a hospital or nursing home.

服务器108还可以被配置成收集从跌倒检测器发送的信息并将该信息合并到数据库110中,无论是本地的、远程的还是基于云端的。一旦从任一个跌倒检测器102接收到跌倒事件,就可以从数据库110中提取相关信息并将其发送到用户接口112以进行进一步的动作。Server 108 can also be configured to collect information sent from fall detectors and merge that information into database 110, whether local, remote, or cloud-based. Once a fall event is received from any fall detector 102, relevant information can be extracted from database 110 and sent to user interface 112 for further action.

参考图2A和2B,所示为移动检测装置设置在淋浴室中合适安装位置的示例。如前所述,用于检测非活动对象100的系统的合适部署用于淋浴设施200,其中诸如老年人或行动不便人员的用户可能遭受跌倒或者在事故或医疗期间可能变得无能为力。Referring to Figures 2A and 2B, an example of a motion detection device installed in a suitable location within a shower room is shown. As previously described, a suitable deployment of a system for detecting inactive objects 100 is provided for shower facilities 200, where users such as the elderly or those with mobility impairments may suffer falls or become incapacitated during accidents or medical emergencies.

如该示例性实施例中所示,移动检测装置202可以放置在顶部区域中,以一个角度(0)204向下倾斜,以便主要获取人员头部和上身部分的最小部分。优选地,移动检测装置202有两个安装位置,在人员的前面200F或在人员的背后(面向人的背部)200R,或者如果需要,根据需要在实施所需的两个位置。As shown in this exemplary embodiment, the motion detection device 202 can be placed in the top region, tilted downwards at an angle (0) 204, to primarily capture the minimum portion of the person's head and upper body. Preferably, the motion detection device 202 has two mounting positions, in front of the person 200F or behind the person (facing the person's back) 200R, or, if desired, in both positions as required.

这些安装位置200F、200R是有利的,因为设备202在顶部区域中的放置避免了水溢出到设备上,使得设备不需要强防水。这可以确保装置可以构造得尽可能便宜。These installation locations 200F and 200R are advantageous because placing the device 202 in the top area prevents water from spilling onto the device, thus eliminating the need for strong waterproofing. This ensures that the device can be constructed as inexpensively as possible.

另外,限制用户的热图像的获取仅限于人的头部和最小上身部份,在人员处于其隐私空间中时(例如,在淋浴期间裸体)可以展现人员的最小视觉细节。反而言之,这种安排将有助于避免用户个人空间的侵入以及减少用户所经历的任何隐私问题。Furthermore, limiting the acquisition of thermal images of users to only the head and minimal upper body, and displaying minimal visual detail of individuals when they are in their private space (e.g., naked while showering), helps to avoid intrusion into users' personal space and reduces any privacy issues they may experience.

参考图3,所示为时间线300,其显示用于检测非活动对象100的系统的检测阶段302或检测窗口的激活,并且因此示出用于最小化任何错误的环境感知检测过程的示例。在该实施例中,检测阶段302是有限量的时间或窗口,其中如果活动对象的检测变为非活动,则将引发警告或警报304。在该实施例中,如果移动检测处理器确定活动对象变为非活动304,但是该事件发生在检测阶段或窗口302之外,则不会发出警报,而是将忽略检测。这是由于警报的环境不被用于检测非活动对象100的系统关注。Referring to Figure 3, a timeline 300 is shown, illustrating the activation of the detection phase 302 or detection window of the system for detecting inactive object 100, and thus illustrating an example of an environment-aware detection process designed to minimize any errors. In this embodiment, the detection phase 302 is a finite amount of time or window during which a warning or alarm 304 is triggered if the detection of an active object becomes inactive. In this embodiment, if the motion detection processor determines that an active object has become inactive 304, but this event occurs outside the detection phase or window 302, no alarm is issued, and the detection is ignored. This is because the environment of the alarm is not of system concern for detecting inactive object 100.

该示例性实施例特别有利于在淋浴室、蒸汽房或桑拿房或具有多于一个热源的任何其他房间或区域。在这些区域或房间中,通常可以找到热物体,例如热水、热水淋浴头、锅炉、热煤、蒸汽喷口等。反而言之,由于系统100依赖于处理热特征,这些热对象可能触发实际上属于误报或非必要的非活动事件。特别是在这些物体是移动物体(例如淋浴喷头)或温度变化的情况下,例如在蒸汽喷口的情况,其可以周期性地运行以维持蒸汽室的温度。This exemplary embodiment is particularly advantageous in shower rooms, steam rooms, saunas, or any other room or area with more than one heat source. In these areas or rooms, hot objects such as hot water, hot showerheads, boilers, hot coal, steam vents, etc., are typically found. Conversely, because system 100 relies on processing thermal characteristics, these hot objects may trigger inactive events that are actually false alarms or unnecessary. This is especially true when these objects are moving objects (e.g., showerheads) or when there are temperature variations, such as in the case of steam vents, which may operate periodically to maintain the temperature of the steam room.

为了过滤这些误报以便最小化错误警示或警报的数量,可以使用环境感知检测过程在检测环境304与系统的目的相关时,定义和运行用于检测非活动对象100系统的检测窗口302。To filter out these false alarms in order to minimize the number of false alerts or alarms, an environment-aware detection process can be used to define and run a detection window 302 for detecting inactive objects 100 in the system when the detection environment 304 is relevant to the purpose of the system.

在一个实施例中,当移动检测处理器106首先检测到对象116已经进入工作区域114(例如淋浴区域或蒸汽室)时,开始或启动检测阶段302。这可以通过检测移动的人或物体的热特征来执行,以便开始检测阶段。人员已经移动进入工作区域114的检测,将被标示环境改变,活动人员现在需要受到监控。反而言之,当检测到移动的人员116或对象离开工作区域114时,检测阶段302关闭。因此作为工作区域114一部分的热源的其他改变将不会触发任何不必要的警示或警报,因为环境将标示在工作区域114中没有相关人员或对象。In one embodiment, detection phase 302 is initiated or activated when the motion detection processor 106 first detects that object 116 has entered work area 114 (e.g., a shower area or steam room). This can be performed by detecting the thermal characteristics of the moving person or object to initiate the detection phase. Detection of a person moving into work area 114 will be flagged as an environmental change, indicating that the active person now needs to be monitored. Conversely, detection phase 302 is deactivated when a moving person 116 or object is detected leaving work area 114. Therefore, other changes in heat sources that are part of work area 114 will not trigger any unnecessary alerts or alarms, as the environment will indicate that no relevant person or object is present in work area 114.

参考图4A和4B,所示为由移动检测处理器处理活动对象的热特征以检测活动对象并监控和识别活动对象的任何运动的结果。在该示例实施例中,利用像素级监控过程来执行非活动识别,以检测可能已遭受跌倒事件或变为不活动的非活动人员。Referring to Figures 4A and 4B, the results show the effects of a motion detection processor processing the thermal features of an active object to detect the active object and monitor and identify any movement of the active object. In this example embodiment, a pixel-level monitoring process is used to perform inactivity identification to detect inactive persons who may have suffered a fall or become inactive.

在该示例中,运行像素级监视过程用于通过追踪与活动对象相关联的热特征的每个部分的值来检测非活动事件,例如与活动对象相关联的像素簇或者优选地在低分辨率图像的情况之下。如果像素值在一定时间内保持稳定一段时间,则该像素被视为无效。如果非活动像素与前景对象的整个像素的比例高于某个阈值,则将其视为非活动事件。因此在数学上,这个过程可以表示如下:In this example, a pixel-level monitoring process is used to detect inactivity events by tracking the values of each part of the thermal features associated with the active object, such as clusters of pixels associated with the active object, or preferably in the case of low-resolution images. If a pixel value remains stable for a certain period of time, the pixel is considered invalid. If the ratio of an inactive pixel to the total pixels of the foreground object is higher than a certain threshold, it is considered an inactive event. Therefore, mathematically, this process can be represented as follows:

1-将时间t处的前景对象(例如活动人员)fg(x,y)的每个像素值与其平均值进行比较1- Compare each pixel value of the foreground object (e.g., an active person) fg(x,y) at time t with its average value.

2-对于用户定义的周期T,如果fg(x,y)和之间的差值小于用户定义的方差σ,该像素值被认为是静态像素sfg(x,y)。因此,没有为该像素记录变化。2. For a user-defined period T, if the difference between fg(x,y) and sfg(x,y) is less than the user-defined variance σ, the pixel value is considered a static pixel sfg(x,y). Therefore, no change is recorded for this pixel.

3-如果静态像素总数∑sfg(x,y)和前景对象的像素总数∑fg(x,y)的比率大于用户定义的阈值R,则确定前景对象(活动人员)不活动。3- If the ratio of the total number of static pixels ∑sfg(x,y) to the total number of pixels of the foreground object ∑fg(x,y) is greater than the user-defined threshold R, then the foreground object (active person) is determined to be inactive.

该检测过程的结果是,热图像400内的前景对象402将被处理以进行移动检测,这意味着将忽略背景404中没有实质热特征的所有其他对象。此外,工作区域内的现有热对象可以是动态的或静态的,但由于这些可能不被认为是前景对象402,这可能是需要监控的用户或对象,因此它们的状态不会影响前景对象402的活动或非活动状态的检测。As a result of this detection process, the foreground object 402 within the thermal image 400 will be processed for motion detection, meaning that all other objects in the background 404 that do not have substantial thermal features will be ignored. Furthermore, existing thermal objects within the working area can be dynamic or static, but since these may not be considered foreground objects 402 (as they may be users or objects that need to be monitored), their state will not affect the detection of the activity or inactivity state of the foreground object 402.

执行该示例检测处理的方式是有利的,因为它可以用低分辨率热图像操作。检测非活动的其他形式需要分析运动轨迹。由于多种原因,在淋浴室中是困难的,包括:The way this example detection process is performed is advantageous because it can operate with low-resolution thermal images. Detecting other forms of inactivity requires analyzing motion trajectories. This is difficult in a shower room for several reasons, including:

1-在我们的设计中,在安装的摄像机的视角下,摔倒的运动轨迹与正常运动无关;以及1. In our design, from the perspective of the installed camera, the trajectory of the fall is unrelated to normal movement; and

2-运动轨迹非常嘈杂,因为淋浴区域通常非常小,因此可能需要高分辨率的热像仪。然而,当用户在需要隐私的淋浴室或蒸汽室时,获取用户的高分辨率细节非常不受欢迎。2- Motion tracing is very noisy because shower areas are typically very small, thus potentially requiring high-resolution thermal imaging. However, obtaining high-resolution details of users in shower rooms or steam rooms where privacy is required is highly undesirable.

参考图5,所示为用于如何根据一个操作示例运行用于检测非活动对象100的系统的流程图500。在该示例中,热图像设备(例如热像仪)将连续获取图像(502)以识别活动对象或人员的任何热特征。这调用了环境感知检测过程(504),其可以被表达为作为状态机的运行。在该示例实现中,状态机可以包括四种状态。这些状态如下:Referring to Figure 5, a flowchart 500 is shown for how a system for detecting inactive objects 100 is operated according to an operational example. In this example, a thermal imaging device (e.g., a thermal imager) will continuously acquire images (502) to identify any thermal features of active objects or people. This invokes an environmental awareness detection process (504), which can be expressed as the operation of a state machine. In this example implementation, the state machine may include four states. These states are as follows:

1-闲置(IDLE)状态:如果没有检测到前景对象,系统将保持闲置(IDLE)状态1- Idle State: If no foreground object is detected, the system will remain in the idle state.

2-决策(DECISION)状态:系统将使用非活动识别算法观察前景物体一段时间。如果没有观察到前景对象,它将跳转到闲置(IDLE)状态。如果有前景对象的活动,它将跳转到主动(ACTIVE)状态。如果没有前景对象的活动,它将跳转到待用(INACTIVE)状态;2. Decision State: The system will observe the foreground object for a period of time using an inactive object recognition algorithm. If no foreground object is observed, it will jump to the idle state. If there is activity in the foreground object, it will jump to the active state. If there is no activity in the foreground object, it will jump to the inactive state.

3-主动(ACTIVE)状态:检测到前景对象。检测窗口在此状态下保持打开状态,在此状态下发生任何非活动事件将被视为跌倒事件;以及3-Active State: A foreground object has been detected. The detection window remains open in this state, and any inactive event occurring in this state will be considered a fall event; and

4-待用(INACTIVE)状态:检测到前景对象但关闭检测窗口。在此状态下发生的任何不活动事件都不会被视为跌倒事件。4-Inactive State: A foreground object is detected, but the detection window is closed. Any inactive events occurring in this state will not be considered fall events.

在该示例实施例中,为了在闲置(IDLE)、主动(ACTIVE)和待用(INACTIVE)之间改变,状态可以仅通过决策(DECISION)状态跳转到彼此的状态。有几个因素(一个或它们的组合)可以触发状态机进入决策(DECISION)状态。例如,当人员进入或离开淋浴区域时会出现这些因素,包括但不限于:In this example embodiment, to change between idle, active, and inactive states, the state can transition to each other simply through a decision state. Several factors (one or a combination thereof) can trigger the state machine to enter a decision state. These factors, for example, occur when a person enters or leaves the shower area, and include, but are not limited to:

-前景对象的面积放大或缩小,可通过其热特征的斑点分析确定;- The area of a foreground object can be magnified or reduced by spot analysis of its thermal features;

-前景物体的质心沿着人进入或离开淋浴区的方向移动;-The center of mass of the foreground object moves along the direction in which a person enters or leaves the shower area;

-前景物体位于图像的边界,在现实世界中,它位于淋浴区域之外。- The foreground object is located at the edge of the image; in the real world, it would be outside the shower area.

反而言之,如果检测到与活动人员相关联的前景对象,则开始或启动检测阶段或检测窗口(505),并且运动检测处理器将继续监控活动对象或人员的热签特征中的移动或运动。Conversely, if a foreground object associated with an active person is detected, a detection phase or detection window (505) is initiated or activated, and the motion detection processor continues to monitor the movement or motion in the hot signature features of the active object or person.

在此阶段,如果检测到任何不活动(506、507),则可以向服务器发送警报信号或其他信息(508)。然后,服务器还可以存储和提取来自数据库的信息(509),并将该信息发送到由护理人员或监督人员者持有的主管或便携式设备的用户界面。如果没有检测到不活动(507),则当活动人员离开工作区域(510)时,然后关闭检测窗口(512),在等待下一个人员进入工作区域时重新开始整个过程。At this stage, if any inactivity is detected (506, 507), an alarm signal or other information can be sent to the server (508). The server can then store and retrieve information from the database (509) and send it to the user interface of a supervisor or portable device held by the caregiver or supervisor. If no inactivity is detected (507), the detection window is closed (512) when the active person leaves the work area (510), and the entire process restarts while waiting for the next person to enter the work area.

尽管不是必需的,但是参考附图描述的实施例可以实现为应用程序编程接口(API)或者由开发人员使用的一系列库,或者可以包括在另一个软件应用程序中,例如终端或个人计算机的操作系统或便携式计算设备的操作系统。通常,由于程序模块包括协助执行特定功能的例程、程序、对象、组件和数据文件,本领域技术人员将理解,软件应用程序的功能可以分布在多个例程、对象或组件上以实现这里所需的功能相同。Although not strictly necessary, the embodiments described with reference to the accompanying drawings can be implemented as an application programming interface (API) or a set of libraries used by developers, or can be included in another software application, such as the operating system of a terminal or personal computer or the operating system of a portable computing device. Typically, since program modules include routines, programs, objects, components, and data files that assist in performing specific functions, those skilled in the art will understand that the functionality of a software application can be distributed across multiple routines, objects, or components to achieve the same functionality required herein.

还应当理解,在本发明的方法和系统完全由计算系统实现或部分由计算系统实现的情况下,可以使用任何适当的计算系统架构。这将包括独立计算机、网络计算机和专用硬件设备。在使用术语“计算系统”和“计算设备”的情况下,这些术语旨在涵盖能够实现所描述的功能的计算机硬件的任何适当配置。It should also be understood that any suitable computing system architecture can be used where the methods and systems of the present invention are implemented entirely or partially by a computing system. This will include stand-alone computers, network computers, and dedicated hardware devices. When using the terms "computing system" and "computing device," these terms are intended to cover any suitable configuration of computer hardware capable of implementing the described functions.

本领域技术人员将理解,在不脱离广泛描述的本发明的精神或范围的情况下,可以对具体实施方案中所示的本发明进行多种变化和/或修改。因此,本发明的实施例在所有方面都被认为是说明性的而非限制性的。Those skilled in the art will understand that various changes and/or modifications can be made to the invention shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. Therefore, the embodiments of the invention are to be considered illustrative rather than restrictive in all respects.

除非另有说明,否则对本文包含的现有技术的任何引用不应视为承认该信息是公知常识。Unless otherwise stated, any reference to prior art contained herein should not be construed as an admission that the information is common general knowledge.

Claims (28)

1.一种用于检测活动对象变成非活动对象的系统,包括:1. A system for detecting when an active object becomes an inactive object, comprising: - 热成像装置,其被配置获取与多个活动对象中的每一者相关联的热特征;以及- A thermal imaging device configured to acquire thermal features associated with each of a plurality of moving objects; and - 移动检测处理器,其被配置为处理所述活动对象的所述热特征以监视所述活动对象的任何运动,- A motion detection processor configured to process the thermal characteristics of the active object to monitor any movement of the active object. 其中每一所获取的热特征被分成多个像素,每一所述像素被进一步处理以确定每一所述像素是动态的还是静态的,且该进一步处理包括:Each acquired thermal feature is divided into multiple pixels, and each pixel is further processed to determine whether it is dynamic or static, and this further processing includes: 将每个像素的像素值与所获取的活动对象的热特征的所述多个像素的平均像素值进行比较;The pixel value of each pixel is compared with the average pixel value of the plurality of pixels of the acquired thermal features of the active object; 在预定周期期间,如果所述像素值与所述平均像素值之间的差小于预定义的方差,则确定所述像素是静态像素;以及During a predetermined period, if the difference between the pixel value and the average pixel value is less than a predefined variance, then the pixel is determined to be a static pixel; and 如果所述静态像素的总数与所获取的活动对象的热特征的所述多个像素的总数的比率大于预定义的阈值,则确定所述活动对象是非活动的,If the ratio of the total number of static pixels to the total number of pixels in the acquired thermal features of an active object is greater than a predefined threshold, then the active object is determined to be inactive. 其中,所述多个活动对象是人。Among them, the multiple objects of the activities are people. 2.根据权利要求1所述的系统,其中所述热成像装置和所述移动检测处理器在检测阶段期间连续地获取并处理所述活动对象的所述热特征。2. The system of claim 1, wherein the thermal imaging device and the mobile detection processor continuously acquire and process the thermal features of the moving object during the detection phase. 3.根据权利要求1所述的系统,其中监视所述活动对象的任何运动包括:跟踪所述热成像装置所获取的热图像流的后续帧中的每个所述热特征。3. The system of claim 1, wherein monitoring any movement of the moving object comprises: tracking each of the thermal features in subsequent frames of the thermal image stream acquired by the thermal imaging device. 4.根据权利要求1所述的系统,其中所述热成像装置是热光学设备,且每个热特征是由所述热光学设备获取的图像或图像流。4. The system of claim 1, wherein the thermal imaging device is a thermal optical device, and each thermal feature is an image or image stream acquired by the thermal optical device. 5.根据权利要求1所述的系统,其中所述移动检测处理器处理热图像流以建立所述活动对象的存在。5. The system of claim 1, wherein the motion detection processor processes the thermal image stream to establish the presence of the active object. 6.根据权利要求5所述的系统,其中所述移动检测处理器跟踪所述热图像流的每个图像内的所述活动对象,并在一时间段内获取所述活动对象的新热特征。6. The system of claim 5, wherein the motion detection processor tracks the active object within each image of the thermal image stream and acquires new thermal features of the active object over a time period. 7.根据权利要求6所述的系统,其中当在所述热图像流内首次获取所述活动对象时,开始检测阶段。7. The system of claim 6, wherein the detection phase begins when the active object is first acquired within the thermal image stream. 8.根据权利要求7所述的系统,其中通过比较热图像流内较早的热图像以及随后的热图像,在所述热图像流内首次获取所述活动对象。8. The system of claim 7, wherein the active object is first acquired within the thermal image stream by comparing an earlier thermal image with a subsequent thermal image within the thermal image stream. 9.根据权利要求7所述的系统,其中当检测到所述活动对象离开所述热图像流时,终止所述检测阶段。9. The system of claim 7, wherein the detection phase is terminated when the active object is detected to have left the thermal image stream. 10.根据权利要求9所述的系统,其中通过比较热图像流内的较早的热图像和随后的热图像,检测所述活动对象离开所述热图像流。10. The system of claim 9, wherein the departure of the active object from the thermal image stream is detected by comparing an earlier thermal image with a subsequent thermal image within the thermal image stream. 11.根据权利要求4所述的系统,其中所述热光学设备是低分辨率热像仪。11. The system of claim 4, wherein the thermal optical device is a low-resolution thermal imager. 12.根据权利要求11所述的系统,其中所述低分辨率热像仪被配置成获取对象的轮廓,所述轮廓具有所述对象的最小细节。12. The system of claim 11, wherein the low-resolution thermal imager is configured to acquire the outline of an object having minimal detail of the object. 13.根据权利要求4所述的系统,其中所述热光学设备被配置于工作区域上方。13. The system of claim 4, wherein the thermal optical device is disposed above the working area. 14.根据权利要求13所述的系统,其中所述工作区域包括一个或多个热源。14. The system of claim 13, wherein the working area includes one or more heat sources. 15.一种用于检测活动对象变成非活动对象的方法,该方法包括以下步骤:15. A method for detecting when an active object becomes an inactive object, the method comprising the following steps: - 获取与多个活动对象中的每一者相关联的热特征;以及- Obtain the thermal features associated with each of the multiple active objects; and - 处理所述活动对象的所述热特征以监视所述活动对象的任何运动,- Process the thermal characteristics of the moving object to monitor any movement of the moving object. 其中,每一所获取的热特征被分成多个像素,每一所述像素被进一步处理以确定每一所述像素是动态的还是静态的,该进一步处理包括:Each acquired thermal feature is divided into multiple pixels, and each pixel is further processed to determine whether it is dynamic or static. This further processing includes: 将每个像素的像素值与所获取的活动对象的热特征的所述多个像素的平均像素值进行比较;The pixel value of each pixel is compared with the average pixel value of the plurality of pixels of the acquired thermal features of the active object; 在预定周期期间,如果所述像素值与所述平均像素值之间的差小于预定义的方差,则确定所述像素是静态像素;以及During a predetermined period, if the difference between the pixel value and the average pixel value is less than a predefined variance, then the pixel is determined to be a static pixel; and 如果所述静态像素的总数与所获取的活动对象的热特征的所述多个像素的总数的比率大于预定义的阈值,则确定所述活动对象是非活动的,If the ratio of the total number of static pixels to the total number of pixels in the acquired thermal features of an active object is greater than a predefined threshold, then the active object is determined to be inactive. 其中,所述多个活动对象是人。Among them, the multiple objects of the activities are people. 16.根据权利要求15所述的方法,其中所述热特征在检测阶段期间被连续地获取并处理。16. The method of claim 15, wherein the thermal features are continuously acquired and processed during the detection phase. 17.根据权利要求15所述的方法,其中监视所述活动对象的任何运动包括:跟踪热图像流的后续帧中的每个所述热特征。17. The method of claim 15, wherein monitoring any movement of the active object comprises: tracking each of the thermal features in subsequent frames of the thermal image stream. 18.根据权利要求15所述的方法,其中每个热特征是由热光学设备获取的图像或图像流。18. The method of claim 15, wherein each thermal feature is an image or image stream acquired by a thermal optical device. 19.根据权利要求15所述的方法,其中获取所述热特征的步骤包括处理热图像流以建立所述活动对象的存在。19. The method of claim 15, wherein the step of acquiring the thermal features includes processing a thermal image stream to establish the presence of the active object. 20.根据权利要求19所述的方法,其中所述获取所述热特征的步骤还包括跟踪所述热图像流的每个图像内的所述活动对象,并在一时间段内获取所述活动对象的新热特征。20. The method of claim 19, wherein the step of acquiring the thermal features further comprises tracking the active object within each image of the thermal image stream and acquiring new thermal features of the active object over a time period. 21.根据权利要求20所述的方法,其中当在所述热图像流内首次获取所述活动对象时,开始所述检测阶段。21. The method of claim 20, wherein the detection phase begins when the active object is first acquired within the thermal image stream. 22.根据权利要求21所述的方法,其中通过比较热图像流内较早的热图像以及随后的热图像,在所述热图像流内首次获取所述活动对象。22. The method of claim 21, wherein the active object is first acquired within the thermal image stream by comparing an earlier thermal image with a subsequent thermal image within the thermal image stream. 23.根据权利要求22所述的方法,其中当检测到所述活动对象离开所述热图像流时,终止所述检测阶段。23. The method of claim 22, wherein the detection phase is terminated when the active object is detected to have left the thermal image stream. 24.根据权利要求23所述的方法,其中通过比较热图像流内的较早的热图像和随后的热图像,检测所述活动对象离开所述热图像流。24. The method of claim 23, wherein the departure of the active object from the thermal image stream is detected by comparing an earlier thermal image within the thermal image stream with a subsequent thermal image. 25.根据权利要求18所述的方法,其中所述热光学设备是低分辨率热像仪。25. The method of claim 18, wherein the thermal optical device is a low-resolution thermal imager. 26.根据权利要求25所述的方法,其中所述低分辨率热像仪被配置成获取对象的轮廓,所述轮廓具有所述对象的最小细节。26. The method of claim 25, wherein the low-resolution thermal imager is configured to acquire the outline of an object having minimal detail of the object. 27.根据权利要求18所述的方法,其中所述热光学设备被配置于工作区域上方。27. The method of claim 18, wherein the thermal optical device is disposed above the working area. 28.根据权利要求27所述的方法,其中所述工作区域包括一个或多个热源。28. The method of claim 27, wherein the working area includes one or more heat sources.
HK42020009818.4A 2018-10-30 2020-06-23 A system and method for detecting inactive objects HK40020128B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
HK18113867.3 2018-10-30

Publications (2)

Publication Number Publication Date
HK40020128A HK40020128A (en) 2020-10-23
HK40020128B true HK40020128B (en) 2024-05-03

Family

ID=

Similar Documents

Publication Publication Date Title
CN111127838B (en) System and method for detecting inactive objects
Sixsmith et al. A smart sensor to detect the falls of the elderly
US10217342B2 (en) Method and process for determining whether an individual suffers a fall requiring assistance
US11120559B2 (en) Computer vision based monitoring system and method
US6614348B2 (en) System and method for monitoring behavior patterns
EP3170125B1 (en) Occupancy detection
WO2017148061A1 (en) Monitoring system and method
US9295390B2 (en) Facial recognition based monitoring systems and methods
EP3361464A1 (en) Person monitoring device and method, and person monitoring system
EP3616095A1 (en) Computer vision based monitoring system and method
KR102078265B1 (en) Aapparatus of processing image and method of providing image thereof
WO2019013105A1 (en) Monitoring assistance system and control method thereof
JP7095870B2 (en) Information processing equipment
HK40020128B (en) A system and method for detecting inactive objects
Shoaib et al. Altcare: Safe living for elderly people
JP7264065B2 (en) Monitored Person Monitoring Support System and Monitored Person Monitoring Support Method
US20240221382A1 (en) Monitoring system and method for recognizing the activity of determined persons
HK40020128A (en) A system and method for detecting inactive objects
JP2025154486A (en) Life monitoring system and program
JP7764692B2 (en) Information processing device, information processing system, analysis result providing method, and control program
JP2020194392A (en) Program for notifying of information, information notification device, and method executed by computer for notifying of information
WO2021027244A1 (en) Monitoring system and monitoring method
WO2020003704A1 (en) Control program, report output method, and report output device
JP7563401B2 (en) Monitoring system, monitoring method, and monitoring program
US20240312621A1 (en) System and a method for monitoring activities of an object