[go: up one dir, main page]

CN114724330A - A realization method of multi-channel video fire real-time alarm system with adaptive mode switching - Google Patents

A realization method of multi-channel video fire real-time alarm system with adaptive mode switching Download PDF

Info

Publication number
CN114724330A
CN114724330A CN202210199443.2A CN202210199443A CN114724330A CN 114724330 A CN114724330 A CN 114724330A CN 202210199443 A CN202210199443 A CN 202210199443A CN 114724330 A CN114724330 A CN 114724330A
Authority
CN
China
Prior art keywords
fire
smoke
flame
alarm
level
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210199443.2A
Other languages
Chinese (zh)
Inventor
熊爱民
罗旭松
温佳文
肖捷
赖文杰
欧阳文婷
何昊斐
余思波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingyuan Huayun Zhikong Technology Co ltd
South China Normal University
South China Normal University Qingyuan Institute of Science and Technology Innovation Co Ltd
Original Assignee
Qingyuan Huayun Zhikong Technology Co ltd
South China Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingyuan Huayun Zhikong Technology Co ltd, South China Normal University filed Critical Qingyuan Huayun Zhikong Technology Co ltd
Priority to CN202210199443.2A priority Critical patent/CN114724330A/en
Publication of CN114724330A publication Critical patent/CN114724330A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B17/00Fire alarms; Alarms responsive to explosion
    • G08B17/12Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions
    • G08B17/125Actuation by presence of radiation or particles, e.g. of infrared radiation or of ions by using a video camera to detect fire or smoke
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/10Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using wireless transmission systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Geometry (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Alarm Systems (AREA)
  • Fire Alarms (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses a method for realizing a multi-channel video fire real-time alarm system with self-adaptive mode switching, which comprises the following steps of one to four. The invention collects the images of the monitoring area in real time through the multi-path cameras and sends the images to the control center for detecting and judging whether a fire alarm occurs, compared with the traditional smoke temperature sensor type fire alarm system, the system is not limited by space, the response is rapid, and the detection accuracy is high; compared with the image type fire alarm system using the traditional pattern recognition, the method adopts the deep learning target detection algorithm to detect the fire, has higher accuracy and stronger generalization capability, and can obtain the position information of the fire; the detection algorithm provided by the invention can be switched in a self-adaptive manner according to different modes of the common infrared camera; the invention provides a fire evaluation module which is matched with pictures for marking flame and smoke to more intuitively show the fire to a user.

Description

一种自适应模式切换的多路视频火灾实时报警系统的实现 方法A realization method of multi-channel video fire real-time alarm system with adaptive mode switching

技术领域technical field

本发明属于火灾实时报警消防技术领域,具体涉及一种自适应模式切换 的多路视频火灾实时报警系统的实现方法。The invention belongs to the technical field of real-time fire alarm and fire protection, and in particular relates to an implementation method of a multi-channel video fire real-time alarm system with adaptive mode switching.

背景技术Background technique

火灾是最经常、最普遍的危害公共安全,威胁社会发展的灾害之一。火 灾的发生会造成人员财产损失。根据国家消防相关法律,法规以及技术规范 规定为了防范火灾,减少火灾造成的损失,所有建筑都需要设计安装消防配 套设施,其目的在于防止火灾发生以及在火灾发生初期及时发现火情以减少 火灾造成的损失。Fire is one of the most frequent and common disasters that endanger public safety and threaten social development. The occurrence of fire will cause personal and property damage. According to the relevant national fire protection laws, regulations and technical specifications, in order to prevent fires and reduce the losses caused by fires, all buildings need to design and install fire-fighting facilities. Loss.

以往的火灾检测一般采用一个或者多个烟雾传感器或温度传感器作为火 灾探测器,在接收到火灾报警信号后,再通过人工现场确认判断是否为真实 报警。火灾初期燃烧面积不大,仅限于初始起火点附近,火势不稳定;在燃 烧区域及附近存在高温,室内平均温度低,室内温差大,不能及时触发温感 报警装置;同时火灾初期会伴有烟雾,但是烟雾弥散到触发烟雾传感器也需 要较长的时间。并且据《火灾自动报警系统设计规范》规定温感烟感安装高 度不宜超过12米,因此无法用于大空间室内外场景。基于温、烟感的火灾报 警装置自身一般不能可视化,管理人员仅能接受到报警信号还需要到现场确 认火情,或者额外安装监控摄像头增加成本。发现晚、报警晚、处置晚通常 是火灾造成巨大大损失的原因,所以能够在火灾发生初期及时报警对于一个 火灾报警系统显得尤为重要。In the past fire detection, one or more smoke sensors or temperature sensors are generally used as fire detectors. After receiving the fire alarm signal, it is judged whether it is a real alarm through manual on-site confirmation. In the early stage of the fire, the burning area is not large, and it is limited to the vicinity of the initial ignition point, and the fire is unstable; there is high temperature in and near the burning area, the average indoor temperature is low, and the indoor temperature difference is large, and the temperature alarm device cannot be triggered in time; at the same time, there will be smoke in the early stage of the fire. , but it also takes a long time for the smoke to disperse to trigger the smoke sensor. And according to the "Code for Design of Automatic Fire Alarm System", the installation height of temperature-sensing smoke detectors should not exceed 12 meters, so it cannot be used for indoor and outdoor scenes in large spaces. Fire alarm devices based on temperature and smoke sense generally cannot be visualized themselves, and managers can only receive alarm signals and need to go to the scene to confirm the fire situation, or install additional surveillance cameras to increase costs. Late discovery, late alarm, and late disposal are usually the reasons for huge losses caused by fire, so it is particularly important for a fire alarm system to be able to alarm in time at the early stage of a fire.

目前市面上也有基于图像的火灾报警系统,如专利申请号 CN201810061303.2中通过背景差分法获取前景图片再通过前景图片中各区域 面积特征、频率特征以及质心运动特征来判断是否发生火情;如专利申请号CN201611068303.2中使用火焰烟雾的动态特征以及颜色特征检测火灾,两者 均使用传统模式检测方法检测火灾,泛化能力差,易受环境变化影响;如申 请号CN202110041008.2采用卷积神经网络实现对包含火焰和不包含火焰图片 的分类实现火灾检测,仅能检测到是否存在火焰无法通过算法得到着火点信 息,而且火灾初期时常会伴有烟雾产生,仅检测火焰而忽视烟雾检测会使报 警时间延后。At present, there are also image-based fire alarm systems on the market. For example, in the patent application number CN201810061303.2, the foreground image is obtained by the background difference method, and then the area characteristics, frequency characteristics and mass center motion characteristics of each area in the foreground image are used to judge whether a fire occurs; for example; In the patent application number CN201611068303.2, the dynamic characteristics and color characteristics of the flame smoke are used to detect fire, both of which use the traditional mode detection method to detect fire, which has poor generalization ability and is easily affected by environmental changes; for example, the application number CN202110041008.2 uses convolution The neural network realizes fire detection by classifying pictures that contain flames and pictures that do not contain flames. It can only detect whether there is a flame and cannot obtain the ignition point information through the algorithm. Moreover, smoke is often generated in the early stage of the fire. Only detecting the flame and ignoring the smoke detection will cause The alarm time is delayed.

普通红外摄像头在昏暗环境下切换到红外模式,夜间监控画面与普通模 式中火焰和烟雾的图像特征有巨大差异,很难在同一算法中同时实现对普通 模式下和夜间模式下的火灾检测,所以我们需要一种反应快,准确率高,泛 化能力强,在摄像头普通模式和夜间模式均适用的初期火灾报系统。When an ordinary infrared camera switches to infrared mode in a dim environment, the image characteristics of flames and smoke in the night monitoring screen are very different from those in the ordinary mode. We need an initial fire alarm system with fast response, high accuracy and strong generalization ability, which is applicable in both normal mode and night mode of the camera.

发明内容SUMMARY OF THE INVENTION

本发明的目的在于提供一种自适应模式切换的多路视频火灾实时报警系 统的实现方法,以解决上述背景技术中提出现有技术中的问题。The purpose of the present invention is to provide an implementation method of a multi-channel video fire real-time alarm system for adaptive mode switching, so as to solve the problems in the prior art proposed in the above-mentioned background technology.

为实现上述目的,本发明采用了如下技术方案:To achieve the above object, the present invention has adopted the following technical solutions:

一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征 在于,包括如下步骤:A kind of realization method of the multi-channel video fire real-time alarm system of self-adaptive mode switching, is characterized in that, comprises the steps:

步骤一,多路摄像头同时采集多个监控区域视频;Step 1, the multi-channel cameras simultaneously capture the videos of multiple monitoring areas;

步骤二,将采集到的视频送入控制中心进行处理,输出火情信息;In step 2, the collected video is sent to the control center for processing, and fire information is output;

步骤三,在本地报警,保存火情信息,并将报警信息上传至云服务器;Step 3, alarm locally, save the fire information, and upload the alarm information to the cloud server;

步骤四,用户在手机APP上接收报警信息;Step 4, the user receives the alarm information on the mobile phone APP;

还包括结合烟雾及火焰检测算法的多路视频火灾实时报警系统,包括图 像采集端、硬盘录像机、交换机、控制中心、云服务器、手机终端;It also includes a multi-channel video fire real-time alarm system combined with smoke and flame detection algorithms, including image acquisition terminals, hard disk recorders, switches, control centers, cloud servers, and mobile phone terminals;

其中图像采集端安装在被监控区域,用于采集被监控区域的视频;The image acquisition terminal is installed in the monitored area and used to collect the video of the monitored area;

硬盘录像机、交换机、控制中心安装在中控室,硬盘录像机用于存储监 控视频,交换机用于将多路摄像头传输的图像传入控制中心,在控制中心中 通过烟雾及火焰检测算法判断图像中是否存在烟雾和火焰,若存在则将算法 输出的火焰或者烟雾信息再送入火情评估模块后得到火情等级,并在本地报 警,同时将火情信息存储在硬盘中并发送至云服务器,若无火情则继续检测 下一帧;云服务器将火情信息和检测结果等数据整理后传递至手机终端,手 机终端上显示检测结果并报警。The hard disk video recorder, switch, and control center are installed in the central control room. The hard disk recorder is used to store surveillance video, and the switch is used to transmit the images transmitted by multi-channel cameras to the control center. In the control center, smoke and flame detection algorithms are used to determine whether the image exists. Smoke and flame, if there is, the flame or smoke information output by the algorithm will be sent to the fire evaluation module to get the fire level, and the local alarm will be reported. At the same time, the fire information will be stored in the hard disk and sent to the cloud server. If there is no fire In case of fire, it continues to detect the next frame; the cloud server organizes the fire information and detection results and transmits it to the mobile terminal, and the mobile terminal displays the detection results and alarms.

优选的,还包括自适应模式切换的火灾检测算法,算法整体包括自适应 模式切换模块、火灾检测算法模块与火情评估模块。Preferably, it also includes a fire detection algorithm for adaptive mode switching, and the algorithm as a whole includes an adaptive mode switching module, a fire detection algorithm module and a fire situation assessment module.

优选的,所述自适应模式切换模块包括:Preferably, the adaptive mode switching module includes:

在检测火焰之前,每隔30s判断一次摄像头所处模式,其算法如下:Before detecting the flame, the mode of the camera is judged every 30s. The algorithm is as follows:

BEGIN(输入图像img):BEGIN (input image img):

Bm,Gm,Rm=图像各通道分离求均值;Bm, Gm, Rm = the average value of each channel of the image;

DIFF1=Bm-Gm;DIFF2=Bm-Rm;DIFF3=Rm-Gm;DIFF1=Bm-Gm; DIFF2=Bm-Rm; DIFF3=Rm-Gm;

IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1):IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1):

THEN return 1;THEN return 1;

ELSE return 0;ELSE return 0;

由于Opencv读到摄像头的图像是BGR格式,只能通过判断各通道值像 素均值是否相等来判断,若返回1为普通模式,若返回0为夜间模式。Since Opencv reads the image of the camera in BGR format, it can only be judged by judging whether the average value of each channel value pixel is equal. If it returns 1, it is normal mode, and if it returns 0, it is night mode.

优选的,所述火灾检测算法模块包括:Preferably, the fire detection algorithm module includes:

步骤一,构建火焰烟雾样本库;Step 1, build a flame smoke sample library;

步骤二,训练火焰烟雾目标检测模型;Step 2, train the flame smoke target detection model;

步骤三,火灾检测算法。Step 3, fire detection algorithm.

优选的,所述火灾检测算法模块的步骤二中包括:Preferably, step 2 of the fire detection algorithm module includes:

训练夜晚使用的算法模型,从火焰烟雾样本库中提取火焰和烟雾的数据, 又由于夜间模式下红外摄像头的拍摄的火灾现场图像难以获得,我们通过以 下算法通过进行模拟:The algorithm model used at night is trained, and the flame and smoke data are extracted from the flame and smoke sample library. Since it is difficult to obtain the fire scene image captured by the infrared camera in the night mode, we simulate it through the following algorithm:

BEGIN(输入图像img):BEGIN (input image img):

img=img.gray();img = img.gray();

img=img.point()*0.7;img=img.point()*0.7;

return img;return img;

优选的,所述火灾检测算法模块的步骤三中包括如下步骤:Preferably, step 3 of the fire detection algorithm module includes the following steps:

从图像采集端中获取图像,经过自适应模式切换模块,判断使用夜间模 式还是普通模式;Obtain the image from the image acquisition terminal, and determine whether to use the night mode or the normal mode through the adaptive mode switching module;

经过自适应模式切换模块,若进入普通模式,采用第3帧检测烟雾,其 中普通模式下烟雾检测算法当帧计数器为3时调用日间烟雾检测模型,若是 存在烟雾,将烟雾的信息送入火情评估模块若不存在则检测下一帧;After the adaptive mode switching module, if the normal mode is entered, the third frame is used to detect smoke. In the normal mode, the smoke detection algorithm calls the daytime smoke detection model when the frame counter is 3. If there is smoke, the smoke information is sent to the fire. If the situation evaluation module does not exist, it will detect the next frame;

第6帧检测火焰,其中普通模式火焰检测算法当帧计数器为6时调用日 间火焰检测模型,将帧计数器复位为1,若是存在火焰,将火焰的信息送入火 情评估模块,若不存在则检测下一帧检测;The 6th frame detects the flame. The normal mode flame detection algorithm calls the daytime flame detection model when the frame counter is 6, and resets the frame counter to 1. If there is a flame, the flame information is sent to the fire evaluation module. Then detect the next frame detection;

若进入夜间模式,夜间烟雾火焰检测算法结构与普通模式下算法相同, 火焰烟雾目标检测算法模型用步骤二训练的夜间烟雾和火焰的算法模型,检 测结束后将火焰和烟雾的信息送入火情评估模块。If you enter the night mode, the structure of the smoke and flame detection algorithm at night is the same as the algorithm in the normal mode. The flame smoke target detection algorithm model uses the algorithm model of night smoke and flame trained in step 2. After the detection, the information of the flame and smoke is sent to the fire situation. Evaluation module.

优选的,所述火情评估模块包括:Preferably, the fire assessment module includes:

火情根据烟雾和火焰区域面积以及面积变化率将火焰等级分为4级,将 烟雾等级分为3级,再根据分级情况确定报警模式。The fire situation divides the flame grade into 4 grades according to the area and area change rate of the smoke and flame area, and divides the smoke grade into 3 grades, and then determines the alarm mode according to the classification situation.

优选的,其中在火情评估模块中判断报警级别包括:Preferably, judging the alarm level in the fire assessment module includes:

若是烟雾,则判断此时烟雾面积占比S1是否大于等于0.3:若为是,则 烟雾级别为3级;If it is smoke, judge whether the smoke area ratio S1 is greater than or equal to 0.3 at this time: if yes, then the smoke level is level 3;

若为否则与上一次烟雾的面积占比相比较:若大于,则烟雾级别加1,若 小于,保持目前的烟雾级别不变;If it is otherwise, compare it with the area proportion of the previous smoke: if it is greater than that, add 1 to the smoke level; if it is less than, keep the current smoke level unchanged;

若是火焰,则判断此时火焰面积占比S2是否大于等于0.1:若为是,则 火焰级别为4级,若为否则与上一次火焰的面积占比相比较,若大于,则火 焰级别加1,若小于,保持目前的火焰级别不变。If it is a flame, judge whether the flame area ratio S2 is greater than or equal to 0.1 at this time: if it is, the flame level is 4, if it is otherwise, it is compared with the area ratio of the previous flame. If it is greater than that, the flame level is increased by 1 , if it is less than, keep the current flame level unchanged.

优选的,将烟雾等级情况分为3级,火焰等级情况分为4级;Preferably, the smoke level situation is divided into 3 levels, and the flame level situation is divided into 4 levels;

其中确定报警模式包括,经过火情评估模块得到火情等级后,经过以下 步骤确定报警模式:Determining the alarm mode includes determining the alarm mode through the following steps after obtaining the fire level through the fire evaluation module:

当仅有烟雾报警时,若烟雾等级为1,2时进入预报警状态,若在5s内无 其他报警发生则将预报警自动复位;When there is only a smoke alarm, if the smoke level is 1 or 2, it will enter the pre-alarm state, and if no other alarm occurs within 5s, the pre-alarm will be automatically reset;

当烟雾等级为3级时,或者检测到火焰时,立刻发出火灾报警,且不可 自动复位。When the smoke level is level 3, or when a flame is detected, a fire alarm is issued immediately and cannot be reset automatically.

本发明的技术效果和优点:本发明提出的一种自适应模式切换的多路视 频火灾实时报警系统的实现方法,与现有技术相比,具有以下优点:Technical effect and advantage of the present invention: the realization method of a kind of self-adaptive mode switching multi-channel video fire real-time alarm system proposed by the present invention has the following advantages compared with the prior art:

本发明提供一种自适应模式切换的多路视频火灾实时报警系统的实现方 法,通过多路摄像头实时采集监测区域的图像送入控制中心进行检测判断是 否有火警发生,与传统的烟温感传感器式火灾报警系统相比,不受空间制约, 反应迅速,检测准确率高;与使用传统模式识别的图像式火灾报警系统相比, 本发明采用深度学习目标检测算法检测火情,准确率更高,泛化能力更强, 且可以得到火情的位置信息;The invention provides an implementation method of a multi-channel video fire real-time alarm system with adaptive mode switching. The images of the monitoring area are collected in real time by multi-channel cameras and sent to the control center for detection and judgment whether there is a fire alarm. Compared with the image-based fire alarm system, it is not restricted by space, has a rapid response, and has a high detection accuracy; compared with the image-based fire alarm system using traditional pattern recognition, the present invention adopts the deep learning target detection algorithm to detect fire, and the accuracy is higher. , the generalization ability is stronger, and the location information of the fire can be obtained;

本发明提供的检测算法根据普通红外摄像头所处模式不同,可以自适应 的切换检测算法,训练了四套目标检测算法模型分别检测日间的火焰烟雾和 夜间的火焰烟雾。本发明在训练算法模型的过程中通过图像合成的方式获得 部分烟雾数据集,通过图像处理的方式用彩色图像模拟夜间模式下监控的灰 度图像,训练夜间使用的检测模型,针对不同的应用场所,将监控区域的实 际画面作为背景一同训练提高了模型的准确率;The detection algorithm provided by the present invention can switch the detection algorithm adaptively according to the different modes of the common infrared camera, and train four sets of target detection algorithm models to detect the flame smoke during the day and the flame smoke at night respectively. In the process of training the algorithm model, the present invention obtains part of the smoke data set by means of image synthesis, uses the color image to simulate the grayscale image monitored in the night mode by means of image processing, trains the detection model used at night, and aims at different application places. , the actual picture of the monitoring area is used as the background to train together to improve the accuracy of the model;

本发明提出了一种火情评估模块,根据火灾检测算法得到的火焰和烟雾 的位置框计算目标面积,根据面积的变化评估火情等级,在根据火情等级采 用不同的报警方式,配合标注火焰和烟雾的图片更直观的将火情展现给用户;The invention proposes a fire situation evaluation module, which calculates the target area according to the position frame of the flame and smoke obtained by the fire detection algorithm, evaluates the fire situation level according to the change of the area, adopts different alarm methods according to the fire situation level, and cooperates with marking the flame. and smoke pictures more intuitively show the fire to the user;

本发明可以直接接入原有的视频监控系统,只需要配置相关控制中心的 设备即可投入使用,可以减少重复铺设监控设备的人员和设备花费。The present invention can be directly connected to the original video monitoring system, and can be put into use only by configuring the equipment of the relevant control center, which can reduce the personnel and equipment costs for repetitively laying monitoring equipment.

本发明的其它特征和优点将在随后的说明书中阐述,并且,部分地从说 明书中变得显而易见,或者通过实施本发明而了解。本发明的目的和其他优 点可通过在说明书以及附图中所指出的结构来实现和获得。Other features and advantages of the present invention will be set forth in the description which follows, and, in part, will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure pointed out in the description and drawings.

附图说明Description of drawings

图1为本发明一种结合烟雾及火焰检测算法的多路视频火灾实时报警系 统的实现方法的整体流程图;Fig. 1 is a kind of overall flow chart of the realization method of the multi-channel video fire real-time alarm system in conjunction with smoke and flame detection algorithm of the present invention;

图2与为本发明一种结合烟雾及火焰检测算法的多路视频火灾实时报警 系统的整体框架之一;Fig. 2 is one of the overall frameworks of a kind of multi-channel video fire real-time alarm system in conjunction with smoke and flame detection algorithm of the present invention;

图3为本发明一种结合烟雾及火焰检测算法的多路视频火灾实时报警系 统的整体框架之二;Fig. 3 is a kind of overall framework of the multi-channel video fire real-time alarm system in conjunction with smoke and flame detection algorithm of the present invention;

图4为本发明实施例中烟雾火焰检测算法的流程图;4 is a flowchart of a smoke and flame detection algorithm in an embodiment of the present invention;

图5为本发明实施例中烟雾和火焰检测算法的示意图;5 is a schematic diagram of a smoke and flame detection algorithm in an embodiment of the present invention;

图6为本发明实施例中火情评估模块的流程示意图。FIG. 6 is a schematic flowchart of a fire situation assessment module in an embodiment of the present invention.

图中标号:1、图像采集端;2、硬盘录像机;3、交换机;4、控制中心; 5、云服务器;6、手机终端;7、存储单元;8、处理单元;9、报警单元。Labels in the figure: 1, image acquisition terminal; 2, hard disk video recorder; 3, switch; 4, control center; 5, cloud server; 6, mobile phone terminal; 7, storage unit; 8, processing unit; 9, alarm unit.

具体实施方式Detailed ways

下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行 清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而 不是全部的实施例。此处所描述的具体实施例仅仅用以解释本发明,并不用 于限定本发明。基于本发明中的实施例,本领域普通技术人员在没有做出创 造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. The specific embodiments described herein are only used to explain the present invention, and are not intended to limit the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

本发明提供了如图1-6所示的实施例:The present invention provides embodiments as shown in Figures 1-6:

一种结合烟雾及火焰检测算法的多路视频火灾实时报警系统的实现方法, 其实施步骤如图1所示包括:A method for implementing a multi-channel video fire real-time alarm system combined with smoke and flame detection algorithms, the implementation steps of which are shown in Figure 1 and include:

步骤一,多路摄像头同时采集多个监控区域视频;Step 1, the multi-channel cameras simultaneously capture the videos of multiple monitoring areas;

步骤二,将采集到的视频送入控制中心进行处理,输出火情信息;In step 2, the collected video is sent to the control center for processing, and fire information is output;

步骤三,在本地报警,保存火情信息,并将报警信息上传至云服务器;Step 3, alarm locally, save the fire information, and upload the alarm information to the cloud server;

步骤四,用户在手机APP上接收报警信息;Step 4, the user receives the alarm information on the mobile phone APP;

以下将详细阐述本申请一种结合烟雾及火焰检测算法的多路视频火灾实 时报警系统的实现方法:A kind of realization method of the multi-channel video fire real-time alarm system in conjunction with smoke and flame detection algorithm of the present application will be elaborated below in detail:

如图2-3所示,其为一种结合烟雾及火焰检测算法的多路视频火灾实时报 警系统整体框架,包括图像采集端1、硬盘录像机2、交换机3、控制中心4、 云服务器5、手机终端6;As shown in Figure 2-3, it is an overall framework of a multi-channel video fire real-time alarm system combined with smoke and flame detection algorithms, including image acquisition terminal 1, hard disk recorder 2, switch 3, control center 4, cloud server 5, Mobile terminal 6;

图像采集端1与硬盘录像机2,硬盘录像机2与交换机3相连,交换机3 与控制中心4相连,控制中心4与云服务器5相连,云服务器5与手机终端6 相连;如图3所述,还包括存储单元7、处理单元8与报警单元9。The image acquisition terminal 1 is connected with the hard disk video recorder 2, the hard disk video recorder 2 is connected with the switch 3, the switch 3 is connected with the control center 4, the control center 4 is connected with the cloud server 5, and the cloud server 5 is connected with the mobile terminal 6; It includes a storage unit 7 , a processing unit 8 and an alarm unit 9 .

其中图像采集端1安装在被监控区域,用于采集被监控区域的视频;硬 盘录像机2,交换机3,控制中心4安装在中控室,硬盘录像机2用于存储监 控视频,交换机3用于将多路摄像头传输的图像传入控制中心4,在控制中心 4中通过烟雾及火焰检测算法判断图像中是否存在烟雾和火焰,若存在则将算 法输出的火焰或者烟雾信息再送入火情评估模块后得到火情等级,并在本地 报警,同时将火情信息存储在硬盘中并发送至云服务器5,若无火情则继续检 测下一帧;云服务器5将火情信息和检测结果等数据整理后传递至手机终端6, 手机终端6上显示检测结果并报警;Among them, the image acquisition terminal 1 is installed in the monitored area to collect the video of the monitored area; the hard disk video recorder 2, the switch 3, and the control center 4 are installed in the central control room, the hard disk video recorder 2 is used to store the monitoring video, and the switch 3 is used to The image transmitted by the camera is sent to the control center 4, and the smoke and flame detection algorithm is used in the control center 4 to determine whether there is smoke or flame in the image. If there is, the flame or smoke information output by the algorithm is sent to the fire evaluation module. Fire level, and alarm locally, and store the fire information in the hard disk and send it to the cloud server 5. If there is no fire, continue to detect the next frame; the cloud server 5 organizes the fire information and detection results and other data. It is transmitted to the mobile terminal 6, and the mobile terminal 6 displays the detection result and alarms;

本发明提出的一种结合烟雾及火焰检测算法的多路视频火灾实时报警系 统的实现方法中,设计了一种自适应模式切换的火灾检测算法,算法整体包 括:(1)自适应模式切换模块、(2)火灾检测算法模块、(3)火情评估模 块In the implementation method of a multi-channel video fire real-time alarm system combined with smoke and flame detection algorithms proposed by the present invention, an adaptive mode switching fire detection algorithm is designed. The algorithm as a whole includes: (1) an adaptive mode switching module , (2) fire detection algorithm module, (3) fire assessment module

(1)本申请的实施方式中,第一个为自适应模式切换模块,其中包括:(1) In the embodiment of this application, the first one is an adaptive mode switching module, which includes:

在检测火焰之前,每隔30s判断一次摄像头所处模式,其算法如下:Before detecting the flame, the mode of the camera is judged every 30s. The algorithm is as follows:

BEGIN(输入图像img):BEGIN (input image img):

Bm,Gm,Rm=图像各通道分离求均值;Bm, Gm, Rm = the average value of each channel of the image;

DIFF1=Bm-Gm;DIFF2=Bm-Rm;DIFF3=Rm-Gm;DIFF1=Bm-Gm; DIFF2=Bm-Rm; DIFF3=Rm-Gm;

IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1):IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1):

THEN return 1;THEN return 1;

ELSE return 0;ELSE return 0;

由于Opencv读到摄像头的图像是BGR格式,只能通过判断各通道值像 素均值是否相等来判断,若返回1为普通模式,若返回0为夜间模式。Since Opencv reads the image of the camera in BGR format, it can only be judged by judging whether the average value of each channel value pixel is equal. If it returns 1, it is normal mode, and if it returns 0, it is night mode.

(2)本申请的实施方式中,第二个为火灾检测算法模块,其中包括:(2) In the embodiment of the present application, the second is a fire detection algorithm module, which includes:

步骤一,构建火焰烟雾样本库:Step 1, build the flame smoke sample library:

在训练之前需要搭建火焰烟雾样本库,我们通过从网络中收集大量火灾 和烟雾的图像以及实地进行燃烧实验得到的图像,这些图像包括多种室内, 天台,办公室等多种场景,强光照,弱光照,白天夜晚多种实验环境等,木 材、塑料、纸张、汽油等多种材料,由于网络上的火灾烟雾图像大多是火灾 后期的浓烟背景,而且图像质量大多较差,数量不足,我们还通过将烟雾和 背景图片合成获得不同场景下烟雾图像,并通过人工对这些数据进行标注, 得到火焰烟雾样本库。Before training, we need to build a fire and smoke sample library. We collect a large number of fire and smoke images from the network and images obtained from burning experiments in the field. These images include a variety of indoor, rooftop, office and other scenes, strong light, weak Lighting, various experimental environments during the day and night, wood, plastic, paper, gasoline and other materials, because most of the fire smoke images on the Internet are the background of thick smoke in the later stage of the fire, and most of the images are of poor quality and insufficient quantity. Smoke images in different scenes are obtained by synthesizing smoke and background images, and these data are manually marked to obtain a flame smoke sample library.

步骤二,训练火焰烟雾目标检测模型:Step 2, train the flame smoke target detection model:

训练白天使用的算法模型,从火焰烟雾样本库中提取火焰和烟雾的数据, 为了提高,模型泛化能力,高斯噪声,对比度增强等方法进行数据扩充,同 时为了使模型学习更多监控现场的情况,除了准备标注好的烟雾的数据集外, 加入现场监控区域监控画面作为背景,约占训练数据的10%,添加背景后能 够有效的减少误报,我们将得到的数据分为训练集和验证集两部份,接着在 服务器上搭建训练环境,最后通过该数据集分别训练火焰及烟雾得到目标检 测算法模型。得到算法模型之后将其部署在控制中心完成检测功能;Train the algorithm model used during the day, extract the flame and smoke data from the flame and smoke sample library, in order to improve the model generalization ability, Gaussian noise, contrast enhancement and other methods for data expansion, and in order to make the model learn more to monitor the situation on site , in addition to preparing the labeled smoke data set, the monitoring screen of the on-site monitoring area is added as the background, accounting for about 10% of the training data. Adding the background can effectively reduce false positives. We divide the obtained data into training set and verification Set two parts, then build a training environment on the server, and finally train the flame and smoke through the data set to obtain the target detection algorithm model. After obtaining the algorithm model, deploy it in the control center to complete the detection function;

训练夜晚使用的算法模型,从火焰烟雾样本库中提取火焰和烟雾的数据, 又由于夜间模式下红外摄像头的拍摄的火灾现场图像难以获得,我们通过以 下算法通过进行模拟:The algorithm model used at night is trained, and the flame and smoke data are extracted from the flame and smoke sample library. Since it is difficult to obtain the fire scene image captured by the infrared camera in the night mode, we simulate it through the following algorithm:

BEGIN(输入图像img):BEGIN (input image img):

img=img.gray();img = img.gray();

img=img.point()*0.7;img=img.point()*0.7;

return img;return img;

通过将图像转化为灰度图并暗化,模拟夜间监控画面,同样将夜间收集到 的现场监控区域监控画面作为背景,占训练样本的10%,将得到的训练样本分 为训练集和验证集,接着在服务器上搭建训练环境,最后通过该数据集分别 训练火焰及烟雾得到目标检测算法模型,得到算法模型之后将其部署在控制 中心完成检测功能;By converting the images into grayscale images and darkening, the nighttime monitoring images are simulated, and the monitoring images of the on-site monitoring area collected at night are also used as the background, accounting for 10% of the training samples, and the obtained training samples are divided into training sets and validation sets. , and then build a training environment on the server, and finally train the flame and smoke through the data set to obtain the target detection algorithm model. After the algorithm model is obtained, it is deployed in the control center to complete the detection function;

步骤三,火灾检测算法:Step 3, fire detection algorithm:

如图4所示是火灾报警系统中的检测算法的流程图,在本实施例中,包 括以下步骤:As shown in Figure 4 is the flow chart of the detection algorithm in the fire alarm system, in this embodiment, comprises the following steps:

①、从图像采集端中获取图像,经过自适应模式切换模块,判断使用夜 间模式还是普通模式。①. Obtain the image from the image acquisition terminal, and determine whether to use the night mode or the normal mode through the adaptive mode switching module.

②、经过自适应模式切换模块,若进入普通模式,采用第3帧检测烟雾, 其中普通模式下烟雾检测算法如图5中(a)所示当帧计数器为3时调用日间 烟雾检测模型,若是存在烟雾,将烟雾的信息送入火情评估模块若不存在则 检测下一帧;第6帧检测火焰,其中普通模式火焰检测算法如图5中(b)所 示当帧计数器为6时调用日间火焰检测模型,将帧计数器复位为1,若是存在 火焰,将火焰的信息送入火情评估模块,若不存在则检测下一帧检测;②. After the adaptive mode switching module, if the normal mode is entered, the third frame is used to detect smoke. The smoke detection algorithm in the normal mode is shown in (a) in Figure 5. When the frame counter is 3, the daytime smoke detection model is called. If there is smoke, send the smoke information to the fire evaluation module. If it does not exist, the next frame will be detected; the 6th frame will detect the flame, of which the normal mode flame detection algorithm is shown in Figure 5 (b) when the frame counter is 6 Call the daytime flame detection model, reset the frame counter to 1, if there is a flame, send the flame information to the fire evaluation module, if not, detect the next frame detection;

若进入夜间模式,夜间烟雾火焰检测算法结构与普通模式下算法相同, 火焰烟雾目标检测算法模型用步骤二训练的夜间烟雾和火焰的算法模型。检 测结束后将火焰和烟雾的信息送入火情评估模块。If the night mode is entered, the structure of the nighttime smoke and flame detection algorithm is the same as that in the normal mode, and the flame smoke target detection algorithm model uses the nighttime smoke and flame algorithm model trained in step 2. After the detection, the information of the flame and smoke is sent to the fire assessment module.

(3)本申请的实施方式中,第三个为火情评估模块,其中包括:(3) In the embodiment of the application, the third is a fire assessment module, which includes:

如图6所示为火情评估模块,火情根据烟雾和火焰区域面积以及面积变 化率将火焰等级分为4级,将烟雾等级分为3级,再根据分级情况确定报警模 式。As shown in Figure 6, the fire evaluation module, the fire situation divides the flame level into 4 levels according to the area of smoke and flame area and the area change rate, and divides the smoke level into 3 levels, and then determines the alarm mode according to the classification situation.

其中在火情评估模块中判断报警级别包括:①若是烟雾,则判断此时烟 雾面积占比S1是否大于等于0.3,若为是,则烟雾级别为3级,若为否则与 上一次烟雾的面积占比相比较,若大于,则烟雾级别加1,若小于,保持目前 的烟雾级别不变。②若是火焰,则判断此时火焰面积占比S2是否大于等于0.1, 若为是,则火焰级别为4级,若为否则与上一次火焰的面积占比相比较,若 大于,则火焰级别加1,若小于,保持目前的火焰级别不变。本发明中将烟雾 等级情况分为3级,火焰等级情况分为4级;Among them, judging the alarm level in the fire assessment module includes: 1. If it is smoke, then judge whether the proportion of smoke area S1 is greater than or equal to 0.3 at this time. Compared with the ratio, if the ratio is greater than that, the smoke level will be increased by 1; if it is less than the ratio, the current smoke level will remain unchanged. ②If it is a flame, judge whether the proportion of the flame area S2 is greater than or equal to 0.1 at this time. If so, the flame level is 4. If it is, it is compared with the area proportion of the previous flame. If it is greater than that, the flame level will be added 1, if less than, keep the current flame level unchanged. In the present invention, the smoke level situation is divided into 3 levels, and the flame level situation is divided into 4 levels;

其中确定报警模式包括,经过火情评估模块得到火情等级后,经过以下 步骤确定报警模式:Determining the alarm mode includes determining the alarm mode through the following steps after obtaining the fire level through the fire evaluation module:

①当仅有烟雾报警时,若烟雾等级为1,2时进入预报警状态,若在5s 内无其他报警发生则将预报警自动复位;①When there is only a smoke alarm, if the smoke level is 1 or 2, it will enter the pre-alarm state, and if no other alarm occurs within 5s, the pre-alarm will be automatically reset;

②当烟雾等级为3级时,或者检测到火焰时,立刻发出火灾报警,且不 可自动复位。② When the smoke level is level 3, or when a flame is detected, a fire alarm will be issued immediately and cannot be reset automatically.

综上,本申请的发明,能够实时监控环境中的火灾异常情况,并将火灾 异常情况以直观的图像形式推送到手机终端中,能够让用户直观的看到现场 的实际情况,对漏报、误报及火灾情况进行准确处理,实现多方协同消防管 理,提高可靠性。采用的烟雾和火焰检测算法提高了本系统的反应速度、判 断灵敏度和判断准确度,而且能够在现有的视频监控系统上进行改造,减少 了硬件成本。To sum up, the invention of the present application can monitor the abnormal fire situation in the environment in real time, and push the abnormal fire situation to the mobile phone terminal in the form of an intuitive image, so that the user can intuitively see the actual situation of the scene, and can prevent false alarms, false alarms, etc. False alarms and fire situations are accurately handled to achieve multi-party coordinated fire management and improve reliability. The adopted smoke and flame detection algorithm improves the response speed, judgment sensitivity and judgment accuracy of the system, and can be retrofitted on the existing video surveillance system, reducing hardware costs.

最后应说明的是:以上所述仅为本发明的优选实施例而已,并不用于限 制本发明,尽管参照前述实施例对本发明进行了详细的说明,对于本领域的 技术人员来说,其依然可以对前述各实施例所记载的技术方案进行修改,或 者对其中部分技术特征进行等同替换,凡在本发明的精神和原则之内,所作 的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。Finally, it should be noted that the above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, for those skilled in the art, the The technical solutions described in the foregoing embodiments can be modified, or some technical features thereof can be equivalently replaced, and any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included. within the protection scope of the present invention.

Claims (9)

1.一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于,包括如下步骤:1. the realization method of the multi-channel video fire real-time alarm system of self-adaptive mode switching, is characterized in that, comprises the steps: 步骤一,多路摄像头同时采集多个监控区域视频;Step 1, the multi-channel cameras simultaneously capture the videos of multiple monitoring areas; 步骤二,将采集到的视频送入控制中心进行处理,输出火情信息;In step 2, the collected video is sent to the control center for processing, and fire information is output; 步骤三,在本地报警,保存火情信息,并将报警信息上传至云服务器;Step 3, alarm locally, save the fire information, and upload the alarm information to the cloud server; 步骤四,用户在手机APP上接收报警信息;Step 4, the user receives the alarm information on the mobile phone APP; 还包括结合烟雾及火焰检测算法的多路视频火灾实时报警系统,包括图像采集端(1)、硬盘录像机(2)、交换机(3)、控制中心(4)、云服务器(5)、手机终端(6);It also includes a multi-channel video fire real-time alarm system combined with smoke and flame detection algorithms, including an image acquisition terminal (1), a hard disk video recorder (2), a switch (3), a control center (4), a cloud server (5), and a mobile phone terminal. (6); 其中图像采集端(1)安装在被监控区域,用于采集被监控区域的视频;Wherein the image acquisition terminal (1) is installed in the monitored area, and is used for collecting the video of the monitored area; 硬盘录像机(2)、交换机(3)、控制中心(4)安装在中控室,硬盘录像机(2)用于存储监控视频,交换机(3)用于将多路摄像头传输的图像传入控制中心(4),在控制中心(4)中通过烟雾及火焰检测算法判断图像中是否存在烟雾和火焰,若存在则将算法输出的火焰或者烟雾信息再送入火情评估模块后得到火情等级,并在本地报警,同时将火情信息存储在硬盘中并发送至云服务器(5),若无火情则继续检测下一帧;云服务器(5)将火情信息和检测结果等数据整理后传递至手机终端(6),手机终端(6)上显示检测结果并报警。The hard disk video recorder (2), the switch (3), and the control center (4) are installed in the central control room. The hard disk video recorder (2) is used to store surveillance video, and the switch (3) is used to transmit the images transmitted by the multi-channel cameras to the control center ( 4), in the control center (4), the smoke and flame detection algorithm is used to judge whether there is smoke and flame in the image, if there is, the flame or smoke information output by the algorithm is sent to the fire evaluation module to obtain the fire level, and in the Local alarm, at the same time, the fire information is stored in the hard disk and sent to the cloud server (5). If there is no fire, the next frame will continue to be detected; A mobile phone terminal (6), the mobile phone terminal (6) displays the detection result and gives an alarm. 2.根据权利要求1所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:还包括自适应模式切换的火灾检测算法,算法整体包括自适应模式切换模块、火灾检测算法模块与火情评估模块。2. the realization method of the multi-channel video fire real-time alarm system of a kind of self-adaptive mode switching according to claim 1, is characterized in that: also comprises the fire detection algorithm of self-adaptive mode switching, the algorithm as a whole comprises self-adaptive mode switching module , Fire detection algorithm module and fire assessment module. 3.根据权利要求2所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:所述自适应模式切换模块包括:3. the realization method of the multi-channel video fire real-time alarm system of a kind of adaptive mode switching according to claim 2, is characterized in that: described adaptive mode switching module comprises: 在检测火焰之前,每隔30s判断一次摄像头所处模式,其算法如下:Before detecting the flame, the mode of the camera is judged every 30s. The algorithm is as follows: BEGIN(输入图像img):BEGIN (input image img): Bm,Gm,Rm=图像各通道分离求均值;Bm, Gm, Rm = the average value of each channel of the image; DIFF1=Bm-Gm;DIFF2=Bm-Rm;DIFF3=Rm-Gm;DIFF1=Bm-Gm; DIFF2=Bm-Rm; DIFF3=Rm-Gm; IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1):IF(SUM(DIFF1,DIFF2,DIFF3)/3<=1): THEN return 1;THEN return 1; ELSEreturn 0;ELSEreturn 0; 由于Opencv读到摄像头的图像是BGR格式,只能通过判断各通道值像素均值是否相等来判断,若返回1为普通模式,若返回0为夜间模式。Since Opencv reads the image of the camera in BGR format, it can only be judged by judging whether the pixel average value of each channel value is equal. If it returns 1, it is normal mode, and if it returns 0, it is night mode. 4.根据权利要求2所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:所述火灾检测算法模块包括:4. the realization method of the multi-channel video fire real-time alarm system of a kind of adaptive mode switching according to claim 2, is characterized in that: described fire detection algorithm module comprises: 步骤一,构建火焰烟雾样本库;Step 1, build a flame smoke sample library; 步骤二,训练火焰烟雾目标检测模型;Step 2, train the flame smoke target detection model; 步骤三,火灾检测算法。Step 3, fire detection algorithm. 5.根据权利要求4所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:所述火灾检测算法模块的步骤二中包括:5. the realization method of the multi-channel video fire real-time alarm system of a kind of self-adaptive mode switching according to claim 4, is characterized in that: in step 2 of described fire detection algorithm module, comprise: 训练夜晚使用的算法模型,从火焰烟雾样本库中提取火焰和烟雾的数据,又由于夜间模式下红外摄像头的拍摄的火灾现场图像难以获得,我们通过以下算法通过进行模拟:The algorithm model used at night is trained to extract flame and smoke data from the flame and smoke sample library. Since the fire scene images captured by infrared cameras in night mode are difficult to obtain, we use the following algorithm to simulate: BEGIN(输入图像img):BEGIN (input image img): img=img.gray();img = img.gray(); img=img.point()*0.7;img=img.point()*0.7; return img。return img. 6.根据权利要求4所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:所述火灾检测算法模块的步骤三中包括如下步骤:6. the realization method of the multi-channel video fire real-time alarm system of a kind of self-adaptive mode switching according to claim 4, is characterized in that: the step 3 of described fire detection algorithm module comprises the following steps: 从图像采集端中获取图像,经过自适应模式切换模块,判断使用夜间模式还是普通模式;Obtain the image from the image acquisition terminal, and determine whether to use the night mode or the normal mode through the adaptive mode switching module; 经过自适应模式切换模块,若进入普通模式,采用第3帧检测烟雾,其中普通模式下烟雾检测算法当帧计数器为3时调用日间烟雾检测模型,若是存在烟雾,将烟雾的信息送入火情评估模块若不存在则检测下一帧;After the adaptive mode switching module, if the normal mode is entered, the third frame is used to detect smoke. In the normal mode, the smoke detection algorithm calls the daytime smoke detection model when the frame counter is 3. If there is smoke, the smoke information is sent to the fire. If the situation evaluation module does not exist, it will detect the next frame; 第6帧检测火焰,其中普通模式火焰检测算法当帧计数器为6时调用日间火焰检测模型,将帧计数器复位为1,若是存在火焰,将火焰的信息送入火情评估模块,若不存在则检测下一帧检测;The 6th frame detects the flame. The normal mode flame detection algorithm calls the daytime flame detection model when the frame counter is 6, and resets the frame counter to 1. If there is a flame, the flame information is sent to the fire evaluation module. Then detect the next frame detection; 若进入夜间模式,夜间烟雾火焰检测算法结构与普通模式下算法相同,火焰烟雾目标检测算法模型用步骤二训练的夜间烟雾和火焰的算法模型,检测结束后将火焰和烟雾的信息送入火情评估模块。If you enter the night mode, the structure of the smoke and flame detection algorithm at night is the same as the algorithm in the normal mode. The flame smoke target detection algorithm model uses the algorithm model of the night smoke and flame trained in step 2. After the detection, the information of the flame and smoke is sent to the fire situation. Evaluation module. 7.根据权利要求2所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:所述火情评估模块包括:7. the realization method of the multi-channel video fire real-time alarm system of a kind of adaptive mode switching according to claim 2, is characterized in that: described fire situation assessment module comprises: 火情根据烟雾和火焰区域面积以及面积变化率将火焰等级分为4级,将烟雾等级分为3级,再根据分级情况确定报警模式。The fire situation divides the flame grade into 4 grades according to the area and area change rate of the smoke and flame area, and divides the smoke grade into 3 grades, and then determines the alarm mode according to the classification situation. 8.根据权利要求7所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:8. the realization method of the multi-channel video fire real-time alarm system of a kind of adaptive mode switching according to claim 7, is characterized in that: 其中在火情评估模块中判断报警级别包括:Among them, judging the alarm level in the fire assessment module includes: 若是烟雾,则判断此时烟雾面积占比S1是否大于等于0.3:若为是,则烟雾级别为3级;If it is smoke, then judge whether the proportion of smoke area S1 is greater than or equal to 0.3 at this time: if so, the smoke level is level 3; 若为否则与上一次烟雾的面积占比相比较:若大于,则烟雾级别加1,若小于,保持目前的烟雾级别不变;If it is otherwise, compare it with the area proportion of the last smoke: if it is greater than, add 1 to the smoke level, if it is less than, keep the current smoke level unchanged; 若是火焰,则判断此时火焰面积占比S2是否大于等于0.1:若为是,则火焰级别为4级,若为否则与上一次火焰的面积占比相比较,若大于,则火焰级别加1,若小于,保持目前的火焰级别不变。If it is a flame, judge whether the flame area ratio S2 is greater than or equal to 0.1 at this time: if it is, the flame level is 4, if it is otherwise, it is compared with the area ratio of the previous flame. If it is greater than that, the flame level is increased by 1 , if it is less than, keep the current flame level unchanged. 9.根据权利要求8所述的一种自适应模式切换的多路视频火灾实时报警系统的实现方法,其特征在于:9. the realization method of the multi-channel video fire real-time alarm system of a kind of self-adaptive mode switching according to claim 8, is characterized in that: 将烟雾等级情况分为3级,火焰等级情况分为4级;The smoke level situation is divided into 3 levels, and the flame level situation is divided into 4 levels; 其中确定报警模式包括,经过火情评估模块得到火情等级后,经过以下步骤确定报警模式:Determining the alarm mode includes determining the alarm mode through the following steps after obtaining the fire level through the fire evaluation module: 当仅有烟雾报警时,若烟雾等级为1,2时进入预报警状态,若在5s内无其他报警发生则将预报警自动复位;When there is only a smoke alarm, if the smoke level is 1 or 2, it will enter the pre-alarm state, and if no other alarm occurs within 5s, the pre-alarm will be automatically reset; 当烟雾等级为3级时,或者检测到火焰时,立刻发出火灾报警,且不可自动复位。When the smoke level is level 3, or when a flame is detected, a fire alarm is issued immediately and cannot be reset automatically.
CN202210199443.2A 2022-03-01 2022-03-01 A realization method of multi-channel video fire real-time alarm system with adaptive mode switching Pending CN114724330A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210199443.2A CN114724330A (en) 2022-03-01 2022-03-01 A realization method of multi-channel video fire real-time alarm system with adaptive mode switching

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210199443.2A CN114724330A (en) 2022-03-01 2022-03-01 A realization method of multi-channel video fire real-time alarm system with adaptive mode switching

Publications (1)

Publication Number Publication Date
CN114724330A true CN114724330A (en) 2022-07-08

Family

ID=82235381

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210199443.2A Pending CN114724330A (en) 2022-03-01 2022-03-01 A realization method of multi-channel video fire real-time alarm system with adaptive mode switching

Country Status (1)

Country Link
CN (1) CN114724330A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115331383A (en) * 2022-10-11 2022-11-11 杭州浩联智能科技有限公司 Construction site safety risk identification method and system
CN115346152A (en) * 2022-08-16 2022-11-15 中国银行股份有限公司 Method for detecting fire based on image and related device
CN115424404A (en) * 2022-09-06 2022-12-02 湖南省永神科技有限公司 Lighting system with fire alarm function
CN115512510A (en) * 2022-10-11 2022-12-23 深圳市狮子王科技有限公司 Charging pile fire intelligent processing system and method
CN115690695A (en) * 2022-12-29 2023-02-03 杭州浩联智能科技有限公司 Construction site fire auxiliary disposal method, system and storage medium
CN116071883A (en) * 2022-12-13 2023-05-05 华能山西综合能源有限责任公司 A fire alarm system and method for photovoltaic power plants
CN116469049A (en) * 2023-04-08 2023-07-21 江苏智能无人装备产业创新中心有限公司 Calculation method, system, equipment and medium of fire hazard degree
CN116704693A (en) * 2023-06-16 2023-09-05 上海伟梦物联网科技有限公司 Method and system for multi-camera linkage confirmation of fire point based on Internet of Things
CN117191031A (en) * 2023-09-08 2023-12-08 北京城建集团有限责任公司 A fire warning and escape path planning method and system based on smart construction
CN117671608A (en) * 2024-02-02 2024-03-08 江苏林洋亿纬储能科技有限公司 Method and system for starting fire-fighting operation of battery energy storage system and computing equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102163361A (en) * 2011-05-16 2011-08-24 公安部沈阳消防研究所 Image-type fire detection method based on cumulative prospect image
CN106997461A (en) * 2017-03-28 2017-08-01 浙江大华技术股份有限公司 A kind of firework detecting method and device
KR101822924B1 (en) * 2016-11-28 2018-01-31 주식회사 비젼인 Image based system, method, and program for detecting fire
CN207529496U (en) * 2017-12-04 2018-06-22 北京华德恒业科技有限公司 A kind of flame warning device
CN110517441A (en) * 2019-09-26 2019-11-29 华南师范大学 Embedded smoke and flame video alarm system and method based on deep learning framework
CN112232318A (en) * 2020-12-14 2021-01-15 北京华云星地通科技有限公司 Cloud plus-end intelligent fire remote sensing monitoring and early warning method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102163361A (en) * 2011-05-16 2011-08-24 公安部沈阳消防研究所 Image-type fire detection method based on cumulative prospect image
KR101822924B1 (en) * 2016-11-28 2018-01-31 주식회사 비젼인 Image based system, method, and program for detecting fire
CN106997461A (en) * 2017-03-28 2017-08-01 浙江大华技术股份有限公司 A kind of firework detecting method and device
CN207529496U (en) * 2017-12-04 2018-06-22 北京华德恒业科技有限公司 A kind of flame warning device
CN110517441A (en) * 2019-09-26 2019-11-29 华南师范大学 Embedded smoke and flame video alarm system and method based on deep learning framework
CN112232318A (en) * 2020-12-14 2021-01-15 北京华云星地通科技有限公司 Cloud plus-end intelligent fire remote sensing monitoring and early warning method

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115346152A (en) * 2022-08-16 2022-11-15 中国银行股份有限公司 Method for detecting fire based on image and related device
CN115424404A (en) * 2022-09-06 2022-12-02 湖南省永神科技有限公司 Lighting system with fire alarm function
CN115512510B (en) * 2022-10-11 2023-09-29 深圳市狮子王科技有限公司 Intelligent fire disaster treatment system and method for charging pile
CN115512510A (en) * 2022-10-11 2022-12-23 深圳市狮子王科技有限公司 Charging pile fire intelligent processing system and method
CN115331383A (en) * 2022-10-11 2022-11-11 杭州浩联智能科技有限公司 Construction site safety risk identification method and system
CN116071883A (en) * 2022-12-13 2023-05-05 华能山西综合能源有限责任公司 A fire alarm system and method for photovoltaic power plants
CN115690695A (en) * 2022-12-29 2023-02-03 杭州浩联智能科技有限公司 Construction site fire auxiliary disposal method, system and storage medium
CN115690695B (en) * 2022-12-29 2024-07-19 杭州浩联智能科技有限公司 Auxiliary treatment method, system and storage medium for fire conditions on construction site
CN116469049A (en) * 2023-04-08 2023-07-21 江苏智能无人装备产业创新中心有限公司 Calculation method, system, equipment and medium of fire hazard degree
CN116704693A (en) * 2023-06-16 2023-09-05 上海伟梦物联网科技有限公司 Method and system for multi-camera linkage confirmation of fire point based on Internet of Things
CN117191031A (en) * 2023-09-08 2023-12-08 北京城建集团有限责任公司 A fire warning and escape path planning method and system based on smart construction
CN117671608A (en) * 2024-02-02 2024-03-08 江苏林洋亿纬储能科技有限公司 Method and system for starting fire-fighting operation of battery energy storage system and computing equipment
CN117671608B (en) * 2024-02-02 2024-04-26 江苏林洋亿纬储能科技有限公司 Method and system for starting fire-fighting operation of battery energy storage system and computing equipment

Similar Documents

Publication Publication Date Title
CN114724330A (en) A realization method of multi-channel video fire real-time alarm system with adaptive mode switching
CN101334924B (en) Fire detection system and fire detection method thereof
US7991187B2 (en) Intelligent image smoke/flame sensor and detection system
CN110517441A (en) Embedded smoke and flame video alarm system and method based on deep learning framework
CN103150856B (en) Fire flame video monitoring and early warning system
CN101814133B (en) Intelligent flame detection method based on computer vision monitoring technology
CN106600888A (en) Forest fire automatic detection method and system
CN201259717Y (en) Fire disaster probe system
CN108389359B (en) Deep learning-based urban fire alarm method
CN101609589A (en) Multi-frequency image fire detection system
CN212782246U (en) A fireworks recognition system based on artificial intelligence
CN201091014Y (en) Fire detecting device
CN101316371B (en) Flame detection method and device
CN108694801A (en) A kind of fire alarm intelligent recognition plateform system
CN110853287A (en) Flame real-time monitoring system and method based on Internet of things distributed architecture
CN212966489U (en) Elevator early warning system on electric motor car based on intelligent analysis technique
CN114998807A (en) Intelligent fire smoke early warning system based on deep learning and edge calculation
CN102609685A (en) Shadowing judging method of image type fire detector
CN108898781A (en) A kind of intelligent fire Internet of things system based on public cloud
CN201435784Y (en) Network video monitoring system
CN201797552U (en) Audible and visual alarm camera
CN110691221A (en) A system for realizing intelligent video surveillance for unattended substations
CN120412168A (en) An intelligent fire prevention and control system based on multi-information fusion and Yolo detection
KR102352477B1 (en) Video analysis system capable of determining false detection of fire sensor
CN115049988A (en) Edge calculation method and device for power distribution network monitoring and prejudging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20230411

Address after: 510000 No. 55, Zhongshan Avenue, Guangzhou, Guangdong

Applicant after: SOUTH CHINA NORMAL University

Applicant after: Qingyuan Huayun Zhikong Technology Co.,Ltd.

Applicant after: South China Normal University (Qingyuan) science and Technology Innovation Research Institute Co.,Ltd.

Address before: 510631 No. 55, Zhongshan Avenue, Guangzhou, Guangdong

Applicant before: SOUTH CHINA NORMAL University

Applicant before: Qingyuan Huayun Zhikong Technology Co.,Ltd.