[go: up one dir, main page]

WO2012137994A1 - Dispositif de reconnaissance d'image et son procédé de surveillance d'image - Google Patents

Dispositif de reconnaissance d'image et son procédé de surveillance d'image Download PDF

Info

Publication number
WO2012137994A1
WO2012137994A1 PCT/KR2011/002341 KR2011002341W WO2012137994A1 WO 2012137994 A1 WO2012137994 A1 WO 2012137994A1 KR 2011002341 W KR2011002341 W KR 2011002341W WO 2012137994 A1 WO2012137994 A1 WO 2012137994A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
monitoring
camera
unit
cameras
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2011/002341
Other languages
English (en)
Korean (ko)
Inventor
정의석
김영석
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ITXSECURITY CO Ltd
Original Assignee
ITXSECURITY CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ITXSECURITY CO Ltd filed Critical ITXSECURITY CO Ltd
Publication of WO2012137994A1 publication Critical patent/WO2012137994A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects

Definitions

  • the present invention relates to an image recognition device for dividing a surveillance zone into a plurality of logical unit surveillance zones to perform video surveillance with a plurality of sensors and a plurality of cameras, and a video surveillance method thereof.
  • An image recognition device is a device that recognizes and analyzes objects in an image by using various image processing techniques beyond simply storing an image signal input through a camera.
  • video surveillance apparatus using a conventional camera includes a CCTV system using a video cassette recorder (VCR) and a digital video recorder (DVR) for storing images on a hard disk.
  • VCR video cassette recorder
  • DVR digital video recorder
  • the applicant has proposed an algorithm for tracking the movement of the object in a logical way beyond simply recognizing the object captured in the camera image of the surveillance zone.
  • An object of the present invention is to provide a video recognition apparatus for performing video surveillance with a plurality of sensors and a plurality of cameras by dividing a surveillance zone into a plurality of logical unit surveillance zones and a video surveillance method thereof.
  • the image recognition device includes a plurality of cameras respectively photographing a plurality of unit surveillance zones divided into an entire surveillance zone, a plurality of sensors installed on an outer surface of the entire surveillance zone, and It includes an image controller that receives images from the plurality of cameras and is connected to an external system.
  • the image controller includes an image receiver, an event generator, an image processor, a monitor, and an external device linking unit.
  • An image monitoring method using an image controller includes: establishing a logical connection relationship between the plurality of cameras based on a moving path of a moving object according to spatial connection of the plurality of unit monitoring zones; Sensing one of the plurality of sensors installed outside the entire monitoring zone and generating a monitoring event; Recognizing and tracking a moving object in an image input from the primary tracking camera by using a camera logically connected to a sensor that detects the moving object among the plurality of cameras as a primary tracking camera according to the monitoring event; And providing an image to the external system that recognizes the moving object at the time when the moving object is recognized.
  • the tracking is performed through an object recognition process for an image input from a secondary tracking camera that is logically connected to the primary tracking camera among the plurality of cameras. Tracking the object again; And providing the image of the secondary tracking camera to the external system when the object is re-recognized by the secondary tracking camera.
  • the video surveillance method of the present invention when the object is not recognized during the tracking, when there are a plurality of cameras logically connected to the primary tracking camera among the plurality of cameras, the video surveillance method of the present invention is logically connected.
  • the second tracking camera is selected by recognizing a moving object with respect to an image input from a plurality of cameras.
  • the image recognition apparatus of the present invention may provide a monitoring result to an external system while monitoring a video by dividing the monitoring zone into a plurality of unit monitoring zones using a plurality of sensors and cameras.
  • the image recognition device may have the same effect as if the manager selects and records the monitored camera according to the moving path of the object once the monitored object is captured.
  • FIG. 1 is a block diagram of an image recognition device according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating an example in which a sensor and a camera are installed in a surveillance area
  • FIG. 3 is a flowchart provided to explain an image monitoring method according to an embodiment of the present invention.
  • FIG. 4 shows an example of an image provided as a result of monitoring.
  • the image recognition device 100 of the present invention is connected to an external system 30 through a network 10.
  • the external system 30 is a device capable of receiving a video surveillance result provided in the form of an image from the image recognition device 100 and displaying the result to the user.
  • the external system 30 may be a mobile phone, a smart phone, or a separately designed security system.
  • the network 10 may be configured in various ways according to the type of the external system 30.
  • the network 10 may correspond to a mobile communication network, a wired or wireless Internet, and the like.
  • the image recognition apparatus 100 may provide the external system 30 with an image surveillance result through image processing on an analog or digital image signal provided by the plurality of cameras 101a to 101e installed in the surveillance space.
  • the image recognition device 100 includes a plurality of cameras 101a to 101e installed in a surveillance space, a plurality of sensors 103a to 103c, and an image controller 110 for processing images captured by the cameras 101a to 101e. It includes.
  • the cameras 101a to 101e are not only analog cameras for generating analog video signals having a predetermined frame rate, digital cameras for generating digital video signals, but also IP (Internet Protocol) cameras that can be connected to the Internet.
  • IP Internet Protocol
  • the cameras 101a to 101e are installed to divide the surveillance zone to photograph each divided space, and each camera 101a to 101e is mutually logical with at least one other camera as described below. Is connected.
  • Sensors 103a to 103c are installed along the outer periphery of the surveillance zone as shown in FIG. 2 to detect an intruder invading into the surveillance zone, and correspond to an infrared detector and a magnet detector.
  • the sensors 103a through 103c are also logically interconnected with at least one of the cameras 101a through 101e.
  • the image controller 110 stores and manages images captured by the cameras 101a to 101e. If necessary, the image controller 110 performs image processing on the images of the cameras 101a to 101e and provides the information to the external system 30 when it corresponds to a predetermined condition. To this end, the image controller 110 includes an image receiver 111, a storage medium 113, a device interface 115, and a controller 130.
  • the image receiving unit 111 receives and decodes the analog image signals provided by the cameras 101a to 101e and then displays them through a display unit (not shown), or converts them into digital image signals and stores them in the storage medium 113. Provided at 130.
  • the storage medium 113 stores the digital video signal provided by the image receiver 111.
  • the device interface unit 115 is a wired or wireless interface for connecting to the network 10.
  • the device interface unit 115 is connected to the external system 30 through the network 10, and transmits various monitoring results provided by the controller 130 to the external system 30.
  • the controller 130 controls the overall operation of the image controller 110.
  • the image controller 110 of the present invention may perform various functions, for example, storing / searching each camera image, such a function is not a characteristic function of the present invention, and thus the description thereof is omitted and the present invention is presented. It will be described based on the interlocking function with the external system 30.
  • the controller 130 is an event generating unit 131, an image processing unit 133, a monitoring unit 135, a recording and playback processing unit 137 and an external device interlocking unit 139 for the characteristic intelligent image tracking function of the present invention. It includes.
  • the event generator 131 reads the sensing result of detecting the intruder from the sensors 103a to 103c to generate a monitoring event, and provides the generated monitoring event to the monitoring unit 135.
  • the image processor 133 recognizes a moving object by performing object recognition on the image input from the camera that the monitoring unit 135 processes from among the cameras in operation.
  • the image processor 133 provides the monitoring unit 135 with detection information of the corresponding object.
  • the detection information includes at least information on a time when a new object appeared in the image of the requested camera and a time when the new object disappeared.
  • Object recognition and tracking of the image processor 133 may use various known methods. For example, general object recognition may be obtained from a subtraction operation of an image of a previous frame and an image of a new frame, and tracking of the detected object may also use a known algorithm.
  • the monitoring unit 135 performs a monitoring algorithm for a monitoring target area with information on a logical connection relationship between each sensor and a camera (or a logical connection relationship between each monitoring area) to be described below.
  • the monitoring unit 135 requests the image processing unit 133 to recognize the intruder (object) through the analysis of the image input from the specific camera based on the monitoring algorithm, and based on the recognition result provided from the image processing unit 133. Based on the monitoring results are generated in a log file and stored in the storage medium (113).
  • the recording / playback processing unit 137 controls an operation for recording and reproducing a basic video signal provided by the image recognition device 100, and requests an image input from a specific camera according to the request of the monitoring unit 135. From this time, it may be managed to be stored as a separate image file or a separate tag or metadata may be assigned.
  • the external device interlocking unit 139 provides the monitoring result of the monitoring unit 135 to the external system 30 through the device interface unit 115.
  • the monitoring result provided by the external device interworking unit 139 may include a camera still image at the moment of recognition of the object, corresponding camera position information, and time information of detecting the object in the image.
  • the monitoring result is recorded by recording the camera position information and the detection time information as part of the image in the camera still image. It may be provided in the form of an image.
  • each unit monitoring zone L1 to L5 is divided by cameras 101a to 101e.
  • first to third sensors 103a to 103c are disposed along the outer periphery of the surveillance zone, and the first to third sensors 103a to 103c are also at least one of the first to fifth cameras 101a to 101e. Logically connected to
  • the first sensor 103a is a magnet detector installed in the window of the first unit monitoring zone L1
  • the second sensor 103b is a magnet detector installed in the window of the second unit monitoring zone L2
  • the third sensor 103c is an example of an infrared detector installed in a window of the third unit monitoring zone L3.
  • Each surveillance zone, each camera or sensor is in a logical connection with each other by moving path analysis based on the purpose of the surveillance, the spatial characteristics of the surveillance zone and the characteristics of the object to be monitored (eg, intruder).
  • the object to be monitored is a human
  • an intruder who invades the first unit monitoring area L1 must pass through the third unit monitoring area L3, and the intruder who appears in the first unit monitoring area L1 has a fourth moment. It does not occur in the unit monitoring area L4. Therefore, the first unit monitoring zone L1 is logically connected to the second unit monitoring zone L2 and the third unit monitoring zone L3.
  • the first sensor 103a is logically connected to the first camera 101a
  • the second sensor 103b is logically connected to the second camera 101b
  • the third sensor 103c is logically connected to the third camera 101c and the fourth camera 101d.
  • the fifth unit monitoring zone (L5) ⁇ the third unit monitoring zone (L3) ⁇ the first unit monitoring zone (L1) is a possible connection, but the fifth unit monitoring zone (L5) ⁇ the fourth unit monitoring zone (L5) (L4) ⁇
  • the first unit monitoring area L1 is impossible because there is no connection between the fourth unit monitoring area L4 and the first unit monitoring area L1.
  • the third sensor 103c ⁇ fourth camera 101d ⁇ fifth camera 101e are possible connections, but the third sensor 103c ⁇ second camera 101b ⁇ third camera 101c is a third connection. Since there is no connection between the sensor 103c and the second camera 101b, this is impossible.
  • FIG. 3 an image monitoring method of the image recognition device 100 of the present invention centering on the monitoring unit 135 and the image processing unit 133 will be described.
  • the event generator 131 reads the first to third sensors 103a to 103c and generates a monitoring event when an intruder is detected (S301).
  • the monitor 135 When the surveillance event is generated by the event generator 131, the monitor 135 requests the image processor 133 to recognize and track an object of an image of a camera logically connected to the surveillance event (S303).
  • the monitoring event has occurred by the first sensor 103a.
  • the object p enters the first unit monitoring area L1 and moves to the third unit monitoring area L3.
  • the event generator 131 generates a surveillance event by the first sensor 103a, and the monitor 135 requests the image processor 133 to recognize and track the object of the image of the first camera 101a. Done.
  • the image processing unit 133 starts object recognition and tracking of an image input from a camera requested to be monitored (in the example of FIG. 2, the first camera).
  • Object recognition, extraction, and tracking of the image processor 133 may be processed by a method known in the image processing field as described above.
  • the image processor 133 When a moving object is extracted during image analysis, the image processor 133 provides object recognition information to the external device interlocking unit 139 and the monitoring unit 135 and starts tracking the extracted object.
  • the object recognition information may include object recognition time and object recognized camera information, and if necessary, may include a corresponding still image.
  • the external device interlocking unit 139 which receives the object recognition information from the image processing unit 133, provides the image processed by the image processing unit 133 to the external system 30. At this time, the camera location information and time information of detecting the intruder are also provided. In the example of FIG. 2, since the intruder will be recognized in the image of the first camera 101a, the monitoring result is obtained from one image captured by the first camera 101a, the first camera position, and the image of the first camera 101a. Time information identifying the intruder is included.
  • FIG 4 shows an example of one image provided to the cellular phone which is one of the external systems 30 as a result of the monitoring.
  • the position of the first camera and the recognition time are recorded in the image provided to the external system 30.
  • the image processor 133 ends the tracking of the object with the end time information to the monitoring unit 135. to provide.
  • the image processing unit 133 starts object recognition and tracking, and the intruder leaves the third unit monitoring area L3 which is a corridor. At this time, the object disappears from the image input from the first camera 101a and the image processor 133 ends the tracking of the object.
  • the monitoring unit 135 When the monitoring unit 135 is notified of the end of the object tracking for the requested camera image from the image processing unit 133, the camera to continue tracking among the cameras (or unit monitoring zones) logically connected to the camera being tracked (unit monitoring zones) Select. To this end, the monitoring unit 135 requests the image processing unit 133 to track all of the logically connected cameras for a predetermined time. In the example, since the logically connected cameras of the first camera 101a are the second camera 101b and the third camera 101c, the monitoring unit 135 is configured for the second camera 101b and the third camera 101c.
  • the image processor 133 requests the monitoring of the predetermined time.
  • the predetermined time may be determined in consideration of the moving capability of the object, the spatial characteristics of the surveillance zone.
  • the image processor 133 monitors whether there is a newly displayed object with respect to the images of the cameras which are requested to be tracked for a set time at the request of the monitor 135, and provides the monitoring result to the monitor 135. As the object p moves from the first unit surveillance zone L1 to the third unit surveillance zone L3, the image processor 133 notifies the monitoring unit 135 that a new object has been recognized in the third surveillance zone. do.
  • the second unit monitoring zone L2 or the third unit monitoring zone L3 may have a previously moving object. Even in this case, the image processor 133 extracts only the newly appearing object from the image of the unit monitoring zone and provides the result to the monitoring unit 135.
  • step S311 may not be performed.
  • the monitoring unit 135 determines whether there is a camera in which the object to be tracked is searched based on the result provided from the image processing unit 133 in step S311.
  • the monitoring unit 135 selects the unit monitoring zone (the third unit monitoring zone in the example of FIG. 2) to continue tracking, and the corresponding unit monitoring zone. While requesting the monitoring result notification of S307 to the external device interlocking unit 139, the image processing unit 133 requests the same object recognition and tracking as in step S309.
  • the external device interlocking unit 139 is an image of the third camera 101c from which the object p was first captured. To the external system 30 as a monitoring result.
  • the first camera 101a becomes the primary tracking camera and the third camera 101c becomes the secondary tracking camera.
  • the external system 30 can check in real time the information on which path the intruder who invaded the surveillance area is invading.
  • Steps S307 to S313 are repeated until the connection monitoring zone to continue tracking is not selected because the moving object is not recognized.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

La présente invention porte sur un dispositif de reconnaissance d'image et sur son procédé de surveillance d'image. Le dispositif de reconnaissance d'image de la présente invention effectue une opération de surveillance d'image à l'aide d'une pluralité de capteurs et d'une pluralité de caméras après division d'une zone de surveillance en une pluralité de zones de surveillance logiques, et fournit un résultat de surveillance à un système externe tout en suivant et en surveillant le mouvement d'un objet reconnu dans une zone cible de surveillance par l'intermédiaire d'une interprétation d'image d'un signal d'image.
PCT/KR2011/002341 2011-04-04 2011-04-05 Dispositif de reconnaissance d'image et son procédé de surveillance d'image Ceased WO2012137994A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2011-0030673 2011-04-04
KR1020110030673A KR101212082B1 (ko) 2011-04-04 2011-04-04 영상인식장치 및 그 영상 감시방법

Publications (1)

Publication Number Publication Date
WO2012137994A1 true WO2012137994A1 (fr) 2012-10-11

Family

ID=46969368

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2011/002341 Ceased WO2012137994A1 (fr) 2011-04-04 2011-04-05 Dispositif de reconnaissance d'image et son procédé de surveillance d'image

Country Status (2)

Country Link
KR (1) KR101212082B1 (fr)
WO (1) WO2012137994A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744140A (zh) * 2014-12-10 2016-07-06 信泰光学(深圳)有限公司 待测物出现次数记录装置及方法
WO2017034114A1 (fr) * 2015-08-24 2017-03-02 Lg Electronics Inc. Terminal mobile et son procédé de commande

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101467663B1 (ko) * 2013-01-30 2014-12-01 주식회사 엘지씨엔에스 영상 모니터링 시스템에서 영상 제공 방법 및 시스템
KR101593187B1 (ko) 2014-07-22 2016-02-11 주식회사 에스원 3차원 영상 정보를 이용한 이상 행동 감시 장치 및 방법
KR102183904B1 (ko) 2014-10-14 2020-11-27 한화테크윈 주식회사 실내위치인식기반 보안관리장치 및 방법
KR102673041B1 (ko) 2016-08-18 2024-06-07 한화비전 주식회사 이벤트 검색 시스템, 장치 및 방법
KR102128108B1 (ko) * 2019-11-25 2020-06-29 고병진 카메라 반응 탐지 장치

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060027955A (ko) * 2004-09-24 2006-03-29 주식회사 유니썬코리아 논리분할에 의한 외곽울타리 감시시스템
KR20060124232A (ko) * 2005-05-31 2006-12-05 손용식 이동통신단말기 카메라와 이동통신단말기 내외장형탐지센서를 이용한 침입탐지 및 방범 시스템
KR20100116829A (ko) * 2009-04-23 2010-11-02 (주)플렛디스 씨씨티브이 카메라 영상에서의 특정 움직임 감지 장치 및 방법

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060027955A (ko) * 2004-09-24 2006-03-29 주식회사 유니썬코리아 논리분할에 의한 외곽울타리 감시시스템
KR20060124232A (ko) * 2005-05-31 2006-12-05 손용식 이동통신단말기 카메라와 이동통신단말기 내외장형탐지센서를 이용한 침입탐지 및 방범 시스템
KR20100116829A (ko) * 2009-04-23 2010-11-02 (주)플렛디스 씨씨티브이 카메라 영상에서의 특정 움직임 감지 장치 및 방법

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105744140A (zh) * 2014-12-10 2016-07-06 信泰光学(深圳)有限公司 待测物出现次数记录装置及方法
WO2017034114A1 (fr) * 2015-08-24 2017-03-02 Lg Electronics Inc. Terminal mobile et son procédé de commande

Also Published As

Publication number Publication date
KR20120113014A (ko) 2012-10-12
KR101212082B1 (ko) 2012-12-13

Similar Documents

Publication Publication Date Title
WO2012137994A1 (fr) Dispositif de reconnaissance d'image et son procédé de surveillance d'image
WO2018124510A1 (fr) Dispositif de mémorisation d'événement, dispositif de recherche d'événement et dispositif de notification d'événement
WO2018135906A1 (fr) Caméra et procédé de traitement d'image d'une caméra
WO2012060535A1 (fr) Système de serrure de porte à sécurité améliorée et procédé de commande associé
WO2014193065A1 (fr) Procédé et appareil de recherche de vidéo
WO2012124852A1 (fr) Dispositif de caméra stéréo capable de suivre le trajet d'un objet dans une zone surveillée, et système de surveillance et procédé l'utilisant
WO2016099084A1 (fr) Système de fourniture de service de sécurité et procédé utilisant un signal de balise
JP6807548B2 (ja) 処理装置、制御方法、プログラム、及びインターホンシステム
KR20190092227A (ko) 지능형 영상 분석에 의한 실영상 및 녹화영상 검색 시스템
WO2018135695A1 (fr) Appareil et système de surveillance
WO2019124635A1 (fr) Procédé orienté syntaxe de détection d'une intrusion d'objet dans une vidéo comprimée
WO2017034177A1 (fr) Système de mise en application pour freiner le stationnement et l'arrêt illégaux à l'aide d'images provenant de différentes caméras et système de commande le comprenant
WO2011136418A1 (fr) Enregistreur dvr et procédé de surveillance d'images de celui-ci
WO2021167374A1 (fr) Dispositif de recherche vidéo et système de caméra de surveillance de réseau le comprenant
WO2021020866A1 (fr) Système et procédé d'analyse d'images pour surveillance à distance
WO2015119326A1 (fr) Dispositif d'affichage et son procédé de commande
WO2017034309A1 (fr) Procédé et appareil de classification de données multimédia
WO2018097384A1 (fr) Appareil et procédé de notification de fréquentation
WO2013162095A1 (fr) Magnétoscope numérique et procédé de surveillance vidéo associé
WO2012050244A1 (fr) Dispositif de surveillance d'image et son procédé de recherche d'objets
WO2020111353A1 (fr) Procédé et appareil pour détecter un équipement d'invasion de confidentialité et système associé
WO2016064107A1 (fr) Procédé et appareil de lecture vidéo sur la base d'une caméra à fonctions de panoramique/d'inclinaison/de zoom
WO2021172943A1 (fr) Dispositif de recherche vidéo et système de caméra de surveillance en réseau le comprenant
JP4985742B2 (ja) 撮影システム、方法及びプログラム
WO2016167428A1 (fr) Équipement de surveillance de type étendu utilisant des modules d'analyse vocale installés dans une pluralité d'emplacements

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11862895

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11862895

Country of ref document: EP

Kind code of ref document: A1