KR101441105B1 - Apparatus method for setting region of interest - Google Patents

Abstract

The interest region setting apparatus sets the region of interest selected by the user to the image photographed by the camera, adaptively changes the coordinate information of the region of interest as at least one of the panning, tilting and zooming of the camera is changed, And resets the region of interest to an image photographed by the camera.

Description

[0001] APPARATUS METHOD FOR SETTING REGION OF INTEREST [0002]

The present invention relates to an apparatus and method for setting a region of interest, and more particularly, to an apparatus and method for resetting a region of interest that is changed in an image region photographed by a camera whose photographing angle is variable, such as a PTZ camera.

Conventional CCTV cameras do not have "intelligence", so the interpretation of the images depends entirely on the user. Therefore, for real - time monitoring, the user should always watch the camera image, and the monitoring efficiency decreases as the monitoring area and time increase. Therefore, video surveillance is changing from movement monitoring of existing CCTV cameras to intelligent surveillance.

Intelligent video surveillance system is generally applied to fixed camera. It is applied to PTZ (Pan / Tilt / Zoom) camera which can control pan / tilt / zoom angle / Is changed. Therefore, the user has to manually reset the area of interest whenever the angle of the PTZ camera is changed. Especially, when the number of the set area of interest is large, the inconvenience of the resetting of the area of interest becomes large.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus and method for setting a region of interest capable of resetting a region of interest that is changed by a camera whose photographing angle is variable without the user's intervention.

According to an embodiment of the present invention, there is provided an apparatus for setting an area of interest in an image photographed by a camera. The region-of-interest setting apparatus includes an initial setting unit and a resetting unit. The initial setting unit sets the region of interest selected by the user to the image photographed by the camera, and stores the region of interest as coordinate information. The reset unit resets the region of interest to an image photographed by the camera adaptively as at least one of the pan, tilt, and zoom of the camera is changed.

The ROI apparatus may further include a feature extraction unit and a matching unit. The feature extraction unit extracts a feature of an image photographed by the camera whenever at least one of the pan, tilt, and zoom of the camera is changed. The matching unit calculates the positional change of the ROI by matching the feature of the current image with the feature of the previous image. At this time, the re-setting unit may change the coordinate information of the ROI based on the positional change of the ROI.

The region-of-interest setting apparatus may further include a change-degree calculator. The variation calculator calculates the degree of change of the ROI from the current pan, tilt, and zoom information of the camera. At this time, the matching unit may match the feature of the region of interest predicted from the degree of change of the ROI in the current image with the feature of the previous ROI.

The feature of the image may include at least one of outline, brightness, and color distribution.

According to another embodiment of the present invention, there is provided a method of setting a region of interest in an image photographed by the camera in accordance with a change in photographing condition of the camera in a region-of-interest setting apparatus. The method includes: converting a region of interest selected by a user into coordinate information in an image captured by the camera; extracting a feature of the image captured by the camera; Calculating a positional change of the ROI by matching features of the ROI, and modifying coordinate information of the ROI based on the ROI of the ROI.

The extracting may include extracting a feature point of the image photographed by the camera when at least one of the pan, tilt, and zoom of the camera is changed.

Wherein calculating the positional change of the ROI includes calculating a degree of change of the ROI from the current pan, tilt, and zoom information of the camera, and calculating a change of the ROI of the ROI And matching the feature with the feature of the previous image.

According to the embodiment of the present invention, even when the photographing angle is changed as in the PTZ camera, the position of the region of interest in the image region photographed by the camera is automatically reset without user intervention, It is possible to eliminate the hassle of resetting the area of interest. Therefore, it can be effectively used in the field of intelligent video surveillance and video control using cameras.

FIG. 1 is a schematic view of a video surveillance system according to an embodiment of the present invention.
2 is a view showing an example of an image taken by the camera shown in FIG.
3 is a view showing an example of a region of interest set in an image photographed by a camera.
FIG. 4 is a view showing a region-of-interest setting unit shown in FIG. 1. FIG.
FIG. 5 is a flowchart illustrating a method of setting a region of interest in the ROI setup unit shown in FIG.
FIG. 6 and FIG. 7 are diagrams illustrating results of a method of setting a ROI according to an embodiment of the present invention.
8 is a schematic diagram of a region of interest setting apparatus according to another embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification and claims, when a section is referred to as "including " an element, it is understood that it does not exclude other elements, but may include other elements, unless specifically stated otherwise.

Now, an apparatus and method for setting a region of interest according to an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a schematic view of a video surveillance system according to an embodiment of the present invention. FIG. 2 is a view showing an example of an image taken by the camera shown in FIG. 1, and FIG. 3 is a view showing an example of a region of interest set in an image taken by a camera.

Referring to FIG. 1, the video surveillance system includes a camera 100, a region-of-interest setting unit 200, a camera controller 300, and a display unit 400.

The camera 100 may be a pan / tilt / zoom (PTZ) camera, which can be rotated at right / left / up and down angles.

The camera 100 controls shooting conditions in accordance with pan (left and right), tilt (up and down), and zoom (enlargement / reduction) commands. The camera 100 photographs an image under the set photographing conditions, determines at least one value of the pan, tilt, and zoom when an event occurs in the region of interest in the photographed image, changes the photographing condition to a determined value, do.

The region-of-interest setting unit 200 sets the region of interest selected by the user to the image photographed by the camera 100 among the entire region photographed by the camera 100. [

The ROI setting unit 200 converts the ROI set in the image captured by the camera 100 into coordinate information and stores the ROI as information of the ROI. Also, the ROI setting unit 200 stores the pan, tilt, and zoom information corresponding to the shooting conditions of the camera 100 as information of the initial shooting conditions.

For example, the camera 100 photographs an image according to a set photographing condition. When the image photographed by the photographing condition set in the camera 100 is as shown in FIG. 2, the region-of-interest setting unit 200 selects After the ROI is converted into coordinate information, the ROI can be set to an image captured by the camera 100 using the coordinate information as shown in FIG.

The camera 100 photographs an image while changing at least one of pan, tilt, and zoom according to a user's selection or setting. Depending on the change of at least one of the pan, tilt and zoom, the image to be photographed changes, thereby changing the position of the region of interest. In the conventional case, when the photographing condition of the camera 100 is changed, the ROI is also manually reset by the user, but the ROI setting unit 200 may set the ROI according to the image photographed by the camera 100 as adaptive To be photographed.

The camera control unit 300 receives the pan, tilt, and zoom commands from the user, and transmits pan, tilt, and zoom commands to the camera 100 to control the camera 100.

The display unit 400 displays an image photographed by the camera 100. [ The user can change at least one of the fan, the filter, and the zoom of the camera 100 to the camera controller 300 while monitoring the displayed image through the display unit 400. [

FIG. 4 is a diagram illustrating the ROI setting unit shown in FIG. 1, and FIG. 5 is a flowchart illustrating a method of setting ROIs in the ROI setting unit shown in FIG.

4, the ROI setup unit 200 includes an initialization unit 210, a feature extraction unit 220, a change degree calculation unit 230, a matching unit 240, a reconfiguration unit 250, 260).

The initial setting unit 210 receives the information of the selected region of interest from the user and sets the region of interest to the image photographed by the camera 100 in operation S502 and displays the region of interest as the coordinate information in the database 260 (S504).

The feature extraction unit 220 extracts the feature of the image photographed by the camera 100 and stores it in the database 260 corresponding to the corresponding image (S506). The characteristics of the image may include edge, brightness, color distribution, and the like.

The feature extraction unit 220 determines whether the photographing conditions of the camera 100 have been changed from the pan, tilt, and zoom information of the camera 100 (S508). Here, the change of the photographing condition means the change of at least one of the pan, tilt, and zoom of the camera 100. The characteristic extracting unit 220 extracts features of the current image photographed by the camera 100 when at least one of the pan, tilt, and zoom of the camera 100 is changed, (S510).

The variation calculator 230 calculates the degree of change of the ROI from the pan, tilt, and zoom information of the camera 100 (S512).

The matching unit 240 predicts the position of the ROI changed from the degree of change of the ROI (S514), searches the database 260 for the feature of the previous image captured by the camera 100, (S516), and calculates the actual positional change of the ROI (S518). That is, the matching unit 240 calculates the positional change of the ROI including the coordinates of the ROI and the characteristics of the ROI, and predicts the position of the ROI of the ROI according to the movement of the camera 100 To find the location of the location. Also, the matching unit 240 may apply an iterative learning technique to find an optimum position.

The resetting unit 250 changes the coordinate information of the ROI set in the previous image based on the actual position change of the ROI (S520), and resets the ROI in the current image captured by the camera 100 with the changed coordinate information (S522).

The resetting unit 250 stores the changed coordinate information in the database 260 in correspondence with the position of the current region of interest in the current image (S524).

The database 260 stores the pan, tilt, and zoom information of the camera 100 corresponding to the image photographed by the camera 100 and also stores the coordinates of the region of interest Information, feature information, and the like are stored.

In this way, the at least one of the panning, tilting, and zooming of the camera 100 can be changed so as to adaptively set the region of interest adaptively to the changed image.

FIG. 6 and FIG. 7 are diagrams illustrating results of a method of setting a ROI according to an embodiment of the present invention.

6 and 7 are views showing images before and after rotation of the camera 100, respectively, when the camera 100 is rotated to the left.

When the camera 100 is rotated to the left when the camera 100 is set in the image taken by the camera 100 as shown in FIG. 6 before the camera 100 rotates to the left, the image photographed by the camera 100 However, the ROI setting unit 200 may reset the ROI to the current image adaptively to the change of the image captured by the camera 100 based on the above-described method, It can be seen that the image is correctly reset to the changed image according to the rotation of the camera 100. [

At least some functions of the apparatus and method for setting a region of interest according to an embodiment of the present invention described above may be implemented in hardware or software combined with hardware. Hereinafter, an embodiment in which the apparatus and method for setting a region of interest are combined with the apparatus will be described in detail with reference to FIG.

FIG. 8 is a schematic diagram of an apparatus for setting a region of interest according to another embodiment of the present invention. The apparatus includes an initial setting unit 210, a feature extraction unit 220, a variation calculation unit 230 ), The registration unit 240, the reconfiguration unit 250, and the database 260. In this example,

8, the region of interest device 800 includes a processor 810, a memory 820, at least a storage device 830 and an input / output (I / O) interface 840.

The processor 810 may be implemented as a central processing unit (CPU) or other chipset, microprocessor, etc., and the memory 820 may be a dynamic random access memory (DRAM), a Rambus DRAM DRAM, RDRAM), synchronous DRAM (synchronous DRAM, SDRAM), static RAM (SRAM), and the like. The storage device 830 may be a hard disk, a compact disk read only memory (CD-ROM), a compact disk rewritable (CD-RW), a digital video disk ROM, , An optical disk such as a blu-ray disk, a flash memory, various types of RAM, or a permanent or volatile storage device. The I / O interface 840 also allows the processor 810 and / or the memory 820 to access the storage device 830.

In this case, the processor 810 may perform at least one of the functions of the initial setting unit 210, the feature extraction unit 220, the change degree calculation unit 230, the matching unit 240, the reconfiguration unit 250, and the database 260 A program command for implementing some functions may be loaded into the memory 820 to control the operations described with reference to FIGS. 4 and 5 to be performed. Such a program command may be stored in the storage device 830 or may be stored in another system connected to the network.

Such a device is built in the camera 100 and resets the region of interest adaptively to the change of the image taken by the camera 100. [

The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded, Such an embodiment can be readily implemented by those skilled in the art from the description of the embodiments described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (7)

An apparatus for setting a region of interest in an image photographed by a camera,
An initial setting unit for setting a region of interest selected by a user to an image photographed by a camera and storing the region of interest as coordinate information,
A feature extracting unit for extracting a feature of an image photographed by the camera whenever at least one of the pan, tilt, and zoom of the camera is changed;
A matching unit for matching a feature of an image captured by the camera with a feature of a previous image and calculating a positional change of the ROI,
The method of claim 1 or 2, further comprising the steps of: adjusting a position of the region of interest by at least one of pan, tilt, and zoom of the camera;
And a region of interest. delete The method of claim 1,
A change degree calculator for calculating a change degree of the ROI from the current pan, tilt, and zoom information of the camera,
Further comprising:
Wherein the matching unit matches the feature of the ROI predicted from the degree of change of the ROI in the current image with the feature of the previous image. The method of claim 1,
Wherein the characteristics of the image include at least one of an outline, a brightness, and a color distribution. There is provided a method of setting a region of interest in an image photographed by the camera in accordance with a change in photographing conditions of the camera in a region-
Converting the region of interest selected by the user into coordinate information within the image taken by the camera,
Extracting feature points of an image photographed by the camera when at least one of the pan, tilt, and zoom of the camera is changed;
Calculating a positional change of the ROI by matching features of an image captured by the camera with a previous image, and
Changing coordinate information of the ROI in an image photographed by the camera based on a change in the position of the ROI
/ RTI > delete The method of claim 5,
The step of calculating a change in position of the ROI
Calculating a degree of change of the ROI from the current pan, tilt, and zoom information of the camera; and
And matching the feature of the region of interest predicted from the degree of change of the region of interest with the feature of the previous image in the image photographed by the camera.

Images