JP7336185B2 - Image processing device and image processing method - Google Patents

Description

The present invention relates to a moving image coding technique.

2. Description of the Related Art In recent years, with the popularization of video conference systems, video systems using cameras have been widely introduced. Surveillance cameras are often introduced into facilities not only for the purpose of crime prevention but also for the purpose of investigation and management. In particular, there are many applications for monitoring objects to be monitored using surveillance cameras, transmitting video data via the Internet or wireless communication, and storing video data in storage media. Recently, image quality and resolution of image data captured by surveillance cameras are increasing, and the amount of image data is increasing, so reduction of the amount of data is required.

As video coding technology, inter-frame prediction predicts the pixel values of the target frame from the frames before and after the target frame, intra-frame prediction predicts the pixel values of the target frame from within the target frame, entropy coding, quantization, etc. is used. By using these video encoding techniques, it becomes possible to effectively compress video data.

By the way, when a scene change occurs in a video, it is desirable to encode as an I frame (Intra-coded Frame) in order to avoid deterioration of image quality. An I frame is a frame in which a prediction signal is generated using decoded pixels around an encoding target block in the frame, and has a larger code amount than a P frame (Predicted Frame) or the like. Japanese Patent Application Laid-Open No. 2002-200003 proposes a technique for changing the range of use (performing a scene change) in a video conference system based on triggers such as voice or the appearance of a person and frame information notified in advance from the encoder unit side. ing. More specifically, efficient encoding processing is performed by performing a scene change at the timing of the I frame in response to reception of a trigger.

JP 2017-28375 A

However, unlike video conferences, in the use of surveillance cameras, an unspecified number of people speak or appear at irregular timings. Therefore, it is difficult to use a trigger such as voice or the appearance of a person as in Patent Document 1. Also, in a ceiling-suspended surveillance camera, a scene change is likely to occur due to a pan-tilt operation. This is because the image is vertically inverted (180° rotation of the image) at the timing when the photographing direction is vertically downward in order to output a natural image. As a result, the amount of motion vector information used in inter-frame prediction increases between frame images before and after inversion. As a result, the coding efficiency of the video as a whole decreases and the coded data size increases.

The present invention has been made in view of such problems, and an object of the present invention is to provide a technique that enables efficient encoding of moving images.

In order to solve the above problems, an image processing apparatus according to the present invention has the following configuration. That is, the image processing device
an imaging means for acquiring a moving image by imaging;
image processing means for performing trimming processing and enlarging processing on frame images constituting the moving image;
determining means for determining whether or not to rotate the frame images forming the moving image by a predetermined angle based on the position coordinates of the trimming area trimmed by the trimming process;
encoding means for encoding frame images forming the moving image using either a first mode using intra-frame prediction or a second mode using inter-frame prediction;
has
When the determining means determines that the frame images constituting the moving image are to be rotated by the predetermined angle, the encoding means encodes the frame images constituting the moving image using the first mode .

ADVANTAGE OF THE INVENTION According to this invention, the technique which enables efficient encoding of a moving image can be provided.

1 is a diagram showing a functional configuration of a surveillance camera including an image processing device according to a first embodiment; FIG. It is a figure which shows the hardware constitutions of a video processing part. It is a figure explaining pan-tilt operation|movement in a three-dimensional coordinate. FIG. 10 is a diagram for explaining an image acquired by a pan-tilt operation; FIG. 10 is a diagram exemplifying a search range when an image is rotated by 180°; It is a figure explaining change control of an encoding process. 4 is an operation flowchart of the image processing apparatus according to the first embodiment; 7 is a flowchart showing control of encoding processing during pan-tilt operation; FIG. 4 is a diagram for explaining a reference frame in each frame; FIG. It is a figure explaining the change of the encoding process in 2nd Embodiment. FIG. 10 is a diagram for explaining reference frames in each frame in the second embodiment; FIG. FIG. 4 is a diagram for explaining image processing based on DPTZ setting information; It is a figure explaining the position coordinate of a rectangular area.

An example of an embodiment of the present invention will be described in detail below with reference to the drawings. It should be noted that the following embodiments are merely examples and are not intended to limit the scope of the present invention.

(First embodiment)
As a first embodiment of an image processing apparatus according to the present invention, an image processing apparatus (image processing unit 200) that encodes an image obtained by a ceiling-suspended surveillance camera will be described below as an example.

<Device configuration>
FIG. 1 is a diagram showing the functional configuration of a surveillance camera including an image processing device according to the first embodiment. The monitoring camera includes a video processing unit 100 , which is an image processing device, a camera 300 , and an overall control unit 200 , and operates based on PTZ setting information received from a PTZ setting unit 201 . In the following description, it is assumed that the PTZ setting unit 201 is configured as a housing separate from the monitoring camera, but may be configured to be included in the same housing.

The PTZ setting unit 201 receives PTZ setting information (direction information) regarding pan/tilt/zoom (PTZ) in the surveillance camera from the user, and transmits the setting to the overall control unit 200 via the network, for example. In the following explanation, it is assumed that the pan/tilt angles (φpan, φtilt) based on the initial position of the surveillance camera are accepted, but it is configured to accept the angle (Δφ) relative to the current tilt angle of the surveillance camera. You may

In order to simplify the explanation, the following explanation focuses on the settings related to tilt. Note that the PTZ setting unit 201 itself may be configured to calculate instead of receiving settings from the user. For example, the configuration may be such that settings necessary for tracking an object photographed by a surveillance camera are calculated based on the photographed image.

Based on the setting of the shooting direction received from the PTZ setting unit 201, the overall control unit 200 controls a motor (not shown) and the like to control the shooting direction by panning and tilting. Here, pan refers to the movement of the camera lens orientation (shooting direction) in the horizontal direction (horizontal direction), and tilt refers to the movement of the camera lens in the vertical direction (up and down direction). are doing. In addition, as an option, information about zooming is transmitted to the camera 100 to control the zooming. Furthermore, the information about the shooting direction is also transmitted to the video processing unit 100 .

Camera 300 captures an image and transmits the captured image to image processing unit 100 . The camera 300 has a camera control section 301 , a lens 302 and an imaging section 303 . A camera control unit 301 controls a lens 302 and an imaging unit 303 and performs zooming and focus control based on information received from the general control unit 200 .

The video processing unit 100 performs image processing and compression encoding on the video obtained by the camera 300, and outputs an encoded stream. In particular, the video processing unit 100 is characterized in that it performs image processing and compression encoding based on PTZ setting information input from the overall control unit 200 .

The image rotation determination unit 101 generates trigger information for image rotation timing in the image processing unit 103 based on an instruction from the overall control unit 200 . Trigger information is information that indicates the timing at which an image (image output from the imaging unit 303) obtained by a ceiling-suspended surveillance camera is rotated by a tilt operation (the vertical relationship of the captured image is reversed). That is. In the following description, it is assumed that image rotation is determined inside the video processing unit 100, but it may be determined by an external device and the result of determination may be received. For example, the overall control unit 200 may determine the timing of image rotation by determining whether or not the tilt setting received from the PTZ setting unit 201 exceeds a preset threshold value.

The encoding processing control unit 102 performs intra-frame prediction (first mode) and inter-frame prediction (second mode) in the encoding unit 104 based on the trigger information of the image rotation timing output from the image rotation determination unit 101 . ) to perform the encoding.

The image processing unit 103 performs image processing on the video obtained by the camera 300 . Video is input from camera 300 in a series of frame images (eg, 30 frames per second). In the following description, it is assumed that the image processing unit 103 rotates the frame image by a predetermined angle (for example, 180°) based on the trigger information received from the image rotation determination unit 101. However, other image processing may be performed. It may be configured to be performed together. A frame image that has been rotated (or not rotated) by the image processing unit 103 is output to the encoding unit 104 .

The encoding unit 104 performs encoding processing on the frame image received from the image processing unit 103 based on the information received from the encoding processing control unit 102 (whether to use intra-frame prediction or inter-frame prediction). conduct.

FIG. 2 is a diagram showing the hardware configuration of the video processing unit 100. As shown in FIG. Video processing unit 100 includes CPU 151 , ROM 152 , RAM 153 , camera I/F 154 , control I/F 155 and network I/F 156 . The ROM 152 stores programs executed by the CPU 151 and various setting data. The CPU 151 reads the program stored in the ROM 152 into the RAM 153 and executes it, thereby realizing image processing and encoding processing for frame images input via the camera I/F 154 and communication processing via the network I/F 156. . Camera I/F 154 receives video (frame images) from camera 300 . Control I/F 155 receives control signals from overall control unit 200 . Network I/F 155 transmits the encoded stream via the network.

<Image captured by a ceiling-mounted surveillance camera>
FIG. 3 is a diagram for explaining a pan-tilt operation in three-dimensional coordinates. Here, in the XYZ orthogonal coordinate system, the pan/tilt operation is shown with the negative direction of the X axis as the initial position of the camera. The photographing direction of the ceiling-suspended surveillance camera faces downward from the horizontal direction (XZ plane). Therefore, here, the tilt angle (φtilt) and the pan angle (φpan) are defined with reference to the direction of the initial position of the camera.

FIG. 4 is a diagram for explaining an image obtained by pan-tilt operation. FIG. 4 corresponds to a state in which the XY plane is observed from the positive direction of the Z axis in FIG. The camera positions shown in (1) to (5) correspond to tilt angles (φtilt) of 30°, 60°, 90°, 120° and 150°, respectively. For simplicity of explanation, it is assumed here that all pan angles (φpan) are 0°.

When the camera position is continuously changed from (1) to (5), the frame image is reversed upside down at the position (3) for photographing vertically downward. FIG. 4 shows a situation in which a person moving in a straight passage extending from west (West Gate) to east (East Gate) is tracked by tilting a surveillance camera installed on the ceiling of the passage. In this case, frame images F1, F2, FA, FB, and FC are obtained in order as images output from the imaging unit 303 . That is, the image is turned upside down in the middle of the image, resulting in an unnatural image. Therefore, a method of rotating the frame images FA, FB, and FC by 180° is sometimes used in order to make the images natural (preventing vertical reversal). As a result of this technique, frame images F1, F2, F3, F4, and F5 are obtained in order.

Therefore, in the first embodiment, the image rotation determination unit 101 determines whether or not the tilt angle (φtilt) information input from the general control unit 200 exceeds a predetermined angle (φtrig). A process of determining whether or not to rotate the image by 180° is performed. For example, when φtrig=90°, the image rotation determination unit 101 determines to rotate the frame image by 180° when φtilt=90° (position (3) shown in FIG. 4). Trigger information is generated and output to the image processing unit 103 at the timing when the 180° rotation changes from “do not” to “do” (or vice versa). Note that the initial position of the camera as a reference and the tilt angle for outputting the trigger information are not limited to those described above, and can be arbitrarily set by the user.

In the first embodiment, the image rotation determination unit 101 determines whether the instruction is a pan operation, a tilt operation, or a combination thereof, based on the pan/tilt angle information set by the PTZ setting unit 201 and received via the general control unit 200. determine if there is Since the image rotation described above does not occur when there is only a panning motion, the image rotation determination unit 101 does not generate trigger information for image rotation when there is only a panning motion.

FIG. 5 is a diagram exemplifying a search range in inter-frame prediction when an image is rotated by 180°. When performing encoding processing using inter-frame prediction, the encoding processing unit 104 uses the previous frame image as a reference frame. However, when the image processing unit 103 rotates the image by 180° in the middle of the video as described with reference to FIG. It will rotate 180°. Therefore, when encoding the image frame 500b immediately after the 180° rotation, the image frame 500a immediately after the 180° rotation is used as a reference frame.

Therefore, when calculating the motion vector for encoding the rectangle B of the image frame 500b, the periphery of the rectangle A of the image frame 500a is set as the motion prediction search range. That is, rectangle C corresponding to rectangle B is out of the search range. As a result, when the image frame 500b is encoded using inter-frame prediction, the difference in motion prediction increases, and accordingly the generated code amount also increases.

Therefore, in the first embodiment, the encoding processing control unit 102 follows trigger information for performing 180° rotation processing of an image input from the image rotation determination unit 101, and performs encoding processing of a frame image corresponding to the trigger information. Control to force intra-frame prediction.

<Device operation>
FIG. 6 is a diagram for explaining change control of encoding processing. Frame images obtained when the camera position is continuously changed from (1) to (5) are exemplified. Conventionally, for example, encoding using intra-frame prediction is performed at a predetermined cycle, and encoding using inter-frame prediction is performed at all other times. In FIG. 6, I(0) is an I-frame (I-picture) encoded using intra-frame prediction. P(1) to P(n) are P frames (P pictures) encoded using interframe prediction. That is, conventionally, a frame image obtained by rotating the image from the imaging unit 303 by 180° is encoded as a P frame (P(6)) using inter-frame prediction using P(5) as a reference frame.

On the other hand, in the first embodiment, a frame image obtained by rotating the image from the imaging unit 303 by 180° is encoded as an I frame (I(1)) using intra-frame prediction. Then, subsequent frame images are encoded as P frames (P(7), . . . , P(n)) using the preceding frame images as reference frames.

FIG. 9 is a diagram for explaining reference frames in each frame. The table shows the relationship between the reference frame corresponding to each processing target frame at each camera position and the 180° rotation trigger. As shown in FIG. 9, the encoding processing unit 104 receives trigger information for 180° rotation at the timing of camera position (3). Therefore, the encoding processing unit 104 encodes the frame image being encoded at that timing as I(1) by intra-frame prediction instead of P(6) by inter-frame prediction.

FIG. 7 is an operation flowchart of the image processing apparatus according to the first embodiment. The processing is performed, for example, in conjunction with the start of surveillance by a surveillance camera.

In step S701, the PTZ setting unit 201 receives the initial setting of the surveillance camera from the user. The information set here includes the shooting time of the monitoring camera, the pan/tilt speed, threshold information regarding the horizontal swing angle of the camera, and the like. The PTZ setting unit 201 notifies the overall control unit 200 of the settings received from the user via, for example, a network.

In step S702, the overall control unit 200 starts photographing with the camera 300. FIG. Here, the position (1) is assumed as the initial position at the start of shooting, but the position at the start of shooting is not limited to this.

In step S703, the overall control unit 200 checks whether or not the settings received from the PTZ setting unit 201 include setting information for PTZ control. If there is no PTZ control setting information (No in S703), the process proceeds to S705. If there is PTZ control setting information (Yes in S703), the process proceeds to S704.

In step S704, the overall control unit 200 performs shooting while performing pan/tilt control of the camera 300 based on the setting information of the PTZ control. Also, the video processing unit 100 receives a moving image (frame image) generated by the camera 300 and performs encoding processing.

In step S705, the overall control unit 200 determines whether or not there is shooting end setting information. If there is no shooting end setting information (No in S705), the process advances to S704, and if there is shooting end setting information (Yes in S705), shooting with the camera 300 ends and processing ends.

FIG. 8 is a flow chart showing control of the encoding process during the pan/tilt operation (S704). Specifically, it is a procedure for determining a prediction mode for encoding processing, which is executed by the image rotation determination unit 101 and the encoding processing control unit 102 . This processing is performed on each frame image input from camera 300 .

In step S<b>801 , the image rotation determination unit 101 determines whether or not panning is performed based on the angle information of the camera motion. If it is determined to be panning (No in S801), the process proceeds to S805, and if it is determined not to be panning (Yes in S801), the process proceeds to S802.

In step S802, the image rotation determination unit 101 determines whether or not it is a tilt operation from the angle information of the camera operation. If it is determined not to be a tilt operation (No in S802), the process proceeds to S805, and if it is determined to be a tilt operation (Yes in S802), the process proceeds to S803.

In step S803, the image rotation determination unit 101 determines the camera position from the camera operation angle information, and determines whether or not the image processing unit 103 rotates the frame image by 180°. If it is determined not to rotate the frame image by 180° (No in S803), the process proceeds to S805, and if it is determined to rotate the frame image by 180° (Yes in S803), the process proceeds to S804.

In step S<b>804 , the image rotation determination unit 101 transmits to the image processing unit 103 a trigger signal for rotating the frame image by 180°. In addition, it transmits to the encoding process control unit 102 an instruction to perform the encoding process by intra-frame prediction on the currently focused frame image to be encoded. Accordingly, the image processing unit 103 rotates the frame image by 180°, and the encoding unit 104 encodes the frame image by intra-frame prediction. The process ends when the encoding is completed.

In step S805, the image processing unit 103 performs the same processing as the preceding frame image on the current frame image to be encoded. That is, if the preceding frame image has not been rotated, it is not rotated, and if it has been rotated, it is rotated. In addition, the encoding unit 104 performs encoding processing on the currently focused frame image to be encoded by preset intra-frame prediction or inter-frame prediction. The process ends when the encoding is completed.

As described above, according to the first embodiment, the encoding process in the encoding unit 104 is controlled based on the video input from the camera 300 . Specifically, the image processing unit 103 performs image rotation on a frame image at the timing at which rotation occurs in the video input from the camera 300, and the encoding unit 104 performs encoding processing using intra-frame prediction. Control. In the above description, the case of 180° rotation has been described, but rotation of other angles may also be used. For example, when tracking a person with a camera installed on the ceiling at the corner of an L-shaped passage, the rotation is 90°, but the same can be applied.

As a result, even when image rotation (scene change) occurs due to the tilt operation of the ceiling-mounted camera, it is possible to generate an encoded stream with higher image quality while suppressing data increase. Therefore, it is possible to save the capacity of the recording medium and reduce the communication load in the case of transmission over the network.

(Modification)
In the first embodiment, the image rotation determination unit 101 determines whether or not to perform image rotation processing in the image processing unit 103 from the camera position information. On the other hand, in the case of rotating the sensor itself of the camera to rotate the image, the overall control unit 200 may be configured to notify the image rotation determination unit 101 of the rotation processing timing of the sensor. At this time, the image rotation determination unit 101 notifies the encoding processing control unit 102 of trigger information that notifies that the image is rotated, thereby making it possible to perform the same processing as described above.

Also, in the above description, a form of setting angle information (φtrig) for generating an image rotation trigger has been described. On the other hand, it is also possible to preset the encoding processing parameters according to the angle information (φtilt). The encoding processing parameter here means information on intra-frame prediction or inter-frame prediction, a quantization value for performing quantization processing, and the like.

In the above description, the image rotation determination unit 101 determines whether or not to perform image rotation processing based on the angle information indicating the amount of tilt movement of the camera input from the overall control unit 200, and controls the encoding processing. did On the other hand, the image rotation determination unit 101 may be configured to notify trigger information at the timing when encoding processing is performed in intra-frame prediction. Based on the received trigger information and camera angle information (φtilt), the overall control unit 200 generates trigger information for image rotation. It is also possible to implement

The angle information (φtrig) can be set not only as a specific angle but also as a predetermined angle range. For example, trigger information may be generated when camera angle information (φtilt) satisfies the following conditions. α is an angular width that can be arbitrarily set by the user.
φtrig-α ≤ φtilt ≤ φtrig + α

(Second embodiment)
In the second embodiment, coding control will be described in the case where a ceiling-suspended camera performs periodic tilting operations to capture images. In particular, when the camera is installed, camera position information for image rotation according to the periodic operation and time information for tilting to the camera position for image rotation are set. Then, a mode of periodically selecting either intra-frame prediction or inter-frame prediction encoding processing based on the set initial information will be described. Note that the functional configuration and hardware configuration of the image processing apparatus are substantially the same as those of the first embodiment. Therefore, the following description will focus on the different parts.

<Device operation>
The PTZ setting unit 201 receives from the user the setting of initial information according to the periodic operation of the camera. The overall control unit 200 receives the initial information from the PTZ setting unit 201 and sets the image rotation determination unit 101 to settings according to the initial information. After that, the image rotation determination unit 101 calculates the image rotation position based on the initial information, and notifies the encoding processing control unit 102 of trigger information when determining that the camera position has reached the image rotation position.

FIG. 10 is a diagram for explaining changes in encoding processing in the second embodiment. Here, the camera position changes periodically by going back and forth between (1) to (5) shown in FIG. 10 by the tilting operation. The lower part of FIG. 10 shows whether a frame image is coded by intra-frame prediction or inter-frame prediction at each camera position in such reciprocating motion.

As shown in FIG. 10, while the camera is periodically tilted, each time the camera position comes to position (3), the presence or absence of image rotation for the frame image is changed. Encoding processing is performed by inner prediction.

FIG. 11 is a diagram for explaining reference frames in each frame in the second embodiment. As shown in FIG. 11, as the initial setting information, the camera position is set according to the installation location of the camera (third column of the table). In addition, setting information indicating whether intra-frame prediction or inter-frame prediction is used for the frame image for each camera position (first column of the table), and the camera position for rotating the frame image by 180° (fourth column of the table). set. In the following description, T is the period from when the frame image is rotated by 180° to when the frame image is rotated by 180°.

Based on the table information shown in FIG. 10 set by the overall control unit 200, the image rotation determination unit 101 determines whether or not to rotate the frame image. As described above, the table information includes given control details that define the shooting direction at each time (each timing). The image rotation determination unit 101 starts counting the operating time at the same time as the shooting is started. Assuming that the operation time is Tcount, and the shooting with the camera is started from the initial position and orientation ((1) in FIG. 10), the camera position shown in (3) in FIG. 10 is obtained when Tcount=T/2. At this time, the image rotation determination unit 101 determines that the camera position requires image rotation, and notifies the encoding processing unit 102 of trigger information for rotating the image by 180°. This enables the encoding processing control unit 102 to select the intra-frame prediction mode and perform encoding processing at the camera position where the image is rotated 180°. At this time, when the image rotation determining unit 101 determines that the camera position is (3), it sets Tcount to an initial value of 0, and restarts the process.

In the above description, the rotation timing of the image is detected based on the time from the start of the tilt operation (fifth column of the table). On the other hand, the image rotation timing may be detected based on the setting information (the first column of the table) indicating whether intra-frame prediction or inter-frame prediction is used for the frame image for each camera position.

In the above description, the table information corresponding to the periodic operation of the camera is created and set when the camera is installed, but the table information may be updated while the camera is operating. As a result, it is possible to cope with a case where the operation mode changes in the middle.

As described above, according to the second embodiment, when a ceiling-suspended surveillance camera performs periodic operations, table information that matches the operation period of the camera is used. By using the table information, it is possible to obtain the same effect as in the first embodiment.

(Third embodiment)
In the third embodiment, processing when using a surveillance camera having a digital pan/tilt/zoom (DPTZ) function will be described. Here, the DPTZ function is a function of generating a panned/tilted/zoomed image by performing a series of image processing such as trimming processing and rotation processing on the image obtained by the monitoring camera. For example, by using an ultra-wide-angle imaging optical system, it is possible to obtain images captured in a wide range of directions without using a movable part configured by a motor, gears, or the like.

The functional configuration of the image processing apparatus is substantially the same as that of the first embodiment (FIG. 1). Zoom. Specifically, the overall control unit 200 provides DPTZ setting information to the video processing unit 100 . The DPTZ setting information is information for instructing the image processing unit 103 about the image area to be output. The video processing unit 100 outputs an encoded stream based on camera information input from the camera 300 and DPTZ setting information input from the overall control unit 200 .

More specifically, the image processing unit 103 performs trimming processing and rotation processing on the frame image input from the camera 300 based on the DPTZ setting information. The image rotation determination unit 101 determines whether or not to rotate the image based on the DPTZ setting information. The encoding processing control unit 102 controls the encoding processing by the encoding unit 104 of the frame generated by the image processing unit 103 using the DPTZ function. Here, encoding processing is adaptively selected by intra-frame prediction or inter-frame prediction.

<Generation of frame image by DPTZ>
FIG. 12 is a diagram illustrating image processing based on DPTZ setting information. An image 1200a indicates a frame image output from the imaging unit 303, and an image 1200b indicates a frame image generated by the image processing unit 103 based on DPTZ setting information.

Specifically, the image 1200b is the result of performing trimming processing, enlargement processing, and 180° rotation processing on one of the three person images included in the image 1200a. A region 1201 indicates a rectangular region (trimming region) set based on the DPTZ setting information in the image 1200a.

FIG. 13 is a diagram for explaining position coordinates of a rectangular area. Here, in the image 1200a, the left end of the image is set to coordinate 0 on the X-axis, and the vertical (vertical) direction center of the image is set to coordinate 0 on the Y-axis. A region 1301 corresponds to the region 1201 and is defined by four vertices AD. Here, the four vertices are defined as A(x1, y1), B(x2, y1), C(x1, y2), D(x2, y2).

The image rotation determination unit 101 acquires position coordinate information of the area 1301 based on the DPTZ setting information transmitted from the overall control unit 200 . Based on the acquired positional coordinate information, the image rotation determination unit 101 determines whether or not to rotate the image that has undergone image processing.

For example, whether or not to perform image rotation on the image of area 1301 is determined using the following determination formula (1).

|y1|-|y2| < 0 (1)
That is, in the formula (1), it is determined whether the region 1301 includes more positive or negative regions in the Y-axis direction. The image rotation determination unit 101 determines to rotate the target rectangle by 180° when formula (1) is satisfied (more negative regions are included in the Y-axis direction), and sends trigger information to the encoding processing control unit 102. Notice. On the other hand, if the formula (1) is not satisfied (more positive regions are included in the Y-axis direction), the image rotation determination unit 101 determines that rotation processing is unnecessary and does not notify the trigger information.

Note that the determination using expression (1) is an example, and the image rotation determination method is not limited to this.

As described above, according to the third embodiment, it is possible to determine the occurrence of image rotation even in a monitoring camera having a DPTZ function. Therefore, by selecting encoding processing based on intra-frame prediction at the timing when image rotation occurs, it is possible to obtain the same effect as in the first embodiment.

(Other examples)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

100 video processing unit; 101 image rotation determination unit; 102 encoding processing control unit; 103 image processing unit; 104 encoding unit; Imaging unit

Claims (6)

an imaging means for acquiring a moving image by imaging;
image processing means for performing trimming processing and enlarging processing on frame images constituting the moving image;
determining means for determining whether or not to rotate the frame images forming the moving image by a predetermined angle based on the position coordinates of the trimming area trimmed by the trimming process;
encoding means for encoding frame images forming the moving image using either a first mode using intra-frame prediction or a second mode using inter-frame prediction;
has
When the determining means determines that the frame images constituting the moving image are to be rotated by the predetermined angle, the encoding means encodes the frame images constituting the moving image using the first mode .
An image processing apparatus characterized by : the predetermined angle is 180°
2. The image processing apparatus according to claim 1 , wherein: The imaging means is a ceiling hanging camera installed on the ceiling of the aisle.
3. The image processing apparatus according to claim 1, wherein: the passage is a straight passage
4. The image processing apparatus according to claim 3 , characterized by: An image processing method executed by an image processing device,
an acquisition step of acquiring a moving image by imaging;
an image processing step of performing trimming processing and enlarging processing on frame images that constitute the moving image;
a determination step of determining whether or not to rotate the frame images constituting the moving image by a predetermined angle based on the position coordinates of the trimming area trimmed by the trimming process;
an encoding step of encoding frame images forming the moving image using either a first mode using intra-frame prediction or a second mode using inter-frame prediction;
including
When it is determined in the determining step that the frame images forming the moving image are to be rotated by the predetermined angle, the encoding step encodes the frame images forming the moving image using the first mode.
An image processing method characterized by: A program for causing a computer to function as each means of the image processing apparatus according to claim 1.

Images