JP2013110754A - Camera device, and photographing method and program of the same - Google Patents

Abstract

An object of the present invention is to reliably obtain a high-quality photographed image in which a main subject is not shaken in panning photography.
In addition to a CCD 13 that captures a subject image for recording, a CCD 23 that captures the same subject is provided, and the CCD 23 performs a plurality of imaging operations within the exposure time of the CCD 13 during photographing. The motion detection unit 38 is caused to detect a motion vector indicating the amount and direction of movement of each part of the subject between images captured one after the other by a plurality of imaging operations. The CPU 31 is caused to specify a motion vector indicating a movement amount and a moving direction of the main subject among the detected motion vectors, and perform a camera shake correction process by a CCD shift method for controlling the position of the CCD 13 based on the specified motion vector. Even within the exposure time at the time of shooting, correct camera shake correction based on accurate shake information reflecting the relative movement of the main subject can be performed.
[Selection] Figure 2

Description

  The present invention relates to a camera device suitable for use in panning shooting, and a shooting method and program thereof.

  2. Description of the Related Art Conventionally, as one of the shooting techniques in still image shooting, there is known a panning shot in which a photographer shoots while shaking a camera in a moving direction of a main subject that is a moving subject. According to this panning shot, the image of the main subject is stationary and only the background is blurred in the shot image, so that it is possible to express the dynamic feeling and speed of the main subject on the shot image.

  However, panning is a shooting technique that is easy for beginners to fail because the photographer has to manually move the camera so that the main subject and the camera are relatively stationary.

  As a technique that can solve this problem, for example, in Patent Document 1 below, the moving speed of a main subject obtained by “trial shooting” prior to actual shooting is calculated in the captured image. On the basis of the movement direction of the subject input in advance, and a technique for shooting by panning shot while moving the correction lens so as to cancel the shake (shake) of the image of the main subject in the shot image ing.

  According to such a conventional technique, since the panning for the main subject can be automated, even a beginner can perform panning.

JP 2006-50149 A

  However, in the above prior art, the moving speed of the correction lens at the time of actual shooting includes the moving speed in the captured image of the main subject obtained at the time of “trial shooting” (relative speed between the camera speed and the subject speed), In other words, since the moving speed before photographing is reflected, the moving speed of the correction lens does not necessarily match the moving speed of the main subject in the photographed image during the main photographing (within the exposure period).

  Therefore, in the above prior art, if the moving speed of the main subject in the image at the time of trial shooting is different from the moving speed of the main subject in the image at the time of main shooting, the correction lens at the time of main shooting is different. Since the accurate moving speed of the main subject in the image is not reflected on the moving speed of the image, the correction lens cannot be moved appropriately so as to cancel out the blur of the image of the main subject.

  As a result, the above-described conventional technique has a problem in that the image of the main subject is blurred in the captured image obtained by the actual shooting, and the panning may fail.

  The present invention has been made in view of such conventional problems, and provides a camera device capable of reliably obtaining a high-quality shot image without blurring of a main subject in panning shot shooting, and a shooting method and program thereof The purpose is to do.

  In order to solve the above problem, in the camera device according to the first aspect of the present invention, in the camera device for recording an image including a plurality of subjects imaged by the first image sensor, the first image sensor is the first image sensor. A second image sensor that captures an image of a subject to be imaged, and a plurality of times within the exposure time of the first image sensor at the time of shooting for generating a subject image for recording. A first imaging control means for performing the imaging operation, a specifying means for specifying a main subject from a plurality of subjects included in the image, and the first imaging element within an exposure time of the first imaging device at the time of shooting. Shake information detecting means for detecting shake information including a movement amount and a movement direction of the main subject specified by the specifying means between images taken by a plurality of image pickup operations of the two image pickup devices; In time, the imaging position of the optical image with respect to the first image sensor is corrected based on the shake information detected by the shake information detecting means, and the main subject is shaken on the exposure surface of the first image sensor. And a vibration preventing means for preventing.

  In the camera device according to the second aspect of the present invention, the image captured by the multiple imaging operations of the second image sensor within the exposure time of the first image sensor at the time of shooting is followed. The apparatus further comprises individual movement amount detection means for individually detecting movement amounts of the plurality of subjects between the images, wherein the specifying means detects the movement amounts of the plurality of subjects detected by the individual movement amount detection means. The main subject is specified based on the above.

  In the camera device according to claim 3, the specifying unit is an area corresponding to a subject portion having the smallest movement amount detected by the individual movement amount detection unit among the plurality of subjects. Is identified as the main subject.

  In the camera device according to a fourth aspect of the present invention, the shake preventing means corrects the position of the first image sensor on a plane perpendicular to the photographing optical axis based on the shake information. To prevent the main subject from shaking on the exposure surface of the first image sensor.

  In the photographing method according to the fifth aspect of the present invention, in the camera device for recording an image including a plurality of subjects imaged by the first image sensor, at the time of photographing for generating a subject image for recording. A step of causing the second image sensor that captures a subject to be imaged by the first image sensor to perform an imaging operation a plurality of times within an exposure time of the first image sensor in A step of identifying a main subject from a plurality of subjects, and between images captured by a plurality of imaging operations of the second imaging device within an exposure time of the first imaging device at the time of photographing, The step of detecting shake information including the movement amount and direction of movement of the main subject specified by the step of specifying the main subject, and the shake detected by the step of detecting the shake information within the exposure time The imaging position of the optical image for the first image sensor is corrected on the basis of the distribution, characterized in that it comprises a step of preventing the shaking of the main subject in the exposure surface of the first imaging device.

In the invention of claim 6, a computer included in a camera device that records an image including a plurality of subjects imaged by the first image sensor,
Imaging a plurality of times with a second imaging element that captures an object to be imaged by the first imaging element within the exposure time of the first imaging element at the time of shooting for generating a subject image for recording. Processing to perform the action;
A process of identifying a main subject from a plurality of subjects included in the image;
A process for detecting shaking information including a movement amount and a movement direction of the main subject between images captured by the plurality of imaging operations of the second imaging element within the exposure time;
The imaging position of the optical image with respect to the first image sensor is corrected based on the shake information detected by the process of detecting the shake information within the exposure time of the first image sensor at the time of shooting, and the first And a process for preventing the main subject from shaking on the exposure surface of the image sensor.

  According to the present invention, it is possible to reliably obtain a high-quality photographed image in which a main subject is not shaken in panning shot photography.

1 is a front view of a digital camera according to the present invention. It is a block diagram which shows the outline of the electronic circuit structure of the digital camera. It is the conceptual diagram which showed the buffer area ensured in a work memory during the operation | movement of the main camera block and a subcamera block. It is a flowchart which shows the process sequence of CPU by a panning mode. It is a timing chart which shows the operation content of the digital camera in a panning mode. It is explanatory drawing which shows the predetermined | prescribed movement amount according to the degree of the flow of the background which a user can set, and the degree of flow.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a front view of a digital camera which is a camera apparatus of the present invention.

  As shown in the drawing, a retractable first imaging lens 2 and a fixed second imaging lens 3 are arranged on the front of the camera body 1, and a shutter key 4 is provided on the upper surface of the camera body 1. It has been. The shutter key 4 has a so-called half shutter function capable of two-stage operation of a half-press operation and a full-press operation, and the half-press operation is used as an AF (autofocus) operation start instruction or the like. Are used as shooting instructions. Although not shown, on the back side of the camera body 1, there are a power key, a plurality of switches such as a mode switching key for switching between the recording mode and the reproduction mode, a zoom key, and a MENU key, and a shooting standby state. A liquid crystal monitor (see FIG. 2) for displaying a live view image (through image) of a subject or reproducing and displaying a recorded image is provided.

  FIG. 2 is a block diagram showing an outline of the electrical configuration of the digital camera. The digital camera shoots the same subject individually and captures two types of subject images having substantially the same contents. A sub camera block 21 is provided.

  The main camera block 11 includes an imaging optical system block 12 including the above-described retractable first imaging lens 2, a CCD 13 (imaging device), a position correction unit 14, an ISP (Image Signa1 Processor) 15, and an optical system drive control. Part 16.

  The imaging optical system block 12 includes a lens group that constitutes the zoom lens and the focus lens as the first imaging lens 2, a diaphragm and a mechanical shutter, a zoom motor and a focus motor for driving them, It consists of an actuator. The operation of each unit of the imaging optical system block 12 is controlled by a drive signal generated by the optical system drive control unit 16 in accordance with a command from the CPU 31.

  The CCD 13 is driven by the drive signal generated by the timing generator 32, photoelectrically converts the optical image of the subject imaged by the imaging optical system block 12, and outputs it to the ISP 15 as an imaging signal. The CCD 13 is used to acquire a subject image (recorded image) for recording. In order to prevent camera shake during shooting, the position correction unit 14 performs a vertical direction in a plane perpendicular to the shooting optical axis. And the horizontal position adjustment is possible.

  The position correction unit 14 includes a vertical actuator that moves the CCD 13 in the vertical direction and a horizontal actuator that moves the CCD 13 in the horizontal direction. Driven by a drive signal generated by the CCD position controller 33 in accordance with the movement amount information, the CCD 13 is moved in the vertical direction and the horizontal direction so as to cancel the relative movement of the main subject on the exposure surface. That is, in the present embodiment, the position correction unit 14, the CCD position control unit 33, and the CPU 31 implement the shake preventing means of the present invention.

  The ISP 15 performs noise removal of the image pickup signal output from the CCD 13 and gain adjustment according to the ISO sensitivity, converts it to a digital image signal, and then converts the data format (from the Bayer array to the luminance signal Y and the color difference signals Cb, Cr). And the like, and output as Y, Cb, Cr image data.

  On the other hand, the sub-camera block 21 includes an imaging optical system block 22 including the fixed second imaging lens 3 described above, a CCD 23, and an ISP (Image Signa1 Processor) 25. The imaging optical system block 22 includes a single focus lens and a stop with a fixed opening.

  The CCD 23 is a second image pickup device of the present invention used as a sensor for detecting the movement of a moving body within the angle of view when shooting in a panning mode to be described later. Compared with the CCD 13 of the main camera block 11. The resolution is low (the number of effective pixels is small), and it is driven at a frame rate higher than that of the CCD 13 by a drive signal different from that of the CCD 13 generated individually by the timing generator 32. Can be imported. The ISP 25 performs the same signal processing as the ISP 15 of the main camera block 11 and converts the image pickup signal output from the CCD 23 into Y, Cb, and Cr image data.

  The image data (Y, Cr, and Cb data) output from the main camera block 11 and the sub camera block 21 are individually transferred to the work memory 34. In the following description, the image data output from the main camera block 11 is referred to as main image data, and the image data output from the sub camera block 21 is referred to as sub image data.

  The work memory 34 is a DRAM or the like. During the operation of the main camera block 11 and the sub camera block 21, the work memory 34 includes a main image buffer area 341 and a first image buffer area 341 as shown in FIG. A sub image buffer area 342a and a second sub image buffer area 342b are secured, main image data is stored in the main image buffer area 341, and the first sub image buffer area 342a and the second sub image buffer area 342b In addition, sub-image data for the latest two frames before and after are individually stored.

  Then, the main image data transferred to the work memory 34 in the photographing standby state is sent to the display processing unit 35. The display processing unit 35 includes a VRAM, performs resolution conversion processing on the main image data, generates display data, outputs the display data to the liquid crystal monitor 36, and causes the liquid crystal monitor 36 to display an image. That is, an image captured from the main camera block 11 at a predetermined frame rate in the shooting standby state is displayed on the liquid crystal monitor 36 as a live view image.

  The main image data at the time of shooting transferred to the work memory 34 in response to the full press of the shutter key 4 is compressed into image data of a predetermined file format such as JPEG by the CPU 31 and then stored in the image memory 37. Is done. Note that image data (recorded image data) stored in the image memory 37 is read and decompressed as necessary by the CPU 31, expanded in the work memory 34, and then displayed on the liquid crystal monitor via the display processing unit 35. Playback and display are performed at 36.

  On the other hand, the sub-image data for two successive frames transferred to the work memory 34 is read by the motion detection unit 38. The motion detection unit 38 is an individual movement amount detection means of the present invention, and indicates the movement amount and movement direction of the moving body in the image (within the angle of view) by comparing the read set of sub-image data. A motion vector is acquired by a known block matching method. Then, movement amount information of a main subject, which will be described later, determined by the CPU 31 based on the motion vector acquired by the motion detection unit 38 is sent to the CCD position control unit 33 described above.

  The key input unit 39 includes various operation keys such as the shutter key 4 described above and outputs a key operation signal indicating the operation state of each key to the CPU 31.

  The CPU 31 controls the operation of each unit described above by operating according to various programs stored in the flash memory 40 and in response to a key operation signal sent from the key input unit 39, and also performs AF processing and AE processing. Various processes including an image compression / decompression process are executed.

  When the CPU 31 is a subordinate mode of the recording mode and the panning mode prepared in advance for use in the panning shooting is set in the digital camera, the CPU 31 executes the process described later to execute the present invention. Imaging control means, shaking information detection means, shaking prevention means, second imaging control means, movement amount detection means, calculation means, imaging condition setting means, movement amount setting means, individual movement amount detection means, identification means, determination means Function as.

  In addition to the above programs, the flash memory 40 stores various data used by the CPU 31, and can be changed by the user as needed or automatically changed by the CPU 31. Setting data is also stored.

  Next, an operation according to the present invention of the digital camera having the above configuration will be described. FIG. 4 is a flowchart showing the processing procedure of the CPU 31 when the panning mode is set by the user, and FIG. 5 is a timing chart showing the operation contents of the digital camera at that time. In the following description, for convenience, the above-described main camera block 11 is referred to as a main camera, and the sub camera block 21 is referred to as a sub camera.

  When the panning mode is set, the CPU 31 immediately starts the imaging operation by the main camera and the sub camera (step S1). That is, each CCD 13 and 23 is periodically driven at a predetermined frame rate, two types of subject images having substantially the same contents are periodically taken, and each image data (main image data and sub-image data) is stored in the work memory 34. Shooting (imaging processing) to be recorded is started. Here, the frame rate on the main camera side is a frame rate (for example, 30 fps) corresponding to the update period of the live view image on the liquid crystal monitor 36. Further, the frame rate on the secondary camera side is much higher than that on the primary camera side.

  Thereafter, the main image data stored in the main image buffer area 341 is sequentially updated at the frame rate, and at the same time, the sub-frames for two frames corresponding to each other stored in the first and second sub image buffer areas 342a and 342b. Of the image data, the previously stored sub-image data is sequentially updated to the latest at the frame rate.

  Then, the CPU 31 displays the captured image (main image data) captured by the main camera on the liquid crystal monitor 36 as a live view image (step S2). While the live view image is being displayed, whether or not a predetermined key operation for instructing the background movement amount setting by the user has been performed and whether or not the shutter key 4 has been half-pressed are sequentially performed. After confirming (steps S3 and S5), when a background movement amount setting instruction is detected (YES in step S3), a prescribed background movement amount (specific movement amount) is set for the user (step S4).

  The prescribed movement amount is a movement amount according to the degree of the flow of the background (portion other than the moving main subject) that should be secured in order to express a feeling of dynamism or speed in a captured image obtained by panning. That is, the specified movement amount is a movement amount in which an arbitrary point of the subject portion as a background moves (flows) in the photographed image in terms of the number of pixels. In this embodiment, as shown in FIG. As the degree of flow, three levels of “large”, “medium”, and “small” can be selected, and the prescribed movement amount is predetermined according to each degree.

  In step S4, a predetermined selection screen is displayed on the liquid crystal monitor 36, the user is allowed to select a desired flow degree on the selection screen by a key operation, and the prescribed movement amount corresponding to the selected degree is flashed. It is stored in the memory 40 together with other setting data. Note that the number of pixels corresponding to a predetermined level (for example, a “medium” level) is set in advance as the initial value of the prescribed movement amount.

  On the other hand, when the shutter key 4 is pressed halfway while displaying the live view image (YES in step S5), the CPU 31 specifies a main subject existing within the angle of view (step S6). In such processing, the motion detection unit 38 is subjected to the latest two frames of the next and subsequent frames stored in the first and second sub-image buffer areas 342a and 342b of the work memory 34 at that time. Then, a motion vector indicating the moving amount and moving direction of each part of the subject in the entire area in the image is acquired by the block matching method.

  A specific method for acquiring a motion vector in the motion detector 38 is as follows. That is, the entire area in the image is divided into a plurality of blocks in one of the sub-image data acquired earlier, and one of the blocks has the same size as the above-described block in the other sub-image data acquired later. The similarity between the comparison area and the processing target block is obtained. The similarity is obtained from the summation of absolute differences (SAD) of the pixels corresponding to the blocks, and it is determined that the similarity is higher as the SAD is smaller. Then, this process is performed on the entire area while shifting the comparison area in the other sub-image data, and the area having the highest similarity is set as the movement destination area. Such processing is repeated for all blocks of one sub-image data as processing targets, and motion vectors are calculated for all blocks.

  Then, the CPU 31 specifies a subject area corresponding to a block (a plurality of blocks) having the smallest movement amount indicated by the motion vector acquired by the motion detection unit 38 as described above as a main subject. Note that a specific method of specifying the main subject in step S6 is arbitrary, and a method different from the block matching method described above may be used.

  Subsequently, the CPU 31 performs an AF process for focusing on the main subject identified as described above (step S7). Such AF processing is based on a well-known contrast detection method, and during the movement of the focus lens of the first imaging lens 2 described above, the main subject described above in the main image data (output from the main camera) during that time. The focus position is searched by detecting a change in contrast for the subject region specified as (or a region having a predetermined area including the subject region), and the main subject is focused.

  Next, the CPU 31 specifies a subject portion excluding the main subject specified in step S6 as a background subject (step S8), and further specifies movement amount information of the specified background subject (step S9). Here, among the motion vectors of the subject portion (the block described above) corresponding to the background subject acquired by the motion detection unit 38 in step S6, the same motion vector (movement amount, movement direction is the largest). A matching motion vector) is determined as a representative motion vector, and the movement amount of the motion vector is specified as the movement amount information of the background subject.

Next, the CPU 31 reads from the flash memory 40 the prescribed background movement amount set in step S4 described above or the background prescribed movement amount set as an initial value (step S10), and based on the read prescribed movement amount. An exposure time (shutter speed) at the time of shooting is calculated (step S11). The exposure time calculated here is the time required for the background subject to move within the angle of view by the specified movement amount (determined number of pixels), specifically, the specified movement amount and step S9. Is calculated from the following equation based on the movement amount (movement amount information) of the background subject acquired in step 1 and the frame rate on the sub camera side.
Exposure time = specified movement amount / background object movement amount x frame rate

  Then, other shooting conditions for obtaining an appropriate exposure based on the exposure time calculated here, that is, ISO sensitivity and aperture value are determined and set as shooting conditions at the time of shooting (step S12). Thereafter, until the shutter key 4 is fully pressed (NO in step S13), while the shutter key 4 is being half-pressed, the above-described steps S6 to S12 are repeated, and the shutter key 4 is half-pressed. When the push is released, the processes after step S2 described above are repeated. If the shutter key 4 is fully pressed during that time (YES in step S13), the exposure of the CCD 13 on the main camera side is immediately started to generate a recording image (step S14). That is, the main shooting is started.

  After that, as in step S6, the CPU 31 targets the motion image indicating the moving amount and moving direction of each part of the subject in the entire area of the image for the latest two frames of sub-image data sequentially updated by the motion detecting unit 38. Based on the acquired motion vector, the main subject is specified, and its shake information is acquired (step S15). That is, a motion vector having the smallest movement amount among the acquired motion vectors is acquired as shake information of the main subject.

  Subsequently, the CPU 31 sends the specified shake information to the CCD position control unit 33, causes the CCD position control unit 33 to generate a drive signal corresponding to the shake information, and the position correction unit 14 indicates the CCD 13 on the main camera side by the shake information. The movement amount is shifted (shifted) in the direction opposite to the movement direction by the movement amount indicated by the shake information (step S16). That is, camera shake correction processing is performed by a so-called CCD shift method that cancels the relative movement of the CCD 13 with respect to the main subject.

  Thereafter, until the exposure time set in step S12 elapses (NO in step S17), the CPU 31 repeats the camera shake correction process in steps S15 and S16 at the frame rate on the sub camera side. When the above exposure time has elapsed (YES in step S17), the CPU 31 performs predetermined image processing relating to image quality such as color adjustment and contrast adjustment on the main image data stored in the main image buffer area 341, and after the processing. After the image data is compressed (step S18), the compressed image data is recorded as an image file in the image memory 37 (step S19), and the processing in the panning mode is terminated.

  As described above, in the present embodiment, in the main shooting when the panning mode is set, the image capturing operation of the subject by the sub camera is continuously performed even during the exposure period, and the sub image data acquired by the sub camera. Based on the above, the shake information of the main subject is detected, and the camera shake correction by the CCD shift method is performed using the detection result.

  Therefore, even if the relative moving direction and amount of movement of the main subject with respect to the camera body 1 change or change from the time immediately before the main photographing within the exposure time during the main photographing, the exposure is performed. Correct camera shake correction based on accurate shake information reflecting the relative movement of the main subject can be performed within the time. Therefore, the main subject (moving subject) is not blurred in the captured image, and a high-quality captured image in which the main subject is not shaken in the panning shot can be reliably obtained.

  In addition, in the present embodiment, the subject portion having the smallest movement amount within the angle of view is automatically identified as the main subject before the shutter key 4 is fully pressed, and within the exposure time. The camera shake correction is performed based on the shake information of the main subject that is automatically identified. Therefore, the main subject can be specified without forcing the user to perform a complicated operation of manually setting the main subject before the shutter key 4 is fully pressed. That is, it is possible to reliably obtain a high-quality captured image without imposing a burden on the user.

  Further, in the present embodiment, the exposure time of the CCD 13 of the main camera block 11 at the time of actual photographing is the time required for the background subject to move within the angle of view within the exposure angle by the specified movement amount (determined number of pixels). Was set to. Therefore, it is possible to reliably obtain a captured image in which the background subject is shaken (flowed) by a specific predetermined movement amount, and as a result, it is possible to more surely sense the dynamic feeling and speed of the main subject (moving subject) in the captured image. Can express.

  In addition, since the user can change the prescribed movement amount as necessary, a captured image in which the background subject is shaken (flowed) to the extent desired by the user can be obtained with certainty. . That is, the user's intention can be reflected in the degree of liveliness and speed of the captured image. In the present embodiment, the specified movement amount that can be set by the user, that is, the degree of flow is set to three stages of “large”, “medium”, and “small”, but the specified movement amount can be set more finely. Alternatively, the prescribed movement amount may not be set stepwise but may be set steplessly.

  In the present embodiment, the main subject is automatically specified by using the half-press of the shutter key 4 as a trigger. However, when the main subject is specified, the shutter key 4 is fully pressed. For example, in a configuration including a shutter key that does not have a so-called half shutter function, the main subject may be specified when the panning mode is set.

  Further, in the present embodiment, the configuration in which the camera shake correction based on the shake information of the main subject is performed by the CCD shift method is described. However, the present invention is not limited to this, and the present invention shifts the correction lens provided in the photographing optical system, for example. In this case, the correction lens may be shifted based on the shake information of the main subject. Further, although the case where a CCD is used as the image sensor has been described, the image sensor may be, for example, a CMOS image sensor.

  Further, in the present embodiment, the motion detection unit 38 is made to acquire a motion vector for the sub-image data for the latest two frames in succession. However, the motion detection unit targets the latest sub-image data acquired in the latest frame and the sub-image data acquired in a frame that is a predetermined frame (for example, two frames) before the latest sub-image data. 38 may acquire a motion vector. In this case, the sub-image data for two frames stored in the first and second sub-image buffer areas 342a and 342b has the latest sub-image data stored in the first sub-image data every time a predetermined frame period elapses. The image data is sequentially updated.

  Further, although the case where the present invention is applied to a general digital camera has been described here, the present invention is not limited to this, and the present invention is incorporated in, for example, a digital video camera having a still image shooting function, a mobile phone terminal, or the like. The present invention can also be applied to other camera devices.

2 First imaging lens 3 Second imaging lens 4 Shutter key 11 Main camera block 13 CCD
14 Position Correction Unit 21 Sub Camera Block 23 CCD
31 CPU
33 CCD position controller 34 Work memory 38 Motion detector 40 Flash memory

Claims (6)

In a camera device for recording an image including a plurality of subjects imaged by a first image sensor,
A second imaging element that images a subject to be imaged by the first imaging element;
First imaging control means for causing the second imaging element to perform an imaging operation a plurality of times within an exposure time of the first imaging element at the time of shooting for generating a subject image for recording;
A specifying means for specifying a main subject from a plurality of subjects included in the image;
The moving amount and moving direction of the main subject specified by the specifying means between images picked up by a plurality of image pickup operations of the second image pickup device within the exposure time of the first image pickup device at the time of shooting Shaking information detecting means for detecting shaking information including
The imaging position of the optical image with respect to the first image sensor is corrected based on the shake information detected by the shake information detection means within the exposure time, and the main subject on the exposure surface of the first image sensor is corrected. A camera apparatus comprising: a shaking prevention means for preventing shaking. The amount of movement of each of the plurality of subjects is individually detected between successive images captured by the plurality of imaging operations of the second imaging element within the exposure time of the first imaging element during shooting. Further comprising an individual movement amount detection means,
The camera device according to claim 1, wherein the specifying unit specifies a main subject based on a movement amount of each of the plurality of subjects detected by the individual movement amount detection unit.   The said specifying means specifies the area | region corresponded to the to-be-photographed object part with the smallest moving amount detected by the said separate moving amount detection means among these several subjects as the said main subject. Camera device.   The shake preventing means corrects the position of the first image sensor on a plane perpendicular to the photographing optical axis based on the shake information, thereby causing the main subject to shake on the exposure surface of the first image sensor. The camera device according to claim 1, wherein the camera device is prevented. In a camera device for recording an image including a plurality of subjects imaged by a first image sensor,
Imaging a plurality of times with a second imaging element that captures an object to be imaged by the first imaging element within the exposure time of the first imaging element at the time of shooting for generating a subject image for recording. A step of performing an action;
Identifying a main subject from a plurality of subjects included in the image;
The main subject identified by the step of identifying the main subject between images captured by a plurality of imaging operations of the second image sensor within the exposure time of the first image sensor at the time of shooting. Detecting shaking information including a moving amount and a moving direction;
An image formation position of an optical image with respect to the first image sensor is corrected based on the shake information detected by the step of detecting the shake information within the exposure time, and the main image on the exposure surface of the first image sensor is corrected. And a step of preventing shaking of the subject. In a computer having a camera device that records an image including a plurality of subjects imaged by the first image sensor,
Imaging a plurality of times with a second imaging element that captures an object to be imaged by the first imaging element within the exposure time of the first imaging element at the time of shooting for generating a subject image for recording. Processing to perform the action;
A process of identifying a main subject from a plurality of subjects included in the image;
A process for detecting shaking information including a movement amount and a movement direction of the main subject between images captured by the plurality of imaging operations of the second imaging element within the exposure time;
The imaging position of the optical image with respect to the first image sensor is corrected based on the shake information detected by the process of detecting the shake information within the exposure time of the first image sensor at the time of shooting, and the first And a process for preventing the main subject from shaking on the exposure surface of the imaging device.

Images