[go: up one dir, main page]

WO2012169301A1 - Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image - Google Patents

Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image Download PDF

Info

Publication number
WO2012169301A1
WO2012169301A1 PCT/JP2012/061675 JP2012061675W WO2012169301A1 WO 2012169301 A1 WO2012169301 A1 WO 2012169301A1 JP 2012061675 W JP2012061675 W JP 2012061675W WO 2012169301 A1 WO2012169301 A1 WO 2012169301A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
image
pixels
group
phase difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2012/061675
Other languages
English (en)
Japanese (ja)
Inventor
智行 河合
宗之 大島
太田　毅
遠藤　宏
井上　知己
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Publication of WO2012169301A1 publication Critical patent/WO2012169301A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/672—Focus control based on electronic image sensor signals based on the phase difference signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements

Definitions

  • the present invention relates to an imaging device having a structure suitable for capturing a stereoscopic moving image and a planar moving image, and an imaging device mounted on the imaging device.
  • Patent Document 1 As a conventional imaging device that captures a stereoscopic image (hereinafter also referred to as a 3D image), for example, there is a device described in Patent Document 1 below.
  • This conventional imaging apparatus includes two cameras, and can capture the same subject with left and right cameras and reproduce a stereoscopic image of the subject.
  • the conventional stereoscopic image capturing apparatus needs to prepare two cameras, there is a problem that the cost is increased and the apparatus is further increased in size.
  • Patent Document 2 a conventional technique described in Patent Document 2 below has been proposed as an imaging apparatus that can capture a stereoscopic image of a subject with a single camera.
  • This stereoscopic image pickup apparatus divides a plurality of pixels (photoelectric conversion elements: photodiodes) two-dimensionally arranged on the surface of a solid-state image pickup device into two groups, and light from an object viewed from the right side enters one group. The other group is made to receive light viewed from the left side of the subject.
  • a single camera can capture a stereoscopic image of a subject, but it cannot capture a two-dimensional image (planar image, hereinafter also referred to as a 2D image) of the subject.
  • a two-dimensional image plane image, hereinafter also referred to as a 2D image
  • Patent Documents 1 and 2 There have been many demands for imaging devices in recent years, and both 3D moving images and 2D moving images that are difficult to realize with the prior art described in Patent Documents 1 and 2 are not limited to low cost and downsizing. A video shooting function that can be used is required.
  • An object of the present invention is to provide an image pickup device that can suitably process both 3D moving image shooting and 2D moving image shooting, and an image pickup apparatus mounted on the image pickup device.
  • the imaging device includes a first group pixel that includes a plurality of pixels arranged in a two-dimensional array and is configured by one pixel row of odd or even rows and the other pixel row of odd or even rows.
  • the second group pixels to be arranged are shifted by a 1 ⁇ 2 pixel pitch in the horizontal direction and the vertical direction, the Bayer array color filter stacked on the first group pixels, and the second group pixels stacked on the second group pixels.
  • An image pickup device including a color filter having a Bayer array, wherein each of the pixels of the first group pixel is obliquely adjacent to the pixel and the color filter of the same color as the pixel is stacked.
  • the imaging apparatus alternately captures an image signal of the phase difference detection pixel from the pixel row of the first group pixel and the pixel row of the second group pixel at the time of capturing a stereoscopic moving image. And an image sensor driving unit for reading.
  • the imaging element driving unit when imaging a planar moving image, the imaging element driving unit outputs the captured image signals of the paired pixels other than the phase difference detection pixels to the pixel rows of the first group pixels and the second group pixels. Are alternately read from the pixel rows.
  • FIG. 1 is an external perspective view of an imaging apparatus (digital camera) according to an embodiment of the present invention. It is a functional block block diagram of the imaging device shown in FIG. It is a surface schematic diagram of the solid-state image sensor shown in FIG. It is explanatory drawing when a 3D moving image is imaged with the solid-state image sensor shown in FIG. It is principle explanatory drawing which can image
  • FIG. 1 is an external perspective view of an imaging apparatus according to an embodiment of the present invention.
  • a lens barrel 13 that houses a photographing lens 12 is attached to a front portion of a camera housing 11 so as to be retractable.
  • a shutter release button 14 is provided at the right end of the upper surface of the camera casing 11, and a liquid crystal display section (display section 28 in FIG. 2) not shown in FIG. 1 is provided at the back of the camera casing 11. .
  • FIG. 2 is a functional block configuration diagram of the imaging apparatus 10 shown in FIG.
  • the imaging device 10 includes a photographic lens 12 and a CMOS solid-state imaging device 21 that is placed on the back of the photographic lens 12 and disposed on the imaging plane thereof.
  • the photographing lens 12 and the solid-state solid-state imaging device 21 are driven by instructions from a system control unit (CPU) 29 described later.
  • CPU system control unit
  • the solid-state imaging device 21 is a CMOS type image sensor in this embodiment, but may be a CCD type or other type of solid-state imaging device.
  • the imaging apparatus 10 of the present embodiment further includes a digital signal processing unit 26 that takes in a digital captured image signal output from the solid-state image sensor 21 and performs interpolation processing, white balance correction, RGB / YC conversion processing, and the like, and a captured image signal
  • a compression / decompression processing unit 27 that compresses image data in JPEG format or the like
  • a display unit 28 that displays menus and displays through images and captured images, and overall control of the entire digital camera
  • a bus 40 connected to each other.
  • an operation unit 33 for inputting an instruction from the user is connected to the system control unit 29, and a flash 25 that emits light in response to an instruction from the system control unit 29 is connected.
  • the imaging device 10 captures a high-definition 2D still image of a subject, a 2D moving image or a 3D moving image with a resolution lower than that of the high-definition still image based on a selection instruction from the operation unit 33 of the user. Then, based on these selection instructions, drive control and image processing of the solid-state imaging device 21 are performed.
  • FIG. 3 is a schematic diagram of the surface of the solid-state imaging device 21, showing a pixel array and a color filter array on each pixel.
  • even-numbered pixel rows are arranged by being shifted by 1/2 pixel pitch with respect to odd-numbered pixel rows. If only even pixel rows are viewed, each pixel 2 is arranged in a square grid, and further, three primary color filters are Bayer arranged, and even if only odd pixel rows are viewed, each pixel 2 is arranged in a square lattice. The three primary color filters are arranged in a Bayer array.
  • the color filter on each pixel in the even line is indicated by uppercase RGB
  • the color filter on each pixel in the odd line is indicated by lowercase rgb.
  • Each pixel in either the even row or the odd row (even row in the illustrated example) is hereinafter also referred to as a group A (or first group) pixel, and the other of the even row or the odd row (in the illustrated example, the odd row).
  • Each pixel is also referred to as a B group (or second group) pixel.
  • the color filter array is a Bayer array for both the A group pixel and the B group pixel, the A group pixel and the B group pixel that are diagonally adjacent to each other are the same color pixel, and constitute a pair pixel.
  • phase difference detection pixel also referred to as a focus detection pixel
  • the light shielding film openings 2a and 2b are located at the center of each of the pair pixels. It is configured to be eccentric in the opposite direction.
  • a normal pixel a pixel that is not a phase difference detection pixel
  • the membrane opening 1 is opened.
  • the light shielding film openings 2a and 2b of the paired pixels of the phase difference detection pixel are smaller than the light shielding film opening 1, and in the example shown in the drawing, the light shielding film opening 2a opens only to the left half with respect to the opening 1.
  • the opening 2b has a configuration in which only the right half of the opening 1 is opened.
  • FIG. 3 only one light-shielding film opening 1 is shown, but it is also provided in other normal pixels (the illustration is omitted because the figure becomes complicated).
  • the microlens is also stacked on the phase difference detection pixel.
  • the opening center position of the light shielding film opening 2a is eccentric to the left with respect to the center of the pixel, and the opening center position of the light shielding film opening 2b is eccentric to the right with respect to the center of the pixel.
  • a lens 12 is disposed in front of the solid-state imaging device 21, and light passing through the lens 12 and received by the pixel through the light-shielding film opening 2 a is on the left side of the lens 12. From the direction of viewing the subject with the left eye, and the light received by the pixels through the light shielding film opening 2b is the light from the right side of the lens 12, that is, the subject viewed with the right eye. The light coming from the direction is the main.
  • the captured image signal of the pixel having the light shielding film opening 2a among the paired pixels constituting the phase difference detection pixel becomes an image obtained by viewing the subject with the left eye, and the captured image signal of the pixel having the light shielding film opening 2b represents the subject.
  • the image is seen with the right eye. Therefore, a combination of the two makes it possible to reproduce a stereoscopic image of the subject.
  • the pupil division method illustrated in FIG. 3 is configured by decentering the light shielding film openings 2a and 2b.
  • it is commonly used for paired pixels.
  • a configuration may be adopted in which a single microlens or the like is mounted, and the incident angles of the paired pixels to each pixel are different.
  • FIG. 4 shows a pair of pixels for reading a picked-up image signal when a solid-state moving image 21 is picked up by the solid-state image pickup device 21 shown in FIG. 3, and a thick line frame is shown in FIG. Only the captured image signal detected by each pixel of the phase difference detection pixel pair indicated by is read out.
  • Shooting is performed by, for example, rolling shutter driving, and when reading a picked-up image signal from the solid-state image pickup device 21, reading is performed in order of horizontal lines in order of A group pixel ⁇ B group pixel ⁇ A group pixel ⁇ B group pixel ⁇ .
  • the captured image signal of the pixel mounting the light shielding film opening 2a is processed as image data of the subject viewed with the left eye, and the captured image signal of the pixel mounting the light shielding film opening 2b is imaged of the subject viewed with the right eye.
  • a stereoscopic moving image of the subject can be recorded by performing image processing as data, associating the subject image after the image processing, and recording the captured image data for each frame in the memory. Of course, it can also be recorded as a stereoscopic still image.
  • the captured image signal for the left eye and the captured image signal for the right eye read from the solid-state image sensor 21 are signals read from the Bayer array pixels, the image processing is performed for the existing Bayer array. An image processing engine can be used, and cost reduction can be achieved.
  • FIG. 5 is a diagram for explaining the principle that a stereoscopic image of a subject can be picked up by a phase difference detection pixel pair.
  • the phase difference detection pixel pairs are arranged at a required interval in the horizontal direction, and a change in the captured image signal obtained through the light shielding film opening 2a is defined as a signal f (x), and a change in the captured image signal obtained through the light shielding film opening 2b is represented as a signal Let g (x).
  • the signal f (x) and the signal g (x) are obtained as a result of receiving incident light from the same subject on the same horizontal line.
  • the signals f (x) and g (x) have the same waveform shifted in the horizontal direction.
  • the amount of phase difference. This phase difference amount is a parallax according to the distance to the subject, and the right-eye captured image signal and the left-eye captured image signal having this phase difference amount are read out from the solid-state image sensor 21, so An image can be generated.
  • the imaging apparatus 10 can capture 3D moving images, but some users may prefer 2D moving images.
  • the monitor or television receiver to be played back is not for 3D image playback and only supports 2D images.
  • it may be required to simultaneously capture both a 3D moving image and a 2D moving image.
  • the imaging apparatus 10 of the present embodiment is equipped with not only 3D but also a 2D moving image shooting function.
  • FIG. 6 is an explanatory diagram of the first embodiment for capturing a 2D moving image.
  • the solid-state imaging device 21 is the same, the pixel arrangement and the color filter arrangement shown in FIG. 6 are the same as those in FIGS.
  • normal pixels surrounded by a thick black frame shown in FIG. 6 are used when capturing a 2D moving image.
  • the pixel pair surrounded by the thick black frame in FIG. 6 is a pixel adjacent to the phase difference detection pixel pair surrounded by the thick black frame in FIG. 4 in the horizontal direction, and is a normal pixel pair.
  • a moving image is generated using an addition average value of captured image signals detected by each pixel of the normal pixel pair. By using the addition average value, S / N is improved.
  • a 3D moving image and a 2D moving image can be shot simultaneously using pixels adjacent in the horizontal direction. Since the above-described average value is used as data for generating a 2D moving image, each pixel position becomes an addition centroid position of a pair pixel, and a position closest to each pixel position of the 3D image. For this reason, 3D moving images and 2D moving images having the same resolution and the same resolution can be obtained.
  • 3D moving image data and 2D moving image data can be read from the same horizontal line from the solid-state imaging device 21, it is possible to simultaneously read the 3D moving image and the 2D moving image in a short time.
  • the image processing of 2D moving image data can use a Bayer array image processing engine because the color array of the read captured image signal is a Bayer array. Can be achieved.
  • FIG. 7 is a flowchart showing a processing procedure when performing 2D moving image shooting according to the second embodiment.
  • the 2D moving image is generated using the addition average value of the normal pixel pair.
  • the present invention is not limited to this, and the 2D moving image is generated using only the captured image signal of one of the paired pixels.
  • the 2D moving image may be generated by adding signals of both captured image signals of the paired pixels outside the solid-state imaging device. It is better to decide which one to use depending on the brightness of the shooting scene.
  • the brightness of the photographic scene is determined in step S1, and if the brightness is equal to or greater than the predetermined threshold value ⁇ , the process proceeds to step S2, and the captured image signal of one of the paired pixels is employed, or the pair The addition average value of the captured image signals of the two pixels of the pixels is adopted, and the process proceeds to step S4.
  • step S1 determines whether the scene brightness is darker than the threshold value ⁇ . If the result of determination in step S1 is that the scene brightness is darker than the threshold value ⁇ , the process proceeds to step S3 to increase the sensitivity, and the captured image signals of the two pixels of the paired pixels are added to step S4. In step S4, 2D moving image data is generated, and this process ends.
  • FIGS. 8 to 10 are diagrams illustrating a method of reading a captured image signal for 2D moving images from the solid-state image sensor 21 according to the third embodiment of the present invention.
  • FIG. 7 when the shooting scene is dark and low in illuminance, two pixels of the paired pixels are added to increase the sensitivity. However, when the shooting scene is darker, it is necessary to further increase the number of added pixels.
  • FIGS. 8 to 10 are diagrams showing the pixel positions to be added when the number of added pixels is increased.
  • a 2D moving image is generated using only the addition average value of the paired pixels described in FIG. 6 and the captured image signal of one pixel, but the shooting scene is darker.
  • FIG. 8 for example, as image data at a pixel position indicated by an ellipse, two normal pixel pairs (indicated by bold black frames) adjacent to the left and right in the horizontal direction of the phase difference detection pixel position indicated by the ellipse.
  • the imaged image signals of a total of 4 pixels are added to obtain image data at the ellipse center position.
  • the four paired pixel positions are, for example, the positions shown in FIG. That is, as the image data at the phase difference detection pixel position indicated by the ellipse, the picked-up image signals of four normal color pixel pairs on the top, bottom, left, and right are selected as addition targets.
  • phase difference detection pixel indicated by an ellipse is also added. Since the phase difference detection pixel is an addition of the left eye and the right eye, if it is added in pairs, it can be used in the same way as a normal pixel.
  • FIG. 10 shows eight pair pixel positions where 16 pixel addition is performed. That is, as the image data at the phase difference detection pixel position indicated by an ellipse, a captured image signal of four pairs of pixels in an oblique direction is added in addition to the top, bottom, left, and right in FIG.
  • a phase difference detection pixel pair indicated by an ellipse is also added in the same manner as described above.
  • FIG. 10 only eight pair pixel positions for one phase difference detection pixel position are shown. However, when eight pair pixel positions for each phase difference detection pixel position are taken, all normal pixel pairs are added. Will be selected. That is, since a 2D moving image is generated using captured image signals of all normal pixels, it is possible to suppress image quality deterioration factors such as false colors and jaggy.
  • FIG. 11 is a diagram for explaining a method of reading a captured image signal for 2D moving images from a solid-state image sensor according to the fourth embodiment.
  • a 2D moving image having the same resolution as that of the 3D moving image has been described.
  • a 2D moving image having an increased horizontal resolution may be desired.
  • an HD quality moving image having an aspect ratio of 16: 9 is desired.
  • the aspect ratio of an image captured by the imaging apparatus 10 is normally 4: 3, but there are cases where it is desired to view a moving image on a large screen of a large television receiver having an aspect ratio of 16: 9. In such a case, the reading method of the following fourth embodiment may be adopted, and selection is made on the menu screen of the imaging apparatus 10.
  • a pair of normal pixels indicated by a thick black frame is selected to read a captured image signal for a 2D image.
  • pixels are not thinned out in the horizontal line, and pixels in the vertical line are thinned out without reading the horizontal line in which the phase difference detection pixel exists.
  • Shooting is performed by, for example, rolling shutter drive, and when a captured image signal is read out from the solid-state image sensor 21, reading is performed in the order of horizontal lines in the order of A group pixel ⁇ B group pixel ⁇ A group pixel ⁇ B group pixel ⁇ .
  • the color array of the picked-up image signal as a result of the averaging is a Bayer array, and it is possible to use an image processing engine for the Bayer array.
  • the 2D moving image data is not generated by using the average value of the paired pixels, but one of the paired pixels is selected and 2D is selected as described in FIG. 2D moving image data is generated by generating moving image data or performing two-pixel addition of paired pixels.
  • the pixel addition is preferably performed by the digital signal processing unit 26 in FIG. 2 after reading out the captured image signal from the solid-state image sensor 21. As a result, the generation speed of 2D moving image data is improved, or highly sensitive 2D moving image data can be obtained.
  • FIG. 12 is a view showing a captured image signal reading method for 2D moving images according to the sixth embodiment. Also in the present embodiment, signal readout is not performed for horizontal lines in which phase difference detection pixels exist, and horizontal lines in which only other normal pixels exist are read out. Then, in this embodiment, when the shooting scene is dark and the sensitivity is insufficient even with the two-pixel addition of the fifth embodiment described above, as shown in FIG. 12, two sets of the same color sandwiching the non-read line in the vertical direction. Four pairs of pixels are added. In FIG. 12, the pair pixels are surrounded by an ellipse, and the pair pixel ellipses to be added are connected by lines. Thereby, it is possible to shoot a 2D moving image with high sensitivity and HD image quality.
  • FIG. 13 is a flowchart showing a processing procedure for variably controlling the pixel addition number according to the brightness of the shooting scene.
  • the process proceeds to step S12, and as described with reference to FIG. 11, only the captured image signal of one pixel of the paired pixels is obtained. Or, an addition average value of captured image signals of paired pixels is adopted.
  • the process proceeds to the next step S13, where a 2D moving image of HD image quality is generated using the adopted captured image signal, and this process is terminated.
  • step S11 determines whether or not the photographed scene is brighter than the second threshold value ⁇ 2 that is darker than ⁇ 1. If it is brighter than the second threshold value ⁇ 2, the process proceeds from step S14 to step S15, the captured image signals of the two pixels of the pair pixel are added, and the process proceeds to step S13.
  • step S14 If the result of determination in step S14 is that the brightness of the photographic scene is darker than the second threshold value ⁇ 2, the process proceeds to step S16, the four-pixel addition of the captured image signal described in FIG. 12 is performed, and the process proceeds to step S13.
  • the imaged image signals of all the pixels are read out. Since the solid-state imaging device 21 can acquire two Bayer array images (captured images by group A pixels and captured images by group B pixels) in which the pixel array (array of captured image signals) is shifted by half a pitch in the vertical and horizontal directions. A high-definition 2D still image can be generated using the two pieces of image data.
  • the captured image signal of the phase difference detection pixel is corrected by interpolation calculation using data of surrounding normal pixels.
  • the gain of the amplification process performed by the digital signal processing unit 26 of FIG. 2 on the captured image signal of the phase difference detection pixel is corrected to be higher than the amplification rate of the captured image signal of the normal pixel.
  • a phase difference detection pixel pair is set only within the range of the aspect ratio of 16: 9 on the light receiving surface. Just place it.
  • the plurality of pixels are arranged in a two-dimensional array, and the first group pixel configured by one pixel row of an odd row or an even row and an odd row or an even row.
  • An image pickup device comprising a Bayer array color filter stacked on a second group pixel, wherein each pixel of the first group pixel and the color filter of the same color as the pixel adjacent to the pixel are stacked
  • the phase difference detection pixel included in the first group pixel acquires one of an image for the right eye or an image for the left eye, and the position included in the second group pixel.
  • the phase difference detection pixel is configured to acquire the other of the right-eye image and the left-eye image.
  • the imaging apparatus includes the imaging element described above, and the captured image signal of the phase difference detection pixel when the stereoscopic moving image is captured, the pixel row of the first group pixel, and the pixel row of the second group pixel. And an image sensor driving unit that alternately reads from the image sensor.
  • the difference in exposure time between the first group pixel and the second group pixel can be minimized, and post-processing can be simplified side by side.
  • the captured image signal of the paired pixels other than the phase difference detection pixel is transmitted to the pixel group row of the first group pixel and the second group. It is characterized by alternately reading from pixel rows of pixels. This makes it possible to generate a 2D moving image while avoiding the influence of the phase difference pixels.
  • the imaging apparatus uses a captured image signal of any one of the paired pixels other than the phase difference detection pixels or a captured image signal of two pixels.
  • An image processing unit that generates the planar moving image using the addition average value is provided. As a result, a 2D moving image can be quickly obtained, and a 2D moving image with good S / N can be obtained.
  • the imaging apparatus includes an image processing unit that generates the planar moving image by adding both the captured image signals of the paired pixels other than the phase difference detection pixels when the shooting scene is dark. It is characterized by. Thereby, a highly sensitive 2D moving image can be obtained.
  • the image processing unit when the shooting scene is further dark, the image processing unit captures image signals of a plurality of pixels constituting the adjacent pair pixels of the same color among the pair pixels other than the phase difference detection pixels. Are added to generate the planar moving image. This makes it possible to capture a 2D moving image with higher sensitivity.
  • the imaging apparatus is characterized in that the planar moving image is captured simultaneously with the stereoscopic moving image. This makes it possible to capture two types of moving images in a short time.
  • phase difference detection pixels of the imaging apparatus of the embodiment are arranged in an aspect ratio of 16: 9 in the imaging device, and the planar moving image is vertical without performing pixel thinning in the horizontal direction of the imaging device. Only the pixel thinning in the direction is performed to obtain an image with an aspect ratio of 16: 9. As a result, a large screen moving image can be captured by a television receiver having an aspect ratio of 16: 9.
  • the imaging apparatus when capturing a high-definition planar still image, the imaging apparatus according to the embodiment reads a captured image signal from all pixels of the image sensor and corrects the captured image signal of the phase difference detection pixel to generate a high-definition planar still image. It is characterized by generating. Since normal pixels are arranged around the phase difference detection pixels, correction can be performed easily and reliably, and a high-definition still image can be acquired.
  • the imaging apparatus can capture not only a still image but also a 3D moving image and a 2D moving image, and is useful as a digital camera or the like with a moving image shooting function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Studio Devices (AREA)
  • Color Television Image Signal Generators (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Blocking Light For Cameras (AREA)
  • Solid State Image Pick-Up Elements (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

L'invention concerne un dispositif de capture d'image qui comprend des pixels de premier groupe et des pixels de second groupe qui sont agencés horizontalement et verticalement de façon à être déplacés d'1/2 pas de pixel, et comporte des filtres colorés (RVB) empilés sur les pixels de premier groupe et des filtres colorés (RVB) empilés sur les pixels de second groupe. Chaque pixel des pixels de premier groupe, et le pixel appartenant aux pixels de second groupe, qui est obliquement adjacent à chacun des pixels des pixels de premier groupe et est empilé avec le filtre coloré, dont la couleur est la même que chaque pixel précité, sont définis en tant que pixels appariés, et les pixels appariés horizontalement et verticalement correspondant à l'intervalle de (2n + 1) (n = 1, 2, …) parmi les pixels appariés sont configurés par des pixels de détection de différence de phase. Les pixels appariés ayant des ouvertures de film protégeant contre la lumière (2a, 2b) sont les paires de pixels de détection de différence de phase.
PCT/JP2012/061675 2011-06-06 2012-05-07 Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image Ceased WO2012169301A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011126643A JP2014158062A (ja) 2011-06-06 2011-06-06 立体動画像及び平面動画像を撮像する撮像素子及びこの撮像素子を搭載する撮像装置
JP2011-126643 2011-06-06

Publications (1)

Publication Number Publication Date
WO2012169301A1 true WO2012169301A1 (fr) 2012-12-13

Family

ID=47295872

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/061675 Ceased WO2012169301A1 (fr) 2011-06-06 2012-05-07 Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image

Country Status (2)

Country Link
JP (1) JP2014158062A (fr)
WO (1) WO2012169301A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013136819A1 (fr) * 2012-03-16 2013-09-19 株式会社ニコン Capteur d'image, dispositif de formation d'image et système de formation d'image
JP2014060693A (ja) * 2012-03-16 2014-04-03 Nikon Corp 撮像素子、撮像装置および撮像システム
WO2015112517A1 (fr) * 2014-01-27 2015-07-30 Microsoft Technology Licensing, Llc Capture universelle
CN105684436A (zh) * 2013-09-26 2016-06-15 株式会社尼康 摄像元件以及摄像装置
CN111052736A (zh) * 2017-08-22 2020-04-21 索尼半导体解决方案公司 固态摄像元件、固态摄像元件的制造方法和电子设备

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3944323B1 (fr) * 2020-07-21 2024-06-05 Imec VZW Détecteur servant à détecter un rayonnement électromagnétique, capteur d'images et procédé de détection d'informations d'image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003007994A (ja) * 2001-06-27 2003-01-10 Konica Corp 固体撮像素子、立体カメラ装置及び測距装置
JP2010056865A (ja) * 2008-08-28 2010-03-11 Fujifilm Corp 撮像装置
JP2010081609A (ja) * 2008-09-25 2010-04-08 Samsung Electronics Co Ltd 立体イメージセンサ
JP2011077829A (ja) * 2009-09-30 2011-04-14 Fujifilm Corp 撮像デバイスおよび電子カメラ

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003007994A (ja) * 2001-06-27 2003-01-10 Konica Corp 固体撮像素子、立体カメラ装置及び測距装置
JP2010056865A (ja) * 2008-08-28 2010-03-11 Fujifilm Corp 撮像装置
JP2010081609A (ja) * 2008-09-25 2010-04-08 Samsung Electronics Co Ltd 立体イメージセンサ
JP2011077829A (ja) * 2009-09-30 2011-04-14 Fujifilm Corp 撮像デバイスおよび電子カメラ

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9906770B2 (en) 2012-03-16 2018-02-27 Nikon Corporation Image sensor, image-capturing apparatus and image capturing system
JP2014060693A (ja) * 2012-03-16 2014-04-03 Nikon Corp 撮像素子、撮像装置および撮像システム
US10412358B2 (en) 2012-03-16 2019-09-10 Nikon Corporation Image sensor, image-capturing apparatus and image-capturing system
WO2013136819A1 (fr) * 2012-03-16 2013-09-19 株式会社ニコン Capteur d'image, dispositif de formation d'image et système de formation d'image
CN105684436A (zh) * 2013-09-26 2016-06-15 株式会社尼康 摄像元件以及摄像装置
JPWO2015045375A1 (ja) * 2013-09-26 2017-03-09 株式会社ニコン 撮像素子および撮像装置
EP3051811A4 (fr) * 2013-09-26 2017-03-22 Nikon Corporation Elément de recueil d'image et dispositif de recueil d'image
US20160286104A1 (en) * 2013-09-26 2016-09-29 Nikon Corporation Imaging element and imaging device
CN111479066A (zh) * 2013-09-26 2020-07-31 株式会社尼康 摄像元件以及摄像装置
CN111479067A (zh) * 2013-09-26 2020-07-31 株式会社尼康 摄像元件以及摄像装置
CN106063248A (zh) * 2014-01-27 2016-10-26 微软技术许可有限责任公司 通用捕获
WO2015112517A1 (fr) * 2014-01-27 2015-07-30 Microsoft Technology Licensing, Llc Capture universelle
CN111052736A (zh) * 2017-08-22 2020-04-21 索尼半导体解决方案公司 固态摄像元件、固态摄像元件的制造方法和电子设备
US11240450B2 (en) 2017-08-22 2022-02-01 Sony Semiconductor Solutions Corporation Solid-state imaging element, method for manufacturing solid-state imaging element, and electronic apparatus

Also Published As

Publication number Publication date
JP2014158062A (ja) 2014-08-28

Similar Documents

Publication Publication Date Title
JP5493054B2 (ja) 立体動画像及び平面動画像を撮像する撮像素子及びこの撮像素子を搭載する撮像装置
CN103493484B (zh) 成像装置和成像方法
CN104041009B (zh) 摄像元件及摄像装置
CN103380392B (zh) 摄像装置及其对焦控制方法
CN102934025B (zh) 摄像装置及摄像方法
US9661210B2 (en) Image pickup device and image pickup apparatus
CN103444185B (zh) 彩色摄像元件及摄像装置
JP5385462B2 (ja) 単眼立体撮像装置、単眼立体撮像装置用シェーディング補正方法及び単眼立体撮像装置用プログラム
WO2012039180A1 (fr) Dispositif de prise d'images et appareil de prise d'images
JP5597777B2 (ja) カラー撮像素子及び撮像装置
JP2012015819A (ja) 立体画像撮像装置
CN102884802A (zh) 三维成像装置和视点图像恢复方法
WO2012169301A1 (fr) Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image
WO2013069445A1 (fr) Dispositif de formation d'images en trois dimensions et procédé de traitement d'images
CN102934024B (zh) 摄像装置及摄像方法
WO2014041845A1 (fr) Dispositif d'imagerie et procédé de traitement de signaux
WO2012147515A1 (fr) Dispositif de capture d'image et procédé de capture d'image
JP5634613B2 (ja) イメージセンサ及び撮像装置
JP5634614B2 (ja) 撮像素子及び撮像装置
JP2011210748A (ja) Ｃｃｄ型固体撮像素子及びその製造方法並びに撮像装置
US8797438B2 (en) Digital camera and pixel adding method of same
WO2013047080A1 (fr) Dispositif d'imagerie tridimensionnelle
JP2011199426A (ja) 固体撮像素子、撮像装置、及びスミア補正方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12797659

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12797659

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP