[go: up one dir, main page]

WO2013047080A1 - Dispositif d'imagerie tridimensionnelle - Google Patents

Dispositif d'imagerie tridimensionnelle Download PDF

Info

Publication number
WO2013047080A1
WO2013047080A1 PCT/JP2012/072091 JP2012072091W WO2013047080A1 WO 2013047080 A1 WO2013047080 A1 WO 2013047080A1 JP 2012072091 W JP2012072091 W JP 2012072091W WO 2013047080 A1 WO2013047080 A1 WO 2013047080A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel cell
aperture
diaphragm
light
stereoscopic image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2012/072091
Other languages
English (en)
Japanese (ja)
Inventor
裕樹 鈴木
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Publication of WO2013047080A1 publication Critical patent/WO2013047080A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B9/00—Exposure-making shutters; Diaphragms
    • G03B9/02—Diaphragms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00—Stereoscopic photography
    • G03B35/08—Stereoscopic photography by simultaneous recording
    • G03B35/10—Stereoscopic photography by simultaneous recording having single camera with stereoscopic-base-defining system
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/218—Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes

Definitions

  • the present invention relates to a stereoscopic image capturing apparatus capable of capturing a stereoscopic image.
  • Stereo image pickup devices that can pick up a stereoscopic image of a subject have begun to become popular, and television devices and personal computer monitor devices that can display stereoscopic images in a stereoscopic manner are also becoming popular.
  • Some conventional stereoscopic image pickup devices are equipped with two image pickup units, and the photographing lens systems of the respective image pickup units are provided side by side on the left and right of the front part of the camera housing.
  • This stereoscopic image capturing apparatus captures a subject image for the right eye through the right photographic lens system and images a subject image for the left eye through the left photographic lens system.
  • a stereoscopic image capturing apparatus having two image capturing units includes an expensive photographing lens system and image capturing element in each image capturing unit. For this reason, the cost of the imaging unit is doubled compared to a general camera that captures a two-dimensional image.
  • Patent Document 1 discloses a stereoscopic image capturing apparatus capable of capturing a stereoscopic image with a single photographing lens and a single image sensor.
  • a liquid crystal shutter provided between the image pickup element and the photographing lens blocks the right half of the optical path of the light collected by the photographing lens and the light collected by the photographing lens. Switch between the states that block the left half of the optical path. In each state, a three-dimensional image is generated from the right image and the left image captured by the image sensor. According to this stereoscopic image capturing apparatus, since a stereoscopic image can be captured by a single photographing lens and a single image sensor, the cost can be reduced.
  • Patent Document 1 needs to perform imaging twice in order to obtain a stereoscopic image. For this reason, when the subject is moving, an image difference other than parallax occurs between the right-eye image and the left-eye image, and a high-quality stereoscopic image cannot be generated. Further, since it is necessary to provide an unnecessary liquid crystal shutter in a general camera, the cost increases accordingly.
  • the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a stereoscopic image capturing apparatus that can simultaneously obtain a plurality of imaging data with parallax and that can reduce manufacturing costs. To do.
  • a stereoscopic image capturing apparatus includes a single photographing optical system including a photographing lens and a diaphragm that adjusts the amount of transmitted light by changing an aperture, and a single light receiving light that has passed through the photographing optical system.
  • a stereoscopic image capturing apparatus including an imaging element, the imaging element having a first pixel cell and a second pixel cell that photoelectrically convert light beams that have passed through different areas of the photographing optical system, respectively, It is configured to generate a first image obtained from the output value of the pixel cell and a second image obtained from the output value of the second pixel cell.
  • the amount of light shielding in the direction orthogonal to the pupil division direction is larger than the amount of light shielding in the pupil division direction.
  • a stereoscopic image capturing apparatus includes a single photographing optical system including a photographing lens, a diaphragm with a fixed aperture and a light amount adjusting unit, and a single imaging element that receives light passing through the photographing optical system.
  • the imaging device includes a first pixel cell and a second pixel cell that photoelectrically convert light beams that have passed through different areas of the imaging optical system, and the first pixel cell A first image obtained from the output value and a second image obtained from the output value of the second pixel cell are configured to generate a first aperture and a first aperture that can be taken in and out of the optical path of the photographing lens.
  • the first diaphragm includes a maximum sensitivity of each of the first pixel cell and the second pixel cell in the incident angle range in the pupil division direction of light incident on the image sensor, and the first diaphragm. Incident angle range in the pupil division direction of light incident on the image sensor via The center of gravity of the area surrounded by the sensitivity distribution waveform of each of the first pixel cell and the second pixel cell (hereinafter referred to as the sensitivity center of gravity) is combined, and the second diaphragm is inserted through the second diaphragm.
  • the incident angles that are the centroids of sensitivity of the first pixel cell and the second pixel cell in the incident angle range in the pupil division direction of the light incident on the image sensor are the first pixel cell and the second pixel cell.
  • Each pixel cell has an aperture that is smaller than the angle of incidence for maximum sensitivity, processes the output values of the first and second pixel cells, and processes the output values of the first pixel cell
  • a stereoscopic image generation processing unit for generating the output value of the first pixel cell and the second In the two-dimensional image generation processing unit that generates two-dimensional image data using the output value of the cell and the photographing mode for obtaining stereoscopic image data, the photographing mode for obtaining the two-dimensional image data by inserting the first aperture into the optical path Then, an image pickup control unit that inserts the second diaphragm into the optical path and causes the image pickup
  • a stereoscopic image capturing apparatus capable of simultaneously obtaining a plurality of imaging data with parallax and suppressing manufacturing cost.
  • FIG. 1 The figure which shows schematic structure of the stereo image imaging device for describing one Embodiment of this invention 2D schematic diagram showing a schematic configuration of the solid-state imaging device 100 shown in FIG. Diagram for explaining the aperture of a general configuration
  • FIG. 1 is a diagram showing a schematic configuration of a stereoscopic image capturing apparatus for explaining an embodiment of the present invention.
  • the stereoscopic image pickup apparatus include a digital camera and a digital video camera, an electronic endoscope, an imaging module mounted on a camera-equipped mobile phone, and the like.
  • a digital camera will be described as an example.
  • the image pickup system of the digital camera shown in the figure has a single shooting optical system including a shooting lens 1 such as a focus lens and a zoom lens and a diaphragm 2 provided behind the shooting lens 1 and light passing through the shooting optical system. And a solid-state imaging device 100 such as a CCD image sensor or a CMOS image sensor for receiving light.
  • a shooting lens 1 such as a focus lens and a zoom lens
  • a diaphragm 2 provided behind the shooting lens 1 and light passing through the shooting optical system.
  • a solid-state imaging device 100 such as a CCD image sensor or a CMOS image sensor for receiving light.
  • the system control unit 11 that controls the entire electric control system of the digital camera controls the flash light emitting unit 12 and the light receiving unit 13. Further, the system control unit 11 controls the lens driving unit 8 to adjust the position of the focus lens included in the photographing lens 1 or adjust the position of the zoom lens included in the photographing lens 1. Further, the system control unit 11 adjusts the exposure amount by controlling the aperture amount of the aperture 2 via the aperture drive unit 9.
  • system control unit 11 drives the solid-state image sensor 100 via the image sensor driving unit 10 and causes the solid-state image sensor 100 to output a subject image captured by the solid-state image sensor 100 through the imaging optical system as a captured image signal.
  • An instruction signal from the user is input to the system control unit 11 through the operation unit 14.
  • the electric control system of the digital camera further includes an analog signal processing unit 6 and an A / D conversion circuit 7.
  • the analog signal processing unit 6 performs analog signal processing such as correlated double sampling processing connected to the output of the solid-state imaging device 100.
  • the A / D conversion circuit converts the RGB color signal output from the analog signal processing unit 6 into a digital signal.
  • the analog signal processing unit 6 and the A / D conversion circuit 7 are controlled by the system control unit 11.
  • the electric control system of the digital camera includes a main memory 16 and a memory control unit 15 connected to the main memory 16. Furthermore, the electric control system of the digital camera includes a digital signal processing unit 17, a compression / decompression processing unit 18, an external memory control unit 20 to which a detachable recording medium 21 is connected, and a liquid crystal mounted on the back of the camera. And a display control unit 22 to which the display unit 23 is connected.
  • the digital signal processing unit 17 performs interpolation calculation, gamma correction calculation, RGB / YC conversion processing, and the like to generate captured image data.
  • the compression / decompression processing unit 18 compresses the captured image data generated by the digital signal processing unit 17 into the JPEG format or decompresses the compressed image data.
  • the memory control unit 15, the digital signal processing unit 17, the compression / decompression processing unit 18, the external memory control unit 20, and the display control unit 22 are connected to each other by a control bus 24 and a data bus 25, and commands from the system control unit 11. Controlled by.
  • the liquid crystal display unit 23 is configured to display two captured image data with parallax so as to be stereoscopically viewed.
  • FIG. 2 is a schematic plan view showing a schematic configuration of the solid-state imaging device 100 shown in FIG.
  • the solid-state imaging device 100 is two-dimensionally arranged in a row direction X and a column direction Y orthogonal to the row direction X (in the example of FIG. 2, a square lattice shape), and has two types of pixel cells (10, 11).
  • the two types of pixel cells include a pixel cell 10 that detects one of a pair of light beams that have passed through different pupil regions of the photographic lens 1 and a pixel cell 11 that detects the other of the pair of light beams. The same number of these two types of pixel cells is provided. Note that the solid-state imaging device 100 is not provided with a pixel cell that can detect both a pair of light beams that have passed through the pupil region of the photographing lens 1.
  • a light receiving region (a portion indicated by a white rectangle in FIG. 2) that receives light and performs photoelectric conversion is eccentric to the left with respect to the center of the pixel cell 10. It has a configuration. A region other than the light receiving region of the pixel cell 10 (a hatched region in FIG. 2) is shielded from light by a light shielding film.
  • the pixel cell 11 has a light receiving region (a portion indicated by a white rectangle in FIG. 2) that receives light and performs photoelectric conversion with respect to the center of the pixel cell 11.
  • the configuration is eccentric in the right direction opposite to the eccentric direction (left direction).
  • a region other than the light receiving region of the pixel cell 11 (a hatched region in FIG. 2) is shielded from light by a light shielding film.
  • Each of the pixel cells 10 and 11 is formed by, for example, decentering the center of the opening formed in the light shielding film provided above the semiconductor substrate on which the photodiode is formed with respect to the center of the pixel cell.
  • the pixel cells 10 and 11 have a configuration in which the center position of the photodiode formed in the semiconductor substrate is decentered with respect to the center of the pixel cell (the photodiode is formed only on the right half or the left half of the pixel cell). There may be.
  • the pixel cells 10 and 11 may be configured as long as pupil division can be performed in the row direction X by the pixel cell 10 and the pixel cell 11, and a well-known configuration can be adopted.
  • rows composed of a plurality of pixel cells 10 arranged in the row direction X and rows composed of a plurality of pixel cells 11 arranged in the row direction X are alternately arranged in the column direction Y. It is an array. That is, in the row of pixel cells of the solid-state imaging device 100, the pixel cells 10 are arranged in the odd rows and the pixel cells 11 are arranged in the even rows.
  • each pixel cell one of three types of color filters is mounted in the light receiving area.
  • a color filter that transmits red has a letter “R” in the light receiving area of the pixel cell provided in the light receiving area.
  • a color filter that transmits green has a letter “G” in the light receiving area of the pixel cell provided in the light receiving area.
  • a color filter that transmits blue is marked with a letter “B” in the light receiving area of the pixel cell provided in the light receiving area.
  • the array of color filters mounted on the pixel cells 10 of the solid-state image sensor 100 is a Bayer array
  • the array of color filters mounted on the pixel cells 11 of the solid-state image sensor 100 is also a Bayer array. It has become.
  • the solid-state imaging device 100 uses a pair that detects red light and green light. A pair to be detected and a pair to detect blue light are arranged in a Bayer shape as a whole.
  • the digital signal processing unit 17 processes captured image signals that are a set of signals output from the pixel cells 10 of the solid-state imaging device 100 to generate right-eye image data,
  • the captured image signal that is a set of signals output from the pixel cell 11 is processed to generate image data for the left eye.
  • the digital signal processing unit 17 generates stereoscopic image data in a format that can be stereoscopically reproduced from these two image data, and records this on the recording medium 21.
  • the system control unit 11 causes the display unit 23 to display a stereoscopic image based on the stereoscopic image data.
  • the digital camera shown in FIG. 1 uses the solid-state imaging device 100 in which pairs of pixel cells divided into pupils each including the pixel cell 10 and the pixel cell 11 adjacent to the pixel cell 10 are two-dimensionally arranged.
  • Two image data (right-eye image data and left-eye image data) having parallax can be generated by a single photographing optical system and a single image sensor.
  • this digital camera can generate two pieces of image data with parallax by one shooting without providing a liquid crystal shutter, unlike the image pickup apparatus described in Patent Document 1.
  • the diaphragm having the general configuration illustrated in FIG. 3 As illustrated in FIG. 2, in the configuration in which pupil division is performed in the pixel cells included in the solid-state imaging device 100, it is preferable to use the diaphragm having the general configuration illustrated in FIG. 3 as the diaphragm 2 illustrated in FIG. 1. May not obtain a good parallax. Hereinafter, the reason will be described.
  • FIG. 3 is a diagram for explaining a general aperture stop.
  • the aperture 200 shown in FIG. 3 forms an aperture 200a that passes all light that passes through the pupil region H of the photographing lens 1 when opened, and the aperture value from the fully open to the minimum aperture (hereinafter referred to as a small aperture).
  • an opening 200b that passes only light that passes through the central portion of the pupil region H is formed.
  • FIG. 4 is a diagram showing the sensitivity of each of the pixel cell 10 and the pixel cell 11 shown in FIG. 2 to the incident angle of light in the row direction X.
  • the horizontal axis of FIG. 4 indicates the incident angle when the incident angle when light is incident on the pixel cell perpendicularly is 0 °. This incident angle is obtained by adding the angle formed between the straight line perpendicular to the paper surface and the paper surface in FIG. 2 to the right, and the straight line perpendicular to the paper surface to the left. The angle between the straight line and the paper is negative.
  • the vertical axis in FIG. 4 indicates the sensitivity of the pixel cells 10 and 11 at each incident angle.
  • the sensitivity distribution of the pixel cell 10 has a waveform indicated by reference numeral 10a
  • the sensitivity distribution of the pixel cell 11 has a waveform indicated by reference numeral 11a.
  • the waveform indicated by reference numeral 11a and the waveform indicated by reference numeral 10a have substantially the same shape, and the incident angles at which the respective maximum sensitivities, that is, peak sensitivities (portions surrounded by circles in FIG. 4) are incident angles. They are located at substantially the same distance in the opposite directions from the 0 ° position.
  • the pixel cell 10 has a light incident angle range determined by the F value of the diaphragm 200.
  • the centroid of the area surrounded by the sensitivity distribution waveform 10a (11a) of (11), that is, the incident angle serving as the sensitivity centroid coincides with the incident angle serving as the peak sensitivity of the pixel cell 10 (11) shown in FIG. It is preferable.
  • incident angle ⁇ G which is the sensitivity centroid of the pixel cell 10 (11)
  • ⁇ G which is the sensitivity centroid of the pixel cell 10 (11)
  • ⁇ represents the value of each incident angle in the incident angle range determined by the F value of the stop
  • I ( ⁇ ) represents the sensitivity of the pixel cell 10 (11) at the incident angle ⁇ .
  • reference numeral 42 denotes a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 200 is a small diaphragm (the most narrowed state).
  • reference numeral 41 denotes a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 200 is between the full aperture and the small diaphragm.
  • the sensitivity centroid of the pixel cells 10 and 11 when light in the incident angle range 40 is incident is a portion surrounded by a circle (solid line and broken line) in the figure. It almost agrees with the peak sensitivity.
  • the sensitivity centroid of the pixel cells 10 and 11 when light in the incident angle range 41 is incident is a portion surrounded by ⁇ (solid line and broken line) in the figure, and the pixel cell when light in the incident angle range 42 is incident.
  • the sensitivity centroids 10 and 11 are surrounded by ⁇ (solid line and broken line) in the figure, and the sensitivity centroids of the pixel cells 10 and 11 become closer to each other as the aperture 200 is reduced.
  • That the sensitivity center of gravity is close means that the pupil division performance (parallax separation performance) in the row direction X of the pixel cell 10 and the pixel cell 11 is lowered. Therefore, when the diaphragm 200 as shown in FIG. 3 is used, the pupil division performance is reduced on the small diaphragm side, and the captured image signal obtained from the pixel cell 10 and the captured image signal obtained from the pixel cell 11 have a parallax. It becomes difficult and a three-dimensional effect is impaired.
  • the pupil division direction (row direction X) is larger than the light shielding amount in the pupil division direction (row direction X).
  • a diaphragm that forms a diaphragm shape that increases the amount of light shielded in the direction orthogonal to the row direction X) is used.
  • the pixel cells 10 and 11 in the incident angle range of the pupil division direction (row direction X) of the light incident on the solid-state imaging device 100 at the respective aperture values from the open position to the small stop are used as the stop 2.
  • the pixel cells 10 and 11 in the incident angle range of the light in the pupil division direction (row direction X) of the solid-state imaging device 100 is coincident (not completely coincident, both are In other words, a device that changes the shape of an aperture through which light is incident on the solid-state imaging device 100 is used.
  • the diaphragm 2 one in which the incident angle range of light in the row direction X of the solid-state imaging device 100 changes as shown in FIG. 5 according to the F value is used.
  • an incident angle range 50 indicates a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is opened.
  • the incident angle ranges 52a and 52b indicate the range of the incident angle of light to the solid-state imaging device 100 in the row direction X when the stop 2 is a small stop.
  • Incident angle ranges 51a and 51b indicate the range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is between the full aperture and the small diaphragm.
  • the sensitivity centroid of the pixel cells 10 and 11 in the incident angle range 50 shown in FIG. 5 is a portion surrounded by a circle (solid line and broken line) in the figure, and substantially coincides with the peak sensitivity of the pixel cells 10 and 11.
  • the sensitivity centroid of the pixel cell 10 in the incident angle range 51a shown in FIG. 5 is a portion surrounded by a circle (solid line) in the figure, and substantially coincides with the peak sensitivity of the pixel cell 10.
  • the sensitivity centroid of the pixel cell 11 in the incident angle range 51b shown in FIG. 5 is a portion surrounded by a circle (broken line) in the figure, and substantially coincides with the peak sensitivity of the pixel cell 11.
  • the sensitivity centroid of the pixel cell 10 in the incident angle range 52a shown in FIG. 5 is a portion surrounded by a circle (solid line) in the figure, and substantially coincides with the peak sensitivity of the pixel cell 10.
  • the sensitivity centroid of the pixel cell 11 in the incident angle range 52b shown in FIG. 5 is a portion surrounded by a circle (broken line) in the figure, and substantially coincides with the peak sensitivity of the pixel cell 11.
  • the diaphragm 2 shown in FIG. 6 includes a movable diaphragm member 2a and a diaphragm member 2b.
  • FIG. 6A in FIG. 6 shows a state when the diaphragm 2 is open. As shown in FIG. 6A, the aperture 2 forms one opening 60 with respect to the pupil region H of the photographing lens 1 when opened.
  • FIG. 6B to FIG. 6D show a state when the diaphragm is gradually narrowed from the state of FIG. 6A, and shows a state when the FIG. 6D is a small diaphragm.
  • the aperture 2 is in a state in which two apertures 60a and 60b arranged in the row direction X with respect to the pupil region H are formed when the aperture 2 is reduced to some extent from the open position. Further, when the diaphragm 2 is further reduced, the openings 60a and 60b become smaller like FIG. 6C and FIG. 6D, respectively.
  • the incident angle range of light incident on the solid-state imaging device 100 through the opening 60 in the case of FIG. 6A is as indicated by reference numeral 50 in FIG.
  • the incident angle range of the light incident on the solid-state image sensor 100 through the opening 60a in the case of FIG. 6B is as indicated by the reference numeral 51a in FIG. 5, and the light incident on the solid-state image sensor 100 through the opening 60b.
  • the incident angle range is indicated by the reference numeral 51b in FIG.
  • the incident angle range of the light incident on the solid-state image sensor 100 through the opening 60a in the case of FIG. 6D is as indicated by the reference numeral 52a in FIG. 5, and the light incident on the solid-state image sensor 100 through the opening 60b.
  • the incident angle range is indicated by reference numeral 52b in FIG.
  • a diaphragm whose incident angle range corresponding to the F value changes as shown in FIG. 7 can be used.
  • incident angle ranges 70 a and 70 b indicate ranges of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is opened.
  • incident angle ranges 72a and 72b indicate ranges of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is a small diaphragm.
  • Incident angle ranges 71a and 71b indicate the range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is between the open and small diaphragms.
  • the sensitivity centroids are the portions surrounded by circles (solid lines) in the figure, and substantially coincide with the peak sensitivity of the image cell 10.
  • the sensitivity centroid of the pixel cell 11 in the incident angle range 70b shown in FIG. 7 the sensitivity centroid of the pixel cell 11 in the incident angle range 71b shown in FIG. 7, and the pixel cell in the incident angle range 72b shown in FIG.
  • the sensitivity centroid of 11 is a portion surrounded by a circle (broken line) in the figure, and substantially coincides with the peak sensitivity of the image cell 11.
  • the diaphragm 2 shown in FIG. 8 includes a movable diaphragm member 2a and a diaphragm member 2b.
  • FIG. 8A in FIG. 8 shows a state when the diaphragm 2 is open.
  • the aperture 2 forms two openings 80a and 80b with respect to the pupil region H of the photographing lens 1 when opened.
  • 8 show the state when the diaphragm 2 is gradually reduced from the state of FIG. 8A, and shows the state when the FIG. 8D is a small stop.
  • the incident angle range of light incident on the solid-state image sensor 100 through the opening 80a is as indicated by the reference numeral 70a in FIG. 7, and the incident light incident on the solid-state image sensor 100 through the opening 80b.
  • the angular range is indicated by reference numeral 70b in FIG.
  • the incident angle range of the light incident on the solid-state image sensor 100 through the opening 80a is as indicated by reference numeral 71a in FIG. 7, and the incident light incident on the solid-state image sensor 100 through the opening 80b.
  • the angular range is indicated by reference numeral 71b in FIG.
  • the incident angle range of the light incident on the solid-state image sensor 100 through the opening 80a is as indicated by the reference numeral 72a in FIG. 7, and the incident light incident on the solid-state image sensor 100 through the opening 80b.
  • the angular range is indicated by reference numeral 72b in FIG.
  • a diaphragm whose incident angle range corresponding to the F value changes as shown in FIG. 9 can be used.
  • an incident angle range 90 indicates a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is opened.
  • An incident angle range 92 indicates a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is a small diaphragm.
  • An incident angle range 91 indicates a range of incident angles of light to the solid-state imaging device 100 in the row direction X when the diaphragm 2 is between the full aperture and the small diaphragm.
  • the sensitivity centroid of the pixel cell 10 in each of the incident angle ranges 90, 91, and 92 shown in FIG. 9 is a portion surrounded by a circle (solid line) in the figure, and substantially coincides with the peak sensitivity of the pixel cell 10.
  • the sensitivity centroid of the pixel cell 11 in each of the incident angle ranges 90, 91, and 92 shown in FIG. 9 is a portion surrounded by a circle (broken line) in the figure, and almost coincides with the peak sensitivity of the pixel cell 11. To do.
  • the diaphragm 2 shown in FIG. 10 is constituted by a movable diaphragm member 2a and a diaphragm member 2b.
  • FIG. 10A in FIG. 10 shows a state when the diaphragm 2 is open. As shown in FIG. 10A, the aperture 2 forms one opening 101 larger than the pupil region H with respect to the pupil region H of the photographing lens 1 when opened.
  • FIG. 10B and FIG. 10C show a state when the diaphragm 2 is gradually reduced from the state of FIG. 10A, and show a state when the FIG.
  • the diaphragm 2 when the diaphragm 2 is squeezed to some extent from the open position, the length of the opening 101 in the column direction Y contracts, and the opening 101 becomes a shape elongated in the row direction X. That is, the diaphragm 2 forms an opening 101 having a longitudinal shape that crosses the pupil region H in the row direction X.
  • the diaphragm 2 when the diaphragm 2 is further reduced from the state of FIG. 10B, the length in the column direction Y of the openings 101 is further reduced.
  • the diaphragm 2 forms at least an opening in a portion overlapping the pupil region H in a line segment that bisects the pupil region H in the column direction Y.
  • the incident angle range of light incident on the solid-state imaging device 100 via the opening 101 is as indicated by reference numeral 90 in FIG.
  • the incident angle range of light incident on the solid-state imaging device 100 through the opening 101 is as indicated by reference numeral 91 in FIG.
  • the incident angle range of light incident on the solid-state imaging device 100 through the opening 101 in the state of FIG. 10C is as indicated by reference numeral 92 in FIG.
  • the sensitivity centroids and the peak sensitivities of the pixel cells 10 and 11 substantially match at any F value. Regardless of the value, good parallax can be obtained.
  • the configuration of the diaphragm shown in FIG. 10 all the light from the end to the end in the row direction X of the subject to be photographed can be incident on the solid-state imaging device 100. Therefore, it is possible to generate a stereoscopic image that can provide a good stereoscopic effect even in a special shooting scene in which the main subject spreads in the horizontal direction, such as a group photo.
  • FIG. 11 is a diagram showing a schematic configuration of a digital camera for explaining another embodiment of the present invention.
  • the digital camera shown in FIG. 11 is obtained by changing the aperture 2 of the digital camera shown in FIG. 1 to an aperture 2 ′ and adding an ND filter 3 and an ND drive unit 19.
  • the aperture 2 ′ includes a first aperture for a two-dimensional imaging mode that can be inserted into and removed from the optical path of the imaging lens 1 and a second aperture for a stereoscopic imaging mode.
  • the two-dimensional imaging mode is a mode in which the digital signal processing unit 17 generates and records one captured image data (two-dimensional image data) using each captured image signal of the pixel cell 10 and the pixel cell 11. .
  • the system control unit 11 that also functions as an imaging control unit retracts the second aperture from the optical path of the imaging lens 1 and inserts the first aperture in the optical path, and then the solid-state imaging device Control is performed to capture an image by 100.
  • the system control unit 11 causes the solid-state imaging device 100 to perform imaging with the first diaphragm retracted from the optical path of the photographing lens 1 and the second diaphragm inserted in the optical path. Take control.
  • the first diaphragm included in the diaphragm 2 ′ has an incident angle (absolute as a sensitivity centroid) of each of the pixel cells 10 and 11 in the incident angle range in the pupil division direction of light incident on the solid-state imaging device 100 through the diaphragm.
  • (Value) has an opening whose value is smaller than the incident angle (absolute value) that is the peak sensitivity of each of the pixel cells 10 and 11 in the pupil division direction of the solid-state imaging device 100.
  • FIG. 12A shows a configuration example of the first aperture in FIG.
  • An aperture 200 shown in FIG. 12A has an opening 200 a formed at the center of the pupil region H of the photographic lens 1.
  • the incident angle range of light incident on the solid-state imaging device 100 through the opening 200a is the same as the incident angle range 42 shown in FIG. 4, for example. That is, when imaging is performed by the solid-state imaging device 100 through the diaphragm 200, the incident angle serving as the sensitivity centroid of each of the pixel cells 10 and 11 approaches 0 °, and the pupil division performance is degraded.
  • the digital signal processing unit 17 that also functions as a two-dimensional image generation processing unit generates one captured image data by using these two captured image signals (for example, an output signal between pixel cells constituting a pair).
  • the captured image signal after the addition is processed to generate one captured image data), and natural captured image data without blur can be generated.
  • the second diaphragm included in the diaphragm 2 ′ includes the sensitivity centroid of each of the pixel cells 10 and 11 in the incident angle range in the pupil division direction of light incident on the solid-state image sensor 100 through the diaphragm, and the solid-state image sensor 100.
  • the pixel cells 10 and 11 in the pupil division direction are provided with apertures that substantially coincide with each other.
  • FIG. 12B and FIG. 12C A configuration example of the second aperture is shown in FIG. 12B and FIG. 12C in FIG.
  • the diaphragm 201 shown in FIG. 12B is formed so that the two openings 201a and 201b arranged in the row direction X overlap with the pupil region H of the photographing lens 1.
  • the stop 202 shown in FIG. 12C is formed so that the opening 202a long in the row direction X overlaps the pupil region H of the photographing lens 1.
  • the incident angle range of light incident on the solid-state imaging device 100 through the aperture 201a of the diaphragm 201 is the same as the incident angle ranges 52a and 52b shown in FIG. Further, the incident angle range of light incident on the solid-state imaging device 100 through the opening 202a of the diaphragm 202 is the same as the incident angle range 90 to 92 shown in FIG. 9, for example.
  • the digital signal processing unit 17 that also functions as a stereoscopic image generation processing unit generates stereoscopic image data having a favorable stereoscopic effect by generating one stereoscopic image data using the two captured image signals. be able to.
  • an ND filter 3 as a light amount adjustment unit is provided between the diaphragm 2 ′ and the solid-state image sensor 100.
  • the ND filter 3 is composed of, for example, an electrochromic element that can electrically control light transmittance.
  • the system control unit 11 issues a command to the ND filter driving unit 19, and the ND filter driving unit 19 adjusts the light transmittance of the ND filter 3 in accordance with this command.
  • the digital camera shown in FIG. 11 adjusts the amount of light incident on the solid-state imaging device 100 by the ND filter 3.
  • the solid-state imaging device 100 having the configuration shown in FIG. 2 is mounted, and the shape of the diaphragm 2 ′ is changed according to the shooting mode. It is possible to switch between shooting and two-dimensional shooting.
  • the aperture and the ND filter are mounted on a general digital camera. For this reason, according to the digital camera shown in FIG. 11, it is possible to realize a function of performing both stereoscopic photography and two-dimensional photography at a low cost.
  • the arrangement of the pixel cells of the solid-state imaging device 100 mounted on the digital camera shown in FIGS. 1 and 11 is not limited to that shown in FIG.
  • the even-numbered rows in which the pixel cells 11 are arranged may be a so-called honeycomb arrangement in which the odd-numbered rows in which the pixel cells 10 are arranged are shifted in the row direction X by 1/2 of the pixel cell arrangement pitch of each row. .
  • each pixel cell of the solid-state imaging device 100 may be a solid-state imaging device for monochrome imaging without mounting a color filter.
  • positions of the diaphragms 2 and 2 ′ may be in front of the photographing lens 1.
  • the disclosed stereoscopic image capturing apparatus includes a single photographing optical system including a photographing lens and a diaphragm that adjusts the amount of transmitted light by changing an aperture amount, and a single photographing that receives light passing through the photographing optical system.
  • the image pickup device includes a first pixel cell and a second pixel cell that photoelectrically convert light beams that have passed through different areas of the photographing optical system, and the first pixel. It is configured to generate a first image obtained from the output value of the cell and a second image obtained from the output value of the second pixel cell. Is characterized in that the light shielding amount in the direction orthogonal to the pupil division direction is larger than the light shielding amount in the pupil division direction.
  • the aperture forms one opening with respect to the pupil region of the photographing lens when opened, and the aperture value up to the minimum aperture is in the pupil division direction with respect to the pupil region.
  • One longitudinally shaped opening is formed.
  • the aperture forms two apertures arranged in the pupil division direction with respect to the pupil region of the photographing lens at any aperture value from the maximum aperture to the minimum aperture.
  • the aperture forms one opening with respect to the pupil region of the photographing lens when opened, and the aperture value up to the minimum aperture is in the pupil division direction with respect to the pupil region. Two side-by-side openings are formed.
  • a color filter is mounted on the first pixel cell arranged in two dimensions, and a color filter of the same color is mounted on the second pixel cell adjacent to the first pixel cell. Is done.
  • a color filter is mounted in a Bayer array in a first pixel cell arranged in two dimensions, and a color filter is arranged in a Bayer array in a second pixel cell arranged in two dimensions. Installed.
  • pupil division is performed by shifting the position of the light shielding film opening of the first pixel cell and the position of the light shielding film opening of the second pixel cell in the opposite directions.
  • the disclosed stereoscopic image capturing apparatus includes a single photographing optical system including a photographing lens, a diaphragm having a fixed aperture amount, and a light amount adjusting unit, and a single imaging element that receives light passing through the photographing optical system.
  • the imaging device includes a first pixel cell and a second pixel cell that photoelectrically convert light beams that have passed through different regions of the imaging optical system, and the first pixel cell A first image obtained from the output value and a second image obtained from the output value of the second pixel cell are configured to generate a first aperture and a first aperture that can be taken in and out of the optical path of the photographing lens.
  • the first diaphragm includes a maximum sensitivity of each of the first pixel cell and the second pixel cell in the incident angle range in the pupil division direction of light incident on the image sensor, and the first diaphragm.
  • Incident angle range in the pupil division direction of light incident on the image sensor via The center of the area surrounded by the sensitivity distribution waveform of each of the first pixel cell and the second pixel cell in the first pixel cell and the second diaphragm is a pupil of light incident on the image sensor through the second diaphragm
  • the size of the incident angle that is the center of gravity of the area surrounded by the sensitivity distribution waveforms of the first pixel cell and the second pixel cell in the incident angle range in the division direction is the first pixel cell and the second pixel.
  • Each cell has an aperture smaller than the angle of incidence for maximum sensitivity, processes the output values of the first and second pixel cells, and processes the output values of the first pixel cell.
  • First captured image data for generating the first image obtained in this way and second captured image data for generating the second image obtained by processing the output value of the second pixel cell Stereo image generation processing unit to be generated, output value of first pixel cell and second pixel
  • Stereo image generation processing unit to be generated, output value of first pixel cell and second pixel
  • the 2D image generation processing unit for generating 2D image data using the output value of the image and in the shooting mode for obtaining stereoscopic image data, in the shooting mode for obtaining 2D image data by inserting the first aperture in the optical path
  • an imaging control unit that inserts a second diaphragm into the optical path and causes the imaging device to perform imaging.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

L'invention concerne un dispositif d'imagerie qui peut obtenir une pluralité de données d'image ayant une parallaxe et peut maintenir des coûts de production. Un dispositif d'imagerie (10) a un système optique d'imagerie et un élément d'imagerie (100) qui reçoit une lumière qui est passée à travers ce système de lentille d'imagerie. Le système optique d'imagerie comprend une lentille d'imagerie (1) et une ouverture (2). L'élément d'imagerie (100) comprend des paires d'une première cellule de pixel et d'une seconde cellule de pixel (10, 11) qui réalisent une conversion photoélectrique d'un flux lumineux respectif qui est passé à travers différentes zones de la lentille d'imagerie (1), et ces paires sont agencées en deux dimensions. Une unité de traitement de signal numérique (17) du dispositif d'imagerie (10) traite les signaux d'image capturée provenant de chacune des cellules de pixel (10, 11) et génère des données d'image tridimensionnelle à partir des données d'image capturée obtenues par traitement du signal d'image capturée des cellules de pixel (10) et des données d'image capturée obtenues par traitement du signal d'image capturée des cellules de pixel (11). Même avec une ouverture (2) d'une valeur d'ouverture quelconque allant d'ouvert à une petite ouverture, le centre de gravité de sensibilité pour les cellules de pixel (10, 11) et la sensibilité maximale pour les cellules de pixel (10, 11) coïncident.
PCT/JP2012/072091 2011-09-29 2012-08-31 Dispositif d'imagerie tridimensionnelle Ceased WO2013047080A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-215641 2011-09-29
JP2011215641 2011-09-29

Publications (1)

Publication Number Publication Date
WO2013047080A1 true WO2013047080A1 (fr) 2013-04-04

Family

ID=47995128

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/072091 Ceased WO2013047080A1 (fr) 2011-09-29 2012-08-31 Dispositif d'imagerie tridimensionnelle

Country Status (1)

Country Link
WO (1) WO2013047080A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108777760A (zh) * 2018-07-25 2018-11-09 宁波舜宇光电信息有限公司 可变光圈结构、摄像模组以及电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001061165A (ja) * 1999-08-20 2001-03-06 Sony Corp レンズ装置及びカメラ
JP2002369223A (ja) * 2001-06-08 2002-12-20 Pentax Corp 画像検出装置と絞り装置
JP2006301473A (ja) * 2005-04-25 2006-11-02 Canon Inc 光学フィルタを有する光学系および撮影装置
JP2010016536A (ja) * 2008-07-02 2010-01-21 Panasonic Corp 静止画像及び動画像撮像装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001061165A (ja) * 1999-08-20 2001-03-06 Sony Corp レンズ装置及びカメラ
JP2002369223A (ja) * 2001-06-08 2002-12-20 Pentax Corp 画像検出装置と絞り装置
JP2006301473A (ja) * 2005-04-25 2006-11-02 Canon Inc 光学フィルタを有する光学系および撮影装置
JP2010016536A (ja) * 2008-07-02 2010-01-21 Panasonic Corp 静止画像及び動画像撮像装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108777760A (zh) * 2018-07-25 2018-11-09 宁波舜宇光电信息有限公司 可变光圈结构、摄像模组以及电子设备
CN108777760B (zh) * 2018-07-25 2024-05-10 宁波舜宇光电信息有限公司 可变光圈结构、摄像模组以及电子设备

Similar Documents

Publication Publication Date Title
US8558915B2 (en) Photographing apparatus and method
JP5227368B2 (ja) ３次元撮像装置
EP2618585B1 (fr) Dispositif d'imagerie monoculaire en 3d, procédé de correction d'ombrage pour dispositif d'imagerie monoculaire en 3d et programme pour dispositif d'imagerie monoculaire en 3d
CN103597811B (zh) 拍摄立体移动图像和平面移动图像的图像拍摄元件以及装配有其的图像拍摄装置
US20220260891A1 (en) Image sensor and image-capturing device that selects pixel signal for focal position
JP5923754B2 (ja) ３次元撮像装置
JP2011199755A (ja) 撮像装置
JP2012015819A (ja) 立体画像撮像装置
WO2012002430A1 (fr) Dispositif de capture d'images stéréoscopiques
CN104508531A (zh) 拍摄元件和拍摄装置
JP2010154310A (ja) 複眼カメラ及び撮影方法
JP5525109B2 (ja) 撮像装置
WO2012169301A1 (fr) Dispositif de capture d'image imageant une image mobile tridimensionnelle et une image mobile bidimensionnelle, et appareil de capture d'image sur lequel est monté un dispositif de capture d'image
JP5611469B2 (ja) 立体撮像装置および方法
WO2013018471A1 (fr) Dispositif de formation d'image
JP5634614B2 (ja) 撮像素子及び撮像装置
WO2013047080A1 (fr) Dispositif d'imagerie tridimensionnelle
JP5907668B2 (ja) 撮像装置及び撮像素子
JP2012015820A (ja) 立体映像表示装置及び立体映像表示方法
WO2012117619A1 (fr) Dispositif d'imagerie 3d
JP2018026373A (ja) 撮像装置
JP6255753B2 (ja) 画像処理装置および撮像装置
JP2012063456A (ja) 撮像装置
JP2011077680A (ja) 立体撮影装置および撮影制御方法
JP2014215526A (ja) 撮像素子およびカメラ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12836119

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12836119

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP