JP6664121B2 - Imaging device and camera - Google Patents

Description

  The present invention relates to an imaging device that captures an image of a subject as image information by photoelectric conversion, and a camera including the imaging device.

  2. Description of the Related Art Conventionally, an imaging device that captures an image using an image sensor is known (for example, see Patent Document 1).

JP 2008-042180 A

  In an imaging device that continuously acquires images by a rolling shutter operation, for example, an unusual image in which the lower area of the image becomes whiter than the upper area of the image due to a sudden event occurring in the subject such as a flash. Certain band images can occur.

  Therefore, an object of the present disclosure is to provide an imaging device that can create an image in place of a band image when a band image is likely to occur.

  An imaging device according to an aspect of the present disclosure includes a photoelectric conversion element that is arranged in a matrix and converts an image of a subject into electric charge, a storage unit that stores the electric charge converted by each of the photoelectric conversion elements, The charge information indicating the amount of charge stored in each of the sections is obtained for each frame as frame information by a rolling shutter operation, and the charge information during exposure before obtaining the frame information is non-destructively stored as intermediate storage information. An information acquisition unit for acquiring, and a new information creation unit for creating new frame information based on the frame information and the intermediate accumulation information included in the continuous first and second frames.

  According to the imaging device according to the present disclosure, it is possible to provide a moving image that does not include a band image.

FIG. 1 is a block diagram illustrating an overall configuration of a camera including the imaging device according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration of an imaging device including a plurality of photoelectric conversion elements and a storage unit. FIG. 3 is a plan view of the photoelectric conversion element according to the first embodiment. FIG. 4 is a side view of the photoelectric conversion element according to the first embodiment. FIG. 5 is a block diagram illustrating a configuration of the pixel circuit according to the first embodiment. FIG. 6 is a diagram illustrating a generation state of a band image. FIG. 7 is a diagram illustrating a state in which new frame information of the first frame according to the first embodiment is created. FIG. 8 is a diagram showing a state in which new frame information of the first frame according to the first embodiment is created. FIG. 9 is a diagram showing a state in which new frame information of the first frame according to the second embodiment is created. FIG. 10 is a diagram illustrating a state in which new frame information of a second frame according to the second embodiment is created. FIG. 11 is a perspective view of a digital still camera according to a modification. FIG. 12 is a perspective view of a video camera according to a modification.

  An imaging device according to an aspect of the present disclosure includes a photoelectric conversion element that is arranged in a matrix and converts an image of a subject into electric charge, a storage unit that stores the electric charge converted by each of the photoelectric conversion elements, The charge information indicating the amount of charge stored in each of the sections is obtained for each frame as frame information by a rolling shutter operation, and the charge information during exposure before obtaining the frame information is non-destructively stored as intermediate storage information. An information acquisition unit for acquiring, and a new information creation unit for creating new frame information based on the frame information and the intermediate accumulation information included in the continuous first and second frames.

  This imaging apparatus can create new frame information in which a sudden event is reflected on the entire image by adjusting frame information that has become a band image based on information accumulated in the middle of a frame before or after the frame. it can.

  Further, for example, the new information creating unit may create new frame information by adding the intermediate accumulation information of the second frame to the frame information of the first frame and adjusting a gain.

  According to this, new frame information can be created without deteriorating the S / N ratio.

  Also, for example, the new information creating unit creates new frame information by adding a difference between the frame information of the first frame and the intermediate accumulation information to the frame information of the second frame and adjusting a gain. You may.

  According to this, new frame information can be created for the subsequent frames without deteriorating the S / N ratio.

  Further, for example, the new information creating unit further adjusts a gain by further adding a difference between the frame information of the third frame immediately before the first frame and the intermediate storage information to the frame information of the first frame. To create new frame information.

  According to this, it is possible to create new frame information in which the time barycenter position is not shifted.

  Further, for example, the new information creating unit further adds the intermediate storage information of a fourth frame that is a frame immediately after the second frame to the frame information of the second frame, adjusts a gain, and generates new frame information. May be created.

  According to this, it is possible to create new frame information for the subsequent frame without further displacement of the time barycenter position.

  Further, for example, further comprising a detecting means for detecting a band image in which a sudden event occurring suddenly in the subject is reflected in the latter half of the frame information of the first frame, wherein the new information creating unit includes When a band image is detected by the means, new frame information of at least the first frame in which the band image has occurred may be created.

  This makes it possible to change only the frame information of the frame in which the band image has occurred.

  Further, for example, the photoelectric conversion element may include an organic thin film as a photoelectric conversion member.

  This makes it possible to effectively acquire intermediate storage information, and to effectively process frame information of a frame in which a band image has occurred.

  Hereinafter, embodiments will be described in detail. Each of the embodiments described below shows a preferred specific example of the present disclosure. Numerical values, shapes, materials, constituent elements, arrangement positions and connection forms of constituent elements, steps, order of steps, and the like shown in the following embodiments are merely examples, and do not limit the present disclosure. The present disclosure is limited only by the claims. Therefore, among the components in the following embodiments, components not described in the independent claims of the present disclosure are not necessarily required to achieve the subject of the present disclosure, but constitute more preferable embodiments. Described as

[overall structure]
(Embodiment 1)
FIG. 1 is a block diagram illustrating an overall configuration of a camera including an imaging device according to an embodiment.

  As shown in FIG. 1, an imaging apparatus 100 forms an image of a subject on the surface of a photoelectric conversion element 102 by an optical system 101 and creates image information based on the amount of electric charge accumulated for each pixel by photoelectric conversion. And includes a storage unit 103, an information acquisition unit 104, and a new information creation unit 105. In the case of the present embodiment, the imaging device 100 further includes a detection unit 106 and a storage device 107.

  In the case of the present embodiment, the information acquisition unit 104, the new information creation unit 105, and the detection unit 106 are processing units realized by the control device 200 executing a program. The control device 200 includes, for example, a memory that stores a program and a processor that executes the program stored in the memory.

[Optical system 101]
The optical system 101 is a combination of optical members for forming an image of a subject on a surface of the photoelectric conversion elements 102 arranged in a matrix. For example, in addition to a lens and a mirror, an aperture blade, a mechanical shutter, a focus It is configured by combining optional optical members such as an adjustment drive mechanism and a camera shake prevention mechanism.

[Photoelectric conversion element 102]
The photoelectric conversion elements 102 are elements that are arranged in a matrix and convert light at each location where an image of a subject formed on the surface by the optical system 101 is formed into electric charges.

  FIG. 2 is a block diagram illustrating a configuration of an imaging device including a plurality of photoelectric conversion elements and a storage unit.

  As shown in the figure, the imaging element 110 includes a photoelectric conversion element 102, a pixel circuit array 120, a readout circuit 121, an output circuit 122, a row scanning circuit 123, a timing control circuit 124, and a voltage application circuit 125. And

  FIG. 3 is a plan view of the photoelectric conversion element.

  FIG. 4 is a side view of the photoelectric conversion element.

  As shown in these drawings, the photoelectric conversion element 102 includes a thin film-shaped photoelectric conversion member 126, a transparent electrode 127 that is in close contact with one surface of the photoelectric conversion member 126, and an N that is in close contact with the other surface of the photoelectric conversion member 126. It is configured to include N × M pixel electrodes 128 arranged in a two-dimensional array of rows and M columns (N and M are integers of 1 or more).

[Photoelectric conversion member 126]
The photoelectric conversion member 126 generates a charge due to the internal photoelectric effect by receiving light in a state where a voltage in a first predetermined range not including 0 V is applied, and generates a charge due to an internal photoelectric effect in a state where a voltage in a second predetermined range including 0 V is applied. It is a member that does not generate charges due to the internal photoelectric effect even when light is received.

  Here, a description will be given on the assumption that the photoelectric conversion member 126 is an organic thin film having the above characteristics. That is, this embodiment is an example in which the imaging element 110 is an organic CMOS image sensor using an organic thin film as a photoelectric conversion member.

  In the case of this embodiment, the photoelectric conversion member 126 is formed of one thin film in one imaging element 110, but a portion overlapping with one pixel electrode 128 functions as one photoelectric conversion element 102. I have.

[Transparent electrode 127]
The transparent electrode 127 is an electrode to which a voltage that causes a potential difference including zero to be applied to the pixel electrode 128 is applied, and transmits light that forms an image of a subject formed on the surface of the photoelectric conversion member 126 by the optical system 101. It has transparency.

[Pixel electrode 128]
The pixel electrode 128 is an electrode that is disposed in close contact with the surface opposite to the transparent electrode 127 with respect to the photoelectric conversion member 126, and is an electrode to which a voltage that causes a positive potential difference with respect to the transparent electrode 127 is applied. . The pixel electrodes 128 are a plurality of electrodes arranged in a two-dimensional array of N rows and M columns on the other surface of one photoelectric conversion member 126, and adjacent pixel electrodes 128 are arranged at predetermined intervals, The surfaces of the photoelectric conversion members 126 are insulated from each other.

  When a charge is generated in the photoelectric conversion member 126 during a period in which a voltage causing a positive potential difference with respect to the transparent electrode 127 is applied to the pixel electrode 128, the charge is generated in the region of the photoelectric conversion member 126 overlapping the pixel electrode 128 and in the region. A positive charge is collected among charges generated in the vicinity.

  Further, in accordance with the voltage applied to the transparent electrode 127 and the pixel electrode 128, the amount of charge generated in the photoelectric conversion member 126 changes, and the amount of charge collected by the transparent electrode 127 also changes. Therefore, the exposure can be adjusted by the applied voltage without using a mechanical member such as an aperture blade.

[Pixel circuit array]
As shown in FIG. 2, the pixel circuit array 120 is a semiconductor device in which N × M pixel circuits 129 corresponding to the pixel electrodes 128 are arranged in a two-dimensional array of N rows and M columns. The pixel circuit 129 is arranged on the pixel electrode 128 side of each photoelectric conversion element 102 so as to overlap with the photoelectric conversion element 102.

  FIG. 5 is a block diagram illustrating a configuration of a pixel circuit.

  As shown in the figure, the pixel circuit 129 includes a reset transistor 191, an amplification transistor 192, a selection transistor 193, and a storage unit 103.

[Accumulation unit 103]
The accumulation unit 103 is a so-called charge accumulation node that accumulates the electric charge converted by each of the photoelectric conversion elements 102, and includes a pixel electrode 128 corresponding to the pixel circuit 129 to which the accumulation unit 103 belongs, a source of the reset transistor 191, and an amplification transistor 192. And a capacitor that stores the positive charges collected by the connected pixel electrode 128.

[Reset transistor 191]
The reset transistor 191 has a gate connected to the reset signal line 194, a drain supplied with the reset voltage VRST, and a source connected to the storage unit 103.

  The reset transistor 191 is turned on by a reset signal delivered from a row scanning circuit 123 (described later) via a reset signal line 194, thereby resetting (initializing) the amount of charge accumulated in the accumulation unit 103. .

  Here, in the description and the claims, the term “exposure period” is used to mean a period from the time when the storage unit 103 is reset to the time when it is reset next time. Further, the phrase “during exposure” is used to mean an arbitrary timing within the exposure period. In other words, the term “exposure” is not used to mean that some member is exposed to light, but rather a series of operations until frame information indicating one desired image is obtained. Is used to mean.

  In the case of the rolling shutter operation, the exposure time is such that the start time and the end time are sequentially shifted for each row of the photoelectric conversion element 102, and the time included in the exposure period for one frame and the exposure time for the next frame are different. The time included in the period may coincide.

[Amplification transistor 192]
The amplification transistor 192 has a gate connected to the storage unit 103, a drain supplied with the power supply voltage VDD, and a source connected to the drain of the selection transistor 193.

  A voltage corresponding to the charge stored in the storage unit 103 is applied to the gate of the amplification transistor 192, and the voltage serves as charge information.

Therefore, when the selection transistor 193 is turned on, a current corresponding to the charge accumulated in the accumulation unit 103 flows in the amplification transistor 192, and the charge information can be output as a current value. Since the output of the charge information does not affect the amount of charge stored in the storage unit 103, the amount of charge in the storage unit 103 can be read nondestructively [select transistor 193].
The selection transistor 193 has a gate connected to the selection signal line 195, a drain connected to the source of the amplification transistor 192, and a source connected to the vertical signal line 196.

  The selection transistor 193 outputs a current flowing through the amplification transistor 192 to the vertical signal line 196 by being turned on by a selection signal delivered from a row scanning circuit 123 (described later) via a selection signal line 195.

  As described later, when the amount of current output to the vertical signal line 196 is detected by a column readout circuit 197 (described later), the storage unit of the pixel circuit 129 including the selection transistor 193 turned on by the selection signal. The amount of charge stored in 103 is read.

  With the above structure, the pixel circuit 129 can sequentially read out the amount of charge accumulated in the accumulation unit 103 in a non-destructive manner.

[Row scanning circuit 123]
As shown in FIG. 2, the row scanning circuit 123 has both an accumulated charge amount reset function and a readout pixel circuit selection function.

[Accumulated charge reset function]
The accumulated charge amount reset function is performed in the pixel circuit array 120 in order from a row farthest from the readout circuit 121 (first row) to a row closest to the readout circuit 121 (Nth row). At a predetermined time t1 interval, a reset signal for resetting the positive charge accumulated in the accumulation unit 103 in each of the pixel circuits 129 belonging to the corresponding row is set to a reset signal line 194 connected to each of the pixel circuits 129 belonging to the corresponding row. This is the function to deliver via.

  As a result, the reset of the charges accumulated in the accumulation units 103 of all the pixel circuits 129 included in the pixel circuit array 120 is sequentially executed in row units from the first row to the Nth row.

[Readout pixel circuit selection function]
The readout pixel circuit selection function is to turn on the selection transistor 193 in each of the pixel circuits 129 belonging to the row in the pixel circuit array 120 in order from the first row to the Nth row, one row at a time, at intervals of t1. Is transmitted via a selection signal line 195 connected to each of the pixel circuits 129 belonging to the corresponding row.

  As a result, the reading of the charge amounts stored in the storage units 103 of all the pixel circuits 129 included in the pixel circuit array 120 is sequentially executed in row units from the first row to the Nth row.

  In the case of the rolling shutter operation, when the reading of the n-th row (n is a natural number equal to or less than N) ends, the n-th row is reset, and the exposure of the n-th row for the next frame starts. This operation is sequentially performed for each row.

[Readout circuit 121]
The readout circuit 121 reads out the amount of charge accumulated in each of the pixel circuits 129 included in the pixel circuit array 120.

  The readout circuit 121 includes M column readout circuits 197 corresponding to each of the M columns of the pixel circuit array 120.

[Column reading circuit 197]
The column reading circuit 197 includes a pixel circuit 129 including a selection transistor 193 which is turned on by a selection signal via a vertical signal line 196 connected to each of the pixel circuits 129 belonging to the corresponding column. Is also referred to as a “read-out image pixel circuit 129”). Thus, the amount of charge stored in the storage unit 103 of the read-out image pixel circuit 129 can be read out. The current value indicating the amount of the read charge is converted into a digital signal of K bits (K is a positive integer, for example, 8), and is output as charge information of the read-out image pixel circuit 129.

[Output circuit 122]
The output circuit 122 outputs the charge information output from the column reading circuit 197 to the outside. The charge information corresponding to each of the pixel circuits 129 in N rows and M columns is one image information. Further, since the charge information can be read out in a non-destructive manner, it is also possible to output information during the exposure to the outside as intermediate storage information.

[Voltage application circuit 125]
The voltage application circuit 125 applies a voltage to the photoelectric conversion element 102. More specifically, the voltage application circuit 125 applies a voltage to the transparent electrode 127 with respect to the pixel electrode 128. Further, the voltage application circuit 125 can adjust the voltage applied to the transparent electrode 127. Therefore, the exposure can be adjusted by the voltage application circuit 125 and also functions as an electronic shutter.

[Timing control circuit 124]
The timing control circuit 124 controls the operation timing of the row scanning circuit 123 and the operation timing of the read circuit 121. Further, the timing control circuit 124 may control the operation timing of the voltage application circuit 125. That is, the timing control circuit 124 controls the timing at which the row scanning circuit 123 executes the accumulated charge amount reset function and the timing at which the readout pixel circuit selection function is executed, and is selected by the selection signal from the readout circuit 121. The timing at which the amount of charge stored in the storage unit 103 of the pixel circuit 129 is read is controlled. Further, the timing control circuit 124 can control the voltage application timing to the photoelectric conversion element 102 by the voltage application circuit 125 so that the voltage application circuit 125 can function as a shutter. Further, the exposure can be adjusted by repeating the on and off of the voltage application to the photoelectric conversion element 102 during the exposure period.

[Information acquisition unit 104]
The information acquisition unit 104 acquires charge information indicating the amount of charge stored in the storage unit 103 provided for each of the photoelectric conversion elements 102 on a one-to-one basis for N rows and M columns by a rolling shutter operation, and converts the frame information into a frame. A processing unit that acquires charge information during exposure before acquiring frame information for each of N rows and M columns, and uses the acquired charge information as intermediate accumulation information.

  In the case of the present embodiment, the information acquisition unit 104 acquires each row output from the output circuit 122 and constructs frame information for each frame. Further, the frame information is sequentially connected for each frame to be one moving image information, and is stored in a storage device 107 such as a flash memory, for example. Further, the information acquisition unit 104 stores the intermediate storage information in a ring memory or the like. The information obtaining unit 104 holds a plurality of pieces of intermediate storage information obtained at each stage obtained in one frame until at least frame information of the next frame is obtained.

  Note that the intermediate storage information is image information obtained during a period from when the storage unit 103 is refreshed to when the frame information is obtained, and the light amount (luminance) of each pixel is calculated based on the light amount of the corresponding pixel in the frame information. Is also small. Also, when acquiring the intermediate storage information a plurality of times, the charge amounts are integrated. That is, the light amount of each pixel is integrated for each pixel. Specifically, for example, as shown in FIG. 6, when three pieces of intermediate accumulation information are acquired such that the intervals of the time centers of gravity of the intermediate information (described later) are equal in one frame, the intermediate accumulation information A obtained first is obtained. Assuming that the light amounts of the respective pixels are integrated and the intermediate information a is obtained, the light amount of the subsequently acquired intermediate accumulation information B is a value obtained by adding the intermediate information b to the intermediate information a. The light quantity of the subsequently stored intermediate information C is a value obtained by adding the intermediate information b and the intermediate information c to the intermediate information a. Therefore, the frame information is D in the figure and is a value obtained by adding the intermediate information a, the intermediate information b, the intermediate information c, and the intermediate information d.

  In the case of the present embodiment, the information acquisition unit 104 gives an instruction to read out the amount of charge accumulated in the accumulation unit 103 of each pixel circuit 129 to the timing control circuit 124, and outputs N from the output circuit 122. The charge information for the row M columns is acquired. The information acquisition unit 104 is performed once or a plurality of times until the instruction for reading out the amount of charge is reset.

[Detection unit 106]
The detection unit 106 is a processing unit that detects a band image in which a sudden event that occurs suddenly in a subject is reflected only in the second half of the frame information of the first frame.

  Here, the sudden event means an event that occurs suddenly in the subject, and as shown in FIG. 6, the sudden event 202 occurs after the reset of the first row of one frame or N rows. This means that the state of the subject changes over almost the entire subject instantaneously until the reset ends. More specifically, an instantaneous event, such as a case where a flash hits a subject, suddenly starts and then returns immediately, is also a sudden event 202, and a high-speed moving object (such as a car) is placed in front of the subject. Suddenly starts and passes for a certain period of time, or a sudden change in the color of the subject itself suddenly starts and continues for a plurality of frames. . In addition, the specification and the claims are described as including in the sudden event the case where the direction of the optical system 101 is suddenly moved. In the present embodiment, a description will be given assuming that the sudden event 202 is a flash event. In this case, the band image may be called a flash band.

  In the case of the present embodiment, the detection unit 106 acquires the frame information from the information acquisition unit 104, and obtains the first information 211 (FIG. 6) which is a part of the information acquired in the latter half by the rolling shutter operation from the frame information. ) Indicates a so-called overexposed state (a state in which all pixels have a light amount equal to or greater than a threshold), further obtains second information 212 that is a part of information obtained in the first half, and If it is determined that the information 212 is not in the overexposed state, it is determined that a band image has occurred, and information indicating the fact is transmitted to the new information creating unit 105.

  Note that the detection method of the band image by the detection unit 106 is not limited to the above, and any method can be adopted. For example, the first information 211 and the second information 212 may be acquired for each frame, and if the difference between them is equal to or greater than a threshold, it may be determined that a band image has occurred. Also, it may be determined that a band image has occurred by comparing the latter half of the intermediate information d with the latter half of the intermediate information c.

  Further, the detection unit 106 detects the second band image in which the sudden event occurring suddenly in the subject is an instantaneous event and is reflected only in the first half of the frame information of the second frame following the first frame. It may be detected.

  In this case, for example, similarly to the case of the first frame, the detection unit 106 acquires the frame information of the second frame from the information acquisition unit 104, and detects the information acquired in the first half by the rolling shutter operation from the frame information. When the third information 213 (see FIG. 6) that is a part indicates a so-called overexposed state, the fourth information 214 that is a part of the information acquired in the latter half is further acquired, and the fourth information 214 is acquired. If it is determined that the band image is not overexposed, a band image may also be generated in the second frame, and information indicating that may be transmitted to the new information creating unit 105.

[New information creation unit 105]
The new information creating unit 105 is, for example, a processing unit that creates new frame information based on the frame information included in the continuous first and second frames F1 and F2 and the intermediate storage information.

  In the case of the present embodiment, the new information creation unit 105 creates new frame information that is not a band image, Replace with frame information.

  Specifically, as shown in FIG. 6, when a band image has occurred in the first frame F1 due to an instantaneous sudden event 202, the new information creating unit 105, as shown in FIG. The halfway accumulated information A of the second frame F2 (same as the halfway information a in the present embodiment) is added to the frame information D of F1. As a result, the light amount corresponding to the first frame F1 is larger than the light amount actually photoelectrically converted. Therefore, the gain is adjusted so that the light amount becomes 4/5 as a whole, and new frame information is created. The old frame information is replaced with the new frame information as the frame information.

  Further, since the band image is also generated in the second frame F2, the new information creating unit 105 adds the frame information D of the first frame F1 to the frame information D of the second frame F2 as shown in FIG. The intermediate information d which is a difference from the accumulated information C is added. In this case as well, since the light amount of the second frame F2 increases by the amount of the intermediate information d, new frame information D is created with 4/5 gain and replaced as the frame information of the second frame F2.

[Effects]
As described above, according to the imaging apparatus 100, since the frame information of the frame in which the band image has occurred is replaced with new frame information based on the intermediate storage information, moving image information that does not cause a sense of incongruity even when a sudden event occurs in the subject is created. It is possible to do.

  In addition, since new frame information is created based on the intermediate storage information before acquiring the frame information of the next frame, even when a sudden event occurs a plurality of times in a short time, moving image shooting can be performed without delay.

  Further, since the gain is adjusted in the direction of reducing the light amount by synthesizing the frame information and the intermediate storage information, it is possible to create frame information having a good S / N ratio without emphasizing noise included in the frame information.

(Embodiment 2)
Subsequently, another embodiment of the imaging device 100 will be described. Note that parts (portions) having the same functions and functions, and the same shapes, mechanisms, and structures as those in the first embodiment are denoted by the same reference numerals, and description thereof may be omitted.

  In the case of the present embodiment, only the new information creation unit 105 is different from that of the first embodiment, and thus the new information creation unit 105 will be described.

[New information creation unit 105]
For example, as shown in FIG. 7, when the new frame information is created by combining the frame information of the first frame F1 with the intermediate information of the second frame F2, the center of gravity of the image of the new frame information becomes the old one. It will deviate from the center of gravity of the image in the frame information.

  Therefore, when the new information creating unit 105 according to the present embodiment obtains information indicating the occurrence of a band image from the detecting unit 106, the new information creating unit 105 combines the frame information where the band image has occurred with the intermediate information of the previous and subsequent frames. By adjusting the gain, new frame information that is not a band image is created and replaced with old frame information.

  When a band image is generated in the first frame F1 due to the instantaneous sudden event 202, the new information creating unit 105 adds the immediately following second frame F2 to the frame information D of the first frame F1, as shown in FIG. (The same as the intermediate information a in the present embodiment) and the immediately preceding third frame F3. As a result, frame information in which the entire image is overexposed is created without shifting the time center of gravity of the newly created frame information. Since the light amount corresponding to the first frame F1 is larger than the light amount actually photoelectrically converted, the gain is adjusted so that the light amount becomes 4/6 as a whole, and new frame information is created. The old frame information is replaced with the new frame information as the frame information.

  If a band image is also generated in the second frame F2, the new information creating unit 105 adds the frame information D of the first frame F1 to the frame information D of the second frame F2 as shown in FIG. The intermediate information d which is the difference between the intermediate information d and the intermediate accumulated information C and the intermediate accumulated information A of the immediately following fourth frame F4 (the same as the intermediate information a in the present embodiment) are added. Also in this case, since the light amount of the second frame F2 increases by the amount of the intermediate information d and the intermediate information a, new frame information D is created with 4/6 gain and replaced as the frame information of the second frame F2.

[Effects]
As described above, according to the imaging apparatus 100 of the present embodiment, in addition to the effects of the imaging apparatus 100 of the first embodiment, a new frame is generated based on intermediate storage information of frames before and after a frame in which a band image occurs. To create information, there is no shift between the time barycenter position of the old frame information and the time barycenter position of the new frame information, and even if a sudden event occurs in the subject, create moving image information that does not make the movement of the subject uncomfortable Becomes possible.

  In this embodiment, the case of overexposure has been described. However, a remarkable effect of this embodiment can be obtained when the outline of the subject is captured as frame information, such as when the subject suddenly moves. appear.

(Supplement)
As described above, two embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which changes, replacements, additions, omissions, and the like are made as appropriate.

  In the embodiment, the imaging device 100 generates an electric charge due to the internal photoelectric effect when the photoelectric conversion member 126 receives light in a state where a voltage is applied, and generates an electric charge due to the internal photoelectric effect even when light is received in a state where no voltage is applied. It has been described that the organic thin film has a function of not generating a charge.

  However, the photoelectric conversion member 126 is not necessarily limited to the organic thin film as long as it is a member that can control whether or not charges are generated by the internal photoelectric effect by an applied voltage. As an example, the imaging device 100 may include an example in which the photoelectric conversion member 126 is a diode having a PN junction surface.

  Needless to say, the present disclosure also includes an electronic device in which the imaging device 100 according to the embodiment is built.

  As shown in FIG. 1 and FIG. 11, a camera 300 which is an example of an electronic device in which the imaging device 100 is built is also included.

  Further, the imaging device 100 may be provided in a video camera 400 as shown in FIG.

  Also, the case where the intermediate storage information is acquired three times in one frame has been described, but the present invention is not limited to this, and the intermediate storage information may be acquired once or multiple times. In addition to the case where the intermediate storage information is acquired evenly in terms of time, before and after reset, the intermediate storage information may be acquired at an arbitrary timing, such as acquiring the intermediate accumulation information with a shorter time interval.

  Also, a case has been described in which the new frame information is created based on the detection of the band image by the detection unit 106, but the present invention is not limited to this. For example, when the imaging apparatus 100 is changed to the band image constant removal mode based on instruction information from a photographer or the like, during the mode, the new information creating unit 105 applies new frame information to any frame. May be created and replaced with the old frame information to create the moving image information.

  Each component (functional block) in the imaging device 100 may be individually formed into one chip by a semiconductor device such as an IC (Integrated Circuit) or an LSI (Large Scale Integration), or may include a part or the whole. May be integrated into one chip. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. After manufacturing the LSI, an FPGA (Field Programmable Gate Array) that can be programmed or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used. Furthermore, if an integrated circuit technology that replaces the LSI appears due to the progress of the semiconductor technology or another derived technology, the functional blocks may be integrated using the technology. Application of biotechnology and the like are possible.

  In addition, all or a part of the above various processes may be realized by hardware such as an electronic circuit, or may be realized by using software. Note that the processing by software is realized by a processor included in the imaging apparatus 100 executing a program stored in a memory. Further, the program may be recorded on a recording medium and distributed or distributed. For example, by installing a distributed program on a device having another processor and causing the processor to execute the program, the device can perform the above-described processing.

  Further, a mode realized by arbitrarily combining the components and functions described in the above-described embodiments is also included in the scope of the present disclosure.

  INDUSTRIAL APPLICATION This indication is widely applicable to the imaging device which images an image.

REFERENCE SIGNS LIST 100 imaging device 101 optical system 102 photoelectric conversion element 103 storage unit 104 information acquisition unit 105 new information creation unit 106 detection unit 107 storage device 110 imaging device 120 pixel circuit array 121 readout circuit 122 output circuit 123 row scanning circuit 124 timing control circuit 125 Voltage application circuit 126 Photoelectric conversion member 127 Transparent electrode 128 Pixel electrode 129 Pixel circuit 191 Reset transistor 192 Amplification transistor 193 Selection transistor 194 Reset signal line 195 Selection signal line 196 Vertical signal line 197 Column readout circuit 200 Control device 202 Sudden event 211 First Information 212 second information 213 third information 214 fourth information 300 camera 400 video camera

Claims (8)

A photoelectric conversion element that is arranged in a matrix and converts an image of a subject into electric charges;
A storage unit for storing the charge converted by each of the photoelectric conversion elements,
The charge information indicating the amount of charge stored in each of the storage units is obtained as frame information by a rolling shutter operation for each frame, and the charge information during exposure before the acquisition of the frame information is not stored as intermediate storage information. An information acquisition unit acquired by destruction,
An imaging apparatus comprising: a first information generating unit that generates new frame information based on the frame information included in a continuous first frame and the second frame and the intermediate storage information. The new information creation unit,
The imaging device according to claim 1, wherein the intermediate information accumulated in the second frame is added to the frame information of the first frame to adjust a gain to create new frame information. The new information creation unit,
The imaging apparatus according to claim 1, wherein a difference between the frame information of the first frame and the intermediate storage information is added to the frame information of the second frame, and a gain is adjusted to create new frame information. The new information creation unit,
3. The method according to claim 2, wherein a difference between the frame information of the third frame immediately before the first frame and the intermediate information is further added to the frame information of the first frame and a gain is adjusted to create new frame information. An imaging device according to any one of the preceding claims. The new information creation unit,
The imaging apparatus according to claim 3, wherein the intermediate information of the fourth frame that is a frame immediately after the second frame is further added to the frame information of the second frame, and a gain is adjusted to create new frame information. A sudden event occurring suddenly in the subject further includes a detecting unit that detects a band image reflected in the latter half of the frame information of the first frame,
The new information creation unit,
The imaging device according to claim 1, wherein when detecting a band image, the detecting unit creates at least new frame information of the first frame in which the band image has occurred. The photoelectric conversion element,
The imaging device according to any one of claims 1 to 6, further comprising an organic thin film as the photoelectric conversion member. An imaging device according to any one of claims 1 to 7,
An optical system that forms an image of a subject on the photoelectric conversion element.

Images