US20240302504A1 - Photodetection device and photodetection system - Google Patents
Photodetection device and photodetection system Download PDFInfo
- Publication number
- US20240302504A1 US20240302504A1 US18/254,707 US202118254707A US2024302504A1 US 20240302504 A1 US20240302504 A1 US 20240302504A1 US 202118254707 A US202118254707 A US 202118254707A US 2024302504 A1 US2024302504 A1 US 2024302504A1
- Authority
- US
- United States
- Prior art keywords
- light
- count
- count values
- photodetection
- threshold
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 claims abstract description 176
- 238000001514 detection method Methods 0.000 claims description 52
- 230000008859 change Effects 0.000 claims description 47
- 239000004065 semiconductor Substances 0.000 claims description 41
- 239000000758 substrate Substances 0.000 claims description 40
- 102100022052 Cyclin N-terminal domain-containing protein 1 Human genes 0.000 description 147
- 101000900815 Homo sapiens Cyclin N-terminal domain-containing protein 1 Proteins 0.000 description 147
- 238000012986 modification Methods 0.000 description 58
- 230000004048 modification Effects 0.000 description 58
- 238000010586 diagram Methods 0.000 description 51
- 238000003384 imaging method Methods 0.000 description 46
- 239000013256 coordination polymer Substances 0.000 description 29
- 238000005259 measurement Methods 0.000 description 17
- 238000005516 engineering process Methods 0.000 description 13
- 238000012937 correction Methods 0.000 description 8
- 230000000630 rising effect Effects 0.000 description 8
- 230000007423 decrease Effects 0.000 description 6
- 230000003247 decreasing effect Effects 0.000 description 6
- 238000000034 method Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 4
- 102100034033 Alpha-adducin Human genes 0.000 description 3
- 102100027417 Cytochrome P450 1B1 Human genes 0.000 description 3
- 101000799076 Homo sapiens Alpha-adducin Proteins 0.000 description 3
- 101000725164 Homo sapiens Cytochrome P450 1B1 Proteins 0.000 description 3
- MKYBYDHXWVHEJW-UHFFFAOYSA-N N-[1-oxo-1-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)propan-2-yl]-2-[[3-(trifluoromethoxy)phenyl]methylamino]pyrimidine-5-carboxamide Chemical compound O=C(C(C)NC(=O)C=1C=NC(=NC=1)NCC1=CC(=CC=C1)OC(F)(F)F)N1CC2=C(CC1)NN=N2 MKYBYDHXWVHEJW-UHFFFAOYSA-N 0.000 description 3
- 101000629598 Rattus norvegicus Sterol regulatory element-binding protein 1 Proteins 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 102100029469 WD repeat and HMG-box DNA-binding protein 1 Human genes 0.000 description 2
- 101710097421 WD repeat and HMG-box DNA-binding protein 1 Proteins 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000000116 mitigating effect Effects 0.000 description 2
- 230000035939 shock Effects 0.000 description 2
- 238000002366 time-of-flight method Methods 0.000 description 2
- 230000003245 working effect Effects 0.000 description 2
- VZSRBBMJRBPUNF-UHFFFAOYSA-N 2-(2,3-dihydro-1H-inden-2-ylamino)-N-[3-oxo-3-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)propyl]pyrimidine-5-carboxamide Chemical compound C1C(CC2=CC=CC=C12)NC1=NC=C(C=N1)C(=O)NCCC(N1CC2=C(CC1)NN=N2)=O VZSRBBMJRBPUNF-UHFFFAOYSA-N 0.000 description 1
- YLZOPXRUQYQQID-UHFFFAOYSA-N 3-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)-1-[4-[2-[[3-(trifluoromethoxy)phenyl]methylamino]pyrimidin-5-yl]piperazin-1-yl]propan-1-one Chemical compound N1N=NC=2CN(CCC=21)CCC(=O)N1CCN(CC1)C=1C=NC(=NC=1)NCC1=CC(=CC=C1)OC(F)(F)F YLZOPXRUQYQQID-UHFFFAOYSA-N 0.000 description 1
- NIPNSKYNPDTRPC-UHFFFAOYSA-N N-[2-oxo-2-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)ethyl]-2-[[3-(trifluoromethoxy)phenyl]methylamino]pyrimidine-5-carboxamide Chemical compound O=C(CNC(=O)C=1C=NC(=NC=1)NCC1=CC(=CC=C1)OC(F)(F)F)N1CC2=C(CC1)NN=N2 NIPNSKYNPDTRPC-UHFFFAOYSA-N 0.000 description 1
- AFCARXCZXQIEQB-UHFFFAOYSA-N N-[3-oxo-3-(2,4,6,7-tetrahydrotriazolo[4,5-c]pyridin-5-yl)propyl]-2-[[3-(trifluoromethoxy)phenyl]methylamino]pyrimidine-5-carboxamide Chemical compound O=C(CCNC(=O)C=1C=NC(=NC=1)NCC1=CC(=CC=C1)OC(F)(F)F)N1CC2=C(CC1)NN=N2 AFCARXCZXQIEQB-UHFFFAOYSA-N 0.000 description 1
- 240000004050 Pentaglottis sempervirens Species 0.000 description 1
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000002485 combustion reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 101150057826 plsC gene Proteins 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4861—Circuits for detection, sampling, integration or read-out
- G01S7/4863—Detector arrays, e.g. charge-transfer gates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
- G01C3/06—Use of electric means to obtain final indication
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4861—Circuits for detection, sampling, integration or read-out
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
- G01S7/4873—Extracting wanted echo signals, e.g. pulse detection by deriving and controlling a threshold value
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
Definitions
- the present disclosure relates to a photodetection device and a photodetection system that detect light.
- a TOF (Time OF Flight) method is frequently used to measure a distance to an detection object.
- this TOF method light is emitted, and reflected light reflected by the detection object is detected. Then, in the TOF method, the distance to the measurement object is measured by measuring a time difference between a timing at which the light is emitted and a timing at which the reflected light is detected.
- PTL 1 discloses a distance measuring device that reduces a light reception amount of ambient light by turning off any of a plurality of light-receiving elements.
- a first photodetection device includes one or a plurality of light-receiving sections, a plurality of first counters, and a subtraction processor.
- the one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the subtraction processor is configured to perform subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
- a second photodetection device includes one or a plurality of light-receiving sections, a plurality of first counters, a stop processor, and a threshold setting section.
- the one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the stop controller is configured to stop the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
- the threshold setting section is configured to make a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- a first photodetection system includes a light-emitting section and a photodetector.
- the light-emitting section is configured to emit light.
- the photodetector is configured to detect light reflected by a detection object of the light emitted from the light-emitting section.
- This photodetector includes one or a plurality of light-receiving sections, a plurality of first counters, and a subtraction processor.
- the one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the subtraction processor is configured to perform subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
- a second photodetection system includes a light-emitting section and a photodetector.
- the light-emitting section is configured to emit light.
- the photodetector is configured to detect light reflected by a detection object of the light emitted from the light-emitting section.
- This photodetector includes one or a plurality of light-receiving sections, a plurality of first counters, a stop processor, and a threshold setting section.
- the one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the stop controller is configured to stop the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
- the threshold setting section is configured to make a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- the one or plurality of light-receiving sections each generates the pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the subtraction processor performs subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of the plurality of count values.
- the one or plurality of light-receiving sections each generates the pulse signal including a pulse corresponding to a result of light reception by the light-receiving element.
- the plurality of first counters each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values.
- the stop controller stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
- the threshold setting section makes a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- FIG. 1 is a block diagram illustrating a configuration example of a photodetection system according to an embodiment of the present disclosure.
- FIG. 2 is a block diagram illustrating a configuration example of a photodetector illustrated in FIG. 1 .
- FIG. 3 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 2 .
- FIG. 4 A is a circuit diagram illustrating a configuration example of a light-receiving section illustrated in FIG. 3 .
- FIG. 4 B is a circuit diagram illustrating another configuration example of the light-receiving section illustrated in FIG. 3 .
- FIG. 5 is a block diagram illustrating a configuration example of a subtraction determining section illustrated in FIG. 3 .
- FIG. 6 is a block diagram illustrating a configuration example of a saturation determining section illustrated in FIG. 3 .
- FIG. 7 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated in FIG. 3 .
- FIG. 8 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated in FIG. 3 .
- FIG. 9 is a flowchart illustrating an operation example of the photodetector illustrated in FIG. 2 .
- FIG. 10 is an explanatory diagram illustrating an operation example of a signal processor illustrated in FIG. 2 .
- FIG. 11 is an explanatory diagram illustrating an operation example of the photodetection unit illustrated in FIG. 3 .
- FIG. 12 A is a circuit diagram illustrating a configuration example of a light-receiving section according to a modification example of a first embodiment.
- FIG. 12 B is a circuit diagram illustrating a configuration example of the light-receiving section according to the modification example of the first embodiment.
- FIG. 13 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment.
- FIG. 14 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment.
- FIG. 15 is a circuit diagram illustrating a configuration example of a light-receiving section illustrated in FIG. 14 .
- FIG. 16 is an explanatory diagram illustrating an operation example of a subtraction controller according to another modification example of the first embodiment.
- FIG. 17 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment.
- FIG. 18 is a circuit diagram illustrating a configuration example of a subtraction determining section illustrated in FIG. 17 .
- FIG. 19 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated in FIG. 17 .
- FIG. 20 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment.
- FIG. 21 is a circuit diagram illustrating a configuration example of a subtraction determining section illustrated in FIG. 20 .
- FIG. 22 is a circuit diagram illustrating another configuration example of the subtraction determining section illustrated in FIG. 20 .
- FIG. 23 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment.
- FIG. 24 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated in FIG. 23 .
- FIG. 25 is another timing waveform diagram illustrating an operation example of the photodetection unit illustrated in FIG. 23 .
- FIG. 26 is an explanatory diagram illustrating an implementation example of a photodetector according to another modification example of the first embodiment.
- FIG. 27 is a circuit diagram illustrating a configuration example of a light-receiving section according to another modification example of the first embodiment.
- FIG. 28 is an explanatory diagram illustrating an implementation example of a photodetector according to another modification example of the first embodiment.
- FIG. 29 is a block diagram illustrating a configuration example of a photodetection system according to another modification example of the first embodiment.
- FIG. 30 is a block diagram illustrating a configuration example of a photodetector illustrated in FIG. 29 .
- FIG. 31 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 30 .
- FIG. 32 is a block diagram illustrating a configuration example of a photodetector according to a second embodiment.
- FIG. 33 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 32 .
- FIG. 34 is an explanatory diagram illustrating an operation example of the photodetection unit illustrated in FIG. 33 .
- FIG. 35 is an explanatory diagram illustrating an example of deviation of time (TOF).
- FIG. 36 is a block diagram illustrating a configuration example of a photodetector according to a modification example of the second embodiment.
- FIG. 37 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 36 .
- FIG. 38 is an explanatory diagram illustrating an operation example of a light reception amount image generator illustrated in FIG. 36 .
- FIG. 39 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the second embodiment.
- FIG. 40 is a block diagram illustrating a configuration example of a photodetector according to another modification example of the second embodiment.
- FIG. 41 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 40 .
- FIG. 42 is a block diagram illustrating a configuration example of a photodetector according to a third embodiment.
- FIG. 43 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated in FIG. 42 .
- FIG. 44 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated in FIG. 43 .
- FIG. 45 is a flowchart illustrating an operation example of the photodetector illustrated in FIG. 42 .
- FIG. 46 is a circuit diagram illustrating a configuration example of a photodetection unit according to a fourth embodiment.
- FIG. 47 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated in FIG. 46 .
- FIG. 48 is a flowchart illustrating an operation example of a photodetector according to the fourth embodiment.
- FIG. 49 is a block diagram depicting an example of schematic configuration of a vehicle control system.
- FIG. 50 is a diagram of assistance in explaining an example of installation positions of an outside-vehicle information detecting section and an imaging section.
- FIG. 1 illustrates a configuration example of a photodetection system (photodetection system 1 ) according to an embodiment.
- the photodetection system 1 is a ToF (Time-of-Flight) sensor, and is configured to emit light and detect reflected light reflected by a detection object OBJ.
- the photodetection system 1 includes a light-emitting section 11 , an optical system 12 , a photodetector 20 , and a controller 14 .
- the light-emitting section 11 is configured to emit a light pulse L 0 toward the detection object OBJ on the basis of an instruction from the controller 14 .
- the light-emitting section 11 emits the light pulse L 0 on the basis of an instruction from the controller 14 by performing a light emission operation of alternately repeating emission and non-emission of light.
- the light-emitting section 11 includes, for example, a light source that emits infrared light. This light source is configured with use of, for example, a laser light source, an LED (Light Emitting Diode), or the like.
- the optical system 12 includes a lens that forms an image on a light-receiving surface S of the photodetector 20 .
- the photodetector 20 is configured to detect the reflected light pulse L 1 on the basis of an instruction from the controller 14 .
- the photodetector 20 then generates a distance image on the basis of a detection result, and outputs image data of the generated distance image as data DT.
- the controller 14 is configured to supply control signals to the light-emitting section 11 and the photodetector 20 and control operations of the light-emitting section 11 and the photodetector 20 to thereby control an operation of the photodetection system 1 .
- FIG. 2 illustrates a configuration example of the photodetector 20 .
- the photodetector 20 includes a photodetection array 21 , a signal generator 22 , a readout controller 23 , a signal processor 24 , and a photodetection controller 25 .
- the photodetection array 21 includes a plurality of photodetection units U disposed in a matrix.
- the photodetection units U are each configured to detect the reflected light pulse L 1 and count the number of detection times of the reflected light pulse L 1 .
- FIG. 3 illustrates a configuration example of the photodetection unit U.
- the photodetection unit U includes a light-receiving section 31 , a plurality of logical AND (AND) circuits 33 (four AND circuits 33 A to 33 D in this example), a plurality of switches 34 (four switches 34 A to 34 D in this example), a plurality of counters 35 (four counters 35 A to 35 D in this example), a subtraction determining section 36 , a subtraction controller 37 , and a saturation determining section 38 .
- AND logical AND
- switches 34 four switches 34 A to 34 D in this example
- a plurality of counters 35 four counters 35 are provided, but this is not limitative.
- three or more circuits including the AND circuit 33 , the switch 34 , and the counter 35 may be provided.
- the light-receiving section 31 is configured to detect light to thereby generate a pulse signal PLS including a pulse corresponding to the detected light.
- FIG. 4 A illustrates a configuration example of the light-receiving section 31 .
- the light-receiving section 31 includes a photodiode PD, a resistor R 1 , and an inverter IV 1 .
- the photodiode PD is a photoelectric conversion element that converts light into electric charge.
- the photodiode PD has an anode supplied with a power supply voltage VSS, and a cathode coupled to a node N 1 . It is possible to use, for example, an avalanche photodiode (APD; Avalanche Photodiode), a single photon avalanche diode (SPAD; Single Photon Avalanche Diode), or the like for the photodiode PD.
- APD avalanche photodiode
- APD avalanche Photodiode
- SPAD Single Photon Avalanche Diode
- the resistor R 1 has one end supplied with a power supply voltage VDD, and another end coupled to the node N 1 .
- the inverter IV 1 is configured to output a low level in a case where a voltage at the node N 1 is higher than a logical threshold, and output a high level in a case where the voltage at the node N 1 is lower than the logical threshold to thereby generate the pulse signal PLS.
- the photodiode PD causes avalanche amplification by detecting light, which decreases the voltage at the node N 1 . Then, in a case where the voltage at the node N 1 becomes lower than the logical threshold of the inverter IV 1 , the pulse signal PLS changes from the low level to the high level. Thereafter, a current flows into the node N 1 through the resistor R 1 to thereby increase the voltage at the node N 1 . Then, in a case where the voltage at the node N 1 becomes higher than the logical threshold of the inverter IV 1 , the pulse signal PLS changes from the high level to the low level. Thus, the light-receiving section 31 generates the pulse signal PLS including a pulse corresponding to the detected light.
- FIG. 4 B illustrates another configuration example of the light-receiving section 31 .
- the light-receiving section 31 includes the photodiode PD, a transistor MP 1 , the inverter IV 1 , and a control circuit CKT 1 .
- the transistor MP 1 is a P-type MOS (Metal Oxide Semiconductor) transistor, and has a gate coupled to an output terminal of the control circuit CKT 1 , a source supplied with the power supply voltage VDD, and a drain coupled to the node N 1 .
- MOS Metal Oxide Semiconductor
- the control circuit CKT 1 is configured to control an operation of the transistor MP 1 on the basis of the pulse signal PLS. Specifically, the control circuit CKT 1 changes a voltage at the gate of the transistor MP 1 to the low level after the pulse signal PLS changes from the low level to the high level, and changes the voltage at the gate of the transistor MP 1 to the high level after the pulse signal PLS changes from the high level to the low level.
- the photodiode PD detects light to thereby decrease the voltage at the node N 1 .
- the pulse signal PLS changes from the low level to the high level.
- the control circuit CKT 1 changes the voltage at the gate of the transistor MP 1 to the low level. This turns on the transistor MP 1 to cause a current to flow into the node N 1 through the transistor MP 1 , which increases the voltage at the node N 1 .
- the pulse signal PLS changes from the high level to the low level.
- the control circuit CKT 1 changes the voltage at the gate of the transistor MP 1 to the high level. This turns off the transistor MP 1 .
- the light-receiving section 31 generates the pulse signal PLS including a pulse corresponding to the detected light.
- the AND circuit 33 A ( FIG. 3 ) is configured to find logical AND of a clock signal CLKA and an inverted signal of a control signal STP.
- the switch 34 A is configured to turn on or off supply of the pulse signal PLS to the counter 35 A on the basis of an output signal of the AND circuit 33 A. Specifically, the switch 34 A supplies the pulse signal PLS to the counter 35 A in a case where the output signal of the AND circuit 33 A is at the high level, and supplies a low-level signal to the counter 35 A in a case where the output signal of the AND circuit 33 A is at the low level.
- the switch 34 A is configured with use of, for example, an AND circuit or a logical OR (OR) circuit.
- the AND circuit 33 B is configured to find logical AND of a clock signal CLKB and the inverted signal of the control signal STP.
- the switch 34 B is configured to turn on or off supply of the pulse signal PLS to the counter 35 B on the basis of an output signal of the AND circuit 33 B.
- the AND circuit 33 C is configured to find logical AND of a clock signal CLKC and the inverted signal of the control signal STP.
- the switch 34 C is configured to turn on or off supply of the pulse signal PLS to the counter 35 C on the basis of an output signal of the AND circuit 33 C.
- the AND circuit 33 D is configured to find logical AND of a clock signal CLKD and the inverted signal of the control signal STP.
- the switch 34 D is configured to turn on or off supply of the pulse signal PLS to the counter 35 D on the basis of an output signal of the AND circuit 33 D.
- the counter 35 A is configured to increment a count value CNTA by performing count processing on the basis of a rising edge of the pulse signal supplied from the switch 34 A.
- the counter 35 B is configured to increment a count value CNTB by performing count processing on the basis of a rising edge of the pulse signal supplied from the switch 34 B.
- the counter 35 C is configured to increment a count value CNTC by performing count processing on the basis of a rising edge of the pulse signal supplied from the switch 34 C.
- the counter 35 D is configured to increment a count value CNTD by performing count processing on the basis of a rising edge of the pulse signal supplied from the switch 34 D.
- the subtraction determining section 36 is configured to generate a control signal CTL by determining whether or not all of the count values CNTA to CNTD have reached a threshold THA. In other words, the subtraction determining section 36 generates the control signal CTL by determining whether or not the smallest value among the count values CNTA to CNTD has reached the threshold THA.
- FIG. 5 illustrates a configuration example of the subtraction determining section 36 .
- the subtraction determining section 36 includes comparator circuits CP 1 A, CP 1 B, CP 1 C, and CP 1 D, and an AND circuit AND 1 .
- the comparator circuit CP 1 A is configured to determine whether or not the count value CNTA is larger than the threshold THA.
- the comparator circuit CP 1 B is configured to determine whether or not the count value CNTB is larger than the threshold THA.
- the comparator circuit CP 1 C is configured to determine whether or not the count value CNTC is larger than the threshold THA.
- the comparator circuit CP 1 D is configured to determine whether or not the count value CNTD is larger than the threshold THA.
- the AND circuit AND 1 is configured to generate the control signal CTL by finding logical AND of an output signal of the comparator circuit CP 1 A, an output signal of the comparator circuit CP 1 B, an output signal of the comparator circuit CP 1 C, and an output signal of the comparator circuit CP 1 D. This configuration allows the subtraction determining section 36 to determine whether or not all of the count values CNTA to CNTD have reached the threshold THA.
- the subtraction controller 37 ( FIG. 3 ) is configured to subtract a predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D on the basis of a determination result of the subtraction determining section 36 .
- the saturation determining section 38 is configured to generate the control signal STP by determining whether or not one or more count values of the count values CNTA to CNTD have reached a threshold THB. Specifically, the saturation determining section 38 changes the control signal STP to the high level in a case where one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP to the low level in a case where none of the count values CNTA to CNTD has reached the threshold THB.
- the threshold THB is set at a value larger than the threshold THA.
- FIG. 6 illustrates a configuration example of the saturation determining section 38 .
- the saturation determining section 38 includes comparator circuits CP 2 A, CP 2 B, CP 2 C, and CP 2 D, and an OR circuit OR 1 .
- the comparator circuit CP 2 A is configured to determine whether or not the count value CNTA is larger than the threshold THB.
- the comparator circuit CP 2 B is configured to determine whether or not the count value CNTB is larger than the threshold THB.
- the comparator circuit CP 2 C is configured to determine whether or not the count value CNTC is larger than the threshold THB.
- the comparator circuit CP 2 D is configured to determine whether or not the count value CNTD is larger than the threshold THB.
- the OR circuit OR 1 is configured to generate the control signal STP by finding logical OR of an output signal of the comparator circuit CP 2 A, an output signal of the comparator circuit CP 2 B, an output signal of the comparator circuit CP 2 C, and an output signal of the comparator circuit CP 2 D. This configuration allows the saturation determining section 38 to determine whether or not one or more count values of the count values CNTA to CNTD have reached the threshold THB.
- each of the AND circuits 33 A to 33 D changes the output signal to the low level. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- the signal generator 22 ( FIG. 2 ) is configured to generate the clock signals CLKA to CLKD and the thresholds THA and THB on the basis of an instruction from the photodetection controller 25 and supply the clock signals CLKA to CLKD and the thresholds THA and THB to the plurality of photodetection units U in the photodetection array 21 .
- the readout controller 23 is configured to control an operation of supplying, to the signal processor 24 , the count values CNTA to CNTD generated in each of the plurality of photodetection units U in the photodetection array 21 , on the basis of an instruction from the photodetection controller 25 .
- the readout controller 23 controls operations of the plurality of photodetection units U to sequentially select the photodetection units U for one row, and cause the selected photodetection units U to supply the count values CNTA to CNTD to the signal processor 24 .
- the signal processor 24 is configured to generate a distance image on the basis of an instruction from the photodetection controller 25 . Specifically, the signal processor 24 generates a distance image by measuring time (TOF value) from emission of the light pulse L 0 by the light-emitting section 11 to detection of the reflected light pulse L 1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U. The signal processor 24 then outputs image data of the generated distance image as the data DT.
- TOF value time
- the photodetection controller 25 is configured to control the operation of the photodetector 20 on the basis of an instruction from the controller 14 ( FIG. 1 ) by supplying control signals to the signal generator 22 , the readout controller 23 , and the signal processor 24 and controlling operations of the signal generator 22 , the readout controller 23 , and the signal processor 24 .
- the light-receiving section 31 corresponds to a specific example of a “light-receiving section” in the present disclosure.
- the photodiode PD corresponds to a specific example of a “light-receiving element” in the present disclosure.
- the pulse signal PLS corresponds to a specific example of a “pulse signal” in the present disclosure.
- the switches 34 A to 34 D correspond to specific examples of a “divider” in the present disclosure.
- the counter 35 corresponds to a specific example of a “counter” in the present disclosure.
- the subtraction determining section 36 and the subtraction controller 37 correspond to specific examples of a “subtraction processor” in the present disclosure.
- the saturation determining section 38 and the AND circuits 33 A to 33 D correspond to specific examples of a “stop processor” in the present disclosure.
- the signal processor 24 corresponds to a specific example of a “first processor” in the present disclosure.
- the threshold THB corresponds to a specific example of a “first threshold” in the present disclosure.
- the threshold THA corresponds to a specific example of a “second threshold” in the present disclosure.
- the light-emitting section 11 emits the light pulse L 0 toward the detection object OBJ.
- the optical system 12 forms an image on the light-receiving surface S of the photodetector 20 .
- the photodetector 20 detects the reflected light pulse L 1 .
- the controller 14 supplies control signals to the light-emitting section 11 and the photodetector 20 and controls operations of the light-emitting section 11 and the photodetector 20 to thereby control a distance measuring operation of the photodetection system 1 .
- the photodetection units U of the photodetection array 21 each generate the count values CNTA to CNTD by detecting the reflected light pulse L 1 .
- the signal generator 22 generates the clock signals CLKA to CLKD and the thresholds THA and THB, and supplies the clock signals CLKA to CLKD and the thresholds THA and THB to the plurality of photodetection units U.
- the readout controller 23 controls an operation of supplying, to the signal processor 24 , the count values CNTA to CNTD generated in each of the plurality of photodetection units U in the photodetection array 21 .
- the signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from the plurality of photodetection units U in the photodetection array 21 and outputs image data of the generated distance image as the data DT.
- the photodetection controller 25 controls the operation of the photodetector 20 on the basis of an instruction from the controller 14 by supplying control signals to the signal generator 22 , the readout controller 23 , and the signal processor 24 and controlling the operations of the signal generator 22 , the readout controller 23 , and the signal processor 24 .
- FIG. 7 illustrates an operation example of the photodetector 20 .
- A indicates a waveform of light emitted from the light-emitting section 11 .
- B indicates a waveform of light reflected by the detection object OBJ and having entered a certain photodetection unit U.
- D indicates waveforms of the clock signals CLKA to CLKD.
- G indicates waveforms of the count values CNTA to CNTD.
- K indicates a waveform of the control signal STP.
- L indicate an operation of the readout controller 23 .
- the photodetection system 1 In a period (exposure period P 1 ) from a timing t 11 to a timing t 18 , the photodetection system 1 repeatedly emits the light pulse L 0 , and repeatedly detects the reflected light pulse L 1 reflected by the detection object OBJ.
- the light-emitting section 11 emits light ((A) of FIG. 7 ).
- the signal generator 22 changes the clock signal CLKA to the high level in a period from the timing t 12 to a timing t 13 , changes the clock signal CLKB to the high level in a period from the timing t 13 to a timing t 14 , changes the clock signal CLKC to the high level in a period from the timing t 14 to a timing t 15 , and changes the clock signal CLKD to the high level in a period from the timing t 15 to a timing t 16 ((C) to (F) of FIG. 7 ).
- the reflected light pulse L 1 is generated in a period in which the clock signal CLKB is changed to the high level and a period in which the clock signal CLKC is changed to the high level ((B) of FIG. 7 ). None of the count values CNTA to CNTD has not reached the threshold THB, and the control signal STP is at the low level ((K) of FIG. 7 ).
- the switch 34 A supplies the pulse signal PLS to the counter 35 A in the period from the timing t 12 to the timing t 13
- the switch 34 B supplies the pulse signal PLS to the counter 35 B in the period from the timing t 13 to the timing t 14
- the switch 34 C supplies the pulse signal PLS to the counter 35 C in the period from the timing t 14 to the timing t 15
- the switch 34 D supplies the pulse signal PLS to the counter 35 D in the period from the timing t 15 to the timing t 16 .
- the switches 34 A to 34 D distribute the pulse signal PLS to the counters 35 A to 35 D in a time division manner on the basis of the clock signals CLKA to CLKD.
- the counter 35 A performs count processing on the basis of a rising edge of the pulse signal PLS supplied from the switch 34 A to increment the count value CNTA ((G) of FIG. 7 ).
- the counter 35 B performs count processing on the basis of a rising edge of the pulse signal PLS supplied from the switch 34 B to increment the count value CNTB ((H) of FIG. 7 ).
- the counter 35 C performs count processing on the basis of a rising edge of the pulse signal PLS supplied from the switch 34 C to increment the count value CNTC ((I) of FIG. 7 ).
- he counter 35 D performs count processing on the basis of a rising edge of the pulse signal PLS supplied from the switch 34 D to increment the count value CNTD ((J) of FIG. 7 ).
- the photodetection unit U repeats such an operation from the timing t 11 to a timing t 17 . Accordingly, the counter 35 A performs count processing in a plurality of periods in which the clock signal CLKA is at the high level to generate the count value CNTA, the counter 35 B performs count processing in a plurality of periods in which the clock signal CLKB is at the high level to generate the count value CNTB, the counter 35 C performs count processing in a plurality of periods in which the clock signal CLKC is at the high level to generate the count value CNTC, and the counter 35 D performs count processing in a plurality of periods in which the clock signal CLKD is at the high level to generate the count value CNTD.
- the readout controller 23 performs readout control CR, thereby controlling the operations of the plurality of photodetection units U to supply, to the signal processor 24 , the count values CNTA to CNTD generated by each of the plurality of photodetection units U ((L) of FIG. 7 ). Thereafter, the count values CNTA to CNTD in the counters 35 A to 35 D are reset.
- the count value CNTB and the CNTC include a component (reflected light component C 1 ) corresponding to reflected light.
- ambient light also enters the photodetector 20 .
- the ambient light may enter the photodetector 20 in all of a period in which the clock signal CLKA is at the high level, a period in which the clock signal CLKB is at the high level, a period in which the clock signal CLKC is at the high level, and a period in which the clock signal CLKC is at the high level.
- the count values CNTA to CNTD each include a component (ambient light component C 2 ) corresponding to the ambient light. The amount of this ambient light component C 2 is substantially equal in the count values CNTA to CNTD.
- FIG. 8 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P 1 .
- a shaded portion indicates the reflected light component C 1
- a white portion indicates the ambient light component C 2 .
- the count values CNTB and CNTC each include the reflected light component C 1 and the ambient light component C 2
- the count values CNTA and CNTD each include the ambient light component C 2 .
- the count values CNTA to CNTD gradually increase with the lapse of time.
- the ambient light component C 2 in each of the count values CNTA to CNTD is smaller than the threshold THA.
- the ambient light component C 2 in each of the count values CNTA to CNTD reaches the threshold THA.
- the subtraction determining section 36 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the subtraction determining section 36 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. Accordingly, the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD ((C) of FIG. 8 ). Thus, a portion of the ambient light component C 2 in each of the count values CNTA to CNTD is removed, and the reflected light component C 1 is maintained.
- the count value CNTC reaches the threshold THB.
- the saturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing. That is, in a case where one or more count values of the count values CNTA to CNTD have reached the threshold THB, even if the exposure period P 1 has not ended, the counters 35 A to 35 D stop count processing.
- FIG. 9 illustrates an operation example of the photodetector 20 .
- the photodetection controller 25 starts the exposure period P 1 (step S 101 ).
- the signal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from the photodetection controller 25 .
- the photodetection controller 25 confirms whether or not the exposure period P 1 having a predetermined time length has ended (step S 102 ). In a case where the exposure period P 1 has ended (“Y” in step S 102 ), processing proceeds to step S 107 .
- the saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S 103 ). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S 103 ), the processing proceeds to step S 106 .
- step S 103 in a case where none of the count values CNT has reached the threshold THB (“N” in step S 103 ), the subtraction determining section 36 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S 104 ). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S 104 ), the processing returns to step S 102 .
- step S 104 in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S 104 ), the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D (step S 105 ). That is, in an example in FIG. 8 , as illustrated in (B) and (C) of FIG. 8 , all of the four count values CNT have reached the threshold THA, which causes the subtraction controller 37 to subtract the predetermined value from each of the count values CNTA to CNTD. The processing then returns to step S 102 .
- step S 103 in a case where one or more count values CNT have reached the threshold THB (“Y” in step S 103 ), the counters 35 A to 35 D stop count processing (step S 106 ). That is, in the example in FIG. 8 , as illustrated in (D) of FIG. 8 , one or more count values CNT of the four count values CNT have reached the threshold THB, which causes the saturation determining section 38 to change the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- the plurality of photodetection units U each perform such an operation individually.
- the photodetector 20 performs readout processing (step S 107 ). Specifically, the readout controller 23 controls the operations of the plurality of photodetection units U to supply, to the signal processor 24 , the count values CNTA to CND generated in each of the plurality of photodetection units U.
- the signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U.
- FIG. 10 illustrates an operation example of the signal processor 24 .
- the signal processor 24 subtracts the smallest value among the count values CNTA to CNTD from the count values CNTA to CNTD supplied from the photodetection unit U. That is, as illustrated in (D) of FIG. 8 , the count values CNTA to CNTD generated by the photodetection unit U each include the reflected light component C 1 and the ambient light component C 2 .
- the signal processor 24 subtracts the smallest value among the count values CNTA to CNTD from the count values CNTA to CNTD to thereby remove the ambient light component C 2 .
- the signal processor 24 determines time (TOF value) from emission of the light pulse L 0 by the light-emitting section 11 to detection of the reflected light pulse L 1 by the photodetection unit U, on the basis of the count values CNTA to CNTD from which the ambient light component C 2 is removed. That is, for example, the count value CNTA indicates the number of detection times of the reflected light pulse L 1 directly after emission of the light pulse L 0 by the light-emitting section 11 , and the count value CNTD indicates the number of detection times of the reflected light pulse L 1 after the lapse of time from the emission of the light pulse L 0 by the light-emitting section 11 . This makes it possible for the signal processor 24 to determine the TOF value on the basis of a distribution of these count values CNTA to CNTD, for example, by determining time corresponding to a peak of this distribution.
- the signal processor 24 performs such processing on the basis of the count values CNTA to CNTD obtained from each of the plurality of photodetection units U to generate a distance image. Then, the signal processor 24 outputs image data of the generated distance image as the data DT.
- the subtraction determining section 36 and the subtraction controller 37 perform subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of a plurality of count values CNT.
- the subtraction determining section 36 and the subtraction controller 37 perform the subtraction processing in a case where all of the plurality of count values CNT have reached the threshold THA.
- the subtraction determining section 36 and the subtraction controller 37 perform the subtraction processing in a case where the smallest values among the plurality of count values CNT has reached the threshold THA. Accordingly, for example, as illustrated in (D) of FIG.
- the amount of the ambient light component C 1 is large under the condition that the amount of ambient light is large, which decreases the signal amount of the reflected light component C 1 .
- the signal amount is small in such a manner, detection accuracy of time or a distance is deteriorated.
- the subtraction determining section 36 and the subtraction controller 37 perform the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of the plurality of count values CNT.
- This makes it possible to secure the signal amount of the reflected light components C 1 , which makes it possible to enhance detection accuracy of time (TOF value) or a distance.
- TOF value detection accuracy of time
- the subtraction determining section 36 and the subtraction controller 37 perform the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, which makes it possible to reduce the number of bits of a counter, thereby making it possible to reduce a circuit scale. That is, in a case where the subtraction processing is not performed, in order to secure the signal amount, a method of increasing the number of bits of the counter may be adopted. However, in this case, the circuit scale is increased. In a case where the circuit scale of the photodetection unit U is large, for example, the number of photodetection units U in the photodetection array may be decreased, or resolution may be decreased.
- the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed, which makes it possible to reduce the number of bits of the counter, thereby making it possible to reduce the circuit scale. Accordingly, for example, it is possible to increase the number of photodetection units U in the photodetection array 21 or to enhance resolution.
- the subtraction determining section 36 and the subtraction controller 37 performs the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT.
- This makes it possible to adaptively remove the ambient light component C 2 in accordance with the light amount of ambient light in each of the plurality of photodetection units U, and makes it possible to secure the signal amount of the reflected light component C 1 .
- it is possible to effectively enhance detection accuracy of time (TOF value) or a distance in each of the plurality of photodetection units U.
- the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed on the basis of one or more count values of the plurality of count values, which makes it possible to secure the signal amount, thereby making it possible to enhance detection accuracy.
- the light-receiving section 31 includes one photodiode PD, but this it not limitative. Instead of this, for example, as illustrated in FIGS. 12 A and 12 B , the light-receiving section 31 may include a plurality of photodiodes PD (four photodiodes PD 1 to PD 4 in this example).
- the photodiodes PD 1 to PD 4 are coupled in parallel to each other, and the photodiodes PD 1 to PD 4 each have an anode supplied with the power supply voltage VSS, and a cathode coupled to the node N 1 . This makes it possible to enhance, for example, light reception sensitivity in the light-receiving section 31 .
- the photodetection unit U includes one light-receiving section 31 , but this it not limitative. Instead of this, for example, as illustrated in FIG. 13 , the photodetection unit U may include a plurality of light-receiving sections 31 .
- This photodetection unit U includes a plurality of light-receiving section 31 (four light-receiving sections 31 A to 31 D in this example), and an OR circuit 32 .
- the light-receiving sections 31 A to 31 D respectively generate the pulse signals PLSA to PLSD.
- Each of the plurality of light-receiving sections 31 has, for example, a circuit configuration illustrated in FIG. 4 A or a circuit configuration illustrated in FIG.
- the OR circuit 32 is configured to generate the pulse signal PLS by finding logical OR of the pulse signals PLSA to PLSD.
- the OR circuit 32 corresponds to a specific example of an “adder” in the present disclosure.
- the photodetection unit U may include a plurality of light-receiving sections 41 (four light-receiving sections 41 A to 41 D in this example) and a negative AND (NAND) circuit 42 .
- the light-receiving sections 41 A to 41 D respectively generate the pulse signals PLSA to PLSD.
- the light-receiving section 41 A includes the photodiode PD and the resistor R 1 . That is, the light-receiving section 41 A is the light-receiving section 31 ( FIG. 4 A ) without the inverter IV 1 .
- the NAND circuit 42 is configured to generate the pulse signal PLS by finding negative AND of the pulse signals PLSA to PLSD. Even in this case, it is possible to enhance, for example, light reception sensitivity.
- the subtraction controller 37 performs subtraction processing for subtracting a predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D, on the basis of a determination result of the subtraction determining section 36 .
- the subtraction controller 37 may perform subtraction processing by changing the bit value of a predetermined count bit in each of the counters 35 A to 35 D.
- the subtraction controller 37 is able to perform subtraction processing by changing the bit value of a most significant bit (MSB: Most Significant Bit) in each of the counters 35 A to 35 D from “1” to “0”.
- MSB most significant bit
- the subtraction determining section 36 determines whether or not all of the count values CNTA to CNTD has reached the threshold THA, but this is not limitative.
- the present modification example is described in detail below with reference to some examples.
- FIG. 17 illustrates a configuration example of the photodetection unit U according to the present modification example.
- This photodetection unit U includes a subtraction determining section 46 .
- the subtraction determining section 46 is configured to generate the control signal CTL by determining whether or not the count value CNT of a predetermined counter 35 (the count value CNTD of the counter 35 D in this example) of the four counters 35 A to 35 D has reached the threshold THA.
- FIG. 18 illustrates a configuration example of the subtraction determining section 46 .
- the subtraction determining section 46 includes the comparator circuit CP 1 D.
- the comparator circuit CP 1 D is configured to generate the control signal CTL by determining whether or not the count value CNTD is larger than the threshold THA.
- FIG. 19 illustrates an operation example in the exposure period P 1 of the photodetection unit U according to the present modification example.
- (A) indicates a waveform of light emitted from the light-emitting section 11 .
- (B) indicates a waveform of light reflected by the detection object OBJ and having entered then photodetection unit U.
- (C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD.
- the light-emitting section 11 emits light ((A) of FIG. 19 ).
- the signal generator 22 changes the clock signal CLKA to the high level in a period from the timing t 22 to a timing t 23 , changes the clock signal CLKB to the high level in a period from the timing t 23 to a timing t 24 , and changes the clock signal CLKC to the high level in a period from the timing t 24 to a timing t 25 ((C) to (E) of FIG. 19 ).
- a timing of the reflected light pulse L 1 is expected to some extent, and the signal generator 22 sequentially changes the clock signals CLKA to CLKC to the high level in a period from the timing t 22 to the timing t 25 including a period in which this reflected light pulse L 1 is generated.
- the signal generator 22 changes the clock signal CLKD to the high level in a period from a timing t 26 to a timing t 27 separated from this period from the timing t 22 to the timing t 25 ((F) of FIG. 19 ). That is, in this example, the photodetection unit U does not detect the reflected light pulse L 1 in this period from the timing t 26 to the timing t 27 ; therefore, it is expected to detect ambient light. Accordingly, the count value CNTD does not include the reflected light component C 1 , and includes the ambient light component C 2 .
- the subtraction determining section 46 determines whether or not the count value CNTD of the counter 35 D has reached the threshold THA, and in a case where the count value CNTD has reached the threshold THA, the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D.
- the present modification example is effective specifically in a case where the number of circuits including the AND circuit 33 , the switch 34 , and the counter 35 is large.
- the present modification example it is possible to determine whether or not to perform subtraction processing on the basis of the count value CNT of one counter 35 of the sixteen counters 35 , and it is possible to generate a distance image on the basis of the count values CNT of fifteen counters 35 .
- FIG. 20 illustrates a configuration example of another photodetection unit U according to the present modification example.
- This photodetection unit U includes a subtraction determining section 56 .
- the subtraction determining section 56 is configured to generate the control signal CTL by determining whether or not both the count values of two predetermined counters 35 (the count values CNTC and CNTD of the counters 35 C and 35 D in this example) of the four counters 35 A to 35 D have reached the threshold THA.
- FIG. 21 illustrates a configuration example of the subtraction determining section 56 .
- the subtraction determining section 56 includes the comparator circuits CP 1 C and CP 1 D and an AND circuit AND 2 .
- the comparator circuit CP 1 C is configured to determine whether or not the count value CNTC is larger than the threshold THA.
- the comparator circuit CP 1 D is configured to determine whether or not the count value CNTD is larger than the threshold THA.
- the AND circuit AND 2 is configured to generate the control signal CTL by finding logical AND of output signals of the comparator circuits CP 1 C and CP 1 D. This configuration allows the subtraction determining section 56 to determine whether or not both the count values CNTC and CNTD have reached the threshold THA. As with the example in FIG.
- the count values CNTC and CNTD each do not include the reflected light component C 1 , and include the ambient light component C 2 .
- the present modification example is effective in a case where the number of circuits including the AND circuit 33 , the switch 34 , and the counter 35 is large, as with the example in FIG. 19 .
- FIG. 22 illustrates a configuration example of the subtraction determining section 56 in this example.
- This subtraction determining section 56 includes an adder circuit ADD 1 and a comparator circuit CP 1 .
- the adder circuit ADD 1 is configured to find the sum of the count value CNTC and the count value CNTD.
- the comparator circuit CP 1 is configured to generate the control signal CTL by determining whether or not a value calculated by the adder circuit ADD 1 is larger than the threshold THA.
- the subtraction determining section 56 determines whether or not the sum of the count values CNTC and CNTD reaches the threshold THA. However, instead of this, for example, the subtraction determining section 56 may determine whether or not an average value of the count values CNTC and CNTD reaches the threshold THA.
- subtraction processing is performed asynchronously, but this is not limitative. Instead of this, for example, subtraction processing may be performed in synchronization with a control signal.
- the present modification example is described in detail below.
- FIG. 23 illustrates a configuration example of the photodetection unit U according to the present modification example.
- This photodetection unit U includes a subtraction determining section 66 , a saturation determining section 68 , and an AND circuit 69 .
- the subtraction determining section 66 includes an AND circuit AND 3 .
- the AND circuit AND 3 is configured to find logical AND of the bit value of a most significant bit of a signal indicating the count value CNTA, the bit value of a most significant bit of a signal indicating the count value CNTB, the bit value of a most significant bit of a signal indicating the count value CNTC, the bit value of a most significant bit of a signal indicating the count value CNTD, and the output signal of the AND circuit 69 .
- the subtraction determining section 66 determines whether or not all of the count values CNTA to CNTD have reached an intermediate value in a count range of the counters 35 A to 35 D.
- the saturation determining section 68 includes latches LTA to LTD and an OR circuit OR 2 .
- the latch LTA is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTA are changed to “1”.
- the latch LTB is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTB are changed to “1”.
- the latch LTC is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTC are changed to “1”.
- the latch LTD is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTD are changed to “1”
- the OR circuit OR 2 is configured to generate the control signal STP by finding logical OR of the output signal of the latch LTA, the output signal of the latch LTB, the output signal of the latch LTC, and the output signal of the latch LTD.
- the saturation determining section 68 generates the control signal STP by determining whether or not one or more counters 35 of the counters 35 A to 35 D are turned to an overflow state.
- the AND circuit 69 is configured to find logical AND of an inverted signal of the control signal STP and a control signal REJEN.
- the control signal REJEN is generated by the signal generator 22 , for example.
- FIG. 24 illustrates an operation example in the exposure period P 1 of the photodetection unit U according to the present modification example.
- (A) indicates a waveform of light emitted from the light-emitting section 11 .
- (B) indicates a waveform of light reflected by the detection object OBJ and having entered the photodetection unit U.
- (C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD.
- (G) indicates a waveform of the control signal REJEN.
- the light-emitting section 11 emits light ((A) of FIG. 24 ).
- the signal generator 22 changes the clock signal CLKA to the high level in a period from the timing t 32 to a timing t 33 , changes the clock signal CLKB to the high level in a period from the timing t 33 to a timing t 34 , changes the clock signal CLKC to the high level in a period from the timing t 34 to a timing t 35 , and changes the clock signal CLKD to the high level in a period from the timing t 35 to a timing t 36 ((C) to (F) of FIG. 24 ).
- the signal generator 22 changes the control signal REJEN to the high level in a period from a timing t 37 to a timing t 38 different from this period from the timing t 32 to the timing t 36 ((G) of FIG. 24 ).
- FIG. 25 illustrates a more specific operation example of the photodetection unit U according to the present modification example.
- A indicates a waveform of light emitted from the light-emitting section 11 .
- B indicates a waveform of light reflected by the detection object OBJ and having entered the photodetection unit U.
- C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD.
- G indicates a waveform of the control signal REJEN.
- H) to (K) respectively indicate the count values CNTA to CNTD.
- L indicates a waveform of the control signal CTL.
- M indicates a waveform of the control signal STP.
- the counter 35 A to 35 D are 4-bit counters, the threshold THA is “8”, and the threshold THB is “15”.
- the photodetection system 1 In a period from a timing t 41 to a timing t 45 (exposure period P 1 ), the photodetection system 1 repeatedly emits the light pulse L 0 , and repeatedly detects the reflected light pulse L 1 reflected by the detection object OBJ.
- the counter 35 A performs count processing in a period in which the clock signal CLKA is at the high level to increment the count value CNTA ((C) and (H) of FIG. 25 ).
- the counter 35 B performs count processing in a period in which the clock signal CLKB is at the high level to increment the count value CNTB ((D) and (I) of FIG. 25 ).
- the counter 35 C performs count processing in a period in which the clock signal CLKC is at the high level to increment the count value CNTC ((E) and (J) of FIG. 25 ).
- the counter 35 D performs count processing in a period in which the clock signal CLKD is at the high level to increment the count value CNTD ((F) and (K) of FIG. 25 ).
- the count value CNTA changes from “7” to “8” ((H) of FIG. 25 ).
- the count value CNTA is the smallest value among the count values CNTA to CNTD; therefore, at this timing t 42 , the smallest value among the count values CNTA to CNTD reaches the threshold THA (“8” in this example).
- the subtraction determining section 66 changes the control signal CTL from the low level to the high level ((L) of FIG.
- the subtraction controller 37 subtracts a predetermined value (“8” in this example) from each of the count values CNTA to CNTD in the counters 35 A to 35 D ((H) to (K) of FIG. 25 ). That is, the photodetection unit U subtracts the predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D at this timing in synchronization with the control signal REJEN.
- the count values CNTA to CNTD are decreased by this subtraction processing, which causes the subtraction determining section 66 to change the control signal CTL from the high level to the low level at a timing directly after this timing t 43 ((L) of FIG. 25 ).
- the count value CNTB changes from “14” to “15” ((I) of FIG. 25 ). That is, the count value CNTB reaches the threshold THB (“15” in this example).
- the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- the control signal STP is at the high level from then on, which changes an output signal of the AND circuit 69 to the low level; therefore, the subtraction determining section 66 maintains the control signal CTL at the low level.
- the control signal REJEN is changed to the high level in a period different from a period in which the clock signals CLKA to CLKD are changed to the high level; therefore, the counters 35 A to 35 D do not perform count processing in a period in which the control signal REJEN is at the high level.
- the subtraction controller 37 to subtract the predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D in a period in which the counters 35 A to 35 D do not perform count processing. As a result, count processing and subtracting processing are not simultaneously performed, which makes it possible to reduce a possibility that a malfunction occurs.
- the photodetector 20 according to the embodiment described above may be formed on one semiconductor substrate, or may be formed on a plurality of semiconductor substrates.
- the present modification example is described in detail below with reference to some examples.
- FIG. 26 illustrates an implementation example of the photodetector 20 .
- the photodetector 20 is formed on two semiconductor substrates 101 and 102 .
- the semiconductor substrate 101 is disposed on side of the light-receiving surface S of the photodetector 20
- the semiconductor substrate 102 is disposed on side opposite to the light-receiving surface S of the photodetector 20 .
- the semiconductor substrates 101 and 102 are superimposed on each other.
- a wiring line of the semiconductor substrate 101 and a wiring line of the semiconductor substrate 102 are coupled to each other by a wiring line 103 . It is possible to use, for example, a metallic bond such as Cu—Cu or a bump for the wiring line 103 .
- the photodetection units U are disposed over these two semiconductor substrates 101 and 102 .
- FIG. 27 illustrates a configuration example of the light-receiving section 31 .
- This light-receiving section 31 has the same circuit configuration as the light-receiving section 31 illustrated in FIG. 4 A .
- the light-receiving section 31 is disposed over the two semiconductor substrates 101 and 102 .
- the photodiode PD is disposed on the semiconductor substrate 101
- the resistor R 1 and the inverter IV 1 are disposed on the semiconductor substrate 102 .
- the photodiode PD has the cathode coupled to the other end of the resistor R 1 and an input terminal of the inverter IV 1 through the wiring line 103 .
- the inverter IV 1 corresponds to a specific example of a “pulse generation circuit” in the present disclosure. It is to be noted that, in this example, the present modification example is applied to the photodetector 20 including the light-receiving section 31 illustrated in FIG. 4 A , but the present modification example may be applied to the photodetector 20 including the light-receiving section 31 illustrated in FIG. 4 B in a similar manner.
- the AND circuits 33 A to 33 D, the switches 34 A to 34 D, the counters 35 A to 35 D, the subtraction determining section 36 , the subtraction controller 37 , and the saturation determining section 38 are disposed on the semiconductor substrate 102 , for example.
- FIG. 28 illustrates another implementation example of the photodetector 20 .
- the photodetector 20 is formed on three semiconductor substrates 111 to 113 .
- the semiconductor substrate 111 is disposed on side of the light-receiving surface S of the photodetector 20
- the semiconductor substrate 113 is disposed on side opposite to the light-receiving surface S of the photodetector 20 .
- the semiconductor substrate 112 is disposed between the semiconductor substrate 111 and the semiconductor substrate 113 .
- the semiconductor substrates 111 to 113 are superimposed on each other.
- a wiring line of the semiconductor substrate 111 and a wiring line of the semiconductor substrate 112 are coupled to each other by a wiring line 114 .
- a wiring line of the semiconductor substrate 112 and a wiring line of the semiconductor substrate 113 are coupled to each other by a wiring line 115 . It is possible to use, for example, a metallic bond such as Cu—Cu or a bump for the wiring lines 114 and 115 .
- the photodetection units U are disposed over these three semiconductor substrates 111 to 113 . Specifically, for example, the photodiode PD is disposed on the semiconductor substrate 111 , the resistor R 1 and the inverter IV 1 are disposed on the semiconductor substrate 112 , and the subtraction determining section 36 , the subtraction controller 37 , and the saturation determining section 38 are disposed on the semiconductor substrate 113 .
- the photodetection system 1 performs only a distance measuring operation, but this is not limitative. Instead of this, for example, the photodetection system 1 may be able to perform both the distance measuring operation and an imaging operation.
- the present modification example is described in detail below.
- FIG. 29 illustrates a configuration example of a photodetection system 1 A according to the present modification example.
- the photodetection system 1 A is configured to be operable as an image sensor and be operable as a ToF sensor.
- the photodetection system 1 A includes a photodetector 80 and a controller 74 .
- the photodetector 80 is configured to detect light on the basis of an instruction from the controller 74 . Then, the photodetector 20 outputs image data based on a detection result as the data DT.
- the controller 74 is configured to supply control signals to the light-emitting section 11 and the photodetector 80 and control operations of the light-emitting section 11 and the photodetector 80 to thereby control an operation of the photodetection system 1 A.
- the controller 74 includes a mode setting section 75 .
- the mode setting section 75 is configured to set an operation mode M of the photodetection system 1 A.
- the photodetection system 1 A is operable in an imaging mode MA and a distance measurement mode MB.
- the imaging mode MA is a mode in which an image of a subject is captured on the basis of light L 10 from the subject.
- the distance measurement mode MB is a mode in which the light pulse L 0 is emitted and the reflected light pulse L 1 reflected by the detection object OBJ is detected to thereby measure a time difference between a timing at which the light pulse L 0 is emitted and a timing at which the reflected light pulse L 1 is detected.
- the mode setting section 75 sets one of the imaging mode MA and the distance measurement mode MB as the operation mode M. Then, the controller 74 controls the operation of the photodetection system 1 A in accordance with the set operation mode M.
- FIG. 30 illustrates a configuration example of the photodetector 80 .
- the photodetector 80 includes a photodetection array 81 , a signal generator 82 , a signal processor 84 , and a photodetection controller 85 .
- the photodetection array 81 includes a plurality of photodetection units U disposed in a matrix.
- the photodetection units U are each configured to detect light and count the number of detection times.
- FIG. 31 illustrates a configuration example of the photodetection unit U.
- the photodetection unit U includes a plurality of light-receiving sections 31 (four light-receiving sections 31 A to 31 D in this example), an OR circuit 32 , and a plurality of selectors 93 (four selectors 93 A to 93 D in this example).
- the light-receiving sections 31 A to 31 D respectively generate the pulse signals PLSA to PLSD.
- Each of the light-receiving sections 31 A to 31 D has, for example, a circuit configuration illustrated in FIG. 4 A or a circuit configuration illustrated in FIG. 4 B .
- the OR circuit 32 is configured to generate the pulse signal PLS by finding logical OR of the pulse signals PLSA to PLSD.
- the selector 93 A is configured to select one of the pulse signal PLSA and the pulse signal PLS on the basis of a mode control signal SMODE and supply the selected pulse signal to the switch 34 A.
- the mode control signal SMODE in this example is at a low level “0” in a case where the operation mode M is the imaging mode MA and is at a high level “1” in a case where the operation mode M is the distance measurement mode MB.
- the selector 93 A selects the pulse signal PLSA in a case where the operation mode M is the imaging mode MA, and selects the pulse signal PLS in a case where the operation mode M is the distance measurement mode MB. Then, the selector 93 A supplies the selected pulse signal to the switch 34 A.
- the selector 93 B is configured to select one of the pulse signal PLSB and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to the switch 34 B.
- the selector 93 C is configured to select one of the pulse signal PLSC and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to the switch 34 C.
- the selector 93 D is configured to select one of the pulse signal PLSD and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to the switch 34 A.
- the switches 34 A to 34 D respectively supplies the pulse signals PLSA to PLSD to the counters 35 A to 35 D in a period in which the clock signals CLKA to CLKD are at the high level.
- the clock signals CLKA to CLKD are four-phase clock signals, as illustrated in FIG. 7 .
- the switches 34 A to 34 D distributes the pulse signal PLS to four counters 35 A to 35 D in a time division manner on the basis of the clock signals CLKA to CLKD.
- the signal generator 82 ( FIG. 30 ) is configured to generate the clock signals CLKA to CLKD and the mode control signal SMODE on the basis of an instruction from the photodetection controller 85 and supply the clock signals CLKA to CLKD and the mode control signal SMODE to the plurality of photodetection units in the photodetection array 81 .
- the signal processor 84 is configured to perform predetermined signal processing on the basis of an instruction from the photodetection controller 85 . Specifically, in a case where the operation mode M is the imaging mode MA, the signal processor 84 generates image data of a captured image by performing predetermined image processing, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in the photodetection array 81 .
- the signal processor 84 generates image data of a distance image by measuring time from emission of the light pulse L 0 by the light-emitting section 11 to detection of the reflected light pulse L 1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in the photodetection array 81 .
- the signal processor 84 then outputs the generated image data as the data DT.
- the photodetection controller 85 is configured to control the operation of the photodetector 80 on the basis of an instruction from the controller 74 ( FIG. 29 ) by supplying control signals to the signal generator 82 , the readout controller 23 , and the signal processor 84 and controlling operations of the signal generator 82 , the readout controller 23 , and the signal processor 84 .
- the present embodiment has a configuration in which a counter is provided that counts the number of times subtraction processing for subtraction from the count values CNTA to CNTD of the counters 35 A to 35 D has been performed. It is to be noted that components substantially the same as those of the photodetection system 1 according to the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate.
- the photodetection system 2 includes a photodetector 120 , as with the photodetection system 1 ( FIG. 1 ) according to the first embodiment described above.
- FIG. 32 illustrates a configuration example of the photodetector 120 .
- the photodetector 120 includes a photodetection array 121 , a readout controller 123 , and a signal processor 124 .
- FIG. 33 illustrates a configuration example of the photodetection unit U in the photodetection array 121 .
- the photodetection unit U includes a counter 131 .
- the counter 131 is configured to count the number of times subtraction processing for subtracting a predetermined value from each of the count values CNTA to CNTD has been performed, on the basis of the control signal CTL generated by the subtraction determining section 36 .
- the counter 131 then outputs the number of times the subtraction processing has been performed as a count value CNTN.
- the readout controller 123 ( FIG. 32 ) is configured to control an operation of supplying, to the signal processor 124 , the count values CNTA to CNTD generated in each of the plurality of photodetection units U in the photodetection array 121 , on the basis of an instruction from the photodetection controller 25 .
- the signal processor 124 is configured to generate a distance image on the basis of an instruction from the photodetection controller 25 . Specifically, the signal processor 124 generates a distance image by measuring time (TOF value) from emission of the light pulse L 0 by the light-emitting section 11 to detection of the reflected light pulse L 1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in the photodetection array 21 .
- TOF value time
- the signal processor 124 includes a distance measurement correction section 126 .
- the distance measurement correction section 126 is configured to correct the TOF value on the basis of the count value CNTN. Specifically, the distance measurement correction section 126 calculates a full count value of the ambient light component C 2 in the photodetection unit U on the basis of the count value CNTN, and corrects the TOF value with use of the full count value of the ambient light component C 2 .
- FIG. 34 illustrates an example of the count values CNTA to CNTD.
- a portion W 1 indicates the count values CNTA to CNTD supplied from the photodetection unit U.
- a portion W 2 indicates a component removed by subtraction processing for the number of times indicated by the count value CNTN. It is possible to represent a count value in the portion W 1 by the threshold THB. It is possible to represent a count value of the removed component indicated by the portion W 2 by the product of the threshold THA and the count value CNTN.
- the distance measurement correction section 126 corrects the TOF value on the basis of the full count value of the ambient light component C 2 . That is, in the photodetection unit U, the light-receiving section 31 is not able to detect subsequent light for a while after detecting light. The TOF value deviates to a value smaller than an actual value due to such dead time.
- FIG. 35 illustrates an example of deviation of the TOF value caused by dead time in a case where there is no ambient light.
- (A) indicates a distribution of the count value CNT.
- (B) indicates a light reception probability in the light-receiving section 31 .
- a horizontal axis indicates elapsed time with reference to a timing at which the light-emitting section 11 emits the light pulse L 0 .
- a characteristic W 11 indicates a distribution of the count value CNT that is supposed to be obtained
- a characteristic W 12 indicates a distribution of the count value CNT actually obtained.
- the light-receiving section 31 is not able to detect subsequent light for a while after detecting light. Accordingly, the light reception probability of the light-receiving section 31 is as illustrated in (B) of FIG. 35 . That is, in a case where the elapsed time is short, as indicated by the characteristic W 11 , a probability that reflected light enters the light-receiving section 31 is low; therefore, the light reception probability is high. As indicated by the characteristic W 11 , the probability that the reflected light enters the light-receiving section 31 becomes higher with the lapse of time. As described above, in a case where the light-receiving section 31 receives the reflected light, it is not possible to detect light in a period of the dead time described above.
- the light-receiving section 11 receives the reflected light with the light reception probability illustrated in (B) of FIG. 35 .
- the distribution of the actual count values CNT becomes like the characteristic W 12 , which causes deviation of time corresponding to a peak of the distribution of the count value CNT. That is, a TOF value (TOF 2 ) obtained by the characteristic W 12 becomes smaller than a TOF value (TOF 1 ) obtained by the characteristic W 11 .
- the TOF value may deviate due to dead time of the light-receiving section 31 in such a manner.
- the light-receiving section 11 receives both reflected light and ambient light with the light reception probability illustrated in (B) of FIG. 35 . Accordingly, the light reception probability of the reflected light is decreased as compared with the case where there is no ambient light. The light reception probability of reflected light changes in such a manner; therefore, deviation of the TOF value may also change.
- the distance measurement correction section 126 corrects the TOF value from TOF 1 to TOF 2 on the basis of the full count value of the ambient light component C 2 in FIG. 35 , for example.
- the distance measurement correction section 126 is able to correct the TOF value on the basis of the full count value of the ambient light component C 2 with use of, for example, a lookup table indicating a relationship between the full count value of the ambient light component C 2 and a correction amount.
- the counter 131 corresponds to a specific example of a “second counter” in the present disclosure.
- the distance measurement correction section 124 corresponds to a specific example of a “second processor” in the present disclosure.
- the TOF value is calculated on the is of the count values CNTA to CNTD of the counters 35 A to 35 D, and this TOF value is corrected on the basis of the count value CNTN of the counter 131 , which makes it possible to enhance detection accuracy of time (TOF value) or a distance.
- the TOF value is calculated on the basis of the count values CNTA to CNTD of the counters 35 A to 35 D, and this TOF value is corrected on the basis of the count value CNTN of the counter 131 , which makes it possible to enhance detection accuracy.
- the photodetection system 2 generates a distance image, but this is not limitative. Instead of this, for example, in addition to the distance image, an image (light reception amount image) indicating a light reception amount may be further generated.
- an image light reception amount image
- the present modification example is described in detail below.
- a photodetection system 2 A according to the present modification example includes a photodetector 140 , as with the photodetection system 2 according to the embodiment described above.
- FIG. 36 illustrates a configuration example of the photodetector 140 .
- the photodetector 140 includes a photodetection array 141 , a signal generator 142 , a readout controller 143 , and a signal processor 144 .
- FIG. 37 illustrates a configuration example of the photodetection unit U in the photodetection array 141 .
- the photodetection unit U includes a counter 151 .
- the counter 151 is configured to count time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB by counting pulses of the clock signal CLK on the basis of the control signal STP generated by the saturation determining section 38 .
- the counter 151 performs count processing on the basis of the clock signal CLK generated in the exposure period P 1 and stops the count processing on the basis of the control signal STP, which makes it possible to count time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB. Then, the counter 151 outputs a result of the count processing as a count value CNTM.
- the signal generator 142 is configured to generate the clock signals CLKA to CLKD and CLK, and the thresholds THA and THB on the basis of an instruction from the photodetection controller 25 and supply the generated clock signals CLKA to CLKD and CLK, and the generated thresholds THA and THB to a plurality of photodetection units U in the photodetection array 141 .
- the readout controller 143 is configured to control an operation of supplying, to the signal processor 144 , the count values CNTA to CNTD, CNTN, and CNTM generated in each of the plurality of photodetection units U in the photodetection array 141 , on the basis of an instruction from the photodetection controller 25
- the signal processor 144 includes a light reception amount image generator 147 .
- the light reception amount image generator 147 is configured to generate a light reception amount image. Specifically, the light reception amount image generator 147 first calculates a count value Nsat with use of the following expression.
- Nsat is a full count value of the largest count value CNT (the count value CNTC in an example in FIG. 34 ) among the count values CNTA to CNTD in the photodetection unit U.
- This count value Nsat is a full count value obtained from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and the count processing stops.
- the light reception amount image generator 147 calculates a count value Nexp indicating a brightness value in the photodetection unit U with use of the following expression.
- Texp is a time length of the exposure period P 1
- Tsat is a time length of a period (count period) from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and the count processing stops.
- the light reception amount image generator 147 converts the count value Nsat obtained in the time Tsat that is the time length of the count period into the count value Nexp to be obtained in the time Texp that is the time length of the exposure period P 1 with use of this expression, as illustrated in FIG. 38 . That is, in each of the plurality of photodetection units U, the count processing individually stops; therefore, a timing at which the count processing stops may differ among the photodetection units U.
- the time length (time Tsat) of the period in which the count value Nsat is obtained may differ among the photodetection units U.
- the light reception amount image generator 147 converts the count value Nsat obtained in the time Tsat into the count value Nexp to be obtained in the time Texp that is the time length of the exposure period P 1 . This makes it possible for the light reception amount image generator 147 to then generate a light reception amount image on the basis of this count value Nexp in the plurality of photodetection units U.
- the counter 151 corresponds to a specific example of a “third counter” in the present disclosure.
- the light reception amount image generator 147 corresponds to a specific example of a “third processor” in the present disclosure.
- the count value Nsat that is the full count value of the largest count value CNT (the count value CNTC in the example in FIG. 34 ) among the count values CNTA to CNTD is converted into the count value Nexp to generate a light reception amount image, but this is not limitative.
- a total value of full count values of the four count values CNTA to CNTD may be converted into the count value Nexp to generate a light reception amount image.
- a full count value of the smallest count value CNT (e.g., the count value CNTA in the example in FIG. 34 ) among the four count values CNTA to CNTD may be converted into the count value Nexp to generate a light reception amount image.
- the signal processor 144 has pieces of information about the count values CNTA to CNTD, CNTN, and CNTM supplied from all the photodetection units U, which makes it possible for the light reception amount image generator 147 to generate a light reception amount image by any of such various methods on the basis of these pieces of information.
- the counter 151 counts time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, but this is not limitative. Instead of this, for example, the counter 151 may count time from when one or more count values of the count values CNTA to CNTD reach the threshold THB to when the exposure period P 1 ends. In this case, the light reception amount image generator 147 is able to convert a result (count value CNTM) of count processing by the counter 151 into time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, and calculate the count value Nexp on the basis of a result of such conversion.
- a latch 161 may be provided that latches, for example, a time code CODE on the basis of the control signal STP generated by the saturation determining section 38 .
- the time code CODE is generated by, for example, the signal generator 142 .
- the latch 161 generates a code CODE by latching a time code TCODE at a timing at which one or more count values of the count values CNTA to CNTD reach the threshold THB.
- the light reception amount image generator 147 is able to obtain time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, on the basis of, for example, a timing at which the exposure period P 1 starts and a timing indicated by this code CODE, and is ale to calculate the count value Nexp on the basis of this time.
- the latch 161 corresponds to a specific example of a “latch circuit” in the present disclosure.
- the present technology is applied to a TOF sensor, but this is not limitative. Instead of this, the present technology may be applied to, for example, an image sensor.
- FIG. 40 illustrates a configuration example of a photodetector 170 according to the present modification example.
- the photodetector 170 includes a photodetection array 171 , a signal generator 172 , the readout controller 143 , and a signal processor 174 .
- FIG. 41 illustrates a configuration example of the photodetection unit U in the photodetection array 171 .
- the photodetection unit U includes the light-receiving sections 31 A to 31 D, an inverter 133 , and the counter 151 .
- the light-receiving sections 31 A to 31 D respectively generate the pulse signals PLSA to PLSD.
- the inverter 133 is configured to invert the control signal STP and supply a thus-inverted signal to the switches 34 A to 34 D.
- the switches 34 A to 34 D respectively supply the pulse signals PLSA to PLSD to the counters 35 A to 35 D in a case where the control signal STP is at the lo level, and stop supply of the pulse signals PLSA to PLSD to the counters 35 A to 35 D in a case where the control signal STP is at the high level.
- the counter 151 is configured to count time from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB by counting pulses of the clock signal CLK on the basis of the control signal STP generated by the saturation determining section 38 . Then, the counter 151 outputs a result of counting pulses of the clock signal CLK as the count value CNTM.
- circuits including the light-receiving section 31 , the switch 34 , and the counter 35 are provided, but this is not limitative.
- the signal generator 172 ( FIG. 40 ) is configured to generate the clock signal CLK and the thresholds THA and THB on the basis of an instruction from the photodetection controller 25 and supply the generated clock signal CLK and the generated thresholds THA and THB to a plurality of photodetection units U in the photodetection array 171 .
- the readout controller 143 is configured to control an operation of supplying, to the signal processor 174 , the count values CNTA to CNTD, CNTN, and CNTM generated in each of the plurality of photodetection units U in the photodetection array 171 , on the basis of an instruction from the photodetection controller 25
- the signal processor 174 is configured to generate a captured image on the basis of an instruction from the photodetection controller 25 . Specifically, the signal processor 174 calculates a full count value of the count value CNTA obtained from when the exposure period P 1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and count processing stops, on the basis of the count values CNTA and the count value CNTN supplied from the photodetection unit U. Then, the signal processor 174 converts the full count value of this count value CNTA into a count value to be obtained in the time Texp that is the time length of the exposure period P 1 , as with the light reception amount image generator 147 . The same applies to the count values CNTB to CNTD. The signal processor 174 is able to generate a captured image in such a manner.
- a photodetection system 3 is configured to have the thresholds THA and THB changeable. It is to be noted that components substantially the same as those of the photodetection system 1 according to the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate.
- the photodetection system 3 includes a photodetector 220 , as with the photodetection system 1 ( FIG. 1 ) according to the first embodiment described above.
- FIG. 42 illustrates a configuration example of the photodetector 220 .
- the photodetector 220 includes a photodetection array 221 and a signal generator 222 .
- FIG. 43 illustrates a configuration example of the photodetection unit U in the photodetection array 221 .
- the photodetection unit U includes a determining section 236 and a threshold setting section 239 .
- the determining section 236 is configured to determine whether or not all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determining section 236 determines whether or not the smallest value among the count values CNTA to CNTD has reached the threshold THA. It is possible for the determining section 236 to have, for example, the same circuit configuration as the circuit configuration of the subtraction determining section 36 ( FIG. 6 ).
- the threshold setting section 239 is configured to set the thresholds THA and THB on the basis of a determination result of the determining section 236 . Then, the threshold setting section 231 supplies the set threshold THA to the determining section 236 , and supplies the set threshold THB to the saturation determining section 38 .
- the signal generator 222 ( FIG. 42 ) is configured to generate the clock signals CLKA to CLKD on the basis of an instruction from the photodetection controller 25 and supply the generated clock signals CLKA to CLKD to the plurality of photodetection units U in the photodetection array 221 .
- the determining section 236 and the threshold setting section 239 correspond to specific examples of a “threshold setting section” in the present disclosure.
- the saturation determining section 38 and the AND circuits 33 A to 33 D correspond to specific examples of a “stop processor” in the present disclosure.
- FIG. 44 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P 1 .
- the count values CNTA to CNTD gradually increase with the lapse of time.
- the ambient light component C 2 in each of the count values CNTA to CNTD is smaller than the threshold value THA.
- the ambient light component C 2 in each of the count values CNTA to CNTD reaches the threshold THA.
- the determining section 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determining section 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. Accordingly, the threshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB ((C) of FIG. 44 ).
- the count value CNTC reaches the threshold THB.
- the saturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- FIG. 45 illustrates an operation example of the photodetector 220 .
- the photodetection controller 25 starts the exposure period P 1 (step S 201 ).
- the signal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from the photodetection controller 25 .
- the photodetection controller 25 confirms whether or not the exposure period P 1 having a predetermined time length has ended (step S 202 ). In a case where the exposure period P 1 has ended (“Y” in step S 202 ), processing proceeds to step S 207 .
- the saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S 203 ). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S 203 ), the processing proceeds to step S 206 .
- step S 203 in a case where none of the count values CNT has reached the threshold THB (“N” in step S 203 ), the determining section 236 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S 204 ). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S 204 ), the processing returns to step S 202 .
- step S 204 in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S 204 ), the threshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB (step S 205 ). That is, in an example in FIG. 44 , as illustrated in (B) and (C) of FIG. 44 , all of the four count values CNT have reached the threshold THA, which causes the threshold setting section 239 to set each of the thresholds THA and THB to a higher value. The processing then returns to step S 202 .
- step S 203 in a case where one or more count values CNT have reached the threshold THB (“Y” in step S 203 ), the counters 35 A to 35 D stop count processing (step S 206 ). That is, in the example in FIG. 44 , as illustrated in (D) of FIG. 44 , one or more count values CNT of the four count values CNT have reached the threshold THB; which causes the saturation determining section 38 to change the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- the plurality of photodetection units U each perform such an operation individually.
- the photodetector 220 performs readout processing (step S 207 ). Specifically, the readout controller 23 controls the operations of the plurality of photodetection units U to supply, to the signal processor 24 , the count values CNTA to CND generated in each of the plurality of photodetection units U.
- the signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U.
- the determining section 236 and the threshold setting section 239 make a change to increase the threshold THB, on the basis of one or more count values of a plurality of count values CNT.
- the determining section 236 and the threshold setting section 239 make a change to increase the threshold THB.
- the determining section 236 and the threshold setting section 239 make a change to increase the threshold THB. Accordingly, as illustrated in (D) of FIG.
- the photodetection system 1 in a case where the amount of ambient light is large, it is possible to secure the signal amount of the reflected light component C 1 . As a result, in the photodetection system 1 , it is possible to enhance detection accuracy of time (TOF value) or a distance. In addition, in a case where the amount of ambient light is small, for example, the threshold THB is not changed, which makes it possible to stop count processing in a shorter time. This makes it possible to reduce electric power consumption and shorten distance measurement time, for example.
- the determining section 236 and the threshold setting section 239 make a change to increase the threshold THB.
- This makes it possible to adaptively set the threshold THB in accordance with the light amount of ambient light in each of the plurality of photodetection units U.
- it is possible to effectively enhance detection accuracy of time (TOF value) or a distance in each of the plurality of photodetection units U.
- the threshold THB is changed to be increased, on the basis of one or more count values of a plurality of count values, which makes it possible to secure the signal amount, thereby makes it possible to enhance detection accuracy.
- the determining section 236 determines whether or not all of the count values CNTA to CNTD have reached the threshold THA, but this is not limitative. For example, as with the modification example 1-4 of the first embodiment described above, whether or not the count value CNT of a predetermined counter 35 of a plurality of counters 35 has reached the threshold THA may be determined, or whether or not both the count values of two predetermined counters 35 of the plurality of counters 35 have reached the threshold THA may be determined. In addition, whether or not the sum of the count values of these two counters 35 reaches the threshold THA may be determined, or whether or not an average value of the count values of these two counters 35 reaches the threshold THA may be determined.
- a photodetection system 4 is a combination of technologies of the first embodiment and the third embodiment. It is to be noted that components substantially the same as those of the photodetection system 1 according to the first embodiment and the photodetection system 3 according to the third embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate.
- the photodetection system 4 includes a photodetector 320 , as with the photodetection system 3 according to the third embodiment described above.
- the photodetector 320 includes a photodetection array 321 and the signal generator 222 , as with the photodetector 220 ( FIG. 42 ) according to the third embodiment described above.
- FIG. 46 illustrate a configuration example of the photodetection unit U in the photodetection array 321 .
- the photodetection unit U includes a threshold setting section 339 , a subtraction determining section 336 , and the subtraction controller 37 .
- the threshold setting section 339 is configured to set the thresholds THA and THB on the basis of a determination result of the determining section 236 and the threshold THB. Specifically, the threshold setting section 339 sets the thresholds THA and THB in a case where the threshold THB has not reached a predetermined threshold THB 0 under a condition that the determining section 236 determines that all of the count values CNTA to CNTD have reached the threshold THA, and supplies the set threshold THA to the determining section 236 , and supplies the set threshold THB to the saturation determining section 38 .
- the subtraction determining section 336 is configured to determine whether or not to perform subtraction processing on the basis of a determination result of the determining section 236 and the threshold THB. Specifically, in a case where the threshold THB has reached the predetermined threshold THB 0 under a condition that the determining section 236 determines that all of the count values CNTA to CNTD have reached the threshold THA, the subtraction determining section 336 determines to perform subtraction processing.
- the subtraction controller 37 is configured to subtract a predetermined value from each of the count values CNTA to CNTD in the counters 35 A to 35 D on the basis of a determination result of this subtraction determining section 336 .
- the signal generator 222 is configured to generate the clock signals CLKA to CLKD on the basis of an instruction from the photodetection controller 25 and supply the generated clock signals CLKA to CLKD to the plurality of photodetection units U in the photodetection array 321 .
- the determining section 236 , the subtraction determining section 336 , and the subtraction controller 37 correspond to specific examples of a “subtraction processor” in the present disclosure.
- the determining section 236 and the threshold setting section 339 correspond to specific examples of a “threshold setting section” in the present disclosure.
- the saturation determining section 38 and the AND circuits 33 A to 33 D correspond to specific examples of a “stop processor” in the present disclosure.
- FIG. 47 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P 1 .
- the count values CNTA to CNTD gradually increase with the lapse of time.
- the ambient light component C 2 in each of the count values CNTA to CNTD is smaller than the threshold THA.
- the ambient light component C 2 in each of the count values CNTA to CNTD reaches the threshold THA.
- the determining section 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determining section 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. At this time, the threshold THB has not yet reached the predetermined threshold THB 0 .
- the threshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to higher value, for example, by adding a predetermined value to the threshold THB ((C) of FIG. 47 ).
- the ambient light component C 2 in each of the count values CNTA to CNTD reaches the changed threshold THA.
- the determining section 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determining section 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA.
- the threshold THB reaches the predetermined threshold THB 0 . Accordingly, the subtraction determining section 336 determines to perform subtraction processing, and the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD ((E) of FIG. 47 ).
- the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD ((E) of FIG. 47 ).
- the count value CNTC reaches the threshold THB.
- the saturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- FIG. 48 illustrates an operation example of the photodetector 320 .
- the photodetection controller 25 starts the exposure period P 1 (step S 301 ).
- the signal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from the photodetection controller 25 .
- the photodetection controller 25 confirms whether or not the exposure period P 1 having a predetermined time length has ended (step S 302 ). In a case where the exposure period P 1 has ended (“Y” in step S 302 ), processing proceeds to step S 309 .
- the saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S 303 ). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S 303 ), the processing proceeds to step S 308 .
- step S 303 in a case where none of the count values CNT has reached the threshold THB (“N” in step S 303 ), the determining section 236 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S 304 ). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S 304 ), the processing returns to step S 302 .
- step S 304 in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S 304 ), the threshold setting section 339 and the subtraction determining section 336 confirm whether or not the threshold THB has reached the predetermined threshold THB 0 (step S 305 ).
- step S 305 in a case where the threshold THB has not reached the predetermined threshold THB 0 (“N” in step S 305 ), the threshold setting section 339 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB (step S 306 ). That is, in an example in FIG. 47 , as illustrated in (B) and (C) of FIG. 47 , all of the four count values CNT have reached the threshold THA, and the threshold THB has not reached the predetermined threshold THB 0 , which causes the threshold setting section 239 to set each of the thresholds THA and THB to a higher value. The processing then returns to step S 302 .
- step S 305 in a case where the threshold THB has reached the predetermined threshold THB 0 (“Y” in step S 305 ), the subtraction determining section 336 determines to perform subtraction processing, and the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD (step S 307 ). That is, in the example in FIG. 47 , as illustrated in (D) and (E) of FIG. 47 , all of the four count values CNT have reached the threshold THA, and the threshold THB has reached the predetermined threshold THB 0 ; therefore, the subtraction determining section 336 determines to perform subtraction processing, and the subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD. The processing then returns to step S 302 .
- step S 303 in a case where one or more count values CNT have reached the threshold THB (“Y” in step S 303 ), the counters 35 A to 35 D stop count processing (step S 308 ). That is, in the example in FIG. 47 , as illustrated in (F) of FIG. 47 , in a case where one or more count values CNT of the four count values CNT have reached the threshold THB, the saturation determining section 38 changes the control signal STP from the low level to the high level.
- the AND circuits 33 A to 33 D each change the output signal to the low level on the basis of this control signal STP. Accordingly, the switches 34 A to 34 D stop supply of the pulse signal PLS to the counters 35 A to 35 D, and the counters 35 A to 35 D stop count processing.
- the plurality of photodetection units U each performs such an operation individually.
- the photodetector 320 performs readout processing (step S 309 ). Specifically, the readout controller 23 controls the operations of the plurality of photodetection units U to supply, to the signal processor 24 , the count values CNTA to CND generated in each of the plurality of photodetection units U.
- the signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U.
- the determining section 236 , the subtraction determining section 336 , and the subtraction controller 37 perform subtraction processing for subtracting a predetermined value from each of a plurality of count values CNT on the basis of one or more count values of the plurality of count values CNT. Accordingly, for example, as with the first embodiment, in a case where the amount of ambient light is large, it is possible to decrease the final ambient light component C 2 to the threshold THA or lower, which makes it possible to secure the signal amount of the reflected light component C 1 . As a result, in the photodetection system 4 , it is possible to enhance detection accuracy of time (TOF value) or a distance.
- TOF value detection accuracy of time
- the determining section 236 and the threshold setting section 339 make a change to increase the threshold THB, on the basis of one or more count values of the plurality of count values CNT. Accordingly, for example, as with the third embodiment, it is possible to secure the signal amount of the reflected light component C 1 in a case where the amount of ambient light is large. As a result, in the photodetection system 4 , it is possible to enhance detection accuracy of time (TOF value) or a distance. In addition, in a case where the amount of ambient light is small, for example, the threshold THB is not changed, which makes it possible to stop count processing in a shorter time. This makes it possible to reduce electric power consumption and shorten distance measurement time, for example.
- the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed, and the threshold THB is changed to be increased, which makes it possible to secure the signal amount, thereby makes it possible to enhance detection accuracy.
- the determining section 236 determines whether or not all of the count values CNTA to CNTD have reached the threshold THA, but this is not limitative. For example, as with the modification example 1-4 of the first embodiment described above, whether or not the count value CNT of a predetermined counter 35 of a plurality of counters 35 has reached the threshold THA may be determined, or whether or not both the count values CNT of two predetermined counters 35 of the plurality of counters 35 have reached the threshold THA may be determined. In addition, whether or not the sum of the count values of these two counters 35 reaches the threshold THA may be determined, or whether or not an average value of the count values of these two counters reaches the threshold THA may be determined.
- the technology (the present technology) according to the present disclosure is applicable to a variety of products.
- the technology according to the present disclosure may be achieved as a device mounted on any type of mobile body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility, an airplane, a drone, a vessel, or a robot.
- FIG. 49 is a block diagram depicting an example of schematic configuration of a vehicle control system as an example of a mobile body control system to which the technology according to an embodiment of the present disclosure can be applied.
- the vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001 .
- the vehicle control system 12000 includes a driving system control unit 12010 , a body system control unit 12020 , an outside-vehicle information detecting unit 12030 , an in-vehicle information detecting unit 12040 , and an integrated control unit 12050 .
- a microcomputer 12051 , a sound/image output section 12052 , and a vehicle-mounted network interface (I/F) 12053 are illustrated as a functional configuration of the integrated control unit 12050 .
- the driving system control unit 12010 controls the operation of devices related to the driving system of the vehicle in accordance with various kinds of programs.
- the driving system control unit 12010 functions as a control device for a driving force generating device for generating the driving force of the vehicle, such as an internal combustion engine, a driving motor, or the like, a driving force transmitting mechanism for transmitting the driving force to wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating the braking force of the vehicle, and the like.
- the body system control unit 12020 controls the operation of various kinds of devices provided to a vehicle body in accordance with various kinds of programs.
- the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various kinds of lamps such as a headlamp, a backup lamp, a brake lamp, a turn signal, a fog lamp, or the like.
- radio waves transmitted from a mobile device as an alternative to a key or signals of various kinds of switches can be input to the body system control unit 12020 .
- the body system control unit 12020 receives these input radio waves or signals, and controls a door lock device, the power window device, the lamps, or the like of the vehicle.
- the outside-vehicle information detecting unit 12030 detects information about the outside of the vehicle including the vehicle control system 12000 .
- the outside-vehicle information detecting unit 12030 is connected with an imaging section 12031 .
- the outside-vehicle information detecting unit 12030 makes the imaging section 12031 image an image of the outside of the vehicle, and receives the imaged image.
- the outside-vehicle information detecting unit 12030 may perform processing of detecting an object such as a human, a vehicle, an obstacle, a sign, a character on a road surface, or the like, or processing of detecting a distance thereto.
- the imaging section 12031 is an optical sensor that receives light, and which outputs an electric signal corresponding to a received light amount of the light.
- the imaging section 12031 can output the electric signal as an image, or can output the electric signal as information about a measured distance.
- the light received by the imaging section 12031 may be visible light, or may be invisible light such as infrared rays or the like.
- the in-vehicle information detecting unit 12040 detects information about the inside of the vehicle.
- the in-vehicle information detecting unit 12040 is, for example, connected with a driver state detecting section 12041 that detects the state of a driver.
- the driver state detecting section 12041 for example, includes a camera that images the driver.
- the in-vehicle information detecting unit 12040 may calculate a degree of fatigue of the driver or a degree of concentration of the driver, or may determine whether the driver is dozing.
- the microcomputer 12051 can calculate a control target value for the driving force generating device, the steering mechanism, or the braking device on the basis of the information about the inside or outside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030 or the in-vehicle information detecting unit 12040 , and output a control command to the driving system control unit 12010 .
- the microcomputer 12051 can perform cooperative control intended to implement functions of an advanced driver assistance system (ADAS) which functions include collision avoidance or shock mitigation for the vehicle, following driving based on a following distance, vehicle speed maintaining driving, a warning of collision of the vehicle, a warning of deviation of the vehicle from a lane, or the like.
- ADAS advanced driver assistance system
- the microcomputer 12051 can perform cooperative control intended for automated driving, which makes the vehicle to travel automatedly without depending on the operation of the driver, or the like, by controlling the driving force generating device, the steering mechanism, the braking device, or the like on the basis of the information about the outside or inside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030 or the in-vehicle information detecting unit 12040 .
- the microcomputer 12051 can output a control command to the body system control unit 12020 on the basis of the information about the outside of the vehicle which information is obtained by the outside-vehicle information detecting unit 12030 .
- the microcomputer 12051 can perform cooperative control intended to prevent a glare by controlling the headlamp so as to change from a high beam to a low beam, for example, in accordance with the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicle information detecting unit 12030 .
- the sound/image output section 12052 transmits an output signal of at least one of a sound and an image to an output device capable of visually or auditorily notifying information to an occupant of the vehicle or the outside of the vehicle.
- an audio speaker 12061 a display section 12062 , and an instrument panel 12063 are illustrated as the output device.
- the display section 12062 may, for example, include at least one of an on-board display and a head-up display.
- FIG. 50 is a diagram depicting an example of the installation position of the imaging section 12031 .
- the imaging section 12031 includes imaging sections 12101 , 12102 , 12103 , 12104 , and 12105 .
- the imaging sections 12101 , 12102 , 12103 , 12104 , and 12105 are, for example, disposed at positions on a front nose, sideview mirrors, a rear bumper, and a back door of the vehicle 12100 as well as a position on an upper portion of a windshield within the interior of the vehicle.
- the imaging section 12101 provided to the front nose and the imaging section 12105 provided to the upper portion of the windshield within the interior of the vehicle obtain mainly an image of the front of the vehicle 12100 .
- the imaging sections 12102 and 12103 provided to the sideview mirrors obtain mainly an image of the sides of the vehicle 12100 .
- the imaging section 12104 provided to the rear bumper or the back door obtains mainly an image of the rear of the vehicle 12100 .
- the imaging section 12105 provided to the upper portion of the windshield within the interior of the vehicle is used mainly to detect a preceding vehicle, a pedestrian, an obstacle, a signal, a traffic sign, a lane, or the like.
- FIG. 50 depicts an example of photographing ranges of the imaging sections 12101 to 12104 .
- An imaging range 12111 represents the imaging range of the imaging section 12101 provided to the front nose.
- Imaging ranges 12112 and 12113 respectively represent the imaging ranges of the imaging sections 12102 and 12103 provided to the sideview mirrors.
- An imaging range 12114 represents the imaging range of the imaging section 12104 provided to the rear bumper or the back door.
- a bird's-eye image of the vehicle 12100 as viewed from above is obtained by superimposing image data imaged by the imaging sections 12101 to 12104 , for example.
- At least one of the imaging sections 12101 to 12104 may have a function of obtaining distance information.
- at least one of the imaging sections 12101 to 12104 may be a stereo camera constituted of a plurality of imaging elements, or may be an imaging element having pixels for phase difference detection.
- the microcomputer 12051 can determine a distance to each three-dimensional object within the imaging ranges 12111 to 12114 and a temporal change in the distance (relative speed with respect to the vehicle 12100 ) on the basis of the distance information obtained from the imaging sections 12101 to 12104 , and thereby extract, as a preceding vehicle, a nearest three-dimensional object in particular that is present on a traveling path of the vehicle 12100 and which travels in substantially the same direction as the vehicle 12100 at a predetermined speed (for example, equal to or more than 0 km/hour). Further, the microcomputer 12051 can set a following distance to be maintained in front of a preceding vehicle in advance, and perform automatic brake control (including following stop control), automatic acceleration control (including following start control), or the like. It is thus possible to perform cooperative control intended for automated driving that makes the vehicle travel automatedly without depending on the operation of the driver or the like.
- automatic brake control including following stop control
- automatic acceleration control including following start control
- the microcomputer 12051 can classify three-dimensional object data on three-dimensional objects into three-dimensional object data of a two-wheeled vehicle, a standard-sized vehicle, a large-sized vehicle, a pedestrian, a utility pole, and other three-dimensional objects on the basis of the distance information obtained from the imaging sections 12101 to 12104 , extract the classified three-dimensional object data, and use the extracted three-dimensional object data for automatic avoidance of an obstacle.
- the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles that the driver of the vehicle 12100 can recognize visually and obstacles that are difficult for the driver of the vehicle 12100 to recognize visually. Then, the microcomputer 12051 determines a collision risk indicating a risk of collision with each obstacle.
- the microcomputer 12051 In a situation in which the collision risk is equal to or higher than a set value and there is thus a possibility of collision, the microcomputer 12051 outputs a warning to the driver via the audio speaker 12061 or the display section 12062 , and performs forced deceleration or avoidance steering via the driving system control unit 12010 .
- the microcomputer 12051 can thereby assist in driving to avoid collision.
- At least one of the imaging sections 12101 to 12104 may be an infrared camera that detects infrared rays.
- the microcomputer 12051 can, for example, recognize a pedestrian by determining whether or not there is a pedestrian in imaged images of the imaging sections 12101 to 12104 .
- recognition of a pedestrian is, for example, performed by a procedure of extracting characteristic points in the imaged images of the imaging sections 12101 to 12104 as infrared cameras and a procedure of determining whether or not it is the pedestrian by performing pattern matching processing on a series of characteristic points representing the contour of the object.
- the sound/image output section 12052 controls the display section 12062 so that a square contour line for emphasis is displayed so as to be superimposed on the recognized pedestrian.
- the sound/image output section 12052 may also control the display section 12062 so that an icon or the like representing the pedestrian is displayed at a desired position.
- the example of the vehicle control system to which the technology according to the present disclosure may be applied has been described above.
- the technology according to the present disclosure may be applied to the imaging section 12031 among the components described above.
- This makes it possible to enhance detection accuracy of time (TOF value) or a distance in the vehicle control system 12000 .
- TOF value detection accuracy of time
- this allows the vehicle control system 12000 to implement, with high accuracy, collision avoidance or shock mitigation for vehicles, a following driving function based on vehicle-to-vehicle distance, a vehicle speed maintaining driving function, a warning function of collision of the vehicle, a warning function of deviation of the vehicle from a lane, and the like.
- the light-receiving section 31 as illustrated in FIGS. 4 A and 4 B is provided; however, the circuit configuration of the light-receiving section 31 is not limited thereto, and any of various circuit configurations is applicable to the light-receiving section 31 .
- the present technology may have the following configurations. According to the present technology having the following configurations, it is possible to enhance detection accuracy.
- a photodetection device including:
- the photodetection device further including a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
- the photodetection device in which the subtraction processor performs the subtracting processing in a case where all of the plurality of count values have reached a second threshold.
- the photodetection device in which the subtraction processor performs the subtraction processing in a case where a smallest value among the plurality of count values has reached a second threshold.
- the photodetection device in which the subtraction processor performs the subtraction processing on the basis of the count values of one or more predetermined first counters of the plurality of first counters.
- the photodetection device according to any one of (2) to (5), in which the subtraction processor performs the subtraction processing by changing a bit value of a predetermined count bit of a plurality of count bits in each of the plurality of first counters.
- the photodetection device in which the predetermined count bit includes a most significant bit of the plurality of count bits.
- the photodetection device according to any one of (2) to (7), in which the subtraction processor performs the subtraction processing in a period in which each of the plurality of first counters does not perform the count processing.
- the photodetection device according to any one of (2) to (8), in which the first threshold includes a largest possible count value taken by the plurality of count values.
- the photodetection device according to any one of (2) to (9), further including a threshold setting section that makes a change to increase the first threshold, on the basis of one or more count values of the plurality of count values, in which
- the photodetection device in which the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
- the photodetection device in which the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
- the photodetection device in which the threshold setting section makes a change to increase the first threshold on the basis of the count values of one or more predetermined counters of the plurality of first counters.
- the photodetection device according to any one of (2) to (13), further including a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
- the photodetection device according to any one of (2) to (14), further including a second counter that counts number of times the subtraction processing has been performed.
- the photodetection device further including a second processor that calculates a photodetection timing on the basis of the plurality of count values after the stop processor stops the count processing in the plurality of first counters, and corrects the photodetection timing on the basis of a count value of the second counter.
- the photodetection device according to (15) or (16), further including a detector that detects a stop timing at which the stop processor stops the count processing in the plurality of first counters.
- the photodetection device in which the detector includes a third counter that measures time from when the plurality of first counters starts the count processing to when the stop processor stops the count processing.
- the photodetection device in which the detector includes a third counter that measures time from when the stop processor stops the count processing to a subsequent predetermined timing.
- the photodetection device further including a code generator that generates a time code, in which
- the photodetection device according to any one of (17) to (20), further including a third processor that corrects count values of the plurality of first counters on the basis of a count value of the second counter and the stop timing.
- a photodetection device including:
- the photodetection device in which the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
- the photodetection device in which the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
- the photodetection device in which the threshold setting section makes a change to increase the first threshold on the basis of the count values of one or more predetermined first counters of the plurality of first counters.
- the photodetection device according to any one of (27) to (30), further including a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
- a photodetection system including:
- a photodetection system including:
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Measurement Of Optical Distance (AREA)
Abstract
A photodetection device according to the present disclosure includes: one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element; a plurality of first counters that each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values; and a subtraction processor that performs subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
Description
- The present disclosure relates to a photodetection device and a photodetection system that detect light.
- A TOF (Time OF Flight) method is frequently used to measure a distance to an detection object. In this TOF method, light is emitted, and reflected light reflected by the detection object is detected. Then, in the TOF method, the distance to the measurement object is measured by measuring a time difference between a timing at which the light is emitted and a timing at which the reflected light is detected. For example,
PTL 1 discloses a distance measuring device that reduces a light reception amount of ambient light by turning off any of a plurality of light-receiving elements. - PTL 1: Japanese Unexamined Patent Application Publication No. 2014-77658
- In a photodetection device, it is desired to enhance detection accuracy, and a further improvement in detection accuracy is expected.
- It is desirable to provide a photodetection device and a photodetection system that make it possible to enhance detection accuracy.
- A first photodetection device according to an embodiment of the present disclosure includes one or a plurality of light-receiving sections, a plurality of first counters, and a subtraction processor. The one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The subtraction processor is configured to perform subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
- A second photodetection device according to an embodiment of the present disclosure includes one or a plurality of light-receiving sections, a plurality of first counters, a stop processor, and a threshold setting section. The one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The stop controller is configured to stop the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold. The threshold setting section is configured to make a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- A first photodetection system according to an embodiment of the present disclosure includes a light-emitting section and a photodetector. The light-emitting section is configured to emit light. The photodetector is configured to detect light reflected by a detection object of the light emitted from the light-emitting section. This photodetector includes one or a plurality of light-receiving sections, a plurality of first counters, and a subtraction processor. The one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The subtraction processor is configured to perform subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
- A second photodetection system according to an embodiment of the present disclosure includes a light-emitting section and a photodetector. The light-emitting section is configured to emit light. The photodetector is configured to detect light reflected by a detection object of the light emitted from the light-emitting section. This photodetector includes one or a plurality of light-receiving sections, a plurality of first counters, a stop processor, and a threshold setting section. The one or plurality of light-receiving sections each includes a light-receiving element, and is configured to generate a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters is configured to each perform count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The stop controller is configured to stop the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold. The threshold setting section is configured to make a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- In the first photodetection device and the first photodetection system according to the embodiments of the present disclosure, the one or plurality of light-receiving sections each generates the pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The subtraction processor performs subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of the plurality of count values.
- In the second photodetection device and the second photodetection system according to the embodiments of the present disclosure, the one or plurality of light-receiving sections each generates the pulse signal including a pulse corresponding to a result of light reception by the light-receiving element. The plurality of first counters each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values. The stop controller stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold. The threshold setting section makes a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
-
FIG. 1 is a block diagram illustrating a configuration example of a photodetection system according to an embodiment of the present disclosure. -
FIG. 2 is a block diagram illustrating a configuration example of a photodetector illustrated inFIG. 1 . -
FIG. 3 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 2 . -
FIG. 4A is a circuit diagram illustrating a configuration example of a light-receiving section illustrated inFIG. 3 . -
FIG. 4B is a circuit diagram illustrating another configuration example of the light-receiving section illustrated inFIG. 3 . -
FIG. 5 is a block diagram illustrating a configuration example of a subtraction determining section illustrated inFIG. 3 . -
FIG. 6 is a block diagram illustrating a configuration example of a saturation determining section illustrated inFIG. 3 . -
FIG. 7 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated inFIG. 3 . -
FIG. 8 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated inFIG. 3 . -
FIG. 9 is a flowchart illustrating an operation example of the photodetector illustrated inFIG. 2 . -
FIG. 10 is an explanatory diagram illustrating an operation example of a signal processor illustrated inFIG. 2 . -
FIG. 11 is an explanatory diagram illustrating an operation example of the photodetection unit illustrated inFIG. 3 . -
FIG. 12A is a circuit diagram illustrating a configuration example of a light-receiving section according to a modification example of a first embodiment. -
FIG. 12B is a circuit diagram illustrating a configuration example of the light-receiving section according to the modification example of the first embodiment. -
FIG. 13 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment. -
FIG. 14 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment. -
FIG. 15 is a circuit diagram illustrating a configuration example of a light-receiving section illustrated inFIG. 14 . -
FIG. 16 is an explanatory diagram illustrating an operation example of a subtraction controller according to another modification example of the first embodiment. -
FIG. 17 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment. -
FIG. 18 is a circuit diagram illustrating a configuration example of a subtraction determining section illustrated inFIG. 17 . -
FIG. 19 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated inFIG. 17 . -
FIG. 20 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment. -
FIG. 21 is a circuit diagram illustrating a configuration example of a subtraction determining section illustrated inFIG. 20 . -
FIG. 22 is a circuit diagram illustrating another configuration example of the subtraction determining section illustrated inFIG. 20 . -
FIG. 23 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the first embodiment. -
FIG. 24 is a timing waveform diagram illustrating an operation example of the photodetection unit illustrated inFIG. 23 . -
FIG. 25 is another timing waveform diagram illustrating an operation example of the photodetection unit illustrated inFIG. 23 . -
FIG. 26 is an explanatory diagram illustrating an implementation example of a photodetector according to another modification example of the first embodiment. -
FIG. 27 is a circuit diagram illustrating a configuration example of a light-receiving section according to another modification example of the first embodiment. -
FIG. 28 is an explanatory diagram illustrating an implementation example of a photodetector according to another modification example of the first embodiment. -
FIG. 29 is a block diagram illustrating a configuration example of a photodetection system according to another modification example of the first embodiment. -
FIG. 30 is a block diagram illustrating a configuration example of a photodetector illustrated inFIG. 29 . -
FIG. 31 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 30 . -
FIG. 32 is a block diagram illustrating a configuration example of a photodetector according to a second embodiment. -
FIG. 33 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 32 . -
FIG. 34 is an explanatory diagram illustrating an operation example of the photodetection unit illustrated inFIG. 33 . -
FIG. 35 is an explanatory diagram illustrating an example of deviation of time (TOF). -
FIG. 36 is a block diagram illustrating a configuration example of a photodetector according to a modification example of the second embodiment. -
FIG. 37 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 36 . -
FIG. 38 is an explanatory diagram illustrating an operation example of a light reception amount image generator illustrated inFIG. 36 . -
FIG. 39 is a circuit diagram illustrating a configuration example of a photodetection unit according to another modification example of the second embodiment. -
FIG. 40 is a block diagram illustrating a configuration example of a photodetector according to another modification example of the second embodiment. -
FIG. 41 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 40 . -
FIG. 42 is a block diagram illustrating a configuration example of a photodetector according to a third embodiment. -
FIG. 43 is a circuit diagram illustrating a configuration example of a photodetection unit illustrated inFIG. 42 . -
FIG. 44 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated inFIG. 43 . -
FIG. 45 is a flowchart illustrating an operation example of the photodetector illustrated inFIG. 42 . -
FIG. 46 is a circuit diagram illustrating a configuration example of a photodetection unit according to a fourth embodiment. -
FIG. 47 is an explanatory diagram illustrating changes in count values in the photodetection unit illustrated inFIG. 46 . -
FIG. 48 is a flowchart illustrating an operation example of a photodetector according to the fourth embodiment. -
FIG. 49 is a block diagram depicting an example of schematic configuration of a vehicle control system. -
FIG. 50 is a diagram of assistance in explaining an example of installation positions of an outside-vehicle information detecting section and an imaging section. - In the following, some embodiments of the present disclosure are described in detail with reference to the drawings. It is to be noted that description is given in the following order.
-
- 1. First Embodiment
- 2. Second Embodiment
- 3. Third Embodiment
- 4. Fourth Embodiment
- 5. Example of Application to Mobile Body
-
FIG. 1 illustrates a configuration example of a photodetection system (photodetection system 1) according to an embodiment. Thephotodetection system 1 is a ToF (Time-of-Flight) sensor, and is configured to emit light and detect reflected light reflected by a detection object OBJ. Thephotodetection system 1 includes a light-emitting section 11, anoptical system 12, aphotodetector 20, and acontroller 14. - The light-emitting section 11 is configured to emit a light pulse L0 toward the detection object OBJ on the basis of an instruction from the
controller 14. The light-emitting section 11 emits the light pulse L0 on the basis of an instruction from thecontroller 14 by performing a light emission operation of alternately repeating emission and non-emission of light. The light-emitting section 11 includes, for example, a light source that emits infrared light. This light source is configured with use of, for example, a laser light source, an LED (Light Emitting Diode), or the like. - The
optical system 12 includes a lens that forms an image on a light-receiving surface S of thephotodetector 20. A light pulse (reflected light pulse L1) emitted from the light-emitting section 11 and reflected by the detection object OBJ enters thisoptical system 12. - The
photodetector 20 is configured to detect the reflected light pulse L1 on the basis of an instruction from thecontroller 14. Thephotodetector 20 then generates a distance image on the basis of a detection result, and outputs image data of the generated distance image as data DT. - The
controller 14 is configured to supply control signals to the light-emitting section 11 and thephotodetector 20 and control operations of the light-emitting section 11 and thephotodetector 20 to thereby control an operation of thephotodetection system 1. -
FIG. 2 illustrates a configuration example of thephotodetector 20. Thephotodetector 20 includes aphotodetection array 21, asignal generator 22, areadout controller 23, asignal processor 24, and aphotodetection controller 25. - The
photodetection array 21 includes a plurality of photodetection units U disposed in a matrix. The photodetection units U are each configured to detect the reflected light pulse L1 and count the number of detection times of the reflected light pulse L1. -
FIG. 3 illustrates a configuration example of the photodetection unit U. The photodetection unit U includes a light-receivingsection 31, a plurality of logical AND (AND) circuits 33 (four ANDcircuits 33A to 33D in this example), a plurality of switches 34 (fourswitches 34A to 34D in this example), a plurality of counters 35 (fourcounters 35A to 35D in this example), asubtraction determining section 36, asubtraction controller 37, and asaturation determining section 38. It is to be noted that, in this example, four circuits including the AND circuit 33, the switch 34, and the counter 35 are provided, but this is not limitative. For example, three or more circuits including the AND circuit 33, the switch 34, and the counter 35 may be provided. - The light-receiving
section 31 is configured to detect light to thereby generate a pulse signal PLS including a pulse corresponding to the detected light. -
FIG. 4A illustrates a configuration example of the light-receivingsection 31. In this example, the light-receivingsection 31 includes a photodiode PD, a resistor R1, and an inverter IV1. - The photodiode PD is a photoelectric conversion element that converts light into electric charge. The photodiode PD has an anode supplied with a power supply voltage VSS, and a cathode coupled to a node N1. It is possible to use, for example, an avalanche photodiode (APD; Avalanche Photodiode), a single photon avalanche diode (SPAD; Single Photon Avalanche Diode), or the like for the photodiode PD.
- The resistor R1 has one end supplied with a power supply voltage VDD, and another end coupled to the node N1.
- The inverter IV1 is configured to output a low level in a case where a voltage at the node N1 is higher than a logical threshold, and output a high level in a case where the voltage at the node N1 is lower than the logical threshold to thereby generate the pulse signal PLS.
- With this configuration, in the light-receiving
section 31, the photodiode PD causes avalanche amplification by detecting light, which decreases the voltage at the node N1. Then, in a case where the voltage at the node N1 becomes lower than the logical threshold of the inverter IV1, the pulse signal PLS changes from the low level to the high level. Thereafter, a current flows into the node N1 through the resistor R1 to thereby increase the voltage at the node N1. Then, in a case where the voltage at the node N1 becomes higher than the logical threshold of the inverter IV1, the pulse signal PLS changes from the high level to the low level. Thus, the light-receivingsection 31 generates the pulse signal PLS including a pulse corresponding to the detected light. -
FIG. 4B illustrates another configuration example of the light-receivingsection 31. In this example, the light-receivingsection 31 includes the photodiode PD, a transistor MP1, the inverter IV1, and a control circuit CKT1. - The transistor MP1 is a P-type MOS (Metal Oxide Semiconductor) transistor, and has a gate coupled to an output terminal of the control circuit CKT1, a source supplied with the power supply voltage VDD, and a drain coupled to the node N1.
- The control circuit CKT1 is configured to control an operation of the transistor MP1 on the basis of the pulse signal PLS. Specifically, the control circuit CKT1 changes a voltage at the gate of the transistor MP1 to the low level after the pulse signal PLS changes from the low level to the high level, and changes the voltage at the gate of the transistor MP1 to the high level after the pulse signal PLS changes from the high level to the low level.
- With this configuration, in the light-receiving
section 31, the photodiode PD detects light to thereby decrease the voltage at the node N1. Then, in a case where the voltage at the node N1 becomes lower than the logical threshold of the inverter IV1, the pulse signal PLS changes from the low level to the high level. After this change in the pulse signal PLS, the control circuit CKT1 changes the voltage at the gate of the transistor MP1 to the low level. This turns on the transistor MP1 to cause a current to flow into the node N1 through the transistor MP1, which increases the voltage at the node N1. Then, in a case where the voltage at the node N1 becomes higher than the logical threshold of the inverter IV1, the pulse signal PLS changes from the high level to the low level. After this change in the pulse signal PLS, the control circuit CKT1 changes the voltage at the gate of the transistor MP1 to the high level. This turns off the transistor MP1. Thus, the light-receivingsection 31 generates the pulse signal PLS including a pulse corresponding to the detected light. - The AND
circuit 33A (FIG. 3 ) is configured to find logical AND of a clock signal CLKA and an inverted signal of a control signal STP. Theswitch 34A is configured to turn on or off supply of the pulse signal PLS to thecounter 35A on the basis of an output signal of the ANDcircuit 33A. Specifically, theswitch 34A supplies the pulse signal PLS to thecounter 35A in a case where the output signal of the ANDcircuit 33A is at the high level, and supplies a low-level signal to thecounter 35A in a case where the output signal of the ANDcircuit 33A is at the low level. Theswitch 34A is configured with use of, for example, an AND circuit or a logical OR (OR) circuit. - Likewise, the AND
circuit 33B is configured to find logical AND of a clock signal CLKB and the inverted signal of the control signal STP. Theswitch 34B is configured to turn on or off supply of the pulse signal PLS to thecounter 35B on the basis of an output signal of the ANDcircuit 33B. The AND circuit 33C is configured to find logical AND of a clock signal CLKC and the inverted signal of the control signal STP. Theswitch 34C is configured to turn on or off supply of the pulse signal PLS to thecounter 35C on the basis of an output signal of the AND circuit 33C. The ANDcircuit 33D is configured to find logical AND of a clock signal CLKD and the inverted signal of the control signal STP. Theswitch 34D is configured to turn on or off supply of the pulse signal PLS to thecounter 35D on the basis of an output signal of the ANDcircuit 33D. - The
counter 35A is configured to increment a count value CNTA by performing count processing on the basis of a rising edge of the pulse signal supplied from theswitch 34A. Likewise, thecounter 35B is configured to increment a count value CNTB by performing count processing on the basis of a rising edge of the pulse signal supplied from theswitch 34B. Thecounter 35C is configured to increment a count value CNTC by performing count processing on the basis of a rising edge of the pulse signal supplied from theswitch 34C. Thecounter 35D is configured to increment a count value CNTD by performing count processing on the basis of a rising edge of the pulse signal supplied from theswitch 34D. - The
subtraction determining section 36 is configured to generate a control signal CTL by determining whether or not all of the count values CNTA to CNTD have reached a threshold THA. In other words, thesubtraction determining section 36 generates the control signal CTL by determining whether or not the smallest value among the count values CNTA to CNTD has reached the threshold THA. -
FIG. 5 illustrates a configuration example of thesubtraction determining section 36. Thesubtraction determining section 36 includes comparator circuits CP1A, CP1B, CP1C, and CP1D, and an AND circuit AND1. The comparator circuit CP1A is configured to determine whether or not the count value CNTA is larger than the threshold THA. The comparator circuit CP1B is configured to determine whether or not the count value CNTB is larger than the threshold THA. The comparator circuit CP1C is configured to determine whether or not the count value CNTC is larger than the threshold THA. The comparator circuit CP1D is configured to determine whether or not the count value CNTD is larger than the threshold THA. The AND circuit AND1 is configured to generate the control signal CTL by finding logical AND of an output signal of the comparator circuit CP1A, an output signal of the comparator circuit CP1B, an output signal of the comparator circuit CP1C, and an output signal of the comparator circuit CP1D. This configuration allows thesubtraction determining section 36 to determine whether or not all of the count values CNTA to CNTD have reached the threshold THA. - The subtraction controller 37 (
FIG. 3 ) is configured to subtract a predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D on the basis of a determination result of thesubtraction determining section 36. - The
saturation determining section 38 is configured to generate the control signal STP by determining whether or not one or more count values of the count values CNTA to CNTD have reached a threshold THB. Specifically, thesaturation determining section 38 changes the control signal STP to the high level in a case where one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP to the low level in a case where none of the count values CNTA to CNTD has reached the threshold THB. The threshold THB is set at a value larger than the threshold THA. -
FIG. 6 illustrates a configuration example of thesaturation determining section 38. Thesaturation determining section 38 includes comparator circuits CP2A, CP2B, CP2C, and CP2D, and an OR circuit OR1. The comparator circuit CP2A is configured to determine whether or not the count value CNTA is larger than the threshold THB. The comparator circuit CP2B is configured to determine whether or not the count value CNTB is larger than the threshold THB. The comparator circuit CP2C is configured to determine whether or not the count value CNTC is larger than the threshold THB. The comparator circuit CP2D is configured to determine whether or not the count value CNTD is larger than the threshold THB. The OR circuit OR1 is configured to generate the control signal STP by finding logical OR of an output signal of the comparator circuit CP2A, an output signal of the comparator circuit CP2B, an output signal of the comparator circuit CP2C, and an output signal of the comparator circuit CP2D. This configuration allows thesaturation determining section 38 to determine whether or not one or more count values of the count values CNTA to CNTD have reached the threshold THB. - In a case where the
saturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB and changes the control signal STP to the high level, each of the ANDcircuits 33A to 33D changes the output signal to the low level. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. - The signal generator 22 (
FIG. 2 ) is configured to generate the clock signals CLKA to CLKD and the thresholds THA and THB on the basis of an instruction from thephotodetection controller 25 and supply the clock signals CLKA to CLKD and the thresholds THA and THB to the plurality of photodetection units U in thephotodetection array 21. - The
readout controller 23 is configured to control an operation of supplying, to thesignal processor 24, the count values CNTA to CNTD generated in each of the plurality of photodetection units U in thephotodetection array 21, on the basis of an instruction from thephotodetection controller 25. For example, thereadout controller 23 controls operations of the plurality of photodetection units U to sequentially select the photodetection units U for one row, and cause the selected photodetection units U to supply the count values CNTA to CNTD to thesignal processor 24. - The
signal processor 24 is configured to generate a distance image on the basis of an instruction from thephotodetection controller 25. Specifically, thesignal processor 24 generates a distance image by measuring time (TOF value) from emission of the light pulse L0 by the light-emitting section 11 to detection of the reflected light pulse L1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U. Thesignal processor 24 then outputs image data of the generated distance image as the data DT. - The
photodetection controller 25 is configured to control the operation of thephotodetector 20 on the basis of an instruction from the controller 14 (FIG. 1 ) by supplying control signals to thesignal generator 22, thereadout controller 23, and thesignal processor 24 and controlling operations of thesignal generator 22, thereadout controller 23, and thesignal processor 24. - Here, the light-receiving
section 31 corresponds to a specific example of a “light-receiving section” in the present disclosure. The photodiode PD corresponds to a specific example of a “light-receiving element” in the present disclosure. The pulse signal PLS corresponds to a specific example of a “pulse signal” in the present disclosure. Theswitches 34A to 34D correspond to specific examples of a “divider” in the present disclosure. The counter 35 corresponds to a specific example of a “counter” in the present disclosure. Thesubtraction determining section 36 and thesubtraction controller 37 correspond to specific examples of a “subtraction processor” in the present disclosure. Thesaturation determining section 38 and the ANDcircuits 33A to 33D correspond to specific examples of a “stop processor” in the present disclosure. Thesignal processor 24 corresponds to a specific example of a “first processor” in the present disclosure. The threshold THB corresponds to a specific example of a “first threshold” in the present disclosure. The threshold THA corresponds to a specific example of a “second threshold” in the present disclosure. - Next, the operation and workings of the
photodetection system 1 according to the present embodiment are described. - First, an overview of the overall operation of the
photodetection system 1 is described with reference toFIGS. 1 and 2 . The light-emitting section 11 emits the light pulse L0 toward the detection object OBJ. Theoptical system 12 forms an image on the light-receiving surface S of thephotodetector 20. Thephotodetector 20 detects the reflected light pulse L1. Thecontroller 14 supplies control signals to the light-emitting section 11 and thephotodetector 20 and controls operations of the light-emitting section 11 and thephotodetector 20 to thereby control a distance measuring operation of thephotodetection system 1. - In the
photodetector 20, the photodetection units U of thephotodetection array 21 each generate the count values CNTA to CNTD by detecting the reflected light pulse L1. Thesignal generator 22 generates the clock signals CLKA to CLKD and the thresholds THA and THB, and supplies the clock signals CLKA to CLKD and the thresholds THA and THB to the plurality of photodetection units U. Thereadout controller 23 controls an operation of supplying, to thesignal processor 24, the count values CNTA to CNTD generated in each of the plurality of photodetection units U in thephotodetection array 21. Thesignal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from the plurality of photodetection units U in thephotodetection array 21 and outputs image data of the generated distance image as the data DT. Thephotodetection controller 25 controls the operation of thephotodetector 20 on the basis of an instruction from thecontroller 14 by supplying control signals to thesignal generator 22, thereadout controller 23, and thesignal processor 24 and controlling the operations of thesignal generator 22, thereadout controller 23, and thesignal processor 24. -
FIG. 7 illustrates an operation example of thephotodetector 20. (A) indicates a waveform of light emitted from the light-emitting section 11. (B) indicates a waveform of light reflected by the detection object OBJ and having entered a certain photodetection unit U. (D) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD. (G) to (J) respectively indicate waveforms of the count values CNTA to CNTD. (K) indicates a waveform of the control signal STP. (L) indicate an operation of thereadout controller 23. - In a period (exposure period P1) from a timing t11 to a timing t18, the
photodetection system 1 repeatedly emits the light pulse L0, and repeatedly detects the reflected light pulse L1 reflected by the detection object OBJ. - Specifically, in a period from the timing t11 to a timing t12, the light-emitting section 11 emits light ((A) of
FIG. 7 ). Thesignal generator 22 changes the clock signal CLKA to the high level in a period from the timing t12 to a timing t13, changes the clock signal CLKB to the high level in a period from the timing t13 to a timing t14, changes the clock signal CLKC to the high level in a period from the timing t14 to a timing t15, and changes the clock signal CLKD to the high level in a period from the timing t15 to a timing t16 ((C) to (F) ofFIG. 7 ). In this example, the reflected light pulse L1 is generated in a period in which the clock signal CLKB is changed to the high level and a period in which the clock signal CLKC is changed to the high level ((B) ofFIG. 7 ). None of the count values CNTA to CNTD has not reached the threshold THB, and the control signal STP is at the low level ((K) ofFIG. 7 ). Accordingly, theswitch 34A supplies the pulse signal PLS to thecounter 35A in the period from the timing t12 to the timing t13, theswitch 34B supplies the pulse signal PLS to thecounter 35B in the period from the timing t13 to the timing t14, theswitch 34C supplies the pulse signal PLS to thecounter 35C in the period from the timing t14 to the timing t15, and theswitch 34D supplies the pulse signal PLS to thecounter 35D in the period from the timing t15 to the timing t16. Thus, theswitches 34A to 34D distribute the pulse signal PLS to thecounters 35A to 35D in a time division manner on the basis of the clock signals CLKA to CLKD. - In the period from the timing t12 to the timing t13, the
counter 35A performs count processing on the basis of a rising edge of the pulse signal PLS supplied from theswitch 34A to increment the count value CNTA ((G) ofFIG. 7 ). Likewise, in the period from the timing t13 to the timing t14, thecounter 35B performs count processing on the basis of a rising edge of the pulse signal PLS supplied from theswitch 34B to increment the count value CNTB ((H) ofFIG. 7 ). In the period from the timing t14 to the timing t15, thecounter 35C performs count processing on the basis of a rising edge of the pulse signal PLS supplied from theswitch 34C to increment the count value CNTC ((I) ofFIG. 7 ). In the period from the timing t15 to the timing t16, he counter 35D performs count processing on the basis of a rising edge of the pulse signal PLS supplied from theswitch 34D to increment the count value CNTD ((J) ofFIG. 7 ). - The photodetection unit U repeats such an operation from the timing t11 to a timing t17. Accordingly, the
counter 35A performs count processing in a plurality of periods in which the clock signal CLKA is at the high level to generate the count value CNTA, thecounter 35B performs count processing in a plurality of periods in which the clock signal CLKB is at the high level to generate the count value CNTB, thecounter 35C performs count processing in a plurality of periods in which the clock signal CLKC is at the high level to generate the count value CNTC, and thecounter 35D performs count processing in a plurality of periods in which the clock signal CLKD is at the high level to generate the count value CNTD. - Then, in a period (readout period P2) from the timing t18 to a timing t19, the
readout controller 23 performs readout control CR, thereby controlling the operations of the plurality of photodetection units U to supply, to thesignal processor 24, the count values CNTA to CNTD generated by each of the plurality of photodetection units U ((L) ofFIG. 7 ). Thereafter, the count values CNTA to CNTD in thecounters 35A to 35D are reset. - As illustrated in
FIG. 7 , in a case where the photodetection unit U detects the reflected light pulse L1 in a period in which the clock signal CLKB is at the high level and a period in which the clock signal CLKC is at the high level, the count value CNTB and the CNTC include a component (reflected light component C1) corresponding to reflected light. - In addition to the reflected light illustrated in (B) of
FIG. 7 , ambient light also enters thephotodetector 20. The ambient light may enter thephotodetector 20 in all of a period in which the clock signal CLKA is at the high level, a period in which the clock signal CLKB is at the high level, a period in which the clock signal CLKC is at the high level, and a period in which the clock signal CLKC is at the high level. Accordingly, the count values CNTA to CNTD each include a component (ambient light component C2) corresponding to the ambient light. The amount of this ambient light component C2 is substantially equal in the count values CNTA to CNTD. -
FIG. 8 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P1. A shaded portion indicates the reflected light component C1, and a white portion indicates the ambient light component C2. As described above, the count values CNTB and CNTC each include the reflected light component C1 and the ambient light component C2, and the count values CNTA and CNTD each include the ambient light component C2. - When the exposure period P1 starts, the count values CNTA to CNTD gradually increase with the lapse of time. At a timing illustrated in (A) of
FIG. 8 , the ambient light component C2 in each of the count values CNTA to CNTD is smaller than the threshold THA. - Thereafter, at a timing illustrated in (B) of
FIG. 8 , the ambient light component C2 in each of the count values CNTA to CNTD reaches the threshold THA. Thesubtraction determining section 36 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, thesubtraction determining section 36 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. Accordingly, thesubtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD ((C) ofFIG. 8 ). Thus, a portion of the ambient light component C2 in each of the count values CNTA to CNTD is removed, and the reflected light component C1 is maintained. - Even after that, the count values CNTA to CNTD gradually increase with the lapse of time.
- Then, at a timing illustrated in (D) of
FIG. 8 , the count value CNTC reaches the threshold THB. Thesaturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. That is, in a case where one or more count values of the count values CNTA to CNTD have reached the threshold THB, even if the exposure period P1 has not ended, thecounters 35A to 35D stop count processing. -
FIG. 9 illustrates an operation example of thephotodetector 20. - First, in the
photodetector 20, thephotodetection controller 25 starts the exposure period P1 (step S101). In the exposure period P1, thesignal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from thephotodetection controller 25. - Next, the
photodetection controller 25 confirms whether or not the exposure period P1 having a predetermined time length has ended (step S102). In a case where the exposure period P1 has ended (“Y” in step S102), processing proceeds to step S107. - In a case where the exposure period P1 has not yet ended (“N” in step S102), the
saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S103). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S103), the processing proceeds to step S106. - In step S103, in a case where none of the count values CNT has reached the threshold THB (“N” in step S103), the
subtraction determining section 36 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S104). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S104), the processing returns to step S102. - In step S104, in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S104), the
subtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D (step S105). That is, in an example inFIG. 8 , as illustrated in (B) and (C) ofFIG. 8 , all of the four count values CNT have reached the threshold THA, which causes thesubtraction controller 37 to subtract the predetermined value from each of the count values CNTA to CNTD. The processing then returns to step S102. - In step S103, in a case where one or more count values CNT have reached the threshold THB (“Y” in step S103), the
counters 35A to 35D stop count processing (step S106). That is, in the example inFIG. 8 , as illustrated in (D) ofFIG. 8 , one or more count values CNT of the four count values CNT have reached the threshold THB, which causes thesaturation determining section 38 to change the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. - The plurality of photodetection units U each perform such an operation individually.
- Then, the
photodetector 20 performs readout processing (step S107). Specifically, thereadout controller 23 controls the operations of the plurality of photodetection units U to supply, to thesignal processor 24, the count values CNTA to CND generated in each of the plurality of photodetection units U. - Thus, this processing ends.
- The
signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U. -
FIG. 10 illustrates an operation example of thesignal processor 24. First, as illustrated inFIG. 10 , thesignal processor 24 subtracts the smallest value among the count values CNTA to CNTD from the count values CNTA to CNTD supplied from the photodetection unit U. That is, as illustrated in (D) ofFIG. 8 , the count values CNTA to CNTD generated by the photodetection unit U each include the reflected light component C1 and the ambient light component C2. As illustrated inFIG. 10 , thesignal processor 24 subtracts the smallest value among the count values CNTA to CNTD from the count values CNTA to CNTD to thereby remove the ambient light component C2. - Then, the
signal processor 24 determines time (TOF value) from emission of the light pulse L0 by the light-emitting section 11 to detection of the reflected light pulse L1 by the photodetection unit U, on the basis of the count values CNTA to CNTD from which the ambient light component C2 is removed. That is, for example, the count value CNTA indicates the number of detection times of the reflected light pulse L1 directly after emission of the light pulse L0 by the light-emitting section 11, and the count value CNTD indicates the number of detection times of the reflected light pulse L1 after the lapse of time from the emission of the light pulse L0 by the light-emitting section 11. This makes it possible for thesignal processor 24 to determine the TOF value on the basis of a distribution of these count values CNTA to CNTD, for example, by determining time corresponding to a peak of this distribution. - The
signal processor 24 performs such processing on the basis of the count values CNTA to CNTD obtained from each of the plurality of photodetection units U to generate a distance image. Then, thesignal processor 24 outputs image data of the generated distance image as the data DT. - Thus, in the
photodetection system 1, thesubtraction determining section 36 and thesubtraction controller 37 perform subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of a plurality of count values CNT. In particular, in this example, thesubtraction determining section 36 and thesubtraction controller 37 perform the subtraction processing in a case where all of the plurality of count values CNT have reached the threshold THA. In other words, thesubtraction determining section 36 and thesubtraction controller 37 perform the subtraction processing in a case where the smallest values among the plurality of count values CNT has reached the threshold THA. Accordingly, for example, as illustrated in (D) ofFIG. 8 , it is possible to decrease the final ambient light component C2 to the threshold THA or lower, which makes it possible to secure a signal amount of the reflected light component C1. As a result, in thephotodetection system 1, it is possible to enhance detection accuracy of time (TOF value) or a distance. - That is, in a case where such subtraction processing is not performed, the amount of the ambient light component C1 is large under the condition that the amount of ambient light is large, which decreases the signal amount of the reflected light component C1. In a case where the signal amount is small in such a manner, detection accuracy of time or a distance is deteriorated. In addition, in this case, in order to prevent a decrease in the detection accuracy, it is possible to perform the operation illustrated in
FIG. 7 a plurality of times. In this case, as illustrated in (A) ofFIG. 11 , a plurality of exposure periods P1 and a plurality of readout periods P2 are provided, which increases detection time. - In contrast, in the
photodetection system 1, thesubtraction determining section 36 and thesubtraction controller 37 perform the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, on the basis of one or more count values of the plurality of count values CNT. This makes it possible to secure the signal amount of the reflected light components C1, which makes it possible to enhance detection accuracy of time (TOF value) or a distance. In addition, as illustrated in (B) ofFIG. 11 , it is possible to reduce the number of readout periods P2 to one, which makes it possible to shorten a detection period. - In addition, in the
photodetection system 1, thesubtraction determining section 36 and thesubtraction controller 37 perform the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT, which makes it possible to reduce the number of bits of a counter, thereby making it possible to reduce a circuit scale. That is, in a case where the subtraction processing is not performed, in order to secure the signal amount, a method of increasing the number of bits of the counter may be adopted. However, in this case, the circuit scale is increased. In a case where the circuit scale of the photodetection unit U is large, for example, the number of photodetection units U in the photodetection array may be decreased, or resolution may be decreased. In contrast, in thephotodetection system 1, the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed, which makes it possible to reduce the number of bits of the counter, thereby making it possible to reduce the circuit scale. Accordingly, for example, it is possible to increase the number of photodetection units U in thephotodetection array 21 or to enhance resolution. - In addition, in the
photodetection system 1, in each of the plurality of photodetection units U, thesubtraction determining section 36 and thesubtraction controller 37 performs the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT. This makes it possible to adaptively remove the ambient light component C2 in accordance with the light amount of ambient light in each of the plurality of photodetection units U, and makes it possible to secure the signal amount of the reflected light component C1. As a result, in thephotodetection system 1, it is possible to effectively enhance detection accuracy of time (TOF value) or a distance in each of the plurality of photodetection units U. - As described above, in the present embodiment, the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed on the basis of one or more count values of the plurality of count values, which makes it possible to secure the signal amount, thereby making it possible to enhance detection accuracy.
- In the embodiment described above, as illustrated in
FIGS. 4A and 4B , the light-receivingsection 31 includes one photodiode PD, but this it not limitative. Instead of this, for example, as illustrated inFIGS. 12A and 12B , the light-receivingsection 31 may include a plurality of photodiodes PD (four photodiodes PD1 to PD4 in this example). The photodiodes PD1 to PD4 are coupled in parallel to each other, and the photodiodes PD1 to PD4 each have an anode supplied with the power supply voltage VSS, and a cathode coupled to the node N1. This makes it possible to enhance, for example, light reception sensitivity in the light-receivingsection 31. - In the embodiment described above, as illustrated in
FIG. 3 , the photodetection unit U includes one light-receivingsection 31, but this it not limitative. Instead of this, for example, as illustrated inFIG. 13 , the photodetection unit U may include a plurality of light-receivingsections 31. This photodetection unit U includes a plurality of light-receiving section 31 (four light-receivingsections 31A to 31D in this example), and anOR circuit 32. The light-receivingsections 31A to 31D respectively generate the pulse signals PLSA to PLSD. Each of the plurality of light-receivingsections 31 has, for example, a circuit configuration illustrated inFIG. 4A or a circuit configuration illustrated inFIG. 4B . It is to be noted that, in this example, four light-receivingsections 31 are provided, but this is not limitative. For example, three or less or five or more light-receivingsections 31 may be provided. The ORcircuit 32 is configured to generate the pulse signal PLS by finding logical OR of the pulse signals PLSA to PLSD. Here, theOR circuit 32 corresponds to a specific example of an “adder” in the present disclosure. Thus, it is possible to enhance, for example, light reception sensitivity in the photodetection unit U. - In addition, as illustrated in
FIG. 14 , the photodetection unit U may include a plurality of light-receiving sections 41 (four light-receivingsections 41A to 41D in this example) and a negative AND (NAND)circuit 42. The light-receivingsections 41A to 41D respectively generate the pulse signals PLSA to PLSD. As illustrated inFIG. 15 , the light-receivingsection 41A includes the photodiode PD and the resistor R1. That is, the light-receivingsection 41A is the light-receiving section 31 (FIG. 4A ) without the inverter IV1. The same applies to the light-receivingsections 41B to 41D. TheNAND circuit 42 is configured to generate the pulse signal PLS by finding negative AND of the pulse signals PLSA to PLSD. Even in this case, it is possible to enhance, for example, light reception sensitivity. - In the embodiment described above, the
subtraction controller 37 performs subtraction processing for subtracting a predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D, on the basis of a determination result of thesubtraction determining section 36. Thesubtraction controller 37 may perform subtraction processing by changing the bit value of a predetermined count bit in each of thecounters 35A to 35D. Specifically, for example, as illustrated inFIG. 16 , thesubtraction controller 37 is able to perform subtraction processing by changing the bit value of a most significant bit (MSB: Most Significant Bit) in each of thecounters 35A to 35D from “1” to “0”. This makes it possible to simplify the circuit configuration of thesubtraction controller 37, and makes it possible to reduce a circuit scale. It is to be noted that, in this example, the bit value of the most significant bit is changed, but this is not limitative. The bit value of any other bit may be changed, or the bit values of a plurality of bits may be changed. - In the embodiment described above, the
subtraction determining section 36 determines whether or not all of the count values CNTA to CNTD has reached the threshold THA, but this is not limitative. The present modification example is described in detail below with reference to some examples. -
FIG. 17 illustrates a configuration example of the photodetection unit U according to the present modification example. This photodetection unit U includes asubtraction determining section 46. Thesubtraction determining section 46 is configured to generate the control signal CTL by determining whether or not the count value CNT of a predetermined counter 35 (the count value CNTD of thecounter 35D in this example) of the fourcounters 35A to 35D has reached the threshold THA. -
FIG. 18 illustrates a configuration example of thesubtraction determining section 46. Thesubtraction determining section 46 includes the comparator circuit CP1D. The comparator circuit CP1D is configured to generate the control signal CTL by determining whether or not the count value CNTD is larger than the threshold THA. -
FIG. 19 illustrates an operation example in the exposure period P1 of the photodetection unit U according to the present modification example. (A) indicates a waveform of light emitted from the light-emitting section 11. (B) indicates a waveform of light reflected by the detection object OBJ and having entered then photodetection unit U. (C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD. - In a period from a timing t21 to a timing t22, the light-emitting section 11 emits light ((A) of
FIG. 19 ). Thesignal generator 22 changes the clock signal CLKA to the high level in a period from the timing t22 to a timing t23, changes the clock signal CLKB to the high level in a period from the timing t23 to a timing t24, and changes the clock signal CLKC to the high level in a period from the timing t24 to a timing t25 ((C) to (E) ofFIG. 19 ). In this example, a timing of the reflected light pulse L1 is expected to some extent, and thesignal generator 22 sequentially changes the clock signals CLKA to CLKC to the high level in a period from the timing t22 to the timing t25 including a period in which this reflected light pulse L1 is generated. In addition, thesignal generator 22 changes the clock signal CLKD to the high level in a period from a timing t26 to a timing t27 separated from this period from the timing t22 to the timing t25 ((F) ofFIG. 19 ). That is, in this example, the photodetection unit U does not detect the reflected light pulse L1 in this period from the timing t26 to the timing t27; therefore, it is expected to detect ambient light. Accordingly, the count value CNTD does not include the reflected light component C1, and includes the ambient light component C2. - In the photodetection unit U, the
subtraction determining section 46 determines whether or not the count value CNTD of thecounter 35D has reached the threshold THA, and in a case where the count value CNTD has reached the threshold THA, thesubtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D. - This makes it possible to simplify the circuit configuration and reduce the circuit scale in the photodetection unit U according to the present modification example. The present modification example is effective specifically in a case where the number of circuits including the AND circuit 33, the switch 34, and the counter 35 is large. For example, in a case where sixteen counters 35 are included, it is possible to determine whether or not to perform subtraction processing on the basis of the count value CNT of one counter 35 of the sixteen counters 35, and it is possible to generate a distance image on the basis of the count values CNT of fifteen counters 35.
-
FIG. 20 illustrates a configuration example of another photodetection unit U according to the present modification example. This photodetection unit U includes asubtraction determining section 56. Thesubtraction determining section 56 is configured to generate the control signal CTL by determining whether or not both the count values of two predetermined counters 35 (the count values CNTC and CNTD of the 35C and 35D in this example) of the fourcounters counters 35A to 35D have reached the threshold THA. -
FIG. 21 illustrates a configuration example of thesubtraction determining section 56. Thesubtraction determining section 56 includes the comparator circuits CP1C and CP1D and an AND circuit AND2. The comparator circuit CP1C is configured to determine whether or not the count value CNTC is larger than the threshold THA. The comparator circuit CP1D is configured to determine whether or not the count value CNTD is larger than the threshold THA. The AND circuit AND2 is configured to generate the control signal CTL by finding logical AND of output signals of the comparator circuits CP1C and CP1D. This configuration allows thesubtraction determining section 56 to determine whether or not both the count values CNTC and CNTD have reached the threshold THA. As with the example inFIG. 19 , the count values CNTC and CNTD each do not include the reflected light component C1, and include the ambient light component C2. The present modification example is effective in a case where the number of circuits including the AND circuit 33, the switch 34, and the counter 35 is large, as with the example inFIG. 19 . - It is to be noted that this is not limitative, and the
subtraction determining section 56 may generate the control signal CTL, for example, by determining whether or not the sum of the count values CNTC and CNTD reaches the threshold THA.FIG. 22 illustrates a configuration example of thesubtraction determining section 56 in this example. Thissubtraction determining section 56 includes an adder circuit ADD1 and a comparator circuit CP1. The adder circuit ADD1 is configured to find the sum of the count value CNTC and the count value CNTD. The comparator circuit CP1 is configured to generate the control signal CTL by determining whether or not a value calculated by the adder circuit ADD1 is larger than the threshold THA. In this example, thesubtraction determining section 56 determines whether or not the sum of the count values CNTC and CNTD reaches the threshold THA. However, instead of this, for example, thesubtraction determining section 56 may determine whether or not an average value of the count values CNTC and CNTD reaches the threshold THA. - In the embodiment described above, in a case where all of the count values CNTA to CNTD have reached the threshold THA, subtraction processing is performed asynchronously, but this is not limitative. Instead of this, for example, subtraction processing may be performed in synchronization with a control signal. The present modification example is described in detail below.
-
FIG. 23 illustrates a configuration example of the photodetection unit U according to the present modification example. This photodetection unit U includes asubtraction determining section 66, asaturation determining section 68, and an ANDcircuit 69. - The
subtraction determining section 66 includes an AND circuit AND3. The AND circuit AND3 is configured to find logical AND of the bit value of a most significant bit of a signal indicating the count value CNTA, the bit value of a most significant bit of a signal indicating the count value CNTB, the bit value of a most significant bit of a signal indicating the count value CNTC, the bit value of a most significant bit of a signal indicating the count value CNTD, and the output signal of the ANDcircuit 69. Thus, thesubtraction determining section 66 determines whether or not all of the count values CNTA to CNTD have reached an intermediate value in a count range of thecounters 35A to 35D. - The
saturation determining section 68 includes latches LTA to LTD and an OR circuit OR2. The latch LTA is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTA are changed to “1”. Likewise, the latch LTB is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTB are changed to “1”. The latch LTC is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTC are changed to “1”. The latch LTD is configured to change an output signal to the high level in a case where all bits of the signal indicating the count value CNTD are changed to “1” The OR circuit OR2 is configured to generate the control signal STP by finding logical OR of the output signal of the latch LTA, the output signal of the latch LTB, the output signal of the latch LTC, and the output signal of the latch LTD. Thus, thesaturation determining section 68 generates the control signal STP by determining whether or not one or more counters 35 of thecounters 35A to 35D are turned to an overflow state. - The AND
circuit 69 is configured to find logical AND of an inverted signal of the control signal STP and a control signal REJEN. In this example, the control signal REJEN is generated by thesignal generator 22, for example. -
FIG. 24 illustrates an operation example in the exposure period P1 of the photodetection unit U according to the present modification example. (A) indicates a waveform of light emitted from the light-emitting section 11. (B) indicates a waveform of light reflected by the detection object OBJ and having entered the photodetection unit U. (C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD. (G) indicates a waveform of the control signal REJEN. In a period from a timing t31 to a timing t32, the light-emitting section 11 emits light ((A) ofFIG. 24 ). Thesignal generator 22 changes the clock signal CLKA to the high level in a period from the timing t32 to a timing t33, changes the clock signal CLKB to the high level in a period from the timing t33 to a timing t34, changes the clock signal CLKC to the high level in a period from the timing t34 to a timing t35, and changes the clock signal CLKD to the high level in a period from the timing t35 to a timing t36 ((C) to (F) ofFIG. 24 ). In addition, thesignal generator 22 changes the control signal REJEN to the high level in a period from a timing t37 to a timing t38 different from this period from the timing t32 to the timing t36 ((G) ofFIG. 24 ). -
FIG. 25 illustrates a more specific operation example of the photodetection unit U according to the present modification example. (A) indicates a waveform of light emitted from the light-emitting section 11. (B) indicates a waveform of light reflected by the detection object OBJ and having entered the photodetection unit U. (C) to (F) respectively indicate waveforms of the clock signals CLKA to CLKD. (G) indicates a waveform of the control signal REJEN. (H) to (K) respectively indicate the count values CNTA to CNTD. (L) indicates a waveform of the control signal CTL. (M) indicates a waveform of the control signal STP. In this example, for explanatory convenience, thecounter 35A to 35D are 4-bit counters, the threshold THA is “8”, and the threshold THB is “15”. - In a period from a timing t41 to a timing t45 (exposure period P1), the
photodetection system 1 repeatedly emits the light pulse L0, and repeatedly detects the reflected light pulse L1 reflected by the detection object OBJ. Thecounter 35A performs count processing in a period in which the clock signal CLKA is at the high level to increment the count value CNTA ((C) and (H) ofFIG. 25 ). Likewise, thecounter 35B performs count processing in a period in which the clock signal CLKB is at the high level to increment the count value CNTB ((D) and (I) ofFIG. 25 ). Thecounter 35C performs count processing in a period in which the clock signal CLKC is at the high level to increment the count value CNTC ((E) and (J) ofFIG. 25 ). Thecounter 35D performs count processing in a period in which the clock signal CLKD is at the high level to increment the count value CNTD ((F) and (K) ofFIG. 25 ). - At a timing t42, the count value CNTA changes from “7” to “8” ((H) of
FIG. 25 ). The count value CNTA is the smallest value among the count values CNTA to CNTD; therefore, at this timing t42, the smallest value among the count values CNTA to CNTD reaches the threshold THA (“8” in this example). Then, at a timing t43 at which a control signal REJ is changed to the high level after this timing t42, thesubtraction determining section 66 changes the control signal CTL from the low level to the high level ((L) ofFIG. 25 ), and thesubtraction controller 37 subtracts a predetermined value (“8” in this example) from each of the count values CNTA to CNTD in thecounters 35A to 35D ((H) to (K) ofFIG. 25 ). That is, the photodetection unit U subtracts the predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D at this timing in synchronization with the control signal REJEN. The count values CNTA to CNTD are decreased by this subtraction processing, which causes thesubtraction determining section 66 to change the control signal CTL from the high level to the low level at a timing directly after this timing t43 ((L) ofFIG. 25 ). - In addition, at a timing t44, the count value CNTB changes from “14” to “15” ((I) of
FIG. 25 ). That is, the count value CNTB reaches the threshold THB (“15” in this example). This causes thesaturation determining section 68 to change the control signal STP from the low level to the high level ((M) ofFIG. 25 ). Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. It is to be noted that the control signal STP is at the high level from then on, which changes an output signal of the ANDcircuit 69 to the low level; therefore, thesubtraction determining section 66 maintains the control signal CTL at the low level. - Thus, in the present modification example, the control signal REJEN is changed to the high level in a period different from a period in which the clock signals CLKA to CLKD are changed to the high level; therefore, the
counters 35A to 35D do not perform count processing in a period in which the control signal REJEN is at the high level. This makes it possible for thesubtraction controller 37 to subtract the predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D in a period in which thecounters 35A to 35D do not perform count processing. As a result, count processing and subtracting processing are not simultaneously performed, which makes it possible to reduce a possibility that a malfunction occurs. - The
photodetector 20 according to the embodiment described above may be formed on one semiconductor substrate, or may be formed on a plurality of semiconductor substrates. The present modification example is described in detail below with reference to some examples. -
FIG. 26 illustrates an implementation example of thephotodetector 20. In this example, thephotodetector 20 is formed on two 101 and 102. Thesemiconductor substrates semiconductor substrate 101 is disposed on side of the light-receiving surface S of thephotodetector 20, and thesemiconductor substrate 102 is disposed on side opposite to the light-receiving surface S of thephotodetector 20. The 101 and 102 are superimposed on each other. A wiring line of thesemiconductor substrates semiconductor substrate 101 and a wiring line of thesemiconductor substrate 102 are coupled to each other by awiring line 103. It is possible to use, for example, a metallic bond such as Cu—Cu or a bump for thewiring line 103. The photodetection units U are disposed over these two 101 and 102.semiconductor substrates -
FIG. 27 illustrates a configuration example of the light-receivingsection 31. This light-receivingsection 31 has the same circuit configuration as the light-receivingsection 31 illustrated inFIG. 4A . In this example, the light-receivingsection 31 is disposed over the two 101 and 102. Specifically, the photodiode PD is disposed on thesemiconductor substrates semiconductor substrate 101, and the resistor R1 and the inverter IV1 are disposed on thesemiconductor substrate 102. The photodiode PD has the cathode coupled to the other end of the resistor R1 and an input terminal of the inverter IV1 through thewiring line 103. Here, the inverter IV1 corresponds to a specific example of a “pulse generation circuit” in the present disclosure. It is to be noted that, in this example, the present modification example is applied to thephotodetector 20 including the light-receivingsection 31 illustrated inFIG. 4A , but the present modification example may be applied to thephotodetector 20 including the light-receivingsection 31 illustrated inFIG. 4B in a similar manner. - The AND
circuits 33A to 33D, theswitches 34A to 34D, thecounters 35A to 35D, thesubtraction determining section 36, thesubtraction controller 37, and thesaturation determining section 38 are disposed on thesemiconductor substrate 102, for example. -
FIG. 28 illustrates another implementation example of thephotodetector 20. In this example, thephotodetector 20 is formed on threesemiconductor substrates 111 to 113. Thesemiconductor substrate 111 is disposed on side of the light-receiving surface S of thephotodetector 20, and thesemiconductor substrate 113 is disposed on side opposite to the light-receiving surface S of thephotodetector 20. Thesemiconductor substrate 112 is disposed between thesemiconductor substrate 111 and thesemiconductor substrate 113. Thesemiconductor substrates 111 to 113 are superimposed on each other. A wiring line of thesemiconductor substrate 111 and a wiring line of thesemiconductor substrate 112 are coupled to each other by awiring line 114. A wiring line of thesemiconductor substrate 112 and a wiring line of thesemiconductor substrate 113 are coupled to each other by awiring line 115. It is possible to use, for example, a metallic bond such as Cu—Cu or a bump for the 114 and 115. The photodetection units U are disposed over these threewiring lines semiconductor substrates 111 to 113. Specifically, for example, the photodiode PD is disposed on thesemiconductor substrate 111, the resistor R1 and the inverter IV1 are disposed on thesemiconductor substrate 112, and thesubtraction determining section 36, thesubtraction controller 37, and thesaturation determining section 38 are disposed on thesemiconductor substrate 113. - In the embodiment described above, the
photodetection system 1 performs only a distance measuring operation, but this is not limitative. Instead of this, for example, thephotodetection system 1 may be able to perform both the distance measuring operation and an imaging operation. The present modification example is described in detail below. -
FIG. 29 illustrates a configuration example of aphotodetection system 1A according to the present modification example. Thephotodetection system 1A is configured to be operable as an image sensor and be operable as a ToF sensor. Thephotodetection system 1A includes aphotodetector 80 and acontroller 74. - The
photodetector 80 is configured to detect light on the basis of an instruction from thecontroller 74. Then, thephotodetector 20 outputs image data based on a detection result as the data DT. - The
controller 74 is configured to supply control signals to the light-emitting section 11 and thephotodetector 80 and control operations of the light-emitting section 11 and thephotodetector 80 to thereby control an operation of thephotodetection system 1A. Thecontroller 74 includes amode setting section 75. Themode setting section 75 is configured to set an operation mode M of thephotodetection system 1A. Thephotodetection system 1A is operable in an imaging mode MA and a distance measurement mode MB. The imaging mode MA is a mode in which an image of a subject is captured on the basis of light L10 from the subject. The distance measurement mode MB is a mode in which the light pulse L0 is emitted and the reflected light pulse L1 reflected by the detection object OBJ is detected to thereby measure a time difference between a timing at which the light pulse L0 is emitted and a timing at which the reflected light pulse L1 is detected. Themode setting section 75 sets one of the imaging mode MA and the distance measurement mode MB as the operation mode M. Then, thecontroller 74 controls the operation of thephotodetection system 1A in accordance with the set operation mode M. -
FIG. 30 illustrates a configuration example of thephotodetector 80. Thephotodetector 80 includes aphotodetection array 81, asignal generator 82, asignal processor 84, and aphotodetection controller 85. - The
photodetection array 81 includes a plurality of photodetection units U disposed in a matrix. The photodetection units U are each configured to detect light and count the number of detection times. -
FIG. 31 illustrates a configuration example of the photodetection unit U. The photodetection unit U includes a plurality of light-receiving sections 31 (four light-receivingsections 31A to 31D in this example), an ORcircuit 32, and a plurality of selectors 93 (fourselectors 93A to 93D in this example). - The light-receiving
sections 31A to 31D respectively generate the pulse signals PLSA to PLSD. Each of the light-receivingsections 31A to 31D has, for example, a circuit configuration illustrated inFIG. 4A or a circuit configuration illustrated inFIG. 4B . The ORcircuit 32 is configured to generate the pulse signal PLS by finding logical OR of the pulse signals PLSA to PLSD. - The
selector 93A is configured to select one of the pulse signal PLSA and the pulse signal PLS on the basis of a mode control signal SMODE and supply the selected pulse signal to theswitch 34A. The mode control signal SMODE in this example is at a low level “0” in a case where the operation mode M is the imaging mode MA and is at a high level “1” in a case where the operation mode M is the distance measurement mode MB. Accordingly, theselector 93A selects the pulse signal PLSA in a case where the operation mode M is the imaging mode MA, and selects the pulse signal PLS in a case where the operation mode M is the distance measurement mode MB. Then, theselector 93A supplies the selected pulse signal to theswitch 34A. - Likewise, the selector 93B is configured to select one of the pulse signal PLSB and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to the
switch 34B. The selector 93C is configured to select one of the pulse signal PLSC and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to theswitch 34C. Theselector 93D is configured to select one of the pulse signal PLSD and the pulse signal PLS on the basis of the mode control signal SMODE and supply the selected pulse signal to theswitch 34A. - In a case where the operation mode M is the imaging mode MA, the clock signals CLKA to CLKD rise at the same timing and falls at the same timing. Accordingly, the
switches 34A to 34D respectively supplies the pulse signals PLSA to PLSD to thecounters 35A to 35D in a period in which the clock signals CLKA to CLKD are at the high level. In addition, in a case where the operation mode M is the distance measurement mode MB, the clock signals CLKA to CLKD are four-phase clock signals, as illustrated inFIG. 7 . Theswitches 34A to 34D distributes the pulse signal PLS to fourcounters 35A to 35D in a time division manner on the basis of the clock signals CLKA to CLKD. - The signal generator 82 (
FIG. 30 ) is configured to generate the clock signals CLKA to CLKD and the mode control signal SMODE on the basis of an instruction from thephotodetection controller 85 and supply the clock signals CLKA to CLKD and the mode control signal SMODE to the plurality of photodetection units in thephotodetection array 81. - The
signal processor 84 is configured to perform predetermined signal processing on the basis of an instruction from thephotodetection controller 85. Specifically, in a case where the operation mode M is the imaging mode MA, thesignal processor 84 generates image data of a captured image by performing predetermined image processing, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in thephotodetection array 81. In addition, in a case where the operation mode M is the distance measurement mode MB, thesignal processor 84 generates image data of a distance image by measuring time from emission of the light pulse L0 by the light-emitting section 11 to detection of the reflected light pulse L1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in thephotodetection array 81. Thesignal processor 84 then outputs the generated image data as the data DT. - The
photodetection controller 85 is configured to control the operation of thephotodetector 80 on the basis of an instruction from the controller 74 (FIG. 29 ) by supplying control signals to thesignal generator 82, thereadout controller 23, and thesignal processor 84 and controlling operations of thesignal generator 82, thereadout controller 23, and thesignal processor 84. - Two or more of these modification examples may be combined.
- Next, description is given of a
photodetection system 2 according to a second embodiment. The present embodiment has a configuration in which a counter is provided that counts the number of times subtraction processing for subtraction from the count values CNTA to CNTD of thecounters 35A to 35D has been performed. It is to be noted that components substantially the same as those of thephotodetection system 1 according to the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate. - The
photodetection system 2 according to the present embodiment includes aphotodetector 120, as with the photodetection system 1 (FIG. 1 ) according to the first embodiment described above. -
FIG. 32 illustrates a configuration example of thephotodetector 120. Thephotodetector 120 includes aphotodetection array 121, areadout controller 123, and asignal processor 124. -
FIG. 33 illustrates a configuration example of the photodetection unit U in thephotodetection array 121. The photodetection unit U includes acounter 131. Thecounter 131 is configured to count the number of times subtraction processing for subtracting a predetermined value from each of the count values CNTA to CNTD has been performed, on the basis of the control signal CTL generated by thesubtraction determining section 36. Thecounter 131 then outputs the number of times the subtraction processing has been performed as a count value CNTN. - The readout controller 123 (
FIG. 32 ) is configured to control an operation of supplying, to thesignal processor 124, the count values CNTA to CNTD generated in each of the plurality of photodetection units U in thephotodetection array 121, on the basis of an instruction from thephotodetection controller 25. - The
signal processor 124 is configured to generate a distance image on the basis of an instruction from thephotodetection controller 25. Specifically, thesignal processor 124 generates a distance image by measuring time (TOF value) from emission of the light pulse L0 by the light-emitting section 11 to detection of the reflected light pulse L1 by the photodetection unit U, on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U in thephotodetection array 21. - The
signal processor 124 includes a distancemeasurement correction section 126. The distancemeasurement correction section 126 is configured to correct the TOF value on the basis of the count value CNTN. Specifically, the distancemeasurement correction section 126 calculates a full count value of the ambient light component C2 in the photodetection unit U on the basis of the count value CNTN, and corrects the TOF value with use of the full count value of the ambient light component C2. -
FIG. 34 illustrates an example of the count values CNTA to CNTD. A portion W1 indicates the count values CNTA to CNTD supplied from the photodetection unit U. A portion W2 indicates a component removed by subtraction processing for the number of times indicated by the count value CNTN. It is possible to represent a count value in the portion W1 by the threshold THB. It is possible to represent a count value of the removed component indicated by the portion W2 by the product of the threshold THA and the count value CNTN. It is possible to represent the full count value of the ambient light component C2 by the sum of the smallest value among the count values CNTA to CNTD supplied from the photodetection unit U indicated in the portion W1 and the count value of the removed component (the product of the threshold THA and the count value CNTN) indicated in the portion W2. - The distance
measurement correction section 126 corrects the TOF value on the basis of the full count value of the ambient light component C2. That is, in the photodetection unit U, the light-receivingsection 31 is not able to detect subsequent light for a while after detecting light. The TOF value deviates to a value smaller than an actual value due to such dead time. -
FIG. 35 illustrates an example of deviation of the TOF value caused by dead time in a case where there is no ambient light. (A) indicates a distribution of the count value CNT. (B) indicates a light reception probability in the light-receivingsection 31. A horizontal axis indicates elapsed time with reference to a timing at which the light-emitting section 11 emits the light pulse L0. In (A) ofFIG. 35 , a characteristic W11 indicates a distribution of the count value CNT that is supposed to be obtained, and a characteristic W12 indicates a distribution of the count value CNT actually obtained. - The light-receiving
section 31 is not able to detect subsequent light for a while after detecting light. Accordingly, the light reception probability of the light-receivingsection 31 is as illustrated in (B) ofFIG. 35 . That is, in a case where the elapsed time is short, as indicated by the characteristic W11, a probability that reflected light enters the light-receivingsection 31 is low; therefore, the light reception probability is high. As indicated by the characteristic W11, the probability that the reflected light enters the light-receivingsection 31 becomes higher with the lapse of time. As described above, in a case where the light-receivingsection 31 receives the reflected light, it is not possible to detect light in a period of the dead time described above. As a result, as the probability that the reflected light enters the light-receivingsection 31 becomes higher with the lapse of time, the light reception probability is decreased. Thus, the light-receiving section 11 receives the reflected light with the light reception probability illustrated in (B) ofFIG. 35 . - As the light reception probability is decreased in such a manner with the lapse of time in a case where the distribution of the count value CNT that is supposed to be obtained is a distribution like the characteristic W11, the distribution of the actual count values CNT becomes like the characteristic W12, which causes deviation of time corresponding to a peak of the distribution of the count value CNT. That is, a TOF value (TOF2) obtained by the characteristic W12 becomes smaller than a TOF value (TOF1) obtained by the characteristic W11. The TOF value may deviate due to dead time of the light-receiving
section 31 in such a manner. - Although the case where there is no ambient light has been described above, in a case where there is ambient light, the light-receiving section 11 receives both reflected light and ambient light with the light reception probability illustrated in (B) of
FIG. 35 . Accordingly, the light reception probability of the reflected light is decreased as compared with the case where there is no ambient light. The light reception probability of reflected light changes in such a manner; therefore, deviation of the TOF value may also change. - Accordingly, the distance
measurement correction section 126 corrects the TOF value from TOF1 to TOF2 on the basis of the full count value of the ambient light component C2 inFIG. 35 , for example. Specifically, the distancemeasurement correction section 126 is able to correct the TOF value on the basis of the full count value of the ambient light component C2 with use of, for example, a lookup table indicating a relationship between the full count value of the ambient light component C2 and a correction amount. - Here, the
counter 131 corresponds to a specific example of a “second counter” in the present disclosure. The distancemeasurement correction section 124 corresponds to a specific example of a “second processor” in the present disclosure. - Thus, in the
photodetection system 2, the TOF value is calculated on the is of the count values CNTA to CNTD of thecounters 35A to 35D, and this TOF value is corrected on the basis of the count value CNTN of thecounter 131, which makes it possible to enhance detection accuracy of time (TOF value) or a distance. - As described above, in the present embodiment, the TOF value is calculated on the basis of the count values CNTA to CNTD of the
counters 35A to 35D, and this TOF value is corrected on the basis of the count value CNTN of thecounter 131, which makes it possible to enhance detection accuracy. - In the embodiment described above, the
photodetection system 2 generates a distance image, but this is not limitative. Instead of this, for example, in addition to the distance image, an image (light reception amount image) indicating a light reception amount may be further generated. The present modification example is described in detail below. - A photodetection system 2A according to the present modification example includes a
photodetector 140, as with thephotodetection system 2 according to the embodiment described above. -
FIG. 36 illustrates a configuration example of thephotodetector 140. Thephotodetector 140 includes aphotodetection array 141, asignal generator 142, areadout controller 143, and asignal processor 144. -
FIG. 37 illustrates a configuration example of the photodetection unit U in thephotodetection array 141. The photodetection unit U includes acounter 151. Thecounter 151 is configured to count time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB by counting pulses of the clock signal CLK on the basis of the control signal STP generated by thesaturation determining section 38. Specifically, thecounter 151 performs count processing on the basis of the clock signal CLK generated in the exposure period P1 and stops the count processing on the basis of the control signal STP, which makes it possible to count time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB. Then, thecounter 151 outputs a result of the count processing as a count value CNTM. - The
signal generator 142 is configured to generate the clock signals CLKA to CLKD and CLK, and the thresholds THA and THB on the basis of an instruction from thephotodetection controller 25 and supply the generated clock signals CLKA to CLKD and CLK, and the generated thresholds THA and THB to a plurality of photodetection units U in thephotodetection array 141. - The
readout controller 143 is configured to control an operation of supplying, to thesignal processor 144, the count values CNTA to CNTD, CNTN, and CNTM generated in each of the plurality of photodetection units U in thephotodetection array 141, on the basis of an instruction from thephotodetection controller 25 - The
signal processor 144 includes a light receptionamount image generator 147. The light receptionamount image generator 147 is configured to generate a light reception amount image. Specifically, the light receptionamount image generator 147 first calculates a count value Nsat with use of the following expression. -
Nsat=THA×CNTN+THB - As illustrated in
FIG. 34 , Nsat is a full count value of the largest count value CNT (the count value CNTC in an example inFIG. 34 ) among the count values CNTA to CNTD in the photodetection unit U. This count value Nsat is a full count value obtained from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and the count processing stops. - Then, the light reception
amount image generator 147 calculates a count value Nexp indicating a brightness value in the photodetection unit U with use of the following expression. -
Nexp=Nsat×Texp/Tsat - Here, Texp is a time length of the exposure period P1, and Tsat is a time length of a period (count period) from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and the count processing stops. The light reception
amount image generator 147 converts the count value Nsat obtained in the time Tsat that is the time length of the count period into the count value Nexp to be obtained in the time Texp that is the time length of the exposure period P1 with use of this expression, as illustrated inFIG. 38 . That is, in each of the plurality of photodetection units U, the count processing individually stops; therefore, a timing at which the count processing stops may differ among the photodetection units U. Accordingly, the time length (time Tsat) of the period in which the count value Nsat is obtained may differ among the photodetection units U. Thus, the light receptionamount image generator 147 converts the count value Nsat obtained in the time Tsat into the count value Nexp to be obtained in the time Texp that is the time length of the exposure period P1. This makes it possible for the light receptionamount image generator 147 to then generate a light reception amount image on the basis of this count value Nexp in the plurality of photodetection units U. - Here, the
counter 151 corresponds to a specific example of a “third counter” in the present disclosure. The light receptionamount image generator 147 corresponds to a specific example of a “third processor” in the present disclosure. - It is to be noted that, in this example, the count value Nsat that is the full count value of the largest count value CNT (the count value CNTC in the example in
FIG. 34 ) among the count values CNTA to CNTD is converted into the count value Nexp to generate a light reception amount image, but this is not limitative. For example, a total value of full count values of the four count values CNTA to CNTD may be converted into the count value Nexp to generate a light reception amount image. In addition, a full count value of the smallest count value CNT (e.g., the count value CNTA in the example inFIG. 34 ) among the four count values CNTA to CNTD may be converted into the count value Nexp to generate a light reception amount image. Thesignal processor 144 has pieces of information about the count values CNTA to CNTD, CNTN, and CNTM supplied from all the photodetection units U, which makes it possible for the light receptionamount image generator 147 to generate a light reception amount image by any of such various methods on the basis of these pieces of information. - In addition, in this example, the
counter 151 counts time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, but this is not limitative. Instead of this, for example, thecounter 151 may count time from when one or more count values of the count values CNTA to CNTD reach the threshold THB to when the exposure period P1 ends. In this case, the light receptionamount image generator 147 is able to convert a result (count value CNTM) of count processing by thecounter 151 into time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, and calculate the count value Nexp on the basis of a result of such conversion. - In addition, for example, as illustrated in
FIG. 39 , alatch 161 may be provided that latches, for example, a time code CODE on the basis of the control signal STP generated by thesaturation determining section 38. The time code CODE is generated by, for example, thesignal generator 142. Thus, thelatch 161 generates a code CODE by latching a time code TCODE at a timing at which one or more count values of the count values CNTA to CNTD reach the threshold THB. In this case, the light receptionamount image generator 147 is able to obtain time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB, on the basis of, for example, a timing at which the exposure period P1 starts and a timing indicated by this code CODE, and is ale to calculate the count value Nexp on the basis of this time. Here, thelatch 161 corresponds to a specific example of a “latch circuit” in the present disclosure. - In the embodiment described above, the present technology is applied to a TOF sensor, but this is not limitative. Instead of this, the present technology may be applied to, for example, an image sensor.
-
FIG. 40 illustrates a configuration example of aphotodetector 170 according to the present modification example. Thephotodetector 170 includes aphotodetection array 171, asignal generator 172, thereadout controller 143, and asignal processor 174. -
FIG. 41 illustrates a configuration example of the photodetection unit U in thephotodetection array 171. The photodetection unit U includes the light-receivingsections 31A to 31D, aninverter 133, and thecounter 151. The light-receivingsections 31A to 31D respectively generate the pulse signals PLSA to PLSD. Theinverter 133 is configured to invert the control signal STP and supply a thus-inverted signal to theswitches 34A to 34D. Accordingly, theswitches 34A to 34D respectively supply the pulse signals PLSA to PLSD to thecounters 35A to 35D in a case where the control signal STP is at the lo level, and stop supply of the pulse signals PLSA to PLSD to thecounters 35A to 35D in a case where the control signal STP is at the high level. Thecounter 151 is configured to count time from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB by counting pulses of the clock signal CLK on the basis of the control signal STP generated by thesaturation determining section 38. Then, thecounter 151 outputs a result of counting pulses of the clock signal CLK as the count value CNTM. It is to be noted that, in this example, four circuits including the light-receivingsection 31, the switch 34, and the counter 35 are provided, but this is not limitative. For example, it is possible to provide two or more circuits including the light-receivingsection 31, the switch 34, and the counter 35. - The signal generator 172 (
FIG. 40 ) is configured to generate the clock signal CLK and the thresholds THA and THB on the basis of an instruction from thephotodetection controller 25 and supply the generated clock signal CLK and the generated thresholds THA and THB to a plurality of photodetection units U in thephotodetection array 171. - The
readout controller 143 is configured to control an operation of supplying, to thesignal processor 174, the count values CNTA to CNTD, CNTN, and CNTM generated in each of the plurality of photodetection units U in thephotodetection array 171, on the basis of an instruction from thephotodetection controller 25 - The
signal processor 174 is configured to generate a captured image on the basis of an instruction from thephotodetection controller 25. Specifically, thesignal processor 174 calculates a full count value of the count value CNTA obtained from when the exposure period P1 starts to when one or more count values of the count values CNTA to CNTD reach the threshold THB and count processing stops, on the basis of the count values CNTA and the count value CNTN supplied from the photodetection unit U. Then, thesignal processor 174 converts the full count value of this count value CNTA into a count value to be obtained in the time Texp that is the time length of the exposure period P1, as with the light receptionamount image generator 147. The same applies to the count values CNTB to CNTD. Thesignal processor 174 is able to generate a captured image in such a manner. - Each of the modification examples of the first embodiment described above may be applied to the
photodetection system 2 according to the embodiment described above. - Next, description is given of a
photodetection system 3 according to a third embodiment. The present embodiment is configured to have the thresholds THA and THB changeable. It is to be noted that components substantially the same as those of thephotodetection system 1 according to the first embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate. - The
photodetection system 3 according to the present embodiment includes aphotodetector 220, as with the photodetection system 1 (FIG. 1 ) according to the first embodiment described above. -
FIG. 42 illustrates a configuration example of thephotodetector 220. Thephotodetector 220 includes aphotodetection array 221 and asignal generator 222. -
FIG. 43 illustrates a configuration example of the photodetection unit U in thephotodetection array 221. The photodetection unit U includes a determiningsection 236 and athreshold setting section 239. - The determining
section 236 is configured to determine whether or not all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determiningsection 236 determines whether or not the smallest value among the count values CNTA to CNTD has reached the threshold THA. It is possible for the determiningsection 236 to have, for example, the same circuit configuration as the circuit configuration of the subtraction determining section 36 (FIG. 6 ). - The
threshold setting section 239 is configured to set the thresholds THA and THB on the basis of a determination result of the determiningsection 236. Then, the threshold setting section 231 supplies the set threshold THA to the determiningsection 236, and supplies the set threshold THB to thesaturation determining section 38. - The signal generator 222 (
FIG. 42 ) is configured to generate the clock signals CLKA to CLKD on the basis of an instruction from thephotodetection controller 25 and supply the generated clock signals CLKA to CLKD to the plurality of photodetection units U in thephotodetection array 221. - Here, the determining
section 236 and thethreshold setting section 239 correspond to specific examples of a “threshold setting section” in the present disclosure. Thesaturation determining section 38 and the ANDcircuits 33A to 33D correspond to specific examples of a “stop processor” in the present disclosure. -
FIG. 44 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P1. - When the exposure period P1 starts, the count values CNTA to CNTD gradually increase with the lapse of time. At a timing illustrated in (A) of
FIG. 44 , the ambient light component C2 in each of the count values CNTA to CNTD is smaller than the threshold value THA. - Thereafter, at a timing illustrated in (B) of
FIG. 44 , the ambient light component C2 in each of the count values CNTA to CNTD reaches the threshold THA. The determiningsection 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determiningsection 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. Accordingly, thethreshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB ((C) ofFIG. 44 ). - Even after that, the count values CNTA to CNTD gradually increase with the lapse of time.
- Then, at a timing illustrated in (D) of
FIG. 44 , the count value CNTC reaches the threshold THB. Thesaturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. -
FIG. 45 illustrates an operation example of thephotodetector 220. - First, in the
photodetector 220, thephotodetection controller 25 starts the exposure period P1 (step S201). In the exposure period P1, thesignal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from thephotodetection controller 25. - Next, the
photodetection controller 25 confirms whether or not the exposure period P1 having a predetermined time length has ended (step S202). In a case where the exposure period P1 has ended (“Y” in step S202), processing proceeds to step S207. - In a case where the exposure period P1 has not yet ended (“N” in step s202), the
saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S203). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S203), the processing proceeds to step S206. - In step S203, in a case where none of the count values CNT has reached the threshold THB (“N” in step S203), the determining
section 236 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S204). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S204), the processing returns to step S202. - In step S204, in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S204), the
threshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB (step S205). That is, in an example inFIG. 44 , as illustrated in (B) and (C) ofFIG. 44 , all of the four count values CNT have reached the threshold THA, which causes thethreshold setting section 239 to set each of the thresholds THA and THB to a higher value. The processing then returns to step S202. - In step S203, in a case where one or more count values CNT have reached the threshold THB (“Y” in step S203), the
counters 35A to 35D stop count processing (step S206). That is, in the example inFIG. 44 , as illustrated in (D) ofFIG. 44 , one or more count values CNT of the four count values CNT have reached the threshold THB; which causes thesaturation determining section 38 to change the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. - The plurality of photodetection units U each perform such an operation individually.
- Then, the
photodetector 220 performs readout processing (step S207). Specifically, thereadout controller 23 controls the operations of the plurality of photodetection units U to supply, to thesignal processor 24, the count values CNTA to CND generated in each of the plurality of photodetection units U. - Thus, this processing ends. Then, the
signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U. - Thus, in the
photodetection system 3, the determiningsection 236 and thethreshold setting section 239 make a change to increase the threshold THB, on the basis of one or more count values of a plurality of count values CNT. In particular, in this example, in a case where all of the plurality of count values CNT have reached the threshold THA, the determiningsection 236 and thethreshold setting section 239 make a change to increase the threshold THB. In other words, in a case where the smallest value among the plurality of count values CNT has reached the threshold THA, the determiningsection 236 and thethreshold setting section 239 make a change to increase the threshold THB. Accordingly, as illustrated in (D) ofFIG. 44 , in a case where the amount of ambient light is large, it is possible to secure the signal amount of the reflected light component C1. As a result, in thephotodetection system 1, it is possible to enhance detection accuracy of time (TOF value) or a distance. In addition, in a case where the amount of ambient light is small, for example, the threshold THB is not changed, which makes it possible to stop count processing in a shorter time. This makes it possible to reduce electric power consumption and shorten distance measurement time, for example. - In addition, in the
photodetection system 3, in each of the plurality of photodetection units U, the determiningsection 236 and thethreshold setting section 239 make a change to increase the threshold THB. This makes it possible to adaptively set the threshold THB in accordance with the light amount of ambient light in each of the plurality of photodetection units U. As a result, in thephotodetection system 3, it is possible to effectively enhance detection accuracy of time (TOF value) or a distance in each of the plurality of photodetection units U. - As described above, in the present embodiment, the threshold THB is changed to be increased, on the basis of one or more count values of a plurality of count values, which makes it possible to secure the signal amount, thereby makes it possible to enhance detection accuracy.
- In the embodiment described above, the determining
section 236 determines whether or not all of the count values CNTA to CNTD have reached the threshold THA, but this is not limitative. For example, as with the modification example 1-4 of the first embodiment described above, whether or not the count value CNT of a predetermined counter 35 of a plurality of counters 35 has reached the threshold THA may be determined, or whether or not both the count values of two predetermined counters 35 of the plurality of counters 35 have reached the threshold THA may be determined. In addition, whether or not the sum of the count values of these two counters 35 reaches the threshold THA may be determined, or whether or not an average value of the count values of these two counters 35 reaches the threshold THA may be determined. - Any of the modification examples of the first embodiment described above may be applied to the
photodetection system 3 according to the embodiment described above. - Next, description is given of a
photodetection system 4 according to a fourth embodiment. The present embodiment is a combination of technologies of the first embodiment and the third embodiment. It is to be noted that components substantially the same as those of thephotodetection system 1 according to the first embodiment and thephotodetection system 3 according to the third embodiment described above are denoted by the same reference numerals, and description thereof is omitted as appropriate. - The
photodetection system 4 according to the present embodiment includes a photodetector 320, as with thephotodetection system 3 according to the third embodiment described above. The photodetector 320 includes a photodetection array 321 and thesignal generator 222, as with the photodetector 220 (FIG. 42 ) according to the third embodiment described above. -
FIG. 46 illustrate a configuration example of the photodetection unit U in the photodetection array 321. The photodetection unit U includes athreshold setting section 339, asubtraction determining section 336, and thesubtraction controller 37. - The
threshold setting section 339 is configured to set the thresholds THA and THB on the basis of a determination result of the determiningsection 236 and the threshold THB. Specifically, thethreshold setting section 339 sets the thresholds THA and THB in a case where the threshold THB has not reached a predetermined threshold THB0 under a condition that the determiningsection 236 determines that all of the count values CNTA to CNTD have reached the threshold THA, and supplies the set threshold THA to the determiningsection 236, and supplies the set threshold THB to thesaturation determining section 38. - The
subtraction determining section 336 is configured to determine whether or not to perform subtraction processing on the basis of a determination result of the determiningsection 236 and the threshold THB. Specifically, in a case where the threshold THB has reached the predetermined threshold THB0 under a condition that the determiningsection 236 determines that all of the count values CNTA to CNTD have reached the threshold THA, thesubtraction determining section 336 determines to perform subtraction processing. - The
subtraction controller 37 is configured to subtract a predetermined value from each of the count values CNTA to CNTD in thecounters 35A to 35D on the basis of a determination result of thissubtraction determining section 336. - The
signal generator 222 is configured to generate the clock signals CLKA to CLKD on the basis of an instruction from thephotodetection controller 25 and supply the generated clock signals CLKA to CLKD to the plurality of photodetection units U in the photodetection array 321. - Here, the determining
section 236, thesubtraction determining section 336, and thesubtraction controller 37 correspond to specific examples of a “subtraction processor” in the present disclosure. The determiningsection 236 and thethreshold setting section 339 correspond to specific examples of a “threshold setting section” in the present disclosure. Thesaturation determining section 38 and the ANDcircuits 33A to 33D correspond to specific examples of a “stop processor” in the present disclosure. -
FIG. 47 illustrates an example of changes in the count values CNTA to CNTD in the exposure period P1. - When the exposure period P1 starts, the count values CNTA to CNTD gradually increase with the lapse of time. At a timing illustrated in (A) of
FIG. 47 , the ambient light component C2 in each of the count values CNTA to CNTD is smaller than the threshold THA. - Thereafter, at a timing illustrated in (B) of
FIG. 47 , the ambient light component C2 in each of the count values CNTA to CNTD reaches the threshold THA. The determiningsection 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determiningsection 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. At this time, the threshold THB has not yet reached the predetermined threshold THB0. Accordingly, thethreshold setting section 239 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to higher value, for example, by adding a predetermined value to the threshold THB ((C) ofFIG. 47 ). - Even after that, the count values CNTA to CNTD gradually increase with the lapse of time.
- Then, at a timing illustrated in (D) of
FIG. 47 , the ambient light component C2 in each of the count values CNTA to CNTD reaches the changed threshold THA. The determiningsection 236 determines that all of the count values CNTA to CNTD have reached the threshold THA. In other words, the determiningsection 236 determines that the smallest value among the count values CNTA to CNTD has reached the threshold THA. At this time, the threshold THB reaches the predetermined threshold THB0. Accordingly, thesubtraction determining section 336 determines to perform subtraction processing, and thesubtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD ((E) ofFIG. 47 ). Thus, a portion of the ambient light component C2 in each of the count values CNTA to CNTD is removed, and the reflected light component C1 is maintained. - Even after that, the count values CNTA to CNTD gradually increase with the lapse of time.
- The, at a timing illustrated in (F) of
FIG. 47 , the count value CNTC reaches the threshold THB. Thesaturation determining section 38 determines that one or more count values of the count values CNTA to CNTD have reached the threshold THB, and changes the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. -
FIG. 48 illustrates an operation example of the photodetector 320. - First, in the photodetector 320, the
photodetection controller 25 starts the exposure period P1 (step S301). In the exposure period P1, thesignal generator 22 generates the clock signals CLKA to CLKD on the basis of an instruction from thephotodetection controller 25. - Next, the
photodetection controller 25 confirms whether or not the exposure period P1 having a predetermined time length has ended (step S302). In a case where the exposure period P1 has ended (“Y” in step S302), processing proceeds to step S309. - In a case where the exposure period P1 has not yet ended (“N” in step S302), the
saturation determining section 38 determines whether or not one or more count values CNT of four count values CNT (count values CNTA to CNTD) have reached the threshold THB (step S303). In a case where one or more count values CNT have reached the threshold THB (“Y” in step S303), the processing proceeds to step S308. - In step S303, in a case where none of the count values CNT has reached the threshold THB (“N” in step S303), the determining
section 236 determines whether or not all of the four count values CNT (count values CNTA to CNTD) have reached the threshold THA (step S304). In a case where all of the count values CNT have not reached the threshold THA (“N” in step S304), the processing returns to step S302. - In step S304, in a case where all of the four count values CNT have reached the threshold THA (“Y” in step S304), the
threshold setting section 339 and thesubtraction determining section 336 confirm whether or not the threshold THB has reached the predetermined threshold THB0 (step S305). - In step S305, in a case where the threshold THB has not reached the predetermined threshold THB0 (“N” in step S305), the
threshold setting section 339 sets the threshold THA to a higher value, for example, by adding a predetermined value to the threshold THA, and sets the threshold THB to a higher value, for example, by adding a predetermined value to the threshold THB (step S306). That is, in an example inFIG. 47 , as illustrated in (B) and (C) ofFIG. 47 , all of the four count values CNT have reached the threshold THA, and the threshold THB has not reached the predetermined threshold THB0, which causes thethreshold setting section 239 to set each of the thresholds THA and THB to a higher value. The processing then returns to step S302. - In step S305, in a case where the threshold THB has reached the predetermined threshold THB0 (“Y” in step S305), the
subtraction determining section 336 determines to perform subtraction processing, and thesubtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD (step S307). That is, in the example inFIG. 47 , as illustrated in (D) and (E) ofFIG. 47 , all of the four count values CNT have reached the threshold THA, and the threshold THB has reached the predetermined threshold THB0; therefore, thesubtraction determining section 336 determines to perform subtraction processing, and thesubtraction controller 37 subtracts a predetermined value from each of the count values CNTA to CNTD. The processing then returns to step S302. - In step S303, in a case where one or more count values CNT have reached the threshold THB (“Y” in step S303), the
counters 35A to 35D stop count processing (step S308). That is, in the example inFIG. 47 , as illustrated in (F) ofFIG. 47 , in a case where one or more count values CNT of the four count values CNT have reached the threshold THB, thesaturation determining section 38 changes the control signal STP from the low level to the high level. The ANDcircuits 33A to 33D each change the output signal to the low level on the basis of this control signal STP. Accordingly, theswitches 34A to 34D stop supply of the pulse signal PLS to thecounters 35A to 35D, and thecounters 35A to 35D stop count processing. - The plurality of photodetection units U each performs such an operation individually.
- Then, the photodetector 320 performs readout processing (step S309). Specifically, the
readout controller 23 controls the operations of the plurality of photodetection units U to supply, to thesignal processor 24, the count values CNTA to CND generated in each of the plurality of photodetection units U. - Thus, this processing ends. Then, the
signal processor 24 generates a distance image on the basis of the count values CNTA to CNTD supplied from each of the plurality of photodetection units U. - Thus, in the
photodetection system 4, the determiningsection 236, thesubtraction determining section 336, and thesubtraction controller 37 perform subtraction processing for subtracting a predetermined value from each of a plurality of count values CNT on the basis of one or more count values of the plurality of count values CNT. Accordingly, for example, as with the first embodiment, in a case where the amount of ambient light is large, it is possible to decrease the final ambient light component C2 to the threshold THA or lower, which makes it possible to secure the signal amount of the reflected light component C1. As a result, in thephotodetection system 4, it is possible to enhance detection accuracy of time (TOF value) or a distance. - In addition, in the
photodetection system 4, the determiningsection 236 and thethreshold setting section 339 make a change to increase the threshold THB, on the basis of one or more count values of the plurality of count values CNT. Accordingly, for example, as with the third embodiment, it is possible to secure the signal amount of the reflected light component C1 in a case where the amount of ambient light is large. As a result, in thephotodetection system 4, it is possible to enhance detection accuracy of time (TOF value) or a distance. In addition, in a case where the amount of ambient light is small, for example, the threshold THB is not changed, which makes it possible to stop count processing in a shorter time. This makes it possible to reduce electric power consumption and shorten distance measurement time, for example. - As described above, in the present embodiment, on the basis of one or more count values of the plurality of count values CNT, the subtraction processing for subtracting a predetermined value from each of the plurality of count values CNT is performed, and the threshold THB is changed to be increased, which makes it possible to secure the signal amount, thereby makes it possible to enhance detection accuracy.
- In the embodiment described above, the determining
section 236 determines whether or not all of the count values CNTA to CNTD have reached the threshold THA, but this is not limitative. For example, as with the modification example 1-4 of the first embodiment described above, whether or not the count value CNT of a predetermined counter 35 of a plurality of counters 35 has reached the threshold THA may be determined, or whether or not both the count values CNT of two predetermined counters 35 of the plurality of counters 35 have reached the threshold THA may be determined. In addition, whether or not the sum of the count values of these two counters 35 reaches the threshold THA may be determined, or whether or not an average value of the count values of these two counters reaches the threshold THA may be determined. - Each of the modification examples of the first embodiment described above may be applied to the
photodetection system 4 according to the embodiment described above. - The technology (the present technology) according to the present disclosure is applicable to a variety of products. For example, the technology according to the present disclosure may be achieved as a device mounted on any type of mobile body such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility, an airplane, a drone, a vessel, or a robot.
-
FIG. 49 is a block diagram depicting an example of schematic configuration of a vehicle control system as an example of a mobile body control system to which the technology according to an embodiment of the present disclosure can be applied. - The
vehicle control system 12000 includes a plurality of electronic control units connected to each other via acommunication network 12001. In the example depicted inFIG. 49 , thevehicle control system 12000 includes a drivingsystem control unit 12010, a bodysystem control unit 12020, an outside-vehicleinformation detecting unit 12030, an in-vehicleinformation detecting unit 12040, and an integrated control unit 12050. In addition, amicrocomputer 12051, a sound/image output section 12052, and a vehicle-mounted network interface (I/F) 12053 are illustrated as a functional configuration of the integrated control unit 12050. - The driving
system control unit 12010 controls the operation of devices related to the driving system of the vehicle in accordance with various kinds of programs. For example, the drivingsystem control unit 12010 functions as a control device for a driving force generating device for generating the driving force of the vehicle, such as an internal combustion engine, a driving motor, or the like, a driving force transmitting mechanism for transmitting the driving force to wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating the braking force of the vehicle, and the like. - The body
system control unit 12020 controls the operation of various kinds of devices provided to a vehicle body in accordance with various kinds of programs. For example, the bodysystem control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various kinds of lamps such as a headlamp, a backup lamp, a brake lamp, a turn signal, a fog lamp, or the like. In this case, radio waves transmitted from a mobile device as an alternative to a key or signals of various kinds of switches can be input to the bodysystem control unit 12020. The bodysystem control unit 12020 receives these input radio waves or signals, and controls a door lock device, the power window device, the lamps, or the like of the vehicle. - The outside-vehicle
information detecting unit 12030 detects information about the outside of the vehicle including thevehicle control system 12000. For example, the outside-vehicleinformation detecting unit 12030 is connected with animaging section 12031. The outside-vehicleinformation detecting unit 12030 makes theimaging section 12031 image an image of the outside of the vehicle, and receives the imaged image. On the basis of the received image, the outside-vehicleinformation detecting unit 12030 may perform processing of detecting an object such as a human, a vehicle, an obstacle, a sign, a character on a road surface, or the like, or processing of detecting a distance thereto. - The
imaging section 12031 is an optical sensor that receives light, and which outputs an electric signal corresponding to a received light amount of the light. Theimaging section 12031 can output the electric signal as an image, or can output the electric signal as information about a measured distance. In addition, the light received by theimaging section 12031 may be visible light, or may be invisible light such as infrared rays or the like. - The in-vehicle
information detecting unit 12040 detects information about the inside of the vehicle. The in-vehicleinformation detecting unit 12040 is, for example, connected with a driverstate detecting section 12041 that detects the state of a driver. The driverstate detecting section 12041, for example, includes a camera that images the driver. On the basis of detection information input from the driverstate detecting section 12041, the in-vehicleinformation detecting unit 12040 may calculate a degree of fatigue of the driver or a degree of concentration of the driver, or may determine whether the driver is dozing. - The
microcomputer 12051 can calculate a control target value for the driving force generating device, the steering mechanism, or the braking device on the basis of the information about the inside or outside of the vehicle which information is obtained by the outside-vehicleinformation detecting unit 12030 or the in-vehicleinformation detecting unit 12040, and output a control command to the drivingsystem control unit 12010. For example, themicrocomputer 12051 can perform cooperative control intended to implement functions of an advanced driver assistance system (ADAS) which functions include collision avoidance or shock mitigation for the vehicle, following driving based on a following distance, vehicle speed maintaining driving, a warning of collision of the vehicle, a warning of deviation of the vehicle from a lane, or the like. - In addition, the
microcomputer 12051 can perform cooperative control intended for automated driving, which makes the vehicle to travel automatedly without depending on the operation of the driver, or the like, by controlling the driving force generating device, the steering mechanism, the braking device, or the like on the basis of the information about the outside or inside of the vehicle which information is obtained by the outside-vehicleinformation detecting unit 12030 or the in-vehicleinformation detecting unit 12040. - In addition, the
microcomputer 12051 can output a control command to the bodysystem control unit 12020 on the basis of the information about the outside of the vehicle which information is obtained by the outside-vehicleinformation detecting unit 12030. For example, themicrocomputer 12051 can perform cooperative control intended to prevent a glare by controlling the headlamp so as to change from a high beam to a low beam, for example, in accordance with the position of a preceding vehicle or an oncoming vehicle detected by the outside-vehicleinformation detecting unit 12030. - The sound/
image output section 12052 transmits an output signal of at least one of a sound and an image to an output device capable of visually or auditorily notifying information to an occupant of the vehicle or the outside of the vehicle. In the example ofFIG. 49 , anaudio speaker 12061, adisplay section 12062, and aninstrument panel 12063 are illustrated as the output device. Thedisplay section 12062 may, for example, include at least one of an on-board display and a head-up display. -
FIG. 50 is a diagram depicting an example of the installation position of theimaging section 12031. - In
FIG. 50 , theimaging section 12031 includes 12101, 12102, 12103, 12104, and 12105.imaging sections - The
12101, 12102, 12103, 12104, and 12105 are, for example, disposed at positions on a front nose, sideview mirrors, a rear bumper, and a back door of theimaging sections vehicle 12100 as well as a position on an upper portion of a windshield within the interior of the vehicle. Theimaging section 12101 provided to the front nose and theimaging section 12105 provided to the upper portion of the windshield within the interior of the vehicle obtain mainly an image of the front of thevehicle 12100. The 12102 and 12103 provided to the sideview mirrors obtain mainly an image of the sides of theimaging sections vehicle 12100. Theimaging section 12104 provided to the rear bumper or the back door obtains mainly an image of the rear of thevehicle 12100. Theimaging section 12105 provided to the upper portion of the windshield within the interior of the vehicle is used mainly to detect a preceding vehicle, a pedestrian, an obstacle, a signal, a traffic sign, a lane, or the like. - Incidentally,
FIG. 50 depicts an example of photographing ranges of theimaging sections 12101 to 12104. Animaging range 12111 represents the imaging range of theimaging section 12101 provided to the front nose. Imaging ranges 12112 and 12113 respectively represent the imaging ranges of the 12102 and 12103 provided to the sideview mirrors. Animaging sections imaging range 12114 represents the imaging range of theimaging section 12104 provided to the rear bumper or the back door. A bird's-eye image of thevehicle 12100 as viewed from above is obtained by superimposing image data imaged by theimaging sections 12101 to 12104, for example. - At least one of the
imaging sections 12101 to 12104 may have a function of obtaining distance information. For example, at least one of theimaging sections 12101 to 12104 may be a stereo camera constituted of a plurality of imaging elements, or may be an imaging element having pixels for phase difference detection. - For example, the
microcomputer 12051 can determine a distance to each three-dimensional object within the imaging ranges 12111 to 12114 and a temporal change in the distance (relative speed with respect to the vehicle 12100) on the basis of the distance information obtained from theimaging sections 12101 to 12104, and thereby extract, as a preceding vehicle, a nearest three-dimensional object in particular that is present on a traveling path of thevehicle 12100 and which travels in substantially the same direction as thevehicle 12100 at a predetermined speed (for example, equal to or more than 0 km/hour). Further, themicrocomputer 12051 can set a following distance to be maintained in front of a preceding vehicle in advance, and perform automatic brake control (including following stop control), automatic acceleration control (including following start control), or the like. It is thus possible to perform cooperative control intended for automated driving that makes the vehicle travel automatedly without depending on the operation of the driver or the like. - For example, the
microcomputer 12051 can classify three-dimensional object data on three-dimensional objects into three-dimensional object data of a two-wheeled vehicle, a standard-sized vehicle, a large-sized vehicle, a pedestrian, a utility pole, and other three-dimensional objects on the basis of the distance information obtained from theimaging sections 12101 to 12104, extract the classified three-dimensional object data, and use the extracted three-dimensional object data for automatic avoidance of an obstacle. For example, themicrocomputer 12051 identifies obstacles around thevehicle 12100 as obstacles that the driver of thevehicle 12100 can recognize visually and obstacles that are difficult for the driver of thevehicle 12100 to recognize visually. Then, themicrocomputer 12051 determines a collision risk indicating a risk of collision with each obstacle. In a situation in which the collision risk is equal to or higher than a set value and there is thus a possibility of collision, themicrocomputer 12051 outputs a warning to the driver via theaudio speaker 12061 or thedisplay section 12062, and performs forced deceleration or avoidance steering via the drivingsystem control unit 12010. Themicrocomputer 12051 can thereby assist in driving to avoid collision. - At least one of the
imaging sections 12101 to 12104 may be an infrared camera that detects infrared rays. Themicrocomputer 12051 can, for example, recognize a pedestrian by determining whether or not there is a pedestrian in imaged images of theimaging sections 12101 to 12104. Such recognition of a pedestrian is, for example, performed by a procedure of extracting characteristic points in the imaged images of theimaging sections 12101 to 12104 as infrared cameras and a procedure of determining whether or not it is the pedestrian by performing pattern matching processing on a series of characteristic points representing the contour of the object. When themicrocomputer 12051 determines that there is a pedestrian in the imaged images of theimaging sections 12101 to 12104, and thus recognizes the pedestrian, the sound/image output section 12052 controls thedisplay section 12062 so that a square contour line for emphasis is displayed so as to be superimposed on the recognized pedestrian. The sound/image output section 12052 may also control thedisplay section 12062 so that an icon or the like representing the pedestrian is displayed at a desired position. - The example of the vehicle control system to which the technology according to the present disclosure may be applied has been described above. The technology according to the present disclosure may be applied to the
imaging section 12031 among the components described above. This makes it possible to enhance detection accuracy of time (TOF value) or a distance in thevehicle control system 12000. As a result, this allows thevehicle control system 12000 to implement, with high accuracy, collision avoidance or shock mitigation for vehicles, a following driving function based on vehicle-to-vehicle distance, a vehicle speed maintaining driving function, a warning function of collision of the vehicle, a warning function of deviation of the vehicle from a lane, and the like. - Although the present technology has been described above with reference to some embodiments, the modification examples, and specific application examples thereof, the present technology is not limited to these embodiments and the like, and may be modified in a variety of ways.
- For example, in the respective embodiments described above, the light-receiving
section 31 as illustrated inFIGS. 4A and 4B is provided; however, the circuit configuration of the light-receivingsection 31 is not limited thereto, and any of various circuit configurations is applicable to the light-receivingsection 31. - It is to be noted that the effects described herein are merely illustrative and non-limiting, and other effects may be included.
- It is to be noted that the present technology may have the following configurations. According to the present technology having the following configurations, it is possible to enhance detection accuracy.
- (1)
- A photodetection device including:
-
- one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element;
- a plurality of first counters that each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values; and
- a subtraction processor that performs subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
(2)
- The photodetection device according to (1), further including a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
- (3)
- The photodetection device according to (2), in which the subtraction processor performs the subtracting processing in a case where all of the plurality of count values have reached a second threshold.
- (4)
- The photodetection device according to (2), in which the subtraction processor performs the subtraction processing in a case where a smallest value among the plurality of count values has reached a second threshold.
- (5)
- The photodetection device according to (2), in which the subtraction processor performs the subtraction processing on the basis of the count values of one or more predetermined first counters of the plurality of first counters.
- (6)
- The photodetection device according to any one of (2) to (5), in which the subtraction processor performs the subtraction processing by changing a bit value of a predetermined count bit of a plurality of count bits in each of the plurality of first counters.
- (7)
- The photodetection device according to (6), in which the predetermined count bit includes a most significant bit of the plurality of count bits.
- (8)
- The photodetection device according to any one of (2) to (7), in which the subtraction processor performs the subtraction processing in a period in which each of the plurality of first counters does not perform the count processing.
- (9)
- The photodetection device according to any one of (2) to (8), in which the first threshold includes a largest possible count value taken by the plurality of count values.
- (10)
- The photodetection device according to any one of (2) to (9), further including a threshold setting section that makes a change to increase the first threshold, on the basis of one or more count values of the plurality of count values, in which
-
- the threshold setting section makes a change to increase the first threshold in a case where the first threshold has not reached a predetermined threshold, and
- the subtraction processor performs the subtraction processing in a case where the first threshold has reached the predetermined threshold.
(11)
- The photodetection device according to (10), in which the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
- (12)
- The photodetection device according to (11), in which the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
- (13)
- The photodetection device according to (10), in which the threshold setting section makes a change to increase the first threshold on the basis of the count values of one or more predetermined counters of the plurality of first counters.
- (14)
- The photodetection device according to any one of (2) to (13), further including a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
- (15)
- The photodetection device according to any one of (2) to (14), further including a second counter that counts number of times the subtraction processing has been performed.
- (16)
- The photodetection device according to (15), further including a second processor that calculates a photodetection timing on the basis of the plurality of count values after the stop processor stops the count processing in the plurality of first counters, and corrects the photodetection timing on the basis of a count value of the second counter.
- (17)
- The photodetection device according to (15) or (16), further including a detector that detects a stop timing at which the stop processor stops the count processing in the plurality of first counters.
- (18)
- The photodetection device according to (17), in which the detector includes a third counter that measures time from when the plurality of first counters starts the count processing to when the stop processor stops the count processing.
- (19)
- The photodetection device according to (17), in which the detector includes a third counter that measures time from when the stop processor stops the count processing to a subsequent predetermined timing.
- (20)
- The photodetection device according to (17), further including a code generator that generates a time code, in which
-
- the detector includes a latch circuit that latches the time code at a timing at which the stop processor stops the count processing.
(21)
- the detector includes a latch circuit that latches the time code at a timing at which the stop processor stops the count processing.
- The photodetection device according to any one of (17) to (20), further including a third processor that corrects count values of the plurality of first counters on the basis of a count value of the second counter and the stop timing.
- (22)
- The photodetection device according to any one of (1) to (21), in which
-
- a divider is provided,
- the one or more light-receiving sections include one light-receiving section,
- the divider distributes the pulse signal generated by the light-receiving section to the plurality of first counters in a time division manner, and
- each of the plurality of first counters performs the count processing on the basis of a distributed signal.
(23)
- The photodetection device according to any one of (1) to (21), in which
-
- an adder and a divider are provided,
- the one or more light-receiving sections include a plurality of light-receiving sections,
- the adder generates an addition pulse signal by performing addition processing on the basis of a plurality of the pulse signals generated by the plurality of light-receiving sections,
- the divider distributes the addition pulse signal to the plurality of first counters in a time division manner, and
- the plurality of first counters performs the count processing on the basis of a distributed signal.
(24)
- The photodetection device according to any one of (1) to (21), in which
-
- the one or more light-receiving sections include a plurality of light-receiving sections provided corresponding to the plurality of first counters, and
- each of the plurality of first counters performs the count processing on the basis of the pulse signal generated by a corresponding light-receiving section of the plurality of light-receiving sections.
(25)
- The photodetection device according to any one of (1) to (24), in which
-
- a plurality of photodetection units is provided, the plurality of photodetection units being arranged side by side in a first direction and a second direction, and
- each of the plurality of photodetection units includes the one or plurality of light-receiving sections, the plurality of first counters, and the subtraction processor.
(26)
- The photodetection device according to any one of (1) to (25), in which
-
- the one or plurality of light-receiving sections each includes a pulse generation circuit that is coupled to the light-receiving element and generates the pulse signal,
- the light-receiving element is provided on a first semiconductor substrate, and
- the pulse generation circuit is provided on a second semiconductor substrate bonded to the first semiconductor substrate.
(27)
- A photodetection device including:
-
- one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element;
- a plurality of first counters that each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values;
- a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold; and
- a threshold setting section that makes a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
(28)
- The photodetection device according to (27), in which the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
- (29)
- The photodetection device according to (28), in which the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
- (30)
- The photodetection device according to (27), in which the threshold setting section makes a change to increase the first threshold on the basis of the count values of one or more predetermined first counters of the plurality of first counters.
- (31)
- The photodetection device according to any one of (27) to (30), further including a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
- (32)
- The photodetection device according to any one of (27) to (31), in which
-
- a divider is provided,
- the one or more light-receiving sections include one light-receiving section,
- the divider distributes the pulse signal generated by the light-receiving section to the plurality of first counters in a time division manner, and
- each of the plurality of first counters performs the count processing on the basis of a distributed signal.
(33)
- The photodetection device according to any one of (27) to (31), in which
-
- an adder and a divider are provided,
- the one or more light-receiving sections include a plurality of light-receiving sections,
- the adder generates an addition pulse signal by performing addition processing on the basis of a plurality of the pulse signals generated by the plurality of light-receiving sections,
- the divider distributes the addition pulse signal to the plurality of first counters in a time division manner, and
- the plurality of first counters performs the count processing on the basis of a distributed signal.
(34)
- The photodetection device according to any one of (27) to (31), in which
-
- the one or more light-receiving sections include a plurality of light-receiving sections provided corresponding to the plurality of first counters, and
- each of the plurality of first counters performs the count processing on the basis of the pulse signal generated by a corresponding light-receiving section of the plurality of light-receiving sections.
(35)
- The photodetection device according to any one of (27) to (34), in which
-
- a plurality of photodetection units is provided, the plurality of photodetection units being arranged side by side in a first direction and a second direction, and
- each of the plurality of photodetection units includes the one or plurality of light-receiving sections, the plurality of first counters, the stop processor, and the threshold setting section.
(36)
- The photodetection device according to any one of (27) to (35), in which
-
- the one or plurality of light-receiving sections each includes a pulse generation circuit that is coupled to the light-receiving element and generates the pulse signal,
- the light-receiving element is provided on a first semiconductor substrate, and
- the pulse generation circuit is provided on a second semiconductor substrate bonded to the first semiconductor substrate.
(37)
- A photodetection system including:
-
- a light-emitting section that emits light; and
- a light-emitting section that emits light; and
- a photodetector that detects light reflected by a detection object of the light emitted from the light-emitting section, in which
- the photodetector includes
- one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element,
- a plurality of first counters that each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values, and
- a subtraction processor that performs subtraction processing for subtracting a predetermined value from each of the plurality of count values, on the basis of one or more count values of the plurality of count values.
(38)
- A photodetection system including:
-
- a light-emitting section that emits light; and
- a photodetector that detects light reflected by a detection object of the light emitted from the light-emitting section, in which
- the photodetector includes
- one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element,
- a plurality of first counters that each performs count processing on the basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values,
- a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold, and
- a threshold setting section that makes a change to increase the first threshold on the basis of one or more count values of the plurality of count values.
- This application claims the priority on the basis of Japanese Patent Application No. 2020-202130 filed on Dec. 4, 2020 with Japan Patent Office, the entire contents of which are incorporated in this application by reference.
- It should be understood by those skilled in the art that various modifications, combinations, sub-combinations, and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Claims (38)
1. A photodetection device comprising:
one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element;
a plurality of first counters that each performs count processing on a basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values; and
a subtraction processor that performs subtraction processing for subtracting a predetermined value from each of the plurality of count values, on a basis of one or more count values of the plurality of count values.
2. The photodetection device according to claim 1 , further comprising a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold.
3. The photodetection device according to claim 2 , wherein the subtraction processor performs the subtracting processing in a case where all of the plurality of count values have reached a second threshold.
4. The photodetection device according to claim 2 , wherein the subtraction processor performs the subtraction processing in a case where a smallest value among the plurality of count values has reached a second threshold.
5. The photodetection device according to claim 2 , wherein the subtraction processor performs the subtraction processing on a basis of the count values of one or more predetermined first counters of the plurality of first counters.
6. The photodetection device according to claim 2 , wherein the subtraction processor performs the subtraction processing by changing a bit value of a predetermined count bit of a plurality of count bits in each of the plurality of first counters.
7. The photodetection device according to claim 6 , wherein the predetermined count bit comprises a most significant bit of the plurality of count bits.
8. The photodetection device according to claim 2 , wherein the subtraction processor performs the subtraction processing in a period in which each of the plurality of first counters does not perform the count processing.
9. The photodetection device according to claim 2 , wherein the first threshold comprises a largest possible count value taken by the plurality of count values.
10. The photodetection device according to claim 2 , further comprising a threshold setting section that makes a change to increase the first threshold, on a basis of one or more count values of the plurality of count values, wherein
the threshold setting section makes a change to increase the first threshold in a case where the first threshold has not reached a predetermined threshold, and
the subtraction processor performs the subtraction processing in a case where the first threshold has reached the predetermined threshold.
11. The photodetection device according to claim 10 , wherein the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
12. The photodetection device according to claim 11 , wherein the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
13. The photodetection device according to claim 10 , wherein the threshold setting section makes a change to increase the first threshold on a basis of the count values of one or more predetermined counters of the plurality of first counters.
14. The photodetection device according to claim 2 , further comprising a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
15. The photodetection device according to claim 2 , further comprising a second counter that counts number of times the subtraction processing has been performed.
16. The photodetection device according to claim 15 , further comprising a second processor that calculates a photodetection timing on a basis of the plurality of count values after the stop processor stops the count processing in the plurality of first counters, and corrects the photodetection timing on a basis of a count value of the second counter.
17. The photodetection device according to claim 15 , further comprising a detector that detects a stop timing at which the stop processor stops the count processing in the plurality of first counters.
18. The photodetection device according to claim 17 , wherein the detector includes a third counter that measures time from when the plurality of first counters starts the count processing to when the stop processor stops the count processing.
19. The photodetection device according to claim 17 , wherein the detector includes a third counter that measures time from when the stop processor stops the count processing to a subsequent predetermined timing.
20. The photodetection device according to claim 17 , further comprising a code generator that generates a time code, wherein
the detector includes a latch circuit that latches the time code at a timing at which the stop processor stops the count processing.
21. The photodetection device according to claim 17 , further comprising a third processor that corrects count values of the plurality of first counters on a basis of a count value of the second counter and the stop timing.
22. The photodetection device according to claim 1 , wherein
a divider is provided,
the one or more light-receiving sections include one light-receiving section,
the divider distributes the pulse signal generated by the light-receiving section to the plurality of first counters in a time division manner, and
each of the plurality of first counters performs the count processing on a basis of a distributed signal.
23. The photodetection device according to claim 1 , wherein
an adder and a divider are provided,
the one or more light-receiving sections include a plurality of light-receiving sections,
the adder generates an addition pulse signal by performing addition processing on a basis of a plurality of the pulse signals generated by the plurality of light-receiving sections,
the divider distributes the addition pulse signal to the plurality of first counters in a time division manner, and
the plurality of first counters performs the count processing on a basis of a distributed signal.
24. The photodetection device according to claim 1 , wherein
the one or more light-receiving sections include a plurality of light-receiving sections provided corresponding to the plurality of first counters, and
each of the plurality of first counters performs the count processing on a basis of the pulse signal generated by a corresponding light-receiving section of the plurality of light-receiving sections.
25. The photodetection device according to claim 1 , wherein
a plurality of photodetection units is provided, the plurality of photodetection units being arranged side by side in a first direction and a second direction, and
each of the plurality of photodetection units includes the one or plurality of light-receiving sections, the plurality of first counters, and the subtraction processor.
26. The photodetection device according to claim 1 , wherein
the one or plurality of light-receiving sections each includes a pulse generation circuit that is coupled to the light-receiving element and generates the pulse signal,
the light-receiving element is provided on a first semiconductor substrate, and
the pulse generation circuit is provided on a second semiconductor substrate bonded to the first semiconductor substrate.
27. A photodetection device comprising:
one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element;
a plurality of first counters that each performs count processing on a basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values;
a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold; and
a threshold setting section that makes a change to increase the first threshold on a basis of one or more count values of the plurality of count values.
28. The photodetection device according to claim 27 , wherein the threshold setting section makes a change to increase the first threshold in a case where all of the plurality of count values have reached a second threshold.
29. The photodetection device according to claim 28 , wherein the threshold setting section further makes a change to increase the second threshold in a case where all of the plurality of count values have reached the second threshold.
30. The photodetection device according to claim 27 , wherein the threshold setting section makes a change to increase the first threshold on a basis of the count values of one or more predetermined first counters of the plurality of first counters.
31. The photodetection device according to claim 27 , further comprising a first processor that subtracts a smallest value among the plurality of count values from the plurality of count values after the stop processor stops the count processing in the plurality of first counters.
32. The photodetection device according to claim 27 , wherein
a divider is provided,
the one or more light-receiving sections include one light-receiving section,
the divider distributes the pulse signal generated by the light-receiving section to the plurality of first counters in a time division manner, and
each of the plurality of first counters performs the count processing on a basis of a distributed signal.
33. The photodetection device according to claim 27 , wherein
an adder and a divider are provided,
the one or more light-receiving sections include a plurality of light-receiving sections,
the adder generates an addition pulse signal by performing addition processing on a basis of a plurality of the pulse signals generated by the plurality of light-receiving sections,
the divider distributes the addition pulse signal to the plurality of first counters in a time division manner, and
the plurality of first counters performs the count processing on a basis of a distributed signal.
34. The photodetection device according to claim 27 , wherein
the one or more light-receiving sections include a plurality of light-receiving sections provided corresponding to the plurality of first counters, and
each of the plurality of first counters performs the count processing on a basis of the pulse signal generated by a corresponding light-receiving section of the plurality of light-receiving sections.
35. The photodetection device according to claim 27 , wherein
a plurality of photodetection units is provided, the plurality of photodetection units being arranged side by side in a first direction and a second direction, and
each of the plurality of photodetection units includes the one or plurality of light-receiving sections, the plurality of first counters, the stop processor, and the threshold setting section.
36. The photodetection device according to claim 27 , wherein
the one or plurality of light-receiving sections each includes a pulse generation circuit that is coupled to the light-receiving element and generates the pulse signal,
the light-receiving element is provided on a first semiconductor substrate, and
the pulse generation circuit is provided on a second semiconductor substrate bonded to the first semiconductor substrate.
37. A photodetection system comprising:
a light-emitting section that emits light; and
a photodetector that detects light reflected by a detection object of the light emitted from the light-emitting section, wherein
the photodetector includes
one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element,
a plurality of first counters that each performs count processing on a basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values, and
a subtraction processor that performs subtraction processing for subtracting a predetermined value from each of the plurality of count values, on a basis of one or more count values of the plurality of count values.
38. A photodetection system comprising:
a light-emitting section that emits light; and
a photodetector that detects light reflected by a detection object of the light emitted from the light-emitting section, wherein
the photodetector includes
one or a plurality of light-receiving sections that each includes a light-receiving element, and generates a pulse signal including a pulse corresponding to a result of light reception by the light-receiving element,
a plurality of first counters that each performs count processing on a basis of one or a plurality of the pulse signals generated by the one or plurality of light-receiving sections, thereby generating a plurality of count values,
a stop processor that stops the count processing in the plurality of first counters in a case where one or more count values of the plurality of count values have reached a first threshold, and
a threshold setting section that makes a change to increase the first threshold on a basis of one or more count values of the plurality of count values.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2020-202130 | 2020-12-04 | ||
| JP2020202130A JP2022089606A (en) | 2020-12-04 | 2020-12-04 | Light detection device and light detection system |
| PCT/JP2021/038568 WO2022118552A1 (en) | 2020-12-04 | 2021-10-19 | Light detection device and light detection system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20240302504A1 true US20240302504A1 (en) | 2024-09-12 |
Family
ID=81853879
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/254,707 Pending US20240302504A1 (en) | 2020-12-04 | 2021-10-19 | Photodetection device and photodetection system |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20240302504A1 (en) |
| JP (1) | JP2022089606A (en) |
| WO (1) | WO2022118552A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2024129220A (en) * | 2023-03-13 | 2024-09-27 | ソニーセミコンダクタソリューションズ株式会社 | Photodetector |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6443132B2 (en) * | 2015-03-03 | 2018-12-26 | 株式会社デンソー | Arithmetic unit |
| WO2018211801A1 (en) * | 2017-05-19 | 2018-11-22 | シャープ株式会社 | Optical sensor and electronic device |
| JP2020085815A (en) * | 2018-11-30 | 2020-06-04 | ソニーセミコンダクタソリューションズ株式会社 | Time measurement device |
| JP2020139810A (en) * | 2019-02-27 | 2020-09-03 | ソニーセミコンダクタソリューションズ株式会社 | Measuring device and range finder |
| JP2020187042A (en) * | 2019-05-16 | 2020-11-19 | 株式会社デンソー | Optical distance measurement device |
-
2020
- 2020-12-04 JP JP2020202130A patent/JP2022089606A/en active Pending
-
2021
- 2021-10-19 WO PCT/JP2021/038568 patent/WO2022118552A1/en not_active Ceased
- 2021-10-19 US US18/254,707 patent/US20240302504A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022118552A1 (en) | 2022-06-09 |
| JP2022089606A (en) | 2022-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12332385B2 (en) | Time measurement device and time measurement unit | |
| US12107174B2 (en) | Light detecting device and system | |
| CN212321848U (en) | Light detection device and distance measurement sensor | |
| US12164029B2 (en) | Time measurement device and time measurement apparatus | |
| US20230408692A1 (en) | Distance measuring sensor and distance measuring system | |
| US20220345652A1 (en) | Solid-state imaging element and electronic device | |
| CN114502977B (en) | Light receiving device, distance measuring device and light receiving circuit | |
| US20250003746A1 (en) | Photodetection device and photodetection system | |
| US20240302504A1 (en) | Photodetection device and photodetection system | |
| US20240056700A1 (en) | Photodetection device and photodetection system | |
| US20240111033A1 (en) | Photodetection device and photodetection system | |
| US20250040269A1 (en) | Photodetection device and distance measuring system | |
| US20230228875A1 (en) | Solid-state imaging element, sensing system, and control method of solid-state imaging element | |
| US20230112018A1 (en) | Solid-state imaging element and electronic device | |
| US20240255622A1 (en) | Photodetector, photodetection system, and photodetection method | |
| US20230417921A1 (en) | Photodetection device and photodetection system | |
| US20250004111A1 (en) | Light detection element | |
| WO2025187718A1 (en) | Light detection device and electronic apparatus | |
| TWI893115B (en) | Light detection circuit and ranging device | |
| US20250097606A1 (en) | Signal generation circuit and photodetection apparatus | |
| US20230204770A1 (en) | Ranging device and ranging system | |
| EP4502659A1 (en) | Range-finding device and range-finding method | |
| WO2025204246A1 (en) | Light detection device and light detection system | |
| WO2023145261A1 (en) | Distance measurement device and control method for distance measurement device | |
| WO2025177720A1 (en) | Light detection device and light detection system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: SONY SEMICONDUCTOR SOLUTIONS CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKATSUKA, TAKAFUMI;IKEDA, YASUJI;OIKE, YUSUKE;SIGNING DATES FROM 20230407 TO 20230427;REEL/FRAME:063774/0556 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |