CN113301280B - Pixel circuit of photosensitive block, image processing method and device and electronic equipment - Google Patents
Pixel circuit of photosensitive block, image processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN113301280B CN113301280B CN202110552874.8A CN202110552874A CN113301280B CN 113301280 B CN113301280 B CN 113301280B CN 202110552874 A CN202110552874 A CN 202110552874A CN 113301280 B CN113301280 B CN 113301280B
- Authority
- CN
- China
- Prior art keywords
- pixel
- charge storage
- electrically connected
- storage device
- pixel circuit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/59—Control of the dynamic range by controlling the amount of charge storable in the pixel, e.g. modification of the charge conversion ratio of the floating node capacitance
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
技术领域technical field
本申请涉及图像处理技术领域,具体而言,本申请涉及一种感光块的像素电路、图像处理方法、装置及电子设备。The present application relates to the technical field of image processing, and in particular, the present application relates to a pixel circuit of a photosensitive block, an image processing method, device and electronic equipment.
背景技术Background technique
摄像机Camera可以替代人眼去获取人无法到达的地方,是人视觉的延伸。Camera端获取信息到显示display端显示会有很大的时延行,这种端到端的延时与人眼获取信息的特性相差较大。The camera can replace the human eye to obtain places that people cannot reach, and is an extension of human vision. There will be a long time delay between obtaining information on the camera side and displaying it on the display side. This end-to-end delay is quite different from the characteristics of human eyes to obtain information.
目前,camera端到display端会出现显示延迟的问题,使得显示效果差,降低用户体验。At present, there will be a display delay problem from the camera end to the display end, which makes the display effect poor and reduces the user experience.
发明内容Contents of the invention
本申请针对现有方式的缺点,提出一种感光块的像素电路、图像处理方法、装置及电子设备,用以解决现有技术存在的显示延迟带来的显示效果差的技术问题。Aiming at the shortcomings of the existing methods, the present application proposes a pixel circuit of a photosensitive block, an image processing method, device and electronic equipment to solve the technical problem of poor display effect caused by display delay in the prior art.
第一方面,本申请实施例提供一种感光块的像素电路,包括:至少三个像素单元和至少一个电荷存储器件;In a first aspect, an embodiment of the present application provides a pixel circuit of a photosensitive block, including: at least three pixel units and at least one charge storage device;
每个像素单元均包括一个光电二极管,用于将光信号转换为电信号;Each pixel unit includes a photodiode for converting light signals into electrical signals;
至少两个像素单元的光电二极管与同一个电荷存储器件电连接,用于对电荷存储器件充电,得到感光块的像素信息。The photodiodes of at least two pixel units are electrically connected to the same charge storage device for charging the charge storage device to obtain pixel information of the photosensitive block.
在一个可能的实现方式中,像素电路包括一个电荷存储器件;In a possible implementation, the pixel circuit includes a charge storage device;
光电二极管均与同一个电荷存储器件电连接。The photodiodes are all electrically connected to the same charge storage device.
在一个可能的实现方式中,每个像素单元都设有一个预设颜色的彩色滤光层;预设颜色包括第一颜色、第二颜色和第三颜色;In a possible implementation, each pixel unit is provided with a color filter layer of a preset color; the preset color includes a first color, a second color and a third color;
预设颜色的彩色滤光层中,有两种颜色的彩色滤光层数量相同。Among the color filter layers of preset colors, the number of color filter layers of two colors is the same.
在一个可能的实现方式中,像素电路包括三个电荷存储器件;In a possible implementation, the pixel circuit includes three charge storage devices;
同一颜色的彩色滤光层对应的光电二极管与同一个电荷存储器件电连接。The photodiodes corresponding to the color filter layers of the same color are electrically connected to the same charge storage device.
在一个可能的实现方式中,像素电路还包括:至少三个第一开关器件;In a possible implementation manner, the pixel circuit further includes: at least three first switching devices;
第一开关器件的第一端均对应与一个光电二极管电连接,第一开关器件的第二端均与电荷存储器件的第一端电连接,第一开关器件的控制端均与同一数据信号线电连接;The first ends of the first switching devices are electrically connected to a photodiode, the second ends of the first switching devices are electrically connected to the first ends of the charge storage device, and the control ends of the first switching devices are connected to the same data signal line. electrical connection;
电荷存储器件的第二端接地。The second terminal of the charge storage device is grounded.
在一个可能的实现方式中,像素电路还包括:至少一个第二开关器件;In a possible implementation manner, the pixel circuit further includes: at least one second switching device;
每行像素单元均与一个第一栅极信号线电连接;Each row of pixel units is electrically connected to a first gate signal line;
至少一个第二开关器件依次排列,第一个第二开关器件的第一端与第一电压端电连接,前一个第二开关器件的第二端与后一个第二开关器件的第一端电连接且连接节点对应与一个第一栅极信号线电连接,最后一个第二开关器件的第二端与最后一行像素单元对应的第一栅极信号线电连接;At least one second switching device is arranged in sequence, the first terminal of the first second switching device is electrically connected to the first voltage terminal, and the second terminal of the previous second switching device is electrically connected to the first terminal of the subsequent second switching device. connected and the connection node is electrically connected to a first gate signal line, and the second end of the last second switching device is electrically connected to the first gate signal line corresponding to the last row of pixel units;
第二开关器件的控制端均与同一个第二栅极信号线电连接。The control ends of the second switching devices are all electrically connected to the same second gate signal line.
第二方面,本申请实施例提供一种图像处理方法,包括:In a second aspect, an embodiment of the present application provides an image processing method, including:
在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式;分块扫描方式采用如第一方面的感光块的像素电路;When it is detected that the speed of the moving target in the image area is greater than the preset speed threshold, the first scanning mode is switched to a block scanning mode; the block scanning mode adopts the pixel circuit of the photosensitive block as in the first aspect;
依次控制每个感光块的至少两个像素单元的光电二极管向同一个电荷存储器件充电,得到图像区域的像素信息。The photodiodes of at least two pixel units of each photosensitive block are sequentially controlled to charge the same charge storage device to obtain pixel information of the image area.
在一个可能的实现方式中,第一扫描方式采用逐行扫描的方式。In a possible implementation manner, the first scanning manner adopts a progressive scanning manner.
第三方面,本申请实施例提供一种图像处理装置,包括:In a third aspect, the embodiment of the present application provides an image processing device, including:
第一控制模块,用于在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式;分块扫描方式采用第一方面的感光块的像素电路;The first control module is configured to switch the first scanning mode to a block scanning mode when it is detected that the speed of the moving target in the image area is greater than a preset speed threshold; the block scanning mode adopts the pixel circuit of the photosensitive block in the first aspect;
第二控制模块,用于依次控制每个感光块的至少两个像素单元的光电二极管向同一个电荷存储器件充电,得到图像区域的像素信息。The second control module is used to sequentially control the photodiodes of at least two pixel units of each photosensitive block to charge the same charge storage device to obtain pixel information of the image area.
第四方面,本申请实施例提供一种电子设备,包括:检测单元、控制单元和第一方面的像素电路;In a fourth aspect, an embodiment of the present application provides an electronic device, including: a detection unit, a control unit, and the pixel circuit of the first aspect;
检测单元,与控制单元电连接,用于检测图像区域的移动目标速度,并将移动目标速度发送给控制单元;The detection unit is electrically connected with the control unit, and is used for detecting the speed of the moving object in the image area, and sending the speed of the moving object to the control unit;
控制单元,用于在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式,依次控制每个感光块的至少两个像素单元的光电二极管向同一个电容充电,得到图像区域的像素信息。The control unit is configured to switch the first scanning mode to a block scanning mode when it is detected that the speed of the moving target in the image area is greater than the preset speed threshold, and sequentially control the photodiodes of at least two pixel units of each photosensitive block to A capacitor is charged to obtain the pixel information of the image area.
第五方面,本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,存储有计算机程序,计算机程序被电子设备执行时实现如第二方面的图像处理方法。In the fifth aspect, the embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program is stored, and when the computer program is executed by an electronic device, the image processing method according to the second aspect is implemented.
本申请实施例提供的技术方案带来的有益技术效果包括:The beneficial technical effects brought by the technical solutions provided by the embodiments of the present application include:
本申请实施例在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式,依次控制每个感光块的至少两个像素单元的光电二极管向同一个电荷存储器件充电,从而缩短了电荷存储器件的充电时间,使得曝光积分的时间也大大减小,提高图像成像和传输速度,避免了显示延迟带来的显示效果差的技术问题,提高了用户体验。In the embodiment of the present application, when the speed of the moving target in the image area is detected to be greater than the preset speed threshold, the first scanning mode is switched to the block scanning mode, and the photodiodes of at least two pixel units of each photosensitive block are sequentially controlled to move to the same The charge storage device is charged, thereby shortening the charging time of the charge storage device, greatly reducing the time of exposure integration, improving image imaging and transmission speed, avoiding the technical problem of poor display effect caused by display delay, and improving user experience .
本申请附加的方面和优点将在下面的描述中部分给出,这些将从下面的描述中变得明显,或通过本申请的实践了解到。Additional aspects and advantages of the application will be set forth in part in the description which follows, and will become apparent from the description, or may be learned by practice of the application.
附图说明Description of drawings
本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present application will become apparent and easy to understand from the following description of the embodiments in conjunction with the accompanying drawings, wherein:
图1为本申请实施例提供的一种图像处理方法的流程图;FIG. 1 is a flow chart of an image processing method provided in an embodiment of the present application;
图2为本申请实施例提供的一种图像处理装置的结构示意图;FIG. 2 is a schematic structural diagram of an image processing device provided in an embodiment of the present application;
图3为本申请实施例提供的一种电子设备的结构示意图;FIG. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
图4为本申请实施例提供的一种感光块的像素电路的结构示意图;FIG. 4 is a schematic structural diagram of a pixel circuit of a photosensitive block provided in an embodiment of the present application;
图5为本申请实施例提供的一种感光块的像素电路的像素单元的排列示意图;FIG. 5 is a schematic diagram of arrangement of pixel units of a pixel circuit of a photosensitive block provided in an embodiment of the present application;
图6为本申请实施例提供另一种与图5的像素单元排列对应的感光块的像素电路的结构示意图。FIG. 6 is a schematic structural diagram of another pixel circuit of a photosensitive block corresponding to the arrangement of pixel units in FIG. 5 according to an embodiment of the present application.
具体实施方式Detailed ways
下面详细描述本申请,本申请的实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的部件或具有相同或类似功能的部件。此外,如果已知技术的详细描述对于示出的本申请的特征是不必要的,则将其省略。下面通过参考附图描述的实施例是示例性的,仅用于解释本申请,而不能解释为对本申请的限制。The present application is described in detail below, and examples of embodiments of the present application are shown in the drawings, wherein the same or similar reference numerals denote the same or similar components or components having the same or similar functions throughout. Also, detailed descriptions of known technologies will be omitted if they are not necessary to illustrate the features of the present application. The embodiments described below by referring to the figures are exemplary only for explaining the present application, and are not construed as limiting the present application.
本技术领域技术人员可以理解,除非另外定义,这里使用的所有术语(包括技术术语和科学术语),具有与本申请所属领域中的普通技术人员的一般理解相同的意义。还应该理解的是,诸如通用字典中定义的那些术语,应该被理解为具有与现有技术的上下文中的意义一致的意义,并且除非像这里一样被特定定义,否则不会用理想化或过于正式的含义来解释。Those skilled in the art can understand that, unless otherwise defined, all terms (including technical terms and scientific terms) used herein have the same meanings as commonly understood by those of ordinary skill in the art to which this application belongs. It should also be understood that terms, such as those defined in commonly used dictionaries, should be understood to have meanings consistent with their meaning in the context of the prior art, and unless specifically defined as herein, are not intended to be idealized or overly Formal meaning to explain.
本技术领域技术人员可以理解,除非特意声明,这里使用的单数形式“一”、“一个”、“所述”和“该”也可包括复数形式。应该进一步理解的是,本申请的说明书中使用的措辞“包括”是指存在所述特征、整数、步骤、操作、元件和/或组件,但是并不排除存在或添加一个或多个其他特征、整数、步骤、操作、元件、组件和/或它们的组。应该理解,当我们称元件被“连接”或“耦接”到另一元件时,它可以直接连接或耦接到其他元件,或者也可以存在中间元件。此外,这里使用的“连接”或“耦接”可以包括无线连接或无线耦接。这里使用的措辞“和/或”包括一个或更多个相关联的列出项的全部或任一单元和全部组合。Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and/or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Additionally, "connected" or "coupled" as used herein may include wireless connection or wireless coupling. The expression "and/or" used herein includes all or any elements and all combinations of one or more associated listed items.
本申请的发明人进行研究发现,传感器Sensor是摄像头的核心,负责将通过Lens的光信号转换为电信号,再经过内部AD(数模转换)转换为数字信号。Camera Sensor有两种像素阵列,一种是RGB阵列,另外一种是拜耳阵列(Bayer pattern),目前市场使用比较多的是拜耳阵列。The inventor of the present application conducted research and found that the sensor is the core of the camera, responsible for converting the optical signal passing through the Lens into an electrical signal, and then converting it into a digital signal through an internal AD (digital-to-analog conversion). Camera Sensor has two kinds of pixel arrays, one is RGB array, and the other is Bayer array (Bayer pattern). Currently, Bayer array is more widely used in the market.
RGB(Red、Green、Blue,红、绿、蓝)阵列,即每个像素上都加入不同颜色的滤镜以滤出RGB三个通道的颜色。RGB (Red, Green, Blue, red, green, blue) array, that is, filters of different colors are added to each pixel to filter out the colors of the three channels of RGB.
拜耳阵列(Bayer pattern),用来解决由于在每个像素上都加入不同颜色的滤镜滤出RGB三个通道的颜色成本太高问题。拜耳阵列的每个像素上并没有放置三色滤镜,而是在每个像素之间有间隔的放置单一颜色的滤镜。每个通道得到一个部分空缺的图片,这种空缺值可以通过各种插值手段进行填充。三个通道有序排列,例如:bayer阵列是2x2的小格子重复排列而成,因为人眼视觉对绿色比较敏感,四个格子中有1个R,1个B,2个G。按照理想情况,每个像素应该有三个色值,而实际上R和B只有1/4,G只有1/2,因此bayer pattern获得的图像只有1/3内容是真实的,其它都是插值获取,这也说明自然图像有大量冗余信息。The Bayer pattern is used to solve the problem that the color cost of the three channels of RGB is too high due to the addition of filters of different colors to each pixel. There is no three-color filter placed on each pixel of the Bayer array, but a single-color filter is placed at intervals between each pixel. Each channel gets a partially vacant picture, and this vacant value can be filled by various interpolation methods. The three channels are arranged in an orderly manner. For example, the bayer array is composed of repeated arrangements of 2x2 small grids, because human vision is more sensitive to green. There are 1 R, 1 B, and 2 G in the four grids. Ideally, each pixel should have three color values, but in fact R and B are only 1/4, and G is only 1/2. Therefore, only 1/3 of the image obtained by bayer pattern is real, and the rest are obtained by interpolation. , which also shows that natural images have a lot of redundant information.
本申请的发明人进一步研究发现,Camera可以替代人眼去获取人无法到达的地方,是人视觉的延伸,当前市场中,camera端获取信息到display端显示会有很大的时延行,这种端到端的延时与人眼获取信息的特性相差较大,需要一种新的技术方案来降低这种端到端的延时,以满足人眼需求。The inventors of the present application have further researched and found that the camera can replace the human eye to obtain places that people cannot reach, and is an extension of human vision. In the current market, there will be a large delay in obtaining information from the camera terminal to displaying it on the display terminal. This end-to-end delay is quite different from the characteristics of human eyes to obtain information. A new technical solution is needed to reduce this end-to-end delay to meet the needs of human eyes.
本申请提供的一种感光块的像素电路、图像处理方法、装置及电子设备,旨在解决现有技术的如上技术问题。The present application provides a pixel circuit of a photosensitive block, an image processing method, device and electronic equipment, aiming to solve the above technical problems in the prior art.
下面以具体地实施例对本申请的技术方案以及本申请的技术方案如何解决上述技术问题进行详细说明。The technical solution of the present application and how the technical solution of the present application solves the above technical problems will be described in detail below with specific embodiments.
本申请实施例提供一种图像处理方法,参见图1所示,该图像处理方法包括:步骤S101至步骤S102。An embodiment of the present application provides an image processing method, as shown in FIG. 1 , the image processing method includes: step S101 to step S102.
S101、在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式;分块扫描方式采用本申请任一实施例的感光块的像素电路,感光块的像素电路的具体结构参见后续具体介绍。S101. When it is detected that the speed of the moving target in the image area is greater than the preset speed threshold, switch the first scanning mode to a block scanning mode; the block scanning mode adopts the pixel circuit of the photosensitive block in any embodiment of the present application, and the photosensitive block For the specific structure of the pixel circuit, please refer to the subsequent specific introduction.
可选地,本申请实施例在拍摄到高速移动物体时,sensor切换积分曝光,采用本申请实施例的分块扫描的方式进行图像处理。Optionally, in the embodiment of the present application, when a high-speed moving object is photographed, the sensor switches the integral exposure, and uses the block scanning method in the embodiment of the present application to perform image processing.
S102、依次控制每个感光块的至少两个像素单元的光电二极管10向同一个电荷存储器件20充电,得到图像区域的像素信息。感光块的像素电路的具体结构参见图4和图6所示。S102 , sequentially controlling the
可选地,依次控制每个感光块的至少两个像素单元的光电二极管10向同一个电荷存储器件20充电,对应得到各感光块的像素信息,从而得到整个图像区域的像素信息。Optionally, the
本申请实施例能够在图像区域的移动目标速度大于预设速度阈值时,将扫描方式切换为分块扫描方式,依次控制每个感光块的至少两个像素单元的光电二极管10向同一个电荷存储器件20充电,从而缩短了电荷存储器件20的充电时间,使得曝光积分的时间也大大减小,提高图像成像和传输速度,避免了显示延迟带来的显示效果差的技术问题,提高了用户体验。In the embodiment of the present application, when the speed of the moving object in the image area is greater than the preset speed threshold, the scanning mode can be switched to a block scanning mode, and the
本申请的发明人考虑到,sensor曝光扫描方式有两种,一种是滚动曝光扫描,一种是全局曝光。目前滚动曝光扫描是采用率比较高的一种曝光方式。The inventors of the present application consider that there are two sensor exposure scanning methods, one is rolling exposure scanning, and the other is global exposure. At present, rolling exposure scanning is an exposure method with a relatively high adoption rate.
滚动曝光扫描即逐行曝光逐行读出,sensor逐行曝光从第一行开始曝光,一个行周期结束之后第二行才开始曝光。依此类推,经过N-1行后第N行开始曝光。第一行曝光结束后开始读出数据,读出一行需要一行周期时间(含行消隐时间)。第一行完全读出后,第二行刚好开始读出,依此类推,当第N-1行读完后,第N行开始读出,直到整福图像完全读出。Rolling exposure scanning means row-by-row exposure and row-by-row readout, sensor row-by-row exposure starts from the first row, and the second row starts to expose after a row period ends. By analogy, after N-1 rows, the Nth row starts to be exposed. Data is read out after the exposure of the first row ends, and a row cycle time (including row blanking time) is required to read out one row. After the first row is completely read out, the second row just starts to be read out, and so on, when the N-1th row is read out, the Nth row starts to be read out until the entire image is completely read out.
全局曝光扫描即帧曝光扫描,Sensor的所有行同时开始曝光,并同时结束曝光,在曝光结束后,Sensor将所有电子从感光块转到存储区,之后逐行地读出像素数据。这样曝光的好处是获得图像每一行的曝光时间比较一致,并且在拍摄运动物体时图像不会出现偏移和歪斜。Global exposure scanning is frame exposure scanning. All rows of the Sensor start to expose at the same time and end the exposure at the same time. After the exposure is over, the Sensor transfers all electrons from the photosensitive block to the storage area, and then reads out the pixel data row by row. The advantage of such exposure is that the exposure time of each row of the image is relatively consistent, and the image will not shift and skew when shooting moving objects.
本申请的发明人进一步研究发现,滚动曝光扫描是目前采用率较高的一种曝光方式,它具有逐行扫描耗时长,图片成像有延时的特性。本申请实施例采用的分块扫描方式是把每帧图像中的像素单元按块打包之后再进行曝光扫描,该方式可以同时减少行扫描时间和行消隐时间,从而可以提升曝光时间和成像速度。The inventors of the present application have further researched and found that rolling exposure scanning is an exposure method with a relatively high adoption rate at present. It has the characteristics of long time-consuming progressive scanning and time-delay in image formation. The block-by-block scanning method used in the embodiment of the present application is to pack the pixel units in each frame of image into blocks and then perform exposure scanning. This method can reduce the line scanning time and line blanking time at the same time, thereby improving the exposure time and imaging speed. .
在一些实施例中,第一扫描方式采用逐行扫描的方式。In some embodiments, the first scanning method adopts a progressive scanning method.
可选地,逐行扫描的方式即现有的滚动曝光扫描的方式,也可以采用现有的其他正常曝光方式。Optionally, the progressive scanning method, that is, the existing rolling exposure scanning method, may also adopt other existing normal exposure methods.
本申请实施例的分块扫描方式,相比于现有的逐行扫描方式,减少了扫描行数节省了行扫描和行消隐时间。Compared with the existing progressive scanning method, the block-by-block scanning method in the embodiment of the present application reduces the number of scanning lines and saves time for line scanning and line blanking.
本申请实施例的分块扫描方式能够降低端到端的延时,能够让人第一时间获取外界信息,保证信息的实时性,在检测到图像区域的移动目标速度大于预设速度阈值的情况下,并根据人眼反应预设一个可接受的速度上限阈值,即保证超出该上限值时,对场景画面基本可以忽略。当头部快速转动时,检测到移动速度超出预设速度阈值时,自动切换曝光方式为分块扫描方式,人眼观察事物的特性是对定格画面的显示速度和画面清晰度要求比较高,当头部快速转动时不会特别关注周围场景。因此,分块扫描方式会降低场景分辨率,通过降低显示数据量来提升每帧的数据传输速度,从而降低传输延时问题。The block scanning method of the embodiment of the present application can reduce the end-to-end delay, enable people to obtain external information at the first time, and ensure the real-time performance of the information. When the speed of the moving target in the detected image area is greater than the preset speed threshold , and preset an acceptable speed upper limit threshold based on the human eye response, that is, to ensure that when the upper limit is exceeded, the scene picture can basically be ignored. When the head rotates rapidly and it is detected that the moving speed exceeds the preset speed threshold, the exposure mode is automatically switched to block scanning mode. The characteristic of human eyes observing things is that the display speed and picture clarity of the freeze-frame picture are relatively high. When the head is turned quickly, it does not pay special attention to the surrounding scene. Therefore, the block scanning method will reduce the resolution of the scene, and increase the data transmission speed of each frame by reducing the amount of display data, thereby reducing the problem of transmission delay.
基于同一发明构思,本申请实施例提供一种图像处理装置,参见图2所示,该图像处理装置200包括:第一控制模块210和第二控制模块220。Based on the same inventive concept, an embodiment of the present application provides an image processing device, as shown in FIG. 2 , the
第一控制模块210,用于在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式;分块扫描方式采用本申请任一实施例的感光块的像素电路。The
第二控制模块220,用于依次控制每个感光块的至少两个像素单元的光电二极管10向同一个电荷存储器件20充电,得到图像区域的像素信息。The
可选地,第一扫描方式采用逐行扫描的方式。Optionally, the first scanning mode adopts a progressive scanning mode.
基于同一发明构思,本申请实施例提供一种电子设备,参见图3所示,该电子设备300包括:检测单元310、控制单元320和本申请任一实施例的感光块的像素电路330。Based on the same inventive concept, an embodiment of the present application provides an electronic device, as shown in FIG. 3 , the
检测单元310与控制单元320电连接,用于检测图像区域的移动目标速度并将移动目标速度发送给控制单元320。The
控制单元320用于在检测到图像区域的移动目标速度大于预设速度阈值时,将第一扫描方式切换为分块扫描方式,依次控制每个感光块的至少两个像素单元的光电二极管10向同一个电容充电,得到图像区域的像素信息。The
可选地,检测单元310包括传感器,用于检测图像区域的移动目标速度。Optionally, the
可选地,电子设备300可以为AR(Augmented Reality,增强现实)眼镜,当人带着AR眼镜快速转动时,就需要本申请实施例的图像处理方法,提高显示效果和用户体验。Optionally, the
本申请实施例提供一种感光块的像素电路,包括:至少三个像素单元和至少一个电荷存储器件20。An embodiment of the present application provides a pixel circuit of a photosensitive block, including: at least three pixel units and at least one
每个像素单元均包括一个光电二极管10,用于将光信号转换为电信号。Each pixel unit includes a
至少两个像素单元的光电二极管10与同一个电荷存储器件20电连接,用于对电荷存储器件20充电,得到感光块的像素信息。The
本申请实施例是对目前图像sensor的两种像素阵列,即RGB像素阵列和Bayer阵列,对应给出了分块曝光扫描方式的两种像素阵列的感光块的像素电路。The embodiment of the present application is for two kinds of pixel arrays of the current image sensor, ie, RGB pixel array and Bayer array, corresponding to the pixel circuits of the photosensitive blocks of the two pixel arrays in the block-by-block exposure scanning mode.
在一些实施例中,参见图4所示,像素电路包括一个电荷存储器件20;光电二极管10均与同一个电荷存储器件20电连接。In some embodiments, as shown in FIG. 4 , the pixel circuit includes a
参见图4所示,电荷存储器件20为第一电容C1,9个光电二极管10均与第一电容C1电连接,向第一电容C1充电,从而缩短了充电时间,曝光积分的时间也大大减小,提高图像成像和传输速度。相比于现有技术的RGB像素阵列中每个光电二极管10单独由一个电容单元控制的方式,本申请实施例缩短了电容的充电时间,提高图像成像和传输速度。As shown in FIG. 4, the
可选地,每个感光块的像素电路也可以包括2个、4个、16个等数量的像素单元,所有像素单元连接的光电二极管10均与同一个电荷存储器件20电连接。Optionally, the pixel circuit of each photosensitive block may also include 2, 4, 16 and other pixel units, and the
在一些实施例中,参见图6所示,每个像素单元都设有一个预设颜色的彩色滤光层;预设颜色包括第一颜色、第二颜色和第三颜色。In some embodiments, as shown in FIG. 6 , each pixel unit is provided with a color filter layer of a preset color; the preset colors include a first color, a second color and a third color.
预设颜色的彩色滤光层中,有两种颜色的彩色滤光层数量相同。Among the color filter layers of preset colors, the number of color filter layers of two colors is the same.
可选地,第一颜色、第二颜色和第三颜色分别为R红、G绿和B蓝三种颜色,红色和蓝色的滤光层的数量相同,绿色的滤光层的数量大于红色和蓝色的滤光层。Optionally, the first color, the second color and the third color are three colors of R red, G green and B blue respectively, the number of red and blue filter layers is the same, and the number of green filter layers is greater than that of red and blue filter layer.
可选地,参见图5所示,第一颜色R和第三颜色B的数量为2个,第二颜色G的数量为4个。图6所示的像素单元的彩色滤光层的设置与图5的像素单元的排列相对应。Optionally, as shown in FIG. 5 , the number of the first color R and the third color B is 2, and the number of the second color G is 4. The arrangement of the color filter layers of the pixel units shown in FIG. 6 corresponds to the arrangement of the pixel units in FIG. 5 .
在一些实施例中,参见图6所示,像素电路包括三个电荷存储器件20。同一颜色的彩色滤光层对应的光电二极管10与同一个电荷存储器件20电连接。三个电荷存储器件20包括第二电容C2、第三电容C3和第四电容C4。In some embodiments, as shown in FIG. 6 , the pixel circuit includes three
在一些实施例中,结合图4和图6所示,像素电路还包括:至少三个第一开关器件30。本申请实施例共有9个第一开关器件30,并未全部标记出。In some embodiments, as shown in FIG. 4 and FIG. 6 , the pixel circuit further includes: at least three
第一开关器件30的第一端均对应与一个光电二极管10电连接,第一开关器件30的第二端均与电荷存储器件20的第一端电连接,第一开关器件30的控制端均与同一数据信号线dataA电连接。电荷存储器件20的第二端接地。The first terminals of the
在一些实施例中,结合图4和图6所示,像素电路还包括:至少一个第二开关器件40。本申请实施例共有3个第二开关器件40。In some embodiments, as shown in FIG. 4 and FIG. 6 , the pixel circuit further includes: at least one
每行像素单元均与一个第一栅极信号线gate电连接。Each row of pixel units is electrically connected to a first gate signal line gate.
至少一个第二开关器件40依次排列,第一个第二开关器件40的第一端与第一电压端电连接,前一个第二开关器件40的第二端与后一个第二开关器件40的第一端电连接且连接节点对应与一个第一栅极信号线gate电连接,最后一个第二开关器件40的第二端与最后一行像素单元对应的第一栅极信号线gate电连接。At least one
第二开关器件40的控制端均与同一个第二栅极信号线gateA电连接。The control terminals of the
可选地,第一开关器件30和第二开关器件40均为开关三极管。Optionally, both the
可选地,光电二极管10的阳极与第一栅极信号线gate电连接,光电二极管10的阴极与第一开关器件30的第一端电连接。Optionally, the anode of the
可选地,像素电路还包括:至少三个第三开关器件和至少三个第五电容。每个第三开关器件的第一端对应与一个光电二极管10电连接,每个第三开关器件的第二端对应与一个第五电容的第一端电连接,第五电容的第二端接地。第三开关器件的控制端连接控制信号线。第三开关器件为开关三极管。参见图4和图6所示,像素电路包括9个第三开关器件和9个第五电容。Optionally, the pixel circuit further includes: at least three third switching devices and at least three fifth capacitors. The first end of each third switching device is correspondingly electrically connected to a
作为一种示例,参见图4所示,本申请实施例将RGB像素阵列的3x3的感光块阵列作为一个基本单位,将3x3感光块的第一栅极信号线gate通过第二开关器件40相连,然后3x3的感光块阵列通过一根第二栅极信号线gateA控制3x3的感光块阵列同时打开。多个感光块组成的整体的像素电路中,每3x3的感光块阵列构成的单元内部又由九个第一开关器件30连接到一起,数据信号线dataA为一个,9个光电二极管10同时打开并将电荷集中向第一电容C1充电,完成光电转换。As an example, as shown in FIG. 4, the embodiment of the present application uses a 3x3 photosensitive block array of an RGB pixel array as a basic unit, and connects the first gate signal line gate of the 3x3 photosensitive block through a
作为一种示例,参见图6所示,本申请实施例将Bayer阵列的3x3的感光块阵列作为一个基本单位,像素单元的排列如图5所示,以9个像素单元为一个小整体,第一颜色R、第二颜色G和第三颜色B的彩色滤光层的像素单元分别互相连接,即9个像素单元中的第一颜色R对应的像素单元的光电二极管10给第三电容C3充电,第二颜色G对应的像素单元的光电二极管10给第二电容C2充电,第三颜色B对应的像素单元的光电二极管10给第四电容C4充电。As an example, as shown in FIG. 6, the embodiment of the present application uses the 3x3 photosensitive block array of the Bayer array as a basic unit, and the arrangement of pixel units is shown in FIG. 5, with 9 pixel units as a small whole, the first The pixel units of the color filter layers of the first color R, the second color G and the third color B are respectively connected to each other, that is, the
可选地,参见图6所示,第二颜色G对应的像素单元数量比第一颜色R和第三颜色B对应的像素单元数量多,所以display端在使用RGB数据时,将G进行二分处理,即取G的1/2值使用。Optionally, as shown in FIG. 6, the number of pixel units corresponding to the second color G is larger than the number of pixel units corresponding to the first color R and the third color B, so when the display end uses RGB data, it performs binary processing on G , that is, use the 1/2 value of G.
现有技术中,Bayer阵列得到一个像素单元只能感受第一颜色R、第二颜色G和第三颜色B中的一种,因此每个像素点中存放的数据是单色光,也就是原始数据Raw Data,该数据不能用于display端直接显示,需要ISP模块将Raw Data转换为RGB格式。In the prior art, a pixel unit obtained by the Bayer array can only perceive one of the first color R, the second color G, and the third color B, so the data stored in each pixel is monochromatic light, that is, the original Data Raw Data, this data cannot be directly displayed on the display side, and the ISP module is required to convert the Raw Data into RGB format.
本申请实施例的Bayer阵列中的9个像素为基本单位,该基本单位中所有的第一颜色R对应的光电二极管10会同时向一个第三电容C3积分电荷,这样积分时间会提升为原来的2倍,数据量变为原来的1/9。第二颜色G和第三颜色B对应的光电二极管10对第二电容C2和第四电容C4的充电方式同理。这样,每一个基本单位最终都会有R、G、B三个积分电容,最后形成一个大的RGB pixel,此RGB像素直接用作display端显示。也就是,本申请实施例的感光块的像素单元不需要将原始值送至ISP,由ISP根据单个感光点值周围的另外两种值,通过插值和特效处理等,计算出该感光点的其他色值,从而还原出RGB的步骤,可以直接得到RGB像素,直接用作display端显示,省去了ISP中转换显示格式的步骤,提高了图像成像速度,同时减少了充电时间,从而减少了camera到display端对端的显示延迟。The 9 pixels in the Bayer array of the embodiment of the present application are the basic unit, and all the
基于同一发明构思,本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,存储有计算机程序,计算机程序被电子设备执行时实现本申请任一实施例的图像处理方法。Based on the same inventive concept, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program is stored, and when the computer program is executed by an electronic device, the image processing method of any embodiment of the present application is implemented.
需要说明的是,本申请的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本申请中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本申请中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、RF(射频)等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable signal medium may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted by any appropriate medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
本申请实施例的计算机可读介质可以是包含在电子设备中;也可以是单独存在,而未装配入电子设备中。The computer-readable medium in the embodiment of the present application may be included in the electronic device, or may exist independently without being assembled in the electronic device.
本技术领域技术人员可以理解,本申请中已经讨论过的各种操作、方法、流程中的步骤、措施、方案可以被交替、更改、组合或删除。进一步地,具有本申请中已经讨论过的各种操作、方法、流程中的其他步骤、措施、方案也可以被交替、更改、重排、分解、组合或删除。进一步地,现有技术中的具有与本申请中公开的各种操作、方法、流程中的步骤、措施、方案也可以被交替、更改、重排、分解、组合或删除。Those skilled in the art can understand that the various operations, methods, and steps, measures, and schemes in the processes that have been discussed in this application can be replaced, changed, combined, or deleted. Furthermore, the various operations, methods, and other steps, measures, and schemes in the processes that have been discussed in this application may also be replaced, changed, rearranged, decomposed, combined, or deleted. Further, steps, measures, and schemes in the prior art that have operations, methods, and processes disclosed in the present application may also be alternated, changed, rearranged, decomposed, combined, or deleted.
术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,除非另有说明,“多个”的含义是两个或两个以上。The terms "first" and "second" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the present application, unless otherwise specified, "plurality" means two or more.
在本说明书的描述中,具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in an appropriate manner.
应该理解的是,虽然附图的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,其可以以其他的顺序执行。而且,附图的流程图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,其执行顺序也不必然是依次进行,而是可以与其他步骤或者其他步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the various steps in the flow chart of the accompanying drawings are displayed sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the flowcharts of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the order of execution is also It is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.
以上所述仅是本申请的部分实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本申请的保护范围。The above descriptions are only some implementations of the present application. It should be pointed out that for those of ordinary skill in the art, some improvements and modifications can be made without departing from the principle of the application. These improvements and modifications are also It should be regarded as the protection scope of this application.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552874.8A CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552874.8A CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113301280A CN113301280A (en) | 2021-08-24 |
| CN113301280B true CN113301280B (en) | 2023-01-24 |
Family
ID=77323229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110552874.8A Active CN113301280B (en) | 2021-05-20 | 2021-05-20 | Pixel circuit of photosensitive block, image processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113301280B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4692794A (en) * | 1985-02-18 | 1987-09-08 | Fuji Photo Film Co., Ltd. | Color image sensor with picture elements each comprising an M×N matrix of red, green, and blue photoelectric conversion elements featuring controllable charge storage time and selective readout for each color |
| CN101755463A (en) * | 2007-07-20 | 2010-06-23 | 伊斯曼柯达公司 | Multiple component readout of image sensor |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN112399113A (en) * | 2019-08-12 | 2021-02-23 | 天津大学青岛海洋技术研究院 | High-speed global exposure pixel structure for realizing intra-pixel correlated double sampling |
| CN112689073A (en) * | 2020-12-28 | 2021-04-20 | 维沃移动通信有限公司 | Image sensor, camera module and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070131992A1 (en) * | 2005-12-13 | 2007-06-14 | Dialog Semiconductor Gmbh | Multiple photosensor pixel image sensor |
-
2021
- 2021-05-20 CN CN202110552874.8A patent/CN113301280B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4692794A (en) * | 1985-02-18 | 1987-09-08 | Fuji Photo Film Co., Ltd. | Color image sensor with picture elements each comprising an M×N matrix of red, green, and blue photoelectric conversion elements featuring controllable charge storage time and selective readout for each color |
| CN101755463A (en) * | 2007-07-20 | 2010-06-23 | 伊斯曼柯达公司 | Multiple component readout of image sensor |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN112399113A (en) * | 2019-08-12 | 2021-02-23 | 天津大学青岛海洋技术研究院 | High-speed global exposure pixel structure for realizing intra-pixel correlated double sampling |
| CN112689073A (en) * | 2020-12-28 | 2021-04-20 | 维沃移动通信有限公司 | Image sensor, camera module and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113301280A (en) | 2021-08-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8749672B2 (en) | Digital camera having a multi-spectral imaging device | |
| US10257447B2 (en) | Imaging method, imaging device, and electronic device | |
| CN111629140A (en) | Image Sensors and Electronics | |
| JP5853166B2 (en) | Image processing apparatus, image processing method, and digital camera | |
| US11064138B2 (en) | High-dynamic image sensor | |
| CN211296854U (en) | Pixel Array and Bionic Vision Sensor | |
| CN114845015B (en) | Image sensor, control method, imaging device, terminal and readable storage medium | |
| US20110216228A1 (en) | Solid-state image sensing element, method for driving solid-state image sensing element and image pickup device | |
| CN114157818A (en) | Frame transfer CCD with multiple working modes and control method thereof | |
| CN115280766B (en) | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method | |
| TW200522730A (en) | Solid-state image sensor, solid-state image sensing apparatus, camera, and method | |
| CN113301280B (en) | Pixel circuit of photosensitive block, image processing method and device and electronic equipment | |
| CN105592265A (en) | Pixel switching method of image sensor, photographing device and terminal | |
| JP6274901B2 (en) | Imaging apparatus and control method thereof | |
| JP2005217955A (en) | IMAGING DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM | |
| CN115776617B (en) | Pixel structure, image sensor, device, image processing method, and control method | |
| CN216852142U (en) | Pixel array and image sensor | |
| KR100594236B1 (en) | Solid-state image sensor and its driving method for enabling image signal processing without frame memory buffer | |
| CN219938454U (en) | Image sensor and electronic device | |
| CN113132692B (en) | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method | |
| CN113141444B (en) | Image sensor, imaging device, electronic device, image processing system, and signal processing method | |
| Xu et al. | A Controllable Luminance Neural Camera | |
| WO2024254854A1 (en) | Image sensor and reading method therefor, and electronic device | |
| CN119211754A (en) | Image sensor, reading method thereof and electronic equipment | |
| JP2003153090A (en) | X-y scanning image pickup element and imaging device equipped with the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |