技术领域technical field
本发明涉及图像处理技术领域，特别涉及一种基于宽动态的图像处理方法、装置及曝光电路。The invention relates to the technical field of image processing, in particular to an image processing method, device and exposure circuit based on wide dynamic range.
背景技术Background technique
宽动态技术是在非常强烈的对比下让摄像机看到影像的特色而运用的一种技术，宽动态技术使场景中亮部细节和暗部细节同时都能看得特别清楚。WDR(Wide DynamicRange，宽动态范围)是图像能分辨的最亮的亮度信号值与能分辨的最暗的亮光信号值的比值。宽动态范围越大，其所能表现的层次越丰富，能同时记录的亮部细节和暗部细节越丰富。Wide dynamic technology is a technology used to allow the camera to see the characteristics of the image under very strong contrast. Wide dynamic technology makes the details of the bright part and dark part of the scene particularly clear at the same time. WDR (Wide Dynamic Range, wide dynamic range) is the ratio of the brightest brightness signal value that can be resolved by the image to the darkest bright light signal value that can be resolved. The wider the wide dynamic range, the richer the layers it can express, and the richer the details of bright parts and dark parts that can be recorded at the same time.
传统的宽动态技术是利用多帧合成的机制，即将进行长曝光所形成的曝光图像和进行短曝光所形成的曝光图像进行叠加获得宽动态数据。The traditional wide dynamic technology uses the mechanism of multi-frame synthesis, that is, the exposure image formed by long exposure and the exposure image formed by short exposure are superimposed to obtain wide dynamic data.
利用传统的宽动态技术的图像处理系统，针对每个像素会进行两次曝光，包括一次长曝光和一次短曝光，然后根据两次曝光所生成的长曝光图像和短曝光图像进行筛选和叠加，得到有效曝光图像，进而进行后续的图像处理流程。其中，曝光依赖于像素电路。现有技术中，每个像素点对应一个像素电路。传统的像素电路如图1所示，具体曝光过程为：在像素开始进行曝光时，图像处理器向该像素电路发送复位信号RST启动复位操作，以使光电二极管PD的输出电压被置为0；光电二极管PD吸收光信号进行有效电荷的累计，当到达曝光时间阈值后，有效电荷的累计结束；光电二极管PD所累计的有效电荷经过源极跟随器T1转换成模拟电压信号，实现光电转换；行选通脉冲RS启动选址开关T2，转换成的模拟电压信号通过列线输出，该模拟电压信号经过模/数转换，生成数字信号(长曝光图像)，完成一次曝光。然后再进行下一次曝光，以生成短曝光图像。进行两次曝光就会有两次RST复位操作，并进行两次光电转换过程。把两次曝光所形成的曝光图像进行叠加，得到有效曝光图像。Using the image processing system of traditional wide dynamic technology, two exposures are performed for each pixel, including a long exposure and a short exposure, and then the long exposure image and the short exposure image generated by the two exposures are screened and superimposed. The effective exposure image is obtained, and then the subsequent image processing process is carried out. Among them, exposure depends on the pixel circuit. In the prior art, each pixel corresponds to a pixel circuit. The traditional pixel circuit is shown in Figure 1. The specific exposure process is: when the pixel starts to be exposed, the image processor sends a reset signal RST to the pixel circuit to start the reset operation, so that the output voltage of the photodiode PD is set to 0; The photodiode PD absorbs the light signal to accumulate the effective charge. When the exposure time threshold is reached, the accumulation of the effective charge ends; the effective charge accumulated by the photodiode PD is converted into an analog voltage signal by the source follower T1 to realize photoelectric conversion; The strobe pulse RS activates the address switch T2, and the converted analog voltage signal is output through the column lines. The analog voltage signal undergoes analog/digital conversion to generate a digital signal (long exposure image) to complete one exposure. The next exposure is then taken to generate a short exposure image. There will be two RST reset operations for two exposures, and two photoelectric conversion processes. The exposure images formed by the two exposures are superimposed to obtain an effective exposure image.
可见，两次RST复位操作之间有时间差，针对移动的物体，进行长曝光所形成的曝光图像和进行短曝光所形成的曝光图像合成的宽动态数据中会出现运动瑕疵，并且曝光图像与曝光图像之间开始曝光时间的时间间隔越大，运动瑕疵越明显。时间差越大，像素开始进行曝光的时间间隔越大，所形成的宽动态数据中运动瑕疵越明显。It can be seen that there is a time difference between the two RST reset operations. For moving objects, there will be motion defects in the wide dynamic data of the exposure image formed by long exposure and the exposure image formed by short exposure, and the exposure image and exposure The greater the time interval between starting exposure times between images, the more pronounced motion artifacts will be. The larger the time difference, the longer the time interval for pixels to start to be exposed, and the more obvious the motion defects in the formed WDR data.
发明内容Contents of the invention
本发明实施例公开了一种基于宽动态的图像处理方法、装置及曝光电路，以减少开始曝光的时间间隔，解决宽动态数据中存在运动瑕疵的问题。具体方案如下：The embodiment of the present invention discloses a wide dynamic-based image processing method, device and exposure circuit, so as to reduce the time interval for starting exposure and solve the problem of motion defects in wide dynamic data. The specific plan is as follows:
一方面，本发明实施例提供了一种基于宽动态的图像处理方法，应用于图像处理系统，所述图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，所述方法包括：On the one hand, the embodiment of the present invention provides an image processing method based on wide dynamic range, which is applied to an image processing system, and each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and one A second pixel circuit for performing a short exposure, the method comprising:
获得针对每个像素点的长曝光复位信号和短曝光复位信号；obtaining a long-exposure reset signal and a short-exposure reset signal for each pixel;
将长曝光复位信号和短曝光复位信号同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成每个像素点的第一长曝光图像和第一短曝光图像；Sending the long exposure reset signal and the short exposure reset signal to each corresponding first pixel circuit and each second pixel circuit at the same time, so that each first pixel circuit and each second pixel circuit start exposure at the same time, generating each The first long exposure image and the first short exposure image of pixels;
将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。The first long-exposure image and the first short-exposure image of each pixel are superimposed to obtain an effective exposure image of each pixel.
可选的，所述将第一长曝光图像和第一短曝光图像进行叠加，获得有效曝光图像，包括：Optionally, the superimposition of the first long exposure image and the first short exposure image to obtain an effective exposure image includes:
根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像；According to the exposure ratio of the first long exposure image and the first short exposure image, normalize the first short exposure image to obtain a second short exposure consistent with the data amount of the first long exposure image image;
将所述第二曝光图像的第二亮度值与预设阈值范围相比；comparing the second brightness value of the second exposure image with a preset threshold range;
如果第二亮度值大于所述预设阈值范围中的最大值，将所述第一短曝光图像确定为可用曝光图像；If the second brightness value is greater than the maximum value in the preset threshold range, determining the first short exposure image as an available exposure image;
如果第二亮度值小于所述预设阈值范围中的最小值，将所述第一长曝光图像确定为可用曝光图像；If the second brightness value is smaller than the minimum value in the preset threshold range, determining the first long exposure image as an available exposure image;
如果第二亮度值处于预设阈值范围内，根据所述第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像；If the second brightness value is within a preset threshold range, determining an available exposure image according to the brightness information of the first long exposure image and the first short exposure image;
利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像。The available exposure image is processed by using a preset brightness equalization method to obtain an effective exposure image with brightness averaged.
可选的，所述根据所述第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像，包括：Optionally, the determining an available exposure image according to brightness information of the first long exposure image and the first short exposure image includes:
将所述第一长曝光图像和所述第一短曝光图像按预定比例进行融合，得到可用曝光图像。The first long-exposure image and the first short-exposure image are fused according to a predetermined ratio to obtain an available exposure image.
可选的，所述根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像，包括：获得所述第一短曝光图像的第一亮度值；将所述第一亮度值乘以所述曝光比，得到与所述第一长曝光图像数据量一致的第二短曝光图像。Optionally, according to the exposure ratio of the first long exposure image and the first short exposure image, the first short exposure image is normalized to obtain a data volume equal to that of the first long exposure image. A consistent second short-exposure image, comprising: obtaining a first brightness value of the first short-exposure image; multiplying the first brightness value by the exposure ratio to obtain a data amount consistent with the first long-exposure image The second short exposure image of .
可选的，所述图像处理系统中每个像素点对应两个第一像素电路和两个第二像素电路；所述像素点被平均划分为四个区域；所述两个第一像素电路分别对应像素点一条对角线上的两个区域；所述两个第二像素电路分别对应像素点另一条对角线上的两个区域；Optionally, each pixel in the image processing system corresponds to two first pixel circuits and two second pixel circuits; the pixel is equally divided into four regions; the two first pixel circuits are respectively Corresponding to two areas on one diagonal line of a pixel point; the two second pixel circuits respectively correspond to two areas on the other diagonal line of a pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
可选的，所述利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像所利用公式为：Optionally, the formula used to process the available exposure image by using the preset brightness equalization method to obtain an effective exposure image with brightness average is:
Y＝X1*K1+X2*K2+X3*K3+X4*K4；Y＝X1* K1+ X2*K2+X3 *K3+X4 *K4;
其中，所述Y表示所述有效曝光图像；所述X1和X4分别表示所述两个第一像素电路分别对应像素点一条对角线上的两个区域的亮度值、X2和X3分别表示所述两个第二像素电路分别对应像素点一条对角线上的两个区域的亮度值；所述K1、K2、K3和K4分别表示预先为所述X1、所述X2、所述X3以及所述X4设置的权重系数；其中，当所述可用曝光图像由所述第一短曝光图像确定时，所述X1和X4取0；当所述可用曝光图像由所述第一长曝光图像确定时，所述X2和X3取0；当所述可用曝光图像由所述第一长曝光图像和第一短曝光图像的亮度信息确定时，所述X1、X2、X3和X4为实际亮度值。Wherein, the Y represents the effective exposure image; the X1 and X4 respectively represent the luminance values of two areas on a diagonal line corresponding to the pixel points of the two first pixel circuits, X2 and X .3 respectively represent the luminance values oftwo areasona diagonal line corresponding to the pixel pointsof the two second pixel circuits; The weight coefficients set by the X2 , the X3 and the X4 ; wherein, when the available exposure image is determined by the first short exposure image, the X1 and X4 are 0; when the When the available exposure image is determined by the first long exposure image, the X2 andX3 are0 ; when the available exposure image is determined by the brightness information of the first long exposure image and the first short exposure image , the X1 , X2 , X3 and X4 are actual brightness values.
另一方面，本发明实施例提供了一种基于宽动态的图像处理装置，应用于图像处理系统，所述图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，所述装置包括：On the other hand, an embodiment of the present invention provides an image processing device based on wide dynamic range, which is applied to an image processing system, and each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and a second pixel circuit for short exposure, said means comprising:
第一获得模块，用于获得针对每个像素点的长曝光复位信号和短曝光复位信号；A first obtaining module, configured to obtain a long-exposure reset signal and a short-exposure reset signal for each pixel;
发送模块，用于将长曝光复位信号和短曝光复位信号同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像；a sending module, configured to simultaneously send the long exposure reset signal and the short exposure reset signal to each corresponding first pixel circuit and each second pixel circuit, so that each first pixel circuit and each second pixel circuit simultaneously Start exposure, generate the first long exposure image and the first short exposure image;
第二获得模块，用于将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。The second obtaining module is configured to superimpose the first long-exposure image and the first short-exposure image of each pixel to obtain an effective exposure image of each pixel.
可选的，所述第二获得模块包括归一化单元、比较单元、第一确定单元、第二确定单元、第三确定单元和处理单元；Optionally, the second obtaining module includes a normalization unit, a comparison unit, a first determination unit, a second determination unit, a third determination unit and a processing unit;
所述归一化单元，用于根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像；The normalization unit is configured to normalize the first short-exposure image according to the exposure ratio of the first long-exposure image and the first short-exposure image to obtain The second short exposure image with the same amount of image data;
所述比较单元，具体用于将所述第二曝光图像的第二亮度值与预设阈值范围相比；The comparison unit is specifically configured to compare the second brightness value of the second exposure image with a preset threshold range;
所述第一确定单元，用于如果第二亮度值大于所述预设阈值范围中的最大值，将所述第一短曝光图像确定为可用曝光图像；The first determination unit is configured to determine the first short exposure image as an available exposure image if the second brightness value is greater than the maximum value in the preset threshold range;
所述第二确定单元，用于如果第二亮度值小于所述预设阈值范围中的最小值，将所述第一长曝光图像确定为可用曝光图像；The second determination unit is configured to determine the first long exposure image as an available exposure image if the second brightness value is smaller than the minimum value in the preset threshold range;
所述第三确定单元，用于如果第二亮度值处于预设阈值范围内，根据所述第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像；The third determination unit is configured to determine an available exposure image according to the brightness information of the first long exposure image and the first short exposure image if the second brightness value is within a preset threshold range;
所述处理单元，用于利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像。The processing unit is configured to process the available exposure image by using a preset brightness equalization method to obtain an effective exposure image with brightness average.
可选的，所述第三确定单元，具体用于将所述第一长曝光图像和所述第一短曝光图像按预定比例进行融合，得到可用曝光图像。Optionally, the third determining unit is specifically configured to fuse the first long-exposure image and the first short-exposure image according to a predetermined ratio to obtain an available exposure image.
可选的，所述归一化单元，具体用于获得所述第一短曝光图像的第一亮度值；将所述第一亮度值乘以所述曝光比，得到与所述第一长曝光图像数据量一致的第二短曝光图像。Optionally, the normalization unit is specifically configured to obtain a first brightness value of the first short-exposure image; multiply the first brightness value by the exposure ratio to obtain the first long-exposure The second short-exposure image with the same amount of image data.
可选的，所述图像处理系统中每个像素点对应两个第一像素电路和两个第二像素电路；所述像素点被平均划分为四个区域；所述两个第一像素电路分别对应像素点一条对角线上的两个区域；所述两个第二像素电路分别对应像素点另一条对角线上的两个区域；Optionally, each pixel in the image processing system corresponds to two first pixel circuits and two second pixel circuits; the pixel is equally divided into four regions; the two first pixel circuits are respectively Corresponding to two areas on one diagonal line of a pixel point; the two second pixel circuits respectively correspond to two areas on the other diagonal line of a pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
可选的，所述利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像所利用公式为：Optionally, the formula used to process the available exposure image by using the preset brightness equalization method to obtain an effective exposure image with brightness average is:
Y＝X1*K1+X2*K2+X3*K3+X4*K4；Y＝X1* K1+ X2*K2+X3 *K3+X4 *K4;
其中，所述Y表示所述有效曝光图像；所述X1和X4分别表示所述两个第一像素电路分别对应像素点一条对角线上的两个区域的亮度值、X2和X3分别表示所述两个第二像素电路分别对应像素点一条对角线上的两个区域的亮度值；所述K1、K2、K3和K4分别表示预先为所述X1、所述X2、所述X3以及所述X4设置的权重系数；其中，当所述可用曝光图像由所述第一短曝光图像确定时，所述X1和X4取0；当所述可用曝光图像由所述第一长曝光图像确定时，所述X2和X3取0；当所述可用曝光图像由所述第一长曝光图像和第一短曝光图像的亮度信息确定时，所述X1、X2、X3和X4为实际亮度值。Wherein, the Y represents the effective exposure image; the X1 and X4 respectively represent the luminance values of two areas on a diagonal line corresponding to the pixel points of the two first pixel circuits, X2 and X .3 respectively represent the luminance values oftwo areasona diagonal line corresponding to the pixel pointsof the two second pixel circuits; The weight coefficients set by the X2 , the X3 and the X4 ; wherein, when the available exposure image is determined by the first short exposure image, the X1 and X4 are 0; when the When the available exposure image is determined by the first long exposure image, the X2 andX3 are0 ; when the available exposure image is determined by the brightness information of the first long exposure image and the first short exposure image , the X1 , X2 , X3 and X4 are actual brightness values.
另一方面，本发明实施例提供了一种曝光电路，至少包括一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路；On the other hand, an embodiment of the present invention provides an exposure circuit, including at least a first pixel circuit for long exposure and a second pixel circuit for short exposure;
所述每个第一像素电路与图像处理器相连，接收所述图像处理器发送的长曝光复位信号进行长曝光；Each of the first pixel circuits is connected to an image processor, and receives a long exposure reset signal sent by the image processor to perform long exposure;
所述每个第二像素电路与所述图像处理器相连，接收所述图像处理器发送的短曝光复位信号进行短曝光。Each of the second pixel circuits is connected to the image processor, and receives a short exposure reset signal sent by the image processor to perform short exposure.
可选的，所述曝光电路对应两个第一像素电路和两个第二像素电路；每一像素点被平均划分为四个区域；所述两个第一像素电路分别对应像素点一条对角线上的两个区域；所述两个第二像素电路分别对应像素点另一条对角线上的两个区域；Optionally, the exposure circuit corresponds to two first pixel circuits and two second pixel circuits; each pixel point is divided into four areas on average; the two first pixel circuits correspond to one diagonal pixel circuit Two areas on the line; the two second pixel circuits respectively correspond to two areas on the other diagonal line of the pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
可选的，所述两个第一像素电路的第一列线相连，所述两个第一像素电路的第一行选通信号线相连；Optionally, the first column lines of the two first pixel circuits are connected, and the first row gate signal lines of the two first pixel circuits are connected;
所述两个第二像素电路的第二列线相连，所述两个第二像素电路的第二行选通信号线相连。The second column lines of the two second pixel circuits are connected, and the second row gate signal lines of the two second pixel circuits are connected.
可选的，所述第一像素电路中包括第一光电二极管、第一源极跟随器和第一选址开关；Optionally, the first pixel circuit includes a first photodiode, a first source follower and a first address switch;
所述第一光电二极管，用于在所述第一像素电路接收到所述图像处理器发送的长曝光复位信号后，将输出电压置0，并吸收光信号进行第一有效电荷的累计；The first photodiode is configured to set the output voltage to 0 after the first pixel circuit receives the long-exposure reset signal sent by the image processor, and absorb light signals to accumulate first effective charges;
所述第一源极跟随器，用于将所述第一光电二极管所累计的第一有效光电荷转换成第一模拟电压信号；The first source follower is configured to convert the first effective photocharge accumulated by the first photodiode into a first analog voltage signal;
所述第一选址开关，用于在接收到所述图像处理器发送的第一行选通信号后，将所述第一源极跟随器所转换的所述第一模拟电压信号通过第一列线输出；The first address selection switch is configured to pass the first analog voltage signal converted by the first source follower through the first Line output;
所述第二像素电路中包括第二光电二极管、第二源极跟随器和第二选址开关；The second pixel circuit includes a second photodiode, a second source follower and a second address switch;
所述第二光电二极管，用于在所述第二像素电路接收到所述图像处理器发送的短曝光复位信号后，将输出电压置0，并吸收光信号进行第二有效电荷的累计；The second photodiode is configured to set the output voltage to 0 after the second pixel circuit receives the short exposure reset signal sent by the image processor, and absorb the light signal to accumulate the second effective charge;
所述第二源极跟随器，用于将所述第二光电二极管所累计的第二有效光电荷转换成第二模拟电压信号；The second source follower is configured to convert the second effective photocharge accumulated by the second photodiode into a second analog voltage signal;
所述第二选址开关，用于在接收到所述图像处理器发送的第二行选通信号后，将所述第二源极跟随器所转换的所述第二模拟电压信号通过第二列线输出。The second address switch is configured to pass the second analog voltage signal converted by the second source follower through the second Line output.
可选的，所述第一像素电路中还包括第一模/数转换器；Optionally, the first pixel circuit further includes a first analog/digital converter;
所述第一模/数转换器，用于将从所述第一列线输出的所述第一模拟电压信号转换成第一数字信号输出至所述图像处理器；The first A/D converter is configured to convert the first analog voltage signal output from the first column line into a first digital signal and output it to the image processor;
所述第二像素电路中还包括第二模/数转换器；The second pixel circuit further includes a second analog/digital converter;
所述第二模/数转换器，用于将从所述第二列线输出的所述第二模拟电压信号转换成第二数字信号输出至所述图像处理器。The second A/D converter is configured to convert the second analog voltage signal output from the second column line into a second digital signal and output it to the image processor.
在本方案中，图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，获得针对每个像素点的长曝光复位信号和短曝光复位信号，同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像，减少了开始曝光的时间间隔，解决了宽动态数据中存在运动瑕疵，然后为了形成效果较好的图像，将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。当然，实施本发明的任一产品或方法必不一定需要同时达到以上所述的所有优点。In this solution, each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and one second pixel circuit for short exposure, and a long exposure reset signal for each pixel is obtained and the short exposure reset signal are sent to each corresponding first pixel circuit and each second pixel circuit at the same time, so that each first pixel circuit and each second pixel circuit start to expose at the same time, and generate the first long exposure image and the first short-exposure image, which reduces the time interval for starting exposure and solves the motion defects in the wide dynamic data. Then, in order to form a better image, the first long-exposure image and the first short-exposure image of each pixel are combined The images are superimposed to obtain an effective exposure image for each pixel. Of course, implementing any product or method of the present invention does not necessarily need to achieve all the above-mentioned advantages at the same time.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为一种传统的像素电路的示意图；FIG. 1 is a schematic diagram of a traditional pixel circuit;
图2为本发明实施例所提供的一种基于宽动态的图像处理方法的流程示意图；FIG. 2 is a schematic flowchart of a wide dynamic-based image processing method provided by an embodiment of the present invention;
图3为图2所示步骤S203的一种具体实现流程示意图；FIG. 3 is a schematic diagram of a specific implementation process of step S203 shown in FIG. 2;
图4为本发明实施例所提供的一种基于宽动态的图像处理装置的结构示意图；4 is a schematic structural diagram of an image processing device based on wide dynamic range provided by an embodiment of the present invention;
图5为图4所示装置中第二获得模块的一种具体结构示意图；Fig. 5 is a kind of specific structural representation of the second obtaining module in the device shown in Fig. 4;
图6为本发明实施例所提供的一种曝光电路的结构示意图；6 is a schematic structural diagram of an exposure circuit provided by an embodiment of the present invention;
图7为本发明实施例所提供的一种曝光电路的电路示意图；7 is a schematic circuit diagram of an exposure circuit provided by an embodiment of the present invention;
图8为本发明实施例所提供的一种第一像素电路和第二像素电路的分布示意图。FIG. 8 is a schematic distribution diagram of a first pixel circuit and a second pixel circuit provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
本发明实施例提供了一种基于宽动态的图像处理方法、装置及曝光电路，以减少开始曝光的时间间隔，解决宽动态数据中存在运动瑕疵的问题。Embodiments of the present invention provide a WDR-based image processing method, device, and exposure circuit to reduce the time interval for starting exposure and solve the problem of motion defects in WDR data.
下面首先对本发明实施例所提供的一种基于宽动态的图像处理方法进行介绍。A wide dynamic range-based image processing method provided by an embodiment of the present invention is firstly introduced below.
需要说明的是，本发明实施例所提供的基于宽动态的图像处理方法，可以应用于图像处理系统，所述图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路。其中，该第一像素电路和第二像素电路各自对应的曝光时间可以通过上层应用软件进行控制。It should be noted that the image processing method based on wide dynamic range provided by the embodiment of the present invention can be applied to an image processing system, and each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and a second pixel circuit for short exposures. Wherein, the respective exposure times of the first pixel circuit and the second pixel circuit can be controlled by upper layer application software.
如图2所示，本发明实施例所提供的基于宽动态的图像处理方法，可以包括如下步骤：As shown in Figure 2, the image processing method based on wide dynamic range provided by the embodiment of the present invention may include the following steps:
S201：获得针对每个像素点的长曝光复位信号和短曝光复位信号；S201: Obtain a long-exposure reset signal and a short-exposure reset signal for each pixel;
可以理解的是，当宽动态功能开启后，所述图像处理系统获得针对每个像素点的长曝光复位信号和短曝光复位信号，其中，该长曝光复位信号与该短曝光复位信号可以相同，也可以不同。在一种具体实现中，该长曝光复位信号与该短曝光复位信号可以均为复位信号RST。It can be understood that when the wide dynamic function is turned on, the image processing system obtains a long exposure reset signal and a short exposure reset signal for each pixel, wherein the long exposure reset signal and the short exposure reset signal may be the same, It can also be different. In a specific implementation, both the long exposure reset signal and the short exposure reset signal may be reset signals RST.
并且，可以采用现有技术获得该长曝光复位信号和短曝光复位信号，在此不做赘述。Moreover, the long-exposure reset signal and the short-exposure reset signal can be obtained by using existing technologies, which will not be repeated here.
S202：将长曝光复位信号和短曝光复位信号同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像；S202: Send the long exposure reset signal and the short exposure reset signal to each corresponding first pixel circuit and each second pixel circuit at the same time, so that each first pixel circuit and each second pixel circuit start exposure at the same time, generating a first long exposure image and a first short exposure image;
为了保证每个第一像素电路和每个第二像素电路能够同时进行曝光，消除开始曝光的时间间隔，解决宽动态数据中存在运动瑕疵的问题。图像处理系统将所获得的长曝光复位信号和短曝光复位信号同时发送至对应的每个第一像素电路和每个第二像素电路。每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像。In order to ensure that each first pixel circuit and each second pixel circuit can be exposed at the same time, the time interval for starting exposure is eliminated, and the problem of motion defects in wide dynamic data is solved. The image processing system simultaneously sends the obtained long-exposure reset signal and short-exposure reset signal to each corresponding first pixel circuit and each second pixel circuit. Each first pixel circuit and each second pixel circuit start exposure simultaneously to generate a first long exposure image and a first short exposure image.
其中，对于每个第一像素电路和每个第二像素电路在进行曝光时，与现有技术相同，在此不做赘述。Wherein, the exposure of each first pixel circuit and each second pixel circuit is the same as that of the prior art, and will not be repeated here.
S203：将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。S203: Superimpose the first long-exposure image and the first short-exposure image of each pixel to obtain an effective exposure image of each pixel.
可以理解的是，对于第一短曝光图像来说，其曝光时间较短，像素点可能会出现曝光不足的现象，此时，会使对应部分所形成的图像过暗，图片的暗部细节得不到很好的体现。对于第一长曝光图像来说，其曝光时间较长，像素点可能会出现曝光超饱和的现象，此时，会使对应部分所形成的图像过亮，图片的亮部细节也得不到很好的体现。为了形成效果较好的图像，更能充分地完整地显示图像中的亮部细节和暗部细节，需要根据所生成的第一长曝光图像和第一短曝光图像确定出有效曝光图像，然后进行后续的图像处理流程。其中，对每个像素点的第一长曝光图像和第一短曝光图像进行叠加可以采用现有技术，在此不做赘述。It can be understood that, for the first short exposure image, the exposure time is relatively short, and the pixels may be underexposed. to a good performance. For the first long-exposure image, the exposure time is longer, and the pixel points may be over-exposed. At this time, the image formed by the corresponding part will be too bright, and the details of the bright part of the image will not be well obtained. good performance. In order to form an image with better effect and fully and completely display the details of the bright part and dark part in the image, it is necessary to determine the effective exposure image according to the generated first long exposure image and first short exposure image, and then perform subsequent image processing flow. The superposition of the first long-exposure image and the first short-exposure image of each pixel can adopt the existing technology, which will not be repeated here.
应用本发明实施例，图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，获得针对每个像素点的长曝光复位信号和短曝光复位信号，同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像，减少了开始曝光的时间间隔，解决了宽动态数据中存在运动瑕疵，然后为了形成效果较好的图像，将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。Applying the embodiment of the present invention, each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and one second pixel circuit for short exposure, so as to obtain long exposure reset for each pixel signal and the short exposure reset signal are sent to each corresponding first pixel circuit and each second pixel circuit at the same time, so that each first pixel circuit and each second pixel circuit start to expose at the same time, generating the first long exposure image and the first short-exposure image, reducing the time interval for starting exposure, and solving the motion defects in the wide dynamic data, and then in order to form a better image, the first long-exposure image and the first short-exposure image of each pixel The exposure images are superimposed to obtain an effective exposure image for each pixel.
在一种具体实现方式中，如图3所示，所述将第一长曝光图像和第一短曝光图像进行叠加，获得有效曝光图像(S203)，包括：In a specific implementation manner, as shown in FIG. 3, the superposition of the first long exposure image and the first short exposure image to obtain an effective exposure image (S203) includes:
S301：根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像；S301: Normalize the first short-exposure image according to the exposure ratio of the first long-exposure image and the first short-exposure image to obtain a second short exposure images;
S302：将所述第二曝光图像的第二亮度值与预设阈值范围相比；S302: Comparing the second brightness value of the second exposure image with a preset threshold range;
S303：如果第二亮度值大于所述预设阈值范围中的最大值，将所述第一短曝光图像确定为可用曝光图像；S303: If the second brightness value is greater than the maximum value in the preset threshold range, determine the first short exposure image as an available exposure image;
S304：如果第二亮度值小于所述预设阈值范围中的最小值，将所述第一长曝光图像确定为可用曝光图像；S304: If the second brightness value is smaller than the minimum value in the preset threshold range, determine the first long exposure image as an available exposure image;
S305：如果第二亮度值处于预设阈值范围内，根据所述第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像；S305: If the second brightness value is within the preset threshold range, determine an available exposure image according to the brightness information of the first long exposure image and the first short exposure image;
S306：利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像。S306: Process the available exposure image by using a preset brightness equalization manner to obtain an effective exposure image with brightness averaged.
由于第一短曝光图像与第一长曝光图像的曝光时间不同，其所呈现的图像亮度存在差异，为了保证能够更好的根据第一短曝光图像与第一长曝光图像，确定出更好的可用曝光图像。首先根据第一长曝光图像和第一短曝光图像的曝光比，对第一短曝光图像进行归一化，将第一短曝光图像转换到与第一长曝光图像同一数据量上，得到第二短曝光图像。其中，第一长曝光图像和第一短曝光图像的曝光比可以根据现有技术确定，在此不做赘述。并且，对第一短曝光图像进行归一化也可以采用现有技术。举例而言，进行归一化之前，对于第一长曝光图像来说，其对应的数据量可能是16bit，而对于第一短曝光图像来说，其对应的数据量可能是12bit。根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化后，可以得到数据量为16bit的第二短曝光图像。Since the exposure time of the first short-exposure image and the first long-exposure image are different, there is a difference in the brightness of the image presented. In order to ensure that a better Available exposure images. First, according to the exposure ratio of the first long exposure image and the first short exposure image, normalize the first short exposure image, convert the first short exposure image to the same data volume as the first long exposure image, and obtain the second Short exposure image. Wherein, the exposure ratio of the first long-exposure image and the first short-exposure image can be determined according to the prior art, which will not be repeated here. In addition, the normalization of the first short-exposure image may also use the existing technology. For example, before normalization, for the first long-exposure image, the corresponding data amount may be 16 bits, and for the first short-exposure image, the corresponding data amount may be 12 bits. According to the exposure ratio of the first long-exposure image and the first short-exposure image, after normalizing the first short-exposure image, a second short-exposure image with a data volume of 16 bits can be obtained.
此时，可以直接将第二曝光图像的第二亮度值与预设阈值范围相比。其中，该预设阈值范围可以通过现有技术确定。并且可以理解的是，当第二亮度值大于预设阈值范围中的最大值时，可以表明第一长曝光图像中的对应像素点可能会出现曝光超饱和的现象，为了使可用曝光图像的质量更好，保证曝光图像的亮部细节的完整体现，可以确定第一短曝光图像为可用曝光图像；当第二亮度值小于预设阈值范围中的最小值时，可以表明第一短曝光图像中的对应像素点可能会出现曝光不充足的现象，为了使可用曝光图像的质量更好，保证曝光图像的暗部细节的完整体现，可以确定第一长曝光图像为可用曝光图像；当第二亮度值处于预设阈值范围内时，可以表明第一短曝光图像对应的像素点曝光充足，并且，第一长曝光图像对应的像素点曝光未超饱和，此时可以根据第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像，即可用曝光图像对应像素点的取值通过第一长曝光图像和第一短曝光图像的对应像素点的亮度信息确定。At this time, the second brightness value of the second exposure image may be directly compared with the preset threshold range. Wherein, the preset threshold range can be determined through existing technologies. And it can be understood that when the second brightness value is greater than the maximum value in the preset threshold range, it can indicate that the corresponding pixel in the first long-exposure image may experience super-exposure saturation. In order to improve the quality of the available exposure image Better, to ensure that the details of the bright part of the exposed image are fully reflected, the first short-exposure image can be determined as an available exposure image; when the second brightness value is less than the minimum value in the preset threshold range, it can be indicated that the first short-exposure image Insufficient exposure may appear in the corresponding pixel of When it is within the preset threshold range, it can indicate that the exposure of the pixel corresponding to the first short exposure image is sufficient, and the exposure of the pixel corresponding to the first long exposure image is not supersaturated. At this time, according to the first long exposure image and the first The brightness information of the short-exposure image determines the available exposure image, that is, the value of the corresponding pixel of the available exposure image is determined by the brightness information of the corresponding pixel of the first long-exposure image and the first short-exposure image.
需要说明的是，当第二亮度值处于预设阈值范围内时，可以表明第一短曝光图像对应的像素点曝光充足，并且，第一长曝光图像对应的像素点曝光未超饱和。此时，可将该第一短曝光图像和第一长曝光图像对应像素点按预定比例进行融合，得到每个像素点的可用曝光图像。It should be noted that when the second brightness value is within the preset threshold range, it may indicate that the exposure of the pixels corresponding to the first short-exposure image is sufficient, and the exposure of the pixels corresponding to the first long-exposure image is not oversaturated. At this time, corresponding pixels of the first short-exposure image and the first long-exposure image may be fused according to a predetermined ratio to obtain an available exposure image of each pixel.
对于每一像素点来说，同时进行长短曝光，每一像素点进行短曝光的部分，形成第一短曝光图像，每一像素点进行长曝光的部分，形成第一长曝光图像。可以理解的是，每一像素点进行长曝光的部分，由于未进行短曝光，在所形成的第一短曝光图像中对应部分未生成亮度；每一像素点进行短曝光的部分，由于未进行长曝光，在所形成的第一长曝光图像中对应部分未生成亮度。为了保证根据第一长曝光图像和第一短曝光图像所确定的可用曝光图像的完整性以及亮度均匀性，可以利用预设的亮度均化方式对可用曝光图像进行处理，得到亮度均化的有效曝光图像。For each pixel point, long and short exposures are performed at the same time, the part of each pixel point subjected to short exposure forms a first short exposure image, and the part of each pixel point subjected to long exposure forms a first long exposure image. It can be understood that, for the part of each pixel subjected to long exposure, because no short exposure is performed, no brightness is generated in the corresponding part of the formed first short exposure image; the part of each pixel subject to short exposure, due to no In the long exposure, no brightness is generated in the corresponding part of the formed first long exposure image. In order to ensure the integrity and brightness uniformity of the available exposure images determined according to the first long exposure image and the first short exposure image, the available exposure images can be processed by using the preset brightness averaging method to obtain an effective brightness averaging Expose the image.
可以理解的是，每个像素点的可用曝光图像有三种情况，其一为：第二短曝光图像对应像素点的第二亮度值大于预设阈值范围中的最大值时，对应的像素点的取值为第一短曝光图像的对应像素点的值；其二为：第二短曝光图像对应像素点的第二亮度值小于预设阈值范围中的最小值时，对应像素点的取值为第一长曝光图像的对应像素点的值；其三为：第二短曝光图像对应像素点的第二亮度值处于预设阈值范围内时，对应像素点的取值为根据第一长曝光图像和第一短曝光图像的亮度信息确定的值。It can be understood that there are three situations for the available exposure image of each pixel, one of which is: when the second brightness value of the pixel corresponding to the second short exposure image is greater than the maximum value in the preset threshold range, the corresponding pixel The value is the value of the corresponding pixel of the first short-exposure image; the second is: when the second brightness value of the corresponding pixel of the second short-exposure image is less than the minimum value in the preset threshold range, the value of the corresponding pixel is The value of the corresponding pixel of the first long-exposure image; the third is: when the second brightness value of the corresponding pixel of the second short-exposure image is within the preset threshold range, the value of the corresponding pixel is based on the value of the first long-exposure image and the value determined by the brightness information of the first short-exposure image.
在一种具体实现方式中，所述根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像，包括：In a specific implementation manner, the first short-exposure image is normalized according to the exposure ratio of the first long-exposure image and the first short-exposure image to obtain The second short exposure image with the same amount of exposure image data, including:
获得所述第一短曝光图像的第一亮度值；将所述第一亮度值乘以所述曝光比，得到与所述第一长曝光图像数据量一致的第二短曝光图像。Obtaining a first brightness value of the first short-exposure image; multiplying the first brightness value by the exposure ratio to obtain a second short-exposure image whose data volume is consistent with that of the first long-exposure image.
由于第一短曝光图像与第一长曝光图像的曝光时间不同，所对应像素点的亮度值的数据量会存在差异，为了确定出更好的可用曝光图像，可以利用现有技术确定第一长曝光图像和第一短曝光图像的曝光比，将该第一短曝光图像转换为与第一长曝光图像数据量一致的第二短曝光图像，以便于对可用曝光图像的筛选。举例而言，第一长曝光图像数据量为16bit，第一短曝光图像数据量为12bit，其曝光比为4：3(16：12)，用所述第一短曝光图像所对应的第一亮度值乘以该曝光比4：3，得到数据量为16bit的第二短曝光图像。Since the exposure time of the first short-exposure image is different from that of the first long-exposure image, the data amount of the brightness value of the corresponding pixel will be different. In order to determine a better usable exposure image, the first long-exposure The exposure ratio between the exposure image and the first short exposure image converts the first short exposure image into a second short exposure image whose data volume is consistent with that of the first long exposure image, so as to facilitate screening of available exposure images. For example, the data volume of the first long-exposure image is 16 bits, the data volume of the first short-exposure image is 12 bits, and the exposure ratio is 4:3 (16:12). The brightness value is multiplied by the exposure ratio of 4:3 to obtain the second short exposure image with a data volume of 16 bits.
另外的，也可以将第一长曝光图像转换到与第一短曝光图像数据量一致的第二长曝光图像，然后根据该第二长曝光图像对应的第三亮度值，进行后续的可用曝光图像的确定，这也是可以的。In addition, it is also possible to convert the first long-exposure image into a second long-exposure image whose data volume is consistent with that of the first short-exposure image, and then perform subsequent usable exposure images according to the third brightness value corresponding to the second long-exposure image ok, this is also possible.
在一种具体实现方式中，所述图像处理系统中每个像素点对应两个第一像素电路和两个第二像素电路；所述像素点被平均划分为四个区域；所述两个第一像素电路分别对应像素点一条对角线上的两个区域；所述两个第二像素电路分别对应像素点另一条对角线上的两个区域；In a specific implementation manner, each pixel in the image processing system corresponds to two first pixel circuits and two second pixel circuits; the pixel is divided into four areas on average; the two second One pixel circuit respectively corresponds to two regions on one diagonal line of the pixel point; the two second pixel circuits respectively correspond to two regions on the other diagonal line of the pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
如图8所示，为了使得每个像素点中曝光亮度均衡，可以将每个像素点平均划分为四个区域，其中，两个区域(区域1和区域4，或者区域2和区域3)进行长曝光，两个区域(区域2和区域3，或者区域1和区域4)进行短曝光。进行长曝光的两个第一像素电路分别对应像素点一条对角线上的两个区域，如：图8中的区域1和区域4，进行短曝光的两个第二像素电路分别对应像素点另一条对角线上的两个区域，如：图8中的区域2和区域3。并且为了保证曝光电路的同步，两个第一像素电路的复位端相连，两个第二像素电路的复位端相连。并且为了减少长曝光和短曝光之间的时间差，避免宽动态数据中存在运动瑕疵的问题，该第一像素电路和第二像素电路同时接收复位信号，同时开始曝光。As shown in Figure 8, in order to balance the exposure brightness in each pixel point, each pixel point can be divided into four areas on average, wherein two areas (area 1 and area 4, or area 2 and area 3) Long exposure, short exposure of two regions (region 2 and region 3, or region 1 and region 4). The two first pixel circuits for long exposure correspond to two areas on a diagonal line of the pixel points, such as: area 1 and area 4 in Figure 8, and the two second pixel circuits for short exposure respectively correspond to pixel points Two areas on the other diagonal, such as: area 2 and area 3 in Figure 8. And in order to ensure the synchronization of the exposure circuit, the reset terminals of the two first pixel circuits are connected, and the reset terminals of the two second pixel circuits are connected. And in order to reduce the time difference between the long exposure and the short exposure and avoid the problem of motion defects in the wide dynamic data, the first pixel circuit and the second pixel circuit receive the reset signal at the same time, and start exposure at the same time.
在一种具体实现方式中，所述利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像所利用公式为：In a specific implementation manner, the preset brightness equalization method is used to process the available exposure image, and the formula used to obtain the effective exposure image with brightness average is:
Y＝X1*K1+X2*K2+X3*K3+X4*K4；Y＝X1* K1+ X2*K2+X3 *K3+X4 *K4;
其中，所述Y表示所述有效曝光图像；所述X1和X4分别表示所述两个第一像素电路分别对应像素点一条对角线上的两个区域的亮度值、X2和X3分别表示所述两个第二像素电路分别对应像素点一条对角线上的两个区域的亮度值；所述K1、K2、K3和K4分别表示预先为所述X1、所述X2、所述X3以及所述X4设置的权重系数；其中，当所述可用曝光图像由所述第一短曝光图像确定时，所述X1和X4取0；当所述可用曝光图像由所述第一长曝光图像确定时，所述X2和X3取0；当所述可用曝光图像由所述第一长曝光图像和第一短曝光图像的亮度信息确定时，所述X1、X2、X3和X4为实际亮度值。Wherein, the Y represents the effective exposure image; the X1 and X4 respectively represent the luminance values of two areas on a diagonal line corresponding to the pixel points of the two first pixel circuits, X2 and X .3 respectively represent the luminance values oftwo areasona diagonal line corresponding to the pixel pointsof the two second pixel circuits; The weight coefficients set by the X2 , the X3 and the X4 ; wherein, when the available exposure image is determined by the first short exposure image, the X1 and X4 are 0; when the When the available exposure image is determined by the first long exposure image, the X2 andX3 are0 ; when the available exposure image is determined by the brightness information of the first long exposure image and the first short exposure image , the X1 , X2 , X3 and X4 are actual brightness values.
其中，K1、K2、K3和K4可以根据实际情况进行设定，在此不做限定。可以理解的是，在对可用曝光图像进行处理时，是分别对应每一像素点进行亮度均化的。Wherein, K1 , K2 , K3 and K4 can be set according to actual conditions, and are not limited here. It can be understood that, when the available exposure image is processed, brightness averaging is performed corresponding to each pixel.
相应于上述方法实施例，本发明实施例提供了一种基于宽动态的图像处理装置，可以应用于图像处理系统，所述图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，如图4所示，所述装置可以包括：Corresponding to the above-mentioned method embodiment, the embodiment of the present invention provides a wide dynamic range-based image processing device, which can be applied to an image processing system, and each pixel in the image processing system corresponds to at least one long-exposure first A pixel circuit and a second pixel circuit for short exposure, as shown in Figure 4, the device may include:
第一获得模块401，用于获得针对每个像素点的长曝光复位信号和短曝光复位信号；A first obtaining module 401, configured to obtain a long exposure reset signal and a short exposure reset signal for each pixel;
发送模块402，用于将长曝光复位信号和短曝光复位信号同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像；The sending module 402 is configured to simultaneously send the long exposure reset signal and the short exposure reset signal to each corresponding first pixel circuit and each second pixel circuit, so that each first pixel circuit and each second pixel circuit Simultaneously start exposure to generate a first long exposure image and a first short exposure image;
第二获得模块403，用于将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。The second obtaining module 403 is configured to superimpose the first long exposure image and the first short exposure image of each pixel to obtain an effective exposure image of each pixel.
应用本发明实施例，图像处理系统中每个像素点至少对应一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路，获得针对每个像素点的长曝光复位信号和短曝光复位信号，同时发送至对应的每个第一像素电路和每个第二像素电路，以使每个第一像素电路和每个第二像素电路同时开始曝光，生成第一长曝光图像和第一短曝光图像，减少了开始曝光的时间间隔，解决了宽动态数据中存在运动瑕疵，然后为了形成效果较好的图像，将每个像素点的第一长曝光图像和第一短曝光图像进行叠加，获得每个像素点的有效曝光图像。Applying the embodiment of the present invention, each pixel in the image processing system corresponds to at least one first pixel circuit for long exposure and one second pixel circuit for short exposure, so as to obtain long exposure reset for each pixel signal and the short exposure reset signal are sent to each corresponding first pixel circuit and each second pixel circuit at the same time, so that each first pixel circuit and each second pixel circuit start to expose at the same time, generating the first long exposure image and the first short-exposure image, which reduces the time interval for starting exposure and solves the motion defects in wide dynamic data. Then, in order to form a better image, the first long-exposure image and the first short-exposure image of each pixel The exposure images are superimposed to obtain an effective exposure image for each pixel.
在一种具体实现方式中，如图5所示，所述第二获得模块403包括归一化单元501、比较单元502、第一确定单元503、第二确定单元504、第三确定单元505和处理单元506；In a specific implementation manner, as shown in FIG. 5, the second obtaining module 403 includes a normalization unit 501, a comparison unit 502, a first determination unit 503, a second determination unit 504, a third determination unit 505 and processing unit 506;
所述归一化单元501，用于根据所述第一长曝光图像和所述第一短曝光图像的曝光比，对所述第一短曝光图像进行归一化，得到与所述第一长曝光图像数据量一致的第二短曝光图像；The normalization unit 501 is configured to normalize the first short-exposure image according to the exposure ratio of the first long-exposure image and the first short-exposure image, to obtain The second short exposure image with the same amount of exposure image data;
所述比较单元502，具体用于将所述第二曝光图像的第二亮度值与预设阈值范围相比；The comparison unit 502 is specifically configured to compare the second brightness value of the second exposure image with a preset threshold range;
所述第一确定单元503，用于如果第二亮度值大于所述预设阈值范围中的最大值，将所述第一短曝光图像确定为可用曝光图像；The first determining unit 503 is configured to determine the first short exposure image as an available exposure image if the second brightness value is greater than the maximum value in the preset threshold range;
所述第二确定单元504，用于如果第二亮度值小于所述预设阈值范围中的最小值，将所述第一长曝光图像确定为可用曝光图像；The second determining unit 504 is configured to determine the first long exposure image as an available exposure image if the second brightness value is smaller than the minimum value in the preset threshold range;
所述第三确定单元505，用于如果第二亮度值处于预设阈值范围内，根据所述第一长曝光图像和第一短曝光图像的亮度信息确定可用曝光图像；The third determination unit 505 is configured to determine an available exposure image according to the brightness information of the first long exposure image and the first short exposure image if the second brightness value is within a preset threshold range;
所述处理单元506，用于利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像。The processing unit 506 is configured to process the available exposure image using a preset brightness equalization method to obtain an effective exposure image with brightness averaged.
在一种具体实现方式中，所述第三确定单元505，具体用于将所述第一长曝光图像和所述第一短曝光图像按预定比例进行融合，得到可用曝光图像。In a specific implementation manner, the third determining unit 505 is specifically configured to fuse the first long-exposure image and the first short-exposure image according to a predetermined ratio to obtain an available exposure image.
在一种具体实现方式中，所述归一化单元501，具体用于获得所述第一短曝光图像的第一亮度值；In a specific implementation manner, the normalization unit 501 is specifically configured to obtain a first brightness value of the first short exposure image;
将所述第一亮度值乘以所述曝光比，得到与所述第一长曝光图像数据量一致的第二短曝光图像。The first brightness value is multiplied by the exposure ratio to obtain a second short-exposure image whose data volume is consistent with the first long-exposure image.
在一种具体实现方式中，所述图像处理系统中每个像素点对应两个第一像素电路和两个第二像素电路；所述像素点被平均划分为四个区域；所述两个第一像素电路分别对应像素点一条对角线上的两个区域；所述两个第二像素电路分别对应像素点另一条对角线上的两个区域；In a specific implementation manner, each pixel in the image processing system corresponds to two first pixel circuits and two second pixel circuits; the pixel is divided into four areas on average; the two second One pixel circuit respectively corresponds to two regions on one diagonal line of the pixel point; the two second pixel circuits respectively correspond to two regions on the other diagonal line of the pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
在一种具体实现方式中，所述利用预设的亮度均化方式对所述可用曝光图像进行处理，得到亮度均化的有效曝光图像所利用公式为：In a specific implementation manner, the preset brightness equalization method is used to process the available exposure image, and the formula used to obtain the effective exposure image with brightness average is:
Y＝X1*K1+X2*K2+X3*K3+X4*K4；Y＝X1* K1+ X2*K2+X3 *K3+X4 *K4;
其中，所述Y表示所述有效曝光图像；所述X1和X4分别表示所述两个第一像素电路分别对应像素点一条对角线上的两个区域的亮度值、X2和X3分别表示所述两个第二像素电路分别对应像素点一条对角线上的两个区域的亮度值；所述K1、K2、K3和K4分别表示预先为所述X1、所述X2、所述X3以及所述X4设置的权重系数；其中，当所述可用曝光图像由所述第一短曝光图像确定时，所述X1和X4取0；当所述可用曝光图像由所述第一长曝光图像确定时，所述X2和X3取0；当所述可用曝光图像由所述第一长曝光图像和第一短曝光图像的亮度信息确定时，所述X1、X2、X3和X4为实际亮度值。Wherein, the Y represents the effective exposure image; the X1 and X4 respectively represent the luminance values of two areas on a diagonal line corresponding to the pixel points of the two first pixel circuits, X2 and X .3 respectively represent the luminance values oftwo areasona diagonal line corresponding to the pixel pointsof the two second pixel circuits; The weight coefficients set by the X2 , the X3 and the X4 ; wherein, when the available exposure image is determined by the first short exposure image, the X1 and X4 are 0; when the When the available exposure image is determined by the first long exposure image, the X2 andX3 are0 ; when the available exposure image is determined by the brightness information of the first long exposure image and the first short exposure image , the X1 , X2 , X3 and X4 are actual brightness values.
应用本发明实施例，可以实现每个第一像素电路和每个第二像素电路同时开始曝光，并且得到亮度均匀的有效曝光图像。By applying the embodiments of the present invention, each first pixel circuit and each second pixel circuit can start exposure at the same time, and an effective exposure image with uniform brightness can be obtained.
相应于上述方法实施例，本发明实施例提供了一种曝光电路，如图6所示，所述曝光电路至少包括一个用于进行长曝光的第一像素电路610和一个用于进行短曝光的第二像素电路620；Corresponding to the above method embodiment, the embodiment of the present invention provides an exposure circuit, as shown in FIG. 6 , the exposure circuit at least includes a first pixel circuit 610 for long exposure and a first pixel circuit 610 for short exposure. a second pixel circuit 620;
所述每个第一像素电路610与图像处理器600相连，接收所述图像处理器600发送的长曝光复位信号进行长曝光；Each of the first pixel circuits 610 is connected to the image processor 600, and receives the long exposure reset signal sent by the image processor 600 to perform long exposure;
所述每个第二像素电路620与所述图像处理器600相连，接收所述图像处理器600发送的短曝光复位信号进行短曝光。Each of the second pixel circuits 620 is connected to the image processor 600 and receives a short exposure reset signal sent by the image processor 600 to perform short exposure.
需要说明的是，图6所示的所述每个第一像素电路610与所述图像处理器600之间的连线、所述每个第二像素电路620与所述图像处理器600之间的连线仅仅用于表明存在通信连接关系，并不代表实体连线。其中，本发明所提供的曝光电路可以对应应用于每一个像素点中。It should be noted that the connection between each first pixel circuit 610 and the image processor 600 shown in FIG. The connection of is only used to indicate the existence of a communication connection, and does not represent a physical connection. Wherein, the exposure circuit provided by the present invention can be correspondingly applied to each pixel.
在实现宽动态功能的电路中，需要对目标物体分别进行长曝光和短曝光两次曝光。本发明实施例中图像处理器600通过向每个第一像素电路610发送长曝光复位信号，启动每个第一像素电路610开始进行长曝光，通过向每个第二像素电路620发送短曝光复位信号，启动每个第二像素电路620开始进行短曝光。其中，该长曝光复位信号和短曝光复位信号可以相同，也可以不同。在一种具体实现方式中，该长曝光复位信号和短曝光复位信号可以均为复位信号RST。In the circuit for realizing the wide dynamic function, it is necessary to perform two exposures of long exposure and short exposure respectively on the target object. In the embodiment of the present invention, the image processor 600 starts each first pixel circuit 610 to start long exposure by sending a long exposure reset signal to each first pixel circuit 610, and sends a short exposure reset signal to each second pixel circuit 620. signal to activate each second pixel circuit 620 to start short exposure. Wherein, the long exposure reset signal and the short exposure reset signal may be the same or different. In a specific implementation manner, the long exposure reset signal and the short exposure reset signal may both be reset signals RST.
需要说明的是，该复位信号RST可以是高电平有效，即复位信号RST为高电平时每个第一像素电路610或每个第二像素电路620开始进行曝光；也可以是低电平有效，即复位信号RST为低电平时每个第一像素电路610或每个第二像素电路620开始进行曝光。It should be noted that the reset signal RST may be active at high level, that is, each first pixel circuit 610 or each second pixel circuit 620 starts to perform exposure when the reset signal RST is at high level; it may also be active at low level , that is, each first pixel circuit 610 or each second pixel circuit 620 starts to perform exposure when the reset signal RST is at a low level.
另外，可以理解的是，图像处理器600可以同时向每个第一像素电路610和每个第二像素电路620发送对应的长曝光复位信号和短曝光复位信号。以使每个第一像素电路610和每个第二像素电路620同时开始曝光，消除长曝光和短曝光之间的开始曝光时间差。In addition, it can be understood that the image processor 600 may simultaneously send a corresponding long exposure reset signal and a short exposure reset signal to each first pixel circuit 610 and each second pixel circuit 620 . Each first pixel circuit 610 and each second pixel circuit 620 start exposure at the same time, eliminating the time difference between long exposure and short exposure.
所述图像处理器600可以采用SOC图像处理芯片。可以理解的是，当未开启宽动态功能时，所述图像处理器600的输出长曝光复位信号或短曝光复位信号的管脚可以处于悬空或接地的状态，当开启宽动态功能时，所述图像处理器600的输出长曝光复位信号的管脚接入每个第一像素电路610，短曝光复位信号的管脚接入每个第二像素电路620。每个管脚的接入方式可以与现有的接入方式相同。另外，需要强调的是，本发明实施例中的“第一像素电路”中的“第一”和“第二像素电路”中的“第二”仅仅用于从命名上区分不同的像素电路，并不具有任何限定意义。The image processor 600 may use a SOC image processing chip. It can be understood that, when the wide dynamic function is not enabled, the pin of the image processor 600 that outputs the long exposure reset signal or the short exposure reset signal may be suspended or grounded; when the wide dynamic function is enabled, the The pin of the image processor 600 outputting the long exposure reset signal is connected to each first pixel circuit 610 , and the pin of the short exposure reset signal is connected to each second pixel circuit 620 . The access method of each pin can be the same as the existing access method. In addition, it should be emphasized that the "first" in the "first pixel circuit" and the "second" in the "second pixel circuit" in the embodiment of the present invention are only used to distinguish different pixel circuits from the name, does not have any limiting meaning.
应用本发明实施例，该曝光电路中至少包括一个用于进行长曝光的第一像素电路和一个用于进行短曝光的第二像素电路；每个第一像素电路与图像处理器相连，接收图像处理器发送的长曝光复位信号进行长曝光；每个第二像素电路与所述图像处理器相连，接收图像处理器发送的短曝光复位信号进行短曝光，该每个第一像素电路和每个第二像素电路可以同时进行曝光，以减少两次曝光之间的时间差。Applying the embodiment of the present invention, the exposure circuit at least includes a first pixel circuit for long exposure and a second pixel circuit for short exposure; each first pixel circuit is connected to an image processor to receive an image The long exposure reset signal sent by the processor performs long exposure; each second pixel circuit is connected to the image processor, receives the short exposure reset signal sent by the image processor to perform short exposure, each first pixel circuit and each The second pixel circuit can be exposed at the same time, so as to reduce the time difference between two exposures.
在一种具体实现方式中，如图7所示，所述曝光电路对应两个第一像素电路610和两个第二像素电路620；每一像素点被平均划分为四个区域；所述两个第一像素电路610分别对应像素点一条对角线上的两个区域；所述两个第二像素电路620分别对应像素点另一条对角线上的两个区域；In a specific implementation manner, as shown in FIG. 7, the exposure circuit corresponds to two first pixel circuits 610 and two second pixel circuits 620; each pixel point is divided into four areas on average; the two The two first pixel circuits 610 respectively correspond to two areas on one diagonal line of the pixel point; the two second pixel circuits 620 respectively correspond to two areas on the other diagonal line of the pixel point;
所述两个第一像素电路的复位端相连；The reset terminals of the two first pixel circuits are connected;
所述两个第二像素电路的复位端相连。The reset terminals of the two second pixel circuits are connected.
为了使得每个像素点中曝光亮度均衡，可以将每个像素点平均划分为四个区域，其中，两个区域进行长曝光，两个区域进行短曝光。进行长曝光的两个第一像素电路610分别对应像素点一条对角线上的两个区域，进行短曝光的两个第二像素电路620分别对应像素点另一条对角线上的两个区域。并且为了保证曝光电路开始曝光的同步，两个第一像素电路610的复位端相连，两个第二像素电路620的复位端相连。并且为了减少长曝光和短曝光之间的时间差，图像处理器600可以同时向每个第一像素电路610和每个第二像素电路620发送对应的长曝光复位信号和短曝光复位信号，该每个第一像素电路610和每个第二像素电路620可以同时接收各自对应的长曝光复位信号和短曝光复位信号，进而同时开始曝光。其中，可以理解的是，复位端为复位信号输入端。In order to balance the exposure brightness in each pixel point, each pixel point can be divided into four areas on average, wherein two areas are subjected to long exposure and two areas are subjected to short exposure. The two first pixel circuits 610 for long exposure respectively correspond to two regions on one diagonal of the pixel point, and the two second pixel circuits 620 for short exposure respectively correspond to two regions on the other diagonal of the pixel point . And in order to ensure the synchronization of the exposure circuit starting exposure, the reset terminals of the two first pixel circuits 610 are connected, and the reset terminals of the two second pixel circuits 620 are connected. And in order to reduce the time difference between the long exposure and the short exposure, the image processor 600 can simultaneously send a corresponding long exposure reset signal and a short exposure reset signal to each first pixel circuit 610 and each second pixel circuit 620, each Each of the first pixel circuits 610 and each of the second pixel circuits 620 can receive their corresponding long exposure reset signal and short exposure reset signal at the same time, and then start exposure at the same time. Wherein, it can be understood that the reset terminal is a reset signal input terminal.
另外，上述实施例仅作为本发明的一种示例，像素点还可以被平均划分为二个区域、八个区域或十个区域等等，这都是可以的。In addition, the above-mentioned embodiment is only an example of the present invention, and the pixel points may be evenly divided into two areas, eight areas or ten areas, etc., which are all possible.
在一种具体实现方式中，所述两个第一像素电路610的第一列线相连，所述两个第一像素电路610的第一行选通信号线相连；In a specific implementation manner, the first column lines of the two first pixel circuits 610 are connected, and the first row gate signal lines of the two first pixel circuits 610 are connected;
所述两个第二像素电路620的第二列线相连，所述两个第二像素电路620的第二行选通信号线相连。The second column lines of the two second pixel circuits 620 are connected, and the second row gate signal lines of the two second pixel circuits 620 are connected.
其中，对于每个第一像素电路610来说，由于每个第一像素电路610所对应的像素点的曝光位置不同，其进行长曝光后，可以共同组成长曝光信号，该两个第一像素电路610的第一列线相连，对所得到的长曝光信号作为一个完整结果进行输出。同理的，对于每个第二像素电路620来说，由于每个第二像素电路620所对应的像素点的曝光位置不同，其进行短曝光后，可以共同组成短曝光信号，该两个第二像素电路620的第二列线相连，对所得到的短曝光信号作为一个完整结果进行输出。Wherein, for each first pixel circuit 610, since the exposure positions of the pixels corresponding to each first pixel circuit 610 are different, after long exposure, they can jointly form a long exposure signal, and the two first pixels The first column lines of the circuit 610 are connected to output the obtained long exposure signal as a complete result. Similarly, for each second pixel circuit 620, since the exposure positions of the pixel points corresponding to each second pixel circuit 620 are different, after short exposure, they can jointly form a short exposure signal, and the two second pixel circuits 620 The second column lines of the two-pixel circuit 620 are connected to output the obtained short exposure signal as a complete result.
其中，由现有技术可知，通过行选通信号启动选址开关后，长曝光信号(或短曝光信号)才会从第一列线(第二列线)输出。为了保证每个曝光电路中所形成的曝光信号能够同时输出该两个第一像素电路610的第一行选通信号线可以相连，该两个第二像素电路620的第二行选通信号线可以相连。Wherein, it is known from the prior art that the long exposure signal (or short exposure signal) will be output from the first column line (second column line) after the address switch is activated by the row select signal. In order to ensure that the exposure signal formed in each exposure circuit can be output simultaneously, the first row gate signal lines of the two first pixel circuits 610 can be connected, and the second row gate signal lines of the two second pixel circuits 620 can be connected.
在一种具体实现方式中，如图7所示，本发明实施例所提供的一种曝光电路中所包含的每一第一像素电路610和每一第二像素电路620的电路结构可以与传统的像素电路的电路结构相同。所述第一像素电路610中包括第一光电二极管PD1、第一源极跟随器T1和第一选址开关T2；In a specific implementation manner, as shown in FIG. 7 , the circuit structure of each first pixel circuit 610 and each second pixel circuit 620 included in an exposure circuit provided by an embodiment of the present invention can be compared with the traditional The circuit structure of the pixel circuit is the same. The first pixel circuit 610 includes a first photodiode PD1, a first source follower T1 and a first address switch T2;
所述第一光电二极管PD1，用于在所述第一像素电路610接收到所述图像处理器600发送的长曝光复位信号后，将输出电压置0，并吸收光信号进行第一有效电荷的累计；The first photodiode PD1 is used to set the output voltage to 0 after the first pixel circuit 610 receives the long-exposure reset signal sent by the image processor 600, and absorb the light signal to perform the first effective charge generation. Grand total;
所述第一源极跟随器T1，用于将所述第一光电二极管PD1所累计的第一有效光电荷转换成第一模拟电压信号；The first source follower T1 is configured to convert the first effective photocharge accumulated by the first photodiode PD1 into a first analog voltage signal;
所述第一选址开关T2，用于在接收到所述图像处理器600发送的第一行选通信号后，将所述第一源极跟随器T1所转换的所述第一模拟电压信号通过第一列线输出；The first address selection switch T2 is configured to convert the first analog voltage signal converted by the first source follower T1 to output through the first column line;
所述第二像素电路中包括第二光电二极管PD2、第二源极跟随器T3和第二选址开关T4；The second pixel circuit includes a second photodiode PD2, a second source follower T3 and a second address switch T4;
所述第二光电二极管PD2，用于在所述第二像素电路620接收到所述图像处理器600发送的短曝光复位信号后，将输出电压置0，并吸收光信号进行第二有效电荷的累计；The second photodiode PD2 is used to set the output voltage to 0 after the second pixel circuit 620 receives the short-exposure reset signal sent by the image processor 600, and absorb the light signal to perform the second effective charge generation. Grand total;
所述第二源极跟随器T3，用于将所述第二光电二极管PD2所累计的第二有效光电荷转换成第二模拟电压信号；The second source follower T3 is configured to convert the second effective photocharge accumulated by the second photodiode PD2 into a second analog voltage signal;
所述第二选址开关T4，用于在接收到所述图像处理器600发送的第二行选通信号后，将所述第二源极跟随器T3所转换的所述第二模拟电压信号通过第二列线输出。The second address selection switch T4 is configured to convert the second analog voltage signal converted by the second source follower T3 to output via the second column line.
其中，每个第一像素电路610和每个第二像素电路620的曝光时间可以通过图像处理器600控制。以第一像素电路610为例：第一像素电路610接收图像处理器600发送的长曝光复位信号后，开始进行长曝光。并且，每个第一像素电路610和每个第二像素电路620的输出各自的曝光信号的时间也可以通过图像处理器600控制。以第一像素电路610为例：第一像素电路610接收图像处理器600发送的第一行选通信号后，将所述第一源极跟随器T1所转换的所述第一模拟电压信号通过对应的第一列线输出。Wherein, the exposure time of each first pixel circuit 610 and each second pixel circuit 620 can be controlled by the image processor 600 . Taking the first pixel circuit 610 as an example: the first pixel circuit 610 starts long exposure after receiving the long exposure reset signal sent by the image processor 600 . In addition, the timing of each first pixel circuit 610 and each second pixel circuit 620 outputting a respective exposure signal can also be controlled by the image processor 600 . Taking the first pixel circuit 610 as an example: after the first pixel circuit 610 receives the first row strobe signal sent by the image processor 600, the first analog voltage signal converted by the first source follower T1 is passed through corresponding to the first column line output.
为了保证每个第一像素电路610和每个第二像素电路620所形成的曝光信号可以同时输出，图像处理器600可以同时发送的第一行选通信号和第二行选通信号。这也是可以的。另外，在一种具体实现中，第一行选通信号和第二行选通信号可以相同，也可以不同，该第一行选通信号和第二行选通信号可以均为行选通脉冲RS，其中，第一行选通信号(第二行选通信号)可以为高电平有效，即高电平时第一选址开关(第二选址开关)开启；也可以是低电平有效，即低电平时第一选址开关(第二选址开关)开启；或者第一行选通信号或第二行选通信号一个高电平有效一个低电平有效，这也是可以的。In order to ensure that the exposure signals formed by each first pixel circuit 610 and each second pixel circuit 620 can be output at the same time, the image processor 600 can simultaneously send the first row strobe signal and the second row strobe signal. This is also possible. In addition, in a specific implementation, the first row strobe signal and the second row strobe signal can be the same or different, and the first row strobe signal and the second row strobe signal can both be row strobe pulses RS, wherein the first row strobe signal (second row strobe signal) can be active at high level, that is, the first address selection switch (second address selection switch) is turned on at high level; it can also be active at low level , that is, the first address selection switch (second address selection switch) is turned on when the level is low; or the first row strobe signal or the second row strobe signal is active at a high level and active at a low level, which is also possible.
需要强调的是，当每个第一像素电路610和每个第二像素电路620复位后，将输出电压置0，由于电路中各器件的影响，可能会存在实际电压的偏移，此时需要对有效电荷进行累计，避免偏移的电压对曝光信号的影响。It should be emphasized that after each first pixel circuit 610 and each second pixel circuit 620 are reset, the output voltage is set to 0. Due to the influence of each device in the circuit, there may be an offset of the actual voltage. At this time, it is necessary to The effective charge is accumulated to avoid the influence of the offset voltage on the exposure signal.
在一种具体实现方式中，如图7所示，所述第一像素电路610中还可以包括第一模/数转换器；In a specific implementation manner, as shown in FIG. 7, the first pixel circuit 610 may further include a first analog-to-digital converter;
所述第一模/数转换器，用于将所述第一模拟电压信号转换成第一数字信号；The first analog-to-digital converter is configured to convert the first analog voltage signal into a first digital signal;
所述第二像素电路620中还可以包括第二模/数转换器；The second pixel circuit 620 may further include a second analog/digital converter;
所述第二模/数转换器，用于将所述第二模拟电压信号转换成第二数字信号。The second A/D converter is used to convert the second analog voltage signal into a second digital signal.
进一步的，所述第一模拟电压信号(第二模拟电压信号)通过对应的第一列线(第二列线)输出后，可以直接输入至连接的第一模/数转换器(第二模/数转换器)中，通过第一模/数转换器(第二模/数转换器)将第一模拟电压信号(第二模拟电压信号)转换成第一数字信号(第二数字信号)再输出至图像处理器600。或者，可以直接输入图像处理器600，进行后续的图像处理流程。Further, after the first analog voltage signal (second analog voltage signal) is output through the corresponding first column line (second column line), it can be directly input to the connected first analog/digital converter (second analog In the digital/digital converter), the first analog voltage signal (second analog voltage signal) is converted into the first digital signal (second digital signal) by the first analog/digital converter (second analog/digital converter) and then output to the image processor 600. Alternatively, it can be directly input to the image processor 600 for subsequent image processing.
其中，该第一模/数转换器(第二模/数转换器)接入本发明实施例所提供的曝光电路的输出端。其中，如图7所示，第一模/数转换器和第二模/数转换器均可以用A/D转换器表示。Wherein, the first A/D converter (the second A/D converter) is connected to the output end of the exposure circuit provided by the embodiment of the present invention. Wherein, as shown in FIG. 7 , both the first A/D converter and the second A/D converter can be represented by A/D converters.
应用本发明实施例，每个第一像素电路和每个第二像素电路可以同时进行曝光，以减少两次曝光之间的时间差，并且可以实现同时对第一模拟电压信号和第二模拟电压信号进行模/数转换。Applying the embodiment of the present invention, each first pixel circuit and each second pixel circuit can be exposed at the same time, so as to reduce the time difference between two exposures, and can realize the simultaneous detection of the first analog voltage signal and the second analog voltage signal Perform analog/digital conversion.
对于系统/装置实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。As for the system/apparatus embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to part of the description of the method embodiments.
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. There is no such actual relationship or order between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
本领域普通技术人员可以理解实现上述方法实施方式中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，所述的程序可以存储于计算机可读取存储介质中，这里所称得的存储介质，如：ROM/RAM、磁碟、光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the implementation of the above method can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, referred to herein as Storage media, such as: ROM/RAM, disk, CD, etc.
以上所述仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内所作的任何修改、等同替换、改进等，均包含在本发明的保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610720722.3ACN107786814B (en) | 2016-08-24 | 2016-08-24 | A wide dynamic-based image processing method, device and exposure circuit |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610720722.3ACN107786814B (en) | 2016-08-24 | 2016-08-24 | A wide dynamic-based image processing method, device and exposure circuit |
| Publication Number | Publication Date |
|---|---|
| CN107786814Atrue CN107786814A (en) | 2018-03-09 |
| CN107786814B CN107786814B (en) | 2023-08-04 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610720722.3AActiveCN107786814B (en) | 2016-08-24 | 2016-08-24 | A wide dynamic-based image processing method, device and exposure circuit |
| Country | Link |
|---|---|
| CN (1) | CN107786814B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495055A (en)* | 2018-04-10 | 2018-09-04 | 中国科学院长春光学精密机械与物理研究所 | Obtain the method and system of more exposure images for high dynamic range imaging |
| CN110460781A (en)* | 2019-08-26 | 2019-11-15 | Oppo广东移动通信有限公司 | Image sensor, image processing method and storage medium |
| CN111491110A (en)* | 2020-04-17 | 2020-08-04 | Oppo广东移动通信有限公司 | High dynamic range image processing system and method, electronic device and storage medium |
| CN111917994A (en)* | 2019-05-10 | 2020-11-10 | 三星电子株式会社 | Method and apparatus for combining image frames captured using different exposure settings into a hybrid image |
| CN114513610A (en)* | 2020-11-17 | 2022-05-17 | 浙江大华技术股份有限公司 | Image processing method, image processing apparatus, and storage apparatus |
| WO2022140897A1 (en)* | 2020-12-28 | 2022-07-07 | 深圳元戎启行科技有限公司 | Image generation method and apparatus, and computer device and storage medium |
| CN116095502A (en)* | 2023-04-13 | 2023-05-09 | 芯动微电子科技(珠海)有限公司 | Method and device for fusing multiple exposure images |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001016499A (en)* | 1999-06-29 | 2001-01-19 | Hitachi Ltd | Wide dynamic range imaging device |
| KR20080104725A (en)* | 2007-05-29 | 2008-12-03 | 한국과학기술연구원 | Image signal processing method with wide dynamic range using physical characteristics of image sensor |
| KR20090048191A (en)* | 2007-11-09 | 2009-05-13 | 주식회사 쎄이미지 | Color image processing apparatus and method for extending the dynamic range |
| US20110063483A1 (en)* | 2009-09-16 | 2011-03-17 | Altasens, Inc. | Image sensor with wide dynamic range |
| CN102075688A (en)* | 2010-12-28 | 2011-05-25 | 青岛海信网络科技股份有限公司 | Wide dynamic processing method for single-frame double-exposure image |
| CN102098444A (en)* | 2009-12-10 | 2011-06-15 | 三星电子株式会社 | Multi-step exposure method using electronic shutter and photography apparatus using the same |
| JP2011244351A (en)* | 2010-05-20 | 2011-12-01 | Fujifilm Corp | Imaging apparatus and drive control method of solid state image sensor |
| US20130033616A1 (en)* | 2011-08-04 | 2013-02-07 | Sony Corporation | Imaging device, image processing method and program |
| US20130051700A1 (en)* | 2011-08-31 | 2013-02-28 | Sony Corporation | Image processing apparatus, image processing method, and program |
| JP2013066145A (en)* | 2011-08-31 | 2013-04-11 | Sony Corp | Image processing apparatus, image processing method, and program |
| US20130208138A1 (en)* | 2012-02-09 | 2013-08-15 | Aptina Imaging Corporation | Imaging systems and methods for generating auto-exposed high-dynamic-range images |
| CN103685995A (en)* | 2012-09-13 | 2014-03-26 | 株式会社东芝 | camera device |
| CN104639920A (en)* | 2013-11-13 | 2015-05-20 | 上海微锐智能科技有限公司 | Wide dynamic fusion method based on single-frame double-pulse exposure mode |
| US20150163423A1 (en)* | 2013-12-11 | 2015-06-11 | Himax Imaging, Inc. | Image sensor and pixel arrary |
| KR20150124381A (en)* | 2014-04-28 | 2015-11-05 | 삼성전자주식회사 | Image processing device and mobile computing device having same |
| CN205945977U (en)* | 2016-08-24 | 2017-02-08 | 杭州海康威视数字技术股份有限公司 | Exposure circuit |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001016499A (en)* | 1999-06-29 | 2001-01-19 | Hitachi Ltd | Wide dynamic range imaging device |
| KR20080104725A (en)* | 2007-05-29 | 2008-12-03 | 한국과학기술연구원 | Image signal processing method with wide dynamic range using physical characteristics of image sensor |
| KR20090048191A (en)* | 2007-11-09 | 2009-05-13 | 주식회사 쎄이미지 | Color image processing apparatus and method for extending the dynamic range |
| US20110063483A1 (en)* | 2009-09-16 | 2011-03-17 | Altasens, Inc. | Image sensor with wide dynamic range |
| CN102098444A (en)* | 2009-12-10 | 2011-06-15 | 三星电子株式会社 | Multi-step exposure method using electronic shutter and photography apparatus using the same |
| JP2011244351A (en)* | 2010-05-20 | 2011-12-01 | Fujifilm Corp | Imaging apparatus and drive control method of solid state image sensor |
| CN102075688A (en)* | 2010-12-28 | 2011-05-25 | 青岛海信网络科技股份有限公司 | Wide dynamic processing method for single-frame double-exposure image |
| US20130033616A1 (en)* | 2011-08-04 | 2013-02-07 | Sony Corporation | Imaging device, image processing method and program |
| US20130051700A1 (en)* | 2011-08-31 | 2013-02-28 | Sony Corporation | Image processing apparatus, image processing method, and program |
| JP2013066145A (en)* | 2011-08-31 | 2013-04-11 | Sony Corp | Image processing apparatus, image processing method, and program |
| US20130208138A1 (en)* | 2012-02-09 | 2013-08-15 | Aptina Imaging Corporation | Imaging systems and methods for generating auto-exposed high-dynamic-range images |
| CN103685995A (en)* | 2012-09-13 | 2014-03-26 | 株式会社东芝 | camera device |
| CN104639920A (en)* | 2013-11-13 | 2015-05-20 | 上海微锐智能科技有限公司 | Wide dynamic fusion method based on single-frame double-pulse exposure mode |
| US20150163423A1 (en)* | 2013-12-11 | 2015-06-11 | Himax Imaging, Inc. | Image sensor and pixel arrary |
| KR20150124381A (en)* | 2014-04-28 | 2015-11-05 | 삼성전자주식회사 | Image processing device and mobile computing device having same |
| CN205945977U (en)* | 2016-08-24 | 2017-02-08 | 杭州海康威视数字技术股份有限公司 | Exposure circuit |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108495055B (en)* | 2018-04-10 | 2019-11-08 | 中国科学院长春光学精密机械与物理研究所 | Method and system for acquiring multi-exposure images for high dynamic range imaging |
| CN108495055A (en)* | 2018-04-10 | 2018-09-04 | 中国科学院长春光学精密机械与物理研究所 | Obtain the method and system of more exposure images for high dynamic range imaging |
| CN111917994A (en)* | 2019-05-10 | 2020-11-10 | 三星电子株式会社 | Method and apparatus for combining image frames captured using different exposure settings into a hybrid image |
| CN113709382A (en)* | 2019-08-26 | 2021-11-26 | Oppo广东移动通信有限公司 | Image sensor, image processing method and storage medium |
| CN110460781A (en)* | 2019-08-26 | 2019-11-15 | Oppo广东移动通信有限公司 | Image sensor, image processing method and storage medium |
| CN113709382B (en)* | 2019-08-26 | 2024-05-31 | Oppo广东移动通信有限公司 | Image sensor, image processing method and storage medium |
| CN110460781B (en)* | 2019-08-26 | 2021-10-12 | Oppo广东移动通信有限公司 | Image sensor, image processing method and storage medium |
| CN111491110A (en)* | 2020-04-17 | 2020-08-04 | Oppo广东移动通信有限公司 | High dynamic range image processing system and method, electronic device and storage medium |
| WO2021208593A1 (en)* | 2020-04-17 | 2021-10-21 | Oppo广东移动通信有限公司 | High dynamic range image processing system and method, electronic device, and storage medium |
| CN111491110B (en)* | 2020-04-17 | 2021-09-17 | Oppo广东移动通信有限公司 | High dynamic range image processing system and method, electronic device, and storage medium |
| CN114513610A (en)* | 2020-11-17 | 2022-05-17 | 浙江大华技术股份有限公司 | Image processing method, image processing apparatus, and storage apparatus |
| WO2022140897A1 (en)* | 2020-12-28 | 2022-07-07 | 深圳元戎启行科技有限公司 | Image generation method and apparatus, and computer device and storage medium |
| CN116095502A (en)* | 2023-04-13 | 2023-05-09 | 芯动微电子科技(珠海)有限公司 | Method and device for fusing multiple exposure images |
| Publication number | Publication date |
|---|---|
| CN107786814B (en) | 2023-08-04 |
| Publication | Publication Date | Title |
|---|---|---|
| CN107786814B (en) | A wide dynamic-based image processing method, device and exposure circuit | |
| CN109076169B (en) | Method, apparatus, and computer-readable medium for capturing color image data | |
| US8508619B2 (en) | High dynamic range image generating apparatus and method | |
| US8391629B2 (en) | Method and apparatus for image noise reduction using noise models | |
| CN104038702B (en) | Picture pick-up device and its control method | |
| CN102077572A (en) | Method and apparatus for motion blur and ghosting prevention in imaging system | |
| US11941791B2 (en) | High-dynamic-range image generation with pre-combination denoising | |
| JP2015033107A (en) | Image processing apparatus, image processing method, and electronic apparatus | |
| JP2011014966A (en) | Image processing device, image processing method, image capturing device, and computer program | |
| US10397473B2 (en) | Image processing apparatus having an image synthesis unit that generates synthesized image data depending on an object brightness, and related image-pickup apparatus | |
| JP2008263522A (en) | Image processing apparatus and method | |
| US9350920B2 (en) | Image generating apparatus and method | |
| US9282256B1 (en) | System and method for HDR imaging | |
| JP2014143498A (en) | Solid-state imaging device | |
| CN105100601A (en) | Camera device, control method thereof, and signal processing device | |
| CN105430360B (en) | imaging method, image sensor, imaging device and electronic device | |
| JP2016134862A (en) | Imaging device, imaging method, image display device, and program | |
| CN111726530B (en) | A method, device and equipment for acquiring multiple video streams | |
| WO2023070660A1 (en) | Image processing method and device | |
| JP7134786B2 (en) | Imaging device and control method | |
| TW201518852A (en) | Image processing device and exposure control method | |
| JP2020115604A (en) | Imaging device and control method thereof | |
| JP4932460B2 (en) | Smear correction method and smear correction unit | |
| JP7669404B2 (en) | IMAGING APPARATUS, PROCESSING METHOD AND PROGRAM FOR IMAGING APPARATUS | |
| US9325916B2 (en) | Cinematic image blur in digital cameras based on exposure timing manipulation |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |