技术领域technical field
本发明关于一种影像处理，特别是一种关于红外线IR信号的影像处理装置及方法。The present invention relates to image processing, in particular to an image processing device and method for infrared IR signals.
背景技术Background technique
传统RGB感测器在低光源的环境具有感光度不足的限制，现今一般监视应用等级的影像获取装置使用红外截止滤波器(IR Cut Filter)，分别在日间模式输出RGB彩色影像及夜晚模式打开人眼看不到的红外线(IR)主动光源借此输出亮度充足的IR影像。然而，机械性的红外截止滤波器装置本身容易因为使用过度而损坏，体积及成本也是相对的增大。近年来，由于IR影像逐渐被应用于人脸辨识、瞳孔辨识、深度辨识，如何在有限的机构空间加入IR影像特色，需求便转向新型的混合型RGBIr感测器。Traditional RGB sensors have insufficient sensitivity in low-light environments. Today’s general surveillance application-level image acquisition devices use IR cut filters to output RGB color images in day mode and night mode. Infrared (IR) active light sources invisible to the human eye thereby output IR images with sufficient brightness. However, the mechanical infrared cut filter device itself is easily damaged due to excessive use, and the volume and cost are relatively increased. In recent years, as IR images have been gradually applied to face recognition, pupil recognition, and depth recognition, the demand for adding IR image features to a limited institutional space has shifted to a new type of hybrid RGBIr sensor.
因为不再使用红外截止滤波器，所以当环境光线中有IR成分时，都会通过混合型RGBIr滤波阵列中的IR像素吸收感光，然而在R/G/B/IR光谱中，本身就会有重叠的状况。现今的感测器制造技术并无法完全的阻隔吸收非来自颜色信号，因此在具有高度IR成分的光能量时，物体颜色就会受到IR串音干扰(Crosstalk)影响发生色彩偏移的色彩流失(colorwashout)现象。Because the infrared cut filter is no longer used, when there is an IR component in the ambient light, it will be absorbed by the IR pixel in the hybrid RGBIr filter array. However, in the R/G/B/IR spectrum, there will be overlap status. Today's sensor manufacturing technology cannot completely block the absorption of non-color signals, so when the light energy with a high IR component is present, the color of the object will be affected by IR crosstalk (Crosstalk) and cause color loss (color shift) colorwashout) phenomenon.
发明内容Contents of the invention
本发明提出的影像处理装置及方法可以降低RGB彩色影像受到IR串音干扰的影响，也可以改善RGB彩色影像色彩偏移而造成色彩流失的现象。The image processing device and method proposed by the present invention can reduce the influence of RGB color images from IR crosstalk interference, and can also improve the phenomenon of color loss caused by color shift of RGB color images.
本发明实施例提供一种影像处理装置，包括：一感测器，包括多个像素点，每一像素点用以感测一影像的三原色光及一红外光；以及一处理器，连接该感测器；其中，该处理器根据该三原色光对该红外光的串音干扰以计算在无该三原色光的串音干扰下该红外光的一真实响应值；其中，该处理器根据该红外光的该真实响应值对该三原色光的串音干扰以计算在无该红外光的串音干扰下该三原色光的一真实响应值；其中，该处理器根据该红外光的该真实响应值的亮度与该三原色光的该真实响应值以增强该影像的亮度。An embodiment of the present invention provides an image processing device, including: a sensor, including a plurality of pixels, each pixel is used to sense the three primary colors of an image and an infrared light; and a processor, connected to the sensor detector; wherein, the processor calculates a real response value of the infrared light without the crosstalk interference of the three primary color lights according to the crosstalk interference of the three primary color lights; wherein, the processor calculates a real response value of the infrared light according to the infrared light The crosstalk interference of the real response value of the three primary colors of light to calculate a real response value of the three primary colors of light without the crosstalk interference of the infrared light; wherein, the processor is based on the brightness of the real response value of the infrared light The true response value of the three primary colors to enhance the brightness of the image.
本发明实施例提供另一种影像处理装置，包括：一感测器，包括多个像素点，每一像素点用以感测一影像的三原色光及一红外光；以及一处理器，连接该感测器，该处理器根据每一原色光对该红外光的一串音干扰程度参数以计算对应该原色光的该红外光的一第一串音响应值、根据该三原色光的该第一串音响应值与该三原色光对该红外光的一串音干扰比重以计算该红外光的一第二串音响应值、以及将该第二串音响应值减去一干扰响应值以取得在无该三原色光的串音干扰下该红外光的一真实响应值。An embodiment of the present invention provides another image processing device, including: a sensor, including a plurality of pixels, each pixel is used to sense three primary colors of an image and an infrared light; and a processor, connected to the The sensor, the processor calculates a first crosstalk response value of the infrared light corresponding to the primary color light according to a crosstalk interference degree parameter of each primary color light to the infrared light, and calculates a first crosstalk response value of the infrared light corresponding to the primary color light, and according to the first Crosstalk response value and a crosstalk interference ratio of the three primary colors to the infrared light to calculate a second crosstalk response value of the infrared light, and subtract an interference response value from the second crosstalk response value to obtain the A real response value of the infrared light without the crosstalk interference of the three primary color lights.
本发明实施例提供又一种影像处理装置，包括：一感测器，包括多个像素点，每一像素点用以感测一影像的三原色光及一红外光；以及一处理器，连接该感测器，该处理器根据该红外光的一真实响应值对每一原色光的一距离响应参数以计算该原色光的一第一串音响应值、根据该影像的一影像位元长度与该原色光的该距离响应参数以计算该原色光的一映射比例、以及根据该原色光的该第一串音响应值与该映射比例以取得在无该红外光的串音干扰下该原色光的一真实响应值。An embodiment of the present invention provides yet another image processing device, including: a sensor, including a plurality of pixels, each pixel is used to sense three primary colors of an image and an infrared light; and a processor, connected to the The sensor, the processor calculates a first crosstalk response value of the primary color light based on a real response value of the infrared light to a distance response parameter of each primary color light, and a video bit length and The distance response parameter of the primary color light is used to calculate a mapping ratio of the primary color light, and according to the first crosstalk response value of the primary color light and the mapping ratio, the primary color light can be obtained without the crosstalk interference of the infrared light A real response value of .
本发明实施例提供再一种影像处理装置，包括：一感测器，包括多个像素点，每一像素点用以感测一影像的三原色光及一红外光；以及一处理器，连接该感测器，该处理器计算一第一比例的该红外光的一真实响应值以取得一第一亮度分量、计算一第二比例的该红外线的该真实响应值以取得一第二亮度分量、依据该第二亮度分量与每一原色光的一真实响应值对该影像的一影像位元长度的比例以取得一第三亮度分量、以及将该原色光的该真实响应值、该第一亮度分量、及该第三亮度分量相加以增强该影像的亮度。An embodiment of the present invention provides another image processing device, including: a sensor, including a plurality of pixels, each pixel is used to sense the three primary colors of an image and an infrared light; and a processor, connected to the a sensor, the processor calculates a real response value of a first proportion of the infrared light to obtain a first brightness component, calculates a second proportion of the real response value of the infrared light to obtain a second brightness component, A third brightness component is obtained according to the ratio of the second brightness component to a real response value of each primary color light to an image bit length of the image, and the real response value of the primary color light, the first brightness component, and the third brightness component to enhance the brightness of the image.
本发明实施例提供一种影像处理方法，应用于一装置，该装置包括一感测器及连接该感测器的一处理器，该感测器包括多个像素点，每一像素点用以感测一影像的三原色光及一红外光，该处理器执行该影像处理方法包括：根据该三原色光对该红外光的串音干扰以计算在无该三原色光的串音干扰下该红外光的一真实响应值；根据该红外光的该真实响应值对该三原色光的串音干扰以计算在无该红外光的串音干扰下该三原色光的一真实响应值；以及根据该红外光的该真实响应值的亮度与该三原色光的该真实响应值以增强该影像的亮度。An embodiment of the present invention provides an image processing method applied to a device, the device includes a sensor and a processor connected to the sensor, the sensor includes a plurality of pixels, each pixel is used for Sensing three primary color lights and one infrared light of an image, the processor executing the image processing method includes: calculating the infrared light without the crosstalk interference of the three primary color lights according to the crosstalk interference of the three primary color lights to the infrared light A real response value; according to the crosstalk interference of the three primary colors of light by the real response value of the infrared light to calculate a real response value of the three primary colors of light without the crosstalk interference of the infrared light; and according to the crosstalk interference of the infrared light The brightness of the real response value and the real response value of the three primary colors are used to enhance the brightness of the image.
本发明提出的影像处理装置及方法可修正镜头的角度偏移(angular shift)现象以重建色彩误差、可消除硬件暗电流效应以准确还原色彩表现、可补偿RGB色彩的响应值动态范围以减少色偏现象、以及在低光源环境下仍可通过IR主动光源以增强RGB彩色影像的亮度。The image processing device and method proposed by the present invention can correct the angular shift phenomenon of the lens to reconstruct the color error, can eliminate the hardware dark current effect to accurately restore the color performance, and can compensate the dynamic range of the RGB color response value to reduce the color error. Offset phenomenon, and the IR active light source can still be used to enhance the brightness of RGB color images in low light source environments.
为了能更进一步了解本发明为实现既定目的所采取的技术、方法及技术效果，请参阅以下有关本发明的详细说明、附图，相信本发明的目的、特征与特点，当可由此得以深入且具体的了解，然而说明书附图仅提供参考与说明用，并非用来对本发明加以限制者。In order to further understand the technology, method and technical effect that the present invention takes to achieve the intended purpose, please refer to the following detailed description and accompanying drawings of the present invention, and believe that the purpose, characteristics and characteristics of the present invention can be deepened and For specific understanding, however, the accompanying drawings in the description are provided for reference and illustration only, and are not used to limit the present invention.
附图说明Description of drawings
图1是本发明一实施例的影像处理装置示意图。FIG. 1 is a schematic diagram of an image processing device according to an embodiment of the present invention.
图2是本发明一实施例的影像处理方法示意图。FIG. 2 is a schematic diagram of an image processing method according to an embodiment of the present invention.
图3是本发明另一实施例的影像处理方法示意图。FIG. 3 is a schematic diagram of an image processing method according to another embodiment of the present invention.
图4是本发明又一实施例的影像处理方法示意图。FIG. 4 is a schematic diagram of an image processing method according to another embodiment of the present invention.
图5是本发明再一实施例的影像处理方法示意图。FIG. 5 is a schematic diagram of an image processing method according to another embodiment of the present invention.
附图标记说明：Explanation of reference signs:
1 影像处理装置1 Image processing device
2 感测器2 sensors
3 处理器3 processors
4 红外光源发射器4 Infrared light source emitters
S101、S103、S105、S301、S303、S305、S501、S503、S505、S701、S703、S705、S707 步骤S101, S103, S105, S301, S303, S305, S501, S503, S505, S701, S703, S705, S707 steps
具体实施方式Detailed ways
在下文将参看说明书附图更充分地描述各种例示性实施例，在说明书附图中展示一些例示性实施例。然而，本发明概念可能以许多不同形式来体现，且不应解释为限于本文中所阐述的例示性实施例。确切而言，提供这些例示性实施例使得本发明将为详尽且完整，且将向熟习此项技术者充分传达本发明概念的实施方式。在诸附图中，可为了清楚而夸示层及区的大小及相对大小。类似数字始终指示类似元件。Various exemplary embodiments will be described more fully hereinafter with reference to the accompanying drawings, in which some exemplary embodiments are shown. However, inventive concepts may be embodied in many different forms and should not be construed as limited to the illustrative embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the implementation of the inventive concept to those skilled in the art. In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Like numbers indicate like elements throughout.
应理解，虽然本文中可能使用术语第一、第二、第三等来描述各种元件或信号等，但这些元件或信号不应受这些术语限制。这些术语乃用以区分一元件与另一元件，或者一信号与另一信号。另外，如本文中所使用，术语「或」视实际情况可能包括相关联的列出项目中的任一者或者多者的所有组合。It should be understood that although the terms first, second, third etc. may be used herein to describe various elements or signals etc., these elements or signals should not be limited by these terms. These terms are used to distinguish one element from another element, or one signal from another signal. In addition, as used herein, the term "or" may include any one or all combinations of more of the associated listed items depending on the actual situation.
图1是本发明一实施例的影像处理装置示意图。本发明的影像处理装置1包括：感测器2、处理器3、及红外光源发射器4，其中处理器3连接感测器2及红外光源发射器4。感测器2包括多个像素点，感测器2用以感测影像，像素点用以感测影像的三原色光(RGBcolors)及红外光(IR ray)，其中像素点可为阵列或任意排列方式，本发明不以此为限。处理器3用以执行影像处理方法。红外光源发射器4用以发射IR主动光源。FIG. 1 is a schematic diagram of an image processing device according to an embodiment of the present invention. The image processing device 1 of the present invention includes: a sensor 2 , a processor 3 , and an infrared light source emitter 4 , wherein the processor 3 is connected to the sensor 2 and the infrared light source emitter 4 . The sensor 2 includes a plurality of pixels, the sensor 2 is used to sense images, and the pixels are used to sense the three primary colors (RGB colors) and infrared light (IR ray) of the image, where the pixels can be arrayed or arranged arbitrarily way, the present invention is not limited thereto. The processor 3 is used for executing the image processing method. The infrared light source transmitter 4 is used for emitting an IR active light source.
图2是本发明一实施例的影像处理方法示意图。当在环境光源充足的情况下，感测器2感测影像的三原色光RGB及红外光IR以便处理器3执行影像处理方法。当在环境光源不足的情况下，红外光源发射器4发射IR主动光源以使得物件得以反射红外光IR，而感测器2感测影像的三原色光RGB及红外光IR以便处理器3执行影像处理方法。处理器3执行影像处理方法包括：S101：根据三原色光RGB对红外光IR的串音干扰(crosstalk)计算在无三原色光RGB的串音干扰下红外光IR的真实响应值(true responsevalue)以便输出IR影像；S103：根据红外光IR的真实响应值对三原色光RGB的串音干扰计算在无红外光IR的串音干扰下三原色光RGB的真实响应值以便输出RGB影像；以及S105：根据红外光IR的真实响应值的亮度与三原色光RGB的真实响应值增强影像的亮度以便输出增强型RGB影像。FIG. 2 is a schematic diagram of an image processing method according to an embodiment of the present invention. When the ambient light source is sufficient, the sensor 2 senses the three primary colors RGB and the infrared light IR of the image so that the processor 3 executes the image processing method. When the ambient light source is insufficient, the infrared light source emitter 4 emits the IR active light source so that the object can reflect the infrared light IR, and the sensor 2 senses the three primary colors RGB and the infrared light IR of the image so that the processor 3 performs image processing method. The image processing method performed by the processor 3 includes: S101: Calculate the true response value (true response value) of the infrared light IR without the crosstalk of the three primary colors RGB to the infrared light IR according to the crosstalk of the three primary colors RGB for output IR image; S103: calculate the real response value of the three primary colors RGB without the crosstalk interference of the infrared light IR according to the crosstalk interference of the infrared light IR to output the RGB image; and S105: according to the infrared light The brightness of the real response value of the IR and the real response value of the three primary colors RGB enhance the brightness of the image so as to output the enhanced RGB image.
图3是本发明另一实施例的影像处理方法示意图。步骤S101中，处理器3根据三原色光RGB对红外光IR的串音干扰以计算在无三原色光RGB的串音干扰下红外光IR的真实响应值包括：S301：根据每一原色光对红外光IR的串音干扰程度参数以计算对应每一原色光的红外光IR的第一串音响应值；S303：根据三原色光RGB的第一串音响应值与三原色光RGB对红外光IR的一串音干扰比重以计算红外光IR的第二串音响应值；以及S305：将第二串音响应值减去一干扰响应值以取得在无三原色光RGB的串音干扰下红外光IR的真实响应值。FIG. 3 is a schematic diagram of an image processing method according to another embodiment of the present invention. In step S101, the processor 3 calculates the real response value of the infrared light IR without the crosstalk interference of the three primary color lights RGB according to the crosstalk interference of the three primary color lights RGB to the infrared light IR, including: S301: According to each primary color light to the infrared light The crosstalk interference degree parameter of IR is used to calculate the first crosstalk response value of the infrared light IR corresponding to each primary color light; S303: According to the first crosstalk response value of the three primary color light RGB and a string of the three primary color light RGB to the infrared light IR Sound interference proportion to calculate the second crosstalk response value of the infrared light IR; and S305: subtracting an interference response value from the second crosstalk response value to obtain the real response of the infrared light IR without the crosstalk interference of the three primary color lights RGB value.
处理器3计算在无三原色光RGB的串音干扰下红外光IR的真实响应值的方程式如下表示。The equation for the processor 3 to calculate the real response value of the infrared light IR without the crosstalk interference of the three primary colors RGB is expressed as follows.
IRcrosstalk_R＝IRori–α1RoriIRcrosstalk_R = IRori -α1 Rori
IRcrosstalk_G＝IRori–α2GoriIRcrosstalk_G = IRori -α2 Gori
IRcrosstalk_B＝IRori–α3BoriIRcrosstalk_B = IRori - α3 Bori
IRcrosstalk_RGB＝β1IRcrosstalk_R+β2IRcrosstalk_G+β3IRcrosstalk_BIRcrosstalk_RGB = β1 IRcrosstalk_R + β2 IRcrosstalk_G + β3 IRcrosstalk_B
IRoutput＝IRcrosstalk_RGB-IRoffsetIRoutput = IRcrosstalk_RGB -IRoffset
其中，串音干扰程度参数αi是使用者根据感测器2吸收光谱特性而设定的比例参数，每一原色光的串音干扰程度参数αi不相同，其中i＝1～3。串音干扰比重βi是红外光IR分别被三原色光RGB影响的比重，每一原色光的串音干扰比重βi不相同，其中i＝1～3。IRori是红外光IR的原始响应值。α1Rori是原色光R的串音干扰程度参数α1与原色光R的原始响应值Rori的乘积。IRcrosstalk_R是红外光IR的原始响应值IRori减去乘积α1Rori后取得的红外光IR的第一串音响应值。α2Gori是原色光G的串音干扰程度参数α2与原色光G的原始响应值Gori的乘积。IRcrosstalk_G是红外光IR的原始响应值IRori减去乘积α2Gori后取得的红外光IR的第一串音响应值。α3Bori是原色光B的串音干扰程度参数α3与原色光B的原始响应值Bori的乘积。IRcrosstalk_B是红外光IR的原始响应值IRori减去乘积α3Bori后取得的红外光IR的第一串音响应值。β1IRcrosstalk_R是原色光R的第一串音响应值IRcrosstalk_R与第一串音干扰比重β1的乘积。β2IRcrosstalk_G是原色光G的第一串音响应值IRcrosstalk_G与第一串音干扰比重β2的乘积。β3IRcrosstalk_B是原色光B的第一串音响应值IRcrosstalk_B与第一串音干扰比重β3的乘积。IRcrosstalk_RGB是将三原色光RGB的乘积相加后取得的红外光IR的第二串音响应值。IRoffset是暗电流干扰响应值。IRoutput是红外光IR的真实响应值。Wherein, the crosstalk interference degree parameter αi is a proportional parameter set by the user according to the absorption spectrum characteristic of the sensor 2 , and the crosstalk interference degree parameter αi of each primary color light is different, where i=1˜3. The crosstalk interference proportion βi is the proportion of the infrared light IR being affected by the three primary colors RGB respectively, and the crosstalk interference proportion βi of each primary color light is different, where i=1-3. IRori is the original response value of infrared light IR. α1 Rori is the product of the crosstalk interference degree parameter α1 of the primary color light R and the original response value Rori of the primary color light R. IRcrosstalk_R is the first crosstalk response value of infrared light IR obtained by subtracting the product α1 Rori from the original response value IRori of infrared light IR. α2 Gori is the product of the crosstalk interference degree parameter α2 of the primary color light G and the original response value Gori of the primary color light G. IRcrosstalk_G is the first crosstalk response value of infrared light IR obtained by subtracting the product α2 Gori from the original response value IRori of infrared light IR. α3 Bori is the product of the crosstalk interference degree parameter α3 of the primary color light B and the original response value Bori of the primary color light B. IRcrosstalk_B is the first crosstalk response value of infrared light IR obtained by subtracting the product α3 Bori from the original response value IRori of infrared light IR. β1 IRcrosstalk_R is the product of the first crosstalk response value IRcrosstalk_R of the primary color light R and the first crosstalk interference specific gravity β1 . β2 IRcrosstalk_G is the product of the first crosstalk response value IRcrosstalk_G of the primary color light G and the first crosstalk interference specific gravity β2 . β3 IRcrosstalk_B is the product of the first crosstalk response value IRcrosstalk_B of the primary color light B and the first crosstalk interference specific gravity β3 . IRcrosstalk_RGB is the second crosstalk response value of the infrared light IR obtained by adding the products of the three primary colors RGB. IRoffset is the dark current interference response value. IRoutput is the real response value of infrared light IR.
步骤S101所实现的技术效果为找出无三原色光RGB的串音干扰与硬件影响下红外光IR的真实响应值IRoutput。在红外光源发射器4关闭以及感测器2感测无红外光IR的影像时找出硬件影响的偏差，即假设环境光源并无红外光IR且感测器2感测红外光IR时，感测器2感测红外光IR的响应值数值应为0，然而红外光IR的响应值仍然存在某些数值，如不为0的数值，此时即表示硬件影响所产生的偏差，如感测器2产生干扰响应值IRoffset，其中干扰响应值不限制由感测器2产生，亦可由其他硬件所产生，本发明不以此为限。步骤S101不但扣除三原色光RGB的串音干扰，同时也消除硬件影响所产生的响应值偏差。The technical effect achieved in step S101 is to find out the real response value IRoutput of the infrared light IR without the crosstalk interference of the three primary colors RGB and the influence of hardware. When the infrared light source emitter 4 is turned off and the sensor 2 senses an image without infrared light IR, the deviation affected by the hardware is found, that is, when the ambient light source does not have infrared light IR and the sensor 2 senses infrared light IR, the sensor The response value of the sensor 2 sensing the infrared light IR should be 0, but the response value of the infrared light IR still has some values, such as a value other than 0, which means that the deviation caused by the hardware influence, such as sensing The sensor 2 generates the interference response value IRoffset , where the interference response value is not limited to be generated by the sensor 2 , but can also be generated by other hardware, and the present invention is not limited thereto. Step S101 not only deducts the crosstalk interference of the three primary colors RGB, but also eliminates the deviation of the response value caused by the hardware influence.
图4是本发明又一实施例的影像处理方法示意图。步骤S103中，处理器3根据红外光IR的真实响应值对三原色光RGB的串音干扰以计算在无红外光IR的串音干扰下三原色光RGB的真实响应值包括：S501：根据红外光IR的真实响应值对每一原色光的距离响应参数以计算每一原色光的第三串音响应值；S503：根据影像的影像位元长度与距离响应参数以计算每一原色光的映射比例；以及S505：根据每一原色光的第三串音响应值与映射比例以取得在无红外光IR的串音干扰下每一原色光的真实响应值。FIG. 4 is a schematic diagram of an image processing method according to another embodiment of the present invention. In step S103, the processor 3 calculates the real response values of the three primary color lights RGB without the crosstalk interference of the infrared light IR according to the crosstalk interference of the infrared light IR to the three primary color light RGB including: S501: according to the infrared light IR Calculate the third crosstalk response value of each primary color light with respect to the distance response parameter of the actual response value of each primary color light; S503: Calculate the mapping ratio of each primary color light according to the image bit length and the distance response parameter of the image; And S505: According to the third crosstalk response value of each primary color light and the mapping ratio, obtain the real response value of each primary color light without the crosstalk interference of infrared light IR.
处理器3计算在无红外光IR的串音干扰下三原色光RGB的真实响应值的方程式以原色光R为例如下表示。The equations for the processor 3 to calculate the real response values of the three primary colors RGB without the crosstalk interference of the infrared light IR are expressed as follows taking the primary color R as an example.
γloc_R＝f_distance(γR)γloc_R = f_distance(γR )
Routput＝(Rori–γloc_RIRoutput)*N/(((N-1)-γloc_RIRoutput)+1)Routput ＝(Rori –γloc_R IRoutput )*N/(((N-1)-γloc_R IRoutput )+1)
其中，γR是感测器2的原色光R光谱特性响应参数，γloc_R是原色光R的距离响应参数，f_distance(x)是感测器2的每一原色光光谱特性响应参数随着像素点中每一原色光与影像的中心点之间的距离递增而线性产生距离响应参数的方程式，每一原色光的距离响应参数不相同。Rori是原色光R的原始响应值。IRoutput是红外光IR的真实响应值。γloc_RIRoutput是红外光IR的真实响应值IRoutput与对原色光R的距离响应参数γloc_R的乘积。(Rori–γloc_RIRoutput)是原色光R的原始响应值Rori减去乘积γloc_RIRoutput后取得原色光R的第三串音响应值。N是影像的影像位元长度，即N＝2j，j＝位元数。(((N-1)-γloc_RIRoutput)+1)是影像位元长度N与乘积γloc_RIRoutput的差值。N/(((N-1)-γloc_RIRoutput)+1)是影像位元长度N除以差值后取得的映射比例。Routput是原色光R的第三串音响应值与映射比例相乘后取得的原色光R的真实响应值。Wherein, γR is the spectral characteristic response parameter of the primary color light R of the sensor 2, γloc_R is the distance response parameter of the primary color light R, and f_distance(x) is the spectral characteristic response parameter of each primary color light of the sensor 2 along with the pixel The distance between each primary color light in the point and the center point of the image increases to linearly generate the equation of the distance response parameter, and the distance response parameter of each primary color light is different. Rori is the original response value of primary color light R. IRoutput is the real response value of infrared light IR. γloc_R IRoutput is the product of the real response value IRoutput of infrared light IR and the distance response parameter γloc_R to primary color light R. (Rori -γloc_R IRoutput ) is the original response value Rori of the primary color light R minus the product γloc_R IRoutput to obtain the third crosstalk response value of the primary color light R. N is the image bit length of the image, that is, N=2j , j=number of bits. (((N-1)-γloc_R IRoutput )+1) is the difference between the image bit length N and the product γloc_R IRoutput . N/(((N-1)-γloc_R IRoutput )+1) is the mapping ratio obtained by dividing the image bit length N by the difference. Routput is the real response value of the primary color light R obtained by multiplying the third crosstalk response value of the primary color light R by the mapping ratio.
另外，取得原色光G与B的真实响应值的方式相似于原色光R，故于此不在赘述。因此，影像处理装置1可分别通过三原色光RGB的方程式以取得三原色光RGB的真实响应值。In addition, the way to obtain the real response values of the primary color lights G and B is similar to that of the primary color light R, so details will not be repeated here. Therefore, the image processing device 1 can respectively obtain the real response values of the three primary colors RGB through the equations of the three primary colors RGB.
步骤S103所实现的技术效果为调整受到红外光IR影响的三原色光RGB的响应值动态范围、找出无红外光IR的串音干扰下三原色光RGB的真实响应值、以及修正影像的色彩误差。假设8位元时，则N＝256，即理想上三原色光RGB的响应值动态范围为0～255。而当受到红外光IR影响时，三原色光RGB的响应值动态范围可能为0～k，k<255，即三原色光RGB的响应值动态范围受到红外光IR影响而变动，因此通过步骤S103调整三原色光RGB的响应值动态范围以接近影像的三原色光RGB的响应值动态范围。另外，由于镜头的物理特性(角度偏移现象)，使得影像由中心到边缘的红外光IR渗透三原色光的程度逐渐产生偏移，因此通过步骤S103通过影像中心点到影像上任一像素点的距离递增而线性补偿三原色光RGB的响应值以改善影像周围因红外光IR渗透导致色彩偏移而造成色彩流失的现象。The technical effect achieved in step S103 is to adjust the dynamic range of the response values of the three primary colors RGB affected by the infrared light IR, find out the real response values of the three primary colors RGB without the crosstalk interference of the infrared light IR, and correct the color error of the image. Assuming 8 bits, then N=256, that is, ideally, the dynamic range of the response values of the three primary colors RGB is 0-255. And when affected by infrared light IR, the dynamic range of the response value of the three primary colors RGB may be 0 ~ k, k<255, that is, the dynamic range of the response value of the three primary colors RGB is affected by the infrared light IR, so adjust the three primary colors through step S103 The dynamic range of the response value of the light RGB is close to the dynamic range of the response value of the RGB of the three primary colors of the image. In addition, due to the physical characteristics of the lens (angle shift phenomenon), the degree of IR penetration of the three primary colors of the image from the center to the edge gradually shifts, so the distance from the center point of the image to any pixel on the image is passed through step S103 Incrementally and linearly compensate the response values of the three primary colors RGB to improve the phenomenon of color loss caused by color shift caused by infrared light IR penetration around the image.
图5是本发明再一实施例的影像处理方法示意图。步骤S105中，处理器3根据红外光IR的真实响应值的亮度与三原色光RGB的真实响应值以增强影像的亮度包括：S701：计算第一比例的红外光IR的真实响应值以取得第一亮度分量；S703：计算第二比例的红外线IR的真实响应值以取得第二亮度分量；S705：依据第二亮度分量与每一原色光的真实响应值对影像的影像位元长度的比例以取得第三亮度分量；以及S707：将每一原色光的真实响应值、第一亮度分量、及第三亮度分量相加以增强影像的亮度。FIG. 5 is a schematic diagram of an image processing method according to another embodiment of the present invention. In step S105, the processor 3 enhances the brightness of the image according to the brightness of the real response value of the infrared light IR and the real response value of the three primary colors RGB, including: S701: Calculate the real response value of the first proportion of the infrared light IR to obtain the first Brightness component; S703: Calculate the real response value of the infrared ray IR of the second ratio to obtain the second brightness component; S705: Obtain according to the ratio of the second brightness component and the real response value of each primary color light to the image bit length of the image the third luminance component; and S707: adding the real response value of each primary color light, the first luminance component, and the third luminance component to enhance the brightness of the image.
处理器3增强影像的亮度的方程式以原色光R为例如下表示。The equation for the processor 3 to enhance the brightness of the image is expressed as follows taking the primary color light R as an example.
Renhanced_output＝Routput+IRoutput*(X-δ)/X+IRoutput*(Routput/(N-1))*(δ/X)Renhanced_output ＝Routput +IRoutput *(X-δ)/X+IRoutput *(Routput /(N-1))*(δ/X)
其中，X是混合精确度参数，δ是混合比例参数，混合精确度参数X大于0，混合比例参数δ小于混合精确度参数X。(X-δ)是混合精确度参数与混合比例参数的差值。(X-δ)/X是差值(X-δ)除以混合精确度参数X后取得的第一比例。(δ/X)是混合比例参数δ除以混合精确度参数X后取得的第二比例。(Routput/(N-1))是原色光R的真实响应值除以影像的影像位元长度。IRoutput*(X-δ)/X是第一亮度分量。IRoutput*(δ/X)是第二亮度分量。IRoutput*(Routput/(N-1))*(δ/X)是第三亮度分量。Renhanced_output是原色光R的真实响应值Routput、第一亮度分量IRoutput*(X-δ)/X、及第三亮度分量IRoutput*(Routput/(N-1))*(δ/X)相加后增强影像的原色光R的亮度。Wherein, X is the mixing precision parameter, δ is the mixing ratio parameter, the mixing precision parameter X is greater than 0, and the mixing ratio parameter δ is smaller than the mixing precision parameter X. (X-δ) is the difference between the mixing precision parameter and the mixing ratio parameter. (X-δ)/X is the first ratio obtained by dividing the difference (X-δ) by the mixed precision parameter X. (δ/X) is the second ratio obtained by dividing the mixing ratio parameter δ by the mixing precision parameter X. (Routput /(N-1)) is the real response value of the primary color light R divided by the image bit length of the image. IRoutput *(X-δ)/X is the first luminance component. IRoutput *(δ/X) is the second luminance component. IRoutput *(Routput /(N-1))*(δ/X) is the third luminance component. Renhanced_output is the real response value Routput of the primary color light R, the first luminance component IRoutput *(X-δ)/X, and the third luminance component IRoutput *(Routput /(N-1))*(δ/ X) After adding, the brightness of the primary color light R of the image is enhanced.
另外，增强影像的原色光G与B的亮度方式相似于原色光R，故于此不在赘述。因此，影像处理装置1可分别通过三原色光RGB的方程式以增加影像的亮度。In addition, the brightness of the primary color lights G and B of the enhanced image is similar to that of the primary color light R, so details will not be described here. Therefore, the image processing device 1 can increase the brightness of the image through the equations of the three primary colors RGB.
步骤S105所实现的技术效果为在低光源环境下，通过IR主动光源提供的亮度，使得三原色光RGB的真实响应值加入红外光IR的真实响应值的部分亮度以便增加RGB彩色影像的亮度。The technical effect achieved in step S105 is that in a low light source environment, through the brightness provided by the IR active light source, the real response value of the three primary colors RGB is added to part of the brightness of the real response value of the infrared light IR to increase the brightness of the RGB color image.
综上所述，本发明提供的影像处理装置及方法，可实现的技术效果为修正镜头的角度偏移(angular shift)现象以重建色彩误差、消除硬件暗电流效应以准确还原色彩表现、降低RGB彩色影像受到IR串音干扰的影响以改善RGB彩色影像色彩偏移而造成色彩流失的现象、补偿RGB色彩的响应值动态范围以减少色偏现象、以及在低光源环境下通过IR主动光源以增强RGB彩色影像的亮度。In summary, the image processing device and method provided by the present invention can achieve technical effects such as correcting the angular shift phenomenon of the lens to reconstruct color errors, eliminating hardware dark current effects to accurately restore color performance, and reducing RGB The color image is affected by IR crosstalk to improve the phenomenon of color loss caused by the color shift of the RGB color image, compensate the dynamic range of the response value of the RGB color to reduce the color shift, and use the IR active light source to enhance the low light source environment The brightness of the RGB color image.
以上所述仅为本发明的优选可行实施例，凡依本发明权利要求所做的均等变化与修饰，皆应属本发明的涵盖范围。The above descriptions are only preferred feasible embodiments of the present invention, and all equivalent changes and modifications made according to the claims of the present invention shall fall within the scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710183561.3ACN108632595B (en) | 2017-03-24 | 2017-03-24 | Image processing device and method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710183561.3ACN108632595B (en) | 2017-03-24 | 2017-03-24 | Image processing device and method |
| Publication Number | Publication Date |
|---|---|
| CN108632595Atrue CN108632595A (en) | 2018-10-09 |
| CN108632595B CN108632595B (en) | 2020-03-03 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710183561.3AActiveCN108632595B (en) | 2017-03-24 | 2017-03-24 | Image processing device and method |
| Country | Link |
|---|---|
| CN (1) | CN108632595B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111050097A (en)* | 2018-10-15 | 2020-04-21 | 瑞昱半导体股份有限公司 | Infrared crosstalk compensation method and device |
| CN116156322A (en)* | 2022-12-16 | 2023-05-23 | 浙江华锐捷技术有限公司 | Image processing method, device, system, electronic device and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104350744A (en)* | 2012-06-07 | 2015-02-11 | 三星泰科威株式会社 | Camera system with multispectral filter array and image processing method thereof |
| US20150062347A1 (en)* | 2013-08-27 | 2015-03-05 | Semiconductor Components Industries, Llc | Image processing methods for visible and infrared imaging |
| CN105578081A (en)* | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, image sensor, imaging device and electronic device |
| CN106488201A (en)* | 2015-08-28 | 2017-03-08 | 杭州海康威视数字技术股份有限公司 | Image signal processing method and system |
| CN106488202A (en)* | 2015-08-24 | 2017-03-08 | 钰立微电子股份有限公司 | Image processing device and image processing method for red, green, blue and infrared light sensor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104350744A (en)* | 2012-06-07 | 2015-02-11 | 三星泰科威株式会社 | Camera system with multispectral filter array and image processing method thereof |
| US20150062347A1 (en)* | 2013-08-27 | 2015-03-05 | Semiconductor Components Industries, Llc | Image processing methods for visible and infrared imaging |
| CN106488202A (en)* | 2015-08-24 | 2017-03-08 | 钰立微电子股份有限公司 | Image processing device and image processing method for red, green, blue and infrared light sensor |
| CN106488201A (en)* | 2015-08-28 | 2017-03-08 | 杭州海康威视数字技术股份有限公司 | Image signal processing method and system |
| CN105578081A (en)* | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, image sensor, imaging device and electronic device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111050097A (en)* | 2018-10-15 | 2020-04-21 | 瑞昱半导体股份有限公司 | Infrared crosstalk compensation method and device |
| CN111050097B (en)* | 2018-10-15 | 2022-03-15 | 瑞昱半导体股份有限公司 | Infrared crosstalk compensation method and device |
| CN116156322A (en)* | 2022-12-16 | 2023-05-23 | 浙江华锐捷技术有限公司 | Image processing method, device, system, electronic device and storage medium |
| Publication number | Publication date |
|---|---|
| CN108632595B (en) | 2020-03-03 |
| Publication | Publication Date | Title |
|---|---|---|
| CN108702437B (en) | Method, system, device and storage medium for calculating depth map | |
| TWI645720B (en) | Image processing device and method | |
| WO2020092477A8 (en) | Display engine for post-rendering processing | |
| US20170111625A1 (en) | Identifying gray regions for auto white balancing | |
| WO2019236626A3 (en) | Hdr image generation from single-shot hdr color image sensors | |
| CN110192241A (en) | Control the brightness of emissive display | |
| TWI715142B (en) | Image sensing device and method for auto white balance therefor | |
| WO2016206004A1 (en) | Photographing device and method for acquiring depth information | |
| EP3888345A1 (en) | Method for generating image data for machine learning based imaging algorithms | |
| TWI672938B (en) | Depth map generation device capable of calibrating occlusion | |
| KR20160011167A (en) | An imaging system and A method for anti-shading correction of an image | |
| CN108063932A (en) | A kind of method and device of luminosity calibration | |
| CN108632595B (en) | Image processing device and method | |
| TW201530249A (en) | Device for generating depth information, method for generating depth information, and stereo camera | |
| CN102801984B (en) | The method of color image sensor and acquisition color digital image | |
| CN108573508A (en) | Information processing unit, information processing method and storage medium | |
| CN105841821A (en) | Calibration-based barrier sheet-free non-uniformity correction device and method thereof | |
| US20160247286A1 (en) | Depth image generation utilizing depth information reconstructed from an amplitude image | |
| TWI577971B (en) | Double aperture ranging system | |
| CN104849241B (en) | The calibration method of propellant smog light screening capacity test system | |
| US8089534B2 (en) | Multi illuminant shading correction using singular value decomposition | |
| CN110458769A (en) | A Color Polarized Image Restoration Method Based on Eliminating Crosstalk Between Channels | |
| US9124828B1 (en) | Apparatus and methods using a fly's eye lens system for the production of high dynamic range images | |
| US20150189129A1 (en) | Lens shading correction method and image signal processing device and image sensor system employing the method | |
| CN112087622B (en) | TDI-CCD camera reflectivity resolution index simulation test method and system |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |