技术领域technical field
本申请涉及图像处理领域，尤其涉及一种单色偏振式CIS及图像处理方法、存储介质。The present application relates to the field of image processing, and in particular, to a monochromatic polarized CIS, an image processing method, and a storage medium.
背景技术Background technique
互补金属氧化物半导体(CMOS，Complementary Metal-Oxide Semiconductor)图像传感器(CIS，CMOS Image Sensor)具有集成度高、功耗小、速度快和成本低等特点，在高分辨率像素产品方面应用广泛。CIS包括单色偏振和彩色偏振这两种形式，而单色偏振由于无需进行后期的色彩处理，使得单色偏振比彩色偏振的成像效率高，故，单色偏振在实际中的应用更为广泛。Complementary Metal-Oxide Semiconductor (CMOS, Complementary Metal-Oxide Semiconductor) image sensor (CIS, CMOS Image Sensor) has the characteristics of high integration, low power consumption, high speed and low cost, and is widely used in high-resolution pixel products. CIS includes two forms: monochromatic polarization and color polarization. Since monochromatic polarization does not require post-color processing, the imaging efficiency of monochromatic polarization is higher than that of color polarization. Therefore, monochromatic polarization is more widely used in practice. .
现有的单色偏振式CIS的结构如图1所示，包括微透镜阵列、偏振器阵列和像素阵列，其中，每个像素包括一个光电二极管(PD，Photo Diode)结构，在PD结构上放置一个角度的偏振片，每四个像素分别放置了四个不同角度的偏振片，将每四个像素作为一个计算单元，通过不同方向偏振器之间的关联计算偏振程度和偏振方向，进而根据偏振程度和偏振方向得到偏振图像。The structure of the existing monochromatic polarized CIS is shown in Figure 1, including a microlens array, a polarizer array and a pixel array, wherein each pixel includes a photodiode (PD, Photo Diode) structure, which is placed on the PD structure. For a polarizer with one angle, four polarizers with different angles are placed for every four pixels, and every four pixels are used as a calculation unit to calculate the degree of polarization and polarization direction through the correlation between polarizers in different directions, and then according to the polarization degree and polarization direction to obtain a polarization image.
然而，现有的单色偏振式CIS需要在四个PD柱上放置四个不同角度的偏振片，其中每个像素只能吸收一个角度的偏振光，当成像光信号的波长小于四个像素的波长之和时，会降低单色偏振式CIS的量子效率。However, the existing monochromatic polarized CIS needs to place four polarizers with different angles on the four PD columns, in which each pixel can only absorb polarized light of one angle, when the wavelength of the imaging light signal is less than that of the four pixels The quantum efficiency of the monochromatic polarized CIS is reduced when the sum of the wavelengths is used.
发明内容SUMMARY OF THE INVENTION
本申请实施例提供一种单色偏振式CIS及图像处理方法、存储介质，能够提高单色偏振式CIS的量子效率。Embodiments of the present application provide a monochromatic polarized CIS, an image processing method, and a storage medium, which can improve the quantum efficiency of the monochromatic polarized CIS.
本申请的技术方案是这样实现的：The technical solution of the present application is realized as follows:
本申请实施例提供一种单色偏振式互补金属氧化物半导体图像传感器CIS，其特征在于，所述单色偏振式CIS包括：An embodiment of the present application provides a monochromatic polarized complementary metal oxide semiconductor image sensor CIS, wherein the monochromatic polarized CIS includes:
在预设方向排布至少一个光电二极管PD柱的亚波长像素单元，所述亚波长像素单元用于利用PD柱吸收预设波长的成像光信号在所述预设方向偏振的RGB单色光；A sub-wavelength pixel unit of at least one photodiode PD column is arranged in a preset direction, and the sub-wavelength pixel unit is used for absorbing the RGB monochromatic light polarized in the preset direction of the imaging light signal of the preset wavelength by the PD column;
与所述亚波长像素单元连接的图像处理器，用于利用所述RGB单色光确定出偏振信息，并基于所述偏振信息得到所述成像光信号对应的偏振图像。An image processor connected to the sub-wavelength pixel unit is configured to determine polarization information by using the RGB monochromatic light, and obtain a polarization image corresponding to the imaging light signal based on the polarization information.
在上述单色偏振式CIS中，所述亚波长像素单元的像素尺寸小于所述预设波长。In the above monochromatic polarized CIS, the pixel size of the sub-wavelength pixel unit is smaller than the preset wavelength.
在上述单色偏振式CIS中，所述PD柱的尺寸是基于单色的共振波长和所述成像光信号的折射率确定的，所述PD柱的形状至少包括长方形、圆形、平行四边形和菱形。In the above monochromatic polarized CIS, the size of the PD column is determined based on the resonance wavelength of the monochromatic color and the refractive index of the imaging optical signal, and the shape of the PD column at least includes a rectangle, a circle, a parallelogram and diamond.
在上述单色偏振式CIS中，所述PD柱的尺寸度量级别为百纳米级，所述预设方向排布的至少一个PD柱的尺寸和形状相同。In the above monochromatic polarized CIS, the size of the PD pillars is in the order of 100 nanometers, and the size and shape of at least one PD pillar arranged in the preset direction are the same.
在上述单色偏振式CIS中，所述预设方向至少包括0度、45度、90度和135度。In the above monochromatic polarized CIS, the preset direction includes at least 0 degrees, 45 degrees, 90 degrees and 135 degrees.
在上述单色偏振式CIS中，所述单色偏振式CIS还包括：与所述至少一个PD柱连接的读出电路，所述读出电路与所述图像处理器连接；In the above-mentioned monochromatic polarized CIS, the monochromatic polarized CIS further comprises: a readout circuit connected to the at least one PD column, and the readout circuit is connected to the image processor;
所述至少一个PD柱，具体用于将所述RGB单色光转换为所述预设方向的电信号；The at least one PD column is specifically used to convert the RGB monochromatic light into an electrical signal in the preset direction;
所述读出电路，用于将所述预设方向的电信号转换为数字信号，得到RAW数据，并将所述RAW数据传输至所述图像处理器；The readout circuit is used to convert the electrical signal in the preset direction into a digital signal to obtain RAW data, and transmit the RAW data to the image processor;
所述图像处理器，具体用于通过预设关联方式将所述RAW数据进行关联，得到偏振程度和偏振方向，将所述偏振程度和所述偏振方向作为所述偏振信息，并根据所述偏振信息得到所述偏振图像。The image processor is specifically configured to associate the RAW data through a preset association method to obtain a polarization degree and a polarization direction, use the polarization degree and the polarization direction as the polarization information, and use the polarization information to obtain the polarized image.
在上述单色偏振式CIS中，所述单色偏振式CIS还包括：与所述亚波长像素单元连接的透镜单元；In the above-mentioned monochromatic polarized CIS, the monochromatic polarized CIS further comprises: a lens unit connected with the sub-wavelength pixel unit;
所述透镜单元，用于对所述预设波长的成像光信号进行聚焦。The lens unit is used for focusing the imaging light signal of the preset wavelength.
本申请实施例提供一种图像处理方法，应用于单色偏振式CIS，所述单色偏振式CIS上设置有在预设方向排布至少一个PD柱的亚波长像素单元，所述预设方向排布的至少一个PD柱的尺寸和形状相同，所述方法包括：The embodiment of the present application provides an image processing method, which is applied to a monochromatic polarized CIS. The monochromatic polarized CIS is provided with a sub-wavelength pixel unit in which at least one PD column is arranged in a preset direction. The size and shape of the at least one PD column arranged are the same, and the method includes:
当获取到预设波长的成像光信号时，利用所述亚波长像素单元的至少一个PD柱吸收所述成像光信号在预设方向偏振的RGB单色光；When the imaging optical signal of the preset wavelength is acquired, use at least one PD column of the sub-wavelength pixel unit to absorb the RGB monochromatic light polarized in the preset direction of the imaging optical signal;
利用所述RGB单色光确定出偏振信息，并基于所述偏振信息得到所述成像光信号对应的偏振图像。The polarization information is determined by using the RGB monochromatic light, and a polarization image corresponding to the imaging light signal is obtained based on the polarization information.
在上述方法中，所述利用所述RGB单色光确定出偏振信息，包括：In the above method, the determining the polarization information by using the RGB monochromatic light includes:
将所述RGB单色光转换为所述预设方向的电信号；converting the RGB monochromatic light into an electrical signal in the preset direction;
将所述预设方向的电信号转换为数字信号，得到RAW数据；converting the electrical signal in the preset direction into a digital signal to obtain RAW data;
通过预设关联方式，将所述RAW数据进行关联，得到所述偏振信息。The RAW data is associated by a preset association method to obtain the polarization information.
本申请实施例提供一种存储介质，其上存储有计算机程序，应用于单色偏振式CIS，其特征在于，该计算机程序被处理器执行时实现如上述任一项所述的方法。An embodiment of the present application provides a storage medium on which a computer program is stored, and is applied to a monochromatic polarization CIS, wherein the computer program is executed by a processor to implement the method described in any one of the above.
本申请实施例提供了一种单色偏振式CIS及图像处理方法、存储介质，该单色偏振式CIS包括：在预设方向排布至少一个光电二极管PD柱的亚波长像素单元，亚波长像素单元用于利用PD柱吸收预设波长的成像光信号在预设方向偏振的RGB单色光；与亚波长像素单元连接的图像处理器，用于利用RGB单色光确定出偏振信息，并基于偏振信息得到成像光信号对应的偏振图像。采用上述单色偏振式CIS实现方案，每个亚波长像素单元能够吸收多个角度偏振的单色光，且亚波长像素单元的波长小于成像光信号的预设波长，使得提高了单色偏振式CIS的量子效率；PD柱的结构能够实现光学共振，其吸收效率远高于传统的PD结构，进而能够提高单色偏振式CIS的量子效率。Embodiments of the present application provide a monochromatic polarized CIS, an image processing method, and a storage medium. The monochromatic polarized CIS includes: a subwavelength pixel unit with at least one photodiode PD column arranged in a preset direction, and a subwavelength pixel unit. The unit is used to use the PD column to absorb the RGB monochromatic light polarized in the preset direction of the imaging light signal of the preset wavelength; the image processor connected with the sub-wavelength pixel unit is used to determine the polarization information by using the RGB monochromatic light, and based on the The polarization information obtains a polarization image corresponding to the imaging optical signal. With the above implementation scheme of monochromatic polarized CIS, each sub-wavelength pixel unit can absorb monochromatic light polarized at multiple angles, and the wavelength of the sub-wavelength pixel unit is smaller than the preset wavelength of the imaging optical signal, which improves the performance of monochromatic polarized light. The quantum efficiency of CIS; the structure of the PD column can realize optical resonance, and its absorption efficiency is much higher than that of the traditional PD structure, which can improve the quantum efficiency of monochromatic polarized CIS.
附图说明Description of drawings
图1为现有技术提出的一种单色偏振式CIS的结构示意图；Fig. 1 is the structural representation of a kind of monochromatic polarized CIS proposed in the prior art;
图2为本申请实施例提供的一种单色偏振式CIS的结构示意图；2 is a schematic structural diagram of a monochromatic polarized CIS provided by an embodiment of the present application;
图3为本申请实施例提供的一种示例性的亚波长像素单元10的PD柱排布图；FIG. 3 is an arrangement diagram of PD columns of an exemplary sub-wavelength pixel unit 10 provided in an embodiment of the present application;
图4为本申请实施例提供的一种图像处理方法的流程图。FIG. 4 is a flowchart of an image processing method provided by an embodiment of the present application.
具体实施方式Detailed ways
应当理解，此处描述的具体实施例仅仅用以解释本申请。并不用于限定本申请。It should be understood that the specific embodiments described herein are merely illustrative of the present application. It is not intended to limit this application.
实施例一Example 1
本申请实施例提供一种单色偏振式互补金属氧化物半导体图像传感器CIS1，如图2所示，该单色偏振式CIS1可以包括：An embodiment of the present application provides a monochromatic polarized complementary metal oxide semiconductor image sensor CIS1. As shown in FIG. 2, the monochromatic polarized CIS1 may include:
在预设方向排布至少一个光电二极管PD柱100的亚波长像素单元10，所述亚波长像素单元用于利用PD柱100吸收预设波长的成像光信号在所述预设方向偏振的RGB单色光；At least one sub-wavelength pixel unit 10 of a photodiode PD column 100 is arranged in a preset direction, and the sub-wavelength pixel unit is used for absorbing the RGB single-wavelength imaging optical signal of the preset wavelength polarized in the preset direction by using the PD column 100 color light;
与所述亚波长像素单元10连接的图像处理器11，用于利用所述RGB单色光确定出偏振信息，并基于所述偏振信息得到所述成像光信号对应的偏振图像。The image processor 11 connected to the sub-wavelength pixel unit 10 is configured to determine polarization information by using the RGB monochromatic light, and obtain a polarization image corresponding to the imaging light signal based on the polarization information.
本申请实施例中，亚波长像素单元10的像素尺寸小于成像光信号对应的预设波长；示例性的，在实际情况下，成像光信号对应的预设波长为400nm，故，亚波长像素单元10的像素小于或者等于400nm。In the embodiment of the present application, the pixel size of the sub-wavelength pixel unit 10 is smaller than the preset wavelength corresponding to the imaging optical signal; exemplarily, in an actual situation, the preset wavelength corresponding to the imaging optical signal is 400 nm, so the sub-wavelength pixel unit 10 pixels are less than or equal to 400nm.
本申请实施例中，每个亚波长像素单元10内沿着预设方向排布至少一个PD柱，多个亚波长像素单元10组成了亚波长像素阵列，其中亚波长像素阵列可以按照一定的排布规则对亚波长像素单元10进行排布，例如：亚波长像素阵列中的每一行像素单元对应吸收RGB的一个颜色、或者亚波长像素阵列中的每一行像素单元对应吸收一个角度的RGB，具体的根据实际情况进行选择，本申请实施例不做具体的限定。In the embodiment of the present application, at least one PD column is arranged in each sub-wavelength pixel unit 10 along a preset direction, and a plurality of sub-wavelength pixel units 10 form a sub-wavelength pixel array, wherein the sub-wavelength pixel array can be arranged in a certain order The sub-wavelength pixel units 10 are arranged according to the distribution rules, for example: each row of pixel units in the sub-wavelength pixel array corresponds to absorbing a color of RGB, or each row of pixel units in the sub-wavelength pixel array corresponds to absorbing an angle of RGB, specifically is selected according to the actual situation, which is not specifically limited in the embodiments of the present application.
本申请实施例中，在一个亚波长像素单元10中，可以在每个预设方向排布一个PD柱，或者在每个预设方向排布多个PD柱，每个预设方向排布PD柱的个数可以根据实际情况进行选择，本申请实施例不做具体的限定。In this embodiment of the present application, in one sub-wavelength pixel unit 10, one PD column may be arranged in each preset direction, or multiple PD columns may be arranged in each preset direction, and PDs may be arranged in each preset direction The number of columns can be selected according to the actual situation, which is not specifically limited in the embodiments of the present application.
可选的，预设方向包括0度、45度、90度和135度，具体的可以根据实际情况进行增删，本申请实施例不做具体的限定。Optionally, the preset directions include 0 degrees, 45 degrees, 90 degrees, and 135 degrees, which may be added or deleted according to actual conditions, which are not specifically limited in this embodiment of the present application.
本申请实施例中，如图3所示，在每个亚波长像素单元10内分别沿0度、45度、90度和135度排布百纳米级别的PD柱，0度、45度、90度和135度排布的PD柱分别吸收对应的0度、45度、90度和135度偏振的RGB单色光，并将每个亚波长像素单元10作为一个计算单元。In the embodiment of the present application, as shown in FIG. 3 , PD columns of hundreds of nanometers are arranged in each sub-wavelength pixel unit 10 along 0 degrees, 45 degrees, 90 degrees and 135 degrees, respectively. The PD columns arranged in degrees and 135 degrees absorb corresponding RGB monochromatic light polarized at 0 degrees, 45 degrees, 90 degrees and 135 degrees, respectively, and use each sub-wavelength pixel unit 10 as a computing unit.
本申请实施例中，在亚波长像素单元中，每个PD柱的形状和尺寸均相同。In the embodiment of the present application, in the sub-wavelength pixel unit, the shape and size of each PD column are the same.
可选的，PD柱的尺寸是基于单色的共振波长和成像光信号的折射率确定的，或者通过光学模拟得到的，具体的根据实际情况进行选择，本申请实施例不做具体的限定。Optionally, the size of the PD column is determined based on the monochromatic resonance wavelength and the refractive index of the imaging optical signal, or obtained through optical simulation, and is specifically selected according to the actual situation, which is not specifically limited in this embodiment of the present application.
本申请实施例中，利用公式(1)确定PD柱的尺寸In the embodiment of the present application, the size of the PD column is determined by using the formula (1)
PD柱的尺寸＝(共振波长-预设常数)/折射率 (1)Size of PD column = (resonance wavelength - preset constant)/refractive index (1)
其中，RGB三原色中不同的单色对应不同的共振波长，折射率为透镜的折射率。Among them, different monochromatic colors of the three primary colors of RGB correspond to different resonance wavelengths, and the refractive index is the refractive index of the lens.
本申请实施例中，以蓝光为例，对应的PD柱的尺寸为长90nm，宽50nm。In the embodiment of the present application, taking blue light as an example, the size of the corresponding PD column is 90 nm in length and 50 nm in width.
可选的，PD柱的形状至少包括长方形、圆形、平行四边形和菱形，具体的根据实际情况进行选择，本申请实施例不做具体的限定。Optionally, the shape of the PD column includes at least a rectangle, a circle, a parallelogram, and a rhombus, which is specifically selected according to the actual situation, which is not specifically limited in the embodiment of the present application.
本申请实施例中，单色偏振式CIS利用PD柱的光学共振，实现了在预设方向偏振的单色光的共振吸收。In the embodiment of the present application, the monochromatic polarized CIS utilizes the optical resonance of the PD column to realize resonance absorption of monochromatic light polarized in a preset direction.
本申请实施例中，单色偏振式CIS还包括：与至少一个PD柱连接的读出电路，且读出电路与图像处理器连接。In the embodiment of the present application, the monochromatic polarized CIS further includes: a readout circuit connected to at least one PD column, and the readout circuit is connected to the image processor.
本申请实施例中，当预设方向的至少一个PD柱吸收了对应的预设方向的RGB单色光之后，预设方向的至少一个PD柱将对应的预设方向的RGB单色光转换为预设方向的电信号，并将预设方向的电信号传输至读出电路，读出电路将预设方向的电信号转换为数字信号，得到RAW数据，并将RAW数据传输至图像处理器；图像处理器通过预设关联方式将RAW数据进行关联，得到偏振程度和偏振方向，将偏振程度和偏振方向作为偏振信息，并根据偏振信息得到偏振图像。In the embodiment of the present application, after at least one PD column in the preset direction absorbs the RGB monochromatic light in the corresponding preset direction, the at least one PD column in the preset direction converts the RGB monochromatic light in the corresponding preset direction into The electrical signal in the preset direction is transmitted to the readout circuit, and the readout circuit converts the electrical signal in the preset direction into a digital signal, obtains RAW data, and transmits the RAW data to the image processor; The image processor correlates the RAW data through a preset correlation method to obtain the polarization degree and polarization direction, takes the polarization degree and polarization direction as polarization information, and obtains a polarization image according to the polarization information.
本申请实施例中，读出电路利用模数转化器(ADC，Analog-to-DigitalConverter)将预设方向的电信号转换为数字信号。In the embodiment of the present application, the readout circuit uses an analog-to-digital converter (ADC, Analog-to-Digital Converter) to convert an electrical signal in a preset direction into a digital signal.
本申请实施例中，预设关联方式可以为矢量相加的方式，读出电路通过将预设方向的电信号进行矢量相加，进而得到成像光信号的偏振程度和偏振方向，之后，读出电路过滤掉不同偏振的反射光和透射光，进而确定出拍摄对象的材质属性，由此能够提供更加清晰的图像。In the embodiment of the present application, the preset correlation method may be a vector addition method, and the readout circuit obtains the polarization degree and polarization direction of the imaging optical signal by performing vector addition of the electrical signals in the preset direction, and then reads out The circuit filters out reflected and transmitted light of different polarizations to determine the material properties of the subject, which can provide a sharper image.
需要说明的是，偏振图像中对应的待成像偏振角度可以为任意角度，图像处理器通过将偏振角度映射成待成像偏振信息，来将RAW数据映射为偏振图像。It should be noted that the corresponding polarization angle to be imaged in the polarization image may be any angle, and the image processor maps the RAW data to the polarization image by mapping the polarization angle to polarization information to be imaged.
本申请实施例中，单色偏振式CIS还包括：与亚波长像素单元连接的透镜单元；透镜单元，用于对预设波长的成像光信号进行聚焦。In the embodiment of the present application, the monochromatic polarized CIS further includes: a lens unit connected to the sub-wavelength pixel unit; the lens unit is used for focusing the imaging optical signal of a preset wavelength.
需要说明的是，由于PD柱的光学共振能够增强局部光强，故，透镜单元并非本申请实施例中单色偏振式CIS中必须的部分，具体的在单色偏振式CIS中是否增加透镜单元根据实际情况进行选择，本申请实施例不做具体的限定。It should be noted that since the optical resonance of the PD column can enhance the local light intensity, the lens unit is not a necessary part of the monochromatic polarized CIS in the embodiment of the present application. Specifically, whether to add a lens unit to the monochromatic polarized CIS? The selection is made according to the actual situation, which is not specifically limited in the embodiments of the present application.
可以理解的是，在本申请提出的单色偏振式CIS中，每个亚波长像素单元能够吸收多个角度偏振的单色光，且亚波长像素单元的波长小于成像光信号的预设波长，使得提高了单色偏振式CIS的量子效率；PD柱的结构能够实现光学共振，其吸收效率远高于传统的PD结构，进而能够提高单色偏振式CIS的量子效率。It can be understood that, in the monochromatic polarized CIS proposed in this application, each sub-wavelength pixel unit can absorb monochromatic light polarized at multiple angles, and the wavelength of the sub-wavelength pixel unit is smaller than the preset wavelength of the imaging optical signal, The quantum efficiency of the monochromatic polarized CIS is improved; the structure of the PD column can realize optical resonance, and its absorption efficiency is much higher than that of the traditional PD structure, thereby improving the quantum efficiency of the monochromatic polarized CIS.
实施例二Embodiment 2
本申请实施例提供一种图像处理方法，应用于单色偏振式CIS，所述单色偏振式CIS上设置有在预设方向排布至少一个PD柱的亚波长像素单元，预设方向排布的至少一个PD柱的尺寸和形状相同，如图4所示，该方法可以包括：The embodiment of the present application provides an image processing method, which is applied to a monochromatic polarized CIS. The monochromatic polarized CIS is provided with a sub-wavelength pixel unit with at least one PD column arranged in a preset direction. At least one PD column of the same size and shape, as shown in Figure 4, the method may include:
S101、当获取到预设波长的成像光信号时，利用亚波长像素单元的至少一个PD柱吸收成像光信号在预设方向偏振的RGB单色光。S101. When the imaging optical signal of a preset wavelength is acquired, use at least one PD column of the sub-wavelength pixel unit to absorb the RGB monochromatic light polarized in the preset direction of the imaging optical signal.
本申请实施例提供的一种图像处理方法适用于利用单色偏振式CIS进行图像处理的场景下。The image processing method provided in the embodiment of the present application is suitable for a scenario in which a monochromatic polarized CIS is used for image processing.
本发明实施例中，单色偏振式CIS利用亚波长像素单元的至少一个PD柱吸收成像光信号在预设方向偏振的RGB单色光，其中，预设方向包括0度、45度、90度和135度，每个亚波长像素单元在预设方向都设置PD柱，预设方向的PD柱基于自身的光学共振，分别在预设方向共振吸收RGB单色光。In the embodiment of the present invention, the monochromatic polarized CIS utilizes at least one PD column of the sub-wavelength pixel unit to absorb RGB monochromatic light polarized in a preset direction of the imaging optical signal, wherein the preset direction includes 0 degrees, 45 degrees, and 90 degrees. and 135 degrees, each sub-wavelength pixel unit is provided with a PD column in a preset direction, and the PD column in the preset direction absorbs RGB monochromatic light resonantly in the preset direction based on its own optical resonance.
本申请实施例中，预设方向的划分不仅限于0度、45度、90度和135度这一种划分形式，具体的划分形式可根据实际情况进行选择，本申请实施例不做具体的限定。In the embodiment of the present application, the division of the preset direction is not limited to the division forms of 0 degrees, 45 degrees, 90 degrees, and 135 degrees. The specific division form can be selected according to the actual situation, which is not specifically limited in the embodiment of the present application. .
可选的，PD柱的形状至少包括长方形、圆形、平行四边形和菱形，具体的根据实际情况进行选择，本申请实施例不做具体的限定。Optionally, the shape of the PD column includes at least a rectangle, a circle, a parallelogram, and a rhombus, which is specifically selected according to the actual situation, which is not specifically limited in the embodiment of the present application.
本申请实施例中，PD柱的尺寸是基于单色的共振波长和成像光信号的折射率确定的，或者通过光学模拟得到的，具体的根据实际情况进行选择，本申请实施例不做具体的限定。In the embodiment of the present application, the size of the PD column is determined based on the monochromatic resonance wavelength and the refractive index of the imaging optical signal, or obtained through optical simulation. limited.
本申请实施例中，利用公式(1)确定PD柱的尺寸In the embodiment of the present application, the size of the PD column is determined by using the formula (1)
PD柱的尺寸＝(共振波长-预设常数)/折射率 (1)Size of PD column = (resonance wavelength - preset constant)/refractive index (1)
其中，RGB三原色中不同的单色对应不同的共振波长，折射率为成像光信号的折射率。Among them, different monochromatic colors of the three primary colors of RGB correspond to different resonance wavelengths, and the refractive index is the refractive index of the imaging optical signal.
本申请实施例中，以蓝光为例，对应的PD柱的尺寸为长90nm，宽50nm。In the embodiment of the present application, taking blue light as an example, the size of the corresponding PD column is 90 nm in length and 50 nm in width.
S102、利用RGB单色光确定出偏振信息，并基于偏振信息得到成像光信号对应的偏振图像。S102. Determine polarization information by using RGB monochromatic light, and obtain a polarization image corresponding to the imaging light signal based on the polarization information.
当单色偏振式CIS利用亚波长像素单元的PD柱吸收成像光信号在预设方向偏振的RGB单色光之后，单色偏振式CIS利用RGB单色光确定出偏振信息，并基于偏振信息得到成像光信号对应的偏振图像。When the monochromatic polarized CIS uses the PD column of the sub-wavelength pixel unit to absorb the RGB monochromatic light polarized in the preset direction of the imaging optical signal, the monochromatic polarized CIS uses the RGB monochromatic light to determine the polarization information, and obtains based on the polarization information. The polarized image corresponding to the imaging optical signal.
本申请实施例中，单色偏振式CIS将RGB单色光转换为预设方向的电信号；之后，单色偏振式CIS将所述预设方向的电信号转换为数字信号，得到RAW数据，并通过预设关联方式，将RAW数据进行关联，得到偏振信息。In the embodiment of the present application, the monochromatic polarized CIS converts RGB monochromatic light into electrical signals in a preset direction; after that, the monochromatic polarized CIS converts the electrical signals in the preset direction into digital signals to obtain RAW data, And through the preset association method, the RAW data is associated to obtain polarization information.
本申请实施例中，预设方向的至少一个PD柱将对应的预设方向的RGB单色光转换为预设方向的电信号，并将预设方向的电信号传输至读出电路，读出电路将预设方向的电信号转换为数字信号，得到RAW数据，并将RAW数据传输至图像处理器；图像处理器通过预设关联方式将RAW数据进行关联，得到偏振程度和偏振方向，将偏振程度和偏振方向作为偏振信息，并根据偏振信息得到偏振图像。In the embodiment of the present application, at least one PD column in the preset direction converts the RGB monochromatic light in the corresponding preset direction into electrical signals in the preset direction, and transmits the electrical signals in the preset direction to the readout circuit, and reads out the electrical signals in the preset direction. The circuit converts the electrical signal in the preset direction into a digital signal, obtains RAW data, and transmits the RAW data to the image processor; the image processor associates the RAW data through a preset association method to obtain the degree of polarization and polarization direction, and the polarization degree and direction are obtained. The degree and polarization direction are used as polarization information, and a polarization image is obtained according to the polarization information.
本申请实施例中，预设关联方式可以为矢量相加的方式，读出电路通过将预设方向的电信号进行矢量相加，进而得到成像光信号的偏振程度和偏振方向，之后，读出电路过滤掉不同偏振的反射光和透射光，进而确定出拍摄对象的材质属性，由此能够提供更加清晰的图像。In the embodiment of the present application, the preset correlation method may be a vector addition method, and the readout circuit obtains the polarization degree and polarization direction of the imaging optical signal by performing vector addition of the electrical signals in the preset direction, and then reads out The circuit filters out reflected and transmitted light of different polarizations to determine the material properties of the subject, which can provide a sharper image.
可以理解的是，在本申请提出的单色偏振式CIS中，每个亚波长像素单元能够吸收多个角度偏振的单色光，且亚波长像素单元的波长小于成像光信号的预设波长，使得提高了单色偏振式CIS的量子效率；PD柱的结构能够实现光学共振，其吸收效率远高于传统的PD结构，进而能够提高单色偏振式CIS的量子效率。It can be understood that, in the monochromatic polarized CIS proposed in this application, each sub-wavelength pixel unit can absorb monochromatic light polarized at multiple angles, and the wavelength of the sub-wavelength pixel unit is smaller than the preset wavelength of the imaging optical signal, The quantum efficiency of the monochromatic polarized CIS is improved; the structure of the PD column can realize optical resonance, and its absorption efficiency is much higher than that of the traditional PD structure, thereby improving the quantum efficiency of the monochromatic polarized CIS.
实施例三Embodiment 3
本申请实施例提供一种存储介质，其上存储有计算机程序，上述计算机可读存储介质存储有一个或者多个程序，上述一个或者多个程序可被一个或者多个处理器执行，应用于单色偏振式CIS1中，该计算机程序实现如实施例二所述的图像处理方法。An embodiment of the present application provides a storage medium on which a computer program is stored, the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors, and is applied to a single In the color polarized CIS1, the computer program implements the image processing method described in the second embodiment.
具体来讲，本实施例中的一种图像处理方法对应的程序指令被一电子设备读取或被执行时，包括如下步骤：Specifically, when a program instruction corresponding to an image processing method in this embodiment is read or executed by an electronic device, the following steps are included:
当获取到预设波长的成像光信号时，利用所述亚波长像素单元的至少一个PD柱吸收所述成像光信号在预设方向偏振的RGB单色光；When the imaging optical signal of the preset wavelength is acquired, use at least one PD column of the sub-wavelength pixel unit to absorb the RGB monochromatic light polarized in the preset direction of the imaging optical signal;
利用所述RGB单色光确定出偏振信息，并基于所述偏振信息得到所述成像光信号对应的偏振图像。The polarization information is determined by using the RGB monochromatic light, and a polarization image corresponding to the imaging light signal is obtained based on the polarization information.
在本发明的实施例中，进一步地，利用所述RGB单色光确定出偏振信息，上述一个或者多个程序被上述一个或者多个处理器执行，具体实现以下步骤：In the embodiment of the present invention, further, the polarization information is determined by using the RGB monochromatic light, and the above one or more programs are executed by the above one or more processors, and the following steps are specifically implemented:
将所述RGB单色光转换为所述预设方向的电信号；converting the RGB monochromatic light into an electrical signal in the preset direction;
将所述预设方向的电信号转换为数字信号，得到RAW数据；converting the electrical signal in the preset direction into a digital signal to obtain RAW data;
通过预设关联方式，将所述RAW数据进行关联，得到所述偏振信息。The RAW data is associated by a preset association method to obtain the polarization information.
以上所述，仅为本申请的较佳实施例而已，并非用于限定本申请的保护范围。The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910330446.3ACN110087004B (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarized CIS, image processing method, and storage medium |
| CN202110532808.4ACN113315934A (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarization type CIS, image processing method and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910330446.3ACN110087004B (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarized CIS, image processing method, and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110532808.4ADivisionCN113315934A (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarization type CIS, image processing method and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN110087004Atrue CN110087004A (en) | 2019-08-02 |
| CN110087004B CN110087004B (en) | 2021-07-13 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110532808.4AWithdrawnCN113315934A (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarization type CIS, image processing method and storage medium |
| CN201910330446.3AExpired - Fee RelatedCN110087004B (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarized CIS, image processing method, and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110532808.4AWithdrawnCN113315934A (en) | 2019-04-23 | 2019-04-23 | Monochromatic polarization type CIS, image processing method and storage medium |
| Country | Link |
|---|---|
| CN (2) | CN113315934A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110445998A (en)* | 2019-08-30 | 2019-11-12 | Oppo广东移动通信有限公司 | Color polarization CIS, image processing method and storage medium |
| CN110460788A (en)* | 2019-08-14 | 2019-11-15 | Oppo广东移动通信有限公司 | Monochromatic polarized CIS, image processing method, and storage medium |
| CN110505422A (en)* | 2019-08-20 | 2019-11-26 | Oppo广东移动通信有限公司 | CIS and terminal |
| CN110891137A (en)* | 2019-11-15 | 2020-03-17 | Oppo广东移动通信有限公司 | Image sensor and electronic device, image processing method and storage medium |
| CN111182245A (en)* | 2020-01-10 | 2020-05-19 | Oppo广东移动通信有限公司 | Polarization type CIS, image processing method, storage medium and terminal equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008108392A (en)* | 2006-10-27 | 2008-05-08 | Konica Minolta Opto Inc | Optical pickup device and optical information recording and reproducing apparatus |
| JP2009288658A (en)* | 2008-05-30 | 2009-12-10 | Sony Corp | Hologram recording and reproducing device, and hologram recording and reproducing method |
| US20150008553A1 (en)* | 2013-07-03 | 2015-01-08 | SK Hynix Inc. | Image sensor having 3d photoelectric conversion device |
| CN105556680A (en)* | 2013-05-22 | 2016-05-04 | 王士原 | Microstructure-enhanced absorption photosensitive device |
| CN107644456A (en)* | 2017-09-22 | 2018-01-30 | 南京理工大学 | Sea-floor relief reconstructing system and method based on polarization characteristics of lasers |
| CN108507678A (en)* | 2018-03-01 | 2018-09-07 | 东南大学 | A kind of adjustable ultraphotic spectrum detection chip of phasmon multi-resonant mechanism enhancing |
| US20180364472A1 (en)* | 2017-06-19 | 2018-12-20 | Nuflare Technology, Inc. | Polarized image acquisition apparatus, pattern inspection apparatus, polarized image acquisition method, and pattern inspection method |
| CN109164529A (en)* | 2018-09-27 | 2019-01-08 | 西北工业大学 | The micro- polarization chip arrays and its imaging device of high sampling rate real-time polarization imaging |
| CN109565578A (en)* | 2016-08-17 | 2019-04-02 | 索尼公司 | Check equipment, inspection method and program |
| CN109565545A (en)* | 2016-08-17 | 2019-04-02 | 索尼公司 | Signal handling equipment, signal processing method and program |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6492394B2 (en)* | 2013-05-31 | 2019-04-03 | 株式会社ニコン | Imaging device and imaging apparatus |
| JP2017152858A (en)* | 2016-02-23 | 2017-08-31 | キヤノン株式会社 | Radiation imaging apparatus, radiation imaging system, and processing method of radiation imaging apparatus |
| KR102677080B1 (en)* | 2016-12-29 | 2024-06-24 | 삼성전자주식회사 | Image sensor, and electronic apparatus comprising the image sensor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008108392A (en)* | 2006-10-27 | 2008-05-08 | Konica Minolta Opto Inc | Optical pickup device and optical information recording and reproducing apparatus |
| JP2009288658A (en)* | 2008-05-30 | 2009-12-10 | Sony Corp | Hologram recording and reproducing device, and hologram recording and reproducing method |
| CN105556680A (en)* | 2013-05-22 | 2016-05-04 | 王士原 | Microstructure-enhanced absorption photosensitive device |
| US20150008553A1 (en)* | 2013-07-03 | 2015-01-08 | SK Hynix Inc. | Image sensor having 3d photoelectric conversion device |
| CN109565578A (en)* | 2016-08-17 | 2019-04-02 | 索尼公司 | Check equipment, inspection method and program |
| CN109565545A (en)* | 2016-08-17 | 2019-04-02 | 索尼公司 | Signal handling equipment, signal processing method and program |
| US20180364472A1 (en)* | 2017-06-19 | 2018-12-20 | Nuflare Technology, Inc. | Polarized image acquisition apparatus, pattern inspection apparatus, polarized image acquisition method, and pattern inspection method |
| CN107644456A (en)* | 2017-09-22 | 2018-01-30 | 南京理工大学 | Sea-floor relief reconstructing system and method based on polarization characteristics of lasers |
| CN108507678A (en)* | 2018-03-01 | 2018-09-07 | 东南大学 | A kind of adjustable ultraphotic spectrum detection chip of phasmon multi-resonant mechanism enhancing |
| CN109164529A (en)* | 2018-09-27 | 2019-01-08 | 西北工业大学 | The micro- polarization chip arrays and its imaging device of high sampling rate real-time polarization imaging |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110460788A (en)* | 2019-08-14 | 2019-11-15 | Oppo广东移动通信有限公司 | Monochromatic polarized CIS, image processing method, and storage medium |
| CN110505422A (en)* | 2019-08-20 | 2019-11-26 | Oppo广东移动通信有限公司 | CIS and terminal |
| CN110505422B (en)* | 2019-08-20 | 2022-01-11 | Oppo广东移动通信有限公司 | CIS and terminal |
| CN110445998A (en)* | 2019-08-30 | 2019-11-12 | Oppo广东移动通信有限公司 | Color polarization CIS, image processing method and storage medium |
| CN110445998B (en)* | 2019-08-30 | 2022-02-25 | Oppo广东移动通信有限公司 | A color polarized CIS, image processing method, and storage medium |
| CN110891137A (en)* | 2019-11-15 | 2020-03-17 | Oppo广东移动通信有限公司 | Image sensor and electronic device, image processing method and storage medium |
| CN111182245A (en)* | 2020-01-10 | 2020-05-19 | Oppo广东移动通信有限公司 | Polarization type CIS, image processing method, storage medium and terminal equipment |
| Publication number | Publication date |
|---|---|
| CN113315934A (en) | 2021-08-27 |
| CN110087004B (en) | 2021-07-13 |
| Publication | Publication Date | Title |
|---|---|---|
| CN110087005B (en) | A color polarized CIS, image processing method, and storage medium | |
| CN110087004B (en) | Monochromatic polarized CIS, image processing method, and storage medium | |
| Garcia et al. | Bioinspired polarization imager with high dynamic range | |
| JP7662649B2 (en) | Image sensor, spectral division and filtering device, and image sensor manufacturing method | |
| JP6725526B2 (en) | Imager with image to create spatially encoded image in a distributed manner | |
| CN110112155B (en) | Pixel unit, image sensor, image processing method, and storage medium | |
| US11394902B2 (en) | Sparse infrared pixel design for image sensors | |
| CN103703770A (en) | Polarized color imaging device | |
| CN110740277B (en) | Image sensor, electronic device and imaging method | |
| CN107851653A (en) | Extend the system and method for the near infrared spectrum response for imaging system | |
| CN110225319B (en) | Image sensor, image processing method and storage medium | |
| CN110445998B (en) | A color polarized CIS, image processing method, and storage medium | |
| WO2020238576A1 (en) | Complementary metal oxide image sensor, image processing method, and storage medium | |
| CN110504279A (en) | Polarization type CIS, image processing method, storage medium and terminal equipment | |
| CN110061019A (en) | Complementary metal oxide image sensor, image processing method and storage medium | |
| CN110740236A (en) | Image sensor, electronic device, image processing method, and storage medium | |
| CN110505422B (en) | CIS and terminal | |
| JP7293020B2 (en) | Imaging element and imaging device provided with the same | |
| CN110312088A (en) | Pixel unit circuit, image processing method and storage medium | |
| CN110112156A (en) | Pixel structure, CMOS image sensor and terminal | |
| CN217982098U (en) | Liquid crystal polarization camera system based on micro-lens array | |
| CN111223882B (en) | Image sensor, image processing method and storage medium | |
| CN110460788A (en) | Monochromatic polarized CIS, image processing method, and storage medium | |
| CN110290328A (en) | Focusing method, device, terminal and computer storage medium | |
| CN110418055A (en) | Focusing method, image sensor and computer storage medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20210713 |