技术领域Technical Field
本发明涉及光学成像技术领域，尤其涉及一种偏振成像方法、装置、电子设备及存储介质。The present invention relates to the field of optical imaging technology, and in particular to a polarization imaging method, device, electronic equipment and storage medium.
背景技术Background technique
随着制造业的发展，产品在线检测领域对工业相机的应用提出了更高的要求，普通的黑白相机和彩色相机已经无法满足某些工业应用需求，偏振相机可以获取目标物体的更多信息，从而可以更好地应用。偏振相机可以分为以下几种：分时式（division oftime）、分振幅式（division of amplitude）、分孔径式（division of aperture）以及分焦平面式（division of focal plane）。因为体积小、集成度高以及实时性强等特有的优势，分焦平面式偏振成像系统的应用越来越热门，尤其在缺陷检测领域。With the development of the manufacturing industry, the field of product online inspection has put forward higher requirements for the application of industrial cameras. Ordinary black and white cameras and color cameras can no longer meet the needs of certain industrial applications. Polarization cameras can obtain more information about the target object, so they can be better applied. Polarization cameras can be divided into the following types: division of time, division of amplitude, division of aperture, and division of focal plane. Due to its unique advantages such as small size, high integration, and strong real-time performance, the application of focal plane polarization imaging systems is becoming more and more popular, especially in the field of defect detection.
常规的分焦平面式偏振相机是通过牺牲一些分辨率的方式同时获取多个偏振方向的信息，该方式的成像分辨率会受到限制，因此图像质量较差。Conventional split-focal plane polarization cameras simultaneously acquire information in multiple polarization directions by sacrificing some resolution. The imaging resolution of this method is limited, so the image quality is poor.
发明内容Summary of the invention
本发明的主要目的在于提供一种偏振成像方法、装置、电子设备及存储介质，旨在解决目前的偏振成像方式成像分辨率受到限制，图像质量较差的技术问题。The main purpose of the present invention is to provide a polarization imaging method, device, electronic device and storage medium, aiming to solve the technical problems of the current polarization imaging method with limited imaging resolution and poor image quality.
为实现上述目的，本发明提供一种偏振成像方法，该方法包括：To achieve the above object, the present invention provides a polarization imaging method, which comprises:
获取偏振图像采集设备生成的原始偏振图像；Acquire an original polarization image generated by a polarization image acquisition device;
根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同；Decomposing the original polarization image into a plurality of blocking images according to a preset polarization direction in the polarization image acquisition device, wherein the polarization directions between the blocking images are different and the polarization directions in the blocking images are the same;
对各所述遮挡图像进行图像还原处理，得到目标偏振图像。Perform image restoration processing on each of the blocked images to obtain a target polarization image.
可选地，所述偏振图像采集设备包括沿光路依次设置的物镜、偏振片阵列、针孔阵列和光电探测器，所述获取偏振图像采集设备生成的原始偏振图像的步骤包括：Optionally, the polarization image acquisition device includes an objective lens, a polarizer array, a pinhole array, and a photodetector sequentially arranged along the light path, and the step of acquiring the original polarization image generated by the polarization image acquisition device includes:
通过所述物镜，将待成像目标经由所述偏振片阵列和所述针孔阵列成像至所述光电探测器上；By means of the objective lens, an object to be imaged is imaged onto the photodetector via the polarizer array and the pinhole array;
获取所述光电探测器探测到的所述原始偏振图像。The original polarization image detected by the photodetector is acquired.
可选地，所述偏振图像采集设备包括沿光路依次设置的微偏振透镜、微偏振阵列和光电探测器，所述获取偏振图像采集设备生成的原始偏振图像的步骤包括：Optionally, the polarization image acquisition device includes a micro-polarization lens, a micro-polarization array, and a photodetector sequentially arranged along the light path, and the step of acquiring an original polarization image generated by the polarization image acquisition device includes:
通过所述微偏振透镜，将待成像目标经由所述微偏振阵列成像至所述光电探测器上；By means of the micro-polarization lens, an object to be imaged is imaged onto the photodetector via the micro-polarization array;
获取所述光电探测器探测到的所述原始偏振图像。The original polarization image detected by the photodetector is acquired.
可选地，所述根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像的步骤包括：Optionally, the step of decomposing the original polarization image into a plurality of occlusion images according to a preset polarization direction in the polarization image acquisition device includes:
将所述预设偏振方向中的第一个偏振方向作为目标偏振方向；Using a first polarization direction among the preset polarization directions as a target polarization direction;
保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像；Retaining pixel units in the original polarization image having the same polarization direction as the target polarization direction, and blocking the remaining pixel units in the original polarization image to obtain a blocked image in the target polarization direction;
将所述第一个偏振方向的下一个偏振方向作为所述目标偏振方向，执行所述保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像的步骤，直至遍历所述预设偏振方向。The next polarization direction of the first polarization direction is used as the target polarization direction, and the steps of retaining the pixel units in the original polarization image that have the same polarization direction as the target polarization direction and blocking the remaining pixel units in the original polarization image to obtain the blocked image of the target polarization direction are performed until the preset polarization direction is traversed.
可选地，所述对各所述遮挡图像进行图像还原处理，得到目标偏振图像的步骤包括：Optionally, the step of performing image restoration processing on each of the blocked images to obtain a target polarization image includes:
对于各所述遮挡图像，将所述遮挡图像中的可见像素单元输入编码器中，得到特征向量；For each of the occluded images, inputting visible pixel units in the occluded image into an encoder to obtain a feature vector;
将所述特征向量和所述遮挡图像中的遮挡像素单元输入解码器中，还原得到所述遮挡图像对应的目标偏振图像。The feature vector and the occluded pixel unit in the occluded image are input into a decoder to restore the target polarization image corresponding to the occluded image.
可选地，所述对各所述遮挡图像进行图像还原处理，得到目标偏振图像的步骤包括：Optionally, the step of performing image restoration processing on each of the blocked images to obtain a target polarization image includes:
对于各所述遮挡图像，获取所述遮挡图像中的可见像素单元的响应值；For each of the occluded images, obtaining a response value of a visible pixel unit in the occluded image;
根据所述响应值，对所述遮挡图像中的遮挡像素单元进行双三次样条插值处理，得到所述遮挡图像对应的目标偏振图像。According to the response value, bicubic spline interpolation processing is performed on the blocked pixel units in the blocked image to obtain a target polarization image corresponding to the blocked image.
可选地，在所述对各所述遮挡图像进行图像还原处理，得到目标偏振图像的步骤之后，所述方法还包括：Optionally, after the step of performing image restoration processing on each of the blocked images to obtain a target polarization image, the method further includes:
基于斯托克斯模型和所述目标偏振图像计算偏振度和偏振角；Calculate the degree of polarization and the polarization angle based on the Stokes model and the target polarization image;
根据所述偏振度输出偏振度图像，根据所述偏振角输出偏振角图像。A polarization degree image is output according to the polarization degree, and a polarization angle image is output according to the polarization angle.
此外，为实现上述目的，本发明还提供一种偏振成像装置，所述偏振成像装置包括：In addition, to achieve the above-mentioned purpose, the present invention further provides a polarization imaging device, the polarization imaging device comprising:
获取模块，用于获取偏振图像采集设备生成的原始偏振图像；An acquisition module, used to acquire an original polarization image generated by a polarization image acquisition device;
分解模块，用于根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同；A decomposition module, configured to decompose the original polarization image into a plurality of occlusion images according to a preset polarization direction in the polarization image acquisition device, wherein the polarization directions of the occlusion images are different and the polarization directions in the occlusion images are the same;
还原模块，用于对各所述遮挡图像进行图像还原处理，得到目标偏振图像。The restoration module is used to perform image restoration processing on each of the blocked images to obtain a target polarization image.
此外，为实现上述目的，本发明还提供一种电子设备，所述电子设备包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的偏振成像程序，所述偏振成像程序配置为实现如上文所述的偏振成像方法的步骤。In addition, to achieve the above-mentioned purpose, the present invention also provides an electronic device, which includes: a memory, a processor, and a polarization imaging program stored in the memory and executable on the processor, wherein the polarization imaging program is configured to implement the steps of the polarization imaging method described above.
此外，为实现上述目的，本发明还提供一种存储介质，所述计算机可读存储介质上存储有偏振成像程序，所述偏振成像程序被处理器执行时实现如上文所述的偏振成像方法的步骤。In addition, to achieve the above-mentioned purpose, the present invention further provides a storage medium, on which a polarization imaging program is stored, and when the polarization imaging program is executed by a processor, the steps of the polarization imaging method described above are implemented.
本发明实施例提供的偏振成像方法，获取偏振图像采集设备生成的原始偏振图像，原始偏振图像能够反映光线经过偏振之后在不同偏振方向上的响应；根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同，每张遮挡图像中保留一个偏振方向的信息；对各所述遮挡图像进行图像还原处理，得到目标偏振图像，以遮挡图像中偏振方向的信息进行预测，将遮挡图像还原为完整的目标偏振图像，如此，对于完整的图像而言，其分辨率就是遮挡图像中偏振方向所在的像素单元，相比于相关技术中使用多个偏振方向为依据得到完整图像的方式，分辨率得到提升，偏振图像的质量也得到提高。The polarization imaging method provided by the embodiment of the present invention obtains an original polarization image generated by a polarization image acquisition device, and the original polarization image can reflect the response of light in different polarization directions after being polarized; according to the preset polarization direction in the polarization image acquisition device, the original polarization image is decomposed into multiple occlusion images, wherein the polarization directions between the occlusion images are different, the polarization directions in the occlusion images are the same, and each occlusion image retains information of a polarization direction; image restoration processing is performed on each of the occlusion images to obtain a target polarization image, and the polarization direction information in the occlusion image is used for prediction to restore the occlusion image to a complete target polarization image. In this way, for the complete image, its resolution is the pixel unit where the polarization direction in the occlusion image is located. Compared with the method of using multiple polarization directions as the basis to obtain a complete image in the related art, the resolution is improved and the quality of the polarization image is also improved.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例方案涉及的硬件运行环境的电子设备的结构示意图；FIG1 is a schematic diagram of the structure of an electronic device in a hardware operating environment according to an embodiment of the present invention;
图2为一种偏振片阵列的偏振方向分布示意图；FIG2 is a schematic diagram of polarization direction distribution of a polarizer array;
图3为偏振相机各像素采集信息对应的偏振角度示意图；FIG3 is a schematic diagram of the polarization angle corresponding to the information collected by each pixel of the polarization camera;
图4为相关技术中进行偏振图像处理的示意图；FIG4 is a schematic diagram of polarization image processing in the related art;
图5为本发明偏振成像方法第一实施例的流程示意图；FIG5 is a schematic diagram of a process flow of a first embodiment of a polarization imaging method according to the present invention;
图6为本发明实施例涉及的将原始偏振图像分解为多张遮挡图像的示意图；FIG6 is a schematic diagram of decomposing an original polarization image into multiple occlusion images according to an embodiment of the present invention;
图7为本发明实施例涉及的一种偏振图像采集设备的结构示意图；FIG7 is a schematic structural diagram of a polarization image acquisition device according to an embodiment of the present invention;
图8为本发明实施例涉及的MAE算法的结构示意图；FIG8 is a schematic diagram of the structure of the MAE algorithm involved in an embodiment of the present invention;
图9为本发明实施例涉及的通过MAE算法还原遮挡图像的示意图；FIG9 is a schematic diagram of restoring an occluded image by using a MAE algorithm according to an embodiment of the present invention;
图10为本发明实施例偏振成像装置的示意图。FIG. 10 is a schematic diagram of a polarization imaging device according to an embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
参照图1，图1为本发明实施例方案涉及的硬件运行环境的电子设备结构示意图。Refer to FIG. 1 , which is a schematic diagram of the structure of an electronic device in a hardware operating environment according to an embodiment of the present invention.
如图1所示，该电子设备可以包括：处理器1001，例如中央处理器（CentralProcessing Unit，CPU），通信总线1002、用户接口1003，网络接口1004，存储器1005。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏（Display）、输入单元比如键盘（Keyboard），可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口（如无线保真（WIreless-FIdelity，WI-FI）接口）。存储器1005可以是高速的随机存取存储器（RandomAccess Memory，RAM）存储器，也可以是稳定的非易失性存储器（Non-Volatile Memory，NVM），例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG1 , the electronic device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
本领域技术人员可以理解，图1中示出的结构并不构成对电子设备的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。Those skilled in the art will appreciate that the structure shown in FIG. 1 does not limit the electronic device and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
如图1所示，作为一种存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及偏振成像程序。As shown in FIG. 1 , the memory 1005 as a storage medium may include an operating system, a network communication module, a user interface module, and a polarization imaging program.
在图1所示的电子设备中，网络接口1004主要用于与其他设备进行数据通信；用户接口1003主要用于与用户进行数据交互；本发明电子设备中的处理器1001、存储器1005可以设置在电子设备中，所述电子设备通过处理器1001调用存储器1005中存储的偏振成像程序，并执行本发明实施例提供的偏振成像方法。In the electronic device shown in FIG1 , the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the electronic device of the present invention can be set in the electronic device, and the electronic device calls the polarization imaging program stored in the memory 1005 through the processor 1001, and executes the polarization imaging method provided by the embodiment of the present invention.
图2为一种偏振片阵列的偏振方向分布示意图，此偏振片阵列为2×2大小，其中左上角的双向箭头可表示线偏振方向为0°，右上角的双向箭头可表示线偏振方向为45°，右下角的双向箭头可表示线偏振方向为90°，左下角的双向箭头可表示线偏振方向为135°，采用此偏振片阵列，相邻的2×2像素采集的数据即为4种偏振方向的数据。图3为偏振相机各像素采集信号对应的偏振角度示意图，每个格子代表一个像素，每个包含4种偏振方向的相邻2×2像素可以合称为体像素（或超像素）。图4为相关技术中进行偏振图像处理的示意图，如图4所示，相关技术中的处理方式把不同偏振方向的响应当作是一个体像素在该偏振方向的响应，从而可以获得4张不同偏振方向的图片，来进行后续的处理和计算。但是在这种方式中，最终图像的分辨率实际是体像素分辨率，相对于光电探测器的像素单元数，实际上分辨率变差了许多。FIG2 is a schematic diagram of the polarization direction distribution of a polarizer array. The polarizer array is 2×2 in size, wherein the double-headed arrow in the upper left corner indicates that the linear polarization direction is 0°, the double-headed arrow in the upper right corner indicates that the linear polarization direction is 45°, the double-headed arrow in the lower right corner indicates that the linear polarization direction is 90°, and the double-headed arrow in the lower left corner indicates that the linear polarization direction is 135°. With this polarizer array, the data collected by adjacent 2×2 pixels are data of four polarization directions. FIG3 is a schematic diagram of the polarization angle corresponding to the collected signal of each pixel of the polarization camera. Each grid represents a pixel, and each adjacent 2×2 pixel containing four polarization directions can be collectively referred to as a body pixel (or super pixel). FIG4 is a schematic diagram of polarization image processing in the related art. As shown in FIG4, the processing method in the related art regards the response of different polarization directions as the response of a body pixel in the polarization direction, so that four pictures of different polarization directions can be obtained for subsequent processing and calculation. However, in this method, the resolution of the final image is actually the body pixel resolution, which is actually much worse than the number of pixel units of the photodetector.
本发明实施例提供了一种偏振成像方法，参照图5，图5为本发明一种偏振成像方法第一实施例的流程示意图。An embodiment of the present invention provides a polarization imaging method. Referring to FIG. 5 , FIG. 5 is a schematic flow chart of a first embodiment of a polarization imaging method of the present invention.
本实施例中，所述偏振成像方法包括：In this embodiment, the polarization imaging method includes:
步骤S10，获取偏振图像采集设备生成的原始偏振图像；Step S10, acquiring an original polarization image generated by a polarization image acquisition device;
偏振图像采集设备是指通过对待成像目标进行偏振成像，得到与待成像目标对应的偏振图像的设备。本实施例所采用的偏振图像采集设备，具有高探测成像速度和高空间分辨率的特点，可以同时采集多个不同偏振方向的响应。原始偏振图像是指偏振图像采集设备生成的偏振图像，原始偏振图像具有如图3所示的特点。本实施例对获取原始偏振图像的实施方式不做具体限制，偏振图像采集设备可以具有不同的设置，以适应实际需求。A polarization image acquisition device refers to a device that obtains a polarization image corresponding to a target to be imaged by performing polarization imaging on the target to be imaged. The polarization image acquisition device used in this embodiment has the characteristics of high detection imaging speed and high spatial resolution, and can simultaneously acquire responses in multiple different polarization directions. An original polarization image refers to a polarization image generated by the polarization image acquisition device, and the original polarization image has the characteristics shown in FIG3. This embodiment does not specifically limit the implementation method for obtaining the original polarization image, and the polarization image acquisition device can have different settings to meet actual needs.
在一些可实施的方式中，将本实施例偏振成像方法应用于芯片缺陷检测领域，所检测的芯片包括Micro-LED（微米发光二极管）芯片。偏振图像采集设备以待检测的芯片为成像目标，置于成像范围内，进行偏振成像，通过成像得到的图像确定芯片是否存在缺陷。In some practicable ways, the polarization imaging method of this embodiment is applied to the field of chip defect detection, and the detected chips include Micro-LED (micron light emitting diode) chips. The polarization image acquisition device takes the chip to be detected as the imaging target, places it within the imaging range, performs polarization imaging, and determines whether the chip has defects through the image obtained by imaging.
作为一种示例，所述偏振图像采集设备包括沿光路依次设置的微偏振透镜、微偏振阵列和光电探测器，步骤S10包括：As an example, the polarization image acquisition device includes a micro-polarization lens, a micro-polarization array, and a photodetector sequentially arranged along the light path, and step S10 includes:
步骤A10，通过所述微偏振透镜，将待成像目标经由所述微偏振阵列成像至所述光电探测器上；Step A10, imaging the target to be imaged onto the photodetector via the micro-polarization array through the micro-polarization lens;
偏振图像采集设备可以包括前置光学系统和后置光学系统。通过前置光学系统将待成像目标成像在微偏振透镜所在的物方焦平面，微偏振透镜将待成像目标成像到光电探测器上。微偏振阵列位于光电探测器前方，可以与光电探测器耦合，经过微偏振阵列的调制作用，待成像目标在不同方向上的光能辐射被调制为特定线偏振角度的光，由光电探测器探测到。微偏振阵列中包含多个不同偏振方向的偏振片。每个微透镜可以对应光电探测器的一个体像素。微透镜也可以采用阵列的形式设置。The polarization image acquisition device may include a front optical system and a rear optical system. The target to be imaged is imaged on the object focal plane where the micro-polarization lens is located through the front optical system, and the micro-polarization lens images the target to be imaged onto the photodetector. The micro-polarization array is located in front of the photodetector and can be coupled with the photodetector. After the modulation of the micro-polarization array, the light energy radiation of the target to be imaged in different directions is modulated into light with a specific linear polarization angle, which is detected by the photodetector. The micro-polarization array contains multiple polarizers with different polarization directions. Each microlens can correspond to a body pixel of the photodetector. The microlenses can also be arranged in the form of an array.
步骤A20，获取所述光电探测器探测到的所述原始偏振图像。Step A20, acquiring the original polarization image detected by the photodetector.
所使用的光电探测器可以包括CCD（Charge-coupled Device，感光耦合组件）或者CMOS（Complementary Metal-Oxide-Semiconductor，互补金属氧化物半导体）传感器。来自待成像目标的光线最终到达光电探测器，光电探测器对探测到的光线进行响应，生成包括不同线偏振方向的原始偏振图像。获取光电探测器生成的原始偏振图像。The photodetector used may include a CCD (Charge-coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) sensor. The light from the target to be imaged eventually reaches the photodetector, which responds to the detected light and generates an original polarization image including different linear polarization directions. The original polarization image generated by the photodetector is obtained.
步骤S20，根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同；Step S20, decomposing the original polarization image into a plurality of blocking images according to a preset polarization direction in the polarization image acquisition device, wherein the polarization directions between the blocking images are different and the polarization directions in the blocking images are the same;
预设偏振方向是指偏振图像采集设备中具有偏振调制作用的部件包含的偏振方向。对于采用偏振片进行线性偏振调制的设备来说，预设偏振方向是指偏振片的偏振方向。本实施例中，偏振图像采集设备可以同时采集不同偏振方向的偏振光信息，其中包含的偏振调制部件也具有不同的偏振方向。在一些可实施的方式中，采用0°、45°、90°和135°这些偏振方向的偏振片组合成偏振片阵列，则预设偏振方向包含了上述角度的偏振方向。The preset polarization direction refers to the polarization direction included in the component with polarization modulation function in the polarization image acquisition device. For a device that uses a polarizer for linear polarization modulation, the preset polarization direction refers to the polarization direction of the polarizer. In this embodiment, the polarization image acquisition device can simultaneously collect polarized light information of different polarization directions, and the polarization modulation components contained therein also have different polarization directions. In some practicable methods, polarizers with polarization directions of 0°, 45°, 90° and 135° are combined into a polarizer array, and the preset polarization direction includes the polarization directions of the above angles.
图6为将原始偏振图像分解为多张遮挡图像的示意图，如图6所示，对原始偏振图像的分解基于每个像素的偏振方向进行，使得在每张遮挡图像中，未遮挡的像素单元都具有相同的偏振方向，而各遮挡图像之间的偏振方向不同。在一些可实施的方式中，预设偏振方向包含4个方向，体像素中其它3个方向的像素单元被遮挡，那么对于整个遮挡图像来说，遮挡比例为75%，1张原始偏振图像就可以分解为4张75%遮挡的遮挡图像。FIG6 is a schematic diagram of decomposing an original polarization image into multiple occlusion images. As shown in FIG6, the decomposition of the original polarization image is performed based on the polarization direction of each pixel, so that in each occlusion image, the unoccluded pixel units have the same polarization direction, while the polarization directions of the occlusion images are different. In some practicable embodiments, the preset polarization direction includes 4 directions, and the pixel units in the other 3 directions in the body pixel are occluded. Then, for the entire occlusion image, the occlusion ratio is 75%, and 1 original polarization image can be decomposed into 4 occlusion images with 75% occlusion.
步骤S30，对各所述遮挡图像进行图像还原处理，得到目标偏振图像。Step S30, performing image restoration processing on each of the blocked images to obtain a target polarization image.
图像还原处理是指将遮挡图像还原为完整图像的处理，将遮挡图像中不可见的像素单元还原为可见的像素单元，得到目标偏振图像，目标偏振图像中可见像素单元的偏振方向相同。本实施例对进行图像还原处理的实施方式不做具体限制，例如，可以采用图像插值算法对遮挡图像进行图像还原处理，得到目标偏振图像。Image restoration processing refers to the process of restoring the blocked image to a complete image, restoring the invisible pixel units in the blocked image to visible pixel units, and obtaining a target polarization image, in which the polarization directions of the visible pixel units are the same. This embodiment does not specifically limit the implementation method of image restoration processing. For example, an image interpolation algorithm can be used to perform image restoration processing on the blocked image to obtain a target polarization image.
图像插值算法处理过程中，对于给定的像素点，可以根据给定像素点周围像素点的信息来对该像素点的值进行预测，应用在本实施例中，可以对遮挡位置处的像素响应值进行预测，得到预测值，预测值与可见位置处的像素响应值进行组合，得到目标偏振图像。During the image interpolation algorithm processing, for a given pixel point, the value of the pixel point can be predicted based on the information of the pixels around the given pixel point. In this embodiment, the pixel response value at the occluded position can be predicted to obtain a predicted value, which is combined with the pixel response value at the visible position to obtain a target polarized image.
作为一种示例，步骤S30包括：As an example, step S30 includes:
步骤B10，对于各所述遮挡图像，获取所述遮挡图像中的可见像素单元的响应值；Step B10, for each of the occluded images, obtaining a response value of a visible pixel unit in the occluded image;
可见像素单元是指遮挡图像中未被遮挡的像素单元，像素单元是指进行图像显示的最小单元。参照图3，一个像素单元可以对应图3中的一个方格。对于偏振图像采集设备中的光电探测器而言，其可以采集到照射至表面的光强信息，将此光强信息作为响应值。对于每张遮挡图像，由于其遮挡的像素位置不同，都可以获取可见像素单元的响应值，作为后续进行图像还原的基础。A visible pixel unit refers to an unobstructed pixel unit in an occluded image, and a pixel unit refers to the smallest unit for image display. Referring to FIG3 , a pixel unit may correspond to a square in FIG3 . For the photodetector in the polarization image acquisition device, it may collect the light intensity information irradiated to the surface, and use this light intensity information as a response value. For each occluded image, due to the different positions of the occluded pixels, the response value of the visible pixel unit may be obtained, which serves as the basis for subsequent image restoration.
步骤B20，根据所述响应值，对所述遮挡图像中的遮挡像素单元进行双三次样条插值处理，得到所述遮挡图像对应的目标偏振图像。Step B20: performing bicubic spline interpolation processing on the blocked pixel units in the blocked image according to the response values to obtain a target polarization image corresponding to the blocked image.
在双三次样条插值处理中，对于遮挡图像中的像素，选取与该像素最近的16个像素点，作为计算目标偏振图像中的对应像素点的依据，目标偏振图像中像素的参数可以采用选取的16个像素点的参数进行加权内插得到。采用双三次样条插值的方法进行图像还原，相比于最近邻方法和线性插值方法的效果更好。In the bicubic spline interpolation process, for a pixel in the occluded image, the 16 pixels closest to the pixel are selected as the basis for calculating the corresponding pixel in the target polarization image. The parameters of the pixel in the target polarization image can be obtained by weighted interpolation using the parameters of the selected 16 pixels. The bicubic spline interpolation method is used for image restoration, which has better results than the nearest neighbor method and linear interpolation method.
在本实施例中，获取偏振图像采集设备生成的原始偏振图像，原始偏振图像能够反映光线经过偏振之后在不同偏振方向上的响应；根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同，每张遮挡图像中保留一个偏振方向的信息；对各所述遮挡图像进行图像还原处理，得到目标偏振图像，以遮挡图像中偏振方向的信息进行预测，将遮挡图像还原为完整的目标偏振图像，如此，对于完整的图像而言，其分辨率就是遮挡图像中偏振方向所在的像素单元，相比于相关技术中使用多个偏振方向为依据得到完整图像的方式，分辨率得到提升，偏振图像的质量也得到提高。In this embodiment, an original polarization image generated by a polarization image acquisition device is obtained, and the original polarization image can reflect the response of light in different polarization directions after being polarized; according to a preset polarization direction in the polarization image acquisition device, the original polarization image is decomposed into multiple occlusion images, wherein the polarization directions between the occlusion images are different, the polarization directions in the occlusion images are the same, and information of a polarization direction is retained in each occlusion image; image restoration processing is performed on each of the occlusion images to obtain a target polarization image, and the polarization direction information in the occlusion image is used for prediction, and the occlusion image is restored to a complete target polarization image. In this way, for a complete image, its resolution is the pixel unit where the polarization direction in the occlusion image is located. Compared with the method of using multiple polarization directions as the basis to obtain a complete image in the related art, the resolution is improved and the quality of the polarization image is also improved.
进一步的，在本发明偏振成像方法的第二实施例中，图7为一种偏振图像采集设备的结构示意图，如图7所示，偏振图像采集设备包括沿光路依次设置的物镜、偏振片阵列、针孔阵列和光电探测器，该方法包括：Further, in a second embodiment of the polarization imaging method of the present invention, FIG. 7 is a schematic diagram of the structure of a polarization image acquisition device. As shown in FIG. 7 , the polarization image acquisition device includes an objective lens, a polarizer array, a pinhole array, and a photodetector sequentially arranged along an optical path. The method includes:
步骤S11，通过所述物镜，将待成像目标经由所述偏振片阵列和所述针孔阵列成像至所述光电探测器上；Step S11, using the objective lens, imaging the target to be imaged onto the photodetector via the polarizer array and the pinhole array;
来自待成像目标的光线通过物镜在针孔阵列中成像，位于针孔阵列后方的光电探测器接收针孔阵列的成像。偏振片阵列位于物镜后方，对透过物镜的光线进行调制，在光电探测器中形成偏振光线的信息。针孔阵列中的每个针孔对应包含4个偏振方向的像素。The light from the target to be imaged is imaged in the pinhole array through the objective lens, and the photodetector behind the pinhole array receives the image of the pinhole array. The polarizer array is located behind the objective lens, modulating the light passing through the objective lens and forming polarized light information in the photodetector. Each pinhole in the pinhole array corresponds to a pixel containing four polarization directions.
步骤S12，获取所述光电探测器探测到的所述原始偏振图像。Step S12, acquiring the original polarization image detected by the photodetector.
光电探测器对针孔阵列的成像进行采集，形成原始偏振图像，还可以采集得到形成原始偏振图像的每个像素的偏振光信息，例如光强响应值。通过光路中各种部件的设置，光电探测器可以同时采集到不同线偏振方向的信息。与使用微偏振阵列和微偏振透镜的结构方案相比，本实施例中的偏振图像采集设备采用光场结构，也能够满足高探测成像速度的要求，适用于芯片产线检测。The photodetector collects the imaging of the pinhole array to form an original polarization image, and can also collect polarization light information of each pixel that forms the original polarization image, such as the light intensity response value. By setting various components in the optical path, the photodetector can simultaneously collect information in different linear polarization directions. Compared with the structural solution using a micro-polarization array and a micro-polarization lens, the polarization image acquisition device in this embodiment adopts a light field structure, which can also meet the requirements of high detection imaging speed and is suitable for chip production line detection.
在本实施例中，采用光场结构的偏振图像采集设备，设备结构较为简单，制作成本低、制作难度小，且能够满足高探测成像速度和高空间分辨率的产线检测要求。In this embodiment, a polarization image acquisition device using a light field structure has a relatively simple device structure, low manufacturing cost, low manufacturing difficulty, and can meet the production line detection requirements of high detection imaging speed and high spatial resolution.
进一步的，在本发明偏振成像方法的第三实施例中，该方法包括：Furthermore, in a third embodiment of the polarization imaging method of the present invention, the method includes:
步骤S21，将所述预设偏振方向中的第一个偏振方向作为目标偏振方向；Step S21, taking the first polarization direction among the preset polarization directions as the target polarization direction;
以预设偏振方向包含0°、45°、90°和135°这4个偏振方向为例，可以按照上述次序作为预设偏振方向的排序，则第一个偏振方向为0°，将0°作为目标偏振方向。Taking the preset polarization directions including 0°, 45°, 90° and 135° as an example, the preset polarization directions can be sorted in the above order, and the first polarization direction is 0°, and 0° is used as the target polarization direction.
步骤S22，保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像；Step S22, retaining pixel units in the original polarization image having the same polarization direction as the target polarization direction, and blocking the remaining pixel units in the original polarization image to obtain a blocked image in the target polarization direction;
参照图6，对于0°偏振方向来说，需要保留原始偏振图像中偏振方向为0°的像素单元，将其它偏振方向的其余像素单元遮挡。由于每个体像素中包含一个0°偏振方向，对于每个体像素来说，遮挡比例为75%，推广至整张遮挡图像中，遮挡比例也为75%。在遮挡图像中，目标偏振方向的像素单元可见，而其余像素单元不可见，其余像素单元的光强响应值也未知。Referring to Figure 6, for the 0° polarization direction, the pixel units with a polarization direction of 0° in the original polarization image need to be retained, and the remaining pixel units with other polarization directions need to be blocked. Since each hoxel contains a 0° polarization direction, the occlusion ratio for each hoxel is 75%, which is also 75% for the entire blocked image. In the blocked image, the pixel units with the target polarization direction are visible, while the remaining pixel units are invisible, and the light intensity response values of the remaining pixel units are unknown.
步骤S23，将所述第一个偏振方向的下一个偏振方向作为所述目标偏振方向，执行所述保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像的步骤，直至遍历所述预设偏振方向。Step S23, taking the next polarization direction of the first polarization direction as the target polarization direction, executing the step of retaining the pixel units in the original polarization image that have the same polarization direction as the target polarization direction, blocking the remaining pixel units in the original polarization image, and obtaining the blocked image of the target polarization direction, until the preset polarization direction is traversed.
在得到0°偏振方向的遮挡图像之后，可以继续进行45°偏振方向的图像处理，得到45°偏振方向的遮挡图像，处理过程相似，所需遮挡的像素单元有所不同。重复执行上述进行图像遮挡的操作，直至得到所有4个偏振方向的遮挡图像。After obtaining the occlusion image in the 0° polarization direction, the image processing in the 45° polarization direction can be continued to obtain the occlusion image in the 45° polarization direction. The processing process is similar, but the pixel units to be occluded are different. Repeat the above image occlusion operation until the occlusion images in all four polarization directions are obtained.
在本实施例中，将原始偏振图像分解为多张遮挡图像，遮挡图像的数量与预设偏振方向中包含的偏振方向的数量相同，每张遮挡图像中仅包含一个偏振方向的像素单元信息，作为后续进行图像还原处理的依据。In this embodiment, the original polarization image is decomposed into multiple occlusion images, the number of occlusion images is the same as the number of polarization directions included in the preset polarization direction, and each occlusion image only contains pixel unit information of one polarization direction as a basis for subsequent image restoration processing.
进一步的，在本发明偏振成像方法的第四实施例中，该方法包括：Furthermore, in a fourth embodiment of the polarization imaging method of the present invention, the method includes:
步骤S31，对于各所述遮挡图像，将所述遮挡图像中的可见像素单元输入编码器中，得到特征向量；Step S31, for each of the occluded images, inputting the visible pixel units in the occluded image into an encoder to obtain a feature vector;
本实施例采用MAE（Masked Autoencoders，掩膜自编码）算法进行图像还原处理。图8为MAE算法的结构示意图，如图8所示，MAE算法采用不对称的编码解码结构，首先将input（输入图像）切分为许多图像块，对图像块进行mask操作，图像块分为可见图像块和遮挡图像块，将可见图像块输入encoder（编码器）中，得到隐变量，再将隐变量与遮挡图像块按照图像顺序进行组合，输入decoder（解码器）中，得到target（目标图像）。在预训练期间，大量随机图像块子集（例如75%）被掩盖。编码器应用于可见图像块的小子集。在编码器之后引入掩码标记，完整的编码块和掩码标记由一个小型解码器处理，以像素为单位重建原始图像。在预训练后，解码器被丢弃，编码器被应用于未损坏的图像（完整的补丁集）以进行识别任务。This embodiment uses the MAE (Masked Autoencoders) algorithm for image restoration processing. FIG8 is a schematic diagram of the structure of the MAE algorithm. As shown in FIG8, the MAE algorithm uses an asymmetric encoding and decoding structure. First, the input image is divided into many image blocks, and the image blocks are masked. The image blocks are divided into visible image blocks and occluded image blocks. The visible image blocks are input into the encoder to obtain hidden variables, and then the hidden variables and the occluded image blocks are combined in the order of the image, and input into the decoder to obtain the target image. During pre-training, a large number of random image block subsets (for example, 75%) are masked. The encoder is applied to a small subset of visible image blocks. Mask markers are introduced after the encoder, and the complete encoding blocks and mask markers are processed by a small decoder to reconstruct the original image in pixels. After pre-training, the decoder is discarded and the encoder is applied to undamaged images (complete patch sets) for recognition tasks.
应用在本实施例中，可以拆分出遮挡图像中的可见像素单元输入至编码器，编码器处理后得到特征向量，此特征向量表征可见像素单元在整张图像中的位置和贡献。In this embodiment, the visible pixel units in the occluded image can be separated and input to the encoder, and the encoder obtains a feature vector after processing. The feature vector represents the position and contribution of the visible pixel unit in the whole image.
步骤S32，将所述特征向量和所述遮挡图像中的遮挡像素单元输入解码器中，还原得到所述遮挡图像对应的目标偏振图像。Step S32: input the feature vector and the occluded pixel unit in the occluded image into a decoder to restore the target polarization image corresponding to the occluded image.
在输入解码器之前，可以将特征向量和遮挡像素单元进行组合，将遮挡像素单元也使用向量的形式表示，按照遮挡图像中的像素单元位置，对两种向量进行组合，再输入解码器中。解码器输出预测向量，再将预测向量还原为图像的形式，得到目标偏振图像。Before inputting the decoder, the feature vector and the occluded pixel unit can be combined, and the occluded pixel unit can also be represented in the form of a vector. According to the position of the pixel unit in the occluded image, the two vectors are combined and then input into the decoder. The decoder outputs a prediction vector, and then the prediction vector is restored to the form of an image to obtain the target polarization image.
图9为通过MAE算法还原遮挡图像的示意图，如图9所示，通过MAE算法的处理，遮挡图像中的遮挡像素单元还原为可见状态，还原后的遮挡图像仍然拥有一致的偏振方向。在遮挡像素单元得以还原的情况下，遮挡像素单元的响应值也可以通过MAE算法预测得到。FIG9 is a schematic diagram of restoring an occluded image through the MAE algorithm. As shown in FIG9 , through the processing of the MAE algorithm, the occluded pixel unit in the occluded image is restored to a visible state, and the restored occluded image still has a consistent polarization direction. When the occluded pixel unit is restored, the response value of the occluded pixel unit can also be predicted by the MAE algorithm.
在本实施例中，采用MAE算法进行图像还原处理，可以得到高质量的目标偏振图像，且遮挡图像的遮挡比例在MAE算法的效果优选范围内，适应偏振成像的特点。In this embodiment, the MAE algorithm is used for image restoration processing to obtain a high-quality target polarization image, and the occlusion ratio of the occluded image is within the preferred effect range of the MAE algorithm, which is adapted to the characteristics of polarization imaging.
进一步的，在本发明偏振成像方法的第五实施例中，该方法包括：Furthermore, in a fifth embodiment of the polarization imaging method of the present invention, the method includes:
步骤S40，基于斯托克斯模型和所述目标偏振图像计算偏振度和偏振角；Step S40, calculating the polarization degree and polarization angle based on the Stokes model and the target polarization image;
斯托克斯模型中包含斯托克斯参数，采用斯托克斯参数进行表达。斯托克斯参数是描述光的偏振状态的参数，包括I、Q、U、V，其中I表示总强度，Q和U表示线偏振度，V表示循环偏振度，这几个参数可以组合成向量进行描述。偏振度是指光束中偏振部分的光强度和整个光强度之比。偏振角是指，当入射角为某特定角时，反射光是线偏振光，其振动方向与入射面垂直，此特定角称为偏振角。确定目标偏振图像中表示偏振状态的参数，将参数的值代入斯托克斯模型的计算公式中，可以计算出偏振度和偏振角。The Stokes model contains Stokes parameters, which are expressed using Stokes parameters. Stokes parameters are parameters that describe the polarization state of light, including I, Q, U, and V, where I represents the total intensity, Q and U represent the linear polarization degree, and V represents the circular polarization degree. These parameters can be combined into a vector for description. The degree of polarization refers to the ratio of the light intensity of the polarized part of the light beam to the total light intensity. The polarization angle means that when the incident angle is a certain angle, the reflected light is linearly polarized light, and its vibration direction is perpendicular to the incident plane. This specific angle is called the polarization angle. Determine the parameters representing the polarization state in the target polarization image, substitute the parameter values into the calculation formula of the Stokes model, and the degree of polarization and polarization angle can be calculated.
步骤S50，根据所述偏振度输出偏振度图像，根据所述偏振角输出偏振角图像。Step S50: output a polarization degree image according to the polarization degree, and output a polarization angle image according to the polarization angle.
根据计算出的偏振度，可以对目标偏振图像进行进一步处理，得到偏振度图像。根据计算出的偏振角，可以对目标偏振图像进行进一步处理，得到偏振角图像。偏振度图像从光强分布的角度反映待成像目标的特征。偏振角图像则体现待成像目标表面的细节特征。According to the calculated polarization degree, the target polarization image can be further processed to obtain a polarization degree image. According to the calculated polarization angle, the target polarization image can be further processed to obtain a polarization angle image. The polarization degree image reflects the characteristics of the target to be imaged from the perspective of light intensity distribution. The polarization angle image reflects the detailed characteristics of the surface of the target to be imaged.
在本实施例中，得到目标偏振图像之后，进行进一步处理得到偏振度图像和偏振角图像，通过偏振度图像和偏振角度图像体现待成像目标的更多特征，应用在芯片缺陷检测中，可以更加全面地进行检测，提高检测的准确性。In this embodiment, after obtaining the target polarization image, further processing is performed to obtain a polarization degree image and a polarization angle image. The polarization degree image and the polarization angle image can reflect more features of the target to be imaged. When applied to chip defect detection, more comprehensive detection can be performed to improve detection accuracy.
本发明实施例还提供一种偏振成像装置，如图10所示，所述偏振成像装置包括：The embodiment of the present invention further provides a polarization imaging device, as shown in FIG10 , the polarization imaging device comprises:
获取模块100，用于获取偏振图像采集设备生成的原始偏振图像；An acquisition module 100 is used to acquire an original polarization image generated by a polarization image acquisition device;
分解模块200，用于根据所述偏振图像采集设备中的预设偏振方向，将所述原始偏振图像分解为多张遮挡图像，其中，各所述遮挡图像之间的偏振方向不同，各所述遮挡图像中的偏振方向相同；A decomposition module 200, configured to decompose the original polarization image into a plurality of occlusion images according to a preset polarization direction in the polarization image acquisition device, wherein the polarization directions of the occlusion images are different and the polarization directions in the occlusion images are the same;
还原模块300，用于对各所述遮挡图像进行图像还原处理，得到目标偏振图像。The restoration module 300 is used to perform image restoration processing on each of the blocked images to obtain a target polarization image.
可选地，所述偏振图像采集设备包括沿光路依次设置的物镜、偏振片阵列、针孔阵列和光电探测器，获取模块100还用于：Optionally, the polarization image acquisition device includes an objective lens, a polarizer array, a pinhole array, and a photodetector sequentially arranged along the optical path, and the acquisition module 100 is further used for:
通过所述物镜，将待成像目标经由所述偏振片阵列和所述针孔阵列成像至所述光电探测器上；By means of the objective lens, an object to be imaged is imaged onto the photodetector via the polarizer array and the pinhole array;
获取所述光电探测器探测到的所述原始偏振图像。The original polarization image detected by the photodetector is acquired.
可选地，所述偏振图像采集设备包括沿光路依次设置的微偏振透镜、微偏振阵列和光电探测器，获取模块100还用于：Optionally, the polarization image acquisition device includes a micro-polarization lens, a micro-polarization array, and a photodetector sequentially arranged along the light path, and the acquisition module 100 is further used for:
通过所述微偏振透镜，将待成像目标经由所述微偏振阵列成像至所述光电探测器上；By means of the micro-polarization lens, an object to be imaged is imaged onto the photodetector via the micro-polarization array;
获取所述光电探测器探测到的所述原始偏振图像。The original polarization image detected by the photodetector is acquired.
可选地，分解模块200还用于：Optionally, the decomposition module 200 is further used for:
将所述预设偏振方向中的第一个偏振方向作为目标偏振方向；Using a first polarization direction among the preset polarization directions as a target polarization direction;
保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像；Retaining pixel units in the original polarization image having the same polarization direction as the target polarization direction, and blocking the remaining pixel units in the original polarization image to obtain a blocked image in the target polarization direction;
将所述第一个偏振方向的下一个偏振方向作为所述目标偏振方向，执行所述保留所述原始偏振图像中与所述目标偏振方向的偏振方向相同的像素单元，将所述原始偏振图像中的其余像素单元遮挡，得到所述目标偏振方向的遮挡图像的步骤，直至遍历所述预设偏振方向。The next polarization direction of the first polarization direction is used as the target polarization direction, and the steps of retaining the pixel units in the original polarization image that have the same polarization direction as the target polarization direction and blocking the remaining pixel units in the original polarization image to obtain the blocked image of the target polarization direction are performed until the preset polarization direction is traversed.
可选地，还原模块300还用于：Optionally, the restoration module 300 is further configured to:
对于各所述遮挡图像，将所述遮挡图像中的可见像素单元输入编码器中，得到特征向量；For each of the occluded images, inputting visible pixel units in the occluded image into an encoder to obtain a feature vector;
将所述特征向量和所述遮挡图像中的遮挡像素单元输入解码器中，还原得到所述遮挡图像对应的目标偏振图像。The feature vector and the occluded pixel unit in the occluded image are input into a decoder to restore the target polarization image corresponding to the occluded image.
可选地，还原模块300还用于：Optionally, the restoration module 300 is further configured to:
对于各所述遮挡图像，获取所述遮挡图像中的可见像素单元的响应值；For each of the occluded images, obtaining a response value of a visible pixel unit in the occluded image;
根据所述响应值，对所述遮挡图像中的遮挡像素单元进行双三次样条插值处理，得到所述遮挡图像对应的目标偏振图像。According to the response value, bicubic spline interpolation processing is performed on the blocked pixel units in the blocked image to obtain a target polarization image corresponding to the blocked image.
可选地，偏振成像装置还包括输出模块，用于：Optionally, the polarization imaging device further includes an output module, configured to:
基于斯托克斯模型和所述目标偏振图像计算偏振度和偏振角；Calculate the degree of polarization and the polarization angle based on the Stokes model and the target polarization image;
根据所述偏振度输出偏振度图像，根据所述偏振角输出偏振角图像。A polarization degree image is output according to the polarization degree, and a polarization angle image is output according to the polarization angle.
本发明实施例还提供一种电子设备，所述电子设备包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的偏振成像程序，所述偏振成像程序配置为实现如上文所述的偏振成像方法的步骤。本发明实施例电子设备的具体实施方式参见上述偏振成像方法各实施例，在此不再赘述。An embodiment of the present invention further provides an electronic device, the electronic device comprising: a memory, a processor, and a polarization imaging program stored in the memory and executable on the processor, the polarization imaging program being configured to implement the steps of the polarization imaging method described above. The specific implementation of the electronic device of the embodiment of the present invention is referred to the above-mentioned embodiments of the polarization imaging method, which will not be described in detail here.
本发明实施例还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有偏振成像程序，所述偏振成像程序被处理器执行时实现如上文所述的偏振成像方法的步骤。本发明实施例计算机可读存储介质的具体实施方式参见上述偏振成像方法各实施例，在此不再赘述。The embodiment of the present invention further provides a computer-readable storage medium, on which a polarization imaging program is stored, and when the polarization imaging program is executed by a processor, the steps of the polarization imaging method described above are implemented. The specific implementation of the computer-readable storage medium in the embodiment of the present invention refers to the above-mentioned embodiments of the polarization imaging method, which will not be repeated here.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还 包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、 方法、物品或者系统中还存在另外的相同要素。It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of more restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
上述本发明实施例序号仅为了描述，不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述 实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通 过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体 现出来，该计算机软件产品存储在如上所述的一个存储介质（如ROM/RAM、磁碟、光盘）中，包括若干指令用以使得一台终端设备（可以是手机，计算机，服务器，或者网络设备等）执行本发明各个实施例所述的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410298423.XACN117939308B (en) | 2024-03-15 | 2024-03-15 | Polarization imaging method, device, electronic equipment and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410298423.XACN117939308B (en) | 2024-03-15 | 2024-03-15 | Polarization imaging method, device, electronic equipment and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN117939308Atrue CN117939308A (en) | 2024-04-26 |
| CN117939308B CN117939308B (en) | 2024-06-18 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410298423.XAActiveCN117939308B (en) | 2024-03-15 | 2024-03-15 | Polarization imaging method, device, electronic equipment and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN117939308B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5689283A (en)* | 1993-01-07 | 1997-11-18 | Sony Corporation | Display for mosaic pattern of pixel information with optical pixel shift for high resolution |
| US20170244958A1 (en)* | 2016-02-24 | 2017-08-24 | Arris Enterprises Llc | Video display for viewing through polarized active shutter glasses |
| CN111738941A (en)* | 2020-06-05 | 2020-10-02 | 大连海事大学 | Underwater image optimization method fused with light field and polarization information |
| CN113203664A (en)* | 2020-01-31 | 2021-08-03 | 卡尔蔡司显微镜有限责任公司 | Particle analysis using optical microscopy and multi-pixel polarizing filters |
| CN114815279A (en)* | 2022-06-24 | 2022-07-29 | 季华实验室 | Polarization imaging method and device based on light field structure, polarization camera and medium |
| CN114842046A (en)* | 2022-05-09 | 2022-08-02 | 北京环境特性研究所 | Device and method for measuring high-dynamic scene image of moving object |
| CN116088184A (en)* | 2023-03-01 | 2023-05-09 | 上海交通大学 | Optical structure for real scene occlusion, AR device and working method |
| CN116699854A (en)* | 2023-07-27 | 2023-09-05 | 北京极溯光学科技有限公司 | Perspective optical system and equipment capable of realizing display shielding |
| CN116739958A (en)* | 2023-08-04 | 2023-09-12 | 长春理工大学 | Dual-spectrum polarization super-resolution fusion detection method and system |
| US20230296965A1 (en)* | 2020-07-30 | 2023-09-21 | I2S | Method and device for underwater imaging |
| CN117274055A (en)* | 2023-09-19 | 2023-12-22 | 西安电子科技大学 | Polarization image super-resolution reconstruction method and system based on information multiplexing |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5689283A (en)* | 1993-01-07 | 1997-11-18 | Sony Corporation | Display for mosaic pattern of pixel information with optical pixel shift for high resolution |
| US20170244958A1 (en)* | 2016-02-24 | 2017-08-24 | Arris Enterprises Llc | Video display for viewing through polarized active shutter glasses |
| CN113203664A (en)* | 2020-01-31 | 2021-08-03 | 卡尔蔡司显微镜有限责任公司 | Particle analysis using optical microscopy and multi-pixel polarizing filters |
| CN111738941A (en)* | 2020-06-05 | 2020-10-02 | 大连海事大学 | Underwater image optimization method fused with light field and polarization information |
| US20230296965A1 (en)* | 2020-07-30 | 2023-09-21 | I2S | Method and device for underwater imaging |
| CN114842046A (en)* | 2022-05-09 | 2022-08-02 | 北京环境特性研究所 | Device and method for measuring high-dynamic scene image of moving object |
| CN114815279A (en)* | 2022-06-24 | 2022-07-29 | 季华实验室 | Polarization imaging method and device based on light field structure, polarization camera and medium |
| CN116088184A (en)* | 2023-03-01 | 2023-05-09 | 上海交通大学 | Optical structure for real scene occlusion, AR device and working method |
| CN116699854A (en)* | 2023-07-27 | 2023-09-05 | 北京极溯光学科技有限公司 | Perspective optical system and equipment capable of realizing display shielding |
| CN116739958A (en)* | 2023-08-04 | 2023-09-12 | 长春理工大学 | Dual-spectrum polarization super-resolution fusion detection method and system |
| CN117274055A (en)* | 2023-09-19 | 2023-12-22 | 西安电子科技大学 | Polarization image super-resolution reconstruction method and system based on information multiplexing |
| Title |
|---|
| DANIEL A. LEMASTER: "Enhanced Detection Through Obscurations using Optimized Temporal Polarization Imaging", 2007 IEEE AEROSPACE CONFERENCE, 31 December 2007 (2007-12-31), pages 1 - 11* |
| 王睿南: "基于IMX250MZR传感器的偏振成像技术研究", 中国优秀硕士论文数据库, 15 July 2022 (2022-07-15), pages 1 - 62* |
| Publication number | Publication date |
|---|---|
| CN117939308B (en) | 2024-06-18 |
| Publication | Publication Date | Title |
|---|---|---|
| Khashabi et al. | Joint demosaicing and denoising via learned nonparametric random fields | |
| EP2536125B1 (en) | Imaging device and method, and image processing method for imaging device | |
| US9473700B2 (en) | Camera systems and methods for gigapixel computational imaging | |
| JP7259757B2 (en) | IMAGING DEVICE, AND IMAGE PROCESSING DEVICE AND METHOD | |
| US20120026349A1 (en) | Imaging device and method, and image processing method for imaging device | |
| JP7192778B2 (en) | IMAGING APPARATUS AND METHOD AND IMAGE PROCESSING APPARATUS AND METHOD | |
| JP5989681B2 (en) | System, method, and medium for reconstructing space-time region from encoded image | |
| EP1357514A1 (en) | Method for obtaining a high-resolution digital image | |
| Kawasaki et al. | Active one-shot scan for wide depth range using a light field projector based on coded aperture | |
| CN112651911B (en) | A high dynamic range imaging generation method based on polarization images | |
| CN104184936B (en) | Image focusing processing method and system based on light field camera | |
| CN113837979A (en) | Live image synthesis method and device, terminal device and readable storage medium | |
| Lou et al. | All-in-focus imaging from event focal stack | |
| JPWO2013088690A1 (en) | Imaging apparatus, imaging system, imaging method, and image processing method | |
| CN107710741B (en) | Method and camera for acquiring depth information | |
| CN116258643A (en) | Image shadow elimination method, device, equipment and storage medium | |
| Shroff et al. | High resolution image reconstruction for plenoptic imaging systems using system response | |
| TWI508554B (en) | An image focus processing method based on light-field camera and the system thereof are disclosed | |
| CN117939308A (en) | Polarization imaging method, device, electronic device and storage medium | |
| JP6338836B2 (en) | Information code reader | |
| CN118691503A (en) | Motion deblurring method and device based on Fourier frequency domain attention mechanism | |
| EP1372335B1 (en) | Processing method for obtaining a high-resolution digital image | |
| CN113034617B (en) | Method, device and equipment for acquiring focal length of camera | |
| Masoudifar et al. | Depth estimation and deblurring from a single image using an optimized-throughput coded aperture | |
| JP6353415B2 (en) | Dictionary generation method, dictionary generation device, image processing method, image processing device, and image processing program |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |