CN110186566B - Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurement - Google Patents
Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurementDownload PDFInfo
- Publication number
- CN110186566B CN110186566BCN201910464299.9ACN201910464299ACN110186566BCN 110186566 BCN110186566 BCN 110186566BCN 201910464299 ACN201910464299 ACN 201910464299ACN 110186566 BCN110186566 BCN 110186566B
- Authority
- CN
- China
- Prior art keywords
- image
- temperature
- multispectral
- dimensional
- light field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
- G01J2003/282—Modified CCD or like
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Radiation Pyrometers (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明属于温度测量技术领域，特别涉及一种基于光场相机多谱测温的二维真实温度场成像方法及系统。The invention belongs to the technical field of temperature measurement, and in particular relates to a two-dimensional real temperature field imaging method and system based on multispectral temperature measurement of a light field camera.
背景技术Background technique
目前，高温部件的测温方式可分为接触式测温与非接触式测温。其中，非接触式测温具有对被测物体无影响、动态响应好、输出信号较大、测量精度较高、测量的范围较宽等优点而备受关注，非接触式测温主要以辐射测温方法为主，包括亮度测温法、比色测温法以及多光谱辐射测温法等。At present, the temperature measurement methods of high temperature components can be divided into contact temperature measurement and non-contact temperature measurement. Among them, non-contact temperature measurement has attracted much attention due to its advantages of no effect on the measured object, good dynamic response, large output signal, high measurement accuracy, and wide measurement range. Non-contact temperature measurement is mainly based on radiation measurement. Temperature methods are mainly used, including brightness thermometry, colorimetric thermometry, and multispectral radiation thermometry.
其中，多光谱测温方法通过测量多个波长(几个到几十个不等)的辐射亮度，根据发射率解算目标真温，在辐射测温领域应用较为广泛。传统多光谱高温计一般为点测量或者测量区域较小，难以能获得被测物表面整体二维温度场，无法避免被测物局部误差。在飞行器、涡轮机叶片以及其他高温部件表面温度测量时，为获得高温部件表面二维温度场，避免局部误差，更加清晰准确的评估高温部件整体工作状态，研究人员提出了基于面阵CCD(Charge-coupled Device)测温的光学系统及其适用算法。Among them, the multi-spectral temperature measurement method is widely used in the field of radiation temperature measurement by measuring the radiance of multiple wavelengths (ranging from several to dozens of wavelengths) and calculating the true temperature of the target according to the emissivity. Traditional multispectral pyrometers are generally point-measured or have a small measurement area, so it is difficult to obtain the overall two-dimensional temperature field on the surface of the measured object, and local errors of the measured object cannot be avoided. When measuring the surface temperature of aircraft, turbine blades and other high-temperature components, in order to obtain a two-dimensional temperature field on the surface of high-temperature components, avoid local errors, and evaluate the overall working state of high-temperature components more clearly and accurately, researchers proposed a method based on area array CCD (Charge- coupled Device) temperature measurement optical system and its applicable algorithm.
近些年，随着计算机视觉领域软硬件的飞速发展，国内外关于面阵CCD辐射测温方法的研究取得了较大进步。但是目前一块彩色感光芯片最多只能采集三个波段(RGB)的多光谱，若实现更多光谱图像采集需要采用相机阵列或者多路分光的方式，其光学采集系统仍会非常复杂，难以实用，构建适当的多光谱成像系统仍是困扰该领域的重要问题。In recent years, with the rapid development of software and hardware in the field of computer vision, great progress has been made in the research on the radiation temperature measurement method of area array CCD at home and abroad. However, at present, a color photosensitive chip can only collect multi-spectrum of three bands (RGB) at most. If more spectral image acquisition needs to use camera array or multi-channel splitting, the optical acquisition system will still be very complicated and difficult to be practical. Building an appropriate multispectral imaging system is still an important problem plaguing this field.
为解决上述问题，研究人员采用光场相机多光谱成像系统采集多光谱图像，用来解算二维真实温度场，但是目前得到的最终二维真实温度场精度较低。In order to solve the above problems, researchers use a light field camera multispectral imaging system to collect multispectral images to solve the two-dimensional real temperature field, but the final two-dimensional real temperature field obtained at present has low accuracy.
经现有技术检索，中国发明专利号为CN201710021578.9，发明名称为一种多光谱光场成像方法，采用的硬件包括：沿光路方向顺次设置宽带滤波片阵列、异构相机阵列、控制板阵列和信息联合处理装置。成像方法为：在异构相机阵列的每个相机镜头和传感器中间放置不同波长的宽带滤波片，使得相机阵列中的每个相机接收固定波段的光谱信息；通过信息联合处理装置对相机阵列获取的多路信息进行基于卷积神经网络的立体匹配以获取入射光线的角度信息，得到全视场范围内的光场信息；根据相机之间的分布位置进行相机校准和视场对齐，通过光谱解复用获取相机阵列中任一相机视角下三倍于相机个数的多波段光谱信息。该发明对二维温度场的解算精度较低。After the prior art search, the Chinese invention patent number is CN201710021578.9, and the name of the invention is a multi-spectral light field imaging method. The hardware used includes: a broadband filter array, a heterogeneous camera array, and a control board are sequentially arranged along the direction of the light path. Array and information combined processing device. The imaging method is: placing broadband filters of different wavelengths between each camera lens and sensor of the heterogeneous camera array, so that each camera in the camera array receives spectral information of a fixed wavelength band; Perform stereo matching based on convolutional neural network to obtain the angle information of the incident light, and obtain the light field information within the full field of view. Use to obtain multi-band spectral information that is three times the number of cameras under any camera angle of view in the camera array. The invention has low solution precision for the two-dimensional temperature field.
发明内容SUMMARY OF THE INVENTION
针对现有技术中的缺陷，本发明的目的是提供一种基于光场相机多谱测温的二维真实温度场成像方法及系统。考虑光场相机成像特点，提出基于拉格朗日乘子法的真实温度计算方法，同时采用导向滤波优化二维温度场，解决光场相机多光谱测温的核心问题，推动多光谱辐射测温技术发展。In view of the defects in the prior art, the purpose of the present invention is to provide a two-dimensional real temperature field imaging method and system based on multispectral temperature measurement of a light field camera. Considering the imaging characteristics of light field cameras, a real temperature calculation method based on the Lagrangian multiplier method is proposed. At the same time, guided filtering is used to optimize the two-dimensional temperature field, which solves the core problem of multi-spectral temperature measurement of light field cameras and promotes multi-spectral radiation temperature measurement. Technological development.
根据本发明提供的一种基于光场相机多谱测温的二维真实温度场成像方法，包括如下步骤：According to a method for imaging a two-dimensional real temperature field based on multispectral temperature measurement of a light field camera provided by the present invention, the method includes the following steps:
S1，标定光场相机多光谱测温系统，获得相机输出信号强度与标准温度之间的对应关系；S1, calibrate the multispectral temperature measurement system of the light field camera, and obtain the corresponding relationship between the intensity of the output signal of the camera and the standard temperature;
S2，将高温部件成像，采集光场相机宏像素多光谱图像；S2, imaging the high-temperature component, and collecting the macro-pixel multispectral image of the light field camera;
S3，解耦光场相机宏像素多光谱图像；S3, decoupled light field camera macro-pixel multispectral image;
S4，逐个解算宏像素多光谱图像对应的真实温度，获取初始的二维真实温度场图像，标记为初始图像t；S4, solve the real temperature corresponding to the macro-pixel multispectral image one by one, and obtain the initial two-dimensional real temperature field image, which is marked as the initial image t;
S5，采用导向滤波法对图像t进行滤波处理，得到优化的二维真实温度场图像，标记为优化图像t0。S5 , filter the image t by using the guided filtering method to obtain an optimized two-dimensional real temperature field image, which is marked as an optimized image t0 .
一些实施例中，所述步骤S4中，采用拉格朗日乘子法逐个解算宏像素多光谱图像对应的真实温度。In some embodiments, in the step S4, the Lagrange multiplier method is used to calculate the real temperature corresponding to the macro-pixel multispectral image one by one.
一些实施例中，所述步骤S5中通过导向滤波法优化初始化图像t的步骤包括：In some embodiments, the step of optimizing the initialization image t by the guided filtering method in the step S5 includes:
步骤A：由高温部件图像v生成导向图像I；Step A: generate a guide image I from the high temperature component image v;
步骤B：求解导向图像I；Step B: Solve the guide image I;
步骤C：以I为导向图像，对温度图像t进行滤波，得到优化温度场图像t0。Step C: Taking I as the oriented image, filtering the temperature image t to obtain the optimized temperature field image t0 .
一些实施例中，所述步骤A中，高温部件图像v是利用光场相机多视角图像解耦方法，从宏像素图像中提取相同相对位置的像素，得到中心波长λC下高温部件图像v。In some embodiments, in the step A, the high temperature component image v is obtained by using the multi-view image decoupling method of a light field camera to extract pixels with the same relative position from the macro pixel image to obtain the high temperature component image v at the center wavelengthλC .
一些实施例中，所述步骤B中，采用岭回归求解目标所对应的参数。In some embodiments, in the step B, ridge regression is used to solve the parameters corresponding to the target.
一些实施例中，步骤C中通过下式得到优化温度场图像t0：In some embodiments, in step C, the optimized temperature field image t0 is obtained by the following formula:
其中，Wij(I)表示由导向图像I确定的加权平均运算中的权值，tj是图像t中第j个像素灰度值。Wherein, Wij (I) represents the weight in the weighted average operation determined by the guide image I, and tj is the gray value of the jth pixel in the image t.
一种基于光场相机多谱测温的二维真实温度场成像系统，采用基于光场相机多谱测温的二维真实温度场成像方法，包括初始图像生成模块与优化初始图像模块；A two-dimensional real temperature field imaging system based on light field camera multispectral temperature measurement, adopts the two-dimensional real temperature field imaging method based on light field camera multispectral temperature measurement, including an initial image generation module and an optimized initial image module;
所述初始图像生成模块包括标定模块、采集模块、解耦模块与真实温度测量模块，所述标定模块将相机输出信号强度与标准温度之间对应后，所述采集模块通过成像的高温部件采集光场相机宏像素多光谱图像，所述解耦模块对所述宏像素多光谱图像进行解耦处理，将多光谱二维图像数据转化为单维度多光谱数据，所述真实温度测量模块通过将单维度多光谱数据转化为宏像素多光谱图像所对应的真实温度后，获得初始二维真实温度场图像t；The initial image generation module includes a calibration module, an acquisition module, a decoupling module and a real temperature measurement module. After the calibration module corresponds between the intensity of the camera output signal and the standard temperature, the acquisition module collects light through the imaging high-temperature components. The macro-pixel multi-spectral image of the field camera, the decoupling module performs decoupling processing on the macro-pixel multi-spectral image, and converts the multi-spectral two-dimensional image data into single-dimensional multi-spectral data, and the real temperature measurement module After the dimensional multi-spectral data is converted into the real temperature corresponding to the macro-pixel multi-spectral image, the initial two-dimensional real temperature field image t is obtained;
所述优化初始图像模块采用导向滤波的方式对初始二维真实温度场图像进行处理，获得优化的二维真实温度场图像t0。The optimized initial image module uses a guided filtering method to process the initial two-dimensional real temperature field image to obtain an optimized two-dimensional real temperature field image t0 .
一些实施例中，所述真实温度测量模块通过拉格朗日乘子法将单维度多光谱数据转化为宏像素多光谱图像所对应的真实温度。In some embodiments, the real temperature measurement module converts the single-dimensional multi-spectral data into the real temperature corresponding to the macro-pixel multi-spectral image through the Lagrangian multiplier method.
一些实施例中，所述优化初始图像模块采用的导向滤波的方式中，首先由高温部件图像v生成导向图像I，其次求解所述导向图像I，最后以导向图像I对温度图像t进行滤波，得到优化的温度场图像t0。In some embodiments, in the guided filtering method adopted by the optimized initial image module, the guided image I is firstly generated from the high temperature component image v, then the guided image I is solved, and finally the temperature image t is filtered with the guided image I, An optimized temperature field image t0 is obtained.
一些实施例中，所述导向图像I是利用光场相机多视角图像解耦方法，从宏像素图像中提取相同相对位置的像素，得到中心波长λC下高温部件图像v，并由图像v生成导向图像I。In some embodiments, the guidance image I uses the multi-view image decoupling method of the light field camera to extract pixels with the same relative position from the macro-pixel image to obtain the high-temperature component image v at the center wavelength λC , and is generated from the image v. Guide image I.
与现有技术相比，本发明具有如下的有益效果：Compared with the prior art, the present invention has the following beneficial effects:
本发明考虑光场相机成像特点，提出基于拉格朗日乘子法的真实温度计算方法，同时采用导向滤波优化二维温度场，提高了二维温度场解算精度，推动了多光谱辐射测温技术发展。Considering the imaging characteristics of the light field camera, the present invention proposes a real temperature calculation method based on the Lagrangian multiplier method, and at the same time adopts the guided filtering to optimize the two-dimensional temperature field, improves the calculation accuracy of the two-dimensional temperature field, and promotes multi-spectral radiation measurement. temperature technology development.
附图说明Description of drawings
通过阅读参照以下附图对非限制性实施例所作的详细描述，本发明的其它特征、目的和优点将会变得更明显：Other features, objects and advantages of the present invention will become more apparent by reading the detailed description of non-limiting embodiments with reference to the following drawings:
图1本发明的基本流程图；Fig. 1 basic flow chart of the present invention;
图2本发明的光场相机多光谱测温系统工作原理示意图；2 is a schematic diagram of the working principle of the multispectral temperature measurement system of the light field camera of the present invention;
图3本发明中光场相机多光谱图像示意图。FIG. 3 is a schematic diagram of a multispectral image of a light field camera in the present invention.
图4本发明中光场多光谱图像解耦过程示意图。FIG. 4 is a schematic diagram of the decoupling process of the light field multispectral image in the present invention.
具体实施方式Detailed ways
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明，但不以任何形式限制本发明。应当指出的是，对本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变化和改进。这些都属于本发明的保护范围。The present invention will be described in detail below with reference to specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that, for those skilled in the art, several changes and improvements can be made without departing from the inventive concept. These all belong to the protection scope of the present invention.
实施例1：Example 1:
本发明专利的基本操作流程如附图1所示，采用的多光谱成像系统基本构架如图2所示。The basic operation flow of the patent of the present invention is shown in FIG. 1 , and the basic structure of the adopted multispectral imaging system is shown in FIG. 2 .
利用黑体炉或者钨丝灯对光场相机多光谱测温系统进行标定，获得相机输出信号强度与标准温度之间对应关系；其次，对高温部件成像，采集光场相机多光谱图像，其原始图像示意图如附图3所示。然后，根据光场相机多视角图像解耦方法，解耦光场相机多光谱图像，将多光谱二维图像数据转化为单维度多光谱数据，解耦过程如附图4所示。Use a blackbody furnace or a tungsten filament lamp to calibrate the multispectral temperature measurement system of the light field camera, and obtain the corresponding relationship between the output signal intensity of the camera and the standard temperature; secondly, image the high temperature components, collect the multispectral image of the light field camera, and the original image A schematic diagram is shown in Figure 3. Then, according to the multi-view image decoupling method of the light field camera, the multi-spectral image of the light field camera is decoupled, and the multi-spectral two-dimensional image data is converted into single-dimensional multi-spectral data. The decoupling process is shown in FIG. 4 .
在完成光场相机多光谱图像解算之后，依托多光谱辐射测温理论，采用拉格朗日乘子法解算真实温度，具体为：After completing the multi-spectral image calculation of the light field camera, relying on the multi-spectral radiation temperature measurement theory, the Lagrangian multiplier method is used to calculate the real temperature, which is as follows:
首先，构造目标函数。依据多光谱辐射测温理论，当有n个波段时，第i个通道的输出信号强度Vi可记为：First, construct the objective function. According to the multispectral radiation thermometry theory, when there are n bands, the output signal intensity Vi of the i-th channel can be recorded as:
其中，
依据标定数据，当参考温度为T′时，由(1)式可得，第i个通道的输出信号强度Vi′为(一般情况下
将(1)(2)式相除取对数并整理得：Divide equations (1) and (2) and take the logarithm to get:
当ε(λi，T)已知时，单个光谱通道的亮度温度Ti应该等于真实温度T，即：When ε(λi , T) is known, the brightness temperature Ti of a single spectral channel should be equal to the true temperature T, namely:
其中E表示期望；where E represents expectation;
由此可构造目标函数：From this, the objective function can be constructed:
令
其次，构造约束条件。由于发射率0＜ε(λi，T)＜1，因此xi＜0，即得不等式约束条件。Second, construct constraints. Since the emissivity is 0<ε(λi , T)<1,xi <0, that is, the inequality constraint is obtained.
最后，构造拉格朗日函数并求解。构造拉格朗日函数：Finally, the Lagrangian function is constructed and solved. Construct the Lagrangian function:
式中x＝[x1，x2…xn]T为自变量，γ＝[γ1，γ2…γn]T为拉格朗日乘子量，σ＝[σ1，σ2…σn]T为松弛变量。where x=[x1 , x2 …xn ]T is the independent variable, γ=[γ1 , γ2 … γn ]T is the Lagrange multiplier, σ=[σ1 , σ2 … σn ]T is the slack variable.
则L(x，γ，σ)在x0处取极值的必要条件为：Then the necessary condition for L(x, γ, σ) to take the extreme value at x0 is:
其中L为L(x，γ，σ)，依据上式求得x0即为最优解，进而可以计算真实温度。采用同样的方式依次可以计算得到每一个宏像素多光谱图像所对应的真实温度，得到二维真实温度场图像t。Among them, L is L(x, γ, σ). According to the above formula, x0 is the optimal solution, and then the real temperature can be calculated. In the same way, the real temperature corresponding to each macro-pixel multispectral image can be calculated in turn, and the two-dimensional real temperature field image t can be obtained.
随后，根据光场相机成像采样特点，采用导向滤波对二维温度场进行优化处理，具体过程为：Then, according to the imaging sampling characteristics of the light field camera, guided filtering is used to optimize the two-dimensional temperature field. The specific process is as follows:
首先，利用光场相机多视角图像解耦方法，从宏像素图像中提取相同相对位置的像素，得到中心波长λC下高温部件图像v，并由图像v生成导向图像I。First, using the multi-view image decoupling method of the light field camera, the pixels with the same relative position are extracted from the macro-pixel image to obtain the high-temperature component image v at the center wavelength λC , and the guide image I is generated from the image v.
其次，求解导向图像I。由于导向图像I与高温部件图像v在一个二维窗口内是局部线性模型，假设ak和bk是当窗口中心位于k时该线性函数的系数，则vi＝akIi+bk，其中vi是图像v中第i个像素灰度值，Ii是图像I中第i个像素灰度值。采用岭回归求解目标所对应的参数ak和bk：Second, solve the guide image I. Since the guide image I and the high-temperature component image v are local linear models in a two-dimensional window, assuming that ak and bk are the coefficients of the linear function when the center of the window is at k, then vi =ak Ii +bk , where vi is the gray value of theith pixel in image v, and I iis the gray value of the ith pixel in image I. Use ridge regression to solve the parameters ak and bk corresponding to the target:
其中，ωk为以像素k为中心的像素窗口，∈为正则化项系数。Among them, ωk is the pixel window centered on pixel k, and ∈ is the regularization term coefficient.
最后，以I为导向图像，对温度图像t进行滤波，得到优化温度场图像t0：Finally, taking I as the oriented image, the temperature image t is filtered to obtain the optimized temperature field image t0 :
其中，Wij(I)表示由引导图像I确定的加权平均运算中的权值，tj是图像t中第j个像素灰度值。这样便可得到导向滤波后的二维温度场，最终得到优化后的二维真实温度场图像。Wherein, Wij (I) represents the weight value in the weighted average operation determined by the guide image I, and tj is the gray value of the jth pixel in the image t. In this way, the two-dimensional temperature field after guided filtering can be obtained, and finally the optimized two-dimensional real temperature field image can be obtained.
实施例2Example 2
如图1-4所示，本发明还提供了一种基于光场相机多谱测温的二维真实温度场成像系统，采用实施例1中所述的基于光场相机多谱测温的二维真实温度场成像方法，包括初始图像生成模块与优化初始图像模块；As shown in Figures 1-4, the present invention also provides a two-dimensional real temperature field imaging system based on light field camera multispectral temperature measurement. 3D real temperature field imaging method, including an initial image generation module and an optimized initial image module;
所述初始图像生成模块包括标定模块、采集模块、解耦模块与真实温度测量模块，所述标定模块将相机输出信号强度与标准温度之间对应后，所述采集模块通过成像的高温部件采集光场相机宏像素多光谱图像，所述解耦模块对所述宏像素多光谱图像进行解耦处理，将多光谱二维图像数据转化为单维度多光谱数据，所述真实温度测量模块通过将单维度多光谱数据转化为宏像素多光谱图像所对应的真实温度后，获得初始二维真实温度场图像t；The initial image generation module includes a calibration module, an acquisition module, a decoupling module and a real temperature measurement module. After the calibration module corresponds between the intensity of the camera output signal and the standard temperature, the acquisition module collects light through the imaging high-temperature components. The macro-pixel multi-spectral image of the field camera, the decoupling module performs decoupling processing on the macro-pixel multi-spectral image, and converts the multi-spectral two-dimensional image data into single-dimensional multi-spectral data, and the real temperature measurement module After the dimensional multi-spectral data is converted into the real temperature corresponding to the macro-pixel multi-spectral image, the initial two-dimensional real temperature field image t is obtained;
所述优化初始图像模块采用导向滤波的方式对初始二维真实温度场图像进行处理，获得优化的二维真实温度场图像t0。The optimized initial image module uses a guided filtering method to process the initial two-dimensional real temperature field image to obtain an optimized two-dimensional real temperature field image t0 .
真实温度测量模块通过拉格朗日乘子法将单维度多光谱数据转化为宏像素多光谱图像所对应的真实温度，其具体步骤与实施例1中的转化过程形同，在此不再赘述。The real temperature measurement module converts the single-dimensional multi-spectral data into the real temperature corresponding to the macro-pixel multi-spectral image through the Lagrangian multiplier method. The specific steps are the same as the conversion process in Embodiment 1, and will not be repeated here. .
所述优化初始图像模块采用的导向滤波的方式中，首先由高温部件图像v生成导向图像I，其次求解所述导向图像I，最后以导向图像I对温度图像t进行滤波，得到优化的温度场图像t0。In the guided filtering method adopted by the optimized initial image module, the guided image I is firstly generated from the high-temperature component image v, then the guided image I is solved, and finally the temperature image t is filtered with the guided image I to obtain an optimized temperature field. image t0 .
本实施例2中的相应的求解过程与实施例1一致，在此不再赘述。The corresponding solution process in Embodiment 2 is the same as that in Embodiment 1, and details are not repeated here.
本领域技术人员知道，除了以纯计算机可读程序代码方式实现本发明提供的系统、装置及其各个模块以外，完全可以通过将方法步骤进行逻辑编程来使得本发明提供的系统、装置及其各个模块以逻辑门、开关、专用集成电路、可编程逻辑控制器以及嵌入式微控制器等的形式来实现相同程序。所以，本发明提供的系统、装置及其各个模块可以被认为是一种硬件部件，而对其内包括的用于实现各种程序的模块也可以视为硬件部件内的结构；也可以将用于实现各种功能的模块视为既可以是实现方法的软件程序又可以是硬件部件内的结构。Those skilled in the art know that, in addition to implementing the system, device and each module provided by the present invention in the form of pure computer readable program code, the system, device and each module provided by the present invention can be completely implemented by logically programming the method steps. The same program is implemented in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, and embedded microcontrollers, among others. Therefore, the system, device and each module provided by the present invention can be regarded as a kind of hardware component, and the modules used for realizing various programs included in it can also be regarded as the structure in the hardware component; A module for realizing various functions can be regarded as either a software program for realizing a method or a structure within a hardware component.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910464299.9ACN110186566B (en) | 2019-05-30 | 2019-05-30 | Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910464299.9ACN110186566B (en) | 2019-05-30 | 2019-05-30 | Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurement |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110186566A CN110186566A (en) | 2019-08-30 |
| CN110186566Btrue CN110186566B (en) | 2020-12-01 |
Family
ID=67719113
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910464299.9AActiveCN110186566B (en) | 2019-05-30 | 2019-05-30 | Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110186566B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111462254B (en)* | 2020-04-30 | 2024-05-03 | 南京智谱科技有限公司 | Multispectral monitoring method and multispectral monitoring system |
| CN113048907B (en)* | 2021-02-08 | 2022-04-22 | 浙江大学 | Single-pixel multispectral imaging method and device based on macro-pixel segmentation |
| CN113033891B (en)* | 2021-03-19 | 2022-01-18 | 河北水熠木丰工程技术有限责任公司 | High pier bridge health monitoring method and device |
| CN113237559B (en)* | 2021-04-25 | 2022-06-21 | 哈尔滨工业大学 | Multispectral radiation temperature measuring device and using method |
| CN114543998A (en)* | 2022-02-17 | 2022-05-27 | 中北大学 | Temperature field spatiotemporal distribution measurement device based on staring snapshot spectral imaging |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090159799A1 (en)* | 2007-12-19 | 2009-06-25 | Spectral Instruments, Inc. | Color infrared light sensor, camera, and method for capturing images |
| CN107798670B (en)* | 2017-09-20 | 2021-03-19 | 中国科学院长春光学精密机械与物理研究所 | A Dehazing Method for Dark Primitive Color Prior Images Using Image-Guided Filters |
| CN109115348B (en)* | 2018-07-24 | 2020-06-30 | 哈尔滨工业大学 | A joint method for 3D temperature reconstruction based on flame light field refocusing images |
| CN109813450A (en)* | 2019-03-27 | 2019-05-28 | 中国航空工业集团公司北京长城计量测试技术研究所 | A kind of transient state imaging type infrared multispectral temperature field measuring apparatus |
- 2019
- 2019-05-30CNCN201910464299.9Apatent/CN110186566B/enactiveActive
Also Published As
| Publication number | Publication date |
|---|---|
| CN110186566A (en) | 2019-08-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110186566B (en) | Two-dimensional real temperature field imaging method and system based on light field camera multispectral temperature measurement | |
| CN110160660B (en) | High-temperature component multispectral temperature measurement method and system based on light field camera | |
| CN105865624B (en) | The spectrum extracting method and device of hyper-spectral data gathering system | |
| CN108507674B (en) | Calibration data processing method of light field spectral imaging spectrometer | |
| CN206146624U (en) | A blind element detection device for a thermal infrared hyperspectral imager | |
| CN113357666B (en) | Furnace temperature measurement method, device and equipment based on neural network | |
| CN103940511A (en) | Spectrum line calibration method and device for hyper-spectrum acquisition system | |
| CN102415099A (en) | Spatially-varying spectral response calibration data | |
| CN115718076B (en) | A multi-band automatic vegetation observation method and device based on digital camera | |
| WO2018083848A1 (en) | Image processing device, chart for calibration, and calibration system | |
| CN113588115B (en) | A temperature measurement method based on multispectral colorimetry | |
| CN117433639A (en) | High-temperature part multispectral temperature measurement method of light field camera based on hyperchromatic super-structured lens array | |
| CN111784780B (en) | Color calibration method of color camera based on deep learning | |
| CN116628946A (en) | Space-based low-illumination low-light-level remote sensing image simulation method | |
| CN114894737B (en) | A spectral reflectance reconstruction method based on infrared images | |
| Zhou et al. | A digital sensor with non-imaging multi-spectral and image modules for continuous monitoring of plant growth conditions: Development and validation | |
| US11651504B2 (en) | Learning method, storage medium and image processing device | |
| CN103234915B (en) | A kind of band selection method based on multispectral detection | |
| CN115307732B (en) | Method, device and storage medium for measuring three-dimensional spectrum intensity distribution of target space | |
| CN113792253B (en) | Temperature measurement method and terminal device for medium and high temperature objects based on near infrared images | |
| CN113432146B (en) | Method, device and equipment for measuring temperature in furnace | |
| JP2020091256A (en) | Processor, imaging apparatus, method for processing, and program | |
| CN118858169A (en) | Soil organic matter content detection method, device, equipment and storage medium | |
| JP2018156208A (en) | Analyzer, imaging apparatus, analysis method and program | |
| CN119290159B (en) | Spectral reconstruction method and system based on optimized digital camera spectral response function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right | Effective date of registration:20211102 Address after:200240 No. 800, Dongchuan Road, Shanghai, Minhang District Patentee after:Shi Shengxian Address before:200240 No. 800, Dongchuan Road, Shanghai, Minhang District Patentee before:SHANGHAI JIAO TONG University | |
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right | Effective date of registration:20211222 Address after:201109 room 1206, building 1, No. 951, Jianchuan Road, Minhang District, Shanghai Patentee after:Yimu (Shanghai) Technology Co.,Ltd. Address before:200240 No. 800, Dongchuan Road, Shanghai, Minhang District Patentee before:Shi Shengxian | |
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address | Address after:Room 102, 1st Floor, Building 98, No. 1441 Humin Road, Minhang District, Shanghai, 2019; Room 302, 3rd Floor, Building 98; Room 402, 4th Floor, Building 98 Patentee after:Yimu (Shanghai) Technology Co.,Ltd. Address before:201109 room 1206, building 1, No. 951, Jianchuan Road, Minhang District, Shanghai Patentee before:Yimu (Shanghai) Technology Co.,Ltd. |