技术领域technical field
本发明涉及核电检测领域,特别涉及一种核电站表面缺陷全景图像检测方法。The invention relates to the field of nuclear power detection, in particular to a panoramic image detection method for surface defects of nuclear power plants.
背景技术Background technique
核动力运行研究的核电站视频检测中,依靠单一帧的方法对缺陷分析,一方面,主观性强;另一方面,缺陷的定位与测量非常困难;检测对象的单调性以及环境的复杂性,常常使得缺陷的辨识力降低,从而造成误判和检测失效。In the video detection of nuclear power plants for nuclear power operation research, relying on a single frame method to analyze defects is highly subjective on the one hand; on the other hand, it is very difficult to locate and measure defects; The ability to identify defects is reduced, resulting in misjudgment and detection failure.
发明内容Contents of the invention
本发明的目的是提供一种能提高视频检测的有效性、可靠性且能降低误检、漏检风险的核电站表面缺陷全景图像检测方法。The purpose of the present invention is to provide a panoramic image detection method for nuclear power plant surface defects that can improve the effectiveness and reliability of video detection and reduce the risk of false detection and missed detection.
为解决上述技术问题,本发明采用如下技术方案: A.建立图像与核电站表面的场景的几何映射In order to solve the above technical problems, the present invention adopts the following technical solutions: A. Build a geometric map of the image and the scene of the surface of the nuclear power plant
场景中的点通过相机的光学成像系统映射成图像上的像素,基于相机成像模型、视频检测中的相机与被检测对象的空间关系,结合检验参数、摄像机参数,建立图像与场景的几何映射关系;The points in the scene are mapped into pixels on the image through the optical imaging system of the camera. Based on the camera imaging model, the spatial relationship between the camera and the detected object in video detection, combined with the inspection parameters and camera parameters, the geometric mapping relationship between the image and the scene is established. ;
假设场景中的两点与,分别映射成图像中与,则可以得出:Suppose two points in the scene and , respectively mapped into the image and , it can be concluded that:
……(1) ……(1)
式中, f’是相机焦距,z0是景与光心所在平面的距离,表示向量长度,检测设备装有两只激光器,已知激光发生器位置固定为d,发出两条参考线,在图像中距离为D,则:In the formula, f' is the focal length of the camera, z0 is the distance between the scene and the plane where the optical center is located, Indicates the length of the vector, the detection equipment is equipped with two lasers, the position of the known laser generator is fixed as d, two reference lines are issued, and the distance in the image is D, then:
……(2) ……(2)
因此,图像中的点对应映射的场景点:Therefore, the points in the image corresponding mapped scene points :
……(3) 、……(4) ...(3), ... (4)
公式(3)、(4)确定了像素点与场景点的唯一映射关系;Formulas (3) and (4) determine the unique mapping relationship between pixel points and scene points;
B.图像拼接B. Image Stitching
首先依据图像场景间的几何映射关系,再按照检验参数、摄像头参数,计算得到视频帧之间的像素变化规律;然后基于像素参量值、视频帧之间的像素变化规律,提取视频帧的像素;最后合并上一步提取的像素,生成完整的拼接图像;First, according to the geometric mapping relationship between the image scenes, and then according to the inspection parameters and camera parameters, the pixel change rule between the video frames is calculated; then, based on the pixel parameter value and the pixel change rule between the video frames, the pixels of the video frame are extracted; Finally, the pixels extracted in the previous step are combined to generate a complete stitched image;
定义像素参量:Define pixel parameters:
……(5) ... (5)
d为激光线的距离,D为图像中提取出来的激光线中心的像素差;d is the distance of the laser line, and D is the pixel difference of the center of the laser line extracted from the image;
视频中任意两帧之间实际变化的像素数可以表达为:The number of pixels actually changed between any two frames in the video can be expressed as:
……(6) ... (6)
V为检测速度,Δt为两帧时间差,单位为秒,检测速度即摄像机速度,v恒定,则任意固定时间间隔的帧之间像素差也是恒定的,因而从视频中固定间隔的帧中提取该像素数的图像,可以合成出完整的拼接图像;V is the detection speed, Δt is the time difference between two frames, and the unit is second. The detection speed is the camera speed. If v is constant, the pixel difference between frames at any fixed time interval is also constant, so the pixel difference between frames at fixed intervals in the video is extracted. The number of pixels of the image can be synthesized into a complete stitching image;
C.图像增强优化C. Image Enhancement Optimization
基于步骤B,可以组合出不同的像素提取参数,得出效果不同的拼接图像,然后依据图像与场景间的几何映射关系,生成每一个被检测点对应的像素的参量集;设置灰度阈值,剔除图像帧中低于阈值的像素参量;使用满足要求的像素参量替换被剔除的像素参量;按照步骤B中的方法生成拼接图像。Based on step B, different pixel extraction parameters can be combined to obtain stitched images with different effects, and then according to the geometric mapping relationship between the image and the scene, the parameter set of the pixel corresponding to each detected point is generated; the gray threshold is set, Eliminate pixel parameters below the threshold in the image frame; replace the eliminated pixel parameters with pixel parameters that meet the requirements; generate a spliced image according to the method in step B.
本发明的有益效果在于:1.本发明设计的全景图像检测系统,算法简单易实现,通过几何映射关系得出的精确像素参量,可以无失真地保留视频的像素信息,得到准确的拼接结果;2.全景图像方法提供了超视场的缺陷分析手段,且可实现像素级精度的几何测量;3.图像增强处理方法能够改善检测图像,有助于降低误检、漏检风险,保证了缺陷分析的可靠性与精度。The beneficial effects of the present invention are: 1. The algorithm of the panorama image detection system designed by the present invention is simple and easy to implement, and the precise pixel parameters obtained through the geometric mapping relationship can retain the pixel information of the video without distortion, and obtain accurate splicing results; 2. The panoramic image method provides a defect analysis method beyond the field of view, and can realize geometric measurement with pixel-level precision; 3. The image enhancement processing method can improve the detection image, help reduce the risk of false detection and missed detection, and ensure the defect Analytical reliability and precision.
具体实施方式Detailed ways
下面对本发明作以下详细描述:A.建立图像与核电站表面的场景的几何映射The present invention is described in detail below: A. Build a geometric map of the image and the scene of the surface of the nuclear power plant
场景中的点通过相机的光学成像系统映射成图像上的像素,基于相机成像模型、视频检测中的相机与被检测对象的空间关系,结合检验参数、摄像机参数,建立图像与场景的几何映射关系;The points in the scene are mapped into pixels on the image through the optical imaging system of the camera. Based on the camera imaging model, the spatial relationship between the camera and the detected object in video detection, combined with the inspection parameters and camera parameters, the geometric mapping relationship between the image and the scene is established. ;
假设场景中的两点与,分别映射成图像中与,则可以得出:Suppose two points in the scene and , respectively mapped into the image and , it can be concluded that:
……(1) ……(1)
式中, f’是相机焦距,z0是景与光心所在平面的距离,表示向量长度,检测设备装有两只激光器,已知激光发生器位置固定为d,发出两条参考线,在图像中距离为D,则:In the formula, f' is the focal length of the camera, z0 is the distance between the scene and the plane where the optical center is located, Indicates the length of the vector, the detection equipment is equipped with two lasers, the position of the known laser generator is fixed as d, two reference lines are issued, and the distance in the image is D, then:
……(2) ……(2)
因此,图像中的点对应映射的场景点:Therefore, the points in the image corresponding mapped scene points :
……(3) 、……(4) ...(3), ... (4)
公式(3)、(4)确定了像素点与场景点的唯一映射关系;Formulas (3) and (4) determine the unique mapping relationship between pixel points and scene points;
B.图像拼接B. Image Stitching
首先依据图像场景间的几何映射关系,再按照检验参数、摄像头参数,计算得到视频帧之间的像素变化规律;然后基于像素参量值、视频帧之间的像素变化规律,提取视频帧的像素;最后合并上一步提取的像素,生成完整的拼接图像;First, according to the geometric mapping relationship between the image scenes, and then according to the inspection parameters and camera parameters, the pixel change rule between the video frames is calculated; then, based on the pixel parameter value and the pixel change rule between the video frames, the pixels of the video frame are extracted; Finally, the pixels extracted in the previous step are combined to generate a complete stitched image;
定义像素参量:Define pixel parameters:
……(5) ... (5)
d为激光线的距离,D为图像中提取出来的激光线中心的像素差;d is the distance of the laser line, and D is the pixel difference of the center of the laser line extracted from the image;
视频中任意两帧之间实际变化的像素数可以表达为:The number of pixels actually changed between any two frames in the video can be expressed as:
……(6) ... (6)
V为检测速度,Δt为两帧时间差,单位为秒,检测速度即摄像机速度,v恒定,则任意固定时间间隔的帧之间像素差也是恒定的,因而从视频中固定间隔的帧中提取该像素数的图像,可以合成出完整的拼接图像;V is the detection speed, Δt is the time difference between two frames, and the unit is second. The detection speed is the camera speed. If v is constant, the pixel difference between frames at any fixed time interval is also constant, so the pixel difference between frames at fixed intervals in the video is extracted. The number of pixels of the image can be synthesized into a complete stitching image;
C.图像增强优化C. Image Enhancement Optimization
基于步骤B,可以组合出不同的像素提取参数,得出效果不同的拼接图像,然后依据图像与场景间的几何映射关系,生成每一个被检测点对应的像素的参量集;设置灰度阈值,剔除图像帧中低于阈值的像素参量;使用满足要求的像素参量替换被剔除的像素参量;按照步骤B中的方法生成拼接图像,所述阈值取值范围为240-245。Based on step B, different pixel extraction parameters can be combined to obtain stitched images with different effects, and then according to the geometric mapping relationship between the image and the scene, the parameter set of the pixel corresponding to each detected point is generated; the gray threshold is set, Eliminate pixel parameters below the threshold in the image frame; replace the eliminated pixel parameters with pixel parameters that meet the requirements; generate a stitched image according to the method in step B, and the threshold value ranges from 240-245.
上述实施例只为说明本发明的技术构思及特点,其目的在于让熟悉此项技术的人士能够了解本发明的内容并据以实施,并不能以此限制本发明的保护范围。凡根据本发明精神所作的等效变化或修饰,都应涵盖在本发明的保护范围之内。The above-mentioned embodiments are only to illustrate the technical concept and characteristics of the present invention, and the purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly, and not to limit the protection scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention shall fall within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911098634.4ACN110807773B (en) | 2019-11-12 | 2019-11-12 | Panoramic image detection method for surface defects of nuclear power station |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911098634.4ACN110807773B (en) | 2019-11-12 | 2019-11-12 | Panoramic image detection method for surface defects of nuclear power station |
| Publication Number | Publication Date |
|---|---|
| CN110807773A CN110807773A (en) | 2020-02-18 |
| CN110807773Btrue CN110807773B (en) | 2023-04-11 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911098634.4AActiveCN110807773B (en) | 2019-11-12 | 2019-11-12 | Panoramic image detection method for surface defects of nuclear power station |
| Country | Link |
|---|---|
| CN (1) | CN110807773B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013185969A (en)* | 2012-03-08 | 2013-09-19 | Mitsubishi Heavy Ind Ltd | Weld defect detection method and weld defect detection device |
| CN104092994A (en)* | 2014-07-15 | 2014-10-08 | 中广核工程有限公司 | Automatic detection method and device for underwater spent fuel grid defects in nuclear power plants |
| CN104822026A (en)* | 2015-04-30 | 2015-08-05 | 武汉大学 | Camera attitude control method used for nuclear power station containment vessel defect detection and device thereof |
| CN105761209A (en)* | 2016-03-16 | 2016-07-13 | 武汉大学 | Nuclear safety shell surface image fusion method and system |
| CN107221364A (en)* | 2017-05-31 | 2017-09-29 | 岭澳核电有限公司 | Nuclear fuel assembly underwater test platform and method of testing |
| CN109657639A (en)* | 2018-12-29 | 2019-04-19 | 中国电子科技集团公司第二十七研究所 | A kind of Situation Awareness System and method based on panoramic vision |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ATE511669T1 (en)* | 2004-01-13 | 2011-06-15 | Renault Sas | DESIGN OF SAFETY CRITICAL SYSTEMS |
| CN102314673B (en)* | 2011-08-02 | 2013-06-05 | 中国科学院长春光学精密机械与物理研究所 | Self-adapting image enhancement method |
| CN103196429B (en)* | 2013-03-25 | 2015-03-04 | 东南大学 | Method for quickly obtaining and measuring orthophotoquad of city skyline contour line facade |
| CN103198481B (en)* | 2013-04-03 | 2015-10-28 | 天津大学 | A kind of camera marking method |
| CN103400409B (en)* | 2013-08-27 | 2016-08-10 | 华中师范大学 | A kind of coverage 3D method for visualizing based on photographic head attitude Fast estimation |
| US20160295108A1 (en)* | 2015-04-01 | 2016-10-06 | Cheng Cao | System and method for panoramic imaging |
| CN105374010A (en)* | 2015-09-22 | 2016-03-02 | 江苏省电力公司常州供电公司 | A panoramic image generation method |
| CN108616733B (en)* | 2016-12-28 | 2020-01-10 | 深圳市掌网科技股份有限公司 | Panoramic video image splicing method and panoramic camera |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2013185969A (en)* | 2012-03-08 | 2013-09-19 | Mitsubishi Heavy Ind Ltd | Weld defect detection method and weld defect detection device |
| CN104092994A (en)* | 2014-07-15 | 2014-10-08 | 中广核工程有限公司 | Automatic detection method and device for underwater spent fuel grid defects in nuclear power plants |
| CN104822026A (en)* | 2015-04-30 | 2015-08-05 | 武汉大学 | Camera attitude control method used for nuclear power station containment vessel defect detection and device thereof |
| CN105761209A (en)* | 2016-03-16 | 2016-07-13 | 武汉大学 | Nuclear safety shell surface image fusion method and system |
| CN107221364A (en)* | 2017-05-31 | 2017-09-29 | 岭澳核电有限公司 | Nuclear fuel assembly underwater test platform and method of testing |
| CN109657639A (en)* | 2018-12-29 | 2019-04-19 | 中国电子科技集团公司第二十七研究所 | A kind of Situation Awareness System and method based on panoramic vision |
| Title |
|---|
| 邢诚,张涛,黄晶晶.《安全壳外观缺陷检查系统设计》.《测绘地理信息》.2017,第42卷(第2期),第71-75页.* |
| 黄晶晶.《R. K. Chapman and M. W. Toft, "Modelling the ultrasonic inspection of smooth and rough planar defects [and nuclear power plant application]》.《IEE Colloquium on New Applications in Modelling and Inversion Techniques for Non-Destructive Testing》.2002,第1999卷第1-4页.* |
| Publication number | Publication date |
|---|---|
| CN110807773A (en) | 2020-02-18 |
| Publication | Publication Date | Title |
|---|---|---|
| CN115272271B (en) | A pipeline defect detection and positioning ranging system based on binocular stereo vision | |
| CN110889829B (en) | A monocular distance measurement method based on fisheye lens | |
| CN103868460B (en) | Binocular stereo vision method for automatic measurement based on parallax optimized algorithm | |
| WO2020259271A1 (en) | Image distortion correction method and apparatus | |
| CN112714287B (en) | Cloud deck target conversion control method, device, equipment and storage medium | |
| WO2014044126A1 (en) | Coordinate acquisition device, system and method for real-time 3d reconstruction, and stereoscopic interactive device | |
| CN103902953B (en) | A kind of screen detecting system and method | |
| CN111723801B (en) | Method and system for detecting and correcting target in fisheye camera picture | |
| CN105741379A (en) | Method for panoramic inspection on substation | |
| CN110853002A (en) | Transformer substation foreign matter detection method based on binocular vision | |
| CN112348775A (en) | Vehicle-mounted all-round-looking-based pavement pool detection system and method | |
| US20190273845A1 (en) | Vibration monitoring of an object using a video camera | |
| CN107948464B (en) | A kind of geometric correction method and system of the laterally offset of printed matter detection image | |
| CN115272256A (en) | Sub-pixel level sensing optical fiber path Gaussian extraction method and system | |
| CN110617772A (en) | Non-contact type line diameter measuring device and method | |
| JP2008249431A (en) | 3D image correction method and apparatus | |
| CN116416702A (en) | A UAV power equipment inspection system based on augmented reality | |
| CN116665077A (en) | Power transmission line detection shooting method and system based on AI (advanced identification) recognition technology | |
| CN115965748A (en) | Three-dimensional reconstruction method of submerged arc based on binocular vision | |
| Liu et al. | Distance measurement system based on binocular stereo vision | |
| CN110807773B (en) | Panoramic image detection method for surface defects of nuclear power station | |
| JP2004364212A (en) | Object photographing apparatus, object photographing method, and object photographing program | |
| CN112146834B (en) | Structural vibration displacement measurement method and device | |
| CN113884017A (en) | A method and system for non-contact deformation detection of insulators based on trinocular vision | |
| CN116934833B (en) | Binocular vision-based underwater structure disease detection method, equipment and medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |