CN201594861U - Multi-band image fusion infrared imaging system - Google Patents

Abstract

Translated fromChinese

本实用新型提供一种结合红外传感器与可见光CCD传感器的特点，将双重图像融合处理的多波段图象融合红外成像系统。它是由红外光学系统、红外传感器、红外信号处理模块、以太网交换处理模块、可见光光学系统、CCD传感器、控制接口模块、控制云台组成的，红外光学系统连接红外传感器，红外传感器连接红外信号处理模块，红外信号处理模块连接以太网交换处理模块，可见光光学系统连接CCD传感器，CCD传感器连接控制接口模块，控制接口模块分别连接以太网交换处理模块和控制云台，本实用新型图像数据传输接口采用TCP/IP网络传输协议，使之可以接入以太网络与远程控制计算机进行实时数据分析。

The utility model provides an infrared imaging system which combines the characteristics of an infrared sensor and a visible light CCD sensor, and multi-waveband image fusion processing of double image fusion. It is composed of an infrared optical system, an infrared sensor, an infrared signal processing module, an Ethernet exchange processing module, a visible light optical system, a CCD sensor, a control interface module, and a control platform. The infrared optical system is connected to the infrared sensor, and the infrared sensor is connected to the infrared signal. The processing module, the infrared signal processing module is connected to the Ethernet exchange processing module, the visible light optical system is connected to the CCD sensor, the CCD sensor is connected to the control interface module, and the control interface module is respectively connected to the Ethernet exchange processing module and the control platform, the image data transmission interface of the utility model The TCP/IP network transmission protocol is adopted, so that it can be connected to the Ethernet network and the remote control computer for real-time data analysis.

Description

Translated fromChinese

多波段图象融合红外成像系统Multi-band image fusion infrared imaging system

(一)技术领域(1) Technical field

本实用新型涉及红外线技术，具体说就是一种多波段图象融合红外成像系统。The utility model relates to infrared technology, in particular to a multi-band image fusion infrared imaging system.

(二)背景技术(2) Background technology

红外热像仪是利用红外探测器、光学成像物镜和光机扫描系统(目前先进的焦平面技术则省去了光机扫描系统)接受被测目标的红外辐射能量分布图形反映到红外探测器的光敏元上，在光学系统和红外探测器之间，有一个光机扫描机构(焦平面热像仪无此机构)对被测物体的红外热像进行扫描，并聚焦在单元或分光探测器上，由探测器将红外辐射能转换成电信号，经放大处理、转换或标准视频信号通过电视屏或监测器显示红外热像图。这种热像图与物体表面的热分布场相对应；实质上是被测目标物体各部分红外辐射的热像分布图由于信号非常弱，与可见光图像相比，缺少层次和立体感，因此，在实际动作过程中为更有效地判断被测目标的红外热分布场，常采用一些辅助措施来增加仪器的实用功能，如图像亮度、对比度的控制，实标校正，伪色彩描绘等技术1800年，英国物理学家F.W.赫胥尔发现了红外线，从此开辟了人类应用红外技术的广阔道路。在第二次世界大战中，德国人用红外变像管作为光电转换器件，研制出了主动式夜视仪和红外通信设备，为红外技术的发展奠定了基础。二次世界大战后，首先由美国德克萨兰仪器公司经过近一年的探索，开发研制的第一代用于军事领域的红外成像装置，称之为红外寻视系统(FLIR)，它是利用光学机械系统对被测目标的红外辐射扫描。由光子探测器接收两维红外辐射迹象，经光电转换及一系列仪器处理，形成视频图像信号。这种系统、原始的形式是一种非实时的自动温度分布记录仪，后来随着五十年代锑化铟和锗掺汞光子探测器的发展，才开始出现高速扫描及实时显示目标热图像的系统。六十年代早期，瑞典AGA公司研制成功第二代红外成像装置，它是在红外寻视系统的基础上增加了测温的功能，称之为红外热像仪。开始由于保密的原因，在发达的国家中也仅限于军用，投入应用的热成像装置可在黑夜或浓厚云雾中探测对方的目标，探测伪装的目标和高速运动的目标。由于有国家经费的支撑，投入的研制开发费用很大，仪器的成本也很高。以后考虑到在工业生产发展中的实用性，结合工业红外探测的特点，采取压缩仪器造价，降低生产成本并根据民用的要求，通过减小扫描速度来提高图像分辨率等措施逐渐发展到民用领域。六十年代中期，AGA公司研制出第一套工业用的实时成像系统(THV)，该系统由液氮致冷，110V电源电压供电，重约35公斤，因此使用中便携性很差，经过对仪器的几代改进，1986年研制的红外热像仪已无需液氮或高压气，而以热电方式致冷，可用电池供电；1988年推出的全功能热像仪，将温度的测量、修改、分析、图像采集、存储合于一体，重量小于7公斤，仪器的功能、精度和可靠性都得到了显著的提高。九十年代中期，美国FSI公司首先研制成功由军用技术(FPA)转民用并商品化的新一红外热像仪(CCD)属焦平面阵列式结构的一种凝成像装置，技术功能更加先进，现场测温时只需对准目标摄取图像，并将上述信息存储到机内的PC卡上，即完成全部操作，各种参数的设定可回到室内用软件进行修改和分析数据，最后直接得出检测报告，由于技术的改进和结构的改变，取代了复杂的机械扫描，仪器重量已小于二公斤，使用中如同手持摄像机一样，单手即可方便地操作。Infrared thermal imager uses infrared detector, optical imaging objective lens and optical-mechanical scanning system (the current advanced focal plane technology omits optical-mechanical scanning system) to accept the infrared radiation energy distribution pattern of the measured target and reflect it to the photosensitive sensor of the infrared detector. On the element, between the optical system and the infrared detector, there is an optical-mechanical scanning mechanism (the focal plane thermal imager does not have this mechanism) to scan the infrared thermal image of the measured object and focus on the unit or the spectroscopic detector. The infrared radiation energy is converted into an electrical signal by the detector, and the infrared thermal image is displayed on a TV screen or a monitor after amplification processing, conversion or standard video signal. This kind of thermal image corresponds to the thermal distribution field on the surface of the object; it is essentially the thermal image distribution of the infrared radiation of each part of the measured target object. Because the signal is very weak, compared with the visible light image, it lacks layers and three-dimensionality. Therefore, In the actual operation process, in order to judge the infrared heat distribution field of the measured target more effectively, some auxiliary measures are often used to increase the practical functions of the instrument, such as image brightness, contrast control, real standard correction, false color rendering and other technologies. 1800 , the British physicist F.W. Huxel discovered infrared, which opened up a broad road for human application of infrared technology. In World War II, the Germans used infrared image changer tubes as photoelectric conversion devices to develop active night vision devices and infrared communication equipment, which laid the foundation for the development of infrared technology. After the Second World War, the first generation of infrared imaging device for the military field was developed by the Texas Instruments Corporation of the United States after nearly a year of exploration. It is called the Infrared Finding System (FLIR), which is The infrared radiation scanning of the measured target is carried out by using the optical mechanical system. The photon detector receives the signs of two-dimensional infrared radiation, and after photoelectric conversion and a series of instrument processing, a video image signal is formed. The original form of this system is a non-real-time automatic temperature distribution recorder. Later, with the development of indium antimonide and germanium-doped mercury photon detectors in the 1950s, high-speed scanning and real-time display of target thermal images began to appear. system. In the early 1960s, the Swedish AGA company successfully developed the second-generation infrared imaging device, which added the function of temperature measurement on the basis of the infrared viewing system, called an infrared thermal imager. At the beginning, due to confidentiality reasons, it was limited to military use in developed countries. The thermal imaging device put into use can detect the opponent's target in the dark night or in thick clouds and fog, detect camouflaged targets and high-speed moving targets. Due to the support of national funds, the research and development cost of input is very large, and the cost of the instrument is also very high. In the future, considering the practicability in the development of industrial production, combined with the characteristics of industrial infrared detection, the cost of equipment will be reduced, the production cost will be reduced, and according to the requirements of civilian use, measures such as reducing the scanning speed to improve image resolution will gradually develop into the civilian field. . In the mid-1960s, AGA Corporation developed the first industrial real-time imaging system (THV). The system was cooled by liquid nitrogen, powered by 110V power supply voltage, and weighed about 35 kg. Therefore, the portability in use was very poor. With several generations of improvements to the instrument, the infrared thermal imager developed in 1986 no longer needs liquid nitrogen or high-pressure gas, but is cooled by thermoelectricity and can be powered by batteries; the full-featured thermal imager launched in 1988 combines temperature measurement, modification, Analysis, image acquisition and storage are integrated, and the weight is less than 7 kg. The function, accuracy and reliability of the instrument have been significantly improved. In the middle of the 1990s, FSI Corporation of the United States first successfully developed a new thermal imaging camera (CCD) that was converted from military technology (FPA) to civilian use and commercialized. It is a coagulation imaging device with a focal plane array structure, and its technical functions are more advanced. When measuring on-site temperature, you only need to aim at the target to capture images, and store the above information on the PC card in the machine to complete all operations. The settings of various parameters can be returned to the room to use software to modify and analyze data, and finally directly According to the test report, due to the improvement of technology and the change of structure, the complicated mechanical scanning has been replaced. The weight of the instrument is less than two kilograms, and it can be easily operated with one hand just like a hand-held camera.

如今，红外热成像系统已经在电力、消防、石化以及医疗等领域得到了广泛的应用。红外热像仪在世界经济的发展中正发挥着举足轻重的作用。Today, infrared thermal imaging systems have been widely used in fields such as electric power, fire protection, petrochemical and medical treatment. Infrared thermal imaging cameras are playing a pivotal role in the development of the world economy.

红外热像仪一般分光机扫描成像系统和非扫描成像系统。光机扫描成像系统采用单元或多元(元数有8、10、16、23、48、55、60、120、180甚至更多)光电导或光伏红外探测器，用单元探测器时速度慢，主要是帧幅响应的时间不够快，多元阵列探测器可做成高速实时热像仪。非扫描成像的热像仪，如近几年推出的阵列式凝视成像的焦平面热像仪，属新一代的热成像装置，在性能上大大优于光机扫描式热像仪，有逐步取代光机扫描式热像仪的趋势。其关键技术是探测器由单片集成电路组成，被测目标的整个视野都聚焦在上面，并且图像更加清晰，使用更加方便，仪器非常小巧轻便，同时具有自动调焦图像冻结，连续放大，点温、线温、等温和语音注释图像等功能，仪器采用PC卡，存储容量可高达500幅图像。Infrared thermal imaging cameras generally include spectrometer scanning imaging systems and non-scanning imaging systems. The optical-mechanical scanning imaging system uses unit or multi-element (numbers are 8, 10, 16, 23, 48, 55, 60, 120, 180 or even more) photoconductive or photovoltaic infrared detectors, and the speed is slow when using unit detectors. The main reason is that the frame response time is not fast enough, and the multi-element array detector can be made into a high-speed real-time thermal imager. Non-scanning thermal imaging cameras, such as the focal plane thermal imaging cameras of array staring imaging introduced in recent years, are a new generation of thermal imaging devices, which are much better than optical-mechanical scanning thermal imaging cameras in performance and are gradually replacing Trends in optomechanical scanning thermal imaging cameras. Its key technology is that the detector is composed of a single-chip integrated circuit. The entire field of view of the measured target is focused on it, and the image is clearer and more convenient to use. Temperature, line temperature, isothermal temperature and voice annotation images and other functions, the instrument uses a PC card with a storage capacity of up to 500 images.

红外热电视是红外热像仪的一种。红外热电视是通过热释电摄像管(PEV)接受被测目标物体的表面红外辐射，并把目标内热辐射分布的不可见热图像转变成视频信号，因此，热释电摄像管是红外热电视的光键器件，它是一种实时成像，宽谱成像(对3～5μm及8～14μm有较好的频率响应)具有中等分辨率的热成像器件，主要由透镜、靶面和电子枪三部分组成。其技术功能是将被测目标的红外辐射线通过透镜聚焦成像到热释电摄像管，采用常温热电视探测器和电子束扫描及靶面成像技术来实现的。红外热像仪是通过吸收目标物体的能量辐射生成红外图像和温度测量的仪器。红外能量是一种肉眼看不见的能量，它的波长很长，无法被肉眼探测到。它是电磁波谱中的一部分，人类将它感知为热量。与可见光不同，在红外领域里，凡是温度在绝对零度以上的物体都能够散发热量。即使如冰块这样表面非常寒冷的物体，同样能够发射红外能量。物体的温度越高，它所辐射的红外能量就越强。红外热像仪能够帮助我们看见肉眼无法看见的情况。红外热像仪能够生成红外图像或热辐射图像，并且能够提供精确的非接触温度测量功能。几乎所有物体在发生故障之前，温度都会随之升高，因此在很多领域内，红外热像仪绝对是一种经济有效的检测工具。由于很多行业都将高效生产、能源管理、提高产量和生产安全作为企业发展的重要目标，因此红外热像仪正在被不断的应用在各种行业和各种应用领域中。Infrared thermal TV is a kind of infrared camera. Infrared thermal TV receives the surface infrared radiation of the target object through the pyroelectric camera tube (PEV), and converts the invisible thermal image of the thermal radiation distribution in the target into a video signal. Therefore, the pyroelectric camera tube is an infrared thermal TV The optical key device, which is a real-time imaging, wide-spectrum imaging (good frequency response to 3-5μm and 8-14μm) thermal imaging device with medium resolution, mainly consists of three parts: lens, target surface and electron gun composition. Its technical function is to focus and image the infrared radiation of the measured target to the pyroelectric camera tube through the lens, and use the normal temperature thermal TV detector, electron beam scanning and target surface imaging technology to realize it. A thermal imaging camera is an instrument that generates infrared images and temperature measurements by absorbing energy radiation from a target object. Infrared energy is invisible to the naked eye, and it has such a long wavelength that it cannot be detected by the naked eye. It is the part of the electromagnetic spectrum that humans perceive as heat. Unlike visible light, in the infrared field, any object with a temperature above absolute zero can emit heat. Even objects with very cold surfaces, such as ice cubes, emit infrared energy. The hotter an object is, the more infrared energy it radiates. Thermal imaging cameras can help us see what the naked eye cannot see. Thermal imaging cameras generate infrared images, or thermal radiation images, and provide accurate, non-contact temperature measurement. Almost everything heats up before it fails, so thermal imaging cameras are definitely a cost-effective inspection tool in many areas. Since many industries regard high-efficiency production, energy management, increased production and production safety as important goals of enterprise development, thermal imaging cameras are being continuously used in various industries and various application fields.

(三)发明内容(3) Contents of the invention

本实用新型的目的在于提供一种结合红外传感器与可见光CCD传感器的特点，将所传输的双重图像进行融合处理的多波段图象融合红外成像系统。The purpose of the utility model is to provide a multi-band image fusion infrared imaging system which combines the characteristics of the infrared sensor and the visible light CCD sensor and performs fusion processing on the transmitted double images.

本实用新型的目的是这样实现的：它是由红外光学系统、红外传感器、红外信号处理模块、以太网交换处理模块、可见光光学系统、CCD传感器、控制接口模块、控制云台、AC24V变压器、以太网络环境和控制主机组成的，红外光学系统连接红外传感器，红外传感器连接红外信号处理模块，红外信号处理模块连接以太网交换处理模块，可见光光学系统连接CCD传感器，CCD传感器连接控制接口模块，控制接口模块分别连接以太网交换处理模块和控制云台，控制云台连接AC24V变压器，以太网交换处理模块连接以太网络环境，以太网络环境连接控制主机。The purpose of this utility model is achieved in that it is composed of an infrared optical system, an infrared sensor, an infrared signal processing module, an Ethernet exchange processing module, a visible light optical system, a CCD sensor, a control interface module, a control platform, an AC24V transformer, an Ethernet Composed of network environment and control host, the infrared optical system is connected to the infrared sensor, the infrared sensor is connected to the infrared signal processing module, the infrared signal processing module is connected to the Ethernet exchange processing module, the visible light optical system is connected to the CCD sensor, the CCD sensor is connected to the control interface module, and the control interface The modules are respectively connected to the Ethernet switching processing module and the control pan-tilt, the control pan-tilt is connected to the AC24V transformer, the Ethernet switching processing module is connected to the Ethernet environment, and the Ethernet environment is connected to the control host.

本实用新型一种多波段图象融合红外成像系统，结合红外传感器与可见光CCD传感器的特点，将所传输的双重图像进行融合处理，经过精密的算法的接合，形成一个有效的融合图像，使之具有红外热图像的优点也可以如可见光图像般清晰可见。图像数据传输接口采用TCP/IP网络传输协议，使之可以接入以太网络与远程控制计算机进行实时数据分析。The utility model is a multi-band image fusion infrared imaging system, which combines the characteristics of the infrared sensor and the visible light CCD sensor, performs fusion processing on the transmitted double images, and forms an effective fusion image through the joint of precise algorithms, so that The advantage of having an infrared thermal image can also be seen as clearly as a visible light image. The image data transmission interface adopts the TCP/IP network transmission protocol, so that it can be connected to the Ethernet network and the remote control computer for real-time data analysis.

(四)附图说明(4) Description of drawings

图1为本实用新型的热成像原理图；Fig. 1 is the thermal imaging principle diagram of the present utility model;

图2为本实用新型的图像融合示意图；Fig. 2 is the image fusion schematic diagram of the present utility model;

图3为本实用新型的融合流程图；Fig. 3 is the fusion flowchart of the utility model;

图4为本实用新型的硬件系统结构方框图。Fig. 4 is a structural block diagram of the hardware system of the present utility model.

(五)具体实施方式(5) Specific implementation methods

下面结合附图举例对本实用新型作进一步说明。Below in conjunction with accompanying drawing example the utility model is described further.

实施例1：结合图4，本实用新型一种多波段图象融合红外成像系统，它是由红外光学系统(1)、红外传感器(2)、红外信号处理模块(3)、以太网交换处理模块(4)、可见光光学系统(5)、CCD传感器(6)、控制接口模块(7)、控制云台(8)、AC24V变压器(9)、以太网络环境(10)和控制主机(11)组成的，红外光学系统(1)连接红外传感器(2)，红外传感器(2)连接红外信号处理模块(3)，红外信号处理模块(3)连接以太网交换处理模块(4)，可见光光学系统(5)连接CCD传感器(6)，CCD传感器(6)连接控制接口模块(7)，控制接口模块(7)分别连接以太网交换处理模块(4)和控制云台(8)，控制云台(8)连接AC24V变压器(9)，以太网交换处理模块(4)连接以太网络环境(10)，以太网络环境(10)连接控制主机(11)。Embodiment 1: in conjunction with Fig. 4, a kind of multi-band image fusion infrared imaging system of the present utility model, it is by infrared optical system (1), infrared sensor (2), infrared signal processing module (3), Ethernet exchange process Module (4), visible light optical system (5), CCD sensor (6), control interface module (7), control pan/tilt (8), AC24V transformer (9), Ethernet environment (10) and control host (11) The infrared optical system (1) is connected to the infrared sensor (2), the infrared sensor (2) is connected to the infrared signal processing module (3), the infrared signal processing module (3) is connected to the Ethernet switching processing module (4), and the visible light optical system (5) Connect the CCD sensor (6), the CCD sensor (6) connects the control interface module (7), the control interface module (7) connects the Ethernet switching processing module (4) and the control pan-tilt (8) respectively, and controls the pan-tilt (8) Connect the AC24V transformer (9), the Ethernet exchange processing module (4) connects to the Ethernet environment (10), and the Ethernet environment (10) connects to the control host (11).

实施例2：结合图1-图3，本实用新型一种多波段图象融合红外成像系统，工作原理如下：Embodiment 2: In conjunction with Fig. 1-Fig. 3, a kind of multi-band image fusion infrared imaging system of the present invention, working principle is as follows:

红外成像传感器可以分别在近红外、短波红外、中波红外和热红外波段成像。其中，近红外(0.7-1.1μm)波段的成像传感器的作用机理与可见光成像传感器相似，主要依靠探测场景的反射成像，它在黄昏和拂晓前后所成的图像中含有相当丰富的图像细节信息。中波红外(3-5μm)和热红外(8-14μm)波段的成像传感器主要通过获取场景的红外辐射成像，具有更好的云雾穿透能力。Infrared imaging sensors can image in the near-infrared, short-wave infrared, mid-wave infrared, and thermal infrared bands, respectively. Among them, the imaging sensor in the near-infrared (0.7-1.1 μm) band has a similar mechanism to that of the visible light imaging sensor, mainly relying on the reflection imaging of the detection scene, and the images formed before and after dusk and dawn contain quite rich image detail information. Imaging sensors in the mid-wave infrared (3-5μm) and thermal infrared (8-14μm) bands mainly obtain infrared radiation imaging of the scene, and have better cloud and fog penetration capabilities.

可见光传感器和红外传感器是两种最常用的传感器。可见光成像传感器获取场景的各种反射信息，有较高的时空分辨率，所成的图像含有丰富的几何和纹理细节，能够提供目标所在场景的细节信息，有利于观察者对场景的整体认知。可见光图像是人们最熟悉，最易于释义的图像。但是可见光传感器在恶劣的天气条件下对大气的穿透成像能力较差，在夜间的成像能力尤其差；另外，大气湍流引起光路中空气折射指数的随机波动，会导致图像的随机模糊。Visible light sensors and infrared sensors are two of the most commonly used sensors. The visible light imaging sensor acquires various reflection information of the scene, has a high temporal and spatial resolution, and the resulting image contains rich geometric and texture details, which can provide detailed information of the scene where the target is located, and is conducive to the observer's overall cognition of the scene . Visible light images are the most familiar and easiest to interpret. However, the visible light sensor has poor penetrating imaging ability to the atmosphere under severe weather conditions, especially at night; in addition, atmospheric turbulence causes random fluctuations in the refractive index of the air in the optical path, which will lead to random blurring of the image.

图像融合是通过一定的算法，用多幅源图像(即输入图像)生成一幅或几幅图像的过程，生成的融合图像有着单一源图像所不具备的优点，含有更多、更准确的信息，从而更适合于人眼机器视觉或者更适合后续的图像处理任务，融合图像去除了源图像中的部分冗余信息，信息量较源图像的总的信息量有了明显的减少。Image fusion is the process of generating one or several images with multiple source images (ie, input images) through a certain algorithm. The generated fusion image has the advantages that a single source image does not have, and contains more and more accurate information. , so that it is more suitable for human eye machine vision or for subsequent image processing tasks. The fused image removes some redundant information in the source image, and the amount of information is significantly reduced compared with the total amount of information in the source image.

图像融合技术所处理的二维图像数据可能在传感器类型、观察条件、相机位置或获取时间上有所不同。这些图像中含有互补的信息和冗余的信息，冗余信息包括一致的和冲突的信息，其中冲突信息是必须去除的。所以图像融合应该：通过互补信息提高系统的完备性；通过冗余信息降低信息的不确定性、不准确性和模糊性，提高系统的可靠性和置信度；降低冗余度；去除源图像中的冲突信息；从而对探测器缺陷进行补偿，并获取场景的准确的、有意义的解释。The 2D image data processed by image fusion techniques may vary in sensor type, observation conditions, camera position, or acquisition time. These images contain complementary information and redundant information. The redundant information includes consistent and conflicting information, and the conflicting information must be removed. Therefore, image fusion should: improve the completeness of the system through complementary information; reduce the uncertainty, inaccuracy and ambiguity of information through redundant information, improve the reliability and confidence of the system; reduce redundancy; conflicting information; thereby compensating for detector imperfections and obtaining an accurate and meaningful interpretation of the scene.

双相机多波段图像融合：所用红外与可见光相机是通过网络协议将图片传输到电脑中并显示出，其红外镜头所照射出的带有景物鲜明的对比，即辐射温度的对比，这也就是所谓红外热成像图。那么，数字可见光相机，所程现出的可见光图像，便是人们肉眼可以直接观看到的图像，它同样是通过一个IP地址来传输电脑中。由于采用红外智能摄像机，其传感器最新一代非制冷式焦平面红外探测器，图像更清晰，它的工作波段在7.5μm-13.5μm属热红外。其数字摄像机采用CCD。红外与可见光图像融合其过程如下：首先，在图像配准中采用像素级多传感器图像配准方法，以小波算法分配图像空间；其次，分别对红外与可见光图像进行预处理。最后，进行图像融合。Dual-camera multi-band image fusion: The infrared and visible light cameras used transmit the pictures to the computer through the network protocol and display them. The infrared lens illuminates a sharp contrast with the scene, that is, the contrast of the radiation temperature. This is the so-called Infrared thermography image. Then, the visible light image displayed by the digital visible light camera is the image that people can directly watch with the naked eye, and it is also transmitted to the computer through an IP address. Due to the use of infrared smart cameras, the sensor’s latest generation of uncooled focal plane infrared detectors has clearer images, and its working band is thermal infrared at 7.5μm-13.5μm. Its digital camera adopts CCD. The process of infrared and visible light image fusion is as follows: first, pixel-level multi-sensor image registration method is used in image registration, and image space is allocated by wavelet algorithm; secondly, infrared and visible light images are preprocessed respectively. Finally, image fusion is performed.

本实用新型是结合红外传感器与可见光CCD传感器的特点，将所传输的双重图像进行融合处理，经过精密的算法的接合，形成一个有效的融合图像，使之具有红外热图像的优点也可以如可见光图像般清晰可见。图像数据传输接口采用TCP/IP网络传输协议，使之可以接入以太网络与远程控制计算机进行实时数据分析。The utility model combines the characteristics of the infrared sensor and the visible light CCD sensor, performs fusion processing on the transmitted double image, and forms an effective fusion image through the joint of precise algorithm, so that it has the advantages of infrared thermal image and can also be used as visible light Image-like clarity and visibility. The image data transmission interface adopts the TCP/IP network transmission protocol, so that it can be connected to the Ethernet network and the remote control computer for real-time data analysis.

Claims (1)

Translated fromChinese

1.一种多波段图象融合红外成像系统，它是由红外光学系统(1)、红外传感器(2)、红外信号处理模块(3)、以太网交换处理模块(4)、可见光光学系统(5)、CCD传感器(6)、控制接口模块(7)、控制云台(8)、AC24V变压器(9)、以太网络环境(10)和控制主机(11)组成的，其特征在于：红外光学系统(1)连接红外传感器(2)，红外传感器(2)连接红外信号处理模块(3)，红外信号处理模块(3)连接以太网交换处理模块(4)，可见光光学系统(5)连接CCD传感器(6)，CCD传感器(6)连接控制接口模块(7)，控制接口模块(7)分别连接以太网交换处理模块(4)和控制云台(8)，控制云台(8)连接AC24V变压器(9)，以太网交换处理模块(4)连接以太网络环境(10)，以太网络环境(10)连接控制主机(11)。1. A multi-band image fusion infrared imaging system, which is composed of infrared optical system (1), infrared sensor (2), infrared signal processing module (3), Ethernet exchange processing module (4), visible light optical system ( 5), CCD sensor (6), control interface module (7), control pan-tilt (8), AC24V transformer (9), Ethernet environment (10) and control host computer (11), it is characterized in that: infrared optical The system (1) is connected to the infrared sensor (2), the infrared sensor (2) is connected to the infrared signal processing module (3), the infrared signal processing module (3) is connected to the Ethernet switching processing module (4), and the visible light optical system (5) is connected to the CCD The sensor (6), the CCD sensor (6) is connected to the control interface module (7), the control interface module (7) is respectively connected to the Ethernet switching processing module (4) and the control pan-tilt (8), and the control pan-tilt (8) is connected to AC24V The transformer (9), the Ethernet exchange processing module (4) is connected to the Ethernet environment (10), and the Ethernet environment (10) is connected to the control host (11).

Images