CN103340601A

Movatterモバイル変換

Info

Publication number: CN103340601A
Application number: CN2013102619238A
Authority: CN
Inventors: 田捷; 迟崇巍; 叶津佐; 杨鑫
Original assignee: Institute of Automation of Chinese Academy of Science
Current assignee: Institute of Automation of Chinese Academy of Science
Priority date: 2013-06-27
Filing date: 2013-06-27
Publication date: 2013-10-09

Abstract

本发明公开了一种基于内窥镜的多光谱成像系统及方法，该系统包括：内窥镜头模块，用于实现内窥；光源模块，用于提供近红外和可见光光源；光学信号采集模块，用于采集近红外及可见光图像；多光谱转换模块，用于对不同光谱谱段进行成像；控制与处理模块，用于对相机进行控制及对采集到的图像进行处理。本发明同时还公开了一种利用所述系统进行多光谱成像的方法。本发明有效的解决了目前市面上绝大部分内窥镜荧光产品成像时只能看到荧光图像或者可见光图像，无法看到多光谱的图像的问题，同时也打破了国外公司在华的技术垄断状况，降低了多光谱内窥镜成像研究的门槛，拓展了光学分子影像探针可供选择的空间，延伸了光学分子影像研究与应用的范围。

The invention discloses an endoscope-based multi-spectral imaging system and method. The system includes: an endoscope lens module for realizing endoscopy; a light source module for providing near-infrared and visible light sources; an optical signal acquisition module, It is used to collect near-infrared and visible light images; the multi-spectral conversion module is used to image different spectral bands; the control and processing module is used to control the camera and process the collected images. The invention also discloses a method for performing multispectral imaging by using the system. The present invention effectively solves the problem that most endoscopic fluorescent products currently on the market can only see fluorescent images or visible light images, but cannot see multi-spectral images when imaging, and also breaks the technological monopoly of foreign companies in China This situation has lowered the threshold for multispectral endoscopic imaging research, expanded the space for optical molecular imaging probes, and extended the scope of optical molecular imaging research and applications.

Description

Translated fromChinese

基于内窥镜的多光谱成像系统和方法Endoscope-based multispectral imaging system and method

技术领域technical field

本发明涉及光学成像技术领域，特别是一种基于内窥镜的多光谱成像系统和方法。The invention relates to the technical field of optical imaging, in particular to an endoscope-based multispectral imaging system and method.

背景技术Background technique

近年来，由于分子影像学技术的不断发展，继放射性核素成像、正电子发射断层扫描、单光子发射计算机断层和磁共振成像之后，出现了高分辨率的光学成像，其中近红外荧光成像倍受关注。但是即使光学分子影像的应用领域较广，组织穿透深度仍是其广泛应用的一大障碍，如何能够实现在体的深度探测是目前亟待解决的问题。In recent years, due to the continuous development of molecular imaging technology, after radionuclide imaging, positron emission tomography, single photon emission computed tomography and magnetic resonance imaging, high-resolution optical imaging has appeared, among which near-infrared fluorescence imaging attention. However, even though optical molecular imaging has a wide range of applications, the tissue penetration depth is still a major obstacle to its wide application. How to achieve in-vivo depth detection is an urgent problem to be solved.

内窥式的探测方式具有探测深度可控等优点，可以有效解决组织穿透深度的问题。通过本发明方法，可以在体观测和定位荧光位置，并通过内窥镜头进入组织中进行深度探测。The endoscopic detection method has the advantages of controllable detection depth, which can effectively solve the problem of tissue penetration depth. Through the method of the invention, the fluorescent position can be observed and positioned in the body, and the endoscopic lens can enter into the tissue for depth detection.

发明内容Contents of the invention

本发明的目的是解决上述现有技术存在的缺陷，提供一种基于内窥镜的多光谱成像系统和方法。本发明根据光学分子影像的特点，并基于长期在光学成像领域的研究经验，采用两台相机来实现荧光、可见光以及拼合图像的获取等功能。The purpose of the present invention is to solve the above-mentioned defects in the prior art, and provide an endoscope-based multi-spectral imaging system and method. According to the characteristics of optical molecular images and based on long-term research experience in the field of optical imaging, the present invention uses two cameras to realize functions such as acquisition of fluorescence, visible light and stitched images.

根据本发明的一方面，提出一种基于内窥镜的多光谱成像系统，该系统包括：内窥镜头模块110、光源模块120、光学信号采集模块130、控制与处理模块140和多光谱切换模块150，其中：According to one aspect of the present invention, an endoscope-based multispectral imaging system is proposed, which includes: an endoscope lens module 110, a light source module 120, an optical signal acquisition module 130, a control andprocessing module 140, and a multispectral switching module 150, of which:

所述内窥镜头模块110，用于对待测组织的探测区域100进行内窥，并将所述探测区域100的反射光传输至所述光学信号采集模块130；The endoscopic lens module 110 is used to endoscopically observe thedetection area 100 of the tissue to be tested, and transmit the reflected light of thedetection area 100 to the optical signal acquisition module 130;

所述光源模块120与所述内窥镜头模块110连接，用于为所述内窥镜头模块110提供激发光和可见光；The light source module 120 is connected to the endoscopic lens module 110 for providing excitation light and visible light to the endoscopic lens module 110;

所述光学信号采集模块130与所述内窥镜头模块110连接，用于根据所述内窥镜头模块110传输的所述探测区域100的反射光得到荧光和可见光图像；The optical signal acquisition module 130 is connected to the endoscopic lens module 110, and is used to obtain fluorescence and visible light images according to the reflected light of thedetection area 100 transmitted by the endoscopic lens module 110;

所述控制与处理模块140与所述光学信号采集模块130连接，用于对所述光学信号采集模块130中的荧光相机134和彩色相机136进行控制，对所述光学信号采集模块130采集得到的荧光和可见光图像进行处理并显示；The control andprocessing module 140 is connected to the optical signal acquisition module 130, and is used to control thefluorescence camera 134 and thecolor camera 136 in the optical signal acquisition module 130, and collect the obtained optical signal by the optical signal acquisition module 130. Fluorescence and visible light images are processed and displayed;

所述多光谱切换模块150，用于为所述光源模块120和所述光学信号采集模块130提供不同光谱的滤光片。The multi-spectrum switching module 150 is configured to provide filters of different spectra for the light source module 120 and the optical signal collection module 130 .

根据本发明的另一方面，提出一种利用所述基于内窥镜的多光谱成像系统进行多光谱成像的方法，该方法包括以下步骤：According to another aspect of the present invention, a method for performing multispectral imaging using the endoscope-based multispectral imaging system is proposed, the method comprising the following steps:

步骤S1，使激发光源121和可见光光源123对探测区域100分别进行照射；Step S1, making theexcitation light source 121 and thevisible light source 123 respectively illuminate thedetection area 100;

步骤S2，根据探测特性，光谱切换模块150对于光源模块120、光学信号采集模块130中滤光片的参数进行设置；Step S2, according to the detection characteristics, the spectrum switching module 150 sets the parameters of the optical filters in the light source module 120 and the optical signal acquisition module 130;

步骤S3，控制模块141对荧光相机134和彩色相机136的成像参数进行调整，所述荧光相机134和彩色相机136分别根据所述探测区域100具有不同光谱或者能量的反射光采集得到图像；Step S3, the control module 141 adjusts the imaging parameters of thefluorescence camera 134 and thecolor camera 136, and thefluorescence camera 134 and thecolor camera 136 acquire images according to the reflected light with different spectra or energies in thedetection area 100 respectively;

步骤S4，图像处理模块142对所述荧光相机134和彩色相机136采集得到的图像进行处理；Step S4, the image processing module 142 processes the images collected by thefluorescence camera 134 and thecolor camera 136;

步骤S5，显示模块143对于所述步骤S4得到的处理后的图像进行实时显示，若显示的图像达不到清晰度要求，则通过光学信号采集模块130来调节镜头131的参数，直到所述显示模块143显示的图像达到清晰度要求；Step S5, the display module 143 displays the processed image obtained in the step S4 in real time, if the displayed image does not meet the definition requirement, the parameters of thelens 131 are adjusted through the optical signal acquisition module 130 until the displayed image The image displayed by module 143 meets the definition requirement;

步骤S6，移动内窥镜头模块110，在待测组织的探测区域100内寻找荧光物体，最终得到所述荧光物体的清晰图像。In step S6, the endoscopic lens module 110 is moved to search for a fluorescent object in thedetection area 100 of the tissue to be measured, and finally a clear image of the fluorescent object is obtained.

本发明通过内窥镜头模块实现光源的激发和光线的采集，光学信号采集模块进行实时采集光线，多光谱转换模块对不同谱段的光线进行过滤，控制与处理模块对采集到的图像信息进行实时的处理，将不同谱段的图像拼合到一起，实现光谱的图像融合并进行显示。目前市面上绝大部分内窥镜荧光产品均采用单一CCD相机进行成像，其缺点在于成像时只能看到荧光图像或者可见光图像，而无法看到多光谱的图像。而本发明有效的解决了该问题，同时也打破了国外公司在华的技术垄断状况，降低了多光谱内窥镜成像研究的门槛，拓展了光学分子影像探针可供选择的空间，延伸了光学分子影像研究与应用的范围。The invention realizes the excitation of the light source and the collection of light through the endoscopic lens module, the optical signal acquisition module collects the light in real time, the multi-spectral conversion module filters the light of different spectral bands, and the control and processing module performs real-time collection of the collected image information The image processing of different spectral bands is stitched together, and the image fusion of the spectrum is realized and displayed. At present, most endoscopic fluorescence products on the market use a single CCD camera for imaging. The disadvantage is that only fluorescence images or visible light images can be seen during imaging, and multi-spectral images cannot be seen. However, the present invention effectively solves this problem, breaks the technological monopoly of foreign companies in China, lowers the threshold for multispectral endoscopic imaging research, expands the space for optical molecular imaging probes, and extends the The scope of research and application of optical molecular imaging.

附图说明Description of drawings

图1是本发明基于内窥镜的多光谱成像系统的结构框图；Fig. 1 is the structural block diagram of the multispectral imaging system based on endoscope of the present invention;

图2是本发明基于内窥镜的多光谱成像系统的系统原理图；Fig. 2 is the system schematic diagram of the multispectral imaging system based on the endoscope of the present invention;

图3是本发明基于内窥镜的多光谱成像方法的流程图。Fig. 3 is a flow chart of the endoscope-based multispectral imaging method of the present invention.

具体实施方式Detailed ways

为使本发明的目的、技术方案和优点更加清楚明白，以下结合具体实施例，并参照附图，对本发明进一步详细说明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

根据本发明的一方面，提出一种基于内窥镜的多光谱成像系统，图1是本发明基于内窥镜的多光谱成像系统的结构框图，图2是本发明基于内窥镜的多光谱成像系统的系统原理图，如图1和图2所示，所述多光谱成像系统包括：内窥镜头模块110、光源模块120、光学信号采集模块130、控制与处理模块140和多光谱切换模块150，其中：According to one aspect of the present invention, a kind of multi-spectral imaging system based on endoscope is proposed, Fig. 1 is the structural block diagram of the multi-spectral imaging system based on endoscope of the present invention, Fig. 2 is the multi-spectral imaging system based on endoscope of the present invention The system schematic diagram of the imaging system, as shown in Figure 1 and Figure 2, the multispectral imaging system includes: endoscopic lens module 110, light source module 120, optical signal acquisition module 130, control andprocessing module 140 and multispectral switching module 150, of which:

所述光源模块120与所述内窥镜头模块110连接，用于为所述内窥镜头模块110提供激发光和可见光，所述可见光作为背景照明光；The light source module 120 is connected to the endoscopic lens module 110, and is used to provide excitation light and visible light for the endoscopic lens module 110, and the visible light is used as background illumination light;

所述内窥镜镜头模块110进一步包括激发光光纤111、可见光光纤112和信号采集光纤113，所述激发光光纤111、可见光光纤112分布在所述信号采集光纤113的周围，其中，所述激发光光纤111与所述光源模块120中的滤光片一122连接，用于引导出所述光源模块120中的激发光源121发出的激发光，以对所述探测区域100进行激发光照射；所述可见光光纤112与所述光源模块120中的滤光片二124连接，用于引导出所述光源模块120中的可见光光源123发出的可见光，以为所述探测区域100提供照明光源；所述信号采集光纤113与所述光学信号采集模块130中的镜头131的前端连接，用于采集所述激发光和可见光在所述探测区域100的反射光，并将所述反射光引导至所述镜头131处。The endoscope lens module 110 further includes an excitation light fiber 111, avisible light fiber 112 and asignal collection fiber 113, and the excitation light fiber 111 and thevisible light fiber 112 are distributed around thesignal collection fiber 113, wherein the excitation light The optical fiber 111 is connected to the filter one 122 in the light source module 120, and is used to guide the excitation light emitted by theexcitation light source 121 in the light source module 120, so as to irradiate thedetection region 100 with excitation light; Thevisible light fiber 112 is connected to the filter 2 124 in the light source module 120, and is used to guide the visible light emitted by thevisible light source 123 in the light source module 120 to provide an illumination source for thedetection area 100; the signal The collectionoptical fiber 113 is connected to the front end of thelens 131 in the optical signal collection module 130, and is used to collect the reflected light of the excitation light and visible light in thedetection area 100, and guide the reflected light to thelens 131 place.

所述光源模块120进一步包括激发光源121、滤光片一122、可见光光源123和滤光片二124，其中，所述激发光源121通过所述滤光片一122与所述内窥镜镜头模块110中的激发光光纤111连接，用于为所述激发光光纤111提供激发光，所述激发光源121可采用波长可调激光器或者卤钨灯等宽谱段光源；所述可见光光源123通过所述滤光片二124与所述内窥镜镜头模块110中的可见光光纤112连接，用于为所述可见光光纤112提供可见光，所述可见光光源123可采用卤钨灯或者LED灯等窄谱段特定波长或波段光源。The light source module 120 further includes anexcitation light source 121, a filter one 122, avisible light source 123 and asecond filter 124, wherein theexcitation light source 121 communicates with the endoscope lens module through the filter one 122 The excitation light fiber 111 in 110 is connected to provide excitation light for the excitation light fiber 111. Theexcitation light source 121 can be a wide-spectrum light source such as a wavelength-tunable laser or a tungsten halogen lamp; thevisible light source 123 passes through the The secondoptical filter 124 is connected to thevisible light fiber 112 in the endoscope lens module 110, and is used to provide visible light for thevisible light fiber 112. Thevisible light source 123 can use a narrow spectrum band such as a tungsten halogen lamp or an LED lamp. Specific wavelength or band light source.

所述光学信号采集模块130进一步包括镜头131、分光棱镜132、滤光片三133、荧光相机134、滤光片四135和彩色相机136，其中，所述镜头131与所述内窥镜镜头模块110中的信号采集光纤113相连接，用于将所述发射光引导至所述分光棱镜132处，并通过调整焦距、调焦环等参数来调整成像清晰度；所述分光棱镜132由二向分光棱镜或者55分光棱镜等分光原件组成，所述分光棱镜132的入射光端与所述镜头131的末端相连，所述分光棱镜132的两个出射端分别通过滤光片三133和滤光片四135与所述荧光相机134和彩色相机136相连，用于将所述镜头131传输的一束光线按照光线的光谱或者能量的不同分成两束；所述荧光相机134和彩色相机136通过数据线101与所述控制与处理模块140连接，用于根据所述分光棱镜132的出射光线进行成像，并将分别得到的具有不同光谱或者不同能量的图像传输至所述控制与处理模块140。The optical signal acquisition module 130 further includes alens 131, adichroic prism 132, an optical filter three 133, afluorescence camera 134, an optical filter four 135 and acolor camera 136, wherein thelens 131 and the endoscope lens module The signal collectingoptical fiber 113 in 110 is connected, and is used for guiding described emitting light to describeddichroic prism 132 place, and adjusts imaging definition by adjusting parameters such as focal length, focus ring; Describeddichroic prism 132 is composed of The beam-splitting prism or 55 beam-splitting prisms and other beam-splitting elements, the incident light end of the beam-splittingprism 132 is connected to the end of thelens 131, and the two outgoing ends of the beam-splittingprism 132 respectively pass through the filter 3 133 and thefilter 135 is connected with thefluorescent camera 134 and thecolor camera 136, and is used to divide a beam of light transmitted by thelens 131 into two beams according to the spectrum or energy of the light; thefluorescent camera 134 and thecolor camera 136 pass through thedata line 101 is connected to the control andprocessing module 140 , and is used to perform imaging according to the outgoing light of thedichroic prism 132 , and transmit the obtained images with different spectra or different energies to the control andprocessing module 140 .

所述控制与处理模块140进一步包括控制模块141、图像处理模块142和显示模块143，其中，所述控制模块141用于对所述荧光相机134和彩色相机136的成像参数(比如曝光时间等)进行控制；所述图像处理模块142用于对所述荧光相机134和彩色相机136拍摄得到的图像数据进行处理，所述处理至少包括图像融合，另外还可以包括图像去噪等处理操作；所述显示模块143用于对于所述图像处理模块142处理后得到的图像进行实时显示，以供工作人员观察。The control andprocessing module 140 further includes a control module 141, an image processing module 142 and a display module 143, wherein the control module 141 is used for imaging parameters (such as exposure time, etc.) of thefluorescence camera 134 and thecolor camera 136 Controlling; the image processing module 142 is used to process the image data captured by thefluorescent camera 134 and thecolor camera 136, the processing includes at least image fusion, and may also include processing operations such as image denoising; the The display module 143 is used to display the image processed by the image processing module 142 in real time for the staff to observe.

所述多光谱切换模块150为滤光轮装置，用于根据不同荧光的激发特性，调整各个滤光片的谱段，以保证多光谱光线的激发和采集，避免不同光谱光线的相互干扰，各个滤光片的谱段一旦调整好后，在整个实时成像的过程中将不再切换。所述滤光片的数量可根据需要进行安装，在本发明一实施例中，所述滤光片的数量为4片：滤光片一122、滤光片二124、滤光片三133和滤光片四135，所述滤光片的谱段为近红外范围，具体为：The multi-spectral switching module 150 is a filter wheel device, which is used to adjust the spectral bands of each filter according to the excitation characteristics of different fluorescent lights, so as to ensure the excitation and collection of multi-spectral light and avoid mutual interference of different spectral light. Once the spectral band of the filter is adjusted, it will not be switched during the whole real-time imaging process. The number of the optical filters can be installed according to the needs. In one embodiment of the present invention, the number of the optical filters is 4: optical filter one 122, optical filter two 124, optical filter three 133 and Optical filter four 135, the spectral band of described optical filter is near-infrared range, specifically:

滤光片一122的谱段为710nm-770nm，直径为25mm；The spectral band of filter one 122 is 710nm-770nm, and the diameter is 25mm;

滤光片二124的谱段为400nm-650nm，直径为25mm；The spectral band of filter 2 124 is 400nm-650nm, and the diameter is 25mm;

滤光片三133的谱段为810nm-870nm，直径为50mm；The spectral band of thethird filter 133 is 810nm-870nm, and the diameter is 50mm;

滤光片四135的谱段为400nm-650nm，直径为50mm。The spectral band of filter four 135 is 400nm-650nm, and the diameter is 50mm.

在操作人员实际使用过程中，可以根据具体的需求切换具有合适光谱的滤光片。During the actual use of the operator, the filter with a suitable spectrum can be switched according to the specific needs.

根据本发明的另一方面，还提出一种利用所述基于内窥镜的多光谱成像系统进行多光谱成像的方法，所述方法包括以下步骤：According to another aspect of the present invention, a method for performing multispectral imaging using the endoscope-based multispectral imaging system is also proposed, the method comprising the following steps:

步骤S4，图像处理模块142对所述荧光相机134和彩色相机136采集得到的图像进行处理，所述处理至少包括图像融合，另外还可以包括图像去噪等处理操作；Step S4, the image processing module 142 processes the images collected by thefluorescence camera 134 and thecolor camera 136, the processing includes at least image fusion, and may also include processing operations such as image denoising;

步骤S6，移动内窥镜头模块110，在待测组织的探测区域100内寻找荧光物体，最终得到所述荧光物体的清晰图像。Step S6, moving the endoscopic lens module 110 to search for fluorescent objects in thedetection area 100 of the tissue to be measured, and finally obtain a clear image of the fluorescent objects.

以上所述的具体实施例，对本发明的目的、技术方案和有益效果进行了进一步详细说明，所应理解的是，以上所述仅为本发明的具体实施例而已，并不用于限制本发明，凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.