CN111419149A - A multimodal endoscope and endoscope imaging system - Google Patents

Abstract

Translated fromChinese

本发明涉及一种多模态内窥镜及内窥成像系统，通过结合超声成像，光学相干层析成像，荧光成像和电子内窥镜成像，具有拍摄光学系统和拍摄元件，被向被检体的消化道(食道、胃、十二指肠、大肠)或者呼吸道(气管、支气管)插入，能够进行消化道、呼吸道的拍摄；设有成像原理不同的光学相干成像装置和荧光成像装置，二者分别与图像处理装置信号连接，且利用波分复用器相结合作为荧光成像系统，可结合各种成像装置的优点获取组织器官的医学影像，有助于捕获更准确的组织器官的层析图。与现有技术相比，本发明可以提供一种性能优异的一种多模态成像内窥镜及内窥系统。

The invention relates to a multimodal endoscope and an endoscope imaging system. By combining ultrasonic imaging, optical coherence tomography, fluorescence imaging and electronic endoscope imaging, it has a photographing optical system and a photographing element. The digestive tract (esophagus, stomach, duodenum, large intestine) or respiratory tract (trachea, bronchus) can be inserted into the digestive tract, which can take pictures of the digestive tract and respiratory tract; it is equipped with an optical coherence imaging device and a fluorescence imaging device with different imaging principles. They are respectively connected to the image processing device, and combined with a wavelength division multiplexer as a fluorescence imaging system, it can combine the advantages of various imaging devices to obtain medical images of tissues and organs, which helps to capture more accurate tomograms of tissues and organs. . Compared with the prior art, the present invention can provide a multimodal imaging endoscope and an endoscope system with excellent performance.

Description

Translated fromChinese

一种多模态内窥镜及内窥成像系统A multimodal endoscope and endoscope imaging system

技术领域technical field

本发明涉及医疗器械技术领域，尤其是涉及一种多模态内窥镜及内窥成像系统。The invention relates to the technical field of medical devices, in particular to a multimodal endoscope and an endoscope imaging system.

背景技术Background technique

近些年来，新成像技术的不断发展为疾病的早期诊断提供了新的手段，包括超声内窥成像，光学相干层析成像，荧光成像，共聚焦成像等等。In recent years, the continuous development of new imaging technologies has provided new means for the early diagnosis of diseases, including endoscopic ultrasound imaging, optical coherence tomography, fluorescence imaging, confocal imaging and so on.

超声内窥镜(Endoscopic Ultrasonography System，EUS)是一种集成超声波与内窥镜为一体的医疗设备。当超声内窥镜的弯曲部插入人体以后，通过前端部的内窥镜探头对内脏器官进行断层扫描，从而获得内脏器官的超声图像。由于超声成像的探测深度很深，所以超声内窥镜在国内大型医院内镜室的诊断和治疗都有着十分重要的作用。Endoscopic Ultrasonography System (EUS) is a medical device that integrates ultrasound and endoscope. After the curved part of the ultrasonic endoscope is inserted into the human body, the internal organs are tomographically scanned by the endoscope probe at the front end, so as to obtain the ultrasonic images of the internal organs. Due to the deep detection depth of ultrasound imaging, ultrasound endoscopy plays a very important role in the diagnosis and treatment of endoscopy rooms in large domestic hospitals.

光学相干成像(Optical Coherence Tomography，OCT)具有高分辨率，无接触，无损伤几个方面的特点。内窥OCT(Endoscopic OCT,E-OCT)作为OCT技术的重要分支，通过探头将光引导至待测器官组织处，可以克服光穿透深度有限的弱点，从而获得人体内器官深度高分辨的层析图像，通过组织形态学的研究，实现疾病的早期治疗。Optical Coherence Tomography (OCT) has the characteristics of high resolution, no contact and no damage. As an important branch of OCT technology, endoscopic OCT (Endoscopic OCT, E-OCT) guides light to the organ and tissue to be measured through a probe, which can overcome the weakness of limited light penetration depth, so as to obtain a high-resolution layer of the organ depth in the human body. Image analysis, through the study of histomorphology, to achieve early treatment of the disease.

荧光成像(Fluorescence Imaging)是荧光物质被激发后所发射的荧光信号的强度在一定范围内与荧光素的量呈线性关系。荧光是一种特异性高的分子，结合荧光成像和OCT就可以同时分析组织的结构和成分，可为胰胆管早期病变提供精准的影像手段。然而，目前尚无用于器官早期病变的OCT/荧光内窥成像研制。Fluorescence imaging is that the intensity of the fluorescent signal emitted by the fluorescent substance is linearly related to the amount of fluorescein within a certain range. Fluorescence is a highly specific molecule. Combined with fluorescence imaging and OCT, the structure and composition of tissues can be analyzed simultaneously, which can provide accurate imaging methods for early pancreaticobiliary duct lesions. However, no OCT/fluorescence endoscopic imaging has been developed for early stage lesions of organs.

综上所述，对于体内早期疾病的诊断，综合在体、断层成像、高分辨率和成像深度几个方面的临床要求。综合每种成像技术的特点，提供一种多模态的内窥镜和成像系统就显得尤为重要。In summary, for the diagnosis of early disease in vivo, the clinical requirements of in vivo, tomographic imaging, high resolution and imaging depth are integrated. Combining the characteristics of each imaging technology, it is particularly important to provide a multimodal endoscope and imaging system.

中国专利CN201910378525.1提供了一种能够抑制光纤的折损且安装性及操作性也优异的内窥镜。该内窥镜具备导光器，该导光器将由光源装置生成的照明光通过内窥镜的内部并从光源装置经过内窥镜的操作部引导至内窥镜的插入部的前端部。这种设计可进行实时成像，但却无法进行多模态的成像，从而无法提供更准确的组织器官的层析图像。Chinese patent CN201910378525.1 provides an endoscope capable of suppressing the breakage of an optical fiber and excellent in installation and operability. The endoscope includes a light guide that guides illumination light generated by the light source device through the inside of the endoscope and from the light source device to the distal end of the insertion portion of the endoscope through the operation portion of the endoscope. This design can perform real-time imaging, but cannot perform multimodal imaging, so it cannot provide more accurate tomographic images of tissues and organs.

发明内容SUMMARY OF THE INVENTION

本发明的目的就是为了克服上述现有技术存在的缺陷而提供一种多模态内窥镜及内窥成像系统。The purpose of the present invention is to provide a multimodal endoscope and an endoscopic imaging system in order to overcome the above-mentioned defects of the prior art.

本发明的目的可以通过以下技术方案来实现：The object of the present invention can be realized through the following technical solutions:

一种多模态内窥镜，包括：A multimodal endoscope comprising:

插入部，用于将光信号转换为电信号，并在接受到电信号后经由信号线将信号传输至连接部，传输回的电信号进入电子内窥镜系统装置中，并经过图像处理后进显现；The insertion part is used to convert the optical signal into an electric signal, and after receiving the electric signal, transmit the signal to the connection part through the signal line, and the transmitted electric signal enters the electronic endoscope system device, and is displayed after image processing. ;

所述的插入部包括依次设置的前端部、弯曲部和挠性管部，所述的前端部包括侧向列排布的用于与超声内窥成像装置通过信号线连接的超声波换能器，探头，用于与OCT成像观测装置通过光纤连接的光学聚焦模块，用于接收光学信号的摄像元件以及用于放置活检钳和其他治疗器械的处置器具通道；The insertion part comprises a front end part, a bending part and a flexible tube part arranged in sequence, and the front end part comprises ultrasonic transducers arranged in a lateral row and used for connecting with the ultrasonic endoscopic imaging device through a signal line, A probe, an optical focusing module for connecting with the OCT imaging observation device through an optical fiber, a camera element for receiving optical signals, and a treatment instrument channel for placing biopsy forceps and other therapeutic instruments;

操作部，用于对插入部的前端部进行供气、供水、负压吸引操作，对插入部的弯曲部进行弯曲操作，并控制处置器具通过处置器具通道输送至体腔；The operation part is used to perform air supply, water supply and negative pressure suction operations on the front end of the insertion part, perform bending operation on the bending part of the insertion part, and control the delivery of the treatment instrument to the body cavity through the treatment instrument channel;

连接部，用于将插入部与电子内窥镜系统装置连接。The connecting portion is used to connect the insertion portion with the electronic endoscope system device.

进一步地，所述的前端部为顶端硬质结构，多个超声换能器侧向列排布在硬质结构的前端部外表面。Further, the front end portion is a hard structure at the top end, and a plurality of ultrasonic transducers are arranged laterally on the outer surface of the front end portion of the hard structure.

进一步地，所述的插入部还包括照明窗以及用以将光传输到照明窗进行照明的单模光纤。Further, the insertion part further includes an illumination window and a single-mode optical fiber for transmitting light to the illumination window for illumination.

进一步地，所述的操作部设于插入部的基端侧，所述的操作部包括用于对弯曲部进行弯曲操作的弯曲旋钮，用于向插入部的前端部进行供气、供水的供气供水管，用于通过内窥镜内部吸去插入部的前端部多余的液体的负压吸引管，以及用于与操作部的处置器具通道连接的处置器具插入口。Further, the operation part is provided on the proximal end side of the insertion part, and the operation part includes a bending knob for performing a bending operation on the bending part, and is used for supplying air and water to the front end part of the insertion part. An air supply pipe, a negative pressure suction tube for sucking excess liquid from the distal end of the insertion portion through the endoscope, and a treatment instrument insertion port for connecting to the treatment instrument channel of the operation portion.

所述的探头包括用于保持位于前方视野照明的所述的照明窗，用于吸出多余的液体管的端部负压吸引装置窗，用于保持送水管的端部，并用于保持送气管的端部供水、供气窗，用于保持处置器具通道的端部的与处置器具插入口连通的处置器具通道窗，以及用于电子内窥镜装置的数据传输的摄像装置观察窗。The probe includes the illumination window for keeping the illumination in the front view, the negative pressure suction device window for sucking out the excess liquid pipe, the end of the water supply pipe, and the end of the air supply pipe. A water supply and air supply window at the end, a treatment instrument channel window for maintaining the end of the treatment instrument channel in communication with the treatment instrument insertion port, and a camera device observation window for data transmission of the electronic endoscope device.

所述的光学聚焦模块为半球状聚焦球透镜，所述的半球状聚焦球透镜的水平底面上设有镀金反射膜，该水平底面与光纤的轴向呈45°角，所述的半球状聚焦球透镜除水平底面外的其他部分与多模光纤融合。The optical focusing module is a hemispherical focusing ball lens. The horizontal bottom surface of the hemispherical focusing ball lens is provided with a gold-plated reflective film, and the horizontal bottom surface is at an angle of 45° with the axial direction of the optical fiber. The other parts of the ball lens except the horizontal bottom surface are fused with the multimode fiber.

所述的摄像元件通过将接收到的光信号转变成电信号，并经由信号线传输至电子内窥镜成像装置中后，通过图像处理装置进行显现。The image pickup element converts the received optical signal into an electrical signal and transmits it to the electronic endoscope imaging device through a signal line, and then is displayed by the image processing device.

一种多模态内窥成像系统，该系统包括：A multimodal endoscopic imaging system comprising:

所述的多模态内窥镜；The multimodal endoscope;

图像处理装置，分别与OCT成像观测装置、荧光成像装置、超声成像装置信号连接，用于根据用户的操作输出控制信号，并根据接收到的反馈信号生成组织器官的多模态影像；The image processing device is respectively connected to the OCT imaging observation device, the fluorescence imaging device, and the ultrasonic imaging device by signal, and is used for outputting a control signal according to the user's operation, and generating a multimodal image of the tissue and organ according to the received feedback signal;

超声成像装置，与多模态内窥镜的超声换能器通过信号线连接，用于根据所述控制信号输出超声控制信号，使所述超声换能器向待测样品组织发射超声波、并将返回的反馈超声波转换为超声反馈信号；The ultrasonic imaging device is connected with the ultrasonic transducer of the multimodal endoscope through a signal line, and is used for outputting an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to the sample tissue to be tested, and transmits ultrasonic waves to the tissue to be tested. The returned feedback ultrasound is converted into an ultrasound feedback signal;

OCT成像观测装置，与半球形聚焦球透镜通过光纤连接，用于根据控制信号输出光信号，所述的光信号通过半球形聚焦球透镜到达待测样品组织，并接收采集的待测样品组织反馈的光信号；The OCT imaging observation device is connected with the hemispherical focusing ball lens through an optical fiber, and is used for outputting an optical signal according to the control signal. The optical signal reaches the sample tissue to be tested through the hemispherical focusing ball lens, and receives the feedback of the collected sample tissue to be tested. the light signal;

荧光成像观测装置，利用波分复用器与OCT成像观测装置构成荧光成像系统，用于将光学相干成像样品臂光源和荧光激励光源整合到同一单模宽带光纤光路；The fluorescence imaging observation device uses a wavelength division multiplexer and an OCT imaging observation device to form a fluorescence imaging system, which is used to integrate the optical coherent imaging sample arm light source and the fluorescence excitation light source into the same single-mode broadband optical fiber optical path;

电子内窥镜系统装置，用于与多模态内窥镜的插入部连接，用于对插入部传输回的电信号进行图像处理并显现。The electronic endoscope system device is used for connecting with the insertion part of the multimodal endoscope, and is used for image processing and visualization of the electrical signals transmitted back by the insertion part.

进一步地，本发明多模态内窥成像系统采用双包层光纤耦合器收集发射的光，并采用半导体激光作为荧光成像的激发光源。Further, the multimodal endoscopic imaging system of the present invention uses a double-clad optical fiber coupler to collect the emitted light, and uses a semiconductor laser as the excitation light source for fluorescence imaging.

进一步地，所述的OCT成像观测装置采用高速VECSEL光源，所述的荧光成像系统采用半导体可调激光的680-750nm波段作为激发光源。Further, the OCT imaging observation device adopts a high-speed VECSEL light source, and the fluorescence imaging system adopts the 680-750 nm wavelength band of a semiconductor tunable laser as the excitation light source.

与现有技术相比，本发明具有以下优点：Compared with the prior art, the present invention has the following advantages:

1)本发明的多模态内窥成像系统设有成像原理不同的第一光学成像装置，即光学相干成像装置和第二光学成像装置，即荧光成像装置，其中光学相干成像技术相比于其他技术具有非侵入、高分辨率、可在体检测生物组织内部微结构，与内窥技术结合之后的OCT内窥成像技可直接对生物组织进行成像，能够完成对组织的高精度扫描，进而可对早期癌变和动脉粥样硬化进行早期诊断；荧光成像是荧光物质被激发后所发射的荧光信号的强度在一定范围内与荧光素的量呈线性关系；多模态系统将充分利用超声的深度组织成像能力、OCT的高分辨组织成像能力以及荧光分子靶向成像的高灵敏度和特异性，实现实时可视化的多模态成像。1) The multimodal endoscopic imaging system of the present invention is provided with a first optical imaging device with different imaging principles, namely an optical coherent imaging device and a second optical imaging device, namely a fluorescence imaging device, wherein the optical coherence imaging technology is compared with other The technology is non-invasive, high-resolution, and can detect the internal microstructure of biological tissue in vivo. The OCT endoscopic imaging technology combined with endoscopic technology can directly image biological tissue, and can complete high-precision scanning of tissue, thereby enabling Early diagnosis of early cancer and atherosclerosis; fluorescence imaging is that the intensity of the fluorescent signal emitted by the fluorescent substance is linearly related to the amount of fluorescein within a certain range; the multimodal system will make full use of the depth of ultrasound The tissue imaging capability, the high-resolution tissue imaging capability of OCT, and the high sensitivity and specificity of fluorescent molecular targeted imaging enable real-time visualization of multimodal imaging.

2)本发明的多模态内窥镜相比于单模态内窥镜的单一性，不稳定性和成像分辨率差的特点，多模态内窥镜的镜头通过信号线、光纤可将声信号—电信号、光信号—电信号进行相互转换，具有综合在体、断层成像、高分辨率和成像深度几个方面的临床特点，综合平衡了这一系列问题，适合对于体内早期疾病的诊断，为早期癌变等提供精准的影像手段；此外，与传统单模态内窥镜相比，多模态内窥镜可实现对胃肠道断层成像，可检测出多种胃肠疾病的微小病变，有利于病人可提前治疗并提高治愈率。2) Compared with the single-mode endoscope, the multi-modal endoscope of the present invention has the characteristics of singleness, instability and poor imaging resolution. Acoustic signal-electrical signal, optical signal-electrical signal are mutually converted, and it has the clinical characteristics of comprehensive in vivo, tomographic imaging, high resolution and imaging depth. Diagnosis, providing accurate imaging methods for early canceration, etc. In addition, compared with traditional single-modality endoscopes, multi-modality endoscopes can realize tomographic imaging of the gastrointestinal tract, and can detect the microscopic features of various gastrointestinal diseases. It is beneficial for patients to be treated in advance and improve the cure rate.

3)本发明的多模态内窥镜的镜头内特殊的半球状聚焦球透镜和超声换能器能够确保通过一次下镜实现多重功能，半球形聚焦球透镜用于与OCT成像观测装置通过光纤连接，超声换能器用于与超声内窥成像装置通过信号线连接，不同的装置使用各自独立的通道，保证各自能够正常稳定工作而互不干扰，相比于传统内窥镜有效解决了目前普遍存在多次下镜存在的病变信号和图像配准问题，且大大降低了目前国内类似手术费用，节省手术时间，此外有助于在应用时较大程度减轻病患痛苦。3) The special hemispherical focusing ball lens and the ultrasonic transducer in the lens of the multimodal endoscope of the present invention can ensure that multiple functions can be realized through a single lens down, and the hemispherical focusing ball lens is used to connect with the OCT imaging observation device through the optical fiber Connection, the ultrasonic transducer is used to connect with the ultrasonic endoscopic imaging device through a signal line, and different devices use their own independent channels to ensure that each can work normally and stably without interfering with each other. Compared with traditional endoscopes, it effectively solves the problem of common There is the problem of lesion signal and image registration that exists under multiple microscopes, and it greatly reduces the current domestic similar operation costs, saves operation time, and helps to reduce the pain of patients to a large extent during application.

4)本发明的光学相干成像装置、荧光成像装置分别与图像处理装置信号连接，且利用波分复用器相结合作为荧光成像系统，可结合各种成像装置的优点获取组织器官的医学影像，有助于捕获更准确的组织器官的层析图。4) The optical coherent imaging device and the fluorescence imaging device of the present invention are signal-connected to the image processing device respectively, and the wavelength division multiplexer is combined as a fluorescence imaging system, which can combine the advantages of various imaging devices to obtain medical images of tissues and organs, Helps capture more accurate chromatograms of tissues and organs.

附图说明Description of drawings

图1为本发明实施例中多模态内窥镜的插入部和操作部的侧面剖视结构示意图；1 is a schematic side sectional structural diagram of an insertion part and an operation part of a multimodal endoscope in an embodiment of the present invention;

图2为本发明实施例中多模态内窥镜的插入部前端探头的结构示意图；2 is a schematic structural diagram of a front-end probe of an insertion portion of a multimodal endoscope according to an embodiment of the present invention;

图3为本发明实施例中多模态内窥成像系统的结构示意图；3 is a schematic structural diagram of a multimodal endoscopic imaging system in an embodiment of the present invention;

图中标号所示：The numbers in the figure show:

101、多模态内窥成像系统，102、多模态内窥镜，103、超声波观测装置，104、电子内窥镜观测装置，105、OCT成像观测装置，106、荧光成像观测装置，107、计算机，108、波分复用器，109、供水罐，110、插入部，111、操作部，112、处置器具插入口，113、通用线缆，114、连接器；203、待测样本组织，204、超声波换能器，205、半球状聚焦球透镜，206、第一信号线，207、多模光纤，208、单模光纤，209、第二信号线，210、负压吸引管，211、送气送水管，212、处置器具通道；301、探头，302、照明窗，303、负压吸引装置窗，304、供水、供气窗，305、处置器具通道窗，306、摄像装置观察窗。101. Multimodal endoscopy imaging system, 102, Multimodal endoscope, 103, Ultrasonic observation device, 104, Electronic endoscope observation device, 105, OCT imaging observation device, 106, Fluorescence imaging observation device, 107, computer, 108, wavelength division multiplexer, 109, water supply tank, 110, insertion part, 111, operation part, 112, insertion port of treatment instrument, 113, universal cable, 114, connector; 203, sample tissue to be tested, 204, ultrasonic transducer, 205, hemispherical focusing ball lens, 206, first signal line, 207, multimode fiber, 208, single mode fiber, 209, second signal line, 210, negative pressure suction tube, 211, Air and water supply pipe, 212, treatment device channel; 301, probe, 302, lighting window, 303, negative pressure suction device window, 304, water supply, air supply window, 305, treatment device channel window, 306, camera device observation window.

具体实施方式Detailed ways

下面结合附图和具体实施例对本发明进行详细说明。显然，所描述的实施例是本发明的一部分实施例，而不是全部实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都应属于本发明保护的范围。The present invention will be described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

实施例Example

本发明涉及一种多模态内窥镜，多模态内窥镜的镜头通过信号线、光纤可将声信号—电信号、光信号—电信号进行相互转换，具有综合在体、断层成像、高分辨率和成像深度几个方面的临床特点，该内窥镜包括：The invention relates to a multimodal endoscope. The lens of the multimodal endoscope can convert acoustic signal-electrical signal, optical signal-electrical signal to each other through signal lines and optical fibers, and has the advantages of comprehensive in-body, tomographic imaging, Clinical features of this endoscope in terms of high resolution and imaging depth include:

插入部，插入部，具有前端部，该前端部为顶端硬质结构，前端部包括侧向列排布的多个超声波换能器、探头以及用于接收光学信号的CCD/CMOS等摄像元件。摄像元件用于向被检体的消化道(食道、胃、十二指肠、大肠)或者呼吸道(气管、支气管)插入，能够进行消化道、呼吸道的拍摄。同时插入部还具有弯曲部以及挠性管部，弯曲部位于前端部后侧，其结构组成：最外层是橡皮，中间层是金属网，最里层是弯曲的蛇骨。蛇骨由许多环状的金属组成，能够上下左右四个方向弯曲活动。弯曲部作用是用来调节观察视场方向；挠性管部位于弯曲部后侧，其结构组成：挠性管部是基于螺旋管、网状管以及外皮的三层结构。挠性管部作用是具有挠性，使得挠性管部朝向体内插入的插入性提高，另外，挠性值越低，挠性管部越柔软，越难以插入体内。The insertion part, the insertion part, has a front end part, the front end part is a rigid structure at the front end, and the front end part includes a plurality of ultrasonic transducers arranged in a lateral row, a probe, and an imaging element such as CCD/CMOS for receiving optical signals. The imaging element is inserted into the digestive tract (esophagus, stomach, duodenum, large intestine) or respiratory tract (trachea, bronchi) of a subject, and can image the digestive tract and the respiratory tract. At the same time, the insertion part also has a bending part and a flexible tube part. The bending part is located at the rear side of the front end part. The snake bone is composed of many ring-shaped metals, which can bend and move in four directions: up, down, left, and right. The function of the bending part is to adjust the viewing field direction; the flexible tube part is located at the rear side of the bending part, and its structural composition: the flexible tube part is based on the three-layer structure of the spiral tube, the mesh tube and the outer skin. The function of the flexible tube portion is to have flexibility, so that the insertability of the flexible tube portion into the body is improved. In addition, the lower the flexibility value, the softer the flexible tube portion and the more difficult it is to be inserted into the body.

操作部，可以控制插入部前端：送水，用于冲洗物镜镜面以及手术野使得视野保持清晰；送气，气体由此进入人体体腔使得扩张；负压吸引，当腔内有过多液体妨碍观察时可控制吸引按钮将液体吸入吸引瓶内；处置器具通道，活检钳和其他治疗器械也可由操作部控制进入体腔内。The operation part can control the front end of the insertion part: water supply, used to flush the objective lens surface and the surgical field to keep the field of view clear; air supply, the gas enters the human body cavity to expand; negative pressure suction, when there is too much liquid in the cavity, it can be used to prevent observation. The suction button is controlled to suck the liquid into the suction bottle; the channel for disposal instruments, biopsy forceps and other therapeutic instruments can also be controlled by the operating part to enter the body cavity.

连接部，用于将插入部与电子内窥镜系统装置连接。插入部的前端有接收光学信号的CCD或者CMOS，可以将光信号转换为电信号，在接受到电信号以后经由信号线将信号传输至连接部。同时，传输回来的电信号进入电子内窥镜系统装置中，并经过图像处理后显现出来；插入部的超声换能器通过信号线和连接部相连，信号线会驱使超声换能器发出高频超声并且射向待测样品组织。同时，从待测样本组织中反射回来的超声信号也会被超生换能器接收并且转换为电信号，在通过信号线经由连接部将电信号传输入超声成像系统中，并经过图像系统处理后显现出来。经过样品反射的光会原路返回至多模光纤中再经由连接部传输至光学模块中，并经过图像系统处理后显现出来。The connecting portion is used to connect the insertion portion with the electronic endoscope system device. The front end of the insertion part has a CCD or CMOS that receives optical signals, converts the optical signals into electrical signals, and transmits the signals to the connection part via signal lines after receiving the electrical signals. At the same time, the transmitted electrical signal enters the electronic endoscope system device, and is displayed after image processing; the ultrasonic transducer of the insertion part is connected to the connecting part through a signal line, and the signal line will drive the ultrasonic transducer to emit high frequency Ultrasonic and directed at the sample tissue to be tested. At the same time, the ultrasonic signal reflected from the sample tissue to be tested will also be received by the ultrasonic transducer and converted into an electrical signal. The electrical signal is transmitted into the ultrasonic imaging system through the signal line through the connecting part, and processed by the image system. show up. The light reflected by the sample will be returned to the multimode fiber, and then transmitted to the optical module through the connecting part, and will be displayed after being processed by the image system.

图1为多模态内窥镜的插入部和操作部的侧面剖视图，在进行检测时，待测样本组织203与插入部的前端部相对应设置。FIG. 1 is a side cross-sectional view of the insertion part and the operation part of the multimodal endoscope. During detection, thesample tissue 203 to be tested is disposed corresponding to the front end of the insertion part.

1)内窥镜的插入部包括超声波换能器204、半球状聚焦球透镜205、第一信号线206、多模光纤207、单模光纤208、第二信号线209、负压吸引管210、送气送水管211和处置器具通道212。其中，超声换能器204位于硬质部外表面，且位于前端部侧向列排布多个超声波换能器204。每一个超声波换能器204连接一个第一信号线206。超声换能器204用于与超声内窥成像装置通过信号线连接，能够使用超声波对其周围脏器(胰脏、胆嚢、胆管、胰管、淋巴结、纵隔内的脏器、血管等)进行拍摄。超声换能器用于将从超声波观测装置发送来的电脉冲信号转换为超声波脉冲(声脉冲)并向被检体照射，并将由被检体反射来的超声波回波转换为通过电压变化来表示的电回波信号并输出。超声成像则通过声发生器和接收器产生和检测超声信号。1) The insertion part of the endoscope includes anultrasonic transducer 204, a hemispherical focusingball lens 205, afirst signal line 206, amulti-mode fiber 207, a single-mode fiber 208, asecond signal line 209, a negativepressure suction tube 210, Air supply and water supply pipe 211 andtreatment tool channel 212 . Wherein, theultrasonic transducers 204 are located on the outer surface of the hard part, and a plurality ofultrasonic transducers 204 are arranged laterally at the front end. Eachultrasonic transducer 204 is connected to afirst signal line 206 . Theultrasonic transducer 204 is used to connect to the endoscopic ultrasound imaging device through a signal line, and can use ultrasonic waves to photograph the surrounding organs (pancreas, bile duct, bile duct, pancreatic duct, lymph node, organs in the mediastinum, blood vessels, etc.) . The ultrasonic transducer is used to convert the electrical pulse signal sent from the ultrasonic observation device into ultrasonic pulses (sound pulses) and irradiate the subject, and convert the ultrasonic echoes reflected by the subject into voltage changes represented by Electric echo signal and output. Ultrasound imaging generates and detects ultrasound signals through sound generators and receivers.

插入部设有一个出光口，该出光口位于插入部前端的侧边，半球状聚焦球透镜205的球面与该出光口对应设置。半球状聚焦球透镜205可与OCT成像观测装置通过光纤连接，半球状聚焦球透镜205用于光学聚焦，其水平底面上设置有镀金反射膜，该水平底面与光纤的轴向呈45°角，使得该镀膜反射膜将光纤传输来的信号以90°角的方向照射在待测样本组织203上，半球状聚焦球透镜205的另一部分直接和多模光纤207融合，从而传输所得到的光学信号。优选地，出光孔采用光透镜。The insertion portion is provided with a light outlet, the light outlet is located on the side of the front end of the insertion portion, and the spherical surface of the hemispherical focusingball lens 205 is arranged corresponding to the light outlet. The hemispherical focusingball lens 205 can be connected with the OCT imaging observation device through an optical fiber. The hemispherical focusingball lens 205 is used for optical focusing, and a gold-plated reflective film is arranged on its horizontal bottom surface, and the horizontal bottom surface and the axis of the optical fiber are at an angle of 45°. The coated reflective film irradiates the signal transmitted by the optical fiber on thesample tissue 203 to be tested at an angle of 90°, and the other part of the hemispherical focusingball lens 205 is directly fused with themultimode fiber 207, thereby transmitting the obtained optical signal . Preferably, the light exit hole adopts a light lens.

插入部中单模光纤208直接将光传输到内窥镜所属插入部前端的照明窗302用于照明；CCD/COMS等摄像元件通过摄像窗口306接收光信号后将光信号转变成电信号经由第二信号线209传输至电子内窥镜成像装置中，在经过图像处理装置显现出来。The single-modeoptical fiber 208 in the insertion part directly transmits light to theillumination window 302 at the front end of the insertion part to which the endoscope belongs for illumination; imaging elements such as CCD/COMS receive the optical signal through theimaging window 306 and convert the optical signal into an electrical signal via the The twosignal lines 209 are transmitted to the electronic endoscope imaging device, and then appear through the image processing device.

插入部中负压吸引管210与内窥镜内部所述插入部前端的负压吸引装置窗303连接，用于吸去肠胃里多余的粘液、消化物和组织液体。The negativepressure suction tube 210 in the insertion part is connected to the negative pressuresuction device window 303 at the front end of the insertion part inside the endoscope, and is used for suctioning excess mucus, digestive matter and tissue fluid in the stomach.

插入部中供气供水管211与内窥镜内部所述插入部前端的供水、供气窗304连接，在临床遇到模糊视野的情况时，送水用于冲洗物镜镜面以及手术野使得视野保持清晰；送气用于人体体腔扩张；二者用来清除干净整个内窥镜视野的异物。The air supply and water supply pipe 211 in the insertion part is connected to the water supply andair supply window 304 at the front end of the insertion part inside the endoscope. When the blurred field of vision is encountered clinically, the water supply is used to flush the objective lens surface and the operating field to keep the field of vision clear ; Air supply is used to expand the body cavity of the human body; the two are used to remove foreign bodies from the entire endoscope field of view.

插入部中处置器具通道212用于放置活检钳和其他治疗器械。Atreatment instrument channel 212 in the insert is used for placement of biopsy forceps and other therapeutic instruments.

2)操作部111是连结于插入部110的基端侧，用于接受来自医生等的各种操作的部分。该操作部111包括用于对弯曲部进行弯曲操作的弯曲旋钮和用于进行各种操作的多个操作构件。如，供水、供气、照明和负压吸引等等。操作部111设有处置器具插入口112，该处置器具插入口112和处置器具通道212连通，供处置器具贯穿路径连接至处置器具窗口305，可以帮助医生更精确的判断病情。2) Theoperation part 111 is a part which is connected to the proximal end side of theinsertion part 110 and receives various operations from a doctor or the like. Theoperation portion 111 includes a bending knob for performing a bending operation on the bending portion and a plurality of operation members for performing various operations. For example, water supply, gas supply, lighting and negative pressure suction, etc. Theoperation part 111 is provided with a treatmentinstrument insertion port 112, which communicates with thetreatment instrument channel 212 for the treatment instrument to be connected to thetreatment instrument window 305 through the path, which can help the doctor to judge the condition more accurately.

图2示出了一种多模态内窥镜的插入部前端部的探头301的正视图，该探头301包括照明窗302，其用于保持位于前方视野的照明；负压吸引装置窗303，其用于吸出多余的液体管的端部；供水、供气窗304，其用于保持送水管的端部，并用于保持送气管的端部；处置器具通道窗305，其用于保持处置器具通道212的端部，该窗口与处置器具插入口112连通；摄像装置观察窗306，其用于电子内窥镜装置的数据传输。FIG. 2 shows a front view of theprobe 301 at the front end of the insertion part of a multimodal endoscope, theprobe 301 includes anillumination window 302 for maintaining illumination in the front view; a negative pressuresuction device window 303, It is used to suck out the end of the excess liquid pipe; the water supply andair supply window 304 is used to hold the end of the water supply pipe and the end of the air supply pipe; the disposaltool channel window 305 is used to hold the disposal implement At the end of thechannel 212, the window communicates with theinsertion port 112 of the treatment instrument; the cameradevice observation window 306 is used for data transmission of the electronic endoscope device.

本发明还涉及一种多模态内窥成像系统，该系统结合超声成像，光学相干层析成像，荧光成像和电子内窥镜成像，具有拍摄光学系统和拍摄元件，被向被检体的消化道(食道、胃、十二指肠、大肠)或者呼吸道(气管、支气管)插入，能够进行消化道、呼吸道的拍摄。The invention also relates to a multimodal endoscopy imaging system, which combines ultrasound imaging, optical coherence tomography, fluorescence imaging and electronic endoscopy imaging, has a photographing optical system and a photographing element, and is digested to the subject. The esophagus (esophagus, stomach, duodenum, large intestine) or respiratory tract (trachea, bronchi) is inserted, and imaging of the digestive tract and the respiratory tract can be performed.

具体地，该系统包括上述内容中的多模态内窥镜102，还包括图像处理装置(未在附图中示出)、超声成像装置(未在附图中示出)、超声波观测装置103、电子内窥镜装置104、OCT成像观测装置105(第一光学成像装置)、荧光成像装置106(第二光学成像装置)、计算机107、波分复用器108、供水罐109和通用线缆113。OCT成像观测装置105，超声成像装置103，荧光成像观测装置106和电子内窥镜系统装置104使用各自独立的通道，保证各自能够正常稳定工作而互不干扰，相比于传统内窥镜有效解决了目前普遍存在多次下镜存在的病变信号和图像配准问题，且大大降低了目前国内类似手术费用，节省手术时间，有助于在应用时较大程度减轻病患痛苦。Specifically, the system includes themultimodal endoscope 102 in the above content, and further includes an image processing device (not shown in the drawings), an ultrasonic imaging device (not shown in the drawings), and anultrasonic observation device 103 ,electronic endoscope device 104, OCT imaging observation device 105 (first optical imaging device), fluorescence imaging device 106 (second optical imaging device),computer 107,wavelength division multiplexer 108,water supply tank 109 anduniversal cable 113. The OCTimaging observation device 105 , theultrasonic imaging device 103 , the fluorescenceimaging observation device 106 and the electronicendoscope system device 104 use independent channels to ensure that they can work normally and stably without interfering with each other, which is an effective solution compared to traditional endoscopes. It solves the common problem of lesion signal and image registration under multiple microscopes, and greatly reduces the current domestic similar operation costs, saves operation time, and helps to reduce the pain of patients to a large extent during application.

超声波观测装置103、电子内窥镜装置104、OCT成像观测装置105、荧光成像观测装置106分别与计算机107连接。将多模态内窥镜102的操作部111连结于插入部110的基端侧，用于接受来自医生等的各种操作的部分。通用线缆113是从多模态内窥镜102的操作部112延伸且配设有用于传输各种信号的多个信号线缆以及用于传输从光源装置供给来的照明光的光纤等的线缆。通用线缆113的一端连接操作部112，另一端与连接器114连接。连接器114用于将通用线缆113分别连接超声波观测装置103、电子内窥镜装置104、波分复用器108和供水罐109。多模态内窥镜102内设有超声换能器204，超声换能器204将从超声波观测装置103发送来的电脉冲信号转换为超声波脉冲(声脉冲)并向被检体照射，并将由被检体反射来的超声波回波转换为通过电压变化来表示的电回波信号并输出。超声成像则通过声发生器和接收器产生和检测超声信号。Theultrasonic observation apparatus 103 , theelectronic endoscope apparatus 104 , the OCTimaging observation apparatus 105 , and the fluorescenceimaging observation apparatus 106 are connected to thecomputer 107 , respectively. Theoperation part 111 of themultimodal endoscope 102 is connected to the proximal end side of theinsertion part 110 and is a part for receiving various operations from a doctor or the like. Theuniversal cable 113 is a wire extending from theoperation part 112 of themultimodal endoscope 102 and provided with a plurality of signal cables for transmitting various signals, an optical fiber for transmitting the illumination light supplied from the light source device, and the like cable. One end of theuniversal cable 113 is connected to theoperation part 112 , and the other end is connected to theconnector 114 . Theconnector 114 is used to connect theuniversal cable 113 to theultrasonic observation device 103 , theelectronic endoscope device 104 , thewavelength division multiplexer 108 and thewater supply tank 109 , respectively. Themultimodal endoscope 102 is provided with anultrasonic transducer 204, and theultrasonic transducer 204 converts the electrical pulse signal sent from theultrasonic observation device 103 into ultrasonic pulses (sound pulses) and irradiates the subject, and will Ultrasonic echoes reflected by the subject are converted into electrical echo signals represented by voltage changes and output. Ultrasound imaging generates and detects ultrasound signals through sound generators and receivers.

图像处理装置用于根据用户的操作输出控制信号，并根据接收到的反馈信号生成组织器官的多模态影像。图像处理装置分别与OCT成像观测装置105、荧光成像装置106、超声成像装置信号连接。The image processing device is used for outputting control signals according to the user's operation, and generating multimodal images of tissues and organs according to the received feedback signals. The image processing device is respectively connected to the OCTimaging observation device 105 , thefluorescence imaging device 106 , and the ultrasonic imaging device in signal connection.

多模态内窥镜102也分别与两个光学成像装置、超声成像装置信号连接，多模态内窥镜102根据两个光学成像装置的光信号反馈光反馈信号，并根据超声成像装置的超声控制信号反馈超声反馈信号，最终图像处理装置根据光反馈信号和超声反馈信号得到胰胆管上样本组织的医学影像，以便用户能够根据该影像和相应的医学知识对组织器官的状态进行判断。Themultimodal endoscope 102 is also signally connected to the two optical imaging devices and the ultrasonic imaging device, respectively. Themultimodal endoscope 102 feeds back the optical feedback signal according to the optical signals of the two optical imaging devices, and according to the ultrasonic imaging device of the ultrasonic imaging device, the optical feedback signal is fed back. The control signal feeds back the ultrasonic feedback signal, and finally the image processing device obtains the medical image of the sample tissue on the pancreaticobiliary duct according to the optical feedback signal and the ultrasonic feedback signal, so that the user can judge the state of the tissue and organ according to the image and corresponding medical knowledge.

超声成像装置与多模态内窥镜102中的超声换能器采用信号线连接，用于根据控制信号输出超声控制信号，以使超声换能器向待测样品组织发射超声波、并将返回的反馈超声波转换为超声反馈信号。The ultrasonic imaging device is connected to the ultrasonic transducer in themultimodal endoscope 102 by a signal line, and is used to output an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to the sample tissue to be tested and returns the ultrasonic waves. The feedback ultrasound is converted into an ultrasound feedback signal.

OCT成像观测装置105与半球状聚焦球透镜205用光纤连接，用于根据控制信号输出光信号，光信号通过半球形聚焦球透镜205到达待测样品组织，并接收采集的待测样品组织反馈的光信号。The OCTimaging observation device 105 is connected with the hemispherical focusingball lens 205 by an optical fiber, and is used for outputting an optical signal according to the control signal. The optical signal reaches the sample tissue to be tested through the hemispherical focusingball lens 205, and receives the collected feedback from the sample tissue to be tested. light signal.

波分复用器108连接OCT成像观测装置105、荧光成像观测装置106，两个观测装置分别与图像处理装置信号连接。波分复用器108的一端通过光纤与OCT成像观测装置105信号连接，并通过另一根光纤与荧光成像观测装置106信号连接，波分复用器108的另一端则通过光纤与半球状聚焦球透镜205连接。利用波分复用器108可将OCT成像观测装置105、荧光成像观测装置106相结合，用于作为荧光成像系统。采用双包层光纤(DispersionCompensating Fiber，DCF)耦合器收集发射的光，以保证系统的紧凑和稳定。半导体激光用于荧光成像的激发光源，和DCF耦合器被纳入到激励光和发射光传输收集。在传输过程中，复合光束通过单点模式芯从输入端口到输出端口，单模芯的小直径保证对表面组织产生高的光能量密度，从而实现高效率的激励。发射回来的荧光经DCF输出到大直径的多模光纤可提高收集发射光的能力并经过相应滤波在PMT中获得荧光信息。Thewavelength division multiplexer 108 is connected to the OCTimaging observation apparatus 105 and the fluorescenceimaging observation apparatus 106 , and the two observation apparatuses are respectively connected to the image processing apparatus by signals. One end of thewavelength division multiplexer 108 is signally connected to the OCTimaging observation device 105 through an optical fiber, and is signally connected to the fluorescenceimaging observation device 106 through another optical fiber, and the other end of thewavelength division multiplexer 108 is connected to the hemispherical focusing device through an optical fiber. Theball lens 205 is connected. Using thewavelength division multiplexer 108, the OCTimaging observation device 105 and the fluorescenceimaging observation device 106 can be combined to serve as a fluorescence imaging system. A double-clad fiber (Dispersion Compensating Fiber, DCF) coupler is used to collect the emitted light to ensure the compactness and stability of the system. A semiconductor laser is used as the excitation light source for fluorescence imaging, and a DCF coupler is incorporated into the collection of excitation light and emission light transmission. During the transmission process, the composite beam passes from the input port to the output port through the single-point mode core. The small diameter of the single-mode core ensures high optical energy density to the surface tissue, thereby achieving high-efficiency excitation. The output of the emitted fluorescence to a large-diameter multimode fiber through DCF can improve the ability to collect the emitted light and obtain fluorescence information in the PMT after corresponding filtering.

作为优选方案，在此多模态内窥成像系统中，OCT成像观测装置105采用高速VECSEL光源，可实现长距离成像，光源发出的光通过多模光纤传输至半球形的球透镜在90°折射到样品上。采用半导体可调激光的680-750nm波段作为激发光源，实现对荧光分子成像。对双模态光路部分的集成则根据OCT成像观测装置105和荧光成像观测装置106不同波长的情况选取波分复用器108将光学相干成像样品臂光源和荧光激励光源整合到同一单模宽带光纤光路，这种全光纤光路设计保证了双模态光路系统紧凑和稳定。As a preferred solution, in this multimodal endoscopic imaging system, the OCTimaging observation device 105 adopts a high-speed VECSEL light source, which can realize long-distance imaging, and the light emitted by the light source is transmitted through the multimode fiber to the hemispherical ball lens and refracted at 90° onto the sample. The 680-750nm band of the semiconductor tunable laser is used as the excitation light source to realize the imaging of fluorescent molecules. For the integration of the dual-mode optical path, thewavelength division multiplexer 108 is selected according to the different wavelengths of the OCTimaging observation device 105 and the fluorescenceimaging observation device 106 to integrate the optical coherent imaging sample arm light source and the fluorescence excitation light source into the same single-mode broadband fiber. Optical path, this all-fiber optical path design ensures that the dual-mode optical path system is compact and stable.

本发明的多模态内窥成像系统设有成像原理不同的光学相干成像装置和荧光成像装置，其中光学相干成像技术相比于其他技术具有非侵入、高分辨率、可在体检测生物组织内部微结构，与内窥技术结合之后的OCT内窥成像技术可直接对生物组织进行成像，能够完成对组织的高精度扫描，进而可对早期癌变和动脉粥样硬化进行早期诊断。The multimodal endoscopic imaging system of the present invention is provided with an optical coherent imaging device and a fluorescence imaging device with different imaging principles, wherein the optical coherent imaging technology is non-invasive, high-resolution, and can detect the interior of biological tissue in vivo compared with other technologies. Microstructure, combined with endoscopic technology, the OCT endoscopic imaging technology can directly image biological tissues, and can complete high-precision scanning of tissues, thereby enabling early diagnosis of early cancer and atherosclerosis.

本发明结合荧光成像技术和OCT成像技术可实现分析组织的结构和成分，可为胰胆管早期病变等提供精准的影像手段，相比单一模态的成像技术的单一性，不稳定性和成像分辨率差的特点，多模态的成像技术更适合对于体内早期疾病的诊断，综合在体、断层成像、高分辨率和成像深度几个方面的临床特点。The invention combines the fluorescence imaging technology and the OCT imaging technology to realize the analysis of the structure and composition of the tissue, and can provide an accurate imaging method for the early lesions of the pancreatic and bile ducts. Due to the characteristics of poor rate, multimodal imaging technology is more suitable for the diagnosis of early disease in vivo, combining the clinical characteristics of in vivo, tomographic imaging, high resolution and imaging depth.

以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的工作人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited to this. Any person familiar with the technical field can easily think of various equivalents within the technical scope disclosed by the present invention. Modifications or substitutions should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims (10)

Translated fromChinese

1.一种多模态内窥镜，其特征在于，包括：1. a multimodal endoscope, is characterized in that, comprises:插入部，用于将光信号转换为电信号，并在接受到电信号后经由信号线将信号传输至连接部，传输回的电信号进入电子内窥镜系统装置中，并经过图像处理后进显现；所述的插入部包括依次设置的前端部、弯曲部和挠性管部，所述的前端部包括侧向列排布的用于与超声内窥成像装置通过信号线连接的超声波换能器，探头，用于与OCT成像观测装置通过光纤连接的光学聚焦模块，用于接收光学信号的摄像元件以及用于放置活检钳和其他治疗器械的处置器具通道；The insertion part is used to convert the optical signal into an electric signal, and after receiving the electric signal, transmit the signal to the connection part through the signal line, and the transmitted electric signal enters the electronic endoscope system device, and is displayed after image processing. The insertion part comprises a front end part, a bending part and a flexible tube part arranged in sequence, and the front end part comprises an ultrasonic transducer arranged in a lateral row for connecting with an ultrasonic endoscopic imaging device through a signal line , a probe, an optical focusing module for connecting with the OCT imaging observation device through an optical fiber, a camera element for receiving optical signals, and a treatment instrument channel for placing biopsy forceps and other therapeutic instruments;操作部，用于对插入部的前端部进行供气、供水、负压吸引操作，对插入部的弯曲部进行弯曲操作，并控制处置器具通过处置器具通道输送至体腔；The operation part is used to perform air supply, water supply and negative pressure suction operations on the front end of the insertion part, perform bending operation on the bending part of the insertion part, and control the delivery of the treatment instrument to the body cavity through the treatment instrument channel;连接部，用于将插入部与电子内窥镜系统装置连接。The connecting portion is used to connect the insertion portion with the electronic endoscope system device.2.根据权利要求1所述的一种多模态内窥镜，其特征在于，所述的前端部为顶端硬质结构，多个超声换能器侧向列排布在硬质结构的前端部外表面。2 . The multimodal endoscope according to claim 1 , wherein the front end portion is a hard structure at the top, and a plurality of ultrasonic transducers are arranged laterally at the front end of the hard structure. 3 . external surface.3.根据权利要求1所述的一种多模态内窥镜，其特征在于，所述的光学聚焦模块为半球状聚焦球透镜，所述的半球状聚焦球透镜的水平底面上设有镀金反射膜，该水平底面与光纤的轴向呈45°角，所述的半球状聚焦球透镜除水平底面外的其他部分与多模光纤融合。3 . The multimodal endoscope according to claim 1 , wherein the optical focusing module is a hemispherical focusing ball lens, and the horizontal bottom surface of the hemispherical focusing ball lens is provided with gold plating. 4 . In the reflective film, the horizontal bottom surface is at an angle of 45° with the axial direction of the optical fiber, and the other parts of the hemispherical focusing ball lens except the horizontal bottom surface are fused with the multimode fiber.4.根据权利要求1所述的一种多模态内窥镜，其特征在于，所述的插入部还包括照明窗以及用以将光传输到照明窗进行照明的单模光纤。4 . The multimodal endoscope according to claim 1 , wherein the insertion portion further comprises an illumination window and a single-mode optical fiber for transmitting light to the illumination window for illumination. 5 .5.根据权利要求1所述的一种多模态内窥镜，其特征在于，所述的摄像元件通过将接收到的光信号转变成电信号，并经由信号线传输至电子内窥镜成像装置中后，通过图像处理装置进行显现。5 . The multimodal endoscope according to claim 1 , wherein the imaging element converts the received optical signal into an electrical signal and transmits it to the electronic endoscope for imaging through a signal line. 6 . After being installed in the device, it is visualized by an image processing device.6.根据权利要求1所述的一种多模态内窥镜，其特征在于，所述的操作部设于插入部的基端侧，所述的操作部包括用于对弯曲部进行弯曲操作的弯曲旋钮，用于向插入部的前端部进行供气、供水的供气供水管，用于通过内窥镜内部吸去插入部的前端部多余的液体的负压吸引管，以及用于与操作部的处置器具通道连接的处置器具插入口。6 . The multimodal endoscope according to claim 1 , wherein the operation part is provided on the proximal end side of the insertion part, and the operation part includes a bending operation for the bending part. 7 . The bending knob, the air supply and water supply pipe for supplying air and water to the front end of the insertion part, the negative pressure suction pipe for sucking excess liquid from the front end of the insertion part through the inside of the endoscope, and the A treatment instrument insertion port to which the treatment instrument channel of the operation part is connected.7.根据权利要求4所述的一种多模态内窥镜，其特征在于，所述的探头包括用于保持位于前方视野照明的所述的照明窗，用于吸出多余的液体管的端部负压吸引装置窗，用于保持送水管的端部，并用于保持送气管的端部供水、供气窗，用于保持处置器具通道的端部的与处置器具插入口连通的处置器具通道窗，以及用于电子内窥镜装置的数据传输的摄像装置观察窗。7. A multimodal endoscope according to claim 4, wherein the probe comprises the illumination window for maintaining the illumination in the front view, and for sucking out the end of the excess liquid tube A negative pressure suction device window for holding the end of the water supply pipe, and for holding the water supply and air supply window at the end of the air supply pipe, for holding the treatment instrument channel at the end of the treatment instrument channel that communicates with the treatment instrument insertion port window, and a viewing window of a camera device for data transmission of an electronic endoscopic device.8.一种包括如权利要求1～7任一项所述的多模态内窥镜的多模态内窥成像系统，其特征在于，该系统还包括：8. A multimodal endoscopy imaging system comprising the multimodal endoscope according to any one of claims 1 to 7, wherein the system further comprises:图像处理装置，分别与OCT成像观测装置、荧光成像装置、超声成像装置信号连接，用于根据用户的操作输出控制信号，并根据接收到的反馈信号生成组织器官的多模态影像；The image processing device is respectively connected to the OCT imaging observation device, the fluorescence imaging device, and the ultrasonic imaging device by signal, and is used for outputting a control signal according to the user's operation, and generating a multimodal image of the tissue and organ according to the received feedback signal;超声成像装置，与多模态内窥镜的超声换能器通过信号线连接，用于根据所述控制信号输出超声控制信号，使所述超声换能器向待测样品组织发射超声波、并将返回的反馈超声波转换为超声反馈信号；The ultrasonic imaging device is connected with the ultrasonic transducer of the multimodal endoscope through a signal line, and is used for outputting an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to the sample tissue to be tested, and transmits ultrasonic waves to the tissue to be tested. The returned feedback ultrasound is converted into an ultrasound feedback signal;OCT成像观测装置，与半球形聚焦球透镜通过光纤连接，用于根据控制信号输出光信号，所述的光信号通过半球形聚焦球透镜到达待测样品组织，并接收采集的待测样品组织反馈的光信号；The OCT imaging observation device is connected with the hemispherical focusing ball lens through an optical fiber, and is used for outputting an optical signal according to the control signal. The optical signal reaches the sample tissue to be tested through the hemispherical focusing ball lens, and receives the feedback of the collected sample tissue to be tested. the light signal;荧光成像观测装置，利用波分复用器与OCT成像观测装置构成荧光成像系统，用于将光学相干成像样品臂光源和荧光激励光源整合到同一单模宽带光纤光路；The fluorescence imaging observation device uses a wavelength division multiplexer and an OCT imaging observation device to form a fluorescence imaging system, which is used to integrate the optical coherent imaging sample arm light source and the fluorescence excitation light source into the same single-mode broadband optical fiber optical path;电子内窥镜系统装置，用于与多模态内窥镜的插入部连接，用于对插入部传输回的电信号进行图像处理并显现。The electronic endoscope system device is used for connecting with the insertion part of the multimodal endoscope, and is used for image processing and visualization of the electrical signals transmitted back by the insertion part.9.根据权利要求8所述的一种多模态内窥成像系统，其特征在于，该系统采用双包层光纤耦合器收集发射的光，并采用半导体激光作为荧光成像的激发光源。9 . The multimodal endoscopic imaging system according to claim 8 , wherein the system uses a double-clad fiber coupler to collect the emitted light, and uses a semiconductor laser as the excitation light source for fluorescence imaging. 10 .10.根据权利要求8所述的一种多模态内窥成像系统，其特征在于，所述的OCT成像观测装置采用高速VECSEL光源，所述的荧光成像系统采用半导体可调激光的680-750nm波段作为激发光源。10 . The multimodal endoscopic imaging system according to claim 8 , wherein the OCT imaging observation device adopts a high-speed VECSEL light source, and the fluorescence imaging system adopts a 680-750 nm semiconductor tunable laser. 11 . band as the excitation light source.

Images