Movatterモバイル変換


[0]ホーム

URL:


CN109091099A - The high definition miniature electronic endoscopic system of binocular vision - Google Patents

The high definition miniature electronic endoscopic system of binocular vision
Download PDF

Info

Publication number
CN109091099A
CN109091099ACN201810446245.5ACN201810446245ACN109091099ACN 109091099 ACN109091099 ACN 109091099ACN 201810446245 ACN201810446245 ACN 201810446245ACN 109091099 ACN109091099 ACN 109091099A
Authority
CN
China
Prior art keywords
image
binocular vision
image acquisition
processing module
points
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810446245.5A
Other languages
Chinese (zh)
Inventor
王帝
刘华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiao Tong University
Original Assignee
Shanghai Jiao Tong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Jiao Tong UniversityfiledCriticalShanghai Jiao Tong University
Priority to CN201810446245.5ApriorityCriticalpatent/CN109091099A/en
Publication of CN109091099ApublicationCriticalpatent/CN109091099A/en
Pendinglegal-statusCriticalCurrent

Links

Classifications

Landscapes

Abstract

Translated fromChinese

一种双目视觉的高清微型电子内窥镜系统,包括:两组相同结构的图像采集单元、与图像采集单元依次相连的数字信号处理模块、双目视觉构建模块,其中:图像采集单元包括依次连接的光纤、镜头、微型高清图像传感器和图像采集模块,光纤将光源引导至镜头前端,为镜头提供照明,图像采集模块的信号输出端通过LVDS导线与LVDS接口相连并输出数字图像信号至数字信号处理模块,数字信号处理模块对数字图像信号进行几何尺寸测量并输出几何信息至双目视觉构建模块,经双目视觉构建模块匹配点修复后实现双目视觉,本发明通过DSP处理器将获取的双目图像进行融合,实现拍摄图像的尺寸、大小、深度等信息,为医生手术操作提供准确定量和高清晰度的医用内窥镜图像。

A high-definition miniature electronic endoscope system with binocular vision, comprising: two sets of image acquisition units with the same structure, a digital signal processing module sequentially connected to the image acquisition units, and a binocular vision building module, wherein: the image acquisition unit includes sequentially Connected optical fiber, lens, miniature high-definition image sensor and image acquisition module. The optical fiber guides the light source to the front of the lens to provide illumination for the lens. The signal output end of the image acquisition module is connected to the LVDS interface through the LVDS wire and outputs the digital image signal to the digital signal The processing module, the digital signal processing module measures the geometric size of the digital image signal and outputs the geometric information to the binocular vision building module, and realizes the binocular vision after the matching points of the binocular vision building module are repaired. The present invention uses the DSP processor to obtain the The binocular images are fused to realize the size, size, depth and other information of the captured images, and provide accurate quantitative and high-definition medical endoscopic images for doctors' surgical operations.

Description

The high definition miniature electronic endoscopic system of binocular vision
Technical field
The present invention relates to a kind of technology of medical field, peeped in the high definition miniature electronic of specifically a kind of binocular visionMirror system.
Background technique
Only one imaging sensor of cannula type endoscopic system, can only obtain flat image, can only in flat imageThe relative positional relationship between image is obtained, the accurate size information of image can not be obtained, and in clinical application, it is peeped by interiorSem observation to image quantitatively to obtain its accurate size information extremely important, such as determine wound size size, lesion area, it is existingSome cannula type endoscopes are unable to complete above-mentioned requirements.
Summary of the invention
The present invention is proposed for the defects of prior art size is big, power consumption is high, structure is complicated and image quality is affectedA kind of high definition miniature electronic endoscopic system of binocular vision, can obtain high-definition image in real time, will acquire by dsp processorBinocular image merged, realize the three-dimensional reconstruction of shooting image, obtain the information such as size, size, depth of shooting image,Accurate quantitative analysis and medical endoscope image high-definition are provided for surgical operation, improves the standard of surgical operation diagnosisTrue rate.
The present invention is achieved by the following technical solutions:
The present invention includes: two groups of mutually isostructural image acquisition units, the number letter being sequentially connected with image acquisition unitsNumber processing module and binocular vision construct module, in which: image acquisition units include sequentially connected optical fiber, camera lens, miniature heightClear imaging sensor and image capture module, optical fiber provide illumination, Image Acquisition mould by light source-guide to camera lens front end, for camera lensThe signal output end of block by LVDS conducting wire be connected with LVDS interface simultaneously output digital image signal to digital signal processing module,Digital signal processing module carries out geometric dimension measurement to data image signal and exports geological information to binocular vision building mouldBlock realizes binocular vision after binocular vision building module carries out match point reparation.
The image acquisition units are set to inside cylinder housing, in which: two optical fiber and two camera lenses are distributed inOn the cross section of cylinder housing.
The geometric dimension measurement refers to: digital signal processing module carries out data image signal according to calibrating parametersAfter distortion correction and polar curve are handed over just, for the certain point in binocular image in the image of side, its local feature information structuring is utilizedLocal feature description's, it is special by same structure method construct part for all the points gone together in the figure of the other side with the figure pointSign description, calculates the Euclidean distance between the Feature Descriptor of two sides picture point, selected distance minimum value is other side figureIn match point, obtain three-dimensional coordinate of the left and right match points in world coordinate system using triangle geometric method, and by multipleIt is mutually matched a little to carry out length, width, depth, area and cubing and obtain geological information.
The match point reparation refers to: causing match point for mistake when the part in the figure of side is blocked in the figure of the other sideWhen match point, Mismatching point is rejected by consistency check, and for the point of non-successful match, using with its most neighborThe parallax value successfully put is carried out the calculating of three-dimensional coordinate using principle of triangulation, obtains three of all the points on the image of two sidesDimension coordinate is to realize binocular vision.
Technical effect
Compared with prior art, the present invention can obtain the three of the geometry information for shooting image and shooting image in real timeImage is tieed up, provides the geometry information of lesion accurate quantitative analysis, compared with prior art, this hair for the diagnosis decision of clinicianIt is bright that the flat image information of shooting image can not only be provided for clinician, additionally it is possible to which that the geometric dimension letter of accurate quantitative analysis is providedBreath and three-dimensional image information provide more acurrate and quantitative information to the correct diagnosis of clinician and decision.
Detailed description of the invention
Fig. 1 is structure chart of the invention;
The top view of the end face of the present invention Fig. 2;
Fig. 3 is left images captured by the present invention;
Fig. 4 is the image of three-dimensional reconstruction of the present invention;
Wherein: camera lens 1, Miniature high-definition imaging sensor 2, image capture module 3, power supply line 4, LVDS conducting wire 5, cylindrical bodyShell 6, LVDS interface 7, digital signal processing module 8, USB3.0 interface 9, computer 10, image processing module 11, optical fiber 12.
Specific embodiment
As shown in Figure 1, the present embodiment include: two groups of mutually isostructural image acquisition units, with image acquisition units successivelyConnected digital signal processing module 8, the computer 10 with image processing module 11, in which: image acquisition units include according toOptical fiber 12, camera lens 1, Miniature high-definition imaging sensor 2 and the image capture module 3 of secondary connection, optical fiber 12 is by light source-guide to mirrorFirst 1 front end provides illumination for camera lens 1, and the signal output end of image capture module 3 is connected by LVDS conducting wire 5 with LVDS interface 7And output digital image signal is to digital signal processing module 8.
The digital signal processing module 8 is connected by USB3.0 interface 9 with computer 10.
The image acquisition units are set to inside cylinder housing 6, in which: two optical fiber 12 and two camera lenses 1 are equalIt is distributed on the cross section of cylinder housing 6.
The mutually isostructural image acquisition units parameter of described two groups is identical, by identical camera lens, LVDS conducting wire andLVDS interface is sent to dsp processor, and two sets of high-definition images are sent to computer, computer by USB3.0 by dsp processorTwo sets of images are carried out three-dimensional reconstruction by upper image processing module 11, obtain the 3D rendering of shooting object.
As shown in figure 3, the image acquisition units carry out geometric dimension measurement to shooting image by following steps:
The first step uses 13 rows, 8 column, gridiron pattern of the cell having a size of 1.5mm square as calibration chessboard, inside peepsMirror with different view takes pictures 25 to chessboard with distance, carries out parameter to two Miniature high-definition cameras using Zhang Zhengyou calibration methodCalibration;
Second step, the parameter obtained using calibration carries out distortion correction to image and polar curve is handed over just;
Third step, for the certain point in left image, using its local feature information structuring local feature description, forThe all the points gone together in right figure with left figure point pass through same structure method construct local feature description;
4th step, computer calculate third step in left images point Feature Descriptor between Euclidean distance, choose away fromFrom the match point that minimum value is in right figure;
5th step is obtained three-dimensional coordinate of the left and right match points in world coordinate system using triangle geometric method, and passed throughIt is multiple to be mutually matched a little to carry out length, width, depth, area and cubing.
As shown in figure 4, the image processing module 11 carries out match point reparation to shooting image by following steps:
The first step, according to from left to right, sequence from top to bottom successively traverses the every bit in left image, and in right figureThe point to match is searched in corresponding row, the three-dimensional coordinate of the point is obtained according to the parallax of match point;
Due to visual angle, the part in left figure may will appear the case where blocking in right figure, the matching obtained at this timePoint is Mismatching point, is in the case rejected Mismatching point using left and right consistency check;
Second step, the point for non-successful match utilize triangle using the parallax value successfully put with its most neighborMeasuring principle carries out the calculating of three-dimensional coordinate, finally obtains the three-dimensional coordinate of all the points on image and is achieved binocular vision.
By above method, the present invention can obtain the geometry information of shooting image in real time and shoot the three-dimensional of imageImage provides the geometry information of lesion accurate quantitative analysis for the diagnosis decision of clinician, compared with prior art, the present inventionThe flat image information of shooting image can not only be provided for clinician, additionally it is possible to provide the geometry information of accurate quantitative analysisAnd three-dimensional image information, accurate and quantitative information is provided to the correct diagnosis of clinician and decision.
Above-mentioned specific implementation can by those skilled in the art under the premise of without departing substantially from the principle of the invention and objective with differenceMode carry out local directed complete set to it, protection scope of the present invention is subject to claims and not by above-mentioned specific implementation instituteLimit, each implementation within its scope is by the constraint of the present invention.

Claims (5)

Translated fromChinese
1.一种双目视觉的高清微型电子内窥镜系统,其特征在于,包括:两组相同结构的图像采集单元、与图像采集单元依次相连的数字信号处理模块、双目视觉构建模块,其中:图像采集单元包括依次连接的光纤、镜头、微型高清图像传感器和图像采集模块,光纤将光源引导至镜头前端,为镜头提供照明,图像采集模块的信号输出端通过LVDS导线与LVDS接口相连并输出数字图像信号至数字信号处理模块,数字信号处理模块对数字图像信号进行几何尺寸测量并输出几何信息至双目视觉构建模块,经双目视觉构建模块匹配点修复后实现双目视觉。1. a high-definition miniature electronic endoscope system of binocular vision, is characterized in that, comprises: the image acquisition unit of two groups of identical structures, the digital signal processing module that links to each other successively with image acquisition unit, binocular vision building block, wherein : The image acquisition unit includes optical fiber, lens, miniature high-definition image sensor and image acquisition module connected in sequence. The optical fiber guides the light source to the front of the lens to provide illumination for the lens. The signal output end of the image acquisition module is connected to the LVDS interface through the LVDS wire and output The digital image signal is sent to the digital signal processing module. The digital signal processing module measures the geometric size of the digital image signal and outputs the geometric information to the binocular vision building block. The binocular vision is realized after the matching points of the binocular vision building block are repaired.2.根据权利要求1所述的系统,其特征是,所述的图像采集单元设置于圆柱体壳体内部,其中:两个光纤和两个镜头均布于圆柱体壳体的横截面上。2. The system according to claim 1, wherein the image acquisition unit is arranged inside the cylindrical shell, wherein: two optical fibers and two lenses are evenly distributed on the cross section of the cylindrical shell.3.根据权利要求1所述的系统,其特征是,所述的几何尺寸测量是指:数字信号处理模块根据标定参数对数字图像信号进行畸变校正与极线交正后,对于双目图像中一侧图像中的某一点,利用其局部特征信息构造局部特征描述子,对于另一侧图中与该图点同行的所有点,通过相同构造方法构造局部特征描述子,计算两侧图像点的特征描述子之间的欧式距离,选取距离最小值即为另一侧图中的匹配点,利用三角几何法得出左右相匹配点在世界坐标系中的三维坐标,并通过多个相互匹配点以进行长度、宽度、深度、面积及体积测量并得到几何信息。3. The system according to claim 1, characterized in that, the measurement of the geometric dimension refers to: after the digital signal processing module performs distortion correction and epipolar line orthogonal to the digital image signal according to the calibration parameters, for the binocular image For a certain point in one side of the image, use its local feature information to construct a local feature descriptor, and for all points in the other side of the image that travel with the point in the image, use the same construction method to construct a local feature descriptor, and calculate the image points on both sides. For the Euclidean distance between feature descriptors, the minimum value of the distance is selected as the matching point in the other side of the picture, and the three-dimensional coordinates of the left and right matching points in the world coordinate system are obtained by using the triangular geometry method, and through multiple mutual matching points To measure length, width, depth, area and volume and obtain geometric information.4.根据权利要求3所述的系统,其特征是,所述的标定参数是指:图像采集单元从不同视角与距离对标定棋盘拍照后,采用张正友标定法对两个微型高清摄像头进行参数标定所得到的标定参数。4. The system according to claim 3, wherein said calibration parameters refer to: after the image acquisition unit takes pictures of the calibration chessboard from different angles of view and distances, the parameters of the two miniature high-definition cameras are calibrated using the Zhang Zhengyou calibration method The resulting calibration parameters.5.根据权利要求3所述的系统,其特征是,所述的匹配点修复是指:当一侧图中的部分在另一侧图中被遮挡导致匹配点为误匹配点时,通过一致性检查将误匹配点剔除,并对于未匹配成功的点,使用与其最相邻匹配成功的点的视差值,利用三角测量原理进行三维坐标的计算,得到两侧图像上所有点的三维坐标从而实现双目视觉。5. The system according to claim 3, wherein said matching point restoration refers to: when a part in one side of the picture is blocked in another side of the picture, causing the matching point to be a mismatching point, through consistent The inconsistency check removes the mis-matched points, and for the unmatched points, use the disparity value of the nearest adjacent matching point, and use the triangulation principle to calculate the three-dimensional coordinates, and obtain the three-dimensional coordinates of all points on the images on both sides This enables binocular vision.
CN201810446245.5A2018-05-112018-05-11The high definition miniature electronic endoscopic system of binocular visionPendingCN109091099A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201810446245.5ACN109091099A (en)2018-05-112018-05-11The high definition miniature electronic endoscopic system of binocular vision

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201810446245.5ACN109091099A (en)2018-05-112018-05-11The high definition miniature electronic endoscopic system of binocular vision

Publications (1)

Publication NumberPublication Date
CN109091099Atrue CN109091099A (en)2018-12-28

Family

ID=64796445

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201810446245.5APendingCN109091099A (en)2018-05-112018-05-11The high definition miniature electronic endoscopic system of binocular vision

Country Status (1)

CountryLink
CN (1)CN109091099A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110992431A (en)*2019-12-162020-04-10电子科技大学 A combined three-dimensional reconstruction method of binocular endoscopic soft tissue images
CN111080778A (en)*2019-12-232020-04-28电子科技大学Online three-dimensional reconstruction method of binocular endoscope soft tissue image
CN113349926A (en)*2021-05-312021-09-07甘肃省人民医院Wound digital model construction system
CN117179676A (en)*2023-11-082023-12-08北京市春立正达医疗器械股份有限公司Disposable intelligent visual multi-functional miniature catheter

Citations (10)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN200970224Y (en)*2006-11-092007-11-07上海大学Three dimension positioning system for medical endoscope body
CN201171665Y (en)*2008-02-042008-12-31长春理工大学 Stereo electronic endoscope dual-channel video signal acquisition device
CN101518438A (en)*2009-03-272009-09-02南开大学Binocular endoscope operation visual system
CN103142202A (en)*2013-01-212013-06-12东北大学Prism-based medical endoscope system with measurement function and method
CN103231708A (en)*2013-04-122013-08-07安徽工业大学Intelligent vehicle obstacle avoiding method based on binocular vision
CN103654699A (en)*2013-12-102014-03-26西安电子科技大学Fluorescence excitation binocular endoscopic system
CN103776419A (en)*2014-01-242014-05-07华南理工大学Binocular-vision distance measurement method capable of widening measurement range
CN104822306A (en)*2012-12-282015-08-05奥林巴斯株式会社Three-dimensional endoscope
CN107302696A (en)*2017-08-102017-10-27郑州金润高科电子有限公司Binocular camera and the image measuring method based on it
CN107990878A (en)*2017-11-082018-05-04中国科学院西安光学精密机械研究所Distance measuring system and distance measuring method based on low-light-level binocular camera

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN200970224Y (en)*2006-11-092007-11-07上海大学Three dimension positioning system for medical endoscope body
CN201171665Y (en)*2008-02-042008-12-31长春理工大学 Stereo electronic endoscope dual-channel video signal acquisition device
CN101518438A (en)*2009-03-272009-09-02南开大学Binocular endoscope operation visual system
CN104822306A (en)*2012-12-282015-08-05奥林巴斯株式会社Three-dimensional endoscope
CN103142202A (en)*2013-01-212013-06-12东北大学Prism-based medical endoscope system with measurement function and method
CN103231708A (en)*2013-04-122013-08-07安徽工业大学Intelligent vehicle obstacle avoiding method based on binocular vision
CN103654699A (en)*2013-12-102014-03-26西安电子科技大学Fluorescence excitation binocular endoscopic system
CN103776419A (en)*2014-01-242014-05-07华南理工大学Binocular-vision distance measurement method capable of widening measurement range
CN107302696A (en)*2017-08-102017-10-27郑州金润高科电子有限公司Binocular camera and the image measuring method based on it
CN107990878A (en)*2017-11-082018-05-04中国科学院西安光学精密机械研究所Distance measuring system and distance measuring method based on low-light-level binocular camera

Cited By (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110992431A (en)*2019-12-162020-04-10电子科技大学 A combined three-dimensional reconstruction method of binocular endoscopic soft tissue images
CN111080778A (en)*2019-12-232020-04-28电子科技大学Online three-dimensional reconstruction method of binocular endoscope soft tissue image
CN111080778B (en)*2019-12-232023-03-31电子科技大学Online three-dimensional reconstruction method of binocular endoscope soft tissue image
CN113349926A (en)*2021-05-312021-09-07甘肃省人民医院Wound digital model construction system
CN117179676A (en)*2023-11-082023-12-08北京市春立正达医疗器械股份有限公司Disposable intelligent visual multi-functional miniature catheter
CN117179676B (en)*2023-11-082024-03-15北京市春立正达医疗器械股份有限公司Disposable intelligent visual multi-functional miniature catheter

Similar Documents

PublicationPublication DateTitle
JP4343341B2 (en) Endoscope device
CN105996961B (en)3D three-dimensional imagings capsule endoscope system and method based on structure light
CN106091984B (en) A method for acquiring 3D point cloud data based on line laser
CN109668509A (en)Based on biprism single camera three-dimensional measurement industrial endoscope system and measurement method
CN113240726B (en) A real-time measurement method of optical target size under endoscope
CN114998499A (en) A method and system for binocular 3D reconstruction based on line laser galvanometer scanning
CN109091099A (en)The high definition miniature electronic endoscopic system of binocular vision
CN106780725A (en)A kind of binocular three-dimensional reconstructing method and system
CN109242898B (en)Three-dimensional modeling method and system based on image sequence
KR20140067970A (en)Optical scanning device
CN109068035B (en)Intelligent micro-camera array endoscopic imaging system
CN108846866B (en)Optical imaging-based craniomaxillofacial soft tissue sagittal axial median plane determination method and system
CN113052898B (en) A real-time localization method of point cloud and strong reflective target based on active binocular camera
CN106767526A (en)A kind of colored multi-thread 3-d laser measurement method based on the projection of laser MEMS galvanometers
CN105342561B (en)The wearable molecular image navigation system of Wireless sound control
CN106408664A (en)Three-dimensional model curved surface reconstruction method based on three-dimensional scanning device
CN108175535A (en)A kind of dentistry spatial digitizer based on microlens array
CN115294128A (en)Monocular structure three-dimensional imaging method and device for digestive endoscopy
CN103142202B (en)Prism-based medical endoscope system with measurement function and method
JP6210483B2 (en) 3D shape acquisition device from stereoscopic endoscope image
CN106580329A (en)Height measurement system and method based on binocular stereovision technology
JP4750197B2 (en) Endoscope device
CN204377058U (en)Based on the three-dimensional display system of hard mirror
CN205094589U (en)Formula molecule image navigation is dressed in wireless acoustic control
Zhou et al.Light field endoscope calibration based on virtual objective lens and virtual feature points

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20181228


[8]ページ先頭

©2009-2025 Movatter.jp