Movatterモバイル変換


[0]ホーム

URL:


CN110211053A - Quick precise phase matching process for three-dimensional measurement - Google Patents

Quick precise phase matching process for three-dimensional measurement
Download PDF

Info

Publication number
CN110211053A
CN110211053ACN201910347159.3ACN201910347159ACN110211053ACN 110211053 ACN110211053 ACN 110211053ACN 201910347159 ACN201910347159 ACN 201910347159ACN 110211053 ACN110211053 ACN 110211053A
Authority
CN
China
Prior art keywords
parallax
point
dimensional
value
matching process
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910347159.3A
Other languages
Chinese (zh)
Other versions
CN110211053B (en
Inventor
张韶越
何志成
尚继辉
陈曾沁
裘泽锋
孟繁冲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spaceflight (shanghai) Science And Technology Co Ltd
Original Assignee
Spaceflight (shanghai) Science And Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spaceflight (shanghai) Science And Technology Co LtdfiledCriticalSpaceflight (shanghai) Science And Technology Co Ltd
Priority to CN201910347159.3ApriorityCriticalpatent/CN110211053B/en
Publication of CN110211053ApublicationCriticalpatent/CN110211053A/en
Application grantedgrantedCritical
Publication of CN110211053BpublicationCriticalpatent/CN110211053B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

The present invention provides a kind of quick precise phase matching process for three-dimensional measurement, comprising: obtains accurate target area;Using weighted interpolation method, three-dimensional correction is carried out to left and right phase, obtains the parallax of sub-pix;Flash removed and isolated point are removed using parallax filter;It is smoothed using surface of the Gaussian filter to three-dimensional reconstruction.Provided by the present invention for the quick precise phase matching process of three-dimensional measurement, reconstruction regions and point cloud can be quickly and accurately obtained, there is preferable precision to the measurement of complex target.

Description

Quick precise phase matching process for three-dimensional measurement
Technical field
The present invention relates to field of optical measuring technologies, in particular to are used for the quick precise phase match party of three-dimensional measurementMethod.
Background technique
Optical three-dimensional measurement technology is quickly grown in recent years.Stereo matching is the important link for guaranteeing measuring system precision.There are many methods of the Stereo matching based on feature, the Stereo matching based on region, Stereo matching based on phase.As DLP is thrownThe development of shadow machine, phase measuring profilometer (PMP) become one of most widely used technology, have measurement accuracy height, measurement speedSpend fast advantage.Traditional matching based on phase is used for global search or polarity equation.However, these methods are time-consuming and precisionIt is low.
Summary of the invention
The purpose of the present invention is to provide the quick precise phase matching process for three-dimensional measurement, to solve to be based on phaseMethod of the matching for global search or polarity equation be time-consuming and problem that precision is low.
In order to solve the above-mentioned technical problem, the technical scheme is that providing a kind of quick essence for three-dimensional measurementTrue phase matching method, comprising: obtain accurate target area;Using weighted interpolation method, three-dimensional school is carried out to left and right phaseJust, the parallax of sub-pix is obtained;Flash removed and isolated point are removed using parallax filter;Using Gaussian filter to three-dimensional reconstructionSurface is smoothed.
Further, accurate target area is obtained using four-stepped switching policy.
Further, after three-dimensional correction, two row images of left and right are parallel to pole outside line, one, the constituency point in the phase diagram of the left side(xL,yL), the point of corresponding the right phase diagram is (xR,yR), yREqual to yLIf the phase value on the left side isIt is correspondingThe right phase value meet equationIt obtains key point (i, j) and (i+1, j), it is horizontalCoordinate isThe key point is used around pointIn two factors of coordinates computed are as follows:
Ordinate is accordingly
Sub-pix parallax is
Para_x=xR-i′;Para_y=yR-j
Further, judge isolated point with one 5 × 5 template, selected from effective subject area point (i,J), pixel ((i-2, j-2), (i-1, j-2) ... (i+1, j+2), (i+2, j+2)) determines the characteristic of point (i, j), such as fruit dot((i+m, j+n)) is that effectively, aggregate-value increases by 1, then accumulates to effective parallaxes of these points, obtains being averaged for parallaxValue, if aggregate-value is greater than 10, and the difference between the parallax and average value of institute's reconnaissance then retains the point less than 2, and otherwise deleting shouldPoint;Parallax is eliminated using linear interpolation, spacing is extracted, parallax line is divided into different parts, when section length is less than 10,Using linear interpolation method, it is assumed that cross-sectional length n, the value of two endpoints are para (0) and para (n-1), the view at this intervalDifference is defined as:
By aforesaid operations, burr and isolated point on parallax are removed.
Further, a cloud is smoothed using Gaussian filter, obtains matched line being divided into differenceThe section of section is used from three directions having a size of 5 pixels, the one-dimensional Gauss that standard deviation is 0.8 pixel in each intervalFilter.
Provided by the present invention for the quick precise phase matching process of three-dimensional measurement, reconstruction can be quickly and accurately obtainedRegion and point cloud, have preferable precision to the measurement of complex target.
Detailed description of the invention
Invention is described further with reference to the accompanying drawing:
Fig. 1 is that the process step of the quick precise phase matching process provided in an embodiment of the present invention for three-dimensional measurement showsIt is intended to.
Fig. 2 a is the image of the candy strip of camera provided in an embodiment of the present invention shooting;
Fig. 2 b is the package phase provided in an embodiment of the present invention obtained using four-stepped switching policy;
Fig. 2 c is intensity image provided in an embodiment of the present invention;
Fig. 2 d is co-occurrence mask provided in an embodiment of the present invention;
Fig. 2 e is intensity mask provided in an embodiment of the present invention;
Fig. 2 f is the foreground area of segmentation provided in an embodiment of the present invention.
Specific embodiment
The quick precise phase proposed by the present invention for three-dimensional measurement is matched below in conjunction with the drawings and specific embodimentsMethod is described in further detail.According to following explanation and claims, advantages and features of the invention will be become apparent from.It needsBright, attached drawing is all made of very simplified form and using non-accurate ratio, only conveniently, lucidly to aid in illustratingThe purpose of the embodiment of the present invention.
Core of the invention thought is, provided by the present invention for the quick precise phase matching process of three-dimensional measurement,Reconstruction regions and point cloud can be quickly and accurately obtained, there is preferable precision to the measurement of complex target.
Fig. 1 is that the process step of the quick precise phase matching process provided in an embodiment of the present invention for three-dimensional measurement showsIt is intended to.Referring to Fig.1, a kind of quick precise phase matching process for three-dimensional measurement is provided, comprising the following steps:
S11, accurate target area is obtained;
S12, the parallax of sub-pix is obtained to left and right phase progress three-dimensional correction using weighted interpolation method;
S13, flash removed and isolated point are removed using parallax filter;
S14, it is smoothed using surface of the Gaussian filter to three-dimensional reconstruction.
Using four-stepped switching policy, the intensity of stripe pattern is
I1(x, y)=Ia(x,y)+Im(x,y)cos(φ(x,y))
I2(x, y)=Ia(x,y)+Im(x,y)cos(φ(x,y)+π/2)
I3(x, y)=Ia(x,y)+Im(x,y)cos(φ(x,y)+π)
I4(x, y)=Ia(x,y)+Im(x,y)cos(φ(x,y)+3π/2) (1)
Ia(x, y) indicates the intensity of environment light, Im(x, y) indicates modulate intensity, and φ (x, y) is expansion phase, from formula(1) in, Ia(x, y) and Im(x, y) can be described as:
Ia(x, y)=(I1+I2+I3+I4)/4
Im(x, y)=(((I4-I2)^2+(I1-I3)^2)^0.5)/2 (2)
Co-occurrence matrix is defined asCijIt indicates in ImIn there is i value and in IaIn have jThe sum of all pixels of value, PijIt is probability value.Fig. 2 is the co-occurrence matrix provided in an embodiment of the present invention based on environment light modulation.ReferenceFig. 2, (s, t) are the threshold values (R1, R2, R3 and R4) that matrix is divided into four quadrants.In biggish modulation and environment illumination intensityUnder, phase value is more accurate.In order to obtain optimal threshold, we it is ensured that equation (4) minimum value.
QR1,QR2,QR3And QR4It is defined as follows:
QR1(s, t)=PR1/(s+1)(t+1)0≤i≤s,0≤j≤t
QR2(s, t)=PR2/(t+1)(L1-s-1)s+1≤i≤L1-1,0≤j≤t
QR3(s, t)=PR3/(L2-t-1)(s+1)0≤i≤s,t+1≤j≤L2-1
QR4(s, t)=PR2/(L1-s-1)(L2-t-1)s+1≤i≤L1-1,t+1≤j≤L2-1 (5)
When threshold value (s, t) is sought, a symbiosis mask can establish for image segmentation.
OTSU algorithm is applied in intensity image IaIntensity mask value Mask is obtained in (x, y)ia.If co-occurrence matrix and intensityMask is true, then subject area is effective.Fig. 2 a is the image of the candy strip of camera provided in an embodiment of the present invention shooting;Figure2b is the package phase provided in an embodiment of the present invention obtained using four-stepped switching policy.Fig. 2 c is intensity provided in an embodiment of the present inventionImage.Referring to Fig. 2 c, the intensity image shown in figure can be calculated with equation (2);Fig. 2 d is provided in an embodiment of the present invention totalExisting mask.It can be obtained by equation (6) referring to Fig. 2 d co-occurrence mask;Fig. 2 e is intensity mask provided in an embodiment of the present invention.Referring to Fig. 2 e, intensity mask is obtained using OTSU method on intensity image;Fig. 2 f is segmentation provided in an embodiment of the present inventionThe advantages of foreground area, reference Fig. 2 f, this method combines two kinds of masks, provide an accurate target area.
After three-dimensional correction, two row images of left and right are parallel to pole outside line.When we choose a point in the phase diagram of the left side(xL,yL), the point of corresponding the right phase diagram is (xR,yR).Because of the reason of three-dimensional correction, yREqual to yL.In this case,yRIt is to fix a pixel.Fig. 3 is provided in an embodiment of the present invention for obtaining the template of subpixel coordinates.Referring to shown in Fig. 3,If the phase value on the left side isCorresponding the right phase value meets equation (7),
Based on this equation, our available key points (i, j) and (i+1, j).Corresponding abscissa can be asked by formula (8)?.
The point that surround based on key point can be used for coordinates computed.The two factors are defined as:
Corresponding ordinate can be obtained by equation (11).
Sub-pix parallax can be obtained by equation (12)
Para_x=xR-i′;Para_y=yR-j (12)
Filtering parallax, there are two steps.One is removal isolated points, and another kind is smooth disparity.Firstly, we are with one 5× 5 template judges isolated point.A point (i, j) is selected from effective subject area.Pixel ((i-2, j-2), (i-1, j-2) ... (i+1, j+2), (i+2, j+2)) determine the characteristic of point (i, j).If fruit dot ((i+m, j+n)) is effectively, to add upValue increases by 1.Then effective parallax of these points is accumulated.The average value of our available parallaxes.If aggregate-value is bigDifference in 10, and between the parallax and average value of institute's reconnaissance then retains the point, otherwise deletes the point less than 2.Second, using lineProperty interpolation eliminates parallax.Spacing is extracted, parallax line is divided into different parts.When section length is less than 10, using lineProperty interpolation method.Assuming that cross-sectional length is n, the value of two endpoints is para (0) and para (n-1).The parallax value at this interval canWith is defined as:
By this operation, the burr and isolated point on parallax are removed.
After obtaining accurate parallax, three-dimensional point cloud can be calculated by calibrating parameters.Using Gaussian filter pairPoint cloud is smoothed.The section that matched line is divided into different sections is obtained.In each interval, make from three directionsWith having a size of 5 pixels, the one-dimensional Gaussian filter that standard deviation is 0.8 pixel.After that, the surface for putting cloud is more smooth.
A kind of quick fine matching method based on absolute phase figure provided by the invention.Object mask can reduce reconstructionNoise spot and runing time.A kind of new weighted interpolation method introduces accurate sub-pix view in abscissa and ordinateDifference.Flash removed and isolated point are removed using parallax and point cloud filter, obtains accurate surface.Measurement of this method to complex targetWith preferable precision.
Obviously, those skilled in the art can carry out various changes and deformation without departing from essence of the invention to the present inventionMind and range.In this way, if these modifications and changes of the present invention belongs to the range of the claims in the present invention and its equivalent technologiesWithin, then the present invention is also intended to include these modifications and variations.

Claims (5)

4. being used for the quick precise phase matching process of three-dimensional measurement as described in claim 1, which is characterized in that with one 5× 5 template judges isolated point, and a point (i, j), pixel ((i-2, j-2), (i- are selected from effective subject area1, j-2) ... (i+1, j+2), (i+2, j+2)) characteristic that determines point (i, j), as fruit dot ((i+m, j+n)) be it is effective, add upValue increases by 1, then accumulates to effective parallax of these points, obtains the average value of parallax, if aggregate-value is greater than 10, and instituteDifference between the parallax and average value of reconnaissance then retains the point, otherwise deletes the point less than 2;Parallax is eliminated using linear interpolation,Spacing is extracted, parallax line is divided into different parts, when section length is less than 10, using linear interpolation method, it is assumed that sectionLength is n, and the value of two endpoints is para (0) and para (n-1), the parallax value at this interval is defined as:
CN201910347159.3A2019-04-282019-04-28Rapid and accurate phase matching method for three-dimensional measurementActiveCN110211053B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201910347159.3ACN110211053B (en)2019-04-282019-04-28Rapid and accurate phase matching method for three-dimensional measurement

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910347159.3ACN110211053B (en)2019-04-282019-04-28Rapid and accurate phase matching method for three-dimensional measurement

Publications (2)

Publication NumberPublication Date
CN110211053Atrue CN110211053A (en)2019-09-06
CN110211053B CN110211053B (en)2023-09-15

Family

ID=67786525

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910347159.3AActiveCN110211053B (en)2019-04-282019-04-28Rapid and accurate phase matching method for three-dimensional measurement

Country Status (1)

CountryLink
CN (1)CN110211053B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2022147670A1 (en)*2021-01-062022-07-14Jiangsu Jitri Micro-Nano Automation Institute Co., LtdAutomatic exposure selection method for high dynamic range 3d optical measurements

Citations (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2008281493A (en)*2007-05-112008-11-20Nippon Steel Corp Surface defect inspection system, method and program
WO2008154989A1 (en)*2007-06-182008-12-24Daimler AgMethod for the optimization of a stereoscopic image
CN101398886A (en)*2008-03-172009-04-01杭州大清智能技术开发有限公司Rapid three-dimensional face identification method based on bi-eye passiveness stereo vision
CN102184540A (en)*2011-05-032011-09-14哈尔滨工程大学Sub-pixel level stereo matching method based on scale space
US20120262454A1 (en)*2010-10-292012-10-18Sony CorporationStereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device, and stereoscopic image data reception method
EP2592595A1 (en)*2010-06-302013-05-15Panasonic CorporationStereo image processing apparatus and method of processing stereo image
CN103440653A (en)*2013-08-272013-12-11北京航空航天大学Binocular vision stereo matching method
CN103729251A (en)*2013-11-062014-04-16中国科学院上海光学精密机械研究所Concurrent computation optical bar chart phase extraction method
CN105043298A (en)*2015-08-212015-11-11东北大学Quick three-dimensional shape measurement method without phase unwrapping based on Fourier transform
CN108613637A (en)*2018-04-132018-10-02深度创新科技(深圳)有限公司A kind of structured-light system solution phase method and system based on reference picture
CN108898575A (en)*2018-05-152018-11-27华南理工大学A kind of NEW ADAPTIVE weight solid matching method
CN109499010A (en)*2018-12-212019-03-22苏州雷泰医疗科技有限公司Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2008281493A (en)*2007-05-112008-11-20Nippon Steel Corp Surface defect inspection system, method and program
WO2008154989A1 (en)*2007-06-182008-12-24Daimler AgMethod for the optimization of a stereoscopic image
CN101398886A (en)*2008-03-172009-04-01杭州大清智能技术开发有限公司Rapid three-dimensional face identification method based on bi-eye passiveness stereo vision
EP2592595A1 (en)*2010-06-302013-05-15Panasonic CorporationStereo image processing apparatus and method of processing stereo image
US20120262454A1 (en)*2010-10-292012-10-18Sony CorporationStereoscopic image data transmission device, stereoscopic image data transmission method, stereoscopic image data reception device, and stereoscopic image data reception method
CN102184540A (en)*2011-05-032011-09-14哈尔滨工程大学Sub-pixel level stereo matching method based on scale space
CN103440653A (en)*2013-08-272013-12-11北京航空航天大学Binocular vision stereo matching method
CN103729251A (en)*2013-11-062014-04-16中国科学院上海光学精密机械研究所Concurrent computation optical bar chart phase extraction method
CN105043298A (en)*2015-08-212015-11-11东北大学Quick three-dimensional shape measurement method without phase unwrapping based on Fourier transform
CN108613637A (en)*2018-04-132018-10-02深度创新科技(深圳)有限公司A kind of structured-light system solution phase method and system based on reference picture
CN108898575A (en)*2018-05-152018-11-27华南理工大学A kind of NEW ADAPTIVE weight solid matching method
CN109499010A (en)*2018-12-212019-03-22苏州雷泰医疗科技有限公司Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BAO WEI 等: "Combining spacetime stereo and phase-shift for fast 3D shape measurement", 《2017 32ND YOUTH ACADEMIC ANNUAL CONFERENCE OF CHINESE ASSOCIATION OF AUTOMATION(YAC)》*
刘欢: "基于双目视觉立体匹配算法的研究与应用", 《中国优秀硕士学位论文全文数据库信息科技辑》*
唐瑞尹: "复杂光学特性表面视觉测量关键技术研究", 《中国博士学位论文全文数据库信息科技辑》*
张韶越 等: "基于区域调制相移模板的高精度三维结构光重建", 《现代机械》*

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2022147670A1 (en)*2021-01-062022-07-14Jiangsu Jitri Micro-Nano Automation Institute Co., LtdAutomatic exposure selection method for high dynamic range 3d optical measurements

Also Published As

Publication numberPublication date
CN110211053B (en)2023-09-15

Similar Documents

PublicationPublication DateTitle
CN104680496B (en)A kind of Kinect depth map restorative procedures based on color images
CN110349132B (en)Fabric flaw detection method based on light field camera depth information extraction
CN108537782B (en) A method of building image matching and fusion based on contour extraction
CN108613637B (en)Structured light system dephasing method and system based on reference image
CN103400366A (en)Method for acquiring dynamic scene depth based on fringe structure light
CN102881014B (en)Quick stereo matching method based on graph cut
CN104504745B (en)A kind of certificate photo generation method split based on image and scratch figure
CN109242811B (en)Image alignment method and device, computer readable storage medium and computer equipment
CN111107337B (en)Depth information complementing method and device, monitoring system and storage medium
CN104952048B (en)A kind of focus storehouse picture synthesis method based on as volume reconstruction
CN106296811A (en)A kind of object three-dimensional reconstruction method based on single light-field camera
CN110322572A (en)A kind of underwater culvert tunnel inner wall three dimensional signal space method based on binocular vision
WO2017004882A1 (en)Video 3d rendering method for flat display apparatuses
CN104751458B (en)A kind of demarcation angular-point detection method based on 180 ° of rotation operators
CN111080716B (en)Camera calibration target based on color coding phase shift stripes and calibration point extraction method
JP2016024052A (en) 3D measurement system, 3D measurement method and program
CN112669280A (en)Unmanned aerial vehicle oblique aerial photography right-angle image control point target detection method based on LSD algorithm
CN112288796A (en)Method for extracting center of perspective image mark point
KR101549929B1 (en)Method and apparatus of generating depth map
CN115330684A (en)Underwater structure apparent defect detection method based on binocular vision and line structured light
CN110930332A (en) A Denoising Method of Digital Holographic Image Based on Artificial Intelligence
JP2015171143A (en) Method and apparatus for camera calibration with color coded structure and computer readable storage medium
CN110211053A (en)Quick precise phase matching process for three-dimensional measurement
JP5200042B2 (en) Disparity estimation apparatus and program thereof
CN110111339B (en)Stripe image target area extraction method

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp