Embodiment
For making the object of the embodiment of the present invention, technical scheme and advantage clearly, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, instead of whole embodiments.The element described in an accompanying drawing of the present invention or a kind of embodiment and feature can combine with the element shown in one or more other accompanying drawing or embodiment and feature.It should be noted that for purposes of clarity, accompanying drawing and eliminate expression and the description of unrelated to the invention, parts known to persons of ordinary skill in the art and process in illustrating.Based on the embodiment in the present invention, the every other embodiment that those of ordinary skill in the art obtain under the prerequisite not paying creative work, all belongs to the scope of protection of the invention.
Embodiment one:
The invention provides a kind of colour point clouds system, comprising:
Digital camera, for obtaining full-view image with preset frequency;
Laser scanner, for obtaining the laser point cloud data of described full-view image;
Inertial Measurement Unit and GPS, described Inertial Measurement Unit and described GPS are for providing the described position and attitude time data of colour point clouds system in moving process based on full-view image;
Matching unit, for by described position and attitude time data and described laser point cloud data one_to_one corresponding, generates colour point clouds data.
The full-view image that colour point clouds system in the present invention obtains respectively according to panorama camera and laser scanner and laser point cloud generate colour point clouds data by concrete algorithm, in visual display, object classification, object modeling etc., have very large advantage.
Optionally, described laser scanner, described digital camera, described Inertial Measurement Unit and described GPS are spatially positioned in identical platform, and described platform is traverse measurement car.Digital camera and laser scanner are spatially rigidly fixed in identical platform by the present invention, are unified in time by GPS, so in the process of experimental check and data fusion from now on, full-view image and laser point cloud can accuracy registrations.
Described digital camera is panorama camera, native system directly obtains full-view image by using panorama camera, by the registration of the full-view image that do not gather in the same time and laser point cloud, provided the three-dimensional coordinate of corresponding position image by laser point cloud, thus can reduce the coordinate of arbitrfary point in full-view image.
Optionally, described matching unit also for: for described laser point cloud data selects suitable full-view image, be specially:
If object point is not blocked in described full-view image, then according to time of described GPS or the nearest full-view image of each object point of geometric distance chosen distance;
Otherwise, choose the full-view image be not blocked that the object point that is blocked is adjacent.
Can be there is the situation of being blocked by other objects in the object point in the full-view image that digital camera obtains in actual photographed, and the situation of blocking from the image that different angles obtains is different, needs for laser point cloud data selects suitable full-view image.
Optionally, described " by described position and attitude time data and described laser point cloud data one_to_one corresponding, generating colour point clouds data " specifically comprises:
S1: descend coordinate (X to S1 system by the terrestrial coordinate (Xt, Yt, Zt) of object point1, Y1, Z1), described S1 is local space rectangular coordinate system, and wherein (dX, dY, dZ) is the terrestrial coordinate of the current panorama ball centre of sphere;
S2: by described S1 system coordinate (X1, Y1, Z1) to S2 system coordinate (Xs, Ys, Zs), described S2 is panorama spherical space rectangular coordinate system;
The coefficient that described (a1, a2, a3, b1, b2, b3, c1, c2, c3) is rotation matrix, by three attitude angle roll angles of full-view imageangle of pitch ω, course angle κ determine;
S3: calculate the polar coordinates of corresponding picture point on panorama ball (B, L, R) by described S2 system coordinate (Xs, Ys, Zs), R is the radius of panorama ball;
S4: calculate pixel coordinate (m, n) by described B, L, wherein, Width is the wide of described full-view image, and Height is the height of described full-view image;
S5: for described laser point cloud data composes color, wherein RGB (Xs, Ys, Zs) represents point (Xs, Ys, Zs) RGB color value, N be full-view image numbering, RGB (m, n, N) represent the RGB color value of pixel (m, n) on this full-view image;
RGB(Xs,Ys,Zs)=RGB(m,n,N)。
According to above-mentioned step, position and attitude time data and laser point cloud data one_to_one corresponding are got up, the pixel coordinate of picture point on the corresponding panorama ball namely calculating object point, and the RGB color value of described picture point is assigned to described object point.
Embodiment two:
As shown in Figure 5, present invention also offers a kind of colour point clouds generation method based on colour point clouds system, comprising:
Digital camera obtains full-view image with preset frequency;
Laser scanner obtains laser point cloud data;
Inertial Measurement Unit and GPS obtain the position and attitude time data of full-view image;
Matching unit, by described position and attitude time data and described laser point cloud data one_to_one corresponding, generates colour point clouds data.
Colour point clouds generation method provided by the invention by obtaining full-view image and laser point cloud, by described full-view image and laser point cloud accuracy registration, and based on composing colored algorithm to corresponding laser point cloud, can draw effect merge preferably after colour point clouds.
Be illustrated in figure 1 described laser scanner obtain laser point cloud data schematic diagram, as Fig. 2 be as described in digital camera obtain full-view image schematic diagram data.
Optionally, described laser point cloud data is the data that described laser scanner continuous sweep obtains, and described laser point cloud data form is (x, y, z, t), and wherein x, y, z is three-dimensional coordinate, and t represents GPS second in week.
Optionally, described full-view image is gather once every 5 meters, and the data of described full-view image are through resolving as jpeg format or BMP form.
Optionally, described full-view image position and attitude time data is the filename of each Zhang Quanjing image, latitude and longitude coordinates, three-dimensional rectangular coordinate, attitude angle and GPS second in week, and described attitude angle comprises roll angleangle of pitch ω, course angle κ.
Can relate to multiple coordinate system in colour point clouds generating algorithm, be illustrated in figure 3 the schematic diagram of multiple coordinate system, earth coordinates S-XtYtZt is absolute coordinates, and in laser point cloud data, each object point all uses this coordinate system record;
Local space rectangular coordinate system S1-X1y1z1: the local space rectangular coordinate system that the origin translation of S system and earth coordinates is formed to the current panorama ball centre of sphere;
Panorama spherical space rectangular coordinate system S2-XsYsZs: with the current panorama ball centre of sphere for initial point, Y-axis points to described traverse measurement car route, and X-axis is pointed on the right side of traverse measurement car car body, and Z axis is vertically upward;
Panorama spheric polar coordinate system P: the polar coordinate system being initial point with the panorama centre of sphere;
Full-view image plane coordinate system O-xy: the plane right-angle coordinate taking principal point as initial point.
In laser point cloud data, the coordinate of each point is absolute coordinates, represent the physical location of object point, colour point clouds generation method described in the present invention calculates the corresponding pixel coordinate (m of picture point on full-view image by the principle of conllinear by the absolute coordinates taking moment object point, n), subsequently the color value of the picture point of correspondence is assigned to above-mentioned object point.
Be exactly need to read in above-mentioned full-view image position and attitude time data composing the colored first step for described picture point, namely comprising multiple parameters.
Optionally, described " matching unit, by described position and attitude time data and described laser point cloud data one_to_one corresponding, generates colour point clouds data " is front also comprises: for described laser point cloud data selects suitable full-view image, be specially:
If object point is not blocked in described full-view image, then according to time of described GPS or the nearest full-view image of each object point of geometric distance chosen distance;
Otherwise, choose the full-view image be not blocked that the object point that is blocked is adjacent.
In the operating process of reality, distance between laser point cloud data sweep trace is about 0.2 meter, the speed of a motor vehicle of traverse measurement car is about 40km/h, full-view image is then every 5 meters one, and the situation of blocking can be there is in the object point that we need in full-view image, take the situation of blocking in the image of acquisition from different perspectives different, so need for laser point cloud data selects suitable full-view image;
If the object point in described full-view image is not blocked, the then immediate full-view image of each object point of chosen distance, the selection of described immediate full-view image is time according to GPS or geometric distance, select time immediate or in distance immediate full-view image;
If object point has been blocked in described full-view image, then to choose the object point that is blocked adjacent and the full-view image be not blocked.
Optionally, described " matching unit, by described position and attitude time data and described laser point cloud data one_to_one corresponding, generates colour point clouds data " specifically comprises:
S1: descend coordinate (X to S1 system by the terrestrial coordinate (Xt, Yt, Zt) of object point1, Y1, Z1) described S1 is local space rectangular coordinate system, wherein (dX, dY, dZ) is the terrestrial coordinate of the current panorama ball centre of sphere;
S2: by described S1 system coordinate (X1, Y1, Z1) to S2 system coordinate (Xs, Ys, Zs), described S2 is panorama spherical space rectangular coordinate system;
The coefficient that described (a1, a2, a3, b1, b2, b3, c1, c2, c3) is rotation matrix, by three attitude angle roll angles of full-view imageangle of pitch ω, course angle κ determine;
S3: calculate the polar coordinates of corresponding picture point on panorama ball (B, L, R) by described S2 system coordinate (Xs, Ys, Zs), R is the radius of panorama ball;
S4: calculate pixel coordinate (m, n) by described B, L, wherein, Width is the wide of described full-view image, and Height is the height of described full-view image;
S5: for described laser point cloud data compose color wherein RGB (Xs, Ys, Zs) represent point (Xs, Ys, Zs) RGB color value, N is full-view image numbering, RGB (m, n, N) represent the RGB color value of pixel (m, n) on this full-view image;
RGB(Xs,Ys,Zs)=RGB(m,n,N)。
First by the coordinate conversion of object point under absolute coordinate system in local space rectangular coordinate system S1, conversion method is provided by formula 1;
Then pass through formula 2 by the coordinate conversion under local space rectangular coordinate system S1 in the rectangular coordinate system S2 of panorama spherical space, and the correlation parameter in formula 2 is determined by three attitude angle of formula 4 by full-view image;
The polar coordinates of coordinate on the panorama ball of correspondence in described panorama spherical space rectangular coordinate system S2 are calculated again by formula 4 and formula 5;
Calculate corresponding pixel coordinate according to above-mentioned polar coordinates, the pixel coordinate that above-mentioned object point is corresponding can be known, subsequently according to the pixel coordinate drawn, for described laser point cloud composes color, be illustrated in figure 4 the colour point clouds schematic diagram after fusion.
According to the colour point clouds generation method in the present invention, the registration between laser point cloud and full-view image accurately can be realized.
State in each embodiment on the invention, the sequence number of embodiment and/or sequencing are only convenient to describe, and do not represent the quality of embodiment.The description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.
Although last it is noted that described the present invention and advantage thereof in detail above, be to be understood that and can carry out various change when not exceeding the spirit and scope of the present invention limited by appended claim, substituting and converting.And scope of the present invention is not limited only to the specific embodiment of process, equipment, means, method and step described by instructions.One of ordinary skilled in the art will readily appreciate that from disclosure of the present invention, can use perform the function substantially identical with corresponding embodiment described herein or obtain and its substantially identical result, existing and that will be developed in the future process, equipment, means, method or step according to the present invention.Therefore, appended claim is intended to comprise such process, equipment, means, method or step in their scope.