Summary of the invention
The technical problem to be solved in the present invention is need user to provide search key and be difficult to be applied to the uncomprehending destination object of user in order to overcome the information retrieval method of prior art, cannot carry out the effectively defect of retrieval to the information of unknown object, propose a kind of information retrieval method and information searching device of destination object.
The present invention solves above-mentioned technical matters by following technical proposals:
The invention provides a kind of information retrieval method of destination object, its feature is, comprises the following steps:
S1, photographic subjects object photo, and location obtains current location;
S2, from picture shared data bank, choose all or part of picture that the distance between geographic position and current location is less than the first default distance threshold as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
S3, from this photo, extract some characteristics of image;
S4, from co-located picture, filter out there are these some characteristics of image picture as picture concerned;
S5, obtain the relatively many some labels of multiplicity in the label of all picture concerned;
S6, these some labels are carried out to network retrieval as keyword, and the information that obtains of output retrieval.
It will be appreciated by those skilled in the art that S1the current location that middle location obtains is photographer's position, and because the distance of taking pictures is conventionally shorter, thereby current location should be similar to destination object present position in most cases.In fact destination object in the present invention can be any object, and what be especially applicable to is the static constant object in position, as some sight spots, television tower, monument etc.S3in image characteristics extraction can adopt any one image characteristics extraction algorithm of the prior art to realize, the characteristics of image of extraction can be the feature of profile, color etc.S2in larger at picture shared data bank, meet distance between geographic position and current location and be less than the picture number of first default this condition of distance threshold when more, can choose meet this condition part picture as co-located picture, otherwise can choose meet this condition whole pictures as co-located picture.
This picture shared data bank can be that photo is shared website as the picture database of Flickr and Picasa, what in the picture database of the shared website of these photos, store is substantially all the photo that user uploads, and in upload pictures, can add geographic position and some labels.Label is herein appreciated that the keyword arranging for ease of classification.For instance, can be " historical building ", " skyscraper " etc.After the image that has utilized positional information and photo screens, can think to screen in the picture obtaining to have the photo that major part is destination object equally.Thereby S5in these some labels of obtaining have very large probability to be also applicable to this destination object.Thereby these some labels are retrieved as keyword, can obtain the information of this destination object.And, S5in multiplicity mean relatively more, the multiplicity of these some labels is with respect to the multiplicity of other labels in the label of all picture concerned and Yan Gengduo.
At this destination object, for user, be unknown, user cannot initiatively provide in the situation of search key, above-mentioned search method can utilize network picture resource automatically effectively to retrieve according to positional information and photo, thereby obtains the information of this unknown destination object.
Preferably, S2and S3between further comprising the steps of:
S21, from co-located picture, choose picture that the distance between geographic position and current location is less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, wherein second distance threshold value is less than the first distance threshold.
Second distance threshold value should be significantly less than the first distance threshold.Like this, as step S21in when the determination result is NO, can think that the position of picture concerned and this destination object is almost identical.Now, have greater probability picture concerned for object and this photo in the destination object taken be identical.
Hold intelligibly step S21after carrying out with before carrying out, compare, in co-located picture, lacked S21in picture concerned.S21in picture concerned and S4in picture concerned itself not identical, but after filtering out from co-located picture, using this two parts picture as a class picture, picture concerned herein should be understood to a class picture.
Preferably, S2by S2areplace S2afor: adopt k-means clustering algorithm by the whole pictures that have in this picture shared data bank according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
K-mean algorithm is a kind of hard clustering algorithm, belongs to the objective function clustering method of local prototype.It has, and time complexity is low, the fireballing advantage of cluster.The processing procedure of k-means algorithm is as follows: first, choose at random k object as the barycenter of individual bunch of initial k; Then, all the other objects are assigned to nearest bunch according to the distance of itself and each bunch barycenter; Finally, even if the barycenter of each bunch again.Said process constantly repeats, until the minimization of object function.The steps flow chart of k-means clustering algorithm is substantially as follows:
Step 1, select k object as the barycenter of initial bunch at random;
The distance of the barycenter ofstep 2, calculating object and each bunch, is divided into object apart from its nearest bunch;
Step 3, recalculate each average of new bunch, i.e. barycenter;
If the barycenter of step 4 bunch no longer changes, return to division result, otherwise return tostep 2.
Preferably, S3for: adopt gabor small wave converting method to extract global feature and the local feature of this photo;
S4for: adopt gabor small wave converting method to extract global feature and the local feature of co-located picture, and filter out co-located picture that global feature is identical with this photo with local feature as picture concerned.
Gabor small wave converting method can provide good set direction and scale selection characteristic, and insensitive for illumination variation, has the adaptability to illumination variation.And in the present invention, need to carry out image characteristics extraction to as if photo and picture, and this part picture is also likely the photo that user uploads more often than not.The characteristics of image of photo is subject to illumination effect, utilizes gabor small wave converting method to extract whole and part characteristic information to the image in the present invention, can more effectively avoid the impact of illumination.It should be noted in the discussion above that above-mentioned global feature and local feature are all for single picture, any in co-located picture processes through gabor small wave converting method global feature and the local feature that the characteristics of image extracting has included this pictures.
The present invention also provides a kind of information searching device, and its feature is, comprising:
One camera module, for the photo of photographic subjects object;
One locating module, obtains current location for location;
One primary importance screening module, for choosing all or part of picture that the distance between geographic position and current location is less than the first default distance threshold from picture shared data bank as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
One characteristics of image screening module, for extracting some characteristics of image from this photo, then from co-located picture, filter out there are these some characteristics of image picture as picture concerned;
One keyword retrieval module, for obtaining the relatively many some labels of label multiplicity of all picture concerned, and carries out network retrieval using these some labels as keyword, the information that output retrieval obtains.
Preferably, this primary importance screening module is enabled a second place screening module after choosing co-located picture, this second place screening module for the picture choosing the distance between geographic position and current location from co-located picture and be less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, then enable this characteristics of image screening module, wherein second distance threshold value is less than the first distance threshold.
Preferably, this primary importance screening module is replaced by a cluster screening module, this cluster screening module for whole pictures of adopting k-means clustering algorithm this picture shared data bank being had according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
Preferably, this characteristics of image screening module is for adopting gabor small wave converting method to extract global feature and the local feature of this photo and co-located picture, then filters out picture that global feature is identical with this photo with local feature as picture concerned.
Preferably, this information searching device is mobile phone.
Meeting on the basis of this area general knowledge, above-mentioned each optimum condition, can combination in any, obtains the preferred embodiments of the invention.
Positive progressive effect of the present invention is:
The information retrieval method of destination object of the present invention and information searching device, by photograph image and the positional information of destination object, thereby suitable searched key word is searched in the picture shared data bank from network, to screen suitable picture Automatic-searching, thereby provide search key without user, just can effectively retrieve the information of unknown object, and user's use is very convenient.
Embodiment
Below in conjunction with accompanying drawing, provide preferred embodiment of the present invention, to describe technical scheme of the present invention in detail, but therefore do not limit the present invention among described scope of embodiments.
Embodiment 1
As shown in Figure 1, the information retrieval method of the destination object of the present embodiment comprises the following steps:
S1, photographic subjects object photo, and location obtains current location;
S2, from picture shared data bank, choose all or part of picture that the distance between geographic position and current location is less than the first default distance threshold as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
S21, from co-located picture, choose picture that the distance between geographic position and current location is less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, wherein second distance threshold value is less than the first distance threshold;
S3, adopt gabor small wave converting method to extract global feature and the local feature of this photo;
S4, adopt gabor small wave converting method to extract global feature and the local feature of co-located picture, and filter out co-located picture that global feature is identical with this photo with local feature as picture concerned;
S5, obtain the relatively many some labels of multiplicity in the label of all picture concerned;
S6, these some labels are carried out to network retrieval as keyword, and the information that obtains of output retrieval.
Wherein, second distance threshold value is 100 meters, and the first distance threshold is 500 meters.Like this, as step S21in when the determination result is NO, can think that the position of picture concerned and this destination object is almost identical.Now, have greater probability picture concerned for object and this photo in the destination object taken be identical.S2in all or part of picture be: in the situation that meet the picture number that distance between geographic position and current location is less than the condition of the first default distance threshold, be greater than a reference value (in the present embodiment, this reference value is 100), choose meet this condition 100 pictures as co-located picture; Otherwise, choose meet this condition all pictures as co-located picture.
In the present embodiment, the quantity of these some labels is 4, finally utilizes 4 keywords to carry out network retrieval, and network retrieval utilizes google search engine to carry out.
This picture shared data bank in the present embodiment is the picture database of the shared website Flickr of photo and Picasa.At this destination object, for user, be unknown, user cannot initiatively provide in the situation of search key, the search method of the present embodiment can utilize network picture resource automatically effectively to retrieve according to positional information and photo, thereby obtains the information of this unknown destination object.
Embodiment 2
The difference of the information retrieval method of the present embodiment and embodiment 1 is only:
S2by S2areplace S2afor: adopt k-means clustering algorithm by the whole pictures that have in this picture shared data bank according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.That is to say, if in the multiclass picture that adopts k-means clustering algorithm to obtain, mean value and the current location in the geographic position of a certain class picture are the most approaching, just using this class picture as co-located picture.
The step of the k-means clustering algorithm adopting in the present embodiment is as follows:
Step 1, select k object (i.e. picture in this picture shared data bank) as the barycenter (barycenter is herein for geographic position corresponding to picture, the centroid position calculating) of initial bunch at random;
The distance of the barycenter ofstep 2, calculating object and each bunch, is divided into object apart from its nearest bunch;
Step 3, recalculate each average of new bunch, i.e. barycenter;
If the barycenter of step 4 bunch no longer changes, return to division result, otherwise return tostep 2.
Embodiment 3
As shown in Figure 2, the information searching device of the present embodiment is a mobile phone, and this mobile phone comprises a camera module 1, alocating module 2, a primaryimportance screening module 3, a second place screening module 4, characteristics ofimage screening module 5 and a keyword retrieval module 6.
This camera module is for the photo of photographic subjects object, and this locating module obtains current location for location.This primary importance screening module, for choosing all or part of picture that the distance between geographic position and current location is less than the first default distance threshold from picture shared data bank as co-located picture, then enable this second place screening module, the picture wherein having in this picture shared data bank has label and geographic position.
This second place screening module for the picture choosing the distance between geographic position and current location from co-located picture and be less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, then enable this characteristics of image screening module, wherein second distance threshold value is less than the first distance threshold.This characteristics of image screening module is for adopting gabor small wave converting method to extract global feature and the local feature of this photo and co-located picture, then filters out picture that global feature is identical with this photo with local feature as picture concerned.
This keyword retrieval module, for obtaining the relatively many some labels of label multiplicity of all picture concerned, and carries out network retrieval using these some labels as keyword, the information that output retrieval obtains.
Embodiment 4
The present embodiment is compared with the mobile phone ofembodiment 3, and difference is only:
This primary importance screening module is replaced by a cluster screening module, this cluster screening module for whole pictures of adopting k-means clustering algorithm this picture shared data bank being had according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
Although more than described the specific embodiment of the present invention, it will be understood by those of skill in the art that these only illustrate, protection scope of the present invention is limited by appended claims.Those skilled in the art is not deviating under the prerequisite of principle of the present invention and essence, can make various changes or modifications to these embodiments, but these changes and modification all fall into protection scope of the present invention.