Movatterモバイル変換


[0]ホーム

URL:


CN103699679A - Method and equipment for retrieving information of target objects - Google Patents

Method and equipment for retrieving information of target objects
Download PDF

Info

Publication number
CN103699679A
CN103699679ACN201310753628.4ACN201310753628ACN103699679ACN 103699679 ACN103699679 ACN 103699679ACN 201310753628 ACN201310753628 ACN 201310753628ACN 103699679 ACN103699679 ACN 103699679A
Authority
CN
China
Prior art keywords
picture
information
photo
concerned
pictures
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201310753628.4A
Other languages
Chinese (zh)
Inventor
李柯材
郑建须
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huaqin Telecom Technology Co Ltd
Original Assignee
Huaqin Telecom Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huaqin Telecom Technology Co LtdfiledCriticalHuaqin Telecom Technology Co Ltd
Priority to CN201310753628.4ApriorityCriticalpatent/CN103699679A/en
Publication of CN103699679ApublicationCriticalpatent/CN103699679A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The invention discloses a method and equipment for retrieving information of target objects. The method for retrieving the information of the target objects includes steps of taking pictures of the target objects, positioning the target objects and acquiring current positions of the target objects; selecting certain pictures from picture shared databases to acquire same-position pictures; extracting a plurality of image features from each same-position picture; screening the same-position pictures to acquire pictures with the image features and using the pictures with the image features as related pictures; acquiring a plurality of tags with high repeat counts from tags of the related pictures; using the tags as keywords to retrieve networks and outputting the information acquired by means of retrieval. The distances from the certain pictures to the current positions are smaller than distance threshold values. The method and the equipment for retrieving the information of the target objects have the advantages that the proper retrieval keywords are automatically determined according to network resources by the aid of the pictures and position information of the target objects, and the networks are retrieved according to the keywords, so that the information of unknown targets can be effectively retrieved without retrieval keywords given by users.

Description

The information retrieval method of destination object and information searching device
Technical field
The present invention relates to a kind of information retrieval method and information searching device of destination object.
Background technology
At present, information retrieval is generally undertaken by network search engines, such as search engines such as utilizing Google, Baidu is realized the retrieval of information.The information of people in order to obtain, conventional search method first selects several keywords, then inputs keyword and searches in the search box of search engine, to obtain retrieving information.
The above-mentioned search that utilizes network to carry out, has expanded to many portable equipments now, such as smart mobile phone etc.Like this, people can carry out information retrieval very easily anywhere.
Yet the shortcoming of this information retrieval method is that people must be for feature or some understanding of information of searched targets.When not understanding the information of target, will be difficult to adopt this information retrieval method to obtain and want the relevant information obtaining.For instance, when visitor arrives a place (such as monument or tower etc.) with milestone in travelling, in the situation that not seeing any Word message, visitor will understand this target, is also difficult to carry out network retrieval by keyword.That is to say, in prior art, lack a kind of method that can effectively retrieve the information of unknown object.
Summary of the invention
The technical problem to be solved in the present invention is need user to provide search key and be difficult to be applied to the uncomprehending destination object of user in order to overcome the information retrieval method of prior art, cannot carry out the effectively defect of retrieval to the information of unknown object, propose a kind of information retrieval method and information searching device of destination object.
The present invention solves above-mentioned technical matters by following technical proposals:
The invention provides a kind of information retrieval method of destination object, its feature is, comprises the following steps:
S1, photographic subjects object photo, and location obtains current location;
S2, from picture shared data bank, choose all or part of picture that the distance between geographic position and current location is less than the first default distance threshold as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
S3, from this photo, extract some characteristics of image;
S4, from co-located picture, filter out there are these some characteristics of image picture as picture concerned;
S5, obtain the relatively many some labels of multiplicity in the label of all picture concerned;
S6, these some labels are carried out to network retrieval as keyword, and the information that obtains of output retrieval.
It will be appreciated by those skilled in the art that S1the current location that middle location obtains is photographer's position, and because the distance of taking pictures is conventionally shorter, thereby current location should be similar to destination object present position in most cases.In fact destination object in the present invention can be any object, and what be especially applicable to is the static constant object in position, as some sight spots, television tower, monument etc.S3in image characteristics extraction can adopt any one image characteristics extraction algorithm of the prior art to realize, the characteristics of image of extraction can be the feature of profile, color etc.S2in larger at picture shared data bank, meet distance between geographic position and current location and be less than the picture number of first default this condition of distance threshold when more, can choose meet this condition part picture as co-located picture, otherwise can choose meet this condition whole pictures as co-located picture.
This picture shared data bank can be that photo is shared website as the picture database of Flickr and Picasa, what in the picture database of the shared website of these photos, store is substantially all the photo that user uploads, and in upload pictures, can add geographic position and some labels.Label is herein appreciated that the keyword arranging for ease of classification.For instance, can be " historical building ", " skyscraper " etc.After the image that has utilized positional information and photo screens, can think to screen in the picture obtaining to have the photo that major part is destination object equally.Thereby S5in these some labels of obtaining have very large probability to be also applicable to this destination object.Thereby these some labels are retrieved as keyword, can obtain the information of this destination object.And, S5in multiplicity mean relatively more, the multiplicity of these some labels is with respect to the multiplicity of other labels in the label of all picture concerned and Yan Gengduo.
At this destination object, for user, be unknown, user cannot initiatively provide in the situation of search key, above-mentioned search method can utilize network picture resource automatically effectively to retrieve according to positional information and photo, thereby obtains the information of this unknown destination object.
Preferably, S2and S3between further comprising the steps of:
S21, from co-located picture, choose picture that the distance between geographic position and current location is less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, wherein second distance threshold value is less than the first distance threshold.
Second distance threshold value should be significantly less than the first distance threshold.Like this, as step S21in when the determination result is NO, can think that the position of picture concerned and this destination object is almost identical.Now, have greater probability picture concerned for object and this photo in the destination object taken be identical.
Hold intelligibly step S21after carrying out with before carrying out, compare, in co-located picture, lacked S21in picture concerned.S21in picture concerned and S4in picture concerned itself not identical, but after filtering out from co-located picture, using this two parts picture as a class picture, picture concerned herein should be understood to a class picture.
Preferably, S2by S2areplace S2afor: adopt k-means clustering algorithm by the whole pictures that have in this picture shared data bank according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
K-mean algorithm is a kind of hard clustering algorithm, belongs to the objective function clustering method of local prototype.It has, and time complexity is low, the fireballing advantage of cluster.The processing procedure of k-means algorithm is as follows: first, choose at random k object as the barycenter of individual bunch of initial k; Then, all the other objects are assigned to nearest bunch according to the distance of itself and each bunch barycenter; Finally, even if the barycenter of each bunch again.Said process constantly repeats, until the minimization of object function.The steps flow chart of k-means clustering algorithm is substantially as follows:
Step 1, select k object as the barycenter of initial bunch at random;
The distance of the barycenter ofstep 2, calculating object and each bunch, is divided into object apart from its nearest bunch;
Step 3, recalculate each average of new bunch, i.e. barycenter;
If the barycenter of step 4 bunch no longer changes, return to division result, otherwise return tostep 2.
Preferably, S3for: adopt gabor small wave converting method to extract global feature and the local feature of this photo;
S4for: adopt gabor small wave converting method to extract global feature and the local feature of co-located picture, and filter out co-located picture that global feature is identical with this photo with local feature as picture concerned.
Gabor small wave converting method can provide good set direction and scale selection characteristic, and insensitive for illumination variation, has the adaptability to illumination variation.And in the present invention, need to carry out image characteristics extraction to as if photo and picture, and this part picture is also likely the photo that user uploads more often than not.The characteristics of image of photo is subject to illumination effect, utilizes gabor small wave converting method to extract whole and part characteristic information to the image in the present invention, can more effectively avoid the impact of illumination.It should be noted in the discussion above that above-mentioned global feature and local feature are all for single picture, any in co-located picture processes through gabor small wave converting method global feature and the local feature that the characteristics of image extracting has included this pictures.
The present invention also provides a kind of information searching device, and its feature is, comprising:
One camera module, for the photo of photographic subjects object;
One locating module, obtains current location for location;
One primary importance screening module, for choosing all or part of picture that the distance between geographic position and current location is less than the first default distance threshold from picture shared data bank as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
One characteristics of image screening module, for extracting some characteristics of image from this photo, then from co-located picture, filter out there are these some characteristics of image picture as picture concerned;
One keyword retrieval module, for obtaining the relatively many some labels of label multiplicity of all picture concerned, and carries out network retrieval using these some labels as keyword, the information that output retrieval obtains.
Preferably, this primary importance screening module is enabled a second place screening module after choosing co-located picture, this second place screening module for the picture choosing the distance between geographic position and current location from co-located picture and be less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, then enable this characteristics of image screening module, wherein second distance threshold value is less than the first distance threshold.
Preferably, this primary importance screening module is replaced by a cluster screening module, this cluster screening module for whole pictures of adopting k-means clustering algorithm this picture shared data bank being had according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
Preferably, this characteristics of image screening module is for adopting gabor small wave converting method to extract global feature and the local feature of this photo and co-located picture, then filters out picture that global feature is identical with this photo with local feature as picture concerned.
Preferably, this information searching device is mobile phone.
Meeting on the basis of this area general knowledge, above-mentioned each optimum condition, can combination in any, obtains the preferred embodiments of the invention.
Positive progressive effect of the present invention is:
The information retrieval method of destination object of the present invention and information searching device, by photograph image and the positional information of destination object, thereby suitable searched key word is searched in the picture shared data bank from network, to screen suitable picture Automatic-searching, thereby provide search key without user, just can effectively retrieve the information of unknown object, and user's use is very convenient.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of information retrieval method of the destination object of the embodiment of the present invention 1.
Fig. 2 is the schematic diagram of the mobile phone of the embodiment of thepresent invention 3.
Embodiment
Below in conjunction with accompanying drawing, provide preferred embodiment of the present invention, to describe technical scheme of the present invention in detail, but therefore do not limit the present invention among described scope of embodiments.
Embodiment 1
As shown in Figure 1, the information retrieval method of the destination object of the present embodiment comprises the following steps:
S1, photographic subjects object photo, and location obtains current location;
S2, from picture shared data bank, choose all or part of picture that the distance between geographic position and current location is less than the first default distance threshold as co-located picture, the picture wherein having in this picture shared data bank has label and geographic position;
S21, from co-located picture, choose picture that the distance between geographic position and current location is less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, wherein second distance threshold value is less than the first distance threshold;
S3, adopt gabor small wave converting method to extract global feature and the local feature of this photo;
S4, adopt gabor small wave converting method to extract global feature and the local feature of co-located picture, and filter out co-located picture that global feature is identical with this photo with local feature as picture concerned;
S5, obtain the relatively many some labels of multiplicity in the label of all picture concerned;
S6, these some labels are carried out to network retrieval as keyword, and the information that obtains of output retrieval.
Wherein, second distance threshold value is 100 meters, and the first distance threshold is 500 meters.Like this, as step S21in when the determination result is NO, can think that the position of picture concerned and this destination object is almost identical.Now, have greater probability picture concerned for object and this photo in the destination object taken be identical.S2in all or part of picture be: in the situation that meet the picture number that distance between geographic position and current location is less than the condition of the first default distance threshold, be greater than a reference value (in the present embodiment, this reference value is 100), choose meet this condition 100 pictures as co-located picture; Otherwise, choose meet this condition all pictures as co-located picture.
In the present embodiment, the quantity of these some labels is 4, finally utilizes 4 keywords to carry out network retrieval, and network retrieval utilizes google search engine to carry out.
This picture shared data bank in the present embodiment is the picture database of the shared website Flickr of photo and Picasa.At this destination object, for user, be unknown, user cannot initiatively provide in the situation of search key, the search method of the present embodiment can utilize network picture resource automatically effectively to retrieve according to positional information and photo, thereby obtains the information of this unknown destination object.
Embodiment 2
The difference of the information retrieval method of the present embodiment and embodiment 1 is only:
S2by S2areplace S2afor: adopt k-means clustering algorithm by the whole pictures that have in this picture shared data bank according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.That is to say, if in the multiclass picture that adopts k-means clustering algorithm to obtain, mean value and the current location in the geographic position of a certain class picture are the most approaching, just using this class picture as co-located picture.
The step of the k-means clustering algorithm adopting in the present embodiment is as follows:
Step 1, select k object (i.e. picture in this picture shared data bank) as the barycenter (barycenter is herein for geographic position corresponding to picture, the centroid position calculating) of initial bunch at random;
The distance of the barycenter ofstep 2, calculating object and each bunch, is divided into object apart from its nearest bunch;
Step 3, recalculate each average of new bunch, i.e. barycenter;
If the barycenter of step 4 bunch no longer changes, return to division result, otherwise return tostep 2.
Embodiment 3
As shown in Figure 2, the information searching device of the present embodiment is a mobile phone, and this mobile phone comprises a camera module 1, alocating module 2, a primaryimportance screening module 3, a second place screening module 4, characteristics ofimage screening module 5 and a keyword retrieval module 6.
This camera module is for the photo of photographic subjects object, and this locating module obtains current location for location.This primary importance screening module, for choosing all or part of picture that the distance between geographic position and current location is less than the first default distance threshold from picture shared data bank as co-located picture, then enable this second place screening module, the picture wherein having in this picture shared data bank has label and geographic position.
This second place screening module for the picture choosing the distance between geographic position and current location from co-located picture and be less than default second distance threshold value as picture concerned, and remove picture concerned from co-located picture, then enable this characteristics of image screening module, wherein second distance threshold value is less than the first distance threshold.This characteristics of image screening module is for adopting gabor small wave converting method to extract global feature and the local feature of this photo and co-located picture, then filters out picture that global feature is identical with this photo with local feature as picture concerned.
This keyword retrieval module, for obtaining the relatively many some labels of label multiplicity of all picture concerned, and carries out network retrieval using these some labels as keyword, the information that output retrieval obtains.
Embodiment 4
The present embodiment is compared with the mobile phone ofembodiment 3, and difference is only:
This primary importance screening module is replaced by a cluster screening module, this cluster screening module for whole pictures of adopting k-means clustering algorithm this picture shared data bank being had according to geographic Location Classification, and using geographic position and the immediate class picture of current location as co-located picture.
Although more than described the specific embodiment of the present invention, it will be understood by those of skill in the art that these only illustrate, protection scope of the present invention is limited by appended claims.Those skilled in the art is not deviating under the prerequisite of principle of the present invention and essence, can make various changes or modifications to these embodiments, but these changes and modification all fall into protection scope of the present invention.

Claims (9)

CN201310753628.4A2013-12-312013-12-31Method and equipment for retrieving information of target objectsPendingCN103699679A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201310753628.4ACN103699679A (en)2013-12-312013-12-31Method and equipment for retrieving information of target objects

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201310753628.4ACN103699679A (en)2013-12-312013-12-31Method and equipment for retrieving information of target objects

Publications (1)

Publication NumberPublication Date
CN103699679Atrue CN103699679A (en)2014-04-02

Family

ID=50361207

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201310753628.4APendingCN103699679A (en)2013-12-312013-12-31Method and equipment for retrieving information of target objects

Country Status (1)

CountryLink
CN (1)CN103699679A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103995871A (en)*2014-05-222014-08-20东北大学Approximate massive address data nearest neighbor query method
CN104933165A (en)*2015-06-292015-09-23努比亚技术有限公司Data screening strategy generation method and device
CN106294558A (en)*2016-07-262017-01-04北京小米移动软件有限公司Object positioning method and device
CN106354744A (en)*2015-07-162017-01-25三星电子株式会社Method for sharing content information and electronic device thereof
WO2017028573A1 (en)*2015-08-202017-02-23惠州Tcl移动通信有限公司Method and system for processing picture information based on mobile terminal
CN107122499A (en)*2017-06-092017-09-01苏州唯亚信息科技股份有限公司Suitable for the method for quickly querying of R & D Database
CN107577790A (en)*2017-09-182018-01-12北京金山安全软件有限公司Image searching method and device
CN110188230A (en)*2019-05-302019-08-30中煤航测遥感集团有限公司Semantic-based image search method and device
CN110764726A (en)*2019-10-182020-02-07网易(杭州)网络有限公司Target object determination method and device, terminal device and storage medium
CN111881322A (en)*2020-09-282020-11-03成都睿沿科技有限公司Target searching method and device, electronic equipment and storage medium
CN114064953A (en)*2021-11-262022-02-18北京度友信息技术有限公司 Image search method, device, electronic device and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101241504A (en)*2008-01-232008-08-13武汉大学 A content-based intelligent search method for remote sensing image data
CN101340661A (en)*2008-08-142009-01-07北京中星微电子有限公司Guide control implementing mobile apparatus and server, guide control method
CN101847154A (en)*2010-02-262010-09-29宇龙计算机通信科技(深圳)有限公司Method and system for inquiring information and method for mobile terminal to inquire information
CN101924992A (en)*2010-07-302010-12-22中国电信股份有限公司Method, system and equipment for acquiring scene information through mobile terminal
US20110314049A1 (en)*2010-06-222011-12-22Xerox CorporationPhotography assistant and method for assisting a user in photographing landmarks and scenes
CN102411582A (en)*2010-09-212012-04-11腾讯科技(深圳)有限公司Picture searching method and device and client
CN102831242A (en)*2012-09-102012-12-19东莞宇龙通信科技有限公司Method and device for searching picture information
US20120323914A1 (en)*2004-11-292012-12-20Ariel Inventions, LlcStoring and retrieving associated information with a digital image
CN103136228A (en)*2011-11-252013-06-05阿里巴巴集团控股有限公司Image search method and image search device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20120323914A1 (en)*2004-11-292012-12-20Ariel Inventions, LlcStoring and retrieving associated information with a digital image
CN101241504A (en)*2008-01-232008-08-13武汉大学 A content-based intelligent search method for remote sensing image data
CN101340661A (en)*2008-08-142009-01-07北京中星微电子有限公司Guide control implementing mobile apparatus and server, guide control method
CN101847154A (en)*2010-02-262010-09-29宇龙计算机通信科技(深圳)有限公司Method and system for inquiring information and method for mobile terminal to inquire information
US20110314049A1 (en)*2010-06-222011-12-22Xerox CorporationPhotography assistant and method for assisting a user in photographing landmarks and scenes
CN101924992A (en)*2010-07-302010-12-22中国电信股份有限公司Method, system and equipment for acquiring scene information through mobile terminal
CN102411582A (en)*2010-09-212012-04-11腾讯科技(深圳)有限公司Picture searching method and device and client
CN103136228A (en)*2011-11-252013-06-05阿里巴巴集团控股有限公司Image search method and image search device
CN102831242A (en)*2012-09-102012-12-19东莞宇龙通信科技有限公司Method and device for searching picture information

Cited By (15)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103995871B (en)*2014-05-222017-04-12东北大学Approximate massive address data nearest neighbor query method
CN103995871A (en)*2014-05-222014-08-20东北大学Approximate massive address data nearest neighbor query method
CN104933165A (en)*2015-06-292015-09-23努比亚技术有限公司Data screening strategy generation method and device
CN104933165B (en)*2015-06-292018-06-05努比亚技术有限公司Data screening strategy-generating method and device
CN106354744A (en)*2015-07-162017-01-25三星电子株式会社Method for sharing content information and electronic device thereof
WO2017028573A1 (en)*2015-08-202017-02-23惠州Tcl移动通信有限公司Method and system for processing picture information based on mobile terminal
US20170278267A1 (en)*2015-08-202017-09-28HuiZhou TLC Mobile Communication Co., Ltd.Picture information processing method and system based on mobile terminal
CN106294558A (en)*2016-07-262017-01-04北京小米移动软件有限公司Object positioning method and device
CN107122499A (en)*2017-06-092017-09-01苏州唯亚信息科技股份有限公司Suitable for the method for quickly querying of R & D Database
CN107577790A (en)*2017-09-182018-01-12北京金山安全软件有限公司Image searching method and device
CN110188230A (en)*2019-05-302019-08-30中煤航测遥感集团有限公司Semantic-based image search method and device
CN110764726A (en)*2019-10-182020-02-07网易(杭州)网络有限公司Target object determination method and device, terminal device and storage medium
CN110764726B (en)*2019-10-182023-08-22网易(杭州)网络有限公司Target object determination method and device, terminal equipment and storage medium
CN111881322A (en)*2020-09-282020-11-03成都睿沿科技有限公司Target searching method and device, electronic equipment and storage medium
CN114064953A (en)*2021-11-262022-02-18北京度友信息技术有限公司 Image search method, device, electronic device and storage medium

Similar Documents

PublicationPublication DateTitle
CN103699679A (en)Method and equipment for retrieving information of target objects
US20180365489A1 (en)Automatically organizing images
US8831352B2 (en)Event determination from photos
JP5170961B2 (en) Image processing system, image processing apparatus and method, program, and recording medium
US20180108182A1 (en)Context-aware tagging for augmented reality environments
CN104331509A (en)Picture managing method and device
CN104426841A (en)Method for arranging background image, and correlation server and system
JP2007206919A (en)Display control device, method, program and storage medium
US10380267B2 (en)System and method for tagging multimedia content elements
US9665773B2 (en)Searching for events by attendants
US20240037142A1 (en)Systems and methods for filtering of computer vision generated tags using natural language processing
KR101782590B1 (en)Method for Providing and Recommending Related Tag Using Image Analysis
CN105159976A (en)Image file processing method and system
US11347739B2 (en)Performing a chained search function
JP6109118B2 (en) Image processing apparatus and method, information processing apparatus and method, and program
US10885619B2 (en)Context-based imagery selection
JP5289211B2 (en) Image search system, image search program, and server device
Chen et al.Context-aware discriminative vocabulary learning for mobile landmark recognition
CN102253935A (en)System and method for classifying photographs
Constantinou et al.Spatial keyframe extraction of mobile videos for efficient object detection at the edge
Lee et al.Effective car video retrieval using feature matching in a mobile video cloud
Zhong et al.i-Memory: An intelligence Android-based photo management system
Vo et al.WhereAmI: Energy efficient positioning using partial textual signatures
Cheng et al.OSNI: Searching for Needles in a Haystack of Social Network Data.
DoongPredicting the popularity of internet memes with Hilbert-Huang spectrum

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20140402


[8]ページ先頭

©2009-2025 Movatter.jp