Summary of the invention
The technical matters that the present invention mainly solves provides a kind of image searching method, device and server, can search for picture, returns user's picture relevant with picture and relevant Word message, for the user provides more resource and service.
For solving the problems of the technologies described above, the technical scheme that the present invention adopts is: a kind of method of picture searching is provided, comprises: obtain at least one information in the realm information of the eigenwert of described picture, the data message that described picture is relevant, described picture; Described at least one the information of obtaining is sent to server; Receive described server and mate obtain corresponding to described picture related information according to described at least one the information of obtaining, wherein, described related information comprises the samples pictures that is complementary with described picture and/or the Word message that is complementary with described picture.
Wherein, described reception server mates after the step of the related information corresponding with described picture that obtains, and also comprises: current positional information and at least one information output in the temporal information and the corresponding service prompts of described picture of realm information, user of utilizing described picture.
Wherein, the described step of obtaining the relevant data message of picture comprises: the title, web page address, content, author, the news relevant with described picture, at least one information in the network service of obtaining described picture.
Wherein, before the step of at least one information in the realm information of the described eigenwert of obtaining picture, data message that picture is relevant, picture, also comprise: by to the current interface sectional drawing and identify to obtain the described picture that needs are searched for.
Wherein, described to the current interface sectional drawing and identify to obtain to need the step of the described picture of search to comprise: the image that the current interface sectional drawing is obtained comprising the current interface content; Demarcate picture in the described image and the literal of picture format by pattern-recognition; To the picture in the described image identify and obtain with described image in the adaptive candidate's picture of picture as the described picture of needs search.
For solving the problems of the technologies described above, another technical solution used in the present invention is: a kind of method of picture searching is provided, comprises: server receives at least one information in the realm information of the relevant data message of the eigenwert of described picture, described picture, described picture; At least one information in the data message that server is relevant with the eigenwert of described picture, described picture, the realm information of described picture and the information in the picture database are mated, obtain the related information corresponding with described picture, and the described related information that will obtain returns to client, wherein, described related information comprises the samples pictures that is complementary with described picture and/or the Word message that is complementary with described picture.
Wherein, before the step that described server mates at least one information in the realm information of the eigenwert of picture, data message that picture is relevant, picture and the information in the picture database, also comprise: server is set up for the picture database that mates.
Wherein, described server foundation comprises for the step of the picture database that mates: from figure film source capturing pictures; Obtain at least one information in the realm information of picture of the relevant data message of the picture of the eigenwert of the picture of described crawl, described crawl and described crawl; Store and set up index at least one in the realm information of the picture of the relevant data message of the picture of the eigenwert of the picture of described crawl, described crawl and described crawl, to set up picture database.
The step of the data message that wherein, the described picture that obtains crawl is relevant comprises: the title, web page address, content, author, the news relevant with the picture of described crawl, at least one data message of information of network service of obtaining the picture of described crawl.
In order to solve the problems of the technologies described above, another technical scheme that the present invention adopts is: the device that a kind of picture searching is provided, comprise acquisition of information module, sending module and information receiving module, wherein: described acquisition of information module is at least one information of the realm information that obtains the eigenwert of described picture, the data message that described picture is relevant, described picture, and described at least one the information output that will obtain given described sending module; Described at least one the information that described sending module is used for described acquisition of information module is obtained sends to server; Described information receiving module is used for receiving the related information corresponding with described picture that obtains after described at least one the information of described server by utilizing is mated, wherein, described related information comprises the samples pictures that is complementary with described picture and/or the Word message that is complementary with described picture.
Wherein, described device also comprises the service prompts module, is used for utilizing the current positional information of realm information, the user of described picture and at least one acquisition of information and the corresponding service prompts of described picture of temporal information, exports to described information receiving module; Wherein, described information receiving module also is used for receiving the described service prompts from described service prompts module.
Wherein, described device also comprises the picture acquisition module, and being used for the current interface sectional drawing and identifying to obtain needs the described picture of search and send to described acquisition of information module.
Wherein, described picture acquisition module comprises sectional drawing unit, division unit and recognition unit, and wherein: described sectional drawing unit is used for the current interface sectional drawing is obtained comprising the image of current interface content, and described image is sent to described division unit; Described division unit be used for to receive the described image from the sectional drawing unit, and demarcates picture in the described image and the literal of picture format by pattern-recognition, and the picture in the described image is sent to described recognition unit; Described recognition unit be used for to the picture of described image identify and obtain with described image in the adaptive candidate's picture of picture as the described picture of needs search, and send to described acquisition of information module.
In order to solve the problems of the technologies described above, provided by the invention also have a technical scheme to be: a kind of picture searching server is provided, comprise that picture database, information receiving unit, matching unit and information returns the unit, wherein: picture and relevant information that described picture database mates when being used for providing picture searching, picture database comprises at least one information in the realm information of picture and the data message relevant with corresponding picture feature value, the picture of described picture, picture, and sets up index according to described picture and corresponding information; Described information receiving unit is used for receiving at least one information from the realm information of the eigenwert of the described picture of user side, the data message that described picture is relevant, described picture, and described at least one the information that will receive sends to described matching unit; Described matching unit is used at least one information of the realm information of the eigenwert of described picture, the data message that described picture is relevant, described picture and the information in the picture database are mated, obtain the related information corresponding with described picture, described related information is exported to described information return the unit; Described information is returned the unit and is used for and will returns to client from the described related information of described matching unit, and wherein, described related information comprises the samples pictures that is complementary with described picture and/or the Word message that is complementary with described picture.
The invention has the beneficial effects as follows: the situation that is different from prior art, image searching method provided by the invention, eigenwert by obtaining picture, relevant data and realm information etc., and the data in the database of setting up in advance with server are compared, thereby Search Results can be returned with the relevant information of picture, for the user provides more detailed information and Service Source.
Embodiment
See also Fig. 1, image searching method one embodiment of the present invention comprises:
Step S101: obtain at least one information in the realm information of the relevant data message of the eigenwert, picture of picture, picture;
At user side, obtain the eigenwert of the picture that needs search, can but be not limited to by obtain the eigenwert of picture in the image based on the histogram feature extraction algorithm of gradient, based on any mode in metric space theory characteristic extraction algorithm and the filtering feature extraction algorithm.Such as, can extract the feature obtain figure itself by eigenwert, such as the figure left side 1 centimeters eyes are arranged, at the bottom of the figure above 2 centimeters a face is arranged.In actual application, in the situation of conditions permit, can obtain as much as possible the relevant data of the picture that needs search such as the author of picture name, URL (web page address), image content, picture, news that picture is relevant, network service etc., the realm information of picture is such as video display star, building, food and drink etc.Need the picture degree of association of search larger so that Search Results is followed, shorten the acquisition of information time.
Step S102: at least one information will obtaining is sent to server;
To all be sent to server in the information that user side obtains, server carries out information matches according to the information from user side that receives in database.If what obtain such as user side is the eigenwert of picture, then mate the related information that finds the eigenwert with picture to be complementary according to the eigenwert of picture; The relevant data of the eigenwert of picture and picture and the realm information of picture etc. if user side obtains, server then mates according to the relevant data of the eigenwert of picture and picture and the realm information of picture respectively, the related information that finds all to be complementary, and these related informations are returned to the user.Wherein, related information comprises the samples pictures that is complementary with picture and/or the Word message that is complementary with picture.
Step S103: reception server mates the related information corresponding with picture that obtains;
Server carries out information matches according to the information from user side in database, find with related information corresponding to picture that needs search and return to user side.Wherein, related information comprises the samples pictures that is complementary with picture and/or the Word message that is complementary with picture.Search for such as the famous painting " night of a star-studded sky " to the van gogh, can return this width of cloth and draw auction price, story behind, van gogh's information is drawn a picture the time etc.; Search for such as the head portrait to certain star, can return the information that this star of user is correlated with, such as he the native place, when engage in this profession and his relevant works etc.Even the star that can also obtain in conjunction with the realm information of picture in the picture is film ﹠ TV circles, can return news search that the user is correlated with this star or microblogging speech etc.In another kind of situation, can also utilize current positional information and the related information corresponding service prompts corresponding with picture of at least one information output in the temporal information of realm information, user of picture.When service prompts referred to that the related information that obtains when picture searching can provide the user more to serve, prompting user can be selected the prompting of corresponding service.If such as user search be near the picture in a dining room the user present position, at this moment can obtain the current positional information of user and current time information in conjunction with relevant application, return the service prompts of user's Reserved seating etc.; Or the picture in a hotel of user search, can return predetermined service prompts in the relevant brief introduction in this hotel of user and room etc.At this moment can operate accordingly the selection of these service prompts according to the user.Can select predetermined hotel room such as the user, at this moment will enter the interface in this hotel reservation room; If the user does not select corresponding service, then remain on not execution action of current interface.
Wherein, in actual application, the user is if when searching for the picture in the current application interface, can also be by to the current interface sectional drawing and identify the picture that obtains needing search, specifically can consult Fig. 2, the present invention by sectional drawing and the step of identifying the picture that obtains needing search comprise:
Step S201: the image that the current interface sectional drawing is obtained comprising the current interface content;
When the user need to search for the picture in the current interface, can obtain to the current interface sectional drawing and by the mode of picture recognition the picture that needs search.Carry out sectional drawing such as one piece of article to current display interface, a lot of literal are arranged in this article, attached several pictures.The user can be only in sectional drawing to the picture part or only word segment is carried out sectional drawing, also can be to literal and picture part together sectional drawing.
Step S202: by pattern-recognition, divide literal at least a of the picture obtain in the image, picture format;
Utilize pattern-recognition (literal, image etc.) method that the literal of the picture in the image of required identification and picture format is all marked respectively.Carry out sectional drawing such as one piece of article to current display interface, a lot of literal are arranged in this article, attached several pictures, if the user only carries out sectional drawing to word segment, then the result of pattern-recognition just only has the literal of picture format; If the user only partly carries out sectional drawing to picture, then the result of pattern-recognition just only has the picture in the image; If the user is to literal and picture together sectional drawing, then the result of pattern-recognition had both comprised that picture in the image also comprised the literal of picture format.All the elements in the sectional drawing all can be marked respectively, indicate respectively with literal such as picture, every pictures marks separately (as living with red circle) etc.Certainly, also can choose a part according to user's needs indicates.Such as drawing a virtual box, only indicate the interior part picture of virtual box or literal etc.
After sign was finished, at this moment the user can choose corresponding part and identify to obtain the picture that needs search.When the user chooses the part that marks accordingly and identifies, various ways can be arranged.Such as can be by picture frame on the literal of the picture in image or picture format, smear, delineate, click and the self-defined at least a mode of choosing in the mode choose.Such as passing through a picture frame, perhaps with a virtual circle on the content (such as a string literal or picture) of required identification, can accurately choose the picture that needs identification by the size of adjusting frame; Such as if touch screen interface can be chosen the picture that needs identification by the mode of delineating or smearing with finger, also can accurately obtain the picture that needs identification by the scope that adjustment is delineated or smeared again.Can certainly be to utilize picture frame, delineate and smear the mode that combines to choose.Such as drawing a very large frame, choose the picture that needs identification by the mode of smearing, delineating, can also find out picture that needs identification etc. such as the mode of phonetic entry, handwriting input by the self-defined mode of choosing.
Step S203: will to the picture in the image identify and obtain with image at least a picture as needing search of literal of the adaptive candidate's picture of picture, picture format;
In actual application, the user may partly carry out sectional drawing to literal or the picture to current interface only, also may picture and word segment sectional drawing together.When including picture in user's the sectional drawing, the picture in the image identified to obtain and the picture of the adaptive candidate's picture of picture as the needs search.In the time need to identifying the picture in the image, at first obtain the eigenwert of the picture in the image, find with the adaptive candidate's picture of the picture in the image according to eigenwert, these adaptive candidate's pictures might be with the same picture of picture in the image, also might be with the relevant picture that relatively approaches of the picture in the image.Such as the picture that belongs to same field with the picture in the image, if the picture perhaps in the image can obtain picture concerned of same star or artist etc. about certain star or artist.
It is worth mentioning that, can be as the picture of needs search by the literal of the picture in the image being identified the picture format that candidate's picture of obtaining or sectional drawing obtain.That is to say that when the user only carried out sectional drawing to the literal of current interface, the literal by the resulting picture format of sectional drawing was as the picture of needs search; When the user only carries out sectional drawing to the picture of current interface, the picture in the image that sectional drawing is obtained identify and the adaptive candidate's picture of the picture with in the image that obtains as the picture of needs search; The user is to literal and picture together sectional drawing, the picture in the image that then sectional drawing is obtained identify and the literal of the adaptive candidate's picture of the picture in image that obtains and picture format as the picture that needs search.In this case, can make the result of picture searching more accurate.If such as the interface that currently is " bird of indignation ", include the picture of bird on the interface, include literal " bird of indignation " below the bird picture.If at this moment the user obtains the image of the picture that comprises bird and following literal by sectional drawing, so the picture of bird is identified candidate's picture that may obtain various birds, if the picture of only searching for as needs with candidate's picture of bird, return results may have the picture of bird and the introduction of various birds etc.And if with candidate's picture of bird in conjunction with the literal " bird of indignation " of picture format together as the picture that needs to search for, at this moment server can extract Word message from the literal of picture format, candidate's picture in conjunction with Word message and bird mates in server database together, can return and comprise " bird of indignation " information that game is relevant, such as game download address, game on line address etc., this and user's demand is pressed close to more.
Description by above-mentioned embodiment, be appreciated that, the image searching method that the application provides, information is compared in relevant information by obtaining the candidate's picture that needs search and the database set up in advance with server, thereby obtain with the relevant information of picture and return to the user, can also provide more service prompts for the user in conjunction with user's actual conditions, save the time that the user searches resource, can obtain again simultaneously reliable comprehensively information, a kind of more powerful way of search is provided.
In addition, if need to search for the picture in the current interface, do not need to withdraw from current interface or the picture in the interface is done too much operation can realize the picture in the current interface is searched for, reduce the courses of action that the user searches for the picture in the current interface, convenient and swift.
See also Fig. 3, another embodiment of image searching method of the present invention comprises:
Step S301: at least one information in the realm information of the eigenwert of server reception picture, the data message that picture is relevant, picture;
Server receives the eigenwert of the picture of the needs search of obtaining from user side, the data that picture is relevant, such as the author of picture name, URL (web page address), image content, picture, news that picture is relevant, network service etc., the realm information of picture is such as video display star, building, food and drink etc.
Step S302: server mates the information of reception and the information in the picture database, obtains the related information corresponding with picture;
Server with the information that receives with its in picture database in information mate and obtain the related information corresponding with the picture of searching for, and these related informations are returned to user side.In actual application, can also return the more service of user side or information in conjunction with user current positional information and temporal information.
Wherein, the picture database of server comprises a large amount of pictures and the information of being correlated with picture, and server is set up the flow process of picture database can consult Fig. 4, may further comprise the steps:
Step S401: from figure film source capturing pictures;
Have much from the mode of figure film source capturing pictures, such as being the picture that the user uploads on the website, it also can be the picture that from other system, imports, also can be to obtain by the internet page crawl of web crawlers from magnanimity, perhaps in above several sources one or more modes in conjunction with and the picture that obtains, the present invention does not do restriction to this.
Step S402: obtain at least one information in the realm information of picture of the relevant data message of the picture of eigenwert, crawl of the picture of crawl and crawl;
After grabbing picture from the figure film source, therefrom obtain the eigenwert of these pictures, the data message relevant with these pictures such as the author of picture name, URL (web page address), image content, picture, news that picture is relevant, network service etc., the realm information of picture is such as video display star, building, food and drink etc.
Step S403: at least one the information of obtaining is stored and index, set up picture database;
Server is stored and index the information that gets access to, and sets up picture and picture database corresponding to information relevant with picture.
It is worth mentioning that the picture database of foundation is not changeless, that is to say that server can grasp new picture constantly, picture database is upgraded, comprehensive as far as possible to guarantee the information that picture search result returns.
See also Fig. 5,picture searching device 100 1 embodiments of the present invention comprise acquisition ofinformation module 11, sendingmodule 12 andinformation receiving module 13, wherein:
Acquisition ofinformation module 11 is used for obtaining at least one information of the realm information of the eigenwert of picture, data message that picture is relevant, picture, and with the information output that obtains to sendingmodule 12;
Acquisition ofinformation module 11 is obtained at least one information in the realm information of the eigenwert of the picture that needs search, data message that picture is relevant, picture, and with the information output that obtains to sendingmodule 12.
The information that sendingmodule 12 is used for acquisition ofinformation module 11 is obtained sends to server;
Information receiving module 13 is used for that information that reception server utilizes acquisition ofinformation module 11 to obtain is mated and the related information corresponding with picture that obtain;
Information receiving module 13 reception servers carry out information matches according to the information from user side in database, and related information corresponding to picture with the needs search that finds.
Preferably, picture searching device one embodiment of the present invention also comprises:
The service prompts module is used for utilizing at least one acquisition of information and the corresponding service prompts of picture of the current positional information of realm information, the user of picture and temporal information, exports toinformation receiving module 13;
The service prompts module can be according to user's current real-time information current location or the zone time such as the user, provide such as make a reservation on the net, the service prompts of booking tickets on net.
Preferably, picture searching device one embodiment of the present invention also comprises the picture acquisition module, and being used for the current interface sectional drawing and identifying to obtain needs the described picture of search and send to described acquisition of information module.
Can consult Fig. 6, the picture acquisition module of picture searching device one embodiment of the present invention further comprisessectional drawing unit 110, division unit 111 andrecognition unit 112, wherein:
Sectional drawing unit 110 is used for the current interface sectional drawing is obtained comprising the image of current interface content, and image is sent to division unit 111;
When the user need to search for the picture in the current interface, can obtain comprising by the 110 pairs of current interface sectional drawings in sectional drawing unit the image of current interface content, and image is sent to division unit 111.
Division unit 111 is used for receiving the image fromsectional drawing unit 110, and demarcates picture in the image and the literal of picture format by pattern-recognition, and the picture in the image is sent torecognition unit 112;
Division unit 111 can utilize pattern-recognition (literal, image etc.) method the picture in the image of required identification to be marked to send torecognition unit 112 identify.
Recognition unit 112 be used for to the picture of image identify and obtain with image in the adaptive candidate's picture of picture as the picture of needs search;
Recognition unit 112 by the picture in the image is identified obtain with image in the adaptive candidate's picture of picture be used as the picture that needs search.
See also Fig. 7, picture searching server one embodiment of the present invention comprises thatpicture database 22,information receiving unit 21, matchingunit 23 andinformation returns unit 24, wherein:
Picture and relevant information that picturedatabase 22 mates when being used for providing picture searching, picture database comprises at least one information in the realm information of picture and the data message relevant with corresponding picture feature value, the picture of described picture, picture, and sets up index according to picture and corresponding information;
Information receiving unit 21 is used for receiving at least one information of the realm information of eigenwert from the picture of user side, data message that picture is relevant, picture, and at least one the information that will receive sends to matchingunit 23;
Matching unit 23 is used at least one information of the realm information of the eigenwert of picture, data message that picture is relevant, picture and the information in the picture database are mated, and obtain the related information corresponding with picture, and the information of exporting to is returnedunit 24;
Information is returnedunit 24 and is used for and will returns to client from the related information of matching unit.
Description by above-mentioned embodiment, be different from the situation of prior art, the invention has the advantages that: a kind of image searching method is provided, eigenwert by obtaining picture, relevant data and realm information etc., and the data in the database of setting up in advance with server are compared, thereby Search Results can be returned with the relevant information of picture, can only return situation with the relevant picture of picture with respect to existing picture searching, image searching method of the present invention can provide more detailed information and Service Source for the user.
In several embodiments provided by the present invention, should be understood that disclosed apparatus and method can realize by another way.For example, device embodiments described above only is schematic, for example, the division of described module, only be that a kind of logic function is divided, during actual the realization other dividing mode can be arranged, for example a plurality of modules or assembly can in conjunction with or can be integrated into another system, or some features can ignore, or do not carry out.Another point, the shown or coupling each other discussed or direct-coupling or communication connection can be by some interfaces, indirect coupling or the communication connection of device or unit can be electrically, machinery or other form.
Described functional module as the separating component explanation can or can not be physically to separate also, the parts that show as the unit can be or can not be physical locations also, namely can be positioned at a place, perhaps also can be distributed on a plurality of network element.Can select according to the actual needs wherein some or all of unit to realize the present invention program's purpose.
In addition, each functional module in each embodiment of the present invention can be integrated in the processing unit, also can be that the independent physics of each functional module exists, and also can two or more functional modules be integrated in the unit.Above-mentioned integrated unit both can adopt the form of hardware to realize, also can adopt the form of SFU software functional unit to realize.
The above only is embodiments of the present invention; be not so limit claim of the present invention; every equivalent structure or equivalent flow process conversion that utilizes instructions of the present invention and accompanying drawing content to do; or directly or indirectly be used in other relevant technical fields, all in like manner be included in the scope of patent protection of the present invention.