Summary of the invention
To solve the above-mentioned problems, inventor of the invention provides one kind and by image compares retrieval to determine with reference to figurePicture, and to user prepare indicative purpose ground scheme.
One aspect of the present invention provides a kind of destination image and compares retrieval device, is stored with real scene image number with externalAccording to live-action map database carry out wireless communication, comprising: input operation part can receive the input of user, and according toThe operation at family generates the instruction that retrieval is compared in starting；Navigation portion, on the electronic map according to the destination information of user's inputIt detects destination locations and current location and marks respectively；Control unit receives opening from the input operation partAfter the dynamic relatively instruction of retrieval, control following portion: shoot part, the control unit compare retrieval according to the starting and refer toIt enables and opens the shoot part, so that the shoot part is by the current location in electronic map towards on the basis of the direction of destination locationsIt is scanned shooting in neighbouring a certain range, multiframe is obtained and continuously shoots image；Acquisition unit, the control unit make the acquirementPortion is according to the current location from the navigation portion at a distance from destination locations and current location is towards destination locationsDirection obtains reference picture from the live-action map database；Storage unit, the control unit make the storage unit store the batTake the photograph image and the reference picture；Comparing section, the control unit make the comparing section will be from the described more of the storage unitFrame continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher than in advanceThe ratio first set, it is determined that for the two matching；Display unit, the control unit enable to the display unit show it is described electronicallyFigure or shooting image, a frame and the reference picture successful match in the shooting image described in the comparing section, the displayPortion shows that the frame of successful match shoots image, and identifies destination on it.
Another aspect of the present invention provides a kind of destination image and compares searching system comprising: ustomer premises access equipment and netNetwork server, the ustomer premises access equipment are carried out wireless communication with network server, which compares searching system and outerThe live-action map database for storing real scene image in portion carries out wireless communication, and the ustomer premises access equipment includes: input operationPortion can receive the input of user, and generate the instruction that retrieval is compared in starting depending on the user's operation；Navigation portion, basisThe destination information of user's input detects destination locations and current location on the electronic map and is marked；ControlPortion controls following portion after receiving the instruction that retrieval is compared in the starting from the input operation part: shootingPortion, the control unit start the shoot part according to described instruction, so that the shoot part is with the current location court in electronic mapOn the basis of the direction of destination locations near be scanned shooting in a certain range, obtain multiframe and continuously shoot image；Display unit, the control unit enable to the display unit to show the electronic map or shooting image；The network server packetIt includes: acquisition unit, according to the current location from the ustomer premises access equipment at a distance from destination locations and the court of current locationThe direction of destination locations obtains reference picture from the live-action map database；Storage unit, storage come from the user terminalThe shooting image and the reference picture of the shoot part shooting of equipment；Comparing section, will be from described in the storage unitMultiframe continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher thanWhen preset ratio, it is determined that for the two matching；Shooting image and the reference picture described in the comparing sectionWith success, the control unit of the ustomer premises access equipment makes the display unit show the shooting image of the successful match, and on itIdentify destination.
Another aspect of the present invention provides a kind of destination image and compares search method, comprising: input operating procedure is received and usedThe input at family, and the instruction that retrieval is compared in starting is generated depending on the user's operation；Navigation step, according to the input of user in electricityDestination locations and current location are detected on sub- map and are marked；Step is shot, inspection is compared according to the startingThe instruction of rope by current location towards the direction of destination locations on the basis of near be scanned shooting in a certain range, takeIt obtains multiframe and continuously shoots image；Obtaining step, according to current location at a distance from destination locations and current location withThe direction of destination locations obtains reference picture from the live-action map database；Storing step stores the shooting stepThe reference picture that the acquired shooting image and the obtaining step obtain；Comparison step, will be from describedMultiframe continuously shoots image and reference picture is compared, when the similarity of the shooting image and the reference picture is higher thanPreset ratio, it is determined that for the two matching；It shows step, shows the electronic map or shooting image, in the middle instituteShooting image and the reference picture successful match described in comparison step are stated, then shows the shooting image of the successful match, andDestination out is known in the shooting image subscript.
Specific embodiment
Fig. 1 be show first embodiment of the invention destination image compare retrieval device 100 composition figure.DestinationImage compares retrieval device 100 and is wirelessly communicated by network and the external realization of live-action map database 200.Live-action map dataLibrary 200 can be such as GoogleStreetView(Google streetscape) external data base, wherein the detail image number of storage streetscapeAccording to the live-action map database can be the image data base for capableing of real-time update.
It includes following several functional units that destination image, which compares retrieval device 100 mainly: navigation portion 101, input operationPortion 102, control unit 103, shoot part 104, acquisition unit 105, storage unit 106, comparing section 107, display unit 108.Wherein, navigation portion101 destination informations inputted according to input operation part 102, show electronic map and on the electronic map on display unit 108Current location and destination locations are marked, and driving or Walking Route from current location to destination locations.Input operationPortion 102 can realize the input of user by screen touch-control or voice input.Navigation portion 101 can be used navigation in the prior art and setIt is standby, such as vehicle mounted guidance or Mobile Telephone Gps etc..
After user arrives at the destination nearby according to the navigation in navigation portion 101, if still can not determine specificWhich destination is actually, then can generate the instruction that retrieval is compared in starting by input operation part 102.Control unit 103 is connecingAfter receiving the instruction that retrieval is compared in the starting, start shoot part 104, so that the shoot part is with the current location in electronic mapShooting is scanned near on the basis of towards the direction of destination locations in a certain range, obtains the continuous shooting figure of multiframePicture.The continuity degree that the multiframe continuously shoots image can be set as needed, such as 10 frame per second.So-called current location courtDestination locations direction can by user by observe electronic map judge, be also possible to be detected according to navigation portionObtained current location is towards the direction of destination locations.The so-called current location in electronic map is towards the side of destination locationsA certain range can be as shown in figure 3, refer to the direction for determining current location in electronic map towards destination near on the basis ofAfterwards, a certain range nearby determined at left and right sides of it, it is a certain range of the reason is that in order to enable the choosing of coverage to select thisIt selects and is unlikely to excessively wide in range with certain Objective, but also there is certain amplitude to be unlikely to excessively narrow.Certainly this oneEven determine range be also towards even 360 ° of the range of 180 ° on the basis of the direction of destination locations by current location can be with, the frame number for the shooting image that only such scanning shoot obtains is more, correspondingly requires higher processing capacity.
The shooting head of portable unit such as mobile phone can also be used in shoot part 104 using vehicle-mounted shooting head.Pass through shoot partThe multiframe shooting image of 104 shootings is stored in storage unit 106 for comparison later.
Meanwhile control unit 103 is after receiving the starting and comparing the instruction of retrieval, according to carrying out working as auto-navigation portion 101Front position is at a distance from destination locations and current location is towards the direction of destination locations, so that acquisition unit 105 is from describedLive-action map database 200 obtains reference picture.Theoretically, according to current location at a distance from destination locations and present bitIt is unique for setting towards reference picture acquired by the two parameters of the direction of destination locations.But actual conditions are, due toThe difference (such as Various Seasonal, different period among one day) for the period that reference picture itself obtains, the reference pictureItself have some differences, such as shooting when the image that is blocked to building of summer wooded and withered winter treesImage be different, such as image captured by dusk and high noon also can be different.In addition, due to live-action map database 200The maintenance and operating condition of itself, image update situation is also different, such as can be shared etc. by the data cloud of online friendMode real-time update, consequently, it is possible to storing the image data at a large amount of same visual angles.Therefore, reference picture also can be for oneIt is multiple.
Then, continuous to the multiframe from the storage unit by comparing section 107 according to the control of control unit 103Shooting image and reference picture be compared, when shooting image and reference picture similarity be higher than preset ratio, thenIt is determined as the two matching.Various manner of comparison in the prior art can be used as the method for specific image comparison, such as take turnsWide manner of comparison, binary conversion treatment manner of comparison, division block manner of comparison etc., this will not be detailed here.When comparing section 107 is looked forTo when being higher than preset ratio (such as 90% similarity) with the similarity of reference picture, control unit 103 makes display unit108 show the shooting image of the successful match, and according to the cartographic information in live-action map database on frame shooting imageMark destination, such as destination gone out with thick circle, or in different colors or bloom show destination, as long as be convenient for userIt identifies and finds destination accordingly.As shown in figure 4, in figure 1300 indicate successful match shooting image, 1301 indicate quiltsThe destination (or destination building) marked.If comparing section 107 does not find to be higher than with the similarity of reference picture and set in advanceThe shooting image of fixed ratio can also then show similar " no matching image " such prompt by display unit 108.In addition, alsoMatching result (successful match or without matching) can be notified by auditory tone cues portion 109.Certainly, auditory tone cues portion 109 is optionalGround is configured, and can also be omitted.
In addition, when comparing section 107 does not find the shooting image with the similarity of reference picture higher than preset ratio,Also the scanning shoot range of shoot part 104 can be made to expand by control unit 103, and re-shoot.Then by comparing portion 107Compare once again.
Fig. 2 is the flow chart for showing the destination image search method of first embodiment of the invention.
In step S201, according to the destination information that user inputs, shows electronic map and mark purpose status on itIt sets and current location, that is, the movement that navigation portion is carried out.In step S202, starting is generated depending on the user's operation and is comparedThe instruction of retrieval.Then, in step S203, the instruction of retrieval is compared according to above-mentioned starting, by the shoot parts such as camera intoRow scanning shoot, the range of scanning shoot can be using the current location in electronic map towards the direction of destination locations as baseA certain range near standard continuously shoots image thus to obtain multiframe, at the same according to current location and destination locations away fromFrom and current location towards the direction of destination locations from live-action map database obtain reference picture, and store above-mentioned shooting figurePicture and reference picture.
Then, step S204 is entered, image comparison is carried out to shooting image and reference picture.
Then judge that whether shoot image and reference picture matches, and can usually preset a ratio threshold in step S205Value then determines that the two matches when shooting image is greater than the proportion threshold value with the similarity of reference picture, enters step S206, i.e.,It shows the frame and the matched shooting image of reference picture, and on it marks destination.If step S205 judges shooting figureAs being mismatched with reference picture, then in step S207, by unmatched result notice to user.
Above destination image, which compares retrieval device and corresponding destination image search method, can carry out according to practical feelingsVariation is made in condition and requirement, and several change case are given below.
Change case 1
Multiframe captured by shoot part 104, which continuously shoots image, can respectively contain such as shooting time, shooting directionDeng image information, such as the image for shooting and storing with Exif format.In this way, 107 pairs of shooting images of comparing section with reference to figureAs when being compared, first comparing the shooting direction of shooting image and the shooting direction of reference picture, when the two is consistent, then compareThe content of the image of reference picture and shooting image itself.The processing time of comparing section 107 can be saved in this way.Above-mentioned shootingThe shooting direction of image and the shooting direction of reference picture it is consistent both refer to it is substantially the same, that is, the error both allowed existsIn predetermined angular range.The predetermined angular range can be set as needed, when the consistency to shooting directionIt is required that the angular range is set as smaller when high.Such as the angular range may be configured as 1 °.
Change case 2
As described above, control unit can compare the instruction of retrieval by the starting that input operation part generates to make according to userIt obtains other each portions' startings and compares retrieval.But it alternatively, can also be by navigation portion 101 to current location and destination locationsThe detection of distance when above-mentioned current location is less than predetermined distance at a distance from destination locations, such as at 200 meters, that is, shows to useWhen family is had come near destination, prompting the user with control unit 103 by display unit 108 or auditory tone cues portion 109 etc. isIt is no to need to issue the instruction that retrieval is compared in starting.User can generate starting to input operation part 102 according to the prompt and compare retrievalInstruction.
Change case 3
As noted previously, as acquisition unit 105 is according to current location at a distance from destination locations and current location is towards meshThe reference picture that is obtained from live-action map database of direction of position may be one or more.When reference picture is moreWhen a, compared with comparing section 107 carries out one by one multiple reference pictures with shooting image.In addition, alternatively, can also first determineThen best reference picture is compared by best reference picture with shooting image again.The selection of best reference picture can basisDifferent situations are carried out with different standards.For example, the multiframe as captured by shoot part 104 continuously shoot image can be respectiveIncluding, for example, the image information of shooting time, shooting direction etc., therefore can be according to the shooting time of shooting image from multiple ginsengsIt examines and selects best reference picture in image.For example, if being selected, being drawn according to 1 year season difference with season sectionThen sectional, such as be divided into four season sections of spring, summer, autumn and winter compares the shooting time of shooting image and multiple with reference to figureSeason section locating for the acquirement time of which of picture is identical or closest, then comparing section 107 is identical by the season sectionOr immediate reference picture is as best reference picture.Or to divide time section at the time of one, such as divideFor 07:00~11:00,11:00~13:00,13:00~18:00,18:00~next day 07:00 this four time sections, work as instituteThe shooting time for stating shooting image is identical as time section locating for the acquirement time of one in multiple reference pictures or most connectClosely, then the comparing section 107 using the reference picture as best reference picture.Certain above two selection mode can also be tied mutuallyIt closes and uses, to select best reference picture.The divisions of various time sections and combination are there are also very much, different an example hereinIt lifts.
Change case 4
It as described in above-mentioned change case 3, in the case that reference picture is multiple, can be divided by time section, with selectionBest reference picture.But the best reference picture chosen in this way may also be multiple, such as in same season section,If being stored with multiple reference pictures in live-action map database, it can all be chosen as best reference picture.At this point it is possible toFurther in more multiple best reference pictures obtain the time and shoot image shooting time it is immediate that, asFinal reference image.
It is that the purpose of the present invention image compares retrieval device and its adoptable various change of corresponding method aboveExample, those skilled in the art can carry out various modifications in optimum range, combination to it.
In addition, the destination image of first embodiment of the invention compare retrieval device in actual implementation, do not need forCompletely new device, each function part therein is available or is equipped in existing various equipment.Such as navigation portion, shootingPortion, display unit can utilize mobile unit or navigation portion and shoot part on portable equipment such as smart phone, other each function partsAlso it is equipped on existing mobile unit or portable equipment.
Fig. 5 shows that the destination image of second embodiment of the invention compares the composition figure of searching system.
Destination image in second embodiment compares searching system compared with the destination image of first embodimentThe difference of retrieval device is, the public server in the configuration of some of which function part on network.This have the advantage that,The workload for needing the comparing section of higher position reason ability can be placed on the higher server of process performance, thus can be reducedThe workload of ustomer premises access equipment (such as portable telephone, mobile unit etc.) improves integral retrieval speed.Therefore in addition to function part is matchedSeated position is different, and the working principle of other each function parts is identical with first embodiment.In the following, comparing inspection to the destination imageCable system carries out simple illustration.
As shown in figure 5, it includes ustomer premises access equipment 31 and network server 32 that destination image, which compares searching system 300, it is somebody's turn to doDestination image compares searching system 300 and carries out wireless communication with live-action map database 400.Wherein, 31 He of ustomer premises access equipmentNetwork server 32 also carries out wireless communication.Live-action map database 400 can be such as GoogleStreetView(Google streetScape) etc. external data bases, wherein storage streetscape detail image data
Ustomer premises access equipment 31 includes: input operation part 311, control unit 312, navigation portion 313, shoot part 314, display unit315.Network server 32 includes: storage unit 321, acquisition unit 322, comparing section 323.Ustomer premises access equipment 31 and network server 32The corresponding first embodiment of movement that carries out of each function part in destination image compare each function in retrieval device 100Portion.
In addition, each portion in ustomer premises access equipment 31 can be also arranged respectively in mobile unit or intelligent portable objects or benefitWith the existing function part in mobile unit or intelligent and portable equipment.
Above several embodiments of the invention are described, but these embodiments are only used as an example, andWithout the intention for limiting invention scope.These embodiments can be implemented by other various forms, lead without departing from inventionVarious omissions, displacement, change are carried out in the range of purport.These embodiments and its deformation are included in invention scope and masterWhile in purport, it is also contained in the invention recorded in claims and the range impartial with it.