Summary of the invention
The objective of the invention is to adopt the automatic collection and the Intelligent treatment of traffic video completely, realization is to the location and the identification of vehicle license, body color, vehicle mark, the information of vehicles of collection and the information of vehicles of vehicle data storehouse record are compared, suspicious fake-licensed car is carried out automatic alarm, prompting traffic-police further evidence obtaining examines, thereby effectively solve and hit the cover board phenomenon of spreading unchecked at present, finish the intellectuality of traffic administration, the real time implementation of processing.
Equipment of the present invention realizes that by the following technical solutions described equipment comprises: the video camera that the video camera of video image acquisition and pattern process computer, video acquisition are used links to each other with pattern process computer by image pick-up card.The video image acquisition video camera can be a ccd video camera, also can be Digital Video, and video camera can use A-frame to be erected at by the road, also can be erected in the vehicle by fixed support.For obtaining license plate image clearly, video camera is monitored two tracks at most.Pattern process computer can be portable Industrial Control Computer, also can be common notebook computer.Pattern process computer has the function of radio communication, can realize being connected with the network of traffic control center by wireless communication module or wireless network card.
A fake-licensed car of the present invention recognition system can be used in warning with automobile, video camera can be placed in the shield glass back by fixed support, the power supply of video camera can provide by vehicle-mounted 12V power supply, the output of video camera is input to computer equipment by video frequency collection card, computer equipment comprises notebook computer or portable industrial pc, computer equipment among the present invention is equipped with sound card, the audible alarm equipment that audio amplifier is formed, car plate steady arm positioning car memorial tablet is put, the car plate recognizer identifies characters on license plate, the body color recognizer is used to discern body color, car mark steady arm is according to the accurate positioning car mark in the position of car plate, the car sign does not identify the car mark according to positioning result, the data base querying device can be according to the car plate result who identifies, body color and car mark result and database are compared, if the vehicle that computer Recognition goes out and the information of vehicles of actual enrollment is not inconsistent or " blacklist " on vehicle, computing machine can be reported to the police by sound and software interface, and the prompting law enfrocement official further examines.Database can be the local data base that has downloaded to computing machine, also can be to connect by wireless network card and command centre by computing machine, supports the long-range data transmission, and the real time access central database is inquired about.
This illustrates that a described fake-licensed car recognition system also can be in the other use of road, video camera can be erected at by the road by A-frame, it is approaching with the car plate height that video camera sets up height, and taking direction can be consistent with vehicle heading, also can be towards vehicle heading.Shooting angle is defined as vehicle heading and the acute angle portion of taking direction, generally between 20 ~ 45 degree, can monitor equidirectional two tracks.
A fake-licensed car of the present invention recognition system adopts the high-definition picture acquisition technique, clear picture, have continuous candid photograph ability, image processing speed is fast, can guarantee can both capture under the different speed of a motor vehicle vehicle and identify information such as car plate, body color and Che Biao.The information that computing machine is preserved comprises vehicle monitoring place, vehicle heading, vehicle time of occurrence, car plate, body color, Che Biao etc., is convenient to the analysis retrieval of lot of data file.
The present invention's video detector is mainly finished the vehicle detection in the video image, and whether vehicle is arranged in the detected image, if discovery has vehicle to occur then starts memory image, and starts recognizer, location and identification car plate, vehicle color and car mark.The work distance of video detector is as follows:
(4) video image obtains: the video image of shot by camera is caught by image pick-up card.
(5) background study: background image is used for the detection of vehicle target, obtains background image by several two field pictures.If ItBe t image constantly, BtIt is the background image of tThen next background constantly has following formula to produce BT+1=α IT+1+ (1-α) Bt, α is a weighting factor, strengthens the influence of current frame image to background.
(6) target detection: target detection mainly is to detect vehicle target, subtract each other by present frame and background image, if gray scale difference greater than preset threshold, is then thought background, for reducing The noise, because car plate part edge abundant information is carried out smoothly with a rectangle frame, if the part greater than threshold value is arranged in the image, then think and include vehicle in this two field picture, trigger, otherwise think do not have vehicle in the image, do not handle.
The present invention's car plate steady arm and recognizer, body color recognizer and car mark steady arm, recognizer have constituted a fake-licensed car core that automatic identification is handled, and the workflow of car plate steady arm is as follows:
(5) difference image that obtains: after video detector detects the image that contains vehicle, trigger the car plate steady arm at once, the car plate steady arm is according to the image detection car plate of catching, and the car plate steady arm carries out difference with image with the Sobel operator, the image high fdrequency component that obtains earlier.
(6) seek the candidate region: the width of general license plate area accounts for 1/5 to 1/7 of picture traverse, with the rectangle frame similar to car plate, its length is respectively from 1/5 to 1/7 of image length, and in entire image, slide, add up its high fdrequency component and, and, count the maximum value of horizontal direction to the horizontal direction projection; Add up the high fdrequency component sum on the maximum position again, to the vertical direction projection, get the maximum value of several vertical direction, the maximum position that level that obtains and vertical direction obtain has constituted the position candidate of car plate.
(7) judgement of license plate area: the candidate region has a plurality of, and car plate has only one or two in the image, the judgement of license plate area is to carry out according to the characteristics of the standard car plate of existing Ministry of Public Security promulgation, present car plate mainly is divided into the civilian car plate of 92 formulas (wrongly written or mispronounced character of the blue end), double cart car plate (yellow end surplus), police car, military vehicle, People's Armed Police's vehicle (white gravoply, with black engraved characters) and part 02 formula car plate.Judge whether the candidate region meets the character queueing discipline to register the license, if, then confidence level is improved, if not, then confidence level reduces, and coming top after the ordering is to be the zone of car plate most possibly.
(8) character cutting: carry out character cutting according to the car plate type of judging, the cutting cost in the process of cost function record cutting is used to weigh the size into the possibility of car plate.
The present invention's car plate recognizer has been finished the identification of characters on license plate and the affirmation of car plate final position, and its workflow is as follows:
(5) character is regular: the single character of car plate that cutting obtains not of uniform size, for ease of identification, to image adopt carry out based on the method for character center of gravity regular, unified regular be 40 * 20 sizes.
(6) feature extraction: only get edge of image, again image be divided into the sub-piece of 8 * 4 sizes, extract the direction character of each sub-piece, with the level of 3 * 3 each sub-piece of template extraction, vertical ,-45 °, the feature of+45 ° of four directions.
(7) character recognition: the feature and the training characteristics that are drawn into are mated, according to the principle output result of arest neighbors.The usefulness because car plate diverse location character rule differs, the scope during coupling is also different, generally speaking, first all is writing a Chinese character in simplified form and military Chinese character of each province, and second is English character, and third and fourth both might be English alphabet, also might be numeral, back three be had only numeral.
(8) confidence level is estimated: confidence level is that the matching degree of character is calculated during according to the cost function of character cutting and character recognition, according to the size of confidence level, and final decision result output, and provide the position of final car plate.
The present invention's body color recognizer is mainly discerned the automobile body color, its workflow is as follows: (4) body color location: the position of car plate is relatively accurate, according to the position of car plate, seeking large stretch of difference value above it is the zone of body color near zero zone.
(5) color conversion: what the spatial model of the coloured image that video camera obtains adopted is the RGB color model, and each pixel has R, G, and the combination of three channel value of B is represented jointly.The HIS space proposes based on the human visual system, has higher precision when being used for identification colors, and calculates simple.So body color RGB is transformed to the HSI space by computing formula.
(6) color identification: in the HSI space, the variation of statistics tone utilizes information such as brightness and saturation degree simultaneously, and vehicle color is classified, and can be divided into: black, white, red, yellow, green, blue etc.
The present invention's car is demarcated the position and has been finished car target Intelligent treatment with recognizer, and its treatment scheme is as follows:
(4) car mark coarse positioning: car mark coarse positioning at first according to the accurate position of car plate, is carried out in certain zone in car target location directly over car plate, seek the general position of car mark.
(5) the car mark is carefully located: may contain unnecessary noises such as the horizontal grid of headstock in the zone of coarse positioning, utilize image enhancement technique, Mathematical Morphology technology that noise is removed, accurately the positioning car mark.
(6) the car sign is not: the car sign does not adopt based on the template matches technology, with binaryzation and regular after car mark on a map the picture mate with known car target image library, the similarity between computed image, the most similar person exports as car mark result, if similarity is less than preset threshold, and refuse to know.
The present invention's data base querying and warning device are the front-end processing parts of a fake-licensed car identification, and its workflow is as follows:
(5) data base querying: by the recognition result of car plate recognizer, body color recognizer and the output of car mark recognizer, with the license plate recognition result is the master index inquiry, inquiry local data base or connect the database of command centre by wireless network is checked in conjunction with body color and car mark again.
(6) automatically report to the police: be registered fake-licensed car if inquire this with the car plate result in database, equipment is directly reported to the police; If not registered fake-licensed car, but the information of vehicles that identifies information of vehicles and record is not inconsistent, and equipment is with alarm.
(7) artificial check and correction: recognition result always has certain error, if recognition result is with a low credibility, but the vehicle of inquiry has cover board suspicion, and device prompts has the artificial nucleus right, and can make amendment to the result.
(8) image is preserved: for preserving the punishment evidence, equipment can adopt the form of .jpg to preserve to the image of capturing.
Below in conjunction with the detailed description of accompanying drawing, the flesh and blood of technical scheme that the present invention may be better understood, identical mark is represented identical device in the accompanying drawing.
Embodiment
An a kind of fake-licensed car identification equipment and method thereof based on car plate, car mark and body color information that the present invention proposes realizes by the following technical solutions.
Fig. 1 is based on a fake-licensed car identification equipment block diagram of car plate, car mark and body color information.As shown in Figure 1, described equipment comprises:
Video detector is used for the obtaining of video image, background study and target detection, occurs if video detector has detected vehicle target, then image is sent into the car plate steady arm, and starts car plate identification, body color identification and car sign not.The car plate steady arm is mainly oriented a plurality of candidate regions of car plate, and the car plate recognizer carries out character cutting to each candidate region, identifies characters on license plate, each zone is provided a confidence level judge the output as a result of that confidence level is the highest.The body color recognizer is according to the accurate location positioning body color of car plate, and the identification body color, and the car plate position that car mark steady arm also provides according to the car plate steady arm is the positioning car mark accurately, and car mark recognizer is discerned the car mark.The data base querying device can be compared according to the car plate result who identifies, body color and car mark result and database, at first inquire about a local fake-licensed car database with the number-plate number of identification, an if fake-licensed car then direct sound and light alarm, if not in a fake-licensed car database, then inquire about command centre vehicle data storehouse, the information of vehicles of the car plate that identifies, car mark and body color and actual enrollment is not inconsistent, computing machine can be reported to the police by sound and software interface, and the prompting law enfrocement official further examines.Database can be the local data base that has downloaded to computing machine, also can be to connect by wireless network card and command centre by computing machine, supports the long-range data transmission, and the real time access central database is inquired about.
The process flow diagram of Fig. 2 video detector.Its concrete steps are as follows:
Video detector obtains video image from input media, and input media can also can be a Digital Video by ccd video camera.Video camera can be erected in the car by fixed support, also can be erected at by the road by A-frame, and the power supply of video camera is provided by vehicle power.Background study is used for the detection of target, and the order of accuarcy of background has influence on the accuracy of target detection, so background study adopts the method for weighting to upgrade.The detection of target can obtain by the mode of frame difference, if region of variation has surpassed preset threshold, then thinking has target to occur, and is for further processing, if there is not target to occur, continues target detection, and upgrades background.
Fig. 3 is an information of vehicles identification processing flow chart.Its step is as follows:
Car plate steady arm and recognizer, body color recognizer and car mark steady arm, recognizer has constituted the core that automatic vehicle identification is handled, the car plate steady arm is the basis of entire process, after video detector detects vehicle, trigger the car plate steady arm at once, the car plate steady arm is according to the informative characteristics of car plate part edge, seek the candidate region, the candidate region of being found has a plurality of, and car plate has only one or two in the image, the judgement of ensuing license plate candidate area is then according to existing car plate standard, judge the whether character queueing discipline of conformance with standard car plate of candidate region, give different confidence levels according to matching degree.Character cutting carries out cutting according to the car plate type of judging, the cutting cost in the process of cost function record cutting also is the size that is used to weigh into the possibility of car plate.The car plate recognizer has been finished the affirmation to the identification of characters on license plate and car plate final position, feature extraction has partly been finished the character feature after the marginalisation has been extracted, the feature and the training characteristics that are drawn into are mated in character recognition, according to the principle output result of arest neighbors.Confidence level is that the matching degree of character is calculated during according to the cost function of character cutting and character recognition, according to the size of confidence level, and final decision result output, and provide the position of final car plate.The position of car plate is relatively accurate, and according to the position of car plate, seeking large stretch of difference value above it is the zone of body color near zero zone.By computing formula body color RGB is transformed to the HSI space.In the HSI space, the variation of statistics tone utilizes information such as brightness and saturation degree simultaneously, and vehicle color is classified, and can be divided into: black, white, red, yellow, green, blue etc.Car is demarcated the position and has been finished car target Intelligent treatment with recognizer, and car target location also is the accurate position according to car plate, carries out car mark coarse positioning in certain zone directly over car plate, seeks the general position of car mark.In the zone of coarse positioning, may contain unnecessary noises such as the horizontal grid of headstock, utilize image enhancement technique, Mathematical Morphology technology that noise is removed, accurately the positioning car mark.Car sign does not adopt based on the template matches technology, with binaryzation and regular after the car picture of marking on a map mate with known car target image library, the similarity between computed image, the most similar person exports as car mark result.
Fig. 4 is data query and warning device.Its workflow is as follows:
Recognition result by car plate recognizer, body color recognizer and the output of car mark recognizer, with the license plate recognition result is the master index inquiry, inquiry local data base or connect the database of command centre by wireless network is checked in conjunction with body color and car mark again.Be registered fake-licensed car if inquire this with the car plate result in database, equipment is directly reported to the police; If not registered fake-licensed car, but the information of vehicles that identifies information of vehicles and record is not inconsistent, and equipment is with alarm.Recognition result always has certain error, if recognition result is with a low credibility, but the vehicle of inquiry has cover board suspicion, and device prompts has the artificial nucleus right, and can make amendment to the result.For preserving the punishment evidence, equipment can adopt the form of .jpg to preserve to the image of capturing.
More than describe and only provide implementation method of the present invention by means of embodiment.For those skilled in the art is conspicuous, the implementation detail that the invention is not restricted to provide above, can realize with additional embodiments under the situation that does not break away from feature of the present invention that some parts among the embodiment decompose, merge or use processor to realize.Therefore, it is illustrative that the embodiment that provides should be considered to, rather than restrictive.Therefore, it is defined by the appended claims realizing and use possibility of the present invention.Thereby the realization various selections of being determined by claim of the present invention comprise that equivalent embodiment also belongs to scope of the present invention.