Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, completeSite preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based onEmbodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every otherEmbodiment shall fall within the protection scope of the present invention.
Referring to Figure 1, Fig. 1 is that a kind of process of the illegal monitoring and managing method of Manpower Transportation provided in an embodiment of the present invention is shownIt is intended to, as shown in Figure 1, comprising the following steps:
101, image information is obtained, described image information includes the non-motor vehicle feature of non-motor vehicle and the face spy of personnelSign.
Wherein, above-mentioned image information can be acquired by the traffic camera that crossing or roadside is arranged in, and be used forThe traffic camera of acquisition, which can be, to be shared with motor vehicle camera and/or pedestrian's camera, is also possible to be separately providedNon-motor vehicle acquisition camera.Above-mentioned non-motor vehicle can be the non-motor vehicles such as bicycle, tricycle, electric vehicle, balance car,Above-mentioned non-motor vehicle feature can be the non-motor vehicles feature such as headstock, handle, pedal, tire.Above-mentioned face characteristic can beThe face characteristics such as face contour, mouth, eye, nose.
It should be noted that may include one or more non-motor vehicle feature in the image information that step 101 is extracted,And one or more face characteristic.In addition, above-mentioned image information may also be referred to as pictorial information visual information orPicture frame information.
In some possible embodiments, image information further includes the posture feature of personnel, and posture feature can be handThe posture features such as posture, foot's posture, upper body posture, by the posture feature for analyzing personnel, it can be determined that personnel whether there isPeople is not judged for example, can judge whether the hand of personnel leaves handle by posture feature by the situation that rule drive non-motor vehicleWhether the foot of member is placed on specified position etc..
102, the non-motor vehicle feature and the face characteristic are tracked, obtains the movement letter of the non-motor vehicleThe motion information of breath and the personnel.
In the step, tracking refers to continuously acquiring the image of non-motor vehicle feature and face, is getting non-motor vehicleAfter feature and face characteristic, can by adjusting camera shooting angle to non-motor vehicle feature and face characteristic carry out withTrack is shot for example, two groups of cameras can be set, and for shooting still image, one group of camera is used for one group of cameraTrack up dynamic image, certainly, two groups of cameras are not to the present invention only to facilitate illustrate the acquisition modes of imageThe limitation of embodiment, is also possible to one or more groups of cameras, the quantity of every group of camera at least one, certainly, it is some canIn the embodiment of energy, camera can also use wide-angle camera, and wide-angle camera possess wide field range, so as toNon-motor vehicle feature and face characteristic can be tracked without the shooting angle by adjusting camera.It can be by moreThe motion information of non-motor vehicle feature is calculated in the misalignment of non-motor vehicle feature on frame image and time, non-maneuverThe motion information of vehicle feature is exactly the motion information of motor vehicle, for example, the 1st frame image is to be with the 200th frame image spacing time4s, non-motor vehicle are that 0m locates in the hypothesis on location of the 1st frame image, in the position of the 200th frame image at 20m, then availableThe average speed of non-motor vehicle is 5m/s, and above-mentioned unit can be rice, the pixel being also possible on image, is not done herein specificIt limits.The motion information of above-mentioned non-motor vehicle can be non-motor vehicle velocity information in the process of moving or trace information,Likewise, the motion information of above-noted persons can be the velocity information or trace information of personnel.In the field range of cameraInterior, the motion information of non-motor vehicle can be divided according to the relative motion state of non-motor vehicle and camera, relative motionState may include: to traveling, whereabouts traveling, stagnation of movement etc., to refer to that non-motor vehicle is gone towards camera to travelingIt sails, under this state, camera can collect the face characteristic of the feature personnel of non-motor vehicle, and get in this caseConvenient for identification, corresponding motion information can be to be carried out Xiang Sudu, comes to motion informations such as tracks face characteristic.Whereabouts traveling refers toIt is that non-motor vehicle is travelled backwards to camera, corresponding motion information can be the motion informations such as whereabouts speed, whereabouts track,Stagnation of movement refers to that non-motor vehicle stops, and corresponding motion information can be the motion informations such as stagnation of movement speed, stagnation of movement track, certainly,Under suspended state, stagnation of movement speed is zero, and stagnation of movement track is point.
It should be noted that the visual field of camera may also be referred to as the visual field of camera.
In some possible embodiments, it is special the non-motor vehicle occurred in video can be tracked by Kalman filtering algorithmSign, to track non-motor vehicle, obtains the motion information of non-motor vehicle.
It 103, is that non-locomotive matching is driven according to the motion information of the non-motor vehicle and the motion information of the personnelMultiply personnel.
In the step, the motion information of non-motor vehicle can be non-motor vehicle velocity information in the process of moving or railMark information, likewise, the motion information of personnel can be the velocity information or trace information of personnel.Non-motor vehicle can be passed throughWith the similitude of driver and passenger's motion information, corresponding driver and passenger are matched for non-motor vehicle, for example, can will have identicalThe non-motor vehicle of speed is matched with personnel, obtains driver and passenger, or can be by speed closest to non-motor vehicle speedPersonnel's matching is driver and passenger, or the non-motor vehicle for possessing same motion trajectory can be matched with personnel, is drivenMultiply personnel, or the personnel of motion profile closest to non-motor vehicle motion profile can be matched as driver and passenger.For example,Assuming that being C there are the motion information of non-motor vehicle B, the motion information there are A1 and two personnel of A2 is respectively D1 and D2, works as D1When being closer to C or is identical, it may be considered that personnel A1 is the driver and passenger of non-motor vehicle B, when A2 is more nearly compared with A1When C, it may be considered that personnel A2 is the driver and passenger of non-motor vehicle B.
It should be noted that above-mentioned driver and passenger are also referred to as driver or driver.
It can also be that non-motor vehicle matches driver and passenger by the posture feature of personnel in some possible embodiments,Posture feature can be the posture features such as hand gestures, foot's posture, upper body posture, for example, can be by judging on handleHand is to belong to the posture feature of which personnel to be matched to the driver and passenger of non-motor vehicle, can be by the foot judged on pedalBelong to the posture feature of which personnel to be matched to the driver and passenger etc. of non-motor vehicle, certainly, is matched by posture featureTo non-motor vehicle driver and passenger when, it is also necessary to posture feature is matched on personnel, so that it is determined that driver and passenger.It can be by appearanceState feature is associated with face characteristic to be matched, so that posture feature is matched on counterpart personnel.
104, according to the motion information of the non-motor vehicle, it is pre-set illegal to judge whether the non-motor vehicle triggersCondition.
The motion information of above-mentioned non-motor vehicle can be non-motor vehicle velocity information in the process of moving or track letterBreath, the illegal condition include: the condition of making a dash across the red light, occupy car lane condition, retrograde condition, hypervelocity condition etc..
The pre-set condition of making a dash across the red light can be virtual coil, by carrying out through transport with road traffic signal control systemControl sends grab signal from road traffic signal control system to camera, for example, road traffic signal control system can be withGrab signal is sent to camera in red light phase at traffic lights, stops sending to camera when in green light phase and captureSignal whole can also send grab signal to camera, after candid photograph, whether determine non-motor vehicle by setting virtual coilTrigger condition of making a dash across the red light.Virtual coil is the usual way of judgement of making a dash across the red light, and does not do excessive repeat herein.
In some possible embodiments, it can also carry out judging whether non-motor vehicle triggers to rush by buried solid circlesRed light condition.
Pre-set occupancy car lane condition, which can be, divides car lane and non-motorized lane, identifies non-The existence of motor vehicle then judges that non-motor vehicle occupies car lane, triggering is occupied when non-motor vehicle is present in car laneCar lane condition.
Pre-set retrograde condition can be non-automotive vehicle direction and road direction angular values, for example, non-machineMotor-car driving direction and road direction angle are 90 degree or more, then may determine that non-motor vehicle drives in the wrong direction, trigger the condition of driving in the wrong direction.OneIn a little possible embodiments, available non-automotive vehicle track, when the driving trace and road driving angular separation meetWhen retrograde Rule of judgment, the condition of driving in the wrong direction is triggered.
Pre-set hypervelocity condition can be the non-motorized lane speed limit value of current road segment, pass through the movement of non-motor vehicleThe available velocity information to non-motor vehicle of information can be with when the speed of non-motor vehicle is more than non-motorized lane speed limit valueJudge that non-motor vehicle is driven over the speed limit, triggers hypervelocity condition.For example, the speed of the non-motor vehicle got is 40 yards, and the sectionNon-motorized lane speed limit be 35 yards, then may determine that the non-motor vehicle is driven over the speed limit, in some possible embodiments, canNon-automotive vehicle speed is measured using velocity sensors such as microwave radars, when measuring non-motor vehicle hypervelocity, then can be sentencedDisconnected non-motor vehicle is driven over the speed limit, and hypervelocity condition is triggered.
It should be noted that above-mentioned camera can be referred to as video camera or camera, above-mentioned illegal condition can also be withCondition or violation condition referred to as violating the regulations.
If 105, the non-motor vehicle triggers the pre-set illegal condition, to the driving people of illegal non-motor vehicleThe identity information of member is confirmed.
In the step, illegal condition includes: the condition of making a dash across the red light, occupies car lane condition, drive in the wrong direction condition, hypervelocity conditionDeng at step 104, having done respective description to above-mentioned illegal condition, no further explanation will be given herein.It is right in step 103The driver and passenger of non-motor vehicle match, and the confirmation of identity information can be carried out by the face characteristic of driver and passenger.For example,The face information of driver and passenger is compared with identity card according to static library, identity card can be according to static library to be arranged in public security systemThe remote database of system is also possible to the local data base being directly linked with camera.
In some possible embodiments, after confirming to the identity information of the driver and passenger of illegal non-motor vehicle, alsoThe image of illegal non-motor vehicle and its driver and passenger can be retained, as illegal evidence.
It should be noted that the illegal monitoring and managing method of Manpower Transportation provided in an embodiment of the present invention can be applied to non-machineMotor-car traffic offence detection device, such as: it is illegal that traffic camera, computer, server etc. can carry out Manpower TransportationThe equipment of detection.
In the embodiment of the present invention, obtain image information, described image information include non-motor vehicle non-motor vehicle feature andThe face characteristic of personnel；Vision tracking is carried out to the non-motor vehicle feature and the face characteristic, obtains the non-motor vehicleMotion information and the personnel motion information；Believed according to the movement of the motion information of the non-motor vehicle and the personnelBreath is that the non-locomotive matches driver and passenger；According to the motion information of the non-motor vehicle, judge whether the non-motor vehicle touchesSend out illegal condition pre-set；If the non-motor vehicle is there are illegal activities, to the driver and passenger's of illegal non-motor vehicleIdentity information is confirmed.Due to being matched by face characteristic and non-motor vehicle feature, thus the driving to non-motor vehiclePersonnel match, and can more effectively supervise to the traffic violation of non power driven vehicle.
Fig. 2 is referred to, Fig. 2 is the process of the illegal monitoring and managing method of another Manpower Transportation provided in an embodiment of the present inventionSchematic diagram, as shown in Figure 2, comprising the following steps:
201, image information is obtained, described image information includes the non-motor vehicle feature of non-motor vehicle and the face spy of personnelSign.
202, vision tracking is carried out to the non-motor vehicle feature and the face characteristic, obtains the fortune of the non-motor vehicleDynamic information and the motion information of the personnel.
It 203, is that non-locomotive matching is driven according to the motion information of the non-motor vehicle and the motion information of the personnelMultiply personnel.
204, according to the motion information of the non-motor vehicle, it is pre-set illegal to judge whether the non-motor vehicle triggersCondition.
If 205, the non-motor vehicle triggers the pre-set illegal condition, to the driving people of illegal non-motor vehicleThe identity information of member is confirmed.
206, the illegal condition triggered according to the non-motor vehicle, generates illegal information.
Above-mentioned illegal information can be Criminal type, wherein above-mentioned Criminal type, which can be, to make a dash across the red light, occupies motor vehicleThe Criminal types such as road, retrograde, hypervelocity, above-mentioned Criminal type can carry out really according to the illegal condition that non-motor vehicle triggersRecognize, the condition for example, non-motor vehicle triggering is made a dash across the red light then generates the illegal information made a dash across the red light, and non-motor vehicle triggering occupies motor vehicleRoad condition then generates the illegal information for occupying car lane.Certainly, above-mentioned illegal information may include the illegal time, it is illegalThe information such as place, for example, in the time B place A, non-motor vehicle triggering is made a dash across the red light condition, then when generating A B the non-motor vehicle rushThe illegal information of red light.Above-mentioned illegal information can also include the identity information of driver and passenger, for example, driver and passenger C is in ABetween the place B, drive non-motor vehicle triggering and make a dash across the red light condition, then when generating A B driver and passenger C drive the non-motor vehicle and make a dash across the red lightIllegal information.It should be noted that above-mentioned illegal information can be recorded or be shown by the facial image capturedShow, is recorded or shown for example, increasing the data such as Criminal type, time, place and identity information on facial image, it can alsoRecorded or shown in a manner of through text, for example, by text to the Criminal type of illegal driver and passenger, the time,The data such as place and identity information are recorded or are shown.Certainly, it also can also be that other modes remember illegal informationRecord or display, for example increase for facial image the mode of illegal information labels, or to illicit video increase temporal information,Point information, mode of identity information etc..
207, prompt information is generated according to the illegal information, and sends prompt equipment for the prompt information, it is describedEquipment is prompted to be used to carry out illegal prompting to the driver and passenger of the illegal non-motor vehicle.
Above-mentioned prompt information can be the prompt information generated according to Criminal type, for example, when driver and passenger C is in ABetween the place B, drive non-motor vehicle when making a dash across the red light, prompt information of making a dash across the red light can be generated: C, you drive in the A time in the place B non-Motor vehicle makes a dash across the red light, it is noted that pedestrian and driving safety.Or when driver and passenger C is in the time B section A, driving non-motor vehicle is rushedWhen occupying car lane, it can be generated and occupy car lane prompt information: C, you drive non-motor vehicle in the place B in the A time and account forWith car lane, it is noted that driving safety returns to non-motorized lane.
Above-mentioned prompt equipment can be the mobile device of the driver and passenger of non-motor vehicle, and wherein mobile device, which can be, setsIt is equipped with prompt information and receives the mobile devices such as mobile phone, the plate of application, be also possible to that the electronic display board at crossing is arranged in, may be used alsoTo be the voice announcer that roadside is arranged in.Can will be prompted to information be sent to the mobile device of driver and passenger to driver and passenger intoRow prompt can also will be prompted to information and be sent to the electronic display board at crossing is arranged in shows prompt information to prompt to driveMultiply personnel, information can also be will be prompted to and be sent to the voice announcer that roadside is set, pass through the voice broadcast of voice announcerPrompt driver and passenger.
It, can be by illegal information to the driving people of illegal non-motor vehicle by generating illegal information in above-mentioned stepMember is recorded, and by generating prompt information, can be warned to the driver and passenger of illegal non-motor vehicle.
It should be noted that the illegal monitoring and managing method of Manpower Transportation provided by the above embodiment can be applied to it is non-maneuverVehicle traffic offence detection device, such as: traffic camera, computer, server etc. can carry out the illegal inspection of Manpower TransportationThe equipment of survey.
Fig. 3 is referred to, Fig. 3 is the process of the illegal monitoring and managing method of another Manpower Transportation provided in an embodiment of the present inventionSchematic diagram, as shown in Figure 3, comprising the following steps:
301, image information is obtained, described image information includes the non-motor vehicle feature of non-motor vehicle and the face spy of personnelSign.
302, vision tracking is carried out to the non-motor vehicle feature and the face characteristic, obtains the fortune of the non-motor vehicleDynamic information and the motion information of the personnel.
303, the motion information of the non-motor vehicle includes the motion information of the non-motor vehicle feature, the fortune of the personnelDynamic information includes the motion information of the face characteristic；
The face characteristic in the non-motor vehicle feature preset range is obtained, according to the movement of the non-motor vehicle featureInformation and the motion information of the face characteristic in the preset range are that the non-locomotive matches driver and passenger.
304, according to the motion information of the non-motor vehicle, it is pre-set illegal to judge whether the non-motor vehicle triggersCondition.
If 305, the non-motor vehicle triggers the pre-set illegal condition, to the driving people of illegal non-motor vehicleThe identity information of member is confirmed.
Wherein, the motion information of above-mentioned non-motor vehicle feature can be speed or the track of non-motor vehicle feature, above-mentionedThe motion information of face characteristic can be speed or the track of face characteristic.In image recognition technology, feature to be identifiedA feature frame can be made into, for example, non-motor vehicle feature and face characteristic can be made into non-motor vehicle feature frame and people respectivelyFace feature frame, the motion information of non-motor vehicle feature can be presented as the motion information of non-motor vehicle feature frame, face characteristicMotion information can be presented as the motion information of face characteristic frame, can be by obtaining in non-motor vehicle feature frame preset rangeFace characteristic frame, to obtain the face characteristic in non-motor vehicle feature preset range, this preset range on the image can be withIt is the pixel radius of non-motor vehicle feature frame, it can also be with size radius, for example, available 100 pixel of non-motor vehicle feature halfFace characteristic in diameter, for another example, available face characteristic frame center is to non-motor vehicle feature frame centre distance less than 200 picturesThe face characteristic frame of element.It can the motion information by non-motor vehicle feature and the face in non-motor vehicle feature preset rangeThe motion information of feature, extract motion information and non-motor vehicle feature motion information is closest or identical face characteristic,As the face characteristic that driver and passenger are possessed, driver and passenger can be also matched.For example, it is assumed that non-motor vehicle feature is B,The motion information of B is C, and there are face characteristic A1, A2, A3 in the preset range of B, the motion information of A1, A2, A3 are respectivelyD1, D2, D3, choose in D1, D2, D3 closest to one of C, and if it is D1 closest to C, then the corresponding face characteristic of D1 isA1, then it is driver and passenger that matching, which possesses the personnel of face characteristic A1, and C, D1, D2, D3 in example can be speed, be also possible to railMark can also be distance.
It should be noted that step 203 is optional, and such as: in some scenes, it is only necessary to according to the non-motor vehicleMotion information and the personnel motion information be the non-locomotive match driver and passenger.
Optionally, face characteristic in the motion information and the preset range according to the non-motor vehicle featureMotion information is that the non-locomotive matches driver and passenger, comprising:
According to the motion information of the face characteristic in the motion information and the preset range of the non-motor vehicle feature, shapeAt face collection；
It is that the non-locomotive matches driver and passenger according to the face collection.
Wherein, the motion information of non-motor vehicle feature can be speed or the track of non-motor vehicle feature, above-mentioned faceThe motion information of feature can be speed or the track of face characteristic, and above-mentioned face collection is in non-motor vehicle feature preset rangeInterior face characteristic set, face collection can be identified with specific number or alphabetical designation, such as face collection E, face collection 1Deng, can also be identified with the characteristic value of non-motor vehicle feature, such as non-motor vehicle feature be B, then to face set identifierIt for face collection B, can also be identified with the color of feature frame on the image, such as non-motor vehicle feature on the imageFeature frame is green, then also makees green frame to the feature frame of the face characteristic in its preset range, and face collection can be greenMark G is represented to be identified.In step 202, vision tracking is carried out to non-motor vehicle feature and face characteristic, it is availableTo multiple image.By multiple image, the motion information of non-motor vehicle feature and the movement letter of face characteristic can be calculatedBreath extracts people similar in the motion information of motion information and non-motor vehicle feature in the preset range of non-motor vehicle featureFace feature forms face collection.Preset range can be also possible to size radius, the fortune of face characteristic with the pixel radius on imageDynamic information is close with the motion information of non-motor vehicle feature, can be the motion information threshold value of non-motor vehicle feature, such as can be withIt is the threshold speed section of non-motor vehicle feature, when the speed of face characteristic falls into the threshold speed section of non-motor vehicle featureWhen, the motion information of the motion information of face characteristic and non-motor vehicle feature can be regarded as close.Such as: non-motor vehicle featureThreshold speed section be 30 yards to 35 yards, then when the speed of face characteristic be 33 yards when, can by the speed of face characteristic withThe speed of non-motor vehicle feature regards close as, so that the motion information of face characteristic and the motion information of non-motor vehicle feature be seenAt close.The threshold speed section of non-motor vehicle feature can be configured by the speed of non-motor vehicle feature.Face is specialThe motion information of sign is close with the motion information of non-motor vehicle feature, is also possible to the track of non-motor vehicle feature and face characteristicSimilarity threshold can be with when the track of face characteristic and the track similarity of non-motor vehicle feature reach track similarity thresholdRegard the motion information of the motion information of face characteristic and non-motor vehicle feature as close.Such as: non-motor vehicle feature and faceThe track similarity threshold of feature can be set to 80%, when the track of face characteristic and the track similarity of non-motor vehicle featureReaching track similarity is more than 80%, then can regard the motion information of face characteristic and the motion information of non-motor vehicle feature as phaseClosely.
In some possible embodiments, in every frame image, a face collection can be formed, multiple image can obtainIt to multiple face collection, seeks common ground to multiple face collection, obtains final face collection, the present embodiment does not limit every frame image and forms oneA face collection is also possible to partial frame image and forms face collection, such as 200 frame images, can extract wherein two frames and form 2 peopleFace collection.The face characteristic concentrated by the final face to seek common ground is during vision tracking always present in non-machineFace characteristic in motor-car feature preset range, it may also be said to be to keep close certain with non-motor vehicle in non-automotive vehicle processThe face characteristic of distance.Such as: assuming that get 400 frame images in vision tracking, extract wherein the 100th frame, the 200th frame,Totally 4 frame images are respectively formed 4 faces collection E1, E2, E3, E4 for 300th frame, the 400th frame, include in E1 face characteristic A1, A2,A3, A4, E2 include face characteristic A1, A2, A4, A5, and E3 includes face characteristic A1, A2, A5, A6, E4 include face characteristic A1,A2, A4, A6, then include face characteristic A1, A2 in the final face collection E to seek common ground to E1, E2, E3, E4, can be in final faceDriver and passenger are matched in collection E, at this point it is possible to by by the movement of the motion information of face characteristic A1 and A2 and non-motor vehicle featureInformation is compared, and motion information is matched with the immediate face characteristic of the motion information of non-motor vehicle feature as driver and passengerThe face characteristic possessed.
Optionally, the motion information of the non-motor vehicle feature includes the speed of non-motor vehicle feature, the face characteristicMotion information include face characteristic speed；
The movement of face characteristic in the motion information and the preset range according to the non-motor vehicle feature is believedBreath forms face collection, comprising:
The speed of the non-motor vehicle feature and the speed of the face characteristic are compared, velocity contrast's result is obtained；
According to the velocity contrast as a result, forming the face collection.
Wherein, in step 202, vision tracking is carried out to non-motor vehicle feature and face characteristic, it is available to arrive multiframeImage.By multiple image, the speed of non-motor vehicle feature and the speed of face characteristic can be calculated, in non-motor vehicle spyIn the preset range of sign, the face characteristic of the similar rate of speed and non-motor vehicle feature is extracted, forms face collection.It is non-maneuverThe speed of vehicle feature and the speed of face characteristic can pass through the middle feature frame central point of image recognition technology position in the pictureVariation and time are calculated, and preset range can be also possible to size radius, the speed of face characteristic with the pixel radius on imageThe similar rate of degree and non-motor vehicle feature, can be the threshold speed of non-motor vehicle feature, for example can be non-motor vehicle spyThe speed of face characteristic and the threshold speed section of non-motor vehicle feature are compared, work as face by the threshold speed section of signIt, can be by the speed of face characteristic and non-motor vehicle feature when the speed of feature falls into the threshold speed section of non-motor vehicle featureSpeed regard close as, such as: the threshold speed section of non-motor vehicle feature be 30 yards to 35 yards, it is assumed that the speed of face characteristic A1Degree is 33 yards, and the speed of face characteristic A2 is 34 yards, and the speed of face characteristic A3 is 29 yards, can be by face characteristic A1 and A2The speed of speed and non-motor vehicle feature regards close as, concentrates so that face characteristic A1 and A2 record are entered face, in this way, canWith remove it is some be clearly not the personnel of motor vehicle driver and passenger, for example possess the personnel of face characteristic A3, face is concentrated onlyThere are face characteristic A1 and A2, the face characteristic element for concentrating face is reduced the number of, and is only needed to calculate face in matching and is concentratedFace characteristic A1 and A2, reduce by face collection match driver and passenger calculation amount.It, can when the face of formation integrates as empty setTo make face collection by the threshold speed section of the preset range for increasing non-motor vehicle feature and/or expansion non-motor vehicle featureAs non-empty face collection.
Optionally, the motion information of the non-motor vehicle feature includes the track of non-motor vehicle feature, the face characteristicMotion information include face characteristic track；
The movement of face characteristic in the motion information and the preset range according to the non-motor vehicle feature is believedBreath forms face collection, comprising:
The track of the non-motor vehicle feature and the track of the face characteristic are compared, track comparing result is obtained；
According to the track comparing result, the face collection is formed.
Wherein, the track that track comparing result can be face characteristic is overlapped with the track of the track of non-motor vehicle featureDegree, for example, the feature frame center of track of the feature frame center of face characteristic in consecutive image and non-motor vehicle feature is existedTrack in consecutive image is compared with the starting of the same end point, calculates the track of face characteristic and the track of non-motor vehicle featureIt is overlapped the ratio of the total trajectory length of the track and non-motor vehicle feature of length and face characteristic, obtains registration, such as: assuming thatThe path length of face characteristic is 49, and the path length of non-motor vehicle feature is 51, and intersection length is 45, and registration is then45*2/ (49+51) * 100%=90%.If registration 90% is greater than the track of face characteristic and the track of non-motor vehicle featureTrack registration threshold value, then can by face characteristic record enter face concentrate.
In addition, track comparing result is also possible to the equation of locus of the track of face characteristic and the track of non-motor vehicle featureComparing result, for example, can the ratio of constant or difference etc. in two equation of locus, ratio illustrates two rails closer to 1Mark equation is more similar, and difference illustrates that two equation of locus are more similar closer to 0.
Optionally, described to include: for non-locomotive matching driver and passenger according to the face collection
The quantity for detecting the face collection face characteristic judges that the face is concentrated with the presence or absence of multiple face characteristics；
Multiple face characteristics if it exists are then chosen with the non-motor vehicle character pixel most in the multiple face characteristicClose face characteristic is determined as the face characteristic of the driver and passenger, obtains the driver and passenger of the non-motor vehicle.
Wherein, pixel is can be recently in the feature frame center of face characteristic in the picture and the feature frame of non-motor vehicle featurePixel separation between the heart is minimum, can also be between the feature frame frame of face characteristic and the feature frame center of non-motor vehicle featurePixel separation it is minimum.
In addition, if face, which is concentrated, is not present multiple face characteristics, that is to say, that the face characteristic that face is concentrated is unique, canBelong to driver and passenger directly to think that this is uniquely present in the face characteristic of face concentration, so that it is determined that driver and passenger.
In some possible embodiments, if face is concentrated, there are multiple face characteristics, can be in multiple face characteristicsThe face characteristic for being determined as driver and passenger with the nearest face characteristic of non-motor vehicle characteristic size is chosen, driving for non-motor vehicle is obtainedMultiply personnel.
Optionally, the identity information of the driver and passenger to illegal non-motor vehicle confirms, comprising:
From the image information got, the figure with the face characteristic of driver and passenger of the illegal non-motor vehicle is chosenAs carrying out quality evaluation, picture quality scoring is obtained；
According to described image quality score, the highest image of picture quality scoring is chosen；
The face that the driver and passenger of the illegal non-motor vehicle are extracted in the highest image of described image quality score is specialSign；
The face characteristic of the driver and passenger of the illegal non-motor vehicle and backstage identity image library are compared, determination is drivenMultiply the identity information of personnel.As shown in Figure 4.
Image quality evaluation (Image Quality Assessment, IQA) among the above is basic in image procossingThen one of technology evaluates image superiority and inferiority (image fault degree) mainly by carrying out specificity analysis research to image.It can be withBy image quality evaluation, picture quality scoring is obtained, can be set to that picture quality is higher, and picture quality scoring is higher,To choose the highest image of picture quality scoring.By picture quality score the face characteristic that extracts in highest image withIdentity card in the identity image library of backstage is chosen and is shone with the highest identity card of face characteristic similarity according to being compared, and extractsThe identity information that corresponding identity card shines, to get the information of the driver and passenger of illegal non-motor vehicle.
Certainly, in some possible embodiments, all personnel in the highest image of quality score can also be extractedFace characteristic shines with the identity card in the identity image library of backstage to be compared, and then gets the information of all personnel in image,Driver and passenger are determined again.
Above-mentioned backstage identity image library can be the image library being arranged on local server, be also possible to be arranged in cloudThe image library of upper server.
In the present embodiment, the embodiment of plurality of optional is increased on the basis of embodiment shown in Fig. 1, and can be intoThe traffic offence confirmation rate of one step raising non-motor vehicle.
Fig. 5 is referred to, Fig. 5 is that a kind of structure of the illegal maintenance device of Manpower Transportation provided in an embodiment of the present invention is shownIt is intended to, as shown in Figure 5, comprising:
First obtains module 401, and for obtaining image information, described image information includes that the non-motor vehicle of non-motor vehicle is specialThe face characteristic of sign and personnel；
Second obtains module 402, for carrying out vision tracking to the non-motor vehicle feature and the face characteristic, obtainsThe motion information of the non-motor vehicle and the motion information of the personnel；
Matching module 403, for being described according to the motion information of the non-motor vehicle and the motion information of the personnelNon-locomotive matches driver and passenger；
It is pre- to judge whether the non-motor vehicle triggers for the motion information according to the non-motor vehicle for judgment module 404The illegal condition being first arranged；
Confirmation module 405, if the pre-set illegal condition is triggered for the non-motor vehicle, to illegal non-machineThe identity information of the driver and passenger of motor-car confirms.
Optionally, as shown in fig. 6, described device further include:
First generation module 406, the illegal condition for being triggered according to the non-motor vehicle, generates illegal information；
Second generation module 407 for generating prompt information according to the illegal information, and the prompt information is sentTo prompt equipment, the prompt equipment is used to carry out illegal prompting to the driver and passenger of the illegal non-motor vehicle.
Optionally, as shown in figure 5, the motion information of the non-motor vehicle includes the movement letter of the non-motor vehicle featureBreath, the motion information of the personnel includes the motion information of the face characteristic；
The matching module 403 is used for root for obtaining the face characteristic in the non-motor vehicle feature preset rangeMotion information according to the face characteristic in the motion information and the preset range of the non-motor vehicle feature is the non-locomotiveMatch driver and passenger.
Optionally, as shown in fig. 7, the matching module 403 includes:
Processing unit 4031, for the face in the motion information and the preset range according to the non-motor vehicle featureThe motion information of feature forms face collection；
Matching unit 4032 is that the non-locomotive matches driver and passenger according to the face collection.
Optionally, as shown in figure 8, the motion information of the non-motor vehicle feature includes the speed of non-motor vehicle feature, instituteThe motion information for stating face characteristic includes the speed of face characteristic；
The processing unit 4031 includes:
First processing subelement 40311, compares the speed of the non-motor vehicle feature and the speed of the face characteristic, obtainsTo velocity contrast's result；
Second processing subelement 40312, according to the velocity contrast as a result, forming the face collection.
Optionally, as shown in figure 9, the matching unit 4032 includes:
Detection sub-unit 40321 detects the quantity of the face collection face characteristic, judges that the face concentration whether there isMultiple face characteristics；
Determine subelement 40322, if it exists multiple face characteristics, then in the multiple face characteristic choose with it is described non-The nearest face characteristic of motor vehicle character pixel is determined as the face characteristic of the driver and passenger, obtains driving for the non-motor vehicleMultiply personnel.
Optionally, as shown in Figure 10, the confirmation module 405 includes:
Picture appraisal unit 4051, for from the image information got, choosing to have the illegal non-motor vehicleThe image of the face characteristic of driver and passenger carries out quality evaluation, obtains picture quality scoring；
Image selection unit 4052, for choosing the highest image of picture quality scoring according to described image quality score；
Extraction unit 4053, for extracting the illegal non-motor vehicle in the highest image of described image quality scoreThe face characteristic of driver and passenger；
Comparison unit 4054, for by the face characteristic of the driver and passenger of the illegal non-motor vehicle and backstage identity imageLibrary compares, and determines the identity information of driver and passenger.
It should be noted that the illegal maintenance device of Manpower Transportation provided in an embodiment of the present invention can be applied to non-machineMotor-car traffic offence detection device, such as: it is illegal that traffic camera, computer, server etc. can carry out Manpower TransportationThe equipment of detection.
The method that the illegal maintenance device of Manpower Transportation provided in an embodiment of the present invention can be realized Fig. 1, Fig. 2 and Fig. 3Each embodiment and corresponding beneficial effect in embodiment, to avoid repeating, which is not described herein again.
It is the structural schematic diagram of a kind of electronic equipment provided in an embodiment of the present invention referring to Figure 11, Figure 11, as shown in figure 11,Include: memory 902, processor 901 and is stored in the computer journey that can be run on the memory and on the processorSequence, in which:
The computer program that processor 901 is used to that memory 902 to be called to store executes following steps:
Image information is obtained, described image information includes the non-motor vehicle feature of non-motor vehicle and the face characteristic of personnel；
Vision tracking is carried out to the non-motor vehicle feature and the face characteristic, obtains the movement letter of the non-motor vehicleThe motion information of breath and the personnel；
It is that people is driven in non-locomotive matching according to the motion information of the non-motor vehicle and the motion information of the personnelMember；
According to the motion information of the non-motor vehicle, judge whether the non-motor vehicle triggers pre-set illegal itemPart；
If the non-motor vehicle triggers the pre-set illegal condition, to the driver and passenger's of illegal non-motor vehicleIdentity information is confirmed.
Optionally, after the execution of processor 901 confirms the identity information of the driver and passenger of illegal non-motor vehicle,Processor 901 also executes step:
According to the illegal condition that the non-motor vehicle triggers, illegal information is generated；
Prompt information is generated according to the illegal information, and sends prompt equipment, the prompt for the prompt informationEquipment is used to carry out illegal prompting to the driver and passenger of the illegal non-motor vehicle.
Optionally, the motion information of the non-motor vehicle includes the motion information of the non-motor vehicle feature, the personnelMotion information include the face characteristic motion information；
Processor 901 execute it is described according to the motion information of the non-motor vehicle and the motion information of the personnel be instituteState non-locomotive matching driver and passenger, comprising:
The face characteristic in the non-motor vehicle feature preset range is obtained, according to the movement of the non-motor vehicle featureInformation and the motion information of the face characteristic in the preset range are that the non-locomotive matches driver and passenger.
Optionally, the motion information according to the non-motor vehicle feature and the default model that processor 901 executesThe motion information of face characteristic in enclosing is that the non-locomotive matches driver and passenger, comprising:
According to the motion information of the face characteristic in the motion information and the preset range of the non-motor vehicle feature, shapeAt face collection；
It is that the non-locomotive matches driver and passenger according to the face collection.
Optionally, the motion information of the non-motor vehicle feature includes the speed of non-motor vehicle feature, the face characteristicMotion information include face characteristic speed；
The people in the motion information and the preset range according to the non-motor vehicle feature that processor 901 executesThe motion information of face feature forms face collection, comprising:
The speed of the non-motor vehicle feature and the speed of the face characteristic are compared, velocity contrast's result is obtained；
According to the velocity contrast as a result, forming the face collection.
Optionally, the described of the execution of processor 901 matches driver and passenger, packet according to the face collection for the non-locomotiveIt includes:
The quantity for detecting the face collection face characteristic judges that the face is concentrated with the presence or absence of multiple face characteristics；
Multiple face characteristics if it exists are then chosen with the non-motor vehicle character pixel most in the multiple face characteristicClose face characteristic is determined as the face characteristic of the driver and passenger, obtains the driver and passenger of the non-motor vehicle.
Optionally, the identity information of the driver and passenger to illegal non-motor vehicle of the execution of processor 901 confirms,Include:
From the image information got, the figure with the face characteristic of driver and passenger of the illegal non-motor vehicle is chosenAs carrying out quality evaluation, picture quality scoring is obtained；
According to described image quality score, the highest image of picture quality scoring is chosen；
The face that the driver and passenger of the illegal non-motor vehicle are extracted in the highest image of described image quality score is specialSign；
The face characteristic of the driver and passenger of the illegal non-motor vehicle and backstage identity image library are compared, determination is drivenMultiply the identity information of personnel.
It should be noted that electronic equipment provided in an embodiment of the present invention can be applied to the illegal supervision of Manpower TransportationEquipment, such as: the equipment that traffic camera, computer, server etc. can carry out the illegal detection of Manpower Transportation.
Electronic equipment provided in an embodiment of the present invention can be realized each reality in the embodiment of the method for Fig. 1, Fig. 2 and Fig. 3Mode and corresponding beneficial effect are applied, to avoid repeating, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage mediumCalculation machine program, the computer program realize Manpower Transportation provided in an embodiment of the present invention illegal supervision when being executed by processorEach process of embodiment of the method, and identical technical effect can be reached, to avoid repeating, which is not described herein again.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be withRelevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage mediumIn, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magneticDish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random AccessMemory, abbreviation RAM) etc..
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainlyIt encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.