Summary of the invention
In order to overcome not having automatic discovery and analyzing the relatively poor deficiency of real-time that anomalous event function, intelligent degree are low, report to the police of existing video monitoring mode, the invention provides a kind of intelligent video monitoring method and system that anomalous event is excavated function that have that has automatic discovery and analyze anomalous event function, intelligent degree height, in time give the alarm and carry out information processing.
The technical solution adopted for the present invention to solve the technical problems is:
A kind of intelligent video monitoring processing method with anomalous event excavation function, this method may further comprise the steps:
Abnormal conditions around the step 1, camera supervised this video camera of passive type, the video data in the acquisition monitoring scene;
Step 2, the moving target that occurs in detection and the tracing and monitoring scene is demarcated moving target, and the position and the size parameter of moving target reached active video camera;
Step 3, active video camera according to the parameter of setting, judge whether that being necessary to transfer active video camera obtains the local feature of target according to behind the position and size parameter that obtain; If reach the requirement of transferring active video camera, then adjust the parameter and the attitude of active video camera, provide the close shot feature of the moving target that occurs in the monitoring scene adaptively; According to the transfer condition of setting, judge whether to stop to transfer equally; If still satisfy the transfer condition, then return the parameter and the attitude that continue to adjust active video camera; If reach the condition that stops to transfer active video camera, then active video camera turns back to initial setting up, monitors Same Scene with the passive type video camera with same focal length;
Step 4, detected moving target is correctly classified: differentiating target is pedestrian or other objects that enter monitoring scene, according to the object edge profile information that obtains in the tracing process and variation characteristic thereof as main classification foundation;
Step 5 is carried out behavior to sorted moving target and is understood, and extracts the behavioural characteristic of movement human target itself, and abnormal behaviour is discerned and judged whether to be to the behavior sample that comparison is trained to its behavior;
Step 6 is set the abnormal behaviour standard, according to the standard that sets, judges whether to take place anomalous event, if no abnormal incident takes place, then returns and continues to gather video data; If anomalous event has taken place, then trigger the alarm setting at once.
Further, in the described step 6,,, check evidence obtaining in order to the staff with unusual condition video recording storage if anomalous event has taken place in the future.
Further again, in the described step 4, after differentiating target and being the pedestrian, distinguishing out what enter again is single or many people of motion together.
Further, in the step 6, should have different abnormal behaviour definition for different application scenarioss.
A kind of intelligent video monitoring treatment system with anomalous event excavation function, described system comprises:
Video acquisition module is used for the collection to the guarded region video, adopts the mode of a pair of principal and subordinate's video camera collaborative work to come anomalous event in the monitoring scene;
The Intelligent Measurement module is used for guarded region motion target detection and tracking, obtains the real time position and the size parameter of moving target;
Anomalous event is excavated module, being used for that sorted moving target is carried out behavior understands, extract the behavioural characteristic of movement human target itself, the behavior sample that comparison is trained, abnormal behaviour is discerned and judged whether to be in its behavior, and the abnormal behaviour standard according to setting judges whether to take place anomalous event, if no abnormal incident takes place, then return and continue to gather video data; If anomalous event has taken place, then trigger the alarm setting at once.
Further, described system also comprises: human-computer interaction module is used for trigger condition, the mode of alarm and the storage of key video sequence and the playback of alarm.
Further again, in the described video acquisition module, the passive type video camera is used for obtaining the video data of fixed monitoring scene, Data Source as the needs processing, attitude and parameter that active video camera is dynamically adjusted video camera according to the moving target position that obtains and size parameter provide the close shot close-up shot of moving target adaptively.
Further, described anomalous event is excavated in the module, according to the speed of moving target, and acceleration, the position, shape facility is discerned moving object and human body.
Described anomalous event is excavated in the module, carries out recognition of face in moving target profile inside, carries out distinguishing single and many people.
Described anomalous event is excavated in the module, by using character description methods such as Hu square and R conversion to extract the behavioural characteristic of movement human, use the similarity of hidden Markov model calculating and training sample then, identify the concrete behavior of human body, excavate out the anomalous event in the scene at last.
Again further, in the described human-computer interaction module, if abnormal behaviour reaches the unusual parameter that sets, then system triggers the anomalous event alarm at once, and the alarm mode comprises that system produces warning information, sends SMS and mail for relevant director.
In the described human-computer interaction module, system will record a video to preserve to current unusual condition automatically and check to be used for the user afterwards when the anomalous event alarm is triggered; The user also can record interested scene at any time and preserve.
Beneficial effect of the present invention mainly shows: the mode that adopts the collaborative work of master-slave mode video camera, passive type camera acquisition video data is also analyzed, active video camera provides important area close shot feature adaptively, can more clearly observe the local feature of moving target; By obtaining the accurate edge contour information of moving target, extract its behavioural characteristic, excavate out the anomalous event that occurs in the monitoring scene according to the behavior database of having set up.
Embodiment
Below in conjunction with accompanying drawing the present invention is further described.
Embodiment 1
See figures.1.and.2, a kind of intelligent video monitoring processing method with anomalous event excavation function, this method may further comprise the steps:
Abnormal conditions around the step 1, camera supervised this video camera of passive type, the video data in the acquisition monitoring scene;
Step 2, the moving target that occurs in detection and the tracing and monitoring scene is demarcated moving target, and the position and the size parameter of moving target reached active video camera;
Step 3, active video camera according to the parameter of setting, judge whether that being necessary to transfer active video camera obtains the local feature of target according to behind the position and size parameter that obtain; If reach the requirement of transferring active video camera, then adjust the parameter and the attitude of active video camera, provide the close shot feature of the moving target that occurs in the monitoring scene adaptively; According to the transfer condition of setting, judge whether to stop to transfer equally; If still satisfy the transfer condition, then return the parameter and the attitude that continue to adjust active video camera; If reach the condition that stops to transfer active video camera, then active video camera turns back to initial setting up, monitors Same Scene with the passive type video camera with same focal length;
Step 4, detected moving target is correctly classified: differentiating target is pedestrian or other objects that enter monitoring scene, according to the object edge profile information that obtains in the tracing process and variation characteristic thereof as main classification foundation;
Step 5 is carried out behavior to sorted moving target and is understood, and extracts the behavioural characteristic of movement human target itself, and abnormal behaviour is discerned and judged whether to be to the behavior sample that comparison is trained to its behavior;
Step 6 is set the abnormal behaviour standard, according to the standard that sets, judges whether to take place anomalous event, if no abnormal incident takes place, then returns and continues to gather video data; If anomalous event has taken place, then trigger the alarm setting at once.
In the described step 6,,, check evidence obtaining in order to the staff with unusual condition video recording storage if anomalous event has taken place in the future.
In the described step 4, after differentiating target and being the pedestrian, distinguishing out what enter again is single or many people of motion together.
In the step 6, should have different abnormal behaviour definition for different application scenarioss.
Be example with the parking lot monitoring below, further set forth the intelligent video monitoring system processing method that anomalous event is excavated function that has of the present invention.Fig. 2 is the process chart that anomalous event is excavated the intelligent video monitoring system of function that has based on the parking lot scene of the present invention.
After in the parking lot, installing active video camera and passive type video camera, two class video camera display frames are transferred to same focal length monitoring Same Scene.
Step 210, the video data in the passive type camera acquisition monitoring scene is as the Data Source of needs processing.
Step 220 detects and also to follow the tracks of the moving target that occurs in the parking lot, demarcates moving target, and with the position of target, parameters such as size reach active video camera.
Step 230, active video camera according to target components such as position that obtains and sizes after, according to the parameter of setting, as moving target whether in the monitoring scene center, whether moving target is less than normal etc., judges whether that being necessary to transfer active video camera obtains the local feature of target.
Step 231 if reach the requirement of transferring active video camera, is then adjusted the parameter and the attitude of active video camera, provides the close shot feature of the moving target that occurs in the parking lot adaptively.
Step 232 equally according to the transfer condition of setting, judges whether to stop to transfer.If still satisfy the transfer condition, then return the parameter and the attitude that continue to adjust active video camera.
Step 233, if reach the condition that stops to transfer active video camera, then active video camera turns back to initial setting up, monitors Same Scene with the passive type video camera with same focal length.
Step 240 is classified to detected moving target, and differentiating target is pedestrian or the vehicle that enters the parking lot, if the people, then should distinguish out what enter is single or many people.
Step 250, the behavioural characteristic of extraction movement human target itself, the behavior sample that comparison is trained, the concrete behavior of identification human body.
Step 260 is set the abnormal behaviour standard, the normal walking of definition here, and trotting to wait belongs to normal behaviour, and jumps, and being trapped in other grade of certain car for a long time is abnormal behaviour.According to the standard that sets, judge whether to be abnormal behaviour, if no abnormal behavior takes place, then return and continue to gather video data.
Step 270 if abnormal behaviour has taken place, then triggers the alarm setting, and with unusual condition video recording storage, checks evidence obtaining in order to the staff at once in the future.
Embodiment 2
See figures.1.and.2, a kind of intelligent video monitoring treatment system with anomalous event excavation function, described system comprises:
Video acquisition module is used for the collection to the guarded region video, adopts the mode of a pair of principal and subordinate's video camera collaborative work to come anomalous event in the monitoring scene;
The Intelligent Measurement module is used for guarded region motion target detection and tracking, obtains the real time position and the size parameter of moving target;
Anomalous event is excavated module, being used for that sorted moving target is carried out behavior understands, extract the behavioural characteristic of movement human target itself, the behavior sample that comparison is trained, abnormal behaviour is discerned and judged whether to be in its behavior, and the abnormal behaviour standard according to setting judges whether to take place anomalous event, if no abnormal incident takes place, then return and continue to gather video data; If anomalous event has taken place, then trigger the alarm setting at once.
Described system also comprises: human-computer interaction module is used for trigger condition, the mode of alarm and the storage of key video sequence and the playback of alarm.
In the described video acquisition module, the passive type video camera is used for obtaining the video data of fixed monitoring scene, Data Source as the needs processing, attitude and parameter that active video camera is dynamically adjusted video camera according to the moving target position that obtains and size parameter provide the close shot close-up shot of moving target adaptively.
Described anomalous event is excavated in the module, according to the speed of moving target, and acceleration, the position, shape facility is discerned moving object and human body.
Described anomalous event is excavated in the module, carries out recognition of face in moving target profile inside, carries out distinguishing single and many people.
Described anomalous event is excavated in the module, by using character description methods such as Hu square and R conversion to extract the behavioural characteristic of movement human, use the similarity of hidden Markov model calculating and training sample then, identify the concrete behavior of human body, excavate out the anomalous event in the scene at last.
In the described human-computer interaction module, if abnormal behaviour reaches the unusual parameter that sets, then system triggers the anomalous event alarm at once, and the alarm mode comprises that system produces warning information, sends SMS and mail for relevant director.
In the described human-computer interaction module, system will record a video to preserve to current unusual condition automatically and check to be used for the user afterwards when the anomalous event alarm is triggered; The user also can record interested scene at any time and preserve.
Fig. 1 is the functional block diagram with intelligent video monitoring system of anomalous event excavation function of the present invention.This system mainly comprises video acquisition module 110, Intelligent Measurement module 120, and anomalous event is excavated module 130 and human-computer interaction module 140.
Video acquisition module 110 is mainly used in the collection to the guarded region video, it is characterized in that adopting the collaborative work of a pair of principal and subordinate's video camera.Comprise passive type camara module 111 and active camara module 112.
Passive type camara module 111 is used for obtaining the video data of fixed monitoring scene, as the Data Source of needs processing.
Attitude and parameter that active camara module 112 is dynamically adjusted video camera according to the moving target position that obtains and size parameter provide the close shot close-up shot of moving target adaptively.
Intelligent Measurement module 120 is mainly used in guarded region motion target detection and tracking, obtains the real time position and the size parameter of moving target.Comprise moving object detection module 121 and motion target tracking module 122.
Moving object detection module 121 is used for the video data that collects is carried out moving object detection, demarcates detected moving target.Because this intelligent video monitoring system is mainly monitored some complex scenes, so code book is a kind of suitable moving target detecting method, its basic thought is to adopt the method that quantizes cluster, from long observation sequence, set up background model, when detecting, measure test pixel and the distance of background pixel on color and intensity simultaneously, with this differentiation prospect and background, As time goes on the background model of estimation is upgraded.
Motion target tracking module 122 is used for detected moving target is accurately followed the tracks of, and obtains moving target position and size parameter.Target following at first relates to forecasting problem, the present invention uses particle filter technology solution the forecasting problem here, and the method that employing is chosen principal character according to ambient conditions improves robustness, information such as the gray scale of target, colourity, texture and yardstick are compared with the scenery of the certain limit at its place, find out feature with the biggest gap principal character as target.Like this, occur complicated or overlap for a long time, block or just be difficult for producing trail-and-error when staggered in multiple target.
Anomalous event excavation module 130 is mainly used in the classification to moving target in the monitoring scene, and the understanding analysis of human body behavior and the definition of abnormal behaviour etc. comprise target classification module 131, behavior Understanding Module 132 and abnormal behaviour definition module 133.
Target classification module 131 is used for the classification to moving object and movement human, and distinguishing to single and many people, use close-up image that active video camera obtains to increase resolution capability, combine as classification foundation with edge that obtains in the tracing process and profile information, speed according to moving target, acceleration, the position, features such as shape are discerned moving object and human body.Carry out recognition of face in moving target profile inside, carry out distinguishing single and many people.
Behavior Understanding Module 132 is mainly used in the understanding of moving target behavior, utilize the character of target itself and the position relation between a plurality of target, motion relevance etc. to extract the moving target behavioural characteristic, to different state classification standards, need to adopt different characteristics combination, judge whether it is abnormal behaviour.Common feature extracting methods such as R conversion extract the behavioural characteristic of movement human by using the Hu square, use the similarity of hidden Markov model (HMM) calculating and training sample then, identify the concrete behavior of human body, excavate out the anomalous event in the scene at last.
Abnormal behaviour definition module 133 is mainly used in the definition of abnormal behaviour, different behaviors should have different abnormal behaviour definition for different application scenarioss, as to run this action can be normal at some, but can be defined as abnormal behaviour in some occasion.
Human-computer interaction module 140 is mainly used in man-machine interaction, comprises the definite condition and the triggering of alarm, and the mode of alarm and the storage of key video sequence and playback etc. comprise Realtime Alerts module 141 and video storage and playback module 142.
Realtime Alerts module 141 comprises the setting of abnormal behaviour parameter and sends the anomalous event alarm that if abnormal behaviour reaches the unusual parameter that sets, then system triggers the anomalous event alarm at once.The alarm mode comprises that system produces warning information, sends note and mail etc. for relevant director.
Video storage and playback module 142 are used to record abnormal behaviour video and playback.On the one hand, system is checked to be used for the user recording a video to preserve to current unusual condition automatically afterwards when the anomalous event alarm is triggered; On the other hand, the user also can record interested scene at any time and preserve.
Of the present invention have anomalous event and excavate in the intelligent video monitoring method of function and the intelligent monitoring environment that system can be applied to various situations, as large parking lot, and museum etc.Method and system of the present invention can alleviate the workload of monitor staff in this type of scene significantly, and can effectively increase its fail safe, reduce unnecessary loss.
Obviously, under the prerequisite that does not depart from true spirit of the present invention and scope, the present invention described here can have many variations.Therefore, the change that all it will be apparent to those skilled in the art that all should be included within the scope that these claims contain.The present invention's scope required for protection is only limited by described claims.