CN101093603A - Module set of intellective video monitoring device, system and monitoring method - Google Patents

Abstract

An intelligent video monitor system comprises one or multiple on-site intelligent video monitor device module, IVSS platform server and video monitor system terminal. It is featured as forming said on-site intelligent monitor device module by input module, output module, image intelligent processing-module and data/signaling transmission module.

Description

Intellective video monitoring device module and system and method for supervising thereof

Technical field

The present invention relates to intellective video monitoring device module and system and method for supervising thereof, particularly, relate to a kind of to the intelligent in-situ monitor equipment that monitors that target detects in real time in the scene, follows the tracks of, classification, behavioural analysis etc. are intelligent, robotization is handled, and based on the intelligent video monitoring system and the method for supervising of this intelligent in-situ monitor equipment.

Background technology

At present conventional video monitoring system only is that the monitoring scene image is sent to Control Room by DVS, is finished occurring the judgement of " unusually " in the monitoring scene by the people, or finishes video storage with realization checking and collecting evidence afterwards by DVR.In above-mentioned supervisory system, the people has played the part of very crucial role, owing to may causing " real incident ", following reason have only very small part to be found: to use a large amount of rig cameras in (1) video monitoring system, and have only a spot of camera views can be presented on the monitoring screen, need be seen by the people by constantly switching with assurance; (2) people's notice can not concentrate on the monitored picture for a long time, will have 80% effective information to lose after 20 minutes; (3) most of monitored pictures of determining are " invalid information " (do not have incident take place).Therefore conventional supervisory system only can play the function of checking afterwards and collecting evidence.

Also have some DVS, DVR or IP video camera to add the function of " move and scout " at present, mobile scouting mainly is by the comparison between the monitoring image " image block ", judges whether change of image content, need or not to produce and alarm.This method does not have really to extract the moving target in the picture, a large amount of false-alarms can occur, even as camera itself because the automatic adjustment that environmental change produces also can produce alarm.

Except that the video sensing of routine; the sensor that also has a lot of other types in the supervisory system; as sensors such as infrared sensor, electrostatic transducer and Men Ci commonly used in the circumference protection etc.; these sensors only rely on physical quantitys such as a certain electromagnetics, optics to change and make judgement; be vulnerable to unexpected disturbing factor influence and produce a large amount of mistake alarms; all can produce warning as the approaching of flying bird and other toys; this can't bear the unit exhausted of receiving a crime report, and causes realizing that the receive a crime report actual operability of integrated safe service of automatic alarm, interlock is not high.

Conventional video monitoring system is in the storage to monitored picture, because " unusually " that occurs in can not the automatic distinguishing picture, can only not add and distinguish whole records, cause a large amount of " invalid information " to occupy most storage spaces, " useful information " is submerged in these garbages fully, can't extract these " useful informations " efficiently as the evidence of handling afterwards, expect that these " useful informations " need expend a large amount of man power and materials.

Summary of the invention

The object of the present invention is to provide the intellective video monitoring device module that uses in a kind of intelligent video monitoring system, the image intelligent treatment facility that has based on it combines with the comprehensive safety defense monitoring system platform software of IVSS intelligent video, constitutes complete intelligent video monitoring system.

The present invention also aims to provide an intelligent video monitoring system.This system detects and the storage useful information automatically, need not manually monitor, and the supervisory system intellectuality, can before taking place, incident handle.

Have the character and the classification function of Intelligent Recognition different target, can accurately distinguish target types such as people, car, animal.

Have the moving target vigilance performance, can realize circumference protection accurately and intrusion detection according to any warning condition that the user sets.

Have moving target in automatic detection and the locking picture, accurately the PTZ following function can be ignored the disturbing factor influence, reduces false alarm rate.

Have automatic feature shoot function, but the complete documentation scene can obtain invador's high definition photo.

Has moving target behavior measuring ability, the detection that realizes falling down to the ground, the detection etc. of pacing up and down.

Have flow detection, crowded measuring ability, realize the busincess intelligence application.

Have the still life measuring ability, realize that legacy detects, stolen quality testing is surveyed.

Have the pyrotechnics measuring ability, can accurately distinguish flame and smog, send alarm according to the thresholding and the condition of prior formulation.

Have long-range, concentrated, finish the whole remote diagnosis of system, maintenance, upgrading, monitoring and management function automatically.

The present invention also aims to provide a kind of method for supervising of intelligent video monitoring system:

Based on above-mentioned intelligent video monitoring system, the verification afterwards that becomes conventional video monitoring is the method for supervising of early warning and prevention in advance.

The algorithm of multiple intellectual analysis such as comprising Target Recognition and classification, moving target warning, motion target tracking, PTZ follow the tracks of, feature shooting automatically, moving target behavior detection, flow detection, crowded detection, legacy/stolen quality testing survey, pyrotechnics detection is provided.

According to one aspect of the present invention, provided a kind of intellective video monitoring device module 100, described module comprises:

Load module 110 is used to obtain the on-the-spot various information of monitoring;

Output module 120 comprises the external alarm interlocking equipment;

Imageintelligent treatment facility 130 when being used to control the input/output module operate as normal, mainly is that various input informations are carried out intellectual analysis and processing;

Data/signaling transport module 140 are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server.

Power module 150 is used to provide each module work electricity consumption.

Best, described load module comprises:

Image unit 111, described image unit are one or several video camera cloud mirror systems that is used to gather vision signal;

Sound recording device 112 is used for the audio frequency acquiring signal;

External intrusion sensor 113 is used for other various information of collection site.

Best, described output module comprises alarm, loudspeaker, fire-fighting spraying equipment etc.

Best, described imageintelligent treatment facility 130 comprises:

Fieldsignal acquisition unit 131, this unit are used to receive the information of described load module input, and the analog information that is received is carried out the A/D conversion, to provide digital signal, so that carry out subsequent treatment;

The order that field data information that intellectualanalysis processing unit 132, this unit are gathered collectingunit 131 and remote monitoring terminal send is analyzed, and makes corresponding Intelligent treatment according to analysis result;

Video service unit 133, this unit are used to realize system management, incident management, communication data processing, audio, video data flow management, audio coding decoding and video encoding function.

Best, describedsound recording device 112 is MIC.

Best, described intellectual analysis that described imageintelligent treatment facility 130 is carried out and processing comprise that moving-target detects and pyrotechnics detects.

According to another aspect of the present invention, provided a kind of intelligent video monitoring system, described system comprises:

Intelligent in-situ monitor unit 10; IVSSPlatform Server 20; Videomonitoring system terminal 30;

Described intelligent in-situ monitor unit 10, comprise one or more described intellective videomonitoring device modules 101, described intellective video monitoring device module is placed on the on-the-spot interior different monitoring point of monitoring, is used to obtain field data and carries out intellectual analysis, and realize Intelligent treatment;

Described IVSSPlatform Server 20, under the management of IVSS platform software, described IVSS Platform Server is realized reception, analysis and the processing to multichannel far-end audio data, video data, sensor data information and imageintelligent treatment facility 130 intellectual analysis results, warning information, realization realizes configuration and maintenance to the described intellective video monitoring device module of far-end to demonstration, storage, playback and the retrieval of all types of data of far-end;

Described videomonitoring system terminal 30, described videomonitoring system terminal 30 comprises PC 301 and the network that is connected on the IVSS Platform Server;

Described network comprises internet and cordless communication network; Wherein, described internet links to each other with PC 302 ormail server 303; Described cordless communication network links to each other withmobile phone 304 or portable personaldigital processor 305.

Wherein, described intellective videomonitoring device module 101 comprises:

Load module 110 is used to obtain the on-the-spot various information of monitoring;

Output module 120 comprises the external alarm interlocking equipment;

Imageintelligent treatment facility 130 when being used to control the input/output module operate as normal, mainly is that various input informations are carried out intellectual analysis and processing; With

Data/signaling transport module 140 are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server.

Power module 150 is used to provide each module work electricity consumption.

Best, described IVSS Platform Server also comprises adata storage unit 202, is used to store the data that each control point sends, and carries out the inquiry of historical data and evidence obtaining in order to the user.

Best, described videomonitoring system terminal 30 is used to receive the warning information from the IVSS Platform Server, notifies the user to do further processing.

Best, described videomonitoring system terminal 30 is thePCs 301 that are connected on the described IVSSPlatform Server 20, or the PC 302 that links to each other with server by internet or other network, then described IVSS Platform Server is when having warning information to occur, transmit live audio/video data by network to terminal, and stack intellectual analysis result.

Best, described IVSSPlatform Server 20 links to each other withmail server 303, then when warning information occurs, IVSSPlatform Server 20 sends to the warning information or the intellectual analysis result's that superposeed the audio/video data form with Email in the Email mailbox of user in the mail server.

Best, described videomonitoring system terminal 30 ismobile phone 304 or PDA305, to the terminal transmits data bag, this packet is the alarm signal or the intellectual analysis result's that superposeed an audio/video data information to then described IVSS Platform Server by cordless communication network.

The user also can be at any old place in the world, arbitrary the computer from the internet or the miscellaneous equipment of access network, IP address and user ID and password access IVSSPlatform Server 20 by input IVSS Platform Server, and by the next instantaneous safety state of initiatively checking each control point of watch-list, perhaps check the historical record image and the Intelligent treatment result of each control point in the server database, realize not limiting the remote monitoring of distance.

According to another aspect more of the present invention, provided a kind of method for supervising of intelligent video monitoring system, said method comprising the steps of:

(1) in one or more monitoring scene, obtains the on-the-spot various information of described monitoring;

(2) data of gathering by 130 pairs of describedload modules 110 of image intelligent treatment facility are carried out intellectual analysis and processing;

(3) with analysis and result, the audio/video data coding back that collects and warning information together by sending described IVSSPlatform Server 20 on the Network Transmission interface to;

(4) described IVSSPlatform Server 20 receives or initiatively obtains relevant information, classifies and is correspondingly processed, and sends warning information to described videomonitoring system terminal 30, and the control intellective videomonitoring device module 101 of giving an order realizes that interlock alarms.

Best, institute carries out intellectual analysis and processing comprises target detection, tracking, classification and behavioural analysis.

Best, described imageintelligent treatment facility 130 can also be controlled external alarm equipment automatically and make corresponding Intelligent treatment.

Best, the intercommunication of described imageintelligent treatment facility 130 and describedIVSS Platform Server 20, describedIVSS Platform Server 20 comprises by the information that network interface sends to described image intelligent treatment facility 130: order data, digital audio-frequency data, control interface output information that all configuration parameters of described imageintelligent treatment facility 130, the work order data of opertaing device, control The Cloud Terrace rotate.

Best, use IVSS Platform Server (20) by and image intelligent treatment facility (130) between intercommunication mutually, can realize that applied environment is managed and function such as system's self-management.

Compared with prior art, intellective video monitoring device of the present invention because the imageintelligent treatment facility 130 that it has combines with the comprehensive safety defense monitoring system platform software of IVSS intelligent video, constitutes complete intelligent monitor system.By simple software and hardware the enforcement that can finish newly-built system is installed, also can be used on the upgrading to the analog/digital video monitoring system, it is convenient to implement, and compatibility is very strong.

Biggest advantage of the present invention is, can and store useful information from motion tracking, need not manually monitor, and also the supervisory system intellectuality, can before taking place, incident handle, stop the generation of incident.

Intelligent video monitoring system of the present invention can automatically lock the moving target in the picture, accurately follows the tracks of, and can ignore simultaneously the influence of the disturbing factors such as shade, rain, snow of animal, the branch that shakes, cloud, reduces false alarm rate significantly.And native system has automatic feature shoot function, so not only can invade the scene by complete documentation, can also obtain invador's high definition photo.

Intelligent video monitoring system of the present invention has and does not have fatigue, do not have carelessness and continual characteristics, reduces the demand to the operator on duty significantly, has reduced cost of labor.In addition, system is very high to the intellectual analysis and the processing capacity reliability of video pictures, has reduced the dependence to outside aiding sensors, further reduces false alarm rate, makes to realize that alarm automatically, the interlock integrated safe service of receiving a crime report becomes possibility.

Intelligent video monitoring system of the present invention only transmits and stores those " useful informations ", can not only guarantee high-quality real-time video transmission like this, save storage space, and in the future when evidence obtaining of searching, the user can make things convenient for and extract these " useful informations " efficiently, has reduced the consumption to human and material resources greatly.

Video monitoring system terminal of the present invention can adopt remote diagnosis, maintenance, upgrading, monitoring and management long-range, concentrated, that automated manner is finished the whole leading portion video monitoring equipments of system.

Description of drawings

Fig. 1 is the structural representation according to intellective video monitoring device module of the present invention.

Fig. 2 is the structured flowchart according to intelligent video monitoring system of the present invention.

Fig. 3 is the functional block diagram according to image intelligent treatment facility of the present invention.

Fig. 4 is according to moving target warning exemplary plot of the present invention.

Fig. 5 is according to the synchronous track up synoptic diagram of many camera lenses of the present invention.

Fig. 6 takes synoptic diagram according to many camera lenses relay tracking of the present invention.

Embodiment

Below, introduce embodiments of the present invention with reference to the accompanying drawings.

At first, with reference to accompanying drawing 1, show intellective videomonitoring device module 101 according to embodiments of the present invention.

As shown in Figure 1, this intellective video monitoring device module 101 comprises: load module 110, output module 120, image intelligent treatment facility 130, data/signaling transport module 140 and power module 150.Wherein, load module 110 is used to obtain the on-the-spot various information of monitoring.This load module 110 comprises for example image unit 111, sound recording device 112 and external all types of intrusion sensor 113.Image unit 111 for example is one or several video camera cloud mirror system, is used to gather vision signal.Sound recording device 112 for example comprises microphone, is used for the audio frequency acquiring signal.External intrusion sensor 113 is used for other various information of collection site.Output module 120 is external alarm interlocking equipments, comprises for example alarm lamp, loudspeaker, fire-fighting spraying equipment etc.When image intelligent treatment facility (SmartTrack) 130 is used to control load module 110, output module 120 operate as normal, mainly be that various input informations are carried out intellectual analysis and processing, the described intellectual analysis that image intelligent treatment facility 130 is carried out and handle can provide the complete identification result of the anomalous event that monitored scene takes place, do not need this complete identification result is carried out aftertreatment, this complete identification result just can provide the complete information relevant with described anomalous event.Data/signaling transport module 140 can be via the data/signaling communication between data network (such as internet, LAN (Local Area Network), wireless network, private etc.) realization image intelligent treatment facility 130 and the video monitoring system terminal.

As shown in Figure 1, imageintelligent treatment facility 130 comprises three parts: fieldsignal acquisition unit 131, this unit are used to receive the information ofload module 110 inputs, and the analog information that is received is carried out the A/D conversion, to provide digital signal, so that carry out subsequent treatment; Intellectualanalysis processing unit 132, this unit is analyzed the order that field data and remote monitoring end send, and makes Intelligent treatment according to analysis result;Video service unit 133, this unit are used for this unit and are used to realize system management, incident management, communication data processing, audio, video data flow management, audio coding decoding and video encoding function.

As mentioned above, self have analysis and processing power according to intellective videomonitoring device module 101 of the present invention at anomalous event, thereby when anomalous event takes place, can make respective handling automatically and give a warning, and send corresponding information toIVSS Platform Server 20, thereby removed monitoring client and operating personnel's thereof working pressure, guaranteed the accuracy of the incident that notes abnormalities simultaneously, eliminated the possibility that the mistakes and omissions anomalous event takes place.

Requirement at the real-time effectiveness of intelligent video monitoring, fieldsignal acquisition unit 131 is acquired signal in real time, including, but not limited to,image unit 111 andsound recording device 112 are gathered the audio frequency and video simulating signal in real time, utilize other detailed information ofexternal intrusion sensor 113 collection sites simultaneously, such as temperature, humidity, atmospheric pressure etc.

Imageintelligent treatment facility 130 can be to carrying out intellectual analysis and processing from the various input informations ofload module 110 with from the information of remote monitoring terminal.

As shown in Figure 3, the intellectualanalysis processing unit 132 in the imageintelligent treatment facility 130 comprises that moving-target detects and the pyrotechnics detection means, and this intellectualanalysis processing unit 132 is finished moving-target and detected and the pyrotechnics measuring ability.Video service unit 133 in the imageintelligent treatment facility 130 comprises system management member, incident management member, communication data processing member, audio and video data streams management component, audio coding decoding member and coding and decoding video member, and system management, incident management, communication data processing, audio, video data flow management, audio coding decoding and video encoding function are finished in this Video service unit.The functional block diagram of imageintelligent treatment facility 130 as shown in Figure 3.

To introduce these below in detail and form member.

The moving-target detection is used to realize Target Recognition and classification, moving target warning, motion target tracking, PTZ tracking, feature shooting automatically, moving target behavior detection, flow detection, detection, legacy/functions such as stolen quality testing survey crowd.

The pyrotechnics detection means is used to realize Smoke Detection and functions of flame detection.

The system management member is used to receive relevant task way scheduling configuration parameter, is responsible for the complete machine task scheduling; Management such as remote upgrade restarts; The heartbeat task management; The audio video synchronization periodic duty is differentiated video and is had or not, and produces video and has or not incident; IO, remote-controller data collection period task; Hardware testing task (internal memory and the test of outside total interface); Network protocol stack management etc.

The incident management member is used to receive incident and the various configuration parameter that each module of this machine produces, and produces various interlock actions according to the interlock prediction scheme, according to the configuration that incident is uploaded Case Number is uploaded, and receives or return configuration parameter.

Communication data processing member (comprising network interface, serial ports and HPI mouth) is used to receive each interface communication data that receives and the data that each module need send and finishes the communications reception data parsing, communication sends packing data, user authority management, differentiation functions such as (maximum 8 users).

The audio and video data streams management component is used to receive audio and video data streams and with controlled variable, link address port audio and video data streams is sent to each network and be connected, and receives or return configuration parameter, and the audio, video data of playing is delivered to physical layer interface.

The audio coding decoding member is used to receive voice data and encoding and decoding configuration parameter, controls encoding-decoding process according to configuration parameter, and codec data is sent to the data stream management module.

Video coding member receiving video data and coding configuration parameter are controlled cataloged procedure according to configuration parameter, and coded data are sent to the data stream management module.

Referring now to the intelligent video monitoring system of Fig. 2 introduction according to embodiments of the present invention.

This intelligent video monitoring system comprises intelligent in-situ monitor unit 10,IVSS Platform Server 20 and videomonitoring system terminal 30.

Intelligent video monitoring system according to embodiments of the present invention, intelligent in-situ monitor unit 10 comprises one or more intellective videomonitoring device modules 101, should can be placed on the on-the-spot interior suitable control point of monitoring by (these) intellective videomonitoring device module 101, be used to obtain field data and carry out intellectual analysis, and noticeIVSS Platform Server 20 when improper incident takes place is so that handle accordingly.

DescribedIVSS Platform Server 20 is used to realize voice data, video data, sensor data information and the imageintelligent treatment facility 130 intellectual analysis results that send to the configuration of intellective videomonitoring device module 101 and maintenance, to intellective videomonitoring device module 101, reception, analysis and the processing of warning information, realizes demonstration, storage, playback and retrieval to all types of data of far-end.

DescribedIVSS Platform Server 20 also comprises adata storage unit 202, is used to store the data that each control point sends, and carries out the inquiry of historical data and evidence obtaining in order to the user.

Described videomonitoring system terminal 30, comprise thePC 301 that is connected on the IVSS Platform Server, thePC 302, themail server 303 that link to each other with server by internet or other network, themobile phone 304, the portable personal digital processor (PDA) 305 that link to each other with server by cordless communication network;

Described videomonitoring system terminal 30 can receive the warning message thatIVSS Platform Server 20 sends, and notifies the user to do further processing.

If videomonitoring system terminal 30 is thePCs 301 that are connected on theIVSS Platform Server 20, or thePC 302 that links to each other with server by internet or other network, thenIVSS Platform Server 20 can be when receiving the warning information that comes from intellective videomonitoring device module 101, transmit on-the-spot audio/video data stream by network to videomonitoring system terminal 30, and the intellectual analysis result that in this data stream, superposes.

IfIVSS Platform Server 20 links to each other withmail server 303, then when warning information occurs,IVSS Platform Server 20 sends to the warning information or the intellectual analysis result's that superposeed the audio/video data form with Email in the Email mailbox of user in the mail server.

Best, described videomonitoring system terminal 30 ismobile phone 304 or PDA305, to the terminal transmits data bag, this packet is the alarm signal or the intellectual analysis result's that superposeed an audio/video data information to then described IVSS Platform Server by cordless communication network.

The user also can be at any old place in the world, arbitrary the computer from the internet or the miscellaneous equipment of access network, IP address and user ID and password accessIVSS Platform Server 20 by input IVSS Platform Server, and by the next instantaneous safety state of initiatively checking each control point of watch-list, perhaps check the historical record image and the Intelligent treatment result of each control point in the server database, realize not limiting the remote monitoring of distance.

In addition,IVSS Platform Server 20 can be safeguarded intellective videomonitoring device module 101 by Asynchronous Serial Interface RS232, also can carry out parameter and state configuration, and control it and work in and deploy troops on garrison duty or withdraw a garrison state intellective videomonitoring device module 101.

Below, with the operating process of introducing in detail according to the intelligent video monitoring system of embodiments of the present invention.

According to embodiments of the present invention, the imageintelligent treatment facility 130 in the intellective videomonitoring device module 101 has two kinds of duties, and a kind of is the state of deploying troops on garrison duty, and another kind is the state of withdrawing a garrison.The user can directly be provided with the duties of imageintelligent treatment facility 130 and switches byIVSS Platform Server 20, also can carry out the setting and the switching of duty by the data communication between all types of videomonitoring system terminals 30 and theIVSS Platform Server 20.

The core of system is an imageintelligent treatment facility 130, and it can carry out intellectual analysis and processing to various input informations.IVSS can safeguard imageintelligent treatment facility 130 by Asynchronous Serial Interface RS232, also can carry out parameter and state configuration, controls it and works in and deploy troops on garrison duty or withdraw a garrison state.

When imageintelligent treatment facility 130 works in when deploying troops on garrison duty state, fieldsignal acquisition unit 131 receives the on-the-spot video data of monitoring in real time fromload module 110 and carries out the A/D conversion, the digital signal after the conversion is passed to intellectualanalysis processing unit 132 carry out intellectual analysis.

What video camera was taken is a static relatively background, and when shooting picture changed, intellectualanalysis processing unit 132 carried out target detection.Target detection mainly is to detect those pixels that do not conform to background model in the present frame, just extracts the foreground target of present frame after they are linked up.This target detection is to realize by for example algorithm of gauss hybrid models method, frame difference method and dynamic self-adapting background subtraction method and so on.

After detecting target, 132 pairs of targets of intellectual analysis processing unit are followed the tracks of.Target following is by setting up the corresponding relation between frame and the frame, carries out then that similarity comparison or template matches realize, this target following for example is that the frame by Kalman filter method, standard waits to the frame track algorithm and realizes.

After having finished target detection and having followed the tracks of, intellectualanalysis processing unit 132 can obtain basic data information such as the position, size, color, shape, speed, direction, movement locus of target, utilizes these information intelligent analysis andprocessing unit 132 automatically tracking target to be carried out type identification and behavioural analysis.Type identification is for example utilized support vector machine, linear classifier to wait and is realized.Behavioural analysis is the information that obtains in comprehensive utilization target detection, tracking, the classification, and whether analyze has " incident " that meet the predefined alarm conditions in the storer (not shown) that is kept at intellectualanalysis processing unit 132 to take place.According to the difference of using, the content of behavioural analysis also is not quite similar, and as under the detection case of pacing up and down, mainly is the position and the movement locus of evaluating objects, and under the situation that legacy detects, and mainly is size, the shape of evaluating objects and parks duration.

If there be " incident " that meet alarm conditions to take place, then intellectualanalysis processing unit 132 sends warning information toIVSS Platform Server 20, and intellectualanalysis processing unit 132 can be made the various Intelligent treatment under the different alarm situations according to different parameter configuration simultaneously.Intellectualanalysis processing unit 132 can be realized the interlock control of external alarm equipment by No. 4 relays alarm Output InterfaceControl output module 120; Can start video recording,, target be carried out PTZ follow the tracks of feature shooting etc. by the rotation of Asynchronous Serial Interface RS485 control The Cloud Terrace, the change of camera state; Also can receive the instruction ofIVSS Platform Server 20, start real-time audio/video and browse, start the real-time audio intercommunication, start audio broadcasting etc.

Video service unit 133 in the imageintelligent treatment facility 130 will sendIVSS Platform Server 20 to after will monitoring the analysis processing result coding of on-the-spot audio/video data information, sensor information and intellectualanalysis processing unit 132, also can be under the situation of needs, the audio-frequency information that decoding IVSS transmits realizes that audio frequency is to the audio broadcasting of making peace.

When imageintelligent treatment facility 130 works in when withdrawing a garrison state, be equivalent to be in holding state.Imageintelligent treatment facility 130 is not analyzed field data at this moment, but can accept the instruction ofIVSS Platform Server 20, and according to the real-time audio/video data transmission of instruction startup, realize browsing of 30 pairs of monitoring of video monitoring system terminal live video information, also can realize the audio frequency intercommunication between the scene of monitoring and the video monitoring system terminal 30.Under the state of withdrawing a garrison, imageintelligent treatment facility 130 can receive the instruction fromIVSS Platform Server 20, reenters the state of deploying troops on garrison duty.

Imageintelligent treatment facility 130 also can receive the data ofexternal intrusion sensor 113 inputs by 4 way switch amount input interfaces, carries out intellectual analysis, has judged whether that warning information occurs.

Imageintelligent treatment facility 130 connects built-in 2 port one 0M/100M self-adaptation Ethernet switches by 10M/100M self-adaptation Ethernet interface, by the total data communication between Internet realizationIVSS Platform Server 20 and the imageintelligent treatment facility 130.

Introduce various functions and application below according to intelligent video monitoring system of the present invention.

1, moving target identification and classification

Can discern the character and the classification of different target intelligently according to intellective videomonitoring device module 101 of the present invention.After the basic data information of detection and extraction target, 132 pairs of targets of intellectual analysis processing unit are carried out type identification, accurately distinguish people, car, animal etc.

Moving target identification and classification can be applicable to the recognition of face field.After detection identifies human body, obtain the human body head photo, and judge according to biological characteristic whether it is the full face of people's face, if then compare with the face template of predefined detection target automatically, thereby identify its identity.

Moving target identification and classification also can be applicable to vehicle license identification field: after identifying target and being vehicle, judge type of vehicle automatically, and the identification license number.

2, moving target warning

Provide a graphic user interface (GUI) according to intelligent video monitoring system of the present invention, the user can make up setting (as shown in Figure 4) by mouse, keyboard etc. to warning conditions such as the scope in Security alert district, the type of target (as: people, car, animal etc.), target travel direction, target speeds in videomonitoring system terminal 30.

Detect object appearing in the video pictures according to intelligent video monitoring system of the present invention, only when having the incident that meets the warning condition to take place, just send alarm.

In conjunction with the identification and the classification of moving target, moving target warning can be used for realizing also can using fields such as non-stopping a train at a target point detects, route or travel by vehicle defines based on the gate inhibition or the vigilance performance of human identity or type of vehicle, license number.

3, motion target tracking

Monitor video image incessantly according to intelligent video monitoring system of the present invention, when detecting the target that meets predefined characteristic, intellectualanalysis processing unit 132 is determined position, the size of target, according to intelligent video monitoring system of the present invention form lock onto target with prompting frame on videomonitoring system terminal 30, and the movement locus of extraction target, the form with curve on videomonitoring system terminal 30 shows.

When occurring a plurality of qualified target in the video pictures, keep automatically comprising the tracking picture of target complete according to intelligent video monitoring system of the present invention, and show the movement locus of each target.

Motion target tracking both can be applicable to the protections of warning region on a large scale such as boundary line, customs, warehouse, military restricted zone, embassy, interior declaration form position, and the crowd is dense, the supervision of the public place of picture complexity also to can be applicable to road, square, station, harbour, airport etc.

4, PTZ follows the tracks of

According to the positional information of intelligent video monitoring system extraction target of the present invention, the controls lens The Cloud Terrace continues the focusing moving target automatically, makes target be positioned at the center of image frame all the time; Intelligent video monitoring system also can be adjusted focal length of camera, obtains the image of target close shot, distant view.Like this, intelligent video monitoring system is realized the PTZ of moving target is followed the tracks of by the control to video camera cloud mirror system.

Can carry out multi-angle to same target by imageintelligent treatment facility 130 automatic control multiple cameras according to intelligent video monitoring system of the present invention and follow the tracks of (as shown in Figure 5) synchronously, to obtain the clear more comprehensive monitored picture and the video recording of important goal; Also can control multiple cameras same target is carried out relay-type track up (as shown in Figure 6) in visual range separately, to obtain the monitored picture and the video recording of important goal full range of movement.

On videomonitoring system terminal 30, can preferentially access the picture that alarm event occurs come automatically according to intelligent video monitoring system of the present invention.When being in synchronous tracking mode of operation according to intelligent video monitoring system of the present invention, centralized displaying can be closed on the associated camera picture automatically by system; When being in the relay tracking pattern according to intelligent video monitoring system of the present invention, this system can be presented at target picture on the viewing area of appointment automatically one by one according to the order of video camera relay.

5, feature is taken automatically

Can control video camera cloud mirror system automatically according to intelligent video monitoring system of the present invention target is carried out head, whole body, close shot and 4 grades of feature track ups of panorama, when finding a plurality of target target is carried out feature shooting one by one, system controls video camera shortening camera lens again and changes the pan-shot mode over to then.Overall process that so not only can recording events, but also the high-resolution photo that can obtain target is as clue and evidence.

6, goal behavior detects

Target basic data information according to intelligent video monitoring system of the present invention utilizes intellectualanalysis processing unit 132 to extract can realize the goal behavior analysis.As to detect target be man-hour, and intelligent video monitoring system utilizes the position of target, and information such as size can realize the detection that falls down to the ground, and utilizes the detection that can realize pacing up and down of the information such as track, speed of target; Detecting target is that car is, intelligent video monitoring system utilizes information such as direction of motion can realize that vehicle drives in the wrong direction and detects.

7, busincess intelligence is used

Busincess intelligence is used and is comprised troop's length detection, and consumer behaviour is followed the tracks of, flow detection, crowded detection etc., and these intellectual analysis result can help businessman to realize the optimization configuration of commodity.

Busincess intelligence is used and is also comprised building management, for example adjusts illumination, heating, air-conditioning system etc. when the no one automatically.

8, article detect

Article detect two kinds of main application modes, and the one, stolen quality testing is surveyed, and a kind of is that legacy detects.

Stolen quality testing need when surveying the user by videomonitoring system terminal 30 in advance with the warning region of static monitoring articles, be removed duration and the eligible alarm event preservation video recording duration before taking place and be provided with to image intelligent treatment facility 130.To alarm automatically and the video recording of preservation incident complete procedure automatically the incident that meets the condition of setting according to intelligent video monitoring system of the present invention, and show the original position of still life that is moved by prompting frame.Still life detects the automatic monitoring that is applicable to jewelry, historical relic, showpiece etc.

Legacy need when detecting the user by videomonitoring system terminal 30 will forbid placing article zone, article size, park duration and meet the preservation video recording duration of alarm conditions incident before taking place and be provided with to image intelligent treatment facility 130.Will be according to intelligent video monitoring system of the present invention to the video recording of alarm and the incident of preservation complete procedure automatically of the incident that meets the condition of setting, and show the position of leaving over article by prompting frame.Legacy detects the needs that meet current anti-terrorism reality especially.

9, pyrotechnics detects automatically

According to intelligent video monitoring system of the present invention according to color of object, time domain variation, time domain periodicity, spatial variations, area extension and information such as time domain continuation, growth property, automatically detect flame and smog at video scene inner region branch, position at display frame subscript naked light flame and smog, and send warning information according to threshold values such as the smog area size of prior appointment, flame area sizes, also can detect the action of smoking in the monitored picture automatically according to intelligent video monitoring system of the present invention.When having fire to take place,, send the interlock signal, formed comprehensive, reliable fire-fighting system, can prevent or slow down fire spreading effectively to spraying system of fire fighting according to intellective videomonitoring device module 101 of the present invention and the interlock of miscellaneous cause sensor.

Automatically pyrotechnics detects the application demand that can satisfy indoor fire safety, outdoor architecture fire prevention, chemical plant or warehouse, forest fire protection.

10, on-the-spot warning

When having the alarm situation to occur, can play the warning sound in the storer (not shown) that is stored in imageintelligent treatment facility 130 in advance automatically according to intelligent video monitoring system of the present invention, also can control by videomonitoring system terminal 30, the warning sound of storage and uniform in the displaying videosupervisory system terminal 30 perhaps carries out the speech talkback between intellective videomonitoring device module 101 and the video monitoring system terminal 30.Can warn monitoring objective to break off an action immediately like this, to stop the generation of " incident ".

11, video demonstration, storage, playback and the search function of videomonitoring system terminal 30

Videomonitoring system terminal 30 receives the information that intellective videomonitoring device module 101 sends viaIVSS Platform Server 20, realize that terminal shows and storage, except that video data, videomonitoring system terminal 30 also demonstrates the intellectual analysis and the result of imageintelligent treatment facility 130, as superimposed motion target location prompting frame, path curves, pyrotechnics position indicating frame etc.The all right playback video information of user is watched repeatedly in addition.Videomonitoring system terminal 30 is stored in the warning information that each intellective videomonitoring device module 101 sends in the database, and the user can be when needed or by the time, or press event type, or by the monitoring scene these information are retrieved.

12, applied environment management

The condition of work that intellective videomonitoring device module 101 can realize automatically detects and alarm.The self check of camera chain integrality can prevent to forge the generation that monitor video signal, image comparison are spent situation such as low, that vision signal intensity is weak excessively, pick-up lens is covered, lose vision signal, The Cloud Terrace is out of control, the burnt length of camera lens is out of control.Imageintelligent treatment facility 130 fault self-checkings prevent that equipment from not having the generation of situations such as response, cpu load is too high, device temperature is too high, partial circuit is out of control.Detect communication quality during data/signaling transport module 140 self checks and whether meet minimum job requirement.

Intellective videomonitoring device module 101 can also be realized monitoring scene adaptive and alarm automatically.The high-brightness environment under the intellective videomonitoring device module 101 suitable sunlight and the video monitoring of the low irradiance environment at night, the video monitoring that is fit to infrared illumination, can get rid of the influence of various weather disturbing factors, the video monitoring service of 24 hours whole days, full weather is provided reliably.

13, system's self-management

Can carry out online remote upgrade to imageintelligent treatment facility 130, each member can online Remote configuration, and its monitored object can carry out remote loading.

Each intellective videomonitoring device module 101 is all supported the control of QoS service quality, Monitoring Data transmission network performance dynamically, and optimize and revise video, audio data stream, transmission quality that can the dynamically adapting for data network provides best monitoring video laser propagation effect.

The present invention is illustrated by top embodiment, still, should be appreciated that the present invention is not limited to particular example as described herein and embodiment.The purpose that comprises these particular example and embodiment here is to help those of skill in the art to put into practice the present invention.Any those of skill in the art are easy to be further improved without departing from the spirit and scope of the present invention and perfect, therefore the present invention only is subjected to the restriction of the content and the scope of claim of the present invention, and its intention contains all and is included in alternatives and equivalent in the spirit and scope of the invention that is limited by claims.

Claims (20)

1, a kind of intellective video monitoring device module (101) is characterized in that, described module comprises:

Load module (110) is used to obtain the on-the-spot various information of monitoring;

Output module (120) comprises the external alarm interlocking equipment;

Image intelligent treatment facility (130) is used to control load module and output module, and also is used for simultaneously intellectual analysis and processing are carried out in instruction and the input information that comes from load module; With

Data/signaling transport module (140) are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server.

Power module (150) is used to provide each module work electricity consumption.

2, according to the described intellective video monitoring device module of claim 1, it is characterized in that described load module comprises:

Image unit (111), described image unit are one or several video camera cloud mirror systems that is used to gather vision signal;

Sound recording device (112) is used for the audio frequency acquiring signal;

External intrusion sensor (113) is used for other various information of collection site.

According to the described intellective video monitoring device module of claim 1, it is characterized in that 3, described output module comprises alarm, loudspeaker, fire-fighting spraying equipment.

4, according to claim 1,2 or 3 described intellective video monitoring device modules, it is characterized in that described image intelligent treatment facility (130) comprising:

Field signal acquisition unit (131), this unit are used to receive the information of described load module input, and the analog information that is received is carried out the A/D conversion, to provide digital signal, so that carry out subsequent treatment;

The order that field data that intellectual analysis processing unit (132), this unit are gathered collecting unit (131) and remote monitoring terminal send is analyzed, and makes corresponding Intelligent treatment according to analysis result;

Video service unit (133), this unit are used to realize system management, incident management, communication data processing, audio, video data flow management, audio coding decoding and video encoding function.

According to the described intellective video monitoring device module of claim 2, it is characterized in that 5, described sound recording device (112) is MIC.

6, according to the described intellective video monitoring device module of claim 4, it is characterized in that,

Described intellectual analysis that described image intelligent treatment facility (130) is carried out and processing comprise that moving-target detects and pyrotechnics detects.

7, a kind of intelligent video monitoring system that adopts as the arbitrary described intellective video monitoring device module of claim 1～6 is characterized in that described system comprises: intelligent in-situ monitor unit (10); IVSS Platform Server (20); Video monitoring system terminal (30);

Described intelligent in-situ monitor unit (10), comprise one or more described intellective video monitoring device modules (101), described intellective video monitoring device module is placed on the on-the-spot interior different monitoring point of monitoring, is used to obtain field data and carries out intellectual analysis, and realize Intelligent treatment;

Described IVSS Platform Server (20), under the management of IVSS platform software, described IVSS Platform Server is realized reception, analysis and the processing to multichannel far-end audio data, video data, sensor data information and image intelligent treatment facility (130) intellectual analysis result, warning information, realization realizes configuration and maintenance to the described intellective video monitoring device module of far-end to demonstration, storage, playback and the retrieval of all types of data of far-end;

Described video monitoring system terminal (30) comprises the PC (301) and the network that are connected on the IVSS Platform Server;

Wherein, described intellective video monitoring device module (101) comprising:

Load module (110) is used to obtain the on-the-spot various information of monitoring;

Output module (120) comprises the external alarm interlocking equipment;

Image intelligent treatment facility (130) is used to control load module and output module, and also is used for simultaneously intellectual analysis and processing are carried out in instruction and the input information that comes from load module; With

Data/signaling transport module (140) are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server.

Power module (150) is used to provide each module work electricity consumption.

According to the described intelligent video monitoring system of claim 7, it is characterized in that 8, described network comprises internet and cordless communication network; Wherein, described internet links to each other with PC (302) or mail server (303); Described cordless communication network links to each other with mobile phone (304) or portable personal digital processor (305).

9, according to the described intelligent video monitoring system of claim 7, it is characterized in that, also comprise a data storage unit (202), be used to store the data that each control point sends, carry out the inquiry of historical data and evidence obtaining in order to the user.

10, according to the described intelligent video monitoring system of claim 7, it is characterized in that,

Described video monitoring system terminal is used to receive the warning information from the IVSS Platform Server, and notifies the user to do further processing.

11, according to claim 7 or 10 described intelligent video monitoring systems, it is characterized in that, described video monitoring system terminal (30) is the PC (301) that is connected on the described IVSS Platform Server (20), or the PC (302) that links to each other with server by internet or other network, then described IVSS Platform Server (20) is when having warning information to occur, transmit live audio/video data by network to terminal, and stack intellectual analysis result.

12, according to claim 7 or 10 described intelligent video monitoring systems, it is characterized in that, described IVSS Platform Server (20) links to each other with mail server (303), then when warning information occurs, IVSS Platform Server (20) sends to the warning information or the intellectual analysis result's that superposeed the audio/video data form with Email in the Email mailbox of user in the mail server.

13, according to claim 7 or 10 described intelligent video monitoring systems, it is characterized in that, described video monitoring system terminal (30) is mobile phone (304) or PDA (305), to the terminal transmits data bag, this packet is the alarm signal or the intellectual analysis result's that superposeed an audio/video data information to then described IVSS Platform Server (20) by cordless communication network.

14, according to claim 7 or 10 described intelligent video monitoring systems, it is characterized in that, the user also can be at any old place in the world, arbitrary the computer from the internet or the miscellaneous equipment of access network, IP address and user ID and password access IVSS Platform Server (20) by input IVSS Platform Server, and by the next instantaneous safety state of initiatively checking each control point of watch-list, perhaps check the historical record image and the Intelligent treatment result of each control point in the server database, realize not limiting the remote monitoring of distance.

15, a kind of method for supervising of intelligent video monitoring system is characterized in that, said method comprising the steps of:

(1) in one or more monitoring scene, obtains the on-the-spot various information of described monitoring;

(2) by image intelligent treatment facility (130) data of described load module (110) input are carried out intellectual analysis and processing,

(3) with analysis and result, the audio/video data coding back that collects and warning information together by sending described IVSS Platform Server (20) on the Network Transmission interface to;

(4) described IVSS Platform Server (20) is received or initiatively obtains relevant information, classify and be correspondingly processed, send warning information to described video monitoring system terminal (30), the control intellective video monitoring device module (101) of giving an order is realized the interlock alarm.

According to the method for supervising of the described intelligent video monitoring system of claim 15, it is characterized in that 16, institute carries out intellectual analysis and processing comprises target detection, tracking, classification and behavioural analysis.

17, according to the method for supervising of the described intelligent monitor system of claim 15, it is characterized in that intellectual analysis that is carried out and processing can realize functions such as Target Recognition and classification, moving target warning, motion target tracking, PTZ follow the tracks of, feature shooting automatically, moving target behavior detection, flow detection, crowded detection, legacy/stolen quality testing survey, pyrotechnics detection.

According to the method for supervising of the described intelligent video monitoring system of claim 15, it is characterized in that 18, described image intelligent treatment facility (130) is also controlled external unit automatically and made corresponding alarming processing.

19, according to the method for supervising of the arbitrary described intelligent video monitoring system of claim 15～18, it is characterized in that, the intercommunication of described image intelligent treatment facility (130) and described IVSS Platform Server (20), described IVSS Platform Server (20) comprises by the information that network interface sends to described image intelligent treatment facility (130): order data, digital audio-frequency data, control interface output information that all configuration parameters of described image intelligent treatment facility (130), the work order data of opertaing device, control The Cloud Terrace rotate.

20, according to the method for supervising of the described intelligent video monitoring system of claim 19, it is characterized in that, use IVSS Platform Server (20) by and image intelligent treatment facility (130) between intercommunication mutually, can realize that applied environment is managed and function such as system's self-management.

Images