CN100504942C - Intelligent video monitoring equipment module and system and monitoring method thereof - Google Patents

Abstract

An intelligent video monitor system comprises one or multiple on-site intelligent video monitor device module, IVSS platform server and video monitor system terminal. It is featured as forming said on-site intelligent monitor device module by input module, output module, image intelligent processing-module and data/signaling transmission module.

Description

Translated fromChinese

智能视频监控设备模组和系统及其监控方法Intelligent video monitoring equipment module and system and monitoring method thereof

技术领域technical field

本发明涉及智能视频监控设备模组和系统及其监控方法，特别是，涉及一种对监视场景中目标进行实时检测、跟踪、分类、行为分析等智能化、自动化处理的现场智能监控设备，以及基于该现场智能监控设备的智能视频监控系统和监控方法。The present invention relates to an intelligent video monitoring equipment module and system and a monitoring method thereof, in particular to an on-site intelligent monitoring equipment for real-time detection, tracking, classification, behavior analysis and other intelligent and automatic processing of targets in a monitoring scene, and An intelligent video monitoring system and a monitoring method based on the on-site intelligent monitoring equipment.

背景技术Background technique

目前常规的视频监控系统仅是将监控场景图像通过DVS传送到监控室，由人来完成对监控场景中出现“异常”的判断，或通过DVR完成视频存储以实现事后的查看和取证。在上述监控系统中，人扮演了非常关键的角色，由于以下原因可能导致“真正的事件”只有非常微小的部分会被发现：(1)视频监控系统中使用大量的监控摄像机，而只有少量的摄像机画面能显示在监控屏幕上，需要通过不断地切换以保证被人看到；(2)人的注意力不能长时间集中在监控画面上，20分钟后将有80％的有效信息丢失；(3)决大多数监控画面均为“无效信息”(没有事件发生)。因此常规的监控系统仅能起到事后查看和取证的功能。At present, the conventional video surveillance system only transmits the monitoring scene images to the monitoring room through DVS, and the judgment of "abnormality" in the monitoring scene is completed by humans, or the video storage is completed through DVR to realize post-event viewing and evidence collection. In the above-mentioned monitoring system, people play a very critical role. Due to the following reasons, only a very small part of the "real event" may be discovered: (1) A large number of monitoring cameras are used in the video monitoring system, and only a small number The camera picture can be displayed on the monitoring screen, which needs to be constantly switched to ensure that it is seen by others; (2) people’s attention cannot be concentrated on the monitoring picture for a long time, and 80% of the effective information will be lost after 20 minutes; ( 3) Most of the monitoring pictures are "invalid information" (no event occurs). Therefore, the conventional monitoring system can only perform the functions of checking and obtaining evidence afterwards.

目前也有一些DVS、DVR或IP摄像机加入了“移动侦察”的功能，移动侦察主要是通过监视画面“图像块”之间的比对，判断画面内容是否发生变动，需要不需要产生告警。这种方法没有真正提取画面中的运动目标，会出现大量的虚警，如即使是相机本身由于环境变化产生的自动调整也会产生告警。At present, some DVS, DVR or IP cameras have added the function of "mobile detection". Mobile detection is mainly through the comparison between the "image blocks" of the monitoring screen to determine whether the content of the screen has changed, and whether it is necessary to generate an alarm. This method does not really extract the moving target in the picture, and there will be a large number of false alarms. For example, even the automatic adjustment of the camera itself due to environmental changes will also generate alarms.

除常规的视频传感外，监控系统中还有很多其它类型的传感器，如周界保护中常用的红外传感器、静电传感器以及门磁等传感器等，这些传感器仅依靠某一种电磁学、光学等物理量发生变化来做出判断，易受到意外干扰因素影响而产生大量误告警，如飞鸟和其他小动物的接近都会产生报警，这使接警单位疲惫不堪，导致实现自动告警、联动接警一体化安全服务的实际可操作性不高。In addition to conventional video sensors, there are many other types of sensors in the monitoring system, such as infrared sensors, electrostatic sensors, and door magnetic sensors commonly used in perimeter protection. These sensors only rely on a certain kind of electromagnetic, optical, etc. Changes in physical quantities are used to make judgments, which are easily affected by unexpected interference factors and cause a large number of false alarms. For example, the approach of birds and other small animals will generate alarms, which makes the alarm receiving units exhausted, leading to the realization of automatic alarms, linkage alarms and integrated security services The actual operability is not high.

常规的视频监控系统在对监控画面的存储中，由于不能自动区分画面中出现的“异常”，只能不加区分全部记录，导致大量的“无效信息”占据了绝大多数的存储空间，“有用信息”完全淹没在这些无用信息中，无法高效地提取这些“有用信息”作为事后处理的证据，要想得到这些“有用信息”需要耗费大量的人力和物力。In the storage of monitoring pictures, conventional video surveillance systems cannot automatically distinguish the "abnormalities" that appear in the pictures, so they can only record all of them without distinction, resulting in a large amount of "invalid information" occupying most of the storage space, " "Useful information" is completely submerged in these useless information, and it is impossible to efficiently extract these "useful information" as evidence for post-processing. To obtain these "useful information" requires a lot of manpower and material resources.

发明内容Contents of the invention

本发明的目的在于提供一种智能视频监控系统中使用的智能视频监控设备模组，基于它具有的图像智能处理设备与IVSS智能视频综合安防监控系统平台软件相结合，构成完整的智能视频监控系统。The purpose of the present invention is to provide an intelligent video surveillance equipment module used in an intelligent video surveillance system, based on the combination of its intelligent image processing equipment and IVSS intelligent video comprehensive security monitoring system platform software, a complete intelligent video surveillance system is formed .

本发明的目的还在于提供一个智能视频监控系统。该系统自动检测并存储有用信息，不用人工监视，而且监控系统智能化，可以在事件发生前进行处理。The object of the present invention is also to provide an intelligent video monitoring system. The system automatically detects and stores useful information without manual monitoring, and the monitoring system is intelligent and can handle events before they occur.

具有智能识别不同目标的性质和类别功能，可准确区分人、车、动物等目标类型。It has the function of intelligently identifying the nature and category of different targets, and can accurately distinguish target types such as people, vehicles, and animals.

具有运动目标警戒功能，可依据用户设定的任意警戒条件实现准确的周界保护和入侵检测。It has a moving target warning function, which can realize accurate perimeter protection and intrusion detection according to any warning conditions set by the user.

具有自动检测并锁定画面中运动目标，准确PTZ跟踪功能，可忽略干扰因素影响，减小误报警率。With automatic detection and locking of moving targets in the screen, accurate PTZ tracking functions, the influence of interference factors can be ignored, and the false alarm rate can be reduced.

具有自动特写拍摄功能，可完整记录现场，可获得入侵者的高清晰度照片。With automatic close-up shooting function, it can fully record the scene and obtain high-definition photos of intruders.

具有运动目标行为检测功能，实现倒地检测、徘徊检测等。It has the function of detecting the behavior of moving objects, and realizes the detection of falling to the ground and wandering detection.

具有流量检测、拥挤检测功能，实现商业智能化应用。It has the functions of traffic detection and congestion detection, and realizes the application of business intelligence.

具有静物检测功能，实现遗留物检测、被盗物检测。It has the function of still object detection to realize the detection of relics and stolen objects.

具有烟火检测功能，可准确区分火焰和烟雾，根据事先制定的门限和条件发出告警。With smoke and fire detection function, it can accurately distinguish between flame and smoke, and send out an alarm according to the threshold and conditions established in advance.

具有远程、集中、自动完成系统全部远程诊断、维护、升级、监控和管理功能。It has remote, centralized and automatic completion of all remote diagnosis, maintenance, upgrade, monitoring and management functions of the system.

本发明的目的还在于提供一种智能视频监控系统的监控方法：The object of the present invention is also to provide a monitoring method of an intelligent video monitoring system:

基于上述智能视频监控系统，变常规视频监控的事后查证为事前预警和阻止的监控方法。Based on the above-mentioned intelligent video surveillance system, the post-event verification of conventional video surveillance is changed to a monitoring method of early warning and prevention.

提供包括目标识别与分类、运动目标警戒、运动目标跟踪、PTZ跟踪、自动特写拍摄、运动目标行为检测、流量检测、拥挤检测、遗留物/被盗物检测、烟火检测等多种智能分析的算法。Provide a variety of intelligent analysis algorithms including target recognition and classification, moving target alert, moving target tracking, PTZ tracking, automatic close-up shooting, moving target behavior detection, flow detection, congestion detection, leftover/stolen object detection, firework detection, etc. .

按照本发明的一个方面，给出了一种智能视频监控设备模组100，所述模组包括：According to one aspect of the present invention, a kind of intelligent video surveillance equipment module 100 is provided, and the module includes:

输入模块110，用于获取监控现场的各种信息；Theinput module 110 is used to obtain various information of the monitoring site;

输出模块120，包括外部告警联动设备；Output module 120, including external alarm linkage equipment;

图像智能处理设备130，用于控制输入/输出模块正常工作的同时，主要是对各种输入信息进行智能分析和处理；The imageintelligent processing device 130 is used to control the normal operation of the input/output module, and mainly perform intelligent analysis and processing on various input information;

数据/信令传输模块140，用于通过交换机，经由互联网实现图像智能处理设备和IVSS平台服务器之间的数据/信令通信。The data/signaling transmission module 140 is used to implement the data/signaling communication between the intelligent image processing device and the IVSS platform server via the Internet through the switch.

电源模块150，用于提供各个模块工作用电。Thepower supply module 150 is used to provide working power for each module.

最好，所述输入模块包括：Preferably, the input module includes:

摄像单元111，所述摄像单元是一个或几个用于采集视频信号的摄像机云镜系统；Camera unit 111, the camera unit is one or several camera cloud mirror systems for collecting video signals;

声音录入设备112，用于采集音频信号；Sound recording device 112, is used for collecting audio signal;

外置侵入传感器113，用于采集现场的其它各类信息。Anexternal intrusion sensor 113 is used to collect other types of information on site.

最好，所述输出模块包括报警器、扬声器、消防喷淋设备等。Preferably, the output module includes an alarm, a loudspeaker, fire sprinkler equipment and the like.

最好，所述图像智能处理设备130包括：Preferably, the imageintelligent processing device 130 includes:

现场信号采集单元131，该单元用于接收所述输入模块输入的信息，并对所接收的模拟信息进行A/D转换，以给出数字信号，以便进行后续处理；On-sitesignal acquisition unit 131, which is used to receive the information input by the input module, and perform A/D conversion on the received analog information to give a digital signal for subsequent processing;

智能分析处理单元132，该单元对采集单元131采集的现场数据信息以及远程监控终端传送来的命令进行分析，并根据分析结果做出相应智能处理；An intelligent analysis andprocessing unit 132, which analyzes the on-site data information collected by theacquisition unit 131 and the commands sent by the remote monitoring terminal, and makes corresponding intelligent processing according to the analysis results;

视频服务单元133，该单元用于实现系统管理、事件管理、通信数据处理、音视频数据流管理、音频编解码以及视频编码功能。Video service unit 133, which is used to implement system management, event management, communication data processing, audio and video data flow management, audio codec and video coding functions.

最好，所述声音录入设备112是MIC。Preferably, thevoice recording device 112 is a MIC.

最好，所述图像智能处理设备130所进行的所述智能分析和处理包括动目标检测和烟火检测。Preferably, the intelligent analysis and processing performed by the imageintelligent processing device 130 includes moving object detection and smoke detection.

按照本发明的另一个方面，给出了一种智能视频监控系统，所述系统包括：According to another aspect of the present invention, a kind of intelligent video monitoring system is provided, and described system comprises:

现场智能监控单元10；IVSS平台服务器20；视频监控系统终端30；On-siteintelligent monitoring unit 10; IVSSplatform server 20; videomonitoring system terminal 30;

所述现场智能监控单元10，包括一个或多个所述智能视频监控设备模组101，所述智能视频监控设备模组放置在监控现场内的不同监控点，用于获取现场数据进行智能分析，并实现智能处理；The on-siteintelligent monitoring unit 10 includes one or more of the intelligent videomonitoring equipment modules 101, and the intelligent video monitoring equipment modules are placed at different monitoring points in the monitoring site to obtain on-site data for intelligent analysis, And realize intelligent processing;

所述IVSS平台服务器20，在IVSS平台软件的管理下，所述IVSS平台服务器实现对多路远端音频数据、视频数据、传感器数据信息、以及图像智能处理设备130智能分析结果、告警信息的接收、分析和处理，实现对远端各类型数据的显示、存储、回放和检索，实现对远端所述智能视频监控设备模组的配置和维护；The IVSSplatform server 20, under the management of the IVSS platform software, the IVSS platform server realizes the reception of multi-channel remote audio data, video data, sensor data information, and imageintelligent processing equipment 130 intelligent analysis results and alarm information , analysis and processing, to realize the display, storage, playback and retrieval of various types of data at the remote end, and to realize the configuration and maintenance of the intelligent video surveillance equipment modules at the remote end;

所述视频监控系统终端30，所述视频监控系统终端30包括连接在IVSS平台服务器上的PC机301和网络；Described videomonitoring system terminal 30, described videomonitoring system terminal 30 comprises thePC machine 301 and network that are connected on the IVSS platform server;

所述网络包括互联网和无线通信网络；其中，所述互联网与PC机302或邮件服务器303相连；所述无线通信网络与移动电话304或便携式个人数字处理机305相连。The network includes the Internet and a wireless communication network; wherein, the Internet is connected to a PC 302 or amail server 303 ; and the wireless communication network is connected to amobile phone 304 or a portable personaldigital processor 305 .

其中，所述智能视频监控设备模组101包括：Wherein, the intelligent videosurveillance equipment module 101 includes:

输入模块110，用于获取监控现场的各种信息；Theinput module 110 is used to obtain various information of the monitoring site;

输出模块120，包括外部告警联动设备；Output module 120, including external alarm linkage equipment;

图像智能处理设备130，用于控制输入/输出模块正常工作的同时，主要是对各种输入信息进行智能分析和处理；和The imageintelligent processing device 130 is used to control the normal operation of the input/output module, and mainly perform intelligent analysis and processing on various input information; and

数据/信令传输模块140，用于通过交换机，经由互联网实现图像智能处理设备和IVSS平台服务器之间的数据/信令通信。The data/signaling transmission module 140 is used to implement the data/signaling communication between the intelligent image processing device and the IVSS platform server via the Internet through the switch.

电源模块150，用于提供各个模块工作用电。Thepower supply module 150 is used to provide working power for each module.

最好，所述IVSS平台服务器还包括一个数据存储单元202，用于存储各监控点传送来的数据，以备用户进行历史数据查询和取证。Preferably, the IVSS platform server also includes adata storage unit 202, which is used to store the data transmitted from each monitoring point, so as to prepare users for historical data query and evidence collection.

最好，所述视频监控系统终端30用于接收来自IVSS平台服务器的告警信息，通知用户做进一步的处理。Preferably, the videomonitoring system terminal 30 is used to receive the alarm information from the IVSS platform server, and notify the user for further processing.

最好，所述视频监控系统终端30是连接在所述IVSS平台服务器20上的PC机301，或通过互联网或其它网络与服务器相连的PC机302，则所述IVSS平台服务器在有告警信息出现时，通过网络向终端传送现场音频/视频数据，并叠加智能分析结果。Preferably, the videomonitoring system terminal 30 is connected to thePC 301 on theIVSS platform server 20, or thePC 302 connected to the server through the Internet or other networks, then the IVSS platform server has an alarm message to occur At the same time, the on-site audio/video data is transmitted to the terminal through the network, and the intelligent analysis results are superimposed.

最好，所述IVSS平台服务器20与邮件服务器303相连，则当有告警信息出现时，IVSS平台服务器20将告警信息或叠加了智能分析结果的音频/视频数据以电子邮件的形式发送到邮件服务器中用户的Emai1邮箱内。Preferably, theIVSS platform server 20 is connected with themail server 303, then when the warning information occurs, theIVSS platform server 20 sends the warning information or the audio/video data superimposed with the intelligent analysis result to the mail server in the form of email In the user's Email1 mailbox.

最好，所述视频监控系统终端30是移动电话304或PDA305，则所述IVSS平台服务器通过无线通信网络向终端发送数据包，该数据包为告警信号、或者叠加了智能分析结果的音频/视频数据信息。Preferably, the videomonitoring system terminal 30 is amobile phone 304 or aPDA 305, then the IVSS platform server sends a data packet to the terminal through a wireless communication network, and the data packet is an alarm signal or an audio/video superimposed with an intelligent analysis result Data information.

用户也可以在世界的任何一个地方，从互联网上的任一台电脑或接入网络的其它设备，通过输入IVSS平台服务器的IP地址和用户ID及口令接入IVSS平台服务器20，并通过监控列表来主动查看各个监控点的即时安全状态，或者查看服务器数据库中各个监控点的历史记录图像及智能处理结果，实现不限定距离的远端监控。Users can also access theIVSS platform server 20 from any computer on the Internet or other devices connected to the network at any place in the world by inputting the IP address, user ID and password of the IVSS platform server, and access theIVSS platform server 20 through the monitoring list. To actively view the real-time security status of each monitoring point, or view the historical record images and intelligent processing results of each monitoring point in the server database, to achieve remote monitoring without a limited distance.

按照本发明的再另一个方面，给出了一种智能视频监控系统的监控方法，所述方法包括以下步骤：According to yet another aspect of the present invention, a monitoring method of an intelligent video monitoring system is provided, the method comprising the following steps:

(1)在一个或多个监控现场中获取所述监控现场的各种信息；(1) Obtain various information of the monitoring site in one or more monitoring sites;

(2)通过图像智能处理设备130对所述输入模块110采集的数据进行智能分析和处理；(2) intelligently analyzing and processing the data collected by theinput module 110 through the imageintelligent processing device 130;

(3)将分析及处理结果、采集到的音频/视频数据编码后和告警信息一起通过网络传输接口上传送给所述IVSS平台服务器20；(3) After analyzing and processing the result, the audio/video data code that collects and alarm information are sent to describedIVSS platform server 20 through the network transmission interface together;

(4)所述IVSS平台服务器20接收或主动获取相关信息，进行分类并作相应的处理，将告警信息传送给所述视频监控系统终端30，发出命令控制智能视频监控设备模组101实现联动告警。(4) TheIVSS platform server 20 receives or actively acquires relevant information, classifies and performs corresponding processing, transmits the alarm information to the videomonitoring system terminal 30, and issues a command to control the intelligent videomonitoring equipment module 101 to realize linkage alarm .

最好，所进行智能分析和处理包括目标检测、跟踪、分类和行为分析。Preferably, the intelligent analysis and processing performed includes object detection, tracking, classification and behavioral analysis.

最好，所述图像智能处理设备130还可以自动控制外部告警设备做出相应智能处理。Preferably, the intelligentimage processing device 130 can also automatically control the external alarm device to perform corresponding intelligent processing.

最好，所述图像智能处理设备130与所述IVSS平台服务器20之间相互通信，所述IVSS平台服务器20通过网络接口发送给所述图像智能处理设备130的信息包括：所述图像智能处理设备130的所有配置参数、控制设备的工作命令数据、控制云台转动的命令数据、数字音频数据、控制接口输出信息。Preferably, the intelligentimage processing device 130 communicates with theIVSS platform server 20, and the information sent by theIVSS platform server 20 to the intelligentimage processing device 130 through the network interface includes: the intelligent image processing device All configuration parameters of 130, work command data for controlling equipment, command data for controlling pan/tilt rotation, digital audio data, and control interface output information.

最好，应用IVSS平台服务器(20)通过和图像智能处理设备(130)之间的相互通信，可以实现应用环境管理和系统自身管理等功能。Preferably, the application IVSS platform server (20) can realize functions such as application environment management and system self-management through mutual communication with the image intelligent processing device (130).

与现有技术相比，本发明的智能视频监控设备，由于它具有的图像智能处理设备130与IVSS智能视频综合安防监控系统平台软件结合，构成完整的智能监控系统。通过简单的软硬件安装即可完成新建系统的实施，也可用于对模拟/数字视频监控系统的升级改造上，实施方便，兼容性很强。Compared with the prior art, the intelligent video monitoring equipment of the present invention forms a complete intelligent monitoring system due to the combination of the imageintelligent processing equipment 130 it has and the IVSS intelligent video comprehensive security monitoring system platform software. The implementation of the new system can be completed through simple software and hardware installation, and it can also be used for the upgrade and transformation of the analog/digital video surveillance system. It is easy to implement and has strong compatibility.

本发明最大的优点在于，可以自动跟踪并存储有用信息，不用人工监视，而且监控系统智能化，可以在事件发生前进行处理，阻止事件的发生。The biggest advantage of the present invention is that useful information can be automatically tracked and stored without manual monitoring, and the monitoring system is intelligent, which can process events before they occur to prevent events from happening.

本发明的智能视频监控系统可以自动锁定画面中的运动目标，进行准确跟踪，同时可以忽略动物、摇动的树枝、云的阴影、雨、雪等干扰因素的影响，大幅度减小误报警率。而且，本系统具有自动特写拍摄功能，这样不仅可以完整记录入侵现场，还可以获得入侵者的高清晰度照片。The intelligent video monitoring system of the present invention can automatically lock the moving target in the picture and track it accurately, while ignoring the influence of disturbing factors such as animals, shaking branches, cloud shadows, rain, snow, etc., and greatly reducing the rate of false alarms. Moreover, the system has an automatic close-up shooting function, so that not only can a complete record of the intrusion scene be obtained, but also high-resolution photos of the intruder can be obtained.

本发明的智能视频监控系统具有无疲劳、无疏忽和不间断的特点，大幅度减少对值班人员的需求，降低了人工成本。另外，系统对视频画面的智能分析和处理功能可靠性很高，减小了对外部辅助传感器的依赖，进一步降低误报警率，使实现自动告警、联动接警一体化安全服务成为可能。The intelligent video monitoring system of the present invention has the characteristics of no fatigue, no negligence, and no interruption, greatly reduces the demand for on-duty personnel, and reduces labor costs. In addition, the system's intelligent analysis and processing functions for video images are highly reliable, which reduces the dependence on external auxiliary sensors, further reduces the false alarm rate, and makes it possible to realize the integrated security service of automatic alarm and linkage alarm reception.

本发明的智能视频监控系统只传输并存储那些“有用信息”，这样不仅能保证高质量的实时视频传输，节省存储空间，而且在日后的查找取证时，用户可以方便而高效地提取这些“有用信息”，大大减小了对人力、物力的消耗。The intelligent video monitoring system of the present invention only transmits and stores those "useful information", which not only ensures high-quality real-time video transmission and saves storage space, but also allows users to conveniently and efficiently extract these "useful information" when searching for evidence in the future. Information", greatly reducing the consumption of manpower and material resources.

本发明的视频监控系统终端可以采用远程、集中、自动方式完成系统全部前段视频监控设备的远程诊断、维护、升级、监控和管理。The video monitoring system terminal of the present invention can complete remote diagnosis, maintenance, upgrade, monitoring and management of all front-end video monitoring equipment of the system in a remote, centralized and automatic manner.

附图说明Description of drawings

图1是按照本发明的智能视频监控设备模组的结构示意图。Fig. 1 is a schematic structural diagram of an intelligent video monitoring equipment module according to the present invention.

图2是按照本发明的智能视频监控系统的结构框图。Fig. 2 is a structural block diagram of the intelligent video monitoring system according to the present invention.

图3是按照本发明的图像智能处理设备的功能框图。Fig. 3 is a functional block diagram of an image intelligent processing device according to the present invention.

图4是按照本发明的运动目标警戒示例图。Fig. 4 is an example diagram of moving target warning according to the present invention.

图5是按照本发明的多镜头同步跟踪拍摄示意图。Fig. 5 is a schematic diagram of multi-lens synchronous tracking shooting according to the present invention.

图6是按照本发明的多镜头接力跟踪拍摄示意图。Fig. 6 is a schematic diagram of multi-camera relay tracking shooting according to the present invention.

具体实施方式Detailed ways

下面，将参照附图介绍本发明的实施方式。Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

首先，参照附图1，示出了按照本发明的实施方式的智能视频监控设备模组101。First, referring to Fig. 1 , it shows an intelligent videosurveillance device module 101 according to an embodiment of the present invention.

如图1所示，该智能视频监控设备模组101包括：输入模块110、输出模块120、图像智能处理设备130、数据/信令传输模块140和电源模块150。其中，输入模块110用于获取监控现场的各种信息。该输入模块110包括例如摄像单元111、声音录入设备112和外置各类型侵入传感器113。摄像单元111例如是一个或几个摄像机云镜系统，用于采集视频信号。声音录入设备112例如包括麦克风，用于采集音频信号。外置侵入传感器113用于采集现场的其它各类信息。输出模块120是外部告警联动设备，包括例如报警灯、扬声器、消防喷淋设备等。图像智能处理设备(SmartTrack)130用于控制输入模块110、输出模块120正常工作的同时，主要是对各种输入信息进行智能分析和处理，图像智能处理设备130所进行的所述智能分析和处理能够给出被监控现场所发生的异常事件的完整认定结果，不需要对该完整认定结果进行后处理，该完整认定结果就能够提供与所述异常事件相关的完整信息。数据/信令传输模块140可以经由数据网络(比如互联网、局域网、无线网、专用网等)实现图像智能处理设备130和视频监控系统终端之间的数据/信令通信。As shown in FIG. 1 , the intelligent videomonitoring device module 101 includes: aninput module 110 , anoutput module 120 , an imageintelligent processing device 130 , a data/signaling transmission module 140 and apower supply module 150 . Among them, theinput module 110 is used to obtain various information of the monitoring site. Theinput module 110 includes, for example, acamera unit 111 , asound recording device 112 and various types ofexternal intrusion sensors 113 . Thecamera unit 111 is, for example, one or several camera cloud mirror systems for collecting video signals. Thesound recording device 112 includes, for example, a microphone for collecting audio signals. Theexternal intrusion sensor 113 is used to collect other types of information on site. Theoutput module 120 is an external alarm linkage device, including, for example, alarm lights, speakers, fire sprinkler equipment, and the like. The intelligent image processing device (SmartTrack) 130 is used to control the normal operation of theinput module 110 and theoutput module 120, and mainly perform intelligent analysis and processing on various input information. The intelligent analysis and processing performed by the intelligentimage processing device 130 The complete identification result of the abnormal event occurring in the monitored site can be given, and the complete identification result can provide complete information related to the abnormal event without post-processing the complete identification result. The data/signaling transmission module 140 can realize the data/signaling communication between the intelligentimage processing device 130 and the terminal of the video monitoring system via a data network (such as the Internet, a local area network, a wireless network, a dedicated network, etc.).

如图1所示，图像智能处理设备130包括三个部分：现场信号采集单元131，该单元用于接收输入模块110输入的信息，并对所接收的模拟信息进行A/D转换，以给出数字信号，以便进行后续处理；智能分析处理单元132，该单元对现场信息和远程监控端传送来的命令进行分析，并根据分析结果做出智能处理；视频服务单元133，该单元用于该单元用于实现系统管理、事件管理、通信数据处理、音视频数据流管理、音频编解码以及视频编码功能。As shown in Figure 1, the imageintelligent processing device 130 includes three parts: the fieldsignal acquisition unit 131, which is used to receive the information input by theinput module 110, and perform A/D conversion on the received analog information to give Digital signal for subsequent processing; intelligent analysis andprocessing unit 132, which analyzes on-site information and commands transmitted from the remote monitoring terminal, and makes intelligent processing according to the analysis results;video service unit 133, which is used for this unit It is used to implement system management, event management, communication data processing, audio and video data flow management, audio codec and video coding functions.

如上所述，按照本发明的智能视频监控设备模组101自身具有针对异常事件的分析和处理能力，因而在发生异常事件时，能够自动做出相应处理并且发出警告，并且向IVSS平台服务器20发送相应信息，从而解除了监控端及其操作人员的工作压力，同时确保了发现异常事件的准确性，消除了发生错漏异常事件的可能性。As mentioned above, according to the intelligent videosurveillance equipment module 101 of the present invention, it has analysis and processing capabilities for abnormal events, so when an abnormal event occurs, it can automatically make corresponding processing and issue a warning, and send a message to theIVSS platform server 20. Corresponding information, thereby relieving the work pressure of the monitoring terminal and its operators, and at the same time ensuring the accuracy of finding abnormal events, eliminating the possibility of errors and omissions of abnormal events.

针对智能视频监控的实时有效性的要求，现场信号采集单元131实时地采集信号，包括但不局限于，摄像单元111和声音录入设备112实时地采集音视频模拟信号，同时利用外置侵入传感器113采集现场的其它细节信息，比如温度、湿度、大气压力等。To meet the real-time effectiveness requirements of intelligent video surveillance, the on-sitesignal acquisition unit 131 collects signals in real time, including but not limited to, thecamera unit 111 and thevoice recording device 112 collect audio and video analog signals in real time, and at the same time use theexternal intrusion sensor 113 Collect other details of the site, such as temperature, humidity, atmospheric pressure, etc.

图像智能处理设备130能够对来自输入模块110的各种输入信息和来自远程监控终端的信息进行智能分析和处理。The imageintelligent processing device 130 can intelligently analyze and process various input information from theinput module 110 and information from the remote monitoring terminal.

如图3所示，图像智能处理设备130中的智能分析处理单元132包括动目标检测和烟火检测构件，该智能分析处理单元132完成动目标检测和烟火检测功能。图像智能处理设备130中的视频服务单元133包括系统管理构件、事件管理构件、通信数据处理构件、音视频数据流管理构件、音频编解码构件和视频编解码构件，该视频服务单元完成系统管理、事件管理、通信数据处理、音视频数据流管理、音频编解码和视频编码功能。图像智能处理设备130的功能框图如图3所示。As shown in FIG. 3 , the intelligentanalysis processing unit 132 in the imageintelligent processing device 130 includes moving object detection and firework detection components, and the intelligentanalysis processing unit 132 completes the functions of moving object detection and firework detection. Thevideo service unit 133 in the imageintelligent processing device 130 includes a system management component, an event management component, a communication data processing component, an audio and video data stream management component, an audio codec component and a video codec component, and the video service unit completes system management, Event management, communication data processing, audio and video data flow management, audio codec and video encoding functions. A functional block diagram of the imageintelligent processing device 130 is shown in FIG. 3 .

下面将详细介绍这些组成构件。These components will be described in detail below.

动目标检测用于实现目标识别与分类、运动目标警戒、运动目标跟踪、PTZ跟踪、自动特写拍摄、运动目标行为检测、流量检测、拥挤检测、遗留物/被盗物检测等功能。Moving target detection is used to realize functions such as target recognition and classification, moving target warning, moving target tracking, PTZ tracking, automatic close-up shooting, moving target behavior detection, traffic detection, crowd detection, leftover/stolen object detection, etc.

烟火检测构件用于实现烟雾检测和火焰检测功能。The smoke detection component is used to realize the functions of smoke detection and flame detection.

系统管理构件用于接收有关任务办法调度配置参数，负责整机任务调度；远程升级重新启动等管理；心跳任务管理；视频同步周期任务，判别视频有无，产生视频有无事件；IO、遥控器数据采集周期任务；硬件测试任务(内存和外部所有接口测试)；网络协议栈管理等。The system management component is used to receive relevant task method scheduling configuration parameters, and is responsible for overall machine task scheduling; remote upgrade and restart management; heartbeat task management; video synchronization periodic tasks, judging whether there is video, and generating video events; IO, remote control Periodic data collection tasks; hardware test tasks (memory and all external interface tests); network protocol stack management, etc.

事件管理构件用于接收本机各模块产生的事件以及各种配置参数，根据联动预案产生各种联动动作，根据事件上传的配置将事件编号上传，接收或返回配置参数。The event management component is used to receive events and various configuration parameters generated by each module of the machine, generate various linkage actions according to the linkage plan, upload the event number according to the event upload configuration, and receive or return configuration parameters.

通信数据处理构件(包括网口、串口和HPI口)用于接收各接口接收的通信数据和各模块需要发送的数据完成通信接收数据解析，通信发送数据打包，用户权限管理、判别(最多8个用户)等功能。The communication data processing component (including network port, serial port and HPI port) is used to receive the communication data received by each interface and the data to be sent by each module to complete the analysis of the communication received data, the packaging of the communication sent data, the management and identification of user rights (up to 8 user) and other functions.

音视频数据流管理构件用于接收音视频数据流和控制参数、连接地址端口将音视频数据流发送给各网络连接，接收或返回配置参数，并将播放的音视频数据送至底层接口。The audio and video data stream management component is used to receive audio and video data streams and control parameters, connect the address port to send audio and video data streams to each network connection, receive or return configuration parameters, and send the played audio and video data to the bottom interface.

音频编解码构件用于接收音频数据和编解码配置参数，根据配置参数控制编解码过程，并将编解码数据传送至数据流管理模块。The audio codec component is used to receive audio data and codec configuration parameters, control the codec process according to the configuration parameters, and transmit the codec data to the data flow management module.

视频编码构件接收视频数据和编码配置参数，根据配置参数控制编码过程，并将编码数据传送至数据流管理模块。The video encoding component receives video data and encoding configuration parameters, controls the encoding process according to the configuration parameters, and transmits the encoded data to the data stream management module.

现在参照图2介绍按照本发明的实施方式的智能视频监控系统。Referring now to FIG. 2, an intelligent video monitoring system according to an embodiment of the present invention will be introduced.

该智能视频监控系统包括现场智能监控单元10、IVSS平台服务器20和视频监控系统终端30。The intelligent video monitoring system includes an on-siteintelligent monitoring unit 10 , anIVSS platform server 20 and a videomonitoring system terminal 30 .

按照本发明的实施方式的智能视频监控系统，现场智能监控单元10包括一个或多个智能视频监控设备模组101，该(这些)智能视频监控设备模组101可以放置在监控现场内的适当监控点上，用于获取现场数据和进行智能分析，并且在非正常事件发生时通知IVSS平台服务器20，以便进行相应的处理。According to the intelligent video monitoring system of the embodiment of the present invention, the on-siteintelligent monitoring unit 10 includes one or more intelligent videomonitoring equipment modules 101, and this (these) intelligent videomonitoring equipment modules 101 can be placed in the appropriate monitoring area in the monitoring site. point, for acquiring on-site data and performing intelligent analysis, and notifying theIVSS platform server 20 when an abnormal event occurs, so as to perform corresponding processing.

所述IVSS平台服务器20用于实现对智能视频监控设备模组101的配置和维护、对智能视频监控设备模组101传送来的音频数据、视频数据、传感器数据信息、以及图像智能处理设备130智能分析结果、告警信息的接收、分析和处理，实现对远端各类型数据的显示、存储、回放和检索。TheIVSS platform server 20 is used to realize the configuration and maintenance of the intelligent videosurveillance equipment module 101, the audio data, video data, sensor data information transmitted by the intelligent videosurveillance equipment module 101, and the intelligentimage processing equipment 130. Receiving, analyzing and processing analysis results and alarm information, realizing display, storage, playback and retrieval of various types of remote data.

所述IVSS平台服务器20还包括一个数据存储单元202，用于存储各监控点传送来的数据，以备用户进行历史数据查询和取证。TheIVSS platform server 20 also includes adata storage unit 202, which is used to store the data transmitted from each monitoring point, so as to prepare the user for historical data query and evidence collection.

所述视频监控系统终端30，包括连接在IVSS平台服务器上的PC机301，通过互联网或其它网络与服务器相连的PC机302、邮件服务器303，通过无线通信网络与服务器相连的移动电话304、便携式个人数字处理机(PDA)305；Described videosurveillance system terminal 30, comprises thePC machine 301 that is connected on the IVSS platform server, thePC machine 302 that links to each other with server,mail server 303 through Internet or other networks, themobile phone 304 that links to each other with server through wireless communication network, portable Personal Digital Processing Unit (PDA) 305;

所述视频监控系统终端30可以接收IVSS平台服务器20传送来的报警信息，通知用户做进一步的处理。The videomonitoring system terminal 30 can receive the alarm information sent by theIVSS platform server 20, and notify the user to do further processing.

如果视频监控系统终端30是连接在IVSS平台服务器20上的PC机301，或通过互联网或其它网络与服务器相连的PC机302，则IVSS平台服务器20可以在接收到来自于智能视频监控设备模组101的告警信息时，通过网络向视频监控系统终端30传送现场音/视频数据流，并在该数据流中叠加智能分析结果。If the videosurveillance system terminal 30 is connected to thePC 301 on theIVSS platform server 20, or thePC 302 connected to the server through the Internet or other networks, then theIVSS platform server 20 can receive information from the intelligent video surveillance equipment module. 101, the live audio/video data stream is transmitted to the videomonitoring system terminal 30 through the network, and the intelligent analysis result is superimposed on the data stream.

如果IVSS平台服务器20与邮件服务器303相连，则当有告警信息出现时，IVSS平台服务器20将告警信息或叠加了智能分析结果的音/视频数据以电子邮件的形式发送到邮件服务器中用户的Email邮箱内。If theIVSS platform server 20 is connected with themail server 303, then when there is an alarm message to occur, theIVSS platform server 20 sends the alarm information or the audio/video data superimposed on the intelligent analysis result to the Email of the user in the mail server in the form of email. in the mailbox.

最好，所述视频监控系统终端30是移动电话304或PDA305，则所述IVSS平台服务器通过无线通信网络向终端发送数据包，该数据包为告警信号、或者叠加了智能分析结果的音频/视频数据信息。Preferably, the videomonitoring system terminal 30 is amobile phone 304 or aPDA 305, then the IVSS platform server sends a data packet to the terminal through a wireless communication network, and the data packet is an alarm signal or an audio/video superimposed with an intelligent analysis result Data information.

用户也可以在世界的任何一个地方，从互联网上的任一台电脑或接入网络的其它设备，通过输入IVSS平台服务器的IP地址和用户ID及口令接入IVSS平台服务器20，并通过监控列表来主动查看各个监控点的即时安全状态，或者查看服务器数据库中各个监控点的历史记录图像及智能处理结果，实现不限定距离的远端监控。Users can also access theIVSS platform server 20 from any computer on the Internet or other devices connected to the network at any place in the world by inputting the IP address, user ID and password of the IVSS platform server, and access theIVSS platform server 20 through the monitoring list. To actively view the real-time security status of each monitoring point, or view the historical record images and intelligent processing results of each monitoring point in the server database, to achieve remote monitoring without a limited distance.

此外，IVSS平台服务器20可以通过异步串行接口RS232对智能视频监控设备模组101进行维护，也可以对智能视频监控设备模组101进行参数和状态配置，并控制其工作于布防或撤防状态。In addition, theIVSS platform server 20 can maintain the intelligent videosurveillance equipment module 101 through the asynchronous serial interface RS232, and can also configure the parameters and status of the intelligent videosurveillance equipment module 101, and control it to work in the armed or disarmed state.

下面，将详细介绍按照本发明的实施方式的智能视频监控系统的操作过程。Next, the operation process of the intelligent video surveillance system according to the embodiment of the present invention will be introduced in detail.

按照本发明的实施方式，智能视频监控设备模组101中的图像智能处理设备130具有两种工作状态，一种是布防状态，另一种是撤防状态。用户可以通过IVSS平台服务器20直接对图像智能处理设备130的工作状态进行设置和切换，也可以通过各类型视频监控系统终端30和IVSS平台服务器20之间的数据通信进行工作状态的设置和切换。According to the embodiment of the present invention, the imageintelligent processing device 130 in the intelligent videosurveillance device module 101 has two working states, one is the armed state, and the other is the disarmed state. The user can directly set and switch the working state of the imageintelligent processing device 130 through theIVSS platform server 20 , and can also set and switch the working state through data communication between various types of videosurveillance system terminals 30 and theIVSS platform server 20 .

系统的核心是图像智能处理设备130，它可以对各种输入信息进行智能分析和处理。IVSS可以通过异步串行接口RS232对图像智能处理设备130进行维护，也可以进行参数和状态配置，控制其工作于布防或撤防状态。The core of the system is the intelligentimage processing device 130, which can intelligently analyze and process various input information. The IVSS can maintain the intelligentimage processing device 130 through the asynchronous serial interface RS232, and can also configure parameters and status, and control it to work in the armed or disarmed state.

当图像智能处理设备130工作于布防状态时，现场信号采集单元131从输入模块110实时地接收监控现场的视频数据进行A/D转换，将转换后的数字信号传给智能分析处理单元132进行智能分析。When the imageintelligent processing device 130 works in the armed state, the on-sitesignal acquisition unit 131 receives the video data of the monitoring site from theinput module 110 in real time for A/D conversion, and transmits the converted digital signal to the intelligent analysis andprocessing unit 132 for intelligent analyze.

摄像机拍摄的是一个相对静止的背景，当拍摄画面发生变化时，智能分析处理单元132进行目标检测。目标检测主要是检测当前帧中与背景模型不相符的那些像素，将它们连贯起来后就提取出当前帧的前景目标。这一目标检测是通过例如高斯混合模型方法、帧差法以及动态自适应背景差法之类的算法来实现的。The camera shoots a relatively still background, and when the shooting picture changes, the intelligent analysis andprocessing unit 132 performs target detection. Target detection is mainly to detect those pixels in the current frame that do not match the background model, and then extract the foreground target of the current frame after connecting them together. This object detection is achieved by algorithms such as Gaussian mixture model method, frame difference method and dynamic adaptive background difference method.

在检测出目标后，智能分析处理单元132对目标进行跟踪。目标跟踪是通过建立帧与帧之间的对应关系，然后进行相似性比较或模板匹配来实现的，这一目标跟踪例如是通过Kalman滤波法、标准的帧到帧跟踪算法等来实现的。After the target is detected, the intelligentanalysis processing unit 132 tracks the target. Object tracking is realized by establishing the corresponding relationship between frames, and then performing similarity comparison or template matching. This object tracking is realized by Kalman filter method, standard frame-to-frame tracking algorithm, etc., for example.

在完成了目标检测和跟踪之后，智能分析处理单元132可以获得目标的位置、大小、颜色、形状、速度、方向、运动轨迹等基础数据信息，利用这些信息智能分析处理单元132自动对跟踪目标进行类型识别和行为分析。类型识别是例如利用支持向量机、线性分类器等来实现的。行为分析是综合利用目标检测、跟踪、分类中获得的信息，分析是否有符合保存在智能分析处理单元132的存储器(未示出)中的预先设定的告警条件的“事件”发生。根据应用的不同，行为分析的内容也不尽相同，如在徘徊检测情况下，主要是分析目标的位置和运动轨迹，而在遗留物检测的情况下，主要是分析目标的大小、形状和停放时长。After completing target detection and tracking, the intelligentanalysis processing unit 132 can obtain basic data information such as the position, size, color, shape, speed, direction, and motion track of the target, and use these information intelligentanalysis processing unit 132 to automatically track the target. Type recognition and behavior analysis. Type recognition is achieved, for example, using a support vector machine, a linear classifier, or the like. Behavior analysis is to comprehensively utilize the information obtained in target detection, tracking, and classification to analyze whether there is an "event" that meets the preset alarm conditions stored in the memory (not shown) of the intelligentanalysis processing unit 132 . Depending on the application, the content of behavior analysis is also different. For example, in the case of loitering detection, it mainly analyzes the position and trajectory of the target, while in the case of relic detection, it mainly analyzes the size, shape and parking of the target. duration.

若有符合告警条件的“事件”发生，则智能分析处理单元132向IVSS平台服务器20发出告警信息，并且智能分析处理单元132同时会根据不同的参数配置，做出不同告警情况下的各种智能处理。智能分析处理单元132可以通过4路继电器告警输出接口控制输出模块120，实现外部告警设备的联动控制；可以启动录像，通过异步串行接口RS485控制云台的转动、相机状态的改变，对目标进行PTZ跟踪，特写拍摄等；也可以接收IVSS平台服务器20的指令，启动实时音/视频浏览、启动实时音频对讲、启动音频广播等。If there is an "event" that meets the alarm condition, the intelligentanalysis processing unit 132 will send an alarm message to theIVSS platform server 20, and the intelligentanalysis processing unit 132 will simultaneously make various intelligence responses under different alarm situations according to different parameter configurations. deal with. The intelligent analysis andprocessing unit 132 can control theoutput module 120 through the 4-way relay alarm output interface to realize the linkage control of the external alarm equipment; it can start video recording, control the rotation of the pan-tilt and the change of the camera state through the asynchronous serial interface RS485, and monitor the target. PTZ tracking, close-up shooting, etc.; can also receive instructions from theIVSS platform server 20, start real-time audio/video browsing, start real-time audio intercom, start audio broadcasting, etc.

图像智能处理设备130中的视频服务单元133将监控现场的音/视频数据信息、传感器信息以及智能分析处理单元132的分析处理结果编码后传送给IVSS平台服务器20，也可以在需要的情况下，解码IVSS传来的音频信息，实现音频对讲和音频广播。Thevideo service unit 133 in the imageintelligent processing device 130 encodes the audio/video data information, sensor information, and the analysis and processing results of the intelligent analysis andprocessing unit 132 of the monitoring site and sends them to theIVSS platform server 20. Decode the audio information from IVSS to realize audio intercom and audio broadcast.

当图像智能处理设备130工作于撤防状态时，相当于处于待机状态。此时图像智能处理设备130并不对现场数据进行分析，但可以接受IVSS平台服务器20的指令，并依照指令启动实时音/视频数据传输，实现视频监控系统终端30对监控现场视频信息的浏览，也可以实现监控现场和视频监控系统终端30之间的音频对讲。在撤防状态下，图像智能处理设备130可以接收来自IVSS平台服务器20的指令，重新进入布防状态。When the imageintelligent processing device 130 is working in the disarmed state, it is equivalent to being in the standby state. At this time, the imageintelligent processing device 130 does not analyze the on-site data, but can accept the instructions of theIVSS platform server 20, and start real-time audio/video data transmission according to the instructions, so that the videomonitoring system terminal 30 can browse the video information of the monitoring site. Audio intercom between the monitoring site and the videomonitoring system terminal 30 can be realized. In the disarmed state, the imageintelligent processing device 130 may receive an instruction from theIVSS platform server 20 to re-enter the armed state.

图像智能处理设备130也可以通过4路开关量输入接口接收外置侵入传感器113输入的数据，进行智能分析，判断是否有告警信息出现。The intelligentimage processing device 130 can also receive the data input by theexternal intrusion sensor 113 through the 4-way digital input interface, and perform intelligent analysis to determine whether there is an alarm message.

图像智能处理设备130通过10M/100M自适应以太网接口连接内置2端口10M/100M自适应以太网交换机，通过Internet实现IVSS平台服务器20和图像智能处理设备130之间的全部数据通信。The imageintelligent processing device 130 is connected to the built-in 2-port 10M/100M adaptive Ethernet switch through the 10M/100M adaptive Ethernet interface, and realizes all data communication between theIVSS platform server 20 and the imageintelligent processing device 130 through the Internet.

下面介绍按照本发明的智能视频监控系统的各种功能及应用。Various functions and applications of the intelligent video monitoring system according to the present invention are introduced below.

1、运动目标识别和分类1. Moving target recognition and classification

按照本发明的智能视频监控设备模组101可以智能地识别不同目标的性质和类别。检测并提取目标的基础数据信息后，智能分析处理单元132对目标进行类型识别，准确区分人、车、动物等。The intelligent videomonitoring equipment module 101 according to the present invention can intelligently identify the properties and categories of different objects. After detecting and extracting the basic data information of the target, the intelligent analysis andprocessing unit 132 identifies the type of the target, accurately distinguishing people, vehicles, animals, etc.

运动目标识别和分类可应用于人脸识别领域。检测识别出人体后，获取人体头部照片，并根据生物特征判断其是否是人脸的正面照片，如果是，则自动与预先定义的检测目标的脸部模板进行比对，从而识别出其身份。Moving target recognition and classification can be applied to the field of face recognition. After the detection and recognition of the human body, obtain the head photo of the human body, and judge whether it is a frontal photo of the human face according to the biological characteristics, and if so, automatically compare it with the pre-defined face template of the detection target to identify its identity .

运动目标识别和分类也可应用于车辆牌照识别领域：识别出目标是车辆后，自动判断车辆类型，并识别车辆牌照号码。Moving target recognition and classification can also be applied to the field of vehicle license plate recognition: after the target is recognized as a vehicle, the vehicle type is automatically judged and the vehicle license plate number is recognized.

2、运动目标警戒2. Moving target warning

按照本发明的智能视频监控系统提供一个图形用户界面(GUI)，用户可以在视频监控系统终端30通过鼠标、键盘等对安全警戒区的范围、目标的类型(如：人、车、动物等)、目标运动方向、目标运动速度等警戒条件进行组合设定(如图4所示)。Provide a graphical user interface (GUI) according to the intelligent video monitoring system of the present invention, the user can be on the videomonitoring system terminal 30 by mouse, keyboard etc. , target motion direction, target motion speed and other warning conditions are set in combination (as shown in Figure 4).

按照本发明的智能视频监控系统检测视频画面中出现的目标，仅在有符合警戒条件的事件发生时才发出告警。According to the intelligent video monitoring system of the present invention, the target appearing in the video picture is detected, and an alarm is issued only when an event meeting the warning condition occurs.

结合运动目标的识别和分类，运动目标警戒可用于实现基于人类身份或车辆类型、牌照号码的门禁或警戒功能，还可应用非定点停车检测、车辆行驶路线界定等领域。Combined with the identification and classification of moving targets, moving target warning can be used to realize access control or warning functions based on human identity or vehicle type, license plate number, non-stationary parking detection, vehicle driving route definition and other fields.

3、运动目标跟踪3. Moving target tracking

按照本发明的智能视频监控系统不间断地监测视频图像，检测出符合预先定义的特性的目标时，智能分析处理单元132确定目标的位置、大小，按照本发明的智能视频监控系统在视频监控系统终端30上以提示框的形式锁定目标，并提取目标的运动轨迹，在视频监控系统终端30上以曲线的形式显示。According to the intelligent video monitoring system of the present invention, the video image is continuously monitored, and when a target meeting the predefined characteristics is detected, the intelligent analysis andprocessing unit 132 determines the position and size of the target. The target is locked on the terminal 30 in the form of a prompt box, and the trajectory of the target is extracted, and displayed on theterminal 30 of the video surveillance system in the form of a curve.

当视频画面中出现多个符合条件的目标时，按照本发明的智能视频监控系统自动保持包含全部目标的跟踪画面，并显示每个目标的运动轨迹。When multiple eligible targets appear in the video picture, the intelligent video monitoring system according to the present invention automatically maintains a tracking picture containing all the targets and displays the movement track of each target.

运动目标跟踪既可应用于边界线、海关、仓库、军事禁区、使馆、内保单位等大范围警戒区域的保护，也可应用于道路、广场、车站、码头、机场等人群密集、画面复杂的公共场所的监视。Moving target tracking can be applied not only to the protection of large-scale warning areas such as borders, customs, warehouses, military restricted areas, embassies, and internal security units, but also to roads, squares, stations, docks, airports, etc. where there are dense crowds and complex images. Surveillance of public places.

4、PTZ跟踪4. PTZ tracking

按照本发明的智能视频监控系统提取目标的位置信息，自动控制镜头云台，持续对焦运动目标，使目标始终位于图像画面的中心位置；智能视频监控系统还可调整摄像机焦距，获取目标近景、远景的图像。这样，智能视频监控系统通过对摄像机云镜系统的控制实现对运动目标的PTZ跟踪。According to the intelligent video monitoring system of the present invention, the location information of the target is extracted, the lens pan/tilt is automatically controlled, and the moving target is continuously focused, so that the target is always located at the center of the image; Image. In this way, the intelligent video surveillance system realizes PTZ tracking of moving targets through the control of the camera cloud mirror system.

按照本发明的智能视频监控系统可以通过图像智能处理设备130自动控制多台摄像机对同一目标进行多角度同步跟踪(如图5所示)，以获得重要目标的更加清晰全面的监控画面和录像；也可以控制多台摄像机对同一目标在各自的视觉范围内进行接力式跟踪拍摄(如图6所示)，以获得重要目标活动全程的监控画面和录像。According to the intelligent video monitoring system of the present invention, a plurality of cameras can be automatically controlled by the imageintelligent processing device 130 to carry out multi-angle synchronous tracking (as shown in FIG. 5 ) to the same target, so as to obtain clearer and comprehensive monitoring pictures and video recordings of important targets; It is also possible to control multiple cameras to carry out relay-style tracking and shooting of the same target within their respective visual ranges (as shown in Figure 6), so as to obtain monitoring pictures and videos of the whole process of important target activities.

在视频监控系统终端30上，按照本发明的智能视频监控系统可自动优先把出现告警事件的画面调出来。当按照本发明的智能视频监控系统处于同步跟踪工作模式时，系统可自动将相关摄像机画面临近集中显示；当按照本发明的智能视频监控系统处于接力跟踪模式时，该系统可以根据摄像机接力的顺序自动将目标画面逐一显示在指定的显示区上。On the videomonitoring system terminal 30, according to the intelligent video monitoring system of the present invention, the picture in which the alarm event occurs can be automatically and preferentially called out. When the intelligent video monitoring system according to the present invention was in the synchronous tracking working mode, the system could automatically display relevant camera pictures close together; Automatically display the target screens one by one on the designated display area.

5、自动特写拍摄5. Automatic close-up shooting

按照本发明的智能视频监控系统可以自动控摄像机云镜系统对目标进行头部、全身、近景和全景4级特写跟踪拍摄，当发现多个目标时对目标进行逐个特写拍摄，然后系统再控制摄像机缩短镜头转入全景拍摄方式。这样不仅可以记录事件的全过程，而且还可以获得目标的高清晰照片作为线索和证据。According to the intelligent video monitoring system of the present invention, the cloud mirror system of the camera can be automatically controlled to carry out 4-level close-up tracking shooting of the target head, whole body, close-up and panorama. When multiple targets are found, the target is taken close-up one by one, and then the system controls the camera Shorten the lens and switch to panoramic shooting mode. In this way, not only can the whole process of the incident be recorded, but also high-resolution photos of the target can be obtained as clues and evidence.

6、目标行为检测6. Target behavior detection

按照本发明的智能视频监控系统利用智能分析处理单元132提取的目标基础数据信息，可以实现目标行为分析。如检测目标为人时，智能视频监控系统利用目标的位置，大小等信息可实现倒地检测，利用目标的轨迹、速度等信息可实现徘徊检测；检测目标为车是，智能视频监控系统利用运动方向等信息可实现车辆逆行检测。According to the intelligent video monitoring system of the present invention, the target basic data information extracted by the intelligentanalysis processing unit 132 can be used to analyze the target behavior. For example, when the detection target is a person, the intelligent video surveillance system can use the target's position, size and other information to realize the detection of falling to the ground, and use the target's trajectory, speed and other information to realize the loitering detection; if the detection target is a car, the intelligent video surveillance system can use the movement direction and other information can realize vehicle retrograde detection.

7、商业智能化应用7. Business intelligence application

商业智能化应用包括队伍长度检测，消费者行为跟踪，流量检测、拥挤检测等，这些智能分析结果可以帮助商家实现商品的最优化配置。Business intelligence applications include queue length detection, consumer behavior tracking, flow detection, congestion detection, etc. These intelligent analysis results can help merchants realize the optimal allocation of commodities.

商业智能化应用还包括建筑物管理，例如在没人时自动调整照明、供暖、空调系统等。Business intelligence applications also include building management, such as automatically adjusting lighting, heating, and air-conditioning systems when no one is present.

8、物品检测8. Item detection

物品检测有两种主要的应用方式，一是被盗物检测，一种是遗留物检测。There are two main application methods for object detection, one is stolen object detection, and the other is relic detection.

被盗物检测时需要用户通过视频监控系统终端30预先将静止监测物品的警戒区域、被移走时长和符合条件告警事件发生之前的保存录像时长设置给图像智能处理设备130。按照本发明的智能视频监控系统将对符合设置条件的事件自动告警并自动保存事件完整过程的录像，并通过提示框显示被移动的静物原来的位置。静物检测适用于珠宝、文物、展品等的自动监控。When detecting a stolen object, the user needs to pre-set the warning area of the stationary monitoring object, the time of being removed, and the video recording time before the qualified alarm event occurs to the imageintelligent processing device 130 through the videomonitoring system terminal 30 . According to the intelligent video monitoring system of the present invention, it will automatically warn the events meeting the set conditions and automatically save the video recording of the complete process of the event, and display the original position of the moved still object through the prompt box. Still life detection is suitable for automatic monitoring of jewelry, cultural relics, exhibits, etc.

遗留物检测时需要用户通过视频监控系统终端30将禁止放置物品的区域、物品大小、停放时长和符合告警条件事件发生之前的保存录像时长设置给图像智能处理设备130。按照本发明的智能视频监控系统将对符合设置条件的事件自动告警并保存事件完整过程的录像，并通过提示框显示遗留物品的位置。遗留物检测特别符合当前反恐现实的需要。When detecting remnants, the user needs to set the area where items are prohibited to be placed, the size of the item, the parking duration, and the storage video recording duration before the occurrence of an event that meets the alarm conditions to the imageintelligent processing device 130 through the videomonitoring system terminal 30 . According to the intelligent video monitoring system of the present invention, the events meeting the setting conditions will be automatically alarmed and the video recording of the complete process of the event will be saved, and the position of the leftover items will be displayed through a prompt box. Remnant detection is particularly in line with the needs of the current counter-terrorism reality.

9、自动烟火检测9. Automatic smoke detection

按照本发明的智能视频监控系统根据目标颜色、时域变化、时域周期性、空间变化、区域扩展和时域持续性、增长性等信息，自动在视频场景内区分检测出火焰和烟雾，在显示画面上标明火焰和烟雾的位置，并根据事先指定的烟雾面积大小、火焰面积大小等门限值发出告警信息，按照本发明的智能视频监控系统也可以自动检测出监控画面中抽烟的动作。有火灾发生时，按照本发明的智能视频监控设备模组101与其它火灾传感器联动，向消防喷淋系统发出联动信号，形成了全面、可靠的消防系统，可以有效地防止或减缓火势蔓延。According to the intelligent video monitoring system of the present invention, according to information such as target color, time domain change, time domain periodicity, space change, area extension and time domain persistence, growth, automatically distinguish and detect flames and smoke in the video scene, in The position of the flame and smoke is marked on the display screen, and an alarm message is issued according to the threshold values such as the size of the smoke area and the size of the flame area specified in advance. According to the intelligent video monitoring system of the present invention, the smoking action in the monitoring screen can also be automatically detected. When a fire occurs, the intelligent videomonitoring equipment module 101 of the present invention is linked with other fire sensors to send a linked signal to the fire sprinkler system, forming a comprehensive and reliable fire protection system, which can effectively prevent or slow down the spread of fire.

自动烟火检测可满足室内防火、室外建筑防火、化学工厂或仓库、森林防火的应用需求。Automatic smoke and fire detection can meet the application requirements of indoor fire protection, outdoor building fire protection, chemical factories or warehouses, and forest fire protection.

10、现场警告10. On-site warning

有告警情况出现时，按照本发明的智能视频监控系统可以自动播放预先存储在图像智能处理设备130的存储器(未示出)中的警告声音，也可以通过视频监控系统终端30进行控制，播放视频监控系统终端30中统一存储的警告声音，或者进行智能视频监控设备模组101和视频监控系统终端30之间的语音对讲。这样可以警告监控目标立即停止行动，以阻止“事件”的发生。When an alarm situation occurs, the intelligent video monitoring system according to the present invention can automatically play the warning sound pre-stored in the memory (not shown) of the imageintelligent processing device 130, and can also be controlled by the videomonitoring system terminal 30 to play video. The warning sound stored uniformly in themonitoring system terminal 30, or the voice intercom between the intelligent videomonitoring equipment module 101 and the videomonitoring system terminal 30. This can warn the monitoring target to stop the action immediately to prevent the "event" from happening.

11、视频监控系统终端30的视频显示、存储、回放和检索功能11. Video display, storage, playback and retrieval functions of the videomonitoring system terminal 30

视频监控系统终端30经由IVSS平台服务器20接收智能视频监控设备模组101传送来的信息，实现终端显示和存储，除视频数据外，视频监控系统终端30还显示出图像智能处理设备130的智能分析和处理结果，如叠加运动目标位置提示框、运动轨迹曲线、烟火位置提示框等。另外用户还可以回放视频信息，反复观看。视频监控系统终端30将每次智能视频监控设备模组101传送来的告警信息存储在数据库中，用户可以在需要时或按时间，或按事件类型，或按监控现场对这些信息进行检索。The videosurveillance system terminal 30 receives the information transmitted by the intelligent videosurveillance equipment module 101 via theIVSS platform server 20, and realizes terminal display and storage. In addition to video data, the videosurveillance system terminal 30 also displays the intelligent analysis of the imageintelligent processing equipment 130. And processing results, such as superimposed moving target position prompt box, motion trajectory curve, pyrotechnic position prompt box, etc. In addition, users can also play back video information and watch it repeatedly. The videomonitoring system terminal 30 stores the alarm information sent by the intelligent videomonitoring equipment module 101 each time in the database, and the user can retrieve the information by time, event type, or monitoring site when needed.

12、应用环境管理12. Application environment management

智能视频监控设备模组101可以自动实现工作条件检测与告警。摄像机系统完整性自检可以防止伪造监控视频信号、图像对比度过低、视频信号强度过弱、摄像镜头被遮盖、丢失视频信号、云台失控、镜头焦长失控等情况的发生。图像智能处理设备130故障自检防止设备无响应、CPU负荷过高、设备温度过高、部分电路失控等情况的发生。数据/信令传输模块140自检时检测通信质量是否符合最低工作要求。The intelligent videomonitoring equipment module 101 can automatically realize working condition detection and alarm. The self-inspection of the camera system integrity can prevent the occurrence of falsified surveillance video signals, low image contrast, weak video signal strength, covered camera lens, lost video signal, out-of-control pan/tilt, out-of-control lens focal length, etc. The intelligentimage processing device 130 performs fault self-checking to prevent the occurrence of situations such as no response of the device, excessive CPU load, high temperature of the device, and loss of control of some circuits. The data/signaling transmission module 140 checks whether the communication quality meets the minimum work requirements during self-check.

智能视频监控设备模组101还可以自动实现监测场景自适应与告警。智能视频监控设备模组101适合阳光下的高亮度环境和夜间的低光照度环境的视频监控，适合红外照明的视频监控，能够排除各种气候干扰因素的影响，可靠地提供24小时全天、全气候的视频监控服务。The intelligent videomonitoring equipment module 101 can also automatically implement monitoring scene adaptation and alarm. Intelligent videosurveillance equipment module 101 is suitable for video surveillance in high-brightness environments under the sun and low-light environments at night, suitable for video surveillance with infrared lighting, can eliminate the influence of various climate interference factors, and reliably provide 24-hour, all-day Climate video surveillance service.

13、系统自身管理13. System self-management

可以对图像智能处理设备130进行在线远程升级，各构件可以在线远程配置，而且其监控对象可以进行远程装载。The intelligentimage processing device 130 can be upgraded remotely online, each component can be configured remotely online, and its monitoring objects can be loaded remotely.

每个智能视频监控设备模组101都支持QoS服务质量控制，能够动态地监测数据传输网络性能，并优化调整视频、语音数据流，能够动态适应数据网络的传输质量，提供最佳的监视视频传输效果。Each intelligent videomonitoring equipment module 101 supports QoS service quality control, can dynamically monitor the performance of the data transmission network, and optimize and adjust video and voice data streams, can dynamically adapt to the transmission quality of the data network, and provide the best surveillance video transmission Effect.

本发明通过上面的实施例进行举例说明，但是，应当理解，本发明并不限于这里所描述的特殊实例和实施方案。在这里包含这些特殊实例和实施方案的目的在于帮助本领域中的技术人员实践本发明。任何本领域中的技术人员很容易在不脱离本发明精神和范围的情况下进行进一步的改进和完善，因此本发明只受到本发明权利要求的内容和范围的限制，其意图涵盖所有包括在由所附权利要求所限定的本发明精神和范围内的备选方案和等同方案。The present invention is illustrated by the above examples, however, it is to be understood that the invention is not limited to the particular examples and embodiments described herein. These specific examples and embodiments are included herein to assist those skilled in the art in practicing the invention. Any person skilled in the art can easily carry out further improvement and perfection without departing from the spirit and scope of the present invention, so the present invention is only limited by the content and scope of the claims of the present invention, and it is intended to cover all Alternatives and equivalents within the spirit and scope of the invention as defined by the appended claims.

Claims (18)

1, a kind of intellective video monitoring device module (101) is characterized in that, described module comprises:

Load module (110) is used to obtain the on-the-spot various information of monitoring;

Output module (120) comprises the external alarm interlocking equipment;

Image intelligent treatment facility (130) is used to control load module and output module, and also is used for simultaneously intellectual analysis and processing are carried out in instruction and the input information that comes from load module; With

Data/signaling transport module (140) are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server;

Power module (150) is used to provide each module work electricity consumption;

Wherein, described image intelligent treatment facility (130) comprising:

Field signal acquisition unit (131), this unit are used to receive the information of described load module input, and the analog information that is received is carried out the A/D conversion, to provide digital signal, so that carry out subsequent treatment;

The order that field data that intellectual analysis processing unit (132), this unit are gathered collecting unit (131) and remote monitoring terminal send is analyzed, and makes corresponding Intelligent treatment according to analysis result;

Video service unit (133), this unit are used to realize system management, incident management, communication data processing, audio, video data flow management, audio coding decoding and video encoding function.

2, according to the described intellective video monitoring device module of claim 1, it is characterized in that described load module comprises:

Image unit (111), described image unit are one or several video camera cloud mirror systems that is used to gather vision signal;

Sound recording device (112) is used for the audio frequency acquiring signal;

External intrusion sensor (113) is used for other various information of collection site.

According to the described intellective video monitoring device module of claim 1, it is characterized in that 3, described output module comprises alarm, loudspeaker, fire-fighting spraying equipment.

According to the described intellective video monitoring device module of claim 2, it is characterized in that 4, described sound recording device (112) is MIC.

5, according to the described intellective video monitoring device module of claim 1, it is characterized in that,

Described intellectual analysis that described image intelligent treatment facility (130) is carried out and processing comprise that moving object detection and pyrotechnics detect.

6, a kind of intelligent video monitoring system that adopts as the arbitrary described intellective video monitoring device module of claim 1～5 is characterized in that described system comprises: intelligent in-situ monitor unit (10); IVSS Platform Server (20); Video monitoring system terminal (30);

Described intelligent in-situ monitor unit (10), comprise one or more described intellective video monitoring device modules (101), described intellective video monitoring device module is placed on the on-the-spot interior different monitoring point of monitoring, is used to obtain field data and carries out intellectual analysis, and realize Intelligent treatment;

Described IVSS Platform Server (20), under the management of IVSS platform software, described IVSS Platform Server is realized reception, analysis and the processing to multichannel far-end audio data, video data, sensor data information and image intelligent treatment facility (130) intellectual analysis result, warning information, realization realizes configuration and maintenance to the described intellective video monitoring device module of far-end to demonstration, storage, playback and the retrieval of all types of data of far-end;

Described video monitoring system terminal (30) comprises the PC (301) and the network that are connected on the IVSS Platform Server;

Wherein, described intellective video monitoring device module (101) comprising:

Load module (110) is used to obtain the on-the-spot various information of monitoring;

Output module (120) comprises the external alarm interlocking equipment;

Image intelligent treatment facility (130) is used to control load module and output module, and also is used for simultaneously intellectual analysis and processing are carried out in instruction and the input information that comes from load module; With

Data/signaling transport module (140) are used for by switch, via the data/signaling communication between internet realization image intelligent treatment facility and the IVSS Platform Server;

Power module (150) is used to provide each module work electricity consumption.

According to the described intelligent video monitoring system of claim 6, it is characterized in that 7, described network comprises internet and cordless communication network; Wherein, described internet links to each other with PC (302) or mail server (303); Described cordless communication network links to each other with mobile phone (304) or portable personal digital processor (305).

8, according to the described intelligent video monitoring system of claim 6, it is characterized in that, also comprise a data storage unit (202), be used to store the data that each control point sends, carry out the inquiry of historical data and evidence obtaining in order to the user.

9, according to the described intelligent video monitoring system of claim 6, it is characterized in that,

Described video monitoring system terminal (30) is used to receive the warning information from the IVSS Platform Server, and notifies the user to do further processing.

10, according to claim 6 or 9 described intelligent video monitoring systems, it is characterized in that, described video monitoring system terminal (30) is the PC (301) that is connected on the described IVSS Platform Server (20), or the PC (302) that links to each other with server by internet, LAN (Local Area Network), wireless network or private, then described IVSS Platform Server (20) is when having warning information to occur, transmit live audio/video data by network to terminal, and stack intellectual analysis result.

11, according to claim 6 or 9 described intelligent video monitoring systems, it is characterized in that, described IVSS Platform Server (20) links to each other with mail server (303), then when warning information occurs, IVSS Platform Server (20) sends to the warning information or the intellectual analysis result's that superposeed the audio/video data form with Email in the Email mailbox of user in the mail server.

12, according to claim 6 or 9 described intelligent video monitoring systems, it is characterized in that, described video monitoring system terminal (30) is mobile phone (304) or PDA (305), to the terminal transmits data bag, this packet is the alarm signal or the intellectual analysis result's that superposeed an audio/video data information to then described IVSS Platform Server (20) by cordless communication network.

13, according to claim 6 or 9 described intelligent video monitoring systems, it is characterized in that, the user also can be at any old place in the world, arbitrary the computer from the internet or the miscellaneous equipment of access network, IP address and user ID and password access IVSS Platform Server (20) by input IVSS Platform Server, and by the next instantaneous safety state of initiatively checking each control point of watch-list, perhaps check the historical record image and the Intelligent treatment result of each control point in the server database, realize not limiting the remote monitoring of distance.

14, a kind of method for supervising of intelligent video monitoring system is characterized in that, said method comprising the steps of:

(1) in one or more monitoring scene, obtains the on-the-spot various information of described monitoring;

(2) by image intelligent treatment facility (130) data of described load module (110) input are carried out intellectual analysis and processing, institute carries out intellectual analysis and processing comprises target detection, tracking, classification and behavioural analysis;

(3) with analysis and result, the audio/video data coding back that collects and warning information together by sending described IVSS Platform Server (20) on the Network Transmission interface to;

(4) described IVSS Platform Server (20) is received or initiatively obtains relevant information, classify and be correspondingly processed, send warning information to described video monitoring system terminal (30), the control intellective video monitoring device module (101) of giving an order is realized the interlock alarm.

15, according to the method for supervising of the described intelligent monitor system of claim 14, it is characterized in that, the intellectual analysis that is carried out and handle can realize that Target Recognition and classification, moving target warning, motion target tracking, PTZ follow the tracks of, feature shootings automatically, moving target behavior detection, flow detection, crowdedly detect, the function of legacy/stolen quality testing survey, pyrotechnics detection.

According to the method for supervising of the described intelligent video monitoring system of claim 14, it is characterized in that 16, described image intelligent treatment facility (130) is also controlled external unit automatically and made corresponding alarming processing.

17, according to the method for supervising of the arbitrary described intelligent video monitoring system of claim 14～16, it is characterized in that, the intercommunication of described image intelligent treatment facility (130) and described IVSS Platform Server (20), described IVSS Platform Server (20) comprises by the information that network interface sends to described image intelligent treatment facility (130): order data, digital audio-frequency data, control interface output information that all configuration parameters of described image intelligent treatment facility (130), the work order data of opertaing device, control The Cloud Terrace rotate.

18, according to the method for supervising of the described intelligent video monitoring system of claim 17, it is characterized in that, use IVSS Platform Server (20) by and image intelligent treatment facility (130) between intercommunication mutually, can realize that applied environment is managed and the function of system's self-management.

Images