











技术领域technical field
本公开涉及计算机视觉技术领域,具体而言,涉及一种场景监测方法、装置、电子设备及存储介质。The present disclosure relates to the technical field of computer vision, and in particular, to a scene monitoring method, apparatus, electronic device, and storage medium.
背景技术Background technique
随着人们生活水平的提高,越来越多的大型活动在各地、各场所内举办。由于举办大型活动时,人流较为密集,使得举办大型活动的地方、场所容易发生事故,比如,踩踏事件、拥堵事件等。故为了保证各地、各场所的安全程度,对人流的有效监测越来越重要。With the improvement of people's living standards, more and more large-scale events are held in various places and venues. Due to the dense flow of people when large-scale events are held, the places and venues where large-scale events are held are prone to accidents, such as stampede events and congestion events. Therefore, in order to ensure the safety of various places and places, the effective monitoring of the flow of people is becoming more and more important.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本公开至少提供一种场景监测方法、装置、电子设备及存储介质。In view of this, the present disclosure provides at least a scene monitoring method, apparatus, electronic device, and storage medium.
第一方面,本公开提供了一种场景监测方法,包括:In a first aspect, the present disclosure provides a scene monitoring method, including:
获取设置于至少一个监控点位的监控设备采集的监控视频;Obtain the surveillance video collected by the surveillance equipment set at at least one surveillance point;
基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件;Determine whether a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point based on the monitoring video;
在所述至少一个监控点位对应的监测区域发生监测事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据;In the case that a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point, obtain the monitoring data of the number of people matching the monitoring event within a preset time period;
基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据。The crowd flow state data of the at least one monitoring device is determined based on the number of people monitoring data matching the monitoring event within a preset time period.
上述方法中,通过获取监控设备采集的监控视频,在基于采集的监控视频,检测到至少一个监控点位对应的监测区域发生监测事件时,获取预设时间段内与监测时间匹配的人数监测数据,并基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,通过确定的人流状态数据表征监测事件的状态,实现对监控视频的监测,比如,人流状态数据可以为总进人流数量,在总进人流数量较大时,表征监测事件的发生较为频繁。In the above method, by obtaining the monitoring video collected by the monitoring equipment, when a monitoring event is detected in the monitoring area corresponding to at least one monitoring point based on the collected monitoring video, the monitoring data of the number of people matching the monitoring time within a preset time period is obtained. , and based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of at least one monitoring device, and use the determined crowd flow status data to characterize the status of the monitoring event to monitor the monitoring video, such as the crowd flow status. The data can be the total number of people entering, and when the total number of people entering is large, it indicates that monitoring events occur more frequently.
一种可能的实施方式中,在确定所述至少一个监控设备的人流状态数据之后,还包括:In a possible implementation manner, after determining the crowd flow state data of the at least one monitoring device, the method further includes:
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息。When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, the crowd flow state alarm information is generated.
这里,在确定的人流状态数据满足告警条件时,生成人流状态告警信息,基于生成的人流状态告警信息,可以对目标监控区域进行调控,避免安全事故的发生,保证目标监控区域下人流的安全性。Here, when the determined crowd flow status data meets the alarm conditions, the crowd flow status alarm information is generated. Based on the generated crowd flow status alarm information, the target monitoring area can be regulated to avoid the occurrence of security accidents and ensure the safety of the crowd flow under the target monitoring area. .
一种可能的实施方式中,在所述监测事件为跨线事件的情况下,基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件,包括:In a possible implementation manner, when the monitoring event is a cross-line event, determining whether a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point based on the monitoring video includes:
基于所述监控视频确定所述至少一个监控点位对应的监测区域内,是否存在跨越与预先绘制的进出界线匹配的目标位置的目标对象;Determine, based on the surveillance video, whether there is a target object spanning a target position matching a pre-drawn entry and exit boundary in the monitoring area corresponding to the at least one monitoring point;
若存在,则确定所述至少一个监控点位对应的监测区域发生跨线事件。If there is, it is determined that a cross-line event occurs in the monitoring area corresponding to the at least one monitoring point.
上述实施方式中,在基于监控视频确定至少一个监控点位对应的监测区域内,存在跨越与进出界线匹配的目标位置的目标对象时,确定至少一个监控点位对应的监测区域发生跨线事件,实现了对跨线事件的实时监测,提高跨线事件监测的准确性。In the above-mentioned embodiment, when there is a target object that crosses the target position matching the entry and exit boundary in the monitoring area corresponding to at least one monitoring point determined based on the monitoring video, it is determined that a cross-line event occurs in the monitoring area corresponding to at least one monitoring point, Real-time monitoring of cross-line events is realized, and the accuracy of cross-line event monitoring is improved.
一种可能的实施方式中,在所述监测事件为跨线事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据,包括:In a possible implementation, in the case that the monitoring event is a cross-line event, obtaining the monitoring data of the number of people matching the monitoring event within a preset time period, including:
获取预设时间段内不同采集时间点的进人流数量和出人流数量,其中,所述不同采集时间点的进人流数量是指在不同采集时间点,沿预先绘制的进方向跨越预先绘制的进出界线的人数;所述不同采集时间点的出人流数量是指在不同采集时间点,沿预先绘制的出方向跨越预先绘制的进出界线的人数。Obtain the number of incoming and outgoing traffic at different collection time points within a preset time period, wherein the number of incoming and outgoing traffic at different collection time points refers to crossing the pre-drawn incoming and outgoing directions along the pre-drawn incoming direction at different collection time points. The number of people in the boundary line; the number of people leaving the boundary at different collection time points refers to the number of people who cross the pre-drawn in-out boundary line along the pre-drawn out direction at different collection time points.
上述方法中,在监测事件为跨线事件时,可以获取预设时间段内不同采集时间点的进人流数量和出人流数量,为后续确定跨线事件对应的人流状态数据提供了数据支持。In the above method, when the monitoring event is a cross-line event, the number of incoming and outgoing human flows at different collection time points within a preset time period can be obtained, which provides data support for subsequent determination of the human flow state data corresponding to the cross-line event.
一种可能的实施方式中,在所述监控点位为一个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In a possible implementation manner, when the monitoring point is one, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of the at least one monitoring device, including: :
基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量;Based on the number of inflows and outflows at different collection time points within the preset time period, determining the total number of inflows and the total number of outflows within the preset time period in the monitoring area corresponding to the monitoring point;
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, generating crowd flow state alarm information, including:
在确定所述预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在确定所述预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息。In the case where it is determined that the total number of people entering the preset time period is greater than the set first threshold of people flow, and/or in the case of determining that the total number of people leaving the flow within the preset time period is greater than the second set threshold of people flow, Generates crowd flow status alarm information.
这里,在监控点位为一个时,基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。在预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息,实现了对该监控视频的进人流数量和出人流数量的预警,以便基于生成的人流状态告警信息进行人流的疏导,避免短时间内进人流数量较多,或者出人流数量较多造成的安全事故的发生。Here, when there is one monitoring point, based on the number of inflows and outflows at different collection time points within the preset time period, the total number of inflows and the total number of inflows in the preset time period in the monitoring area corresponding to the monitoring point is determined. The number of outflows. In the case where the total number of people entering the preset time period is greater than the set first threshold, and/or when the total number of people leaving within the preset time period is greater than the second set threshold, generating a traffic state alarm message, It realizes the early warning of the number of people entering and leaving the surveillance video, so as to divert the flow of people based on the generated warning information of the flow of people, and avoid security accidents caused by a large number of people entering or leaving a large number of people in a short time. happened.
一种可能的实施方式中,在所述监控点位为一个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In a possible implementation manner, when the monitoring point is one, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of the at least one monitoring device, including: :
基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中的进人流速度和出人流速度。Based on the number of inflows and outflows at different collection time points within a preset time period, the inflow speed and the outflow speed in the monitoring area corresponding to the monitoring point are determined.
上述方法中,可以基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中的进人流速度和出人流速度,实现对进人流速度和出人流速度的监测,避免进人流速度较大,或者出人流速度较大造成的安全事故的发生。In the above method, the inflow speed and the outflow speed in the monitoring area corresponding to the monitoring point can be determined based on the number of inflows and outflows at different collection time points within a preset time period, so as to realize the control of the inflow and outflow. Speed monitoring to avoid the occurrence of safety accidents caused by large inflow speed or high outflow speed.
一种可能的实施方式中,在所述监控点位为多个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In a possible implementation manner, in the case that there are multiple monitoring points, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the people flow status data of the at least one monitoring device, include:
针对每个所述监控点位,基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量;For each of the monitoring points, based on the number of inflows and the number of outflows at different collection time points within the preset time period, determine the total number of inflows and the number of inflows in the preset time period in the monitoring area corresponding to the monitoring point and the The total number of people leaving;
基于所述预设时间段内目标监控区域的历史人数,以及多个所述监控点位分别对应的所述预设时间段内的总进人流数量和总出人流数量,确定所述目标监控区域内的人员净存量;The target monitoring area is determined based on the historical number of people in the target monitoring area within the preset time period, and the total number of incoming and outgoing people in the preset time period corresponding to a plurality of the monitoring points respectively the net stock of personnel in
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, generating crowd flow state alarm information, including:
在确定所述目标监控区域内的人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息。When it is determined that the net stock of people in the target monitoring area is greater than the set net stock threshold, alarm information about the flow of people is generated.
这里,在确定每个监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量之后,可以基于预设时间段内目标监控区域的历史人数,以及多个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量,确定目标监控区域内的人员净存量,并在目标监控区域内的人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息,实现了对目标监控区域中的人员净存量的预警,以便在人员净存量较多时,基于生成的人流状态告警信息进行人员的疏导,避免目标监控区域中人员较多时造成安全事故的发生。Here, after determining the total number of incoming and outgoing people in the preset time period in the monitoring area corresponding to each monitoring point, it can be based on the historical number of people in the target monitoring area within the preset time period, and multiple monitoring points. The total number of people entering and leaving the corresponding preset time period is determined, and the net personnel stock in the target monitoring area is determined, and when the net personnel stock in the target monitoring area is greater than the set net stock threshold, Generates human flow status alarm information to realize the early warning of the net stock of people in the target monitoring area, so that when the net stock of people is large, people can be dredged based on the generated crowd flow status warning information to avoid safety when there are many people in the target monitoring area. the occurrence of the accident.
一种可能的实施方式中,在所述监测事件为过密事件的情况下,基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件,包括:In a possible implementation manner, in the case that the monitoring event is an over-density event, determining whether a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point based on the monitoring video includes:
基于所述监控视频,确定所述至少一个监控点位对应的监测区域内的目标对象个数是否超过过密阈值;Based on the monitoring video, determine whether the number of target objects in the monitoring area corresponding to the at least one monitoring point exceeds an excessive density threshold;
若是,则确定所述至少一个监控点位对应的监测区域发生过密事件。If yes, it is determined that an over-density event occurs in the monitoring area corresponding to the at least one monitoring point.
上述方法中,在基于监控视频,确定至少一个监控点位对应的监测区域内的目标对象个数超过过密阈值时,确定至少一个监控点位对应的监测区域发生过密事件,实现了对过密事件的实时监测,提高过密事件监测的准确性。In the above method, when it is determined based on the surveillance video that the number of target objects in the monitoring area corresponding to at least one monitoring point exceeds the over-density threshold, it is determined that an over-density event has occurred in the monitoring area corresponding to at least one monitoring point, thereby realizing the over-density event. Real-time monitoring of secret incidents to improve the accuracy of over-densified incident monitoring.
一种可能的实施方式中,在所述监测事件为过密事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据,包括:In a possible implementation manner, in the case that the monitoring event is an overcrowded event, acquiring the monitoring data of the number of people matching the monitoring event within a preset time period, including:
统计预设时间段内不同采集时间点的所述目标对象的个数。The number of the target objects at different collection time points within a preset time period is counted.
上述方法中,在监测事件为过密事件时,可以统计预设时间段内不同采集时间点的所述目标对象的个数,为后续确定过密事件对应的人流状态数据提供了数据支持。In the above method, when the monitoring event is an over-density event, the number of the target objects at different collection time points within a preset time period can be counted, which provides data support for the subsequent determination of the crowd flow state data corresponding to the over-density event.
一种可能的实施方式中,在所述监控点位为一个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In a possible implementation manner, when the monitoring point is one, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of the at least one monitoring device, including: :
基于预设时间段内不同采集时间点的所述目标对象的个数,确定所述监控点位对应的监测区域在所述预设时间段内的平均人数;Determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period based on the number of the target objects at different collection time points within the preset time period;
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, generating crowd flow state alarm information, including:
在确定所述监控点位对应的监测区域在所述预设时间段内的平均人数大于设置的第一人数阈值的情况下,生成人流状态告警信息。In a case where it is determined that the average number of people in the monitoring area corresponding to the monitoring point within the preset time period is greater than the set first number of people threshold, alarm information about the flow of people is generated.
上述方法中,在监控点位为一个时,基于预设时间段内不同采集时间点的目标对象的个数,确定监控点位对应的监测区域在预设时间段内的平均人数;并在监控点位对应的监测区域在预设时间段内的平均人数大于设置的第一人数阈值的情况下,生成人流状态告警信息,实现了对该监控视频的检测区域中的平均人数的监控,以便基于生成的人流状态告警信息对检测区域进行人流疏导,避免检测区域内的人员较为密集时,造成的安全事故的发生。In the above method, when there is one monitoring point, the average number of people in the monitoring area corresponding to the monitoring point within the preset time period is determined based on the number of target objects at different collection time points within the preset time period; When the average number of people in the monitoring area corresponding to the point in the preset time period is greater than the set first number of people threshold, the alarm information of the flow of people is generated, and the monitoring of the average number of people in the detection area of the monitoring video is realized, so that based on the The generated crowd flow status alarm information diverts the flow of people in the detection area, so as to avoid the occurrence of safety accidents when the people in the detection area are crowded.
一种可能的实施方式中,在所述监控点位为多个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In a possible implementation manner, in the case that there are multiple monitoring points, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the people flow status data of the at least one monitoring device, include:
针对每个所述监控点位,基于预设时间段内不同采集时间点的所述目标对象的个数,确定所述监控点位对应的监测区域在所述预设时间段内的平均人数;For each monitoring point, determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period based on the number of the target objects at different collection time points within the preset time period;
基于多个所述监控点位分别对应的所述平均人数,确定目标监控区域中的总实时人数;Determine the total real-time number of people in the target monitoring area based on the average number of people corresponding to a plurality of the monitoring points respectively;
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, generating crowd flow state alarm information, including:
在确定所述目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息。In a case where it is determined that the total real-time number of people in the target monitoring area is greater than the set second threshold of the number of people, alarm information about the flow of people is generated.
上述方法中,在确定了每个监控点位对应的监测区域在预设时间段内的平均人数之后,可以基于多个所述监控点位分别对应的平均人数,确定目标监控区域中的总实时人数;并在确定目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息,实现了对目标监控区域中的总实时人数的预警,以便在总实时人数较多时,基于生成的人流状态告警信息对目标监控区域中的人员进行疏导,避免目标监控区域中总实时人数较多时造成安全事故的发生。In the above method, after determining the average number of people in the monitoring area corresponding to each monitoring point within the preset time period, the total real-time number in the target monitoring area can be determined based on the average number of people corresponding to a plurality of the monitoring points respectively. and when it is determined that the total real-time number of people in the target monitoring area is greater than the set second threshold of the number of people, the alarm information of the flow of people is generated, which realizes the early warning of the total real-time number of people in the target monitoring area, so that the total real-time number of people in the target monitoring area is relatively For a long time, based on the generated crowd flow state alarm information, the personnel in the target monitoring area are dredged, so as to avoid the occurrence of security accidents when the total real-time number of people in the target monitoring area is large.
一种可能的实施方式中,所述方法还包括:In a possible implementation, the method further includes:
将最近多个历史日期内同一采集时间点的人流状态数据求平均,得到每个采集时间点对应的预测人流状态数据;Average the crowd flow status data at the same collection time point in recent multiple historical dates to obtain the predicted crowd flow status data corresponding to each collection time point;
各个采集时间点分别对应的预测人流状态数据,构成人流状态数据在未来日期内的预测数据;其中,所述预测数据用于生成人流疏导计划。The predicted crowd flow state data corresponding to each collection time point respectively constitutes prediction data of the crowd flow state data in a future date; wherein, the predicted data is used to generate a crowd flow diversion plan.
以下装置、电子设备等的效果描述参见上述方法的说明,这里不再赘述。For descriptions of the effects of the following apparatuses, electronic devices, etc., reference may be made to the descriptions of the above-mentioned methods, which will not be repeated here.
第二方面,本公开提供了一种场景监测装置,包括:In a second aspect, the present disclosure provides a scene monitoring device, including:
第一获取模块,用于获取设置于至少一个监控点位的监控设备采集的监控视频;a first acquisition module, configured to acquire monitoring video collected by monitoring equipment arranged at at least one monitoring point;
检测模块,用于基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件;a detection module, configured to determine whether a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point based on the monitoring video;
第二获取模块,用于在所述至少一个监控点位对应的监测区域发生监测事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据;a second acquisition module, configured to acquire monitoring data of the number of people matching the monitoring event within a preset time period when a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point;
确定模块,用于基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据。A determination module, configured to determine the crowd flow state data of the at least one monitoring device based on the number of people monitoring data matching the monitoring event within a preset time period.
第三方面,本公开提供一种电子设备,包括:处理器、存储器和总线,所述存储器存储有所述处理器可执行的机器可读指令,当电子设备运行时,所述处理器与所述存储器之间通过总线通信,所述机器可读指令被所述处理器执行时执行如上述第一方面或任一实施方式所述的场景监测方法的步骤。In a third aspect, the present disclosure provides an electronic device, comprising: a processor, a memory, and a bus, the memory stores machine-readable instructions executable by the processor, and when the electronic device runs, the processor communicates with the The memories communicate with each other through a bus, and when the machine-readable instructions are executed by the processor, the steps of the scene monitoring method according to the first aspect or any one of the implementation manners are performed.
第四方面,本公开提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该计算机程序被处理器运行时执行如上述第一方面或任一实施方式所述的场景监测方法的步骤。In a fourth aspect, the present disclosure provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the scenario described in the first aspect or any one of the embodiments above is executed. The steps of the monitoring method.
为使本公开的上述目的、特征和优点能更明显易懂,下文特举较佳实施例,并配合所附附图,作详细说明如下。In order to make the above-mentioned objects, features and advantages of the present disclosure more obvious and easy to understand, the preferred embodiments are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.
附图说明Description of drawings
为了更清楚地说明本公开实施例的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,此处的附图被并入说明书中并构成本说明书中的一部分,这些附图示出了符合本公开的实施例,并与说明书一起用于说明本公开的技术方案。应当理解,以下附图仅示出了本公开的某些实施例,因此不应被看作是对范围的限定,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他相关的附图。In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings required in the embodiments, which are incorporated into the specification and constitute a part of the specification. The drawings illustrate embodiments consistent with the present disclosure, and together with the description serve to explain the technical solutions of the present disclosure. It should be understood that the following drawings only show some embodiments of the present disclosure, and therefore should not be regarded as limiting the scope. Other related figures are obtained from these figures.
图1示出了本公开实施例所提供的一种场景监测方法的流程示意图;FIG. 1 shows a schematic flowchart of a scene monitoring method provided by an embodiment of the present disclosure;
图2a示出了本公开实施例所提供的一种展示绘制有监测标识的视频画面截图的界面示意图的界面示意图;Fig. 2a shows a schematic interface diagram of an interface diagram showing a screenshot of a video screen with a monitoring logo drawn according to an embodiment of the present disclosure;
图2b示出了本公开实施例所提供的一种展示绘制有监测标识的视频画面截图的界面示意图的界面示意图;Fig. 2b shows a schematic interface diagram of a schematic interface diagram showing a video screen shot with a monitoring logo drawn according to an embodiment of the present disclosure;
图3示出了本公开实施例所提供的一种展示人流状态告警的详细信息的界面示意图;FIG. 3 shows a schematic diagram of an interface for displaying detailed information of a crowd flow state alarm provided by an embodiment of the present disclosure;
图4a示出了本公开实施例所提供的一种展示人流状态告警的详细信息的界面示意图;FIG. 4a shows a schematic diagram of an interface for displaying detailed information of a crowd flow state alarm provided by an embodiment of the present disclosure;
图4b示出了本公开实施例所提供的另一种展示人流状态告警的详细信息的界面示意图;FIG. 4b shows another schematic interface diagram for displaying detailed information of a crowd flow state alarm provided by an embodiment of the present disclosure;
图4c示出了本公开实施例所提供的一种展示告警详情的界面示意图;FIG. 4c shows a schematic diagram of an interface for displaying alarm details provided by an embodiment of the present disclosure;
图5示出了本公开实施例所提供的一种展示人流状态告警的详细信息的界面示意图;FIG. 5 shows a schematic diagram of an interface for displaying detailed information of a crowd flow state alarm provided by an embodiment of the present disclosure;
图6a示出了本公开实施例所提供的一种展示人流状态告警的详细信息的界面示意图;Fig. 6a shows a schematic diagram of an interface for displaying detailed information of a crowd flow state alarm provided by an embodiment of the present disclosure;
图6b示出了本公开实施例所提供的一种展示告警详情的界面示意图;FIG. 6b shows a schematic diagram of an interface for displaying alarm details provided by an embodiment of the present disclosure;
图7示出了本公开实施例所提供的一种场景监测装置的架构示意图;FIG. 7 shows a schematic diagram of the architecture of a scene monitoring apparatus provided by an embodiment of the present disclosure;
图8示出了本公开实施例所提供的一种电子设备的结构示意图。FIG. 8 shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.
具体实施方式Detailed ways
为使本公开实施例的目的、技术方案和优点更加清楚,下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。通常在此处附图中描述和示出的本公开实施例的组件可以以各种不同的配置来布置和设计。因此,以下对在附图中提供的本公开的实施例的详细描述并非旨在限制要求保护的本公开的范围,而是仅仅表示本公开的选定实施例。基于本公开的实施例,本领域技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments These are only some of the embodiments of the present disclosure, but not all of the embodiments. The components of the disclosed embodiments generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations. Therefore, the following detailed description of the embodiments of the disclosure provided in the accompanying drawings is not intended to limit the scope of the disclosure as claimed, but is merely representative of selected embodiments of the disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present disclosure.
随着人们生活水平的提高,越来越多的大型活动在各地、各场所内举办。由于举办大型活动时,人流较为密集,使得举办大型活动的地方、场所容易发生事故,比如,踩踏事件、拥堵事件等。故为了保证各地、各场所的安全程度,对人流的有效监测越来越重要。为了解决上述问题,提高地方、场所的安全度,本公开实施例提供了一种场景监测方法、装置、电子设备及存储介质。With the improvement of people's living standards, more and more large-scale events are held in various places and venues. Due to the dense flow of people when large-scale events are held, the places and venues where large-scale events are held are prone to accidents, such as stampede events and congestion events. Therefore, in order to ensure the safety of various places and places, the effective monitoring of the flow of people is becoming more and more important. In order to solve the above problems and improve the security of places and places, embodiments of the present disclosure provide a scene monitoring method, apparatus, electronic device, and storage medium.
为便于对本公开实施例进行理解,首先对本公开实施例所公开的一种场景检测方法进行详细介绍。本公开实施例所提供的场景监测方法的执行主体一般为具有一定计算能力的计算机设备,该计算机设备例如包括:终端设备或服务器或其它处理设备,终端设备可以为用户设备(User Equipment,UE)、移动设备、用户终端、终端、蜂窝电话、无绳电话、个人数字处理(Personal Digital Assistant,PDA)、手持设备、计算设备、车载设备、可穿戴设备等。在一些可能的实现方式中,该场景监测方法可以通过处理器调用存储器中存储的计算机可读指令的方式来实现。In order to facilitate understanding of the embodiments of the present disclosure, a scene detection method disclosed in the embodiments of the present disclosure is first introduced in detail. The execution subject of the scene monitoring method provided by the embodiment of the present disclosure is generally a computer device with a certain computing capability. , mobile devices, user terminals, terminals, cellular phones, cordless phones, Personal Digital Assistant (PDA), handheld devices, computing devices, in-vehicle devices, wearable devices, etc. In some possible implementations, the scene monitoring method may be implemented by the processor calling computer-readable instructions stored in the memory.
参见图1所示,为本公开实施例所提供的一种场景监测方法的流程示意图,该方法包括S101-S104,具体的:Referring to FIG. 1, which is a schematic flowchart of a scene monitoring method provided by an embodiment of the present disclosure, the method includes S101-S104, and specifically:
S101,获取设置于至少一个监控点位的监控设备采集的监控视频。S101, acquiring surveillance video collected by a surveillance device set at at least one surveillance point.
S102,基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件。S102. Determine whether a monitoring event occurs in a monitoring area corresponding to the at least one monitoring point based on the monitoring video.
S103,在所述至少一个监控点位对应的监测区域发生监测事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据。S103, in the case that a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point, acquire the monitoring data of the number of people matching the monitoring event within a preset time period.
S104,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据。S104, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the people flow state data of the at least one monitoring device.
上述方法中,通过获取监控设备采集的监控视频,在基于采集的监控视频,检测到至少一个监控点位对应的监测区域发生监测事件时,获取预设时间段内与监测时间匹配的人数监测数据,并基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,通过确定的人流状态数据表征监测事件的状态,实现对监控视频的监测,比如,人流状态数据可以为总进人流数量,在总进人流数量较大时,表征监测事件的发生较为频繁。In the above method, by obtaining the monitoring video collected by the monitoring equipment, when a monitoring event is detected in the monitoring area corresponding to at least one monitoring point based on the collected monitoring video, the monitoring data of the number of people matching the monitoring time within a preset time period is obtained. , and based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of at least one monitoring device, and use the determined crowd flow status data to characterize the status of the monitoring event to monitor the monitoring video, such as the crowd flow status. The data can be the total number of people entering, and when the total number of people entering is large, it indicates that monitoring events occur more frequently.
下述对S101-S104进行具体说明。S101-S104 will be specifically described below.
针对S101:For S101:
具体实施时,可以使用该方法对目标监控区域进行检测,该目标监控区域可以为现实场景中的任一区域,比如,该目标监控区域可以为商场、沙滩、公园、地铁站等。During specific implementation, the method can be used to detect a target monitoring area, and the target monitoring area can be any area in a real scene. For example, the target monitoring area can be a shopping mall, a beach, a park, a subway station, or the like.
示例性的,可以在目标监控区域处设置多个监控点位,在每个监控点位处安装一个监控设备,以便监控设备可以对对应的监测区域进行监测,实现对目标监控区域的监测。其中,监控点位的设置可以根据实际需要进行确定,比如,在目标监控区域为商场时,可以在商场的每个门处设置一个监控点位、和/或在每个电梯口处设置一个监控点位等。Exemplarily, multiple monitoring points may be set at the target monitoring area, and a monitoring device may be installed at each monitoring point, so that the monitoring device can monitor the corresponding monitoring area and monitor the target monitoring area. The setting of monitoring points can be determined according to actual needs. For example, when the target monitoring area is a shopping mall, a monitoring point can be set at each door of the shopping mall, and/or a monitoring point can be set at each elevator entrance. point etc.
具体实施时,监控设备可以为监控摄像头等设备。通过在每个监控点位处设置一个监控设备,通过监控设备采集对应监测区域内的监控视频,以便可以获取每个监控设备采集的监控视频,即获取设置于至少一个监控点位的监控设备采集的监控视频。During specific implementation, the monitoring device may be a device such as a monitoring camera. By setting a monitoring device at each monitoring point, the monitoring video in the corresponding monitoring area can be collected by the monitoring device, so that the monitoring video collected by each monitoring device can be obtained, that is, the monitoring equipment set at at least one monitoring point can be obtained. surveillance video.
针对S102:For S102:
这里,可以针对每个监控设备采集的监控视频,基于该监控视频,确定该监控点位对应的监测区域是否发生监测事件,进而可以确定至少一个监控点位中每个监控点位对应的监测区域是否发生监测事件。其中,监测事件可以包括过密事件和/或跨线事件;过密事件是指区域内的人数密度大于设置的值,即区域内的人员密度较大;跨线是指区域内有行人跨越了设置的基准线。Here, for the monitoring video collected by each monitoring device, based on the monitoring video, determine whether a monitoring event occurs in the monitoring area corresponding to the monitoring point, and then determine the monitoring area corresponding to each monitoring point in the at least one monitoring point. Whether a monitoring event has occurred. Among them, monitoring events can include over-density events and/or cross-line events; over-density events refer to the density of people in the area being greater than the set value, that is, the density of people in the area is relatively large; cross-line events refer to pedestrians crossing the area Set the baseline.
结合具体的场景对跨线事件和过密事件进行说明,比如,针对跨线事件,在地铁站内,可以在站台上,距离地铁预设距离(例如1米)的位置处设置一条基准线,监测是否有人跨越该基准线(即是否有人跨越基准线进入地铁或出地铁),若是,则发生了跨越事件。比如,针对过密事件,在沙滩上,可以设置一个目标监控区域,在该目标监控区域内的人数大于设置的人数值时,确定发生了过密事件。The cross-line events and over-density events are explained in combination with specific scenarios. For example, for cross-line events, in a subway station, a reference line can be set on the platform at a preset distance (for example, 1 meter) from the subway to monitor Whether someone crossed the baseline (that is, whether someone crossed the baseline into or out of the subway), and if so, a crossing event occurred. For example, for an over-density event, a target monitoring area can be set on the beach, and when the number of people in the target monitoring area is greater than the set number of people, it is determined that an over-density event has occurred.
在另一可选实施方式中,还可以针对每个监控视频,设置功能按钮,通过功能按钮的触发,确定对监控点位的监测区域进行监测事件的监测。比如,可以设置跨线事件对应的第一功能按钮(针对单个监控视频进行跨线事件的监测),在监控视频A对应的第一功能按钮被触发后,则确定对监控视频A进行跨线事件的监测;或者,还可以设置跨线事件对应的第二功能按钮(针对监控视频组进行跨线事件的监测),在监控视频A、监控视频B等构成的监控视频组A对应的第二功能按钮被触发后,则确定对该监控视频组A进行跨线事件监测。In another optional embodiment, a function button may also be set for each monitoring video, and by triggering the function button, it is determined to monitor the monitoring event in the monitoring area of the monitoring point. For example, the first function button corresponding to the cross-line event can be set (monitoring the cross-line event for a single surveillance video). After the first function button corresponding to the monitoring video A is triggered, it is determined to perform the cross-line event on the monitoring video A. Alternatively, the second function button corresponding to the cross-line event can also be set (to monitor the cross-line event for the monitoring video group), and the second function corresponding to the monitoring video group A formed by monitoring video A, monitoring video B, etc. After the button is triggered, it is determined to perform cross-line event monitoring on the monitoring video group A.
再比如,还可以设置过密事件对应的第三功能按钮(针对单个监控视频进行过密事件的监测),在监控视频A对应的第三功能按钮被触发后,则确定对监控视频A进行过密事件的监测;或者,还可以设置过密事件对应的第四功能按钮(针对监控视频组进行过密事件的监测),在监控视频A、监控视频B等构成的监控视频组A对应的第四功能按钮被触发后,则确定对该监控视频组A进行过密事件监测。For another example, you can also set a third function button corresponding to an over-confidence event (monitoring a single surveillance video for an over-dense event). After the third function button corresponding to surveillance video A is triggered, it is determined that surveillance video A has been checked. Or, you can also set the fourth function button corresponding to the over-encrypted event (to monitor over-encrypted events for the surveillance video group), and set the fourth function button corresponding to the surveillance video group A composed of surveillance video A, surveillance video B, etc. After the four-function button is triggered, it is determined that the monitoring video group A is monitored for over-density events.
在具体实施时,在基于监控视频,确定至少一个监控点位对应的监测区域是否发生监测事件之前,可以绘制该监控视频对应的监测标识。针对跨线事件,该监测标识可以为预先绘制的进出界线、进方向和出方向;针对过密事件,该监测标识可以为预先绘制的任一多边形,或者,针对过密事件,可以不设置对应的监测标识。其中,不同监控视频对应的监测标识不同,即可以针对每个监控视频,为该监控视频绘制对应的监测标识(跨线事件对应的监测标识和/或过密事件对应的监测标识)。In a specific implementation, before determining whether a monitoring event occurs in a monitoring area corresponding to at least one monitoring point based on the monitoring video, a monitoring identification corresponding to the monitoring video may be drawn. For cross-line events, the monitoring mark may be a pre-drawn entry and exit boundary, inbound and outbound directions; for over-density events, the monitoring mark may be any pre-drawn polygon, or, for over-density events, no corresponding monitoring identification. Wherein, the monitoring identifications corresponding to different monitoring videos are different, that is, for each monitoring video, a corresponding monitoring identification (a monitoring identification corresponding to a cross-line event and/or a monitoring identification corresponding to an over-density event) can be drawn for the monitoring video.
具体实施时,针对每个监控视频,可以从该监控视频中采集一帧视频画面截图,展示该视频画面截图,使得用户可以根据实际需要在视频画面截图上绘制监测标识。再可以通过获取预先绘制有监测标识的视频画面截图,确定视频画面截图中的监测标识在视频画面截图中的位置信息,其中,该位置信息可以为监测标识在视频画面截图对应的像素坐标系下的坐标集合,比如,可以为进出界线的位置信息等。进而,可以在该监控视频的视频画面中确定与监测标识匹配的目标位置信息。其中,在监控设备的位置、朝向等安装信息不发生改变时,监测标识在视频画面截图中的位置信息,可以为监测标识在监控视频的视频画面中的目标位置信息。进而,可以基于针对该监控设备采集的监控视频和确定的目标位置信息,确定该监控点位对应的监测区域是否发生监测事件。During specific implementation, for each surveillance video, a frame of video screenshot can be collected from the surveillance video, and the video screenshot can be displayed, so that the user can draw a monitoring logo on the video screenshot according to actual needs. Then, the location information of the monitoring logo in the video screenshot in the video screenshot can be determined by acquiring the video screenshot that is pre-drawn with the monitoring logo, wherein the position information can be that the monitoring logo is in the pixel coordinate system corresponding to the video screenshot. The set of coordinates, for example, can be the position information of the entry and exit boundaries, etc. Further, the target location information matching the monitoring identification can be determined in the video picture of the monitoring video. Wherein, when the installation information such as the location and orientation of the monitoring device does not change, the location information of the monitoring logo in the screenshot of the video screen may be the target location information of the monitoring logo in the video screen of the monitoring video. Furthermore, it can be determined whether a monitoring event occurs in the monitoring area corresponding to the monitoring point based on the monitoring video collected for the monitoring device and the determined target location information.
示例性的,在监测标识包括跨线事件对应的监测标识时,参见图2a所示的一种展示绘制有监测标识的视频画面截图的界面示意图,该图2a中包括预先绘制的监测标识21,监测标识包括绘制的进出界线和指示进出方向的箭头标识。在绘制监测标识时,还可以在显示的界面上设置入人流阈值(即第一人流阈值)和/或出人流阈值(即第二人流阈值),以便基于设置的入人流阈值和/或出人流阈值,对监控视频进行监测。该图中还包括位于视频画面截图上方的越线事件设置的提示信息,以便用户根据显示的越线事件设置的提示信息,绘制监测标识。在绘制监测标识时,还可以触发“重新绘制”的按钮,将已绘制的监测标识删除,重新绘制新的监测标识。Exemplarily, when the monitoring mark includes a monitoring mark corresponding to a cross-line event, referring to a schematic interface diagram showing a screenshot of a video screen drawn with a monitoring mark as shown in FIG. 2a, the
在监测标识包括过密事件的监测标识时,参见图2b所示的一种绘制有监测标识的视频画面截图的界面示意图,该图中包括预先绘制的监测标识21,监测标识包括指示检测区域的多边形,其中,检测区域的数量可以为多个。在绘制监测标识时,还可以在显示的界面上设置分级预警人数,即一般风险对应的预警人数、较大风险对应的预警人数、和重大风险对应的预警人数,以便基于设置的分级预警人数,对监控视频进行监测。该图中还包括位于视频画面截图上方的过密事件设置的提示信息,以便用户根据显示的越线事件设置的提示信息,绘制指示检测区域的监测标识。在绘制监测标识时,还可以触发“重新绘制”的按钮,将已绘制的监测标识删除,重新绘制新的监测标识。在绘制了监控视频对应的监测标识后,可以将绘制的监测标识存储在复用区域内,以便下次确定监测标识时,可以直接触发复用区域的功能按钮,实现监测标识的再次利用。When the monitoring mark includes the monitoring mark of the over-density event, refer to the schematic interface diagram of a video screen shot with the monitoring mark drawn as shown in FIG. Polygon, wherein the number of detection regions can be multiple. When drawing the monitoring logo, you can also set the number of people for early warning by classification on the displayed interface, that is, the number of people for early warning corresponding to general risks, the number of people for early warning corresponding to major risks, and the number of people for early warning corresponding to major risks, so that based on the set number of people for early warning, Monitor surveillance video. The figure also includes the prompt information of the overcrowded event setting above the screenshot of the video screen, so that the user can draw a monitoring mark indicating the detection area according to the displayed prompt information of the over-the-line event setting. When drawing a monitoring mark, you can also trigger the "redraw" button to delete the drawn monitoring mark and redraw a new monitoring mark. After drawing the monitoring logo corresponding to the monitoring video, the drawn monitoring logo can be stored in the multiplexing area, so that when the monitoring logo is determined next time, the function button of the multiplexing area can be directly triggered to realize the reuse of the monitoring logo.
图2b中的人体标注的功能按钮,用于展示人体标注的设置信息。考虑到,监控视频画面中人体的面积大小、与监控设备的高度和角度有关,且同一人体与监控设备的距离不同,在监控视频画面中的面积大小不同,即与监控设备的距离较近时,人体的面积较大,故人体标注是跨线事件、过密事件的基础设置。The function button of human body annotation in Figure 2b is used to display the setting information of human body annotation. Considering that the size of the human body in the surveillance video screen is related to the height and angle of the monitoring equipment, and the distance between the same human body and the monitoring equipment is different, the size of the area in the monitoring video screen is different, that is, when the distance from the monitoring equipment is relatively close. , the area of the human body is large, so human body labeling is the basic setting for cross-line events and over-density events.
具体的,可以在视频画面截图中,从位于不同深度位置处标记多个行人的人体框,估计每个行人的人体框的面积和所处的深度信息;便于算法(比如,用于识别人体的图像识别算法)利用人体标注结果,对不同情况下的不同监控设备进行人体识别,提高识别精度,其中,人体框越多,精度越高,具体实施时,标记的行人框的数量可以根据需要进行设置,比如,可以设置标记的行人框的数量范围为3-10个。进而可以利用多个行人的人体框的面积以及每个行人所处的深度信息,对监控视频中每秒视频画面的检测区域中包括的实时人数进行检测。Specifically, in the screenshot of the video screen, the human body frames of multiple pedestrians can be marked at different depth positions, and the area and depth information of the human body frame of each pedestrian can be estimated; Image recognition algorithm) uses the human body labeling results to perform human body recognition on different monitoring equipment in different situations to improve the recognition accuracy, wherein the more human body frames, the higher the accuracy. Set, for example, you can set the number of marked pedestrian boxes to range from 3-10. Furthermore, the area of the human body frame of multiple pedestrians and the depth information of each pedestrian can be used to detect the real-time number of people included in the detection area of the video frame per second in the surveillance video.
在过密事件中,当绘制了检测区域(监测标识)后,可以基于人体标注中标记的人体样本,计算出绘制区域在现实场景中的预测面积,并在图2b下方的“区域面积预估”处显示预测面积,并可以在后续的点位过密告警、视频组过密告警等中,计算出检测区域内的人员密度。以及,该图2b中还包括“更正面积”的功能按钮,可以在触发了“更正面积”的功能按钮后,对区域面积预估处显示的预测面积进行更正。In the event of overcrowding, when the detection area (monitoring mark) is drawn, the predicted area of the drawn area in the real scene can be calculated based on the human body samples marked in the human body annotation, and the predicted area of the drawn area in the real scene can be calculated and displayed in the “area area estimation” at the bottom of Figure 2b. ”, the predicted area is displayed, and the density of people in the detection area can be calculated in the subsequent alarms of over-density of points and over-density of video groups, etc. And, the figure 2b also includes a "correct area" function button, after triggering the "correct area" function button, the predicted area displayed at the area area estimation can be corrected.
一种可选实施方式中,在监测事件为跨线事件的情况下,基于监控视频确定至少一个监控点位对应的监测区域是否发生监测事件,包括:In an optional embodiment, when the monitoring event is a cross-line event, determining whether a monitoring event occurs in the monitoring area corresponding to at least one monitoring point based on the monitoring video includes:
基于所述监控视频确定所述至少一个监控点位对应的监测区域内,是否存在跨越与预先绘制的进出界线匹配的目标位置的目标对象;Determine, based on the surveillance video, whether there is a target object spanning a target position matching a pre-drawn entry and exit boundary in the monitoring area corresponding to the at least one monitoring point;
若存在,则确定所述至少一个监控点位对应的监测区域发生跨线事件。If there is, it is determined that a cross-line event occurs in the monitoring area corresponding to the at least one monitoring point.
在监测事件为跨线事件时,针对每个监控点位采集的监控视频,可以基于监控视频,确定该监控点位对应的监测区域内,是否存在跨越与进出界线匹配的目标位置的目标对象,比如在监控视频中检测是否有行人跨越了绘制的进出界线,若存在,则确定该监控点位对应的监测区域发生跨线事件;若不存在,则确定该监控点位对应的监测区域未发生跨线事件。When the monitoring event is a cross-line event, for the monitoring video collected at each monitoring point, it can be determined based on the monitoring video whether there is a target object that crosses the target position matching the entry and exit boundary in the monitoring area corresponding to the monitoring point, For example, it is detected in the surveillance video whether a pedestrian has crossed the drawn entry and exit boundary. If it exists, it is determined that a cross-line event has occurred in the monitoring area corresponding to the monitoring point; if it does not exist, it is determined that the monitoring area corresponding to the monitoring point has not occurred. Cross-Line Events.
其中,监控点位对应的监测区域可以为该监控点位处设置的监控设备可以监控的检测区域;监控点位对应的监测区域与监控设备的安装位置、安装角度有关,不同的安装位置和/安装角度对应不同的监测区域。Among them, the monitoring area corresponding to the monitoring point may be the detection area that can be monitored by the monitoring equipment set at the monitoring point; the monitoring area corresponding to the monitoring point is related to the installation position and installation angle of the monitoring equipment, and different installation positions and/or The installation angles correspond to different monitoring areas.
上述实施方式中,在基于监控视频确定至少一个监控点位对应的监测区域内,存在跨越与进出界线匹配的目标位置的目标对象时,确定至少一个监控点位对应的监测区域发生跨线事件,实现了对跨线事件的实时监测,提高跨线事件监测的准确性。In the above-mentioned embodiment, when there is a target object that crosses the target position matching the entry and exit boundary in the monitoring area corresponding to at least one monitoring point determined based on the monitoring video, it is determined that a cross-line event occurs in the monitoring area corresponding to at least one monitoring point, Real-time monitoring of cross-line events is realized, and the accuracy of cross-line event monitoring is improved.
一种可选实施方式中,在监测事件为过密事件的情况下,基于监控视频确定至少一个监控点位对应的监测区域是否发生监测事件,包括:In an optional implementation manner, in the case that the monitoring event is an over-density event, determining whether a monitoring event occurs in the monitoring area corresponding to at least one monitoring point based on the monitoring video, including:
基于所述监控视频,确定所述至少一个监控点位对应的监测区域内的目标对象个数是否超过过密阈值;Based on the monitoring video, determine whether the number of target objects in the monitoring area corresponding to the at least one monitoring point exceeds an excessive density threshold;
若是,则确定所述至少一个监控点位对应的监测区域发生过密事件。If yes, it is determined that an over-density event occurs in the monitoring area corresponding to the at least one monitoring point.
在监测事件为过密事件时,针对每个监控点位采集的监控视频,可以基于监控视频,确定该监控点位对应的监测区域内目标对象的数量是否超过过密阈值,比如在监控视频中确定监测区域内的人类数量,判断该人类数量是否大于社会组的过密阈值,若是,则确定该监控点位对应的监测区域发生过密事件;若否,则确定该监控点位对应的监测区域未发生过密事件。这里,在监测事件为过密事件时,监控点位对应的监测区域可以为与绘制的多边形匹配的检测区域;在未绘制监测标识时,则监控点位对应的监测区域为该监控点位处设置的监控设备可以监控的检测区域(即监控视频的监控界面对应的区域均为监测区域)。When the monitoring event is an over-density event, for the monitoring video collected at each monitoring point, it can be determined based on the monitoring video whether the number of target objects in the monitoring area corresponding to the monitoring point exceeds the over-density threshold, for example, in the monitoring video Determine the number of humans in the monitoring area, and determine whether the number of humans is greater than the over-density threshold of the social group. If so, determine that an over-density event has occurred in the monitoring area corresponding to the monitoring point; if not, determine the monitoring point corresponding to the monitoring point. No overcrowding incidents have occurred in the area. Here, when the monitoring event is an over-density event, the monitoring area corresponding to the monitoring point may be the detection area matching the drawn polygon; when the monitoring logo is not drawn, the monitoring area corresponding to the monitoring point is the monitoring point. The set detection area that can be monitored by the monitoring device (that is, the area corresponding to the monitoring interface of the monitoring video is the monitoring area).
上述方法中,在基于监控视频,确定至少一个监控点位对应的监测区域内的目标对象个数超过过密阈值时,确定至少一个监控点位对应的监测区域发生过密事件,实现了对过密事件的实时监测,提高过密事件监测的准确性。In the above method, when it is determined based on the surveillance video that the number of target objects in the monitoring area corresponding to at least one monitoring point exceeds the over-density threshold, it is determined that an over-density event has occurred in the monitoring area corresponding to at least one monitoring point, thereby realizing the over-density event. Real-time monitoring of secret incidents to improve the accuracy of over-densified incident monitoring.
针对S103和S104:For S103 and S104:
这里,在确定至少一个监控点位对应的监测区域发生监测事件时,可以获取预设时间段内与监测事件匹配的人数监测数据;人数监测数据包括跨线事件对应的人数监测数据和/或过密事件对应的人数监测数据。进而,基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据;人流状态数据包括跨线事件对应的人流状态数据和/或过密事件对应的人流状态数据。其中,预设时间段可以根据需要进行设置,比如,预设时间段可以为在确定发生监测事件的时刻开始至一个小时后的时间段,若确定发生监测事件的时刻为13时10分00秒,则预设时间段为从13时10分00秒至14时10分00秒内的时间段。比如,预设时间段可以为在确定发生监测事件的时刻开始至一分钟后的时间段,若确定发生监测事件的时刻为13时10分00秒,则预设时间段为从13时10分00秒至13时11分00秒内的时间段。Here, when it is determined that a monitoring event occurs in a monitoring area corresponding to at least one monitoring point, the number of people monitoring data that matches the monitoring event within a preset time period can be obtained; the number of people monitoring data includes the number of people monitoring data corresponding to cross-line events and/or The number of people monitoring data corresponding to the confidential incident. Further, based on the number of people monitoring data that matches the monitoring event within a preset time period, determine the crowd flow status data of at least one monitoring device; the crowd flow status data includes the crowd flow status data corresponding to the cross-line event and/or the crowd flow status data corresponding to the over-density event . The preset time period can be set as required. For example, the preset time period can be the time period from the moment when the monitoring event is determined to occur to one hour later. If the moment when the monitoring event is determined to occur is 13:10:00 , the preset time period is a time period from 13:10:00 to 14:10:00. For example, the preset time period may be the time period from the time when the monitoring event is determined to occur to one minute later. If it is determined that the time when the monitoring event occurs is 13:10:00, the preset time period is from 13:10 The time period from 00 seconds to 13:11:00.
针对跨线事件,可以获取预设时间段内与跨线事件匹配的人数监测数据;并基于预设时间段内与跨线事件匹配的人数监测数据,确定至少一个监控设备的、与跨线事件匹配的人流状态数据。For cross-line events, the monitoring data of the number of people matching the cross-line event within a preset time period can be obtained; Matching traffic status data.
针对过密事件,可以获取预设时间段内与过密事件匹配的人数监测数据;并基于预设时间段内与过密事件匹配的人数监测数据,确定至少一个监控设备的、与过密事件匹配的人流状态数据。For over-density events, the monitoring data of the number of people matching the over-density events within a preset time period can be obtained; and based on the number of people monitoring data matching the over-density events within the preset time period, determine at least one monitoring device that matches the over-density events. Matching traffic status data.
一种可选实施方式中,在确定至少一个监控设备的人流状态数据之后,还包括:在确定至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息。In an optional implementation manner, after determining the crowd flow state data of the at least one monitoring device, the method further includes: generating crowd flow state alarm information when it is determined that the crowd flow state data of the at least one monitoring device meets the alarm condition.
这里,判断至少一个监控设备的人流状态数据是否满足告警条件,若满足,则生成人流状态告警信息,以便用户可以基于人流状态告警信息,生成疏导计划,避免目标监控区域发生踩踏、拥堵等事件。Here, it is judged whether the crowd flow status data of at least one monitoring device satisfies the alarm condition, and if so, the crowd flow status alarm information is generated, so that the user can generate a grooming plan based on the crowd flow status alarm information to avoid events such as trampling and congestion in the target monitoring area.
这里,在确定的人流状态数据满足告警条件时,生成人流状态告警信息,基于生成的人流状态告警信息,可以对目标监控区域进行调控,避免安全事故的发生,保证目标监控区域下人流的安全性。Here, when the determined crowd flow status data meets the alarm conditions, the crowd flow status alarm information is generated. Based on the generated crowd flow status alarm information, the target monitoring area can be regulated to avoid the occurrence of security accidents and ensure the safety of the crowd flow under the target monitoring area. .
下述分别对跨线事件的告警过程和过密事件的告警过程进行详细说明。The following sections describe in detail the alarming process for cross-line events and the alarming process for overcrowded events.
首先对跨线事件的告警过程进行说明。First, the alarm process of the cross-line event is described.
在监测事件为跨线事件的情况下,获取预设时间段内与监测事件匹配的人数监测数据,包括:If the monitoring event is a cross-line event, obtain the monitoring data of the number of people matching the monitoring event within a preset time period, including:
获取预设时间段内不同采集时间点的进人流数量和出人流数量,其中,所述不同采集时间点的进人流数量是指在不同采集时间点,沿预先绘制的进方向跨越预先绘制的进出界线的人数;所述不同采集时间点的出人流数量是指在不同采集时间点,沿预先绘制的出方向跨越预先绘制的进出界线的人数。Obtain the number of incoming and outgoing traffic at different collection time points within a preset time period, wherein the number of incoming and outgoing traffic at different collection time points refers to crossing the pre-drawn incoming and outgoing directions along the pre-drawn incoming direction at different collection time points. The number of people in the boundary line; the number of people leaving the boundary at different collection time points refers to the number of people who cross the pre-drawn in-out boundary line along the pre-drawn out direction at different collection time points.
这里,跨线事件对应的监测标识中可以包括预先设置的进出界线和进出方向(进方向和/或出方向,出方向为进方向的反方向),进出界线可以将监控视频对应的监测区域划分为进区域和出区域,进出方向中的进方向可以为从出区域进入进区域的方向,进出方向中的出方向可以为从进区域进入出区域的方向。Here, the monitoring identification corresponding to the cross-line event may include a preset entry and exit boundary and an entry and exit direction (the entry direction and/or the exit direction, and the exit direction is the opposite direction of the entry direction), and the entry and exit boundary may divide the monitoring area corresponding to the surveillance video. For the entry area and the exit area, the entry direction in the entry and exit directions may be the direction from the exit area into the entry area, and the exit direction in the entry and exit directions may be the direction from the entry area into the exit area.
进而可以基于设置的进出界线、进出方向和监控视频,确定监控视频中预设时间段内每个采集时间点的进人流数量(即入人流数量)和出人流数量,不同采集时间点的进人流数量是指在不同采集时间点,沿进方向跨越进出界线的人数;不同采集时间点的出人流数量是指在不同采集时间点,沿出方向跨越进出界线的人数。Then, based on the set entry and exit boundaries, entry and exit directions, and surveillance video, the number of incoming and outgoing traffic (that is, the number of incoming traffic) and outgoing traffic at each collection time point in the preset time period in the surveillance video can be determined, and the incoming traffic at different collection time points. Quantity refers to the number of people who cross the inbound and outbound boundary along the incoming direction at different collection time points;
示例性的,可以利用训练好的目标追踪算法,基于设置的监测标识对监控视频进行检测,在预设时间段内,每间隔预设时间输出一次检测结果,预设时间段内的多次检测结果可以为预设时间段内不同采集时间点的进人流数量和出人流数量,每个检测结果关联有输出时间(该输出时间为采集时间点),进而可以获取预设时间段内不同采集时间点的进人流数量和出人流数量。Exemplarily, the trained target tracking algorithm can be used to detect the surveillance video based on the set monitoring identification, and within a preset time period, output a detection result at a preset time interval, and detect multiple times within the preset time period. The result can be the number of inflows and outflows at different collection time points within a preset time period, and each detection result is associated with an output time (the output time is the collection time point), and then different collection times within the preset time period can be obtained. The number of incoming and outgoing traffic at the point.
上述方法中,在监测事件为跨线事件时,可以获取预设时间段内不同采集时间点的进人流数量和出人流数量,为后续确定跨线事件对应的人流状态数据提供了数据支持。In the above method, when the monitoring event is a cross-line event, the number of incoming and outgoing human flows at different collection time points within a preset time period can be obtained, which provides data support for subsequent determination of the human flow state data corresponding to the cross-line event.
一种可选实施方式中,在监控点位为一个的情况下,基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,包括:基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。In an optional embodiment, in the case that there is one monitoring point, based on the number of people monitoring data that matches the monitoring event within a preset time period, determining the crowd flow status data of at least one monitoring device includes: based on the preset time period. The number of inflows and outflows at different time points are collected, and the total number of inflows and outflows in the preset time period in the monitoring area corresponding to the monitoring point is determined.
在确定至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:在确定预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在确定预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息。When it is determined that the crowd flow state data of at least one monitoring device satisfies the alarm condition, generating the crowd flow state alarm information includes: determining that the total number of people entering the crowd flow within a preset time period is greater than the set first crowd flow threshold, and/or determining In the case that the total number of outgoing people flow in the preset time period is greater than the set second people flow threshold value, the people flow state alarm information is generated.
在获取了预设时间段内与监测事件(跨线事件)匹配的人数监测数据之后,即针对跨线事件,在获取了预设时间段内不同采集时间点的进人流数量和出人流数量之后,可以基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定该监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。After obtaining the number of people monitoring data matching the monitoring event (cross-line event) within the preset time period, that is, for the cross-line event, after obtaining the number of incoming and outgoing traffic at different collection time points within the preset time period , the total number of inflows and outflows in the preset time period in the monitoring area corresponding to the monitoring point can be determined based on the number of inflows and outflows at different collection time points within the preset time period.
承接上述实施例继续说明,训练好的目标追踪算法可以每3秒输出一次检测结果(每3秒确定一个采集时间点),该检测结果可以为该3秒内的进人流数量和出人流数量,例如,检测结果可以为:08时10分01秒-08时10分03秒(包括10分01秒和10分03秒)之间的进人流数量为20、出人流数量为50,关联的输出时间(采集时间点)为08时10分03秒;进而可以得到预设时间段内的多次检测结果,即得到预设时间段内不同采集时间点的进人流数量和出人流数量。Continuing to explain the above-mentioned embodiment, the trained target tracking algorithm can output a detection result every 3 seconds (a collection time point is determined every 3 seconds), and the detection result can be the number of people entering and leaving the flow within the 3 seconds, For example, the detection result can be: the number of incoming traffic between 08:10:01 and 08:10:03 (including 10:01 and 10:03) is 20, the number of outgoing traffic is 50, and the associated output The time (collection time point) is 08:10:03; then multiple detection results within a preset time period can be obtained, that is, the number of incoming and outgoing traffic at different collection time points within the preset time period.
在得到了预设时间段内不同采集时间点的进人流数量和出人流数量之后,可以将不同采集时间点的进人流数量进行相加,得到预设时间段内的总进人流数量;以及可以将不同采集时间点的出人流数量进行相加,得到预设时间段内的总出人流数量。After obtaining the number of inflows and outflows at different collection time points within the preset time period, the number of inbound flows at different collection time points can be added to obtain the total number of inflows in the preset time period; and Add up the number of outbound people at different collection time points to obtain the total number of outbound people in the preset time period.
这里,第一人流阈值、第二人流阈值为预先设置的,第一人流阈值和第二人流阈值可以根据实际需要进行设置。在得到预设时间段内的总进人流数量和总出人流数量之后,可以判断该预设时间段内的总进人流数量是否大于设置的第一人流阈值,和/或,判断该预设时间段内的总出人流数量是否大于设置的第二人流阈值。Here, the first crowd flow threshold and the second crowd flow threshold are preset, and the first crowd flow threshold and the second crowd flow threshold may be set according to actual needs. After obtaining the total number of people entering and exiting within the preset time period, it can be determined whether the total number of people entering the preset time period is greater than the set first threshold of people flow, and/or, the preset time can be judged. Whether the total number of people leaving the segment is greater than the set second threshold.
在判断该预设时间段内的总进人流数量是否大于设置的第一人流阈值,以及判断该预设时间段内的总出人流数量是否大于设置的第二人流阈值的情况下,若预设时间段内的总进人流数量大于设置的第一人流阈值,和/或,若在预设时间段内的总出人流数量大于设置的第二人流阈值时,生成人流状态告警信息。生成的人流状态告警信息可以为文字、语音、视频等格式的信息,比如,生成的人流状态告警信息可以为“注意,进人流数量较大”。这种情况下,人流状态告警信息的告警事件类型为:点位越线告警。In the case of judging whether the total number of people entering the preset time period is greater than the set first threshold, and judging whether the total number of people leaving the preset time period is greater than the set second threshold, if the preset The total number of people entering in the time period is greater than the set first threshold, and/or, if the total number of people leaving within the preset time period is greater than the second threshold, a people flow state alarm message is generated. The generated crowd status alarm information may be information in the format of text, voice, video, etc. For example, the generated crowd status alarm information may be "Attention, the number of people entering the flow is large". In this case, the alarm event type of the crowd flow state alarm information is: point crossing line alarm.
进一步的,可以在触发生成的人流状态告警信息之后,可以显示该人流状态告警的详细信息,详细信息包括但不限于告警点位(即告警的监控设备的名称等)、告警时间、告警事件类型,在告警事件类型为点位越线告警时,详细信息还包括该单位时间内的进人流数量、出人流数量等。Further, after triggering the generated crowd state alarm information, the detailed information of the crowd state alarm can be displayed, and the detailed information includes but is not limited to the alarm point (namely, the name of the alarm monitoring device, etc.), the alarm time, and the type of the alarm event. , when the alarm event type is a point crossing alarm, the detailed information also includes the number of incoming and outgoing traffic in the unit time.
这里,在监控点位为一个时,基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。在预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息,实现了对该监控视频的进人流数量和出人流数量的预警,以便基于生成的人流状态告警信息进行人流的疏导,避免短时间内进人流数量较多,或者出人流数量较多造成的安全事故的发生。Here, when there is one monitoring point, based on the number of inflows and outflows at different collection time points within the preset time period, the total number of inflows and the total number of inflows in the preset time period in the monitoring area corresponding to the monitoring point is determined. The number of outflows. In the case where the total number of people entering the preset time period is greater than the set first threshold, and/or when the total number of people leaving within the preset time period is greater than the second set threshold, generating a traffic state alarm message, It realizes the early warning of the number of people entering and leaving the surveillance video, so as to divert the flow of people based on the generated warning information of the flow of people, and avoid security accidents caused by a large number of people entering or leaving a large number of people in a short time. happened.
一种可选实施方式中,在监控点位为一个的情况下,基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,包括:基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中的进人流速度和出人流速度。In an optional embodiment, in the case that there is one monitoring point, based on the number of people monitoring data that matches the monitoring event within a preset time period, determining the crowd flow status data of at least one monitoring device includes: based on the preset time period. The number of inflows and outflows at different collection time points within the system is used to determine the inflow and outflow speeds in the monitoring area corresponding to the monitoring point.
这里,还可以基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中的进人流速度和出人流速度。Here, the inflow speed and the outflow speed in the monitoring area corresponding to the monitoring point may also be determined based on the number of inflows and outflows at different collection time points within a preset time period.
具体实施时,在得到了预设时间段内不同采集时间点的进人流数量和出人流数量之后,可以对多次检测结果按照输出时间(采集时间点)进行归类、并整合,得到单位时间内(比如一分钟)的进人流数量和出人流数量,进而可以得到进人流速度和出人流速度。During specific implementation, after obtaining the number of inflows and outflows at different collection time points within the preset time period, the multiple detection results can be classified and integrated according to the output time (collection time point) to obtain the unit time The number of inflows and outflows within one minute (for example, one minute), and then the speed of inflows and outflows can be obtained.
比如,可以将输出时间为08时10分00秒至08时11分00秒(不包括08时10分00秒、包括08时11分00秒)之内的输出结果进行归类并整合,即将输出时间为08时10分03秒、08时10分06秒、……、08时10分57秒、08时11分00秒得到的输出结果划分为一类,并将该类内的检测结果进行整合,得到08时10分00秒-08时11分00秒之间的1分钟内(单位时间内)的进人流数量和出人流数量,即得到了08时10分对应的进人流速度(单位:人/分)和出人流速度(单位:人/分)。For example, the output results from 08:10:00 to 08:11:00 (excluding 08:10:00, including 08:11:00) can be classified and integrated, i.e. The output time is 08:10:03, 08:10:06,... Perform integration to obtain the number of incoming and outgoing traffic within 1 minute (unit time) between 08:10:00 and 08:11:00, that is, to obtain the corresponding speed of incoming traffic at 08:10 ( Unit: person/minute) and outflow speed (unit: person/minute).
上述方法中,可以基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中的进人流速度和出人流速度,实现对进人流速度和出人流速度的监测,避免进人流速度较大,或者出人流速度较大造成的安全事故的发生。In the above method, the inflow speed and the outflow speed in the monitoring area corresponding to the monitoring point can be determined based on the number of inflows and outflows at different collection time points within a preset time period, so as to realize the control of the inflow and outflow. Speed monitoring to avoid the occurrence of safety accidents caused by large inflow speed or high outflow speed.
参见图3所示的一种展示人流状态告警的详细信息的界面示意图,该图中包括告警详情、当天跨线事件时段统计,告警详情包括告警点位、事件类型、告警时间、持续时长(跨线事件持续的时间)、入流峰值、出流峰值等,当前跨线事件时段统计包括从当天的零点至统计的当前时间之间的越线事件告警。该图中还包括视频画面截图,该视频画面截图上显示有当前时刻对应的出人流信息(出人流数量和出人流速度)和入人流信息(入人流数量和入人流速度);视频画面截图下方显示有多帧告警图片,其中,告警图片的数量与告警的持续时长相关,比如,跨线事件的持续时长为17分钟时,可以每间隔一分钟提取一帧告警图片,作为告警记录,即可以在视频画面截图下方显示17帧告警图片。Referring to a schematic diagram of an interface showing the detailed information of the human flow state alarm shown in FIG. 3, the figure includes the alarm details, the statistics of the cross-line event period of the day, and the alarm details include the alarm point, event type, alarm time, and duration (cross-line event). The duration of the line event), peak inflow, peak outflow, etc., the current cross-line event period statistics include cross-line event alarms from the zero point of the day to the current time of the statistics. The figure also includes a screenshot of the video screen, and the screenshot of the video screen displays the information of the outgoing flow (the number of outgoing flows and the speed of the outgoing flow) and the information of the incoming flow (the number of the incoming flow and the speed of the incoming flow) corresponding to the current moment; Displays multiple frames of alarm pictures, in which the number of alarm pictures is related to the duration of the alarm. For example, when the duration of the cross-line event is 17 minutes, one frame of alarm pictures can be extracted every one minute as an alarm record, that is, 17 frames of alarm pictures are displayed below the video screenshot.
在具体实施时,还可以将监控设备的名称、安装位置、采集的监控视频等点位信息、以及单位时间内的出人流数量、进人流数量等信息持久化存储在搜索服务器(比如,elasticsearch)中,以便后续搜索查询。In the specific implementation, the name of the monitoring device, the installation location, the point information such as the collected monitoring video, and the number of outgoing and incoming traffic per unit time can also be persistently stored in the search server (for example, elasticsearch) , for subsequent search queries.
一种可选实施方式中,在监控点位为多个的情况下,基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,包括:In an optional embodiment, in the case of multiple monitoring points, based on the number of people monitoring data matching the monitoring event within a preset time period, determine the crowd flow status data of at least one monitoring device, including:
步骤一、针对每个所述监控点位,基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。Step 1: For each of the monitoring points, determine the total number of inflows and outflows in the preset time period in the monitoring area corresponding to the monitoring point based on the number of inflows and outflows at different collection time points within the preset time period. and total outflows.
步骤二、基于预设时间段内目标监控区域的历史人数,以及多个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量,确定目标监控区域内的人员净存量。Step 2: Determine the net stock of personnel in the target monitoring area based on the historical number of people in the target monitoring area within the preset time period, and the total number of incoming and outgoing people in the preset time period corresponding to multiple monitoring points respectively. .
在确定至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:在确定目标监控区域内的人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息。When it is determined that the people flow state data of at least one monitoring device satisfies the alarm condition, generating the people flow state alarm information includes: when it is determined that the net stock of people in the target monitoring area is greater than the set net stock threshold, generating the people flow state warning information .
这里,考虑到一个场地或场所可能设置多个监控设备,故可以对多个监控设备分别采集的监控视频进行人流分析,得到多个监控视频的人流状态数据。其中,多个监控设备分别采集的监控视频构成了视频组,即可以对视频组进行人流分析,得到该视频组对应的人流状态数据。在具体实施时,可以通过触发展示界面上设置的视频组对应的跨线事件的开启按钮,开启视频组内每个监控视频的跨线分析功能。同时,还可以在展示界面上设置人流总存量分级预警的具体信息,比如,填写存量趋多对应的一级预警人数、存量警示对应的二级预警人数、和存量过热对应的三级预警人数。Here, considering that multiple monitoring devices may be set up in a site or place, people flow analysis can be performed on the surveillance videos collected by the multiple monitoring devices respectively, so as to obtain the crowd flow status data of the multiple surveillance videos. The monitoring videos collected by multiple monitoring devices respectively constitute a video group, that is, the crowd flow analysis can be performed on the video group to obtain the crowd flow status data corresponding to the video group. During specific implementation, the cross-line analysis function of each surveillance video in the video group can be enabled by triggering the open button of the cross-line event corresponding to the video group set on the display interface. At the same time, you can also set the specific information of the level warning of the total stock of people on the display interface, for example, fill in the number of people in the first-level warning corresponding to the increasing stock, the number of people in the second-level warning corresponding to the stock warning, and the number of people in the third-level warning corresponding to the overheating stock.
步骤一中,针对每个监控点位,在获取了该监控点位对应的预设时间段内不同采集时间点的进人流数量和出人流数量之后,可以将不同采集时间点的进人流数量相加,得到该监控点位对应的预设时间段内的总进人流数量;以及可以将不同采集时间点的出人流数量相加,得到该监控点位对应的预设时间段内的总出人流数量。进而可以得到各个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量。In step 1, for each monitoring point, after acquiring the number of inflows and outflows at different collection time points within the preset time period corresponding to the monitoring point, the numbers of inflows at different collection time points can be compared. Add up to obtain the total number of people entering the preset time period corresponding to the monitoring point; and the number of exiting people at different collection time points can be added to obtain the total number of people leaving the monitoring point in the preset time period corresponding to the monitoring point. quantity. Then, the total number of incoming and outgoing traffic in the preset time period corresponding to each monitoring point can be obtained.
比如,可以得到每个监控设备对应的08时11分00秒的时间点至08时12分00秒的时间点内的总进人流数量和总出人流数量,08时11分00秒的时间点至08时12分00秒的时间点之间的时间段即为预设时间段。For example, the total number of people entering and exiting from the time point of 08:11:00 to 08:12:00 corresponding to each monitoring device can be obtained, and the time point of 08:11:00 The time period between the time point of 08:12:00 is the preset time period.
进而,基于预设时间段内目标监控区域的历史人数,以及多个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量,确定目标监控区域内的人员净存量。比如,针对视频组内的每个监控视频,可以将该监控视频分别对应的预设时间段的总进人流数量与总出人流数量相减,得到该监控视频在该预设时间段内的人流变化量,将各个监控视频分别对应的预设时间段内的人流变化量相加,得到视频组对应的总人流变化量(即视频组对应的场地或场所对应的总人流变化量),再将视频组对应的总人流变化量与预设时间段内目标监控区域的历史人数相加,得到目标监控区域内的人员净存量(即得到视频组对应的场地或场所对应的当前时间点的当前人数)。Further, based on the historical number of people in the target monitoring area within the preset time period, and the total number of incoming and outgoing people in the preset time period corresponding to the multiple monitoring points, the net personnel stock in the target monitoring area is determined. For example, for each surveillance video in a video group, the total number of incoming traffic and the total number of outgoing traffic in the preset time period corresponding to the surveillance video can be subtracted to obtain the traffic of the surveillance video in the preset time period. The change amount, add up the change amount of people flow in the preset time period corresponding to each surveillance video to obtain the change amount of total people flow corresponding to the video group (that is, the total change amount of people flow corresponding to the venue or venue corresponding to the video group), and then add The total change of people flow corresponding to the video group is added to the historical number of people in the target monitoring area within the preset time period to obtain the net stock of personnel in the target monitoring area (that is, the current number of people at the current time point corresponding to the venue or venue corresponding to the video group is obtained. ).
比如,预设时间段可以为08时11分00秒的时间点至08时12分00秒的时间点之间的时间段,再可以得到08时11分00秒的时间点对应的当前人数(即预设时间段内目标监控区域的历史人数),并可以得到视频组内每个监控视频对应的08时11分00秒至08时12分00秒(预设时间段)内的总进人流数量和总出人流数量,在基于预设时间段内目标监控区域的历史人数(即得到的08时11分00秒的时间点的人员净存量)、以及视频组内每个监控视频对应的08时11分00秒至08时12分00秒内的总进人流数量和总出人流数量,确定目标监控区域中08时12分00秒的人员净存量。For example, the preset time period can be the time period between the time point of 08:11:00 and 08:12:00, and then the current number of people corresponding to the time of 08:11:00 can be obtained ( That is, the historical number of people in the target monitoring area within the preset time period), and can get the total inflow of people from 08:11:00 to 08:12:00 (the preset time period) corresponding to each monitoring video in the video group The number and the total number of outgoing people, based on the historical number of people in the target monitoring area within the preset time period (that is, the obtained net stock of personnel at the time point of 08:11:00), and the 08 corresponding to each monitoring video in the video group. From 11:00:00 to 08:12:00, the total number of people entering and leaving and the total number of people leaving, determine the net stock of people in the target monitoring area at 08:12:00.
在得到目标监控区域内的人员净存量之后,可以对目标监控区域内的人员净存量进行监测,在监测到目标监控区域内的人员净存量大于预先设置的净存量阈值的时,生成人流状态告警信息。比如,生成的人流状态告警信息可以为“注意,当前时间xx场地人员净存量较多”。这种情况下,人流状态告警信息的告警事件类型为:视频组跨线告警。After obtaining the net stock of personnel in the target monitoring area, you can monitor the net stock of personnel in the target monitoring area. When the net stock of personnel in the target monitoring area is detected to be greater than the preset net stock threshold, a people flow status alarm will be generated information. For example, the generated crowd flow state alarm information may be "Attention, there are a lot of net people in the xx venue at the current time". In this case, the alarm event type of the crowd status alarm information is: video group cross-line alarm.
具体实施时,针对视频组跨线告警,可以设置多级告警风险,比如,多级告警风险包括:存量趋多、存量警示、存量过热,针对不同的告风险设置不同的净存量阈值,例如,存量趋多对应的净存量阈值可以为100,存量警示对应的净存量阈值可以为200,存量过热对应的净存量阈值可以为500。针对不同的告警风险,可以设置不同的人流状态告警信息。比如,存量趋多对应的人流状态告警信息可以为:文字格式的告警信息;存量警示对应的人流状态告警信息可以为:语音格式的告警信息;存量过热对应的人流状态告警信息可以为:视频格式的告警信息。During specific implementation, multi-level alarm risks can be set for cross-line alarms of video groups. For example, multi-level alarm risks include: increasing inventory, inventory warning, and inventory overheating. Different net inventory thresholds are set for different alarm risks. For example, The net stock threshold corresponding to increasing stock may be 100, the net stock threshold corresponding to stock warning may be 200, and the net stock threshold corresponding to overheating stock may be 500. For different alarm risks, you can set different alarm information about the flow of people. For example, the warning information of the crowd status corresponding to the increasing stock may be: alarm information in text format; the warning information of the crowd status corresponding to the stock warning may be: alarm information in voice format; the warning information of the crowd status corresponding to the overheating stock may be: video format alarm information.
进一步的,可以在触发生成的人流状态告警信息之后,可以显示该人流状态告警的详细信息,详细信息包括但不限于告警点位(即告警的监控设备的名称等)、告警时间、告警事件类型,在告警时间类型为视频组跨线告警时,详细信息还可以包括:当前时间点的人员净存量。Further, after triggering the generated crowd state alarm information, the detailed information of the crowd state alarm can be displayed, and the detailed information includes but is not limited to the alarm point (namely, the name of the alarm monitoring device, etc.), the alarm time, and the type of the alarm event. , and when the alarm time type is a video group cross-line alarm, the detailed information may further include: the net stock of personnel at the current time point.
这里,在确定每个监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量之后,可以基于预设时间段内目标监控区域的历史人数,以及多个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量,确定目标监控区域内的人员净存量,并在目标监控区域内的人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息,实现了对目标监控区域中的人员净存量的预警,以便在人员净存量较多时,基于生成的人流状态告警信息进行人员的疏导,避免目标监控区域中人员较多时造成安全事故的发生。Here, after determining the total number of incoming and outgoing people in the preset time period in the monitoring area corresponding to each monitoring point, it can be based on the historical number of people in the target monitoring area within the preset time period, and multiple monitoring points. The total number of people entering and leaving the corresponding preset time period is determined, and the net personnel stock in the target monitoring area is determined, and when the net personnel stock in the target monitoring area is greater than the set net stock threshold, Generates crowd flow status alarm information to realize the early warning of the net stock of people in the target monitoring area, so that when the net stock of people is large, people can be dredged based on the generated crowd flow status alarm information to avoid safety when there are many people in the target monitoring area. the occurrence of the accident.
参见图4a所示的一种展示人流状态告警的详细信息的界面示意图,图4a中以地图模式展示了人流状态告警的详细信息;以及参见图4b所示的另一种展示人流状态告警的详细信息的界面示意图,图4b中以列表模式展示了人流状态告警的详细信息,其中,图4b中展示的列表中包括过密事件和越线事件。具体的,在触发图4a中显示的越线事件的信息之后,或者,在触发图4b中显示的越线事件的信息之后,可以展示图4c中显示的告警详情,图4c中显示的告警详情包括分组名称(即视频组对应的名称)、事件类型、告警时间、持续时长、人流总存量峰值、当天人流总存量统计。Referring to a schematic diagram of an interface showing the detailed information of the crowd flow state alarm shown in FIG. 4a, the detailed information of the crowd flow state alarm is displayed in a map mode in FIG. 4a; A schematic diagram of the interface of the information, Fig. 4b shows the detailed information of the crowd flow state alarm in a list mode, wherein the list shown in Fig. 4b includes over-density events and line crossing events. Specifically, after triggering the information of the line crossing event shown in FIG. 4a, or after triggering the information of the line crossing event shown in FIG. 4b, the alarm details shown in FIG. 4c can be displayed, and the alarm details shown in FIG. 4c can be displayed. Including the group name (namely the name corresponding to the video group), event type, alarm time, duration, peak value of the total stock of people, and statistics of the total stock of people on the day.
其次,可以对过密事件的告警过程进行详细说明。Secondly, the alarm process of the over-densification event can be described in detail.
一种可选实施方式中,在监测事件为过密事件的情况下,获取预设时间段内与监测事件匹配的人数监测数据,包括:统计预设时间段内不同采集时间点的目标对象的个数。In an optional implementation manner, in the case that the monitoring event is an overcrowded event, obtaining the monitoring data of the number of people matching the monitoring event within a preset time period includes: counting the data of target objects at different collection time points within the preset time period. number.
这里,在监控视频中存在过密事件对应的监测标识时,可以基于过密事件对应的监测标识和监控视频,对监测标识对应的检测区域中的目标对象(人类)进行检测,得到各个采集时间点时检测区域内的目标对象的数量。在监控视频中不存在过密时间对应的监测标识时,则认为监控视频的整个监控画面均为检测区域,可以对监控视频进行检测,得到各个采集时间点时检测区域中的目标对象的数量。Here, when there is a monitoring identifier corresponding to an over-density event in the surveillance video, the target object (human) in the detection area corresponding to the monitoring identifier can be detected based on the monitoring identifier and the surveillance video corresponding to the over-density event, and each collection time can be obtained. The number of target objects in the detection area when you click. When there is no monitoring mark corresponding to the over-density time in the surveillance video, it is considered that the entire surveillance image of the surveillance video is a detection area, and the surveillance video can be detected to obtain the number of target objects in the detection area at each collection time point.
具体实施时,可以利用训练好的用于识别目标对象的深度学习算法,对监控视频中的检测区域进行检测,实时的输出检测结果,检测结果可以为监控视频中每个采集时间点时检测区域内的人数。其中,深度学习算法可以周期性的输出检测结果,比如,深度学习算法可以每秒输出一次检测结果,或者,还可以每两秒输出一次检测结果等。比如,检测结果可以为:08时10分00秒(采集时间点)时检测区域内的人数为50;08时10分01秒时检测区域内的人数为54等。In specific implementation, the trained deep learning algorithm for identifying target objects can be used to detect the detection area in the surveillance video, and the detection result can be output in real time. The detection result can be the detection area at each collection time point in the surveillance video. number of people inside. The deep learning algorithm may output detection results periodically, for example, the deep learning algorithm may output detection results every second, or may output detection results every two seconds, and so on. For example, the detection result may be: the number of people in the detection area at 08:10:00 (the collection time point) is 50; the number of people in the detection area at 08:10:01 is 54, and so on.
进而可以统计预设时间段内不同采集时间点的目标对象的个数,比如,预设时间段为08时10分00秒至08时11分00秒,将预设时间点内的每秒时间点作为一次采集时间点,即可以统计08时10分00秒(采集时间点1)的目标对象的个数、08时10分01秒(采集时间点2)的目标对象的个数、…、08时10分59秒(采集时间点60)的目标对象的个数等。Then, the number of target objects at different collection time points in the preset time period can be counted. For example, the preset time period is from 08:10:00 to 08:11:00. Point as a collection time point, that is, the number of target objects at 08:10:00 (collection time point 1), the number of target objects at 08:10:01 (collection time point 2), …, The number of target objects at 08:10:59 (collection time point 60), etc.
上述方法中,在监测事件为过密事件时,可以统计预设时间段内不同采集时间点的所述目标对象的个数,为后续确定过密事件对应的人流状态数据提供了数据支持。In the above method, when the monitoring event is an over-density event, the number of the target objects at different collection time points within a preset time period can be counted, which provides data support for the subsequent determination of the crowd flow state data corresponding to the over-density event.
一种可选实施方式中,在监控点位为一个的情况下,基于预设时间段内与监测事件匹配的人数监测数据,确定至少一个监控设备的人流状态数据,包括:基于预设时间段内不同采集时间点的目标对象的个数,确定监控点位对应的监测区域在预设时间段内的平均人数。In an optional embodiment, in the case that there is one monitoring point, based on the number of people monitoring data that matches the monitoring event within a preset time period, determining the crowd flow status data of at least one monitoring device includes: based on the preset time period. The number of target objects at different collection time points in the system is used to determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period.
在确定至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:在确定监控点位对应的监测区域在预设时间段内的平均人数大于设置的第一人数阈值的情况下,生成人流状态告警信息。When it is determined that the crowd flow state data of at least one monitoring device satisfies the alarm condition, generating crowd flow state alarm information, including: determining that the average number of people in the monitoring area corresponding to the monitoring point within a preset time period is greater than the set first number of people threshold In the case of the traffic flow status alarm information.
这里,可以将预设时间段内不同采集时间点的目标对象的个数求平均,得到监控点位对应的监测区域在预设时间段内的平均人数。并将该预设时间段内的平均人数进行监测,在该平均人数大于设置的第一人数阈值时,生成人流状态告警信息。其中,预设时间段的长度可以根据需要进行设置,比如,预设时间段的长度可以为5秒、10秒、60秒、5分钟等。跨线事件对应的预设时间段与过密事件对应的预设时间段的长度可以相同,也可以不同。Here, the number of target objects at different collection time points within the preset time period can be averaged to obtain the average number of people in the monitoring area corresponding to the monitoring point within the preset time period. The average number of people in the preset time period is monitored, and when the average number of people is greater than the set first number of people threshold, alarm information about the flow of people is generated. The length of the preset time period may be set as required, for example, the length of the preset time period may be 5 seconds, 10 seconds, 60 seconds, 5 minutes, and the like. The length of the preset time period corresponding to the cross-line event and the preset time period corresponding to the overcrowding event may be the same or different.
比如,预设时间段内不同采集时间点的所述目标对象的个数包括:08时10分01秒时目标对象的个数为50、08时10分02秒时目标对象的个数为53、08时10分03秒时目标对象的个数为52、08时10分04秒时目标对象的个数为51、08时10分05秒时目标对象的个数为54,则可以将5次检测结果取平均值,得到平均值为52,确定08时10分01秒至08时10分05秒内,监控点位对应的监测区域的平均人数为52。For example, the number of the target objects at different collection time points in the preset time period includes: the number of target objects at 08:10:01 is 50, and the number of target objects at 08:10:02 is 53 , the number of target objects at 08:10:03 is 52, the number of target objects at 08:10:04 is 51, and the number of target objects at 08:10:05 is 54, then 5 The average of the detection results was taken, and the average was 52. It was determined that the average number of people in the monitoring area corresponding to the monitoring point within 08:10:01 to 08:10:05 was 52.
进而,可以对该监控点位对应的监测区域在预设时间段内的平均人数进行监测,在该平均人数大于设置的第一人数阈值时,生成人流状态告警信息。比如,生成的人流状态告警信息可以为“注意,当前时间xx区域人数较多”。这种情况下,人流状态告警信息的告警事件类型为:点位过密告警。Furthermore, the average number of people in the monitoring area corresponding to the monitoring point within a preset time period can be monitored, and when the average number of people is greater than the set first number of people threshold, alarm information about the flow of people is generated. For example, the generated crowd status alarm information may be "Attention, there are many people in the xx area at the current time". In this case, the alarm event type of the crowd flow status alarm information is: point overload alarm.
进一步的,可以在触发生成的人流状态告警信息之后,可以显示该人流状态告警的详细信息,详细信息包括但不限于告警点位(即告警的监控设备的名称等)、告警时间、告警事件类型,在告警事件类型为点位过密告警时,详细信息还可以包括:当前时间点的检测区域内的实时人数。Further, after triggering the generated crowd state alarm information, the detailed information of the crowd state alarm can be displayed, and the detailed information includes but is not limited to the alarm point (namely, the name of the alarm monitoring device, etc.), the alarm time, and the type of the alarm event. , and when the alarm event type is an alarm of over-density of points, the detailed information may further include: the real-time number of people in the detection area at the current time point.
参见图5所示的一种展示人流状态告警的详细信息的界面示意图,该图中包括告警详情、当天过密事件时段统计,告警详情包括告警点位、事件类型、告警时间、过密时长、人数峰值、密度峰值等,当前过密事件时段统计包括从当天的零点至统计的当前时间之间的过密事件告警。该图中还包括视频画面截图,以及在视频画面截图下方显示有多帧告警图片,其中,告警图片的数量与过密事件的持续时长相关,比如,过密事件的持续时长为17分钟时,可以每间隔一分钟提取一帧告警图片,作为告警记录,即可以在视频画面截图下方显示17帧告警图片。Refer to Figure 5 for a schematic diagram of an interface displaying detailed information of a crowd flow state alarm. The figure includes the alarm details, the statistics of the day's overcrowded event period, and the alarm details include the alarm point, event type, alarm time, overcrowding duration, Peak number of people, peak density, etc. The statistics of the current over-density event period include over-density event alarms from zero o'clock of the day to the current time of the statistics. The figure also includes a screenshot of the video screen, and multiple frames of alarm pictures are displayed below the screenshot of the video screen. The number of alarm pictures is related to the duration of the over-density event. For example, when the duration of the over-density event is 17 minutes, A frame of alarm pictures can be extracted every one minute as an alarm record, that is, 17 frames of alarm pictures can be displayed below the screenshot of the video screen.
在具体实施时,还可以将监控设备的名称、安装位置、采集的监控视频等点位信息、以及该监控设备每分钟内的实时人数、实时人数的最大值、实时人数的最小值等信息持久化关联存储在搜索服务器(比如,elasticsearch)中,以便后续搜索查询。In the specific implementation, the name of the monitoring device, the installation location, the point information such as the collected monitoring video, and the real-time number of people per minute, the maximum number of real-time people, the minimum number of real-time people and other information can also be persisted. The associations are stored in a search server (e.g., elasticsearch) for subsequent search queries.
上述方法中,在监控点位为一个时,基于预设时间段内不同采集时间点的目标对象的个数,确定监控点位对应的监测区域在预设时间段内的平均人数;并在监控点位对应的监测区域在预设时间段内的平均人数大于设置的第一人数阈值的情况下,生成人流状态告警信息,实现了对该监控视频的检测区域中的平均人数的监控,以便基于生成的人流状态告警信息对检测区域进行人流疏导,避免检测区域内的人员较为密集时,造成的安全事故的发生。In the above method, when there is one monitoring point, the average number of people in the monitoring area corresponding to the monitoring point within the preset time period is determined based on the number of target objects at different collection time points within the preset time period; When the average number of people in the monitoring area corresponding to the point in the preset time period is greater than the set first number of people threshold, the alarm information of the flow of people is generated, and the monitoring of the average number of people in the detection area of the monitoring video is realized, so that based on the The generated crowd flow status alarm information diverts the flow of people in the detection area, so as to avoid the occurrence of safety accidents when the people in the detection area are crowded.
一种可选实施方式中,在监控点位为多个的情况下,基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据,包括:In an optional embodiment, in the case of multiple monitoring points, based on the number of people monitoring data that matches the monitoring event within a preset time period, determining the crowd flow status data of the at least one monitoring device, including:
步骤一、针对每个监控点位,基于预设时间段内不同采集时间点的所述目标对象的个数,确定所述监控点位对应的监测区域在所述预设时间段内的平均人数。Step 1: For each monitoring point, determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period based on the number of the target objects at different collection time points within the preset time period. .
步骤二、基于多个所述监控点位分别对应的所述平均人数,确定目标监控区域中的总实时人数。Step 2: Determine the total real-time number of people in the target monitoring area based on the average number of people corresponding to the plurality of monitoring points respectively.
在确定至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息,包括:在确定目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息。When it is determined that the people flow state data of at least one monitoring device satisfies the alarm condition, generating the people flow state alarm information includes: when it is determined that the total real-time number of people in the target monitoring area is greater than the set second number of people threshold, generating the people flow state alarm information.
这里,针对每个监控点位,可以基于预设时间段内不同采集时间点的目标对象的个数,确定该监控点位对应的监测区域在预设时间段内的平均人数;再可以将多个监控点位分别对应的平均人数相加,确定目标监控区域中的总实时人数。Here, for each monitoring point, the average number of people in the monitoring area corresponding to the monitoring point within the preset time period can be determined based on the number of target objects at different collection time points within the preset time period; The average number of people corresponding to each monitoring point is added to determine the total real-time number of people in the target monitoring area.
在确定了目标监控区域中的总实时人数之后,可以对该总实时人数进行监测,在确定目标监控区域中的总实时人数大于设置的第二人数阈值时,生成人流状态告警信息。After the total real-time number of people in the target monitoring area is determined, the total real-time number of people can be monitored, and when it is determined that the total real-time number of people in the target monitoring area is greater than the set second threshold for the number of people, the traffic state alarm information is generated.
在具体实施时,可以通过触发展示界面上设置的视频组对应的过密事件的开启按钮,开启视频组内每个监控视频的人流过密分析功能。同时,还可以在展示界面上设置实时总人数分级预警的具体信息,比如,填写一般风险对应的一级预警人数、较大风险对应的二级预警人数、和重大风险对应的三级预警人数。During specific implementation, the function of analyzing the overcrowded traffic of each surveillance video in the video group can be enabled by triggering the open button of the overcrowded event corresponding to the video group set on the display interface. At the same time, you can also set the specific information of the real-time total number of people in the early warning on the display interface, for example, fill in the number of people in the first-level early warning corresponding to general risks, the number of people in the second-level early warning corresponding to larger risks, and the number of people in the third-level early warning corresponding to major risks.
这里,在监控设备包括多个时,多个监控设备分别采集的监控视频构成了视频组。针对每个监控设备采集的监控视频(即针对视频组内的每个监控视频),可以利用训练好的用于识别目标对象的深度学习算法,对监控视频中监测标识指示的检测区域进行检测,实时的输出检测结果,检测结果可以为监控视频中采集时间点的检测区域内目标对象的个数。进一步的,可以基于周期性得到的检测结果,确定监控点位对应的监测区域在预设时间段内的平均人数。Here, when there are multiple monitoring devices, the monitoring videos respectively collected by the multiple monitoring devices constitute a video group. For the monitoring video collected by each monitoring device (that is, for each monitoring video in the video group), the trained deep learning algorithm for identifying the target object can be used to detect the detection area indicated by the monitoring mark in the monitoring video, The detection result is output in real time, and the detection result can be the number of target objects in the detection area at the collection time point in the surveillance video. Further, the average number of people in the monitoring area corresponding to the monitoring point within the preset time period may be determined based on the periodically obtained detection results.
在得到视频组内每个监控视频对应的平均人数之后,可以将视频组内包括的各个监控视频对应的平均人数相加,确定目标监控区域中的总实时人数。进而可以对目标监控区域中的总实时人数进行监测,在目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息。比如,生成的人流状态告警信息可以为“注意,当前时间xx场景总人数较多”。这种情况下,人流状态告警信息的告警事件类型为:视频组过密告警。After obtaining the average number of people corresponding to each surveillance video in the video group, the average number of people corresponding to each surveillance video included in the video group can be added to determine the total real-time number of people in the target surveillance area. Further, the total real-time number of people in the target monitoring area can be monitored, and when the total real-time number of people in the target monitoring area is greater than the set second threshold of the number of people, alarm information on the flow of people is generated. For example, the generated crowd status alarm information may be "Attention, there are many people in the scene xx at the current time". In this case, the alarm event type of the crowd flow state alarm information is: video group overcrowded alarm.
具体实施时,针对视频组过密告警,可以设置多级告警风险,比如,多级告警风险包括:一级风险、较大风险、重大风险,针对不同的告警风险设置不同的第二人数阈值,例如,一级风险对应的第二人数阈值可以为100,二级风险对应的第二人数阈值可以为200,重大风险对应的第二人数阈值可以为500。针对不同的告警风险,可以设置不同的人流状态告警信息。比如,一级风险对应的人流状态告警信息可以为:文字格式的告警信息;二级风险对应的人流状态告警信息可以为:语音格式的告警信息;三级风险对应的人流状态告警信息可以为:视频格式的告警信息。During specific implementation, multi-level alarm risks can be set for the over-density alarm of video groups. For example, multi-level alarm risks include: first-level risk, major risk, and major risk. For example, the second population threshold corresponding to the first-level risk may be 100, the second population threshold corresponding to the second-level risk may be 200, and the second population threshold corresponding to the major risk may be 500. For different alarm risks, you can set different alarm information about the flow of people. For example, the warning information of the people flow state corresponding to the first-level risk may be: the warning information of text format; the warning information of the people flow state corresponding to the second-level risk may be: the warning information of the people flow state; the warning information of the people flow state corresponding to the third-level risk may be: Alarm information in video format.
进一步的,可以在触发生成的人流状态告警信息之后,可以显示该人流状态告警的详细信息,详细信息包括但不限于告警点位(即告警的监控设备的名称等)、告警时间、告警事件类型,在告警事件类型为视频组过密告警时,详细信息还可以包括:现实场景的总实时人数。Further, after triggering the generated crowd state alarm information, the detailed information of the crowd state alarm can be displayed, and the detailed information includes but is not limited to the alarm point (namely, the name of the alarm monitoring device, etc.), the alarm time, and the type of the alarm event. , when the alarm event type is a video group over-density alarm, the detailed information may further include: the total real-time number of people in the real scene.
参见图6a所示的一种展示人流状态告警的详细信息的界面示意图,图6a中以地图模式展示了人流状态告警的详细信息;以及参见图4b所示的另一种展示人流状态告警的详细信息的界面示意图,图4b中以列表模式展示了人流状态告警的详细信息,其中,图4b中展示的列表中包括过密事件和越线事件。具体的,在触发图6a中显示的过密事件的信息之后,或者,在触发图4b中显示的过密事件的信息之后,可以展示图6b中显示的告警详情,图6b中显示的告警详情包括分组名称(即视频组对应的名称)、事件类型、告警时间、持续时长、人数峰值、密度峰值、当天实时总人数统计、视频源统计。Referring to a schematic diagram of an interface showing the detailed information of the people flow state alarm shown in FIG. 6a, the detailed information of the people flow state alarm is shown in a map mode in FIG. 6a; A schematic diagram of the interface of the information, Fig. 4b shows the detailed information of the crowd flow state alarm in a list mode, wherein the list shown in Fig. 4b includes over-density events and line crossing events. Specifically, after triggering the information of the overcrowded event shown in FIG. 6a, or after triggering the information of the overcrowding event shown in FIG. 4b, the alarm details shown in FIG. 6b can be displayed, and the alarm details shown in FIG. 6b can be displayed. Including group name (namely the name corresponding to the video group), event type, alarm time, duration, peak number of people, peak density, real-time total number of people statistics on the day, and video source statistics.
这里,在基于至少一个监控设备采集的监控视频,以及预先绘制的与视频画面中的目标位置匹配的监测标识,确定现实场景中的人流状态数据之后,还可以生成人流状态数据随着时间的变化示意图,以便对当天的人流状态数据进行直观展示。具体的,人流状态数据随时间的变化示意图包括实时总人数随时间的第一变化示意图,第一变化示意图中包括人数峰值随时间的变化关系、和人数谷值随时间的变化关系;和/或,人流总存量随时间的第二变化示意图;第二变化示意图中包括出总人流随时间的变化关系、入总人流随时间的变化关系、和人流总存量随时间的变化关系。其中,第一变化图、第二变化图设置的时间间隔可以为5分钟、10分钟、30分钟、1小时等。Here, after determining the people flow state data in the real scene based on the monitoring video collected by at least one monitoring device and the pre-drawn monitoring identification that matches the target position in the video screen, the change of the people flow state data over time can also be generated. Schematic diagram to visually display the current state of people flow data. Specifically, the schematic diagram of the change of the people flow state data over time includes a first schematic diagram of the real-time total number of people changing with time, and the first schematic diagram of the change includes the relationship between the peak number of people and the time change relationship of the valley value of the number of people; and/or , the second change diagram of the total stock of people flow with time; the second change diagram includes the change relationship of the total flow of people with time, the change relationship of the total flow of people with time, and the change relationship of the total stock of people flow with time. The time interval set by the first change graph and the second change graph may be 5 minutes, 10 minutes, 30 minutes, 1 hour, and the like.
上述方法中,在确定了每个监控点位对应的监测区域在预设时间段内的平均人数之后,可以基于多个所述监控点位分别对应的平均人数,确定目标监控区域中的总实时人数;并在确定目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息,实现了对目标监控区域中的总实时人数的预警,以便在总实时人数较多时,基于生成的人流状态告警信息对目标监控区域中的人员进行疏导,避免目标监控区域中总实时人数较多时造成安全事故的发生。In the above method, after determining the average number of people in the monitoring area corresponding to each monitoring point within the preset time period, the total real-time number in the target monitoring area can be determined based on the average number of people corresponding to a plurality of the monitoring points respectively. and when it is determined that the total real-time number of people in the target monitoring area is greater than the set second threshold of the number of people, the alarm information of the flow of people is generated, which realizes the early warning of the total real-time number of people in the target monitoring area, so that the total real-time number of people in the target monitoring area is relatively For a long time, based on the generated crowd flow state alarm information, the personnel in the target monitoring area are dredged, so as to avoid the occurrence of security accidents when the total real-time number of people in the target monitoring area is large.
一种可选实施方式,所述方法还包括:将最近多个历史日期内同一采集时间点的人流状态数据求平均,得到每个采集时间点对应的预测人流状态数据;各个采集时间点分别对应的预测人流状态数据,构成人流状态数据在未来日期内的预测数据;其中,预测数据用于生成人流疏导计划。In an optional implementation manner, the method further includes: averaging the crowd flow state data at the same collection time point in multiple recent historical dates to obtain predicted crowd flow state data corresponding to each collection time point; each collection time point corresponds to The predicted crowd flow state data constitutes the predicted data of the crowd flow state data in the future date; wherein, the predicted data is used to generate the crowd flow diversion plan.
这里,多个历史周期可以根据需要进行设置,比如,多个历史周期可以为最近7天(一个历史周期对应一天)内的人流状态数据,即在10月8日00点00分时,可以获取10月1日至10月7日(7个历史周期)的人流状态数据,将最近7个历史日期内同一采集时间点的人流状态数据求平均,得到每个采集时间点对应的预测人流状态数据;各个采集时间点分别对应的预测人流状态数据,构成人流状态数据在未来日期内的预测数据。Here, multiple historical periods can be set as required. For example, multiple historical periods can be the data on the flow of people in the last 7 days (one historical period corresponds to one day), that is, at 00:00 on October 8, it can be obtained From October 1st to October 7th (7 historical periods), the crowd flow status data at the same collection time point in the last 7 historical dates are averaged to obtain the predicted crowd flow status data corresponding to each collection time point. ; The predicted people flow state data corresponding to each collection time point respectively constitutes the prediction data of the people flow state data in the future date.
比如,生成总进人流数量在未来日期(未来一天)内的预测数据、生成总出人流数量在未来日期(未来一天)内的预测数据、和生成人员净存量在未来日期(未来一天)内的预测数据。For example, generate the forecast data of the total number of inflows in the future date (one day in the future), generate the forecast data of the total number of outgoing people in the future date (one day in the future), and generate the forecast data of the net stock of people in the future date (one day in the future) forecast data.
进而可以基于人流状态数据在未来日期内的预测数据,生成人流疏导计划,比如,若在预测数据中可知,15点时总实时人数最多,则可以在15点时控制进入目标监控区域的人流数量。Then, based on the forecast data of the people flow status data in the future date, a people flow diversion plan can be generated. For example, if it is known from the forecast data that the total number of people in real time is the largest at 15:00, the number of people entering the target monitoring area can be controlled at 15:00. .
在实际的应用场景中,该方法可以应用于商场、大厅等场景中。下述以商场为例分别对一个监控视频的越线事件和视频组的越线事件进行说明,假设商场有两个门,则可以在每个门口位置处(监控点位)设置一个监控设备,即监控设备一(监控点位一处设置的监控设备一)采集大门A的监控视频,监控设备二(监控点位二处设置的监控设备二)采集大门B的监控视频,该监控设备一、监控设备二可以对该进出该门的行人进行监测。In practical application scenarios, the method can be applied to shopping malls, halls and other scenarios. The following takes a shopping mall as an example to illustrate the line crossing event of a surveillance video and the line crossing event of a video group. Assuming that the shopping mall has two doors, you can set up a monitoring device at each door position (monitoring point). That is, monitoring equipment 1 (monitoring equipment 1 set up at one monitoring point) collects the surveillance video of gate A, and monitoring equipment 2 (
具体实施时,可以获取监控设备一采集的监控视频一,以及获取监控设备二采集的监控视频二。针对监控视频一,在监控视频一的视频画面截图上绘制进出界线和进出方向,确定监控视频一中监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量;进而在预设时间段内的总进人流数量大于设置的第一人流阈值,和/或预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息。以及针对监控视频二,在监控视频二的视频画面截图上设置进出界线和进出方向,确定监控视频二中监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量。进而在预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息。During specific implementation, the first monitoring video collected by the first monitoring device and the second monitoring video collected by the second monitoring device may be obtained. For surveillance video 1, draw the entry and exit boundaries and entry and exit directions on the screenshots of surveillance video 1, and determine the total number of people entering and exiting within the preset time period in the monitoring area corresponding to the monitoring point in surveillance video 1; Further, when the total number of people entering the preset time period is greater than the set first threshold, and/or the total number of exiting people within the preset time period is greater than the second set threshold, the traffic state alarm information is generated. And for
同时,监控视频一和监控视频二构成了视频组,可以对视频组进行分析,确定监控设备一和监控设备二对应的目标监控区域中的人流状态数据。具体实施时,针对监控视频一,确定监控点位一对应的监测区域中预设时间段内的总进人流数量和总出人流数量;针对监控视频二,确定监控点位二对应的监测区域中预设时间段内的总进人流数量和总出人流数量。进而,基于预设时间段内目标监控区域的历史人数,以及多个监控点位分别对应的预设时间段内的总进人流数量和总出人流数量,确定目标监控区域内的人员净存量。即确定了该商场内的人员净存量。在人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息,以便在接收到人流状态告警信息之后,可以对商场中的行人进行调控,避免拥堵事件的发生。At the same time, surveillance video 1 and
下述以大厅为例分别对一个监控视频的过密事件和视频组的过密事件进行说明。假设在大厅的四个角落(四个监控点位)分别设置有监控设备,即在四个监控设备对大厅的四个检测区域进行检测,四个监控设备中各个监控设备采集的监控视频构成了视频组。The following takes the lobby as an example to describe the over-densification event of a surveillance video and the over-densification event of a video group respectively. Assuming that monitoring devices are installed in the four corners (four monitoring points) of the hall, that is, the four monitoring devices detect the four detection areas of the hall, and the monitoring videos collected by each monitoring device in the four monitoring devices constitute a video group.
具体实施时,针对视频组中的每个监控视频,基于预设时间段内不同采集时间点的目标对象的个数,确定监控点位对应的监测区域在预设时间段内的平均人数,在该监控视频对应的平均人数大于设置的第一人数阈值时,生成该监控视频对应的人流状态告警信息。即实现了针对视频组中每个监控视频的过密事件监测。During specific implementation, for each monitoring video in the video group, based on the number of target objects at different collection time points within the preset time period, determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period, When the average number of people corresponding to the surveillance video is greater than the set first threshold of the number of people, alarm information of the crowd flow state corresponding to the surveillance video is generated. That is, the monitoring of over-density events for each surveillance video in the video group is realized.
同时,可以在视频画面截图上绘制监测标识,即监测标识对应的区域为检测区域;也可以不在视频画面截图上绘制监测标识,即监控视频不存在对应的基准面标识,此时,默认整个视频画面均为检测区域。At the same time, the monitoring logo can be drawn on the video screenshot, that is, the area corresponding to the monitoring logo is the detection area; or the monitoring logo can not be drawn on the video screenshot, that is, the monitoring video does not have a corresponding datum plane logo. In this case, the entire video is defaulted to The screen is the detection area.
同时,可以对视频组进行过密事件监测,确定视频组对应的目标监控区域中的总实时人数。具体实施时,针对视频组内的每个监控视频,确定监控点位对应的监测区域在预设时间段内的平均人数;并基于四个监控点位分别对应的平均人数,确定目标监控区域中的总实时人数。即确定了该大厅内的多个检测区域的总实时人数。在目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息,以便在接收到人流状态告警信息之后,可以对大厅中的密集区域进行疏导,避免人员密集造成的事故发生。At the same time, the video group can be monitored for over-density events, and the total real-time number of people in the target monitoring area corresponding to the video group can be determined. During specific implementation, for each monitoring video in the video group, determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period; and based on the average number of people corresponding to the four monitoring points, determine the target monitoring area. total real-time headcount. That is, the total real-time number of people in multiple detection areas in the hall is determined. When the total real-time number of people in the target monitoring area is greater than the set second threshold for the number of people, the crowd flow status alarm information is generated, so that after receiving the crowd flow status alarm information, the crowded areas in the hall can be dredged to avoid crowding caused by crowding. accident occurred.
本领域技术人员可以理解,在具体实施方式的上述方法中,各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定,各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。Those skilled in the art can understand that in the above method of the specific implementation, the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.
基于相同的构思,本公开实施例还提供了一种场景监测装置,参见图7所示,为本公开实施例提供的场景监测装置的架构示意图,包括第一获取模块701、检测模块702、第二获取模块703、确定模块704,具体的:Based on the same concept, an embodiment of the present disclosure also provides a scene monitoring apparatus. Referring to FIG. 7 , a schematic diagram of the architecture of the scene monitoring apparatus provided by the embodiment of the present disclosure includes a
第一获取模块701,用于获取设置于至少一个监控点位的监控设备采集的监控视频;A
检测模块702,用于基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件;A
第二获取模块703,用于在所述至少一个监控点位对应的监测区域发生监测事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据;A second obtaining
确定模块704,用于基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据。A
一种可能的实施方式中,在确定所述至少一个监控设备的人流状态数据之后,还包括:告警模块705,用于:In a possible implementation manner, after determining the crowd flow state data of the at least one monitoring device, the method further includes: an
在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息。When it is determined that the crowd flow state data of the at least one monitoring device satisfies the alarm condition, the crowd flow state alarm information is generated.
一种可能的实施方式中,在所述监测事件为跨线事件的情况下,所述检测模块702,在基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件时,用于:In a possible implementation manner, in the case where the monitoring event is a cross-line event, the
基于所述监控视频确定所述至少一个监控点位对应的监测区域内,是否存在跨越与预先绘制的进出界线匹配的目标位置的目标对象;Determine, based on the surveillance video, whether there is a target object spanning a target position matching a pre-drawn entry and exit boundary in the monitoring area corresponding to the at least one monitoring point;
若存在,则确定所述至少一个监控点位对应的监测区域发生跨线事件。If there is, it is determined that a cross-line event occurs in the monitoring area corresponding to the at least one monitoring point.
一种可能的实施方式中,在所述监测事件为跨线事件的情况下,所述第二获取模块703,在获取预设时间段内与所述监测事件匹配的人数监测数据时,用于:In a possible implementation, in the case that the monitoring event is a cross-line event, the
获取预设时间段内不同采集时间点的进人流数量和出人流数量,其中,所述不同采集时间点的进人流数量是指在不同采集时间点,沿预先绘制的进方向跨越预先绘制的进出界线的人数;所述不同采集时间点的出人流数量是指在不同采集时间点,沿预先绘制的出方向跨越预先绘制的进出界线的人数。Obtain the number of incoming and outgoing traffic at different collection time points within a preset time period, wherein the number of incoming and outgoing traffic at different collection time points refers to crossing the pre-drawn incoming and outgoing directions along the pre-drawn incoming direction at different collection time points. The number of people in the boundary line; the number of people leaving the boundary at different collection time points refers to the number of people who cross the pre-drawn in-out boundary line along the pre-drawn out direction at different collection time points.
一种可能的实施方式中,在所述监控点位为一个的情况下,所述确定模块704,在基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据时,用于:In a possible implementation, in the case that the monitoring point is one, the determining
基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量;Based on the number of inflows and outflows at different collection time points within the preset time period, determining the total number of inflows and the total number of outflows within the preset time period in the monitoring area corresponding to the monitoring point;
所述告警模块705,在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息时,用于:The
在确定所述预设时间段内的总进人流数量大于设置的第一人流阈值,和/或在确定所述预设时间段内的总出人流数量大于设置的第二人流阈值的情况下,生成人流状态告警信息。In the case where it is determined that the total number of people entering the preset time period is greater than the set first threshold of people flow, and/or in the case of determining that the total number of people leaving the flow within the preset time period is greater than the second set threshold of people flow, Generates crowd flow status alarm information.
一种可能的实施方式中,在所述监控点位为一个的情况下,所述确定模块704,在基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据时,用于:In a possible implementation, in the case that the monitoring point is one, the determining
基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中的进人流速度和出人流速度。Based on the number of inflows and outflows at different collection time points within a preset time period, the inflow speed and the outflow speed in the monitoring area corresponding to the monitoring point are determined.
一种可能的实施方式中,在所述监控点位为多个的情况下,所述确定模块704,在基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据时,用于:In a possible implementation, when there are multiple monitoring points, the determining
针对每个所述监控点位,基于预设时间段内不同采集时间点的进人流数量和出人流数量,确定所述监控点位对应的监测区域中预设时间段内的总进人流数量和总出人流数量;For each of the monitoring points, based on the number of inflows and the number of outflows at different collection time points within the preset time period, determine the total number of inflows and the number of inflows in the preset time period in the monitoring area corresponding to the monitoring point and the The total number of people leaving;
基于所述预设时间段内目标监控区域的历史人数,以及多个所述监控点位分别对应的所述预设时间段内的总进人流数量和总出人流数量,确定所述目标监控区域内的人员净存量;The target monitoring area is determined based on the historical number of people in the target monitoring area within the preset time period, and the total number of incoming and outgoing people in the preset time period corresponding to a plurality of the monitoring points respectively the net stock of personnel in
所述告警模块705,在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息时,用于:The
在确定所述目标监控区域内的人员净存量大于设置的净存量阈值的情况下,生成人流状态告警信息。When it is determined that the net stock of people in the target monitoring area is greater than the set net stock threshold, alarm information about the flow of people is generated.
一种可能的实施方式中,在所述监测事件为过密事件的情况下,所述检测模块702,在基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件时,用于:In a possible implementation manner, in the case that the monitoring event is an over-density event, the
基于所述监控视频,确定所述至少一个监控点位对应的监测区域内的目标对象个数是否超过过密阈值;Based on the monitoring video, determine whether the number of target objects in the monitoring area corresponding to the at least one monitoring point exceeds an excessive density threshold;
若是,则确定所述至少一个监控点位对应的监测区域发生过密事件。If yes, it is determined that an over-density event occurs in the monitoring area corresponding to the at least one monitoring point.
一种可能的实施方式中,在所述监测事件为过密事件的情况下,所述第二获取模块703,在获取预设时间段内与所述监测事件匹配的人数监测数据时,用于:In a possible implementation manner, when the monitoring event is an overcrowded event, the
统计预设时间段内不同采集时间点的所述目标对象的个数。The number of the target objects at different collection time points within a preset time period is counted.
一种可能的实施方式中,在所述监控点位为一个的情况下,所述确定模块704,在基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据时,用于:In a possible implementation, in the case that the monitoring point is one, the determining
基于预设时间段内不同采集时间点的所述目标对象的个数,确定所述监控点位对应的监测区域在所述预设时间段内的平均人数;Determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period based on the number of the target objects at different collection time points within the preset time period;
所述告警模块705,在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息时,用于:The
在确定所述监控点位对应的监测区域在所述预设时间段内的平均人数大于设置的第一人数阈值的情况下,生成人流状态告警信息。In a case where it is determined that the average number of people in the monitoring area corresponding to the monitoring point within the preset time period is greater than the set first number of people threshold, alarm information about the flow of people is generated.
一种可能的实施方式中,在所述监控点位为多个的情况下,所述确定模块704,在基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据时,用于:In a possible implementation, when there are multiple monitoring points, the determining
针对每个所述监控点位,基于预设时间段内不同采集时间点的所述目标对象的个数,确定所述监控点位对应的监测区域在所述预设时间段内的平均人数;For each monitoring point, determine the average number of people in the monitoring area corresponding to the monitoring point within the preset time period based on the number of the target objects at different collection time points within the preset time period;
基于多个所述监控点位分别对应的所述平均人数,确定目标监控区域中的总实时人数;Determine the total real-time number of people in the target monitoring area based on the average number of people corresponding to a plurality of the monitoring points respectively;
所述告警模块705,在确定所述至少一个监控设备的人流状态数据满足告警条件的情况下,生成人流状态告警信息时,用于:The
在确定所述目标监控区域中的总实时人数大于设置的第二人数阈值的情况下,生成人流状态告警信息。In a case where it is determined that the total real-time number of people in the target monitoring area is greater than the set second threshold of the number of people, alarm information about the flow of people is generated.
一种可能的实施方式中,所述装置还包括:预警模块706,用于:In a possible implementation manner, the device further includes: an
将最近多个历史日期内同一采集时间点的人流状态数据求平均,得到每个采集时间点对应的预测人流状态数据;Average the crowd flow status data at the same collection time point in recent multiple historical dates to obtain the predicted crowd flow status data corresponding to each collection time point;
各个采集时间点分别对应的预测人流状态数据,构成人流状态数据在未来日期内的预测数据;其中,所述预测数据用于生成人流疏导计划。The predicted crowd flow state data corresponding to each collection time point respectively constitutes prediction data of the crowd flow state data in a future date; wherein, the predicted data is used to generate a crowd flow diversion plan.
在一些实施例中,本公开实施例提供的装置具有的功能或包含的模板可以用于执行上文方法实施例描述的方法,其具体实现可以参照上文方法实施例的描述,为了简洁,这里不再赘述。In some embodiments, the functions or templates included in the apparatus provided by the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments. For specific implementation, reference may be made to the above method embodiments. For brevity, here No longer.
基于同一技术构思,本公开实施例还提供了一种电子设备。参照图8所示,为本公开实施例提供的电子设备的结构示意图,包括处理器801、存储器802、和总线803。其中,存储器802用于存储执行指令,包括内存8021和外部存储器8022;这里的内存8021也称内存储器,用于暂时存放处理器801中的运算数据,以及与硬盘等外部存储器8022交换的数据,处理器801通过内存8021与外部存储器8022进行数据交换,当电子设备800运行时,处理器801与存储器802之间通过总线803通信,使得处理器801在执行以下指令:Based on the same technical concept, an embodiment of the present disclosure also provides an electronic device. Referring to FIG. 8 , a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure includes a processor 801 , a memory 802 , and a bus 803 . Among them, the memory 802 is used to store the execution instructions, including the memory 8021 and the external memory 8022; the memory 8021 here is also called the internal memory, and is used to temporarily store the operation data in the processor 801 and the data exchanged with the external memory 8022 such as the hard disk, The processor 801 exchanges data with the external memory 8022 through the memory 8021. When the electronic device 800 is running, the processor 801 communicates with the memory 802 through the bus 803, so that the processor 801 executes the following instructions:
获取设置于至少一个监控点位的监控设备采集的监控视频;Obtain the surveillance video collected by the surveillance equipment set at at least one surveillance point;
基于所述监控视频确定所述至少一个监控点位对应的监测区域是否发生监测事件;Determine whether a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point based on the monitoring video;
在所述至少一个监控点位对应的监测区域发生监测事件的情况下,获取预设时间段内与所述监测事件匹配的人数监测数据;In the case that a monitoring event occurs in the monitoring area corresponding to the at least one monitoring point, obtain the monitoring data of the number of people matching the monitoring event within a preset time period;
基于预设时间段内与所述监测事件匹配的人数监测数据,确定所述至少一个监控设备的人流状态数据。The crowd flow state data of the at least one monitoring device is determined based on the number of people monitoring data matching the monitoring event within a preset time period.
此外,本公开实施例还提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该计算机程序被处理器运行时执行上述方法实施例中所述的场景监测方法的步骤。In addition, an embodiment of the present disclosure further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of the scene monitoring method described in the foregoing method embodiments are executed. .
本公开实施例所提供的场景监测方法的计算机程序产品,包括存储了程序代码的计算机可读存储介质,所述程序代码包括的指令可用于执行上述方法实施例中所述的场景监测方法的步骤,具体可参见上述方法实施例,在此不再赘述。The computer program product of the scene monitoring method provided by the embodiment of the present disclosure includes a computer-readable storage medium storing program codes, and the program code includes instructions that can be used to execute the steps of the scene monitoring method described in the above method embodiments. , for details, refer to the foregoing method embodiments, which will not be repeated here.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统和装置的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。在本公开所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,又例如,多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些通信接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the system and device described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here. In the several embodiments provided by the present disclosure, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. The apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外,在本公开各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个处理器可执行的非易失的计算机可读取存储介质中。基于这样的理解,本公开的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本公开各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-OnlyMemory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The functions, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a processor-executable non-volatile computer-readable storage medium. Based on this understanding, the technical solutions of the present disclosure can be embodied in the form of software products in essence, or the parts that make contributions to the prior art or the parts of the technical solutions. The computer software products are stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present disclosure. The aforementioned storage medium includes: U disk, removable hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
以上仅为本公开的具体实施方式,但本公开的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本公开揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本公开的保护范围之内。因此,本公开的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical scope of the present disclosure can easily think of changes or substitutions, which should be covered within the scope of the present disclosure. within the scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011190695.6ACN112333431B (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| CN202210655667.XACN114900669A (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| PCT/CN2021/094699WO2022088653A1 (en) | 2020-10-30 | 2021-05-19 | Scene monitoring method and apparatus, electronic device, storage medium, and program |
| JP2021576933AJP7305808B2 (en) | 2020-10-30 | 2021-05-19 | On-site monitoring method and device, electronic device, storage medium and program |
| KR1020217042832AKR20220058859A (en) | 2020-10-30 | 2021-05-19 | Scenario monitoring methods, devices, electronic devices, storage media and programs |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011190695.6ACN112333431B (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210655667.XADivisionCN114900669A (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN112333431A CN112333431A (en) | 2021-02-05 |
| CN112333431Btrue CN112333431B (en) | 2022-06-07 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011190695.6AActiveCN112333431B (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| CN202210655667.XAPendingCN114900669A (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210655667.XAPendingCN114900669A (en) | 2020-10-30 | 2020-10-30 | Scene monitoring method and device, electronic equipment and storage medium |
| Country | Link |
|---|---|
| JP (1) | JP7305808B2 (en) |
| KR (1) | KR20220058859A (en) |
| CN (2) | CN112333431B (en) |
| WO (1) | WO2022088653A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112333431B (en)* | 2020-10-30 | 2022-06-07 | 深圳市商汤科技有限公司 | Scene monitoring method and device, electronic equipment and storage medium |
| CN113507588A (en)* | 2021-06-03 | 2021-10-15 | 山西三友和智慧信息技术股份有限公司 | Wisdom campus visitor flow monitoring system based on artificial intelligence |
| CN113536932A (en)* | 2021-06-16 | 2021-10-22 | 中科曙光国际信息产业有限公司 | Crowd gathering prediction method and device, computer equipment and storage medium |
| CN113762169A (en)* | 2021-09-09 | 2021-12-07 | 北京市商汤科技开发有限公司 | People flow counting method and device, electronic equipment and storage medium |
| CN113987252A (en)* | 2021-10-28 | 2022-01-28 | 杭州海康威视数字技术股份有限公司 | Image annotation method, device and electronic device |
| TWI796033B (en)* | 2021-12-07 | 2023-03-11 | 巨鷗科技股份有限公司 | People flow analysis and identification system |
| CN114724360A (en)* | 2022-03-14 | 2022-07-08 | 江上(上海)软件科技有限公司 | Application early warning system and early warning method based on smart city |
| CN114694285B (en)* | 2022-03-29 | 2023-09-01 | 重庆紫光华山智安科技有限公司 | People flow alarming method and device, electronic equipment and storage medium |
| CN115376036A (en)* | 2022-06-23 | 2022-11-22 | 兰州飞天网景信息产业有限公司 | Automatic power-off protection method, device and equipment for production equipment and storage medium |
| CN115471978A (en)* | 2022-08-18 | 2022-12-13 | 北京声智科技有限公司 | Swimming place monitoring method and device |
| CN116188357B (en)* | 2022-09-27 | 2024-07-19 | 珠海视熙科技有限公司 | Entrance and exit human body detection method, imaging equipment, device and storage medium |
| CN115474005A (en)* | 2022-10-28 | 2022-12-13 | 通号通信信息集团有限公司 | Data processing method, data processing device, electronic apparatus, and storage medium |
| CN115909667B (en)* | 2022-12-07 | 2024-05-17 | 宁波云弧科技有限公司 | A monitoring and alarm system for oil tank area |
| CN116012776B (en)* | 2022-12-09 | 2024-02-23 | 北京数原数字化城市研究中心 | Method and device for monitoring number of people, electronic equipment and readable storage medium |
| CN116824509A (en)* | 2023-07-20 | 2023-09-29 | 深圳康佳电子科技有限公司 | Calculation method and related equipment for average residence time of tourists in intelligent scenic spot |
| CN117395369B (en)* | 2023-10-11 | 2024-11-19 | 浪潮通用软件有限公司 | A method, device and medium for regional overcrowding control based on multi-source video fusion |
| CN117238092B (en)* | 2023-11-16 | 2024-01-30 | 建龙西林钢铁有限公司 | Industrial factory risk early warning method based on oblique photography and man-vehicle positioning |
| CN119150193B (en)* | 2024-09-18 | 2025-05-02 | 北京悦途出行网络科技有限公司 | Quick ticket gate people flow monitoring control system based on data analysis |
| CN120223849B (en)* | 2025-05-28 | 2025-08-15 | 北京中科金马科技股份有限公司 | Intelligent building video monitoring equipment automatic control system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106778688A (en)* | 2017-01-13 | 2017-05-31 | 辽宁工程技术大学 | The detection method of crowd's throat floater event in a kind of crowd scene monitor video |
| CN107133607A (en)* | 2017-05-27 | 2017-09-05 | 上海应用技术大学 | Demographics' method and system based on video monitoring |
| WO2018059408A1 (en)* | 2016-09-29 | 2018-04-05 | 北京市商汤科技开发有限公司 | Cross-line counting method, and neural network training method and apparatus, and electronic device |
| CN107911653A (en)* | 2017-11-16 | 2018-04-13 | 王磊 | The module of intelligent video monitoring in institute, system, method and storage medium |
| CN111274340A (en)* | 2020-01-15 | 2020-06-12 | 中国联合网络通信集团有限公司 | People flow density monitoring processing method, equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2007243342A (en)* | 2006-03-06 | 2007-09-20 | Yokogawa Electric Corp | Image monitoring apparatus and image monitoring system |
| CA2672511A1 (en)* | 2008-07-16 | 2010-01-16 | Verint Systems Inc. | A system and method for capturing, storing, analyzing and displaying data relating to the movements of objects |
| US9197861B2 (en)* | 2012-11-15 | 2015-11-24 | Avo Usa Holding 2 Corporation | Multi-dimensional virtual beam detection for video analytics |
| WO2014174737A1 (en) | 2013-04-26 | 2014-10-30 | 日本電気株式会社 | Monitoring device, monitoring method and monitoring program |
| CN104021570B (en)* | 2014-06-04 | 2016-11-09 | 电子科技大学 | A directional cross-border and line-mixing detection method in video |
| CN104239908A (en)* | 2014-07-28 | 2014-12-24 | 中国科学院自动化研究所 | Intelligent ridership automatic statistical method based on self-adaptive threshold value |
| US11019268B2 (en)* | 2015-03-27 | 2021-05-25 | Nec Corporation | Video surveillance system and video surveillance method |
| US9840166B2 (en)* | 2015-04-13 | 2017-12-12 | Verizon Patent And Licensing Inc. | Determining the number of people in a vehicle |
| CN105139425B (en)* | 2015-08-28 | 2018-12-07 | 浙江宇视科技有限公司 | A kind of demographic method and device |
| CN105447458B (en)* | 2015-11-17 | 2018-02-27 | 深圳市商汤科技有限公司 | A kind of large-scale crowd video analytic system and method |
| CN205354276U (en)* | 2015-12-24 | 2016-06-29 | 上海市水利工程设计研究院有限公司 | Pressure sensing formula people current density alarm device |
| US10346688B2 (en)* | 2016-01-12 | 2019-07-09 | Hitachi Kokusai Electric Inc. | Congestion-state-monitoring system |
| CN105763853A (en)* | 2016-04-14 | 2016-07-13 | 北京中电万联科技股份有限公司 | Emergency early warning method for stampede accident in public area |
| CN106211065A (en)* | 2016-06-30 | 2016-12-07 | 北京奇虎科技有限公司 | Method and device for monitoring personnel flow data |
| JP6950692B2 (en) | 2016-08-04 | 2021-10-13 | 日本電気株式会社 | People flow estimation device, people flow estimation method and program |
| CN107844848B (en)* | 2016-09-20 | 2020-12-29 | 中国移动通信集团湖北有限公司 | A method and system for predicting the flow of people in a region |
| CN109428938A (en)* | 2017-09-04 | 2019-03-05 | 上海仪电(集团)有限公司中央研究院 | A kind of linkage control intelligence system based on video analysis |
| JP2019117425A (en)* | 2017-12-26 | 2019-07-18 | キヤノンマーケティングジャパン株式会社 | Information processing device, control method therefor, and program |
| CN110708501A (en)* | 2018-07-10 | 2020-01-17 | 中兴通讯股份有限公司 | Monitoring control method, device, equipment, system and computer storage medium |
| CN109087478A (en)* | 2018-08-22 | 2018-12-25 | 徐自远 | A kind of early warning of the anti-swarm and jostlement of intelligence and method of river diversion and system |
| CN109272153A (en)* | 2018-09-10 | 2019-01-25 | 合肥巨清信息科技有限公司 | A kind of tourist attraction stream of people early warning system |
| CN109685009A (en)* | 2018-12-20 | 2019-04-26 | 天和防务技术(北京)有限公司 | A kind of method of region crowd density video detection |
| CN114821546A (en)* | 2019-10-22 | 2022-07-29 | 上海商汤智能科技有限公司 | Method and device for processing images in vehicle cabin |
| CN110708518B (en)* | 2019-11-05 | 2021-05-25 | 北京深测科技有限公司 | People flow analysis early warning dispersion method and system |
| CN110929648B (en)* | 2019-11-22 | 2021-03-16 | 广东睿盟计算机科技有限公司 | Monitoring data processing method and device, computer equipment and storage medium |
| CN111652161A (en)* | 2020-06-08 | 2020-09-11 | 上海商汤智能科技有限公司 | Crowd overcrowding prediction method, device, electronic device and storage medium |
| CN112333431B (en)* | 2020-10-30 | 2022-06-07 | 深圳市商汤科技有限公司 | Scene monitoring method and device, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018059408A1 (en)* | 2016-09-29 | 2018-04-05 | 北京市商汤科技开发有限公司 | Cross-line counting method, and neural network training method and apparatus, and electronic device |
| CN106778688A (en)* | 2017-01-13 | 2017-05-31 | 辽宁工程技术大学 | The detection method of crowd's throat floater event in a kind of crowd scene monitor video |
| CN107133607A (en)* | 2017-05-27 | 2017-09-05 | 上海应用技术大学 | Demographics' method and system based on video monitoring |
| CN107911653A (en)* | 2017-11-16 | 2018-04-13 | 王磊 | The module of intelligent video monitoring in institute, system, method and storage medium |
| CN111274340A (en)* | 2020-01-15 | 2020-06-12 | 中国联合网络通信集团有限公司 | People flow density monitoring processing method, equipment and storage medium |
| Publication number | Publication date |
|---|---|
| JP7305808B2 (en) | 2023-07-10 |
| CN112333431A (en) | 2021-02-05 |
| JP2023502816A (en) | 2023-01-26 |
| CN114900669A (en) | 2022-08-12 |
| WO2022088653A1 (en) | 2022-05-05 |
| KR20220058859A (en) | 2022-05-10 |
| Publication | Publication Date | Title |
|---|---|---|
| CN112333431B (en) | Scene monitoring method and device, electronic equipment and storage medium | |
| Adam et al. | Robust real-time unusual event detection using multiple fixed-location monitors | |
| WO2018180588A1 (en) | Facial image matching system and facial image search system | |
| CN110309735A (en) | Abnormality detection method, device, server and storage medium | |
| JP6621092B1 (en) | Risk determination program and system | |
| JP6737290B2 (en) | Information processing apparatus, information processing method, and program | |
| US11763662B2 (en) | Systems and methods of enforcing dynamic thresholds of social distancing rules | |
| CN110717358B (en) | Visitor number counting method and device, electronic equipment and storage medium | |
| US11450186B2 (en) | Person monitoring system and person monitoring method | |
| US11893827B2 (en) | Systems and methods of detecting mask usage | |
| CN113330491A (en) | Opening method and device of electronic gate and server | |
| CN110717357A (en) | Early warning method and device, electronic equipment and storage medium | |
| CN118942159A (en) | A park visitor safety warning method, system and medium based on digital twin | |
| CN116863580A (en) | Intelligent access control system based on Internet of things | |
| JP6739119B1 (en) | Risk judgment program and system | |
| JP6739115B1 (en) | Risk judgment program and system | |
| CN113450236B (en) | Suspicious person identification method, device, system and medium based on spatio-temporal data | |
| JP5081035B2 (en) | Crime risk assessment apparatus and crime risk assessment program | |
| US12307813B2 (en) | Systems and methods of detecting incorrect mask usage | |
| CN112633039B (en) | Method and system for filtering congestion area | |
| HK40040125A (en) | Scene monitoring method, device, electronic equipment and storage medium | |
| HK40040125B (en) | Scene monitoring method, device, electronic equipment and storage medium | |
| CN117830960B (en) | A risk identification method, device, equipment and medium based on smart community | |
| CN119107745B (en) | A method and device for intrusion protection based on scene recognition | |
| WO2021149274A1 (en) | Monitoring system, monitoring device, monitoring method, and program |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code | Ref country code:HK Ref legal event code:DE Ref document number:40040125 Country of ref document:HK | |
| GR01 | Patent grant | ||
| GR01 | Patent grant |