Background
At present, with the improvement of a social security system, video monitoring equipment is distributed in all corners, and when a law enforcement officer needs to identify a suspect, the suspect can be searched through a monitoring image. At present, suspects are identified through monitoring images mainly through a manual identification mode or a machine automatic identification mode, but the identification modes can only identify various image characteristics (such as human face characteristics, behavior characteristics, clothing characteristics, action characteristics, gait characteristics, driven vehicle characteristics and the like) appearing in the current monitoring images. However, the suspect is not usually in a static state, and leaves the current monitoring area, so that the problem of determining the direction of the suspect is solved.
For example, if a suspect is found in a surveillance image captured by a camera a installed in a location of a case at 5 pm, but the suspect leaves the field of view of the camera a at 5 pm and 10 pm, in order to determine the behavior of the suspect after 5 pm and 10 pm, it is generally necessary to manually check whether the suspect appears in the surveillance image captured by another camera installed near the camera a after 5 pm and 10 pm, and if the suspect is found in the surveillance image captured by the camera B, the corresponding surveillance image needs to be extracted for specific analysis. Under the conditions of complex road conditions, various cameras or unclear videos, the processing mode is time-consuming and labor-consuming.
Meanwhile, there may be a case where the suspect passes through the vicinity of the camera B after leaving the visual field range of the camera a, but the suspect does not appear in the visual field of the camera B due to the shooting angle of the camera B, so that the suspect cannot be found in the monitored image shot by the camera B, and the suspect disappears from the monitored image.
Further, due to the photographing angle of the camera a, although the suspect is in the spot, the suspect does not appear in the field of view of the camera a. In this case, the suspect cannot be found in time by merely recognizing the monitoring image.
Disclosure of Invention
The embodiment of the invention provides a data merging processing method, a data merging processing device and a data merging processing system for video monitoring. Therefore, when the suspect is searched through the video monitoring image, the suspect can be tracked by using the electronic identity mark, the monitoring image shot by the plurality of cameras does not need to be manually checked, and the working efficiency is greatly improved.
According to one aspect of the present invention, there is provided a data merging processing method for video monitoring, including:
receiving a video image acquired by a video acquisition device and an electronic identity acquired by an identity acquisition device;
and combining the electronic identity identification with the corresponding audio information in the video image to generate a streaming media file, wherein the acquisition time of the electronic identity identification is synchronous with the acquisition time of the corresponding audio information.
In one embodiment, merging the electronic identity with corresponding audio information in the video image comprises:
sampling the electronic identity marks according to the specified sampling frequency;
carrying out quantization processing on the sampling result to obtain a quantized electronic identity;
and merging the quantized electronic identity with the corresponding audio information in the video image.
In one embodiment, a feature code is added to the quantized electronic identity prior to merging to distinguish the electronic identity from the audio information.
In one embodiment, the specified sampling frequency is not greater than the sampling frequency of the audio information in the video image.
In one embodiment, the electronic identity is a MAC address.
In one embodiment, the electronic identity and/or video image corresponding to the input time information is queried in the streaming media file based on the time information input by the user.
In one embodiment, video images and/or time information corresponding to the entered electronic identity are queried in the streaming media file based on the electronic identity entered by the user.
In one embodiment, in the event that a specified electronic identity appears in the streaming media file, an alert message is sent to the management platform.
According to another aspect of the present invention, there is provided a data merging processing apparatus for video surveillance, comprising:
the receiving module is used for receiving the video image acquired by the video acquisition device and the electronic identity acquired by the identity acquisition device;
and the merging module is used for merging the electronic identity identifier and the corresponding audio information in the video image to generate a streaming media file, wherein the acquisition time of the electronic identity identifier is synchronous with the acquisition time of the corresponding audio information.
In one embodiment, the combining module comprises a sampling unit, a quantization unit and a combining processing unit, wherein:
the sampling unit is used for sampling the electronic identity label according to the specified sampling frequency;
the quantization unit is used for performing quantization processing on the sampling result to obtain a quantized electronic identity;
and the merging processing unit is used for merging the quantized electronic identity identification with the corresponding audio information in the video image.
In one embodiment, the merging processing unit adds a feature code to the quantized electronic identity before merging in order to distinguish the electronic identity from the audio information.
In one embodiment, the specified sampling frequency is not greater than the sampling frequency of the audio information in the video image.
In one embodiment, the electronic identity is a MAC address.
In one embodiment, the apparatus further comprises a retrieval module, wherein:
and the retrieval module is used for inquiring the electronic identity and/or the video image corresponding to the input time information in the streaming media file according to the time information input by the user.
In one embodiment, the retrieval module is further configured to query the streaming media file for video images and/or time information corresponding to the input electronic identifier according to the electronic identifier input by the user.
In one embodiment, the above apparatus further comprises an early warning module, wherein:
and the early warning module is used for sending warning information to the management platform under the condition that the specified electronic identity mark appears in the streaming media file.
According to another aspect of the present invention, there is provided a data merging processing system for video monitoring, including the data merging processing apparatus according to any of the above embodiments, and
the video acquisition device is used for acquiring video images;
the identity mark acquisition device is used for acquiring the electronic identity mark;
and the server is used for storing the streaming media file generated by the data merging processing device.
In one embodiment, the identity acquisition device is a WiFi device.
In one embodiment, the data merge processing means is provided in the video capture device.
In one embodiment, the identification collecting device is further used for sending the collected electronic identification to the video collecting device;
the video acquisition device is also used for providing the acquired video images and audio sampling frequency and the electronic identity sent by the identity acquisition device for the data merging processing device.
In one embodiment, the data merging processing device is arranged in the identity acquisition device.
In one embodiment, the video capture device is further configured to send the captured video image to the identification capture device;
the identification mark acquisition device is also used for decoding the received video image to obtain the sampling frequency of the audio information and providing the received video image, the sampling frequency of the audio information and the acquired electronic identification mark for the data merging processing device.
In one embodiment, the data merging processing device is provided in a server.
In one embodiment, the video capture device is further configured to send the captured video image to a server;
the identity identification acquisition device is also used for sending the acquired electronic identity identification to the server;
the server is also used for decoding the received video image to obtain the sampling frequency of the audio information and providing the video image, the sampling frequency of the audio information and the electronic identity mark to the data merging processing device.
Other features of the present invention and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which proceeds with reference to the accompanying drawings.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The relative arrangement of the components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless specifically stated otherwise.
Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
Fig. 1 is a schematic diagram of an embodiment of a data merging processing method for video surveillance according to the present invention. Wherein:
step 101, receiving a video image acquired by a video acquisition device and an electronic identity acquired by an identity acquisition device.
Optionally, the electronic identity is a MAC address.
And 102, combining the electronic identity identification with corresponding audio information in the video image to generate a streaming media file, wherein the acquisition time of the electronic identity identification is synchronous with the acquisition time of the corresponding audio information.
For example, the acquisition time of a certain electronic identity is 15 points at 25/2016, while the acquisition time of a video image acquired by a video acquisition device is all day at 25/12/2016, and the acquisition time of corresponding audio information is 0 to 24 points at 25/12/2016, and the electronic identity and the audio information at 15 points at 25/12/2016 are merged through merging processing.
Based on the data merging processing method for video monitoring provided by the above embodiment of the present invention, the collected electronic identification is merged with the corresponding audio information in the video image to generate the streaming media file, wherein the collection time of the electronic identification is synchronized with the collection time of the corresponding audio information. Therefore, when the suspect is searched through the video monitoring image, the suspect can be tracked by using the electronic identity mark, the monitoring image shot by the plurality of cameras does not need to be manually checked, and the working efficiency is greatly improved.
Fig. 2 is a schematic diagram of another embodiment of a data merging processing method for video surveillance according to the present invention. The step of merging the electronic identity identifier with the corresponding audio information in the video image comprises:
step 201, sampling the electronic identity according to a specified sampling frequency.
Optionally, the specified sampling frequency is not greater than the sampling frequency of the audio information in the video image.
Step 202, performing quantization processing on the sampling result to obtain a quantized electronic identity.
Step 203, merging the quantized electronic identity with the corresponding audio information in the video image.
Optionally, before merging, a feature code is added to the quantized electronic identity in order to distinguish the electronic identity from the audio information. So that the decoder can recognize the electronic identification and sample the corresponding rule for decoding when decoding.
Optionally, according to the time information input by the user, the electronic identity and/or the video image corresponding to the input time information is inquired in the streaming media file. In addition, according to the electronic identification input by the user, the video image and/or the time information corresponding to the input electronic identification can be inquired in the streaming media file.
Therefore, monitoring video information in a specified time and electronic identification marks appearing in the monitoring area can be known quickly, or when certain electronic identification mark appears in which monitoring area can be known quickly, which is very beneficial to monitoring and locking suspects quickly.
For example, a suspect is found in a surveillance video shot by a camera a installed in a kitchen area at 5 pm, and the suspect leaves the visual field of the camera a at 5 o 'clock and 10 o' clock. By utilizing the method and the device, 5 electronic identifications (the 5 electronic identifications can be changed into a first electronic identification set) appearing in the monitoring area of the camera A at the moment of 5 points and 3 electronic identifications (the 3 electronic identifications can be changed into a second electronic identification set) appearing in the monitoring area of the camera A at the moment of 5 points and 10 points can be quickly obtained, the obtained first electronic identification set and the obtained second electronic identification set are intersected, and if only one electronic identification exists in the intersection, the electronic identification is the electronic identification of the suspect mobile terminal.
Aiming at the track of the suspect after 5 points and 10 minutes, the surveillance video shot by other cameras arranged near the camera A after 5 points and 10 minutes is not required to be manually checked, the obtained electronic identity of the suspect is only required to be searched, if the surveillance video shot by the camera B after 5 points and 10 minutes comprises the electronic identity of the suspect, namely, the suspect is shown to enter the surveillance area of the camera B from the surveillance area of the camera A, the surveillance video shot by the camera B can be directly called, the surveillance video shot by other cameras is not required to be checked, and the working efficiency is greatly improved.
Meanwhile, the invention also has the advantage that even if the suspect enters the monitoring area where the camera B is located, the suspect can be determined to enter the area even if the image of the suspect cannot be shot due to the shooting angle of the camera B, so that the track of the suspect is further monitored. Therefore, the suspect can be effectively tracked and monitored.
In addition, under the condition that the specified electronic identity appears in the streaming media file, alarm information can be sent to the management platform. That is, the suspect can be actively monitored by actively inquiring the electronic identification.
For example, the obtained electronic identity of the suspect can be input into the system, and when the electronic identity is found in the monitoring video, that is, the suspect is indicated to have flowed to the monitoring area, at this time, the suspect can be monitored in time by sending alarm information.
It should be noted that the specified electronic identity may or may not be targeted. If the electronic identity marks appear in the areas where no people should appear, the alarm can be given immediately.
For example, a suspect enters a mall and hide in a corner where a camera cannot shoot at business hours, and then comes out to steal when no person is in the mall at night. Since the suspect cannot be found from the monitoring video, a great potential safety hazard is brought. After the method is implemented, although no abnormity is found in the monitored image, the monitored video shot by a certain camera at the end of the business hours of the shopping mall comprises the electronic identity, and no person exists in the shopping mall at the moment, so that the fact that the person is hidden in the monitored area is indicated, and the method can give an alarm in time under the condition, and can effectively reduce the potential safety hazard.
Fig. 3 is a schematic diagram of an embodiment of a data merging processing apparatus for video surveillance according to the present invention. As shown in fig. 3, the data merging processing apparatus may include areceiving module 301 and amerging module 302. Wherein:
the receivingmodule 301 is configured to receive a video image acquired by a video acquisition device and an electronic identity acquired by an identity acquisition device.
Optionally, the electronic identity is a MAC address.
The mergingmodule 302 is configured to merge the electronic identity with corresponding audio information in the video image to generate a streaming media file, where the acquisition time of the electronic identity is synchronized with the acquisition time of the corresponding audio information.
Based on the data merging processing device for video monitoring provided by the above embodiment of the present invention, the collected electronic identification is merged with the corresponding audio information in the video image to generate the streaming media file, wherein the collection time of the electronic identification is synchronized with the collection time of the corresponding audio information. Therefore, when the suspect is searched through the video monitoring image, the suspect can be tracked by using the electronic identity mark, the monitoring image shot by the plurality of cameras does not need to be manually checked, and the working efficiency is greatly improved.
Fig. 4 is a schematic diagram of another embodiment of a data merging processing device for video surveillance according to the present invention. The combiningmodule 302 may include asampling unit 401, aquantization unit 402, and a combiningprocessing unit 403. Wherein:
thesampling unit 401 is configured to sample the electronic identity according to a specified sampling frequency.
Optionally, the specified sampling frequency is not greater than the sampling frequency of the audio information in the video image.
Thequantization unit 402 is configured to perform quantization processing on the sampling result to obtain a quantized electronic identity.
The mergingprocessing unit 403 is configured to merge the quantized electronic identity with the corresponding audio information in the video image.
Optionally, the mergingprocessing unit 403 adds a feature code to the quantized electronic identity, in particular before merging, so as to distinguish the electronic identity from the audio information.
Fig. 5 is a schematic diagram of a data merging processing device for video surveillance according to another embodiment of the present invention. Compared with the embodiment shown in fig. 3, the data merging processing device further includes aretrieval module 503 in addition to the receivingmodule 501 and the mergingmodule 502. Wherein:
the retrievingmodule 503 is configured to query the streaming media file for an electronic identity and/or a video image corresponding to the input time information according to the time information input by the user.
Optionally, the retrievingmodule 503 is further configured to query the streaming media file for the video image and/or the time information corresponding to the input electronic identity according to the electronic identity input by the user.
Therefore, a user can quickly know monitoring video information in a specified time and electronic identification marks appearing in the monitoring area, or can quickly know when a certain electronic identification mark appears in which monitoring area, and the method is very beneficial to monitoring and quickly locking suspects.
For example, a suspect is found in a surveillance video shot by a camera a installed in a kitchen area at 5 pm, and the suspect leaves the visual field of the camera a at 5 o 'clock and 10 o' clock. By utilizing the method and the device, 5 electronic identifications (the 5 electronic identifications can be changed into a first electronic identification set) appearing in the monitoring area of the camera A at the moment of 5 points and 3 electronic identifications (the 3 electronic identifications can be changed into a second electronic identification set) appearing in the monitoring area of the camera A at the moment of 5 points and 10 points can be quickly obtained, the obtained first electronic identification set and the obtained second electronic identification set are intersected, and if only one electronic identification exists in the intersection, the electronic identification is the electronic identification of the suspect mobile terminal.
Aiming at the track of the suspect after 5 points and 10 minutes, the surveillance video shot by other cameras arranged near the camera A after 5 points and 10 minutes is not required to be manually checked, the obtained electronic identity of the suspect is only required to be searched, if the surveillance video shot by the camera B after 5 points and 10 minutes comprises the electronic identity of the suspect, namely, the suspect is shown to enter the surveillance area of the camera B from the surveillance area of the camera A, the surveillance video shot by the camera B can be directly called, the surveillance video shot by other cameras is not required to be checked, and the working efficiency is greatly improved.
Meanwhile, the invention also has the advantage that even if the suspect enters the monitoring area where the camera B is located, the suspect can be determined to enter the area even if the image of the suspect cannot be shot due to the shooting angle of the camera B, so that the track of the suspect is further monitored. Therefore, the suspect can be effectively tracked and monitored.
Optionally, the data storage and storage device shown in fig. 5 may further include anearly warning module 504, where:
theearly warning module 504 is configured to send warning information to the management platform when a specified electronic identity appears in the streaming media file.
That is, the suspect can be actively monitored by actively inquiring the electronic identification.
For example, the obtained electronic identity of the suspect can be input into the system, and when the electronic identity is found in the monitoring video, that is, the suspect is indicated to have flowed to the monitoring area, at this time, the suspect can be monitored in time by sending alarm information.
It should be noted that the specified electronic identity may or may not be targeted. If the electronic identity marks appear in the areas where no people should appear, the alarm can be given immediately.
For example, a suspect enters a mall and hide in a corner where a camera cannot shoot at business hours, and then comes out to steal when no person is in the mall at night. Since the suspect cannot be found from the monitoring video, a great potential safety hazard is brought. After the method is implemented, although no abnormity is found in the monitored image, the monitored video shot by a certain camera at the end of the business hours of the shopping mall comprises the electronic identity, and no person exists in the shopping mall at the moment, so that the fact that the person is hidden in the monitored area is indicated, and the method can give an alarm in time under the condition, and can effectively reduce the potential safety hazard.
Fig. 6 is a schematic diagram of an embodiment of a data merging processing system for video surveillance according to the present invention. As shown in fig. 6, the system may include a datamerge processing device 601, avideo capture device 602, anid capture device 603, and aserver 604. The data mergingprocessing device 601 is the data merging processing device according to any one of the embodiments of fig. 3 to 5, thevideo collecting device 602 is configured to collect a video image, the identificationmark collecting device 603 is configured to collect an electronic identification mark, and theserver 604 is configured to store a streaming media file generated by the data merging processing device.
Alternatively, thevideo capture device 602 may be a camera and theid capture device 603 may be a WiFi device.
The data track-mergingprocessing device 601 can be realized by chips such as an FPGA or a CPLD, and can also be realized by software. The data combiningprocessing device 401 may be disposed independently, or may be disposed in thevideo capture device 602, theid capture device 603, or theserver 604.
The following is a description by specific examples.
(1) The data merging and processing device is arranged in the video acquisition device
As shown in fig. 7, the data mergingprocessing device 701 is provided in thevideo capture device 702. The identificationmark acquisition device 703 sends the acquired electronic identification mark to thevideo acquisition device 702, and thevideo acquisition device 702 provides the acquired video image and audio sampling frequency and the electronic identification mark sent by the identification mark acquisition device to the data mergingprocessing device 701 for processing. Thevideo capture device 702 finally provides the streaming media file generated by the data mergeprocessing device 701 to theserver 704.
After the audio information is acquired by thevideo acquisition device 702, the audio information may not be encoded, but the data mergingprocessing device 701 is first used to sample and quantize the received electronic identity according to the audio sampling rate (or frequency division thereof), and finally the audio information and the quantized electronic identity are encoded together.
Or, thevideo capture device 702 may also directly encode the audio information after capturing the audio information, and when receiving the electronic identifier, on the one hand, decode the audio information, and on the other hand, sample and quantize the received electronic identifier according to the audio sampling rate (or its frequency division) by using the data mergeprocessing device 701, and finally encode the audio information and the quantized electronic identifier together.
(II) the data merging processing device is arranged in the identity acquisition device
As shown in fig. 8, the data mergingprocessing device 801 is disposed in theidentification collecting device 803. Thevideo capture device 802 sends the captured video image to theidentification capture device 803. Theid collecting device 803 decodes the received video image to obtain the sampling frequency of the audio information, and provides the received video image, the sampling frequency of the audio information, and the collected electronic id to the data mergingprocessing device 801 for processing. Theidentification collecting device 803 finally provides the streaming media file generated by the data mergingprocessing device 801 to theserver 804.
(III) the data merging processing device is arranged in the server
As shown in fig. 9, the data merge processing means 901 is provided in theserver 904. Thevideo capture device 902 sends the captured video images to theserver 904, and theid capture device 903 sends the captured electronic id to the server. Theserver 904 decodes the received video image to obtain the sampling frequency of the audio information, provides the video image, the sampling frequency of the audio information, and the electronic identity to the data mergingprocessing device 901 for processing, and stores the streaming media file generated by the data mergingprocessing device 901.
By implementing the method and the device, the collected electronic identity is combined with the corresponding audio information in the video image to generate the streaming media file, wherein the collection time of the electronic identity is synchronous with the collection time of the corresponding audio information. Therefore, when the suspect is searched through the video monitoring image, the suspect can be tracked by using the electronic identity mark, the monitoring image shot by the plurality of cameras does not need to be manually checked, and the working efficiency is greatly improved.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.