Movatterモバイル変換


[0]ホーム

URL:


CN114494916A - Black-neck crane monitoring and tracking method based on YOLO and DeepsORT - Google Patents

Black-neck crane monitoring and tracking method based on YOLO and DeepsORT
Download PDF

Info

Publication number
CN114494916A
CN114494916ACN202210079600.6ACN202210079600ACN114494916ACN 114494916 ACN114494916 ACN 114494916ACN 202210079600 ACN202210079600 ACN 202210079600ACN 114494916 ACN114494916 ACN 114494916A
Authority
CN
China
Prior art keywords
tracking
black
data
yolo
thread
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210079600.6A
Other languages
Chinese (zh)
Inventor
段光辉
孙永浩
朱锦科
王文达
谢小兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Software Technology Co Ltd
Original Assignee
Inspur Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Software Technology Co LtdfiledCriticalInspur Software Technology Co Ltd
Priority to CN202210079600.6ApriorityCriticalpatent/CN114494916A/en
Publication of CN114494916ApublicationCriticalpatent/CN114494916A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The invention discloses a Black-neck Crane monitoring and tracking method based on YOLO and DeepsORT, and relates to the technical field of image recognition; the method comprises the steps of collecting image data and video data in a target range, analyzing the image data and the video data by using a target detection tracking model, detecting and identifying black-neck crane images and videos, learning depth correlation measurement by using a black-neck crane data set in an offline pre-training stage based on YOLO and DeepsORT, establishing measurement-to-track correlation by using a visual appearance space neighbor query method in an online application stage, training to complete the target detection tracking model, and uploading a detection identification result to a visualization platform.

Description

Black-neck crane monitoring and tracking method based on YOLO and DeepsORT
Technical Field
The invention discloses a method, relates to the technical field of image recognition, and particularly relates to a black-neck crane monitoring and tracking method based on yolo and deep SORT.
Background
The black-neck crane is the first-grade national animal for protection and is the only crane growing and breeding in the plateau in the world. In recent years, the development of a series of biodiversity protection measures in China leads to remarkable effect of biodiversity protection in China. The living environment of the black-neck crane is greatly improved, and some rare animals are gradually discovered.
Due to the development of habitats, the number of black-neck cranes is increased year by year, the inherent habits of the black-neck cranes need to be studied, but manual identification of the black-neck cranes and annual statistics of the number of the black-neck cranes are troublesome, and automatic identification of monitoring and tracking of the black-neck cranes is currently imperfect.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a black-neck crane monitoring and tracking method based on yolo and deep SORT, and the specific scheme provided by the invention is as follows:
a black-neck crane monitoring and tracking method based on yolo and deep SORT collects image data and video data in a target range,
analyzing the image data and the video data by using a target detection tracking model, detecting and identifying black neck crane images and videos, wherein based on YOLO and DeepsORT, a black neck crane data set is used for learning depth correlation measurement in an offline pre-training stage, a measurement-to-track correlation is established by using a visual appearance space neighbor query method in an online application stage, and the target detection tracking model is trained and completed,
and uploading the detection and identification result to a visualization platform.
Preferably, in the black-neck crane monitoring and tracking method based on yolo and DeepSORT, the acquiring of image data and video data within the target range includes:
and image data and video data in a target range are acquired through a satellite, an unmanned aerial vehicle and a camera terminal.
Preferably, in the black-neck crane monitoring and tracking method based on yolo and deep sort, the analyzing the image data and the video data by using the target detection and tracking model includes:
the image data and video data are analyzed by a target detection tracking model in the edge computing device.
Preferably, in the black-neck crane monitoring and tracking method based on yolo and deep sort, the edge computing device uses multiple threads to perform inference of video stream target detection and tracking.
Preferably, the inference process in the black-neck crane monitoring and tracking method based on yolo and deep sort is as follows:
the method comprises the steps of deploying a data push flow thread which is in charge of receiving and caching video frames, deploying an algorithm reasoning thread, carrying out target detection on the video frames pushed out by the data push flow thread, deploying a target tracking algorithm reasoning thread, tracking targets retreated by the algorithm reasoning thread, deploying a data storage thread, and storing images, videos, recognition results and tracking processes recognized by the algorithm reasoning thread.
The invention also provides a black-neck crane monitoring and tracking system based on yolo and deep SORT, which comprises an acquisition module, an analysis module and a communication module,
the acquisition module acquires image data and video data within a target range,
the analysis module analyzes the image data and the video data by using a target detection tracking model, detects and identifies black neck crane images and videos, learns depth correlation measurement by using a black neck crane data set in an off-line pre-training stage based on YOLO and DeepsORT, establishes measurement-to-track correlation by using a neighbor query method of a visual appearance space in an on-line application stage, and trains and finishes the target detection tracking model,
and the communication module uploads the detection identification result to the visualization platform.
The invention also provides edge computing equipment for monitoring and tracking the black-neck crane based on yolo and deep SORT, which comprises a receiving module, an analysis module and a communication module,
the receiving module receives image data and video data in a target range acquired by the acquisition equipment,
the analysis module analyzes the image data and the video data by using a target detection tracking model, detects and identifies black neck crane images and videos, learns depth correlation measurement by using a black neck crane data set in an off-line pre-training stage based on YOLO and DeepsORT, establishes measurement-to-track correlation by using a neighbor query method of a visual appearance space in an on-line application stage, and trains and finishes the target detection tracking model,
and the communication module uploads the detection identification result to the visualization platform.
Preferably, the black-neck crane monitoring and tracking edge computing device based on yolo and deep sort completes inference of video stream target detection and tracking by utilizing multiple threads.
Preferably, the inference process of the edge computing device based on the black-neck crane monitoring and tracking of yolo and deep sort is as follows:
the method comprises the steps of deploying a data push flow thread which is in charge of receiving and caching video frames, deploying an algorithm reasoning thread, carrying out target detection on the video frames pushed out by the data push flow thread, deploying a target tracking algorithm reasoning thread, tracking targets retreated by the algorithm reasoning thread, deploying a data storage thread, and storing images, videos, recognition results and tracking processes recognized by the algorithm reasoning thread.
The invention has the advantages that:
the invention provides a black-neck crane monitoring and tracking method based on yolo and DeepSORT, which can realize automatic counting and tracking, identify the number of black-neck cranes in a visual field range in real time and reduce the manual workload for identifying the number of the black-neck cranes.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of the application framework of the method of the present invention.
Fig. 2 is a schematic diagram of a network topology to which the method of the present invention is applied.
FIG. 3 is a schematic flow chart of the application of the method of the present invention.
Fig. 4 is a schematic diagram of the application of the recognition photo of the method of the present invention.
Detailed Description
The present invention is further described below in conjunction with the following figures and specific examples so that those skilled in the art may better understand the present invention and practice it, but the examples are not intended to limit the present invention.
The invention provides a black-neck crane monitoring and tracking method based on yolo and deep SORT, which is used for collecting image data and video data in a target range,
analyzing the image data and the video data by using a target detection tracking model, detecting and identifying black neck crane images and videos, wherein based on YOLO and DeepsORT, a black neck crane data set is used for learning depth correlation measurement in an offline pre-training stage, a measurement-to-track correlation is established by using a visual appearance space neighbor query method in an online application stage, and the target detection tracking model is trained and completed,
and uploading the detection and identification result to a visualization platform.
The method can realize automatic counting and tracking, identify the number of black-neck cranes in a visual field range in real time, reduce the manual workload of identifying the number of the black-neck cranes, has the characteristics of high efficiency, small error and low cost compared with the method for manually identifying the black-neck cranes, and can realize all-weather 24-hour detection and tracking.
In specific application, in some embodiments of the method, when the black-neck crane tracking identification is carried out, an ad hoc network or a special line can be set up for carrying out data transmission,
for example, VPDN private network: it adopts PSTN, ISDN, XDSL, cable or wireless to access the China broadband Internet in dialing mode, adopts special network encryption and communication protocol to construct a virtual special channel without external interference, thereby safely accessing the internal data resource service of the network,
special line: a bridge is provided for access to a public network,
an infinite bridge: bridging communications between two or more networks is accomplished using wireless transmission, and referring to figure 2,
the method of the invention utilizes the camera shooting collection equipment such as the wild protection infrared camera and the fixed camera to collect the image data and the video data in the target range,
receiving the image data and the video data by utilizing an edge computing device, such as an edge computing box, identifying the acquired image data and video data through a target detection tracking model, wherein the target detection tracking model designs a deep convolutional neural network based on YOLO v5 to train and verify a basic data set, perfects the loss and the fitting degree of a monitoring algorithm,
the method comprises the steps that inference of video stream target detection tracking is completed through an edge computing box by means of multithreading, a data stream pushing Thread through which video frames are deployed and used for bearing and caching video frames, an algorithm inference Thread through which detection is performed, video frames pushed out by the Thread through which detection is performed are deployed, a target tracking algorithm inference Thread through which tracking is performed on the basis of targets exited by the Thread through which detection is performed, a data Storage Thread through which images, videos, identification results, tracking processes and the number identified by the Thread through which detection is performed are deployed, and the data such as the identification results, the tracking processes and the number are transmitted back to a server, and the image data and the video data can be backed up into the server slowly and are finally displayed on a visualization platform such as a black-neck crane natural protection area.
In the process, the method of the invention combines the ad hoc network, the special line and the edge computing box, thereby effectively reducing the data transmission cost and greatly improving the monitoring timeliness.
According to the method flow, a black-neck crane monitoring and tracking architecture is also constructed, and referring to fig. 1, a sky-ground integrated network is shown: by means of satellite data, unmanned aerial vehicle monitoring, ground monitoring equipment and personnel management and protection teams, a sky-ground integrated real-time monitoring network is formed.
Monitoring the cloud: and various storage, calculation, network and other resources required by the operation of the big data platform are provided in a cloud mode.
The data center comprises: and summarizing and integrating various data to form a uniform basic data resource for supporting the operation of the platform.
A support platform: and the work identification and data analysis service application supporting the monitoring and tracking of the black-neck crane is realized.
N intelligent applications: and carrying out targeted system development construction according to the properties of different works, including black-neck crane identification, quantity identification, black-neck crane tracking, data analysis and the like.
The invention also provides a black-neck crane monitoring and tracking system based on yolo and deep SORT, which comprises an acquisition module, an analysis module and a communication module,
the acquisition module acquires image data and video data within a target range,
the analysis module analyzes the image data and the video data by using a target detection tracking model, detects and identifies black neck crane images and videos, learns depth correlation measurement by using a black neck crane data set in an off-line pre-training stage based on YOLO and DeepsORT, establishes measurement-to-track correlation by using a neighbor query method of a visual appearance space in an on-line application stage, and trains and finishes the target detection tracking model,
and the communication module uploads the detection identification result to the visualization platform.
The information interaction, execution process and other contents between the modules in the system are based on the same concept as the method embodiment of the present invention, and specific contents can be referred to the description in the method embodiment of the present invention, and are not described herein again.
Similarly, the system can realize automatic counting and tracking, identify the number of black-neck cranes in a visual field range in real time, reduce the manual workload for identifying the number of black-neck cranes, and compared with a method for manually identifying black-neck cranes, the system has the characteristics of high efficiency, small error and low cost, and can realize all-weather 24-hour detection and tracking.
The invention also provides edge computing equipment for black-neck crane monitoring and tracking based on yolo and DeepsORT, which comprises a receiving module, an analysis module and a communication module,
the receiving module receives image data and video data in a target range acquired by the acquisition equipment,
the analysis module analyzes the image data and the video data by using a target detection tracking model, detects and identifies black neck crane images and videos, learns depth correlation measurement by using a black neck crane data set in an off-line pre-training stage based on YOLO and DeepsORT, establishes measurement-to-track correlation by using a neighbor query method of a visual appearance space in an on-line application stage, and trains and finishes the target detection tracking model,
and the communication module uploads the detection identification result to the visualization platform.
Since the contents of information interaction, execution process, and the like between the modules in the edge computing device are based on the same concept as the method embodiment of the present invention, specific contents may refer to the description in the method embodiment of the present invention, and are not described herein again.
Similarly, the edge computing equipment can help to realize automatic counting and tracking, identify the number of black-neck cranes in a visual field range in real time and reduce the manual workload of identifying the number of the black-neck cranes.
It should be noted that not all steps and modules in the above flows and system structure diagrams are necessary, and some steps or modules may be omitted according to actual needs. The execution sequence of the steps is not fixed and can be adjusted according to the needs. The system structure described in the above embodiments may be a physical structure or a logical structure, that is, some modules may be implemented by the same physical entity, or some modules may be implemented by a plurality of physical entities, or some components in a plurality of independent devices may be implemented together.
The above-mentioned embodiments are merely preferred embodiments for fully illustrating the present invention, and the scope of the present invention is not limited thereto. The equivalent substitution or change made by the technical personnel in the technical field on the basis of the invention is all within the protection scope of the invention. The protection scope of the invention is subject to the claims.

Claims (9)

CN202210079600.6A2022-01-242022-01-24Black-neck crane monitoring and tracking method based on YOLO and DeepsORTPendingCN114494916A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202210079600.6ACN114494916A (en)2022-01-242022-01-24Black-neck crane monitoring and tracking method based on YOLO and DeepsORT

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202210079600.6ACN114494916A (en)2022-01-242022-01-24Black-neck crane monitoring and tracking method based on YOLO and DeepsORT

Publications (1)

Publication NumberPublication Date
CN114494916Atrue CN114494916A (en)2022-05-13

Family

ID=81475166

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202210079600.6APendingCN114494916A (en)2022-01-242022-01-24Black-neck crane monitoring and tracking method based on YOLO and DeepsORT

Country Status (1)

CountryLink
CN (1)CN114494916A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN115103204A (en)*2022-05-202022-09-23北京科技大学 A method and device for realizing edge intelligent application supporting AI engine
CN115131187A (en)*2022-07-072022-09-30北京拙河科技有限公司Method and system for generating multipoint positioning monitoring data of airport

Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2021017291A1 (en)*2019-07-312021-02-04平安科技(深圳)有限公司Darkflow-deepsort-based multi-target tracking detection method, device, and storage medium
CN112927127A (en)*2021-03-112021-06-08华南理工大学Video privacy data fuzzification method running on edge device
CN113706579A (en)*2021-08-092021-11-26华北理工大学Prawn multi-target tracking system and method based on industrial culture
CN113781521A (en)*2021-07-122021-12-10山东建筑大学 A bionic robotic fish detection and tracking method based on improved YOLO-DeepSort

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2021017291A1 (en)*2019-07-312021-02-04平安科技(深圳)有限公司Darkflow-deepsort-based multi-target tracking detection method, device, and storage medium
CN112927127A (en)*2021-03-112021-06-08华南理工大学Video privacy data fuzzification method running on edge device
CN113781521A (en)*2021-07-122021-12-10山东建筑大学 A bionic robotic fish detection and tracking method based on improved YOLO-DeepSort
CN113706579A (en)*2021-08-092021-11-26华北理工大学Prawn multi-target tracking system and method based on industrial culture

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MADISON L. HARASYN等: "Detection and tracking of belugas, kayaks and motorized boats in drone video using deep learning", 《DRONE SYST. APPL》, vol. 10, 4 January 2022 (2022-01-04), pages 77 - 96*
NICOLAI WOJKE等: "SIMPLE ONLINE AND REALTIME TRACKING WITH A DEEP ASSOCIATION METRIC", 《ARXIV》, 21 March 2017 (2017-03-21), pages 3 - 4*
王野: "基于卫星跟踪揭示两个黑颈鹤种群的迁徙模式和栖息地利用", 《中国优秀硕士学位论文全文数据库 基础科学辑》, no. 02, 15 February 2021 (2021-02-15), pages 006 - 1511*

Cited By (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN115103204A (en)*2022-05-202022-09-23北京科技大学 A method and device for realizing edge intelligent application supporting AI engine
CN115103204B (en)*2022-05-202023-10-10北京科技大学 An edge intelligence application implementation method and device supporting AI engine
CN115131187A (en)*2022-07-072022-09-30北京拙河科技有限公司Method and system for generating multipoint positioning monitoring data of airport
CN115131187B (en)*2022-07-072023-09-19北京拙河科技有限公司Airport multi-point positioning monitoring data generation method and system

Similar Documents

PublicationPublication DateTitle
CN114362367B (en) Transmission line monitoring system and method, identification system and method for cloud-edge collaboration
CN112990262B (en) An integrated solution system for grassland ecological data monitoring and intelligent decision-making
CN108109385B (en) A vehicle identification and dangerous behavior identification system and method for preventing external breakage of power lines
US11461995B2 (en)Method and apparatus for inspecting burrs of electrode slice
CN104200671B (en)A kind of virtual bayonet socket management method based on large data platform and system
CN111353413A (en) A method for identifying defects with low false negative rate in power transmission equipment
CN109785289A (en)A kind of transmission line of electricity defect inspection method, system and electronic equipment
CN112348003B (en)Aircraft refueling scene identification method and system based on deep convolutional neural network
CN106547814A (en)A kind of power transmission line unmanned machine patrols and examines the structuring automatic archiving method of image
CN110084165A (en)The intelligent recognition and method for early warning of anomalous event under the open scene of power domain based on edge calculations
CN109359686A (en) A method and system for user portrait based on campus network traffic
CN114494916A (en)Black-neck crane monitoring and tracking method based on YOLO and DeepsORT
CN111832398A (en) An image detection method for broken strands of distribution line poles and tower conductors based on unmanned aerial vehicle images
CN113837097B (en)Unmanned aerial vehicle edge calculation verification system and method for visual target identification
CN109376660A (en)A kind of target monitoring method, apparatus and system
CN113269039A (en)On-duty personnel behavior identification method and system
CN114359578A (en) Application method and system of intelligent terminal for identification of pests and diseases
CN118555462B (en) A bionic eagle eye monitoring device
CN118447421A (en)Power transmission line abnormal target detection method for carrying edge computing platform on unmanned aerial vehicle
CN110059076A (en)A kind of Mishap Database semi-automation method for building up of power transmission and transformation line equipment
CN113139476A (en)Data center-oriented human behavior attribute real-time detection method and system
CN116318365A (en)Space-time service big data platform with multiple elements
CN116189076A (en)Observation and identification system and method for bird observation station
CN109509558A (en)Fever epidemic situation fast reaction intelligence public affairs based on B/S framework defend service system
CN114067202A (en)Resistance identification method and device for wheat scab

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination

[8]ページ先頭

©2009-2025 Movatter.jp