Background
The requirements of modern battlefields on reconnaissance, accurate positioning and striking are gradually increased, and the requirements on moving target detection, positioning and tracking are higher and higher. The SAR can image the moving target, and the position, the movement direction, the speed of the moving target and even the shape information of the target are represented in a high-resolution image. The conventional SAR moving target detection technology has some defects: firstly, because the SAR imaging frequency is positively correlated with the radar working frequency, the traditional SAR has low working frequency and low imaging frame rate, and the target motion track in the synthetic aperture time can be lost, so that the real-time tracking of the moving target can not be realized; secondly, the minimum detectable speed is high, and the slow target is easy to be interfered by clutter and cannot be detected; moreover, the SAR system which has high resolution and GMTI (ground Moving Target indication) capability has high complexity, and has larger limit on a carrying platform. The video SAR is an SAR system capable of realizing high frame rate imaging, and can realize real-time monitoring of a target by continuously monitoring and imaging a ground target area to form at least 5 frames of images per second. The imaging characteristics of high resolution and high frame rate play an important role, and the moving target detection technology based on the video SAR also becomes a new research hotspot in the field of radar remote sensing.
The moving target detection technology aiming at the traditional SAR has a single channel as follows: spectrum filtering, time-frequency analysis, RDM, Keystone algorithm and the like, but the single-channel algorithm has poor target detection capability; there are also multi-channel algorithms such as: phase center offset (DPCA), along-track interference (ATI), STAP, etc., but the multi-channel algorithm system has higher complexity. The methods aim at the echo of a moving target, and then calculate a back-term scattering coefficient (RCS) to detect the moving target, and the Doppler frequency shift and defocusing generated by the moving target lead to poor detection performance of directly detecting the echo signal of the moving target, small speed measurement range and error generation of position positioning of the moving target.
The moving target detection method for the video SAR has a few researches, has various problems, has a poor detection effect when applied to a video SAR mode, generates shadows due to the fact that an emission signal is blocked in a video SAR imaging result, the shadows correspond to the real position of the target, and the detection through the shadows in the video SAR imaging result has many advantages, such as: (1) the slow target detection performance is good, (2) the moving target is accurately positioned, (3) continuous monitoring can be realized according to the shadow, (4) the detection process is simple to realize, and the like.
The moving target can be detected well through shadow detection, the detection of the moving target is realized by detecting the shadow in the imaging result of the video SAR at present, but the processing flow is more complex, and the threshold segmentation technology adopts the globally same threshold. Because the shadow of the moving target is detected by analyzing the contrast of the shadow and the background clutter and comparing the local area characteristics, the following formula is adopted:
wherein DTCR is the ratio of clutter to shadow intensity, σoHRepresenting the intensity, σ, of ambient noise in the shadowoLIndicating the intensity of the echo in the shaded area, σNThe detection effect of the shadow is dependent on the value of the local area DTCR for the total noise of the image, and by using the global same threshold, a better result can be obtained for a considerable part of the objects, but it may cause false detection or false alarm in the case that the shadow itself is bright.
Disclosure of Invention
The invention aims to solve the problems and the defects, and provides a moving target detection method based on a video SAR (synthetic aperture radar). on the basis of the shadow detection technology of the existing video SAR mode, the moving target is detected by detecting the shadow, the threshold segmentation is considered from the local information, the processing flow is simplified, the moving target can be detected more accurately, the false alarm or missing detection is reduced, and the moving target detection effect is improved.
The moving target detection method based on the video SAR is realized by the following steps, and the whole block diagram of the detection process is shown as the attached figure 1. The whole introduction of the process: the invention aims at the detection of the moving target in the imaging result of the video SAR, the video SAR has high frame rate, and if the moving target detection can be realized, the real-time observation of the moving target in the monitoring scene is facilitated. A moving object is detected by detecting a change in shading in successive frame images. Firstly, the registration can match the feature points of continuous multi-frame images, thereby facilitating the subsequent detection of shadow movement. Then, a shadow, a background and a clutter region are distinguished by utilizing binarization, and a background image can be obtained by utilizing a binarization result and background modeling, wherein the background image represents the background of a plurality of continuous images. The subtraction between the images can result in a foreground image. The foreground image is displayed as a changed shadow, but a false alarm caused by partial clutter interference exists, and the moving shadow can be finally obtained by utilizing the regularity of adjacent frame targets and the randomness of the clutter, so that the moving target can be detected.
The technical scheme of the invention is as follows: a moving target detection method based on a video SAR is characterized by comprising the following steps:
s1, acquiring the continuous multi-frame imaging result of the video SAR, and carrying out image acquisition on any continuous 9-frame images Ii-4,Ii-3,Ii-2,Ii-1,Ii,Ii+1,Ii+2,Ii+3,Ii+4The selection of 7 frames is: i isi-4,Ii-2,Ii-1,Ii,Ii+1,Ii+2,Ii+4Wherein IiFor the ith frame image in the continuous image sequence, then adopting SIFT algorithm to carry out image registration, and registering to the 4 th frame I in 7 framesiAs a reference image;
s2, carrying out threshold segmentation on the image: the m × n matrix data of the image is computationally expressed as 1 row of m × n columns, the influence of points in the transverse and longitudinal directions adjacent to any point in the m × n matrix is respectively considered, and points adjacent to the point in the two directions are synthesized for summation, wherein the summation in the transverse direction is as follows:
the summation in the longitudinal direction is:
wherein p is
nIs the gray value of any point in the image gray value matrix, s
1、s
2Respectively represent p in the transverse and longitudinal directions
nAdjacent points taken as centers, f
s1(n) represents the transverse direction s
1+1 points of the sum of the gray values, f
s2(n) represents s in the longitudinal direction
2+1 dot of the sum of the gray values, where s
1,s
2Value takingOf transverse and longitudinal extent, respectively, of the original image
Calculating the whole single-row matrix according to a transverse and longitudinal summation formula to respectively obtain two single-row matrices F
s1(n)、F
s2(n) reverse recovery of the single-row matrix into two mxn matrices F
1、F
2Then, the two matrixes are summed to obtain a matrix F which simultaneously considers the transverse and longitudinal influences
allWill F
allNumber of summations per coordinate s
1+s
2+2 average to get the average
Obtaining a first threshold segmentation result T
1(n):
Wherein T is a set common variable representing the influence of the value of a point adjacent to the point on the point, T1(n) represents whether the point value is 0 or 1, wherein the result is that 1 represents shadow, 0 represents non-shadow and corresponds to the threshold segmentation result of the video SAR image;
using the value p with the largest number of gray values in the gray value distribution of the whole imagemostTaking 0.9 of the value as preprocessing to obtain a second threshold segmentation result T2(n):
Dividing the first threshold into results T1(n) and a second threshold segmentation result T2(n) and operation:
Tresultrepresenting the final threshold segmentation result;
s3, acquiring a background image of the current image: obtaining the threshold segmentation result of the 7 frames of images registered in the step S1 according to the step S2, taking 5 frames from the 7 frames of images, and taking: i isi-4,Ii-2,Ii,Ii+2,Ii+4The 5 frames of images are subjected to background modeling under the condition that the sum of the same points is more than 3 and is taken as 1:
acquired background image IbackRepresenting the part of the 5 frames with unchanged shadow, namely a static object, the reference image IiAnd its left and right adjacent images Ii-1,Ii+1Is obtained by thresholdingbinarySubtracting the background image to obtain a corresponding foreground image IprospectForeground image IprospectThe part displayed in (1) is the corresponding threshold segmentation result IbinaryMoving object shadow in (1):
Iprospect=Ibinary-Iback
s4, filtering interference between adjacent frames:
adopting the adjacent frame phase-and-phase mode to filter different interference between adjacent frames, and setting the foreground image corresponding to the ith frame image as
The adjacent previous frame is
Adjacent next frame is
Wherein I
1For the first two of the three adjacent frame foregroundsThe frame sum result is used for filtering random clutter interference of different areas in adjacent frames, and meanwhile, a common part is reserved; performing an etching operation of
1Enlarged middle shadow part and then
And (3) carrying out the following operation:
performing a subtraction operation to filter out the same interference between adjacent frames:
I3for the result obtained by subtracting the adjacent frames, after performing the etching operation, the result is compared with I2And operation is carried out to obtain a final shadow detection result:
wherein I4And detecting the moving object according to the final shadow detection result.
The method has the advantages of simple flow, and can reduce false alarm and missing detection by adopting a self-adaptive mode during threshold segmentation, and accurately detect the moving target.
Detailed Description
The invention is described in detail below with reference to the attached drawing
The invention comprises the following steps:
step 1: processing the imaging video result of the video SAR to generate a multi-frame image, selecting 7 frames from the continuous 9-frame images, and performing image registration by adopting an SIFT algorithm, wherein the registration takes the 4 th frame of the 7 frames as a reference image, and the selection method comprises the following steps: i isi-4、Ii-2、Ii-1、Ii、Ii+1、Ii+2、Ii+4Wherein IiIs the ith frame image in the image sequence.
Step 2: the image needs to be thresholded after registration, so that the edge between the shadow and the environmental clutter is clearer, the threshold segmentation mode is based on a Wellner self-adaptive threshold processing algorithm, the influence of points in the vertical direction of the image is considered on the basis of the algorithm, and meanwhile, the mode in the gray value distribution of the whole image is utilized to filter some interference generated by the threshold segmentation method.
(1) The thresholding method computationally represents the m × n data of an image as 1 row m × n columns, yielding the data format of fig. 3. The threshold used by the algorithm for thresholding each point in the image is constantly changing, and each point is not affected by all points in the whole image, so the values of the points in the transverse and longitudinal directions adjacent to the point are considered as shown in fig. 2, wherein red represents the transverse transformation and blue represents the longitudinal transformation, and the points adjacent to the point in the two directions are summed, wherein the summation in the transverse direction is as follows:
the sum in the longitudinal direction is as follows:
wherein p is
nFor grey scale of imagesThe grey value of a point in the matrix of values, s
1、s
2Respectively represent p in the transverse and longitudinal directions
nTaking a total of several points adjacent to the centre, f
s1(n) represents the transverse direction s
1+1 dot of the sum of the gray values. f. of
s2(n) represents s in the longitudinal direction
2+1 dot of the sum of the gray values, where s
1,s
2Taking values of the transverse and longitudinal lengths of the original image respectively
Two single-row matrixes F can be obtained by calculating the whole single-row matrix according to a transverse and longitudinal summation formula
s1(n)、F
s2(n) wherein due to the start and end of a single row of matrices
Or
The method can not satisfy simultaneous calculation of left and right, and can directly select the original value corresponding to the image matrix without summation calculation, and then reversely restore the single-row matrix into two m multiplied by n matrixes F
1、F
2Then, the two matrixes are summed to obtain a matrix F which simultaneously considers the transverse and longitudinal influences
allWill F
allThe number s of each coordinate summation
1+s
2+2 average to get the average
Judging the point p
nFinally, 0 or 1 is taken according to the following formula:
where T is a common variable representing the effect of the value of a point adjacent to the point on the point, T1And (n) represents whether the final value of the point is 0 or 1, wherein the result is that 1 represents shadow, 0 represents non-shadow and corresponds to the threshold segmentation result of the video SAR image.
(2) By the method, a good threshold segmentation effect can be obtained, but the gray value around the local point is large, so that even if the gray value of the current point is large in the whole image, the gray value is finally judged to be 1 to form a false shadow, and the interference to a real target shadow is caused. The method detects the shadow to realize the detection of the moving target, and utilizes the value p with the maximum number of gray values in the gray value distribution in the whole imagemostTaking 0.9 of this value as a pre-treatment, the following equation:
wherein p isnThe threshold segmentation result T is obtained according to the gray value of a certain point in the video SAR image2(n) and the threshold value division result T1And (n) filtering false dark regions in the result of the threshold segmentation method to reduce interference to real target shadows.
And step 3: background modeling obtains a background image of the current image. Obtaining the binarization result of the registered adjacent 7 frames of images according to the step 2, and taking 5 frames from the 7 frames of images because the imaging frame rate of the video SAR is high, the time difference between the adjacent frames of images is small, and the moving distance of the moving target is small, wherein the 5 frames of images are taken every 1 frame, for example: i isi-4,Ii-2,Ii,Ii+2,Ii+4And carrying out background modeling on the condition that the sum of the same points of the 5 frames of images is more than 3 and is taken as 1:
obtaining a background image IbackRepresenting the part of the 5 frames with unchanged shade, namely a static object, and then segmenting the threshold value of the image of the (I-1, I, I + 1) th frame to obtain an image IbinarySubtracting the background image to obtain a corresponding foreground image IprospectForeground image IprospectThe part displayed in (1) is also the corresponding threshold segmentation nodeFruit IbinaryThe moving object shadow in (1) is expressed by the following relation:
Iprospect=Ibinary-Iback
wherein the variables are defined as described above, and then scattered and fine clutter interference is filtered out by adopting connected domain detection.
And 4, step 4: the foreground image obtained in the step 3 is subjected to connected domain detection to filter scattered and fine clutter, but still more clutter interference is left to cause the possibility of false alarm, and because the clutter interference generated between adjacent frames is different, the background image I in the step 3 isbackNot very accurate, and different random clutter interferences may exist in different frames in the foreground image obtained thereby. For the clutter, the random clutter is filtered by adopting a mode of adjacent frame phase and to reduce the possibility of false alarm, wherein the mode is as follows:
(1) obtaining a foreground image corresponding to the i-1, i, i +1 frame image according to the previous steps, wherein the foreground image corresponding to the i frame image is set as
The adjacent previous frame is
Adjacent next frame is
For these three frames of images, first, the operation is as follows:
in the formula I1Processing the sum result of the first two frames in the foreground of the three adjacent frames to filter random clutter interference of different areas in the adjacent frames and simultaneously reserve a common part; these common parts arise for two reasons: firstly, as the time difference between adjacent frames is very small in the video SAR imaging result, the same moving target does not change greatly between the adjacent frames, and an overlapping part still exists; second oneRandom clutter interference exists between adjacent frames, interference of the same region exists at the same time, but the regions are fixed and only appear in adjacent images, and although the regions are static, the background modeling is not judged as the background in the step 3.
The intersection of two frame images can obtain the moving target part, and simultaneously filters out the random clutter interference in different areas, but the processing with the operation is carried out, I
1As a result, the shadow of the moving object in the image becomes smaller, and the direct intersection is taken, which may result in missed detection, so that proper corrosion operation is carried out to reduce I
1All the shadow parts are enlarged and then are compared with
The following processing steps are carried out:
I2the results obtained for the AND operation of the first two frames appropriately erode the results of the AND operation of the third frame, in which the random interference portions between adjacent frames are filtered.
(2) The subtraction operation may filter out the same interference between adjacent frames, as:
wherein I3The same interference can be filtered for the result of the subtraction between adjacent frames. Also, the shadow of the target is reduced, and after the etching operation is required, the target is etched2And operating to obtain a final shadow detection result, as shown in the formula:
wherein I4And the final shadow detection result is obtained.
The following combined simulation verifies the practicability of the invention:
setting an experimental environment: intel i3-4170 processor, Windows operating system, Matlab R2017 a;
setting parameters: when the binarization algorithm in the step 2 is adopted, the values of the horizontal direction and the longitudinal direction are the lengths in all directions
the value of t is 15, 8 neighborhoods are adopted during the detection processing of the connected domain, and the number of the connected objects is more than 50 for reservation. The etching operation used a flat disc structure of radius 4, strel ('disk',4) in Matlab.
Video results were imaged using video SAR published by the National laboratory of Sandia National Laboratories, SNL, usa.
According to the technical scheme, the shadow is detected and marked back to the original image, the experimental result is shown in figure 4, and the moving target in the SAR imaging result of the video can be accurately detected by observing the experimental result.