Disclosure of Invention
The invention aims to provide a wind power tower barrel blade detection system based on an unmanned aerial vehicle aiming at the defects existing at present.
The invention adopts the following technical scheme:
A wind power tower barrel blade detection system based on an unmanned aerial vehicle comprises a machine body control module, an image acquisition module, a communication module, a detection diagnosis module and an energy management module;
The system comprises an unmanned aerial vehicle, a machine body control module, a communication module, an image acquisition module, a detection diagnosis module, an energy management module and a control module, wherein the machine body control module is used for controlling and realizing stable flight and accurate navigation of the unmanned aerial vehicle;
The machine body control module comprises a flight control unit and an automatic obstacle avoidance unit, wherein the flight control unit is used for controlling the unmanned aerial vehicle to fly along a set detection route, and the automatic obstacle avoidance unit is used for controlling the unmanned aerial vehicle to detect obstacles in a flight path in real time and adjust the flight path of the unmanned aerial vehicle to realize real-time obstacle avoidance in the flight process;
The detection and diagnosis module comprises an image preprocessing unit, a real-time detection unit and an early warning unit, wherein the image preprocessing unit is used for preprocessing and storing wind power tower blade images acquired in each flight task of the unmanned aerial vehicle, the real-time detection unit is used for detecting wind power tower blade conditions when the unmanned aerial vehicle executes the flight tasks, and the early warning unit is used for completing early warning of abnormal conditions of wind power tower blades in the future according to detection results of the real-time detection unit in a history record;
The image preprocessing unit further comprises an image acquisition subunit, an image splicing subunit and an image storage subunit, wherein the image acquisition subunit is used for acquiring wind power tower blade images continuously shot by the image acquisition module, and the image splicing subunit is used for correcting and splicing the continuously shot wind power tower blade images;
further, the workflow of the image stitching subunit is as follows:
s11, acquiring continuously shot wind power tower barrel blade images;
S12, correcting the brightness, contrast and color of all the blade images;
s13, identifying and extracting key feature points of all corrected blade images, and generating feature descriptors for the key feature points, wherein the feature descriptors are acquired based on gradient information of areas around the corresponding feature points;
S14, matching the extracted key feature points in each image according to the distance measurement between feature descriptors of the key feature points in each image;
s15, performing geometric transformation and alignment operation on each image according to the matched key feature points to splice, and performing fusion treatment on spliced areas of the images;
S16, generating and outputting a spliced blade image;
Furthermore, the real-time detection unit completes the detection of the blade condition by inputting the spliced blade image into a pre-trained blade defect recognition model, wherein the output of the blade defect recognition model comprises various defect types and defect severity degrees corresponding to the defect types;
Further, the real-time detection unit sets an alarm threshold for each defect type, and in the detection process of the blade condition, when the defect severity of a certain defect type exceeds the set alarm threshold, the real-time detection unit automatically triggers an alarm and sends alarm information to staff, wherein the alarm information comprises the defect type, the defect severity and the defect specific position acquired according to the blade image;
furthermore, the early warning unit analyzes the severity degree of the defects corresponding to each defect type in the comprehensive historical detection results to complete the prediction alarm of the possible defect type of the blade, and sends early warning information to staff when predicting that the future blade is likely to have abnormal situation defects.
The beneficial effects obtained by the invention are as follows:
The invention realizes a high-efficiency image processing flow through the combination of the image acquisition subunit, the image splicing subunit and the image storage subunit, generates and outputs complete blade images through integrating, correcting and splicing continuously shot partial blade images, provides a more comprehensive blade view for subsequent analysis and identification, can more accurately identify and analyze blade surface defects, identifies the blade defect condition in real time through the real-time detection unit, predicts the possible blade defects in the future through the early warning unit, and can take measures in advance to prevent the defects from further developing.
Detailed Description
To make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below in connection with the embodiments thereof, it should be understood that the specific embodiments described herein are for explanation and not limitation of the present invention, other systems, methods and/or features of the present embodiments will become apparent to those skilled in the art after reviewing the following detailed description, it is intended that all such additional systems, methods, features and advantages be included in the present specification, be within the scope of the present invention, and be protected by the appended claims, additional features of the disclosed embodiments be described in the following detailed description, and these features will be apparent from the following detailed description.
In the description of the present invention, it should be understood that, if there is an orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", etc. based on the orientation or positional relationship shown in the drawings, it is merely for convenience of describing the present invention and simplifying the description, rather than indicating or suggesting that the apparatus or component referred to must have a specific orientation, construction and operation in the specific orientation, and thus the terms describing the positional relationship in the drawings are merely for exemplary illustration and are not to be construed as limitations of the present patent, and that the specific meaning of the terms may be understood by those skilled in the art according to circumstances.
Embodiment one.
As shown in fig. 1, the embodiment provides a wind power tower blade detection system based on an unmanned aerial vehicle, which comprises a machine body control module, an image acquisition module, a communication module, a detection diagnosis module and an energy management module;
The system comprises an unmanned aerial vehicle, a machine body control module, a communication module, an image acquisition module, a detection diagnosis module, an energy management module and a control module, wherein the machine body control module is used for controlling and realizing stable flight and accurate navigation of the unmanned aerial vehicle;
The machine body control module comprises a flight control unit and an automatic obstacle avoidance unit, wherein the flight control unit is used for controlling the unmanned aerial vehicle to fly along a set detection route, and the automatic obstacle avoidance unit is used for controlling the unmanned aerial vehicle to detect obstacles in a flight path in real time and adjust the flight path of the unmanned aerial vehicle to realize real-time obstacle avoidance in the flight process;
The detection and diagnosis module comprises an image preprocessing unit, a real-time detection unit and an early warning unit, wherein the image preprocessing unit is used for preprocessing and storing wind power tower blade images acquired in each flight task of the unmanned aerial vehicle, the real-time detection unit is used for detecting wind power tower blade conditions when the unmanned aerial vehicle executes the flight tasks, and the early warning unit is used for completing early warning of abnormal conditions of wind power tower blades in the future according to detection results of the real-time detection unit in a history record;
The image preprocessing unit further comprises an image acquisition subunit, an image splicing subunit and an image storage subunit, wherein the image acquisition subunit is used for acquiring wind power tower blade images continuously shot by the image acquisition module, and the image splicing subunit is used for correcting and splicing the continuously shot wind power tower blade images;
further, as shown in fig. 2, the workflow of the image stitching subunit is as follows:
s11, acquiring continuously shot wind power tower barrel blade images;
S12, correcting the brightness, contrast and color of all the blade images;
s13, identifying and extracting key feature points of all corrected blade images, and generating feature descriptors for the key feature points, wherein the feature descriptors are acquired based on gradient information of areas around the corresponding feature points;
S14, matching the extracted key feature points in each image according to the distance measurement between feature descriptors of the key feature points in each image;
s15, performing geometric transformation and alignment operation on each image according to the matched key feature points to splice, and performing fusion treatment on spliced areas of the images;
S16, generating and outputting a spliced blade image;
further, in the step S13, key feature points of each blade image are identified and extracted by using a SIFT algorithm;
further, as shown in fig. 3, in the step S15, the fusion process for the splicing region is completed by:
s151, decomposing two images to be spliced into a plurality of levels containing different detail features through Gaussian filtering and downsampling, wherein the uppermost level contains the most detail features and the lowermost level contains the least detail features;
S152, calculating and obtaining fusion weights on each level of the two spliced images according to the gradient amplitude of pixels of each level;
S153, effectively fusing corresponding levels of the two spliced images by using the fusion weight obtained in the previous step, and reconstructing each fused level layer by layer to generate a complete spliced blade image;
Specifically, in the step S151, gaussian filtering is first applied to the two images to smooth the images to reduce high frequency noise, and the main structure and low frequency information are retained; after Gaussian filtering is applied, downsampling is carried out on the two images so as to reduce the resolution ratio of the images, one hierarchy of the two images is obtained after the Gaussian filtering and downsampling operation is carried out once, the Gaussian filtering and downsampling operation is repeatedly carried out, so that a plurality of hierarchies of the two images containing different detail characteristics are obtained, and the detail characteristics of each hierarchy are image characteristics such as edges, textures, structures and the like contained in the hierarchy;
Further, in the step S152, the acquisition of the fusion weight for each layer is completed by:
S1521, for two spliced images, calculating gradient amplitude of pixels of each image on each level:
wherein F1,i (x, y) is the gradient amplitude of the first spliced image at the ith level, x represents the transverse direction, y represents the longitudinal direction, I1,x,i is the gradient of the first spliced image at the ith level in the transverse direction, I1,y,i is the gradient of the first spliced image at the ith level in the longitudinal direction, F2,i (x, y) is the gradient amplitude of the second spliced image at the ith level, I2,x,i is the gradient of the second spliced image at the ith level in the transverse direction, I2,y,i is the gradient of the second spliced image at the ith level in the longitudinal direction, F1,,i(x,y)≥F2,,i (x, y) is set;
S1522, calculating an initial weight of each image at each level:
Wherein, W1,i (x, y) is the initial weight of the first spliced image at the ith level, and W2,i (x, y) is the initial weight of the second spliced image at the ith level;
S1523, calculating fusion weight of each image on each level:
W′1,i(x,y)=W1,i(x,y)+ΔWi(x,y)×W2,i(x,y);
W′2,i(x,y)=1-W′1,i(x,y);
Wherein, W '1,i (x, y) is the fusion weight of the first stitched image at the ith level, W'2,i (x, y) is the fusion weight of the second stitched image at the ith level, Δwi (x, y) is a weight adjustment factor, which satisfies the following conditions:
Wherein k is an adjustment coefficient, and the value range is [1,10];
further, in the step S53, the complete spliced blade image is generated by fusion reconstruction in the following manner:
S1531 for each level, generating a fused output for that level:
Lout,i=W′1,i(x,y)×L1,i+W′2,i(x,y)×L2,i
wherein Lout,i is the fusion output of the ith level, L1,i is the detail characteristic of the first image at the ith level, L2,i is the detail characteristic of the second image at the ith level;
S1532, starting from the lowest level, reconstructing the images layer by using the Lout,i of each layer obtained by fusion until the images are reconstructed to the uppermost level, so as to generate spliced blade images;
The wind power tower has the advantages that the blade size of the wind power tower is huge, a single image is difficult to cover all areas, an effective splicing method is adopted to reconstruct a complete blade view from a plurality of images, the complete blade view is important for maintenance and safety inspection, the embodiment can effectively capture detailed information of the wind power blade on different levels through decomposing the images to different levels for image fusion, the detailed information from the whole outline to micro cracks or abrasion is included, dynamic weight adjustment is carried out on two spliced images on each level during fusion, more weights are set on the spliced images with more details according to gradient amplitude analysis calculation of the images on each level, the detail degree during image fusion is enhanced, the detail degree and definition of the spliced blade images are improved, and a more accurate visual basis is provided for subsequent blade condition analysis.
Embodiment two:
This embodiment should be understood to include at least all of the features of any one of the foregoing embodiments, and be further modified based thereon;
The embodiment provides a wind power tower barrel blade detection system based on an unmanned aerial vehicle, which comprises a machine body control module, an image acquisition module, a communication module, a detection diagnosis module and an energy management module;
The system comprises an unmanned aerial vehicle, a machine body control module, a communication module, an image acquisition module, a detection diagnosis module, an energy management module and a control module, wherein the machine body control module is used for controlling and realizing stable flight and accurate navigation of the unmanned aerial vehicle;
The machine body control module comprises a flight control unit and an automatic obstacle avoidance unit, wherein the flight control unit is used for controlling the unmanned aerial vehicle to fly along a set detection route, and the automatic obstacle avoidance unit is used for controlling the unmanned aerial vehicle to detect obstacles in a flight path in real time and adjust the flight path of the unmanned aerial vehicle to realize real-time obstacle avoidance in the flight process;
The detection and diagnosis module comprises an image preprocessing unit, a real-time detection unit and an early warning unit, wherein the image preprocessing unit is used for preprocessing and storing wind power tower blade images acquired in each flight task of the unmanned aerial vehicle, the real-time detection unit is used for detecting wind power tower blade conditions when the unmanned aerial vehicle executes the flight tasks, and the early warning unit is used for completing early warning of abnormal conditions of wind power tower blades in the future according to detection results of the real-time detection unit in a history record;
Furthermore, the real-time detection unit completes the detection of the blade condition by inputting the spliced blade image into a pre-trained blade defect recognition model, wherein the output of the blade defect recognition model comprises various defect types and defect severity degrees corresponding to the defect types;
Further, the real-time detection unit sets an alarm threshold for each defect type, and in the detection process of the blade condition, when the defect severity of a certain defect type exceeds the set alarm threshold, the real-time detection unit automatically triggers an alarm and sends alarm information to staff, wherein the alarm information comprises the defect type, the defect severity and the defect specific position acquired according to the blade image;
Furthermore, after the analysis of the detection results of the multiple real-time detection units in the history record is completed, the early warning unit sends early warning information to a user to finish early warning of abnormal conditions of the wind power tower blades in the future, wherein the early warning information comprises defect type repair early warning priority information of each wind power tower blade;
Further, the specific workflow of the early warning unit is as follows:
s21, acquiring n detection results closest to the current time for all detected wind power tower blades, wherein the detection results are various defect types output by a real-time detection unit and defect severity degrees corresponding to the defect types;
S22, for each defect type of each wind power tower blade, calculating a corresponding defect repair priority coefficient:
Wherein K is a defect repair priority coefficient of a certain defect type, Qj is an alarm accumulation coefficient of a j-th detection result, Wavg is an average value of defect severity of all detection results which do not reach a set alarm threshold, max (Ej) is a maximum value of defect severity of all detection results which do not reach the set alarm threshold, and gamma is the set alarm threshold;
For Qj:
S23, sequencing all defect types of each wind power tower blade according to the defect repair priority coefficient from high to low, wherein the repair early warning priority corresponding to the defect type with higher defect repair priority coefficient is higher;
The wind power tower barrel blade has higher operation and maintenance cost, is more critical to timely find and prevent blade defects in an early stage, analyzes the defect development trend of the blade according to the severity of various defect types by integrating multiple historical detection results, thereby providing early warning and repairing priorities for various defect types of each blade, and can better control the operation and maintenance cost, respond to potential risks in advance, improve the reliability and safety of equipment, finally reduce the repairing cost and prolong the service life of the equipment by integrating monitoring and early warning.
The foregoing disclosure is only a preferred embodiment of the present invention and is not intended to limit the scope of the invention, so that all equivalent technical changes made by applying the description of the present invention and the accompanying drawings are included in the scope of the present invention, and in addition, elements in the present invention can be updated as the technology develops.