Movatterモバイル変換


[0]ホーム

URL:


CN106909886B - A high-precision traffic sign detection method and system based on deep learning - Google Patents

A high-precision traffic sign detection method and system based on deep learning
Download PDF

Info

Publication number
CN106909886B
CN106909886BCN201710041906.1ACN201710041906ACN106909886BCN 106909886 BCN106909886 BCN 106909886BCN 201710041906 ACN201710041906 ACN 201710041906ACN 106909886 BCN106909886 BCN 106909886B
Authority
CN
China
Prior art keywords
traffic sign
features
training
convolutional neural
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710041906.1A
Other languages
Chinese (zh)
Other versions
CN106909886A (en
Inventor
张卫山
孙浩云
徐亮
李忠伟
宫文娟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China University of Petroleum East China
Original Assignee
China University of Petroleum East China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China University of Petroleum East ChinafiledCriticalChina University of Petroleum East China
Priority to CN201710041906.1ApriorityCriticalpatent/CN106909886B/en
Publication of CN106909886ApublicationCriticalpatent/CN106909886A/en
Application grantedgrantedCritical
Publication of CN106909886BpublicationCriticalpatent/CN106909886B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

Translated fromChinese

本发明公开了一种基于深度学习的高精度交通标志检测方法及系统。其中,该方法将深度学习技术与高精度交通标志检测技术相结合,通过对SSD网络和卷积神经网络进行训练,利用训练好的SSD网络提取来自视频流中按比例进行重叠切割后的交通标志特征,根据SSD网络提取到的交通标志特征,利用训练好的卷积神经网络提取交通标志特征的特征,将提取到的交通标志特征的特征与交通标志图像检测数据库的正负两类交通标志的特征进行匹配,保留正类交通标志特征,得到高精度交通标志匹配筛选结果,有效地提高了高精度交通标志检测的准确率。

The invention discloses a high-precision traffic sign detection method and system based on deep learning. Among them, this method combines deep learning technology with high-precision traffic sign detection technology. By training SSD network and convolutional neural network, the trained SSD network is used to extract traffic signs from the video stream after overlapping cuts in proportion. Features: According to the traffic sign features extracted by the SSD network, the trained convolutional neural network is used to extract the features of the traffic sign features, and the extracted features of the traffic sign features are compared with the positive and negative types of traffic signs in the traffic sign image detection database. The features are matched, and the positive traffic sign features are retained, and the high-precision traffic sign matching and screening results are obtained, which effectively improves the accuracy of high-precision traffic sign detection.

Description

A kind of high-precision method for traffic sign detection and system based on deep learning
Technical field
The invention belongs to artificial intelligence field more particularly to a kind of high-precision road traffic sign detection sides based on deep learningMethod and system.
Background technique
Deep learning is the topnotch of current machine learning development, a kind of side of the convolutional neural networks as deep learningMethod has preferable effect in fields such as object identification, image procossings.For feature extraction, convolutional neural networks have permissibleThe advantage of automatic study characteristics of image, reduces manual intervention, extracts the feature of high quality, thus to improve images matchAccuracy rate lays a solid foundation.
Since the method for deep learning does not do enough specific aim treatment of details in image pre-processing module, image is excessiveThe effect of expected high-precision testing result may be not achieved in target object proportion when too small, in order to improve detection identificationAccuracy, it usually needs specific application scenarios and picture material are analyzed and carry out image preprocessing etc..
Traffic sign is as one of the important goal in video monitoring, and to subsequent identification, auxiliary positioning is led for accurate detectionBoat plays conclusive effect.The huge number of traffic sign, size, angle are disobeyed, itself are difficult to accomplish accurately to detect, andAnd in true environment, influenced by factors such as weather, illumination, so that the detection of traffic sign is more difficult, especiallyIn automatic Pilot scene, the detection and identification of traffic sign play vital work to the understanding of driving ambient enviroment for itWith.Such as the speed etc. of current vehicle is controlled by detection identification speed(-)limit sign;On the other hand, traffic sign is embedded into heightIn precision map, crucial booster action is also functioned to location navigation.
In view of this, being badly in need of solving the problems, such as lower to the accuracy rate of road traffic sign detection.
Summary of the invention
Lower to the accuracy rate of road traffic sign detection in order to solve the problems, such as, the first object of the present invention is to provide a kind of baseIn the high-precision method for traffic sign detection of deep learning.This method greatly increases the accuracy rate and detection essence of feature extractionDegree.
A kind of high-precision method for traffic sign detection based on deep learning of the invention, comprising:
Step 1: it acquires the Traffic Sign Images of history and carries out overlapping cutting in proportion, then be input to SSD network, untilObtain optimal SSD network parameter;
Step 2: extracted using the optimal SSD network of parameter cutting after Traffic Sign Images traffic sign feature and byAccording to whether being that traffic sign feature is divided into these two types of traffic sign features of positive and negative classification and stores to Traffic Sign Images testing numberAccording to library;
Step 3: using Traffic Sign Images Test database come training convolutional neural networks, until obtaining optimal convolutionNeural network parameter;
Step 4: the traffic indication map after overlapping is cut in proportion in video flowing is extracted using the optimal SSD network of parameterThe traffic sign feature of picture, then the traffic sign feature of extraction is input to the optimal convolutional neural networks of parameter, and then extractThe feature of traffic sign feature out;
Step 5: by the feature for the traffic sign feature extracted and Traffic Sign Images Test database it is positive and negative this twoClass traffic sign feature is matched respectively, and retains positive class traffic sign feature;
Step 6: in the Traffic Sign Images before final testing result to be restored to overlapping cutting in proportion.
Further, in the step 1, the Traffic Sign Images of collected history are subjected to overlapping cutting in proportionLater, position coordinates of the Traffic Sign Images in the Traffic Sign Images before overlapping cutting after saving cutting.
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, and save the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in Traffic Sign Images are that accurate reproduction Traffic Sign Images improve coordinate basis.
Further, it during the step 1 training SSD network, is trained first using default parameters, according toTraining intermediate result is constantly adjusted initial weight, training rate and the number of iterations, until the SSD network is with defaultEfficiency reach preset recognition effect.
SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the friendship after overlapping cutting in proportionThe traffic sign feature of logical sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
Further, it during step 3 training convolutional neural networks, is instructed first using default parametersPractice, according to training intermediate result, initial weight, training rate and the number of iterations are constantly adjusted, until the convolution mindPreset recognition effect is reached with preset efficiency through network.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
The second object of the present invention is to provide a kind of high-precision road traffic sign detection system based on deep learning.
A kind of high-precision road traffic sign detection system based on deep learning of the invention, comprising:
SSD network training module is used to acquire the Traffic Sign Images of history and carries out overlapping cutting in proportion, then defeatedEnter to SSD network, until obtaining optimal SSD network parameter;
Tagsort module is used to extract the friendship of Traffic Sign Images after cutting using the optimal SSD network of parameterLogical flag sign and according to whether being divided into positive and negative classification these two types traffic sign feature for traffic sign feature and store to trafficSign image Test database;
Convolutional neural networks training module is used for using Traffic Sign Images Test database come training convolutional nerve netNetwork, until obtaining optimal convolutional neural networks parameter;
Characteristic extracting module is used to be extracted using the optimal SSD network of parameter in video flowing and is overlapped cutting in proportionThe traffic sign feature of Traffic Sign Images afterwards, then the traffic sign feature of extraction is input to the optimal convolutional Neural of parameterNetwork, and then extract the feature of traffic sign feature;
Characteristic matching module, the feature and Traffic Sign Images detection data of the traffic sign feature for being used to extractPositive and negative these two types traffic sign feature is matched respectively in library, and retains positive class traffic sign feature;
Image restoring module, the traffic indication map before being used to for final testing result being restored to overlapping cutting in proportionAs in.
Further, which further includes cutting traffic indication map image position logging modle, is used to go through collectedAfter the Traffic Sign Images of history carry out overlapping cutting in proportion, the Traffic Sign Images after saving cutting are before overlapping cuttingPosition coordinates in Traffic Sign Images.
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, and save the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in Traffic Sign Images are that accurate reproduction Traffic Sign Images improve coordinate basis.
Further, it in the SSD network training module, is trained first using default parameters, according in trainingBetween as a result, to initial weight, training rate and the number of iterations be constantly adjusted, until the SSD network is with preset efficiencyReach preset recognition effect.
SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the friendship after overlapping cutting in proportionThe traffic sign feature of logical sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
Further, it in the convolutional neural networks training module, is trained first using default parameters, according to instructionPractice intermediate result, initial weight, training rate and the number of iterations is constantly adjusted, until the convolutional neural networks are with pre-If efficiency reach preset recognition effect.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
The second object of the present invention is to provide a kind of high-precision road traffic sign detection system based on deep learning.
High-precision road traffic sign detection system the present invention also provides another kind based on deep learning.
Another high-precision road traffic sign detection system based on deep learning of the invention, comprising:
Image collecting device, is configured as the Traffic Sign Images of acquisition history, and is sent to server;
The server, is configured as:
Overlapping cutting is carried out by the Traffic Sign Images of the history of acquisition and in proportion, then is input to SSD network, untilTo optimal SSD network parameter;
Extracted using the optimal SSD network of parameter cutting after Traffic Sign Images traffic sign feature and according to whetherIt is divided into these two types of traffic sign features of positive and negative classification for traffic sign feature and stores to Traffic Sign Images Test database;
Using Traffic Sign Images Test database come training convolutional neural networks, until obtaining optimal convolutional Neural netNetwork parameter;
The friendship of the Traffic Sign Images after overlapping is cut in proportion in video flowing is extracted using the optimal SSD network of parameterLogical flag sign, then the traffic sign feature of extraction is input to the optimal convolutional neural networks of parameter, and then extract trafficThe feature of flag sign;
By these two types of traffic positive and negative in the feature for the traffic sign feature extracted and Traffic Sign Images Test databaseFlag sign is matched respectively, and retains positive class traffic sign feature;
In Traffic Sign Images before final testing result to be restored to overlapping cutting in proportion.
Further, the server is also configured in proportion carry out the Traffic Sign Images of collected historyPosition coordinates of the Traffic Sign Images in the Traffic Sign Images before overlapping cutting after overlapping cutting, after saving cutting.
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, and save the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in Traffic Sign Images are that accurate reproduction Traffic Sign Images improve coordinate basis.
Further, the server is also configured to use default parameters first during training SSD networkIt is trained, according to training intermediate result, initial weight, training rate and the number of iterations is constantly adjusted, until describedSSD network reaches preset recognition effect with preset efficiency.
SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the friendship after overlapping cutting in proportionThe traffic sign feature of logical sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
Further, the server, during being also configured to training convolutional neural networks, first using defaultParameter is trained, and according to training intermediate result, is constantly adjusted to initial weight, training rate and the number of iterations, untilThe convolutional neural networks reach preset recognition effect with preset efficiency.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
SSD network of the present invention, full name in English are as follows: Single Shot MultiBox Detector network,It is after carrying out convolution to image using single convolutional neural networks, prediction is a series of not at each position of characteristic imageWith the bounding box of size and length-width ratio.In test phase, SSD network is to the object for separately including each classification in each bounding boxA possibility that body, is predicted, and is adjusted to bounding box to adapt to the shape of target object.
Compared with prior art, the beneficial effects of the present invention are:
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, by SSD network and convolutional neural networks to Traffic Sign Images dataFeature extraction is carried out, and the testing result by obtaining after SSD training refreshes high-precision Traffic Sign Images database, greatlyImprove the accuracy rate and detection accuracy of feature extraction.
Detailed description of the invention
The accompanying drawings constituting a part of this application is used to provide further understanding of the present application, and the application's showsMeaning property embodiment and its explanation are not constituted an undue limitation on the present application for explaining the application.
Fig. 1 is a kind of process signal of the high-precision method for traffic sign detection based on deep learning in the embodiment of the present inventionFigure;
Fig. 2 is a kind of high-precision road traffic sign detection system structure signal based on deep learning in the embodiment of the present inventionFigure;
Fig. 3 is that another kind is illustrated based on the high-precision road traffic sign detection system structure of deep learning in the embodiment of the present inventionFigure.
Specific embodiment
It is noted that following detailed description is all illustrative, it is intended to provide further instruction to the application.Unless anotherIt indicates, all technical and scientific terms used herein has usual with the application person of an ordinary skill in the technical fieldThe identical meanings of understanding.
It should be noted that term used herein above is merely to describe specific embodiment, and be not intended to restricted rootAccording to the illustrative embodiments of the application.As used herein, unless the context clearly indicates otherwise, otherwise singularAlso it is intended to include plural form, additionally, it should be understood that, when in the present specification using term "comprising" and/or " packetInclude " when, indicate existing characteristics, step, operation, device, component and/or their combination.
As background technique is introduced, the problem lower to the accuracy rate of road traffic sign detection exists in the prior art,In order to solve technical problem as above, the invention proposes a kind of high-precision method for traffic sign detection based on deep learning.
Fig. 1 is a kind of process signal of the high-precision method for traffic sign detection based on deep learning in the embodiment of the present inventionFigure, high-precision method for traffic sign detection of one of the present embodiment as shown in the figure based on deep learning may include:
S101 acquires the Traffic Sign Images of history and carries out overlapping cutting in proportion, then is input to SSD network, untilObtain optimal SSD network parameter.
In the specific implementation, acquiring the Traffic Sign Images of history and carrying out overlapping cutting in proportion, after cutting being overlappedTraffic Sign Images are stored to historical traffic sign image database.Then it is selected out of historical traffic sign image database againTake the sample of trained SSD network, the sample set of composing training SSD network.
It during training SSD network, is trained first using default parameters, according to training intermediate result, to firstBeginning weight, training rate and the number of iterations are constantly adjusted, until the SSD network reaches preset knowledge with preset efficiencyOther effect.SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the traffic after overlapping cutting in proportionThe traffic sign feature of sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
S102, extracted using the optimal SSD network of parameter cutting after Traffic Sign Images traffic sign feature and byAccording to whether being that traffic sign feature is divided into these two types of traffic sign features of positive and negative classification and stores to Traffic Sign Images testing numberAccording to library.
In the specific implementation, the traffic sign for extracting Traffic Sign Images after cutting using the optimal SSD network of parameter is specialIt levies and stores to Traffic Sign Images Test database;For the traffic sign feature extracted using the optimal SSD network of parameter,If traffic sign feature, then the class that is positive traffic sign feature;If not traffic sign feature, then the class that is negative traffic sign is specialSign.
Wherein, these two types of traffic sign features of positive and negative classification are stored to Traffic Sign Images Test database.
S103, using Traffic Sign Images Test database come training convolutional neural networks, until obtaining optimal convolutionNeural network parameter.
In the specific implementation, the training set of training convolutional neural networks is chosen from Traffic Sign Images Test database, andIt is input in convolutional neural networks.Wherein, convolutional neural networks from be input to output include convolutional layer, pond layer, articulamentum andSoftmax returns classifier layer.Softmax returns classifier layer and there was only one layer, and the number of plies of convolutional layer, pond layer and articulamentumIt is set according to actual conditions or adjusts.Such as: convolutional neural networks include three-layer coil lamination, three layers of pond layer, three layers of full connectionLayer and classifier layer is returned positioned at last softmax.
During hands-on convolutional neural networks, it is trained first using default parameters, it is intermediate according to trainingAs a result, being constantly adjusted to initial weight, training rate and the number of iterations, until the convolutional neural networks are with preset effectRate reaches preset recognition effect.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
S104 extracts the traffic indication map after overlapping is cut in proportion in video flowing using the optimal SSD network of parameterThe traffic sign feature of picture, then the traffic sign feature of extraction is input to the optimal convolutional neural networks of parameter, and then extractThe feature of traffic sign feature out.
In the specific implementation, after carrying out overlapping cutting in proportion in video flowing using the extraction of trained SSD networkTraffic sign feature, the traffic sign feature extracted according to SSD network, using trained convolutional neural networks to extraction bandFeature carry out further training screening.
S105, by positive and negative these two types in the feature for the traffic sign feature extracted and Traffic Sign Images Test databaseTraffic sign feature is matched respectively, and retains positive class traffic sign feature.
In the specific implementation, if the feature for the traffic sign feature extracted and positive class traffic sign characteristic matching, are extractedTo the feature of traffic sign feature retain the traffic sign feature, and then detect Traffic Sign Images.
Final testing result is restored in the Traffic Sign Images before overlapping is cut by S106 in proportion.
In another embodiment, it after the Traffic Sign Images of collected history being carried out overlapping cutting in proportion, protectsPosition coordinates of the Traffic Sign Images in the Traffic Sign Images before overlapping cutting after depositing cutting.
In this way by using there is the cutting method of overlapping to cut image, the ratio that target object accounts for original image is increasedExample can effectively improve the accuracy rate of feature extraction, and save friendship of the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in logical sign image are that accurate reproduction Traffic Sign Images improve coordinate basis.
The present embodiment combines depth learning technology with high-precision road traffic sign detection technology, by SSD network andConvolutional neural networks are trained, and are extracted after carrying out overlapping cutting in proportion in video flowing using trained SSD networkTraffic sign feature, the traffic sign feature extracted according to SSD network, utilize trained convolutional neural networks extract hand overThe feature of logical flag sign, by the feature for the traffic sign feature extracted and positive and negative the two of Traffic Sign Images Test databaseThe feature of class traffic sign is matched, and positive class traffic sign feature is retained, and obtains high-precision traffic sign matching the selection result,Effectively improve the accuracy rate of high-precision road traffic sign detection.
Fig. 2 is a kind of high-precision road traffic sign detection system structure signal based on deep learning in the embodiment of the present inventionFigure, high-precision road traffic sign detection system of one of the present embodiment as shown in the figure based on deep learning may include:
(1) SSD network training module is used to acquire the Traffic Sign Images of history and carries out overlapping cutting in proportion,It is input to SSD network again, until obtaining optimal SSD network parameter.
In the specific implementation, acquiring the Traffic Sign Images of history and carrying out overlapping cutting in proportion, after cutting being overlappedTraffic Sign Images are stored to historical traffic sign image database.Then it is selected out of historical traffic sign image database againTake the sample of trained SSD network, the sample set of composing training SSD network.
It during training SSD network, is trained first using default parameters, according to training intermediate result, to firstBeginning weight, training rate and the number of iterations are constantly adjusted, until the SSD network reaches preset knowledge with preset efficiencyOther effect.SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the traffic after overlapping cutting in proportionThe traffic sign feature of sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
(2) tagsort module is used to extract Traffic Sign Images after cutting using the optimal SSD network of parameterTraffic sign feature and according to whether being divided into these two types of traffic sign features of positive and negative classification for traffic sign feature and store best friendLogical sign image Test database.
In the specific implementation, the traffic sign for extracting Traffic Sign Images after cutting using the optimal SSD network of parameter is specialIt levies and stores to Traffic Sign Images Test database;For the traffic sign feature extracted using the optimal SSD network of parameter,If traffic sign feature, then the class that is positive traffic sign feature;If not traffic sign feature, then the class that is negative traffic sign is specialSign.
Wherein, these two types of traffic sign features of positive and negative classification are stored to Traffic Sign Images Test database.
(3) convolutional neural networks training module is used for using Traffic Sign Images Test database come training convolutional mindThrough network, until obtaining optimal convolutional neural networks parameter.
In the specific implementation, the training set of training convolutional neural networks is chosen from Traffic Sign Images Test database, andIt is input in convolutional neural networks.Wherein, convolutional neural networks from be input to output include convolutional layer, pond layer, articulamentum andSoftmax returns classifier layer.Softmax returns classifier layer and there was only one layer, and the number of plies of convolutional layer, pond layer and articulamentumIt is set according to actual conditions or adjusts.Such as: convolutional neural networks include three-layer coil lamination, three layers of pond layer, three layers of full connectionLayer and classifier layer is returned positioned at last softmax.
During hands-on convolutional neural networks, it is trained first using default parameters, it is intermediate according to trainingAs a result, being constantly adjusted to initial weight, training rate and the number of iterations, until the convolutional neural networks are with preset effectRate reaches preset recognition effect.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
(4) characteristic extracting module is used to be extracted using the optimal SSD network of parameter in video flowing to be overlapped in proportion and be cutThe traffic sign feature of Traffic Sign Images after cutting, then the traffic sign feature of extraction is input to the optimal convolution mind of parameterThrough network, and then extract the feature of traffic sign feature.
In the specific implementation, after carrying out overlapping cutting in proportion in video flowing using the extraction of trained SSD networkTraffic sign feature, the traffic sign feature extracted according to SSD network, using trained convolutional neural networks to extraction bandFeature carry out further training screening.
(5) characteristic matching module, the feature and Traffic Sign Images for the traffic sign feature for being used to extract detectPositive and negative these two types traffic sign feature is matched respectively in database, and retains positive class traffic sign feature.
In the specific implementation, if the feature for the traffic sign feature extracted and positive class traffic sign characteristic matching, are extractedTo the feature of traffic sign feature retain the traffic sign feature, and then detect Traffic Sign Images.
(6) image restoring module, the traffic mark before being used to for final testing result being restored to overlapping cutting in proportionIn will image.
In another embodiment, which further includes cutting traffic indication map image position logging modle, is used to acquireTo history Traffic Sign Images carry out overlapping cutting in proportion after, save cutting after Traffic Sign Images cut in overlappingThe position coordinates in Traffic Sign Images before cutting.
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, and save the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in Traffic Sign Images are that accurate reproduction Traffic Sign Images improve coordinate basis.
The present embodiment combines depth learning technology with high-precision road traffic sign detection technology, by SSD network andConvolutional neural networks are trained, and are extracted after carrying out overlapping cutting in proportion in video flowing using trained SSD networkTraffic sign feature, the traffic sign feature extracted according to SSD network, utilize trained convolutional neural networks extract hand overThe feature of logical flag sign, by the feature for the traffic sign feature extracted and positive and negative the two of Traffic Sign Images Test databaseThe feature of class traffic sign is matched, and positive class traffic sign feature is retained, and obtains high-precision traffic sign matching the selection result,Effectively improve the accuracy rate of high-precision road traffic sign detection.
Fig. 3 is that another kind is illustrated based on the high-precision road traffic sign detection system structure of deep learning in the embodiment of the present inventionFigure, high-precision road traffic sign detection system of one of the present embodiment as shown in the figure based on deep learning may include:
(1) image collecting device, is configured as the Traffic Sign Images of acquisition history, and is sent to server.
Wherein, image collecting device can be realized using video camera, be used to acquire traffic mark image.
(2) server is configured as:
Overlapping cutting is carried out by the Traffic Sign Images of the history of acquisition and in proportion, then is input to SSD network, untilTo optimal SSD network parameter;
Extracted using the optimal SSD network of parameter cutting after Traffic Sign Images traffic sign feature and according to whetherIt is divided into these two types of traffic sign features of positive and negative classification for traffic sign feature and stores to Traffic Sign Images Test database;
Using Traffic Sign Images Test database come training convolutional neural networks, until obtaining optimal convolutional Neural netNetwork parameter;
The friendship of the Traffic Sign Images after overlapping is cut in proportion in video flowing is extracted using the optimal SSD network of parameterLogical flag sign, then the traffic sign feature of extraction is input to the optimal convolutional neural networks of parameter, and then extract trafficThe feature of flag sign;
By these two types of traffic positive and negative in the feature for the traffic sign feature extracted and Traffic Sign Images Test databaseFlag sign is matched respectively, and retains positive class traffic sign feature;
In Traffic Sign Images before final testing result to be restored to overlapping cutting in proportion.
In another embodiment, the server, be also configured to by the Traffic Sign Images of collected history by thanPosition of the Traffic Sign Images in the Traffic Sign Images before overlapping cutting after example carries out overlapping cutting, after saving cuttingCoordinate.
The present invention increases target object and accounts for original image by using there is the cutting method of overlapping to cut imageRatio can effectively improve the accuracy rate of feature extraction, and save the Traffic Sign Images after cutting before overlapping cuttingPosition coordinates in Traffic Sign Images are that accurate reproduction Traffic Sign Images improve coordinate basis.
In another embodiment, the server is also configured to during training SSD network, first using silentRecognize parameter to be trained, according to training intermediate result, initial weight, training rate and the number of iterations are constantly adjusted, directlyPreset recognition effect is reached with preset efficiency to the SSD network.
SSD network parameter that in this way can be optimal, and then accurately extract in video flowing the friendship after overlapping cutting in proportionThe traffic sign feature of logical sign image is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
In another embodiment, the server during being also configured to training convolutional neural networks, makes firstIt is trained with default parameters, according to training intermediate result, initial weight, training rate and the number of iterations is constantly adjustedIt is whole, until the convolutional neural networks reach preset recognition effect with preset efficiency.
Convolutional neural networks parameter that in this way can be optimal, and then the traffic sign for accurately extracting Traffic Sign Images is specialThe feature of sign is the accuracy rate of traffic sign feature extraction and the basis that detection accuracy is established.
The present embodiment combines depth learning technology with high-precision road traffic sign detection technology, by SSD network andConvolutional neural networks are trained, and are extracted after carrying out overlapping cutting in proportion in video flowing using trained SSD networkTraffic sign feature, the traffic sign feature extracted according to SSD network, utilize trained convolutional neural networks extract hand overThe feature of logical flag sign, by the feature for the traffic sign feature extracted and positive and negative the two of Traffic Sign Images Test databaseThe feature of class traffic sign is matched, and positive class traffic sign feature is retained, and obtains high-precision traffic sign matching the selection result,Effectively improve the accuracy rate of high-precision road traffic sign detection.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer programProduct.Therefore, the shape of hardware embodiment, software implementation or embodiment combining software and hardware aspects can be used in the present inventionFormula.Moreover, the present invention, which can be used, can use storage in the computer that one or more wherein includes computer usable program codeThe form for the computer program product implemented on medium (including but not limited to magnetic disk storage and optical memory etc.).
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program productFigure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructionsThe combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programsInstruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produceA raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for realThe device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spyDetermine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram orThe function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that countingSeries of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer orThe instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram oneThe step of function of being specified in a box or multiple boxes.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be withRelevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage mediumIn, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magneticDish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (RandomAccessMemory, RAM) etc..
Above-mentioned, although the foregoing specific embodiments of the present invention is described with reference to the accompanying drawings, not protects model to the present inventionThe limitation enclosed, those skilled in the art should understand that, based on the technical solutions of the present invention, those skilled in the art are notNeed to make the creative labor the various modifications or changes that can be made still within protection scope of the present invention.

Claims (10)

Translated fromChinese
1.一种基于深度学习的高精度交通标志检测方法,其特征在于,包括:1. a high-precision traffic sign detection method based on deep learning, is characterized in that, comprises:步骤1:采集历史的交通标志图像并按比例进行重叠切割,再输入至SSD网络,直至得到最优的SSD网络参数;Step 1: Collect historical traffic sign images, overlap and cut them proportionally, and then input them to the SSD network until the optimal SSD network parameters are obtained;步骤2:采用参数最优的SSD网络来提取切割后交通标志图像的交通标志特征并按照是否为交通标志特征分成正负分类这两类交通标志特征并存储至交通标志图像检测数据库;Step 2: Use the SSD network with the optimal parameters to extract the traffic sign features of the cut traffic sign images and divide them into two types of traffic sign features, positive and negative, according to whether they are traffic sign features and store them in the traffic sign image detection database;步骤3:利用交通标志图像检测数据库来训练卷积神经网络,直至得到最优的卷积神经网络参数;Step 3: Use the traffic sign image detection database to train the convolutional neural network until the optimal convolutional neural network parameters are obtained;步骤4:利用参数最优的SSD网络来提取视频流中按比例重叠切割后的交通标志图像的交通标志特征,再将提取的交通标志特征输入至参数最优的卷积神经网络,进而提取出交通标志特征的特征;Step 4: Use the SSD network with the optimal parameters to extract the traffic sign features of the traffic sign images that are overlapped and cut proportionally in the video stream, and then input the extracted traffic sign features into the convolutional neural network with the optimal parameters, and then extract the characteristics of traffic sign features;步骤5:将提取到的交通标志特征的特征与交通标志图像检测数据库中正负这两类交通标志特征分别进行匹配,并保留正类交通标志特征;Step 5: Match the features of the extracted traffic sign features with the positive and negative traffic sign features in the traffic sign image detection database, respectively, and retain the positive traffic sign features;步骤6:将最终的检测结果按比例还原至重叠切割前的交通标志图像中。Step 6: Restore the final detection result to the traffic sign image before overlapping cutting in proportion.2.如权利要求1所述的基于深度学习的高精度交通标志检测方法,其特征在于,在所述步骤1中,将采集到的历史的交通标志图像按比例进行重叠切割之后,保存切割后的交通标志图像在重叠切割前的交通标志图像中的位置坐标。2. The high-precision traffic sign detection method based on deep learning as claimed in claim 1, wherein in the step 1, after the collected historical traffic sign images are overlapped and cut in proportion, the cut The location coordinates of the traffic sign image in the traffic sign image before overlapping cutting.3.如权利要求1所述的基于深度学习的高精度交通标志检测方法,其特征在于,在所述步骤1训练SSD网络的过程中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述SSD网络以预设的效率达到预设的识别效果。3. The high-precision traffic sign detection method based on deep learning as claimed in claim 1, characterized in that, in the process of training the SSD network in the step 1, first use default parameters for training, and according to the intermediate results of the training, the initial The weights, the training rate and the number of iterations are continuously adjusted until the SSD network achieves a preset recognition effect with a preset efficiency.4.如权利要求1所述的基于深度学习的高精度交通标志检测方法,其特征在于,在所述步骤3训练卷积神经网络的过程中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述卷积神经网络以预设的效率达到预设的识别效果。4. the high-precision traffic sign detection method based on deep learning as claimed in claim 1, is characterized in that, in the process of described step 3 training convolutional neural network, first use default parameter to train, according to training intermediate result, The initial weights, the training rate and the number of iterations are continuously adjusted until the convolutional neural network achieves a preset recognition effect with a preset efficiency.5.一种基于深度学习的高精度交通标志检测系统,其特征在于,包括:5. A high-precision traffic sign detection system based on deep learning, characterized in that, comprising:SSD网络训练模块,其用于采集历史的交通标志图像并按比例进行重叠切割,再输入至SSD网络,直至得到最优的SSD网络参数;The SSD network training module is used to collect historical traffic sign images, overlap and cut them in proportion, and then input them to the SSD network until the optimal SSD network parameters are obtained;特征分类模块,其用于采用参数最优的SSD网络来提取切割后交通标志图像的交通标志特征并按照是否为交通标志特征分成正负分类这两类交通标志特征并存储至交通标志图像检测数据库;The feature classification module is used to use the SSD network with the optimal parameters to extract the traffic sign features of the cut traffic sign images, and divide them into two types of traffic sign features according to whether they are traffic sign features, positive and negative, and store them in the traffic sign image detection database. ;卷积神经网络训练模块,其用于利用交通标志图像检测数据库来训练卷积神经网络,直至得到最优的卷积神经网络参数;A convolutional neural network training module, which is used to train a convolutional neural network using a traffic sign image detection database until optimal parameters of the convolutional neural network are obtained;特征提取模块,其用于利用参数最优的SSD网络来提取视频流中按比例重叠切割后的交通标志图像的交通标志特征,再将提取的交通标志特征输入至参数最优的卷积神经网络,进而提取出交通标志特征的特征;The feature extraction module is used to extract the traffic sign features of the traffic sign images in the video stream after overlapping and cutting in proportion by using the SSD network with the optimal parameters, and then input the extracted traffic sign features into the convolutional neural network with the optimal parameters , and then extract the features of traffic sign features;特征匹配模块,其用于将提取到的交通标志特征的特征与交通标志图像检测数据库中正负这两类交通标志特征分别进行匹配,并保留正类交通标志特征;The feature matching module is used to match the extracted features of the traffic sign with the positive and negative traffic sign features in the traffic sign image detection database respectively, and retain the positive traffic sign features;图像还原模块,其用于将最终的检测结果按比例还原至重叠切割前的交通标志图像中。The image restoration module is used to restore the final detection result to the traffic sign image before overlapping cutting in proportion.6.如权利要求5所述的一种基于深度学习的高精度交通标志检测系统,其特征在于,该系统还包括位置记录模块,其用于将采集到的历史的交通标志图像按比例进行重叠切割之后,保存切割后的交通标志图像在重叠切割前的交通标志图像中的位置坐标。6 . The high-precision traffic sign detection system based on deep learning according to claim 5 , wherein the system further comprises a position recording module, which is used to overlap the collected historical traffic sign images in proportion. 7 . After cutting, save the position coordinates of the cut traffic sign image in the traffic sign image before overlapping cutting.7.如权利要求5所述的一种基于深度学习的高精度交通标志检测系统,其特征在于,在所述SSD网络训练模块中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述SSD网络以预设的效率达到预设的识别效果;7. A high-precision traffic sign detection system based on deep learning as claimed in claim 5, wherein, in the SSD network training module, first use default parameters for training, and according to the intermediate results of training, the initial weight is The value, the training rate and the number of iterations are continuously adjusted until the SSD network reaches the preset recognition effect with the preset efficiency;或在所述卷积神经网络训练模块中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述卷积神经网络以预设的效率达到预设的识别效果。Or in the convolutional neural network training module, first use default parameters for training, and according to the intermediate results of training, the initial weights, training rates and the number of iterations are continuously adjusted until the convolutional neural network reaches a preset efficiency. achieve the preset recognition effect.8.一种基于深度学习的高精度交通标志检测系统,其特征在于,包括:8. A high-precision traffic sign detection system based on deep learning, comprising:图像采集装置,其被配置为采集历史的交通标志图像,并传送至服务器;an image capture device configured to capture historical traffic sign images and transmit them to the server;所述服务器,其被配置为:The server, which is configured as:将采集的历史的交通标志图像并按比例进行重叠切割,再输入至SSD网络,直至得到最优的SSD网络参数;The collected historical traffic sign images are overlapped and cut proportionally, and then input to the SSD network until the optimal SSD network parameters are obtained;采用参数最优的SSD网络来提取切割后交通标志图像的交通标志特征并按照是否为交通标志特征分成正负分类这两类交通标志特征并存储至交通标志图像检测数据库;Adopt the SSD network with optimal parameters to extract the traffic sign features of the cut traffic sign images and divide them into two types of traffic sign features according to whether they are traffic sign features, positive and negative, and store them in the traffic sign image detection database;利用交通标志图像检测数据库来训练卷积神经网络,直至得到最优的卷积神经网络参数;Use the traffic sign image detection database to train the convolutional neural network until the optimal convolutional neural network parameters are obtained;利用参数最优的SSD网络来提取视频流中按比例重叠切割后的交通标志图像的交通标志特征,再将提取的交通标志特征输入至参数最优的卷积神经网络,进而提取出交通标志特征的特征;The SSD network with the optimal parameters is used to extract the traffic sign features of the traffic sign images that are overlapped and cut in proportion in the video stream, and then the extracted traffic sign features are input to the convolutional neural network with the optimal parameters, and then the traffic sign features are extracted. Characteristics;将提取到的交通标志特征的特征与交通标志图像检测数据库中正负这两类交通标志特征分别进行匹配,并保留正类交通标志特征;Match the features of the extracted traffic sign features with the positive and negative traffic sign features in the traffic sign image detection database respectively, and keep the positive traffic sign features;将最终的检测结果按比例还原至重叠切割前的交通标志图像中。The final detection result is scaled back to the traffic sign image before overlapping cutting.9.如权利要求8所述的一种基于深度学习的高精度交通标志检测系统,其特征在于,所述服务器,还被配置为:将采集到的历史的交通标志图像按比例进行重叠切割之后,保存切割后的交通标志图像在重叠切割前的交通标志图像中的位置坐标。9 . The high-precision traffic sign detection system based on deep learning according to claim 8 , wherein the server is further configured to: after the collected historical traffic sign images are overlapped and cut proportionally. 10 . , and save the position coordinates of the cut traffic sign image in the traffic sign image before overlapping cutting.10.如权利要求8所述的一种基于深度学习的高精度交通标志检测系统,其特征在于,所述服务器,还被配置为:在训练SSD网络的过程中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述SSD网络以预设的效率达到预设的识别效果;10 . The high-precision traffic sign detection system based on deep learning according to claim 8 , wherein the server is further configured to: in the process of training the SSD network, first use default parameters for training, 10 . According to the intermediate results of training, the initial weight, training rate and number of iterations are continuously adjusted until the SSD network achieves a preset recognition effect with a preset efficiency;或所述服务器,还被配置为:训练卷积神经网络的过程中,首先使用默认参数进行训练,根据训练中间结果,对初始权值、训练速率和迭代次数不断进行调整,直到所述卷积神经网络以预设的效率达到预设的识别效果。Or the server is further configured to: in the process of training the convolutional neural network, first use the default parameters for training, and continuously adjust the initial weights, training rate and the number of iterations according to the intermediate results of training, until the convolutional neural network is The neural network achieves a preset recognition effect with a preset efficiency.
CN201710041906.1A2017-01-202017-01-20 A high-precision traffic sign detection method and system based on deep learningActiveCN106909886B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201710041906.1ACN106909886B (en)2017-01-202017-01-20 A high-precision traffic sign detection method and system based on deep learning

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201710041906.1ACN106909886B (en)2017-01-202017-01-20 A high-precision traffic sign detection method and system based on deep learning

Publications (2)

Publication NumberPublication Date
CN106909886A CN106909886A (en)2017-06-30
CN106909886Btrue CN106909886B (en)2019-05-03

Family

ID=59207028

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201710041906.1AActiveCN106909886B (en)2017-01-202017-01-20 A high-precision traffic sign detection method and system based on deep learning

Country Status (1)

CountryLink
CN (1)CN106909886B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN108230421A (en)*2017-09-192018-06-29北京市商汤科技开发有限公司A kind of road drawing generating method, device, electronic equipment and computer storage media
CN107909021A (en)*2017-11-072018-04-13浙江师范大学A kind of guideboard detection method based on single deep layer convolutional neural networks
CN108009518A (en)*2017-12-192018-05-08大连理工大学A kind of stratification traffic mark recognition methods based on quick two points of convolutional neural networks
CN108615230A (en)*2018-03-162018-10-02北京邮电大学A kind of hub surface method for detecting abnormality and system
JP6985207B2 (en)*2018-05-092021-12-22トヨタ自動車株式会社 Autonomous driving system
CN109447066B (en)*2018-10-182021-08-20中国人民武装警察部队海警学院Rapid and accurate single-stage target detection method and device
EP3602410B1 (en)*2019-01-112021-09-29Advanced New Technologies Co., Ltd.A logistic regression modeling scheme using secret sharing
CN112784084B (en)*2019-11-082024-01-26阿里巴巴集团控股有限公司Image processing method and device and electronic equipment
CN111243310B (en)*2020-01-102021-08-31广州大学 Traffic sign recognition method, system, medium and device
CN113762039B (en)*2021-04-292025-06-27腾讯科技(深圳)有限公司 Traffic sign information matching method and related device
US11887379B2 (en)2021-08-172024-01-30Robert Bosch GmbhRoad sign content prediction and search in smart data management for training machine learning model
US11978264B2 (en)2021-08-172024-05-07Robert Bosch GmbhScalable road sign knowledge graph construction with machine learning and human in the loop
CN120353810A (en)*2025-06-252025-07-22中国石油大学(华东)Road traffic sign updating method based on crowd source data

Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105930830A (en)*2016-05-182016-09-07大连理工大学 A road traffic sign recognition method based on convolutional neural network
CN106022300A (en)*2016-06-022016-10-12中国科学院信息工程研究所Traffic sign identifying method and traffic sign identifying system based on cascading deep learning
CN106326858A (en)*2016-08-232017-01-11北京航空航天大学Road traffic sign automatic identification and management system based on deep learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN105930830A (en)*2016-05-182016-09-07大连理工大学 A road traffic sign recognition method based on convolutional neural network
CN106022300A (en)*2016-06-022016-10-12中国科学院信息工程研究所Traffic sign identifying method and traffic sign identifying system based on cascading deep learning
CN106326858A (en)*2016-08-232017-01-11北京航空航天大学Road traffic sign automatic identification and management system based on deep learning

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Wei Liu etc..SSD: Single Shot MultiBox Detector.《European Conference on Computer Vision》.2016,
基于图模型与卷积神经网络的交通标志识别方法;刘占文等;《交通运输工程学报》;20161031;第122-130页
基于联合卷积和递归神经网络的交通标志识别;宣森炎等;《传感器与微系统》;20140331;第33卷(第8期);第30-33页

Also Published As

Publication numberPublication date
CN106909886A (en)2017-06-30

Similar Documents

PublicationPublication DateTitle
CN106909886B (en) A high-precision traffic sign detection method and system based on deep learning
CN112270249B (en)Target pose estimation method integrating RGB-D visual characteristics
CN113160062B (en)Infrared image target detection method, device, equipment and storage medium
CN111080794B (en) A 3D reconstruction method for edge-cloud collaboration in arable land
CN111914813B (en)Power transmission line inspection image naming method and system based on image classification
CN110222787A (en)Multiscale target detection method, device, computer equipment and storage medium
CN110245644A (en)A kind of unmanned plane image transmission tower lodging knowledge method for distinguishing based on deep learning
CN111213155A (en) Image processing method, equipment, movable platform, unmanned aerial vehicle and storage medium
CN107085696A (en)A kind of vehicle location and type identifier method based on bayonet socket image
CN114841923B (en) A high-precision real-time crack detection method based on drones
WO2017041396A1 (en)Driving lane data processing method, device, storage medium and apparatus
CN111461319A (en)CNN-based object detection method and device capable of adapting to user requirements
CN106897681A (en)A kind of remote sensing images comparative analysis method and system
CN117351359B (en)Mining area unmanned aerial vehicle image sea-buckthorn identification method and system based on improved Mask R-CNN
KR102416714B1 (en)System and method for city-scale tree mapping using 3-channel images and multiple deep learning
CN117274826A (en)River and lake management violation problem remote sensing monitoring method based on large model and prompt guidance
CN111127520A (en) A method and system for vehicle tracking based on video analysis
CN105825207A (en)Fragmented high-voltage line detection method and device
CN115294472A (en)Fruit yield estimation method, model training method, equipment and storage medium
CN119048932A (en)Landslide crack identification method based on unmanned aerial vehicle orthographic image and pyramid scene analysis network image segmentation algorithm
CN118097465A (en) A method for positioning and identifying rice ears in the field based on UAV images and deep learning
CN119763000B (en)Saline-alkali soil information monitoring and treatment method and system
CN117710592A (en)Map topology detection system, method, electronic equipment and storage medium
CN119418285A (en)Road defect detection method based on DRR module and SDFM
CN112419345A (en)Patrol car high-precision tracking method based on echo state network

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp