Summary of the invention
The main purpose of the present invention is to provide a kind of adaptability object sorter for having parallel framework and its methods, put downRow handles multiple barrier images, so as to accelerate image processing efficiency, and then simplifies the complexity and reduction of image processingIt is time-consuming.
Another object of the present invention is to provide a kind of adaptability object sorter for having parallel framework and its method,Corresponding scene can be judged according to the image captured, it can be according to various different scenes come elastic adjustment classifier parameters, energyThe higher barrier image of accuracy and its type are calculated, enough to solve the problems, such as existing detecting system erroneous judgement.
Another object of the present invention is to provide a kind of adaptability object sorter for having parallel framework and its method,It can select barrier image capturing range appropriate according to the remote depth of the image captured and the size of barrier image, frame and carry out shadow againAs processing, it is able to ascend image processing efficiency.
A further object of the present invention is to provide a kind of adaptability object sorter for having parallel framework and its method,It is embeddable in the anti-collision system of vehicle, to achieve the purpose that detecting real-time.
In order to achieve the above object, the present invention provides a kind of adaptability object classification method for having parallel framework, the partyThe step of method includes more scenario parameters of storage and more classifier parameters, adaptability object classification method includes the following steps:Capture an at least image data;Frame selects multiple barrier images in image data, and according to each barrier image capturing rangeSelect selection range appropriate.Multiple image process units are recycled to respectively correspond more barriers for calculating multiple barrier imagesHinder object characteristic, and chooses corresponding scenario parameters and corresponding multiple classifier parameters according to multiple barrier characteristicsAnd operation is carried out, to obtain more classification data.Wherein, multiple classifier parameters include more directions of different obstacle speciesGradient Features parameter, each classification data are multiplied by corresponding classifier parameters by each barrier characteristic, and add up andIt obtains.Whether match stop data are greater than a floating threshold, the corresponding obstacle species of floating threshold, if so, determining classificationThe corresponding obstacle species of data, and export institute's frame and select the position of barrier image, appoint if it is not, then determining that classification data is not correspondingWhat obstacle species.Since the present invention not only can effectively shorten operation time with the multiple barrier images of parallel processing, fromAnd achieve the purpose that detecting real-time, and corresponding scene can be judged according to image data, it can not only be suitable according to scenario parametersAnswering property adjusts classifier parameters, and barrier characteristic of arranging in pairs or groups carries out operation to obtain more reliable classification data, therefore canWhole detecting accuracy, great market competition advantage is substantially improved.
Wherein, further comprising the steps of before frame selects multiple barrier image steps: from image data select one have it is emergingInteresting region, then select from interesting region center multiple barrier images in image data.And in view of in image dataMultiple barrier images have remote depth and image size issue, therefore after frame selects multiple barrier image steps, it further include that adjustment is everyThe step of selection range size of one barrier image.
Wherein, direction gradient algorithm is further comprising the steps of: first calculating the marginal value of each barrier image, direction gradientEach barrier image is divided into multiple block of cells by algorithm (HOG), then calculates the direction of each pixel in each block of cellsAnd edge parameter value and add up, to obtain nine feature vectors, and nine feature vectors in each block of cells are counted, is hinderedHinder the barrier characteristic of object image.
The present invention also provides a kind of adaptability object sorter for having parallel framework, which stores more scenesParameter and more classifier parameters, adaptability object sorter include an at least video capture device and an image processor.ShadowAs an acquisition device acquisition at least image data, and frame selects multiple barrier images in image data, and according to each obstacleObject image capturing range selectes selection range appropriate.Image processor includes multiple image process units, multiple image process unitsMore barrier characteristics for calculating multiple barrier images are respectively corresponded, according to the selection pair of multiple barrier characteristicsThe contextual data and corresponding multiple classifier parameters answered simultaneously carry out operation, to obtain more classification data, then by classification dataCompared with a floating threshold, the corresponding obstacle species of floating threshold, and the institute's frame for exporting corresponding floating threshold selects barrierThe position of image.
Below by specific embodiment elaborate, when be easier to understand the purpose of the present invention, technology contents, feature and itsThe effect of reached.
Specific embodiment
To make anti-collision system (AEB) that can quickly judge braking time, the present invention provides one kind to have parallelization frameThe adaptability object sorter and its method of structure and pipelined operation technology, come solve the prior art can not detecting real-time lackPoint.
It is as shown in Figure 1 block schematic diagram of the invention.Adaptability object sorter is built into an anti-collision system, is fittedAnswering property object classification device includes a reservoir 10, at least a video capture device 12 and an image processor 14, image processor14 are electrically connected reservoir 10 and video capture device 12.Wherein, reservoir 10 can be synchronous dynamic random-access reservoir(Synchronous Dynamic Random Access Memory, SDRAM), internal reservoir has more scenario parameters 102And more classifier parameters 104, image processor 14 include multiple image process units 142 and multiple adjustment dimension cells(resize unit) 144, multiple image process unit 142 are electrically connected multiple adjustment dimension cells 144.Image captureAfter device 12 captures an image data 122, frame selects multiple barrier images 124 in image data 122, and according to each barrier124 range of object image is hindered to select selection range appropriate.Since video capture device 12 has far and near pick-up image ability, barrier124 range of image is also different therewith, therefore each barrier image 124 for being selected institute's frame using multiple adjustment dimension cells 144Range is adjusted to selection range appropriate, can so reduce the data volume of subsequent images processing.In order to accelerate image processing to imitateRate, center select several barrier images 124 and are just corresponding with the several progress of image process units 142 parallel processing, Yi JiyingPicture processing unit 142 and barrier image 124 are one-to-one parallel processing, therefore multiple image process units 142 are correspondingCalculate more barrier characteristics of multiple barrier images.Corresponding field is chosen further according to multiple barrier characteristicsScape parameter 102 and corresponding multiple classifier parameters 104 simultaneously carry out operation, to obtain more classification data, then by classification dataCompared with a floating threshold, the corresponding obstacle species of floating threshold, and the institute's frame for exporting corresponding floating threshold selects barrierThe position of image 124 is in a display 16.Using several 124 methods of barrier image of parallel processing, can speed up at imageEfficiency is managed, and then simplifies the complexity of image processing and reduces time-consuming.
Reach detecting real-time effect to be further understood that the present invention such as how parallel shelf structure and pipelined operation mode,As shown in Figure 1, Figure 2 and Figure 3, Fig. 2 is step flow chart of the invention, and Fig. 3 is that the multiple frame of parallelization of the invention selects barrierImage schematic diagram.Firstly, capturing an at least image data 122 such as step S10, illustrating by taking an image data as an example herein.It canAccording to dynamic interest section of driving a vehicle at present, dynamically adjust the region scanned, avoid scanning the imagery zone for not needing operation withOperand is reduced, such as step S12, an interesting region (ROI) is selected from image data, then select from interesting region centerMultiple barrier images in image data 122, multiple barrier images are vehicle, pedestrian, animal, electric pole, Lu Shu, roadblockOr above combination, as shown in figure 3, multiple barrier images include barrier image 124a, barrier image 124b, obstacleObject image 124c and barrier image 124d is respectively corresponded every to adjust such as step S14 using multiple adjustment dimension cells 144The selection range size of one barrier image 124a, 124b, 124c, 124d is chosen to be each 124 range of barrier image suitableWhen selection range, due to the difference of obstacle species, length and the shadow presented in view of shooting focal length is far and nearAs difference in size, selection range size is adjusted for different barrier images using adjustment dimension cells 144, is able to ascend shadowAs processing speed.Such as step S16, more barriers for calculating multiple barrier images are respectively corresponded using multiple image process unitsHinder object characteristic, as image process unit 142a calculates the barrier characteristic of barrier image 124a, image processingUnit 142b calculates the barrier characteristic of barrier image 124b, and image process unit 142c calculates barrier imageThe barrier characteristic of 124c, image process unit 142d calculate the barrier characteristic of barrier image 124d,In, image process unit 142a, 142b, 142c, 142d be barrier image 124a, 124b, 124c corresponding to parallel processing,124d, and corresponding scenario parameters 102 and corresponding multiple classifier parameters 104 are chosen simultaneously according to multiple barrier characteristicsOperation is carried out, to obtain more classification data.Wherein, scenario parameters 102 are overexposure scene, night scenes, on the sunny side scene or HuangConfused scene, and elastic according to different scenes can adjust, classifier parameters 104 include more direction ladders of different obstacle speciesCharacteristic parameter is spent, and can be adjusted in time according to obstacle species.Whether last such as step S18, match stop data are greater than oneFloating threshold, the corresponding obstacle species of floating threshold determine the corresponding barrier of classification data if so, thening follow the steps S20Type, and export the position that institute's frame selects barrier image;If it is not, thening follow the steps 22, then it is any to determine that classification data does not correspond toOne obstacle species, wherein obstacle species are car body, pedestrian or roadblock.Since the present invention can sentence according to the image capturedDisconnected corresponding scene out, it is higher can to calculate accuracy according to various different scenes come elastic adjustment classifier parameters 104Barrier image 124 and its type, to solve the problems, such as the erroneous judgement of existing detecting system, and in multiple image process units 142It is built in the anti-collision system of vehicle.
To further illustrate how image process unit 142 of the invention calculates the barrier characteristic of barrier imageAccording to, and how corresponding scenario parameters and corresponding classifier parameters to be chosen according to barrier characteristic and carry out operation,To obtain classification data, illustrate by taking pedestrian's detecting image as an example in this barrier image.As shown in Fig. 1 and Fig. 4 A to Fig. 4 D, figure4A to Fig. 4 D is the flow diagram of barrier in detecting image data of the present invention.Here, the present invention is that use direction gradient is calculatedMethod (Histogram of Oriented Gradient, HOG) calculates barrier characteristic value, predominantly counts the ladder of whole imageThe foundation of intensity and directional information as subsequent classification is spent, use direction gradient algorithm increases intensity for the edge of barrierAnd there is higher tolerance to barrier deformability.In addition, the more classifier parameters that the present invention stores are from supporting vectorMachine classifier (Support Vector Machine, SVM), to be corresponded to the characteristic parameter of barrier using inner product of vectorsThe separating degree of barrier characteristic value is maximum by one hyperplane.Specifically, support vector machine classifier is using hundreds of or countsThe pedestrian sample of a thousand sheets after calculating barrier characteristic value via direction gradient algorithm, then is inputted as pedestrian's image databaseTrained off-line is carried out to support vector machine classifier, finally using more classifier parameters of training result as subsequent obstacle speciesThe classification foundation of class.
As shown in Figure 4 A, an image data 122 is captured, and frame selects multiple barrier images in image data 122124a, barrier image 124b, barrier image 124c, then as shown in Figure 4 B, each 142 utilization orientation of image process unit ladderDegree algorithm first calculates the marginal value of each barrier image, and each barrier image 124 after frame is selected is divided into multiple smallBlock (block), then calculate the direction of each pixel in each block of cells and edge parameter value and add up, it is each to obtainNine feature vectors in block of cells.For example, detect barrier image 124 be pedestrian when, 124 size of barrier imageIt is 64 (n) × 128 (m), each of barrier image 124 pixel is subjected to edge detection (Edge Detection), it canThe edge direction and edge strength of each pixel are obtained, it is 16 × 16 and portion that barrier image 124, which is next divided into size,The operation for dividing the unit (cell) to overlap to carry out direction gradient algorithm, and 8 lattice of displacement every time, here, in order to reduce operation time,Pipeline design method can be utilized, data flow is pre-stored in a fritter memory (SRAM), to reduce the data-moving time,In the assisted instruction period, wherein memory is electrically connected image processor 14.Since edge direction difference 180 degree can be considered same sideTo, therefore each unit is divided into nine feature vectors, that is, each 16 × 16 blocks in 0~180 degree according to edge directionNine directions can be corresponded to, as shown in Figure 4 C, the total amount of data in this stage is a barrier characteristic of 9 × (n/8) × (m/8)According to.Wherein all pixels do ballot statistics to the direction character vector belonging to it respectively in each unit, and the poll thrown is pictureThe information of the edge strength of element, this nine directions can be represented with the vector of nine dimensions, that is, nine feature vectors.By four phasesAdjacent unit is considered as a block, can mutually overlap between different blocks, and block describes obstacle with the feature vector of its interior 4 unitThe local edge information of 124 position of object image.Parallel calculation is utilized herein, four units are calculated with the time, and willIt is put into memory to be counted, to accelerate the whole instruction cycle.It is finally represented with 36 dimensional vectors, 36 dimensional vectors are through normalization(Normalize) make vector length 1, by 36 dimensional vectors of all 7x15 blocks combine it is available 3780 dimension toAmount, this vector contain the whole information with part of pedestrian, that is, the barrier characteristic of barrier image 124.
It connects, every barrier characteristic is multiplied by corresponding classifier parameters, such as barrier characteristic 9 ×(n/8) × (m/8) is multiplied by classifier parameters 9 × (n/8) × (m/8), and adds up and obtain an end value, this end value frame thusThe score of favored area represents this frame favored area with detected barrier as soon as such score is greater than floating threshold, it is on the contrary thenClear, as shown in Figure 4 D, herein for detecting pedestrian, therefore, the score of frame favored area is greater than one floating threshold, that is, tableShow that frame favored area has detected barrier for pedestrian, and pedestrian's image of display box favored area, such as shows barrier image124b, barrier image 124c;Conversely, the score of frame favored area is less than a floating threshold, then frame favored area, which has, is detectedBarrier non-pedestrian, thus it is for example possible to be vehicle, roadblock or other barriers or without any barrier.Not due to obstacle speciesTogether, classifier parameters can also change therewith with floating threshold, therefore can adjust classifier parameters in real time, more accurately be detectd with reachingEfficiency is surveyed, existing generate because scenario parameters and sorting parameter can not be adaptively adjusted is no longer limited to and detects asking for mistakeTopic.That is, image process unit 142 can choose corresponding scenario parameters and corresponding classification according to barrier characteristicDevice parameter simultaneously carries out operation, to obtain classification data, reinforces the identification precision of this device.In conclusion due to the prior artObstruction detection and sort out obstacle species must in image one by one search detect barrier, then sequentially detect operation atObstacle species are managed and sort out, this image operand is quite big and time-consuming, is not easy to reach the efficiency of real-time judge.And it is of the inventionIn order to enable anti-collision system quickly accurately to judge brake opportunity, therefore devise the suitable of the parallel framework of tool and pipelined operation frameworkAnswering property object classification device can speed up statistical vector using the multiple barrier images of one-to-one image processing parallel calculationTreatment effeciency, the higher barrier data of accuracy are provided and give anti-collision system, are avoided that traffic accident, and then simplify shadowAs the complexity and time-consuming problem of processing.
In addition, since current used classifier parameters are the good parameters of precondition, and be embedded in anti-collision system, whenWhen vehicle encounters different scenes in outdoor traveling, such as dusk, on the sunny side, night or overexposure scene, it is appropriate because that can not adjustScenario parameters also can not adjust classifier parameters because scene is different, erroneous judgement and the decline of detecting rate etc. is be easy to cause to lackPoint.And the present invention can judge corresponding scene according to the image captured, it can be according to various different scenes come elastic adjustment pointClass device parameter can calculate the higher barrier image of accuracy and its kind because having the scene judgement of adaptabilityClass, to solve the problems, such as existing detecting system erroneous judgement.Still further, the present invention can according to the remote deep of the image captured andThe size of barrier image, frame select barrier image capturing range appropriate and carry out image processing again, are able to ascend image processing effectRate, so solve the problems, such as that current image capturing range is big and caused by operand it is huge.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not used to limit the scope of implementation of the present invention.Therefore i.e.Equivalent change or modification carried out by all features according to the scope of claims of the present invention and spirit, should be included in of the inventionIn protection scope.