Summary of the invention
Technical problem to be solved by the present invention lies in provide a kind of provincial characteristics based on binary segmentation tree to describe methodAnd system, it is intended to solve the prior art when carrying out feature extraction, the problem that feature robustness is poor, information content is not abundant enough.
The invention is realized in this way a kind of provincial characteristics based on binary segmentation tree describes method, step includes:
Original image is divided into several cut zone by step A;
Step B calculates the similarity between the adjacent cut zone, and highest two adjacent area of similarity is synthesizedOne superzone domain;
Step C repeats step B until obtained all adjacent areas are merged into complete original image;
Step D constructs binary segmentation tree according to the cut zone and the superzone domain;
Step E extracts the corresponding superzone domain in target area and the target area in the binary segmentation tree respectivelyFeature simultaneously constructs provincial characteristics accordingly, is then described according to the feature that the provincial characteristics carries out target area.
Further, in step, the original image is split using image segmentation algorithm.
Further, in stepb, the similarity between the adjacent cut zone is calculated, similarity is highestTwo cut zone merge to obtain superzone domain, specifically include:
With RjIndicate a certain cut zone, NjIndicate cut zone RjAdjacent area set, S (Rn,Rj) indicate to divideCut region RjWith its a certain adjacent area RnSimilarity, RsIndicate cut zone RjSimilarity between region adjacent theretoMaximum value, then the region merging technique criterion of two cut zone are as follows:
Rs=arg max S (Rn,Rj), Rn∈Nj。
It further, include root node, leaf node and non-leaf nodes in the binary segmentation tree, wherein rootNode indicates that the entire original image merged, leaf node indicate a cut zone, and non-leaf node indicates a superzoneDomain.
Further, the step E is specifically included:
Step E1 extracts the fundamental region feature of target area and the corresponding superzone domain in the target area respectively;
Step E2, with provincial characteristics described in the fundamental region feature construction that is extracted in step E1, according to the provincial characteristicsFeature description is carried out to the target area.
Further, the step E2 is specifically included:
Step E211, calculate the target area in the binary segmentation tree fundamental region feature and the target areaThe fundamental region feature in the superzone domain of corresponding β superior node;
Step E212, according to fundamental region feature construction first area feature;
With RkIndicate the target area, k indicates that k-th of node, β indicate target area RkThe grade of corresponding superior nodeNot Shuo, hkIndicate target area RkCorresponding fundamental region feature,Indicate first area feature;
Step E213, if the target area RkThe number of levels for reaching root node in the binary segmentation tree is greater than the meshThe number of levels β of the corresponding superior node in region is marked, then the first area featureAre as follows:
Step E214, if the target area RkThe number of levels for reaching root node in the binary segmentation tree is less than the meshThe number of levels β, n of the corresponding superior node in mark region indicate that n-1 to the number of levels of the root node, is then replicated in the target areaThe fundamental region feature of node makes the series of superior node be β, i.e., the described first area featureAre as follows:
Further, the step E2 is specifically included:
Step E221, calculate the target area of the binary segmentation tree fundamental region feature and the target area pairThe base region of the corresponding level region of fundamental region feature and the target area in the superzone domain for the β superior node answeredThe fundamental region feature of the level region in characteristic of field and the superzone domain;
Step E222, all fundamental region feature construction second area features calculated according to step E221;
With RmIndicate the target area, m indicates that m-th of node, β indicate target area RmThe grade of corresponding superior nodeNot Shuo, hmIndicate target area RmCorresponding fundamental region feature,Indicate the target area and superzone domainThe first area feature of building, slibing (hm) indicate the target area level region fundamental region feature,Indicate target area RmThe fundamental region feature in corresponding β -1 layers of higher level superzone domain,Indicate second area feature;
Step E223, if the target area RmThe number of levels for reaching root node in the binary segmentation tree is greater than the meshMark region RmThe number of levels β of corresponding superior node, then the second area featureAre as follows: then:
Step E224, if the target area RmThe number of levels for reaching root node in the binary segmentation tree is less than the meshMark region RmThe number of levels β of corresponding superior node, m indicate the target area to the number of levels of the root node, then it is describedSecond area featureAre as follows:
The present invention also provides a kind of provincial characteristics based on binary segmentation tree to describe system, comprising:
Cutting unit, for original image to be divided into several cut zone;
Combining unit is adjacent by similarity highest two for calculating the similarity between the adjacent cut zoneRegion synthesizes a superzone domain and continues to merge then using the superzone domain of synthesis as the adjacent area of the cut zone, untilTo all adjacent areas be merged into complete original image;
Construction unit, for constructing binary segmentation tree according to the cut zone and the superzone domain;
Unit is described, for extracting target area in the binary segmentation tree respectively and the target area is corresponding surpassesThe feature in region simultaneously constructs provincial characteristics accordingly, is then described according to the feature that the provincial characteristics carries out target area.
Further, the cutting unit is split the original image using image segmentation algorithm;
It include root node, leaf node and non-leaf nodes in the binary segmentation tree, wherein root node indicates to closeAnd complete entire original image, leaf node indicate a cut zone, non-leaf node indicates superzone domain;
The combining unit, for calculating the similarity between the adjacent cut zone, by similarity highest twoA cut zone merges to obtain superzone domain, specifically includes:
With RjIndicate a certain cut zone, NjIndicate cut zone RjAdjacent area set, S (Rn,Rj) indicate to divideCut region RjWith its a certain adjacent area RnSimilarity, RsIndicate cut zone RjSimilarity between region adjacent theretoMaximum value, then the region merging technique criterion of two cut zone are as follows:
Rs=arg max S (Rn,Rj), Rn∈Nj。
Further, description unit is specifically used for:
Firstly, extracting the fundamental region feature of target area and the corresponding superzone domain in the target area respectively;
Secondly, provincial characteristics described in fundamental region feature construction with extraction;
Finally, carrying out feature description to target area according to the provincial characteristics.
Compared with prior art, the present invention beneficial effect is: the present invention merged target area, superzone domain at the same level andThe feature that target area is described adjacent to the fundamental region feature in higher level region and superzone domain, both contains local features,Global context information is also contained, so the advantage that can have context aware power, high resolution, robustness strong.Thus overcomeThe disadvantage that feature robustness is poor in prior art, information content is not abundant enough.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, rightThe present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, andIt is not used in the restriction present invention.
In the present invention, the method and system that the provincial characteristics based on binary segmentation tree describes again are proposed, are containedThe part of cut zone and global context information, with context aware power, high resolution and the strong advantage of robustness.
The invention is realized in this way a kind of provincial characteristics based on binary segmentation tree as shown in Figure 1 describes method, walkSuddenly include:
Original image is divided into several cut zone by S1.In this step, Mean-shift, Graph are utilizedOne such partitioning algorithm of any image segmentation algorithm such as based, gPb is split the original image.
S2 calculates the similarity between the adjacent cut zone, by the highest two adjacent areas synthesis one of similaritySuperzone domain.
With RjIndicate a certain cut zone, NjIndicate cut zone RjAdjacent area set, S (Rn,Rj) indicate to divideCut region RjWith its a certain adjacent area RnSimilarity, RsIndicate cut zone RjSimilarity between region adjacent theretoMaximum value, then the region merging technique criterion of two cut zone are as follows:
Rs=arg max S (Rn,Rj), Rn∈Nj。
S3 repeats step S2 until obtained all adjacent areas are merged into complete original image in this stepIn, the superzone domain that step S2 is synthesized repeats step S2 until being merged into as the adjacent area of the cut zoneWhole original image;
S4 constructs binary segmentation tree according to the cut zone and the superzone domain.In this step, in the binary pointCutting in tree includes root node, leaf node and non-leaf nodes, wherein and root node indicates the entire original image merged,Leaf node indicates a cut zone, and non-leaf node indicates superzone domain.
S5 extracts the feature of target area and the corresponding superzone domain in the target area respectively, constructs provincial characteristics, thenThe feature description of target area is carried out according to the provincial characteristics.In this step, after building binary segmentation tree according to S2,Before carrying out region description, first selected target region, which can be any node on binary segmentation tree.
As shown in Fig. 2, being the provincial characteristics structural schematic diagram based on binary segmentation tree, illustrate how that combination is basic in figureProvincial characteristics constructs target area Rk、RmAnd RnCharacteristic area descriptor.In Fig. 2, hiIndicate target area RiBase regionCharacteristic of field.
When constructing the frame of binary segmentation tree, it is necessary first to carry out region segmentation in original image, be built in region segmentationA binary segmentation tree is stood, to extract layered image region and systematically analyze their proximity relations.In practical applicationIn, to the method for region segmentation, there is no limit for example can use Mean-shift, Graph based, gPb etc..Region merging techniqueCriterion is determined by the similarity of adjacent area:
Rs=arg max S (Rn,Rj),Rn∈Nj
NjRepresent adjacent target region RjSet, S (Rn,Rj) represent adjacent area RnAnd RjSimilarity.Pass through mergingThe region of generation is known as superzone domain, and in binary segmentation tree, root node indicates the entire original image merged, leaf node generationOne cut zone of table, non-leaf nodes represent superzone domain.
On the basis of the binary segmentation tree that such as Fig. 2 is constructed, by following observation, we have proposed an advanced spiesLevy structural framing.
Firstly, the image-region (segment) in cut tree leaf node is very little, people can not be by individually observingAnd effectively recognize them, therefore go to extract feature to be not have for conspicuousness target detection only by small regionEnough diversity factoies;Secondly, complete target (little girl in such as Fig. 2) is in some cut zone or superzone in cut treeIt fails to separate from background completely in domain.But when from we are from leaf node up, the major part of targetIt can become more and more clear, such as arm, skirt and the head of little girl.This illustrates that Two-component Multi-layer expression can capture targetGlobal scene.Based on described above, the present embodiment propose two methods go to calculate leaf node region based on binary segmentationThe provincial characteristics (being named as hierarchy-associated rich features, HARF) of tree.
HARF in structure figures 21Specific steps include:
A1 calculates the fundamental region feature and the corresponding β in the target area of the target area in the binary segmentation treeThe fundamental region feature in the superzone domain of a superior node;
A2, according to fundamental region feature construction first area feature;
With RkIndicate the target area, k indicates that k-th of node, β indicate target area RkThe grade of corresponding superior nodeNot Shuo, hkIndicate target area RkCorresponding fundamental region feature,Indicate first area feature;
A3, if the target area RkThe number of levels for reaching root node in the binary segmentation tree is greater than the target areaThe number of levels β of corresponding superior node, the then characteristic areaAre as follows:
A4, if the target area RkThe number of levels for reaching root node in the binary segmentation tree is less than the target areaThe number of levels β, n of corresponding superior node indicate that n-1 node to the number of levels of the root node, is then replicated in the target areaFundamental region feature makes the series of superior node be β, i.e., the described characteristic areaAre as follows:
During constructing HARF1, firstly, calculating the target area R in cut treekWith corresponding β superior nodeSuperzone domain fundamental region featureThen the fundamental region feature extracted is piled into an eigenmatrix.ThisThe feature extracted is denoted asWherein, R represents target area, β represent for calculate HARF in dividing layerSuperzone domain number of levels.Thus, it is supposed that the fundamental region for representing each region or superzone domain is characterized in a d dimensional feature squareBattle array, then generateThe dimension of feature is d+d* β.Calculate featureMethod indicate are as follows:
HARF in structure figures 22Specific steps include:
B1, fundamental region feature and the target area for calculating the target area of the binary segmentation tree are β correspondingThe fundamental region feature of the corresponding level region of fundamental region feature and the target area in the superzone domain of superior node,And the fundamental region feature of the level region in the superzone domain;
B2, all fundamental region feature construction second area features calculated according to step b1;
With RmIndicate the target area, m indicates that m-th of node, β indicate target area RmThe grade of corresponding superior nodeNot Shuo, hmIndicate target area RmCorresponding fundamental region feature,Indicate the target area and superzone domainThe first area feature of building, slibing (hm) indicate the target area level region fundamental region feature,Indicate target area RmThe fundamental region feature in corresponding β -1 layers of higher level superzone domain,Indicate second area feature;
B3, if the target area RmThe number of levels for reaching root node in the binary segmentation tree is greater than the target areaRmThe number of levels β of corresponding superior node, the then characteristic areaAre as follows: then:
B4, if the target area RmThe number of levels for reaching root node in the binary segmentation tree is less than the target areaRmThe number of levels β of corresponding superior node, m indicate the target area to the number of levels of the root node, then the characteristic areaDomainAre as follows:
During constructing HARF2, a target area R is givenm, comprehensively consider the superior node in binary segmentation treeSuperzone domainAnd their corresponding level regionsIt is proposed that one can obtainThe method of richer HARF feature, is denoted as
Be byFeature adds the level region silbing (h of target aream) andThe level region in higher level superzone domainThe new matrix that piles of essential characteristic, expression formula can determineJustice is as follows, and this feature matrix dimension is d+2d* β.
It is to be noted that the complete image in root node had both contained conspicuousness target or had included background area, becauseAnd it is not used to calculate HARF value, in addition, not all region in leaf node reaches the number of levels of root node allIt is equal, thus removes calculating HARF without enough series there are some regions, it in this case, can be by replicating mostThe fundamental region feature in high-rise superzone domain and the HARF feature that target area is generated in conjunction with other features of lower level are such as schemedIn 2WithIn conclusion generating the flow chart of the provincial characteristics based on binary segmentation treeIt can be shown in Fig. 3
It is compared with existing technology, HARF provided by the invention is because merged target area, superzone domain at the same level and neighbourThe fundamental region feature in nearly higher level region and superzone domain describes the feature of target area, both contains local features,Global context information is contained, so the advantage that can have context aware power, high resolution, robustness strong.Thus overcomeHave the shortcomings that feature robustness is poor in technology, information content is not abundant enough.
We are applied in conspicuousness target detection by the experimental verification advantage of HARF, traditional special with usingSign (include color, texture and region property) and convolutional neural networks (CNN) Characteristic Contrast, in MSRA-B, PASCAL-1500 withIt is tested on SOD data set, using F-score (β2=0.3) result is evaluated with mean absolute error (MAE), Fig. 4Different characteristic structure notable figure generated is used to be different, can significantly see the advantage of HARF.Fig. 4 uses different characteristic knotNotable figure caused by structure, wherein (a) indicates original image, (b) indicates traditional characteristic, (c) indicates based on traditional characteristicHARF1, (d) indicate the HARF based on traditional characteristic2, (e) indicate traditional characteristic and CNN feature, (f) indicate to be based on traditional characteristicWith the HARF of CNN feature1, (g) indicate the HARF based on traditional characteristic and CNN feature2。
In the following table, we have obtained the F for generating notable figure using different characteristic structure on different data setsβScoreMAE value, as a result in as can be seen that be added HARF feature structure frame after three data sets FβScore is obviously improved (higher tableShow that performance is better), and mean absolute error has apparent reduction (lower expression performance is better).We pass through theory analysisThe provincial characteristics based on binary segmentation tree proposed all verified with experiment describes the superiority of method (HARF).Following table indicatesThe F of different characteristic structure is used on three data setsβScore and MAE value.
The present invention also provides a kind of provincial characteristics based on binary segmentation tree as shown in Figure 5 to describe system, comprising:
Cutting unit 1, for original image to be divided into several cut zone;
Combining unit 2 is adjacent by similarity highest two for calculating the similarity between the adjacent cut zoneRegion synthesizes a superzone domain and continues to merge then using the superzone domain of synthesis as the adjacent area of the cut zone, untilTo all adjacent areas be merged into complete original image;
Construction unit 3, for constructing binary segmentation tree according to the cut zone and the superzone domain;
Unit 4 is described, it is corresponding for extracting target area in the binary segmentation tree and the target area respectivelyThe feature in superzone domain simultaneously constructs provincial characteristics accordingly, is then described according to the feature that the provincial characteristics carries out target area.
Further, cutting unit 1 divides image segmentation algorithm to institute using Mean-shift, Graph based, gPb etc.Original image is stated to be split;
It include root node, leaf node and non-leaf nodes in the binary segmentation tree, wherein root node indicates to closeAnd complete entire original image, leaf node indicate a cut zone, non-leaf node indicates superzone domain;
Combining unit 2, for calculating the similarity between the adjacent cut zone, by highest two points of similarityIt cuts region merging technique and obtains superzone domain, specifically include:
With RjIndicate a certain cut zone, NjIndicate cut zone RjAdjacent area set, S (Rn,Rj) indicate to divideCut region RjWith its a certain adjacent area RnSimilarity, RsIndicate cut zone RjSimilarity between region adjacent theretoMaximum value, then the region merging technique criterion of two cut zone are as follows:
Rs=arg max S (Rn,Rj), Rn∈Nj。
Further, description unit 4 is specifically used for:
Firstly, extracting the fundamental region feature of target area and the corresponding superzone domain in the target area respectively;
Secondly, provincial characteristics described in fundamental region feature construction with extraction;
Finally, carrying out feature description to target area according to the provincial characteristics.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the inventionMade any modifications, equivalent replacements, and improvements etc., should all be included in the protection scope of the present invention within mind and principle.