Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
A data processing system for acquiring facial image features, the system comprising: the image processing system comprises a database, a processor, a memory storing a computer program, a first image data processing platform and N second image data processing platforms, wherein the database comprises a first face image list and a preset image information set, and when the computer program is executed by the processor, the following steps are realized, as shown in fig. 1:
s100, acquiring a first face image list A= { A from a database1 ,……,Ai ,……,Aλ },Ai For the first face image corresponding to the ith first target user, i= … … λ, where λ is the number of first target users.
Specifically, the database further includes an initial face image set of the target user, and when the computer program is executed by the processor, the first face image list is obtained through the following steps:
s110, acquiring a first face image list A and a second face image list B according to the initial face image set of the target user.
Specifically, in S110, the following steps are further included:
s111, acquiring an initial face image set Q= { Q of a target user from a database1 ,……,Qg ,……,Qn },Qg For the g-th face image of the target user, g= … … n, n is the number of target users.
S112, according to Q, obtaining an initial time list T= { T corresponding to Q1 ,……,Tg ,……,Tn },Tg Is Qg Corresponding initial time nodes.
S113, when T0 -Tg When T 'is less than or equal to T', T is taken asg Corresponding Qg Inserting a first initial face image list A '= { A'1 ,……,A'q ,……,A'b },A'q For the first initial face image corresponding to the q-th first initial target user, q= … … b, where b is the number of first initial target users, where T0 And T' is a preset first time threshold value for the current time node corresponding to the Q.
Specifically, the value range of T 'is 90 to 180 days, and those skilled in the art know that T' is selected according to actual requirements, which is not described herein.
S114, when T0 -Tg At > T', T is takeng Corresponding Qg Inserting a second initial face image list B '= { B'1 ,……,B'L ,……,B't },B'L For the second initial face image corresponding to the L-th second initial target user, l= … … t, where t is the number of second initial target users.
S115, when b > lambda0 When a=a 'and b=b' are acquired.
S116, when b is less than or equal to lambda0 When T 'is replaced by T'1 Wherein lambda is0 For a preset image quantity threshold value, T'1 Is a preset second time threshold.
Specifically, λ is performed according to the data amount storable by the second image data processing platform0 Is known to those skilled in the art, and is not described in detail herein.
Specifically, T'1 >T'。
By expanding the time range, more initial face images are distributed in the first initial face image set, the comparison quantity of the initial face images with preset image information in the database can be reduced, the face image searching and identifying range is reduced, and the real-time performance of face identification is improved.
S107, when T0 -TL ≤T'1 When B 'is to be used'L Inserted into a 'to obtain a=a', wherein TL Is B'L Corresponding time nodes.
S108, when T0 -TL >T'1 When B 'is to be used'j Deleted in B 'to obtain b=b'.
According to the method, the initial face images of the target users are divided and classified according to different times, the time is dynamically adjusted according to the data quantity which can be stored by the second image data processing platform, more face images are input into the second data platform, the face image searching and identifying range can be shortened, and the real-time performance of face identification is improved.
S200, acquiring a preset image information set M= { M from a database1 ,……,Ms ,……,Mv },Ms For the s-th preset image information in the database, s= … … v, v is the number of preset image information.
S300, inputting M into N second image data processing platforms, and obtaining a target image vector list C corresponding to each second image data processing platform
h ={C
h0 ,……,C
hk ,……,C
hμ }, wherein C
hk For the kth target image vector corresponding to the (h) th second image data processing platform, h= … … N, C
hk =M
h+k*N ,M
h+k*N For the (h+k x N) th preset image information in M, k=0 … … μ,
according to the method, the preset image information is input to the N second image data processing platforms, a certain amount of preset image information is stored in each second image data processing platform, and the association relation is established by storing the data information in different platforms, so that the data storage space is reduced, and the accuracy of the obtained face image features is higher under the condition that the database information is not lost.
S400, pair Chk Processing to obtain Ch Corresponding set of target image vector types C'h ={C'h1 ,……,C'hβ ,……,C'ha },C'hβ ={C'1hβ ,……,C'uhβ ,……,C'w(β)hβ },C'uhβ For the nth target image vector in the nth class in the nth second image data processing platform, u= … … w (β), w (β) is the number of target image vectors in the nth class, β= … … a, a is C'h The number of target image vector types.
Specifically, in S400, the following steps are further included:
s401, from Ch Mid-image vector type set Hh ={Hh1 ,……,Hhβ ,……,Hha Sum Hh Corresponding initial center point set H1h ={H1h1 ,……,H1hβ ,……,H1ha },Hhβ For the intermediate image vector of the beta type in the H second image data processing platform, H1hβ From C when initially unblusteredh The vector of the beta sample obtained in (1), wherein, the initial Hhβ =Null。
S402, according to Ch And H1h Obtaining Chk Corresponding target similarity list HChk ={HC1hk ,……,HCβhk ,……,HCahk },HCβhk Is Chk And H is1hβ The target similarity between the two can be calculated according to any model by a person skilled in the art, and will not be described here.
S403, when HCβhk Is HC (HC)hk At the minimum of (C)hk Inserted into Hhβ In order to obtain C'hβ =Hhβ 。
S404, according to Hhβ Obtaining Hh Corresponding intermediate center point set H2h ={H2h1 ,……,H2hβ ,……,H2ha }, wherein H2hβ Meets the following conditions:
wherein Y is
1y To H after 1 st clustering
hβ The y-th preset image information, eta
1 (H
hβ ) To H after 1 st clustering
hβ The number of image information is preset.
S405, repeatedly executing S402-S404 to obtain Hh Corresponding target center point set HEh ={HEh1 ,……,HEhβ ,……,HEha }, wherein HEhβ Is the beta target center point obtained after the clustering of the (E-1) th time.
Specifically, the HEhβ Acquisition mode and H of (2)2hβ The acquisition modes of the obtained images are consistent.
S406, when HEhβ =HE-1hβ At the time, C'hβ =Hhβ 。
According to the method, the preset image information in each second image data processing platform is clustered, similar images are gathered into one type, and when the first face image is compared with the preset image information in the second image data processing platform, the face image recognition search range can be narrowed, so that the real-time performance of face recognition is improved.
Specifically, in S400, a meets the following condition:
a=r1 (μ+1)3 +r2 (μ+1)2 +r3 (μ+1)+r4 wherein r is1 For a preset first parameter, r2 For a preset second parameter, r3 R is a preset third parameter4 Is a preset fourth parameter.
Specifically, r1 The range of the value of (C) is-8 e-13 ~-5e-12 Wherein e is the euler constant.
Preferably, r1 The value of (2) is-4 e-12 。
Specifically, r2 The value range of (2) is 2e-8 ~3e-6 。
Preferably, r2 Has a value of 2e-7 。
Specifically, r3 The range of the value of (2) is-1 to 1.
Preferably, r3 Has a value of-0.0068.
Specifically, r4 The range of the value of (2) is 50-100.
Preferably, r4 Is 99.025.
Above-mentioned, carry out the adjustment of face image type quantity according to the size of face image data volume, the balance of performance and recall rate when can guaranteeing the data match for when obtaining initial face image feature, guarantee the efficiency of data operation and the comprehensiveness of data match, make the degree of accuracy of the face image feature who obtains higher.
S500, according to A and C'uhβ Acquiring a first target image feature set AC= { AC corresponding to A1 ,……,ACi ,……,ACλ },ACi Is Ai A corresponding first list of target image features.
Specifically, in S500, the following steps are further included:
s501 according to Ai And C'h Obtaining Ai Corresponding first similarity list Fih ={Fih1 ,……,Fihβ ,……,Fiha },Fihβ Is Ai And C'hβ Is a first similarity of (c).
Specifically, in S501, the following steps are further included:
s5011, according to A, obtaining a first face image vector list A corresponding to A0 ={A01 ,……,A0i ,……,A0λ },A0i Is Ai A corresponding first face image vector.
Specifically, the model for converting the first face image into the first face image vector is selected by a person skilled in the art according to actual requirements, and will not be described herein.
S5013, according to A0 Obtaining A0i =(A0i1 ,……,A0ix ,……,A0ip ) Wherein A is0ix Is A0i The bit value of the x-th bit in (1), x= … … p, p is the dimension of the first face image vector.
S5015, according to C'h Obtaining C'uhβ =(C'u1hβ ,……,C'uxhβ ,……,C'uphβ ) Wherein C'uxhβ Is C'uhβ Bit value of the x-th bit in (b).
S5017 according to A0ix And C'uxhβ Obtaining a first similarity Fihβ Wherein F isihβ Meets the following conditions:
s503, when Fihβ ≥F0 At the time, obtain Ai Corresponding second similarity list Fihβ ={Fi1hβ ,……,Fiuhβ ,……,Fiw(β)hβ },Fiuhβ Is Ai And C'uhβ Is of the second similarity of F0 Is a preset first similarity threshold.
Specifically, Fiuhβ Acquisition mode and F of (2)ihβ The acquisition modes of the obtained images are consistent.
Specifically, F0 The value range of (2) is 0.85-0.9, and the preset similarity threshold is set by the person skilled in the art according to the actual requirement, and will not be described herein.
S505, when Fiuhβ ≥F1 At the time, the AC is acquiredi Wherein F1 Is a preset second similarity threshold.
Specifically, F1 The value range of (2) is 0.85-0.9, and the preset similarity threshold is set by the person skilled in the art according to the actual requirement, and will not be described herein.
Specifically, F0 =F1 。
Specifically, the second image data processing platform further includes Ch Corresponding first image feature list FCh ={FCh0 ,……,FChk ,……,FChμ },FChk ={FC1hk ,……,FCθhk ,……,FCζhk },FCθhk Is Chk Corresponding to the first record included in the θ -th first field in the first image feature list, θ= … … ζ, where ζ is the number of first fields.
Specifically, in S505, the following steps are further included:
s501, when Fiuhβ ≥F1 At the time, F is acquirediuhβ Corresponding C'uhβ 。
S503, when C'uhβ =Chk At the time, the AC is acquiredi =FChk 。
The first face image is compared with the target image vector types in each second image data processing platform, the target image vector types meeting the conditions are selected according to the preset similarity threshold, and then the comparison is carried out with the target image vectors meeting the conditions, so that the face image searching range can be narrowed, the real-time performance of face recognition is improved, meanwhile, the data storage space is reduced, and the accuracy of the obtained face image features is higher under the condition that database information is not lost.
S600 according to ACi The first image data processing platform acquires a second target image feature set AD= { AD corresponding to the A1 ,……,ADi ,……,ADλ },ADi Is Ai And a corresponding second target image feature list.
Specifically, the first image data processing platform further includes a second image feature list M ' = { M ' corresponding to M '1 ,……,M's ,……,M'v },M's ={M's1 ,……,M'sε ,……,M'sη },M'sε Is Ms And the epsilon=1 … … eta, eta is the number of the second fields, of the second records contained in the epsilon second field in the corresponding second image feature list.
Specifically, the step S600 includes the following steps:
s601, when the theta first field is a preset field and the epsilon second field is a preset field, obtaining the FCθhk And M'sε Wherein the preset field is an ID.
S603, when s=h+k×n, acquiring ADi =M's 。
By associating the data in the first image data processing platform with the data in the second image data processing platform, the second image data processing platform with less stored data is subjected to the same ID matching with the first image data processing platform, so that all the information of the first face image is obtained, the searching range of the face image is reduced, the real-time performance of face recognition is improved, and meanwhile, the accuracy of the obtained face image features is higher under the condition that the database information is not lost.
S700, ADi And sending the message to the ith first target user.
Specifically, the method further comprises the following steps after S700:
s800, obtaining a second face image list B= { B from the database1 ,……,Bj ,……,Bγ },Bj For the second face image corresponding to the j-th second target user, j= … … γ, and γ is the number of second target users.
S900, B and M are input into the first image data processing platform, and a second target image feature set BD= { BD corresponding to B is obtained1 ,……,BDj ,……,BDγ },BDj Is Bj And a corresponding second target image feature list.
Specifically, in S900, the following steps are further included:
s901, according to B, obtaining a second face image vector list B corresponding to B0 ={B01 ,……,B0j ,……,B0γ },B0j And the j second face image vector is the j second face image vector in the B.
Specifically, the mode of acquiring the second face image vector is consistent with the mode of acquiring the first face image vector, and the fact that the acquired vector forms are inconsistent due to different modes can be avoided by ensuring the consistency of the acquisition modes, the accuracy of subsequent similarity calculation is affected, and therefore the accuracy of the acquired face image features is affected.
S903, obtaining B from B and Mj Corresponding third similarity list BMj ={BM1j ,……,BMsj ,……,BMvj },BMsj Is Bj And M is as followss Is a third similarity of (3).
Specifically, BMsj Acquisition mode of Fiuhβ Acquisition mode and BM of (a)sj The acquisition modes of the obtained images are consistent.
S905, as BMsj ≥F2 At the time of acquiring BDj Wherein F is2 Is a preset third similarity threshold.
Specifically, F2 The value range of (2) is 0.85-0.9, and the preset similarity threshold is set by the person skilled in the art according to the actual requirement, and will not be described herein.
Specifically, F0 =F1 =F2 。
Specifically, in S905, the following steps are further included:
s9051, as BMsj ≥F2 At the time, obtain Bj Corresponding Ms 。
S9053 according to Ms And M's Obtaining BDj ={M's1 ,……,M'sε ,……,M'sη }。
S1000, BD is processedj And transmitting to the j second target user.
The invention provides a data processing system for acquiring facial image characteristics, which comprises: the system comprises a database, a processor, a memory storing a computer program, a first image data processing platform and N second image data processing platforms, wherein the database comprises a first face image list and a preset image information set, and when the computer program is executed by the processor, the following steps are realized: acquiring a first face image list and a preset image information set from a database, inputting the preset image information set into N second image data processing platforms to acquire a target image vector list corresponding to each second image data processing platform, carrying out clustering processing on target image vectors in each second image data processing platform to acquire a target image vector type set corresponding to each second image data processing platform, acquiring a first target image feature set corresponding to a first face image according to the first face image list and the target image vectors, acquiring a second target image feature set corresponding to the first face image according to the first target image feature and the first image data processing platform, and sending the second target image feature set corresponding to the first face image to a first target user. As can be seen, in one aspect of the invention, the face images in the database are not subjected to one-to-one comparison, the preset image information in the database is subjected to clustering treatment, the comparison is firstly performed with the preset image information type, and then the comparison is performed with the preset image information meeting the preset type, so that the face image searching and identifying range is reduced, and the real-time performance of face identification is improved; on the other hand, the plurality of data query platforms are associated, face images are processed at the same time, the clustering quantity of data in the data query platforms is dynamically adjusted, the data storage space is improved, and the accuracy of the obtained face image features is higher under the condition that information in a database is not lost.
While certain specific embodiments of the invention have been described in detail by way of example, it will be appreciated by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the invention. Those skilled in the art will also appreciate that many modifications may be made to the embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.