Movatterモバイル変換


[0]ホーム

URL:


CN110335628A - The tone testing method, apparatus and electronic equipment of smart machine - Google Patents

The tone testing method, apparatus and electronic equipment of smart machine
Download PDF

Info

Publication number
CN110335628A
CN110335628ACN201910580478.9ACN201910580478ACN110335628ACN 110335628 ACN110335628 ACN 110335628ACN 201910580478 ACN201910580478 ACN 201910580478ACN 110335628 ACN110335628 ACN 110335628A
Authority
CN
China
Prior art keywords
result
matching
sub
recognition result
practical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910580478.9A
Other languages
Chinese (zh)
Other versions
CN110335628B (en
Inventor
余明
刘子祥
陈果果
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Shanghai Xiaodu Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co LtdfiledCriticalBeijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910580478.9ApriorityCriticalpatent/CN110335628B/en
Publication of CN110335628ApublicationCriticalpatent/CN110335628A/en
Application grantedgrantedCritical
Publication of CN110335628BpublicationCriticalpatent/CN110335628B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

The embodiment of the present invention provides the tone testing method, apparatus and electronic equipment of a kind of smart machine, which comprises obtains smart machine to the practical recognition result of tested speech, the practical recognition result includes a plurality of first sub- result;According to the matching result of each second sub- result in the first sub- result each in practical recognition result standard recognition result corresponding with the tested speech, the matching result of the practical recognition result Yu the standard recognition result is determined;According to the matching result of the practical recognition result and the standard recognition result, the tone testing result of the smart machine is determined.The efficiency of this method significant increase speech recognition test, additionally it is possible to guarantee the correctness of matching result.

Description

The tone testing method, apparatus and electronic equipment of smart machine
Technical field
The present embodiments relate to intelligent sound technology more particularly to a kind of tone testing method, apparatus of smart machineAnd electronic equipment.
Background technique
With the continuous development of speech recognition technology, there are more and more smart machines for supporting automatic speech recognition,Such as support speaker, mobile phone, the tablet computer etc. of automatic speech recognition.These support the smart machine of automatic speech recognition going outBefore factory, the automatic speech recognition function to these equipment is needed to test.Wherein, the quasi- sentence standard of word is that speech identifying function is surveyedAn important indicator in examination.During the test, a series of standard is inputted to smart machine by modes such as true man's testsThe corresponding voice of recognition result, smart machine obtain a series of practical recognition result according to the voice of input.By to standardRecognition result and practical recognition result are matched and are analyzed, and the quasi- sentence calibration information of word of smart machine is obtained.
In the prior art, mainly by way of manually comparing to standard recognition result and the progress of practical recognition resultMatch.Specifically, manually comparing the matching degree of each standard recognition result and practical recognition result one by one by tester, and uniteCount the quasi- sentence calibration information of word.
But the inefficiency of speech recognition test is carried out using the method for the prior art.
Summary of the invention
The embodiment of the present invention provides the tone testing method, apparatus and electronic equipment of a kind of smart machine, existing for solvingThere is the problem that speech recognition testing efficiency is low in technology.
First aspect of the embodiment of the present invention provides a kind of tone testing method of smart machine, comprising:
Smart machine is obtained to the practical recognition result of tested speech, the practical recognition result includes a plurality of first son knotFruit;
According in the first sub- result each in practical recognition result standard recognition result corresponding with the tested speechThe matching result of each second sub- result, determines the matching result of the practical recognition result Yu the standard recognition result;
According to the matching result of the practical recognition result and the standard recognition result, the language of the smart machine is determinedSound test result.
Further, described according to the first sub- result each in practical recognition result mark corresponding with the tested speechThe matching result of each second sub- result, determines of the practical recognition result Yu the standard recognition result in quasi- recognition resultWith result, comprising:
According to the matching result of each first sub- result and each second sub- result, multiple matchings set and each described are determinedThe matching score value of set is matched, includes multiple matchings pair in each matching set, each matching is to by one first son knotFruit and a second sub- result composition;
According to the maximum matching set of matching score value, the practical recognition result and the standard recognition result are determinedMatching result.
Further, the matching result of each first sub- result and each second sub- result includes each first sub- result and eachThe matching score value of second sub- result;
The matching result according to each first sub- result and each second sub- result determines multiple matchings set and eachThe matching score value of the matching set, comprising:
According to the matching score value of fixed first matching set and current first sub- result and the current second sub- resultMatching score value, determine the second matching set;
Wherein, the current first sub- result and the current second sub- result are when generating in the first matching setBetween matching where the first sub- result the latest to a matching later to included the first sub- result and the second sub- result.
Further, described to be gathered according to the maximum matching of matching score value, determine the practical recognition result and instituteState the matching result of standard recognition result, comprising:
According to matching pair included in the maximum matching set of the matching score value, the practical identification knot is generatedThe matching result of fruit and the standard recognition result.
Further, described according to the first sub- result each in practical recognition result mark corresponding with the tested speechThe matching result of each second sub- result, determines of the practical recognition result Yu the standard recognition result in quasi- recognition resultBefore result, further includes:
First sub- result each in the practical recognition result is ranked up according to the time is generated;
According to the longest common subsequence between each first sub- result and each second sub- result after sequence, each first is determinedThe matching result of sub- result and each second sub- result.
Further, the smart machine that obtains is to the practical recognition result of tested speech, comprising:
It obtains the smart machine and identifies test log generated when the tested speech;
According to preset keyword and preset regular expressions information, the intelligence is filtered out from the test logPractical recognition result of the equipment to tested speech.
Further, the matching result according to the practical recognition result and the standard recognition result, determines instituteState the test result of smart machine, comprising:
According to the matching result of the practical recognition result and the standard recognition result, the word of the smart machine is determinedAccuracy rate and/or sentence accuracy rate.
Second aspect of the embodiment of the present invention provides a kind of tone testing device of smart machine, comprising:
Module is obtained, for obtaining smart machine to the practical recognition result of tested speech, the practical recognition result packetInclude a plurality of first sub- result;
First determining module, for corresponding with the tested speech according to the first sub- result each in the practical recognition resultStandard recognition result in each second sub- result matching result, determine the practical recognition result and the standard recognition resultMatching result;
Second determining module, for the matching result according to the practical recognition result and the standard recognition result, reallyThe tone testing result of the fixed smart machine.
Further, first determining module is specifically used for:
According to the matching result of each first sub- result and each second sub- result, multiple matchings set and each described are determinedThe matching score value of set is matched, includes multiple matchings pair in each matching set, each matching is to by one first son knotFruit and a second sub- result composition;
According to the maximum matching set of matching score value, the practical recognition result and the standard recognition result are determinedMatching result.
Further, the matching result of each first sub- result and each second sub- result includes each first sub- result and eachThe matching score value of second sub- result;
First determining module is specifically used for:
According to the matching score value of fixed first matching set and current first sub- result and the current second sub- resultMatching score value, determine the second matching set;
Wherein, the current first sub- result and the current second sub- result are when generating in the first matching setBetween matching where the first sub- result the latest to a matching later to included the first sub- result and the second sub- result.
Further, first determining module is specifically used for:
According to matching pair included in the maximum matching set of the matching score value, the practical identification knot is generatedThe matching result of fruit and the standard recognition result.
Further, described device further include:
Sorting module, for being ranked up to the first sub- result each in the practical recognition result according to the time is generated;
Third determining module, for public according to the longest between each first sub- result and each second sub- result after sequenceSubsequence determines the matching result of each first sub- result Yu each second sub- result.
Further, the acquisition module is specifically used for:
It obtains the smart machine and identifies test log generated when the tested speech;
According to preset keyword and preset regular expressions information, the intelligence is filtered out from the test logPractical recognition result of the equipment to tested speech.
Further, second determining module is specifically used for:
According to the matching result of the practical recognition result and the standard recognition result, the word of the smart machine is determinedAccuracy rate and/or sentence accuracy rate.
The third aspect of the embodiment of the present invention provides a kind of electronic equipment, comprising:
Memory, for storing program instruction;
Processor executes side described in above-mentioned first aspect for calling and executing the program instruction in the memoryMethod step.
Fourth aspect of the embodiment of the present invention provides a kind of readable storage medium storing program for executing, and calculating is stored in the readable storage medium storing program for executingMachine program, the computer program is for executing method described in above-mentioned first aspect.
The tone testing method, apparatus and electronic equipment of smart machine provided by the embodiment of the present invention, are getting intelligenceAfter energy equipment is to the practical recognition result of tested speech, based on each in each sub- result in practical recognition result and standard recognition resultThe matching result of sub- result can determine the whole matching of practical recognition result and standard recognition result as a result, in turn can be withAccording to the whole matching of practical recognition result and standard recognition result as a result, determining the test result of smart machine, thus realThe existing quasi- recognition result of automatic benchmarking and practical recognition result match, thus the efficiency of significant increase speech recognition test.TogetherWhen, this method is dynamically determined based on the matching result of sub- result each in practical recognition result and sub- result each in standard recognition resultThe whole matching of practical recognition result and standard recognition result is as a result, thereby it is ensured that the correctness of matching result out.
Detailed description of the invention
It, below will be to embodiment or the prior art in order to illustrate more clearly of the present invention or technical solution in the prior artAttached drawing needed in description is briefly described, it should be apparent that, the accompanying drawings in the following description is of the invention oneA little embodiments for those of ordinary skill in the art without any creative labor, can also be according to thisA little attached drawings obtain other attached drawings.
Fig. 1 is the exemplary system architecture figure of the tone testing method of smart machine provided in an embodiment of the present invention;
Fig. 2 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention;
Fig. 3 is the exemplary diagram of above-mentioned matching result;
Fig. 4 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention;
Fig. 5 is the schematic diagram for determining the matching score value of matching set and matching set;
Fig. 6 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention;
Fig. 7 is the function structure chart of the tone testing device of smart machine provided in an embodiment of the present invention;
Fig. 8 is the function structure chart of the tone testing device of smart machine provided in an embodiment of the present invention;
Fig. 9 is the structural schematic diagram of a kind of electronic equipment 900 provided in an embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached in the embodiment of the present inventionFigure, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is the present inventionA part of the embodiment, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not havingEvery other embodiment obtained under the premise of creative work is made, shall fall within the protection scope of the present invention.
Standard recognition result and practical recognition result are matched by way of manually comparing in the prior art, it is thisThe inefficiency of method progress speech recognition test.Meanwhile when standard recognition result is more, it is also possible to matching error occurProblem causes test accuracy low.
The embodiment of the present invention based on the above issues, proposes a kind of tone testing method of smart machine, is getting intelligenceAfter equipment is to the practical recognition result of tested speech, based on each son in each sub- result in practical recognition result and standard recognition resultAs a result matching result can determine the whole matching of practical recognition result and standard recognition result as a result, in turn can rootFactually the whole matching of border recognition result and standard recognition result is as a result, determine the test result of smart machine, to realizeThe quasi- recognition result of automatic benchmarking and practical recognition result match, thus the efficiency of significant increase speech recognition test.MeanwhileThis method is dynamically determined out based on the matching result of each sub- result in sub- result each in practical recognition result and standard recognition resultThe whole matching of practical recognition result and standard recognition result is as a result, thereby it is ensured that the correctness of matching result.
Fig. 1 is the exemplary system architecture figure of the tone testing method of smart machine provided in an embodiment of the present invention, such as Fig. 1Shown, this method is related to tested smart machine and test equipment.Wherein, test equipment is obtained from tested smart machineThe practical recognition result of tested speech is taken, and carries out matching treatment using the method for the embodiment of the present invention, and determine test result.
Wherein, the PC etc. for the smart machine connection that above-mentioned test equipment can be and be tested, smart machine is set with testIt is standby can be by wired or wireless way downlink connection, the present invention is not especially limit this.
Know in addition, above-mentioned tested smart machine can be intelligent sound box, smart phone, smartwatch etc. with voiceThe smart machine of other function, the embodiment of the present invention are not especially limited the specific form of tested smart machine.
Fig. 2 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention, and this method is heldRow main body is above-mentioned test test equipment, as shown in Fig. 2, this method comprises:
S201, smart machine is obtained to the practical recognition result of tested speech, which includes a plurality of firstSub- result.
Smart machine in the present embodiment and following embodiments each means tested smart machine.
Above-mentioned practical recognition result refers to actually to be obtained after tested smart machine carries out speech recognition to tested speechThe recognition result arrived.
Optionally, tested speech can be issued from true man to smart machine by true man's test mode, alternatively, can also be withIt prerecords real voice and generates audio, carried out from test equipment to the audio of smart machine input test voice by smart machineIdentification.
Optionally, tested speech may include more voices of separated in time, these voices are identified by smart machineLater, obtained practical recognition result may include a plurality of first son as a result, every strip result is that smart machine identification is a certainText is formed by after sentence language voice.
Illustratively, one of them first sub- result in practical recognition result is " today stays indoor with umbrella ".
S202, it is tied according to the first sub- result each in above-mentioned practical recognition result standard identification corresponding with above-mentioned tested speechThe matching result of each second sub- result, determines the matching result of above-mentioned practical recognition result and above-mentioned standard recognition result in fruit.
Optionally, tested speech is preset voice, and the corresponding standard recognition result of tested speech, which refers to be directed to, to be somebody's turn to doTested speech, it should the correct recognition result identified.Tested speech includes more voices, correspondingly, tested speech is correspondingStandard recognition result may include the corresponding more texts of more voices, every text is a second sub- result.
Illustratively, tested speech includes 1000 voices, wherein a voice is the voice of " today stays indoor with umbrella ",Then the corresponding second sub- result of this voice is " today stays indoor with umbrella " this text.
Wherein, standard recognition result is generated and is saved previously according to tested speech.
In the multiple second sub- results in standard recognition result and practical recognition result multiple first it is sub as a result, two-by-two itBetween matched, available matching result between any two.Based on matching result between any two, can be moved in the present embodimentState determines the matching result of standard recognition result He practical recognition result.It wherein, include standard recognition result in the matching resultIn in each sub- result and practical recognition result each sub- result corresponding relationship.
Fig. 3 be above-mentioned matching result exemplary diagram, as shown in figure 3, in standard recognition result sequentially in time include A,B, C, D, E, F, G include A, A, B, G, D, E, G, F, i.e., practical recognition result possibility in practical recognition result sequentially in timeIn the presence of repetition, it is also possible to it is inconsistent with standard recognition result sequence, after the matching process of the present embodiment, weight can be removedIt is multiple, and to the unidentified null value that is partially filled with standard recognition result neutron result out, meanwhile, the identification of mistake can be removedAs a result, i.e. A is matched with A, and B is matched with B to obtaining matching result shown in Fig. 3, C without matching, and so on.
S203, according to the matching result of above-mentioned practical recognition result and above-mentioned standard recognition result, determine that above-mentioned intelligence is setStandby tone testing result.
Optionally, the tone testing result of smart machine may include the indexs such as word accuracy rate, sentence accuracy rate.
As an alternative embodiment, in the matching according to above-mentioned practical recognition result and above-mentioned standard recognition resultAs a result, can be identified according to above-mentioned practical recognition result and above-mentioned standard when determining the tone testing result of above-mentioned smart machineAs a result matching result determines the word accuracy rate and/or sentence accuracy rate of above-mentioned smart machine.
By taking smart machine is intelligent sound box as an example, when test equipment gets the practical recognition result and standard of intelligent sound boxIt, can be to including each sub- knot in standard recognition result and practical recognition result in matching result after the matching result of recognition resultThe corresponding relationship of fruit carries out statistical disposition, to obtain the word accuracy rate and/or sentence accuracy rate of intelligent sound box.
Referring to above-mentioned example shown in Fig. 3, determined in standard recognition result and practical recognition result by the present embodimentThe corresponding relationship of sub- result is that A is matched with A, and B is matched with B, C without matching etc., then can calculate in practical recognition result A relative toThe word accuracy rate of A in standard recognition result, word accuracy rate of the B relative to B in standard recognition result in practical recognition result, with thisAnalogize, then average equal weightings processing is carried out to the word accuracy rate of each sub- result, to obtain the word accuracy rate of practical recognition result.
In the present embodiment, after getting smart machine to the practical recognition result of tested speech, based on practical identification knotThe matching result of each sub- result and each sub- result in standard recognition result in fruit can determine that practical recognition result and standard are knownThe whole matching of other result is as a result, in turn can be according to the whole matching of practical recognition result and standard recognition result as a result, reallyThe test result of smart machine is made, thus realize that the quasi- recognition result of automatic benchmarking and practical recognition result match, thusThe efficiency of significant increase speech recognition test.Meanwhile this method is based on each sub- result and standard identification in practical recognition result and tiesIn fruit the matching result of each sub- result be dynamically determined out practical recognition result and standard recognition result whole matching as a result, becauseThis, can guarantee the correctness of matching result.
Fig. 4 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention, as shown in figure 4,A kind of optional embodiment of above-mentioned steps S202 includes:
S401, according to the matching result of each first sub- result and each second sub- result, determine multiple matchings set and everyIt is a to match the matching score value gathered, it include multiple matchings pair in each matching set, it is each to match to by a first sub- resultWith a second sub- result composition.
Wherein, each matching set expression standard recognition result and the one of the corresponding relationship of each sub- result of practical recognition resultKind combination.
Illustratively, include of A, B, C tri- first in standard recognition result as a result, in practical recognition result including 1,2,3 three second sons are as a result, then may include following two matchings set:
{ A-1, B-2, C-3 } is a matching set, i.e., A is matched with 1, and for a matching pair, B is matched with 2, is onePairing, C are matched with 3, for a matching pair.
{ A-2, B-3, C-1 } is another matching set, i.e., A is matched with 2, and for a matching pair, B is matched with 3, is oneMatching pair, C is matched with 1, for a matching pair.
Each matching included in each matching set is to all having a matching result, the matching based on each matching pairAs a result, the matching score value of available each matching set.The matching score value of some matching set is higher, indicates the matching setIncluded in matching pair matching relationship it is more excellent.
As an alternative embodiment, the matching result of above-mentioned each first sub- result and each second sub- result includes eachThe matching score value of first sub- result and each second sub- result can then determine multiple matchings set and each according to following processesMatch the matching score value of set:
According to the matching score value of fixed first matching set and current first sub- result and the current second sub- resultMatching score value, determine the second matching set.
Wherein, above-mentioned current first sub- result and above-mentioned current second sub- result are when generating in above-mentioned first matching setBetween matching where the first sub- result the latest to a matching later to included the first sub- result and the second sub- result.
In this approach, each matching set is by the previous matching set that has confirmed and in previous set of matchesThe matching score value of a newest matching pair determines on the basis of conjunction.
S402, according to matching the maximum above-mentioned matching set of score value, determine above-mentioned practical recognition result and above-mentioned standard knowledgeThe matching result of other result.
There is a matching score value by the set of each matching determined by above-mentioned S401, can therefrom select matching pointIt is worth maximum matching set, the matching relationship of the matching pair for being included in the matching set is optimal matching relationship.
It, can be raw according to matching pair included in the maximum matching set of above-mentioned matching score value in a kind of optional wayAt the matching result of above-mentioned practical recognition result and above-mentioned standard recognition result.
Illustratively, the matching maximum set of matches of score value is combined into { A-1, B-2, C-3 }, then can be generated and close including the matchingThe matching result of system, the matching result include: that A is matched with 1, and B is matched with 2, and C is matched with 3.
The process of above-mentioned determining matching set is illustrated below by way of one.
Fig. 5 is the schematic diagram for determining the matching score value of matching set and matching set, as shown in fig. 5, it is assumed that test languageCorresponding 7 second sons of sound are as a result, include 7 standard sentences i.e. in standard recognition result, smart machine is practical to identify 5 firstSon is as a result, include 5 standard sentences in practical recognition result.Table indicates 7 the second sub- results and 5 first on the left of Fig. 5The matching score value matched two-by-two of sub- result, each in the table on the right side of Fig. 6 indicate the matching point of the second current matching setValue.
Assuming that the matching score value of the second matching set indicates that i indicates i-th in 5 the first sub- results using c [i] [j]A, j indicates j-th in 7 the second sub- results, then c [i] [j] can be calculated by following formula (1):
C [i] [j]=max (c [i-1] [j-1]+p [i] [j], c [i-1] [j]) (1)
Wherein, c [i-1] [j-1] and c [i-1] [j] indicates that fixed first matching is gathered before the second matching set, p[i] [j] indicates the matching score value of current first sub- result and current second result.
Referring to Fig. 5, it is assumed that i=3, j=5, then c [i-1] [j-1]=c [2] [4]=12, c [i-1] [j]=c [2] [5]=13, p [i] [j]=p [3] [5]=4, then according to above-mentioned formula (1), c [3] [5]=16.
Based on above-mentioned formula (1), the matching score value that every kind of matching is gathered in available Fig. 5 is therefrom selected maximumMatching score value, i.e., 27, it is based on the matching score value, the mode of passage path backtracking determines in the corresponding matching set of the matching score valueIncluded each matching pair.
Fig. 6 is the flow diagram of the tone testing method of smart machine provided in an embodiment of the present invention, as shown in fig. 6,Before above-mentioned steps S202, the matching knot of each first sub- result Yu each second sub- result can be determined by following process firstFruit:
S601, the first sub- result each in above-mentioned practical recognition result is ranked up according to the time is generated.
Since standard recognition result is pre-generated according to tested speech, standard recognition result is arranged according to the timeTherefore sequence in this step, can make standard know the first sub- result in practical recognition result according to time-sequencing firstMatching efficiency when other result is matched with practical recognition result is higher.
S602, according to the longest common subsequence between each first sub- result and each second sub- result after sequence, determineThe matching result of each first sub- result and each second sub- result.
Wherein, longest common subsequence is the most eldest son in the subsequence for all including to the first sub- result and the second sub- resultSequence.
Illustratively, it is assumed that the first sub- result is " today stay indoor band umbrella ", and the second sub- result is that " tomorrow gos out with not having toHold up an umbrella ", it is assumed that it include two common subsequences in the two sub- results, a common subsequence is " day does not have to umbrella ", anotherCommon subsequence is " going out with umbrella in day ", in the two subsequences, the latter sub-sequence length longest, therefore be the public son of longestSequence.
It, can be using the length of longest common subsequence as matching point if matching result is above-mentioned matching score valueValue.For example, in the examples described above, the matching score value of the first sub- result and the second sub- result is 5.
In above-mentioned steps S201, practical recognition result of the available smart machine of test equipment to tested speech.MakeFor a kind of optional embodiment, test equipment can obtain the practical recognition result by test log.
Specifically, test equipment can obtain test log generated when smart machine identification tested speech first, intoAnd according to preset keyword and preset regular expressions information, smart machine is filtered out from test log to test languageThe practical recognition result of sound.
Optionally, smart machine can record corresponding keyword in the relevant log of record speech recognition first, becauseThis, test equipment can according to the keyword, determine certain log whether be speech recognition result log.In addition, in logText in addition to recording speech recognition result, can also record information, these information such as the time of result generation can be by justThen expression is matched to obtain.
Fig. 7 is the function structure chart of the tone testing device of smart machine provided in an embodiment of the present invention, as shown in fig. 7,The device includes:
Module 701 is obtained, for obtaining smart machine to the practical recognition result of tested speech, the practical recognition resultIncluding a plurality of first sub- result.
First determining module 702, for according to the first sub- result each in the practical recognition result and the tested speechThe matching result of each second sub- result in corresponding standard recognition result determines that the practical recognition result and the standard identifyAs a result matching result.
Second determining module 703, for the matching result according to the practical recognition result and the standard recognition result,Determine the tone testing result of the smart machine.
In another embodiment, the first determining module 702 is specifically used for:
According to the matching result of each first sub- result and each second sub- result, multiple matchings set and each described are determinedThe matching score value of set is matched, includes multiple matchings pair in each matching set, each matching is to by one first son knotFruit and a second sub- result composition.
According to the maximum matching set of matching score value, the practical recognition result and the standard recognition result are determinedMatching result.
In another embodiment, the matching result of each first sub- result and each second sub- result includes each first sub- resultWith the matching score value of each second sub- result;
First determining module 702 is specifically used for:
According to the matching score value of fixed first matching set and current first sub- result and the current second sub- resultMatching score value, determine the second matching set;
Wherein, the current first sub- result and the current second sub- result are when generating in the first matching setBetween matching where the first sub- result the latest to a matching later to included the first sub- result and the second sub- result.
In another embodiment, the first determining module 702 is specifically used for:
According to matching pair included in the maximum matching set of the matching score value, the practical identification knot is generatedThe matching result of fruit and the standard recognition result.
Fig. 8 is the function structure chart of the tone testing device of smart machine provided in an embodiment of the present invention, as shown in figure 8,Described device further include:
Sorting module 704, for being ranked up to the first sub- result each in the practical recognition result according to the time is generated.
Third determining module 705, for according to the longest between each first sub- result and each second sub- result after sequenceCommon subsequence determines the matching result of each first sub- result Yu each second sub- result.
In another embodiment, obtains module 701 and is specifically used for:
It obtains the smart machine and identifies test log generated when the tested speech;
According to preset keyword and preset regular expressions information, the intelligence is filtered out from the test logPractical recognition result of the equipment to tested speech.
In another embodiment, the second determining module 703 is specifically used for:
According to the matching result of the practical recognition result and the standard recognition result, the word of the smart machine is determinedAccuracy rate and/or sentence accuracy rate.
It should be noted that it should be understood that the modules of apparatus above division be only a kind of logic function division,It can completely or partially be integrated on a physical entity in actual implementation, it can also be physically separate.And these modules can be withAll realized by way of processing element calls with software;It can also all realize in the form of hardware;It can also part mouldBlock realizes that part of module passes through formal implementation of hardware by way of processing element calls software.For example, determining module can be withFor the processing element individually set up, it also can integrate and realized in some chip of above-mentioned apparatus, in addition it is also possible to programThe form of code is stored in the memory of above-mentioned apparatus, is called by some processing element of above-mentioned apparatus and is executed above trueThe function of cover half block.The realization of other modules is similar therewith.Furthermore these modules completely or partially can integrate together, can alsoWith independent realization.Processing element described here can be a kind of integrated circuit, the processing capacity with signal.In the process of realizationIn, each step of the above method or the above modules can by the integrated logic circuit of the hardware in processor elements orThe instruction of software form is completed.
For example, the above module can be arranged to implement one or more integrated circuits of above method, such as:One or more specific integrated circuits (application specific integrated circuit, ASIC), or, oneOr multi-microprocessor (digital signal processor, DSP), or, one or more field programmable gate array(field programmable gate array, FPGA) etc..For another example, when some above module dispatches journey by processing elementWhen the form of sequence code is realized, which can be general processor, such as central processing unit (centralProcessing unit, CPU) or it is other can be with the processor of caller code.For another example, these modules can integrate oneIt rises, is realized in the form of system on chip (system-on-a-chip, SOC).
In the above-described embodiments, can come wholly or partly by software, hardware, firmware or any combination thereof realIt is existing.When implemented in software, it can entirely or partly realize in the form of a computer program product.The computer programProduct includes one or more computer instructions.When loading on computers and executing the computer program instructions, all orIt partly generates according to process or function described in the embodiment of the present invention.The computer can be general purpose computer, dedicated meterCalculation machine, computer network or other programmable devices.The computer instruction can store in computer readable storage mediumIn, or from a computer readable storage medium to the transmission of another computer readable storage medium, for example, the computerInstruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data centerUser's line (DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another web-site, computer, server orData center is transmitted.The computer readable storage medium can be any usable medium that computer can access orIt is comprising data storage devices such as one or more usable mediums integrated server, data centers.The usable medium can be withIt is magnetic medium, (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or semiconductor medium (such as solid state hard diskSolid state disk (SSD)) etc..
Fig. 9 is the structural schematic diagram of a kind of electronic equipment 900 provided in an embodiment of the present invention.As shown in figure 9, the electronics is setStandby may include: processor 91, memory 92, communication interface 93 and system bus 94, and the memory 92 and the communication connectMouth 93 connect with the processor 91 by the system bus 94 and completes mutual communication, and the memory 92 is for depositingComputer executed instructions are stored up, the communication interface 93 is used for and other equipment are communicated, and the processor 91 executes the meterThe scheme such as above-mentioned Fig. 1 to embodiment illustrated in fig. 6 is realized when calculation machine program.
The system bus mentioned in the Fig. 9 can be Peripheral Component Interconnect standard (peripheral componentInterconnect, PCI) bus or expanding the industrial standard structure (extended industry standardArchitecture, EISA) bus etc..The system bus can be divided into address bus, data/address bus, control bus etc..ForConvenient for indicating, only indicated with a thick line in figure, it is not intended that an only bus or a type of bus.Communication interfaceFor realizing the communication between database access device and other equipment (such as client, read-write library and read-only library).MemoryMay include random access memory (random access memory, RAM), it is also possible to further include nonvolatile memory(non-volatile memory), for example, at least a magnetic disk storage.
Above-mentioned processor can be general processor, including central processor CPU, network processing unit (networkProcessor, NP) etc.;It can also be digital signal processor DSP, application-specific integrated circuit ASIC, field programmable gate arrayFPGA or other programmable logic device, discrete gate or transistor logic, discrete hardware components.
Optionally, the embodiment of the present invention also provides a kind of storage medium, and instruction is stored in the storage medium, when itsWhen being run on computer, so that computer executes the method such as above-mentioned Fig. 1 to embodiment illustrated in fig. 6.
Optionally, the embodiment of the present invention also provides a kind of chip of operating instruction, and the chip is for executing above-mentioned Fig. 1 extremelyThe method of embodiment illustrated in fig. 6.
The embodiment of the present invention also provides a kind of program product, and described program product includes computer program, the computerProgram is stored in a storage medium, at least one processor can read the computer program from the storage medium, describedThe method that at least one processor can realize above-mentioned Fig. 1 to embodiment illustrated in fig. 6 when executing the computer program.
In embodiments of the present invention, "at least one" refers to one or more, and " multiple " refer to two or more."and/or" describes the incidence relation of affiliated partner, indicates may exist three kinds of relationships, for example, A and/or B, can indicate: singleSolely there are A, A and B are existed simultaneously, the case where individualism B, wherein A, B can be odd number or plural number.The general table of character "/"Show that forward-backward correlation object is a kind of relationship of "or";In formula, character "/" indicates that forward-backward correlation object is a kind of " being divided by "Relationship.At least one of " following (a) " or its similar expression, refer to these in any combination, including individual event (a) orAny combination of complex item (a).For example, at least one (a) in a, b or c, can indicate: a, b, c, a-b, a-c, b-c,Or a-b-c, wherein a, b, c can be individually, be also possible to multiple.
It is understood that the area that the various digital numbers being related in embodiments of the present invention only carry out for convenience of descriptionPoint, it is not intended to limit the invention the range of embodiment.
It is understood that in an embodiment of the present invention, magnitude of the sequence numbers of the above procedures are not meant to executeSequence it is successive, the execution of each process sequence should be determined by its function and internal logic, the reality without coping with the embodiment of the present inventionIt applies process and constitutes any restriction.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extentPipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according toSo be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features intoRow equivalent replacement;And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solutionThe range of scheme.

Claims (10)

CN201910580478.9A2019-06-282019-06-28Voice test method and device of intelligent equipment and electronic equipmentActiveCN110335628B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201910580478.9ACN110335628B (en)2019-06-282019-06-28Voice test method and device of intelligent equipment and electronic equipment

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201910580478.9ACN110335628B (en)2019-06-282019-06-28Voice test method and device of intelligent equipment and electronic equipment

Publications (2)

Publication NumberPublication Date
CN110335628Atrue CN110335628A (en)2019-10-15
CN110335628B CN110335628B (en)2022-03-18

Family

ID=68143702

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201910580478.9AActiveCN110335628B (en)2019-06-282019-06-28Voice test method and device of intelligent equipment and electronic equipment

Country Status (1)

CountryLink
CN (1)CN110335628B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111081252A (en)*2019-12-032020-04-28深圳追一科技有限公司Voice data processing method and device, computer equipment and storage medium
CN114822501A (en)*2022-04-182022-07-29四川虹美智能科技有限公司Automatic testing method and system for voice recognition and semantic recognition of intelligent equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101154175A (en)*2006-09-252008-04-02佛山市顺德区顺达电脑厂有限公司Audio testing method and system combining with voice recognition
US20160118050A1 (en)*2014-10-242016-04-28Sestek Ses Ve Iletisim Bilgisayar Teknolojileri Sanayi Ticaret Anonim SirketiNon-standard speech detection system and method
CN106228986A (en)*2016-07-262016-12-14北京奇虎科技有限公司The automated testing method of a kind of speech recognition engine, device and system
CN108538296A (en)*2017-03-012018-09-14广东神马搜索科技有限公司Speech recognition test method and test terminal
CN109102797A (en)*2018-07-062018-12-28平安科技(深圳)有限公司Speech recognition test method, device, computer equipment and storage medium
CN109493852A (en)*2018-12-112019-03-19北京搜狗科技发展有限公司A kind of evaluating method and device of speech recognition

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101154175A (en)*2006-09-252008-04-02佛山市顺德区顺达电脑厂有限公司Audio testing method and system combining with voice recognition
US20160118050A1 (en)*2014-10-242016-04-28Sestek Ses Ve Iletisim Bilgisayar Teknolojileri Sanayi Ticaret Anonim SirketiNon-standard speech detection system and method
CN106228986A (en)*2016-07-262016-12-14北京奇虎科技有限公司The automated testing method of a kind of speech recognition engine, device and system
CN108538296A (en)*2017-03-012018-09-14广东神马搜索科技有限公司Speech recognition test method and test terminal
CN109102797A (en)*2018-07-062018-12-28平安科技(深圳)有限公司Speech recognition test method, device, computer equipment and storage medium
CN109493852A (en)*2018-12-112019-03-19北京搜狗科技发展有限公司A kind of evaluating method and device of speech recognition

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
樊重俊等: "《数据大分析与应用》", 31 January 2016, 立信会计出版社*

Cited By (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111081252A (en)*2019-12-032020-04-28深圳追一科技有限公司Voice data processing method and device, computer equipment and storage medium
CN114822501A (en)*2022-04-182022-07-29四川虹美智能科技有限公司Automatic testing method and system for voice recognition and semantic recognition of intelligent equipment
CN114822501B (en)*2022-04-182023-07-25四川虹美智能科技有限公司Automatic test method and system for intelligent equipment voice recognition and semantic recognition

Also Published As

Publication numberPublication date
CN110335628B (en)2022-03-18

Similar Documents

PublicationPublication DateTitle
CN111382255B (en) Method, apparatus, device and medium for question answering processing
US11270081B2 (en)Artificial intelligence based virtual agent trainer
US20210027788A1 (en)Conversation interaction method, apparatus and computer readable storage medium
US8856098B2 (en)Ranking search results based on word weight
US11734322B2 (en)Enhanced intent matching using keyword-based word mover's distance
JP7642335B2 (en) Information processing device, method, and program
US8917853B2 (en)Enhanced customer experience through speech detection and analysis
US20170364506A1 (en)System and method for generating phrase based categories of interactions
US20170193085A1 (en)Entailment knowledge base in natural language processing systems
CN109360550A (en) Test method, device, equipment and storage medium for voice interactive system
US8719025B2 (en)Contextual voice query dilation to improve spoken web searching
CN114528391B (en) Training method, device, equipment and storage medium for question-answer pair scoring model
CN111898643A (en)Semantic matching method and device
CN117935863A (en)Reading evaluation method and device, electronic equipment and storage medium
CN110335628A (en)The tone testing method, apparatus and electronic equipment of smart machine
US20200143159A1 (en)Search device, search method, search program, and recording medium
CN111859985B (en)AI customer service model test method and device, electronic equipment and storage medium
CN110264995A (en)The tone testing method, apparatus electronic equipment and readable storage medium storing program for executing of smart machine
WO2020232899A1 (en)Troubleshooting method for data analysis system, and related device
CN118886430A (en) Model evaluation methods, devices, equipment and media
US12380343B2 (en)Complementary evidence identification in natural language inference
CN119202156A (en) Question processing method, device, computer equipment and medium based on artificial intelligence
US12236190B2 (en)Intelligent phrase derivation generation
US12164969B2 (en)Method and system for learning to temporal align signals with interspersed outliers
KR20220085806A (en) Automatic mining of real audio training data

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
TA01Transfer of patent application right
TA01Transfer of patent application right

Effective date of registration:20210518

Address after:100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing

Applicant after:BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.

Applicant after:Shanghai Xiaodu Technology Co.,Ltd.

Address before:100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing

Applicant before:BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd.

GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp