Summary of the invention
In view of the above problems, the present invention has been proposed to provide one to overcome the problems referred to above or at least part ofThe audio-visual synchronous detection method that addresses the above problem and corresponding audio-visual synchronous checkout gear.
According to one aspect of the present invention, a kind of audio-visual synchronous detection method is provided, comprising:
Reception is arranged on the Capture of audio-visual devices and plays the first shadow of storage at described audio-visual devicesThe second video-audio data gathering when sound data;
Mate described the first video-audio data and described the second video-audio data, judge play described first audio-visualWhether data are audio-visual synchronous.
Preferably, described the first video-audio data comprises the first view data and the first voice data, describedTwo video-audio datas comprise the second view data and second audio data.
Preferably, described the first video-audio data of described coupling and described the second video-audio data, judgement is playWhether described the first video-audio data is audio-visual synchronously comprises:
In described the second view data, search and the first object extracting from described the first view dataThe second destination image data that view data is identical;
In described second audio data, extract with described the second destination image data gather simultaneously secondTarget audio data;
The first object voice data that comparison is play with described first object view data simultaneously and described theTwo target audio data, obtain voice data deviate, if described voice data deviate meets default soundIt is first pre-that audio data deviation range and the first reproduction time corresponding to described first object view data meetIf time range, judges the first view data and described the first audio frequency that described the first video-audio data comprisesData are synchronous.
Preferably, at described the first video-audio data of described coupling and described the second video-audio data, judge and playDescribed the first video-audio data whether audio-visual synchronous after, described method also comprises:
Show described first object voice data and described the second order at the display interface of described audio-visual devicesMark with phonetic symbols audio data, and corresponding to described voice data deviate in described the second target audio dataDeviation target audio data identify.
Preferably, described the first video-audio data of described coupling and described the second video-audio data, judgement is playWhether described the first video-audio data is audio-visual synchronously comprises:
In described second audio data, search and the first object extracting from described the first voice dataThe second target audio data that voice data is identical;
In described the second view data, extract with described the second target audio data gather simultaneously secondDestination image data;
The first object view data that comparison is play with described first object voice data simultaneously and described theTwo destination image data, obtain view data deviate, if described view data deviate meets default figureMeet second pre-as data deviation scope and the second reproduction time corresponding to described first object voice dataIf time range, judges the first view data and described the first audio frequency that described the first video-audio data comprisesData are synchronous.
Preferably, at described the first video-audio data of described coupling and described the second video-audio data, judge and playDescribed the first video-audio data whether audio-visual synchronous after, described method also comprises:
Show described first object view data and described the second order at the display interface of described audio-visual devicesMark view data, and corresponding to described view data deviate in described the second destination image dataDeviation destination image data identifies.
Preferably, described Capture comprises HDMI high definition capture card.
The present invention also provides a kind of audio-visual synchronous checkout gear, comprising:
The second video-audio data acquisition module, for receiving the Capture that is arranged on audio-visual devices describedThe second video-audio data that audio-visual devices gathers while playing the first video-audio data of storage;
Audio-visual synchronous determination module, for mating described the first video-audio data and described the second video-audio data,Judge that whether audio-visual described the first video-audio data of playing is synchronous.
Preferably, described the first video-audio data comprises the first view data and the first voice data, describedTwo video-audio datas comprise the second view data and second audio data.
Preferably, described audio-visual synchronous determination module comprises:
The second destination image data is searched submodule, in described the second view data, search with fromThe second identical destination image data of first object view data of extracting in described the first view data;
The second target audio data are extracted submodule, at described second audio data, extract and instituteState the second target audio data that the second destination image data gathers simultaneously;
The first video-audio data is synchronously determined submodule, for comparison and described first object view data whileFirst object voice data and described the second target audio data play, obtain voice data deviate,If described voice data deviate meets default voice data deviation range and described first object picture numberMeet the first Preset Time scope according to the first reproduction time of correspondence, judge described the first video-audio data bagFirst view data of drawing together is synchronizeed with described the first voice data.
Preferably, described device also comprises:
Voice data display module, at described the first video-audio data of described coupling and described second audio-visualData, judge described the first video-audio data of playing whether audio-visual synchronous after, at described audio-visual devicesDisplay interface is shown described first object voice data and described the second target audio data, and describedIn the second target audio data, deviation target audio data corresponding to described voice data deviate are carried outMark.
Preferably, described the first video-audio data of described coupling and described the second video-audio data, judgement is playDescribed the first video-audio data possesses and audio-visually synchronously comprises:
The second target audio data search submodule, at described second audio data, search with fromThe second identical target audio data of first object voice data of extracting in described the first voice data;
The second destination image data is extracted submodule, in described the second view data, extracts and instituteState the second destination image data that the second target audio data gather simultaneously;
The second video-audio data is synchronously determined submodule, for comparison and described first object voice data whileFirst object view data and described the second destination image data play, obtain view data deviate,If described view data deviate meets default view data deviation range and described first object audio frequency numberMeet the second Preset Time scope according to the second reproduction time of correspondence, judge described the first video-audio data bagFirst view data of drawing together is synchronizeed with described the first voice data.
Preferably, described device also comprises:
View data display module, at described the first video-audio data of described coupling and described second audio-visualData, judge described the first video-audio data of playing whether audio-visual synchronous after, at described audio-visual devicesDisplay interface is shown described first object view data and described the second destination image data, and describedIn the second destination image data, deviation destination image data corresponding to described view data deviate carried outMark.
Preferably, described Capture comprises HDMI high definition capture card.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge the whether shadow of described the first video-audio data of playingSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
And, after the synchronism that completes the first video-audio data that audio-visual devices is play detects, audio-visual establishingStandby display interface is shown first object video-audio data and the second target video-audio data for comparing, andInclined to one side to the view data calculating in first object video-audio data and the second target video-audio data respectivelyTarget video-audio data corresponding to difference or voice data deviate identifies, and user can be by reading phaseClose mark and find out fast the position that deviation appears in the second target video-audio data, shortened user and checked detection knotThe time of fruit.
In addition, support HDMI output based on audio-visual devices, utilize HDMI high definition capture card to playingThe first video-audio data gather, can collect simultaneously and comprise the second view data and the second audio frequency numberAccording to the second video-audio data. Because HDMI high definition capture card can carry out the first video-audio data of playingFully pressure-free contracting in real time gathers, and has saved the required operating time of squeeze operation, has ensured for the second shadowThe acquisition operations of sound data with for the play operation of the first video-audio data synchronism in time, thereforeIn the first video-audio data process of broadcasting, can complete first according to the second video-audio data of synchronous acquisitionThe whether audio-visual synchronous detection of video-audio data, without after end to be collected again to the first video-audio data and secondVideo-audio data is compared, and has shortened detection time, has further improved detection efficiency.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to better understand skill of the present inventionArt means, and can being implemented according to the content of description, and for allow of the present invention above-mentioned and otherObject, feature and advantage can become apparent, below especially exemplified by the specific embodiment of the present invention.
Detailed description of the invention
Exemplary embodiment of the present disclosure is described below with reference to accompanying drawings in more detail. Although show in accompanying drawingExemplary embodiment of the present disclosure, but should be appreciated that and can realize the disclosure and not with various formsThe embodiment that should be set forth here limits. On the contrary, providing these embodiment is for can be more thoroughlyUnderstand the disclosure, and can be by the those skilled in the art that conveys to complete the scope of the present disclosure.
With reference to Fig. 1, show a kind of audio-visual synchronous detection method flow process according to the embodiment of the present invention 1Figure, described method specifically can comprise:
Step 101, reception are arranged on the Capture of audio-visual devices and play storage at described audio-visual devicesThe first video-audio data time the second video-audio data of gathering.
Audio-visual devices can comprise that personal computer, TV box, panel computer and smart mobile phone etc. are audio-visualEquipment. Capture has memory function, and being pre-stored within of can playing for collection is audio-visualThe first video-audio data of equipment.
In the embodiment of the present invention, in advance the first video-audio data is stored in audio-visual devices, by audio-visual collectionCard is arranged in audio-visual devices, before broadcasting the first video-audio data, needs the first audio-visual number in decompressed stateAccording to compressing, obtain the first video-audio data with audio-visual form storage, described audio-visual form can beAVI, wma, rmvb, rm, flash, mp4, mid or other audio-visual form being suitable for. Audio-visual establishingStandby the first video-audio data of playing after compression, it is right that Capture monitors after the broadcasting behavior of audio-visual devicesThe first video-audio data of playing gathers, and can obtain the second video-audio data in decompressed state.
In specific implementation, Capture can be divided into compression Capture and epitome sound with no pressure collectionCard, utilizes the video-audio data of contracting Capture with no pressure collection more to mate with the video-audio data of broadcasting.
Step 102, mate described the first video-audio data and described the second video-audio data, judge the institute playingState the first video-audio data whether audio-visual synchronous.
In the embodiment of the present invention, audio-visual can be synchronously the demonstration of audio-visual devices while playing the first video-audio dataThe synchronous sound that the image of showing interface and loudspeaker are play. Particularly, can be audio-visual to gather secondData and the first pre-stored video-audio data are compared, when described the second video-audio data and described firstWhen video-audio data coupling, judge that described the first video-audio data of playing possesses audio-visual synchronous.
In specific implementation, the first pre-stored video-audio data can be audio-visual synchronous data, canThe first video-audio data that utilizes contracting Capture collection with no pressure to play, obtains and the first audio-visual number of playingAccording to the second video-audio data of coupling. The first video-audio data based on storage is audio-visual synchronous data, canThe second video-audio data gathering by contrast and audio-visual the first synchronous video-audio data, judge second of collectionWhether audio-visual devices is audio-visual synchronous, further judges that whether audio-visual the first video-audio data of playing is synchronous, thenFurther judge whether the audio-visual playback equipment of playing the first video-audio data has audio-visual synchronous playing function.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge that described the first video-audio data of playing possesses shadowSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
With reference to Fig. 2, show a kind of audio-visual synchronous detection method flow process according to the embodiment of the present invention 2Figure, described method specifically can comprise:
Step 201, reception are arranged on the Capture of audio-visual devices and play storage at described audio-visual devicesThe first video-audio data time the second video-audio data of gathering.
In the embodiment of the present invention, the first pre-stored video-audio data of described audio-visual devices can be in decompress(ion) shapeState, described the first video-audio data can comprise the first view data and the first voice data, can be in storageThe corresponding relation of preset the first view data and the first voice data, i.e. preset difference when the first video-audio dataThe first view data that moment plays simultaneously and the corresponding relation of the first voice data. Described CaptureThe second video-audio data gathering can be in decompressed state, and described the second video-audio data can comprise the second imageData and second audio data. Described Capture can be simultaneously to the second view data and the second audio frequencyData gather, and have ensured the second view data and the synchronism of second audio data on acquisition time,Avoid the audio-visual asynchronous problem causing because of acquisition operations.
In specific implementation, described Capture can be HDMI high definition capture card (HighDefinitionMultimediaInterface), HDMI high definition capture card can be audio-visual to play firstData are carried out the collection without compression, obtain the first view data and the first voice data. Particularly, described inThe first view data and the second view data all can be according to certain tactic one group of frame of video, and oneGroup ordered graph picture or picture, described the first voice data and second audio data all can be a section audio waveformFigure. Correspondingly, the present invention program can implement on the audio-visual devices with HDMI output function.
Step 202, in described the second view data, search and extract from described the first view dataThe second identical destination image data of first object view data.
In the embodiment of the present invention, described first object view data can be for to choose from the first view dataFor comparing the view data of audio-visual synchronism; Described the second destination image data can be described secondThe view data identical with described first object view data in view data.
Particularly, can from the first view data of described the first video-audio data, extract first object in advanceView data, in the second view data of described the second video-audio data, searches and the first object extractingThe second destination image data that view data is identical.
In specific implementation, described first object view data can be to play continuously for a certain periodOne group of ordered graph picture; Also can be the picture group for multiple image compositions of multiple discontinuous broadcastings of momentPicture.
Step 203, in described second audio data, extract with described the second destination image data simultaneouslyThe the second target audio data that gather.
In the embodiment of the present invention, because Capture can be simultaneously to the second view data and the second audio frequencyData gather, so passable for the second view data and the second audio data of a certain moment collectionThere is corresponding relation. In the second view data, find and extract from described the first view dataAfter identical the second destination image data of first object view data, in described second audio data, canWith the second target audio data of searching and extraction and described the second destination image data gather simultaneously.
The first object voice data that step 204, comparison and described first object view data are play simultaneouslyWith described the second target audio data, obtain voice data deviate, if described voice data deviate symbolClose the first reproduction time symbol corresponding to default voice data deviation range and described first object view dataClose the first Preset Time scope, judge the first view data that described the first video-audio data comprises with described inThe first voice data is synchronous. For example, the first time range when default is N at least second, described first objectThe first reproduction time corresponding to view data is M second, if M is greater than N second second, judges described firstThe first view data that video-audio data comprises is synchronizeed with described the first voice data; If M is less than N second second,Judge that the first view data that described the first video-audio data comprises is asynchronous with described the first voice data.
In the embodiment of the present invention, based on storage preset first view data and first when the first video-audio dataThe corresponding relation of voice data can be searched and extraction and described first object figure in the first voice dataThe first object voice data of simultaneously playing as data.
Can be after definite first object voice data and the second target audio data, by related algorithm,Calculate the audio frequency nonsynchronous deviation of the second target audio data with respect to first object voice data, obtainVoice data deviate. The voice data deviate obtaining and default voice data deviation range are comparedRight, if described voice data deviate meets default voice data deviation range, judge first object soundAudio data and first object view data are synchronous broadcasting; Otherwise, judge first object voice data and theOne destination image data is asynchronous broadcasting, and then it is audio-visual synchronous to judge that the first video-audio data does not possess. ?Judge that first object voice data and first object view data, as after synchronous broadcasting, further judge instituteState the relation of the first reproduction time corresponding to first object view data and the first Preset Time scope, if instituteState the first reproduction time corresponding to first object view data and meet the first Preset Time scope, judgeOne view data with described the first voice data for synchronizeing broadcasting, and then judge play the first video-audio dataPossess audio-visual synchronous; If it is first pre-that the first reproduction time corresponding to described first object view data do not meetIf time range, judges that the first video-audio data of playing does not possess audio-visual synchronous.
In specific implementation, can calculate by the following method the second target audio data with respect to the first orderThe nonsynchronous deviation of audio frequency of mark with phonetic symbols audio data, obtains voice data deviate, but not as limitting itHis computational methods also can, the described method of the present embodiment comprises:
Step S1, section audio data of choosing in first object voice data are designated as first object audio frequencyData, respectively to each audio frequency in the first object audio frequency subdata of choosing and the second target audio dataData acquisition sampling point is normalized.
Normalized is that a kind of dimensionless is processed means, makes the absolute value of physical system numerical value become certainRelative value relation, is to simplify to calculate, and dwindles the effective ways of value, is applied to the embodiment of the present invention, canSo that the volume unification of each audio data sampling point comprising is treated between-1～1.
Particularly, voice data comprises a large amount of audio data sampling points, plays or gather voice dataCan be and play or gather a large amount of audio data sampling points. Broadcasting frequency or the frequency acquisition of voice data canThink the number of the audio data sampling point of playing or gathering in certain hour, conventionally, play frequency or adoptCollection frequency is predefined, and unmodified keeps inconvenience.
Step S2, by the data initiating terminal of the described first object audio frequency subdata after normalized with returnOne changes the data initiating terminal alignment of the second target audio data after treatment, by have corresponding relation, belong toIn the audio data sampling point and the audio frequency that belongs to the second target audio data of first object audio frequency subdataThe mean value calculation that data acquisition sampling point differs from, specific formula for calculation is:
X1＝((A[1]-B[1])+(A[2]-B[2])+….+(A[n]-B[n]))/n
Wherein, X1For the first mean value calculating; A[1]For the initial audio frequency of first object audio frequency subdataData acquisition sampling point; A[2]For second audio data sampling point of first object audio frequency subdata; A[n]BeN audio data sampling point of one target audio subdata; B[1]Be rising of the second target audio dataBeginning audio data sampling point; B[2]Be second audio data sampling point of the second target audio data; B[n]Be n audio data sampling point of the second target audio data; N is first object audio frequency subdata bagThe number of the audio data sampling point containing, n is positive integer.
Step S3, by the mobile m audio frequency to the right of the first object audio frequency subdata after normalizedData acquisition sampling point, by the data initiating terminal of described first object audio frequency subdata and the second target audio dataIn (1+m) individual audio data sampling point alignment, by thering is corresponding relation, belong to first objectThe audio data sampling point of audio frequency subdata and the audio data sampling point that belongs to the second target audio dataThe mean value calculation differing from, specific formula for calculation is:
X2＝((A[1]-B[1+m])+(A[2]-B[2+m])+….+(A[n]-B[n+m]))/n，{m∈(0～(a-n))}
Wherein, X2For the second mean value calculating; A[1]For the initial audio frequency of first object audio frequency subdataData acquisition sampling point; A[2]For second audio data sampling point of first object audio frequency subdata; A[n] beN audio data sampling point of first object audio frequency subdata; B[1+m]Be the second target audio data(1+m) individual audio data sampling point; B[2+m]It is (2+m) individual sound of the second target audio dataAudio data sampled point; B[n+m]It is (n+m) individual audio data sampling point of the second target audio data;N is the number of the audio data sampling point that comprises of first object audio frequency subdata, and n is positive integer; M isOnce skew occurs needs the number of the audio data sampling point of process, and m is positive integer; A is first objectThe total number of the audio data sampling point that voice data comprises, a is positive integer and a > n.
Step S4, repeating step S3, m audio frequency successively moves right first object audio frequency subdataData acquisition sampling point, calculates the 3rd mean value X3, the average X of Siping City4..., p mean value Xp, straightBe aligned to the data end of first object audio frequency subdata and the data end of the second target audio dataOnly, each mean value X1～pCorresponding one section of second audio frequency target data, from all mean values that calculateX1～XPIn select minimum average B configuration value Xmin＝Q, judges this minimum average B configuration value XminWhether meet preset matchingScope, if meet, judges first object audio frequency subdata and minimum average B configuration value XminCorresponding one section theTwo target audio data are accurately mated.
Particularly, can set preset matching scope as required, when preset matching scope is made as1 o'clock, first object audio frequency subdata and minimum average B configuration value XminIt is 0 o'clock one section of second corresponding targetVoice data mates completely.
Step S5, calculates minimum average B configuration value Xmin＝One section of second target audio data corresponding to q with respect toThe displacement deviator r of the second target audio data initial data, using r as first object voice data andThe deviation of two target audio data, specific formula for calculation is:
r＝(q-1)×m
Wherein, r is the deviation of first object audio frequency and the second target audio; Q is minimum average B configuration value Xmin＝qCorresponding skew number of times; There is once skew to need the number of the audio data sampling point of process in m; M,N is positive integer.
Step S6, based on voice data fixing broadcasting frequency and frequency acquisition, calculates each voice dataThe broadcasting that sampled point is corresponding or the time of collection, according to the first object voice data and the second target that obtainThe deviation r of voice data, so calculate between first object voice data and the second target audio data timeBetween deviation, specific formula for calculation is:
T＝t×r
Wherein, T is the time deviation between first object voice data and the second target audio data; R isThe deviation of first object audio frequency and the second target audio; T is the broadcasting that each audio data sampling point is correspondingOr the time gathering.
In addition, can according to HDMI high definition capture card without compressed video, play the at audio-visual devicesOne video-audio data gathers the character of the second video-audio data simultaneously, in the first video-audio data playing process to adoptingPart second video-audio data of collection and the first pre-stored video-audio data are compared, when the first audio-visual numberWhether after finishing according to broadcasting, can complete described the first video-audio data is audio-visual synchronous detection; Also canWith the second video-audio data to collection and the first pre-stored shadow after finishing in the first video-audio data broadcastingSound data is compared, and whether complete the first video-audio data is audio-visual synchronous detection.
When described first object view data be one group of ordered graph playing continuously for a certain period as time,The first reproduction time corresponding to described first object view data can be to be made up of multiple continuous momentTime period; When described first object view data is the multiple image sets for multiple discontinuous broadcastings of momentBecome one group of image time, the first reproduction time corresponding to described first object view data is by multiple non-companiesThe time period of continuous moment composition.
Step 205, show described first object voice data and institute at the display interface of described audio-visual devicesState the second target audio data, and in described the second target audio data to described voice data deviationDeviation target audio data corresponding to value identify.
In the embodiment of the present invention, judge the first video-audio data of playing possess or do not possess audio-visual synchronous after,Respectively by described first object video-audio data and described the second target audio data display at audio-visual devicesOn display interface, and corresponding to described voice data deviate in described the second target audio dataDeviation target audio data identify, and identify deviation target corresponding to described voice data deviateVoice data is Data Position of living in second audio data, and user can look into rapidly by reading markSee testing result.
In specific implementation, in deviation target audio data being identified in second audio data,Also can be to the first object view data identical with the second destination image data in the first voice dataCorresponding first object voice data identifies, the first object sound that user can identify by comparisonAudio data and the second target audio data analysis voice data deviation situation.
With reference to Fig. 3, show displaying first object video-audio data and the second target shadow of the embodiment of the present inventionThe schematic diagram of the display interface of the audio-visual devices of sound data. The display interface exhibition of the audio-visual devices shown in Fig. 3Show for the first object view data of a certain period broadcasting and the second destination image data of collection, theBetween one target video-audio data and the second video-audio data, one time shaft is set, in figure, identifying a is that voice data is inclined to one sidePoor mark, can determine that deviation target audio data are in the second target audio rapidly by identification marking aRecord position in data. Particularly, first object view data and the second destination image data are oneOrganize orderly image, the second target audio data of the first object voice data of described broadcasting and collection are equalBe one section of oscillogram, first object voice data is positioned at the below of first object view data, for a certainMoment, first object view data be positioned at below first object voice data be play simultaneously firstTarget video-audio data, in like manner, for a certain moment, the second destination image data be positioned at below secondTarget audio data are the second target video-audio data simultaneously gathering. As can be seen from Figure 3, based on firstDestination image data is vertically alignd with the second destination image data, by first object view data and secondDestination image data, as synchronization criterion, identifies by comparison the first object voice data and that a is correspondingTwo target audio data, the waveform existing between known the second target audio data and first object voice dataDeviation is larger, if the voice data deviate of calculating does not meet default voice data deviation range, can sentenceDisconnected first object video-audio data does not possess audio-visual synchronous, i.e. the first object audio frequency of first object video-audio dataData and first object view data are asynchronous broadcasting, and then can judge that the first video-audio data does not possessAudio-visual synchronous.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge the whether shadow of described the first video-audio data of playingSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
And, after the synchronism that completes the first video-audio data that audio-visual devices is play detects, audio-visual establishingStandby display interface is shown first object video-audio data and the second target video-audio data for comparing, andInclined to one side to the view data calculating in first object video-audio data and the second target video-audio data respectivelyTarget video-audio data corresponding to difference or voice data deviate identifies, and user can be by reading phaseClose mark and find out fast the position that deviation appears in the second target video-audio data, shortened user and checked detection knotThe time of fruit.
In addition, support HDMI output based on audio-visual devices, utilize HDMI high definition capture card to playingThe first video-audio data gather, can collect simultaneously and comprise the second view data and the second audio frequency numberAccording to the second video-audio data. Because HDMI high definition capture card can carry out the first video-audio data of playingFully pressure-free contracting in real time gathers, and has saved the required operating time of squeeze operation, has ensured for the second shadowThe acquisition operations of sound data with for the play operation of the first video-audio data synchronism in time, thereforeIn the first video-audio data process of broadcasting, can complete first according to the second video-audio data of synchronous acquisitionThe whether audio-visual synchronous detection of video-audio data, without after end to be collected again to the first video-audio data and secondVideo-audio data is compared, and has shortened detection time, has further improved detection efficiency.
For making those skilled in the art more clearly understand the present invention, audio-visual in the example of enumerating belowSynchronous detection method is described in detail.
With reference to Fig. 4, show the schematic diagram of the audio-visual synchronous detection method of the embodiment of the present invention. By scheming4 is known, and described detection method specifically comprises:
The first step, is stored to audio-visual devices by the first video-audio data to be measured;
Second step, is arranged on HDMI high definition capture card in audio-visual devices;
The 3rd step, HDMI high definition capture card detects after the play operation of audio-visual devices, gathers to playThe first video-audio data obtains the second video-audio data;
The 4th step is chosen first object view data in the first view data of the first video-audio data,In the second image of the second video-audio data, search second target image identical with first object view dataData, if find the second destination image data, carry out next step operation; If do not find the second targetView data, this detects unsuccessfully;
The 5th step is searched with the second destination image data same in the second audio data of the second video-audio dataTime the second target audio data of gathering, comparison the second target audio data and first object view data are togetherTime play first object voice data, if the second target audio data are with respect to first object voice dataVoice data deviate do not meet default voice data deviation range, judge first object audio frequency numberAccording to first object view data be asynchronous broadcasting, corresponding first object video-audio data does not possess audio-visualSynchronously; If second audio data meets default sound with respect to the voice data deviate of the first voice dataAudio data deviation range, judge first object voice data with first object view data as synchronizeing broadcasting,Corresponding first object video-audio data possesses audio-visual synchronous;
The 6th step, first reproduction time corresponding to first object voice data judges, if first broadcastsThe time of putting meets the first Preset Time scope, judges that the first video-audio data possesses audio-visual synchronous; If firstReproduction time does not meet the first Preset Time scope, judges that the first video-audio data does not possess audio-visual synchronous,Again other played data of the first video-audio data is detected. For example, Preset Time scope is at least5min, the first reproduction time is 6min, the first reproduction time meets the first preset range, judgesOne video-audio data possesses audio-visual synchronous.
In specific implementation, may be because cassette tape or other reason cause failing to look in the second view dataTo second destination image data identical with first object view data, thereby there is detection validation failureTesting result.
With reference to Fig. 5, Fig. 5 shows a kind of audio-visual synchronous detection method according to the embodiment of the present invention 3Flow chart, described method specifically can comprise:
Step 301, reception are arranged on the Capture of audio-visual devices and play storage at described audio-visual devicesThe first video-audio data time the second video-audio data of gathering.
Step 302, in described second audio data, search and extract from described the first voice dataThe second identical target audio data of first object voice data.
In the embodiment of the present invention, described first object voice data can be for to choose from the first voice dataFor comparing the voice data of audio-visual synchronism; Described the second AV data can be described secondThe voice data identical with described first object voice data in voice data.
Particularly, can from the first voice data of described the first video-audio data, extract first object in advanceVoice data, in the second audio data of described the second video-audio data, searches and the first object extractingThe second target audio data that voice data is identical.
In specific implementation, described first object voice data can be to play continuously for a certain periodOne section of continuous oscillogram; Also can be the discontinuous waveform of multistage for multiple discontinuous broadcastings of momentFigure.
Step 303, in described the second view data, extract with described the second target audio data simultaneouslyThe second destination image data gathering.
In the embodiment of the present invention, because Capture can be simultaneously to the second view data and the second audio frequencyData gather, so the second view data and the second audio data that gather for a certain moment haveCorresponding relation. In second audio data, find with from described the first voice data, extract firstAfter identical the second target audio data of target audio data, in described the second view data, search alsoExtract the second destination image data simultaneously gathering with described the second target audio data.
The first object view data that step 304, comparison and described first object voice data are play simultaneouslyWith described the second destination image data, obtain view data deviate, if described view data deviate symbolClose the second reproduction time symbol that default view data deviation range and described first object voice data are correspondingClose the second Preset Time scope, judge the first view data that described the first video-audio data comprises with described inThe first voice data is synchronous.
In the embodiment of the present invention, based on when storage the first preset view data and the first voice data rightShould be related to, can in the first view data, search and extraction and described first object voice data are broadcast simultaneouslyThe first object view data of putting.
Can be after definite first object view data and the second destination image data, by related algorithm,The nonsynchronous deviation of image of calculating the second destination image data and first object view data, obtains imageData deviation value. The view data deviate obtaining and default view data deviation range are compared,If described view data deviate meets default view data deviation range, judge first object audio frequency numberAccording to first object view data be synchronous broadcasting; Otherwise, judge first object voice data and the first orderMark view data is asynchronous broadcasting, and then it is audio-visual synchronous to judge that the first video-audio data does not possess. JudgingFirst object voice data and first object view data are after synchronous broadcasting, further judge described theThe second reproduction time that one target audio data are corresponding and the relation of the second Preset Time scope, if describedThe second reproduction time corresponding to one target audio data meets the second Preset Time scope, and judgement is playThe first video-audio data possesses audio-visual synchronous, and the first view data is broadcast for synchronizeing with described the first voice dataPut; If the second reproduction time that described first object voice data is corresponding does not meet the second Preset Time scope,Judge that the first video-audio data of playing does not possess audio-visual synchronous.
Step 305, show described first object view data and institute at the display interface of described audio-visual devicesState the second destination image data, and in described the second destination image data to described view data deviationDeviation destination image data corresponding to value identifies.
In the embodiment of the present invention, judge the first video-audio data of playing possess or do not possess audio-visual synchronous after,Respectively by described first object video-audio data and described the second target audio data display at audio-visual devicesOn display interface, and corresponding to described view data deviate in described the second destination image dataDeviation destination image data identifies, and identifies deviation target corresponding to described view data deviateView data is Data Position of living in the second view data, and user can look into rapidly by reading markSee testing result.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge the whether shadow of described the first video-audio data of playingSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
And, after the synchronism that completes the first video-audio data that audio-visual devices is play detects, audio-visual establishingStandby display interface is shown first object video-audio data and the second target video-audio data for comparing, andInclined to one side to the view data calculating in first object video-audio data and the second target video-audio data respectivelyTarget video-audio data corresponding to difference or voice data deviate identifies, and user can be by reading phaseClose mark and find out fast the position that deviation appears in the second target video-audio data, shortened user and checked detection knotThe time of fruit.
Based on the explanation of said method embodiment, the present invention also provides corresponding audio-visual synchronous detection dressPut embodiment, realize the content described in said method embodiment.
With reference to Fig. 6, show a kind of audio-visual synchronous structure of the detecting device according to the embodiment of the present invention 1Block diagram, described device can comprise:
The second video-audio data acquisition module 401, the Capture that is arranged on audio-visual devices for receiving existsThe second video-audio data that described audio-visual devices gathers while playing the first video-audio data of storage.
Audio-visual synchronous determination module 402, for mating described the first video-audio data and described the second audio-visual numberAccording to, judge that whether audio-visual described the first video-audio data of playing is synchronous.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge the whether shadow of described the first video-audio data of playingSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
With reference to Fig. 7, show a kind of audio-visual synchronous structure of the detecting device according to the embodiment of the present invention 2Block diagram, described device can comprise:
The second video-audio data acquisition module 501, the Capture that is arranged on audio-visual devices for receiving existsThe second video-audio data that described audio-visual devices gathers while playing the first video-audio data of storage.
Audio-visual synchronous determination module 502, for mating described the first video-audio data and described the second audio-visual numberAccording to, judge that whether audio-visual described the first video-audio data of playing is synchronous.
Voice data display module 503, for described the first video-audio data of described coupling and described secondVideo-audio data, judge described the first video-audio data of playing possess audio-visual synchronous after, described audio-visual establishingStandby display interface is shown described first object voice data and described the second target audio data, andDeviation target audio data corresponding to described voice data deviate in described the second target audio dataIdentify.
Described audio-visual synchronous determination module 502 comprises:
The second destination image data is searched submodule 5021, in described the second view data, searchesThe second target image number identical with the first object view data of extracting from described the first view dataAccording to;
The second target audio data are extracted submodule 5022, at described second audio data, extractThe the second target audio data that simultaneously gather with described the second destination image data;
The first video-audio data is synchronously determined submodule 5023, for comparison and described first object view dataFirst object voice data and described the second target audio data play obtain voice data deviation simultaneouslyValue, if described voice data deviate meets default voice data deviation range and described first object imageThe first reproduction time corresponding to data meets the first Preset Time scope, judges described the first video-audio dataThe first view data comprising is synchronizeed with described the first voice data.
In the embodiment of the present invention, preferably, described the first video-audio data can comprise the first view data andThe first voice data, described the second video-audio data can comprise the second view data and second audio data.
In the embodiment of the present invention, preferably, described Capture can comprise HDMI high definition capture card.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge the whether shadow of described the first video-audio data of playingSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
And, after the synchronism that completes the first video-audio data that audio-visual devices is play detects, audio-visual establishingStandby display interface is shown first object video-audio data and the second target video-audio data for comparing, andInclined to one side to the view data calculating in first object video-audio data and the second target video-audio data respectivelyTarget video-audio data corresponding to difference or voice data deviate identifies, and user can be by reading phaseClose mark and find out fast the position that deviation appears in the second target video-audio data, shortened user and checked detection knotThe time of fruit.
In addition, support HDMI output based on audio-visual devices, utilize HDMI high definition capture card to playingThe first video-audio data gather, can collect simultaneously and comprise the second view data and the second audio frequency numberAccording to the second video-audio data. Because HDMI high definition capture card can carry out the first video-audio data of playingFully pressure-free contracting in real time gathers, and has saved the required operating time of squeeze operation, has ensured for the second shadowThe acquisition operations of sound data with for the play operation of the first video-audio data synchronism in time, thereforeIn the first video-audio data process of broadcasting, can complete first according to the second video-audio data of synchronous acquisitionThe whether audio-visual synchronous detection of video-audio data, without after end to be collected again to the first video-audio data and secondVideo-audio data is compared, and has shortened detection time, has further improved detection efficiency.
With reference to Fig. 8, show a kind of audio-visual synchronous structure of the detecting device according to the embodiment of the present invention 3Block diagram, described device can comprise:
The second video-audio data acquisition module 601, the Capture that is arranged on audio-visual devices for receiving existsThe second video-audio data that described audio-visual devices gathers while playing the first video-audio data of storage.
Audio-visual synchronous determination module 602, for mating described the first video-audio data and described the second audio-visual numberAccording to, judge that whether audio-visual described the first video-audio data of playing is synchronous.
View data display module 603, for described the first video-audio data of described coupling and described secondVideo-audio data, judge described the first video-audio data of playing possess audio-visual synchronous after, described audio-visual establishingStandby display interface is shown described first object view data and described the second destination image data, andThe deviation destination image data corresponding to described view data deviate in described the second destination image dataIdentify.
Described audio-visual synchronous determination module 602 comprises:
The second target audio data search submodule 6021, at described second audio data, searchesThe second target audio number identical with the first object voice data extracting from described the first voice dataAccording to;
The second destination image data is extracted submodule 6022, in described the second view data, extractsThe second destination image data simultaneously gathering with described the second target audio data;
The second video-audio data is synchronously determined submodule 6023, for comparison and described first object voice dataFirst object view data and described the second destination image data play obtain view data deviation simultaneouslyValue, if described view data deviate meets default view data deviation range and described first object audio frequencyThe second reproduction time corresponding to data meets the second Preset Time scope, judges described the first video-audio dataThe first view data comprising is synchronizeed with described the first voice data.
According to the embodiment of the present invention, utilize the Capture that is arranged on audio-visual devices to complete playingThe collection of the first video-audio data that is pre-stored within audio-visual devices, obtain the second video-audio data, coupling instituteState the first video-audio data and described the second video-audio data, judge that described the first video-audio data of playing possesses shadowSound is synchronous, and whole testing process, without manual operation, has improved detection efficiency.
And, after the synchronism that completes the first video-audio data that audio-visual devices is play detects, audio-visual establishingStandby display interface is shown first object video-audio data and the second target video-audio data for comparing, andInclined to one side to the view data calculating in first object video-audio data and the second target video-audio data respectivelyTarget video-audio data corresponding to difference or voice data deviate identifies, and user can be by reading phaseClose mark and find out fast the position that deviation appears in the second target video-audio data, shortened user and checked detection knotThe time of fruit.
For above-mentioned coding mode judgment means embodiment, because it is substantially similar to embodiment of the method,So that describes is fairly simple, relevant part referring to the part explanation of embodiment of the method shown in Fig. 1-Fig. 5 isCan.
Each embodiment in this description all adopts the mode of going forward one by one to describe, and each embodiment stressesBe all and the difference of other embodiment, between each embodiment identical similar part mutually referring to.
Those skilled in the art are easy to expect: any combination of above-mentioned each embodiment is applied allFeasible, therefore any combination between above-mentioned each embodiment is all embodiment of the present invention,But this description has not just described in detail one by one at this as space is limited.
The algorithm providing at this and demonstration are solid with any certain computer, virtual system or miscellaneous equipmentHave relevant. Various general-purpose systems also can with based on using together with this teaching. According to description above,It is apparent constructing the desired structure of this type systematic. In addition, the present invention is not also for any specificProgramming language. It should be understood that and can utilize various programming languages to realize content of the present invention described here,And the description of above language-specific being done is in order to disclose preferred forms of the present invention.
In the description that provided herein, a large amount of details are described. But, can understand, thisInventive embodiment can be put into practice in the situation that there is no these details. In some instances, notBe shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, should be appreciated that in order to simplify the disclosure and to help to understand in each inventive aspectOr multiple, in the above in the description of exemplary embodiment of the present invention, each feature of the present invention is sometimesBe grouped together into single embodiment, figure or in its description. But, should be by the disclosureMethod be construed to the following intention of reflection: the present invention for required protection requires than in each claimThe more feature of the middle feature of clearly recording. Or rather, as claims below reflectLike that, inventive aspect is to be less than all features of disclosed single embodiment above. Therefore, followClaims of detailed description of the invention are incorporated to this detailed description of the invention, wherein each right thus clearlyRequirement itself is all as independent embodiment of the present invention.
Those skilled in the art are appreciated that and can carry out certainly the module in the equipment in embodimentChange adaptively and they are arranged in one or more equipment different from this embodiment. CanModule in embodiment or unit or assembly are combined into a module or unit or assembly, and in addition canTo put them into multiple submodules or subelement or sub-component. Except such feature and/or process orAt least some in unit are, outside mutually repelling, can adopt any combination (to comprise companion to this descriptionWith claim, summary and accompanying drawing) in disclosed all features and so disclosed any method orAll processes or the unit of person's equipment combine. Unless clearly statement in addition, this description (comprises companionWith claim, summary and accompanying drawing) in disclosed each feature can be by providing identical, being equal to or phaseAlternative features like object replaces.
In addition, although those skilled in the art will appreciate that embodiment more described herein comprise itIncluded some feature instead of further feature in its embodiment, but the group of the feature of different embodimentClose and mean within scope of the present invention and form different embodiment. For example, power belowIn profit claim, the one of any of embodiment required for protection can make with combination arbitrarilyWith.
All parts embodiment of the present invention can realize with hardware, or with in one or more processingThe software module of moving on device realizes, or realizes with their combination. Those skilled in the art shouldUnderstand, can use in practice microprocessor or digital signal processor (DSP) to realize basisSome of some or all parts in the audio-visual synchronous checkout equipment of the embodiment of the present invention or completePortion's function. The present invention can also be embodied as for carrying out part or all of method as described hereinEquipment or device program (for example, computer program and computer program). Such realizationProgram of the present invention can be stored on computer-readable medium, or can have one or more letterNumber form. Such signal can be downloaded and obtain from internet website, or carries on carrier signalConfession, or provide with any other form.
It should be noted above-described embodiment the present invention will be described instead of limit the invention,And those skilled in the art can design replacement in the case of not departing from the scope of claimsEmbodiment. In the claims, any reference symbol between bracket should be configured to rightThe restriction requiring. Word " comprises " not to be got rid of existence and is not listed as element or step in the claims. Be positioned atWord " one " before element or " one " do not get rid of and have multiple such elements. The present invention can be byIn including the hardware of some different elements and realizing by means of the computer of suitably programming. EnumeratingIn the unit claim of some devices, these device in several can be by same hardwareItem carrys out imbody. The use of word first, second and C grade does not represent any order. Can be byThese word explanations are title.