Summary of the invention
For solving the technical problem that prior art exists, the embodiment of the present invention provide a kind of information processing method andElectronic equipment.
A kind of information processing method that the embodiment of the present invention provides, be applied to have the first image acquisition units,Second image acquisition units, display unit, the first sound collection unit electronic equipment in, described method bagInclude:
When described first image acquisition units and described second image acquisition units work simultaneously, obtain respectivelyThe video information that described first image acquisition units and described second image acquisition units are gathered, obtains firstVideo information and the second video information, described first video information and described second video information use the first faceColor form, described first image acquisition units and described second image acquisition units to gather when working simultaneouslyObject different；
Described first video information is added to the appointment region of described second video information, obtains the 3rd videoInformation；
Described 3rd video information being carried out color format conversion, obtains the 4th video information, the described 4th regardsFrequently information uses the second color format；
Described 4th video information is converted to the 5th video information, and described 5th video information includes can beThe video framing that described display unit shows；
Sample according to the audio-frequency information that described first sound collection unit is gathered by default sample rate,Obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted to word；
Described word is added to the appointment region of described 5th video information, obtains adding the 5th of word and regardFrequently information；
The 5th video information adding word is carried out color format conversion, obtains the 6th video information, described6th video information uses the first color format；
Described 6th video information, described first audio-frequency information, stamp of the described very first time are encoded,To the multimedia messages that can play.
Wherein, described described 4th video information be converted to the 5th video information include:
The 5th video information is obtained by described 4th video information is plotted to graphic plotting instrument.
Wherein, described in the voice that will identify that be converted to word, including:
The voice that will identify that is converted to preset the word that languages are corresponding.
Wherein, described making very first time stamp includes:
Very first time stamp is obtained by recording current system time.
Wherein, described first color format includes that YUV color format, described second color format include RGBColor format.
Wherein, described electronic equipment also includes that the second sound collection unit, described method also include:
Sample according to the audio-frequency information that described second sound collection unit is gathered by default sample rate,Obtain the second audio-frequency information, and make the second timestamp, described first sound collection unit when sampling every timeObject to be gathered when simultaneously working with the second sound collection unit is different；
Accordingly, described 6th video information, described first audio-frequency information, stamp of the described very first time are carried outCoding, obtains the multimedia messages that can play, for:
To described 6th video information, described first audio-frequency information, stamp of the described very first time, described second soundFrequently information, described second timestamp encode, and obtain the multimedia messages that can play.
A kind of electronic equipment that the embodiment of the present invention provides, has the first image acquisition units, the second image is adoptedCollection unit, display unit and the first sound collection unit, described first image acquisition units and described second figureAs object to be gathered when collecting unit works is different simultaneously, described electronic equipment also includes:
Processing unit, for when described first image acquisition units and described second image acquisition units work simultaneouslyWhen making, obtain described first image acquisition units respectively and video that described second image acquisition units is gatheredInformation, obtains the first video information and the second video information, described first video information and described second videoInformation uses the first color format；
Described first video information is added to the appointment region of described second video information, obtains the 3rd videoInformation；
Described 3rd video information being carried out color format conversion, obtains the 4th video information, the described 4th regardsFrequently information uses the second color format；
Described 4th video information is converted to the 5th video information, and described 5th video information includes can beThe video framing that described display unit shows；
Sample according to the audio-frequency information that described first sound collection unit is gathered by default sample rate,Obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted to word；
Described word is added to the appointment region of described 5th video information, obtains adding the 5th of word and regardFrequently information；
The 5th video information adding word is carried out color format conversion, obtains the 6th video information, described6th video information uses the first color format；
Described 6th video information, described first audio-frequency information, stamp of the described very first time are encoded,To the multimedia messages that can play.
Wherein, described processing unit, specifically for by being plotted to graphic plotting by described 4th video informationInstrument obtains the 5th video information.
Wherein, described processing unit, the voice specifically for will identify that is converted to preset the literary composition that languages are correspondingWord.
Wherein, described processing unit, specifically for stabbing between first during by recording current system time and obtaining.
Wherein, described electronic equipment also includes the second sound collection unit, described first sound collection unit andThe object that second sound collection unit to be gathered when working simultaneously is different；
Described processing unit, is additionally operable to the sample rate according to presetting and is gathered described second sound collection unitAudio-frequency information sample, obtain the second audio-frequency information, and make the second timestamp when sampling every time；And for described 6th video information, described first audio-frequency information, stamp of the described very first time, described theTwo audio-frequency informations, described second timestamp encode, and obtain the multimedia messages that can play.
From the foregoing, it will be observed that the technical scheme of the embodiment of the present invention includes: be applied to have the first image acquisition units,Second image acquisition units, display unit, the first sound collection unit electronic equipment in, method includes:When described first image acquisition units and described second image acquisition units work simultaneously, obtain described respectivelyThe video information that first image acquisition units and described second image acquisition units are gathered, obtains the first videoInformation and the second video information, described first video information and described second video information use the first color latticeFormula, described first image acquisition units and described second image acquisition units to be gathered right when working simultaneouslyAs difference；Described first video information is added to the appointment region of described second video information, obtains the 3rdVideo information；Described 3rd video information is carried out color format conversion, obtains the 4th video information, described4th video information uses the second color format；Described 4th video information is converted to the 5th video information,Described 5th video information includes the video framing that can show at described display unit；According to default samplingThe audio-frequency information that described first sound collection unit is gathered by rate is sampled, and obtains the first audio-frequency information,And very first time stamp is made when sampling every time；Described first audio-frequency information is carried out speech recognition, and will knowThe voice not gone out is converted to word；Described word is added to the appointment region of described 5th video information,To the 5th video information adding word；The 5th video information adding word is carried out color format conversion,Obtaining the 6th video information, described 6th video information uses the first color format；To described 6th video letterBreath, described first audio-frequency information, stamp of the described very first time encode, and obtain the multimedia letter that can playBreath.The embodiment of the present invention is the most simple to operate, and disclosure satisfy that the video recording that user is shooting adds shadow in real timePicture, sound and the demand of captions.
Detailed description of the invention
For making the purpose of the application, technical scheme and advantage clearer, below in conjunction with the present inventionAccompanying drawing in embodiment, is clearly and completely described the technical scheme in the embodiment of the present invention, aobviousSo, described embodiment is only a part of embodiment of the present invention rather than whole embodiments.BaseEmbodiment in the present invention, those of ordinary skill in the art are institute under not making creative work premiseThe every other embodiment obtained, broadly falls into the scope of protection of the invention.In the case of not conflicting, thisEmbodiment in application and the feature in embodiment can mutual combination in any.Flow chart at accompanying drawing illustratesStep can perform in the computer system of such as one group of computer executable instructions.And, althoughShow logical order in flow charts, but in some cases, can hold with the order being different from hereinStep shown or described by row.
The first embodiment of a kind of information processing method that the present invention provides, is applied to have the first image acquisitionUnit, the second image acquisition units, display unit, the first sound collection unit electronic equipment in, as figureShown in 1, described method includes:
Step 101, when described first image acquisition units and described second image acquisition units work simultaneously,Obtain described first image acquisition units respectively and video information that described second image acquisition units is gathered,Obtain the first video information and the second video information；
Here, described first video information and described second video information use the first color format, and describedThe object that one image acquisition units to be gathered when working with described second image acquisition units simultaneously is different.
Described in the present embodiment, the first color format includes YUV color format.
Step 102 to, described first video information is added the appointment region of described second video information,To the 3rd video information.
Step 103, described 3rd video information is carried out color format conversion, obtain the 4th video information；
Here, described 4th video information uses the second color format.
Described in the present embodiment, the second color format includes RGB color format.
Step 104, described 4th video information is converted to the 5th video information；
Here, described 5th video information includes the video framing that can show at described display unit；
Concrete, described described 4th video information is converted to the 5th video information may include that
The 5th video information is obtained by described 4th video information is plotted to graphic plotting instrument.Described figureShape drawing tool can be Canvas.
Step 105, the audio-frequency information described first sound collection unit gathered according to the sample rate presetSample, obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Concrete, the audio pulse code modulation of monophonic or double track can be carried out with the sample rate of 8K(Pulse Code Modulation, PCM) coded sample.
In one embodiment, described making very first time stamp may include that
Very first time stamp is obtained by recording current system time.
Step 106, described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted toWord；
Concrete, speech recognition detection can be done, do the pattern match of optimal languages according to phonetic feature, andObtain corresponding semantic.
In one embodiment, described in the voice that will identify that be converted to word, may include that
The voice that will identify that is converted to preset the word that languages are corresponding.Such as, the voice identified is Chinese,Default languages are English, it is simply that the Chinese that will identify that is converted to English.Described default languages are that user selectsTarget translation languages.
Step 107 to, described word is added the appointment region of described 5th video information, obtain adding literary composition5th video information of word.
Step 108, by add word the 5th video information carry out color format conversion, obtain the 6th videoInformation, described 6th video information uses the first color format；
Step 109, described 6th video information, described first audio-frequency information, the described very first time are stabbed intoRow coding, obtains the multimedia messages that can play.
Here, described multimedia messages can be the format informations such as mp4,3gp.
Needing exist for explanation, the form of concrete RGB depends on the specification of target display devices, Ke YishiRGB888 or RGB565.
Yes being appreciated that, described first image acquisition units and described second image acquisition units can usePhotographic head；Described first sound collection unit can use mike.
In actual applications, here the sequencing of step 301 and step 305 is not limited.
Shown in Figure 2, the multimedia messages that the embodiment of the present invention obtains can show on the display unit.
From the foregoing, it will be observed that the embodiment of the present invention can by the first image acquisition units, the second image acquisition units,The information of the first sound collection unit collection carries out combined in real time, and adds captions in real time, not only operates letterSingle, and disclosure satisfy that the video recording that user is shooting adds the demand of image, sound and captions in real time.
Second embodiment of a kind of information processing method that the present invention provides, is applied to have the first image acquisitionUnit, the second image acquisition units, display unit, the first sound collection unit, the second sound collection unitElectronic equipment in, as it is shown on figure 3, described method includes:
Step 301, when described first image acquisition units and described second image acquisition units work simultaneously,Obtain described first image acquisition units respectively and video information that described second image acquisition units is gathered,Obtain the first video information and the second video information；
Here, described first video information and described second video information use the first color format, and describedThe object that one image acquisition units to be gathered when working with described second image acquisition units simultaneously is different.
Described in the present embodiment, the first color format includes YUV color format.
Step 302 to, described first video information is added the appointment region of described second video information,To the 3rd video information.
Step 303, described 3rd video information is carried out color format conversion, obtain the 4th video information；
Here, described 4th video information uses the second color format.
Described in the present embodiment, the second color format includes RGB color format.
Step 304, described 4th video information is converted to the 5th video information；
Here, described 5th video information includes the video framing that can show at described display unit；
Concrete, described described 4th video information is converted to the 5th video information may include that
The 5th video information is obtained by described 4th video information is plotted to graphic plotting instrument.Described figureShape drawing tool can be Canvas.
Step 305, the audio-frequency information described first sound collection unit gathered according to the sample rate presetSample, obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Concrete, the audio pulse code modulation of monophonic or double track can be carried out with the sample rate of 8K(Pulse Code Modulation, PCM) coded sample.
In one embodiment, described making very first time stamp may include that
Very first time stamp is obtained by recording current system time.
Step 306, the audio-frequency information described second sound collection unit gathered according to the sample rate presetSample, obtain the second audio-frequency information, and make the second timestamp when sampling every time；
In one embodiment, described making the second timestamp may include that
The second timestamp is obtained by recording current system time.
Here, it should be noted that described first sound collection unit and the second sound collection unit work simultaneouslyObject to be gathered when making is different.
Step 307, described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted toWord；
Concrete, speech recognition detection can be done, do the pattern match of optimal languages according to phonetic feature, andObtain corresponding semantic.
In one embodiment, described in the voice that will identify that be converted to word, may include that
The voice that will identify that is converted to preset the word that languages are corresponding.Such as, the voice identified is Chinese,Default languages are English, it is simply that the Chinese that will identify that is converted to English.Described default languages are that user selectsTarget translation languages.
Step 308 to, described word is added the appointment region of described 5th video information, obtain adding literary composition5th video information of word.
Step 309, by add word the 5th video information carry out color format conversion, obtain the 6th videoInformation, described 6th video information uses the first color format；
Step 310, to described 6th video information, described first audio-frequency information, the described very first time stamp,Described second audio-frequency information, described second timestamp encode, and obtain the multimedia messages that can play.
Here, described multimedia messages can be the format informations such as mp4,3gp.
Needing exist for explanation, the form of concrete RGB depends on the specification of target display devices, Ke YishiRGB888 or RGB565.
Yes being appreciated that, described first image acquisition units and described second image acquisition units can usePhotographic head；Described first sound collection unit can use mike.
In actual applications, here the sequencing of step 301 and step 305 is not limited, additionally,The sequencing of step 305 and step 306 is not limited.
From the foregoing, it will be observed that the embodiment of the present invention can add two-way audio information, so can ensure that the complete of informationWhole property.
The first embodiment of a kind of electronic equipment that the present invention provides, as shown in Figure 4, has the first image and adoptsCollection unit the 401, second image acquisition units 402, display unit 403 and the first sound collection unit 404,Described first image acquisition units 401 and described second image acquisition units 402 to gather when working simultaneouslyObject different, described electronic equipment also includes:
Processing unit 405, is used for when described first image acquisition units and described second image acquisition units are sameTime work time, obtain described first image acquisition units respectively and described second image acquisition units gatheredVideo information, obtains the first video information and the second video information, described first video information and described secondVideo information uses the first color format；
Described first video information is added to the appointment region of described second video information, obtains the 3rd videoInformation；
Described 3rd video information being carried out color format conversion, obtains the 4th video information, the described 4th regardsFrequently information uses the second color format；
Described 4th video information is converted to the 5th video information, and described 5th video information includes can beThe video framing that described display unit shows；
Sample according to the audio-frequency information that described first sound collection unit is gathered by default sample rate,Obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted to word；
Described word is added to the appointment region of described 5th video information, obtains adding the 5th of word and regardFrequently information；
The 5th video information adding word is carried out color format conversion, obtains the 6th video information, described6th video information uses the first color format；
Described 6th video information, described first audio-frequency information, stamp of the described very first time are encoded,To the multimedia messages that can play.
In one embodiment, described processing unit 405, specifically for by painting described 4th video informationSystem obtains the 5th video information to graphic plotting instrument.
In one embodiment, described processing unit 405, the voice specifically for will identify that is converted to presetThe word that languages are corresponding.
In one embodiment, described processing unit 405, specifically for obtaining by recording current system timeThen stab between first.
Needing exist for explanation, described in the present embodiment, the first color format includes YUV color format,Described second color format includes RGB color format.
Yes being appreciated that, described first image acquisition units and described second image acquisition units can usePhotographic head；Described first sound collection unit can use mike.
From the foregoing, it will be observed that the embodiment of the present invention can by the first image acquisition units, the second image acquisition units,The information of the first sound collection unit collection carries out combined in real time, and adds captions in real time, not only operates letterSingle, and disclosure satisfy that the video recording that user is shooting adds the demand of image, sound and captions in real time.
Second embodiment of a kind of electronic equipment that the present invention provides, adopts as it is shown in figure 5, have the first imageCollection unit the 401, second image acquisition units 402, display unit the 403, first sound collection unit 404 andSecond sound collection unit 406, described first image acquisition units 401 and described second image acquisition units402 objects to be gathered when simultaneously working are different, described first sound collection unit 404 and the second soundThe object that collecting unit 406 to be gathered when working simultaneously is different；
Described electronic equipment also includes:
Processing unit 405, is used for when described first image acquisition units and described second image acquisition units are sameTime work time, obtain described first image acquisition units respectively and described second image acquisition units gatheredVideo information, obtains the first video information and the second video information, described first video information and described secondVideo information uses the first color format；
Described first video information is added to the appointment region of described second video information, obtains the 3rd videoInformation；
Described 3rd video information being carried out color format conversion, obtains the 4th video information, the described 4th regardsFrequently information uses the second color format；
Described 4th video information is converted to the 5th video information, and described 5th video information includes can beThe video framing that described display unit shows；
Sample according to the audio-frequency information that described first sound collection unit is gathered by default sample rate,Obtain the first audio-frequency information, and make very first time stamp when sampling every time；
Sample according to the audio-frequency information that described second sound collection unit is gathered by default sample rate,Obtain the second audio-frequency information, and make the second timestamp when sampling every time；
Described first audio-frequency information is carried out speech recognition, and the voice that will identify that is converted to word；
Described word is added to the appointment region of described 5th video information, obtains adding the 5th of word and regardFrequently information；
The 5th video information adding word is carried out color format conversion, obtains the 6th video information, described6th video information uses the first color format；
To described 6th video information, described first audio-frequency information, stamp of the described very first time, described second soundFrequently information, described second timestamp encode, and obtain the multimedia messages that can play.
In one embodiment, described processing unit 405, specifically for by painting described 4th video informationSystem obtains the 5th video information to graphic plotting instrument.
In one embodiment, described processing unit 405, the voice specifically for will identify that is converted to presetThe word that languages are corresponding.
In one embodiment, described processing unit 405, specifically for obtaining by recording current system timeThen stab between first.
Needing exist for explanation, described in the present embodiment, the first color format includes YUV color format,Described second color format includes RGB color format.
Yes being appreciated that, described first image acquisition units and described second image acquisition units can usePhotographic head；Described first sound collection unit can use mike.
From the foregoing, it will be observed that the embodiment of the present invention can add two-way audio information, so can ensure that the complete of informationWhole property.
In sum, the technical scheme of the embodiment of the present invention includes: be applied to have the first image acquisition units,Second image acquisition units, display unit, the first sound collection unit electronic equipment in, method includes:When described first image acquisition units and described second image acquisition units work simultaneously, obtain described respectivelyThe video information that first image acquisition units and described second image acquisition units are gathered, obtains the first videoInformation and the second video information, described first video information and described second video information use the first color latticeFormula, described first image acquisition units and described second image acquisition units to be gathered right when working simultaneouslyAs difference；Described first video information is added to the appointment region of described second video information, obtains the 3rdVideo information；Described 3rd video information is carried out color format conversion, obtains the 4th video information, described4th video information uses the second color format；Described 4th video information is converted to the 5th video information,Described 5th video information includes the video framing that can show at described display unit；According to default samplingThe audio-frequency information that described first sound collection unit is gathered by rate is sampled, and obtains the first audio-frequency information,And very first time stamp is made when sampling every time；Described first audio-frequency information is carried out speech recognition, and will knowThe voice not gone out is converted to word；Described word is added to the appointment region of described 5th video information,To the 5th video information adding word；The 5th video information adding word is carried out color format conversion,Obtaining the 6th video information, described 6th video information uses the first color format；To described 6th video letterBreath, described first audio-frequency information, stamp of the described very first time encode, and obtain the multimedia letter that can playBreath.The embodiment of the present invention is the most simple to operate, and disclosure satisfy that the video recording that user is shooting adds shadow in real timePicture, sound and the demand of captions.
In several embodiments provided herein, it should be understood that disclosed equipment and method, canTo realize by another way.Apparatus embodiments described above is only schematically, such as, and instituteStating the division of unit, be only a kind of logic function and divide, actual can have other dividing mode when realizing,As: multiple unit or assembly can be in conjunction with, or it is desirably integrated into another system, or some features can be neglectedSlightly, or do not perform.It addition, the coupling each other of shown or discussed each ingredient or directly couplingClose or communication connection can be the INDIRECT COUPLING by some interfaces, equipment or unit or communication connection, canBe electrical, machinery or other form.
The above-mentioned unit illustrated as separating component can be or may not be physically separate, asThe parts that unit shows can be or may not be physical location；Both may be located at a place, it is possible toTo be distributed on multiple NE；Part or all of unit therein can be selected according to the actual needsRealize the purpose of the present embodiment scheme.
It addition, each functional unit in various embodiments of the present invention can be fully integrated in a processing unit,Can also be that each unit is individually as a unit, it is also possible to two or more unit are integrated in oneIn individual unit；Above-mentioned integrated unit both can realize to use the form of hardware, it would however also be possible to employ hardware adds softThe form of part functional unit realizes.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment canCompleting with the hardware relevant by programmed instruction, aforesaid program can be stored in embodied on computer readable storageIn medium, this program upon execution, performs to include the step of said method embodiment；And aforesaid storage is situated betweenMatter includes: movable storage device, read only memory (Read-Only Memory, ROM), random access memoryMemorizer (Random Access Memory, RAM), magnetic disc or CD etc. are various can store programThe medium of code.
Or, if the above-mentioned integrated unit of the present invention is using the form realization of software function module and as independentProduction marketing or use time, it is also possible to be stored in a computer read/write memory medium.Based on soUnderstanding, the part that prior art is contributed by the technical scheme of the embodiment of the present invention the most in other words canEmbodying with the form with software product, this computer software product is stored in a storage medium, bagInclude some instructions with so that a computer equipment (can be personal computer, server or networkEquipment etc.) perform all or part of of method described in each embodiment of the present invention.And aforesaid storage medium bagInclude: movable storage device, read only memory (Read-Only Memory, ROM), random access memoryDevice (Random Access Memory, RAM), magnetic disc or CD etc. are various can store program codeMedium.
The above, the only detailed description of the invention of the present invention, but protection scope of the present invention is not limited toThis, any those familiar with the art, in the technical scope that the invention discloses, can readily occur inChange or replacement, all should contain within protection scope of the present invention.Therefore, protection scope of the present invention shouldIt is as the criterion with described scope of the claims.