The application date of the invention is as follows: 2016, 9, 7.D., having the patent application number of 201610807780.X, entitled "earphone device with local call condition confirmation mode", filed by divisional application of the Chinese patent application.
[ detailed description ] embodiments
The following detailed description of the invention refers to the accompanying drawings.
In the present invention, the terms "in one embodiment" and "in an embodiment" do not specifically mean that they are in the same embodiment, and may be in different embodiments.
The invention provides a multifunctional earphone device which can provide multiple auxiliary functions for a user and improve the use experience of the user. The headset device may be a known or future-capable wireless headset such as a bluetooth headset.
Fig. 1 is a block diagram of an embodiment of anearphone device 100 according to the present invention. As shown in fig. 1, theearphone device 100 includes afirst microphone 110, asecond microphone 120, amicro processing unit 130, aspeaker 150, acommand interface 160, awireless communication module 170, and astorage unit 180.
Thefirst microphone 110 is disposed at a position close to the user's lips, and as a specific embodiment, when theearphone device 100 is a headphone or an in-ear earphone, thefirst microphone 110 is disposed on a structure body of the earphone body extending to the user's lips; or as another specific embodiment, thefirst microphone 110 may be worn near the user's lips for a separate device. Thefirst microphone 110 is used for collecting a first sound signal, which mainly includes user voice, but also includes ambient sound. Thefirst microphone 110 may be a microphone or a microphone array;
in contrast to thefirst microphone 110, thesecond microphone 120 is disposed away from the lips of the user; in one embodiment, when theearphone device 100 is a headphone or an in-ear earphone, thesecond microphone 120 is disposed on the earphone body at a position farthest from the lips of the user and opposite to the lips of the user. Or as another specific embodiment, thesecond microphone 120 may be a separate device that is worn on the user away from his lips. Thesecond microphone 120 is used for collecting a second sound signal, which mainly includes the ambient sound, but also includes the user voice. Thesecond microphone 120 may be a microphone or a microphone array;
thewireless communication module 170 is used to establish a wireless communication connection with an external electronic device (e.g., a smart phone, a tablet computer, a notebook computer, a desktop computer, a vehicle-mounted communication system, etc.), transmit an audio signal from themicroprocessor unit 130 to themicroprocessor unit 130, and receive an audio signal from the external electronic device. Thewireless communication module 170 may be a bluetooth communication module.
Thespeaker 150 is used to play audio signals.
Themicro processing unit 130 is used to control the respective modules, and may have a variety of functional modes.
Thecommand interface 160 can receive external control commands, which are commands for informing the micro-processing unit to enter the corresponding functional mode, and after receiving these commands, thecommand interface 160 transmits the commands to themicro-processing unit 130, so that themicro-processing unit 130 enters the corresponding functional mode.
Thecommand interface 160 may be a plurality of buttons, or one button, which is triggered to issue an instruction to enter a corresponding mode to themicro processing unit 130. Thecommand interface 160 may also be a voice recognition interface, and a user speaks a preset voice control command, and the voice recognition interface recognizes the voice control command and sends an instruction to enter a corresponding mode to the micro processing unit.
One of the features and advantages of theearphone device 100 of the present invention is: themicro-processing unit 130 has one or more functional modes, each having its own corresponding control instructions. The added functional modes of theearphone device 100 will be described below one by one.
Ambient sound alert mode
In one embodiment, the MPU 130 has an ambient sound alert mode, and at this time, the control command includes an enter ambient sound alert mode command and an exit ambient sound alert command.
Fig. 2 is a functional flow chart of the ambient sound alert mode of the earphone device according to the present invention. As shown in fig. 2, it is determined whether an ambient sound alert mode command is received atstep 210, and after receiving the ambient sound alert mode entering command, the mcu enters an ambient sound alert mode atstep 220.
In the ambient sound alert mode,step 230 is entered to collect ambient sound by using thefirst microphone 110, andstep 240 is entered to play the collected ambient sound through thespeaker 150 in real time to alert the user of the current real-time ambient sound. Of course, in alternative embodiments, thesecond microphone 120 may also be selected to capture ambient sound. It should be noted that the environmental sounds collected by thefirst microphone 110 or thesecond microphone 120 are played through thespeaker 150 in real time and in time, rather than recording the environmental sounds for a period of time and then playing the recorded environmental sounds, so that the user can hear the real-time environmental sounds as much as possible without significant delay. The delay time from when the ambient sound is collected to when the ambient sound is played by the speaker is very short, for example, the delay time may be less than 1 second. In one example, the captured ambient sound may be buffered using a buffer and then played back through a speaker in real-time.
Then, step 250 is entered to determine whether an instruction to exit the ambient sound alert mode is received, and after receiving the instruction to exit the ambient sound alert mode, the micro-processing unit exits the ambient sound alert mode instep 260. In another alternative embodiment, the ambient sound alert mode may be automatically exited after the ambient sound alert mode has been in the predetermined duration, and the ambient sound alert mode may not be exited. Of course, other ways of exiting the ambient sound alert mode may also be used.
Therefore, when a user wears the earphone device to listen to music or make a call, if the user needs to call or speak with other people, the user only needs to send an environmental sound reminding mode instruction through thecommand interface 160, so that the earphone device can enter an environmental sound reminding mode, the user can also listen to external environmental sound without taking off the earphone, for example, the sound of other people, the user can also communicate with other people by using normal volume, and the earphone device is greatly convenient for people to use. In real life, it can be seen that a user wearing the earphone to listen to music can listen to the sound of other people only by picking off the earphone when communicating with other people, and can communicate with other people with normal volume, but the earphone device is not picked off in the invention.
When thecommand interface 160 is a key, the key may be triggered to issue an instruction to enter the ambient sound alert mode and/or an instruction to exit the ambient sound alert mode, where the key may be a specific key newly added to the earphone, for example, pressing a specific key indicates entering the ambient sound alert mode, and then pressing the specific key indicates exiting the ambient sound alert mode; or a 'specific key' formed after a specific operation mode is set for a conventional key on the earphone, for example, continuously pressing the volume + key on the earphone for 3 times enters an ambient sound reminding mode. That is, if the user in the call is worried that the speaking voice is too loud, the user can listen to the environmental voice of the user by pressing the specific key, and the volume of the user can be adjusted according to the environmental voice. This application is also practical for users who sing with headphones. It is known that when people who have a fever with earphones sing with the music, people often feel booming and suspicion of people around because the people cannot hear or cannot hear the sound produced by the people, and the people always get out of tune when the people actually sing. The environment sound reminding mode provided by the earphone device can enable the following player to hear the music sound and the following sound after wearing the earphone, so that the following player can correct the singing sound of the following player in time. Therefore, the invention can record and listen to the surrounding environmental sound and the sound emitted by the user in real time through the earphone device while using the earphone to communicate or listen to the voice content such as music and the like, thereby creating a voice environment as if the user does not wear the earphone, and the invention has simple operation and convenient use and can avoid some unnecessary embarrassment.
When the command interface is a voice recognition interface, a plurality of voice control instruction templates may be trained for each voice control instruction in the voice recognition interface in advance, and then a user speaks a preset voice control instruction, so that the voice recognition interface can recognize the voice control instruction. Specifically, a user trains a voice control instruction template in advance for an instruction of entering the ambient sound reminding mode, the user speaks a section of 'entering the ambient sound reminding mode' for multiple times, and then when the user speaks 'entering the ambient sound reminding mode' during formal use, the voice recognition interface can recognize that the instruction is 'entering the ambient sound reminding mode'. Based on the same mode, the user can also train a voice control instruction template in advance for the instruction of exiting the environmental sound reminding mode, and then can send the instruction of exiting the environmental sound reminding mode through voice. When the method is applied, when a user wants to communicate with other people, the user only needs to say that the user enters the environment sound reminding mode, can hear external environment sound, can normally communicate with other people, and can exit the environment sound reminding mode only by saying that the user exits the environment sound reminding mode after the communication is finished.
In one embodiment, in the ambient sound alert mode, the playing of the audio signal currently desired to be played in the speaker may be paused. For example, when the user is listening to music, after entering the ambient sound alert mode, the user may pause the currently playing music and start playing the recorded ambient sound. And after the environment sound reminding mode is exited, resuming the playing of the audio signal which needs to be played in the loudspeaker at present.
In a preferred embodiment, the earphone device is a stereo earphone device, and thespeakers 150 include a left channel speaker and a right channel speaker. Under the ambient sound reminding mode, the audio signal which needs to be played currently can be played through one of the left channel loudspeaker and the right channel loudspeaker, and meanwhile, the collected ambient sound can be played in real time through the other one of the left channel loudspeaker and the right channel loudspeaker. Therefore, the music played at present can be heard, and the external environment sound can be heard, so that better experience is provided for users.
In a preferred embodiment, themicro-processing unit 130 performs Voice Detection (Voice Activity Detection) on the first sound signal collected by thefirst microphone 110, and when a Voice is detected, an instruction to enter the ambient sound alert mode is issued, so that themicro-processing unit 130 enters the ambient sound alert mode. In this way, theMPU 130 can enter the ambient sound alert mode without entering control commands through thecommand interface 160.
In one embodiment, each time the ambient sound alert mode is maintained for a predetermined period of time, the ambient sound alert mode can be automatically exited after the ambient sound alert mode is maintained for the predetermined period of time.
Decibel reminding mode
In one embodiment, themicro-processing unit 130 has a decibel alert mode, and the control instruction may include an instruction to enter the decibel alert mode, and after receiving the instruction to enter the decibel alert mode, the micro-processing unit enters the decibel alert mode. In the decibel alert mode, themicroprocessor unit 130 detects and obtains the decibel value of the sound heard by the user, and broadcasts the decibel value through the speaker. In another embodiment, themcu 130 can be in the db alert mode at all times without a corresponding instruction.
In one embodiment, the control instruction may further include an exit decibel alert mode instruction, and the microprocessor unit exits the decibel alert mode after receiving the exit decibel alert mode instruction. In another alternative embodiment, the ambient sound alert mode may be automatically exited after the decibel alert mode command has been issued for a predetermined length of time or alternatively, after the decibel value has been broadcast. Of course, other modes can be adopted to exit the decibel reminding mode.
The decibel reminding mode can be started simultaneously when the micro-processing unit is in other functional modes, so that the decibel value of sound transmitted into the ears of the user can be monitored at any time, and the hearing of the user is protected.
FIG. 3 is a block diagram of themicroprocessor unit 130 in one embodiment. As shown in fig. 3, themicro-processing unit 130 includes a decibelvalue forming unit 131 and a decibelvoice forming unit 132. The decibelvalue forming unit 131 is configured to obtain a decibel value thereof according to sound heard by a user in a decibel alert mode, and the decibelvoice forming unit 132 is configured to perform voice synthesis on the decibel value formed by the decibelvalue forming unit 131 in the decibel alert mode to obtain a decibel voice signal, and send the decibel voice signal to the speaker for playing.
In one embodiment, as shown in fig. 1, theearphone device 100 further includes a third microphone (not shown) near the ear hole of the user when the earphone device is worn on the head of the user. Fig. 4 is a functional flowchart of the decibel alert mode of the earphone device according to an embodiment of the present invention. As shown in fig. 4, in the decibel alert mode, sounds near the ear hole of the user are collected by thethird microphone 180 atstep 410, and then decibel values of the sounds collected by the third microphone are calculated atstep 420. The sound collected by thethird microphone 180 may include sound played by thespeaker 150, and may also include sound transmitted from the external environment to the vicinity of the ear hole of the user. Then, instep 430, the decibel value obtained by calculation is speech-synthesized to obtain a decibel speech signal. Finally, instep 440, the decibel voice signal is broadcast by a speaker. In this way, the user can hear the decibel value alert, thereby protecting the user's ear, and if the sound exceeds 80 decibels, the user may decrease the volume or make less stays in the area. In this embodiment, the earphone device is preferably a headphone device, not an in-ear earphone device, so that there is enough space to place thethird microphone 180.
In another alternative embodiment, thestorage unit 180 stores a corresponding relationship between output power consumption of the earphone device and a decibel value of a sound heard by a user, and the larger the output power consumption is, the larger the corresponding decibel value is. The corresponding relationship can be obtained by testing in advance, specifically, the output power consumption of the earphone device is at different values, when the output power consumption is at one value, a professional decibel value measuring device is used for measuring the decibel value at theloudspeaker 150, and the corresponding relationship between the output power consumption value and the decibel value is recorded. In the decibel alert mode, the decibelvalue forming unit 131 detects the output power consumption of the earphone device, and finds out the decibel value of the sound heard by the user through the corresponding relationship between the output power consumption of the earphone device and the decibel value of the sound heard by the user, at this time, the influence of the audio signal that thespeaker 150 needs to play is mainly considered, and the audio signal played by thespeaker 150 may be an audio signal from an external electronic device, or an audio signal from thefirst microphone 110, or an audio signal from thesecond microphone 120; themicro-processing unit 130 may also perform noise reduction processing on the first sound signal based on the second sound signal to eliminate the ambient noise in the first sound signal, and output the sound signal after the noise reduction processing to thespeaker 150 as the audio signal required to be played by thespeaker 150, or output the sound signal after the noise reduction processing to thespeaker 150 after mixing with the audio signal from the external electronic device as the audio signal required to be played by thespeaker 150.
In a more preferred embodiment, thestorage unit 180 further stores a predetermined decibel threshold and a duration threshold corresponding to the predetermined decibel threshold, and when the decibel value detected by themicroprocessor 130 exceeds the predetermined decibel threshold and continues to exceed the duration threshold corresponding to the predetermined decibel threshold, the detected decibel value may be broadcasted, the volume of thespeaker 150 may also be automatically reduced, and the playing of the current audio signal may also be automatically stopped. This may provide better protection to the user's hearing.
In one embodiment, in the decibel alert mode, the decibel value is broadcast once every predetermined time. For example, decibel values are broadcast every 20 seconds. In another embodiment, in the decibel alert mode, when the decibel value obtained by themicro processing unit 130 based on the sound collected by the third microphone exceeds a predetermined decibel threshold (e.g., 80 decibels, 90 decibels, etc.), the decibel value is broadcast through thespeaker 150.
When thecommand interface 160 is a button, the button may be triggered to issue an instruction to enter the decibel alert mode or exit the decibel alert mode, and the button may be a specific button newly added to the headset or a "specific button" formed after setting a specific operation mode for a conventional button on the headset. For example, triggering a specific key indicates entering the decibel alert mode instruction, and triggering the specific key again indicates exiting the decibel alert mode instruction. That is, if the user wants to know the level of the currently heard sound, the user only needs to trigger the specific key, thespeaker 150 broadcasts the decibel value at this time, and the user can exit the decibel alert mode instruction by triggering the specific key again. Of course, the decibel reminding mode can also be automatically exited after the decibel value is broadcasted.
When the command interface is a voice recognition interface, a plurality of voice control instruction templates can be trained for each voice control instruction in the voice recognition interface in advance, and then a user speaks a preset voice control instruction, so that the voice control instruction can be recognized by the voice recognition interface. Specifically, a voice control instruction template is trained in advance for an instruction of entering a decibel reminding mode by a user, the user speaks a section of entering the decibel reminding mode for multiple times, and then the voice recognition interface can recognize that the speech recognition interface enters the decibel reminding mode when the user speaks entering the decibel reminding mode during formal use. Based on the same mode, a voice control instruction template can be trained in advance for the instruction of exiting the decibel reminding mode by the user.
Local call condition confirmation mode
In one embodiment, theearphone device 100 of the present invention may have a dual-microphone noise reduction function, that is, thefirst microphone 110 collects a first sound signal, thesecond microphone 120 collects a second sound signal, and themicro processing unit 130 performs noise reduction processing on the first sound signal based on the second sound signal to eliminate ambient noise in the first sound signal, so that the first sound signal can be transmitted to a far-end opposite party more clearly, thereby improving the quality of voice call.
Theearphone device 100 of the present invention may further have an active noise reduction function, that is, thesecond microphone 120 collects a second sound signal, themicroprocessor unit 130 generates an inverse noise waveform based on the second sound signal, and plays the inverse noise waveform through the speaker, so as to achieve the purpose of canceling the ambient noise. Theearphone device 100 greatly eliminates the influence of the environmental noise on the earphone user by combining the active noise elimination and the passive noise reduction design, and can obtain a clearer listening effect.
However, the conventional dual-microphone noise reduction function has an unstable noise reduction effect due to various reasons such as a noise reduction algorithm and noise specificity under different environments. The active noise reduction function enables the earphone user to be unable to clearly hear the sound emitted by the user. In some specific applications, the headset user does not want the other party to hear the ambient sound he is in, such as when receiving a call in a conference, does not want the other party to hear any conference content, and in this case, the headset user may have to leave the conference site because he cannot confirm whether the dual-microphone noise reduction function of the headset is actually useful or needs to ensure that the other party only hears what he is willing to hear. In other specific applications, the user of the earphone also needs to listen to the sound generated by the user in time to control the volume, correct the pronunciation, etc.
The local call condition confirmation mode of the invention can help the user to master the sound sent by the user and the content heard by the opposite side in time.
In one embodiment, themicro processing unit 130 has a local call condition confirmation mode, in which case the control command includes a command to enter the local call condition confirmation mode, and after receiving the command to enter the local call condition confirmation mode, the micro processing unit enters the local call condition confirmation mode.
Fig. 5 is a functional flowchart of a local call situation confirmation mode of the ear speaker device in the present invention in one embodiment. In the local call situation confirmation mode, in one embodiment, atstep 510, the first voice signal subjected to the two-microphone noise reduction processing may be recorded, and then, atstep 520, the recorded first voice signal subjected to the two-microphone noise reduction processing may be played through thespeaker 150; thus, the local call condition confirmation mode of the invention enables the earphone user to hear the sound made by the user and to know the voice effect heard by the other party. In one embodiment, the recorded sound signal after the noise reduction processing is recorded for a predetermined time period, and then the recorded sound signal after the noise reduction processing is played through the loudspeaker for the predetermined time period.
In one embodiment, when the first sound signal subjected to the noise reduction processing by the two microphones is played, the playing of the audio signal currently required to be played in the speakers may be paused, and the audio signal currently required to be played in the speakers may be music data or a sound source at a far end.
In another preferred embodiment, thespeakers 150 include a left channel speaker and a right channel speaker, and in the local call condition confirmation mode, the audio signal currently to be played may be played through one of the left channel speaker and the right channel speaker, and the recorded first sound signal subjected to the two-microphone noise reduction processing may be played through the other one of the left channel speaker and the right channel speaker. Therefore, under the local call condition confirmation mode, the voice effect listened by the opposite party can be known, the playing of the current audio signal (such as a far-end sound source) needing to be played can be not hindered, and the user experience is improved.
After playing, the local call condition confirmation mode can be automatically exited. Of course, in other embodiments, the local call situation confirmation mode may be exited in other manners, such as exiting the local call situation confirmation mode by exiting the local call situation confirmation mode instruction.
When thecommand interface 160 is a key, the instruction to enter the local call condition confirmation mode may be issued by activating the key, for example, pressing a specific key indicates an instruction to enter the local call condition confirmation mode.
When thecommand interface 160 is a voice recognition interface, the user speaks a preset voice control command, and the voice recognition interface recognizes the voice control command and issues a command to enter a local call condition confirmation mode.
Selection of local call environment mode
In one embodiment, themcu 130 has a plurality of local call environment modes, and the control command includes a command to enter each local call environment mode, and after receiving the command to enter the corresponding local call environment mode, the mcu enters the corresponding local call environment mode. In a local communication environment mode, a first microphone collects a first sound signal, a second microphone collects a second sound signal, and a micro-processing unit selectively performs noise reduction processing on the first sound signal based on the second sound signal, so as to retain a predetermined type of environment noise (or called environment sound) corresponding to the local communication environment mode and eliminate the rest types of environment noise.
In application, the plurality of local call environment modes may include an office call environment mode, a highway call environment mode, a home call environment mode, and the like, and which local call environment mode to enter may be selected. When entering a local call environment mode, such as a home call environment mode, the ambient noise associated with the home environment in the first sound signal is allowed to remain, while ambient noise not associated with the home environment, which may include a child's voice, a doorbell, etc., is removed.
Similarly, when entering the office call environment mode, the first sound signal is allowed to have the environmental noise associated with the office environment preserved, while the environmental noise not associated with the office environment is removed, which may include a landline ring tone or the like.
In one embodiment, the microprocessor unit identifies a predetermined type of ambient sound corresponding to the local communication environment mode from the second sound signal, removes the identified predetermined type of ambient sound corresponding to the local communication environment mode from the first sound signal, and performs noise reduction processing on the first sound signal by using the remaining sound signal.
In one embodiment, themicro processing unit 130 separates the user voice and the ambient noise based on the second sound signal and the first sound signal, and adjusts a mixing ratio of the user voice and the ambient sound according to a user selection.
When thecommand interface 160 is a key, the key may be activated to issue an instruction to enter each local call environment mode, for example, pressing a specific key indicates an instruction to enter a local call environment mode. When thecommand interface 160 is a voice recognition interface, the user speaks a preset voice control command, and the voice recognition interface recognizes the voice control command and issues a command to enter each local call environment mode.
The foregoing description has disclosed fully preferred embodiments of the present invention. It should be noted that those skilled in the art can make modifications to the embodiments of the present invention without departing from the scope of the appended claims. Accordingly, the scope of the appended claims is not to be limited to the specific embodiments described above.