技术领域technical field
本发明属于音效调节技术领域,尤其涉及一种自适应调节音效的方法及系统。The invention belongs to the technical field of sound effect adjustment, and in particular relates to a method and system for adaptively adjusting sound effect.
背景技术Background technique
随着生活水平的提高,耳机、音响等音频类消费电子产品越来越受到市场和用户的欢迎。与此同时,用户也要求这些音频类消费电子产品的功能越来越完善和强大。其中,一个典型的功能需求便是,用户希望这类产品的音质能够更好地适应和还原真实世界的声音。为了适应市场的这一需求,目前的音频类消费电子产品大多具有音效调节、音效均衡以及音效设置的功能。一般来说,通常的设计方案通过以下方式进行音效相关的操作:在耳机上提供硬开关或按键,用户通过操作打开或关闭某种音效功能;或者,通过各种有线或无线连接方式,使用电脑端或移动端的软件进行耳机音效设置的相关工作。With the improvement of living standards, audio consumer electronic products such as earphones and stereos are more and more popular in the market and users. At the same time, users also demand that the functions of these audio consumer electronic products become more and more perfect and powerful. Among them, a typical functional requirement is that users hope that the sound quality of such products can better adapt to and restore real-world sounds. In order to meet this demand of the market, most of the current audio consumer electronic products have the functions of sound effect adjustment, sound effect equalization and sound effect setting. Generally speaking, the usual design schemes perform sound-related operations in the following ways: provide hard switches or buttons on the earphones, and users can turn on or off certain sound effects through operations; or, through various wired or wireless connections, use the computer The software on the terminal or mobile terminal can perform the work related to the sound effect setting of the earphone.
上述方式都需要用户手动进行相关操作。首先,用户的反应需要时间,存在用户进行设置时该设置已经不适用于当前的输入音频;其次,一般人的耳朵受到年龄等因素的影响,对输入音频的辨别能力有所不足;最后,一般用户不是专业的声学技术人员,他们对于输入音频所适用的音效设置并不专业,有可能导致设置后的音效不适用于当前输入音频,使用户的使用体验受到影响。All of the above methods require the user to manually perform related operations. First of all, it takes time for the user to respond, and the setting is no longer suitable for the current input audio when the user makes the settings; second, the ears of ordinary people are affected by factors such as age, and the ability to distinguish the input audio is insufficient; finally, the average user Not professional acoustic technicians, they are not professional in the sound effect settings applicable to the input audio, which may cause the set sound effect to be unsuitable for the current input audio, which will affect the user experience.
发明内容Contents of the invention
本发明实施例的目的在于提供一种自适应调节音效的方法及系统,旨在解决现有技术中音效的设置均需要用户手动进行相关操作的问题。The purpose of the embodiments of the present invention is to provide a method and system for adaptively adjusting sound effects, aiming at solving the problem in the prior art that the setting of sound effects requires manual operations by the user.
本发明实施例是这样实现的,一种自适应调节音效的方法,包括:The embodiment of the present invention is achieved in this way, a method for adaptively adjusting sound effects, comprising:
根据用户终端正在执行的音频应用判断输入音频的来源;Determine the source of the input audio according to the audio application being executed by the user terminal;
根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式;matching a corresponding sound effect mode from a preset correspondence table between sound effect modes and audio sources according to the source of the input audio;
利用匹配出的音效模式播放所述输入音频。The input audio is played using the matched sound effect mode.
在本发明实施例所述的自适应调节音效的方法中,所述根据用户终端正在执行的音频应用判断输入音频的来源具体包括:In the method for adaptively adjusting sound effects according to the embodiment of the present invention, the determining the source of the input audio according to the audio application being executed by the user terminal specifically includes:
接收用户终端根据自身正在执行的音频应用发送的音频来源标识码;Receiving the audio source identification code sent by the user terminal according to the audio application being executed by itself;
根据所述音频来源标识码识别出所述输入音频的来源。The source of the input audio is identified according to the audio source identification code.
在本发明实施例所述的自适应调节音效的方法中,所述音效模式包括电影模式、语音模式、游戏模式以及音乐模式,所述利用匹配出的音效模式播放所述输入音频具体包括:In the method for adaptively adjusting the sound effect described in the embodiment of the present invention, the sound effect mode includes movie mode, voice mode, game mode and music mode, and playing the input audio by using the matched sound effect mode specifically includes:
若匹配出的音效模式为电影模式,则采用SRS音效播放所述输入音频;If the matched sound effect mode is a movie mode, then use SRS sound effect to play the input audio;
若匹配出的音效模式为语音模式,则对所述输入音频进行主动降噪,并将所述输入音频中对应的中频语音信号的增益提高;If the matched sound effect mode is a voice mode, active noise reduction is performed on the input audio, and the gain of the corresponding intermediate frequency voice signal in the input audio is increased;
若匹配出的音效模式为游戏模式,则采用SRS音效播放所述输入音频,并对所述输入音频进行声源定位;If the matched sound effect mode is a game mode, then adopt SRS sound effect to play the input audio, and perform sound source localization to the input audio;
若匹配出的音效模式为音乐模式,则自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式。If the matched sound effect mode is a music mode, automatically judge the music category of the input audio, and automatically adjust the gain mode of the equalizer according to the music category.
在本发明实施例所述的自适应调节音效的方法中,所述自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益设置具体包括:In the method for adaptively adjusting sound effects according to the embodiment of the present invention, the automatically determining the music category of the input audio, and automatically adjusting the gain setting of the equalizer according to the music category specifically includes:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,提取出所述音频信号的音频特征向量,并根据所述音频特征向量和预先通过SVM训练器进行训练得到的分类模型识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio feature vector of the audio signal is extracted, and according to the audio The feature vector and the classification model obtained by training the SVM trainer in advance identify the music category of the buffered input audio;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
在本发明实施例所述的自适应调节音效的方法中,所述自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式具体包括:In the method for adaptively adjusting the sound effect described in the embodiment of the present invention, the automatically determining the music category of the input audio, and automatically adjusting the gain mode of the equalizer according to the music category specifically includes:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述输入音频前段时间内的音频信号作为分析对象,对所述音频信号进行傅里叶变换,将所述音频信号从时域信号转换为频域分量,然后取各频域分量的傅里叶变换系数作为每一频点的能量大小,根据每一频点的能量大小识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically cached, and the audio signal in the previous period of the input audio is prefetched as an analysis object, and the audio signal is Fourier transformed, and the audio signal is converted from The time domain signal is converted into a frequency domain component, and then the Fourier transform coefficients of each frequency domain component are taken as the energy size of each frequency point, and the music category of the buffered input audio is identified according to the energy size of each frequency point;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
本发明实施例的另一目的在于,提供一种自适应调节音效的系统,包括:Another object of the embodiments of the present invention is to provide a system for adaptively adjusting sound effects, including:
音频来源识别模块,用于根据用户终端正在执行的音频应用判断输入音频的来源;The audio source identification module is used to determine the source of the input audio according to the audio application being executed by the user terminal;
音效模式设置模块,用于根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式;A sound effect mode setting module, configured to match a corresponding sound effect mode from a preset correspondence table between sound effect modes and audio sources according to the source of the input audio;
音频播放模块,用于利用匹配出的音效模式播放所述输入音频。The audio playing module is used to play the input audio by using the matched sound effect mode.
在本发明实施例所述的自适应调节音效的系统中,所述音频来源识别模块包括:In the system for adaptively adjusting sound effects according to the embodiment of the present invention, the audio source identification module includes:
接收单元,用于接收用户终端根据自身正在执行的音频应用发送的音频来源标识码;The receiving unit is configured to receive the audio source identification code sent by the user terminal according to the audio application being executed by itself;
标识码识别单元,用于根据所述音频来源标识码识别出所述输入音频的来源。An identification code identifying unit, configured to identify the source of the input audio according to the audio source identification code.
在本发明实施例所述的自适应调节音效的系统中,所述音效模式包括电影模式、语音模式、游戏模式以及音乐模式,所述音频播放模块具体用于:In the system for adaptively adjusting sound effects according to the embodiment of the present invention, the sound effect modes include movie mode, voice mode, game mode and music mode, and the audio playback module is specifically used for:
若匹配出的音效模式为电影模式,则采用SRS音效播放所述输入音频;If the matched sound effect mode is a movie mode, then use SRS sound effect to play the input audio;
若匹配出的音效模式为语音模式,则对所述输入音频进行主动降噪,并将所述输入音频中对应的中频语音信号的增益提高;If the matched sound effect mode is a voice mode, active noise reduction is performed on the input audio, and the gain of the corresponding intermediate frequency voice signal in the input audio is increased;
若匹配出的音效模式为游戏模式,则采用SRS音效播放所述输入音频,并对所述输入音频进行声源定位;If the matched sound effect mode is a game mode, then adopt SRS sound effect to play the input audio, and perform sound source localization to the input audio;
若匹配出的音效模式为音乐模式,则自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式。If the matched sound effect mode is a music mode, automatically judge the music category of the input audio, and automatically adjust the gain mode of the equalizer according to the music category.
在本发明实施例所述的自适应调节音效的系统中,所述音乐播放模块具体用于:In the system for adaptively adjusting sound effects described in the embodiment of the present invention, the music playing module is specifically used for:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,提取出所述音频信号的音频特征向量,并根据所述音频特征向量和预先通过SVM训练器进行训练得到的分类模型识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio feature vector of the audio signal is extracted, and according to the audio The feature vector and the classification model obtained by training the SVM trainer in advance identify the music category of the buffered input audio;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
在本发明实施例所述的自适应调节音效的系统中,所述音乐播放模块具体用于:In the system for adaptively adjusting sound effects described in the embodiment of the present invention, the music playing module is specifically used for:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,对所述音频信号进行傅里叶变换,将所述音频信号从时域信号转换为频域分量,然后取各频域分量的傅里叶变换系数作为每一频点的能量大小,根据每一频点的能量大小识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio signal is Fourier transformed, and the audio signal is Converting the time domain signal into a frequency domain component, then taking the Fourier transform coefficients of each frequency domain component as the energy size of each frequency point, identifying the music category of the buffered input audio according to the energy size of each frequency point;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
实施本发明实施例提供的一种自适应调节音效的方法及系统具有以下有益效果:Implementing a method and system for adaptively adjusting sound effects provided by the embodiments of the present invention has the following beneficial effects:
本发明实施例通过根据用户终端正在执行的音频应用判断输入音频的来源,然后,根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式,并利用匹配出的音效模式播放所述输入音频,从而实现了根据输入音频的来源自适应调节音效模式的目的,其无需用户手动操作,能够提高用户的听觉效果和体验感。In the embodiment of the present invention, the source of the input audio is determined according to the audio application being executed by the user terminal, and then the corresponding sound effect mode is matched from the preset correspondence table between the sound effect mode and the audio source according to the source of the input audio, and The input audio is played by using the matched sound effect mode, thereby achieving the purpose of adaptively adjusting the sound effect mode according to the source of the input audio, which can improve the user's hearing effect and experience without manual operation by the user.
附图说明Description of drawings
图1是本发明实施例提供的自适应调节音效的系统的外部架构图;FIG. 1 is an external architecture diagram of a system for adaptively adjusting sound effects provided by an embodiment of the present invention;
图2本发明实施例提供的自适应调节音效的方法的具体实现流程图;Fig. 2 is a specific implementation flowchart of the method for adaptively adjusting the sound effect provided by the embodiment of the present invention;
图3是本发明实施例提供的自适应调节音效的方法中S101的具体实现流程图;FIG. 3 is a specific implementation flowchart of S101 in the method for adaptively adjusting sound effects provided by an embodiment of the present invention;
图4是本发明实施例提供的自适应调节音效的系统的内部结构示意图。Fig. 4 is a schematic diagram of an internal structure of a system for adaptively adjusting sound effects provided by an embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
图1示出了本发明实施例提供的自适应调节音效的系统的外部架构图。为了便于说明,仅示出了与本实施例相关的部分。FIG. 1 shows an external architecture diagram of a system for adaptively adjusting sound effects provided by an embodiment of the present invention. For ease of description, only the parts related to this embodiment are shown.
参照图1,该系统的外部架构包括了耳机1和用户终端2。其中,用户终端2包括但不限于智能手机、平板、PDA(Personal Digital Assistant,掌上电脑)等终端设备,用户终端2要求支持音频播放和蓝牙通讯功能。耳机1具有SRS(Sound Retrieval System,虚拟环绕音系统)、EQ(Equalizer,均衡器)调节、主动降噪以及蓝牙通讯等功能。Referring to FIG. 1 , the external architecture of the system includes a headset 1 and a user terminal 2 . Wherein, the user terminal 2 includes but not limited to smart phones, tablets, PDA (Personal Digital Assistant, handheld computer) and other terminal devices, and the user terminal 2 is required to support audio playback and Bluetooth communication functions. The headset 1 has functions such as SRS (Sound Retrieval System, virtual surround sound system), EQ (Equalizer, equalizer) adjustment, active noise reduction, and Bluetooth communication.
基于图1所示的系统的外部结构,以下结合具体的实施例对本发明实施例提供的自适应调节音效的方法及系统进行详细阐述:Based on the external structure of the system shown in Figure 1, the method and system for adaptively adjusting sound effects provided by the embodiments of the present invention are described in detail below in conjunction with specific embodiments:
图2示出了本发明实施例提供的自适应调节音效的方法的具体实现流程,在图2所示实施例中,流程的执行主体为图1中的耳机1。该方法的实现流程详述如下:FIG. 2 shows a specific implementation flow of the method for adaptively adjusting sound effects provided by an embodiment of the present invention. In the embodiment shown in FIG. 2 , the execution subject of the flow is the earphone 1 in FIG. 1 . The implementation process of this method is detailed as follows:
在S101中,根据用户终端2正在执行的音频应用判断输入音频的来源。In S101 , determine the source of the input audio according to the audio application being executed by the user terminal 2 .
在本实施例中,音频应用包括但不限于影音播放APP(Application,应用程序)、音乐播放APP、语音通话APP以及游戏APP。图2示出了S101的具体实现过程:In this embodiment, the audio application includes, but is not limited to, an audio-visual playing APP (Application, application program), a music playing APP, a voice call APP, and a game APP. Figure 2 shows the specific implementation process of S101:
在S201中,接收用户终端2根据自身正在执行的音频应用发送的音频来源标识码。In S201, the audio source identification code sent by the user terminal 2 according to the audio application being executed by itself is received.
在S202中,根据所述音频来源标识码识别出所述输入音频的来源。In S202, identify the source of the input audio according to the audio source identification code.
在本实施例中,用户终端2会根据自身正在执行的音频应用向与其建立有蓝牙配对连接的耳机1发送对应的音频来源标识码,耳机1和用户终端2均存储有音频来源标识码与音频来源的对应关系表,耳机1接收到音频来源标识码后可以根据该音频来源标识码从预存的音频来源标识码与音频来源的关系表中查找出对应的音频来源。这里的音频来源标识码可以为阿拉伯数字,也可以为英文字母。In this embodiment, the user terminal 2 will send the corresponding audio source identification code to the earphone 1 with which it has established a Bluetooth pairing connection according to the audio application being executed by itself. Both the earphone 1 and the user terminal 2 store the audio source identification code and audio Source correspondence table, after the earphone 1 receives the audio source identification code, it can find out the corresponding audio source from the pre-stored audio source identification code and audio source relationship table according to the audio source identification code. The audio source identification code here can be Arabic numerals or English letters.
在S102中,根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式。In S102, a corresponding sound effect mode is matched from a preset correspondence table between sound effect modes and audio sources according to the source of the input audio.
在S103中,利用匹配出的音效模式播放所述输入音频。In S103, play the input audio by using the matched sound effect mode.
在本实施例中,在本实施例中,所述音效模式包括但不限于电影模式、语音模式、游戏模式以及音乐模式。所述利用匹配出的音效模式播放所述输入音频具体包括:In this embodiment, in this embodiment, the sound effect mode includes but not limited to movie mode, voice mode, game mode and music mode. The playing the input audio using the matched sound effect mode specifically includes:
若匹配出的音效模式为电影模式,则采用SRS音效播放所述输入音频;If the matched sound effect mode is a movie mode, then use SRS sound effect to play the input audio;
若匹配出的音效模式为语音模式,则对所述输入音频进行主动降噪,并将所述输入音频中对应的中频语音信号的增益提高;If the matched sound effect mode is a voice mode, active noise reduction is performed on the input audio, and the gain of the corresponding intermediate frequency voice signal in the input audio is increased;
若匹配出的音效模式为游戏模式,则采用SRS音效播放所述输入音频,并对所述输入音频进行声源定位;If the matched sound effect mode is a game mode, then adopt SRS sound effect to play the input audio, and perform sound source localization to the input audio;
若匹配出的音效模式为音乐模式,则自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式。If the matched sound effect mode is a music mode, automatically judge the music category of the input audio, and automatically adjust the gain mode of the equalizer according to the music category.
作为一具体实现示例,所述自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益设置具体包括:As a specific implementation example, the automatically determining the music category of the input audio, and automatically adjusting the gain setting of the equalizer according to the music category specifically includes:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,提取出所述音频信号的音频特征向量,并根据所述音频特征向量和预先通过SVM(Support Vector Machine,支持向量机)训练器进行训练得到的分类模型识别出所述输入音频的音乐类别;优选的,本实施例中,预取所述缓存输入音频前20s内的音频信号作为分析对象,当然在其他实施例中用户可以根据自身的需要自行设置预取作为分析对象的音频信号的时间段,设置的时间段越长,其分析结果的可靠性越高;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio feature vector of the audio signal is extracted, and according to the audio The feature vector and the classification model obtained by training the SVM (Support Vector Machine, Support Vector Machine) trainer in advance identify the music category of the input audio; preferably, in this embodiment, prefetch the first 20s of the cache input audio The audio signal within is used as the analysis object. Of course, in other embodiments, the user can set the time period for prefetching the audio signal as the analysis object according to his own needs. The longer the set time period, the higher the reliability of the analysis result;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
作为另一具体实现示例,所述自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式具体包括:As another specific implementation example, the automatically determining the music category of the input audio, and automatically adjusting the gain mode of the equalizer according to the music category specifically includes:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,对所述音频信号进行傅里叶变换,将所述音频信号从时域信号转换为频域分量,然后取各频域分量的傅里叶变换系数作为每一频点的能量大小,根据每一频点的能量大小识别出所述缓存输入音频的音乐类别;优选的,本实施例中,预取所述缓存输入音频前30s内的音频信号作为分析对象,当然在其他实施例中用户可以根据自身的需要自行设置预取作为分析对象的音频信号的时间段,设置的时间段越长,其分析结果的可靠性越高;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio signal is Fourier transformed, and the audio signal is Converting the time domain signal into a frequency domain component, then taking the Fourier transform coefficients of each frequency domain component as the energy size of each frequency point, identifying the music category of the buffered input audio according to the energy size of each frequency point; Preferably, in this embodiment, prefetch the audio signal within 30s before the cached input audio as the analysis object. Of course, in other embodiments, the user can set the time period for prefetching the audio signal as the analysis object according to his own needs. , the longer the time period is set, the higher the reliability of the analysis results;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
在本发明实施例中,增益模式包括但不限于古典音乐模式、流行音乐模式、爵士音乐模式、摇滚音乐模式、普通模式和自动改变模式。用户可以在使用耳机1前预先根据自己的需要自行设置不同音乐模式下均衡器的增益参数并保存。In the embodiment of the present invention, the gain modes include but not limited to classical music mode, pop music mode, jazz music mode, rock music mode, normal mode and automatic change mode. The user can set and save the gain parameters of the equalizer in different music modes according to his needs before using the earphone 1 .
此外,在本发明实施例中各个音效模式所对应的音效参数均为可更改的,本实施例中仅仅例举出了上述较佳的实施方式,但并不限于上述实施方式。In addition, in the embodiment of the present invention, the sound effect parameters corresponding to each sound effect mode can be changed. This embodiment only exemplifies the above-mentioned preferred implementation manners, but is not limited to the above-mentioned implementation manners.
本发明实施例提供的自适应调节音效的方法由于首先判断输入音频的来源;然后,根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式,利用匹配出的音效模式播放所述输入音频,从而实现了根据输入音频的来源自适应调节音效模式的目的,其无需用户手动操作,能够提高用户的听觉效果和体验感。The method for adaptively adjusting the sound effect provided by the embodiment of the present invention first determines the source of the input audio; then, according to the source of the input audio, matches the corresponding sound effect mode from the preset correspondence table between the sound effect mode and the audio source, The input audio is played by using the matched sound effect mode, thereby achieving the purpose of adaptively adjusting the sound effect mode according to the source of the input audio, which can improve the user's hearing effect and experience without manual operation by the user.
图4示出了本发明实施例提供的自适应调节音效的系统的内部结构示意图,该系统可以位于如图1所示的耳机1之中,用于运行本发明图2至图3实施例所述的自适应调节音效的方法。为了便于说明,仅示出了与本实施例相关的部分。Fig. 4 shows a schematic diagram of the internal structure of the system for adaptively adjusting the sound effect provided by the embodiment of the present invention. The system can be located in the earphone 1 shown in Fig. The method for adaptively adjusting the sound effect described above. For ease of description, only the parts related to this embodiment are shown.
参照图4,该系统包括:Referring to Figure 4, the system includes:
音频来源识别模块11,用于根据用户终端2正在执行的音频应用判断输入音频的来源;Audio source identification module 11, for judging the source of input audio according to the audio application that user terminal 2 is executing;
音效模式设置模块12,用于根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式;A sound effect mode setting module 12, configured to match a corresponding sound effect mode from a preset correspondence table between sound effect modes and audio sources according to the source of the input audio;
音频播放模块13,用于利用匹配出的音效模式播放所述输入音频。The audio playing module 13 is configured to play the input audio by using the matched sound effect mode.
可选的,所述音频来源识别模块包括:Optionally, the audio source identification module includes:
接收单元111,用于接收用户终端2根据自身正在执行的音频应用发送的音频来源标识码;The receiving unit 111 is configured to receive the audio source identification code sent by the user terminal 2 according to the audio application being executed by itself;
标识码识别单元112,用于根据所述音频来源标识码识别出所述输入音频的来源。The identification code identification unit 112 is configured to identify the source of the input audio according to the audio source identification code.
可选的,所述音效模式包括电影模式、语音模式、游戏模式以及音乐模式,所述音频播放模块13具体用于:Optionally, the sound effect mode includes movie mode, voice mode, game mode and music mode, and the audio playback module 13 is specifically used for:
若匹配出的音效模式为电影模式,则采用SRS音效播放所述输入音频;If the matched sound effect mode is a movie mode, then use SRS sound effect to play the input audio;
若匹配出的音效模式为语音模式,则对所述输入音频进行主动降噪,并将所述输入音频中对应的中频语音信号的增益提高;If the matched sound effect mode is a voice mode, active noise reduction is performed on the input audio, and the gain of the corresponding intermediate frequency voice signal in the input audio is increased;
若匹配出的音效模式为游戏模式,则采用SRS音效播放所述输入音频,并对所述输入音频进行声源定位;If the matched sound effect mode is a game mode, then adopt SRS sound effect to play the input audio, and perform sound source localization to the input audio;
若匹配出的音效模式为音乐模式,则自动判断所述输入音频的音乐类别,并根据所述音乐类别自动调节均衡器的增益模式。If the matched sound effect mode is a music mode, automatically judge the music category of the input audio, and automatically adjust the gain mode of the equalizer according to the music category.
可选的,所述音乐播放模块13具体用于:Optionally, the music playing module 13 is specifically used for:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述缓存输入音频前段时间内的音频信号作为分析对象,提取出所述音频信号的音频特征向量,并根据所述音频特征向量和预先通过SVM训练器进行训练得到的分类模型识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically buffered, and the audio signal of the buffered input audio is prefetched as an analysis object, and the audio feature vector of the audio signal is extracted, and according to the audio The feature vector and the classification model obtained by training the SVM trainer in advance identify the music category of the buffered input audio;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
可选的,所述音乐播放模块13具体用于:Optionally, the music playing module 13 is specifically used for:
若匹配出的音效模式为音乐模式,则自动缓存输入音频,并预取所述输入音频前段时间内的音频信号作为分析对象,对所述音频信号进行傅里叶变换,将所述音频信号从时域信号转换为频域分量,然后取各频域分量的傅里叶变换系数作为每一频点的能量大小,根据每一频点的能量大小识别出所述缓存输入音频的音乐类别;If the matched sound effect mode is a music mode, the input audio is automatically cached, and the audio signal in the previous period of the input audio is prefetched as an analysis object, and the audio signal is Fourier transformed, and the audio signal is converted from The time domain signal is converted into a frequency domain component, and then the Fourier transform coefficients of each frequency domain component are taken as the energy size of each frequency point, and the music category of the buffered input audio is identified according to the energy size of each frequency point;
根据所述音乐类别从预存的音乐类别与均衡器的增益模式的对应关系表中匹配出对应的增益模式,并利用匹配出的增益模式播放所述缓存输入音频。Match the corresponding gain mode from the pre-stored correspondence table of the music category and the gain mode of the equalizer according to the music category, and use the matched gain mode to play the buffered input audio.
本发明实施例提供的自适应调节音效的系统同样由于首先判断输入音频的来源;然后,根据所述输入音频的来源从预设的音效模式与音频来源的对应关系表中匹配出对应的音效模式,利用匹配出的音效模式播放所述输入音频,从而实现了根据输入音频的来源自适应调节音效模式的目的,其无需用户手动操作,能够提高用户的听觉效果和体验感。The system for adaptively adjusting sound effects provided by the embodiments of the present invention also firstly determines the source of the input audio; then, according to the source of the input audio, the corresponding sound effect mode is matched from the preset correspondence table between sound effect modes and audio sources , using the matched sound effect mode to play the input audio, thereby achieving the purpose of adaptively adjusting the sound effect mode according to the source of the input audio, which can improve the user's auditory effect and experience without manual operation by the user.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| CN201510188030.4ACN104811864B (en) | 2015-04-20 | 2015-04-20 | A kind of method and system of automatic adjusument audio | 
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| CN201510188030.4ACN104811864B (en) | 2015-04-20 | 2015-04-20 | A kind of method and system of automatic adjusument audio | 
| Publication Number | Publication Date | 
|---|---|
| CN104811864A CN104811864A (en) | 2015-07-29 | 
| CN104811864Btrue CN104811864B (en) | 2018-11-13 | 
| Application Number | Title | Priority Date | Filing Date | 
|---|---|---|---|
| CN201510188030.4AActiveCN104811864B (en) | 2015-04-20 | 2015-04-20 | A kind of method and system of automatic adjusument audio | 
| Country | Link | 
|---|---|
| CN (1) | CN104811864B (en) | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN105242900B (en)* | 2015-08-04 | 2018-11-09 | 美国掌赢信息科技有限公司 | A kind of the audio frequency parameter adjusting method and equipment of mobile device | 
| CN105263086A (en)* | 2015-10-27 | 2016-01-20 | 小米科技有限责任公司 | Adjustment method of equalizer, device and intelligent speaker | 
| CN105516451A (en)* | 2015-11-23 | 2016-04-20 | 小米科技有限责任公司 | Sound effect adjustment method and device | 
| CN105657530A (en)* | 2015-12-30 | 2016-06-08 | 深圳Tcl数字技术有限公司 | Sound effect mode synchronization method and device | 
| CN106024034B (en)* | 2016-06-16 | 2018-11-13 | 广东欧珀移动通信有限公司 | A kind of method and terminal of adjustment audio | 
| CN106126172B (en)* | 2016-06-16 | 2017-11-14 | 广东欧珀移动通信有限公司 | A sound effect processing method and mobile terminal | 
| CN106126169A (en)* | 2016-06-16 | 2016-11-16 | 广东欧珀移动通信有限公司 | A sound effect adjustment method and user terminal | 
| CN106231484A (en)* | 2016-08-29 | 2016-12-14 | 北海爱飞数码科技有限公司 | Many audios intelligent sound box | 
| CN107920290A (en)* | 2016-10-10 | 2018-04-17 | 峰范(北京)科技有限公司 | Automatically adjust the Headphone device and balanced device adjusting method of balanced device | 
| CN106792253B (en)* | 2016-11-30 | 2019-07-09 | 广州视源电子科技股份有限公司 | Sound effect processing method and system | 
| CN106658300A (en)* | 2017-03-01 | 2017-05-10 | 深圳市麦思美汽车电子有限公司 | Sound effect control method for vehicle-mounted audio/video system | 
| US10991379B2 (en)* | 2018-06-22 | 2021-04-27 | Babblelabs Llc | Data driven audio enhancement | 
| CN110827843B (en)* | 2018-08-14 | 2023-06-20 | Oppo广东移动通信有限公司 | Audio processing method and device, storage medium and electronic equipment | 
| CN109388367B (en)* | 2018-09-04 | 2021-03-02 | Oppo广东移动通信有限公司 | Sound effect adjustment method, device, electronic device and storage medium | 
| CN109147739B (en)* | 2018-09-12 | 2021-07-23 | 网易(杭州)网络有限公司 | Voice control-based sound effect adjustment method, medium, device and computing device | 
| CN109246515B (en)* | 2018-10-09 | 2019-10-29 | 王青云 | A kind of intelligent earphone and method promoting personalized sound quality function | 
| CN109087634A (en)* | 2018-10-30 | 2018-12-25 | 四川长虹电器股份有限公司 | A kind of sound quality setting method based on audio classification | 
| CN110602626B (en)* | 2019-10-23 | 2021-09-21 | 维沃移动通信有限公司 | Microphone hole misplug detection method and electronic equipment | 
| CN113411707A (en)* | 2021-06-17 | 2021-09-17 | 歌尔智能科技有限公司 | Auxiliary listening earphone, control method, device and system thereof, and readable medium | 
| CN114344901A (en)* | 2021-12-23 | 2022-04-15 | 深圳市达实智控科技股份有限公司 | Audio adjustment method, device and game controller for game controller | 
| CN118972752A (en)* | 2024-07-30 | 2024-11-15 | 惠州中哲尚蓝柏科技有限公司 | Classification playback method, audio, equipment and storage medium based on audio recognition | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN101937445A (en)* | 2010-05-24 | 2011-01-05 | 中国科学技术信息研究所 | Automatic file classification system | 
| CN103731722A (en)* | 2013-11-27 | 2014-04-16 | 乐视致新电子科技(天津)有限公司 | Method and device for adjusting sound effect in self-adaption mode | 
| CN103927146A (en)* | 2014-04-30 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Sound effect self-adapting method and device | 
| CN104078050A (en)* | 2013-03-26 | 2014-10-01 | 杜比实验室特许公司 | Device and method for audio classification and audio processing | 
| WO2015000401A1 (en)* | 2013-07-02 | 2015-01-08 | 华为技术有限公司 | Audio signal classification processing method, apparatus, and device | 
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| CN101937445A (en)* | 2010-05-24 | 2011-01-05 | 中国科学技术信息研究所 | Automatic file classification system | 
| CN104078050A (en)* | 2013-03-26 | 2014-10-01 | 杜比实验室特许公司 | Device and method for audio classification and audio processing | 
| WO2015000401A1 (en)* | 2013-07-02 | 2015-01-08 | 华为技术有限公司 | Audio signal classification processing method, apparatus, and device | 
| CN103731722A (en)* | 2013-11-27 | 2014-04-16 | 乐视致新电子科技(天津)有限公司 | Method and device for adjusting sound effect in self-adaption mode | 
| CN103927146A (en)* | 2014-04-30 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Sound effect self-adapting method and device | 
| Title | 
|---|
| 支持向量机集成及在音乐分类中的应用;田慧;《中国优秀硕士学位论文全文数据库信息科技辑》;20090915(第9期);章节5.2-5.3,章节6.1* | 
| Publication number | Publication date | 
|---|---|
| CN104811864A (en) | 2015-07-29 | 
| Publication | Publication Date | Title | 
|---|---|---|
| CN104811864B (en) | A kind of method and system of automatic adjusument audio | |
| US9913056B2 (en) | System and method to enhance speakers connected to devices with microphones | |
| US8165321B2 (en) | Intelligent clip mixing | |
| JP5969034B2 (en) | Method of providing compensation service for characteristics of audio equipment using smart devices | |
| US10506323B2 (en) | User customizable headphone system | |
| CN103714824B (en) | A kind of audio-frequency processing method, device and terminal device | |
| WO2016184119A1 (en) | Volume adjustment method, system and equipment, and computer storage medium | |
| CN106126172B (en) | A sound effect processing method and mobile terminal | |
| CN105554611A (en) | Earphone and implementation method thereof | |
| CN103297581B (en) | A kind of mobile terminal and regulate the method for its equalizer | |
| CN106126163A (en) | A method and terminal for adjusting sound effects | |
| WO2019228329A1 (en) | Personal hearing device, external sound processing device, and related computer program product | |
| WO2017032012A1 (en) | Volume adjusting method and user terminal | |
| WO2022262223A1 (en) | Hearing aid earphone, control method, apparatus and system therefor, and readable medium | |
| CN111770404A (en) | Recording method, device, electronic device and readable storage medium | |
| CN107371102A (en) | Audio playback volume control method, device, storage medium and mobile terminal | |
| TWM526238U (en) | Electronic device capable of adjusting settings of equalizer according to user's age and audio playing device thereof | |
| TWM519370U (en) | Electronic device capable of adjusting equalizer settings according to the hearing physiological condition and audio playing device | |
| CN105280203B (en) | A kind of audio frequency playing method and user equipment | |
| CN107205095A (en) | Voice information playback method, device and terminal | |
| US10433081B2 (en) | Consumer electronics device adapted for hearing loss compensation | |
| CN114420158A (en) | Model training method and device, target frequency response information determination method and device | |
| CN103200480A (en) | Headset and working method thereof | |
| US20140355778A1 (en) | Headphone device and control method thereof | |
| CN113518284A (en) | Audio processing method, wireless headset and computer readable storage medium | 
| Date | Code | Title | Description | 
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Address after:Longgang District of Shenzhen City, Guangdong province 518116 Ping Street Takahashi Industrial Park East Area Applicant after:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Address before:Longgang District of Shenzhen City, Guangdong province 518116 Ping Street Takahashi Industrial Park East Area Applicant before:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. | |
| COR | Change of bibliographic data | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | Denomination of invention:A method and system for adaptive adjustment of sound effect Effective date of registration:20230220 Granted publication date:20181113 Pledgee:Bank of Communications Limited Shenzhen Branch Pledgor:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Registration number:Y2023980033001 | |
| PC01 | Cancellation of the registration of the contract for pledge of patent right | Granted publication date:20181113 Pledgee:Bank of Communications Limited Shenzhen Branch Pledgor:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Registration number:Y2023980033001 | |
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | Denomination of invention:A method and system for adaptive adjustment of sound effects Granted publication date:20181113 Pledgee:Bank of Communications Limited Shenzhen Branch Pledgor:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Registration number:Y2024980007841 | |
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right | Granted publication date:20181113 Pledgee:Bank of Communications Limited Shenzhen Branch Pledgor:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Registration number:Y2024980007841 | |
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | Denomination of invention:A method and system for adaptive adjustment of sound effects Granted publication date:20181113 Pledgee:Bank of Communications Limited Shenzhen Branch Pledgor:SHENZHEN GRANDSUN ELECTRONIC Co.,Ltd. Registration number:Y2025980012367 | |
| PE01 | Entry into force of the registration of the contract for pledge of patent right |