技术领域Technical Field
本公开涉及无麦K歌领域，尤其涉及一种音频信号处理方法、装置、音频处理系统及存储介质。The present disclosure relates to the field of karaoke without microphone, and in particular to an audio signal processing method, device, audio processing system and storage medium.
背景技术Background Art
在无麦K歌场景中，通常需要对音频处理系统中的音频处理算法(包括降噪算法、回声消除算法和防啸叫处理算法等算法)输入参考信号，以基于参考信号对输入的麦克风(microphone，MIC)信号进行降噪处理、回声消除处理以及防啸叫处理等，从而达到降低噪声、回声消除和防止声音啸叫的目的。In the scenario of singing karaoke without a microphone, it is usually necessary to input a reference signal into the audio processing algorithm (including noise reduction algorithm, echo cancellation algorithm and anti-howling processing algorithm) in the audio processing system, so as to perform noise reduction processing, echo cancellation processing and anti-howling processing on the input microphone (MIC) signal based on the reference signal, so as to achieve the purpose of reducing noise, canceling echoes and preventing sound howling.
然而，由于输入音频处理算法的参考信号是语音识别场景下的参考信号，并不适用于无麦K歌场景。因此，基于语音识别场景下的参考信号，通过音频处理算法无法滤除混入输入MIC信号中的干扰音频信号，在K歌过程中可能出现啸叫现象，严重影响用户的K歌体验。However, since the reference signal of the input audio processing algorithm is the reference signal in the speech recognition scenario, it is not applicable to the karaoke scenario without a microphone. Therefore, based on the reference signal in the speech recognition scenario, the audio processing algorithm cannot filter out the interfering audio signal mixed in the input MIC signal, and howling may occur during the karaoke process, seriously affecting the user's karaoke experience.
发明内容Summary of the invention
通常，输入音频处理算法中的参考信号为语音识别场景下的参考信号，通过音频处理算法无法滤除混入输入MIC信号中的干扰音频信号，在K歌过程中可能出现啸叫现象，严重影响用户的K歌体验。Usually, the reference signal in the input audio processing algorithm is the reference signal in the speech recognition scenario. The audio processing algorithm cannot filter out the interfering audio signal mixed in the input MIC signal. Howling may occur during the karaoke process, seriously affecting the user's karaoke experience.
为了解决上述技术问题，本公开提供了一种基于无麦K歌的音频信号处理方法，包括：In order to solve the above technical problems, the present disclosure provides an audio signal processing method based on microphone-free karaoke, comprising:
确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号；Determine a karaoke sound effect mode and an audio input signal input by a user into the audio processing system in the karaoke sound effect mode;
确定K歌音效模式对应的调节参数组；Determine the adjustment parameter group corresponding to the karaoke sound effect mode;
确定音频输入信号对应的初始参考信号；Determine an initial reference signal corresponding to the audio input signal;
基于调节参数组中的第一调节参数，对初始参考信号进行特征处理，得到目标参考信号；Based on the first adjustment parameter in the adjustment parameter group, feature processing is performed on the initial reference signal to obtain a target reference signal;
基于调节参数组中的第二调节参数、目标参考信号和音频输入信号，生成需要音频处理系统的扬声器播放的K歌音频信号。Based on the second adjustment parameter in the adjustment parameter group, the target reference signal and the audio input signal, a karaoke audio signal to be played by a speaker of the audio processing system is generated.
本公开的第二个方面，提供了一种音频处理系统，包括：A second aspect of the present disclosure provides an audio processing system, comprising:
音频处理器、与音频处理器耦接的功率放大器以及与功率放大器耦接的扬声器；an audio processor, a power amplifier coupled to the audio processor, and a speaker coupled to the power amplifier;
音频处理器，用于确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号；向功率放大器传输K歌音效模式；The audio processor is used to determine the karaoke sound effect mode and the audio input signal input by the user into the audio processing system in the karaoke sound effect mode; and transmit the karaoke sound effect mode to the power amplifier;
功率放大器，用于确定K歌音效模式对应的第一调节参数；确定音频输入信号对应的初始参考信号，基于第一调节参数，对初始参考信号进行特征处理，得到目标参考信号，并将目标参考信号输出至音频处理器；The power amplifier is used to determine a first adjustment parameter corresponding to the karaoke sound effect mode; determine an initial reference signal corresponding to the audio input signal, perform feature processing on the initial reference signal based on the first adjustment parameter to obtain a target reference signal, and output the target reference signal to the audio processor;
音频处理器，用于确定K歌音效模式对应的第二调节参数，基于第二调节参数、目标参考信号和音频输入信号，生成音频处理信号，并将音频处理信号输出至功率放大器；An audio processor, used to determine a second adjustment parameter corresponding to the karaoke sound effect mode, generate an audio processing signal based on the second adjustment parameter, the target reference signal and the audio input signal, and output the audio processing signal to the power amplifier;
功率放大器，用于对音频处理信号进行功率放大，生成需要音频处理系统的扬声器播放的K歌音频信号，并将K歌音频信号输出至扬声器；A power amplifier is used to amplify the power of the audio processing signal, generate a karaoke audio signal that needs to be played by a speaker of the audio processing system, and output the karaoke audio signal to the speaker;
扬声器，用于播放K歌音频信号。The speaker is used to play karaoke audio signals.
本公开第三方面实施例提出了一种无麦K歌的音频信号处理装置，包括：The third aspect of the present disclosure provides an audio signal processing device for karaoke without a microphone, including:
第一确定模块，用于确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号；A first determination module is used to determine a karaoke sound effect mode and an audio input signal input by a user into the audio processing system in the karaoke sound effect mode;
第二确定模块，用于确定K歌音效模式对应的调节参数组；The second determination module is used to determine the adjustment parameter group corresponding to the karaoke sound effect mode;
第三确定模块，用于确定音频输入信号对应的初始参考信号；A third determination module, used to determine an initial reference signal corresponding to the audio input signal;
第一处理模块，用于基于调节参数组中的第一调节参数，对初始参考信号进行特征处理，得到目标参考信号；A first processing module, configured to perform feature processing on the initial reference signal based on a first adjustment parameter in the adjustment parameter group to obtain a target reference signal;
生成模块，用于基于调节参数组中的第二调节参数、目标参考信号和音频输入信号，生成需要音频处理系统的扬声器播放的K歌音频信号。The generating module is used to generate a karaoke audio signal to be played by a speaker of the audio processing system based on the second adjusting parameter in the adjusting parameter group, the target reference signal and the audio input signal.
本公开第四方面实施例提供了一种计算机可读存储介质，存储介质存储有计算机程序，计算机程序用于执行上述第一方面的基于无麦K歌的音频信号处理方法。The fourth aspect of the present disclosure provides a computer-readable storage medium, wherein the storage medium stores a computer program for executing the audio signal processing method based on microphone-free karaoke in the first aspect.
本公开实施例中，通过确定K歌音效模式对应的调节参数组，并基于K歌音效模式对应的调节参数组中的第一调节参数对音频输入信号对应的初始参考信号进行特征处理，确保目标参考信号能够适用于无麦K歌场景，从而能够准确体现无麦K歌尝尽与语音识别场景的不同。进而，根据调节参数组中的第二调节参数、目标参考信号和音频输入信号生成K歌音频信号时，能够将K歌音频信号中的干扰音频信号滤除，避免K歌过程中的啸叫现象，提高用户的K歌体验。In the disclosed embodiment, by determining the adjustment parameter group corresponding to the karaoke sound effect mode, and based on the first adjustment parameter in the adjustment parameter group corresponding to the karaoke sound effect mode, the initial reference signal corresponding to the audio input signal is feature processed to ensure that the target reference signal can be applied to the karaoke scene without a microphone, so as to accurately reflect the difference between the karaoke scene without a microphone and the speech recognition scene. Furthermore, when generating a karaoke audio signal according to the second adjustment parameter in the adjustment parameter group, the target reference signal and the audio input signal, the interfering audio signal in the karaoke audio signal can be filtered out to avoid the howling phenomenon during the karaoke process and improve the user's karaoke experience.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本公开一示例性实施例提供的一种车载系统中实现无麦K歌的音频处理系统的示意图。FIG. 1 is a schematic diagram of an audio processing system for implementing microphone-free karaoke in a vehicle-mounted system provided by an exemplary embodiment of the present disclosure.
图2是本公开一示例性实施例提供的另一种车载系统中实现无麦K歌的音频处理系统的示意图。FIG. 2 is a schematic diagram of another audio processing system for implementing microphone-free karaoke in a vehicle-mounted system provided by an exemplary embodiment of the present disclosure.
图3是本公开一示例性实施例提供的一种基于无麦K歌的音频信号处理方法的流程示意图。FIG3 is a flowchart of an audio signal processing method based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图4是本公开一示例性实施例提供的另一种基于无麦K歌的音频信号处理方法的流程示意图。FIG. 4 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图5是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理方法的流程示意图。FIG. 5 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图6是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理方法的流程示意图。FIG. 6 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图7是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理方法的流程示意图。FIG. 7 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图8是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理方法的流程示意图。FIG8 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图9是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理方法的流程示意图。FIG. 9 is a flowchart of another method for processing audio signals based on karaoke without microphone provided by an exemplary embodiment of the present disclosure.
图10是本公开一示例性实施例提供的一种音频处理系统的结构示意图。FIG. 10 is a schematic structural diagram of an audio processing system provided by an exemplary embodiment of the present disclosure.
图11是本公开一示例性实施例提供的另一种音频处理系统的结构示意图。FIG. 11 is a schematic diagram of the structure of another audio processing system provided by an exemplary embodiment of the present disclosure.
图12是本公开一示例性实施例提供的一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 12 is a schematic structural diagram of an audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图13是本公开一示例性实施例提供的另一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 13 is a schematic structural diagram of another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图14是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 14 is a schematic structural diagram of another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图15是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 15 is a schematic structural diagram of another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图16是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 16 is a schematic structural diagram of another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图17是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 17 is a schematic structural diagram of another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图18是本公开一示例性实施例提供的又一种基于无麦K歌的音频信号处理装置的结构示意图。FIG. 18 is a schematic structural diagram of yet another audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure.
图19是本公开一示例性实施例提供的一种电子设备的结构示意图。FIG. 19 is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure.
具体实施方式DETAILED DESCRIPTION
为了解释本公开，下面将参考附图详细地描述本公开的示例实施例，显然，所描述的实施例仅是本公开的一部分实施例，而不是全部实施例，应理解，本公开不受示例性实施例的限制。To explain the present disclosure, example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. It should be understood that the present disclosure is not limited to the example embodiments.
应注意到：除非另外具体说明，否则在这些实施例中阐述的部件和步骤的相对布置、数字表达式和数值不限制本公开的范围。It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
申请概述Application Overview
目前，无麦K歌由于其相对于手持麦具有成本低、使用方便以及支持合唱的优点，已得到了越来越多的关注，且已应用于车载领域以及智能家电领域(例如，智能电视、智能音响等)。通常，车载领域和智能家电领域中的音频处理系统主要用于识别用户语音，在本公开中可以通过复用智能车辆或智能家电的音频处理系统实现无麦K歌功能。本公开实施例以无麦K歌应用在车载领域为例进行示例性说明。At present, microphone-free karaoke has received more and more attention due to its advantages over handheld microphones, such as low cost, ease of use, and support for chorus, and has been applied to the automotive field and the field of smart home appliances (e.g., smart TVs, smart speakers, etc.). Generally, the audio processing systems in the automotive field and the field of smart home appliances are mainly used to recognize user voices. In the present disclosure, the microphone-free karaoke function can be realized by multiplexing the audio processing systems of smart vehicles or smart home appliances. The present disclosure embodiment takes the application of microphone-free karaoke in the automotive field as an example for illustrative explanation.
示例性系统Exemplary Systems
图1是本公开一示例性实施例提供的一种车载系统中的音频处理系统的示意图。如图1所示，音频处理系统10包括音频处理模块11、与音频处理模块11耦接的功率放大器12以及与功率放大器12耦接的扬声器13。音频处理模块11包括车载麦克风110、预处理单元111和音频处理单元112。Fig. 1 is a schematic diagram of an audio processing system in a vehicle-mounted system provided by an exemplary embodiment of the present disclosure. As shown in Fig. 1, the audio processing system 10 includes an audio processing module 11, a power amplifier 12 coupled to the audio processing module 11, and a speaker 13 coupled to the power amplifier 12. The audio processing module 11 includes a vehicle-mounted microphone 110, a pre-processing unit 111, and an audio processing unit 112.
其中，车载麦克风110的输入端与音频处理模块11的输入端耦接，车载麦克风110的输出端与预处理单元111的输入端耦接。预处理单元111的输出端与音频处理单元112的第一输入端耦接。音频处理单元112的输出端作为音频处理模块11的输出端与功率放大器12的输入端耦接。功率放大器12的第一输出端与音频处理单元112的第二输入端耦接，功率放大器12的第二输出端与扬声器13的输入端耦接。The input end of the vehicle microphone 110 is coupled to the input end of the audio processing module 11, and the output end of the vehicle microphone 110 is coupled to the input end of the preprocessing unit 111. The output end of the preprocessing unit 111 is coupled to the first input end of the audio processing unit 112. The output end of the audio processing unit 112 is coupled to the input end of the power amplifier 12 as the output end of the audio processing module 11. The first output end of the power amplifier 12 is coupled to the second input end of the audio processing unit 112, and the second output end of the power amplifier 12 is coupled to the input end of the speaker 13.
下面结合图1对采用车载系统中的音频处理系统实现无麦K歌的过程进行介绍。The following is an introduction to the process of realizing microphone-free karaoke using the audio processing system in the vehicle-mounted system in conjunction with FIG. 1 .
如图1所示，首先，音频处理模块11获取K歌音效模式选择信号(例如，基于用户输入的K歌音效模式选择操作可以生成该K歌音效模式选择信号)，基于该K歌音效模式选择信号确定K歌音效模式，并向功率放大器12发送该K歌音效模式。As shown in Figure 1, first, the audio processing module 11 obtains a karaoke sound effect mode selection signal (for example, the karaoke sound effect mode selection signal can be generated based on a karaoke sound effect mode selection operation input by a user), determines the karaoke sound effect mode based on the karaoke sound effect mode selection signal, and sends the karaoke sound effect mode to the power amplifier 12.
然后，通过车载麦克风110采集用户音频信号(如用户唱歌的音频信号)和混入用户音频信号之中的扬声器13的播放音频信号，并将用户音频信号和扬声器13的播放音频信号转化为MIC信号(混合音频信号)输出至预处理单元111。Then, the vehicle-mounted microphone 110 collects the user audio signal (such as the audio signal of the user singing) and the playback audio signal of the speaker 13 mixed into the user audio signal, and converts the user audio signal and the playback audio signal of the speaker 13 into a MIC signal (mixed audio signal) and outputs it to the preprocessing unit 111.
其次，预处理单元111接收MIC信号并对MIC信号进行预处理(包括MIC信号的幅值和相位的调节处理)，得到预处理后的MIC信号，并将预处理后的MIC信号输出至音频处理单元112。Secondly, the preprocessing unit 111 receives the MIC signal and preprocesses the MIC signal (including adjusting the amplitude and phase of the MIC signal) to obtain the preprocessed MIC signal, and outputs the preprocessed MIC signal to the audio processing unit 112 .
再次，音频处理单元112接收功率放大器12输出的参考信号，基于参考信号对预处理后的MIC信号进行降噪处理、回声消除处理和防啸叫处理，得到处理后的MIC信号，并将处理后的MIC信号输出至功率放大器12。Again, the audio processing unit 112 receives the reference signal output by the power amplifier 12, performs noise reduction, echo cancellation and anti-howling processing on the pre-processed MIC signal based on the reference signal, obtains the processed MIC signal, and outputs the processed MIC signal to the power amplifier 12.
最后，功率放大器12根据K歌音效模式对处理后的MIC信号进行对应的信号处理(如滤波和功率放大)，得到K歌音效模式对应的K歌音频信号，并将K歌音效模式对应的K歌音频信号输出至扬声器13和音频处理单元112，扬声器13播放该K歌音频信号。同时，功率放大器12将K歌音效模式对应的K歌音频信号作为参考信号输出至音频处理单元112。从而音频处理单元112在处理下一帧音频时可基于该参考信号对下一帧预处理后的MIC信号进行处理。Finally, the power amplifier 12 performs corresponding signal processing (such as filtering and power amplification) on the processed MIC signal according to the karaoke sound effect mode, obtains the karaoke audio signal corresponding to the karaoke sound effect mode, and outputs the karaoke audio signal corresponding to the karaoke sound effect mode to the speaker 13 and the audio processing unit 112, and the speaker 13 plays the karaoke audio signal. At the same time, the power amplifier 12 outputs the karaoke audio signal corresponding to the karaoke sound effect mode as a reference signal to the audio processing unit 112. Therefore, the audio processing unit 112 can process the pre-processed MIC signal of the next frame based on the reference signal when processing the next frame of audio.
在采用上述音频处理系统实现语音识别功能时，由于扬声器13的播放音频信号不会被车载麦克风110采集，因此可以直接将功率放大器12输出的K歌音频信号作为音频处理单元112的参考信号。但是采用上述音频处理系统实现无麦K歌时，车载麦克风110会同时采集用户音频信号和扬声器13的播放音频信号，因此如果直接将功率放大器12输出的K歌音频信号作为音频处理单元112的参考信号，则无法消除扬声器13输出的播放音频信号所造成的干扰，导致对MIC信号的处理回路变成一个正反馈系统，会产生非常刺耳的尖锐啸叫，严重影响用户的K歌体验。When the above-mentioned audio processing system is used to implement the voice recognition function, since the audio signal played by the speaker 13 will not be collected by the vehicle-mounted microphone 110, the karaoke audio signal output by the power amplifier 12 can be directly used as the reference signal of the audio processing unit 112. However, when the above-mentioned audio processing system is used to implement microphone-free karaoke, the vehicle-mounted microphone 110 will simultaneously collect the user audio signal and the audio signal played by the speaker 13. Therefore, if the karaoke audio signal output by the power amplifier 12 is directly used as the reference signal of the audio processing unit 112, the interference caused by the audio signal played by the speaker 13 cannot be eliminated, resulting in the processing loop of the MIC signal becoming a positive feedback system, which will produce a very harsh and sharp howl, seriously affecting the user's karaoke experience.
因此，亟需对各K歌音效模式下的MIC信号和K歌音频信号进行有效分析，确定出适合的参考信号，以通过该参考信号对MIC信号进行预处理、降噪处理、回声消除处理和防啸叫处理，以解决啸叫问题，提高用户的K歌体验。Therefore, it is urgent to effectively analyze the MIC signals and karaoke audio signals under each karaoke sound effect mode and determine a suitable reference signal so that the MIC signals can be pre-processed, denoised, echo-cancelled and anti-howling processed through the reference signal to solve the howling problem and improve the user's karaoke experience.
基于上述问题，本公开实施例提供了一种基于无麦K歌的音频信号处理方法，通过确定K歌音效模式对应的调节参数组，并基于K歌音效模式对应的调节参数组中的第一调节参数对音频输入信号对应的初始参考信号进行特征处理，确保目标参考信号能够适用于无麦K歌场景，从而能够准确体现无麦K歌场景与语音识别场景的不同。进而，根据目标参考信号、调节参数组中的第二调节参数和音频输入信号生成K歌音频信号时，能够将K歌音频信号中的干扰音频信号过滤掉，避免K歌过程中的啸叫现象，提高用户的K歌体验。Based on the above problems, the disclosed embodiment provides an audio signal processing method based on microphone-free karaoke, by determining the adjustment parameter group corresponding to the karaoke sound effect mode, and based on the first adjustment parameter in the adjustment parameter group corresponding to the karaoke sound effect mode, the initial reference signal corresponding to the audio input signal is feature processed to ensure that the target reference signal can be applied to the microphone-free karaoke scene, so as to accurately reflect the difference between the microphone-free karaoke scene and the speech recognition scene. Furthermore, when generating a karaoke audio signal based on the target reference signal, the second adjustment parameter in the adjustment parameter group and the audio input signal, the interfering audio signal in the karaoke audio signal can be filtered out to avoid the howling phenomenon during the karaoke process and improve the user's karaoke experience.
下面结合图1对采用音频处理系统10实现无麦K歌时，本公开实施例提供的音频信号处理方法的处理过程进行介绍。The following describes the processing process of the audio signal processing method provided by the embodiment of the present disclosure when the audio processing system 10 is used to implement karaoke without a microphone in conjunction with FIG. 1 .
如图1所示，首先，音频处理模块11在确定K歌音效模式后，向预处理单元111和功率放大器12发送该K歌音效模式。As shown in FIG. 1 , first, after determining the karaoke sound effect mode, the audio processing module 11 sends the karaoke sound effect mode to the pre-processing unit 111 and the power amplifier 12 .
其次，通过车载麦克风110采集用户音频信号和混入用户音频信号之中的扬声器13的播放音频信号，并将用户音频信号和扬声器13的播放音频信号转化为MIC信号输出至预处理单元111。Secondly, the vehicle-mounted microphone 110 collects the user audio signal and the audio signal played by the speaker 13 mixed into the user audio signal, and converts the user audio signal and the audio signal played by the speaker 13 into MIC signals and outputs them to the preprocessing unit 111.
再次，预处理单元111根据K歌音效模式确定对应的调节参数组，并基于调节参数组中的第二调节参数对MIC信号进行预处理，得到预处理后的MIC信号，并将预处理后的MIC信号输出至音频处理单元112。Again, the preprocessing unit 111 determines the corresponding adjustment parameter group according to the karaoke sound effect mode, and preprocesses the MIC signal based on the second adjustment parameter in the adjustment parameter group to obtain the preprocessed MIC signal, and outputs the preprocessed MIC signal to the audio processing unit 112.
接着，音频处理单元112接收预处理后的MIC信号和功率放大器12输出的K歌音效模式对应的参考信号，基于该参考信号对预处理后的MIC信号进行降噪处理、回声消除处理和防啸叫处理，得到处理后的MIC信号，并将处理后的MIC信号输出至功率放大器12。Next, the audio processing unit 112 receives the preprocessed MIC signal and a reference signal corresponding to the karaoke sound effect mode output by the power amplifier 12, performs noise reduction, echo elimination and anti-howling processing on the preprocessed MIC signal based on the reference signal to obtain a processed MIC signal, and outputs the processed MIC signal to the power amplifier 12.
最后，功率放大器12根据K歌音效模式对处理后的MIC信号进行对应的信号处理(如滤波和功率放大)，得到K歌音效模式对应的K歌音频信号；将该K歌音频信号输出至扬声器13，扬声器13播放K歌音频信号。同时，功率放大器12根据K歌音效模式确定对应的调节参数组中的第一调节参数，并基于第一调节参数对该K歌音频信号进行特征调节，得到特征调节后的K歌音频信号。并将特征调节后的K歌音频信号作为K歌音效模式对应的参考信号输出至音频处理单元112，从而音频处理单元112在处理下一帧音频时可基于该参考信号对下一帧预处理后的MIC信号进行处理。Finally, the power amplifier 12 performs corresponding signal processing (such as filtering and power amplification) on the processed MIC signal according to the karaoke sound effect mode to obtain a karaoke audio signal corresponding to the karaoke sound effect mode; the karaoke audio signal is output to the speaker 13, and the speaker 13 plays the karaoke audio signal. At the same time, the power amplifier 12 determines the first adjustment parameter in the corresponding adjustment parameter group according to the karaoke sound effect mode, and performs feature adjustment on the karaoke audio signal based on the first adjustment parameter to obtain a karaoke audio signal after feature adjustment. The feature-adjusted karaoke audio signal is output to the audio processing unit 112 as a reference signal corresponding to the karaoke sound effect mode, so that the audio processing unit 112 can process the pre-processed MIC signal of the next frame based on the reference signal when processing the next frame of audio.
在采用音频处理系统10实现无麦K歌时，需要先确定各K歌音效模式对应的调节参数组，并将各K歌音效模式对应的调节参数组中的第一调节参数配置到功率放大器12(例如，功率放大器12中的Flash存储器)，将K歌音效模式对应的调节参数组中的第二调节参数配置到预处理单元111(例如，预处理单元111中的数字信号处理器(Digital SignalProcess，DSP)中的寄存器)。When using the audio processing system 10 to realize microphone-free karaoke, it is necessary to first determine the adjustment parameter group corresponding to each karaoke sound effect mode, and configure the first adjustment parameter in the adjustment parameter group corresponding to each karaoke sound effect mode to the power amplifier 12 (for example, the Flash memory in the power amplifier 12), and configure the second adjustment parameter in the adjustment parameter group corresponding to the karaoke sound effect mode to the preprocessing unit 111 (for example, the register in the digital signal processor (Digital Signal Process, DSP) in the preprocessing unit 111).
在一些实施例中，为了确定各K歌音效模式对应的调节参数组，如图2所示，音频处理系统10还包括语音数据采集模块14、参数确定模块15以及存储音频检测文件的存储器16。In some embodiments, in order to determine the adjustment parameter group corresponding to each karaoke sound effect mode, as shown in FIG2 , the audio processing system 10 further includes a voice data acquisition module 14 , a parameter determination module 15 and a memory 16 for storing audio detection files.
其中，存储器16与音频处理模块11耦接，音频处理模块11用于将存储器16中存储的音频检测文件转化为音频检测信号。语音数据采集模块14，分别与功率放大器12和参数确定模块15耦接，用于采集功率放大器12输出的测试播放信号，并向参数确定模块15输出该测试播放信号。同时，语音数据采集模块14上设有语音信号采集设备(例如，麦克风)，可通过语音该采集设备采集音频检测信号，并向参数确定模块15输出该音频检测信号。The memory 16 is coupled to the audio processing module 11, and the audio processing module 11 is used to convert the audio detection file stored in the memory 16 into an audio detection signal. The voice data acquisition module 14 is coupled to the power amplifier 12 and the parameter determination module 15, respectively, and is used to collect the test playback signal output by the power amplifier 12, and output the test playback signal to the parameter determination module 15. At the same time, the voice data acquisition module 14 is provided with a voice signal acquisition device (for example, a microphone), and the audio detection signal can be collected by the acquisition device through the voice, and the audio detection signal can be output to the parameter determination module 15.
下面结合图2对确定各K歌音效模式对应的调节参数组的过程进行示例性说明。The following is an exemplary description of the process of determining the adjustment parameter group corresponding to each karaoke sound effect mode in conjunction with FIG. 2 .
如图1所示，首先，音频处理模块11向功率放大器12发送K歌音效模式，音频处理模块11播放存储器16中存储的音频检测文件，产生检测输入音频信号。音频处理模块11中的车载麦克风110采集检测输入音频信号和混入检测输入音频信号中扬声器13播放的测试音频信号，并将检测输入音频信号和测试音频信号转换为检测MIC信号(对应混合检测音频信号)输出至预处理单元111。As shown in FIG1 , first, the audio processing module 11 sends a karaoke sound effect mode to the power amplifier 12, and the audio processing module 11 plays the audio detection file stored in the memory 16 to generate a detection input audio signal. The vehicle-mounted microphone 110 in the audio processing module 11 collects the detection input audio signal and the test audio signal played by the speaker 13 mixed in the detection input audio signal, and converts the detection input audio signal and the test audio signal into a detection MIC signal (corresponding to the mixed detection audio signal) and outputs it to the preprocessing unit 111.
其次，预处理单元111接收检测MIC信号，并对检测MIC信号进行预处理(包括MIC信号的幅值和相位的调节处理)，得到预处理后的检测MIC信号，并将预处理后的检测MIC信号输出至音频处理单元112。Secondly, the preprocessing unit 111 receives the detection MIC signal, and preprocesses the detection MIC signal (including adjusting the amplitude and phase of the MIC signal) to obtain the preprocessed detection MIC signal, and outputs the preprocessed detection MIC signal to the audio processing unit 112.
再次，音频处理单元112接收功率放大器12输出的前一帧音频检测信号对应的测试播放信号，并将前一帧音频信号对应的测试播放信号作为参考信号，对预处理后的检测MIC信号进行降噪处理、回声消除处理和防啸叫处理，得到处理后的检测MIC信号，并将处理后的检测MIC信号输出至功率放大器12。Again, the audio processing unit 112 receives the test playback signal corresponding to the previous frame audio detection signal output by the power amplifier 12, and uses the test playback signal corresponding to the previous frame audio signal as a reference signal, performs noise reduction processing, echo elimination processing and anti-howling processing on the pre-processed detection MIC signal, obtains the processed detection MIC signal, and outputs the processed detection MIC signal to the power amplifier 12.
再次，功率放大器12根据K歌音效模式对处理后的检测MIC信号进行对应的信号处理(如滤波和功率放大)，得到K歌音效模式对应的测试播放信号并将K歌音效模式对应的测试播放信号发送至扬声器13和语音数据采集模块14。Again, the power amplifier 12 performs corresponding signal processing (such as filtering and power amplification) on the processed detection MIC signal according to the karaoke sound effect mode, obtains a test playback signal corresponding to the karaoke sound effect mode, and sends the test playback signal corresponding to the karaoke sound effect mode to the speaker 13 and the voice data acquisition module 14.
接着，扬声器13接收并播放K歌音效模式对应的测试播放信号；语音数据采集模块14上的语音信号采集设备采集检测输入音频信号和扬声器13播放的测试音频信号，得到检测MIC信号，并将检测MIC信号和K歌音效模式对应的测试播放信号输出在参数确定模块15。Next, the speaker 13 receives and plays the test playback signal corresponding to the karaoke sound effect mode; the voice signal acquisition device on the voice data acquisition module 14 collects the detection input audio signal and the test audio signal played by the speaker 13 to obtain a detection MIC signal, and outputs the detection MIC signal and the test playback signal corresponding to the karaoke sound effect mode to the parameter determination module 15.
最后，参数确定模块15对K歌音效模式对应的测试播放信号和检测MIC信号进行分析处理，得到各K歌音效模式对应的调节参数组。Finally, the parameter determination module 15 analyzes and processes the test playback signal and the detection MIC signal corresponding to the karaoke sound effect mode to obtain the adjustment parameter group corresponding to each karaoke sound effect mode.
上述确定K歌音效模式对应的调节参数组的过程中，由于测试播放信号和检测MIC信号均为语音数据采集模块14在无麦K歌场景下所采集的信号，因此测试播放信号和MIC信号均能够准确地反映无麦K歌场景。进而，根据测试播放信号和检测MIC信号所确定的调节参数组能够准确地体现无麦K歌场景与语音识别场景的不同。In the above process of determining the adjustment parameter group corresponding to the karaoke sound effect mode, since the test playback signal and the detection MIC signal are both signals collected by the voice data acquisition module 14 in the karaoke scene without a microphone, the test playback signal and the MIC signal can accurately reflect the karaoke scene without a microphone. Furthermore, the adjustment parameter group determined according to the test playback signal and the detection MIC signal can accurately reflect the difference between the karaoke scene without a microphone and the voice recognition scene.
示例性方法Exemplary Methods
图3是本公开一示例性实施例提供的一种基于无麦K歌的音频信号处理方法的流程示意图。该基于无麦K歌的音频信号处理方法可应用于如图1或2所示的音频处理系统10中，如图3所示，该基于无麦K歌的音频信号处理方法可以包括如下步骤301至步骤305。Fig. 3 is a flowchart of an audio signal processing method based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure. The audio signal processing method based on microphone-free karaoke can be applied to the audio processing system 10 shown in Fig. 1 or 2. As shown in Fig. 3, the audio signal processing method based on microphone-free karaoke can include the following steps 301 to 305.
步骤301，确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号。Step 301, determining a karaoke sound effect mode and an audio input signal input by a user into an audio processing system in the karaoke sound effect mode.
示例性地，K歌音效模式是指在用户在K歌应用中所选择的用于改变音频输出的音质和风格，以适应不同的场景或个人喜好，改善和增强用户的歌唱体验的一种音效配置。在一些示例中，K歌音效模式可包括标准模式、流行模式、摇滚模式、爵士模式、环绕模式等模式中的任一个。例如，K歌音效模式可以是默认的标准模式。Exemplarily, the karaoke sound effect mode refers to a sound effect configuration selected by the user in the karaoke application to change the sound quality and style of the audio output to adapt to different scenes or personal preferences, and to improve and enhance the user's singing experience. In some examples, the karaoke sound effect mode may include any one of the modes such as standard mode, pop mode, rock mode, jazz mode, surround mode, etc. For example, the karaoke sound effect mode may be the default standard mode.
在一些示例中，参考图1所示，用户可以在车辆的中控屏上通过触摸操作输入音效模式选择操作，也可以通过语音输入音效模式选择指令。音频处理模块11响应该音效模式选择操作或音效模式选择指令确定对应的K歌音效模式。通过音频处理模块11内部的通信总线将K歌音效模式传递至音频处理系统10中的预处理单元111，同时将该K歌音效模式通过音频处理模块11外部的CAN总线传递至功率放大器12，使得音频处理系统10工作在用户选择的K歌音效模式下。In some examples, as shown in reference figure 1, the user can input the sound effect mode selection operation through touch operation on the central control screen of the vehicle, or can input the sound effect mode selection instruction through voice. The audio processing module 11 responds to the sound effect mode selection operation or the sound effect mode selection instruction to determine the corresponding karaoke sound effect mode. The karaoke sound effect mode is transmitted to the pre-processing unit 111 in the audio processing system 10 through the communication bus inside the audio processing module 11, and the karaoke sound effect mode is transmitted to the power amplifier 12 through the CAN bus outside the audio processing module 11, so that the audio processing system 10 operates in the karaoke sound effect mode selected by the user.
示例性地，音频输入信号可以是输入音频处理系统的MIC信号。在一些示例中，音频输入信号可以包括用户音频信号对应的K歌MIC信号和播放音频信号对应的播放MIC信号。Exemplarily, the audio input signal may be a MIC signal input to the audio processing system. In some examples, the audio input signal may include a karaoke MIC signal corresponding to the user audio signal and a playback MIC signal corresponding to the playback audio signal.
步骤302，确定K歌音效模式对应的调节参数组。Step 302, determining the adjustment parameter group corresponding to the karaoke sound effect mode.
示例性地，调节参数组是指用于调节音频输入信号和参考信号特征的参数组。在一些示例中，调节参数组可包括多个幅值调节参数和/或多个相位调节参数，本公开实施例对此不作限定。Exemplarily, the adjustment parameter group refers to a parameter group used to adjust the characteristics of the audio input signal and the reference signal. In some examples, the adjustment parameter group may include multiple amplitude adjustment parameters and/or multiple phase adjustment parameters, which are not limited in the embodiments of the present disclosure.
示例性地，可以根据K歌音效模式从调节参数组对应关系中查询各K歌音效模式对应的调节参数组。调节参数组对应关系可包括各K歌音效模式对应的调节参数组。调节参数组对应关系可参见下表1所示。Exemplarily, the adjustment parameter group corresponding to each karaoke sound effect mode can be queried from the adjustment parameter group correspondence according to the karaoke sound effect mode. The adjustment parameter group correspondence may include the adjustment parameter group corresponding to each karaoke sound effect mode. The adjustment parameter group correspondence can be shown in Table 1 below.
表1Table 1
其中，不同K歌音效模式对应的调节参数组可以相同，也可以不同，本公开实施例对此不作限定。Among them, the adjustment parameter groups corresponding to different karaoke sound effect modes can be the same or different, and the embodiments of the present disclosure are not limited to this.
在一些示例中，参考图2所示，音频处理系统10中的预处理单元111和功率放大器12中可存储上述表1所示的调节参数组对应关系，并在预处理单元111和功率放大器12接收到用户选择的K歌音效模式后，查询该调节参数组对应关系，确定用户选择的K歌音效模式信号对应的调节参数组。In some examples, as shown in reference Figure 2, the preprocessing unit 111 and the power amplifier 12 in the audio processing system 10 may store the correspondence between the adjustment parameter groups shown in Table 1 above, and after the preprocessing unit 111 and the power amplifier 12 receive the karaoke sound effect mode selected by the user, the correspondence between the adjustment parameter groups is queried to determine the adjustment parameter group corresponding to the karaoke sound effect mode signal selected by the user.
步骤303，确定音频输入信号对应的初始参考信号。Step 303: determine an initial reference signal corresponding to the audio input signal.
示例性地，初始参考信号可以是前一帧音频信号对应的K歌音频信号。例如，参考图2所示，可以将音频处理系统10在对前一帧音频输入信号进行处理时，功率放大器12生成的需要扬声器播放的K歌音频信号确定为初始参考信号。Exemplarily, the initial reference signal may be a karaoke audio signal corresponding to the previous frame of audio signal. For example, referring to FIG2 , the karaoke audio signal generated by the power amplifier 12 and required to be played by the speaker when the audio processing system 10 processes the previous frame of audio input signal may be determined as the initial reference signal.
步骤304，基于调节参数组中的第一调节参数，对初始参考信号进行特征处理，得到目标参考信号。Step 304: Based on the first adjustment parameter in the adjustment parameter group, feature processing is performed on the initial reference signal to obtain a target reference signal.
示例性地，第一调节参数可以包括用于调节初始参考信号特征的多个参数。在一些示例中，第一调节参数可以包括用于调节初始参考信号的幅值的增益参数和用于调节初始参考信号的相位的延迟参数。Exemplarily, the first adjustment parameter may include multiple parameters for adjusting the characteristics of the initial reference signal. In some examples, the first adjustment parameter may include a gain parameter for adjusting the amplitude of the initial reference signal and a delay parameter for adjusting the phase of the initial reference signal.
示例性地，参考图2所示，功率放大器12可以基于K歌音效模式信号查询第一调节参数对应关系，确定K歌音效模式信号对应的第一调节参数。并基于第一调节参数对需要扬声器播放的K歌音频信号进行幅值和相位调节，将得到的幅值和相位调节后的K歌音频信号作为目标参考信号输出至音频处理单元112。Exemplarily, referring to FIG2 , the power amplifier 12 can query the first adjustment parameter correspondence based on the karaoke sound effect mode signal to determine the first adjustment parameter corresponding to the karaoke sound effect mode signal. The karaoke audio signal to be played by the speaker is adjusted in amplitude and phase based on the first adjustment parameter, and the obtained karaoke audio signal after amplitude and phase adjustment is output to the audio processing unit 112 as a target reference signal.
在一些示例中，功率放大器12中可包括DSP和Flash存储器，且Flash存储器中可存储有预先配置的第一调节参数对应关系。在功率放大器12接收到K歌音效模式时，功率放大器12中的DSP可以响应该K歌音效模式，从Flash存储器中查询第一调节参数对应关系，获取K歌音效模式对应的第一调节参数。接着DSP可以基于第一调节参数对需要扬声器播放的K歌音频信号进行幅值和相位调节，并将得到的目标参考信号输出至音频处理单元112。In some examples, the power amplifier 12 may include a DSP and a Flash memory, and the Flash memory may store a pre-configured first adjustment parameter correspondence. When the power amplifier 12 receives a karaoke sound effect mode, the DSP in the power amplifier 12 may respond to the karaoke sound effect mode, query the first adjustment parameter correspondence from the Flash memory, and obtain the first adjustment parameter corresponding to the karaoke sound effect mode. Then the DSP may adjust the amplitude and phase of the karaoke audio signal to be played by the speaker based on the first adjustment parameter, and output the obtained target reference signal to the audio processing unit 112.
示例性地，第一调节参数对应关系可包括各K歌音效模式对应的第一调节参数。在一些示例中，由于各调节参数组中均可包括第一调节参数，因此，第一调节参数对应关系可为上述表1。在另一些示例中，第一调节参数对应关系可为对上述表1进行分解后所得到的表2，本公开实施例对此不作限定。Exemplarily, the first adjustment parameter correspondence may include the first adjustment parameter corresponding to each karaoke sound effect mode. In some examples, since each adjustment parameter group may include the first adjustment parameter, the first adjustment parameter correspondence may be the above-mentioned Table 1. In other examples, the first adjustment parameter correspondence may be Table 2 obtained by decomposing the above-mentioned Table 1, which is not limited in the embodiments of the present disclosure.
表2Table 2
其中，不同K歌音效模式对应的增益参数和延迟参数可以部分相同，也可以完全不同，本公开实施例对此不作限定。Among them, the gain parameters and delay parameters corresponding to different karaoke sound effect modes may be partially the same or completely different, and the embodiments of the present disclosure are not limited to this.
步骤305，基于调节参数组中的第二调节参数、目标参考信号和音频输入信号，生成需要音频处理系统的扬声器播放的K歌音频信号。Step 305: Generate a karaoke audio signal to be played by a speaker of the audio processing system based on the second adjustment parameter in the adjustment parameter group, the target reference signal and the audio input signal.
示例性地，第二调节参数可以包括用于调节音频输入信号特征的多个参数。在一些示例中，第二调节参数可以包括用于调节音频输入信号的幅值的增益参数和用于调节音频输入信号的相位的延迟参数。Exemplarily, the second adjustment parameter may include a plurality of parameters for adjusting the characteristics of the audio input signal. In some examples, the second adjustment parameter may include a gain parameter for adjusting the amplitude of the audio input signal and a delay parameter for adjusting the phase of the audio input signal.
示例性地，可以基于调节参数组中的第二调节参数先对音频输入信号进行第一次处处理，得到第一次处理后的音频输入信号。然后基于目标参考信号对第一次处理后的音频输入信号进行第二次处理，得到需要音频处理系统的扬声器播放的K歌音频信号。For example, the audio input signal can be first processed based on the second adjustment parameter in the adjustment parameter group to obtain the first processed audio input signal. Then, the first processed audio input signal is second processed based on the target reference signal to obtain a karaoke audio signal that needs to be played by the speaker of the audio processing system.
在一些示例中，参考图2所示，预处理单元111基于第二调节参数对音频输入信号进行预处理，得到预处理后的音频输入信号，并将预处理后的音频输入信号输出至音频处理单元112。音频处理单元112基于功率放大器12输出的目标参考信号对预处理后的音频输入信号进行音频处理，得到需要扬声器13播放的K歌音频信号。In some examples, as shown in FIG2 , the preprocessing unit 111 preprocesses the audio input signal based on the second adjustment parameter to obtain a preprocessed audio input signal, and outputs the preprocessed audio input signal to the audio processing unit 112. The audio processing unit 112 performs audio processing on the preprocessed audio input signal based on the target reference signal output by the power amplifier 12 to obtain a karaoke audio signal that needs to be played by the speaker 13.
本公开实施例中，通过确定K歌音频模式、K歌音频模式下输入音频处理系统的音频输入信号以及K歌音效模式对应的调节参数组。并根据调节参数组中的第一调节参数对音频输入信号对应的初始参考信号进行特征处理，确保目标参考信号能够适用于无麦K歌场景，从而能够准确体现无麦K歌的场景与语音识别场景的不同。进而，根据调节参数组中的第二调节参数、目标参考信号和音频输入信号生成K歌音频信号时，能够将K歌音频信号中的干扰音频信号过滤掉，避免K歌过程中的啸叫现象，提高用户的K歌体验。In the disclosed embodiment, a karaoke audio mode, an audio input signal input to the audio processing system in the karaoke audio mode, and an adjustment parameter group corresponding to the karaoke sound effect mode are determined. The initial reference signal corresponding to the audio input signal is feature processed according to the first adjustment parameter in the adjustment parameter group to ensure that the target reference signal is applicable to the karaoke scene without a microphone, thereby accurately reflecting the difference between the karaoke scene without a microphone and the speech recognition scene. Furthermore, when a karaoke audio signal is generated according to the second adjustment parameter in the adjustment parameter group, the target reference signal, and the audio input signal, the interfering audio signal in the karaoke audio signal can be filtered out to avoid the howling phenomenon during the karaoke process and improve the user's karaoke experience.
如图4所示，在上述图3所示实施例的基础上，步骤302可包括如下步骤3021和步骤3023。As shown in FIG. 4 , based on the embodiment shown in FIG. 3 , step 302 may include the following steps 3021 and 3023 .
步骤3021，确定在K歌音效模式下输入音频处理系统的音频检测信号。Step 3021, determining the audio detection signal input into the audio processing system in the karaoke sound effect mode.
示例性地，音频检测信号可以是将音频检测文件进行音频转换所得到的检测MIC信号。音频检测文件可以是用于模拟实际环境所包括的所有音频信号的立体声音频。在一些示例中，音频检测文件可包括用于模拟不同特征的6段音频。Exemplarily, the audio detection signal may be a detection MIC signal obtained by converting the audio detection file into an audio signal. The audio detection file may be a stereo audio signal for simulating all audio signals included in the actual environment. In some examples, the audio detection file may include 6 audio segments for simulating different features.
示例性地，6段音频可包括第一段音频至第六段音频。其中，第一段音频可包括左通道为白噪声，右通道为空；第二段音频可包括左通道为空，右声道为白噪声；第三段音频可包括左通道为白噪声，右声道为1KHz(千赫兹)；第四段音频可包括左通道为1KHz，右通道为白噪声；第五段音频可包括左通道为白噪声，右通道为音乐；第六段音频可包括左通道为音乐，右通道为白噪声。Exemplarily, the six audio segments may include the first to sixth audio segments. The first audio segment may include white noise on the left channel and empty on the right channel; the second audio segment may include empty on the left channel and white noise on the right channel; the third audio segment may include white noise on the left channel and 1KHz (kilohertz) on the right channel; the fourth audio segment may include 1KHz on the left channel and white noise on the right channel; the fifth audio segment may include white noise on the left channel and music on the right channel; the sixth audio segment may include music on the left channel and white noise on the right channel.
示例性地，各段音频的时长可根据信号处理系统的处理精度确定。在一些示例中，各段音频的时长可均大于或等于10s(秒)。例如，各段音频的时长可均为30s。Exemplarily, the duration of each audio segment can be determined according to the processing accuracy of the signal processing system. In some examples, the duration of each audio segment can be greater than or equal to 10 seconds. For example, the duration of each audio segment can be 30 seconds.
示例性地，参考图2所示，可以通过语音数据采集模块14上设置的语音信号采集设备采集检测输入音频信号和混入检测音频信号中的测试音频信号，并将得到的检测MIC信号传递至参数确定模块15。Exemplarily, as shown in FIG. 2 , the voice signal acquisition device provided on the voice data acquisition module 14 may be used to acquire the detection input audio signal and the test audio signal mixed into the detection audio signal, and the obtained detection MIC signal may be transmitted to the parameter determination module 15 .
步骤3022，确定音频检测信号的前一帧音频信号对应的测试播放信号。Step 3022: Determine the test playback signal corresponding to the previous frame audio signal of the audio detection signal.
示例性地，测试播放信号可以是指音频处理系统对音频检测信号进行处理后所得到的需要扬声器播放的音频信号。在一些示例中，参考下图1或2所示，测试播放信号可以是在向音频处理系统10中的预处理单元111发送检测MIC信号时，功率放大器12输出至扬声器13的音频信号。Exemplarily, the test playback signal may refer to an audio signal that is obtained after the audio processing system processes the audio detection signal and needs to be played by the speaker. In some examples, referring to FIG. 1 or 2 below, the test playback signal may be an audio signal that the power amplifier 12 outputs to the speaker 13 when sending a detection MIC signal to the preprocessing unit 111 in the audio processing system 10.
示例性地，参考图2所示，由于音频处理单元112按照一帧音频信号(例如，16毫秒)进行处理，而功率放大器12向音频处理单元112传输目标参考信号的时长为微秒级别(例如，100微秒)，因此，在音频处理系统对当前帧音频检测信号进行处理时功率放大器12可输出音频检测信号的前一帧音频信号对应的测试播放信号。Exemplarily, as shown in reference Figure 2, since the audio processing unit 112 processes according to one frame of audio signal (for example, 16 milliseconds), and the duration of the target reference signal transmitted by the power amplifier 12 to the audio processing unit 112 is in the microsecond level (for example, 100 microseconds), therefore, when the audio processing system processes the current frame of audio detection signal, the power amplifier 12 can output a test playback signal corresponding to the previous frame of audio signal of the audio detection signal.
在一些示例中，可通过语音数据采集模块14采集功率放大器12输出的音频检测信号的前一帧音频信号对应的测试播放信号，并将音频检测信号的前一帧音频信号对应的测试播放信号传递给参数确定模块15。In some examples, the voice data acquisition module 14 may acquire a test playback signal corresponding to a previous frame of audio signal of the audio detection signal output by the power amplifier 12 , and transmit the test playback signal corresponding to the previous frame of audio signal of the audio detection signal to the parameter determination module 15 .
步骤3023，基于音频检测信号、测试播放信号和K歌音效模式对应的预设参数条件，确定K歌音效模式对应的调节参数组。Step 3023, based on the audio detection signal, the test playback signal and the preset parameter conditions corresponding to the karaoke sound effect mode, determine the adjustment parameter group corresponding to the karaoke sound effect mode.
示例性地，预设参数条件可以是根据经验所确定的与K歌音效模式对应的正常参数范围。不同的K歌音效模式所对应的预设参考条件可以相同也可以不相同。例如，标准模式对应的预设参考调节可以与流行模式对应的预设参考条件相同，但与环绕模式对应的预设参考条件不同，本公开实施例对此不作限定。Exemplarily, the preset parameter condition may be a normal parameter range corresponding to a karaoke sound effect mode determined based on experience. The preset reference conditions corresponding to different karaoke sound effect modes may be the same or different. For example, the preset reference adjustment corresponding to the standard mode may be the same as the preset reference condition corresponding to the popular mode, but different from the preset reference condition corresponding to the surround mode, which is not limited in the embodiments of the present disclosure.
示例性地，参考图2所示，参数确定模块15可通过检测应用软件确定K歌音效模式对应的调节参数组。在一些示例中，可以将音频检测信号和测试播放信号加载至包括K歌音效模式对应的预设参数条件的检测应用软件中，通过检测应用软件对预设参数条件、音频检测信号和测试播放信号进行特征分析处理，得到K歌音效模式对应的调节参数组。Exemplarily, referring to FIG2 , the parameter determination module 15 can determine the adjustment parameter group corresponding to the karaoke sound effect mode through the detection application software. In some examples, the audio detection signal and the test playback signal can be loaded into the detection application software including the preset parameter conditions corresponding to the karaoke sound effect mode, and the detection application software performs feature analysis processing on the preset parameter conditions, the audio detection signal and the test playback signal to obtain the adjustment parameter group corresponding to the karaoke sound effect mode.
本公开实施例中，在K歌音效模式对应的预设参数条件能够准确反映无麦K歌场景下K歌音效模式对应的正常参数范围时，基于音频检测信号、测试播放信号和K歌音效模式对应的预设参数条件所确定的K歌音效模式对应的调节参数组能够准确地体现无麦K歌场景与语音识别场景的不同。In the disclosed embodiment, when the preset parameter conditions corresponding to the karaoke sound effect mode can accurately reflect the normal parameter range corresponding to the karaoke sound effect mode in the microphone-free karaoke scenario, the adjustment parameter group corresponding to the karaoke sound effect mode determined based on the audio detection signal, the test playback signal and the preset parameter conditions corresponding to the karaoke sound effect mode can accurately reflect the difference between the microphone-free karaoke scenario and the voice recognition scenario.
如图5所示，在上述图4所示实施例的基础上，步骤3023可包括如下步骤501和步骤502。As shown in FIG. 5 , based on the embodiment shown in FIG. 4 , step 3023 may include the following steps 501 and 502 .
步骤501，基于音频检测信号和测试播放信号，确定测试参数。Step 501, determining test parameters based on the audio detection signal and the test playback signal.
示例性地，测试参数可以用于表示音频检测信号与测试播放信号的信号特征。在一些示例中，测试参数可包括底噪(例如，参考信号的底噪幅度)、音频检测信号与测试播放信号之间的幅度差和相位差以及抑制量等。Exemplarily, the test parameters can be used to represent the signal characteristics of the audio detection signal and the test playback signal. In some examples, the test parameters may include background noise (e.g., background noise amplitude of the reference signal), amplitude difference and phase difference between the audio detection signal and the test playback signal, and suppression amount, etc.
示例性地，参考图2所示，可以将音频检测信号和测试播放信号加载至参数确定模块15上的检测应用软件，通过包括K歌音效模式对应的预设参数条件的检测应用软件，对音频检测信号和测试播放信号进行分析，得到测试参数。Exemplarily, as shown in reference Figure 2, the audio detection signal and the test playback signal can be loaded into the detection application software on the parameter determination module 15. The audio detection signal and the test playback signal are analyzed by the detection application software including the preset parameter conditions corresponding to the karaoke sound effect mode to obtain the test parameters.
步骤502，基于测试参数和K歌音效模式对应的预设参数条件，确定K歌音效模式对应的调节参数组。Step 502, based on the test parameters and the preset parameter conditions corresponding to the karaoke sound effect mode, determine the adjustment parameter group corresponding to the karaoke sound effect mode.
示例性地，参考图2所示，参数确定模块15上的检测应用软件可以判断测试参数是否满足K歌音效模式对应的预设参数条件，根据判断结果确定K歌音效模式对应的调节参数组。Exemplarily, referring to FIG. 2 , the detection application software on the parameter determination module 15 can determine whether the test parameters meet the preset parameter conditions corresponding to the karaoke sound effect mode, and determine the adjustment parameter group corresponding to the karaoke sound effect mode according to the determination result.
本公开实施例中，在音频检测信号能够反映所有音频特征的情况下，基于音频检测信号和测试播放信号，能够确定多种类型的测试参数。进而，在预设参数条件能够准确反映无麦K歌场景下K歌音效模式对应的正常参数范围时，基于多种类型的测试参数和K歌音效模式对应的预设参数条件能够准确地确定K歌音效模式对应的调节参数组。In the embodiment of the present disclosure, when the audio detection signal can reflect all audio features, multiple types of test parameters can be determined based on the audio detection signal and the test playback signal. Furthermore, when the preset parameter conditions can accurately reflect the normal parameter range corresponding to the karaoke sound effect mode in the karaoke scene without a microphone, the adjustment parameter group corresponding to the karaoke sound effect mode can be accurately determined based on the multiple types of test parameters and the preset parameter conditions corresponding to the karaoke sound effect mode.
在本公开实施例中，可以响应于测试参数中的至少一个参数不满足K歌音效模式对应的预设参数条件，基于至少一个参数和预设参数条件，确定K歌音效模式对应的调节参数组。In an embodiment of the present disclosure, in response to at least one parameter among the test parameters not satisfying the preset parameter condition corresponding to the karaoke sound effect mode, an adjustment parameter group corresponding to the karaoke sound effect mode can be determined based on at least one parameter and the preset parameter condition.
示例性地，参考图2所示，参数确定模块15上的检测应用软件可以在判断测试参数中的至少一个参数不满足K歌音效模式对应的预设参数条件时，根据该至少一个参数和预设参数条件，确定K个音效模式对应的调节参数组。Exemplarily, as shown in reference Figure 2, when it is determined that at least one parameter in the test parameters does not meet the preset parameter conditions corresponding to the karaoke sound effect mode, the detection application software on the parameter determination module 15 can determine the adjustment parameter groups corresponding to K sound effect modes based on the at least one parameter and the preset parameter conditions.
在一些示例中，可以计算至少一个参数与预设参数条件对应的参数指标之间的差值，并基于该参数差值确定K个音效模式对应的调节参数组。In some examples, a difference between at least one parameter and a parameter index corresponding to a preset parameter condition may be calculated, and adjustment parameter groups corresponding to K sound effect modes may be determined based on the parameter difference.
本公开实施例中，在K歌音效模式对应的预设参数条件能够准确反映无麦K歌场景下K歌音效模式对应的正常参数范围时，基于至少一个参数和预设参数条件能够准确地确定K歌音效模式对应的调节参数组。In the disclosed embodiment, when the preset parameter conditions corresponding to the karaoke sound effect mode can accurately reflect the normal parameter range corresponding to the karaoke sound effect mode in the microphone-free karaoke scenario, the adjustment parameter group corresponding to the karaoke sound effect mode can be accurately determined based on at least one parameter and the preset parameter conditions.
在一些示例中，可以响应于至少一个参数中的测试播放信号和音频检测信号的幅值差不满足预设参数条件中的幅值条件，基于幅值差和幅值条件，确定第一调节参数中的第一增益参数和/或第二调节参数中的第二增益参数；响应于至少一个参数中的测试播放信号和音频检测信号的相位差不满足预设参数条件中的相位条件，基于相位差和相位条件，确定第一调节参数中的第一延迟参数和/或第二调节参数中的第二延迟参数。In some examples, in response to the amplitude difference between the test playback signal and the audio detection signal in at least one parameter not satisfying the amplitude condition in the preset parameter conditions, a first gain parameter in the first adjustment parameter and/or a second gain parameter in the second adjustment parameter can be determined based on the amplitude difference and the amplitude condition; in response to the phase difference between the test playback signal and the audio detection signal in at least one parameter not satisfying the phase condition in the preset parameter conditions, a first delay parameter in the first adjustment parameter and/or a second delay parameter in the second adjustment parameter can be determined based on the phase difference and the phase condition.
示例性地，幅值条件可以包括幅值差小于预设幅值。相位条件可以包括相位差小于预设时长。在一些示例中，预设幅值可以为小于或等于6dB的任一值。预设时长可以为小于或等于5ms。For example, the amplitude condition may include that the amplitude difference is less than a preset amplitude. The phase condition may include that the phase difference is less than a preset duration. In some examples, the preset amplitude may be any value less than or equal to 6 dB. The preset duration may be less than or equal to 5 ms.
示例性地，第一增益参数可以为第一调节参数中用于调节初始参考信号的幅值的参数，第一延迟参数可以为第一调节参数中用于调节初始参考信号的相位的参数。第二增益参数可以为第二调节参数中用于调节音频输入信号的幅值的参数，第二延迟参数可以为第二调节参数中用于调节音频输入信号的相位的参数。Exemplarily, the first gain parameter may be a parameter in the first adjustment parameter for adjusting the amplitude of the initial reference signal, and the first delay parameter may be a parameter in the first adjustment parameter for adjusting the phase of the initial reference signal. The second gain parameter may be a parameter in the second adjustment parameter for adjusting the amplitude of the audio input signal, and the second delay parameter may be a parameter in the second adjustment parameter for adjusting the phase of the audio input signal.
在一些示例中，第一增益参数对应的增益值与第二增益参数的增益值可以相同，但极性相反。第一延迟参数对应的时长与第二延迟参数的时长可以相同，但极性相反。例如，第一增益参数可以为5dB，第二增益参数可以为-5dB，第一延迟参数可以为11ms，第二延迟参数可以为-11ms。再例如，第一增益参数可以为-5dB，第二增益参数可以为5dB，第一延迟参数可以为-11ms，第二延迟参数可以为11ms。In some examples, the gain value corresponding to the first gain parameter may be the same as the gain value of the second gain parameter, but with opposite polarity. The duration corresponding to the first delay parameter may be the same as the duration of the second delay parameter, but with opposite polarity. For example, the first gain parameter may be 5dB, the second gain parameter may be -5dB, the first delay parameter may be 11ms, and the second delay parameter may be -11ms. For another example, the first gain parameter may be -5dB, the second gain parameter may be 5dB, the first delay parameter may be -11ms, and the second delay parameter may be 11ms.
示例性地，不同极性的增益值可表示不同的调节方向。在一些示例中，正的增益值可表示增加对应幅值，负的增益值可表示减小对应幅值。在另一些示例中，正的增益值可表示减小对应幅值，负的增益值可表示增加对应幅值，本公开实施例对增益值的极性所对应的调节方向不作限定。本公开实施例以正的增益值表示增加对应幅值，负的增益值表示减小对应幅值为例进行示例性说明。例如，-5dB可表示减小5dB的幅值，5dB表示增加5dB的幅值。Exemplarily, gain values of different polarities may represent different adjustment directions. In some examples, a positive gain value may represent an increase in the corresponding amplitude, and a negative gain value may represent a decrease in the corresponding amplitude. In other examples, a positive gain value may represent a decrease in the corresponding amplitude, and a negative gain value may represent an increase in the corresponding amplitude. The disclosed embodiment does not limit the adjustment direction corresponding to the polarity of the gain value. The disclosed embodiment takes the example that a positive gain value represents an increase in the corresponding amplitude, and a negative gain value represents a decrease in the corresponding amplitude as an example for illustrative explanation. For example, -5dB may represent a decrease in the amplitude of 5dB, and 5dB represents an increase in the amplitude of 5dB.
示例性地，不同极性的时长可表示不同的调节方向。在一些示例中，正的时长可表示延迟对应时长，负的时长可表示超前对应时长。在另一些示例中，正的时长可表示超前对应时长，负的时长可表示延迟对应时长，本公开实施例对时长的极性所对应的调节方向不作限定。本公开实施例以正的时长表示延迟对应时长，负的时长表示超前对应时长为例进行示例性说明。例如，-11ms可表示超前11ms，11dB表示延迟11ms。Exemplarily, durations of different polarities may represent different adjustment directions. In some examples, a positive duration may represent a delay corresponding duration, and a negative duration may represent an advance corresponding duration. In other examples, a positive duration may represent an advance corresponding duration, and a negative duration may represent a delay corresponding duration. The disclosed embodiment does not limit the adjustment direction corresponding to the polarity of the duration. The disclosed embodiment takes the example that a positive duration represents a delay corresponding duration, and a negative duration represents an advance corresponding duration as an example. For example, -11ms may represent an advance of 11ms, and 11dB represents a delay of 11ms.
示例性地，参考图2所示，参数确定模块15上的检测应用软件可以在确定测试播放信号和音频检测信号的幅值差大于预设幅值时，根据测试播放信号和音频检测信号的幅值差与预设幅值，确定第一调节参数中的第一增益参数和/或第二调节参数中的第二增益参数。参数确定模块15上的检测应用软件也可以在确定测试播放信号和音频检测信号的相位差大于预设时长时，根据测试播放信号和音频检测信号的相位差与预设时长，确定第二调节参数中的第二增益参数和/或第二调节参数中的第二增益参数。然后，参数确定模块15上的检测应用软件可以基于第一增益参数和第一相位参数，确定第一调节参数对应关系。基于第二增益参数和第二相位参数，确定第二调节参数对应关系。Exemplarily, as shown in reference figure 2, the detection application software on the parameter determination module 15 can determine the first gain parameter in the first adjustment parameter and/or the second gain parameter in the second adjustment parameter according to the amplitude difference between the test play signal and the audio detection signal and the preset amplitude when it is determined that the amplitude difference between the test play signal and the audio detection signal is greater than the preset amplitude. The detection application software on the parameter determination module 15 can also determine the second gain parameter in the second adjustment parameter and/or the second gain parameter in the second adjustment parameter according to the phase difference between the test play signal and the audio detection signal and the preset duration when it is determined that the phase difference between the test play signal and the audio detection signal is greater than the preset duration. Then, the detection application software on the parameter determination module 15 can determine the first adjustment parameter correspondence based on the first gain parameter and the first phase parameter. Based on the second gain parameter and the second phase parameter, determine the second adjustment parameter correspondence.
在一些示例中，在确定第一调节参数对应关系和第二调节参数对应关系之后，可以通过编译器分别将第一调节参数对应关系配置至功率放大器12中的Flash存储器，将第二调节参数对应关系配置至预处理单元111的DSP中的寄存器。In some examples, after determining the first adjustment parameter correspondence relationship and the second adjustment parameter correspondence relationship, the first adjustment parameter correspondence relationship can be configured to the Flash memory in the power amplifier 12 and the second adjustment parameter correspondence relationship can be configured to the register in the DSP of the preprocessing unit 111 through a compiler.
在一些示例中，参数确定模块15上的检测应用软件可以计算测试播放信号和音频检测信号的幅值差与预设幅值的幅值差，将得到的幅值差或大于该幅值差的幅值确定为第一调节参数中的第一增益参数和/或第二调节参数中的第二增益参数。例如，测试播放信号和音频检测信号的幅值差为9.5dB，预设幅值为6dB，则第一增益参数和/或第二增益参数为3.5dB，也可以为大于3.5dB的5dB。In some examples, the detection application software on the parameter determination module 15 can calculate the amplitude difference between the test playback signal and the audio detection signal and the amplitude difference of the preset amplitude, and determine the obtained amplitude difference or the amplitude greater than the amplitude difference as the first gain parameter in the first adjustment parameter and/or the second gain parameter in the second adjustment parameter. For example, if the amplitude difference between the test playback signal and the audio detection signal is 9.5 dB, and the preset amplitude is 6 dB, then the first gain parameter and/or the second gain parameter is 3.5 dB, or 5 dB greater than 3.5 dB.
在一些示例中，参数确定模块15上的检测应用软件可以计算测试播放信号和音频检测信号的相位差与预设时长的时间差，将得到的时间差/或大于该时间差的时长确定为第一调节参数中的第一相位参数和/或第二调节参数中的第二相位参数。例如，测试播放信号和音频检测信号的时间差为-9ms，预设时长为0ms，则第一相位参数和/或第二相位参数为9ms，也可以为大于9ms的11ms。In some examples, the detection application software on the parameter determination module 15 can calculate the time difference between the phase difference of the test playback signal and the audio detection signal and the preset duration, and determine the obtained time difference/or the duration greater than the time difference as the first phase parameter in the first adjustment parameter and/or the second phase parameter in the second adjustment parameter. For example, if the time difference between the test playback signal and the audio detection signal is -9ms, and the preset duration is 0ms, then the first phase parameter and/or the second phase parameter is 9ms, or can be 11ms which is greater than 9ms.
本公开实施例中，在幅值条件准确反映无麦K歌场景下K歌音效模式对应的正常幅值范围时，根据幅值条件所确定的第一增益参数和/或第二增益参数能够准确地体现无麦K歌场景与语音识别场景的不同。在相位条件能够反映无麦K歌场景下K歌音效模式对应的正常相位范围时，根据相位条件所确定的第一延迟参数和/或第二延迟参数也能够准确地体现无麦K歌场景与语音识别场景的不同。In the disclosed embodiment, when the amplitude condition accurately reflects the normal amplitude range corresponding to the karaoke sound effect mode in the karaoke scene without a microphone, the first gain parameter and/or the second gain parameter determined according to the amplitude condition can accurately reflect the difference between the karaoke scene without a microphone and the speech recognition scene. When the phase condition can reflect the normal phase range corresponding to the karaoke sound effect mode in the karaoke scene without a microphone, the first delay parameter and/or the second delay parameter determined according to the phase condition can also accurately reflect the difference between the karaoke scene without a microphone and the speech recognition scene.
在又一些示例中，可以响应于至少一个参数中的测试播放信号的底噪不满足预设参数条件中的底噪条件，基于测试播放信号的底噪和底噪条件，确定K歌音效模式的滤波器。In some other examples, in response to the background noise of the test playback signal in at least one parameter not satisfying the background noise condition in the preset parameter condition, a filter for the karaoke sound effect mode can be determined based on the background noise of the test playback signal and the background noise condition.
示例性地，底噪条件可为小于预设底噪值，预设底噪可根据音频的质量确定。在一些示例中，预设底噪值可以为小于或等于16dBm(分贝毫瓦)的任一值。Exemplarily, the background noise condition may be less than a preset background noise value, and the preset background noise may be determined according to the quality of the audio. In some examples, the preset background noise value may be any value less than or equal to 16 dBm (decibel milliwatt).
示例性地，参考图2所示，参数确定模块15上的检测应用软件可以在确定测试播放信号的底噪幅度不满足底噪条件时，根据测试播放信号的底噪与底噪条件对应的底噪值范围，确定对音频处理系统10中功率放大器12的电源上增加滤波电路或在功率放大器12中增加滤波软件。Exemplarily, as shown in reference Figure 2, when it is determined that the noise floor amplitude of the test playback signal does not meet the noise floor condition, the detection application software on the parameter determination module 15 can determine to add a filtering circuit to the power supply of the power amplifier 12 in the audio processing system 10 or to add filtering software in the power amplifier 12 based on the noise floor value range corresponding to the noise floor condition and the noise floor amplitude of the test playback signal.
在一些示例中，若测试播放信号的底噪幅度为23dBm，底噪条件为小于或等于16dBm，则可以将测试播放信号的底噪幅度与底噪条件的最大幅度之间的差值7dBm作为滤波器的设计需求。In some examples, if the noise floor amplitude of the test playback signal is 23dBm and the noise floor condition is less than or equal to 16dBm, the difference of 7dBm between the noise floor amplitude of the test playback signal and the maximum amplitude of the noise floor condition can be used as the design requirement of the filter.
本公开实施例中，通过在至少一个参数中的测试播放信号的底噪不满足预设参数条件中的底噪条件时，能够基于测试播放信号的底噪和底噪条件，较为准确地确定K歌音效模式的滤波器，从而使得音频处理系统的扬声器播放的K歌音频信号的底噪满足底噪要求。In the embodiment of the present disclosure, when the background noise of the test playback signal in at least one parameter does not meet the background noise condition in the preset parameter condition, the filter of the karaoke sound effect mode can be determined more accurately based on the background noise of the test playback signal and the background noise condition, so that the background noise of the karaoke audio signal played by the speaker of the audio processing system meets the background noise requirement.
如图6所示，在上述图3所示实施例的基础上，步骤303可包括如下步骤3031至步骤3033。As shown in FIG. 6 , based on the embodiment shown in FIG. 3 , step 303 may include the following steps 3031 to 3033 .
步骤3031，获取音频输入信号的前一帧音频信号对应的多路K歌音频信号。Step 3031, obtaining a multi-channel karaoke audio signal corresponding to a previous frame of audio signal of the audio input signal.
示例性地，多路K歌音频信号可以包括用于输入7路扬声器的7路差分音频信号。在一些示例中，该7路扬声器可包括前排左通道(Front Left，FL)、前排右通道(Front Right，FR)；后排左通道(Rear Left，RL)、后排右通道(Rear Right，RR)、中置通道(Center，CTR)、环绕通道(Surrounding，SRD)以及低音炮通道(Subwoofer，SUBW)。Exemplarily, the multi-channel karaoke audio signal may include 7-channel differential audio signals for inputting 7-channel speakers. In some examples, the 7-channel speakers may include a front left channel (Front Left, FL), a front right channel (Front Right, FR); a rear left channel (Rear Left, RL), a rear right channel (Rear Right, RR), a center channel (Center, CTR), a surround channel (Surrounding, SRD) and a subwoofer channel (Subwoofer, SUBW).
示例性地，参考图1或2所示，在音频处理系统对当前帧音频输入信号进行处理时，功率放大器12可生成音频输入信号的前一帧音频信号对应的多路K歌播放信号。Exemplarily, referring to FIG. 1 or 2 , when the audio processing system processes the current frame audio input signal, the power amplifier 12 may generate a multi-channel karaoke playback signal corresponding to the previous frame audio signal of the audio input signal.
步骤3032，确定多路K歌音频信号相互间的相关性，得到相关性结果。Step 3032, determine the correlation between multiple karaoke audio signals and obtain a correlation result.
示例性地，相关性结果可包括多路K歌音频信号中各路K歌音频信号之间相关或不相关。在一些示例中，相关性结果可包括多路K歌音频信号中至少两路K歌音频信号相关，除至少两路K歌音频信号之外的其他路K歌音频信号不相关。Exemplarily, the correlation result may include whether the karaoke audio signals in the multiple karaoke audio signals are correlated or uncorrelated. In some examples, the correlation result may include whether at least two karaoke audio signals in the multiple karaoke audio signals are correlated, and other karaoke audio signals except the at least two karaoke audio signals are uncorrelated.
示例性地，至少两路K歌音频信号相关是指至少两路K歌音频信号的特征差异较小或特征相同。至少两路K歌音频信号不相关是指至少两路K歌音频信号的特征差异较大。Exemplarily, at least two karaoke audio signals are related, which means that the features of at least two karaoke audio signals are slightly different or have the same features. At least two karaoke audio signals are unrelated, which means that the features of at least two karaoke audio signals are significantly different.
示例性地，可以对多路K歌音频信号进行相关性分析，将得到的分析结果确定为相关性结果。在一些示例中，可以通过相关性函数计算多路K歌音频信号中各路K歌音频信号之间的相关性，得到相关性结果。Exemplarily, correlation analysis can be performed on multiple karaoke audio signals, and the obtained analysis results can be determined as correlation results. In some examples, the correlation between the karaoke audio signals in the multiple karaoke audio signals can be calculated by a correlation function to obtain a correlation result.
在一些示例中，参考图1或2所示，可以通过功率放大器12中的DSP对多路K歌音频信号进行相关性分析，得到相关性结果。In some examples, referring to FIG. 1 or 2 , the DSP in the power amplifier 12 can perform correlation analysis on multiple karaoke audio signals to obtain correlation results.
步骤3033，基于相关性结果和多路K歌音频信号，确定初始参考信号。Step 3033: Determine an initial reference signal based on the correlation result and the multi-channel karaoke audio signals.
示例性地，参考图1或2所示，功率放大器12可以根据相关性结果和预设的选择规则从多路K歌音频信号中选择互不相关的至少一路K歌音频信号，并将互不相关的至少一路K歌音频信号作为初始参考信号。在一些示例中，预设的选择规则可包括信号完整性和最少信号传输通道数量。Exemplarily, referring to FIG. 1 or 2, the power amplifier 12 can select at least one unrelated karaoke audio signal from multiple karaoke audio signals according to the correlation result and the preset selection rule, and use the at least one unrelated karaoke audio signal as the initial reference signal. In some examples, the preset selection rule may include signal integrity and the minimum number of signal transmission channels.
本公开实施例中，在基于相关性结果和多路K歌音频信号，确定初始参考信号时，若初始参考信号仅包括不相关的K歌音频信号，则初始参考信号在包括完整的音频信号信息的情况下，可以包括最小路数的K歌音频信号。从而，在后级传输初始参考信号对应的目标参考信号时，能够减小传输的通道数量，降低对中央处理器(Central Processing Unit，CPU)资源的消耗。In the disclosed embodiment, when determining the initial reference signal based on the correlation result and multiple karaoke audio signals, if the initial reference signal only includes unrelated karaoke audio signals, the initial reference signal can include the minimum number of karaoke audio signals while including complete audio signal information. Thus, when the target reference signal corresponding to the initial reference signal is transmitted in the later stage, the number of transmission channels can be reduced, and the consumption of central processing unit (CPU) resources can be reduced.
如图7所示，在上述图6所示实施例的基础上，步骤3033可包括如下步骤701至步骤703。As shown in FIG. 7 , based on the embodiment shown in FIG. 6 , step 3033 may include the following steps 701 to 703 .
步骤701，响应于相关性结果为多路K歌音频信号间互不相关，从多路K歌音频信号中确定初始参考信号。Step 701: in response to the correlation result indicating that the multiple karaoke audio signals are not correlated with each other, an initial reference signal is determined from the multiple karaoke audio signals.
示例性地，参考图1或2所示，功率放大器12可以在多路K歌音频信号间互不相关的情况下，将多路K歌音频信号确定为初始参考信号。Exemplarily, referring to FIG. 1 or 2 , the power amplifier 12 may determine the multiple karaoke audio signals as the initial reference signals when the multiple karaoke audio signals are not correlated with each other.
步骤702，响应于相关性结果为多路K歌音频信号中的至少两路K歌音频信号间相关，从至少两路K歌音频信号中确定第一路K歌音频信号，以及从多路K歌音频信号中确定第二路K歌音频信号。Step 702, in response to the correlation result being that at least two of the multiple karaoke audio signals are correlated, determine a first karaoke audio signal from the at least two karaoke audio signals, and determine a second karaoke audio signal from the multiple karaoke audio signals.
示例性地，第一路K歌音频信号可以包括一路K歌音频信号，也可以包括两路或两路以上K歌音频信号，本公开实施例对此不作限定。Exemplarily, the first karaoke audio signal may include one karaoke audio signal, or may include two or more karaoke audio signals, which is not limited in the embodiments of the present disclosure.
在一些示例中，若至少两路K歌音频信号仅包括一组相关的K歌音频信号，则第一路K歌音频信号包括一路K歌音频信号，且该路K歌音频信号为该组相关的K歌音频信号中的任意一路；若至少两路K歌音频信号包括至少两组相关的K歌音频信号，则第一路K歌音频信号包括至少两路K歌音频信号，该至少两路K歌音频信号互不相关，且包括各组相关的K歌音频信号中的任意一路。In some examples, if at least two karaoke audio signals include only one group of related karaoke audio signals, the first karaoke audio signal includes one karaoke audio signal, and the karaoke audio signal is any one of the group of related karaoke audio signals; if at least two karaoke audio signals include at least two groups of related karaoke audio signals, the first karaoke audio signal includes at least two karaoke audio signals, the at least two karaoke audio signals are unrelated to each other, and include any one of the groups of related karaoke audio signals.
示例性地，可以将多路K歌音频信号中除至少两路K歌音频信号之外的剩余路K歌音频信号确定为第二路K歌音频信号。第二路K歌音频信号可以包括至少一路K歌音频信号，需要根据多路K歌音频信号与至少两路K歌音频信号的路数确定。例如，若多路K歌音频信号包括7路，至少两路K歌音频信号包括3路，则第二路K歌音频信号包括4路，本公开实施例对此不作限定。Exemplarily, the remaining karaoke audio signals except at least two karaoke audio signals in the multi-channel karaoke audio signals can be determined as the second karaoke audio signal. The second karaoke audio signal may include at least one karaoke audio signal, which needs to be determined according to the number of channels of the multi-channel karaoke audio signals and the at least two karaoke audio signals. For example, if the multi-channel karaoke audio signals include 7 channels and the at least two karaoke audio signals include 3 channels, then the second karaoke audio signal includes 4 channels, which is not limited in the embodiments of the present disclosure.
示例性地，以至少两路K歌音频信号仅包括一组相关的K歌音频信号为例，参考图1或2所示，功率放大器12可以在多路K歌音频信号中的至少两路K歌音频信号间相关的情况下，将至少两路K歌音频信号中的任一路K歌音频信号确定为第一路K歌音频信号，将多路K歌音频信号中除至少两路K歌音频信号之外的剩余路K歌音频信号，确定为第二路K歌音频信号。Exemplarily, taking the example that at least two karaoke audio signals only include a group of related karaoke audio signals, referring to Figure 1 or 2, the power amplifier 12 can, when at least two karaoke audio signals in the multiple karaoke audio signals are correlated, determine any one karaoke audio signal in the at least two karaoke audio signals as the first karaoke audio signal, and determine the remaining karaoke audio signals in the multiple karaoke audio signals except the at least two karaoke audio signals as the second karaoke audio signal.
步骤703，基于第一路K歌音频信号和第二路K歌音频信号，确定初始参考信号。Step 703: Determine an initial reference signal based on the first karaoke audio signal and the second karaoke audio signal.
示例性地，参考图2所示，功率放大器12可以将第一路K歌音频信号和第二路K歌音频信号共同作为初始参考信号。Exemplarily, referring to FIG. 2 , the power amplifier 12 may use the first karaoke audio signal and the second karaoke audio signal as initial reference signals.
本公开实施例中，通过在多路K歌音频信号间互不相关时，从多路K歌音频信号中确定初始参考信号，在多路K歌音频信号中的至少两路K歌音频信号间相关时，从至少两路K歌音频信号中确定第一路K歌音频信号，以及从多路K歌音频信号中确定第二路K歌音频信号，并基于第一路K歌音频信号和第二路K歌音频信号，确定初始参考信号。如此，可以保证初始参考信号中各各路K歌音频信号不相关。In the disclosed embodiment, when the multiple karaoke audio signals are uncorrelated, an initial reference signal is determined from the multiple karaoke audio signals, when at least two karaoke audio signals in the multiple karaoke audio signals are correlated, a first karaoke audio signal is determined from the at least two karaoke audio signals, and a second karaoke audio signal is determined from the multiple karaoke audio signals, and the initial reference signal is determined based on the first karaoke audio signal and the second karaoke audio signal. In this way, it can be ensured that the karaoke audio signals in the initial reference signal are uncorrelated.
如图8所示，在上述图3所示实施例的基础上，步骤304可包括如下步骤3041和步骤3042。As shown in FIG. 8 , based on the embodiment shown in FIG. 3 , step 304 may include the following steps 3041 and 3042 .
步骤3041，基于第一调节参数中的第一增益参数调节初始参考信号的幅值，得到幅值调节信号。Step 3041: adjust the amplitude of the initial reference signal based on the first gain parameter in the first adjustment parameter to obtain an amplitude adjustment signal.
示例性地，参考图2所示，功率放大器12中的DSP可在读取第一增益参数和初始参考信号后，对初始参考信号中的各信号的幅值进行调节，并将幅值调节后的初始参考信号确定为幅值调节信号。Exemplarily, referring to FIG2 , the DSP in the power amplifier 12 may adjust the amplitude of each signal in the initial reference signal after reading the first gain parameter and the initial reference signal, and determine the amplitude-adjusted initial reference signal as the amplitude-adjusted signal.
在一些示例中，可以对初始参考信号中的各信号的幅值进行相同的调节。例如，第一增益参数为-5dB，则可对初始参考信号中的各信号的幅值均减小5dB。In some examples, the amplitude of each signal in the initial reference signal may be adjusted in the same manner. For example, if the first gain parameter is -5 dB, the amplitude of each signal in the initial reference signal may be reduced by 5 dB.
步骤3042，基于第一调节参数中的第一延迟参数调节幅值调节信号的相位，得到目标参考信号。Step 3042: Adjust the phase of the amplitude adjustment signal based on the first delay parameter in the first adjustment parameter to obtain a target reference signal.
示例性地，参考图2所示，功率放大器12中的DSP可在读取第一延迟参数，并得到幅值调节信号后，对幅值调节信号中的各信号的相位进行调节，并将相位调节后的幅值调节信号确定为目标参考信号传递至音频处理单元112。Exemplarily, as shown in reference Figure 2, the DSP in the power amplifier 12 can adjust the phase of each signal in the amplitude adjustment signal after reading the first delay parameter and obtaining the amplitude adjustment signal, and determine the amplitude adjustment signal after phase adjustment as the target reference signal to be transmitted to the audio processing unit 112.
在一些示例中，可以对幅值调节信号中的各信号的相位进行相同的调节。例如，第一延迟参数为11ms，则可对幅值调节信号中的各信号的相位均延迟11ms。In some examples, the phase of each signal in the amplitude adjustment signal may be adjusted in the same manner. For example, if the first delay parameter is 11 ms, the phase of each signal in the amplitude adjustment signal may be delayed by 11 ms.
在本公开的另一些实施例中，可先基于第一调节参数中的第一延迟参数调节初始参考信号的相位，得到相位调节信号，然后基于第一调节参数中的第一幅值参数调节相位调节信号的幅值，得到目标参考信号。本公开实施例幅值调节和相位调节的先后顺序不作限定。In some other embodiments of the present disclosure, the phase of the initial reference signal may be adjusted based on the first delay parameter in the first adjustment parameter to obtain a phase adjustment signal, and then the amplitude of the phase adjustment signal may be adjusted based on the first amplitude parameter in the first adjustment parameter to obtain a target reference signal. The order of amplitude adjustment and phase adjustment in the embodiments of the present disclosure is not limited.
本公开实施例中，在第一增益参数和第二增益参数均能够准确体现无麦K歌场景与语音识别场景的不同时，通过基于第一增益参数调节初始参考信号的幅值，能够得到适用于无麦K歌场景的幅值调节信号，基于第一延迟参数调节幅值调节信号的相位，能够得到适用于无麦K歌场景的目标参考信号。In the disclosed embodiment, when the first gain parameter and the second gain parameter can both accurately reflect the difference between the karaoke scene without a microphone and the speech recognition scene, an amplitude adjustment signal suitable for the karaoke scene without a microphone can be obtained by adjusting the amplitude of the initial reference signal based on the first gain parameter, and a target reference signal suitable for the karaoke scene without a microphone can be obtained by adjusting the phase of the amplitude adjustment signal based on the first delay parameter.
如图9所示，在上述图3所示实施例的基础上，步骤305可包括如下步骤3051和步骤3052。As shown in FIG. 9 , based on the embodiment shown in FIG. 3 , step 305 may include the following steps 3051 and 3052 .
步骤3051，基于第二调节参数，对音频输入信号进行特征处理，得到特征处理后的音频输入信号。Step 3051: Based on the second adjustment parameter, feature processing is performed on the audio input signal to obtain the audio input signal after feature processing.
示例性地，第二调节参数可以包括用于调节音频输入信号特征的多个参数。在一些示例中，第二调节参数可以包括用于调节音频输入信号的幅值的增益参数和用于调节音频输入信号的相位的延迟参数。Exemplarily, the second adjustment parameter may include a plurality of parameters for adjusting the characteristics of the audio input signal. In some examples, the second adjustment parameter may include a gain parameter for adjusting the amplitude of the audio input signal and a delay parameter for adjusting the phase of the audio input signal.
示例性地，参考图2所示，预处理单元111可以根据K歌音效模式信号查询第二调节参数对应关系，确定K歌音效模式对应的第二调节参数，并基于第二调节参数调节音频输入信号的幅值和相位，并将幅值和相位调节后的音频输入信号输出至音频处理单元112。Exemplarily, as shown in reference Figure 2, the preprocessing unit 111 can query the corresponding relationship of the second adjustment parameter according to the karaoke sound effect mode signal, determine the second adjustment parameter corresponding to the karaoke sound effect mode, and adjust the amplitude and phase of the audio input signal based on the second adjustment parameter, and output the audio input signal after amplitude and phase adjustment to the audio processing unit 112.
在一些示例中，预处理单元111中可包括DSP，且DSP中的寄存器中可存储有预先配置的第二调节参数对应关系。DSP可在接收并响应于该K歌音效模式信号，从对应的寄存器中查询第二调节参数对应关系，获取K歌音效模式信号对应的第二调节参数。预处理单元111可基于第二调节参数对音频输入信号进行幅值和相位调节，将得到的幅值和相位调节后的音频输入信号输出至音频处理单元112。In some examples, the preprocessing unit 111 may include a DSP, and a register in the DSP may store a preconfigured second adjustment parameter correspondence relationship. The DSP may query the second adjustment parameter correspondence relationship from the corresponding register when receiving and responding to the karaoke sound effect mode signal, and obtain the second adjustment parameter corresponding to the karaoke sound effect mode signal. The preprocessing unit 111 may adjust the amplitude and phase of the audio input signal based on the second adjustment parameter, and output the obtained audio input signal after amplitude and phase adjustment to the audio processing unit 112.
示例性地，第二调节参数对应关系可包括各K歌音效模式对应的第二调节参数。在一些示例中，由于各调节参数组中均可包括第二调节参数，因此，第二调节参数对应关系可为上述表1。在另一些示例中，第二调节参数对应关系可为对上述表1进行分解后所得到的表3，本公开实施例对此不作限定。Exemplarily, the second adjustment parameter correspondence may include the second adjustment parameters corresponding to each karaoke sound effect mode. In some examples, since each adjustment parameter group may include the second adjustment parameter, the second adjustment parameter correspondence may be the above-mentioned Table 1. In other examples, the second adjustment parameter correspondence may be Table 3 obtained by decomposing the above-mentioned Table 1, which is not limited in the embodiments of the present disclosure.
表3Table 3
其中，不同音效模式对应的增益参数和延迟参数可以部分相同，也可以完全不同，本公开实施例对此不作限定。Among them, the gain parameters and delay parameters corresponding to different sound effect modes may be partially the same or completely different, and the embodiments of the present disclosure are not limited to this.
步骤3052，根据目标参考信号对特征处理后的音频输入信号进行调节，得到K歌音频信号。Step 3052: adjust the feature-processed audio input signal according to the target reference signal to obtain a karaoke audio signal.
示例性地，参考图2所示，音频处理单元112可以接收目标参考信号，基于目标参考信号对幅值和相位调节后的音频输入信号进行降噪处理、回声消除处理和防啸叫处理，得到处理后的音频输入信号，并将处理后的音频输入信号输出至功率放大器12。功率放大器12对处理后的音频输入信号进行K歌音效模式对应的滤波和功率放大，得到K歌音效模式对应的K歌音频信号，并将K歌音效模式对应的K歌音频信号输出至扬声器13。Exemplarily, as shown in reference to FIG2 , the audio processing unit 112 may receive a target reference signal, perform noise reduction processing, echo cancellation processing, and anti-howling processing on the audio input signal after amplitude and phase adjustment based on the target reference signal, obtain a processed audio input signal, and output the processed audio input signal to the power amplifier 12. The power amplifier 12 performs filtering and power amplification corresponding to the karaoke sound effect mode on the processed audio input signal, obtains a karaoke audio signal corresponding to the karaoke sound effect mode, and outputs the karaoke audio signal corresponding to the karaoke sound effect mode to the speaker 13.
本公开实施例中，在第二调节参数能够准确地体现无麦K歌场景与语音识别场景对音频幅值和音频相位不同时，基于第二调节信号对音频输入信号进行特征处理，能够得到适用于无麦K歌场景的特征处理后的音频输入信号。进而，在目标参考信号也适用于无麦K歌场景时，根据目标参考信号对特征处理后的音频输入信号进行调节，能够将K歌音频信号中的干扰音频信号滤除，避免K歌过程中的啸叫现象，提高用户的K歌体验。In the disclosed embodiment, when the second adjustment parameter can accurately reflect the difference in audio amplitude and audio phase between the no-microphone karaoke scene and the speech recognition scene, feature processing is performed on the audio input signal based on the second adjustment signal to obtain a feature-processed audio input signal suitable for the no-microphone karaoke scene. Furthermore, when the target reference signal is also suitable for the no-microphone karaoke scene, the feature-processed audio input signal is adjusted according to the target reference signal, and the interference audio signal in the karaoke audio signal can be filtered out, avoiding the howling phenomenon during the karaoke process, and improving the user's karaoke experience.
在上述实施例的基础上，本公开实施例提供了一种音频处理系统。图10是本公开一示例性实施例提供的一种音频处理系统的结构示意图。如图10所示，该音频处理系统100包括音频处理器1001、与音频处理器1001耦接的功率放大器1002以及与功率放大器1002耦接的扬声器1003。Based on the above embodiments, an embodiment of the present disclosure provides an audio processing system. FIG10 is a schematic diagram of the structure of an audio processing system provided by an exemplary embodiment of the present disclosure. As shown in FIG10 , the audio processing system 100 includes an audio processor 1001, a power amplifier 1002 coupled to the audio processor 1001, and a speaker 1003 coupled to the power amplifier 1002.
音频处理器1001，用于确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号；向功率放大器1002传输K歌音效模式；The audio processor 1001 is used to determine the karaoke sound effect mode and the audio input signal input by the user into the audio processing system in the karaoke sound effect mode; and transmit the karaoke sound effect mode to the power amplifier 1002;
功率放大器1002，用于确定K歌音效模式对应的第一调节参数；确定音频输入信号对应的初始参考信号，基于第一调节参数，对初始参考信号进行特征处理，得到目标参考信号，并将目标参考信号输出至音频处理器1001；The power amplifier 1002 is used to determine a first adjustment parameter corresponding to the karaoke sound effect mode; determine an initial reference signal corresponding to the audio input signal, perform feature processing on the initial reference signal based on the first adjustment parameter to obtain a target reference signal, and output the target reference signal to the audio processor 1001;
音频处理器1001，用于确定K歌音效模式对应的第二调节参数，基于第二调节参数、目标参考信号和音频输入信号，生成音频处理信号，并将音频处理信号输出至功率放大器1002；The audio processor 1001 is used to determine a second adjustment parameter corresponding to the karaoke sound effect mode, generate an audio processing signal based on the second adjustment parameter, the target reference signal and the audio input signal, and output the audio processing signal to the power amplifier 1002;
功率放大器1002，用于对音频处理信号进行功率放大，生成需要音频处理系统的扬声器播放的K歌音频信号，并将K歌音频信号输出至扬声器1003；The power amplifier 1002 is used to amplify the power of the audio processing signal, generate a karaoke audio signal that needs to be played by the speaker of the audio processing system, and output the karaoke audio signal to the speaker 1003;
扬声器1003，用于播放K歌音频信号。The loudspeaker 1003 is used to play karaoke audio signals.
如图11所示，在上述图10所示实施例的基础上，音频处理系统100还包括检测板1004和与检测板1004耦接的参数检测处理器1005。As shown in FIG. 11 , based on the embodiment shown in FIG. 10 , the audio processing system 100 further includes a detection board 1004 and a parameter detection processor 1005 coupled to the detection board 1004 .
功率放大器1002，用于确定音频检测信号的前一帧音频信号对应的测试播放信号，并向检测板1004传输测试播放信号；The power amplifier 1002 is used to determine the test play signal corresponding to the previous frame audio signal of the audio detection signal, and transmit the test play signal to the detection board 1004;
检测板1004，用于检测K歌音效模式下输入音频处理系统的音频检测信号，并将音频检测信号和测试播放信号发送至参数检测处理器1005；The detection board 1004 is used to detect the audio detection signal input into the audio processing system in the karaoke sound effect mode, and send the audio detection signal and the test playback signal to the parameter detection processor 1005;
参数检测处理器1005，用于基于音频检测信号、测试播放信号和K歌音效模式对应的预设参数条件，确定K歌音效模式对应的调节参数组。The parameter detection processor 1005 is used to determine the adjustment parameter group corresponding to the karaoke sound effect mode based on the audio detection signal, the test playback signal and the preset parameter conditions corresponding to the karaoke sound effect mode.
示例性装置Exemplary Devices
图12是本公开一示例性实施例提供的一种基于无麦K歌的音频信号处理装置的结构示意图。如图12所示，该基于无麦K歌的音频信号处理装置120可包括第一确定模块1201、第二确定模块1202、第三确定模块1203、第一处理模块1204以及生成模块1205。FIG12 is a schematic diagram of the structure of an audio signal processing device based on microphone-free karaoke provided by an exemplary embodiment of the present disclosure. As shown in FIG12 , the audio signal processing device 120 based on microphone-free karaoke may include a first determination module 1201, a second determination module 1202, a third determination module 1203, a first processing module 1204, and a generation module 1205.
第一确定模块1201，用于确定K歌音效模式，以及用户在K歌音效模式下输入音频处理系统的音频输入信号；The first determination module 1201 is used to determine a karaoke sound effect mode and an audio input signal input by a user into the audio processing system in the karaoke sound effect mode;
第二确定模块1202，用于确定K歌音效模式对应的调节参数组；The second determination module 1202 is used to determine the adjustment parameter group corresponding to the karaoke sound effect mode;
第三确定模块1203，用于确定音频输入信号对应的初始参考信号；A third determination module 1203, configured to determine an initial reference signal corresponding to the audio input signal;
第一处理模块1204，用于基于调节参数组中的第一调节参数，对初始参考信号进行特征处理，得到目标参考信号；A first processing module 1204 is used to perform feature processing on the initial reference signal based on the first adjustment parameter in the adjustment parameter group to obtain a target reference signal;
生成模块1205，用于基于调节参数组中的第二调节参数、目标参考信号和音频输入信号，生成需要音频处理系统的扬声器播放的K歌音频信号。The generating module 1205 is used to generate a karaoke audio signal to be played by a speaker of the audio processing system based on the second adjustment parameter in the adjustment parameter group, the target reference signal and the audio input signal.
在一些实施例中，如图13所示，在上述图12所示实施例的基础上，第一处理模块1204可包括第一调节单元1301和第二调节单元1302。In some embodiments, as shown in FIG. 13 , based on the embodiment shown in FIG. 12 , the first processing module 1204 may include a first adjustment unit 1301 and a second adjustment unit 1302 .
第一调节单元1301，用于基于第一调节参数中的第一增益参数调节初始参考信号的幅值，得到幅值调节信号；The first adjustment unit 1301 is used to adjust the amplitude of the initial reference signal based on the first gain parameter in the first adjustment parameter to obtain an amplitude adjustment signal;
第二调节单元1302，用于基于第一调节参数中的第一延迟参数调节幅值调节信号的相位，得到目标参考信号。The second adjustment unit 1302 is configured to adjust the phase of the amplitude adjustment signal based on the first delay parameter in the first adjustment parameter to obtain a target reference signal.
在一些实施例中，如图14所示，在上述图12所示实施例的基础上，生成模块1205可包括第一处理单元1401和第三调节单元1402。In some embodiments, as shown in FIG. 14 , based on the embodiment shown in FIG. 12 , the generating module 1205 may include a first processing unit 1401 and a third adjusting unit 1402 .
第一处理单元1401，用于基于第二调节参数，对音频输入信号进行特征处理，得到特征处理后的音频输入信号。The first processing unit 1401 is configured to perform feature processing on the audio input signal based on the second adjustment parameter to obtain the audio input signal after feature processing.
第三调节单元1402，用于根据目标参考信号对特征处理后的音频输入信号进行调节，得到K歌音频信号。The third adjustment unit 1402 is used to adjust the feature-processed audio input signal according to the target reference signal to obtain a karaoke audio signal.
在一些实施例中，如图15所示，在上述图12所示实施例的基础上，第三确定模块1203可包括获取单元1501、第一确定单元1502和第二确定单元1503。In some embodiments, as shown in FIG. 15 , based on the embodiment shown in FIG. 12 , the third determination module 1203 may include an acquisition unit 1501 , a first determination unit 1502 and a second determination unit 1503 .
获取单元1501，用于获取音频输入信号的前一帧音频信号对应的多路K歌音频信号。The acquisition unit 1501 is used to acquire multiple karaoke audio signals corresponding to the previous frame of audio signal of the audio input signal.
第一确定单元1502，用于确定多路K歌音频信号相互间的相关性，得到相关性结果。The first determining unit 1502 is used to determine the correlation between multiple karaoke audio signals and obtain a correlation result.
第二确定单元1503，用于基于相关性结果和多路K歌音频信号，确定初始参考信号。The second determination unit 1503 is used to determine an initial reference signal based on the correlation result and the multiple karaoke audio signals.
在一些实施例中，如图16所示，在上述图15实施例的基础上，第二确定单元1503可包括第一确定子单元1601、第二确定子单元1602和第三确定子单元1603。In some embodiments, as shown in FIG. 16 , based on the embodiment of FIG. 15 , the second determining unit 1503 may include a first determining subunit 1601 , a second determining subunit 1602 and a third determining subunit 1603 .
第一确定子单元1601，用于响应于相关性结果为多路K歌音频信号间互不相关，从多路K歌音频信号中确定初始参考信号。The first determining subunit 1601 is configured to determine an initial reference signal from the multiple karaoke audio signals in response to the correlation result indicating that the multiple karaoke audio signals are not correlated with each other.
第二确定子单元1602，响应于相关性结果为多路K歌音频信号中的至少两路K歌音频信号间相关，从至少两路K歌音频信号中确定第一路K歌音频信号，以及从多路K歌音频信号中确定第二路K歌音频信号。The second determination subunit 1602, in response to the correlation result being that at least two of the multiple karaoke audio signals are correlated, determines a first karaoke audio signal from the at least two karaoke audio signals, and determines a second karaoke audio signal from the multiple karaoke audio signals.
第三确定子单元1603，基于第一路K歌音频信号和第二路K歌音频信号，确定初始参考信号。The third determining subunit 1603 determines an initial reference signal based on the first karaoke audio signal and the second karaoke audio signal.
在一些实施例中，如图17所示，在上述图12所示的实施例的基础上，第二确定模块1202可包括第三确定单元1701、第四确定单元1702和第五确定单元1703。In some embodiments, as shown in FIG. 17 , based on the embodiment shown in FIG. 12 , the second determination module 1202 may include a third determination unit 1701 , a fourth determination unit 1702 and a fifth determination unit 1703 .
第三确定单元1701，用于确定在K歌音效模式下输入音频处理系统的音频检测信号。The third determining unit 1701 is used to determine the audio detection signal input into the audio processing system in the karaoke sound effect mode.
第四确定单元1702，用于确定音频检测信号的前一帧音频信号对应的测试播放信号。The fourth determining unit 1702 is configured to determine a test playback signal corresponding to an audio frame of a previous audio detection signal.
第五确定单元1703，用于基于音频检测信号、测试播放信号和K歌音效模式对应的预设参数条件，确定K歌音效模式对应的调节参数组。The fifth determination unit 1703 is used to determine the adjustment parameter group corresponding to the karaoke sound effect mode based on the audio detection signal, the test playback signal and the preset parameter conditions corresponding to the karaoke sound effect mode.
在一些实施例中，如图18所示，在上述图17所示的实施例的基础上，第五确定单元1703包括第四确定子单元1801和第五确定子单元1802。In some embodiments, as shown in FIG. 18 , based on the embodiment shown in FIG. 17 , the fifth determining unit 1703 includes a fourth determining subunit 1801 and a fifth determining subunit 1802 .
第四确定子单元1801，基于音频检测信号和测试播放信号，确定测试参数。The fourth determining subunit 1801 determines a test parameter based on the audio detection signal and the test playback signal.
第五确定子单元1802，基于测试参数和K歌音效模式对应的预设参数条件，确定K歌音效模式对应的调节参数组。The fifth determining subunit 1802 determines the adjustment parameter group corresponding to the karaoke sound effect mode based on the test parameters and the preset parameter conditions corresponding to the karaoke sound effect mode.
在一些实施例中，第五确定子单元1802，具体用于响应于测试参数中的至少一个参数不满足K歌音效模式对应的预设参数条件，基于至少一个参数和预设参数条件，确定K歌音效模式对应的调节参数组。In some embodiments, the fifth determination subunit 1802 is specifically used to determine the adjustment parameter group corresponding to the karaoke sound effect mode based on at least one parameter and the preset parameter condition in response to at least one parameter in the test parameters not satisfying the preset parameter condition corresponding to the karaoke sound effect mode.
在一些实施例中，第五确定子单元1802，具体用于响应于所述至少一个参数中的测试播放信号和音频检测信号的幅值差不满足所述预设参数条件中的幅值条件，基于所述幅值差和所述幅值条件，确定所述第一调节参数中的第一增益参数和/或所述第二调节参数中的第二增益参数；响应于所述至少一个参数中的测试播放信号和音频检测信号的相位差不满足所述预设参数条件中的相位条件，基于所述相位差和所述相位条件，确定所述第一调节参数中的第一延迟参数和/或所述第二调节参数中的第二延迟参数。In some embodiments, the fifth determination subunit 1802 is specifically used to determine, in response to the amplitude difference between the test playback signal and the audio detection signal in the at least one parameter not satisfying the amplitude condition in the preset parameter condition, a first gain parameter in the first adjustment parameter and/or a second gain parameter in the second adjustment parameter based on the amplitude difference and the amplitude condition; in response to the phase difference between the test playback signal and the audio detection signal in the at least one parameter not satisfying the phase condition in the preset parameter condition, a first delay parameter in the first adjustment parameter and/or a second delay parameter in the second adjustment parameter based on the phase difference and the phase condition.
在一些实施例中，第五确定子单元1802，具体用于响应于至少一个参数中的测试播放信号的底噪不满足预设参数条件中的底噪条件，基于测试播放信号的底噪和底噪条件，确定K歌音效模式的滤波器。In some embodiments, the fifth determination subunit 1802 is specifically used to determine the filter of the karaoke sound effect mode based on the background noise of the test playback signal and the background noise condition in response to the background noise of the test playback signal in at least one parameter not satisfying the background noise condition in the preset parameter condition.
关于上述实施例中的一种基于无麦K歌的音频信号处理装置，其中各个模块执行操作的具体方式及相应的有益效果已经在前述中基于无麦K歌的音频信号处理方法部分的相应实施例部分已经进行详细描述，可以参见上述示例性方法部分的相应执行操作方式和有益技术效果，在此不再赘述。Regarding an audio signal processing device based on microphone-free karaoke in the above-mentioned embodiment, the specific manner in which each module performs operations and the corresponding beneficial effects have been described in detail in the corresponding embodiment part of the audio signal processing method based on microphone-free karaoke in the aforementioned embodiment. Please refer to the corresponding execution operation manner and beneficial technical effects of the above-mentioned exemplary method part, which will not be repeated here.
示例性电子设备Exemplary Electronic Devices
图19是本公开一示例性实施例提供的一种电子设备的结构示意图，如图19所示，该电子设备190包括一个或多个处理器1901和存储器1902。FIG. 19 is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present disclosure. As shown in FIG. 19 , the electronic device 190 includes one or more processors 1901 and a memory 1902 .
处理器1901可以是中央处理单元(CPU)或者具有数据处理能力和/或指令执行能力的其他形式的处理单元，并且可以控制电子设备190中的其他组件以执行期望的功能。The processor 1901 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 190 to perform desired functions.
存储器1902可以包括一个或多个计算机程序产品，计算机程序产品可以包括各种形式的计算机可读存储介质，例如易失性存储器和/或非易失性存储器。易失性存储器例如可以包括随机存取存储器(Random Access Memory，RAM)和/或高速缓冲存储器(cache)等。非易失性存储器例如可以包括只读存储器(Read-Only Memory，ROM)、硬盘、闪存等。在计算机可读存储介质上可以存储一个或多个计算机程序指令，处理器1901可以运行程序指令，以实现上文的本公开的各个实施例的基于无麦K歌的音频信号处理方法以及/或者其他期望的功能。The memory 1902 may include one or more computer program products, and the computer program product may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and/or cache memory, etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 1901 may run the program instructions to implement the audio signal processing method based on the microphone-free karaoke of each embodiment of the present disclosure above and/or other desired functions.
在一个示例中，电子设备190还可以包括：输入装置1903和输出装置1904，这些组件通过总线系统和/或其他形式的连接机构(未示出)互连。In one example, the electronic device 190 may further include: an input device 1903 and an output device 1904 , and these components are interconnected via a bus system and/or other forms of connection mechanisms (not shown).
当然，为了简化，图19中仅示出了该电子设备190中与本公开有关的组件中的一些，省略了诸如总线、输入/输出接口等等的组件。除此之外，根据具体应用情况，电子设备190还可以包括任何其他适当的组件。Of course, for simplicity, FIG19 only shows some of the components related to the present disclosure in the electronic device 190, omitting components such as a bus, an input/output interface, etc. In addition, the electronic device 190 may further include any other appropriate components according to specific application scenarios.
示例性计算机程序产品和计算机可读存储介质Exemplary computer program products and computer-readable storage media
除了上述方法和设备以外，本公开的实施例还可以是计算机程序产品，其包括计算机程序指令，计算机程序指令在被处理器运行时使得处理器执行本说明书上述“示例性方法”部分中描述的根据本公开各种实施例的基于无麦K歌的音频信号处理方法中的步骤。In addition to the above-mentioned methods and devices, an embodiment of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the audio signal processing method based on microphone-free karaoke according to various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of this specification.
计算机程序产品可以以一种或多种程序设计语言的任意组合来编写用于执行本公开实施例操作的程序代码，程序设计语言包括面向对象的程序设计语言，诸如Java、C++等，还包括常规的过程式程序设计语言，诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。The computer program product may be written in any combination of one or more programming languages to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
此外，本公开的实施例还可以是计算机可读存储介质，其上存储有计算机程序指令，计算机程序指令在被处理器运行时使得处理器执行本说明书上述“示例性方法”部分中描述的根据本公开各种实施例的基于无麦K歌的音频信号处理方法中的步骤。In addition, an embodiment of the present disclosure may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the steps of the audio signal processing method based on microphone-free karaoke according to various embodiments of the present disclosure described in the above "Exemplary Method" section of this specification.
计算机可读存储介质可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如但不限于包括电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(Erasable Programmable Read OnlyMemory，EPROM或闪存)、光纤、便携式紧凑盘只读存储器(Compact Disc Read-OnlyMemory，CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium is, for example, but not limited to, a system, device or device including electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
以上结合具体实施例描述了本公开的基本原理，但是，在本公开中提及的优点、优势、效果等仅是示例而非限制，不能认为其是本公开的各个实施例必须具备的。另外，上述公开的具体细节仅是为了示例的作用和便于理解的作用，而非限制，上述细节并不限制本公开为必须采用上述具体的细节来实现。The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and cannot be considered as being required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, rather than limitation, and the above details do not limit the present disclosure to being implemented by adopting the above specific details.
本领域的技术人员可以对本公开进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本公开权利要求及其等同技术的范围之内，则本公开也意图包含这些改动和变型在内。Those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the present disclosure claims and their equivalents, the present disclosure is also intended to include these modifications and variations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410384304.6ACN118555523A (en) | 2024-03-29 | 2024-03-29 | Audio signal processing method, device, audio processing system and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410384304.6ACN118555523A (en) | 2024-03-29 | 2024-03-29 | Audio signal processing method, device, audio processing system and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN118555523Atrue CN118555523A (en) | 2024-08-27 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410384304.6APendingCN118555523A (en) | 2024-03-29 | 2024-03-29 | Audio signal processing method, device, audio processing system and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN118555523A (en) |
| Publication | Publication Date | Title |
|---|---|---|
| US11569789B2 (en) | Compensation for ambient sound signals to facilitate adjustment of an audio volume | |
| CN111883156B (en) | Audio processing method and device, electronic equipment and storage medium | |
| US8842851B2 (en) | Audio source localization system and method | |
| RU2520420C2 (en) | Method and system for scaling suppression of weak signal with stronger signal in speech-related channels of multichannel audio signal | |
| JP6652978B2 (en) | Sports headphones with situational awareness | |
| CN110956976B (en) | Echo cancellation method, device and equipment and readable storage medium | |
| CN113270082A (en) | Vehicle-mounted KTV control method and device and vehicle-mounted intelligent networking terminal | |
| CN112954581B (en) | A kind of audio playback method, system and device | |
| CN104604254A (en) | Audio processing device, method, and program | |
| JP3994788B2 (en) | Transfer characteristic measuring apparatus, transfer characteristic measuring method, transfer characteristic measuring program, and amplifying apparatus | |
| CN111883153B (en) | Microphone array-based double-end speaking state detection method and device | |
| CN113555030A (en) | Audio signal processing method, device and equipment | |
| US9628907B2 (en) | Audio device and method having bypass function for effect change | |
| US20150365061A1 (en) | System and method for modifying an audio signal | |
| EP4564351A2 (en) | Audio processing method and apparatus, computer readable storage medium and electronic device | |
| JP2010288262A (en) | Signal processing apparatus | |
| CN116015993B (en) | Audio signal processing method and terminal | |
| CN109195072B (en) | Audio playing control system and method based on automobile | |
| US20030126975A1 (en) | Electronic musical instrument | |
| WO2018179506A1 (en) | Audio device and computer readable program | |
| JP4791613B2 (en) | Audio adjustment device | |
| JPWO2020017518A1 (en) | Audio signal processor | |
| CN118555523A (en) | Audio signal processing method, device, audio processing system and storage medium | |
| CN117880693A (en) | Loudness adjustment method, device, storage medium and electronic device | |
| JP7474548B2 (en) | Controlling the playback of audio data |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right | Effective date of registration:20250715 Address after:201306 building C, No. 888, Huanhu West 2nd Road, Lingang New District, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Applicant after:Shanghai Beige Magnesium Technology Co.,Ltd. Country or region after:China Address before:201306 building C, No. 888, Huanhu West 2nd Road, Lingang New Area, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Applicant before:Shanghai Wote Magnesium Technology Co.,Ltd. Country or region before:China |