CN116193321A - Sound signal processing method, device, equipment and storage medium - Google Patents
Sound signal processing method, device, equipment and storage mediumDownload PDFInfo
- Publication number
- CN116193321A CN116193321ACN202211468994.0ACN202211468994ACN116193321ACN 116193321 ACN116193321 ACN 116193321ACN 202211468994 ACN202211468994 ACN 202211468994ACN 116193321 ACN116193321 ACN 116193321A
- Authority
- CN
- China
- Prior art keywords
- sound signal
- gain
- signal
- frequency response
- environmental
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
- Circuit For Audible Band Transducer (AREA)
- Control Of Amplification And Gain Control (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本申请涉及信号处理技术领域，尤其涉及一种声音信号处理方法、装置、设备及存储介质。The present application relates to the technical field of signal processing, and in particular to an audio signal processing method, device, device and storage medium.
背景技术Background technique
随着人工智能的飞速发展，声音信号处理技术在多个场景中得到了广泛的应用，例如智能眼镜、车载智能终端等，为用户提供了更为方便的人机交互方式，提高了用户的使用体验。With the rapid development of artificial intelligence, sound signal processing technology has been widely used in many scenarios, such as smart glasses, vehicle-mounted smart terminals, etc., providing users with more convenient human-computer interaction methods and improving user experience. experience.
目前主要的采用气传导的方式给予佩戴者音频体验。声音的传播路径依次是扬声器—空气—人耳，在传播到空气时会不可避免的产生声泄露的问题，现有方案中大多采用了声偶极子的声学设计方案，但是仍不能很好的解决声学私密性泄露的难题。Currently, air conduction is mainly used to give the wearer an audio experience. The sound propagation path is loudspeaker-air-human ear in turn, and the problem of sound leakage will inevitably occur when it spreads into the air. Most of the existing solutions use the acoustic design of the acoustic dipole, but it is still not very good. Solve the problem of acoustic privacy leakage.
发明内容Contents of the invention
本申请实施例提供一种声音信号处理方法、装置、设备及存储介质，用于解决声学私密性泄露的难题。Embodiments of the present application provide an audio signal processing method, device, device, and storage medium, which are used to solve the problem of acoustic privacy leakage.
第一方面，本申请实施例提供一种声音信号处理方法，包括：In the first aspect, the embodiment of the present application provides a sound signal processing method, including:
获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；Obtain the ambient noise floor signal in the ambient sound signal collected by the microphone in the current gain control cycle;
根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，其中，所述第一增益用于控制所述第一声音信号的入耳频响大于所述环境底噪信号的频响，且所述第一声音信号的泄露频响小于所述环境底噪信号的频响；Determine the first gain of the first sound signal played by the loudspeaker in the current gain adjustment period according to the environmental noise floor signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the environmental floor The frequency response of the noise signal, and the leakage frequency response of the first sound signal is smaller than the frequency response of the environmental background noise signal;
根据所述第一增益对当前增益调控周期内所述扬声器播放的第一声音信号进行增益调控。Gain regulation is performed on the first sound signal played by the loudspeaker in the current gain regulation period according to the first gain.
在一些实施例中，所述根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal played by the speaker in the current gain adjustment period according to the environmental noise floor signal includes:
获取声隔离度及当前增益调控周期内所述第一声音信号的泄露频响；Obtaining the sound isolation and the leakage frequency response of the first sound signal in the current gain control period;
根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益。The first gain of the first sound signal in the current gain regulation cycle is determined according to the sound isolation, the leakage frequency response of the first sound signal, and the ambient noise floor.
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental noise floor includes: :
确定当前增益调控周期内所述环境底噪信号的噪声能量；Determining the noise energy of the environmental noise floor signal in the current gain control cycle;
根据所述声隔离度、所述第一声音信号的泄露频响及所述噪声能量确定当前增益调控周期内所述第一声音信号的第一增益。The first gain of the first sound signal in the current gain adjustment period is determined according to the sound isolation, the leakage frequency response of the first sound signal, and the noise energy.
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental noise floor includes: :
对所述环境底噪信号进行分频，得到多个预设频带的目标环境底噪信号；performing frequency division on the environmental noise floor signal to obtain target environmental noise floor signals of multiple preset frequency bands;
确定各所述预设频段的目标声隔离度及各所述预设频段的所述第一声音信号的目标泄露频响；determining the target sound isolation of each of the preset frequency bands and the target leakage frequency response of the first sound signal of each of the preset frequency bands;
根据各所述预设频段的所述目标环境底噪信号、所述目标声隔离度及所述目标泄露频响确定当前增益调控周期内各所述预设频段的第一声音信号的第一增益。Determine the first gain of the first sound signal of each of the preset frequency bands in the current gain control period according to the target environmental noise floor signal of each of the preset frequency bands, the target sound isolation degree and the target leakage frequency response .
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益之前，还包括：In some embodiments, before determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental floor noise signal, Also includes:
确定当前增益调控周期内所述第一声音信号的情景模式；determining the scene mode of the first sound signal in the current gain adjustment cycle;
根据所述情景模式对所述环境底噪信号进行带通滤波。performing band-pass filtering on the ambient background noise signal according to the scenario mode.
在一些实施例中，根据当前增益调控周期内扬声器播放的第一声音信号对所述环境声音信号进行回声消除，得到环境底噪信号。In some embodiments, echo cancellation is performed on the environmental sound signal according to the first sound signal played by the loudspeaker in the current gain adjustment period to obtain the environmental floor noise signal.
在一些实施例中，所述根据所述第一增益对当前增益调控周期内所述扬声器播放的声音信号进行增益调控，包括：In some embodiments, the gain adjustment of the sound signal played by the speaker in the current gain adjustment period according to the first gain includes:
确定上一增益调控周期的第二增益；determining the second gain of the previous gain regulation cycle;
根据所述第二增益对所述第一增益进行平滑，得的第三增益；smoothing the first gain according to the second gain to obtain a third gain;
根据所述第三增益对当前增益调控周期内所述扬声器播放的声音信号进行增益调控。Gain regulation is performed on the sound signal played by the loudspeaker in the current gain regulation period according to the third gain.
第二方面，本申请实施例还提供一种声音信号处理装置，包括：In the second aspect, the embodiment of the present application also provides an audio signal processing device, including:
获取单元，用于获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；The acquisition unit is used to acquire the environmental noise floor signal in the environmental sound signal collected by the microphone in the current gain control cycle;
增益单元，用于根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，其中，所述第一增益用于控制所述第一声音信号的入耳频响大于所述环境底噪信号的频响，且所述第一声音信号的泄露频响小于所述环境底噪信号的频响；A gain unit, configured to determine the first gain of the first sound signal played by the speaker in the current gain adjustment period according to the environmental noise floor signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal greater than the frequency response of the environmental noise floor signal, and the leakage frequency response of the first sound signal is smaller than the frequency response of the environmental floor noise signal;
调控单元，用于根据所述第一增益对当前增益调控周期内所述扬声器播放的第一声音信号进行增益调控。A regulating unit, configured to perform gain regulation on the first sound signal played by the loudspeaker in the current gain regulation period according to the first gain.
第三方面，本申请实施例提供了一种电子设备，包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现如上述任一种所述的声音信号处理方法。In the third aspect, the embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and operable on the processor, and the processor implements any of the above-mentioned computer programs when executing the program. A kind of described sound signal processing method.
第四方面，本申请实施例提供一种非暂态计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现如上述任一种所述的声音信号处理方法。In a fourth aspect, an embodiment of the present application provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the sound signal processing method described in any one of the above-mentioned methods is implemented.
第五方面，本申请实施例提供了一种计算机程序产品，包括计算机程序，所述计算机程序被处理器执行时实现如上述任一种所述的声音信号处理方法。In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, the sound signal processing method described in any one of the foregoing is implemented.
附图说明Description of drawings
为了更清楚地说明本申请或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the present application or the prior art, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are the For some embodiments of the present invention, those of ordinary skill in the art can also obtain other drawings based on these drawings on the premise of not paying creative efforts.
图1是本申请一个实施例提供的智能穿戴设备的结构示意图；Fig. 1 is a schematic structural diagram of a smart wearable device provided by an embodiment of the present application;
图2是本申请一个实施例提供的智能穿戴设备的频响曲线的示意图；Fig. 2 is a schematic diagram of a frequency response curve of a smart wearable device provided by an embodiment of the present application;
图3是本申请一个实施例提供的声音信号处理方法的流程示意图；Fig. 3 is a schematic flowchart of a sound signal processing method provided by an embodiment of the present application;
图4是本申请一个实施例提供的声音信号处理方法的一个应用场景的声隔离度的示意图；Fig. 4 is a schematic diagram of sound isolation in an application scenario of a sound signal processing method provided by an embodiment of the present application;
图5是本申请一个实施例提供的声音信号处理装置的结构示意图；Fig. 5 is a schematic structural diagram of an audio signal processing device provided by an embodiment of the present application;
图6是本申请一个实施例提供的电子设备的结构示意图。Fig. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
为使本申请的目的、技术方案和优点更加清楚，下面将结合本申请中的附图，对本申请中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings in this application. Obviously, the described embodiments are part of the embodiments of this application , but not all examples. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的术语在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”所区别的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”一般表示前后关联对象是一种“或”的关系。本申请实施例提供的声音信号处理方法，可以应用于智能穿戴设备，或者可以应用于控制智能穿戴设备的终端设备。The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein and that "first" and "second" distinguish objects. It is usually one category, and the number of objects is not limited. For example, there may be one or more first objects. In addition, "and/or" in the description and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship. The sound signal processing method provided in the embodiment of the present application may be applied to a smart wearable device, or may be applied to a terminal device controlling a smart wearable device.
在一些实施例中，智能穿戴设备是应用穿戴式技术对日常穿戴进行智能化设计、开发出可以穿戴的设备的总称，例如眼镜、手套、手表、服饰和鞋子等。广义的智能穿戴设备包括功能全、可不依赖智能手机实现完整或者部分的功能，例如智能手表或智能眼镜(如增强现实(Augmented Reality，AR)眼镜)等，以及只专注于某一类应用功能，需要和其它终端设备例如智能手机配合使用，例如，各类进行体征监测的智能手环、智能首饰等。随着技术的进步以及用户需求的变迁，智能穿戴设备的形态与应用热点也在不断地变化。In some embodiments, a smart wearable device is a general term for applying wearable technology to intelligently design daily wear and develop wearable devices, such as glasses, gloves, watches, clothing and shoes. In a broad sense, smart wearable devices include full-featured devices that can achieve complete or partial functions without relying on smartphones, such as smart watches or smart glasses (such as augmented reality (Augmented Reality, AR) glasses), etc., and only focus on a certain type of application function, It needs to be used in conjunction with other terminal devices such as smart phones, for example, various smart bracelets and smart jewelry for physical sign monitoring. With the advancement of technology and changes in user needs, the form and application hotspots of smart wearable devices are also constantly changing.
在一些实施例中，终端设备(终端)包括各种具有无线通信功能的手持设备、车载设备、可穿戴设备、计算设备或连接到无线调制解调器的其它处理设备，例如，手机、平板、台式笔记本以及可以运行应用程序的智能设备，包括智能汽车的中央控制台等。具体可以指用户设备(user equipment，UE)、接入终端、用户单元、用户站、移动站、移动台、远方站、远程终端、移动设备、用户终端、终端、无线通信设备、用户代理或用户装置。终端设备还可以是卫星电话、蜂窝电话、智能手机、无线数据卡、无线调制解调器、机器类型通信设备、可以是无绳电话、会话启动协议(session initiation protocol，SIP)电话、无线本地环路(wireless local loop，WLL)站、个人数字处理(personal digital assistant，PDA)、具有无线通信功能的手持设备、计算设备或连接到无线调制解调器的其它处理设备、车载设备或可穿戴设备，虚拟现实(virtual reality，VR)终端设备、增强现实(augmented reality，AR)终端设备、工业控制(industrial control)中的无线终端、无人驾驶(self-driving)中的无线终端、远程医疗(remote medical)中的无线终端、智能电网(smart grid)中的无线终端、运输安全(transportation safety)中的无线终端、智慧城市(smart city)中的无线终端、智慧家庭(smart home)中的无线终端、5G网络或者未来通信网络中的终端设备等。终端可以由电池供电，还可以附接到车辆或者船舶的电源系统，并由车辆或者船舶的电源系统供电。车辆或者船舶的电源系统还可以为终端的电池充电，以延长终端的通信时间。In some embodiments, terminal devices (terminals) include various handheld devices with wireless communication functions, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems, such as mobile phones, tablets, desktop notebooks, and Smart devices that can run applications, including the center console of smart cars, etc. Specifically, it may refer to user equipment (user equipment, UE), access terminal, subscriber unit, subscriber station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent, or user device. The terminal device can also be a satellite phone, a cellular phone, a smart phone, a wireless data card, a wireless modem, a machine type communication device, can be a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (wireless local loop) loop, WLL) station, personal digital assistant (PDA), handheld device with wireless communication capabilities, computing device or other processing device connected to a wireless modem, vehicle-mounted device or wearable device, virtual reality (virtual reality, VR) terminal equipment, augmented reality (augmented reality, AR) terminal equipment, wireless terminals in industrial control (industrial control), wireless terminals in self-driving (self-driving), wireless terminals in remote medical (remote medical) , wireless terminals in smart grid, wireless terminals in transportation safety, wireless terminals in smart city, wireless terminals in smart home, 5G network or future communication Terminal equipment in the network, etc. The terminal may be powered by a battery, and may also be attached to and powered by the power system of the vehicle or ship. The power system of the vehicle or ship can also charge the battery of the terminal to prolong the communication time of the terminal.
图1为本申请一个实施例提供的智能穿戴设备的结构示意图。Fig. 1 is a schematic structural diagram of a smart wearable device provided by an embodiment of the present application.
如图1所示，智能穿戴设备100包括：麦克风110、回声消除模块120、噪声估计模块130、增益控制模块140及扬声器150。As shown in FIG. 1 , the smart
其中，麦克风110用于采集环境声音信号，该环境声音信号包括扬声器150播放的声音信号在当前环境空间内的声学回声信号及当前环境空间内的环境底噪信号。Wherein, the
回声消除模块120用于对麦克风110传输的环境声音信号进行回声消除，消除掉当前环境空间内的声学回声信号，得到所需要的环境底噪信号，其中，作为一种可实施的方式，可以将扬声器160播放的声音信号作为回声消除中的参考信号。The
噪声估计模块130用于对环境底噪信号进行噪声估计，即评估出环境底噪信号的噪声能量，进而根据噪声能量估计出扬声器160所需要的增益。The
作为一种可实施的方式，参考图2，图2为在一个标准环境空间内控制智能穿戴设备以一个特定音量播放音频时测得的频响曲线的示意图。As an implementable manner, refer to FIG. 2 , which is a schematic diagram of a frequency response curve measured when the smart wearable device is controlled to play audio at a specific volume in a standard environmental space.
其中，图2中横坐标代表信号采样点的频率，纵坐标代表信号采样点的幅值(电平)。虚线代表入耳频响，即表征佩戴者实际可听到的声音信号的频响，其可以通过头和躯干模拟器测试得到。实线代表泄露频响，即表征周围路人可听到的声音信号的频响，其可以通过标准麦克风测试得的。Wherein, the abscissa in FIG. 2 represents the frequency of the signal sampling point, and the ordinate represents the amplitude (level) of the signal sampling point. The dotted line represents the in-ear frequency response, that is, the frequency response that represents the sound signal that the wearer can actually hear, which can be obtained through the head and torso simulator test. The solid line represents the leakage frequency response, that is, the frequency response that characterizes the sound signal audible to passers-by around, which can be measured by a standard microphone.
本实施例中，噪声估计模块130用于根据智能穿戴设备在标准环境空间内测得的频响曲线、智能穿戴设备在当前环境空间内设定的音量及当前环境空间内的噪声能量确定出扬声器160播放的声音信号所需要的增益。In this embodiment, the
增益控制模块140用于对扬声器160播放的声音信号进行增益调控，使得增益调控后的声音信号的入耳频响大于当前环境空间内的环境底噪信号的频响，且增益调控后的声音信号的泄露频响小于当前环境空间内的环境底噪信号的频响。The
扬声器160用于播放经过增益控制模块140增益调控后的声音信号，由此由于播放的声音信号的入耳频响大于当前环境空间内的环境底噪信号的频响，且泄露频响小于当前环境空间内的环境底噪信号的频响，由此确保声学隐私不泄露，且佩戴者还可以听清扬声器160播放的声音信号。The loudspeaker 160 is used to play the sound signal after gain adjustment by the
目前解决智能穿戴设备私密性的方案大多采用纯声学结构方案，例如声偶极子的声学设计方案，虽然声偶极子的声学设计方案能够提供一定的声学私密性保障，但是由于声偶极子的设计原理是设计两个出声孔，其中一个作为主声源，向外发声，另外一个作为辅助声源，消除漏音，两个出声孔向外辐射的声波的相位相差为180°，且它们之间相距很近，频率和振动幅值相同(或者相近)合成最终的声源，从而使得从佩戴者之外的周围人几乎听不到声音，但是无法确保声学隐私是否不泄露。At present, most of the solutions to solve the privacy of smart wearable devices use pure acoustic structure solutions, such as the acoustic design of the acoustic dipole. Although the acoustic design of the acoustic dipole can provide a certain degree of acoustic privacy protection, due to the The design principle is to design two sound holes, one of which is used as the main sound source to emit sound outward, and the other is used as an auxiliary sound source to eliminate sound leakage. The phase difference of the sound waves radiated from the two sound holes is 180°. And they are very close to each other, and the frequency and vibration amplitude are the same (or similar) to synthesize the final sound source, so that people around the wearer can hardly hear the sound, but it is impossible to ensure that the acoustic privacy is not leaked.
为此，本申请实施例提供了一种应用于上述智能穿戴设备的声音信号处理方法，可以确保声学隐私不泄露，且佩戴者还可以听清扬声器播放的声音信号。To this end, the embodiment of the present application provides a sound signal processing method applied to the above-mentioned smart wearable device, which can ensure that the acoustic privacy is not leaked, and the wearer can also clearly hear the sound signal played by the speaker.
可以理解地，本申请实施例中的信号均指代数据域信号，在此不在具体赘述。It can be understood that the signals in the embodiments of the present application all refer to data domain signals, which are not described in detail here.
图3为本申请一个实施例提供的声音信号处理方法的流程示意图。如图3所示，该方法包括以下步骤：步骤301、步骤302和步骤303。该方法流程步骤仅仅作为本申请一个可能的实现方式。Fig. 3 is a schematic flowchart of a sound signal processing method provided by an embodiment of the present application. As shown in FIG. 3 , the method includes the following steps:
步骤301，获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；
其中，环境声音信号指代智能穿戴设备的麦克风在当前环境空间内采集到的声音信号，环境声音信号中包括当前环境空间内的声学回声信号及当前环境空间内的环境底噪信号。Wherein, the environmental sound signal refers to the sound signal collected by the microphone of the smart wearable device in the current environmental space, and the environmental sound signal includes the acoustic echo signal in the current environmental space and the environmental background noise signal in the current environmental space.
本实施中可以通过一个麦克风采集环境声音信号，也可以通过两个或两个以上的麦克风采集环境声音信号，对此不作限制。In this implementation, one microphone may be used to collect the ambient sound signal, or two or more microphones may be used to collect the ambient sound signal, which is not limited.
本发明实施例中，增益调控周期的周期时长可以根据智能穿戴设备的音频帧的播放时长来确定，例如，智能穿戴设备播放一帧音频帧的时长为m，则增益调控周期内的周期时长为m*n，其中，n取值可以为正整数。In the embodiment of the present invention, the cycle duration of the gain regulation cycle can be determined according to the playback duration of the audio frame of the smart wearable device. For example, if the duration of the smart wearable device to play an audio frame is m, then the cycle duration in the gain regulation cycle is m*n, wherein, the value of n can be a positive integer.
在一个示例中，在扬声器开始播放第一帧音频帧时，麦克风同步采集环境声音信号，在扬声器开始播放第二帧音频帧时，智能穿戴设备进入第一个增益调控周期，并将扬声器播放第一帧音频帧期间，麦克风采集的环境声音信号作为第一个增益调控周期内的环境声音信号，接着在扬声器开始播放第三帧音频帧时，智能穿戴设备进入第二个增益调控周期，并将扬声器播放第二帧音频帧期间，麦克风采集的环境声音信号作为第二个增益调控周期内的环境声音信号…以此类推。In an example, when the speaker starts to play the first audio frame, the microphone collects the ambient sound signal synchronously, and when the speaker starts to play the second audio frame, the smart wearable device enters the first gain control period, and plays the second audio frame from the speaker. During one frame of audio frame, the ambient sound signal collected by the microphone is used as the ambient sound signal in the first gain control cycle, and then when the speaker starts to play the third frame of audio frame, the smart wearable device enters the second gain control cycle, and During the period when the speaker plays the second audio frame, the ambient sound signal collected by the microphone is used as the ambient sound signal in the second gain control cycle...and so on.
在一个示例中，在扬声器开始播放第一帧音频帧时，智能穿戴设备同步进入第一个增益调控周期，麦克风同步采集环境声音信号，且麦克风在采集预设时长的环境声音信号后，停止采集，直至扬声器开始播放第二帧音频帧…以此类推。In one example, when the speaker starts to play the first audio frame, the smart wearable device enters the first gain adjustment cycle synchronously, the microphone collects the ambient sound signal synchronously, and the microphone stops collecting the ambient sound signal after collecting the preset duration , until the speaker starts playing the second audio frame...and so on.
在一些实施例中，可以根据当前增益调控周期内扬声器播放的第一声音信号对环境声音信号进行回声消除，得到环境底噪信号。In some embodiments, echo cancellation may be performed on the environmental sound signal according to the first sound signal played by the loudspeaker in the current gain adjustment period to obtain the environmental floor noise signal.
例如，设定自适应滤波器的参考信号为扬声器播放的第一声音信号，之后将环境声音信号输入至自适应滤波器中，自适应滤波器即可输出环境底噪信号。For example, setting the reference signal of the adaptive filter as the first sound signal played by the speaker, and then inputting the ambient sound signal into the adaptive filter, the adaptive filter can output the ambient noise floor signal.
其中，本实施例中的第一声音信号可以为实时产生的声音信号，比如语音通话过程中产生的声音信号，还可以为预先录制好的声音信号，比如音乐等，对此不作限制。Wherein, the first sound signal in this embodiment may be a sound signal generated in real time, such as a sound signal generated during a voice call, or a pre-recorded sound signal, such as music, etc., without limitation.
步骤302，根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益；
其中，第一增益用于控制第一声音信号的入耳频响大于环境底噪信号的频响，且第一声音信号的泄露频响小于环境底噪信号的频响Wherein, the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the environmental floor noise signal, and the leakage frequency response of the first sound signal is smaller than the frequency response of the environmental floor noise signal
本实施例中，第一增益指代当前增益调控周期内第一声音信号的幅值的增益。In this embodiment, the first gain refers to the gain of the amplitude of the first sound signal in the current gain adjustment period.
在得到环境底噪信号后，可以检测出环境底噪信号的幅值，由此可以根据环境底噪信号的幅值来确定出第一声音信号的幅值的增益。After the environmental noise floor signal is obtained, the amplitude of the environmental floor noise signal can be detected, and thus the gain of the amplitude of the first sound signal can be determined according to the amplitude of the environmental floor noise signal.
在一个示例中，可以预先设定好每一个环境底噪信号的幅值区间对应的第一声音信号的第一增益，例如，幅值大的环境底噪信号对应的第一增益的数值也越大。In an example, the first gain of the first sound signal corresponding to the amplitude range of each environmental noise floor signal can be preset. For example, the value of the first gain corresponding to the environmental floor noise signal with a larger amplitude big.
步骤303，根据所述第一增益对当前增益调控周期内所述扬声器播放的第一声音信号进行增益调控；
本实施例中，根据第一增益对当前增益调控周期内扬声器播放的第一声音信号的幅值进行增益调控，进而调整扬声器播放的第一声音信号的音量，由此使得扬声器播放的第一声音信号的入耳频响大于环境底噪信号的频响，且第一声音信号的泄露频响小于环境底噪信号的频响。In this embodiment, gain regulation is performed on the amplitude of the first sound signal played by the speaker in the current gain regulation period according to the first gain, and then the volume of the first sound signal played by the speaker is adjusted, thereby making the first sound played by the speaker The in-ear frequency response of the signal is greater than the frequency response of the environmental background noise signal, and the leakage frequency response of the first sound signal is smaller than the frequency response of the environmental background noise signal.
其中，在进行增益调控时，可以一次性地将第一声音信号的增益调整至第一增益，还可以平缓地多次将第一声音信号的增益调整至第一增益，对此不作限制。Wherein, when performing gain adjustment, the gain of the first sound signal may be adjusted to the first gain at one time, or the gain of the first sound signal may be adjusted to the first gain gently multiple times, which is not limited.
本申请实施例提供的声音信号处理方法，通过获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；接着根据环境底噪信号确定出使得第一声音信号的入耳频响大于环境底噪信号的频响，且第一声音信号的泄露频响小于环境底噪信号的频响的第一增益，进而实现根据第一增益对扬声器播放的第一声音信号进行增益调控后，可以确保声学隐私不泄露，且佩戴者还可以听清扬声器播放的声音信号。The sound signal processing method provided by the embodiment of the present application obtains the environmental noise signal in the environmental sound signal collected by the microphone in the current gain control cycle; The frequency response of the noise floor signal, and the leakage frequency response of the first sound signal is less than the first gain of the frequency response of the environmental floor noise signal, and then the first sound signal played by the speaker is adjusted according to the first gain, which can ensure Acoustic privacy is not leaked, and the wearer can still hear the sound signal played by the speaker.
在一些实施例中，所述根据所述第一增益对当前增益调控周期内所述扬声器播放的声音信号进行增益调控，包括：In some embodiments, the gain adjustment of the sound signal played by the speaker in the current gain adjustment period according to the first gain includes:
确定上一增益调控周期的第二增益；determining the second gain of the previous gain regulation cycle;
根据所述第二增益对所述第一增益进行平滑，得的第三增益；smoothing the first gain according to the second gain to obtain a third gain;
根据所述第三增益对当前增益调控周期内所述扬声器播放的声音信号进行增益调控。Gain regulation is performed on the sound signal played by the loudspeaker in the current gain regulation period according to the third gain.
需要说明的是，本实施例中的第一增益和第二增益为一个固定的数值，第三增益为一个与时间相关的变动的数值，比如，在第0时刻至第2时刻时(上一增益调控周期)，其对应的第二增益为10dB，第2时刻至第4时刻(当前增益调控周期)，其对应的第一增益为20dB，则在第2时刻时的第三增益为10dB、第(2+T1)时刻时的第三增益为(10+a)dB、第(2+T1+T2)时刻时的第三增益为(10+a+b)dB…以此类推，直至在第4时刻时的第三增益为20dB，其中，T1和T2可以相同，也可以不相同，a和b可以相同也可以不相同。It should be noted that the first gain and the second gain in this embodiment are a fixed value, and the third gain is a variable value related to time, for example, from the 0th moment to the 2nd moment (the previous Gain regulation period), its corresponding second gain is 10dB, from the 2nd moment to the 4th moment (current gain regulation period), its corresponding first gain is 20dB, then the third gain at the 2nd moment is 10dB, The third gain at the moment (2+T1 ) is (10+a)dB, the third gain at the moment (2+T1+T2 ) is (10+a+b)dB... and so on, The third gain until the fourth moment is 20dB, where T1 and T2 may or may not be the same, and a and b may or may not be the same.
本实施例中，可以采用指数平滑法确定出第三增益，比如根据第一增益及第二增益之间的增益差，确定当前增益调控周期的指数平滑系数，其中，增益差越大，则指数平滑系数也越大。In this embodiment, the third gain can be determined by using the exponential smoothing method. For example, according to the gain difference between the first gain and the second gain, the exponential smoothing coefficient of the current gain control cycle is determined. The smoothing factor is also larger.
本申请实施例提出的声音信号处理方法，通过确定上一增益调控周期的第二增益；根据第二增益对第一增益进行平滑，得的第三增益；根据第三增益对当前增益调控周期内扬声器播放的声音信号进行增益调控，由此使得扬声器播放的第一声音信号可以平滑地过渡，提高了佩戴者的体验感。In the sound signal processing method proposed in the embodiment of the present application, by determining the second gain of the previous gain control cycle; smoothing the first gain according to the second gain, the third gain is obtained; The gain of the sound signal played by the loudspeaker is adjusted, so that the first sound signal played by the loudspeaker can transition smoothly, which improves the experience of the wearer.
在一些实施例中，所述根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal played by the speaker in the current gain adjustment period according to the environmental noise floor signal includes:
获取声隔离度及当前增益调控周期内所述第一声音信号的泄露频响；Obtaining the sound isolation and the leakage frequency response of the first sound signal in the current gain control period;
根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益。The first gain of the first sound signal in the current gain regulation cycle is determined according to the sound isolation, the leakage frequency response of the first sound signal, and the ambient noise floor.
本实施例中的声隔离度指代智能穿戴设备在播放声音信号时，声音信号的入耳频响与泄露频响之间的差值。The sound isolation in this embodiment refers to the difference between the in-ear frequency response and the leakage frequency response of the sound signal when the smart wearable device plays the sound signal.
需要说明的是，本实施例中的声隔离度是一个与智能穿戴设备的物理声学结构设计有关的固定值，例如参考图4，图4为某一个特定的物理声学结构智能穿戴设备声隔离度的示意图。It should be noted that the sound isolation in this embodiment is a fixed value related to the physical acoustic structure design of the smart wearable device. For example, refer to Figure 4, which shows the sound isolation of a specific physical acoustic structure smart wearable device schematic diagram.
在一个示例中，设定一个参考泄露频响，即在一个标准环境空间内控制智能穿戴设备以一个参考音量播放音频时测得的泄露频响。In an example, a reference leakage frequency response is set, that is, a leakage frequency response measured when the smart wearable device is controlled to play audio at a reference volume in a standard environmental space.
本实施例中，根据第一声音信号的音量及预设的参考泄露频响，确定出第一声音信号的泄露频响，接着根据声隔离度确定出第一声音信号的入耳频响，由此根据第一声音信号的泄露频响、第一声音信号的入耳频响及环境底噪信号确定出第一增益。In this embodiment, the leakage frequency response of the first sound signal is determined according to the volume of the first sound signal and the preset reference leakage frequency response, and then the in-ear frequency response of the first sound signal is determined according to the sound isolation, thus The first gain is determined according to the leakage frequency response of the first sound signal, the in-ear frequency response of the first sound signal, and the background noise signal of the environment.
本申请实施提出的声音信号处理方法，通过获取声隔离度及当前增益调控周期内第一声音信号的泄露频响；进而可以根据声隔离度、第一声音信号的泄露频响及环境底噪信号确定出第一声音信号的第一增益。The sound signal processing method proposed by this application implements the sound isolation degree and the leakage frequency response of the first sound signal in the current gain control period; and then can be based on the sound isolation degree, the leakage frequency response of the first sound signal and the environmental floor noise signal A first gain of the first sound signal is determined.
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental noise floor includes: :
确定当前增益调控周期内所述环境底噪信号的噪声能量；Determining the noise energy of the environmental noise floor signal in the current gain control period;
根据所述声隔离度、所述第一声音信号的泄露频响及所述噪声能量确定当前增益调控周期内所述第一声音信号的第一增益。The first gain of the first sound signal in the current gain adjustment period is determined according to the sound isolation, the leakage frequency response of the first sound signal, and the noise energy.
在一个示例中，可以对环境底噪信号进行RMS(root mean square，均方根)处理，得到环境底噪信号的噪声能量(即有效噪声)，RMS处理步骤同现有技术中一致，在此不再赘述。In an example, RMS (root mean square, root mean square) processing can be performed on the environmental noise floor signal to obtain the noise energy (i.e. effective noise) of the environmental floor noise signal. The RMS processing steps are consistent with those in the prior art, and here No longer.
本实施例中，对环境底噪信号进行RMS处理后，可以根据噪声能量获取到环境底噪信号的有效幅值，其中，有效幅值为一个与噪声频率无关的固定幅值。In this embodiment, after the RMS processing is performed on the environmental noise floor signal, the effective amplitude of the environmental noise floor signal can be obtained according to the noise energy, wherein the effective amplitude is a fixed amplitude independent of the noise frequency.
在一个示例中，可以在同一个频响坐标系中确定出第一声音信号的泄露频响曲线、第一声音信号的入耳频响曲线及环境底噪信号的频响曲线，其中，环境底噪信号的频响曲线中各频率对应的幅值均相等(即均等于有效噪声的幅值)，之后同步将泄露频响曲线及入耳频响曲线沿着频响坐标系的纵轴进行上下调整，直至环境底噪信号的频响曲线近似位于第一声音信号的泄露频响曲线及第一声音信号的入耳频响曲线之间，则满足此条件下的泄露频响曲线(入耳频响曲线)与原来的泄露频响曲线(入耳频响曲线)之间的幅值差即为第一声音信号的第一增益。In an example, the leakage frequency response curve of the first sound signal, the in-ear frequency response curve of the first sound signal, and the frequency response curve of the environmental floor noise signal can be determined in the same frequency response coordinate system, wherein the environmental floor noise The amplitudes corresponding to each frequency in the frequency response curve of the signal are equal (that is, they are equal to the amplitude of the effective noise), and then the leakage frequency response curve and the ear frequency response curve are adjusted up and down along the vertical axis of the frequency response coordinate system synchronously. Until the frequency response curve of the environmental background noise signal is approximately between the leakage frequency response curve of the first sound signal and the ear-in frequency response curve of the first sound signal, then the leakage frequency response curve (in-ear frequency response curve) and The amplitude difference between the original leakage frequency response curves (in-ear frequency response curves) is the first gain of the first sound signal.
本申请实施提出的声音信号处理方法，通过获取环境底噪信号的噪声能量，以将环境底噪信号转换成一个可用于衡量的信号，进而确保可以根据声隔离度、泄露频响及噪声能量精准确定出第一声音信号的第一增益。The sound signal processing method proposed in this application is to convert the environmental noise floor signal into a measurable signal by obtaining the noise energy of the environmental floor noise signal, thereby ensuring that the sound isolation, leakage frequency response, and noise energy can be accurately measured. A first gain of the first sound signal is determined.
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益，包括：In some embodiments, the determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental noise floor includes: :
对所述环境底噪信号进行分频，得到多个预设频带的目标环境底噪信号；performing frequency division on the environmental noise floor signal to obtain target environmental noise floor signals of multiple preset frequency bands;
确定各所述预设频段的目标声隔离度及各所述预设频段的所述第一声音信号的目标泄露频响；determining the target sound isolation of each of the preset frequency bands and the target leakage frequency response of the first sound signal of each of the preset frequency bands;
根据各所述预设频段的所述目标环境底噪信号、所述目标声隔离度及所述目标泄露频响确定当前增益调控周期内各所述预设频段的第一声音信号的第一增益。Determine the first gain of the first sound signal of each of the preset frequency bands in the current gain control period according to the target environmental noise floor signal of each of the preset frequency bands, the target sound isolation degree and the target leakage frequency response .
在一个示例中，可以通过分频器对环境底噪信号进行成分分析，通过预先设定好分频器的分频点，将环境底噪信号分频出多个预设频带的目标环境底噪信号。In an example, the environmental noise floor signal can be analyzed by a frequency divider, and the environmental floor noise signal can be frequency-divided into multiple preset frequency bands by setting the frequency division point of the frequency divider in advance. Signal.
需要说明的是，由于不同环境场景下的噪声成分差别比较明显，因此通过将环境底噪信号分频出多个预设频带的目标环境底噪信号，去分别进行增益调控，可以提高智能穿戴设备的声学私密性。It should be noted that due to the obvious difference in noise components in different environmental scenarios, by frequency-dividing the environmental noise floor signal into target environmental noise floor signals of multiple preset frequency bands, and separately performing gain adjustment, the smart wearable device can be improved. acoustic privacy.
本实施例中，分别对各个预设频带的目标声隔离度、目标泄露频响及目标环境底噪信号进行处理，确定出各个预设频带匹配的第一增益，之后结合EQ(Audio equalizerfilter，音频均衡器)滤波器对第一声音信号进行增益调控，其中，EQ滤波器的分频点与分频器的分频点相同。In this embodiment, the target sound isolation, the target leakage frequency response, and the target environmental noise floor signal of each preset frequency band are processed respectively, and the first gain matched by each preset frequency band is determined, and then combined with EQ (Audio equalizer filter, audio equalizer) filter to adjust the gain of the first sound signal, wherein the frequency division point of the EQ filter is the same as the frequency division point of the frequency divider.
其中，本实施例中的各预设频段的第一声音信号的第一增益的获取方式同上述实施例中的一致，在此不再赘述。Wherein, the acquisition method of the first gain of the first sound signal of each preset frequency band in this embodiment is the same as that in the above embodiment, and will not be repeated here.
本申请实施提出的声音信号处理方法，通过各预设频段的第一增益来分别调控各个预设频段的第一声音信号，由此确保各预设频段的第一声音信号的入耳频响均可大于相应频段的环境底噪信号的频响，且泄露频响均可小于相应频段的环境底噪信号的频响，由此提高了智能穿戴设备在不同噪声场景下的适应性，使得智能穿戴设备的声音隐私性更高。This application implements the sound signal processing method proposed by adjusting the first sound signal of each preset frequency band through the first gain of each preset frequency band, thereby ensuring that the in-ear frequency response of the first sound signal of each preset frequency band is acceptable. The frequency response of the environmental noise floor signal is greater than the corresponding frequency band, and the leakage frequency response can be smaller than the frequency response of the environmental noise floor signal of the corresponding frequency band, thereby improving the adaptability of the smart wearable device in different noise scenarios, making the smart wearable device The voice privacy is higher.
在一些实施例中，所述根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益之前，还包括：In some embodiments, before determining the first gain of the first sound signal in the current gain adjustment period according to the sound isolation, the leakage frequency response of the first sound signal, and the environmental floor noise signal, Also includes:
确定当前增益调控周期内所述第一声音信号的情景模式；determining the scene mode of the first sound signal in the current gain adjustment period;
根据所述情景模式对所述环境底噪信号进行带通滤波。performing band-pass filtering on the ambient background noise signal according to the scenario mode.
本实施例中，情景模式指代声音信号的应用情景，比如该声音信号是用于进行语音通话(即语音通话情景模式)，还是用于传递音乐数据(音乐情景模式)。In this embodiment, the scene mode refers to the application scene of the sound signal, for example, whether the sound signal is used for voice calls (ie, voice call scene mode) or for transferring music data (music scene mode).
在一个示例中，预设设定好多个情景模式及各情景模式下的滤波带宽，由此根据预设的各情景模式下的滤波带宽对各情景模式下的环境底噪信号进行带通滤波。In one example, a plurality of scene modes and filter bandwidths in each scene mode are preset, so that band-pass filtering is performed on the ambient noise floor signals in each scene mode according to the preset filter bandwidths in each scene mode.
比如，设定语音通话情景模式下的滤波带宽为300HZ至4000HZ，设定音乐情景模式下的滤波带宽为80HZ至1000HZ，则在处于语音通话情景模式下，对环境底噪信号进行300HZ至4000HZ的带通滤波，以保留300HZ至4000HZ的环境底噪信号，在处于音乐情景模式下，对环境底噪信号进行80HZ至1000HZ的带通滤波，以保留80HZ至1000HZ的环境底噪信号。For example, if the filter bandwidth is set to 300HZ to 4000HZ in the voice call scene mode, and the filter bandwidth is set to 80HZ to 1000HZ in the music scene mode, then in the voice call scene mode, the background noise signal of the environment is 300HZ to 4000HZ. Band-pass filtering to retain the ambient noise floor signal from 300HZ to 4000HZ. In the music scene mode, band-pass filter the ambient noise floor signal from 80HZ to 1000HZ to retain the ambient noise floor signal from 80HZ to 1000HZ.
本实施例提出的声音信号处理方法，通过确定当前增益调控周期内所述第一声音信号的情景模式；根据情景模式对环境底噪信号进行带通滤波，避免了其他频率范围的环境底噪信号对第一增益的结果的干扰，由此提高了第一增益的结果的精准度。The sound signal processing method proposed in this embodiment, by determining the scene mode of the first sound signal in the current gain control cycle; according to the scene mode, the environmental background noise signal is band-pass filtered to avoid the environmental background noise signal in other frequency ranges Interference with the result of the first gain, thereby improving the accuracy of the result of the first gain.
下面对本申请实施例提供的声音信号处理装置进行描述，下文描述的声音信号处理装置与上文描述的声音信号处理方法可相互对应参照。The sound signal processing device provided by the embodiment of the present application is described below, and the sound signal processing device described below and the sound signal processing method described above can be referred to in correspondence.
图5为本申请一个实施例提供的声音信号处理装置的结构示意图，如图5所示，该声音信号处理装置500包括：Fig. 5 is a schematic structural diagram of a sound signal processing device provided by an embodiment of the present application. As shown in Fig. 5, the sound signal processing device 500 includes:
获取单元510，用于获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；An
增益单元520，用于根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，其中，所述第一增益用于控制所述第一声音信号的入耳频响大于所述环境底噪信号的频响，且所述第一声音信号的泄露频响小于所述环境底噪信号的频响；The
调控单元530，用于根据所述第一增益对当前增益调控周期内所述扬声器播放的第一声音信号进行增益调控。The adjusting
在一些实施例中，增益单元520，还用于获取声隔离度及当前增益调控周期内所述第一声音信号的泄露频响；根据所述声隔离度、所述第一声音信号的泄露频响及所述环境底噪信号确定当前增益调控周期内所述第一声音信号的第一增益。In some embodiments, the
在一些实施例中，增益单元520，还用于确定当前增益调控周期内所述环境底噪信号的噪声能量；根据所述声隔离度、所述第一声音信号的泄露频响及所述噪声能量确定当前增益调控周期内所述第一声音信号的第一增益。In some embodiments, the
在一些实施例中，增益单元520，还用于对所述环境底噪信号进行分频，得到多个预设频带的目标环境底噪信号；确定各所述预设频段的目标声隔离度及各所述预设频段的所述第一声音信号的目标泄露频响；根据各所述预设频段的所述目标环境底噪信号、所述目标声隔离度及所述目标泄露频响确定当前增益调控周期内各所述预设频段的第一声音信号的第一增益。In some embodiments, the
在一些实施例中，增益单元520，还用于确定当前增益调控周期内所述第一声音信号的情景模式；根据所述情景模式对所述环境底噪信号进行带通滤波。In some embodiments, the
在一些实施例中，获取单元510，还用于根据当前增益调控周期内扬声器播放的第一声音信号对所述环境声音信号进行回声消除，得到环境底噪信号。In some embodiments, the obtaining
在一些实施例中，调控单元530，还用于确定上一增益调控周期的第二增益；根据所述第二增益对所述第一增益进行平滑，得的第三增益；根据所述第三增益对当前增益调控周期内所述扬声器播放的声音信号进行增益调控。In some embodiments, the
在此需要说明的是，本申请实施例提供的声音信号处理装置，能够实现上述声音信号处理方法实施例所实现的所有方法步骤，且能够达到相同的技术效果，在此不再对本实施例中与方法实施例相同的部分及有益效果进行具体赘述。What needs to be explained here is that the sound signal processing device provided in the embodiment of the present application can realize all the method steps implemented in the above sound signal processing method embodiment, and can achieve the same technical effect, and no further description is given here in this embodiment. The same parts and beneficial effects as those of the method embodiment will be described in detail.
图6为本申请提供的电子装置的结构示意图，如图6所示，该电子装置可以包括：处理器(Processor)610、通信接口(Communications Interface)620、存储器(Memory)630和通信总线(Communications Bus)640，其中，处理器610，通信接口620，存储器630通过通信总线640完成相互间的通信。处理器610可以调用存储器630中的逻辑命令，以执行如下方法：FIG. 6 is a schematic structural diagram of an electronic device provided by the present application. As shown in FIG. 6, the electronic device may include: a processor (Processor) 610, a communication interface (Communications Interface) 620, a memory (Memory) 630, and a communication bus (Communications Bus) 640, wherein, the
获取当前增益调控周期内麦克风采集的环境声音信号中的环境底噪信号；根据所述环境底噪信号确定当前增益调控周期内扬声器播放的第一声音信号的第一增益，其中，所述第一增益用于控制所述第一声音信号的入耳频响大于所述环境底噪信号的频响，且所述第一声音信号的泄露频响小于所述环境底噪信号的频响；根据所述第一增益对当前增益调控周期内所述扬声器播放的第一声音信号进行增益调控。Obtain the environmental noise floor signal in the environmental sound signal collected by the microphone in the current gain regulation cycle; determine the first gain of the first sound signal played by the speaker in the current gain regulation cycle according to the environmental noise floor signal, wherein the first The gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the environmental floor noise signal, and the leakage frequency response of the first sound signal is smaller than the frequency response of the environmental floor noise signal; according to the The first gain controls the gain of the first sound signal played by the loudspeaker in the current gain control cycle.
此外，上述的存储器630中的逻辑命令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干命令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。In addition, the above-mentioned logic commands in the
本申请实施例提供的电子装置中的处理器可以调用存储器中的逻辑指令，实现上述方法，其具体的实施方式与前述方法实施方式一致，且可以达到相同的有益效果，此处不再赘述。The processor in the electronic device provided by the embodiment of the present application can call the logic instructions in the memory to implement the above method, and its specific implementation mode is consistent with the above method implementation mode, and can achieve the same beneficial effect, so it will not be repeated here.
本申请实施例还提供一种计算机可读的存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现以执行上述各实施例提供的方法。An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and the computer program is implemented when executed by a processor to execute the methods provided in the foregoing embodiments.
其具体的实施方式与前述方法实施方式一致，且可以达到相同的有益效果，此处不再赘述。Its specific implementation mode is consistent with the aforementioned method implementation mode, and can achieve the same beneficial effect, and will not be repeated here.
本申请实施例提供一种计算机程序产品，包括计算机程序，计算机程序被处理器执行时实现如上述方法。An embodiment of the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, the foregoing method is implemented.
以上所描述的装置实施例仅仅是示意性的，其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下，即可以理解并实施。The device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network elements. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. It can be understood and implemented by those skilled in the art without any creative efforts.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the above description of the implementations, those skilled in the art can clearly understand that each implementation can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products can be stored in computer-readable storage media, such as ROM/RAM, magnetic discs, optical discs, etc., including several instructions to make a computer device (which may be a personal computer, server, or network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.
最后应说明的是：以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, rather than limiting them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present application.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211468994.0ACN116193321A (en) | 2022-11-22 | 2022-11-22 | Sound signal processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211468994.0ACN116193321A (en) | 2022-11-22 | 2022-11-22 | Sound signal processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116193321Atrue CN116193321A (en) | 2023-05-30 |
Family
ID=86433327
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211468994.0APendingCN116193321A (en) | 2022-11-22 | 2022-11-22 | Sound signal processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116193321A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117692843A (en)* | 2024-02-02 | 2024-03-12 | 江西斐耳科技有限公司 | Sound automatic adjusting method, system, storage medium and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10791389B1 (en)* | 2019-05-29 | 2020-09-29 | Facebook Technologies, Llc | Ear-plug assembly for acoustic conduction systems |
| WO2021114953A1 (en)* | 2019-12-12 | 2021-06-17 | 华为技术有限公司 | Voice signal acquisition method and apparatus, electronic device, and storage medium |
| US11212606B1 (en)* | 2019-12-31 | 2021-12-28 | Facebook Technologies, Llc | Headset sound leakage mitigation |
| CN113891205A (en)* | 2021-09-18 | 2022-01-04 | 恒玄科技(上海)股份有限公司 | Active noise reduction method and device for compensating earphone leakage and earphone |
| CN114374907A (en)* | 2021-12-29 | 2022-04-19 | 北京小米移动软件有限公司 | Sound playback method, device, audio playback device and medium |
- 2022
- 2022-11-22CNCN202211468994.0Apatent/CN116193321A/enactivePending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10791389B1 (en)* | 2019-05-29 | 2020-09-29 | Facebook Technologies, Llc | Ear-plug assembly for acoustic conduction systems |
| WO2021114953A1 (en)* | 2019-12-12 | 2021-06-17 | 华为技术有限公司 | Voice signal acquisition method and apparatus, electronic device, and storage medium |
| US11212606B1 (en)* | 2019-12-31 | 2021-12-28 | Facebook Technologies, Llc | Headset sound leakage mitigation |
| CN113891205A (en)* | 2021-09-18 | 2022-01-04 | 恒玄科技(上海)股份有限公司 | Active noise reduction method and device for compensating earphone leakage and earphone |
| CN114374907A (en)* | 2021-12-29 | 2022-04-19 | 北京小米移动软件有限公司 | Sound playback method, device, audio playback device and medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117692843A (en)* | 2024-02-02 | 2024-03-12 | 江西斐耳科技有限公司 | Sound automatic adjusting method, system, storage medium and electronic equipment |
| CN117692843B (en)* | 2024-02-02 | 2024-04-16 | 江西斐耳科技有限公司 | Sound automatic adjusting method, system, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12262184B2 (en) | Active noise cancellation method and apparatus | |
| CN108476256A (en) | A volume adjustment method and terminal | |
| CN111508510B (en) | Audio processing method and device, storage medium and electronic equipment | |
| CN106331257B (en) | A kind of noise cancellation method, device and communication equipment | |
| WO2015139642A1 (en) | Bluetooth headset noise reduction method, device and system | |
| JP2006139307A (en) | Apparatus and method having voice effect processing and noise control | |
| US9491545B2 (en) | Methods and devices for reverberation suppression | |
| CN112969115B (en) | Tone quality optimization method of wireless earphone and related equipment | |
| US20140236590A1 (en) | Communication apparatus and voice processing method therefor | |
| WO2021189309A1 (en) | Method and system for active noise reduction, electronic device, and chip | |
| CN101937682A (en) | A method and device for processing and answering voice | |
| CN109314814A (en) | Active denoising method and earphone | |
| CN108510997A (en) | Electronic equipment and echo cancellation method applied to electronic equipment | |
| CN116193321A (en) | Sound signal processing method, device, equipment and storage medium | |
| WO2023160286A1 (en) | Noise reduction parameter adaptation method and apparatus | |
| WO2023093412A1 (en) | Active noise cancellation method and electronic device | |
| CN114466278A (en) | Method for determining parameters corresponding to earphone mode, earphone, terminal and system | |
| CN113038318B (en) | A kind of voice signal processing method and device | |
| CN111863006B (en) | Audio signal processing method, audio signal processing device and earphone | |
| CN116048448B (en) | Audio playing method and electronic device | |
| CN116744169B (en) | Earphone device, sound signal processing method and wearing fit testing method | |
| CN114666700B (en) | Noise reduction earphone, earphone noise reduction method and storage medium | |
| CN111083250A (en) | Mobile terminal and noise reduction method thereof | |
| CN108833681A (en) | A kind of volume adjusting method and mobile terminal | |
| WO2023051622A1 (en) | Method for improving far-field speech interaction performance, and far-field speech interaction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information | Address after:No. B1337, Chuanggu Initiation Zone, Taizihu Cultural Digital Creative Industry Park, No. 18 Shenlong Avenue, Wuhan Economic and Technological Development Zone, Wuhan, Hubei Province, 430058 Applicant after:Hubei Xingji Meizu Technology Co.,Ltd. Address before:430014 No. b1337, chuanggu startup area, taizihu cultural Digital Creative Industry Park, No. 18, Shenlong Avenue, Wuhan Economic and Technological Development Zone, Wuhan, Hubei Province Applicant before:Hubei Xingji times Technology Co.,Ltd. |