CN111696513A - Audio signal processing method and device, electronic equipment and storage medium - Google Patents
Audio signal processing method and device, electronic equipment and storage mediumDownload PDFInfo
- Publication number
- CN111696513A CN111696513ACN202010425184.1ACN202010425184ACN111696513ACN 111696513 ACN111696513 ACN 111696513ACN 202010425184 ACN202010425184 ACN 202010425184ACN 111696513 ACN111696513 ACN 111696513A
- Authority
- CN
- China
- Prior art keywords
- signal
- noise
- sound source
- noise reduction
- source position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K11/00—Methods or devices for transmitting, conducting or directing sound in general; Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/16—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general
- G10K11/175—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound
- G10K11/178—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase
- G10K11/1781—Methods or devices for protecting against, or for damping, noise or other acoustic waves in general using interference effects; Masking sound by electro-acoustically regenerating the original acoustic waves in anti-phase characterised by the analysis of input or output signals, e.g. frequency range, modes, transfer functions
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Soundproofing, Sound Blocking, And Sound Damping (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本公开涉及音频处理技术领域，具体而言，涉及一种音频信号处理方法、音频信号处理装置、电子设备以及计算机可读存储介质。The present disclosure relates to the technical field of audio processing, and in particular, to an audio signal processing method, an audio signal processing apparatus, an electronic device, and a computer-readable storage medium.
背景技术Background technique
目前，电子设备(例如，智能终端、头戴设备等)在人们的生活中应用越来越广泛。电子设备在工作中产生较多的热量，虽然可以通过散热风扇进行散热，但是该过程中将会产生噪声，影响用户体验。并且，相关技术中降噪的效果较差。At present, electronic devices (eg, smart terminals, head-mounted devices, etc.) are more and more widely used in people's lives. Electronic equipment generates a lot of heat during operation. Although it can be dissipated by a cooling fan, noise will be generated during this process, which will affect the user experience. Also, the noise reduction effect in the related art is poor.
发明内容SUMMARY OF THE INVENTION
本公开的目的在于提供一种音频信号处理方法、音频信号处理装置、电子设备以及计算机可读存储介质，进而在一定程度上克服由于相关技术的限制和缺陷而导致的降噪效果较差的问题。The purpose of the present disclosure is to provide an audio signal processing method, an audio signal processing apparatus, an electronic device, and a computer-readable storage medium, so as to overcome the problem of poor noise reduction effect caused by the limitations and defects of the related art to a certain extent .
根据本公开的第一方面，提供一种音频信号处理方法，包括：According to a first aspect of the present disclosure, there is provided an audio signal processing method, comprising:
获取噪声信号，并确定所述噪声信号的声源位置参数；Acquiring a noise signal, and determining a sound source location parameter of the noise signal;
利用所述噪声信号，确定与所述噪声信号频率相同、相位相反的反相降噪信号；Using the noise signal, determine an anti-phase noise reduction signal with the same frequency and opposite phase as the noise signal;
根据所述声源位置参数以及所述反相降噪信号，得到并输出多个声道的降噪信号；obtaining and outputting noise reduction signals of multiple channels according to the sound source position parameter and the inverse noise reduction signal;
其中，所述多个声道的降噪信号在用户侧叠加时对应的声源位置与所述噪声信号的声源位置相同。Wherein, when the noise reduction signals of the multiple channels are superimposed on the user side, the corresponding sound source positions are the same as the sound source positions of the noise signal.
根据本公开的第二方面，提供一种音频信号处理装置，包括：According to a second aspect of the present disclosure, there is provided an audio signal processing apparatus, comprising:
噪声信号获取模块，用于获取噪声信号；Noise signal acquisition module, used to acquire noise signal;
声源位置确定模块，用于确定所述噪声信号的声源位置参数；a sound source position determination module, used for determining the sound source position parameter of the noise signal;
信号处理模块，用于利用所述噪声信号，确定与所述噪声信号频率相同、相位相反的反相降噪信号；a signal processing module, configured to use the noise signal to determine an anti-phase noise reduction signal with the same frequency and opposite phase as the noise signal;
多声道信号确定模块，用于根据所述声源位置参数以及所述反相降噪信号，得到多个声道的降噪信号；其中，所述多个声道的降噪信号在用户侧叠加时对应的声源位置与所述噪声信号的声源位置相同；a multi-channel signal determination module, configured to obtain noise reduction signals of multiple channels according to the sound source position parameter and the inverse noise reduction signal; wherein the noise reduction signals of the multiple channels are on the user side The corresponding sound source position when superimposed is the same as the sound source position of the noise signal;
信号输出模块，用于分别输出所述多个声道的降噪信号。A signal output module, configured to output the noise reduction signals of the multiple channels respectively.
根据本公开的第三方面，提供一种电子设备，包括：处理器；以及存储器，用于存储所述处理器的可执行指令；其中，所述处理器配置为经由执行所述可执行指令来执行上述音频信号处理方法。According to a third aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the executable instructions to The above-described audio signal processing method is performed.
根据本公开的第四方面，提供一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现上述音频信号处理方法。According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, the computer program implementing the above audio signal processing method when executed by a processor.
本公开示例性实施例可以具有以下部分或全部有益效果：Exemplary embodiments of the present disclosure may have some or all of the following benefits:
在本公开的一示例实施方式所提供的音频信号处理方法中，在确定噪声信号的位置以及反相降噪信号后，生成多个声道的降噪信号。如果用户只接收多个声道的降噪信号，可以使用户更立体地感觉到是从噪声信号的位置传过来的。这样，用户同时接收噪声信号和多个声道的降噪信号时，噪声信号和降噪信号进行叠加时可以达到最佳的降噪效果，从而可以提升用户体验。In the audio signal processing method provided by an exemplary embodiment of the present disclosure, after determining the position of the noise signal and inverting the noise reduction signal, noise reduction signals of multiple channels are generated. If the user only receives noise reduction signals of multiple channels, it can make the user feel more three-dimensionally that the noise signal is transmitted from the position of the noise signal. In this way, when the user simultaneously receives the noise signal and the noise reduction signal of multiple channels, the best noise reduction effect can be achieved when the noise signal and the noise reduction signal are superimposed, thereby improving the user experience.
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本公开。It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。显而易见地，下面描述中的附图仅仅是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1示出了本公开实施例中电子设备的结构示意图；FIG. 1 shows a schematic structural diagram of an electronic device in an embodiment of the present disclosure;
图2示出了头戴设备各区域的温度分布示意图；FIG. 2 shows a schematic diagram of the temperature distribution of each area of the head-mounted device;
图3示出了本公开实施例中音频信号处理方法的一种流程图；FIG. 3 shows a flowchart of an audio signal processing method in an embodiment of the present disclosure;
图4示出了声波叠加的一种示意图；Fig. 4 shows a kind of schematic diagram of sound wave superposition;
图5示出了本公开实施例中麦克风、扬声器和人头模型的位置关系示意图；FIG. 5 shows a schematic diagram of the positional relationship between a microphone, a speaker, and a human head model in an embodiment of the present disclosure;
图6示出了本公开实施例中音频信号处理装置的一种结构示意图。FIG. 6 shows a schematic structural diagram of an audio signal processing apparatus in an embodiment of the present disclosure.
具体实施方式Detailed ways
现在将参考附图更全面地描述示例实施方式。然而，示例实施方式能够以多种形式实施，且不应被理解为限于在此阐述的范例；相反，提供这些实施方式使得本公开将更加全面和完整，并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。在下面的描述中，提供许多具体细节从而给出对本公开的实施方式的充分理解。然而，本领域技术人员将意识到，可以实践本公开的技术方案而省略所述特定细节中的一个或更多，或者可以采用其它的方法、组元、装置、步骤等。在其它情况下，不详细示出或描述公知技术方案以避免喧宾夺主而使得本公开的各方面变得模糊。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be employed. In other instances, well-known solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
此外，附图仅为本公开的示意性图解，并非一定是按比例绘制。图中相同的附图标记表示相同或类似的部分，因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体，不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体，或在一个或多个硬件模块或集成电路中实现这些功能实体，或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted. Some of the block diagrams shown in the figures are functional entities that do not necessarily necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
图1示出了本公开实施例中电子设备的结构示意图。需要说明的是，图1示出的电子设备100仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。FIG. 1 shows a schematic structural diagram of an electronic device in an embodiment of the present disclosure. It should be noted that the electronic device 100 shown in FIG. 1 is only an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
如图1所示，电子设备100包括：处理器110、音频模块120、扬声器121、受话器122、麦克风123、耳机接口124、通用串行总线接口130、充电管理模块140、电源管理模块141、电池142、传感器模块150、显示模块160、摄像模组170、内部存储器180、外部存储器接口190。As shown in FIG. 1 , the electronic device 100 includes: a processor 110, an
可以理解的是，本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中，电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件、软件或软件和硬件的组合实现。It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器、调制解调处理器、图形处理器、图像信号处理器、控制器、视频编解码器、数字信号处理器、基带处理器和/或神经网络处理器等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor, a modem processor, a graphics processor, an image signal processor, a controller, a video codec, a digital signal processor , baseband processor and/or neural network processor, etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
处理器110可以通过集成电路内置音频总线与音频模块120耦合，实现处理器110与音频模块120之间的通信。电子设备100可以通过音频模块120、扬声器121、受话器122、麦克风123、耳机接口124及应用处理器等实现音频功能。例如音乐播放、录音等。The processor 110 may be coupled with the
音频模块120用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块120还可以用于对音频信号编码和解码。在一些实施例中，音频模块120可以设置于处理器110中，或将音频模块120的部分功能模块设置于处理器110中。The
扬声器121，也称“喇叭”，用于将音频电信号转换为声音信号。电子设备100可以通过扬声器121收听音乐，或收听免提通话。The speaker 121, also called "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 121, or listen to a hands-free call.
受话器122，也称“听筒”，用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时，可以通过将受话器122靠近人耳接听语音。The receiver 122, also referred to as an "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 122 close to the human ear.
麦克风123，也称“话筒”、“传声器”，用于将声音信号转换为电信号。当拨打电话或发送语音信息时，用户可以通过人嘴靠近麦克风123发声，将声音信号输入到麦克风123。电子设备100可以设置至少一个麦克风123。在另一些实施例中，电子设备100可以设置两个麦克风123，除了采集声音信号，还可以实现降噪功能。在另一些实施例中，电子设备100还可以设置三个、四个或更多麦克风123，实现采集声音信号，降噪，还可以识别声音来源，实现定向录音功能等。The microphone 123, also referred to as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 123 through a human mouth, and input the sound signal into the microphone 123 . The electronic device 100 may be provided with at least one microphone 123 . In other embodiments, the electronic device 100 may be provided with two microphones 123, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further be provided with three, four or more microphones 123 to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.
耳机接口124用于连接有线耳机。耳机接口124可以是USB(Universal SerialBus，通用串行总线)接口130，也可以是3.5mm的开放移动电子设备平台(Open MobileTerminal Platform，OMTP)标准接口，美国蜂窝电信工业协会(CellularTelecommunications Industry Association of the USA，CTIA)标准接口。The earphone jack 124 is used to connect wired earphones. The earphone interface 124 can be a USB (Universal Serial Bus, Universal Serial Bus) interface 130, or can be a 3.5mm Open Mobile Terminal Platform (Open Mobile Terminal Platform, OMTP) standard interface, the Cellular Telecommunications Industry Association of the United States USA, CTIA) standard interface.
通用串行总线接口130是符合USB标准规范的接口，具体可以是MiniUSB接口，MicroUSB接口，USBTypeC接口等。通用串行总线接口130可以用于连接充电器为电子设备100充电，也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如头戴设备等。The universal serial bus interface 130 is an interface conforming to the USB standard specification, and may specifically be a MiniUSB interface, a MicroUSB interface, a USBTypeC interface, and the like. The universal serial bus interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as head-mounted devices.
充电管理模块140用于从充电器接收充电输入。其中，充电器可以是无线充电器，也可以是有线充电器。电源管理模块141用于连接电池142、充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110、内部存储器121、显示模块160、摄像模组170等供电。The
显示模块160用于显示图像、视频等，摄像模组170用于捕获静态图像或视频。The display module 160 is used to display images, videos, etc., and the camera module 170 is used to capture still images or videos.
作为另一方面，本申请还提供了一种计算机可读存储介质，该计算机可读存储介质可以是上述实施例中描述的电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。上述计算机可读存储介质承载有一个或者多个计算机程序，当上述一个或者多个计算机程序被一个该电子设备执行时，使得该电子设备实现如下述实施例中所述的方法。例如，所述的电子设备可以实现如图3所示的各个步骤等。As another aspect, the present application also provides a computer-readable storage medium. The computer-readable storage medium may be included in the electronic device described in the above embodiments; in electronic equipment. The above-mentioned computer-readable storage medium carries one or more computer programs, and when the above-mentioned one or more computer programs are executed by an electronic device, the electronic device enables the electronic device to implement the methods described in the following embodiments. For example, the electronic device can implement the various steps shown in FIG. 3 and the like.
需要说明的是，本公开所示的计算机可读存储介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器、只读存储器、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读存储介质，该计算机可读存储介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读存储介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：无线、电线、光缆、射频等等，或者上述的任意合适的组合。It should be noted that the computer-readable storage medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory, read only memory, erasable programmable read only memory (EPROM) or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable storage medium other than a computer-readable storage medium that can be sent, propagated, or transmitted for use by or in connection with the instruction execution system, apparatus, or device program of. Program code embodied on a computer-readable storage medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, radio frequency, etc., or any suitable combination of the foregoing.
以下对本公开实施例的技术方案进行详细阐述：The technical solutions of the embodiments of the present disclosure are described in detail below:
随着电子设备的发展，智能终端、头戴设备等可以实现越来越多的功能，给用户提供较好的使用体验。例如，VR(Virtual Reality，虚拟现实)可以通过3D计算机模型或者模拟技术，给用户带来强烈的视觉感知和沉浸感的技术。与之对应的还有AR(AugmentedReality，增强现实)技术，AR技术是一种将虚拟信息与真实世界巧妙融合的技术，广泛运用了多媒体、三维建模、实时跟踪及注册、智能交互、传感等多种技术手段，将计算机生成的文字、图像、三维模型、音乐、视频等虚拟信息模拟仿真后，应用到真实世界中，两种信息互为补充，从而实现对真实世界的“增强”。With the development of electronic devices, smart terminals, head-mounted devices, etc. can realize more and more functions, and provide users with a better use experience. For example, VR (Virtual Reality, virtual reality) can bring users a strong visual perception and immersion technology through 3D computer model or simulation technology. Corresponding to it is AR (Augmented Reality, Augmented Reality) technology. AR technology is a technology that skillfully integrates virtual information with the real world. It widely uses multimedia, 3D modeling, real-time tracking and registration, intelligent interaction, sensing After simulating and simulating virtual information such as computer-generated text, images, 3D models, music, and videos, and applying it to the real world, the two kinds of information complement each other, thereby realizing the "enhancement" of the real world.
用户在使用AR/VR时，通常都戴在头部，因此可以统称为头戴设备。AR/VR等头戴设备都需要通过计算机虚拟呈现出2D/3D图像，尤其是AR技术，还需要融合现实的环境。因此，需要消耗较大的计算资源，较大的计算量将导致较大的功耗以及较高的发热。用户在使用电子设备时，与皮肤近距离接触，任意一点温度的上升都会被用户感知到，对用户体验产生较大的影响。When users use AR/VR, they are usually worn on the head, so they can be collectively referred to as headsets. AR/VR and other head-mounted devices need to virtually present 2D/3D images through a computer, especially AR technology, and also need to integrate the real environment. Therefore, a large amount of computing resources needs to be consumed, and a large amount of computation will lead to large power consumption and high heat generation. When a user is using an electronic device and is in close contact with the skin, the temperature rise at any point will be perceived by the user, which will have a greater impact on the user experience.
例如，某AR眼镜虽然为分体式眼镜，但是该AR眼镜在使用时整机的热量非常大。从图2可以看到，在靠近用户额头的位置温度最高，在实测时温度可以达到47摄氏度，用户能明显感觉到发热，影响用户体验。For example, although a certain AR glasses are split glasses, the heat of the whole machine is very large when the AR glasses are in use. As can be seen from Figure 2, the temperature near the user's forehead is the highest, and the temperature can reach 47 degrees Celsius during the actual measurement. The user can obviously feel the heat, which affects the user experience.
目前，散热方式包括：被动散热和主动散热。为了达到较好的散热效果，降低头戴设备的工作温度。在整体散热体积一定的情况下，被动散热无法达到预定温度时，可以采用主动散热的方式。主动散热可以使用增加散热风扇的方式，通过风扇转动产生空气对流，从而通过空气的流动带走热量。然而，散热风扇时属于机械结构，风扇转动时由于机械摩擦、振动以及空气流动等会产生较大的噪声，尤其是当风扇转速增加时，噪声更加明显。At present, the cooling methods include passive cooling and active cooling. In order to achieve better heat dissipation, reduce the operating temperature of the headset. When the overall heat dissipation volume is certain, and the passive heat dissipation cannot reach the predetermined temperature, the active heat dissipation method can be adopted. Active cooling can use the method of adding a cooling fan to generate air convection through the rotation of the fan, so as to remove heat through the flow of air. However, the cooling fan belongs to a mechanical structure, and when the fan rotates, it will generate larger noise due to mechanical friction, vibration and air flow, especially when the fan speed increases, the noise is more obvious.
并且，头戴设备是佩戴在头部使用，距离人耳更近，这些风扇的噪音更容易被人耳察觉，将严重影响用户的整机体验。同样地，对于智能手机，在工作时间较长的情况下，温度也会较高，在通过散热风扇进行散热时，也会产生较大的噪音，影响用户体验。In addition, the headset is worn on the head and is closer to the human ear. The noise of these fans is more easily detected by the human ear, which will seriously affect the user's overall experience. Similarly, for smartphones, when the working time is long, the temperature will be higher, and when the cooling fan is used to dissipate heat, a larger noise will also be generated, which will affect the user experience.
为了解决上述问题，本公开提供了一种音频信号处理方法、音频信号处理装置、电子设备以及计算机可读存储介质，可以提高降噪的效果。In order to solve the above problems, the present disclosure provides an audio signal processing method, an audio signal processing apparatus, an electronic device, and a computer-readable storage medium, which can improve the effect of noise reduction.
参见图3，图3示出了本公开实施例中音频信号处理方法的一种流程图，可以包括以下步骤：Referring to FIG. 3, FIG. 3 shows a flowchart of an audio signal processing method in an embodiment of the present disclosure, which may include the following steps:
步骤S310，获取噪声信号，并确定噪声信号的声源位置参数。In step S310, a noise signal is acquired, and a sound source location parameter of the noise signal is determined.
步骤S320，利用噪声信号，确定与噪声信号频率相同、相位相反的反相降噪信号。Step S320, using the noise signal to determine an anti-phase noise reduction signal with the same frequency and opposite phase as the noise signal.
步骤S330，根据声源位置参数以及反相降噪信号，得到并输出多个声道的降噪信号；其中，多个声道的降噪信号在用户侧叠加时对应的声源位置与噪声信号的声源位置相同。Step S330, obtaining and outputting the noise reduction signals of multiple channels according to the sound source position parameter and the inverse noise reduction signal; wherein, the corresponding sound source positions and noise signals when the noise reduction signals of the multiple channels are superimposed on the user side The sound source position is the same.
本公开实施例的音频信号处理方法中，在确定噪声信号的位置以及反相降噪信号后，生成多个声道的降噪信号。如果用户只接收多个声道的降噪信号，可以使用户更立体地感觉到是从噪声信号的位置传过来的。这样，用户同时接收噪声信号和多个声道的降噪信号时，噪声信号和降噪信号进行叠加时可以达到最佳的降噪效果，从而可以提升用户体验。In the audio signal processing method according to the embodiment of the present disclosure, after determining the position of the noise signal and inverting the noise reduction signal, noise reduction signals of multiple channels are generated. If the user only receives noise reduction signals of multiple channels, it can make the user feel more three-dimensionally that the noise signal is transmitted from the position of the noise signal. In this way, when the user simultaneously receives the noise signal and the noise reduction signal of multiple channels, the best noise reduction effect can be achieved when the noise signal and the noise reduction signal are superimposed, thereby improving the user experience.
以下对本公开实施例的音频信号处理方法进行更加详细的介绍。The audio signal processing method according to the embodiment of the present disclosure will be introduced in more detail below.
在步骤S310中，获取噪声信号，并确定噪声信号的声源位置参数。In step S310, a noise signal is acquired, and a sound source location parameter of the noise signal is determined.
本公开实施例中，噪声信号可以包括散热风扇产生的噪声信号，或者，也可以包括其他噪声信号。噪声信号的数量可以是一个或多个，由于针对每个噪声信号的处理方式相同，在对每个噪声信号进行处理之后，将每个噪声信号对应的输出信号与其他噪声信号对应的输出信号分别进行叠加即可。当然，为了降低计算量，也可以先确定多个噪声信号的强度，对信号强度较大的一个或多个噪声信号进行降噪处理。In this embodiment of the present disclosure, the noise signal may include a noise signal generated by a cooling fan, or may also include other noise signals. The number of noise signals can be one or more. Since the processing method for each noise signal is the same, after each noise signal is processed, the output signal corresponding to each noise signal and the output signals corresponding to other noise signals are separated. It can be superimposed. Of course, in order to reduce the amount of calculation, the strengths of multiple noise signals may also be determined first, and noise reduction processing is performed on one or more noise signals with larger signal strengths.
具体的，本公开可以通过拾音模块采集噪声信号，拾音模块可以是麦克风等。麦克风采集的噪声信号，可以是模拟信号，也可以是数字信号。当采集模拟信号时，拾音模块里面还可以包括信号的滤波、放大、模数转换电路。当采集数字信号时，可以直接输出数字信号。Specifically, the present disclosure can collect noise signals through a sound pickup module, and the sound pickup module can be a microphone or the like. The noise signal collected by the microphone can be an analog signal or a digital signal. When collecting analog signals, the pickup module may also include signal filtering, amplification, and analog-to-digital conversion circuits. When collecting digital signals, digital signals can be output directly.
麦克风采集到噪声信号后，可以将噪声信号输出至处理器。处理器可以根据麦克风采集到的噪声信号确定噪声信号的声源位置参数，声源位置参数表示噪声信号所在位置的相关参数，可以包括：噪声信号与采集信号时所在位置之间的距离、水平方位角、仰角等。例如，可以基于波束形成的方法，或者基于高分辨率谱估计的方法，或者基于声达时延差的方法来确定噪声信号的位置。After the microphone collects the noise signal, the noise signal can be output to the processor. The processor can determine the sound source position parameter of the noise signal according to the noise signal collected by the microphone, and the sound source position parameter represents the relevant parameters of the position of the noise signal, which can include: the distance between the noise signal and the position when the signal is collected, the horizontal azimuth angle, elevation, etc. For example, the location of the noise signal may be determined based on a beamforming method, or a high resolution spectral estimation based method, or a sound arrival delay difference based method.
在本公开的一种实现方式中，可以分别从多个不同方向采集噪声信号，根据采集到的噪声信号以及从多个不同方向采集噪声信号时的相对位置，确定噪声信号的声源位置参数。例如，多个麦克风可以分布在头戴设备的不同位置，对于某个位置产生的噪声，各个麦克风可以从不同的方向进行采集，距离噪声较近的麦克风采集到的噪声信号的强度较大，距离噪声较远的麦克风采集到的噪声信号的强度较小，可以根据采集到的噪声信号的强度，以及各个麦克风的相对位置确定噪声的位置。In an implementation manner of the present disclosure, noise signals may be collected from multiple different directions, respectively, and sound source location parameters of the noise signals may be determined according to the collected noise signals and the relative positions of the noise signals collected from multiple different directions. For example, multiple microphones can be distributed in different positions of the headset. For noise generated at a certain position, each microphone can collect from different directions. The intensity of the noise signal collected by the farther noise microphone is smaller, and the position of the noise can be determined according to the intensity of the collected noise signal and the relative position of each microphone.
再比如，距离噪声较近的麦克风采集到噪声信号花费的时间较短，距离噪声较远的麦克风采集到噪声信号花费的时间较长，可以根据两者之间的时间差，以及两者之间的相对位置确定噪声的位置。需要说明的是，本公开实施例中，通过两个麦克风采集噪声信号即可确定噪声的位置。当然，也可以使用更多个麦克风确定噪声的位置，以提高所确定的噪声位置的准确性。For another example, it takes a short time for the microphone that is closer to the noise to collect the noise signal, and the microphone that is farther away from the noise takes a longer time to collect the noise signal. The relative position determines the location of the noise. It should be noted that, in this embodiment of the present disclosure, the position of the noise can be determined by collecting noise signals through two microphones. Of course, more microphones can also be used to determine the location of the noise, so as to improve the accuracy of the determined noise location.
本公开实施例中，在一些场景下，例如，散热风扇产生的噪声等，是可以直接获取的。在另一些场景下，也可以采集原始音频信号，原始音频信号可以是噪声信号和用户实际想要获取的音频信号的叠加。然后从原始音频信号中提取出噪声信号，并通过本公开实施例的方法进行降噪。In the embodiments of the present disclosure, in some scenarios, for example, noise generated by a cooling fan, etc., can be directly obtained. In other scenarios, the original audio signal may also be collected, and the original audio signal may be the superposition of the noise signal and the audio signal that the user actually wants to acquire. Then, the noise signal is extracted from the original audio signal, and noise reduction is performed by the method of the embodiment of the present disclosure.
在步骤S320中，利用噪声信号，确定与噪声信号频率相同、相位相反的反相降噪信号。In step S320, using the noise signal, an anti-phase noise reduction signal with the same frequency and opposite phase as the noise signal is determined.
可以理解的是，噪声信号是一种声波。对于任一声波，将其与反相声波进行叠加之后，可以相互抵消，反相声波与该声波的相位相差180°。参见图4，图4示出了声波叠加的一种示意图，可以看出，原声波在和反相声波叠加之后相互抵消。因此，为了将噪声信号消除，也就是使用户感受不到噪声信号，可以确定噪声信号对应的反相降噪信号。Understandably, the noise signal is a sound wave. For any sound wave, after superimposing it and the anti-phase sound wave, they can cancel each other, and the phase difference between the anti-phase sound wave and the sound wave is 180°. Referring to FIG. 4 , FIG. 4 shows a schematic diagram of the superposition of sound waves, and it can be seen that the original sound waves cancel each other after being superimposed with the anti-phase sound waves. Therefore, in order to eliminate the noise signal, that is, to prevent the user from feeling the noise signal, an inverse noise reduction signal corresponding to the noise signal may be determined.
在步骤S330中，根据声源位置参数以及反相降噪信号，得到并输出多个声道的降噪信号；其中，多个声道的降噪信号在用户侧叠加时对应的声源位置与噪声信号的声源位置相同。In step S330, according to the sound source position parameter and the anti-phase noise reduction signal, the noise reduction signals of multiple channels are obtained and output; wherein, when the noise reduction signals of the multiple channels are superimposed on the user side, the corresponding sound source positions are the same as The sound source position of the noise signal is the same.
本公开实施例中，声道的数量可以是2个，例如，左声道和右声道。为了使降噪效果更好，也可以是更多个声道，在此不做限定。由于人类是通过双耳线索感知声音源以确定方位角和位置的，双耳线索包括：双耳时间差和双耳音强差。这些对于声音的具体影响可以称为头部相关传递函数，因此，在本公开的一种实现方式中，可以基于声源位置参数以及头部相关传递函数，对反相降噪信号的音频参数进行调节，得到音频参数不同的多个声道的降噪信号。In this embodiment of the present disclosure, the number of channels may be 2, for example, a left channel and a right channel. In order to make the noise reduction effect better, there may also be more channels, which is not limited here. Since humans perceive sound sources to determine azimuth and position through binaural cues, binaural cues include: binaural time difference and binaural sound intensity difference. These specific effects on the sound may be referred to as head-related transfer functions. Therefore, in an implementation manner of the present disclosure, the audio parameters of the inverse noise reduction signal may be processed based on the sound source position parameter and the head-related transfer function. Adjust to obtain noise reduction signals of multiple channels with different audio parameters.
其中，音频参数可以包括：信号强度、相位等信息。例如，可以配置两个独立的音频通道，然后通过基于对象的方式来实现环绕声。在一个基于对象的系统中，不同的音频元素可以根据声源位置参数和混音时的矢量信息进行编码。结合头部相关传递函数，以通过标准的立体声通道输出，以达到在特定位置产生声音的目的。The audio parameters may include information such as signal strength and phase. For example, you can configure two independent audio channels and then implement surround sound in an object-based manner. In an object-based system, different audio elements can be encoded based on sound source location parameters and vector information during mixing. Combined with head-related transfer functions to output through standard stereo channels for the purpose of producing sounds at specific locations.
需要说明的是，头部相关传递函数可以通过实验的方式建立，即可以通过实验的方式确定头部相关传递函数中的参数值。在不同的场景下，对应的头部相关传递函数可以相同，也可以不同。It should be noted that the head-related transfer function can be established through experiments, that is, parameter values in the head-related transfer function can be determined through experiments. In different scenarios, the corresponding head-related transfer functions may be the same or different.
本公开实施例中，对于已建立的头部相关传递函数，用户在实际使用之前，还可以对其进行调节，以更好地适用于用户。例如，用户在使用时，可以先展示一个参数调节的界面，该界面用于提示用户执行具体的操作。用户在该界面上执行相应的操作后，电子设备可以接收到对应的校正指令，响应于校正指令，可以对头部相关传递函数中的参数进行调节。In the embodiment of the present disclosure, for the established head-related transfer function, the user can also adjust it before actually using it, so as to be more suitable for the user. For example, when a user is using, a parameter adjustment interface may be displayed first, and the interface is used to prompt the user to perform a specific operation. After the user performs the corresponding operation on the interface, the electronic device can receive the corresponding correction instruction, and in response to the correction instruction, can adjust the parameters in the head-related transfer function.
本公开实施例中，除了根据头部相关传递函数对反相降噪信号的音频参数进行调节之外，也可以通过其他方法进行处理。例如，可以预先建立声场模型，并通过声场模型进行处理，该声场模型可以通过神经网络算法训练得到。In the embodiment of the present disclosure, in addition to adjusting the audio parameters of the inverse noise reduction signal according to the head-related transfer function, other methods may also be used for processing. For example, a sound field model can be established in advance and processed through the sound field model, and the sound field model can be obtained by training a neural network algorithm.
在得到多个声道的降噪信号，可以驱动多个扬声器分别输出单个声道的降噪信号。参见图5，图5示出了本公开实施例中麦克风、扬声器和人头模型的位置关系示意图。可以看出，在人头模型的左右两边各有一个麦克风和扬声器，两个麦克风用于采集噪声信号，两个扬声器可以用于分别输出左声道的降噪信号和右声道的降噪信号。这样，假设单纯存在左声道的降噪信号和右声道的降噪信号时，用户的直观感受是，降噪信号是从特定位置(即噪声信号所在位置)传过来的。降噪信号与噪声信号进行叠加之后，可以将噪声消除，达到较好的降噪效果。例如，对于上述头戴设备而言，在进行散热时，可以在不需要降低风扇转速的情况下有效地降低了风扇的噪声，实现静音散热。After the noise reduction signals of multiple channels are obtained, multiple speakers can be driven to output the noise reduction signals of a single channel respectively. Referring to FIG. 5 , FIG. 5 shows a schematic diagram of the positional relationship between a microphone, a speaker, and a human head model in an embodiment of the present disclosure. It can be seen that there is a microphone and a speaker on the left and right sides of the human head model. The two microphones are used to collect noise signals, and the two speakers can be used to output the noise reduction signal of the left channel and the noise reduction signal of the right channel respectively. In this way, assuming that the noise reduction signal of the left channel and the noise reduction signal of the right channel only exist, the user's intuitive feeling is that the noise reduction signal is transmitted from a specific position (ie, the position where the noise signal is located). After the noise reduction signal and the noise signal are superimposed, the noise can be eliminated to achieve a better noise reduction effect. For example, for the above-mentioned head-mounted device, when heat dissipation is performed, the noise of the fan can be effectively reduced without the need to reduce the rotational speed of the fan, thereby realizing silent heat dissipation.
本公开实施例中，针对每个声道，在输出该声道的降噪信号时，可以将该声道的降噪信号和该声道的待输出音频信号进行叠加输出，也就是多个声道中每个声道的降噪信号可以是与对应声道的待输出音频信号叠加之后输出的。例如，在输出左声道的降噪信号和右声道的降噪信号时，可以将左声道的降噪信号和左声道的待输出音频信号进行叠加输出，将右声道的降噪信号和右声道的待输出音频信号进行叠加输出。In the embodiment of the present disclosure, for each channel, when the noise reduction signal of the channel is output, the noise reduction signal of the channel and the to-be-output audio signal of the channel may be superimposed and output, that is, multiple sound The noise reduction signal of each channel in the channel may be output after being superimposed with the to-be-output audio signal of the corresponding channel. For example, when outputting the noise reduction signal of the left channel and the noise reduction signal of the right channel, the noise reduction signal of the left channel and the to-be-output audio signal of the left channel can be superimposed and output, and the noise reduction signal of the right channel can be superimposed and output. The signal and the audio signal of the right channel to be output are superimposed and output.
其中，待输出音频信号是用户实际要接收的音频信号，例如，可以是游戏中的音频信号、电影中的音频信号等。将降噪信号与待输出音频信号进行叠加输出，再与噪声信号进行叠加，用户可以接收到不包含其他信号的待输出音频信号。The to-be-output audio signal is an audio signal that the user actually wants to receive, for example, it may be an audio signal in a game, an audio signal in a movie, and the like. The noise reduction signal and the audio signal to be output are superimposed and output, and then superimposed with the noise signal, and the user can receive the audio signal to be output that does not contain other signals.
需要说明的是，不同时刻噪声信号的强度可能不同，在降噪的时候，可以通过本公开实施例的音频信号处理方法实时进行处理，并实时调整扬声器的输出，形成反馈机制。It should be noted that the intensity of the noise signal may be different at different times. During noise reduction, the audio signal processing method of the embodiment of the present disclosure can be used for real-time processing, and the output of the speaker is adjusted in real time to form a feedback mechanism.
可以理解的是，噪声信号可以是电子设备内部产生的，也可以是电子设备之外的其他设备产生的，即不管噪声信号的位置在哪里，电子设备均可以通过扬声器输出对应的降噪信号，并且可以达到较好的降噪效果。因此，本公开实施例的音频信号处理方法除了可以适用于头戴设备之外，还可以适用于其他电子设备，例如智能手机、笔记本电脑等。It can be understood that the noise signal can be generated inside the electronic device, or it can be generated by other devices outside the electronic device, that is, no matter where the noise signal is located, the electronic device can output the corresponding noise reduction signal through the speaker, And can achieve better noise reduction effect. Therefore, the audio signal processing method of the embodiment of the present disclosure can be applied to other electronic devices, such as smart phones, notebook computers, and the like, in addition to head mounted devices.
举例而言，对于笔记本电脑，在用户使用时间较长时，发热比较严重，用户可以在底部放置一个散热风扇，散热风扇转动时产生较大的噪音，此时可以通过本公开实施例的音频信号处理方法进行降噪处理。For example, for a notebook computer, when the user uses it for a long time, the heat generation is serious, the user can place a cooling fan at the bottom, and the cooling fan generates a large noise when it rotates. At this time, the audio signal of the embodiment of the present disclosure can be passed. The processing method performs noise reduction processing.
本公开实施例中，根据声源位置参数和反相降噪信号，可以得到并输出多个声道的降噪信号，并且，用户接收到多个声道的降噪信号后，可以感受到降噪信号来源于该位置。相应地，除了进行降噪处理之外，在另一种场景下，还可以实现空间音源的效果。也就是，将降噪信号替换为用户实际想要输出的音频信号时，将声源位置参数替换为特定位置的位置参数，可以在特定位置输出多个声道的音频信号。In the embodiment of the present disclosure, according to the sound source position parameter and the anti-phase noise reduction signal, the noise reduction signals of multiple channels can be obtained and output, and after receiving the noise reduction signals of multiple channels, the user can feel the noise reduction. The noise signal originates from this location. Correspondingly, in addition to noise reduction processing, in another scenario, the effect of a spatial sound source can also be achieved. That is, when the noise reduction signal is replaced with the audio signal that the user actually wants to output, the sound source position parameter is replaced with the position parameter of a specific position, and audio signals of multiple channels can be output at the specific position.
具体的，可以获取目标音频信号，并确定目标音频信号对应的目标声源位置。目标音频信号也就是用户实际想要输出的音频信号，例如，可以是音乐音频等，目标音频信号对应的目标声源位置是用户接收目标音频信号时想要感受到的位置。根据目标声源位置和目标音频信号，得到并输出多个声道的音频信号。其处理过程与上述反相降噪信号的处理过程类似，在此不再赘述。这样，用户在接收到多个声道的音频信号时，可以感受到其来源于目标声源位置。因此，本公开可以在空间任意位置模拟音频信号，可以达到更加沉静的音效体验。Specifically, the target audio signal may be acquired, and the target sound source position corresponding to the target audio signal may be determined. The target audio signal is the audio signal that the user actually wants to output, such as music audio, etc. The target sound source position corresponding to the target audio signal is the position that the user wants to feel when receiving the target audio signal. According to the target sound source position and the target audio signal, audio signals of multiple channels are obtained and output. The processing process is similar to the processing process of the above-mentioned inverse noise reduction signal, and will not be repeated here. In this way, when the user receives audio signals of multiple channels, they can feel that the audio signals originate from the target sound source position. Therefore, the present disclosure can simulate audio signals at any position in space, and can achieve a quieter sound effect experience.
本公开实施例的音频信号处理方法，通过对采集到的噪声信号进行处理，得到与噪声信号频率相同、相位相反的降噪信号。通过输出多个声道的降噪信号，使用户感受到降噪信号来源于噪声信号所在的位置，降噪信号与噪声信号相互抵消，可以达到较好的降噪效果。除此之外，还可以在空间任意位置模拟音频信号，可以适用于更多的应用场景。The audio signal processing method of the embodiment of the present disclosure obtains a noise reduction signal with the same frequency and opposite phase as the noise signal by processing the collected noise signal. By outputting noise reduction signals of multiple channels, the user can feel that the noise reduction signal originates from the location of the noise signal, and the noise reduction signal and the noise signal cancel each other out, which can achieve a better noise reduction effect. In addition, it can also simulate audio signals at any position in space, which can be applied to more application scenarios.
应当注意，尽管在附图中以特定顺序描述了本公开中方法的各个步骤，但是，这并非要求或者暗示必须按照该特定顺序来执行这些步骤，或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的，可以省略某些步骤，将多个步骤合并为一个步骤执行，以及/或者将一个步骤分解为多个步骤执行等。It should be noted that although the various steps of the methods of the present disclosure are depicted in the figures in a particular order, this does not require or imply that the steps must be performed in that particular order, or that all illustrated steps must be performed to achieve the desired the result of. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, and the like.
进一步的，本示例实施方式中，还提供了一种音频信号处理装置600，如图6所示，包括：Further, in this exemplary embodiment, an audio
噪声信号获取模块610，用于获取噪声信号；a noise
声源位置确定模块620，用于确定噪声信号的声源位置参数；a sound source
信号处理模块630，用于利用噪声信号，确定与噪声信号频率相同、相位相反的反相降噪信号；a
多声道信号确定模块640，用于根据声源位置参数以及反相降噪信号，得到多个声道的降噪信号；其中，多个声道的降噪信号在用户侧叠加时对应的声源位置与噪声信号的声源位置相同；The multi-channel
信号输出模块650，用于分别输出多个声道的降噪信号。The
在本公开的一种示例性实施例中，上述音频信号处理装置还包括：In an exemplary embodiment of the present disclosure, the above-mentioned audio signal processing apparatus further includes:
目标音频信号获取模块，获取目标音频信号；a target audio signal acquisition module to acquire the target audio signal;
声源位置确定模块，还用于确定目标音频信号对应的目标声源位置；The sound source position determination module is also used to determine the target sound source position corresponding to the target audio signal;
多声道信号确定模块，还用于根据目标声源位置和目标音频信号，得到多个声道的音频信号；The multi-channel signal determination module is also used to obtain the audio signals of multiple channels according to the target sound source position and the target audio signal;
信号输出模块，还用于输出多个声道的音频信号。The signal output module is also used to output audio signals of multiple channels.
在本公开的一种示例性实施例中，多声道信号确定模块具体用于基于声源位置参数以及头部相关传递函数，对反相降噪信号的音频参数进行调节，得到音频参数不同的多个声道的降噪信号。In an exemplary embodiment of the present disclosure, the multi-channel signal determination module is specifically configured to adjust the audio parameters of the anti-phase noise reduction signal based on the sound source position parameter and the head-related transfer function to obtain different audio parameters. Noise reduction signal for multiple channels.
在本公开的一种示例性实施例中，上述音频信号处理装置还包括：In an exemplary embodiment of the present disclosure, the above-mentioned audio signal processing apparatus further includes:
函数调节模块，用于响应于校正指令，对头部相关传递函数中的参数进行调节。The function adjustment module is used to adjust the parameters in the head-related transfer function in response to the correction instruction.
在本公开的一种示例性实施例中，多个声道中每个声道的降噪信号是与对应声道的待输出音频信号叠加之后输出的。In an exemplary embodiment of the present disclosure, the noise reduction signal of each channel of the plurality of channels is output after being superimposed with the to-be-output audio signal of the corresponding channel.
在本公开的一种示例性实施例中，噪声信号获取模块，具体用于分别从多个不同的方向采集噪声信号；In an exemplary embodiment of the present disclosure, a noise signal acquisition module is specifically configured to acquire noise signals from a plurality of different directions respectively;
声源位置确定模块，具体用于根据采集到的噪声信号以及从多个不同方向采集噪声信号时的相对位置，确定噪声信号的声源位置参数。The sound source position determination module is specifically configured to determine the sound source position parameter of the noise signal according to the collected noise signal and the relative positions when the noise signal is collected from multiple different directions.
在本公开的一种示例性实施例中，噪声信号获取模块，具体用于采集原始音频信号，从原始音频信号中提取出噪声信号。In an exemplary embodiment of the present disclosure, the noise signal acquisition module is specifically configured to collect an original audio signal, and extract the noise signal from the original audio signal.
上述装置中各模块或单元的具体细节已经在对应的音频信号处理方法中进行了详细的描述，因此此处不再赘述。The specific details of each module or unit in the above-mentioned apparatus have been described in detail in the corresponding audio signal processing method, and thus will not be repeated here.
应当注意，尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元，但是这种划分并非强制性的。实际上，根据本公开的实施方式，上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之，上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。It should be noted that although several modules or units of the apparatus for action performance are mentioned in the above detailed description, this division is not mandatory. Indeed, according to embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided into multiple modules or units to be embodied.
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由下面的权利要求指出。Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010425184.1ACN111696513A (en) | 2020-05-19 | 2020-05-19 | Audio signal processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010425184.1ACN111696513A (en) | 2020-05-19 | 2020-05-19 | Audio signal processing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111696513Atrue CN111696513A (en) | 2020-09-22 |
Family
ID=72477274
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010425184.1APendingCN111696513A (en) | 2020-05-19 | 2020-05-19 | Audio signal processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111696513A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203178A (en)* | 2020-09-23 | 2021-01-08 | 江苏视天虚拟现实科技有限公司 | XR glasses and noise reduction method |
| CN112911198A (en)* | 2021-01-18 | 2021-06-04 | 广州佰锐网络科技有限公司 | Processing system for intelligent noise reduction of audio in video communication |
| CN113709288A (en)* | 2021-08-16 | 2021-11-26 | Oppo广东移动通信有限公司 | Noise reduction method and device, electronic equipment and computer readable storage medium |
| CN113889067A (en)* | 2021-09-23 | 2022-01-04 | 维沃移动通信有限公司 | Noise reduction method, apparatus, electronic device and readable storage medium |
| CN113936633A (en)* | 2021-07-28 | 2022-01-14 | 广东美的环境电器制造有限公司 | Noise reduction method, noise reduction device and home appliance |
| CN114120956A (en)* | 2021-12-13 | 2022-03-01 | Oppo广东移动通信有限公司 | Noise reduction method and device, vehicle and storage medium |
| WO2022179069A1 (en)* | 2021-02-25 | 2022-09-01 | 荣耀终端有限公司 | Noise reduction method for fan of laptop and laptop |
| CN115132161A (en)* | 2022-05-27 | 2022-09-30 | 歌尔股份有限公司 | Noise reduction method, head-mounted display device, and computer-readable storage medium |
| CN115419608A (en)* | 2022-08-23 | 2022-12-02 | 歌尔科技有限公司 | Fan noise reduction method, system, device and medium for head-mounted display equipment |
| CN118592041A (en)* | 2022-12-16 | 2024-09-03 | 北京小米移动软件有限公司 | Audio acquisition analysis method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0915527A (en)* | 1995-06-27 | 1997-01-17 | Olympus Optical Co Ltd | Head-mounted video display device |
| CN1685762A (en)* | 2002-09-23 | 2005-10-19 | 皇家飞利浦电子股份有限公司 | Sound reproduction system, program and data carrier |
| CN201616843U (en)* | 2010-03-18 | 2010-10-27 | 华为终端有限公司 | Audio frequency device capable of lowering noise and noise reducing mobile phone |
| CN104616650A (en)* | 2015-02-10 | 2015-05-13 | 南京信息工程大学 | Noise reduction device suitable for small space |
| CN105679300A (en)* | 2015-12-29 | 2016-06-15 | 努比亚技术有限公司 | Mobile terminal and noise reduction method |
| CN208258023U (en)* | 2018-06-15 | 2018-12-18 | 深圳市华美迪科技有限公司 | One kind having the function of active noise reduction bluetooth headset |
| CN209234033U (en)* | 2019-03-07 | 2019-08-09 | 歌尔科技有限公司 | A kind of active noise reduction earphone |
| CN111050250A (en)* | 2020-01-15 | 2020-04-21 | 北京声智科技有限公司 | Noise reduction method, device, equipment and storage medium |
| CN111081213A (en)* | 2018-10-19 | 2020-04-28 | 比亚迪股份有限公司 | New energy vehicle, active sound system and active sound control method thereof |
- 2020
- 2020-05-19CNCN202010425184.1Apatent/CN111696513A/enactivePending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0915527A (en)* | 1995-06-27 | 1997-01-17 | Olympus Optical Co Ltd | Head-mounted video display device |
| CN1685762A (en)* | 2002-09-23 | 2005-10-19 | 皇家飞利浦电子股份有限公司 | Sound reproduction system, program and data carrier |
| CN201616843U (en)* | 2010-03-18 | 2010-10-27 | 华为终端有限公司 | Audio frequency device capable of lowering noise and noise reducing mobile phone |
| CN104616650A (en)* | 2015-02-10 | 2015-05-13 | 南京信息工程大学 | Noise reduction device suitable for small space |
| CN105679300A (en)* | 2015-12-29 | 2016-06-15 | 努比亚技术有限公司 | Mobile terminal and noise reduction method |
| CN208258023U (en)* | 2018-06-15 | 2018-12-18 | 深圳市华美迪科技有限公司 | One kind having the function of active noise reduction bluetooth headset |
| CN111081213A (en)* | 2018-10-19 | 2020-04-28 | 比亚迪股份有限公司 | New energy vehicle, active sound system and active sound control method thereof |
| CN209234033U (en)* | 2019-03-07 | 2019-08-09 | 歌尔科技有限公司 | A kind of active noise reduction earphone |
| CN111050250A (en)* | 2020-01-15 | 2020-04-21 | 北京声智科技有限公司 | Noise reduction method, device, equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 沈晋原: "《多媒体通信技术基础》", 国防工业出版社* |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203178A (en)* | 2020-09-23 | 2021-01-08 | 江苏视天虚拟现实科技有限公司 | XR glasses and noise reduction method |
| CN112911198A (en)* | 2021-01-18 | 2021-06-04 | 广州佰锐网络科技有限公司 | Processing system for intelligent noise reduction of audio in video communication |
| WO2022179069A1 (en)* | 2021-02-25 | 2022-09-01 | 荣耀终端有限公司 | Noise reduction method for fan of laptop and laptop |
| CN113936633A (en)* | 2021-07-28 | 2022-01-14 | 广东美的环境电器制造有限公司 | Noise reduction method, noise reduction device and home appliance |
| CN113709288A (en)* | 2021-08-16 | 2021-11-26 | Oppo广东移动通信有限公司 | Noise reduction method and device, electronic equipment and computer readable storage medium |
| CN113889067A (en)* | 2021-09-23 | 2022-01-04 | 维沃移动通信有限公司 | Noise reduction method, apparatus, electronic device and readable storage medium |
| CN114120956A (en)* | 2021-12-13 | 2022-03-01 | Oppo广东移动通信有限公司 | Noise reduction method and device, vehicle and storage medium |
| CN115132161A (en)* | 2022-05-27 | 2022-09-30 | 歌尔股份有限公司 | Noise reduction method, head-mounted display device, and computer-readable storage medium |
| CN115419608A (en)* | 2022-08-23 | 2022-12-02 | 歌尔科技有限公司 | Fan noise reduction method, system, device and medium for head-mounted display equipment |
| CN115419608B (en)* | 2022-08-23 | 2025-06-17 | 歌尔科技有限公司 | Fan noise reduction method, system, device and medium for head mounted display device |
| CN118592041A (en)* | 2022-12-16 | 2024-09-03 | 北京小米移动软件有限公司 | Audio acquisition analysis method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111696513A (en) | Audio signal processing method and device, electronic equipment and storage medium | |
| US11838707B2 (en) | Capturing sound | |
| US20120183161A1 (en) | Determining individualized head-related transfer functions | |
| US10757528B1 (en) | Methods and systems for simulating spatially-varying acoustics of an extended reality world | |
| CN109165005B (en) | Sound effect enhancement method and device, electronic equipment and storage medium | |
| US20240155302A1 (en) | Emoji that indicates a location of binaural sound | |
| JP7210602B2 (en) | Method and apparatus for processing audio signals | |
| US11356795B2 (en) | Spatialized audio relative to a peripheral device | |
| KR20050083928A (en) | Method for processing audio data and sound acquisition device therefor | |
| CN106537942A (en) | 3d immersive spatial audio systems and methods | |
| US10979846B2 (en) | Audio signal rendering | |
| WO2024000645A1 (en) | Vibration motor control method and apparatus, storage medium, and electronic device | |
| CN117835121A (en) | Stereo playback method, computer, microphone device, sound box device and television | |
| WO2020107201A1 (en) | Stereo sound playback method and device, storage medium and electronic device | |
| CN118264971B (en) | Speaker-based spatial audio system, audio processor, vehicle, virtual surround sound conversion method, and audio rendering method | |
| CN114339582B (en) | Dual-channel audio processing method, device and medium for generating direction sensing filter | |
| US20240312468A1 (en) | Spatial Audio Upscaling Using Machine Learning | |
| KR102284811B1 (en) | Incoherent idempotent ambisonics rendering | |
| CN108574925A (en) | Method and device for controlling audio signal output in virtual auditory environment | |
| WO2019174442A1 (en) | Adapterization equipment, voice output method, device, storage medium and electronic device | |
| CN114630240B (en) | Directional filter generation method, audio processing method, device and storage medium | |
| CN117676002B (en) | Audio processing method and electronic equipment | |
| CN119233186A (en) | Audio data processing method, audio data processing device, medium and electronic equipment | |
| CN119893375A (en) | Wearing equipment | |
| JP2025529877A (en) | Rendering audio captured by multiple devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |