CN114515164A - Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage medium - Google Patents
Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage mediumDownload PDFInfo
- Publication number
- CN114515164A CN114515164ACN202210119158.5ACN202210119158ACN114515164ACN 114515164 ACN114515164 ACN 114515164ACN 202210119158 ACN202210119158 ACN 202210119158ACN 114515164 ACN114515164 ACN 114515164A
- Authority
- CN
- China
- Prior art keywords
- auscultation
- signal
- microphones
- auscultation sound
- sound signals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/04—Electric stethoscopes
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/026—Stethoscopes comprising more than one sound collector
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本申请涉及医疗技术领域，更具体地，涉及一种声信号获取方法、装置、电子设备以及存储介质。The present application relates to the field of medical technology, and more particularly, to an acoustic signal acquisition method, apparatus, electronic device, and storage medium.
背景技术Background technique
听诊诊断是通过人体发出的生理声信号，根据声信号表现出来的特征，进行病症判断的一种方法，常用于心血管疾病、呼吸系统疾病等，听诊的目标也主要是针对心脏、肺等器官，通过拾取心音、肺音等，依赖医生的经验，对拾取生理声信号进行诊断。其中，听诊器时配合实现听诊诊断的重要工具，但是，目前的听诊器的听诊效果欠佳。Auscultation diagnosis is a method of judging symptoms according to the characteristics of the acoustic signals through the physiological sound signals emitted by the human body. , by picking up heart sounds, lung sounds, etc., and relying on the experience of doctors to diagnose physiological acoustic signals. Among them, the stethoscope is an important tool for realizing auscultation diagnosis. However, the auscultation effect of the current stethoscope is not good.
发明内容SUMMARY OF THE INVENTION
鉴于上述问题，本申请提出了一种声信号获取方法、装置、电子设备以及存储介质，以解决上述问题。In view of the above problems, the present application proposes an acoustic signal acquisition method, apparatus, electronic device and storage medium to solve the above problems.
第一方面，本申请实施例提供了一种声信号获取方法，应用于听诊器，所述听诊器包括听诊振膜和第一音频采集装置，所述第一音频采集装置包括多个麦克风，所述方法包括：当所述听诊振膜振动带动空气振动时，通过所述第一音频采集装置对所述空气振动产生的听诊声信号进行拾取；获取所述多个麦克风各自拾取的听诊声信号；基于所述多个麦克风各自拾取的听诊声信号，获得目标听诊声信号。In a first aspect, an embodiment of the present application provides a method for acquiring an acoustic signal, which is applied to a stethoscope. The stethoscope includes an auscultation diaphragm and a first audio collection device, and the first audio collection device includes a plurality of microphones. The method The method includes: when the vibration of the auscultation diaphragm drives the air to vibrate, picking up the auscultation sound signal generated by the air vibration through the first audio collection device; acquiring the auscultation sound signals picked up by the plurality of microphones; The auscultation sound signals picked up by the plurality of microphones are obtained, and the target auscultation sound signal is obtained.
第二方面，本申请实施例提供了一种声信号获取装置，应用于听诊器，所述听诊器包括听诊振膜和第一音频采集装置，所述第一音频采集装置包括多个麦克风，所述装置包括：拾取控制模块，用于当所述听诊振膜振动带动空气振动时，通过所述第一音频采集装置对所述空气振动产生的听诊声信号进行拾取；听诊声信号获取模块，用于获取所述多个麦克风各自拾取的听诊声信号；目标听诊声信号获得模块，用于基于所述多个麦克风各自拾取的听诊声信号，获得目标听诊声信号。In a second aspect, an embodiment of the present application provides an apparatus for acquiring an acoustic signal, which is applied to a stethoscope, where the stethoscope includes an auscultation diaphragm and a first audio collection apparatus, the first audio collection apparatus includes a plurality of microphones, and the apparatus It includes: a pickup control module for picking up the auscultation sound signal generated by the air vibration through the first audio collection device when the vibration of the auscultation diaphragm drives the air to vibrate; the auscultation sound signal acquisition module for obtaining the auscultation sound signal auscultation sound signals picked up by the plurality of microphones; a target auscultation sound signal obtaining module, configured to obtain the target auscultation sound signal based on the auscultation sound signals picked up by the plurality of microphones respectively.
第三方面，本申请实施例提供了一种听诊器，包括存储器和处理器，所述存储器耦接到所述处理器，所述存储器存储指令，当所述指令由所述处理器执行时所述处理器执行上述方法。In a third aspect, an embodiment of the present application provides a stethoscope, including a memory and a processor, the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the The processor executes the above method.
第四方面，本申请实施例提供了一种计算机可读取存储介质，所述计算机可读取存储介质中存储有程序代码，所述程序代码可被处理器调用执行上述方法。In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, and the program code can be invoked by a processor to execute the above method.
本申请实施例提供的声信号获取方法、装置、听诊器以及存储介质，当听诊振膜振动带动空气振动时，通过第一音频采集装置对空气振动产生的听诊声信号进行拾取，获取多个麦克风各自拾取的听诊声信号，基于多个麦克风各自拾取的听诊声信号，获得目标听诊声信号，从而通过多通道采集听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，从而提升听诊效果。The acoustic signal acquisition method, device, stethoscope and storage medium provided by the embodiments of the present application, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device, and the respective The picked-up auscultation sound signal is based on the auscultation sound signal picked up by multiple microphones to obtain the target auscultation sound signal, so that the auscultation sound signal can be collected through multiple channels, which can achieve the effect of enhancing the auscultation sound signal and achieve the improvement of the signal-to-noise ratio, thereby improving the Auscultation effect.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained from these drawings without creative effort.
图1示出了本申请实施例提供的听诊器的结构示意图；FIG. 1 shows a schematic structural diagram of a stethoscope provided by an embodiment of the present application;
图2示出了本申请实施例提供的听诊振膜的第一视角的结构示意图；FIG. 2 shows a schematic structural diagram of the auscultation diaphragm provided by the embodiment of the present application from a first perspective;
图3示出了本申请实施例提供的听诊振膜的第二视角的结构示意图；FIG. 3 shows a schematic structural diagram of a second viewing angle of the auscultation diaphragm provided by an embodiment of the present application;
图4示出了本申请一实施例提供的声信号获取方法的流程示意图；FIG. 4 shows a schematic flowchart of a method for acquiring an acoustic signal provided by an embodiment of the present application;
图5示出了本申请一实施例提供的声信号获取方法的流程示意图；FIG. 5 shows a schematic flowchart of a method for acquiring an acoustic signal provided by an embodiment of the present application;
图6示出了本申请的图5所示的声信号获取方法的步骤S240的流程示意图；FIG. 6 shows a schematic flowchart of step S240 of the acoustic signal acquisition method shown in FIG. 5 of the present application;
图7示出了本申请的图6所示的声信号获取方法的步骤S241的流程示意图；FIG. 7 shows a schematic flowchart of step S241 of the acoustic signal acquisition method shown in FIG. 6 of the present application;
图8示出了本申请的图7所示的声信号获取方法的步骤S2411的流程示意图；FIG. 8 shows a schematic flowchart of step S2411 of the acoustic signal acquisition method shown in FIG. 7 of the present application;
图9示出了本申请实施例提供的听诊声信号的波形示意图；FIG. 9 shows a schematic waveform diagram of an auscultation sound signal provided by an embodiment of the present application;
图10示出了本申请一实施例提供的声信号获取装置的模块框图；10 shows a block diagram of a module of an apparatus for acquiring an acoustic signal provided by an embodiment of the present application;
图11示出了本申请实施例用于执行根据本申请实施例的声信号获取方法的电子设备的框图；FIG. 11 shows a block diagram of an electronic device for executing the acoustic signal acquisition method according to the embodiment of the present application;
图12示出了本申请实施例的用于保存或者携带实现根据本申请实施例的声信号获取方法的程序代码的存储单元。FIG. 12 shows a storage unit according to an embodiment of the present application for storing or carrying a program code for implementing the method for acquiring an acoustic signal according to the embodiment of the present application.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述。In order to make those skilled in the art better understand the solutions of the present application, the following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application.
其中，传统听诊器的前端是一个面积较大的膜腔，而塞入耳朵的一端由于腔道细窄，气体振动幅度会比腔道大，可放大体内声波振动，听诊器应用了这个原理而制成。传统听诊器的由膜片和空心充气管组成，存在着灵敏度低、背景噪声高、频带失真、无法定量测量等诸多缺点。电子听诊器的出现能够一定程度上克服以上缺点，一定程度上使得信号的信噪比提高。电子听诊器一般也是由膜片、音腔、拾音部件是麦克风等构成。Among them, the front end of the traditional stethoscope is a large membrane cavity, and the end that is inserted into the ear is narrower than the cavity, and the vibration amplitude of the gas will be larger than that of the cavity, which can amplify the sound wave vibration in the body. The stethoscope is made by applying this principle. . The traditional stethoscope is composed of a diaphragm and a hollow gas tube, and has many shortcomings such as low sensitivity, high background noise, frequency band distortion, and inability to quantitatively measure. The emergence of electronic stethoscope can overcome the above shortcomings to a certain extent, and improve the signal-to-noise ratio of the signal to a certain extent. Electronic stethoscopes are also generally composed of diaphragms, sound chambers, and microphones.
尽管电子听诊器的设计有了进步，同时新型听诊器应用了数字滤波和放大等基本信号处理技术；但所有市面上可买到的电子听诊器仍然是单通道设备，单通道电子听诊器不能受益于更有效的多通道信号处理方法，如多通道噪声消除、波束形成等方法，市面上电子听诊器的整体信噪比有待提高；同时已有的电子听诊器大多数都不能很好的消除环境噪声的影响，从而大大影响了听诊效果。Despite advances in electronic stethoscope design and the application of basic signal processing techniques such as digital filtering and amplification to new stethoscopes; all commercially available electronic stethoscopes are still single-channel devices, and single-channel electronic stethoscopes cannot benefit from the more efficient Multi-channel signal processing methods, such as multi-channel noise cancellation, beamforming and other methods, the overall signal-to-noise ratio of electronic stethoscopes on the market needs to be improved; affect the auscultation effect.
目前的主要缺点是低信噪比，因此在做听诊诊断算法，或者医生听诊时不能提供良好信号输入，进而影响诊断的效果；同时目前技术方案受到环境噪声干扰较大，在背景噪声强等复杂环境下，不能够有效拾取听诊的声信号，使得听诊诊断严重受到影响，听诊效果欠佳。The main disadvantage at present is the low signal-to-noise ratio, so the auscultation diagnosis algorithm or the doctor's auscultation cannot provide a good signal input, thus affecting the diagnosis effect; at the same time, the current technical solution is greatly interfered by the environmental noise, and the background noise is strong and complicated. Under the circumstance, the acoustic signal of auscultation cannot be effectively picked up, which seriously affects the auscultation diagnosis and the auscultation effect is not good.
针对上述问题，发明人经过长期的研究发现，并提出了本申请实施例提供的声信号获取方法、装置、听诊器以及存储介质，通过多通道采集听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，从而提升听诊效果。其中，具体的声信号获取方法在后续的实施例中进行详细的说明。In view of the above-mentioned problems, the inventor has discovered through long-term research, and proposed the acoustic signal acquisition method, device, stethoscope and storage medium provided by the embodiments of the present application. Improve the signal-to-noise ratio, thereby improving the auscultation effect. The specific acoustic signal acquisition method will be described in detail in the following embodiments.
请参阅图1，图1示出了本申请实施例提供的听诊器的结构示意图。如图1所示，该听诊器100包括听诊振膜101、结构件102、结构装置103、音腔104、收音口105、第一音频采集装置106、第二音频采集装置107以及密闭圈108。其中，听诊振膜101用于与皮肤接触，心音、肺音等通过振动传导的方式引起听诊振膜101的振动，音腔104用于实现聚声的效果。Referring to FIG. 1 , FIG. 1 shows a schematic structural diagram of a stethoscope provided by an embodiment of the present application. As shown in FIG. 1 , the stethoscope 100 includes an
在一些实施方式中，针对听诊振膜101，为了固定听诊振膜101通常需要一个结构装置103将其固定，这样做结构装置103会有一定的高度差(一般是3mm以内)，由于这个高度差的存在，在进行听诊测量时会影响听诊振膜101与皮肤的贴合程度进而影响听诊的信噪比。如图2所述，其中听诊振膜101的材料可以选择玻璃纤维压板、塑料等具有一定刚性的材料；为了减少上文所述的高度差，可以做一个结构件(凸台)102，由于结构件102的存在，可以实现将听诊振膜101顶起，这样能够实现听诊振膜101与皮肤的良好接触，进而可以减少声信号在传导过程中皮肤与听诊振膜101界面耦合时的衰减；由于听诊振膜101具有一定刚性，在与结构件102接合处需要一定柔软度的材料来实现，本实施例可以选用硅胶材料，因此可以通过双射注塑工艺将两种材质的材料接合，可以将塑料材质的听诊振膜101和硅胶注塑成型，如图3所示，其中内圈是听诊振膜101，外圈收音口105是硅胶。In some embodiments, for the
在一些实施方式中，音腔104的主要作用是聚声，分别从腔体形状、高度、出口面积进行了设计；其中腔体形状本实施例可以选择内凹形腔体，这样就可以实现与皮肤接触面大，出音口面积小的良好聚声效果；此外腔体的高度也是影响聚声速率和频率响应的因素，本实施例综合考虑了可选的腔体高度是5-10mm；腔体的出口面积要结合麦克风的收音口，以及频率响应，综合考虑下本实施例可选的出口是圆形出口，直径在1-2mm之间。通过以上的设计可以很好的兼顾性能和产品结构堆叠。In some embodiments, the main function of the
请参阅图4，图4示出了本申请一实施例提供的声信号获取方法的流程示意图。该方法用于通过多通道采集听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，从而提升听诊效果。在具体的实施例中，该声信号获取方法应用于如图10所示的声信号获取装置200以及配置有声信号获取装置200的听诊器100(图11)。在本实施中，该听诊器包括听诊振膜以及第一音频采集装置，该第一音频刺激装置包括多个麦克风。下面将针对图4所示的流程进行详细的阐述，所述声信号获取方法具体可以包括以下步骤：Please refer to FIG. 4 , which shows a schematic flowchart of a method for acquiring an acoustic signal provided by an embodiment of the present application. The method is used for collecting auscultation sound signals through multiple channels, which can achieve the effect of enhancing the auscultation sound signals, and realize the improvement of the signal-to-noise ratio, thereby improving the auscultation effect. In a specific embodiment, the acoustic signal acquisition method is applied to the acoustic signal acquisition apparatus 200 shown in FIG. 10 and the stethoscope 100 ( FIG. 11 ) equipped with the acoustic signal acquisition apparatus 200 . In this embodiment, the stethoscope includes an auscultation diaphragm and a first audio collection device, and the first audio stimulation device includes a plurality of microphones. The flow shown in FIG. 4 will be described in detail below, and the acoustic signal acquisition method may specifically include the following steps:
步骤S110：当所述听诊振膜振动带动空气振动时，通过所述第一音频采集装置对所述空气振动产生的听诊声信号进行拾取。Step S110 : when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device.
在本实施例中，当需要利用听诊器对目标对象进行听诊诊断时，则可以将听诊器的听诊振膜贴附于目标对象的皮肤表面，以通过心音、肺音等振动传导的方式引起听诊振膜振动。其中，在一些实施方式中，由于该听诊振膜下方设置有用于将听诊振膜顶起的结构件，从而可以实现在听诊振膜贴附于目标对象的皮肤表面时，与目标对象的皮肤表面的接触更加良好，可以减少听诊声信号在传导过程中皮肤与听诊振膜面耦合时的衰减。在一些实施方式中，由于该听诊器的音腔104是内凹形腔体，这样可以实现与皮肤的接触面积打，初音口面积小的良好聚声效果。In this embodiment, when a stethoscope needs to be used to perform auscultation diagnosis on the target object, the auscultation diaphragm of the stethoscope can be attached to the skin surface of the target object, so as to induce the auscultation diaphragm through vibration conduction such as heart sounds and lung sounds. vibration. Wherein, in some embodiments, since the auscultation diaphragm is provided with a structural member for jacking up the auscultation diaphragm, when the auscultation diaphragm is attached to the skin surface of the target object, it can be The contact of the auscultation sound is better, which can reduce the attenuation of the auscultation sound signal when the skin is coupled with the auscultation diaphragm surface during the conduction process. In some embodiments, since the
作为一种方式，该目标对象可以包括人、动物等，该目标对象的皮肤表面可以包括人体的心脏皮肤表面、人体的肺部皮肤表面、动物的心脏皮肤表面、动物的肺部皮肤表面等，在此不做限定。As an approach, the target object may include a human, an animal, etc., and the skin surface of the target object may include a human heart skin surface, a human lung skin surface, an animal heart skin surface, an animal lung skin surface, and the like, This is not limited.
在一些实施方式中，听诊器在进行听诊器，听诊器的听诊振膜可以贴附与目标对象的皮肤表面，此时，会基于目标对象的心音、肺音的振动传导引起听诊振膜的振动，从而通过听诊振膜的振动带动听诊器内的空气振动。于本实施例中，当听诊振膜带动空气振动时，则可以通过该听诊器的第一音频采集装置对空气振动产生的听诊声信号进行拾取。In some embodiments, when the stethoscope is in operation, the auscultation diaphragm of the stethoscope can be attached to the skin surface of the target object. The vibration of the auscultation diaphragm drives the air in the stethoscope to vibrate. In this embodiment, when the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration can be picked up by the first audio collection device of the stethoscope.
在一些实施方式中，该第一音频采集装置可以多个麦克风，例如，该第一音频采集装置可以包括2个麦克风、可以包括3个麦克风……可以包括n个麦克风等，在此不做限定，其中，n为大于3的整数。作为一种方式，多个麦克风可以规则排列，也可以无规则排列等，在此不做限定。其中，当多个麦克风规则排列时，则该多个麦克风可以沿听诊器的目标方向依次间隔排列，例如，沿听诊器的纵向依次间隔排列、沿听诊器的横向依次间隔排列、沿听诊器的环绕排列形成圆环等，在此不做限定。In some embodiments, the first audio collection device may include multiple microphones. For example, the first audio collection device may include 2 microphones, may include 3 microphones, ... may include n microphones, etc., which is not limited here. , where n is an integer greater than 3. As an example, the plurality of microphones may be arranged regularly or randomly, which is not limited here. Wherein, when a plurality of microphones are regularly arranged, the plurality of microphones can be arranged at intervals along the target direction of the stethoscope. Rings, etc., are not limited here.
其中，当第一音频采集装置包括2个麦克风时，则当听诊振膜振动带动空气振动时，则可以通过2个麦克风对空气振动产生的听诊声信号进行拾取；当第一音频采集装置包括3个麦克风时，则当听诊振膜振动带动空气振动时，则可以通过3个麦克风对空气振动产生的听诊声信号进行拾取。Wherein, when the first audio collection device includes 2 microphones, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signals generated by the air vibration can be picked up by the 2 microphones; when the first audio collection device includes 3 When there are two microphones, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration can be picked up by the three microphones.
其中，当该第一音频采集装置包括2个麦克风时，则该第一音频采集装置可以为双通道麦克风，该双通道麦克风可以用于进行听诊声信号的拾取，由于使用了双通道麦克风的设计，在拾取听诊声信号时可以很好的实现听诊声信号的增强，达到提高信噪比的效果。Wherein, when the first audio collection device includes two microphones, the first audio collection device may be a dual-channel microphone, and the dual-channel microphone can be used to pick up the auscultation sound signal, because the design of the dual-channel microphone is used. , when picking up the auscultation sound signal, the enhancement of the auscultation sound signal can be well achieved, and the effect of improving the signal-to-noise ratio can be achieved.
步骤S120：获取所述多个麦克风各自拾取的听诊声信号。Step S120: Acquire auscultation sound signals picked up by the plurality of microphones.
在本实施例中，在通过第一音频采集装置对空气振动产生的听诊声信号进行拾取时，则可以获取该第一音频采集装置采集的听诊声信号，即，可以获取该多个麦克风各自拾取的听诊声信号。In this embodiment, when the auscultation sound signal generated by air vibration is picked up by the first audio collection device, the auscultation sound signal collected by the first audio collection device can be obtained, that is, the auscultation sound signals picked up by the plurality of microphones can be obtained. auscultation sound signal.
在一些实施方式中，可以实时获取该多个麦克风各自拾取的听诊声信号，可以按预设时间间隔获取该多个麦克风各自拾取的听诊声信号，也可以按预设时长获取该多个麦克风各自拾取的听诊声信号等，在此不做限定。In some embodiments, the auscultation sound signals picked up by the multiple microphones can be acquired in real time, the auscultation sound signals picked up by the multiple microphones can be acquired at preset time intervals, or the auscultation sound signals picked up by the multiple microphones can be acquired at a preset time interval. The picked up auscultation sound signals and the like are not limited here.
步骤S130：基于所述多个麦克风各自拾取的听诊声信号，获得目标听诊声信号。Step S130: Obtain a target auscultation sound signal based on the auscultation sound signals picked up by the plurality of microphones.
在本实施例中，在获得多个麦克风各自拾取的听诊声信号后，则可以基于该多个麦克风各自拾取的听诊声信号，获得目标听诊声信号，其中，目标听诊声信号即为传导到用户耳朵里的声信号。In this embodiment, after the auscultation sound signals picked up by the plurality of microphones are obtained, the target auscultation sound signal can be obtained based on the auscultation sound signals picked up by the plurality of microphones, wherein the target auscultation sound signal is transmitted to the user. Acoustic signals in the ear.
在一些实施方式中，在获得多个麦克风各自拾取的听诊声信号后，则可以对多个麦克风各自拾取的听诊声信号进行合成处理，获得目标听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，为后续听诊诊断提供了良好的数据保证。作为一种可实施的方式，对多个麦克风各自拾取的听诊声信号进行合成处理可以包括：对多个麦克风各自拾取的听诊声信号进行叠加处理、对多个麦克风各自拾取的听诊声信号进行加权叠加处理等，在此不做限定。In some embodiments, after the auscultation sound signals picked up by the multiple microphones are obtained, the auscultation sound signals picked up by the multiple microphones can be synthesized and processed to obtain the target auscultation sound signal, which can achieve the effect of enhancing the auscultation sound signal. The improvement of the signal-to-noise ratio is realized, which provides a good data guarantee for the subsequent auscultation diagnosis. As an implementable manner, performing synthesis processing on the auscultation sound signals picked up by the multiple microphones may include: performing superimposition processing on the auscultation sound signals picked up by the multiple microphones, and weighting the auscultation sound signals picked up by the multiple microphones. The superimposition processing and the like are not limited here.
在一些实施方式中，在在获得多个麦克风各自拾取的听诊声信号后，则可以对多个麦克风各自拾取的听诊声信号进行合成处理，获得合成声信号，然后判断该合成声信号是否满足预设声信号条件，其中，当判断结果表征该合成声信号满足预设声信号条件时，则可以将该合成声信号确定为目标听诊声信号，当判断结果表征该合成声信号不满足预设声信号条件时，则可以控制第一音频采集装置重新采集音频声信号，直到基于重新采集的音频声信号获得的合成声信号满足预设声信号条件。In some embodiments, after the auscultation sound signals picked up by the multiple microphones are obtained, the auscultation sound signals picked up by the multiple microphones may be synthesized and processed to obtain a synthesized sound signal, and then it is judged whether the synthesized sound signal satisfies the predetermined conditions. Set the acoustic signal condition, wherein, when the judgment result indicates that the synthetic acoustic signal satisfies the preset acoustic signal condition, the synthetic acoustic signal can be determined as the target auscultation sound signal, and when the judgment result indicates that the synthetic acoustic signal does not meet the preset acoustic signal When the signal condition is met, the first audio collection device may be controlled to collect the audio acoustic signal again until the synthesized acoustic signal obtained based on the re-collected audio acoustic signal satisfies the preset acoustic signal condition.
作为一种可实施的方式，预设声信号条件可以包括：合成声信号的清晰度满足预设清晰度、合成声信号的杂音数量小于预设杂音数量等，在此不做限定。As an implementable manner, the preset acoustic signal conditions may include: the clarity of the synthesized acoustic signal satisfies the preset clarity, the noise quantity of the synthetic acoustic signal is less than the preset noise quantity, etc., which are not limited herein.
本申请一实施例提供的声信号获取方法，当听诊振膜振动带动空气振动时，通过第一音频采集装置对空气振动产生的听诊声信号进行拾取，获取多个麦克风各自拾取的听诊声信号，基于多个麦克风各自拾取的听诊声信号，获得目标听诊声信号，从而通过多通道采集听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，从而提升听诊效果In the acoustic signal acquisition method provided by an embodiment of the present application, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device, and the auscultation sound signals picked up by the plurality of microphones are acquired respectively, Based on the auscultation sound signals picked up by multiple microphones, the target auscultation sound signal is obtained, and the auscultation sound signal is collected through multiple channels, which can achieve the effect of enhancing the auscultation sound signal and the signal-to-noise ratio, thereby improving the auscultation effect.
请参阅图5，图5示出了本申请一实施例提供的声信号获取方法的流程示意图。该方法应用于上述听诊器，该听诊器包括听诊振膜、第一音频采集装置以及第二音频采集装置，该第一音频采集装置包括多个麦克风。下面将针对图5所示的流程进行详细的阐述，所述声信号获取方法具体可以包括以下步骤：Please refer to FIG. 5 , which shows a schematic flowchart of a method for acquiring an acoustic signal provided by an embodiment of the present application. The method is applied to the above-mentioned stethoscope. The stethoscope includes an auscultation diaphragm, a first audio collection device, and a second audio collection device. The first audio collection device includes a plurality of microphones. The flow shown in FIG. 5 will be described in detail below, and the acoustic signal acquisition method may specifically include the following steps:
步骤S210：当所述听诊振膜振动带动空气振动时，通过所述第一音频采集装置对所述空气振动产生的听诊声信号进行拾取。Step S210 : when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device.
步骤S220：获取所述多个麦克风各自拾取的听诊声信号。Step S220: Acquire auscultation sound signals picked up by the plurality of microphones.
其中，步骤S210-步骤S220的具体描述请参阅步骤S110-步骤S120，在此不再赘述。Wherein, the specific description of steps S210-step S220 can refer to steps S110-step S120, and details are not repeated here.
步骤S230：获取所述第二音频采集装置采集的环境噪声信号。Step S230: Acquire an environmental noise signal collected by the second audio collection device.
在一些实施方式中，该听诊器还可以包括第二音频采集装置，该第二音频采集装置可以用于进行环境噪声的采集，以用于音频声信号的整体降噪。其中，该第二音频采集装置可以一个或多个麦克风，当该第二音频采集装置仅包括一个麦克风时，则可以通过该一个麦克风采集环境噪声信号，并获取该一个麦克风采集的环境噪声信号；当该第二音频采集装置包括多个麦克风时，则可以通过该多个麦克风采集环境噪声信号，并获取该多个麦克风各自采集的环境噪声信号。In some embodiments, the stethoscope may further include a second audio collection device, and the second audio collection device may be used to collect ambient noise for overall noise reduction of the audio sound signal. Wherein, the second audio collection device may be one or more microphones, and when the second audio collection device includes only one microphone, the ambient noise signal may be collected through the one microphone, and the ambient noise signal collected by the one microphone may be acquired; When the second audio collection device includes a plurality of microphones, the environmental noise signals can be collected through the plurality of microphones, and the environmental noise signals collected by the plurality of microphones can be acquired.
在一些实施方式中，听诊器可以同时布置有第一音频采集装置和第二音频采集装置，则可以同时通过第一音频采集装置(多个麦克风)和第二音频采集装置进行音频信号的采集，并获得多个麦克风各自采集的听诊声信号和第二音频采集装置采集的环境噪声信号。其中，多个麦克风采集到的听诊声信号用于增强信噪比，第二音频采集装置采集到的环境噪声信号用于消除或者减弱环境噪声的影响。In some implementations, the stethoscope may be equipped with a first audio collection device and a second audio collection device at the same time, then the audio signal may be collected by the first audio collection device (multiple microphones) and the second audio collection device at the same time, and The auscultation sound signals collected by the plurality of microphones and the environmental noise signal collected by the second audio collection device are obtained. The auscultation sound signals collected by the multiple microphones are used to enhance the signal-to-noise ratio, and the environmental noise signal collected by the second audio collection device is used to eliminate or reduce the influence of the environmental noise.
在一些实施方式中，基于环境噪声信号和听诊声信号的频率不同的特性，本实施例可以预先设置并存储有听诊声信号对应的频率，即预设频率，该预设频率用于作为采集的多个音频信号的判断依据。因此，在本实施例中，可以通过第二音频采集装置采集音频信号，在采集获得多个音频信号后，可以将多个音频信号中的每个音频信号的频率与预设频率进行比较，以判断每个音频信号的频率是否与预设频率匹配，根据判断结果，可以从多个音频信号中获取不属于预设频率的音频信号，作为环境噪声信号。In some embodiments, based on the characteristics of different frequencies of the environmental noise signal and the auscultation sound signal, this embodiment may preset and store the frequency corresponding to the auscultation sound signal, that is, the preset frequency, and the preset frequency is used as the collected frequency. Judgment basis for multiple audio signals. Therefore, in this embodiment, the audio signal may be collected by the second audio collection device, and after the collection and acquisition of multiple audio signals, the frequency of each audio signal in the multiple audio signals may be compared with the preset frequency to obtain It is judged whether the frequency of each audio signal matches the preset frequency, and according to the judgment result, the audio signal that does not belong to the preset frequency can be obtained from the plurality of audio signals as the environmental noise signal.
步骤S240：基于所述多个麦克风各自拾取的听诊声信号和所述环境噪声信号，获得所述目标听诊声信号。Step S240: Obtain the target auscultation sound signal based on the auscultation sound signals picked up by the plurality of microphones and the environmental noise signal.
在本实施例中，在获得多个麦克风各自拾取的听诊声信号(第一音频采集装置拾取的听诊声信号)和第二音频采集装置采集到的环境噪声信号后，则可以基于多个麦克风各自拾取的听诊声信号和第二音频采集装置采集到的环境噪声信号，获得目标听诊信号，其中，目标听诊信号即为传导到用户耳朵里的声信号。In this embodiment, after obtaining the auscultation sound signals picked up by the plurality of microphones (the auscultation sound signals picked up by the first audio collection device) and the environmental noise signal collected by the second audio collection device, the The picked-up auscultation sound signal and the environmental noise signal collected by the second audio collection device are used to obtain the target auscultation signal, wherein the target auscultation signal is the sound signal conducted into the user's ear.
在一些实施方式中，在获得多个麦克风各自拾取的听诊声信号和第二音频采集装置采集到的环境噪声信号后，则可以将多个麦克风各自拾取的听诊声信号进行合成处理，获得合成声信号，并将合成声信号和环境噪声信号进行过滤处理，获得目标噪声信号，获得目标听诊声信号，能够实现听诊声信号增强以及抑制环境噪声信号的影响，实现信噪比的提升。In some embodiments, after the auscultation sound signals picked up by the multiple microphones and the environmental noise signal collected by the second audio collection device are obtained, the auscultation sound signals picked up by the multiple microphones may be synthesized and processed to obtain a synthesized sound The synthetic sound signal and the environmental noise signal are filtered to obtain the target noise signal and the target auscultation sound signal, which can enhance the auscultation sound signal, suppress the influence of the environmental noise signal, and improve the signal-to-noise ratio.
请参阅图6，图6示出了本申请的图5所示的声信号获取方法的步骤S240的流程示意图。下面将针对图6所示的流程进行详细的阐述，所述方法具体可以包括以下步骤：Please refer to FIG. 6. FIG. 6 shows a schematic flowchart of step S240 of the acoustic signal acquisition method shown in FIG. 5 of the present application. The flow shown in FIG. 6 will be described in detail below, and the method may specifically include the following steps:
步骤S241：对所述多个麦克风各自拾取的听诊声信号进行合成处理，获得合成声信号。Step S241: Perform synthesis processing on the auscultation sound signals picked up by the plurality of microphones to obtain a synthesized sound signal.
在本实施例中，在获得多个麦克风各自拾取的听诊声信号后，则可以对多个麦克风各自拾取的听诊声信号进行合成处理，获得该合成声信号。作为一种可实施的方式，在获得多个麦克风各自拾取的听诊声信号后，则可以通过波束成形的方式，将多个麦克风各自拾取的听诊声信号合成一路听诊声信号，即，合成声信号。In this embodiment, after the auscultation sound signals picked up by the multiple microphones are obtained, the auscultation sound signals picked up by the multiple microphones may be synthesized and processed to obtain the synthesized sound signal. As an implementable manner, after the auscultation sound signals picked up by the multiple microphones are obtained, the auscultation sound signals picked up by the multiple microphones can be synthesized into one auscultation sound signal by means of beamforming, that is, the synthesized sound signal .
请参阅图7，图7示出了本申请的图6所示的声信号获取方法的步骤S241的流程示意图。下面将针对图7所示的流程进行详细的阐述，所述方法具体可以包括以下步骤：Please refer to FIG. 7 . FIG. 7 shows a schematic flowchart of step S241 of the acoustic signal acquisition method shown in FIG. 6 of the present application. The flow shown in FIG. 7 will be described in detail below, and the method may specifically include the following steps:
步骤S2411：获取所述多个麦克风各自拾取的听诊声信号对应的权重，其中，所述多个麦克风各自拾取的听诊声信号对应的权重之和为1。Step S2411 : Acquire weights corresponding to the auscultation sound signals picked up by the multiple microphones, wherein the sum of the weights corresponding to the auscultation sound signals picked up by the multiple microphones is 1.
在本实施例中，在获得多个麦克风各自拾取的听诊声信号后，则可以获取该多个麦克风各自拾取的听诊声信号对应的权重，其中，该多个麦克风各自拾取的听诊声信号对应的权重之和为1。In this embodiment, after the auscultation sound signals picked up by the plurality of microphones are obtained, the weights corresponding to the auscultation sound signals picked up by the plurality of microphones can be obtained, wherein the corresponding weights of the auscultation sound signals picked up by the plurality of microphones The sum of the weights is 1.
在一些实施方式中，听诊声信号对应的权重可以与听诊声信号对应，即，听诊声信号对应的权重大小可以根据听诊声信号的不同而改变，而与其他因素无关。此时，可以获取多个麦克风各自拾取的听诊声信号，并对多个麦克风各自拾取的听诊声信号进行解析，获得解析结果，以及基于该解析结果确定多个麦克风各自拾取的听诊声信号对应的权重。In some embodiments, the weight corresponding to the auscultation sound signal may correspond to the auscultation sound signal, that is, the weight corresponding to the auscultation sound signal may vary according to different auscultation sound signals, regardless of other factors. At this time, the auscultation sound signals picked up by the multiple microphones can be acquired, and the auscultation sound signals picked up by the multiple microphones can be analyzed to obtain an analysis result, and based on the analysis result, the corresponding auscultation sound signals picked up by the multiple microphones can be determined. Weights.
在一些实施方式中，听诊声信号对应的权重与麦克风对应，即，听诊声信号对应的权重大小可以根据麦克风的不同而不同，而与其他因素无关。此时，获取获取每个听诊声信号对应的麦克风，并获取每个麦克风对应的权重，基于每个听诊声信号对应的麦克风和每个麦克风对应的权重，可以确定多个麦克风各自拾取的听诊声信号对应的权重。In some embodiments, the weight corresponding to the auscultation sound signal corresponds to the microphone, that is, the magnitude of the weight corresponding to the auscultation sound signal may vary according to different microphones, regardless of other factors. At this time, the microphone corresponding to each auscultation sound signal is obtained, and the weight corresponding to each microphone is obtained. Based on the microphone corresponding to each auscultation sound signal and the corresponding weight of each microphone, the auscultation sounds picked up by the plurality of microphones can be determined. The corresponding weight of the signal.
请参阅图8，图8示出了本申请的图7所示的声信号获取方法的步骤S2411的流程示意图。下面将针对图8所示的流程进行详细的阐述，所述方法具体可以包括以下步骤：Please refer to FIG. 8 , which shows a schematic flowchart of step S2411 of the acoustic signal acquisition method shown in FIG. 7 of the present application. The flow shown in FIG. 8 will be described in detail below, and the method may specifically include the following steps:
步骤S24111：获取所述多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差。Step S24111: Acquire variances of signal-to-noise ratios corresponding to the auscultation sound signals picked up by the plurality of microphones within the target time period.
在本实施例中，听诊器可以预先设置并存储有目标时间段，该目标时间段用于作为获取听诊声信号对应的信噪比的方差的时长依据。因此，在本实施例中，可以获取多个麦克风各自在目标时间段内拾取的听诊声信号，并基于多个麦克风各自在目标时间内拾取的听诊声信号，计算该多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差。In this embodiment, a target time period may be preset and stored in the stethoscope, and the target time period is used as a time length basis for obtaining the variance of the signal-to-noise ratio corresponding to the auscultation sound signal. Therefore, in this embodiment, the auscultation sound signals picked up by the multiple microphones within the target time period may be acquired, and based on the auscultation sound signals picked up by the multiple microphones within the target time period, the respective auscultation sound signals of the multiple microphones may be calculated at the target time period. The variance of the respective signal-to-noise ratios of the auscultation sound signals picked up in the segment.
作为一种可实施的方式，以多个麦克风中的一个麦克风(以下称目标麦克风)为例，则可以获取目标麦克风在目标时间段内拾取的听诊声信号，并基于该目标麦克风在目标时间段内拾取的听诊声信号，计算获得该目标麦克风在目标时间段内拾取的听诊声信号对应的信噪比的方差。例如，请参阅图9，可以通过SNR＝20*log(A1/A2)计算目标麦克风拾取的听诊声信号的信噪比，然后通过目标时间段内的多个信噪比，计算该目标麦克风在目标时间段内拾取的听诊声信号对应的信噪比的方差，其中，A1、A2是用于反应听诊声信号的信号幅度。As an implementable manner, taking one of the multiple microphones (hereinafter referred to as the target microphone) as an example, the auscultation sound signal picked up by the target microphone in the target time period can be obtained, and based on the target microphone in the target time period The variance of the signal-to-noise ratio corresponding to the auscultation sound signal picked up by the target microphone in the target time period is calculated and obtained. For example, referring to Fig. 9, the SNR of the auscultation sound signal picked up by the target microphone can be calculated by SNR=20*log(A1/A2), and then the signal-to-noise ratio of the target microphone in the target time period can be calculated. The variance of the signal-to-noise ratio corresponding to the auscultation sound signal picked up in the target time period, wherein A1 and A2 are the signal amplitudes used to reflect the auscultation sound signal.
步骤S24112：基于所述多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差，获取所述多个麦克风各自拾取的听诊声信号对应的权重。Step S24112: Based on the variance of the respective signal-to-noise ratios of the auscultation sound signals picked up by the multiple microphones within the target time period, obtain the weights corresponding to the auscultation sound signals picked up by the multiple microphones.
在本实施例中，在获得多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差后，则可以基于多个麦克风各自在目标时间段拾取的听诊声信号各自对应的信噪比的方差，获取该多个麦克风各自拾取的听诊声信号对应的权重。In this embodiment, after obtaining the variance of the signal-to-noise ratio corresponding to the auscultation sound signals picked up by the multiple microphones in the target time period, the corresponding The variance of the signal-to-noise ratio is obtained, and the corresponding weights of the auscultation sound signals picked up by the plurality of microphones are obtained.
作为一种可实施的方式，可以基于
步骤S2412：基于所述多个麦克风各自拾取的听诊声信号以及所述多个麦克风各自拾取的听诊声信号对应的权重，获得所述多个麦克风各自拾取的听诊声信号对应的加权声信号。Step S2412: Based on the auscultation sound signals picked up by the multiple microphones and the weights corresponding to the auscultation sound signals picked up by the multiple microphones, obtain weighted sound signals corresponding to the auscultation sound signals picked up by the multiple microphones.
在本实施例中，在获得多个麦克风各自拾取的听诊声信号，以及多个麦克风各自拾取的听诊声信号对应的权重后，则可以基于多个麦克风各自拾取的听诊声信号以及多个麦克风各自拾取的听诊声信号对应的权重，获得该多个麦克风各自拾取的听诊声信号对应的加权声信号。In this embodiment, after obtaining the auscultation sound signals picked up by the multiple microphones and the weights corresponding to the auscultation sound signals picked up by the multiple microphones, the auscultation sound signals picked up by the multiple microphones and the The weights corresponding to the picked up auscultation sound signals are obtained, and the weighted sound signals corresponding to the auscultation sound signals picked up by the plurality of microphones are obtained.
在一些实施方式中，在获得多个麦克风各自拾取的听诊声信号，以及多个麦克风各自拾取的听诊声信号对应的权重后，则可以计算每个听诊声信号与对应的权重的乘积，作为每个听诊声信号对应的加权声信号。例如，假设听诊声信号为S，权重为ω，则该听诊声信号S对应的加权声信号为ω×S。In some embodiments, after obtaining the auscultation sound signals picked up by the multiple microphones and the weights corresponding to the auscultation sound signals picked up by the multiple microphones, the product of each auscultation sound signal and the corresponding weight can be calculated as each auscultation sound signal. A weighted acoustic signal corresponding to each auscultation acoustic signal. For example, assuming that the auscultation sound signal is S and the weight is ω, the weighted sound signal corresponding to the auscultation sound signal S is ω×S.
步骤S2413：对所述多个麦克风各自拾取的听诊声信号对应的加权声信号进行合成处理，获得所述合成声信号。Step S2413: Perform synthesis processing on the weighted sound signals corresponding to the auscultation sound signals picked up by the plurality of microphones to obtain the synthesized sound signals.
在一些实施方式中，在获得多个麦克风各自拾取的听诊声信号对应的加权声信号后，则可以对多个麦克风各自拾取的听诊声信号对应的加权声信号进行合成处理，获得合成声信号。In some embodiments, after obtaining the weighted sound signals corresponding to the auscultation sound signals picked up by the plurality of microphones, synthesis processing may be performed on the weighted sound signals corresponding to the auscultation sound signals picked up by the plurality of microphones to obtain the synthesized sound signal.
作为一种可实施的方式，在获得多个麦克风各自拾取的听诊声信号对应的加权声信号后，则可以将多个麦克风各自拾取的听诊声信号对应的加权声信号相加，获得合成声信号。As an implementable manner, after obtaining the weighted sound signals corresponding to the auscultation sound signals picked up by the multiple microphones, the weighted sound signals corresponding to the auscultation sound signals picked up by the multiple microphones can be added to obtain a synthetic sound signal .
在一些实施方式中，可以通过S合＝ω1×S1...+ωn×Sn对多个麦克风各自拾取的听诊声信号对应的加权声信号进行合成处理，获得合成声信号，其中，S合为合成声信号，ωn×Sn为加权声信号，Sn为听诊声信号，ωn为听诊声信号对应的权重，n为大于或等于2的整数。例如，当n为2时，则可以通过S合＝ω1×S1+ω2×S2对第一麦克风拾取的第一听诊声信号对应的第一加权声信号，以及第二麦克风拾取的第二听诊声信号对应的第二加权声信号进行合成处理，获得合成声信号，其中，ω1×S1为第一加权声信号，ω2×S2为第二加权声信号，S1为第一听诊声信号，S2为第二听诊声信号，ω1为第一听诊声信号对应的权重，ω2为第二听诊声信号对应的权重。In some embodiments, the weighted acoustic signals corresponding to the auscultation sound signals picked up by the plurality of microphones may besynthesized by S = ω1 ×S1 . . . +ωn ×Sn to obtain a synthesized sound signal, wherein , Sis a synthetic sound signal, ωn ×Sn is a weighted sound signal,Sn is auscultation sound signal, ωn is the corresponding weight of auscultation sound signal, n is an integer greater than or equal to 2. For example, when n is 2,the first weighted sound signal corresponding to the first auscultation sound signal picked up by the first microphone and the sound signal picked up by the second microphone can be obtained through S = ω1 ×S1 +ω2 ×S2 The second weighted acoustic signal corresponding to the second auscultation acoustic signal is synthesized and processed to obtain a synthesized acoustic signal, wherein ω1 ×S1 is the first weighted acoustic signal, ω2 ×S2 is the second weighted acoustic signal, and S1 is For the first auscultation sound signal, S2 is the second auscultation sound signal, ω1 is the weight corresponding to the first auscultation sound signal, and ω2 is the weight corresponding to the second auscultation sound signal.
步骤S242：基于所述环境噪声信号对所述合成声信号进行过滤处理，获得所述目标听诊声信号。Step S242: Perform filtering processing on the synthesized sound signal based on the environmental noise signal to obtain the target auscultation sound signal.
在本实施例中，在基于多个麦克风各自采集的听诊声信号合成获得合成声信号后，则可以基于环境噪声信号对合成声信号进行过滤处理，以获得目标听诊声信号。作为一种可实施的方式，在基于多个麦克风各自采集的听诊声信号合成获得合成声信号后，则可以基于环境噪声信号对合成声信号中包含的噪声信号进行消除，获得目标听诊声信号。In this embodiment, after a synthetic sound signal is obtained by synthesizing the auscultation sound signals collected by the multiple microphones, the synthetic sound signal may be filtered based on the environmental noise signal to obtain the target auscultation sound signal. As an implementable manner, after the synthesized acoustic signal is obtained by synthesizing the auscultation sound signals collected by the multiple microphones, the noise signal contained in the synthesized acoustic signal can be eliminated based on the environmental noise signal to obtain the target auscultation sound signal.
在一些实施方式中，可以通过S目＝S合-α×S噪基于环境噪声信号对合成声信号进行过滤处理，获得目标听诊声信号，其中，S目为目标听诊声信号，S噪为环境噪声信号，α为环境噪声信号的滤波因子，0＜α≤1。作为一种可实施的方式，当合成声信号S合＝ω1×S1...+ωn×Sn时，则目标听诊声信号S目＝ω1×S1...+ωn×Sn-α×S噪。例如，当n为2时，则可以通过S目＝ω1×S1+ω2×S2-α×S噪对第一麦克风拾取的第一听诊声信号对应的第一加权声信号、第二麦克风拾取的第二听诊声信号对应的第二加权声信号、以及对第二音频采集装置采集的环境噪声信号进行合成、过滤处理，获得目标听诊声信号，其中，ω1×S1为第一加权声信号，ω2×S2为第二加权声信号，S1为第一听诊声信号，S2为第二听诊声信号，ω1为第一听诊声信号对应的权重，ω2为第二听诊声信号对应的权重，S噪为环境噪声信号，α为环境噪声信号的滤波因子。In some embodiments, the synthetic sound signal can be filtered based on the environmental noise signal by Smesh =Scombined -α×Snoise to obtain the target auscultation sound signal, where Smesh is the target auscultation sound signal, and Snoise is the environment Noise signal, α is the filter factor of environmental noise signal, 0<α≤1. As an implementable manner, whenthe synthesizedacoustic signal S=ω1×S1. ×Sn -α×Snoise . For example, when n is2 ,the first weighted sound signal corresponding to thefirstauscultation sound signal picked up by thefirst microphone, the first weighted sound signal and the first weighted sound signal corresponding to the firstauscultation sound signal picked up by the first microphone may be The target auscultation sound signal is obtained by synthesizing and filtering the second weighted sound signal corresponding to the second auscultation sound signal picked up by the two microphones and the environmental noise signal collected by the second audio collection device, where ω1 ×S1 is the first A weighted sound signal, ω2 ×S2 is the second weighted sound signal, S1 is the first auscultation sound signal, S2 is the second auscultation sound signal, ω1 is the corresponding weight of the first auscultation sound signal, ω2 is The weight corresponding to the second auscultation sound signal, Snoise is the environmental noise signal, and α is the filter factor of the environmental noise signal.
本申请一实施例提供的声信号获取方法，当听诊振膜振动带动空气振动时，通过第一音频采集装置对空气振动产生的听诊声信号进行拾取，获取多个麦克风各自拾取的听诊声信号，获取第二音频采集装置采集的环境噪声信号，基于多个麦克风各自拾取的听诊声信号和环境噪声信号，获得目标听诊声信号。相较于图4所示的声信号获取方法，本实施例还通过第二音频采集装置采集环境噪声信号，以抑制环境噪声的影响，从而提升听诊效果。In the acoustic signal acquisition method provided by an embodiment of the present application, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device, and the auscultation sound signals picked up by the plurality of microphones are acquired respectively, The environmental noise signal collected by the second audio collection device is acquired, and the target auscultation sound signal is obtained based on the auscultation sound signal and the environmental noise signal picked up by the plurality of microphones respectively. Compared with the acoustic signal acquisition method shown in FIG. 4 , in this embodiment, the environmental noise signal is also collected by the second audio collection device, so as to suppress the influence of the environmental noise, thereby improving the auscultation effect.
请参阅图10，图10示出了本申请一实施例提供的声信号获取装置的模块框图。该声信号获取装置200应用于上述听诊器，该听诊器包括听诊振膜和第一音频采集装置，该第一音频采集装置包括多个麦克风，下面将针对图10所述的框图进行阐述，所述声信号获取装置200包括：拾取控制模块210、听诊声信号获取模块220以及目标听诊声信号获得模块230，其中：Please refer to FIG. 10. FIG. 10 shows a block diagram of a module of an apparatus for acquiring an acoustic signal provided by an embodiment of the present application. The acoustic signal acquisition device 200 is applied to the above-mentioned stethoscope. The stethoscope includes an auscultation diaphragm and a first audio collection device. The first audio collection device includes a plurality of microphones. The signal acquisition device 200 includes a pickup control module 210, an auscultation sound signal acquisition module 220, and a target auscultation sound signal acquisition module 230, wherein:
拾取控制模块210，用于当所述听诊振膜振动带动空气振动时，通过所述第一音频采集装置对所述空气振动产生的听诊声信号进行拾取。The pickup control module 210 is configured to pick up the auscultation sound signal generated by the air vibration through the first audio collection device when the auscultation diaphragm vibrates to drive the air to vibrate.
听诊声信号获取模块220，用于获取所述多个麦克风各自拾取的听诊声信号。The auscultation sound signal acquisition module 220 is configured to acquire the auscultation sound signals picked up by each of the plurality of microphones.
目标听诊声信号获得模块230，用于基于所述多个麦克风各自拾取的听诊声信号，获得目标听诊声信号。The target auscultation sound signal obtaining module 230 is configured to obtain the target auscultation sound signal based on the auscultation sound signals picked up by the plurality of microphones respectively.
进一步地，所述听诊器还包括第二音频采集装置，所述目标听诊声信号获得模块230包括：环境噪声信号获取子模块和目标听诊声信号获得子模块，其中：Further, the stethoscope further includes a second audio collection device, and the target auscultation sound signal obtaining module 230 includes: an environmental noise signal obtaining sub-module and a target auscultation sound signal obtaining sub-module, wherein:
环境噪声信号获取子模块，用于获取所述第二音频采集装置采集的环境噪声信号。The environmental noise signal acquisition sub-module is configured to acquire the environmental noise signal collected by the second audio collection device.
目标听诊声信号获得子模块，用于基于所述多个麦克风各自拾取的听诊声信号和所述环境噪声信号，获得所述目标听诊声信号。The target auscultation sound signal obtaining sub-module is configured to obtain the target auscultation sound signal based on the auscultation sound signals picked up by the plurality of microphones and the environmental noise signal.
进一步地，所述目标听诊声信号获得子模块包括：合成声信号获得单元和目标听诊声信号获得单元，其中：Further, the target auscultation sound signal obtaining sub-module includes: a synthetic sound signal obtaining unit and a target auscultation sound signal obtaining unit, wherein:
合成声信号获得单元，用于对所述多个麦克风各自拾取的听诊声信号进行合成处理，获得合成声信号。The synthetic sound signal obtaining unit is configured to perform synthetic processing on the auscultation sound signals picked up by the plurality of microphones to obtain a synthetic sound signal.
进一步地，所述合成声信号获得单元包括：权重获取子单元、加权声信号获得子单元以及合成声信号获得子单元，其中：Further, the synthetic acoustic signal obtaining unit includes: a weight obtaining subunit, a weighted acoustic signal obtaining subunit, and a synthetic acoustic signal obtaining subunit, wherein:
权重获取子单元，用于获取所述多个麦克风各自拾取的听诊声信号对应的权重，其中，所述多个麦克风各自拾取的听诊声信号对应的权重之和为1。The weight acquisition subunit is configured to acquire the weights corresponding to the auscultation sound signals picked up by the multiple microphones, wherein the sum of the weights corresponding to the auscultation sound signals picked up by the multiple microphones is 1.
进一步地，所述权重获取子单元包括：方差获取子子单元和权重获取子子单元，其中：Further, the weight acquisition subunit includes: a variance acquisition subunit and a weight acquisition subunit, wherein:
方差获取子子单元，用于获取所述多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差。The variance acquiring sub-subunit is configured to acquire variances of the respective signal-to-noise ratios of the auscultation sound signals picked up by the plurality of microphones within the target time period.
权重获取子子单元，用于基于所述多个麦克风各自在目标时间段内拾取的听诊声信号各自对应的信噪比的方差，获取所述多个麦克风各自拾取的听诊声信号对应的权重。The weight obtaining sub-unit is configured to obtain the weights corresponding to the auscultation sound signals picked up by the multiple microphones based on the variance of the respective signal-to-noise ratios of the auscultation sound signals picked up by the multiple microphones within the target time period.
进一步地，所述权重获取子子单元包括：权重获取子子子单元，其中：Further, the weight acquiring sub-sub-unit includes: a weight-acquiring sub-sub-sub-unit, wherein:
权重获取子子子单元，用于基于
加权声信号获得子单元，用于基于所述多个麦克风各自拾取的听诊声信号以及所述多个麦克风各自拾取的听诊声信号对应的权重，获得所述多个麦克风各自拾取的听诊声信号对应的加权声信号。A weighted acoustic signal obtaining subunit, configured to obtain the corresponding weights of the auscultation sound signals picked up by the multiple microphones based on the auscultation sound signals picked up by the multiple microphones and the corresponding weights of the auscultation sound signals picked up by the multiple microphones respectively weighted acoustic signal.
合成声信号获得子单元，用于对所述多个麦克风各自拾取的听诊声信号对应的加权声信号进行合成处理，获得所述合成声信号。The synthesized acoustic signal obtaining subunit is used for synthesizing the weighted acoustic signals corresponding to the auscultation acoustic signals picked up by the plurality of microphones to obtain the synthesized acoustic signal.
进一步地，所述合成声信号获得子单元包括：合成声信号获得子子单元，其中：Further, the synthetic acoustic signal obtaining sub-unit includes: a synthetic acoustic signal obtaining sub-unit, wherein:
合成声信号获得子子单元，用于通过S合＝ω1×S1...+ωn×Sn对所述多个麦克风各自拾取的听诊声信号对应的加权声信号进行合成处理，获得所述合成声信号，其中，S合为合成声信号，ωn×Sn为加权声信号，Sn为听诊声信号，ωn为听诊声信号对应的权重，n为大于或等于2的整数。The synthetic acoustic signal obtaining sub-sub-unit is configuredto synthesize the weighted acoustic signals corresponding to the auscultation acoustic signals picked up by the plurality of microphones through S sum = ω1 ×S1 . . . +ωn ×Sn , to obtain The synthetic acoustic signal, wherein Sis a synthetic acoustic signal, ωn ×Sn is a weighted acoustic signal,Sn is an auscultation acoustic signal, ωn is a weight corresponding to the auscultation acoustic signal, and n is an integer greater than or equal to 2 .
目标听诊声信号获得单元，用于基于所述环境噪声信号对所述合成声信号进行过滤处理，获得所述目标听诊声信号。A target auscultation sound signal obtaining unit, configured to filter the synthetic sound signal based on the environmental noise signal to obtain the target auscultation sound signal.
进一步地，所述目标听诊声信号获得单元包括：目标听诊声信号获得子单元，其中：Further, the target auscultation sound signal obtaining unit includes: a target auscultation sound signal obtaining subunit, wherein:
目标听诊声信号获得子单元，用于通过S目＝S合-α×S噪基于所述环境噪声信号对所述合成声信号进行过滤处理，获得所述目标听诊声信号，其中，S目为目标听诊声信号，S噪为环境噪声信号，α为环境噪声信号的滤波因子，0＜α≤1。The target auscultation sound signal obtaining subunit is used for filtering the synthetic sound signal based on the environmental noise signal by using Smesh =Ssum- α×Snoise to obtain the target auscultation sound signal, where Smesh is Target auscultation sound signal, Snoise is the environmental noise signal, α is the filter factor of the environmental noise signal, 0<α≤1.
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述装置和模块的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the above-described devices and modules, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.
在本申请所提供的几个实施例中，模块相互之间的耦合可以是电性，机械或其它形式的耦合。In several embodiments provided in this application, the coupling between the modules may be electrical, mechanical or other forms of coupling.
另外，在本申请各个实施例中的各功能模块可以集成在一个处理模块中，也可以是各个模块单独物理存在，也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.
请参阅图11，其示出了本申请实施例提供的一种听诊器100的结构框图。该听诊器100可以是智能手机、平板电脑、电子书等能够运行应用程序的电子设备。本申请中的听诊器100可以包括一个或多个如下部件：处理器110、存储器120以及一个或多个应用程序，其中一个或多个应用程序可以被存储在存储器120中并被配置为由一个或多个处理器110执行，一个或多个程序配置用于执行如前述方法实施例所描述的方法。Please refer to FIG. 11 , which shows a structural block diagram of a stethoscope 100 provided by an embodiment of the present application. The stethoscope 100 may be an electronic device capable of running an application program, such as a smart phone, a tablet computer, an electronic book, or the like. The stethoscope 100 in the present application may include one or more of the following components: a
其中，处理器110可以包括一个或者多个处理核。处理器110利用各种接口和线路连接整个听诊器100内的各个部分，通过运行或执行存储在存储器120内的指令、程序、代码集或指令集，以及调用存储在存储器120内的数据，执行听诊器100的各种功能和处理数据。可选地，处理器110可以采用数字信号处理(Digital Signal Processing，DSP)、现场可编程门阵列(Field－Programmable Gate Array，FPGA)、可编程逻辑阵列(ProgrammableLogic Array，PLA)中的至少一种硬件形式来实现。处理器110可集成中央处理器(CentralProcessing Unit，CPU)、图形处理器(Graphics Processing Unit，GPU)和调制解调器等中的一种或几种的组合。其中，CPU主要处理操作系统、用户界面和应用程序等；GPU用于负责待显示内容的渲染和绘制；调制解调器用于处理无线通信。可以理解的是，上述调制解调器也可以不集成到处理器110中，单独通过一块通信芯片进行实现。The
存储器120可以包括随机存储器(Random Access Memory，RAM)，也可以包括只读存储器(Read-Only Memory)。存储器120可用于存储指令、程序、代码、代码集或指令集。存储器120可包括存储程序区和存储数据区，其中，存储程序区可存储用于实现操作系统的指令、用于实现至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等。存储数据区还可以存储听诊器100在使用中所创建的数据(比如电话本、音视频数据、聊天记录数据)等。The
请参阅图12，其示出了本申请实施例提供的一种计算机可读存储介质的结构框图。该计算机可读介质300中存储有程序代码，所述程序代码可被处理器调用执行上述方法实施例中所描述的方法。Please refer to FIG. 12 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. The computer-readable medium 300 stores program codes, and the program codes can be invoked by the processor to execute the methods described in the above method embodiments.
计算机可读存储介质300可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。可选地，计算机可读存储介质300包括非易失性计算机可读介质(non-transitory computer-readable storage medium)。计算机可读存储介质300具有执行上述方法中的任何方法步骤的程序代码310的存储空间。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。程序代码310可以例如以适当形式进行压缩。The computer-readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 300 has storage space for
综上所述，本申请实施例提供的声信号获取方法、装置、听诊器以及存储介质，当听诊振膜振动带动空气振动时，通过第一音频采集装置对空气振动产生的听诊声信号进行拾取，获取多个麦克风各自拾取的听诊声信号，基于多个麦克风各自拾取的听诊声信号，获得目标听诊声信号，从而通过多通道采集听诊声信号，能够实现听诊声信号增强的效果，实现信噪比的提升，从而提升听诊效果。To sum up, according to the method, device, stethoscope and storage medium provided in the embodiments of the present application, when the vibration of the auscultation diaphragm drives the air to vibrate, the auscultation sound signal generated by the air vibration is picked up by the first audio collection device, Obtain the auscultation sound signals picked up by multiple microphones, and obtain the target auscultation sound signal based on the auscultation sound signals picked up by the multiple microphones, so as to collect the auscultation sound signals through multiple channels, which can enhance the auscultation sound signal and achieve the signal-to-noise ratio. to improve the auscultation effect.
最后应说明的是：以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or some technical features thereof are equivalently replaced; and these modifications or replacements do not drive the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (11)
Translated fromChinese
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210119158.5ACN114515164A (en) | 2022-02-08 | 2022-02-08 | Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210119158.5ACN114515164A (en) | 2022-02-08 | 2022-02-08 | Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114515164Atrue CN114515164A (en) | 2022-05-20 |
Family
ID=81597656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210119158.5APendingCN114515164A (en) | 2022-02-08 | 2022-02-08 | Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114515164A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2014234A1 (en)* | 2007-06-04 | 2009-01-14 | Universita'degli Studi Di Milano | Auscultation device with high ambient noise rejection and operating method thereof |
| CN102088912A (en)* | 2008-07-11 | 2011-06-08 | 阿尔卡特朗讯 | Application server for reducing environmental noise in auscultation signals and recording comments when auscultating a patient with an electronic stethoscope |
| US20110137209A1 (en)* | 2009-11-04 | 2011-06-09 | Lahiji Rosa R | Microphone arrays for listening to internal organs of the body |
| KR101407049B1 (en)* | 2013-01-16 | 2014-06-24 | 이병훈 | An apparatus and method of extracting body signals from signals including noise signals and detected by a stethoscope |
| CN208447630U (en)* | 2017-10-17 | 2019-02-01 | 歌尔科技有限公司 | A kind of stethoscope |
| US20190183450A1 (en)* | 2017-12-20 | 2019-06-20 | International Business Machines Corporation | Monitoring body sounds and detecting health conditions |
| CN111132620A (en)* | 2017-09-28 | 2020-05-08 | 聿信医疗科技股份有限公司 | Networked Electronic Stethoscope System |
| CN111544030A (en)* | 2020-05-20 | 2020-08-18 | 京东方科技集团股份有限公司 | Stethoscope, diagnosis device and diagnosis method |
| US20210030390A1 (en)* | 2018-04-20 | 2021-02-04 | Ai Health Highway India Private Limited | Electronic stethoscope |
| CN113520449A (en)* | 2020-04-13 | 2021-10-22 | 中国人民解放军海军特色医学中心 | Electronic auscultation system and method |
- 2022
- 2022-02-08CNCN202210119158.5Apatent/CN114515164A/enactivePending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2014234A1 (en)* | 2007-06-04 | 2009-01-14 | Universita'degli Studi Di Milano | Auscultation device with high ambient noise rejection and operating method thereof |
| CN102088912A (en)* | 2008-07-11 | 2011-06-08 | 阿尔卡特朗讯 | Application server for reducing environmental noise in auscultation signals and recording comments when auscultating a patient with an electronic stethoscope |
| US20110137209A1 (en)* | 2009-11-04 | 2011-06-09 | Lahiji Rosa R | Microphone arrays for listening to internal organs of the body |
| KR101407049B1 (en)* | 2013-01-16 | 2014-06-24 | 이병훈 | An apparatus and method of extracting body signals from signals including noise signals and detected by a stethoscope |
| CN111132620A (en)* | 2017-09-28 | 2020-05-08 | 聿信医疗科技股份有限公司 | Networked Electronic Stethoscope System |
| CN208447630U (en)* | 2017-10-17 | 2019-02-01 | 歌尔科技有限公司 | A kind of stethoscope |
| US20190183450A1 (en)* | 2017-12-20 | 2019-06-20 | International Business Machines Corporation | Monitoring body sounds and detecting health conditions |
| US20210030390A1 (en)* | 2018-04-20 | 2021-02-04 | Ai Health Highway India Private Limited | Electronic stethoscope |
| CN113520449A (en)* | 2020-04-13 | 2021-10-22 | 中国人民解放军海军特色医学中心 | Electronic auscultation system and method |
| CN111544030A (en)* | 2020-05-20 | 2020-08-18 | 京东方科技集团股份有限公司 | Stethoscope, diagnosis device and diagnosis method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111132620A (en) | Networked Electronic Stethoscope System | |
| JP3626198B2 (en) | Electronic stethoscope | |
| AU2006215644B2 (en) | Sound monitor | |
| CN106344064B (en) | Audio signal acquisition device and acquisition method | |
| US20170281089A1 (en) | Acoustic sensors for abdominal fetal cardiac activity detection | |
| WO2016147054A1 (en) | Acoustic sensors for abdominal fetal cardiac activity detection | |
| CN111657991A (en) | Intelligent array sensor electronic auscultation system | |
| WO2013086112A1 (en) | Electronic stethoscopes with user selectable digital filters | |
| CN102340719B (en) | Method and device for acquiring sound signal based on sensor | |
| CN111150422A (en) | Intelligent auscultation system and auscultation method thereof | |
| CN104287772A (en) | Digital stethoscope | |
| CN102228381A (en) | Wireless stethoscope head | |
| CN209018776U (en) | smart stethoscope | |
| CN202386677U (en) | Multi-channel lung sound imaging device | |
| CN104064190A (en) | Human body audio digital collection and recognition system and implementation method thereof | |
| CN119167008A (en) | Signal noise reduction processing method, device, stethoscope device and storage medium | |
| CN111388003B (en) | Flexible electronic auscultation device, body sound determination device and auscultation system | |
| CN114515164A (en) | Acoustic signal acquisition method, acoustic signal acquisition device, stethoscope, and storage medium | |
| CN117119020A (en) | System for monitoring human cardiopulmonary activity state by using mobile phone microphone as stethoscope | |
| CN203408061U (en) | Heart sound signal display and storage system based on Android | |
| CN206414284U (en) | A kind of audio signal sample device | |
| CN209107399U (en) | Electronic auscultation device, electronic auscultation apparatus and system | |
| US20140012095A1 (en) | Storage control apparatus, storage control system, and storage medium | |
| Jain et al. | Development of a low-cost electronic stethoscope-DIY Digital Stethoscope | |
| CN202211703U (en) | Wireless auscultation head |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20220520 |