技术领域technical field
本发明涉及数据处理技术领域，尤其涉及一种音频处理方法、音频处理装置、移动终端以及计算机可读存储介质。The present invention relates to the technical field of data processing, and in particular to an audio processing method, an audio processing device, a mobile terminal, and a computer-readable storage medium.
背景技术Background technique
用户在使用音乐播放器听音乐时，会产生多种多样的个性化需求。为满足用户的需求，不断有新的音乐播放器的功能被开发和改进。这些功能的种类与效果直接决定了用户的音乐播放体验。When users use music players to listen to music, they will have various personalized needs. In order to meet the needs of users, the functions of new music players are constantly being developed and improved. The types and effects of these functions directly determine the user's music playback experience.
在用户听音乐时，有时会有只听某个乐器或某个歌手的音乐的需求，例如，用户认为某个乐器的声音或某个歌手的歌声特别好听，想要去掉其他声音的干扰，只听这个乐器或这个歌手的音乐。然而，当前常用的音频处理的技术方案无法满足用户只听某种音色的音乐的需求。When a user listens to music, sometimes there is a need to only listen to a certain musical instrument or the music of a certain singer. Listen to this instrument or this singer's music. However, currently commonly used technical solutions for audio processing cannot satisfy the user's requirement of only listening to music of a certain timbre.
发明内容Contents of the invention
本发明实施例的目的是提供一种音频处理方法、音频处理装置、移动终端以及计算机可读存储介质，以解决无法满足用户只听某种音色的音乐的需求的问题。The purpose of the embodiments of the present invention is to provide an audio processing method, an audio processing device, a mobile terminal, and a computer-readable storage medium, so as to solve the problem that users cannot only listen to music of a certain tone color.
为解决上述技术问题，本发明实施例是这样实现的：In order to solve the above-mentioned technical problems, the embodiment of the present invention is implemented as follows:
第一方面，本发明实施例提供了一种音频处理方法，应用于移动终端，包括：接收对目标音乐的拆分请求；响应于拆分请求，获取目标音乐的元数据，其中，元数据包括目标音乐的频谱信息；根据频谱信息拆分目标音乐，得到多个音乐片段，其中，每个音乐片段对应一种音色。In a first aspect, an embodiment of the present invention provides an audio processing method applied to a mobile terminal, including: receiving a split request for target music; and obtaining metadata of the target music in response to the split request, wherein the metadata includes Spectrum information of the target music; splitting the target music according to the spectrum information to obtain multiple music fragments, wherein each music fragment corresponds to a tone color.
第二方面，本发明实施例提供了一种音频处理装置，应用于移动终端，包括：拆分请求接收模块，用于接收对目标音乐的拆分请求；元数据获取模块，用于响应于拆分请求，获取目标音乐的元数据，其中，元数据包括目标音乐的频谱信息；音乐拆分模块，用于根据频谱信息拆分目标音乐，得到多个音乐片段，其中，每个音乐片段对应一种音色。In a second aspect, an embodiment of the present invention provides an audio processing device, which is applied to a mobile terminal, including: a split request receiving module, configured to receive a split request for target music; a metadata acquisition module, configured to respond to the split request sub-request to obtain the metadata of the target music, wherein the metadata includes the spectrum information of the target music; the music splitting module is used to split the target music according to the spectrum information to obtain a plurality of music fragments, wherein each music fragment corresponds to a tone.
第三方面，本发明实施例提供了一种移动终端，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，计算机程序被处理器执行时实现如上述第一方面所述的音频处理方法的步骤。In a third aspect, an embodiment of the present invention provides a mobile terminal, including: a memory, a processor, and a computer program stored in the memory and operable on the processor. When the computer program is executed by the processor, the above-mentioned first aspect is implemented. The steps of the audio processing method.
第四方面，本发明实施例提供了一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，计算机程序被处理器执行时实现如上述第一方面所述的音频处理方法的步骤。In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the audio processing method described in the above-mentioned first aspect are implemented. .
根据本发明实施例的技术方案，一方面，接收对目标音乐的拆分请求，能够确定想要进行拆分的目标音乐；另一方面，响应于拆分请求，获取目标音乐的元数据，能够得到包含目标音乐的频谱信息的元数据；再一方面，根据频谱信息拆分目标音乐，得到多个音乐片段，能够实现自动按音色对音乐拆分的功能，满足了用户只听某个音色的音乐的需求。According to the technical solution of the embodiment of the present invention, on the one hand, receiving the splitting request to the target music, can determine the target music to be split; on the other hand, in response to the splitting request, obtain the metadata of the target music, can Obtain the metadata containing the spectrum information of the target music; on the other hand, split the target music according to the spectrum information to obtain multiple music fragments, which can realize the function of automatically splitting the music according to the timbre, satisfying the user's desire to only listen to a certain timbre music needs.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明中记载的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments described in the present invention. Those skilled in the art can also obtain other drawings based on these drawings without any creative effort.
图1示出了根据本发明的一些实施例提供的音频处理方法的流程示意图；FIG. 1 shows a schematic flowchart of an audio processing method provided according to some embodiments of the present invention;
图2示出了根据本发明的另一些实施例提供的音频处理方法的流程示意图；Fig. 2 shows a schematic flowchart of an audio processing method provided according to another embodiment of the present invention;
图3示出了根据本发明的一些实施例提供的音频处理方法的应用场景的示意图；Fig. 3 shows a schematic diagram of an application scenario of an audio processing method provided according to some embodiments of the present invention;
图4示出了根据本发明的一些实施例提供的按音色拆分目标音乐片段的流程示意图；Fig. 4 shows a schematic flow chart of splitting target music segments according to timbre provided according to some embodiments of the present invention;
图5示出了根据本发明的一些实施例提供的音频处理装置的示意框图；以及Fig. 5 shows a schematic block diagram of an audio processing device provided according to some embodiments of the present invention; and
图6示出了根据本发明的另一些实施例提供的移动终端的示意框图。Fig. 6 shows a schematic block diagram of a mobile terminal provided according to other embodiments of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明中的技术方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都应当属于本发明保护的范围。In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
图1示出了根据本发明的一些实施例提供的音频处理方法的流程示意图，该音频处理方法应用于移动终端。参照图1所示，该音频处理方法包括步骤S110、步骤S120、步骤S130。下面对图1的示例实施例中的音频处理方法进行详细的说明。Fig. 1 shows a schematic flowchart of an audio processing method provided according to some embodiments of the present invention, and the audio processing method is applied to a mobile terminal. Referring to FIG. 1, the audio processing method includes step S110, step S120, and step S130. The audio processing method in the example embodiment of FIG. 1 will be described in detail below.
参照图1所示，在步骤S110中，接收对目标音乐的拆分请求。Referring to FIG. 1 , in step S110, a split request for target music is received.
在一些实施例中，音乐播放器接收到想要对目标音乐，例如一首歌曲“南屏晚钟”，进行拆分的请求。提出拆分目标音乐的请求的方式可以是点击在播放器界面预先设置的控件“查看拆分音乐片段”，也可以是当播放歌曲时音乐播放器后台自动提出对该歌曲进行拆分的请求，本发明对此并不进行特殊限定。In some embodiments, the music player receives a request to split target music, such as a song "Nanping Evening Bell". The way to make a request to split the target music can be to click the pre-set control on the player interface "View Split Music Segment", or the background of the music player can automatically make a request to split the song when the song is playing. The present invention does not specifically limit it.
在另一些示例实施例中，接收对目标音乐片段的拆分请求。除了完整的音乐曲目，音乐片段也可以被音乐播放器按音色拆分。接收对目标音乐片段的拆分请求的方式可以是接收对目标音乐的进度条上的目标点的获取指令，也可以是将一首歌自动拆分成若干个短时间的音乐片段后播放器提供的音乐片段列表中选择想要拆分的目标音乐片段，本发明对此并不进行特殊限定。In other example embodiments, a split request for a target piece of music is received. In addition to complete music tracks, music clips can also be split by timbre by the music player. The way to receive the split request for the target music segment can be to receive the instruction to acquire the target point on the progress bar of the target music, or to automatically split a song into several short-term music segments and then the player provides Select the target music segment that you want to split from the list of music segments, which is not specifically limited in the present invention.
参照图1所示，在步骤S120中，响应于拆分请求，获取目标音乐的元数据，其中，元数据包括目标音乐的频谱信息。Referring to FIG. 1, in step S120, in response to the split request, metadata of the target music is acquired, wherein the metadata includes spectrum information of the target music.
在示例实施例中，用户提出播放目标音乐的请求，此时音乐播放器自动提出对目标音乐的拆分请求，首先确定目标音乐的元数据是否存在于服务器：若服务器中存在目标音乐的元数据，则服务器返回该元数据到音乐播放器；若服务器中不存在目标音乐的元数据，则通过网络下载目标音乐到服务器中，对下载的目标音乐进行分析，生成目标音乐的元数据，再将生成的元数据返回音乐播放器。其中，该元数据包括目标音乐的频谱信息，例如目标音乐的波形图的频率、相位等信息。In an exemplary embodiment, the user puts forward a request to play the target music. At this time, the music player automatically proposes a split request to the target music, and first determines whether the metadata of the target music exists in the server: if the metadata of the target music exists in the server , the server returns the metadata to the music player; if the metadata of the target music does not exist in the server, the target music is downloaded to the server through the network, the downloaded target music is analyzed, and the metadata of the target music is generated, and then The generated metadata is returned to the music player. Wherein, the metadata includes spectrum information of the target music, such as information such as frequency and phase of the wave form of the target music.
在示例实施例中，一种音色计划产生的音调的声波称之为基波，在乐理上又叫基音，例如想用小提琴拉出频率为1000赫兹的音调；伴随基音发出的音调的声波称之为谐波，在乐理上又叫泛音，例如小提琴在拉出频率为1000赫兹的音调时往往伴随着2000赫兹、3000赫兹等一系列声音。基波与谐波叠加在一起，成为我们能观测到的音波的波形图，可利用数学工具将其分离出来进行分析和处理。多种音色在演奏同一个声调时，不同音色对应的泛音与基音的混合比例不同，反映到波形图中，可以看到每种音色的音波对应的波形图形状各不相同，故频率、相位等参数各不相同。每种音色演奏一个音调时的波形图的频率、相位等信息，可以作为区分不同音色的特征参数。In an exemplary embodiment, the sound wave of a pitch produced by a timbre plan is called the fundamental wave, which is also called the fundamental tone in music theory. For harmonics, it is also called overtone in music theory. For example, when a violin produces a tone with a frequency of 1000 Hz, it is often accompanied by a series of sounds such as 2000 Hz and 3000 Hz. The fundamental wave and the harmonic are superimposed together to form a waveform diagram of the sound wave that we can observe, which can be separated for analysis and processing using mathematical tools. When multiple timbres play the same tone, the mixing ratios of overtones and fundamentals corresponding to different timbres are different, which is reflected in the waveform diagram. It can be seen that the shape of the waveform diagram corresponding to the sound wave of each timbre is different, so the frequency, phase, etc. The parameters vary. The frequency, phase and other information of the waveform diagram when each timbre plays a tone can be used as characteristic parameters to distinguish different timbres.
需要说明的是，目标音乐的元数据除了包含目标音乐的频谱信息之外，还可以包含作曲人、歌曲名称、演唱者等信息，也可以包含其他适当的音乐信息，这同样在本发明的保护范围内。It should be noted that, besides the spectrum information of the target music, the metadata of the target music may also contain information such as composer, song title, singer, etc., and may also contain other appropriate music information, which is also covered under the protection of the present invention. within range.
接下来，在步骤S120中，根据频谱信息拆分目标音乐，得到多个音乐片段，其中，每个音乐片段对应一种音色。Next, in step S120, the target music is split according to the frequency spectrum information to obtain a plurality of music fragments, wherein each music fragment corresponds to a tone color.
在示例实施例中，在音乐播放器中，根据目标音乐的多种音色各自的频率、相位等参数，可以把目标音乐分离为多个音乐片段，每个音乐片段对应一种音色。目标音乐的波形图为若干条不同形状的周期性波形，每条周期性波形对应一种音色，根据频谱信息拆分后，一个音乐片段的波形图为一条周期性波形，不同音乐片段对应的波形形状不同。In an exemplary embodiment, in the music player, the target music can be separated into multiple music segments according to the frequency, phase and other parameters of various timbres of the target music, and each music segment corresponds to a timbre. The waveform diagram of the target music is a number of periodic waveforms of different shapes, and each periodic waveform corresponds to a tone color. After splitting according to the spectrum information, the waveform diagram of a music segment is a periodic waveform, and the waveforms corresponding to different music segments The shapes are different.
进一步地，在示例实施例中，将音乐片段对应的频谱信息与音色信息库中的各种音色的频谱信息进行匹配，该音色信息库中存储有多种音色的频谱信息与标识信息；基于匹配结果确定该音乐片段对应的音色的标识信息，其中，该音色的标识信息包括所述音色对应的乐器或演唱者的信息。Further, in an exemplary embodiment, the spectral information corresponding to the music piece is matched with the spectral information of various timbres in the timbre information library, and the spectral information and identification information of various timbres are stored in the timbre information library; based on the matching As a result, the identification information of the timbre corresponding to the music segment is determined, wherein the identification information of the timbre includes the information of the musical instrument or singer corresponding to the timbre.
在示例实施例中，音色信息库中的数据可以是通过互联网搜索了大量的音乐并进行分析处理后得到的，也可以是通过人工录入的方法得到的，本发明对此并不进行特殊限定。In an exemplary embodiment, the data in the timbre information library may be obtained after searching a large amount of music on the Internet and analyzing and processing, or may be obtained by manual input, which is not specifically limited in the present invention.
需要注意的是，每种乐器对应一种音色的音乐片段，不同人发出的人声音色不同，每一位演唱者对应一个被拆分出的音乐片段，例如音乐“南屏晚钟”拆分后可得到多个音乐片段：华晨宇片段、苏诗丁片段、钢琴片段、贝斯片段、和声片段、架子鼓片段。It should be noted that each musical instrument corresponds to a piece of music with a timbre, and the voices of different people have different timbres. Each singer corresponds to a piece of music that has been split. For example, the music "Nanping Evening Bell" split Afterwards, multiple music clips can be obtained: Hua Chenyu clip, Su Shiding clip, piano clip, bass clip, harmony clip, and drum kit clip.
根据图1的示例实施例中的音频处理方法，一方面，接收对目标音乐的拆分请求，可以确定想要进行拆分的目标音乐；另一方面，响应于拆分请求，获取目标音乐的元数据，能够得到包含目标音乐的频谱信息的元数据；再一方面，根据频谱信息拆分目标音乐，得到多个音乐片段，能够实现自动按音色对音乐拆分的功能，满足了用户只听某个音色的音乐的需求。According to the audio processing method in the example embodiment of Fig. 1, on the one hand, receive the split request to target music, can determine the target music that wants to split; Metadata, which can obtain the metadata containing the spectrum information of the target music; on the other hand, split the target music according to the spectrum information to obtain multiple music fragments, which can realize the function of automatically splitting the music according to the timbre, satisfying the requirement that users only listen to The demand for music of a certain timbre.
进一步地，在示例实施例中，将目标音乐或目标音乐片段按音色拆分成若干个单音色的音乐片段后，还可以基于用户发出的混合操作指令将其中几种不同音色的音乐片段混合后播放。Further, in the exemplary embodiment, after splitting the target music or the target music segment into several single-tone music segments according to the timbre, several music segments of different timbres can be mixed based on the mixing operation instruction issued by the user. play.
图2示出了根据本发明的另一些实施例提供的音频处理方法的流程示意图。Fig. 2 shows a schematic flowchart of an audio processing method provided according to other embodiments of the present invention.
参照图2所示，在步骤S210中，音乐播放器请求服务器中的元数据。Referring to FIG. 2, in step S210, the music player requests metadata from the server.
在示例实施例中，音乐播放器请求服务器返回目标音乐的元数据。元数据是描述目标音乐的数据，包含了许多目标音乐相关的信息，例如音乐的名称、艺人、专辑、年份等。In an example embodiment, the music player requests that the server return metadata for the targeted music. Metadata is the data describing the target music, which contains a lot of information related to the target music, such as the name, artist, album, year, etc. of the music.
接下来，在步骤S215中，确认元数据是否存在于服务器中：若元数据存在于服务器，则进入步骤S235；若元数据不存在于服务器，则进入步骤S220。Next, in step S215, it is confirmed whether the metadata exists in the server: if the metadata exists in the server, proceed to step S235; if the metadata does not exist in the server, proceed to step S220.
在示例实施例中，确认元数据是否存在于服务器，主要是确认包含频谱信息的元数据是否存在于服务器，元数据中与此无关的信息是否缺失对步骤S215的判断不构成影响。In an exemplary embodiment, confirming whether the metadata exists on the server is mainly to confirm whether the metadata including spectrum information exists on the server, and whether irrelevant information in the metadata is missing does not affect the judgment of step S215.
在步骤S220中，通过网络下载目标音乐。In step S220, the target music is downloaded through the network.
在示例实施例中，除了联网下载，获取目标音乐的方式也可以是加载本地音乐，本发明对此不进行特殊限定。In an exemplary embodiment, in addition to downloading through the Internet, the way to acquire the target music may also be to load local music, which is not specifically limited in the present invention.
在步骤S225中，服务器对目标音乐进行分析。In step S225, the server analyzes the target music.
在示例实施例中，服务器分析目标音乐的波形图，得到波形图中多种音色对应的多个周期性波形各自的频率相位等频谱信息。In an exemplary embodiment, the server analyzes the waveform diagram of the target music to obtain frequency spectrum information such as frequency phases of multiple periodic waveforms corresponding to multiple timbres in the waveform diagram.
在步骤S230中，生成元数据。In step S230, metadata is generated.
在示例实施例中，根据步骤S225中得到的频谱信息，生成包含目标音乐的频谱信息的目标音乐的元数据。In an exemplary embodiment, metadata of the target music including the spectrum information of the target music is generated based on the spectrum information obtained in step S225.
在步骤S235中，元数据被返回到音乐播放器。In step S235, metadata is returned to the music player.
在示例实施例中，若服务器中已经存有目标音乐的包含频谱信息的元数据，步骤S215得到的答复是“是”，服务器直接返回元数据到音乐播放器；若服务器中没有目标音乐的元数据，则步骤S215得到的答复是“否”，经过步骤S220、步骤S225、步骤S230后，将生成的包含频谱信息的元数据返回音乐播放器。In an example embodiment, if there is metadata containing spectrum information of the target music in the server, the answer obtained in step S215 is "Yes", and the server directly returns the metadata to the music player; if there is no metadata of the target music in the server, data, the answer obtained in step S215 is "No", and after step S220, step S225, and step S230, the generated metadata containing spectrum information is returned to the music player.
在另一些示例实施例中，服务器中存在不完整的目标音乐的元数据，即缺乏关键的频谱信息。此时步骤S215得到的答复也是“否”，跳过步骤S220,经过步骤S225、步骤S230后，将生成的包含频谱信息的元数据返回音乐播放器。In some other exemplary embodiments, there is incomplete metadata of the target music in the server, ie lack of key spectral information. At this time, the answer obtained in step S215 is also "No", step S220 is skipped, and after step S225 and step S230, the generated metadata containing spectrum information is returned to the music player.
在步骤S240中，根据服务器返回的元数据对目标音乐进行拆分。In step S240, the target music is split according to the metadata returned by the server.
在示例实施例中，根据服务器返回的元数据中的频谱信息，音乐播放器中集成的音乐拆分模块将目标音乐拆分为单音色的音乐片段。在拆分后的单音色音乐片段中，目标音乐的混音中消除掉一部分声音，只保留一种音色的声音。例如，钢琴片段中只留下钢琴声，没有歌手的人声、伴奏的和声以及其他乐器的声音。In an example embodiment, according to the frequency spectrum information in the metadata returned by the server, the music splitting module integrated in the music player splits the target music into monochromatic music segments. In the split monochrome music segment, part of the sound is eliminated from the mix of the target music, and only the sound of one tone is retained. For example, only the piano sound is left in the piano section, without the vocals of the singer, the harmony of the accompaniment, and the sounds of other instruments.
在步骤S245中，将拆分后的音乐片段保存在客户端本地缓存。In step S245, save the split music segment in the local cache of the client.
在示例实施例中，将拆分后的音乐片段先按音色命名，然后保存在客户端本地缓存，以便用户提出查看拆分音乐片段列表的请求时加载并播放。In an example embodiment, the divided music pieces are first named according to the timbre, and then stored in the client's local cache, so that the user can load and play when requesting to view the list of divided music pieces.
在示例实施例中，拆分后的每个音乐片段都对应一种音色，例如：钢琴独奏音乐片段、小提琴独奏音乐片段、华晨宇单独演唱音乐片段、苏诗丁单独演唱音乐片段。In an exemplary embodiment, each divided music segment corresponds to a tone color, for example: a piano solo music segment, a violin solo music segment, a music segment sung by Hua Chenyu alone, and a music segment sung by Su Shiding alone.
需要说明的是，在示例实施例中，每种乐器都对应一种音色，一种乐器独奏的音乐片段被视为一种音色的音乐片段；人声与乐器声不同，每个人的人声都是一种独特的音色，不能将所有人声归为同一种音色，因此，两位不同歌手的单独演唱音乐片段被视为两种音色的音乐片段。It should be noted that, in the exemplary embodiment, each musical instrument corresponds to a timbre, and a musical segment played by an instrument solo is regarded as a musical segment of a timbre; It is a unique timbre, and all voices cannot be classified as the same timbre. Therefore, a piece of music sung by two different singers alone is regarded as a music piece of two timbres.
在示例实施例中，命名规则如下：某个歌手单独演唱的音乐片段，以歌手名称命名，例如将华晨宇单独演唱音乐片段命名为“华晨宇片段”；某个乐器独奏的音乐片段，以乐器名称命名，例如将钢琴独奏音乐片段命名为“钢琴片段”。In the exemplary embodiment, the naming rules are as follows: a piece of music sung by a certain singer is named after the name of the singer, for example, a piece of music sung by Hua Chenyu alone is named "Hua Chenyu Section"; a piece of music performed by a certain instrument is named after the name of the instrument name, such as naming a solo piano piece "Piano Section".
进一步地，在示例实施例中，在某个歌手单独演唱的音乐片段中，只有此歌手的人声，没有任何背景音乐和伴唱，类似于清唱；在某个乐器独奏的音乐片段中，只有此乐器的声音，不存在人声和其他乐器声。Further, in an exemplary embodiment, in a music segment sung by a certain singer alone, there is only the vocal of the singer without any background music and accompaniment, similar to a cappella; in a music segment performed by a certain instrument solo, only the vocal The sound of musical instruments, there is no human voice and other instrumental sounds.
在步骤S250中，在播放器界面显示拆分后的片段列表。In step S250, the split segment list is displayed on the player interface.
在示例实施例中，用户提出查看拆分音乐片段列表的请求，音乐播放器从客户端本地缓存加载目标音乐的所有拆分后的音乐片段，以列表的形式显示在播放器界面，供用户查看与选择播放。In an exemplary embodiment, the user puts forward a request to view a list of split music fragments, and the music player loads all split music fragments of the target music from the local cache of the client, and displays them on the player interface in the form of a list for the user to view. and select Play.
在示例实施例中，在音乐播放器接到显示拆分后的音乐片段的列表的请求后，从客户端本地缓存加载将目标音乐拆分后得到的所有音乐片段，并将其显示在播放器界面上。用户点击感兴趣的音乐片段，音乐播放器会停止播放原本的音乐，开始播放用户选择的音乐片段。In an exemplary embodiment, after the music player receives a request for displaying a list of split music pieces, it loads all the music pieces obtained after the target music is split from the local cache of the client, and displays them on the player. interface. When the user clicks on the music clip he is interested in, the music player will stop playing the original music and start playing the music clip selected by the user.
进一步地，在示例实施例中，用户向音乐播放器提出显示拆分后的音乐片段的列表的请求有多种方式，例如，点击控件“查看拆分音乐片段”，或长按目标音乐的进度条上的目标点。Further, in an exemplary embodiment, there are various ways for the user to request the music player to display a list of split music pieces, for example, click on the control "view split music pieces", or press and hold the progress of the target music target point on the bar.
此外，在另一些示例实施例中，点击拆分后的音乐片段，播放用户选择的音乐片段的同时，在播放器界面展示与音乐片段对应音色的乐谱。例如，用户点击“钢琴片段”，音乐播放器停下原本的音乐播放工作，开始播放该音乐片段，此时播放器界面展示的是与该音乐片段对应的钢琴琴谱；用户点击“华晨宇片段”，播放器界面展示的是与该音乐片段对应的带有歌词的歌曲乐谱。这些乐谱可以被分享到指定目的地，例如，将“钢琴乐谱”分享至朋友圈。In addition, in some other example embodiments, when the divided music segment is clicked, and the music segment selected by the user is played, the music score corresponding to the timbre of the music segment is displayed on the player interface. For example, when the user clicks "Piano Fragment", the music player stops the original music playback and starts playing the music fragment. At this time, the player interface displays the piano score corresponding to the music fragment; ”, the player interface displays the song score with lyrics corresponding to the music clip. These scores can be shared to designated destinations, for example, share "piano score" to Moments.
在示例实施例中，在播放器界面显示拆分后的音乐片段的列表中，每一个音乐片段都可以被分享到指定目的地，例如，将“华晨宇片段”分享至朋友圈，将“贝斯片段”分享至QQ好友。In an exemplary embodiment, in the list of split music clips displayed on the player interface, each music clip can be shared to a designated destination, for example, share "Hua Chenyu clip" to Moments, and "Bass Clip" to share with QQ friends.
在步骤S255中，检测到用户对目标音乐片段的选择操作之后，选择播放该选择操作选中的片段。In step S255, after the user's selection operation on the target music segment is detected, the segment selected by the selection operation is selected to be played.
在示例实施例中，用户在拆分后的音乐片段列表中选择某个感兴趣的音乐片段，例如贝斯片段，音乐播放器停止当前的播放任务，转而播放被选择的音乐片段。In an exemplary embodiment, the user selects an interested music segment in the split music segment list, such as a bass segment, and the music player stops the current playing task and plays the selected music segment instead.
图3示出了根据本发明的一些实施例提供的音频处理方法的应用场景的示意图。参照图3所示，在该移动终端的播放器界面310的中下方，设置有控件“查看拆分音乐片段”330。在用户播放音乐时，点击控件“查看拆分音乐片段”330，进入另一播放器界面320。在播放器界面320中，设置有控件“钢琴片段”340、分享按钮350以及控件“返回原音乐播放界面”360。当点击控件“钢琴片段”340时，音乐播放器开始播放将音乐“南屏晚钟”按音色自动拆分后得到的钢琴独奏的音乐片段。当点击分享按钮350时，将音乐“南屏晚钟”按音色自动拆分后得到的贝斯独奏的音乐片段将被分享到目的地，在播放器界面320的下方弹出可供选择的分享目的地，例如，微信好友、朋友圈、QQ好友。点击控件“返回原音乐播放界面”360，则播放器界面320切换回播放器界面310。Fig. 3 shows a schematic diagram of an application scenario of an audio processing method provided according to some embodiments of the present invention. Referring to FIG. 3 , in the middle and lower part of the player interface 310 of the mobile terminal, there is a control "View Split Music Segments" 330 . When the user is playing music, he clicks on the control “View Split Music Segments” 330 to enter another player interface 320 . In the player interface 320 , there are a control “piano piece” 340 , a share button 350 and a control “return to the original music playing interface” 360 . When the control "piano segment" 340 is clicked, the music player starts to play the music segment of the piano solo obtained by automatically splitting the music "Nanping Evening Bell" according to the timbre. When the share button 350 is clicked, the bass solo music segment obtained after automatically splitting the music "Nanping Evening Bell" according to the timbre will be shared to the destination, and an optional sharing destination will pop up at the bottom of the player interface 320 , for example, WeChat friends, circle of friends, QQ friends. Click the control “return to the original music playing interface” 360 , and the player interface 320 switches back to the player interface 310 .
需要说明的是，图3的移动终端包括但不限于手机、平板电脑、电脑、可穿戴设备等智能终端。需要注意的是，上述应用场景仅是为了便于理解本发明的精神和原理而示出，本发明的实施例在此方面不受任何限制。相反，本发明的实施例可以应用于适用的任何场景。It should be noted that the mobile terminals in FIG. 3 include but are not limited to smart terminals such as mobile phones, tablet computers, computers, and wearable devices. It should be noted that the above application scenarios are only shown for the purpose of understanding the spirit and principle of the present invention, and the embodiments of the present invention are not limited in this regard. On the contrary, the embodiments of the present invention can be applied to any applicable scene.
图4示出了根据本发明的一些实施例提供的按音色拆分目标音乐片段的流程示意图。Fig. 4 shows a schematic flowchart of splitting a target music segment by timbre according to some embodiments of the present invention.
参照图4所示，在步骤S410中，接收对目标音乐的进度条上的目标点的获取指令。Referring to FIG. 4 , in step S410, an instruction to acquire a target point on the progress bar of the target music is received.
在示例实施例中，音乐播放器检测到对目标音乐的进度条上的目标点的获取操作，接收对该目标点的获取指令。In an exemplary embodiment, the music player detects an acquisition operation of a target point on a progress bar of target music, and receives an acquisition instruction for the target point.
需要说明的是，在示例实施例中，对目标音乐的进度条上的目标点的获取操作，可以是长按操作，也可以是快速双击操作，本发明并不对此进行特殊限定。It should be noted that, in the exemplary embodiment, the acquisition operation of the target point on the progress bar of the target music may be a long-press operation or a quick double-click operation, which is not particularly limited in the present invention.
参照图4所示，在步骤S420中，响应于获取指令，识别与该目标点对应的目标音乐片段。Referring to FIG. 4, in step S420, in response to the acquisition instruction, identify the target music segment corresponding to the target point.
在示例实施例中，音乐播放器在播放目标音乐的同时，自动按时间将目标音乐划分为若干个时间较短的音乐片段，例如，目标音乐总时长为4分30秒，音乐播放器将其从前往后划分为9个30秒的音乐片段，分别起名为音片段1、音片段2……音片段9。用户在目标音乐的进度条上获取一个目标点，例如对该目标点进行长按操作，音乐播放识别该目标点属于哪个自动划分好的短时间音乐片段，例如，用户点击了上面例子中提到的目标音乐的进度条中1分20秒对应的位置，则音乐播放器自动识别出这个位置的目标点对应音片段3。In an exemplary embodiment, the music player automatically divides the target music into several shorter music segments according to time while playing the target music. For example, the total duration of the target music is 4 minutes and 30 seconds, and the music player divides it From front to back, it is divided into nine 30-second music segments, which are respectively named as sound segment 1, sound segment 2...sound segment 9. The user obtains a target point on the progress bar of the target music, for example, by long-pressing the target point, and the music player recognizes which automatically divided short-time music segment the target point belongs to. For example, the user clicks the The position corresponding to 1 minute and 20 seconds in the progress bar of the target music, then the music player automatically recognizes that the target point at this position corresponds to the sound clip 3.
在步骤S420中，获取所识别的目标音乐片段的元数据。In step S420, metadata of the identified target music segment is acquired.
在示例实施例中，音乐播放器自动提出对目标音乐片段的拆分请求，首先向服务器请求目标音乐片段的元数据；接着服务器返回包含该目标音乐片段的频谱信息的元数据到音乐播放器。In an exemplary embodiment, the music player automatically proposes a split request for the target music segment, and first requests metadata of the target music segment from the server; then the server returns metadata including spectrum information of the target music segment to the music player.
图5示出了根据本发明的一些实施例提供的音频处理装置的示意框图，该音频处理装置应用于移动终端。参照图5所示，该音频处理装置500包括：拆分请求接收模块510、元数据获取模块520及音乐拆分模块530。拆分请求接收模块510用于接收对目标音乐的拆分请求；元数据获取模块520响应于拆分请求，获取目标音乐的元数据，其中，元数据包括目标音乐的频谱信息；音乐拆分模块530用于根据频谱信息拆分目标音乐，得到多个音乐片段，其中，每个音乐片段对应一种音色。Fig. 5 shows a schematic block diagram of an audio processing device provided according to some embodiments of the present invention, and the audio processing device is applied to a mobile terminal. Referring to FIG. 5 , the audio processing device 500 includes: a splitting request receiving module 510 , a metadata acquiring module 520 and a music splitting module 530 . Splitting request receiving module 510 is used for receiving the splitting request to target music; Metadata obtaining module 520 is responded to splitting request, obtains the metadata of target music, and wherein, metadata comprises the spectrum information of target music; Music splitting module 530 is used to split the target music according to the spectrum information to obtain multiple music segments, where each music segment corresponds to a tone color.
在本发明的一些实施例中，基于上述方案，该音频处理装置还包括：音色匹配单元，用于将音乐片段对应的频谱信息与音色信息库中的各种音色的频谱信息进行匹配，音色信息库中存储有多种音色的频谱信息与标识信息；标识确定单元，用于基于匹配结果确定音乐片段对应的音色的标识信息，其中，音色的标识信息包括音色对应的乐器或演唱者的信息。In some embodiments of the present invention, based on the above solution, the audio processing device further includes: a timbre matching unit, configured to match the spectral information corresponding to the music piece with the spectral information of various timbres in the timbre information library, the timbre information Spectrum information and identification information of various timbres are stored in the library; an identification determination unit is used to determine the identification information of the timbre corresponding to the music segment based on the matching result, wherein the identification information of the timbre includes the information of the musical instrument or singer corresponding to the timbre.
在本发明的一些实施例中，基于上述方案，拆分请求接收模块，包括：音乐片段拆分单元，用于接收对目标音乐中的目标音乐片段的拆分请求；元数据获取模块，包括：音乐片段获取单元，用于响应于拆分请求，获取目标音乐片段的元数据。In some embodiments of the present invention, based on the above scheme, the splitting request receiving module includes: a music segment splitting unit, configured to receive a splitting request for the target music segment in the target music; the metadata acquisition module includes: A music segment acquisition unit, configured to acquire metadata of a target music segment in response to the split request.
在本发明的一些实施例中，基于上述方案，音乐片段拆分单元，包括：获取指令接收单元，用于接收对目标音乐的进度条上的目标点的获取指令；音乐片段获取单元，包括：音乐片段识别单元，用于响应于获取指令，识别与目标点对应的目标音乐片段；片段元数据获取单元，用于获取所识别的目标音乐片段的元数据。In some embodiments of the present invention, based on the above scheme, the music fragment splitting unit includes: an acquisition instruction receiving unit, configured to receive an acquisition instruction for the target point on the progress bar of the target music; the music fragment acquisition unit includes: The music segment identification unit is used to identify the target music segment corresponding to the target point in response to the acquisition instruction; the segment metadata acquisition unit is used to acquire the metadata of the identified target music segment.
在本发明的一些实施例中，基于上述方案，该音频处理装置还包括：乐谱展示单元，用于展示与目标音乐片段对应的音色的乐谱，目标音乐片段为多个音乐片段中的一个。In some embodiments of the present invention, based on the above solution, the audio processing device further includes: a musical score display unit, configured to display a musical score of a timbre corresponding to a target music segment, where the target music segment is one of the plurality of music segments.
在本发明的一些实施例中，基于上述方案，该音频处理装置还包括：音乐分享单元，用于分享目标音乐片段或目标音乐片段对应的音色的乐谱至目标界面。In some embodiments of the present invention, based on the above solution, the audio processing device further includes: a music sharing unit, configured to share the target music segment or the score of the timbre corresponding to the target music segment to the target interface.
在本发明的一些实施例中，基于上述方案，元数据获取模块，还包括：元数据判断单元，用于确定目标音乐的元数据是否存在于目标服务器；音乐下载单元，用于若不存在，则通过网络下载目标音乐，基于下载的目标音乐生成元数据；元数据获取单元，用于若存在，则从目标服务器获取目标音乐的元数据。In some embodiments of the present invention, based on the above solution, the metadata acquisition module further includes: a metadata judgment unit, configured to determine whether the metadata of the target music exists in the target server; a music download unit, configured to, if not, The target music is downloaded through the network, and metadata is generated based on the downloaded target music; the metadata acquiring unit is configured to acquire the metadata of the target music from the target server if it exists.
图6为本发明一实施例提供的一种移动终端的硬件结构示意图，如图6所示，该移动终端600包括但不限于：射频单元601、网络模块602、音频输出单元603、输入单元604、传感器605、显示单元606、用户输入单元607、接口单元608、存储器609、处理器610、以及电源611等部件。本领域技术人员可以理解，图6中示出的移动终端结构并不构成对移动终端的限定，移动终端可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。在本发明实施例中，移动终端包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。FIG. 6 is a schematic diagram of a hardware structure of a mobile terminal provided by an embodiment of the present invention. As shown in FIG. 6, the mobile terminal 600 includes but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, and an input unit 604 , a sensor 605 , a display unit 606 , a user input unit 607 , an interface unit 608 , a memory 609 , a processor 610 , and a power supply 611 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 6 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than shown in the figure, or combine certain components, or different components layout. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, and a pedometer.
其中，存储器609内存储有计算机程序，该计算机程序被处理器610执行时，能够实现以下流程：接收对目标音乐的拆分请求；响应于拆分请求，获取该目标音乐的元数据，其中，元数据包括目标音乐的频谱信息；根据频谱信息拆分目标音乐，得到多个音乐片段，其中，每个音乐片段对应一种音色。Wherein, a computer program is stored in the memory 609, and when the computer program is executed by the processor 610, the following process can be realized: receiving a split request for the target music; in response to the split request, obtaining the metadata of the target music, wherein, The metadata includes spectrum information of the target music; the target music is split according to the spectrum information to obtain a plurality of music fragments, wherein each music fragment corresponds to a timbre.
可选地，该计算机程序被处理器610执行时，还可以实现以下流程：将音乐片段对应的频谱信息与音色信息库中的各种音色的频谱信息进行匹配，音色信息库中存储有多种音色的频谱信息与标识信息；基于匹配结果确定音乐片段对应的音色的标识信息，其中，音色的标识信息包括该音色对应的乐器或演唱者的信息。Optionally, when the computer program is executed by the processor 610, the following process may also be implemented: matching the spectral information corresponding to the music piece with the spectral information of various timbres in the timbre information library, which stores a variety of Spectrum information and identification information of the timbre; determining the identification information of the timbre corresponding to the music segment based on the matching result, wherein the identification information of the timbre includes the information of the musical instrument or the singer corresponding to the timbre.
可选地，该计算机程序被处理器610执行时，接收对目标音乐的拆分请求，包括：接收对目标音乐片段的拆分请求；响应于拆分请求，获取目标音乐的元数据，包括：响应于拆分请求，获取目标音乐片段的元数据。Optionally, when the computer program is executed by the processor 610, receiving a split request for the target music includes: receiving a split request for the target music segment; in response to the split request, obtaining metadata of the target music, including: In response to the split request, metadata of the target music segment is acquired.
可选地，该计算机程序被处理器610执行时，接收对目标音乐中的目标音乐片段的拆分请求，包括：接收对目标音乐的进度条上的目标点的获取指令；响应于拆分请求，获取目标音乐片段的元数据，包括：响应于获取指令，识别与该目标点对应的目标音乐片段；获取所识别的目标音乐片段的元数据。Optionally, when the computer program is executed by the processor 610, receiving a split request for the target music segment in the target music includes: receiving an acquisition instruction for the target point on the progress bar of the target music; responding to the split request , acquiring metadata of a target music segment, including: responding to an acquisition instruction, identifying a target music segment corresponding to the target point; acquiring metadata of the identified target music segment.
可选地，该计算机程序被处理器610执行时，展示与目标音乐片段对应的音色的乐谱，目标音乐片段为多个音乐片段中的一个。Optionally, when the computer program is executed by the processor 610, a score of a timbre corresponding to a target music segment is displayed, and the target music segment is one of the plurality of music segments.
可选地，该计算机程序被处理器610执行时，分享目标音乐片段或目标音乐片段对应的音色的乐谱至目标界面。Optionally, when the computer program is executed by the processor 610, the target music segment or the score of the timbre corresponding to the target music segment is shared to the target interface.
可选地，该计算机程序被处理器610执行时，获取目标音乐的元数据，包括：确定目标音乐的元数据是否存在于目标服务器；若不存在，则通过网络下载目标音乐，基于下载的目标音乐生成元数据；若存在，则从目标服务器获取目标音乐的元数据。Optionally, when the computer program is executed by the processor 610, obtaining the metadata of the target music includes: determining whether the metadata of the target music exists in the target server; if not, downloading the target music through the network, based on the downloaded target The music generates metadata; if it exists, the metadata of the target music is obtained from the target server.
应理解的是，本发明实施例中，射频单元601可用于收发信息或通话过程中，信号的接收和发送，具体的，将来自基站的下行数据接收后，给处理器610处理；另外，将上行的数据发送给基站。通常，射频单元601包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外，射频单元601还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present invention, the radio frequency unit 601 can be used for receiving and sending signals during sending and receiving information or during a call. Specifically, the downlink data from the base station is received and processed by the processor 610; in addition, the Uplink data is sent to the base station. Generally, the radio frequency unit 601 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 601 can also communicate with the network and other devices through a wireless communication system.
移动终端通过网络模块602为用户提供了无线的宽带互联网访问，如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The mobile terminal provides users with wireless broadband Internet access through the network module 602, such as helping users send and receive emails, browse web pages, and access streaming media.
音频输出单元603可以将射频单元601或网络模块602接收的或者在存储器609中存储的音频数据转换成音频信号并且输出为声音。而且，音频输出单元603还可以提供与移动终端600执行的特定功能相关的音频输出(例如，呼叫信号接收声音、消息接收声音等等)。音频输出单元603包括扬声器、蜂鸣器以及受话器等。The audio output unit 603 may convert audio data received by the radio frequency unit 601 or the network module 602 or stored in the memory 609 into an audio signal and output as sound. Also, the audio output unit 603 can also provide audio output related to a specific function performed by the mobile terminal 600 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 603 includes a speaker, a buzzer, a receiver, and the like.
输入单元604用于接收音频或视频信号。输入单元604可以包括图形处理器(Graphics Processing Unit，GPU)6041和麦克风6042，图形处理器6041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元606上。经图形处理器6041处理后的图像帧可以存储在存储器609(或其它存储介质)中或者经由射频单元601或网络模块602进行发送。麦克风6042可以接收声音，并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元601发送到移动通信基站的格式输出。The input unit 604 is used for receiving audio or video signals. The input unit 604 may include a graphics processing unit (Graphics Processing Unit, GPU) 6041 and a microphone 6042, and the graphics processing unit 6041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The data is processed. The processed image frames may be displayed on the display unit 606 . The image frames processed by the graphics processor 6041 may be stored in the memory 609 (or other storage media) or sent via the radio frequency unit 601 or the network module 602 . The microphone 6042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to a mobile communication base station via the radio frequency unit 601 for output in the case of a phone call mode.
移动终端600还包括至少一种传感器605，比如光传感器、运动传感器以及其他传感器。具体地，光传感器包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板6061的亮度，接近传感器可在移动终端600移动到耳边时，关闭显示面板6061和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别移动终端姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；传感器605还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等，在此不再赘述。The mobile terminal 600 also includes at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 6061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 6061 and the display panel 6061 when the mobile terminal 600 moves to the ear / or backlighting. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games, etc.) , magnetometer posture calibration), vibration recognition-related functions (such as pedometer, knocking), etc.; the sensor 605 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
显示单元606用于显示由用户输入的信息或提供给用户的信息。显示单元606可包括显示面板6061，可以采用液晶显示器(Liquid Crystal Display，LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板6061。The display unit 606 is used to display information input by the user or information provided to the user. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.
用户输入单元607可用于接收输入的数字或字符信息，以及产生与移动终端的用户设置以及功能控制有关的键信号输入。具体地，用户输入单元607包括触控面板6071以及其他输入设备6072。触控面板6071，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板6071上或在触控面板6071附近的操作)。触控面板6071可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器610，接收处理器610发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板6071。除了触控面板6071，用户输入单元607还可以包括其他输入设备6072。具体地，其他输入设备6072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。The user input unit 607 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 607 includes a touch panel 6071 and other input devices 6072 . The touch panel 6071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 6071 or near the touch panel 6071). operate). The touch panel 6071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and sends it to For the processor 610, receive the command sent by the processor 610 and execute it. In addition, the touch panel 6071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 6071 , the user input unit 607 may also include other input devices 6072 . Specifically, other input devices 6072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
进一步的，触控面板6071可覆盖在显示面板6061上，当触控面板6071检测到在其上或附近的触摸操作后，传送给处理器610以确定触摸事件的类型，随后处理器610根据触摸事件的类型在显示面板6061上提供相应的视觉输出。虽然，触控面板6071与显示面板6061是作为两个独立的部件来实现移动终端的输入和输出功能，但是在某些实施例中，可以将触控面板6071与显示面板6061集成而实现移动终端的输入和输出功能，具体此处不做限定。Furthermore, the touch panel 6071 can be covered on the display panel 6061, and when the touch panel 6071 detects a touch operation on or near it, it will be sent to the processor 610 to determine the type of the touch event, and then the processor 610 can The type of event provides a corresponding visual output on the display panel 6061. Although the touch panel 6071 and the display panel 6061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 6071 and the display panel 6061 can be integrated to realize the mobile terminal. The input and output functions are not limited here.
接口单元608为外部装置与移动终端600连接的接口。例如，外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元608可以用于接收来自外部装置的输入(例如，数据信息、电力等等)并且将接收到的输入传输到移动终端600内的一个或多个元件或者可以用于在移动终端600和外部装置之间传输数据。The interface unit 608 is an interface for connecting an external device to the mobile terminal 600 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 608 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.
存储器609可用于存储软件程序以及各种数据。存储器609可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器609可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 609 can be used to store software programs as well as various data. The memory 609 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application program required by a function (such as a sound playback function, an image playback function, etc.); Data created by the use of mobile phones (such as audio data, phonebook, etc.), etc. In addition, the memory 609 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.
处理器610是移动终端的控制中心，利用各种接口和线路连接整个移动终端的各个部分，通过运行或执行存储在存储器609内的软件程序和/或模块，以及调用存储在存储器609内的数据，执行移动终端的各种功能和处理数据，从而对移动终端进行整体监控。处理器610可包括一个或多个处理单元；优选的，处理器610可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器610中。The processor 610 is the control center of the mobile terminal, which uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 609, and calling data stored in the memory 609 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 610 may include one or more processing units; preferably, the processor 610 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 610 .
移动终端600还可以包括给各个部件供电的电源611(比如电池)，优选的，电源611可以通过电源管理系统与处理器610逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The mobile terminal 600 can also include a power supply 611 (such as a battery) for supplying power to various components. Preferably, the power supply 611 can be logically connected to the processor 610 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.
另外，移动终端600包括一些未示出的功能模块，在此不再赘述。In addition, the mobile terminal 600 includes some functional modules not shown, which will not be repeated here.
本申请实施例中的移动终端能够实现前述音频处理方法的各个过程，并达到相同的效果和功能，这里不再重复。The mobile terminal in the embodiment of the present application can implement each process of the aforementioned audio processing method, and achieve the same effect and function, which will not be repeated here.
进一步地，本发明实施例还提供一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，该计算机程序被处理器执行时实现上述音频处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。其中，所述的计算机可读存储介质，如只读存储器(Read-Only Memory，简称ROM)、随机存取存储器(Random AccessMemory，简称RAM)、磁碟或者光盘等。Furthermore, an embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above audio processing method embodiment is implemented, and can achieve The same technical effects are not repeated here to avoid repetition. Wherein, the computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk or an optical disk, and the like.
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本发明上述实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, disk, CD) contains several instructions to enable a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the above-mentioned embodiments of the present invention.
上面结合附图对本发明的实施例进行了描述，但是本发明并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本发明的启示下，在不脱离本发明宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本发明的保护之内。Embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementations, and the above-mentioned specific implementations are only illustrative, rather than restrictive, and those of ordinary skill in the art will Under the enlightenment of the present invention, without departing from the gist of the present invention and the protection scope of the claims, many forms can also be made, all of which belong to the protection of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910449494.4ACN110162660A (en) | 2019-05-28 | 2019-05-28 | Audio processing method, device, mobile terminal and storage medium |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910449494.4ACN110162660A (en) | 2019-05-28 | 2019-05-28 | Audio processing method, device, mobile terminal and storage medium |
| Publication Number | Publication Date |
|---|---|
| CN110162660Atrue CN110162660A (en) | 2019-08-23 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910449494.4APendingCN110162660A (en) | 2019-05-28 | 2019-05-28 | Audio processing method, device, mobile terminal and storage medium |
| Country | Link |
|---|---|
| CN (1) | CN110162660A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110728990A (en)* | 2019-09-24 | 2020-01-24 | 维沃移动通信有限公司 | Pitch detection method, apparatus, terminal device and medium |
| CN110827850A (en)* | 2019-11-11 | 2020-02-21 | 广州国音智能科技有限公司 | Audio separation method, device, equipment and computer readable storage medium |
| CN111309962A (en)* | 2020-01-20 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Method and device for extracting audio clip and electronic equipment |
| CN111782865A (en)* | 2020-06-23 | 2020-10-16 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio information processing method and device and storage medium |
| CN114237731A (en)* | 2021-11-03 | 2022-03-25 | 桂林长海发展有限责任公司 | Webpage audio playing method and device and storage medium |
| WO2025190785A1 (en)* | 2024-03-11 | 2025-09-18 | Sony Group Corporation | Apparatus and method for processing an audio file storing a music track and apparatus and method for determining a sample underlying a music track |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104766612A (en)* | 2015-04-13 | 2015-07-08 | 李素平 | Sinusoidal model separation method based on musical sound timbre matching |
| CN105847991A (en)* | 2016-03-30 | 2016-08-10 | 乐视控股（北京）有限公司 | Multimedia data playing method and terminal |
| CN106024005A (en)* | 2016-07-01 | 2016-10-12 | 腾讯科技（深圳）有限公司 | Processing method and apparatus for audio data |
| CN106128472A (en)* | 2016-07-12 | 2016-11-16 | 乐视控股（北京）有限公司 | The processing method and processing device of singer's sound |
| US20160364963A1 (en)* | 2015-06-12 | 2016-12-15 | Google Inc. | Method and System for Detecting an Audio Event for Smart Home Devices |
| CN107481735A (en)* | 2017-08-28 | 2017-12-15 | 中国移动通信集团公司 | Method for converting audio sound production, server and computer readable storage medium |
| CN108986841A (en)* | 2018-08-08 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Audio-frequency information processing method, device and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104766612A (en)* | 2015-04-13 | 2015-07-08 | 李素平 | Sinusoidal model separation method based on musical sound timbre matching |
| US20160364963A1 (en)* | 2015-06-12 | 2016-12-15 | Google Inc. | Method and System for Detecting an Audio Event for Smart Home Devices |
| CN105847991A (en)* | 2016-03-30 | 2016-08-10 | 乐视控股（北京）有限公司 | Multimedia data playing method and terminal |
| CN106024005A (en)* | 2016-07-01 | 2016-10-12 | 腾讯科技（深圳）有限公司 | Processing method and apparatus for audio data |
| CN106128472A (en)* | 2016-07-12 | 2016-11-16 | 乐视控股（北京）有限公司 | The processing method and processing device of singer's sound |
| CN107481735A (en)* | 2017-08-28 | 2017-12-15 | 中国移动通信集团公司 | Method for converting audio sound production, server and computer readable storage medium |
| CN108986841A (en)* | 2018-08-08 | 2018-12-11 | 百度在线网络技术（北京）有限公司 | Audio-frequency information processing method, device and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110728990A (en)* | 2019-09-24 | 2020-01-24 | 维沃移动通信有限公司 | Pitch detection method, apparatus, terminal device and medium |
| CN110827850A (en)* | 2019-11-11 | 2020-02-21 | 广州国音智能科技有限公司 | Audio separation method, device, equipment and computer readable storage medium |
| CN110827850B (en)* | 2019-11-11 | 2022-06-21 | 广州国音智能科技有限公司 | Audio separation method, device, equipment and computer readable storage medium |
| CN111309962A (en)* | 2020-01-20 | 2020-06-19 | 北京字节跳动网络技术有限公司 | Method and device for extracting audio clip and electronic equipment |
| CN111309962B (en)* | 2020-01-20 | 2023-05-16 | 抖音视界有限公司 | Method and device for extracting audio clips and electronic equipment |
| CN111782865A (en)* | 2020-06-23 | 2020-10-16 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio information processing method and device and storage medium |
| CN114237731A (en)* | 2021-11-03 | 2022-03-25 | 桂林长海发展有限责任公司 | Webpage audio playing method and device and storage medium |
| WO2025190785A1 (en)* | 2024-03-11 | 2025-09-18 | Sony Group Corporation | Apparatus and method for processing an audio file storing a music track and apparatus and method for determining a sample underlying a music track |
| Publication | Publication Date | Title |
|---|---|---|
| CN110162660A (en) | Audio processing method, device, mobile terminal and storage medium | |
| US9552419B2 (en) | Systems and methods to facilitate media search | |
| CN108228882B (en) | A method and terminal device for recommending song audition fragments | |
| US9281793B2 (en) | Systems, methods, and apparatus for generating an audio signal based on color values of an image | |
| US20210027800A1 (en) | Method for processing audio, electronic device and storage medium | |
| CN108090140A (en) | A kind of playback of songs method and mobile terminal | |
| CN112511850B (en) | Wheat connecting method, live broadcast display device, equipment and storage medium | |
| CN110568926A (en) | A sound signal processing method and terminal equipment | |
| CN111933098B (en) | Method, device and computer-readable storage medium for generating accompaniment music | |
| CN109657236A (en) | Guidance information acquisition methods, device, electronic device and storage medium | |
| CN111491211A (en) | Video processing method, video processing device and electronic equipment | |
| CN107680614B (en) | Audio signal processing method, apparatus and storage medium | |
| CN107798107A (en) | The method and mobile device of song recommendations | |
| WO2022111260A1 (en) | Music filtering method, apparatus, device, and medium | |
| CN108763475A (en) | A recording method, recording device and terminal equipment | |
| CN111831249B (en) | Audio playing method and device, storage medium and electronic equipment | |
| CN108231046B (en) | Song tone identification method and device | |
| CN110378677B (en) | Red envelope pickup method and device, mobile terminal and storage medium | |
| CN113936628B (en) | Audio synthesis method, device, equipment and computer readable storage medium | |
| CN111008298A (en) | Method, device, system, equipment and storage medium for searching song accompaniment | |
| CN112597331B (en) | Method, device, equipment and storage medium for displaying range matching information | |
| CN113204673A (en) | Audio processing method, device, terminal and computer readable storage medium | |
| CN115767117B (en) | Method, device and storage medium for live interaction operation | |
| CN107945777B (en) | A kind of audio production method, mobile terminal and computer readable storage medium | |
| CN107767851B (en) | A kind of song playing method, mobile terminal |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20190823 |