Movatterモバイル変換


[0]ホーム

URL:


CN114399986B - Musical instrument auxiliary exercise method, device, medium and electronic equipment - Google Patents

Musical instrument auxiliary exercise method, device, medium and electronic equipment

Info

Publication number
CN114399986B
CN114399986BCN202210036019.6ACN202210036019ACN114399986BCN 114399986 BCN114399986 BCN 114399986BCN 202210036019 ACN202210036019 ACN 202210036019ACN 114399986 BCN114399986 BCN 114399986B
Authority
CN
China
Prior art keywords
performance
music
score
server
currently performed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210036019.6A
Other languages
Chinese (zh)
Other versions
CN114399986A (en
Inventor
田煦春
马泽君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Youzhuju Network Technology Co Ltd
Original Assignee
Beijing Youzhuju Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Youzhuju Network Technology Co LtdfiledCriticalBeijing Youzhuju Network Technology Co Ltd
Priority to CN202210036019.6ApriorityCriticalpatent/CN114399986B/en
Publication of CN114399986ApublicationCriticalpatent/CN114399986A/en
Application grantedgrantedCritical
Publication of CN114399986BpublicationCriticalpatent/CN114399986B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Classifications

Landscapes

Abstract

Translated fromChinese

本公开涉及一种乐器辅助练习方法、装置、介质及电子设备。方法包括:实时采集演奏音乐;每隔预设时间间隔将预设时间间隔内的演奏片段发送至与终端通信连接的服务器,并生成预设时间间隔内的演奏片段所演奏的每一音符的跟谱信息,将跟谱信息发送至服务器,以由服务器根据当前演奏音乐的每一演奏片段和每一演奏片段所演奏的每一音符的跟谱信息,生成当前演奏音乐的演奏反馈结果;接收并显示服务器发送的演奏反馈结果。由此,可自动生成演奏反馈结果,节省人力,且能保证演奏反馈结果的客观准确。另外,由于是边演奏边进行演奏片段和相应跟谱信息的传输,由此,能在演奏结束后的短时间内快速生成当前演奏音乐的演奏反馈结果,提升演奏者的演奏体验。

The present disclosure relates to a method, device, medium and electronic device for auxiliary practice of musical instruments. The method comprises: collecting the music to be performed in real time; sending the performance segments within the preset time interval to a server connected to the terminal communication at every preset time interval, and generating the score information of each note played by the performance segments within the preset time interval, sending the score information to the server, so that the server generates the performance feedback result of the current music to be performed according to each performance segment of the current music to be performed and the score information of each note played by each performance segment; receiving and displaying the performance feedback result sent by the server. In this way, the performance feedback result can be automatically generated, which saves manpower and ensures the objectivity and accuracy of the performance feedback result. In addition, since the performance segments and the corresponding score information are transmitted while the music is being performed, the performance feedback result of the current music to be performed can be quickly generated in a short time after the end of the performance, thereby improving the performance experience of the performer.

Description

Musical instrument auxiliary exercise method, device, medium and electronic equipment
Technical Field
The present disclosure relates to the field of information processing technologies, and in particular, to a method, an apparatus, a medium, and an electronic device for assisting in practicing a musical instrument.
Background
Music is inherited from ancient times by virtue of unique artistic charm and value. Musical instrument performance is one of the main expression forms of music, and can be used for mastering the mind and promoting the improvement of aesthetic consciousness and musical literacy. With the improvement of living standard, enthusiasm for people to learn musical instrument performance is continuously increased, and parents also pay more attention to the culture of musical literacy of children. However, learning the performance of a musical instrument requires a professional teacher to conduct instruction and accumulation of a large number of exercises, which in the past have relied more on manual instruction feedback, requiring a great deal of time and effort.
Disclosure of Invention
This section is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This section is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
In a first aspect, the present disclosure provides a musical instrument auxiliary exercise method, applied to a terminal, including:
collecting performance music in real time;
transmitting performance fragments in a preset time interval to a server in communication connection with the terminal at intervals of the preset time interval, generating the following information of each note played by the performance fragments in the preset time interval, and transmitting the following information to the server so that the server generates a performance feedback result of the current performance music according to each performance fragment of the current performance music and the following information of each note played by each performance fragment;
And receiving and displaying the performance feedback result sent by the server.
In a second aspect, the present disclosure provides a musical instrument auxiliary exercise apparatus, applied to a terminal, comprising:
the acquisition module is used for acquiring the playing music in real time;
The sending module is used for sending the performance fragments in the preset time interval acquired by the acquisition module to a server in communication connection with the terminal at intervals of preset time intervals, generating the following spectrum information of each note played by the performance fragments in the preset time interval, and sending the following spectrum information to the server so that the server can generate a performance feedback result of the current performance music according to each performance fragment of the current performance music and the following spectrum information of each note played by each performance fragment;
And the display module is used for receiving and displaying the performance feedback result sent by the server.
In a third aspect, the present disclosure provides a computer readable medium having stored thereon a computer program which when executed by a processing device implements the steps of the method provided by the first aspect of the present disclosure.
In a fourth aspect, the present disclosure provides an electronic device comprising:
a storage device having at least one computer program stored thereon;
At least one processing means for executing the at least one computer program in the storage means to implement the steps of the method provided by the first aspect of the present disclosure.
According to the technical scheme, the playing fragments in the preset time interval are sent to the server in communication connection with the terminal at preset time intervals, the following spectrum information of each note played by the playing fragments in the preset time interval is generated, the following spectrum information is sent to the server, the server generates a playing feedback result of the current playing music according to each playing fragment of the current playing music and the following spectrum information of each note played by each playing fragment, and the playing feedback result sent by the server is received and displayed. Therefore, the performance feedback result can be automatically generated, labor is saved, and the objective and accurate performance feedback result can be ensured. In addition, the transmission of the performance fragments and the corresponding score following information is performed while the performance is performed, so that the server can quickly generate the performance feedback result of the current performance music in a short time after the performance is finished, the problem of transmission delay caused by the fact that large unstructured performance music is transmitted only when the performance is finished is avoided, a player can quickly acquire the performance feedback result, and the performance experience of the player is improved.
Additional features and advantages of the present disclosure will be set forth in the detailed description which follows.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale. In the drawings:
FIG. 1 is a flow chart illustrating a method of assisting in practicing a musical instrument according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating a musical instrument auxiliary exercise method according to another exemplary embodiment.
Fig. 3 is a flowchart illustrating a musical instrument auxiliary exercise method according to another exemplary embodiment.
Fig. 4 is a block diagram illustrating an instrument accessory exercise device according to an exemplary embodiment.
Fig. 5 is a block diagram of an electronic device, according to an example embodiment.
Detailed Description
As discussed in the background, learning a musical instrument performance requires a professional teacher to conduct instruction and accumulation of a large number of exercises, which in the past have relied more on manual instruction feedback, requiring a significant amount of time and effort. For this reason, it is necessary to automatically generate performance feedback results by means of a computer. At present, the terminal generally collects performance music, and after the performance is finished, the performance music is transmitted to the server, so that a performance feedback result is generated by the server according to the received performance music and is fed back to the terminal. Since performance music is usually large unstructured data, transmission will take a lot of time, and thus, the efficiency of generating performance feedback results will be affected, affecting the performance experience of players.
In view of this, the present disclosure provides a musical instrument auxiliary exercise method, apparatus, medium, and electronic device.
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment," another embodiment "means" at least one additional embodiment, "and" some embodiments "means" at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Fig. 1 is a flowchart illustrating a musical instrument auxiliary exercise method according to an exemplary embodiment, wherein the method may be applied to a terminal of a smart phone, a personal computer, a tablet computer, etc. As shown in FIG. 1, the method may include the following steps S101 to S103.
In S101, performance music is collected in real time.
In the present disclosure, performance music is tone data acquired by collecting tones emitted by a player using instrumental performance, which is unstructured data.
In S102, the performance segments within the preset time interval are sent to a server communicatively connected to the terminal at preset time intervals, and the following information of each note played by the performance segments within the preset time interval is generated, and the following information is sent to the server, so that the server generates a performance feedback result of the current performance music according to each performance segment of the current performance music and the following information of each note played by each performance segment.
In S103, the performance feedback result transmitted by the server is received and displayed.
In the present disclosure, the terminal transmits performance pieces within a preset time interval (e.g., 10 seconds) to a server communicatively connected to the terminal at intervals of the preset time interval, i.e., streams performance music.
In addition, the heel spectrum information may include a performance pitch, a reference pitch, a performance start time, and a reference start time. The performance feedback results may include deviation notes in the current performance music and/or scores of the current performance music, wherein the deviation notes may include misplayed notes (i.e., played as other misnotes), missed notes, delayed played notes (i.e., the time lag of the playing of the notes), and duration non-conforming notes (notes with longer or shorter duration).
In one embodiment, the performance feedback results include bias notes in the currently performed music. In this way, the player can correct in time in the subsequent play according to the deviation notes.
In another embodiment, the performance feedback results include scores of the currently performed music. In this way, the player can acquire the overall evaluation of the current performance.
In yet another embodiment, the performance feedback result includes both the bias notes in the current performance music and the scores of the current performance music.
The method comprises the steps that after the terminal generates the following spectrum information of each note played by a playing segment in a preset time interval, the terminal can send the following spectrum information to a server, the server receives the playing segment sent by the terminal at intervals and the following spectrum information of each note played by the playing segment, when the playing is finished, a playing feedback result of the current playing music is generated according to the following spectrum information of each playing segment of the current playing music and each note played by each playing segment, then the server feeds back the playing feedback result to the terminal, and the terminal receives and displays the playing feedback result. For example, the terminal may display a communication message with the server in the form of a session.
According to the technical scheme, the playing fragments in the preset time interval are sent to the server in communication connection with the terminal at preset time intervals, the following spectrum information of each note played by the playing fragments in the preset time interval is generated, the following spectrum information is sent to the server, the server generates a playing feedback result of the current playing music according to each playing fragment of the current playing music and the following spectrum information of each note played by each playing fragment, and the playing feedback result sent by the server is received and displayed. Therefore, the performance feedback result can be automatically generated, labor is saved, and the objective and accurate performance feedback result can be ensured. In addition, the transmission of the performance fragments and the corresponding score following information is performed while the performance is performed, so that the server can quickly generate the performance feedback result of the current performance music in a short time after the performance is finished, the problem of transmission delay caused by the fact that large unstructured performance music is transmitted only when the performance is finished is avoided, a player can quickly acquire the performance feedback result, and the performance experience of the player is improved.
In addition, the terminal can establish connection with the server by firstly sending an initial message for requesting connection establishment to the server by the terminal, sending a connection response message to the terminal after the server receives the initial message, and establishing connection by the terminal after the terminal receives the connection response message, so that reliable connection between the terminal and the server can be ensured.
Similarly, the terminal may disconnect from the server in a similar manner to the connection established by the server, specifically, first, the terminal sends an end message for requesting disconnection to the server, after receiving the end message, the server sends a disconnection response message to the terminal, and after receiving the disconnection response message, the terminal disconnects the terminal and the server.
In order to avoid packet loss and ensure the integrity of data transmission, the server can send a confirmation receiving message to the terminal after receiving the performance segment or the following information of each note played by the performance segment sent by the terminal each time, and if the terminal does not receive the confirmation receiving message within a preset time threshold after sending the performance segment or the following information of each note played by the performance segment, the server is sent the following information of each note played by the performance segment again.
The following describes in detail the following specific embodiment of the heel information of each note played by the performance segment generated in the preset time interval in S102. Specifically, the method can be realized through the following steps (1) to (3):
(1) And performing music transcription on the performance fragments in a preset time interval to obtain performance score information corresponding to the performance fragments.
In the present disclosure, the performance score information is structured data, and may specifically include a pitch, a performance start time, a performance end time, etc. of each note performed by a performance segment, which reflects a pitch level at a certain moment, reflects that a player played a note at a certain moment, and can reflect that related information such as a pitch, a note start time, a note end time, etc. in a score are all called performance score information. Wherein the score can be a staff, a numbered musical notation, etc.
(2) Standard score information of a standard music piece corresponding to the performance piece is obtained.
In the present disclosure, the standard score information may include information of an identification of each note corresponding to the standard musical piece, a reference start time, a reference end time, a reference pitch, a section to which the note belongs, a phrase to which the note belongs, and a hand (left hand or right hand) for playing, and the like.
Specifically, the standard score information of the standard musical piece corresponding to the performance piece may be obtained by identifying the first performance piece or obtaining a musical composition name of the current performance music according to a performance music name or the like input/selected by a player through a keyboard or voice, thereafter, the standard score information corresponding to the current performance music may be obtained from a local or network through the musical composition name, and finally, the score information corresponding to the start-stop time of the current performance piece among the standard score information corresponding to the current performance piece is determined as the standard score information of the standard musical piece corresponding to the performance piece.
(3) According to the performance score information and the standard score information, heel spectrum information of each note played by the performance segment is generated.
In the present disclosure, a dynamic time warping (DYNAMIC TIME WARPING, DTW) algorithm may be used to align the performance score information with the standard score information, thereby obtaining the heel spectrum information of each note performed by the performance segment.
The following describes in detail the specific embodiment of generating the performance feedback result of the current performance music based on the heel information of each performance segment of the current performance music and each note performed by each performance segment.
In one embodiment, the following information of each note played by each piece of the current performance music may be aggregated (i.e., the following information of each note played by each piece of the current performance music is summarized) to obtain a first deviation note in the current performance music, meanwhile, each piece of the current performance music may be spliced, the following information of the spliced performance music may be determined, and a second deviation note in the current performance music may be generated according to the following information, and then the first deviation note and the second deviation note may be combined, and the combined deviation note may be used as a performance feedback result. The integrity of the deviation notes can be enhanced by determining the deviation notes in two different ways and combining.
In another embodiment, the following spectrum information of each note played by each piece of the current playing music can be aggregated to obtain a first deviation note in the current playing music, meanwhile, each piece of the current playing music can be spliced, the following spectrum information of the played music obtained after splicing is determined, a second deviation note in the current playing music is generated according to the following spectrum information, then the first deviation note and the second deviation note are combined, finally, the score of the current playing music is determined according to the number and the position of the combined deviation notes, and the score is used as a playing feedback result.
In yet another embodiment, the heel information of each note played by each piece of the currently playing music may be aggregated to obtain a first deviation note in the currently playing music; meanwhile, each piece of the current playing music can be spliced, the following spectrum information of the spliced playing music is determined, a second deviation note in the current playing music is generated according to the following spectrum information, then the first deviation note and the second deviation note are combined, finally, the score of the current playing music is determined according to the number and the positions of the combined deviation notes, and the score and the combined deviation notes are used as a playing feedback result together.
Fig. 2 is a flowchart illustrating a musical instrument auxiliary exercise method according to another exemplary embodiment, wherein the method is applied to a terminal. As shown in fig. 2, the above method may further include the following S104.
In S104, the heel spectrum information is displayed.
Thus, the player can know the heel condition of the current performance segment in detail, and the possibility of subsequent performance errors is reduced.
Fig. 3 is a flowchart illustrating a musical instrument auxiliary exercise method according to another exemplary embodiment, wherein the method is applied to a terminal. As shown in fig. 3, the above method may further include the following S105 and S106.
In S105, if the performance feedback result is not received within a preset time period after the performance is completed, the performance feedback result of the current performance music is generated according to the heel information of each note performed by each performance segment of the current performance music.
In S106, performance feedback results are displayed.
In the present disclosure, when communication between the terminal and the server is failed or the server is failed, the terminal will not be able to acquire the performance feedback result from the server, at which time the terminal may locally generate and display the performance feedback result of the current performance music. Thus, even if there is a communication failure or a server failure with the server, the player can acquire the performance feedback result.
In addition, in order to maintain data consistency between the terminal and the server, the terminal may synchronize the locally generated performance feedback result to the server after the failure is released.
The following describes in detail the embodiment of generating the performance feedback result of the current performance music with respect to the heel information of each note performed according to each performance segment of the current performance music in S105.
In one embodiment, the score information of each note played by each piece of the current playing music may be aggregated to obtain a deviation note in the current playing music, and then the deviation note is used as a playing feedback result.
In another embodiment, the score of the current playing music is determined according to the number and the position of the deviation notes, and the score is used as a playing feedback result.
In yet another embodiment, the score of the current performance music is determined according to the number and the position of the deviation notes, and the score and the deviation notes are used together as the performance feedback result.
The present disclosure also provides a musical instrument auxiliary exercise apparatus, wherein the terminal may be applied to a terminal. As shown in fig. 4, the apparatus 400 includes:
The acquisition module 401 is used for acquiring performance music in real time;
A sending module 402, configured to send, at intervals of a preset time interval, performance segments acquired by the acquisition module 401 in the preset time interval to a server communicatively connected to the terminal, generate heel spectrum information of each note played by the performance segments in the preset time interval, and send the heel spectrum information to the server, so that the server generates a performance feedback result of the current performance music according to each performance segment of the current performance music and the heel spectrum information of each note played by each performance segment;
And the display module 403 is configured to receive and display the performance feedback result sent by the server.
According to the technical scheme, the playing fragments in the preset time interval are sent to the server in communication connection with the terminal at preset time intervals, the following spectrum information of each note played by the playing fragments in the preset time interval is generated, the following spectrum information is sent to the server, the server generates a playing feedback result of the current playing music according to each playing fragment of the current playing music and the following spectrum information of each note played by each playing fragment, and the playing feedback result sent by the server is received and displayed. Therefore, the performance feedback result can be automatically generated, labor is saved, and the objective and accurate performance feedback result can be ensured. In addition, the transmission of the performance fragments and the corresponding score following information is performed while the performance is performed, so that the server can quickly generate the performance feedback result of the current performance music in a short time after the performance is finished, the problem of transmission delay caused by the fact that large unstructured performance music is transmitted only when the performance is finished is avoided, a player can quickly acquire the performance feedback result, and the performance experience of the player is improved.
Optionally, the sending module 402 includes:
The transcriber module is used for performing music transcription on the performance fragments in the preset time interval to obtain performance score information corresponding to the performance fragments;
the acquisition sub-module is used for acquiring standard music score information of a standard music segment corresponding to the performance segment;
and the generation sub-module is used for generating the heel spectrum information of each note played by the performance fragment according to the performance score information and the standard score information.
Optionally, the heel spectrum information includes a performance pitch, a reference pitch, a performance start time, and a reference start time.
Optionally, the performance feedback result includes a bias note in the current performance music and/or a score of the current performance music.
Optionally, the display module 403 is further configured to display the heel chart information.
Optionally, the apparatus 400 further includes:
The generation module is used for generating a performance feedback result of the current performance music according to the heel spectrum information of each note played by each performance segment of the current performance music if the performance feedback result is not received within a preset time period after the performance is finished;
The display module 403 is further configured to display the performance feedback result.
Optionally, the performance feedback result includes a bias note in the current performance music and a score of the current performance music;
The generation module comprises:
the aggregation sub-module is used for aggregating the heel-spectrum information of each note played by each playing segment of the current playing music to obtain a deviation note in the current playing music;
and the determining submodule is used for determining the score of the current playing music according to the number and the position of the deviation notes.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.
The present disclosure also provides a computer-readable medium having stored thereon a computer program which, when executed by a processing device, implements the steps of the above-described musical instrument auxiliary exercise method provided by the present disclosure.
Referring now to fig. 5, a schematic diagram of an electronic device (e.g., terminal device) 500 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 5, the electronic device 500 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 501, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
In general, devices may be connected to I/O interface 505 including input devices 506, including for example, touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc., output devices 507, including for example, liquid Crystal Displays (LCDs), speakers, vibrators, etc., storage devices 508, including for example, magnetic tape, hard disk, etc., and communication devices 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 shows an electronic device 500 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 501.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of a computer-readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to electrical wiring, fiber optic cable, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some implementations, the clients may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be included in the electronic device or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs, which when executed by the electronic device, cause the electronic device to collect performance music in real time, send performance fragments in the preset time interval to a server in communication with the terminal at preset time intervals, generate heel spectrum information of each note played by the performance fragments in the preset time interval, send the heel spectrum information to the server, generate feedback results of the current performance music according to each performance fragment of the current performance music and the heel spectrum information of each note played by each performance fragment, and receive and display the performance feedback results sent by the server.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented in software or hardware. The name of the module is not limited to the module itself in some cases, and for example, the acquisition module may also be described as "a module that acquires performance music in real time".
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic that may be used include Field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems-on-a-chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, example 1 provides a musical instrument auxiliary exercise method including collecting performance music in real time, transmitting performance fragments in a preset time interval to a server communicatively connected to the terminal at intervals of a preset time interval, generating heel spectrum information of each note played by the performance fragments in the preset time interval, transmitting the heel spectrum information to the server, generating performance feedback results of the current performance music by the server according to each performance fragment of the current performance music and the heel spectrum information of each note played by each performance fragment, and receiving and displaying the performance feedback results transmitted by the server.
According to one or more embodiments of the present disclosure, example 2 provides a method of example 1, where generating the following information of each note played by a performance segment in the preset time interval includes performing music transcription on the performance segment in the preset time interval to obtain performance score information corresponding to the performance segment, obtaining standard score information of a standard music segment corresponding to the performance segment, and generating the following information of each note played by the performance segment according to the performance score information and the standard score information.
According to one or more embodiments of the present disclosure, example 3 provides the method of example 1, the heel spectrum information including a performance pitch, a reference pitch, a performance start time, and a reference start time.
In accordance with one or more embodiments of the present disclosure, example 4 provides the method of example 1, the performance feedback result including a bias note in the current performance music and/or a score of the current performance music.
In accordance with one or more embodiments of the present disclosure, example 5 provides the method of any one of examples 1-4, the method further comprising displaying the heel profile information.
According to one or more embodiments of the present disclosure, example 6 provides the method of any one of examples 1 to 4, further comprising generating a performance feedback result of the current performance music according to heel spectrum information of each note performed by each performance segment of the current performance music if the performance feedback result is not received within a preset time period after performance is completed, and displaying the performance feedback result.
According to one or more embodiments of the present disclosure, example 7 provides the method of example 6, wherein the performance feedback result includes a bias note in the current performance music and a score of the current performance music, and wherein the generating the performance feedback result of the current performance music according to the heel spectrum information of each note performed by each performance segment of the current performance music includes aggregating the heel spectrum information of each note performed by each performance segment of the current performance music to obtain the bias note in the current performance music, and determining the score of the current performance music according to the number and the position of the bias notes.
According to one or more embodiments of the present disclosure, example 8 provides a musical instrument auxiliary exercise apparatus applied to a terminal, including an acquisition module for acquiring performance music in real time, a transmission module for transmitting performance fragments acquired by the acquisition module within a preset time interval to a server communicatively connected to the terminal at preset time intervals, generating heel information of each note played by the performance fragments within the preset time interval, and transmitting the heel information to the server, so as to generate a performance feedback result of the current performance music by the server according to each performance fragment of the current performance music and the heel information of each note played by each performance fragment, and a display module for receiving and displaying the performance feedback result transmitted by the server.
According to one or more embodiments of the present disclosure, example 9 provides the apparatus of example 8, where the sending module includes a transcriber module configured to perform music transcription on a performance segment within the preset time interval to obtain performance score information corresponding to the performance segment, an obtaining sub-module configured to obtain standard score information of a standard music segment corresponding to the performance segment, and a generating sub-module configured to generate, according to the performance score information and the standard score information, heel score information of each note performed by the performance segment.
In accordance with one or more embodiments of the present disclosure, example 10 provides the apparatus of example 8, the heel spectrum information includes a performance pitch, a reference pitch, a performance start time, and a reference start time.
In accordance with one or more embodiments of the present disclosure, example 11 provides the apparatus of example 8, the performance feedback result includes a bias note in the current performance music and/or a score of the current performance music.
According to one or more embodiments of the present disclosure, example 12 provides the apparatus of any one of examples 8-11, the display module further to display the heel chart information.
According to one or more embodiments of the present disclosure, example 13 provides the apparatus of any one of examples 8 to 11, further including a generating module configured to generate a performance feedback result of the current performance music according to heel spectrum information of each note performed by each performance segment of the current performance music if the performance feedback result is not received within a preset time period after performance is completed, and the display module is further configured to display the performance feedback result.
According to one or more embodiments of the present disclosure, example 14 provides the apparatus of example 13, the performance feedback result includes a bias note in the current performance music and a score of the current performance music, the generating module includes an aggregation sub-module configured to aggregate heel information of each note performed by each performance segment of the current performance music to obtain the bias note in the current performance music, and a determining sub-module configured to determine the score of the current performance music according to the number and the position of the bias notes.
According to one or more embodiments of the present disclosure, example 15 provides a computer-readable medium having stored thereon a computer program which, when executed by a processing device, implements the steps of the method of any of examples 1-7.
According to one or more embodiments of the present disclosure, example 16 provides an electronic device comprising storage means having stored thereon at least one computer program, and at least one processing means for executing the at least one computer program in the storage means to implement the steps of the method of any one of examples 1-7.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims. The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

Claims (10)

Translated fromChinese
1.一种乐器辅助练习方法,应用于终端,其特征在于,包括:1. A musical instrument auxiliary practice method, applied to a terminal, characterized by comprising:实时采集演奏音乐;Collect and perform music in real time;每隔预设时间间隔将所述预设时间间隔内的演奏片段发送至与所述终端通信连接的服务器,并生成所述预设时间间隔内的演奏片段所演奏的每一音符的跟谱信息,将所述跟谱信息发送至所述服务器,以由所述服务器根据当前演奏音乐的每一演奏片段和每一所述演奏片段所演奏的每一音符的跟谱信息,生成所述当前演奏音乐的演奏反馈结果;Sending the performance segments within the preset time interval to a server connected to the terminal at every preset time interval, generating score tracking information of each note played in the performance segments within the preset time interval, and sending the score tracking information to the server, so that the server generates a performance feedback result of the currently performed music according to each performance segment of the currently performed music and the score tracking information of each note played in each performance segment;接收并显示所述服务器发送的所述演奏反馈结果;receiving and displaying the performance feedback result sent by the server;其中,所述当前演奏音乐的演奏反馈结果是由所述服务器将所述当前演奏音乐中的第一偏差音符和所述当前演奏音乐中的第二偏差音符合并后,由合并所得的偏差音符得到的,所述第一偏差音符是由所述服务器将所述当前演奏音乐的每一演奏片段所演奏的每一音符的跟谱信息聚合得到的;所述第二偏差音符是由所述服务器将所述当前演奏音乐的每一演奏片段进行拼接,确定拼接后所得的演奏音乐的跟谱信息,并根据所述拼接后所得的演奏音乐的跟谱信息生成的。Among them, the performance feedback result of the currently performed music is obtained by the server merging the first deviation note in the currently performed music and the second deviation note in the currently performed music, and the first deviation note is obtained by the server aggregating the score tracking information of each note played in each performance segment of the currently performed music; the second deviation note is generated by the server splicing each performance segment of the currently performed music, determining the score tracking information of the spliced performance music, and based on the score tracking information of the spliced performance music.2.根据权利要求1所述的方法,其特征在于,所述生成所述预设时间间隔内的演奏片段所演奏的每一音符的跟谱信息,包括:2. The method according to claim 1, characterized in that the step of generating the score information of each note played in the performance segment within the preset time interval comprises:对所述预设时间间隔内的演奏片段进行音乐转录,得到该演奏片段对应的演奏乐谱信息;Performing music transcription on the performance segment within the preset time interval to obtain performance score information corresponding to the performance segment;获取该演奏片段对应的标准音乐片段的标准乐谱信息;Obtain standard music score information of a standard music segment corresponding to the performance segment;根据所述演奏乐谱信息和所述标准乐谱信息,生成该演奏片段所演奏的每一音符的跟谱信息。According to the performance score information and the standard score information, score information of each note played in the performance segment is generated.3.根据权利要求1所述的方法,其特征在于,所述跟谱信息包括演奏音高、参考音高、演奏起始时间以及参考起始时间。3. The method according to claim 1 is characterized in that the score-following information includes a performance pitch, a reference pitch, a performance start time and a reference start time.4.根据权利要求1所述的方法,其特征在于,所述演奏反馈结果包括所述合并所得的偏差音符和/或所述当前演奏音乐的评分,其中,所述评分是根据所述合并所得的偏差音符的数量和位置确定的。4. The method according to claim 1 is characterized in that the performance feedback result includes the deviation notes obtained by the merger and/or the score of the currently performed music, wherein the score is determined based on the number and position of the deviation notes obtained by the merger.5.根据权利要求1-4中任一项所述的方法,其特征在于,所述方法还包括:5. The method according to any one of claims 1 to 4, characterized in that the method further comprises:显示所述跟谱信息。The score tracking information is displayed.6.根据权利要求1-4中任一项所述的方法,其特征在于,所述方法还包括:6. The method according to any one of claims 1 to 4, characterized in that the method further comprises:若在演奏结束后的预设时长内未接收到所述演奏反馈结果,则根据所述当前演奏音乐的每一演奏片段所演奏的每一音符的跟谱信息,生成所述当前演奏音乐的演奏反馈结果;If the performance feedback result is not received within a preset time after the end of the performance, the performance feedback result of the currently performed music is generated according to the score information of each note played in each performance segment of the currently performed music;显示所述演奏反馈结果。The performance feedback result is displayed.7.根据权利要求6所述方法,其特征在于,所述演奏反馈结果包括所述当前演奏音乐中的偏差音符和所述当前演奏音乐的评分;7. The method according to claim 6, characterized in that the performance feedback result includes the deviation notes in the currently performed music and the score of the currently performed music;所述根据当前演奏音乐的每一演奏片段所演奏的每一音符的跟谱信息,生成所述当前演奏音乐的演奏反馈结果,包括:The generating of the performance feedback result of the currently performed music according to the score information of each note played in each performance segment of the currently performed music comprises:将当前演奏音乐的每一演奏片段所演奏的每一音符的跟谱信息进行聚合,得到所述当前演奏音乐中的偏差音符;Aggregating the score information of each note played in each performance segment of the currently performed music to obtain the deviation notes in the currently performed music;根据所述偏差音符的数量和位置,确定所述当前演奏音乐的评分。The score of the currently performed music is determined according to the number and position of the deviation notes.8.一种乐器辅助练习装置,应用于终端,其特征在于,包括:8. A musical instrument auxiliary practice device, applied to a terminal, characterized by comprising:采集模块,用于实时采集演奏音乐;The acquisition module is used to collect the performance music in real time;发送模块,用于每隔预设时间间隔将所述采集模块采集到的所述预设时间间隔内的演奏片段发送至与所述终端通信连接的服务器,并生成所述预设时间间隔内的演奏片段所演奏的每一音符的跟谱信息,将所述跟谱信息发送至所述服务器,以由所述服务器根据当前演奏音乐的每一演奏片段和每一所述演奏片段所演奏的每一音符的跟谱信息,生成所述当前演奏音乐的演奏反馈结果;a sending module, configured to send the performance segments within the preset time interval collected by the collecting module to a server in communication with the terminal at every preset time interval, and generate score tracking information of each note played in the performance segments within the preset time interval, and send the score tracking information to the server, so that the server generates a performance feedback result of the currently performed music according to each performance segment of the currently performed music and the score tracking information of each note played in each performance segment;显示模块,用于接收并显示所述服务器发送的所述演奏反馈结果;A display module, used for receiving and displaying the performance feedback result sent by the server;其中,所述当前演奏音乐的演奏反馈结果是由所述服务器将所述当前演奏音乐中的第一偏差音符和所述当前演奏音乐中的第二偏差音符合并后,由合并所得的偏差音符得到的,所述第一偏差音符是由所述服务器将所述当前演奏音乐的每一演奏片段所演奏的每一音符的跟谱信息聚合得到的;所述第二偏差音符是由所述服务器将所述当前演奏音乐的每一演奏片段进行拼接,确定拼接后所得的演奏音乐的跟谱信息,并根据所述拼接后所得的演奏音乐的跟谱信息生成的。Among them, the performance feedback result of the currently performed music is obtained by the server merging the first deviation note in the currently performed music and the second deviation note in the currently performed music, and the first deviation note is obtained by the server aggregating the score tracking information of each note played in each performance segment of the currently performed music; the second deviation note is generated by the server splicing each performance segment of the currently performed music, determining the score tracking information of the spliced performance music, and based on the score tracking information of the spliced performance music.9.一种计算机可读介质,其上存储有计算机程序,其特征在于,该程序被处理装置执行时实现权利要求1-7中任一项所述方法的步骤。9. A computer-readable medium having a computer program stored thereon, characterized in that when the program is executed by a processing device, the steps of the method according to any one of claims 1 to 7 are implemented.10.一种电子设备,其特征在于,包括:10. An electronic device, comprising:存储装置,其上存储有至少一个计算机程序;a storage device having at least one computer program stored thereon;至少一个处理装置,用于执行所述存储装置中的所述至少一个计算机程序,以实现权利要求1-7中任一项所述方法的步骤。At least one processing device, configured to execute the at least one computer program in the storage device to implement the steps of the method according to any one of claims 1 to 7.
CN202210036019.6A2022-01-102022-01-10Musical instrument auxiliary exercise method, device, medium and electronic equipmentActiveCN114399986B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202210036019.6ACN114399986B (en)2022-01-102022-01-10Musical instrument auxiliary exercise method, device, medium and electronic equipment

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202210036019.6ACN114399986B (en)2022-01-102022-01-10Musical instrument auxiliary exercise method, device, medium and electronic equipment

Publications (2)

Publication NumberPublication Date
CN114399986A CN114399986A (en)2022-04-26
CN114399986Btrue CN114399986B (en)2025-07-18

Family

ID=81231703

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202210036019.6AActiveCN114399986B (en)2022-01-102022-01-10Musical instrument auxiliary exercise method, device, medium and electronic equipment

Country Status (1)

CountryLink
CN (1)CN114399986B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106228961A (en)*2016-07-212016-12-14赵洪云Play evaluation methodology and device
CN106340286A (en)*2016-09-272017-01-18华中科技大学Universal real-time musical instrument playing evaluation system

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP3678135B2 (en)*1999-12-242005-08-03ヤマハ株式会社 Performance evaluation apparatus and performance evaluation system
JP4111004B2 (en)*2003-02-282008-07-02ヤマハ株式会社 Performance practice device and performance practice program
CN104183171B (en)*2013-05-232016-10-19杭州灵机科技有限公司The system and method that a kind of instrument playing level based on electronic music is precisely passed judgment on
CN105070298B (en)*2015-07-202019-07-30科大讯飞股份有限公司The methods of marking and device of polyphony musical instrument
CN105118490B (en)*2015-07-202019-01-18科大讯飞股份有限公司Polyphony instrumental notes localization method and device
CN106228965A (en)*2016-07-122016-12-14赵倩仪A kind of musical instrument teaching auxiliary based on audio identification
CN107424476A (en)*2017-08-012017-12-01上海破破飞网络科技有限公司A kind of instrumental music training mate system
CN108648520B (en)*2018-03-272019-11-19小叶子(北京)科技有限公司A kind of piano performance learning method and device
CN111680187B (en)*2020-05-262023-11-24平安科技(深圳)有限公司Music score following path determining method and device, electronic equipment and storage medium
CN111976329B (en)*2020-08-312022-06-21深圳市月白电子科技有限公司Staff automatic following method and automatic tracking system in musical instrument playing
CN112201217A (en)*2020-09-222021-01-08上海汉图科技有限公司Method, device and equipment for judging musical instrument playing
CN113066455A (en)*2021-03-092021-07-02未知星球科技(东莞)有限公司 Music control method, device and readable storage medium
CN113724741B (en)*2021-06-022024-07-23深圳市芒果未来科技有限公司Musical instrument playing or singing evaluation method and system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN106228961A (en)*2016-07-212016-12-14赵洪云Play evaluation methodology and device
CN106340286A (en)*2016-09-272017-01-18华中科技大学Universal real-time musical instrument playing evaluation system

Also Published As

Publication numberPublication date
CN114399986A (en)2022-04-26

Similar Documents

PublicationPublication DateTitle
CN110677711B (en)Video dubbing method and device, electronic equipment and computer readable medium
CN109543064B (en)Lyric display processing method and device, electronic equipment and computer storage medium
JP6971292B2 (en) Methods, devices, servers, computer-readable storage media and computer programs for aligning paragraphs and images
WO2020253806A1 (en)Method and apparatus for generating display video, device and storage medium
US20250218418A1 (en)Audio detection method and apparatus, storage medium and electronic device
US20240404548A1 (en)Method, apparatus, device and storage medium for video recording
CN115665435A (en)Live broadcast processing method and device and electronic equipment
CN115052188B (en)Video editing method, device, equipment and medium
CN114117127B (en) Video generation method, device, readable medium and electronic device
CN114399986B (en)Musical instrument auxiliary exercise method, device, medium and electronic equipment
CN112312163B (en)Video generation method, device, electronic equipment and storage medium
CN114430491A (en) A kind of data processing method and device based on live broadcast
CN112825245B (en)Real-time sound repairing method and device and electronic equipment
CN117939239A (en) Video processing method, device, electronic device and storage medium
CN112071287A (en)Method, apparatus, electronic device and computer readable medium for generating song score
CN115774539B (en)Sound processing method, device, equipment and medium
CN112287171A (en)Information processing method and device and electronic equipment
CN115240711B (en) Audio quality analysis method, device, electronic device and computer readable storage medium
CN115547330A (en)Information display method and device based on voice interaction and electronic equipment
CN114758639A (en)Guzheng audio playing method and device, electronic equipment and computer readable medium
CN112163237B (en) Data processing method, device and electronic device
CN114822456A (en)Music score audio detection method, device, equipment and computer medium based on music score
CN107135407A (en)Synchronous method and system in a kind of piano video teaching
CN116737994A (en)Method, device, equipment and medium for synchronously playing video, music score audio and music score
CN116580701B (en)Alarm audio frequency identification method, device, electronic equipment and computer medium

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp