Audio adjusting method and system for online classroomTechnical Field
The invention relates to the field of online teaching, in particular to an online classroom audio adjusting method and system.
Background
With the popularization of the internet, the mode of network remote education is more and more accepted by the public, and the mode becomes one of the important supplementary forms of the conventional daily education, and a large number of remote teaching platforms are appeared. After the remote teaching platform has been developed for more than ten years, the functions of all aspects are relatively perfect at present, and the remote teaching platform plays a core role in schools, education institutions and training institutions. The online classroom includes the classroom of talkbacking and a plurality of classroom of answering, and the classroom of talkbacking includes teacher's terminal, answers the classroom and includes a plurality of student terminals, and teacher's terminal passes through the server interconnection with a plurality of microphone sound data who answers the student terminal in classroom, and every student main part and the words that teacher's main part said promptly, other terminals can both hear, have sound big difference to and unnecessary sound influences the quality of teaching.
Disclosure of Invention
In view of the technical defects and technical drawbacks in the prior art, embodiments of the present invention provide an online classroom audio adjusting method and system that overcome the above problems or at least partially solve the above problems, and the specific scheme is as follows:
as a first aspect of the present invention, there is provided an audio adjusting method for an online classroom, comprising a lecture room including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the plurality of student terminals in the answer classroom through a server; the method comprises the following steps:
collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera;
calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server;
and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition.
Further, the step of analyzing the video stream to determine the class of each listening classroom, and for the listening classroom with abnormal class conditions, the step of filtering out the microphone sound data corresponding to the listening classroom specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
Further, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Further, the method further comprises: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
As a second aspect of the present invention, there is provided an audio conditioning system for an online classroom, the system comprising a lecture classroom including a teacher terminal and a plurality of answer classrooms including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the student terminals of the plurality of answer classrooms through a server; the server comprises a data acquisition unit, a gain adjustment unit and a video analysis unit;
the data acquisition unit is used for acquiring microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms and acquiring video streams of monitoring pictures of a lecture hall and each answering classroom in real time through an IPC camera;
the gain adjusting unit is used for calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time and automatically gaining the collected microphone sound data according to the decibels specified by the server;
the video analysis unit is used for analyzing the video stream, judging the classroom conditions of each receiving classroom, and filtering the microphone sound data of the corresponding receiving classroom for the receiving classroom with abnormal classroom conditions.
Further, the step of analyzing the video stream to determine the class of each listening classroom, and for the listening classroom with abnormal class conditions, the step of filtering out the microphone sound data corresponding to the listening classroom specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and filtering out the microphone sound data of the corresponding answering classroom if the situations exist.
Further, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Further, the video analysis unit is further configured to: and acquiring visual focus areas of the student main body and the teacher main body in the current frame image in real time through the video stream, and determining whether the sound data of the microphones of the terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas.
The invention has the following beneficial effects:
according to the audio adjusting method and system for the online classroom, the decibel of the collected sound is calculated in real time, and the decibel specified by the server is used for automatic gain, so that the sound heard by a teacher and a listening classroom are the same, and the condition that some sound is particularly big and some sound is particularly small and cannot be heard is avoided; in addition, still carry out the analysis through gathering the video, judge whether need to filter the microphone sound data of listening the classroom or the terminal that student's subject and teacher's subject correspond, filter out the sound irrelevant with classroom teaching to promote the teaching quality.
Drawings
Fig. 1 is a flowchart illustrating an audio adjusting method for an online classroom according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, as a first embodiment of the present invention, there is provided an audio adjusting method for an online classroom, including a lecture classroom including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone audio data of the student terminals of the plurality of answer classroom through a server; the method comprises the following steps:
collecting microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms, and collecting video streams of monitoring pictures of a main lecture and each answering classroom in real time through an IPC camera;
calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time, and automatically gaining according to the decibels specified by the server;
and analyzing the video stream to judge the classroom condition of each listening classroom, and filtering out the microphone sound data of the corresponding listening classroom for the listening classroom with abnormal classroom condition.
According to the audio adjusting method and system for the online classroom, the decibel of the collected sound is calculated in real time, and the decibel specified by the server is used for automatic gain, so that the sound heard by a teacher and a listening classroom are the same, and the condition that some sound is particularly big and some sound is particularly small and cannot be heard is avoided; in addition, still carry out the analysis through gathering the video, judge whether need to filter the microphone sound data of listening the classroom or the terminal that student's subject and teacher's subject correspond, filter out the sound irrelevant with classroom teaching to promote the teaching quality.
The method comprises the following steps of analyzing video streams, judging the classroom of each listening classroom, and filtering microphone sound data corresponding to the listening classroom for the listening classroom with abnormal classroom conditions: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and if so, filtering out the microphone sound data of the corresponding answering classroom, thereby avoiding the interference of the microphone sound data on teaching of the main lecture classroom or learning of other answering classrooms.
The specific automatic gain in decibels specified by the server is as follows: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Wherein the method further comprises: the method comprises the steps of obtaining visual focus areas of a student main body and a teacher main body in a current frame image in real time through the video stream, determining whether microphone sound data of terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas, and filtering the sound to avoid the interference of the sound with normal teaching if the visual focus areas of the student main body and the teacher main body are in non-student terminal or teacher terminal areas, wherein the sound may be a sound chatting with others but not teaching sound.
As a second embodiment of the present invention, there is provided an audio conditioning system for an online classroom, the system including a lecture room including a teacher terminal and a plurality of answer classroom including a plurality of student terminals, the teacher terminal being interconnected with microphone sound data of the student terminals of the plurality of answer classroom through a server; the server comprises a data acquisition unit, a gain adjustment unit and a video analysis unit;
the data acquisition unit is used for acquiring microphone sound data of a teacher terminal and a plurality of student terminals in answering classrooms and acquiring video streams of monitoring pictures of a lecture hall and each answering classroom in real time through an IPC camera;
the gain adjusting unit is used for calculating decibels of the collected microphone sound data of the teacher terminal and the collected microphone sound data of the student terminals in real time and automatically gaining the collected microphone sound data according to the decibels specified by the server;
the video analysis unit is used for analyzing the video stream, judging the classroom conditions of each receiving classroom, and filtering the microphone sound data of the corresponding receiving classroom for the receiving classroom with abnormal classroom conditions.
Preferably, the step of analyzing the video stream to determine the class of each listening classroom, and the step of filtering out the microphone sound data corresponding to the listening classroom for the listening classroom with abnormal class conditions specifically includes: and analyzing the classroom behaviors of students in each answering classroom through the video stream, judging whether the situations of chatting or alarming in class exist, and if so, filtering out the microphone sound data of the corresponding answering classroom, thereby avoiding the interference of the microphone sound data on teaching of the main lecture classroom or learning of other answering classrooms.
Preferably, the automatic gain in decibels specified by the server specifically includes: and judging whether the acquired corresponding microphone sound data is in a preset reference parameter range, and increasing or decreasing an audio constant value when the microphone sound data is not in the reference parameter range until the microphone sound data is in the reference parameter range.
Preferably, the video analysis unit is further configured to: the method comprises the steps of obtaining visual focus areas of a student main body and a teacher main body in a current frame image in real time through the video stream, determining whether microphone sound data of terminals corresponding to the student main body and the teacher main body need to be filtered or not based on the focus areas, and filtering the sound to avoid the interference of the sound with normal teaching if the visual focus areas of the student main body and the teacher main body are in non-student terminal or teacher terminal areas, wherein the sound may be a sound chatting with others but not teaching sound.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.