技术领域technical field
本发明属于教育技术学领域，具体说是一种基于知识关联的资源展示方法。The invention belongs to the field of educational technology, and specifically relates to a method for displaying resources based on knowledge association.
背景技术Background technique
目前随着技术的发展与教学需求的不断改善，教学不在是以单屏幕为主，多屏教学逐渐兴起。在多屏教学中，双轨教学无疑是主力军。At present, with the development of technology and the continuous improvement of teaching needs, teaching is no longer based on a single screen, and multi-screen teaching is gradually emerging. In multi-screen teaching, dual-track teaching is undoubtedly the main force.
在双轨教学中，应用的最多是学生在学习教学内容时，可以同时查看其他与课堂教学相关的资料，这样就大大增加了学习的效率与效果。In dual-track teaching, the most widely used is that students can view other materials related to classroom teaching at the same time when learning teaching content, which greatly increases the efficiency and effect of learning.
但这种教学模式中，双屏所展示的资源之间并无密切的连接关系，双方在展示时互不影响。当学生在学习观看视频时，还需要在文档资源中将视频中所提到的知识点查找出来；同样在查看文档资源中某些内容时，如果想观看与之相关的视频资源片段，也需要在视频资源中手动查找与这些内容相关的视频片段。However, in this teaching mode, there is no close connection between the resources displayed on the dual screens, and the two sides do not affect each other when displaying. When students are learning to watch videos, they also need to find out the knowledge points mentioned in the video in the document resources; similarly, when viewing certain content in document resources, if they want to watch related video resource fragments, they also need to Manually find video clips related to this content in the video assets.
这样不仅加大了学生学习的成本，而且学习效率也极为低下，学习效果大大减弱。This not only increases the cost of students' learning, but also reduces the learning efficiency and greatly weakens the learning effect.
发明内容Contents of the invention
针对现有技术的以上缺陷或改进需求，本发明的目的是提供一种基于知识关联的资源展示方法，可将文档与视频通过知识点相关联。In view of the above deficiencies or improvement needs of the prior art, the purpose of the present invention is to provide a resource presentation method based on knowledge association, which can associate documents and videos through knowledge points.
本发明解决其技术问题所采用的技术方案是：一种基于知识关联的资源展示方法，包括如下步骤The technical solution adopted by the present invention to solve its technical problem is: a resource display method based on knowledge association, including the following steps
S01，用户终端以知识点为匹配依据，根据包括文档的标题、文档的字数、文档的行数、文档的段落数量、文档的页码在内的文档特征来查找文档资源信息，将提取的文档资源信息与存储在服务器中知识库的知识点进行相似度匹配，生成包含知识点id，文档资源信息id，文本相似匹配权重、推荐匹配权重、添加时间在内的知识点与文档资源匹配列表；S01, the user terminal uses the knowledge points as the matching basis to search for document resource information according to document features including the title of the document, the number of words in the document, the number of lines in the document, the number of paragraphs in the document, and the page number of the document, and the extracted document resources Similarity matching is performed between the information and the knowledge points stored in the knowledge base in the server, and a matching list of knowledge points and document resources including knowledge point id, document resource information id, text similarity matching weight, recommended matching weight, and adding time is generated;
S02，用户终端对提取的知识点信息进行分类，采用基于知识关联的相似度匹配方法计算知识关联相似度匹配权重，所述基于知识关联的相似度匹配方法基于同义词词林的相似度匹配方法，步骤为：S02. The user terminal classifies the extracted knowledge point information, and calculates the knowledge association similarity matching weight by using a similarity matching method based on knowledge association. The similarity matching method based on knowledge association is based on the similarity matching method of synonym Cilin, The steps are:
（1）对于某一类别下的知识点A，查找知识库中相同或相似类别下的所有知识点，从第一个知识点B开始遍历；(1) For a knowledge point A under a certain category, search for all knowledge points under the same or similar category in the knowledge base, and start traversing from the first knowledge point B;
（2）判断知识点A和知识点B在同义词词林中作为叶子节点的两个义项所处的分支，从第一层开始判断，相同乘以1，否则在分支层乘以相应的系数，然后乘以调节参数cos(n*)，然后乘以控制参数(n-k+1)/n，两个义项的相似度用Similar表示，若两个义项不在同一树上，则Similar(A，B)=0；若两个义项在同一树上：(2) Judging the branch where knowledge point A and knowledge point B are located as the two meaning items of the leaf node in the synonym word forest, judge from the first layer, multiply the same by 1, otherwise multiply the corresponding coefficient at the branch layer, Then multiply by the adjustment parameter cos(n* ), and then multiplied by the control parameter (n-k+1)/n, the similarity of the two meaning items is represented by Similar, if the two meaning items are not on the same tree, then Similar(A, B)=0; if the two meaning items on the same tree:
（21）若在第2层分支，系数为x，则Similar(A，B)=1*x*cos(n*)*；(21) If the branch is in the second layer and the coefficient is x, then Similar(A, B)=1*x*cos(n* )* ;
（22）若在第3层分支，系数为y，则Similar(A，B)=1*1*y*cos(n*)*；(22) If the branch is in the third layer and the coefficient is y, then Similar(A, B)=1*1*y*cos(n* )* ;
（23）若在第4层分支，系数为z，则Similar(A，B)=1*1*1*z*cos(n*)*；(23) If the branch is in the 4th layer and the coefficient is z, then Similar(A, B)=1*1*1*z*cos(n* )* ;
（24）若在第5层分支，系数为q，则Similar(A，B)=1*1*1*q*cos(n*)*；(24) If the branch is at the 5th layer and the coefficient is q, then Similar(A, B)=1*1*1*q*cos(n* )* ;
在计算A和B相似度时，把A和B的义项分别两两计算，取其中的最大值作为两个词语的相似度的值；根据以上的计算方法，得到从文档中提取的知识点信息与知识库的知识点关联的相似匹配权重；推荐匹配权重初始化与知识关联相似匹配权重相等，后期根据用户反馈、评价修改推荐匹配权重，增加灵活性；When calculating the similarity between A and B, the meaning items of A and B are calculated in pairs, and the maximum value is taken as the value of the similarity between the two words; according to the above calculation method, the knowledge point information extracted from the document is obtained The similar matching weight associated with the knowledge point of the knowledge base; the initialization of the recommended matching weight is equal to the similar matching weight of the knowledge association, and the recommended matching weight is modified according to user feedback and evaluation in the later stage to increase flexibility;
S03，用户终端将知识点与文档资源匹配列表上传到服务器的资源处理中心；S03, the user terminal uploads the matching list of knowledge points and document resources to the resource processing center of the server;
S04，用户终端以知识点为匹配依据，分时段提取包括视频的标题、视频的大小、视频的格式、视频的时间长度在内的视频中内容描述性信息，以服务器中知识库的知识点为基础，对提取的视频资源时间表进行基于知识关联的视频相似度匹配，用户终端按照步骤S02中的同义词词林的相似度匹配方法，生成包含知识点id，视频资源信息id，文本相似匹配权重、推荐匹配权重、添加时间在内的知识点与视频资源匹配列表；S04, the user terminal takes the knowledge points as the matching basis, and extracts the descriptive information of the content in the video including the title of the video, the size of the video, the format of the video, and the length of the video in time intervals, and takes the knowledge points of the knowledge base in the server as Based on knowledge-based video similarity matching for the extracted video resource timetable, the user terminal generates a similarity matching method including knowledge point id, video resource information id, and text similarity matching weight according to the similarity matching method of the synonym Cilin in step S02. , Recommended matching weight, knowledge points including the added time and matching list of video resources;
S05，用户终端将知识点与视频资源匹配列表上传到服务器的资源处理中心；S05, the user terminal uploads the matching list of knowledge points and video resources to the resource processing center of the server;
S06，用户终端通过知识点来获取相应的文档资源信息时，服务器依照用户自定义匹配权重优先提取文本相似匹配权重高的记录，将多条记录按照权重大小排列发送到客户终端；若文本相似度匹配无法满足要求，则增加推荐匹配权重并优先提取与之相关的记录；S06, when the user terminal obtains the corresponding document resource information through knowledge points, the server preferentially extracts records with high text similarity matching weights according to the user-defined matching weights, and sends multiple records to the client terminal in order of weights; if the text similarity If the matching cannot meet the requirements, increase the weight of the recommended matching and preferentially extract the records related to it;
S07，用户终端改变文档状态时，服务器端先获取文档改变状态的信息，根据改变状态的信息获取知识点与文档资源的匹配列表，查找到对应的知识点，通过读取知识点与视频资源匹配列表，动态调整视频播放进度，自适应完成视频资源的展示；S07, when the user terminal changes the status of the document, the server first obtains information about the status of the document change, obtains a matching list of knowledge points and document resources according to the information about the status change, finds the corresponding knowledge points, and matches the knowledge points with the video resources by reading List, dynamically adjust the video playback progress, and adaptively complete the display of video resources;
S08，用户终端播放视频资源时，服务器端检测视频资源中有包括全屏文档资源、更改文档资源呈现页面、做笔记等设定好的教学动作时，若此时文档没有人为操作或控制，根据教学动作动态修改文档资源呈现页面，自适应完成文档资源的展示；S08. When the user terminal is playing video resources, the server detects that there are set teaching actions in the video resources including full-screen document resources, changing document resource presentation pages, taking notes, etc., if the document is not manually operated or controlled at this time, according to the teaching The action dynamically modifies the document resource presentation page, and adaptively completes the display of document resources;
S09，用户终端改变视频播放的状态时，服务器端先获取视频资源改变状态的信息，根据改变状态的信息获取知识点与视频资源的匹配列表，查找到对应的知识点，通过读取知识点与文档资源匹配列表，动态调整文档呈现页面，自适应完成文档资源的展示。S09, when the user terminal changes the state of video playback, the server first obtains information about the change state of the video resource, obtains a matching list of knowledge points and video resources according to the information of the change state, finds the corresponding knowledge point, and reads the knowledge point and Document resource matching list, dynamically adjust the document presentation page, and complete the display of document resources adaptively.
所述的一种基于知识关联的资源展示方法，其文档包括txt、doc、html、pdf、ppt或xls文件。According to the resource presentation method based on knowledge association, its documents include txt, doc, html, pdf, ppt or xls files.
所述的一种基于知识关联的资源展示方法，提取txt文档信息时先针对段落处理，然后针对行、句子进行处理。In the resource display method based on knowledge association, when extracting txt document information, it first processes paragraphs, and then processes lines and sentences.
所述的一种基于知识关联的资源展示方法，提取ppt文档信息时先进行分页处理，然后针对标题、内容进行处理。In the resource display method based on knowledge association, when extracting ppt document information, paging processing is performed first, and then processing is performed on the title and content.
所述的一种基于知识关联的资源展示方法，其步骤S01中的文本相似匹配权重通过文本相似度算法获取。In the resource presentation method based on knowledge association, the text similarity matching weight in step S01 is obtained through a text similarity algorithm.
所述的一种基于知识关联的资源展示方法，所述的视频资源包括mp4、3gp、mkv、avi、rmvb或wmv文件，用户终端对视频资源的处理包含视频语音部分的处理和视频图像部分的处理。In the resource display method based on knowledge association, the video resource includes mp4, 3gp, mkv, avi, rmvb or wmv files, and the processing of the video resource by the user terminal includes the processing of the video voice part and the video image part deal with.
所述的一种基于知识关联的资源展示方法，用户终端针对视频语音部分，先使用语音识别技术来提取视频资源中知识内容，形成包括视频资源时间表id的视频资源时间表，再根据语音含义分段提取的资源知识内容和提取知识内容对应的时间点。In the resource display method based on knowledge association, the user terminal first uses speech recognition technology to extract the knowledge content in the video resource for the voice part of the video, and forms a video resource schedule including the video resource schedule id, and then according to the meaning of the voice The segmentally extracted resource knowledge content and the time point corresponding to the extracted knowledge content.
所述的一种基于知识关联的资源展示方法，其用户终端针对视频图像部分，使用图像识别技术来获取视频中包含全屏文档资源、更改文档资源呈现页面、做笔记在内的教学动作。In the resource display method based on knowledge association, the user terminal uses image recognition technology to obtain teaching actions in the video including full-screen document resources, changing document resource presentation pages, and taking notes for the video image part.
所述的一种基于知识关联的资源展示方法，其步骤S07中教学者或学习者在用户终端通过改变文档的内容来改变视频教学内容：教学者或学习者在打开文档资源和视频资源后，通过修改文档资源的显示状态，获取文档改变的状态，同时读取知识点与文档资源匹配列表，获取知识点与文档资源的关联关系，根据读取的知识点与视频资源匹配列表，以知识点为中心，来改变视频的播放进度。In the resource display method based on knowledge association, in step S07, the teacher or learner changes the video teaching content by changing the content of the document on the user terminal: after the teacher or learner opens the document resource and the video resource, By modifying the display status of document resources, obtain the status of document changes, and at the same time read the matching list of knowledge points and document resources, obtain the association relationship between knowledge points and document resources, and use knowledge points according to the matching list of read knowledge points and video resources Center to change the playback progress of the video.
所述的一种基于知识关联的资源展示方法，其步骤S08中教学者或学习者在用户终端通过改变视频进度来改变文档显示内容：教学者或学习者在打开文档资源和视频资源后，在视频自动播放或手动改变视频的播放进度时，获取视频的播放状态，读取知识点与视频资源匹配列表，获取知识点与视频资源的关联关系，同时根据读取的知识点与文档资源匹配列表，以知识点为中心，来改变文档资源的呈现页面；或者在视频资源中提取提前预备好的视频资源的教学动作，根据这些教学动作来改变文档资源的呈现内容。In the resource presentation method based on knowledge association, in step S08, the teacher or learner changes the document display content by changing the progress of the video on the user terminal: after the teacher or learner opens the document resource and the video resource, When the video plays automatically or manually changes the playback progress of the video, obtain the playback status of the video, read the matching list of knowledge points and video resources, obtain the association relationship between knowledge points and video resources, and at the same time match the list of knowledge points and document resources according to the read , to change the presentation page of the document resource with knowledge points as the center; or extract the teaching actions of the video resources prepared in advance from the video resources, and change the presentation content of the document resources according to these teaching actions.
本发明的有益效果是：The beneficial effects of the present invention are:
本发明在移动端、web端、双屏教学等方面有着很大的应用范围，让学生在学习过程中可以文档资源与视频资源同步呈现，学生在学习过程中更加方便，提高学习效率；在双轨教学上，教师无需同时操作两个屏幕，只要操作一个屏幕基本可以满足教学的需求，方便了教师教学过程，提升了教师教学的质量；本发明可以让教师在资源中设计自己的教学教案，设计完教学教案后教学过程很大程度上无需自身亲自展示指导，减轻了教师工作强度，同时也新颖了教学活动。进一步地，以知识点为中心的资源列表，更加丰富了教学资源，更加丰富了教学内容，更加丰富了教学质量。The present invention has a wide range of applications in mobile terminals, web terminals, dual-screen teaching, etc., allowing students to present document resources and video resources synchronously during the learning process, making it more convenient for students during the learning process and improving learning efficiency; In teaching, the teacher does not need to operate two screens at the same time, as long as one screen can basically meet the needs of teaching, which facilitates the teaching process and improves the quality of teacher teaching; this invention allows teachers to design their own teaching plans in resources, design After finishing the teaching plan, the teaching process largely does not need to be personally displayed and guided, which reduces the workload of teachers and also innovates teaching activities. Furthermore, the resource list centered on knowledge points enriches the teaching resources, teaching content and teaching quality.
附图说明Description of drawings
图1是本发明资源展示的方法流程图；Fig. 1 is a flow chart of a method for displaying resources of the present invention;
图2是本发明文档资源的处理流程图；Fig. 2 is the processing flowchart of the document resource of the present invention;
图3是本发明视频资源的处理流程图；Fig. 3 is the processing flowchart of video resource of the present invention;
图4是本发明资源的呈现流程图。Fig. 4 is a flow chart of presenting resources of the present invention.
具体实施方式detailed description
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。此外，下面所描述的本发明各个实施方式中所涉及到的技术特征只要彼此之间未构成冲突就可以相互组合。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.
本发明公开了一种基于知识关联的资源展示方法，基于用户终端和服务器，其中The invention discloses a resource display method based on knowledge association, which is based on a user terminal and a server, wherein
用户终端用于对用户上传的文档资源内容和视频资源内容进行处理，得到文档资源与知识点匹配列表和视频资源时间点与知识点匹配列表，将两种列表上传到服务器。The user terminal is used to process the document resource content and video resource content uploaded by the user, obtain the document resource-knowledge point matching list and the video resource time point-knowledge point matching list, and upload the two lists to the server.
服务器用于提取文档资源与知识点匹配列表和视频资源时间点与知识点匹配列表中的相关信息，以知识点为匹配依据，将提取的文档资源内容，包括文档标题、文档页码、文档字数、每段或每页的信息与对应页码，与知识点相匹配起来；以知识点为匹配依据，将提取的视频资源内容，包括视频名称、视频大小、视频长度、每段视频对应的含义，与知识点相匹配起来。The server is used to extract the relevant information in the document resource and knowledge point matching list and the video resource time point and knowledge point matching list. Based on the knowledge point, the extracted document resource content includes document title, document page number, document word count, The information of each paragraph or page and the corresponding page number are matched with the knowledge points; based on the knowledge points, the content of the extracted video resources, including the video name, video size, video length, and the corresponding meaning of each video, are matched with Knowledge points are matched.
如图1所示，基于知识关联的资源展示方法，包含以下的步骤：As shown in Figure 1, the resource display method based on knowledge association includes the following steps:
S01，根据文档特征提取知识点信息：用户终端以知识点为匹配依据，根据文档特征来查找文档信息，在进行查找文档信息时，根据文档的特征不同，进行不同方式的处理，信息查找完成后，通过文本关键词提取等算法来提取文档信息中的知识点信息。S01. Extract knowledge point information based on document features: the user terminal uses knowledge points as a matching basis to search for document information based on document features. When searching for document information, it performs different processing according to different document features. After the information search is completed , to extract the knowledge point information in the document information through algorithms such as text keyword extraction.
提取文档的特征，包括文档的标题、文档的字数、文档的行数、文档的段落数量、文档的页码；文档资源的类型有多种，包括txt、doc、html、pdf、ppt、xls等，每种类型的资源都不同种类的特点，针对不同资源要进行相应的处理。Extract the features of the document, including the title of the document, the number of words in the document, the number of lines in the document, the number of paragraphs in the document, and the page number of the document; there are many types of document resources, including txt, doc, html, pdf, ppt, xls, etc. Each type of resource has different types of characteristics, and corresponding processing should be carried out for different resources.
例如：txt文档中没有页码信息，只是包含了段落、行、句子等，故提取其信息时要先针对段落处理，然后再针对行处理或句子处理。而在ppt中，包含了页码、标题、内容、段落、行，这里就需要首先对其进行分页处理，然后就是标题、内容。For example: there is no page number information in the txt document, but only paragraphs, lines, sentences, etc., so when extracting its information, it must be processed for paragraphs first, and then for lines or sentences. In ppt, it includes page number, title, content, paragraph, and line. Here, it needs to be paginated first, and then the title and content.
知识库中包含种类丰富、数据量极大的知识点，这里以知识点为基础，对已经提取出来的文档资源信息表进行基于知识关联的相似度匹配，最终生成知识点与文档资源匹配列表，列表包括：知识点id，文档资源信息id，知识关联相似匹配权重、推荐匹配权重、添加时间。The knowledge base contains a wide variety of knowledge points with a large amount of data. Here, based on the knowledge points, the extracted document resource information table is matched based on knowledge association similarity, and finally a knowledge point and document resource matching list is generated. The list includes: knowledge point id, document resource information id, knowledge association similar matching weight, recommended matching weight, and adding time.
S02，用户终端对提取的知识点信息进行分类，采用基于知识关联的相似度匹配方法计算知识关联相似度匹配权重，所述基于知识关联的相似度匹配方法基于同义词词林的相似度匹配方法，步骤为：S02. The user terminal classifies the extracted knowledge point information, and calculates the knowledge association similarity matching weight by using a similarity matching method based on knowledge association. The similarity matching method based on knowledge association is based on the similarity matching method of synonym Cilin, The steps are:
（1）对于某一类别下的知识点A，查找知识库中相同或相似类别下的所有知识点，从第一个知识点B开始遍历；(1) For a knowledge point A under a certain category, search for all knowledge points under the same or similar category in the knowledge base, and start traversing from the first knowledge point B;
（2）判断知识点A和知识点B在同义词词林中作为叶子节点的两个义项所处的分支，从第一层开始判断，相同乘以1，否则在分支层乘以相应的系数，然后乘以调节参数cos(n*)，然后乘以控制参数(n-k+1)/n。具体如下：(2) Judging the branch where knowledge point A and knowledge point B are located as the two meaning items of the leaf node in the synonym word forest, judge from the first layer, multiply the same by 1, otherwise multiply the corresponding coefficient at the branch layer, Then multiply by the adjustment parameter cos(n* ), and then multiplied by the control parameter (n-k+1)/n. details as follows:
若两个义项的相似度用Similar表示If the similarity between two meaning items is represented by Similar
若两个义项不在同一树上，则Similar(A，B)=0;If the two sense items are not on the same tree, then Similar(A, B)=0;
若两个义项在同一树上，If two senses are on the same tree,
若在第2层分支，系数为x，则Similar(A，B)=1*x*cos(n*)*；If the branch is on the second layer, the coefficient is x, then Similar(A, B)=1*x*cos(n* )* ;
若在第3层分支，系数为y，则Similar(A，B)=1*1*y*cos(n*)*；If the branch is in the third layer, the coefficient is y, then Similar(A, B)=1*1*y*cos(n* )* ;
若在第4层分支，系数为z，则Similar(A，B)=1*1*1*z*cos(n*)*；If the branch is in the 4th layer, the coefficient is z, then Similar(A, B)=1*1*1*z*cos(n* )* ;
若在第5层分支，系数为q，则Similar(A，B)=1*1*1*q*cos(n*)*；If the branch is on the 5th layer, the coefficient is q, then Similar(A, B)=1*1*1*q*cos(n* )* ;
在计算A和B相似度时，把A和B的义项分别两两计算，取其中的最大值作为两个词语的相似度的值。When calculating the similarity between A and B, the sense items of A and B are calculated in pairs, and the maximum value is taken as the value of the similarity between the two words.
根据以上的计算方法，可以得到从文档中提取的知识点信息与服务器知识库关联的相似匹配权重。推荐匹配权重初始化与知识关联相似匹配权重相等，后期根据用户反馈、评价修改推荐匹配权重，增加灵活性。According to the above calculation method, the similarity matching weight associated with the knowledge point information extracted from the document and the server knowledge base can be obtained. The initialization of the recommended matching weight is equal to the similar matching weight of the knowledge association. Later, the recommended matching weight is modified according to user feedback and evaluation to increase flexibility.
知识关联相似匹配权重是知识点与文档资源信息的关联紧密程度，关联越紧密，权重越大，关联越弱，权重越小。用户通过知识点来获取相应的文档资源信息时，优先提取知识关联相似匹配权重高的记录，若需提取相关的多条记录，则按照权重大小分别提取相应的记录。推荐匹配权重是由根据用户反馈、评价修改而来，当基于知识关联的相似度匹配无法满足要求时，可以增加推荐匹配权重，这时将优先提取与之相关的记录，这样大大提高了灵活性，满足不同的需求。Knowledge association similarity matching weight is the degree of association between knowledge points and document resource information. The tighter the association, the greater the weight, and the weaker the association, the smaller the weight. When the user obtains the corresponding document resource information through the knowledge points, the records with high knowledge association similarity matching weights are preferentially extracted. If multiple related records need to be extracted, the corresponding records are extracted according to the weights. The recommended matching weight is modified based on user feedback and evaluation. When the similarity matching based on knowledge association cannot meet the requirements, the recommended matching weight can be increased. At this time, the related records will be extracted first, which greatly improves flexibility. , to meet different needs.
S03，用户终端将知识点与文档资源匹配列表上传到服务器的资源处理中心；S03, the user terminal uploads the matching list of knowledge points and document resources to the resource processing center of the server;
S04，用户终端以知识点为匹配依据，提取视频的特征，包括视频的标题、视频的大小、视频的格式、视频的时间长度，分时段提取视频中内容描述性信息（视频特征）；这里以知识点为基础，对已经提取出来的视频资源时间表进行基于知识关联的相似度匹配，用户终端按照步骤S02中的同义词词林的相似度匹配方法，生成包含知识点id，视频资源信息id，文本相似匹配权重、推荐匹配权重、添加时间在内的知识点与视频资源匹配列表。S04, the user terminal uses the knowledge points as the matching basis to extract the features of the video, including the title of the video, the size of the video, the format of the video, and the length of the video, and extract the content descriptive information (video features) in the video by time; here Based on the knowledge points, carry out similarity matching based on knowledge association on the extracted video resource timetable, and the user terminal generates information including knowledge point id, video resource information id, Text similarity matching weights, recommendation matching weights, knowledge points including added time and video resource matching list.
视频资源的类型有多种，包括mp4、3gp、mkv、avi、rmvb、wmv等，对于视频资源的处理包含了两个方面：一个是视频资源语音部分的处理，一个是视频图像部分的处理。针对视频语音部分，先使用语音识别技术来提取视频资源中知识内容，形成包括视频资源时间表id的视频资源时间表，再根据语音含义分段提取的资源知识内容和提取知识内容对应的时间点；针对视频图像部分的处理，使用图像识别技术来获取视频中包含全屏文档资源、更改文档资源呈现页面、做笔记在内的教学动作。There are many types of video resources, including mp4, 3gp, mkv, avi, rmvb, wmv, etc. The processing of video resources includes two aspects: one is the processing of the audio part of the video resource, and the other is the processing of the video image part. For the voice part of the video, first use speech recognition technology to extract the knowledge content in the video resource, form a video resource timetable including the video resource timetable id, and then extract the resource knowledge content segmented according to the voice meaning and the time point corresponding to the extracted knowledge content ;Aiming at the processing of the image part of the video, image recognition technology is used to obtain teaching actions in the video including full-screen document resources, changing document resource presentation pages, and taking notes.
视频资源中包含的教学动作是特有的教学动作，主要是为了学生在现场没有教师指导的前提下更好与听从教师的引导，提高学习效率。The teaching actions contained in the video resources are unique teaching actions, mainly for students to better follow the teacher's guidance and improve learning efficiency without the teacher's guidance on site.
S05，用户终端将知识点与视频资源匹配列表上传到服务器的资源处理中心；S05, the user terminal uploads the matching list of knowledge points and video resources to the resource processing center of the server;
S06，用户终端通过知识点来获取相应的文档资源信息时，服务器依照用户自定义匹配权重优先提取文本相似匹配权重高的记录，将多条记录按照权重大小排列发送到客户终端；若文本相似度匹配无法满足要求，则增加推荐匹配权重并优先提取与之相关的记录；S06, when the user terminal obtains the corresponding document resource information through knowledge points, the server preferentially extracts records with high text similarity matching weights according to the user-defined matching weights, and sends multiple records to the client terminal in order of weights; if the text similarity If the matching cannot meet the requirements, increase the weight of the recommended matching and preferentially extract the records related to it;
S07，用户终端改变文档状态时，服务器端先获取文档改变状态的信息，根据改变状态的信息获取知识点与文档资源的匹配列表，查找到对应的知识点，通过读取知识点与视频资源匹配列表，动态调整视频播放进度，自适应完成视频资源的展示。S07, when the user terminal changes the status of the document, the server first obtains information about the status of the document change, obtains a matching list of knowledge points and document resources according to the information about the status change, finds the corresponding knowledge points, and matches the knowledge points with the video resources by reading List, dynamically adjust the video playback progress, and adaptively complete the display of video resources.
本步骤中教学者或学习者在用户终端通过改变文档的内容来改变视频教学内容：教学者或学习者在打开文档资源和视频资源后，通过修改文档资源的显示状态，获取文档改变的状态，同时读取知识点与文档资源匹配列表，获取知识点与文档资源的关联关系，根据读取的知识点与视频资源匹配列表，以知识点为中心，来改变视频的播放进度。In this step, the teacher or learner changes the video teaching content by changing the content of the document on the user terminal: After opening the document resource and the video resource, the teacher or learner obtains the status of the document change by modifying the display status of the document resource, At the same time, read the matching list of knowledge points and document resources, obtain the relationship between knowledge points and document resources, and change the playback progress of the video based on the read matching list of knowledge points and video resources, centering on knowledge points.
S08，用户终端播放视频资源时，服务器端检测视频资源中有包括全屏文档资源、更改文档资源呈现页面、做笔记等设定好的教学动作时，若此时文档没有人为操作或控制，根据教学动作动态修改文档资源呈现页面，自适应完成文档资源的展示。S08. When the user terminal is playing video resources, the server detects that there are set teaching actions in the video resources including full-screen document resources, changing document resource presentation pages, taking notes, etc., if the document is not manually operated or controlled at this time, according to the teaching The action dynamically modifies the document resource presentation page, and completes the display of document resources adaptively.
本步骤中教学者或学习者在用户终端通过改变视频进度来改变文档显示内容：In this step, the teacher or learner changes the document display content by changing the video progress on the user terminal:
教学者或学习者在打开文档资源和视频资源后，在视频自动播放或手动改变视频的播放进度时，获取视频的播放状态，读取知识点与视频资源匹配列表，获取知识点与视频资源的关联关系，同时根据读取的知识点与文档资源匹配列表，以知识点为中心，来改变文档资源的呈现页面；After the teacher or learner opens the document resource and video resource, when the video is automatically played or the video playback progress is manually changed, the teacher or learner can obtain the playback status of the video, read the matching list of knowledge points and video resources, and obtain the matching list of knowledge points and video resources. Association relationship, and change the presentation page of document resources according to the knowledge points read and the matching list of document resources, with the knowledge points as the center;
或者在视频资源中提取提前预备好的视频资源的教学动作，根据这些教学动作来改变文档资源的呈现内容。Alternatively, the teaching actions of the video resources prepared in advance are extracted from the video resources, and the presentation content of the document resources is changed according to these teaching actions.
S09，用户终端改变视频播放的状态时，服务器端先获取视频资源改变状态的信息，根据改变状态的信息获取知识点与视频资源的匹配列表，查找到对应的知识点，通过读取知识点与文档资源匹配列表，动态调整文档呈现页面，自适应完成文档资源的展示。S09, when the user terminal changes the state of video playback, the server first obtains information about the change state of the video resource, obtains a matching list of knowledge points and video resources according to the information of the change state, finds the corresponding knowledge point, and reads the knowledge point and Document resource matching list, dynamically adjust the document presentation page, and complete the display of document resources adaptively.
教学者或学习者可以通过两种方式来进行教学或学习，一种是通过改变文档的内容来改变视频教学内容，一种是通过改变视频进度来改变文档显示内容。Teachers or learners can teach or learn in two ways, one is to change the video teaching content by changing the content of the document, and the other is to change the document display content by changing the video progress.
在第一种方式中，教学者或学习者在打开文档资源和视频资源后，修改了文档资源的显示状态，比如：改变了文档资源的页面发生变化（如果有页码的话），改变了鼠标光标的位置，选中文档中一段文字等，这样可以获取文档改变的状态，同时在这里读取知识点与文档资源匹配列表，获取知识点与文档资源的关联关系，接着根据读取知识点与视频资源匹配列表，包括：知识点id，视频资源信息id，知识关联相似匹配权重、推荐匹配权重、添加时间，以知识点为中心，来改变视频的播放进度。In the first method, after opening the document resources and video resources, the educator or learner modifies the display status of the document resources, for example: the page of the document resource changes (if there is a page number), and the mouse cursor changes position, select a piece of text in the document, etc., so that the status of the document change can be obtained, and at the same time, the matching list of knowledge points and document resources can be read here to obtain the relationship between knowledge points and document resources, and then according to the read knowledge points and video resources Matching list, including: knowledge point id, video resource information id, knowledge association similar matching weight, recommended matching weight, adding time, centering on knowledge point, to change the playback progress of the video.
在第二种方式中，教学者或学习者在打开文档资源和视频资源后，有两种改变方式：第1种是在视频自动播放或手动改变视频的播放进度时，可以获取视频的播放状态，包括：视频名称、视频播放时间点、是否改变，在这里读取知识点与视频资源匹配列表，获取知识点与视频资源的关联关系，接着根据读取知识点与文档资源匹配列表，列表包括：知识点id，文档资源信息id，知识关联相似匹配权重、推荐匹配权重、添加时间。以知识点为中心，来改变文档资源的呈现页面。第2种方法是在视频资源中提取提前预备好的视频资源的教学动作，包括全屏文档资源、更改文档资源呈现页面、做笔记等，根据这些教学动作，来改变文档资源的呈现内容（在改变之前，首先判断文档资源是否有认为操作，如果有，则以人为操作为主，不改变呈现内容。In the second method, after the teacher or learner opens the document resources and video resources, there are two ways to change them: the first one is to obtain the playback status of the video when the video is automatically played or the video playback progress is manually changed , including: video name, video playback time, whether to change, read the matching list of knowledge points and video resources here, obtain the association relationship between knowledge points and video resources, and then read the matching list of knowledge points and document resources according to the list, the list includes : knowledge point id, document resource information id, knowledge association similarity matching weight, recommendation matching weight, and adding time. Focus on knowledge points to change the presentation page of document resources. The second method is to extract the teaching actions of video resources prepared in advance from the video resources, including full-screen document resources, changing the presentation page of document resources, taking notes, etc., and changing the presentation content of document resources according to these teaching actions (changing Before, it was first judged whether the document resource had any operations, and if so, it was mainly based on human operations without changing the presentation content.
进一步地，视频播放进度改变时，在资源处理中心查找视频进度改变后对应的知识点ID，接着根据知识点ID再查找相对应的文档资源信息，最后改变文档资源信息的状态；Further, when the video playback progress changes, search the resource processing center for the knowledge point ID corresponding to the video progress change, then search for the corresponding document resource information according to the knowledge point ID, and finally change the state of the document resource information;
进一步地，文档资源页面或鼠标光标改变时，在资源处理中心查找文档信息页面对应的知识点ID，接着根据知识点ID再查找相对应的视频资源信息，最后改变视频资源的播放状态；Further, when the document resource page or the mouse cursor changes, search for the knowledge point ID corresponding to the document information page in the resource processing center, then search for the corresponding video resource information according to the knowledge point ID, and finally change the playing state of the video resource;
进一步地，知识点按照知识点之间相关性强弱存储知识点的关联关系；Further, the knowledge points store the association relationship of the knowledge points according to the strength of the correlation between the knowledge points;
进一步地，知识点与文档资源匹配列表中存储知识点与文档资源匹配的关联权重，查找时优先提取权重最高的记录；Further, the matching list of knowledge points and document resources stores the associated weights of matching knowledge points and document resources, and the record with the highest weight is preferentially extracted when searching;
进一步地，知识点与视频资源匹配列表中存储知识点与视频资源匹配的关联权重，查找时优先提取权重最高的记录；Further, the knowledge point and video resource matching list stores the associated weight of the knowledge point and video resource matching, and the record with the highest weight is preferentially extracted when searching;
进一步地，视频进度改变时，在资源处理中心查找视频进度改变后对应的知识点ID，根据知识点ID查找不到相对应的文档资源信息时，在知识点关联关系库中查找关联关系最强的知识点ID，然后根据查找后的知识点ID查找相对应的文档资源信息；若还是无法查到，则按照以上操作，继续在知识点关联库中查找关联关系第二紧密的知识点ID，以此类推，直到能够查找到相对应的文档资源信息。Further, when the progress of the video changes, search the resource processing center for the ID of the knowledge point corresponding to the change of the video progress, and if the corresponding document resource information cannot be found according to the ID of the knowledge point, search for the strongest association in the knowledge point association relationship database knowledge point ID, and then search for the corresponding document resource information according to the knowledge point ID after searching; if it still cannot be found, follow the above operation to continue to search for the knowledge point ID with the second closest relationship in the knowledge point association database. And so on, until the corresponding document resource information can be found.
本领域的技术人员容易理解，以上所述仅为本发明的较佳实施例而已，并不用以限制本发明，凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等，均应包含在本发明的保护范围之内。Those skilled in the art can easily understand that the above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention, All should be included within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710798032.4ACN107562896B (en) | 2017-09-06 | 2017-09-06 | Knowledge association-based resource organization and display method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710798032.4ACN107562896B (en) | 2017-09-06 | 2017-09-06 | Knowledge association-based resource organization and display method |
| Publication Number | Publication Date |
|---|---|
| CN107562896Atrue CN107562896A (en) | 2018-01-09 |
| CN107562896B CN107562896B (en) | 2021-11-26 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710798032.4AActiveCN107562896B (en) | 2017-09-06 | 2017-09-06 | Knowledge association-based resource organization and display method |
| Country | Link |
|---|---|
| CN (1) | CN107562896B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108335363A (en)* | 2018-01-22 | 2018-07-27 | 上海星合网络科技有限公司 | Multidimensional knowledge system stereo exhibition method and device |
| CN108563749A (en)* | 2018-04-16 | 2018-09-21 | 中山大学 | On-line education system resource recommendation method based on various dimensions information and knowledge network |
| CN108900917A (en)* | 2018-07-09 | 2018-11-27 | 东北大学 | A kind of online teaching audio/video player system and method towards the structure of knowledge |
| CN110119473A (en)* | 2019-05-23 | 2019-08-13 | 北京金山数字娱乐科技有限公司 | A kind of construction method and device of file destination knowledge mapping |
| CN110415569A (en)* | 2019-06-29 | 2019-11-05 | 嘉兴梦兰电子科技有限公司 | Share educational method and system in campus classroom |
| CN111241386A (en)* | 2018-11-28 | 2020-06-05 | 中国移动通信集团有限公司 | An information processing method and device, and a storage medium |
| CN111314792A (en)* | 2020-02-27 | 2020-06-19 | 北京奇艺世纪科技有限公司 | Note generation method and electronic equipment |
| CN111813993A (en)* | 2020-09-04 | 2020-10-23 | 中山大学深圳研究院 | Video content expanding method and device, terminal equipment and storage medium |
| CN112256834A (en)* | 2020-10-28 | 2021-01-22 | 中国科学院声学研究所 | Marine science data recommendation system based on content and literature |
| CN112286943A (en)* | 2020-12-26 | 2021-01-29 | 东华理工大学南昌校区 | Ideological and political theory teaching plan display method and system based on current affair case optimization |
| CN113177026A (en)* | 2021-04-16 | 2021-07-27 | 宋彦震 | Live-action-screen learning note management method based on teaching video |
| CN115119066A (en)* | 2022-06-30 | 2022-09-27 | 武汉美和易思数字科技有限公司 | Teaching video interaction method and system based on dynamic weight |
| CN117435746A (en)* | 2023-12-18 | 2024-01-23 | 广东信聚丰科技股份有限公司 | Knowledge point labeling method and system based on natural language processing |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236690A (en)* | 2010-05-07 | 2011-11-09 | 李晓 | Data management method, file format applying method and electronic equipment |
| CN103020270A (en)* | 2012-12-26 | 2013-04-03 | 中国科学院计算技术研究所 | Information search system and method for electronic books |
| WO2013163636A1 (en)* | 2012-04-28 | 2013-10-31 | Hewlett-Packard Development Company, L.P. | Generating a page, assigning sections to a document and generating a slide |
| CN103458018A (en)* | 2013-08-26 | 2013-12-18 | 华中师范大学 | Resource correlation presenting method and system |
| US20140214859A1 (en)* | 2013-01-28 | 2014-07-31 | Beijing Founder Electronics Co., Ltd. | Method and device for pushing association knowledge |
| CN106021293A (en)* | 2016-05-03 | 2016-10-12 | 华中师范大学 | Knowledge linkage based study note storage method, storage device and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236690A (en)* | 2010-05-07 | 2011-11-09 | 李晓 | Data management method, file format applying method and electronic equipment |
| WO2013163636A1 (en)* | 2012-04-28 | 2013-10-31 | Hewlett-Packard Development Company, L.P. | Generating a page, assigning sections to a document and generating a slide |
| CN103020270A (en)* | 2012-12-26 | 2013-04-03 | 中国科学院计算技术研究所 | Information search system and method for electronic books |
| US20140214859A1 (en)* | 2013-01-28 | 2014-07-31 | Beijing Founder Electronics Co., Ltd. | Method and device for pushing association knowledge |
| CN103458018A (en)* | 2013-08-26 | 2013-12-18 | 华中师范大学 | Resource correlation presenting method and system |
| CN106021293A (en)* | 2016-05-03 | 2016-10-12 | 华中师范大学 | Knowledge linkage based study note storage method, storage device and system |
| Title |
|---|
| 陈宏朝等: ""基于路径与深度的同义词词林词语相似度计算"", 《中文信息学报》* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108335363A (en)* | 2018-01-22 | 2018-07-27 | 上海星合网络科技有限公司 | Multidimensional knowledge system stereo exhibition method and device |
| CN108563749B (en)* | 2018-04-16 | 2020-11-10 | 中山大学 | Online education system resource recommendation method based on multi-dimensional information and knowledge network |
| CN108563749A (en)* | 2018-04-16 | 2018-09-21 | 中山大学 | On-line education system resource recommendation method based on various dimensions information and knowledge network |
| CN108900917A (en)* | 2018-07-09 | 2018-11-27 | 东北大学 | A kind of online teaching audio/video player system and method towards the structure of knowledge |
| CN111241386A (en)* | 2018-11-28 | 2020-06-05 | 中国移动通信集团有限公司 | An information processing method and device, and a storage medium |
| CN110119473A (en)* | 2019-05-23 | 2019-08-13 | 北京金山数字娱乐科技有限公司 | A kind of construction method and device of file destination knowledge mapping |
| CN110415569A (en)* | 2019-06-29 | 2019-11-05 | 嘉兴梦兰电子科技有限公司 | Share educational method and system in campus classroom |
| CN110415569B (en)* | 2019-06-29 | 2021-08-03 | 嘉兴梦兰电子科技有限公司 | Campus classroom sharing education method and system |
| CN111314792A (en)* | 2020-02-27 | 2020-06-19 | 北京奇艺世纪科技有限公司 | Note generation method and electronic equipment |
| CN111314792B (en)* | 2020-02-27 | 2022-04-08 | 北京奇艺世纪科技有限公司 | Note generation method, electronic device and storage medium |
| CN111813993A (en)* | 2020-09-04 | 2020-10-23 | 中山大学深圳研究院 | Video content expanding method and device, terminal equipment and storage medium |
| CN112256834A (en)* | 2020-10-28 | 2021-01-22 | 中国科学院声学研究所 | Marine science data recommendation system based on content and literature |
| CN112256834B (en)* | 2020-10-28 | 2021-06-08 | 中国科学院声学研究所 | A content and literature-based marine scientific data recommendation system |
| CN112286943A (en)* | 2020-12-26 | 2021-01-29 | 东华理工大学南昌校区 | Ideological and political theory teaching plan display method and system based on current affair case optimization |
| CN113177026A (en)* | 2021-04-16 | 2021-07-27 | 宋彦震 | Live-action-screen learning note management method based on teaching video |
| CN113177026B (en)* | 2021-04-16 | 2022-11-22 | 山东亿方锦泽信息科技有限公司 | Live-broadcasting bullet screen learning note management method based on teaching video |
| CN115119066A (en)* | 2022-06-30 | 2022-09-27 | 武汉美和易思数字科技有限公司 | Teaching video interaction method and system based on dynamic weight |
| CN115119066B (en)* | 2022-06-30 | 2024-03-29 | 武汉美和易思数字科技有限公司 | Teaching video interaction method and system based on dynamic weights |
| CN117435746A (en)* | 2023-12-18 | 2024-01-23 | 广东信聚丰科技股份有限公司 | Knowledge point labeling method and system based on natural language processing |
| CN117435746B (en)* | 2023-12-18 | 2024-02-27 | 广东信聚丰科技股份有限公司 | Knowledge point labeling method and system based on natural language processing |
| Publication number | Publication date |
|---|---|
| CN107562896B (en) | 2021-11-26 |
| Publication | Publication Date | Title |
|---|---|---|
| CN107562896A (en) | A kind of the resource tissue and methods of exhibiting of knowledge based association | |
| CN109359215B (en) | Video intelligent pushing method and system | |
| JP6515624B2 (en) | Method of identifying lecture video topics and non-transitory computer readable medium | |
| CN115329200B (en) | Teaching resource recommendation method based on knowledge graph and user similarity | |
| US20140120516A1 (en) | Methods and Systems for Creating, Delivering, Using, and Leveraging Integrated Teaching and Learning | |
| CN108345593A (en) | Question bank system-based teaching lecture generation method and device | |
| CN103324685B (en) | The approach for video retrieval by video clip of Japanese Online Video language material | |
| CN111046194A (en) | Method for constructing multi-mode teaching knowledge graph | |
| CN110569364A (en) | online teaching method, device, server and storage medium | |
| KR102010343B1 (en) | Method and apparatus for providing segmented internet based lecture contents | |
| US20150026184A1 (en) | Methods and systems for content management | |
| US20150254999A1 (en) | Method and system for providing contextual vocabulary acquisition through association | |
| JP2019522229A (en) | A computerized learning system based on affinity knowledge | |
| CN107424100A (en) | Information providing method and system | |
| KR20150139395A (en) | Method and server for providing online video-education service | |
| Huang | Taking stock of corpus-based instruction in teaching English as an international language | |
| Miranda et al. | Topic modeling and sentiment analysis of martial arts learning textual feedback on YouTube | |
| Chen | Information visualization skills for academic librarians: A content analysis of publications and online LibGuides in the digital humanities | |
| US20180158361A1 (en) | Method for facilitating contextual vocabulary acquisition through association | |
| GanChanyawudhiwan | Use of smart learning resource management systems for sustainable learning | |
| CN112347354B (en) | Courseware management method for intelligent education | |
| JP3887685B2 (en) | Presentation material retrieval system, method and program thereof | |
| Salim et al. | Improving the learning effectiveness of educational videos | |
| Anggraeny et al. | Undergraduate Thesis Supervisor Recommendation Based On Text Similarity | |
| Jia et al. | A mental health education strategy based on online videos |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |