技术领域technical field
本发明涉及计算机网络技术，尤其涉及一种互联网媒体资源元数据的处理方法及其系统。The invention relates to computer network technology, in particular to a method and system for processing metadata of Internet media resources.
背景技术Background technique
随着互联网产业蓬勃发展，网络带宽不断增大，互联网媒体资源内容商纷纷兴起，为用户提供更加丰富多彩的多媒体资源。越来越多的互联网媒体资源也给用户的分类查找带来诸多不变。With the vigorous development of the Internet industry and the continuous increase of network bandwidth, Internet media resource content providers have emerged one after another to provide users with more colorful multimedia resources. More and more Internet media resources have also brought many changes to users' classification search.
目前媒体资源元数据聚合解决方案是利用高性能服务器获取并存储各个媒体资源内容商的多媒体资源元数据信息。当用户需要访问或搜索媒体资源时，服务器在缓存数据中寻找终端用户请求的媒体资源并返回媒体资源元数据。由于服务器对媒体资源元数据的获取和解析具有一定滞后，因此会出现聚合服务器缓存数据滞后媒体内容商数据的情况，导致出现没有媒体内容商的最新媒体资源元数据或者缓存的媒体资源元数据不可用的情况。此外，使用聚合服务器进行多媒体资源元数据聚合需架设大量服务器，部署较多数据节点，投资较高。终端用户的访问范围受限于服务器的索引范围，对服务器有极大的依赖，且服务器的稳定性决定终端用户使用的稳定性。The current media resource metadata aggregation solution is to use high-performance servers to obtain and store multimedia resource metadata information of various media resource content providers. When a user needs to access or search for a media resource, the server searches the cached data for the media resource requested by the end user and returns the metadata of the media resource. Because the server has a certain lag in obtaining and parsing the media resource metadata, the aggregation server cache data lags behind the media content provider data, resulting in the absence of the latest media resource metadata of the media content provider or the cached media resource metadata is not available. use case. In addition, using an aggregation server to aggregate metadata of multimedia resources requires setting up a large number of servers, deploying many data nodes, and requiring high investment. The access range of end users is limited by the index range of the server, and there is a great dependence on the server, and the stability of the server determines the stability of the use of end users.
发明内容Contents of the invention
本发明的目的在于实时获取互联网媒体资源元数据，为终端用户提供多媒体资源元数据聚合结果。The purpose of the present invention is to obtain the metadata of Internet media resources in real time, and provide the aggregation result of the metadata of multimedia resources for terminal users.
为实现上述的目的，一方面，本发明提供了一种互联网媒体资源元数据的处理方法，该方法包括：运行脚本语言插件，获取和解析互联媒体资源元数据信息，将异构的媒体资源元数据整合为一致性数据结构，并对整合后的结果聚合呈现。In order to achieve the above object, on the one hand, the present invention provides a method for processing metadata of Internet media resources, the method comprising: running script language plug-ins, acquiring and analyzing metadata information of Internet media resources, and converting heterogeneous media resource metadata The data is integrated into a consistent data structure, and the integrated results are aggregated and presented.
优选地，脚本语言插件包括多个脚本语言文件、一个描述文件和多个资源文件，通过脚本语言文件和资源文件将脚本语言插件的功能描述可视化展现给用户。Preferably, the scripting language plug-in includes multiple scripting language files, a description file and multiple resource files, and the functional description of the scripting language plug-in is visually displayed to the user through the scripting language file and the resource file.
优选地，通过运行脚本语言插件，解析互联网媒体资源商的门户网站的网页数据，获取相应的媒体资源元数据。Preferably, by running the scripting language plug-in, the web page data of the portal website of the Internet media resource provider is analyzed to obtain the corresponding media resource metadata.
优选地，通过运行脚本语言插件，通过互联网媒体资源商的开放接口获取相应的媒体资源元数据。Preferably, by running the scripting language plug-in, the corresponding media resource metadata is obtained through the open interface of the Internet media resource provider.
优选地，通过运行脚本语言插件，通过第三方开发接口获取相应的媒体资源元数据。Preferably, the corresponding media resource metadata is acquired through a third-party development interface by running a scripting language plug-in.
优选地，通过脚本语言插件升级服务器获取脚本语言插件的版本信息，并与当前脚本语言插件版本信息进行比较；如果存在高版本的脚本语言插件，则从所述脚本语言插件升级服务器下载并更新所述高版本的脚本语言插件。Preferably, the version information of the scripting language plug-in is obtained through the scripting language plug-in upgrade server, and is compared with the current scripting language plug-in version information; The above version of the scripting language plugin.
另一方面，本发明提供了一种互联网媒体资源元数据的处理系统，该系统包括：插件管理模块，脚本语言解释器和数据存储模块，其中插件管理模块用于通过解析脚本语言插件的描述文件，对脚本语言插件进行识别和区分，获取每个插件的描述信息和资源信息，建立数据结构并存储相关信息；脚本语言解释器用于运行脚本语言插件，通过运行脚本语言插件获取和解析互联媒体资源元数据信息；数据存储模块用于实现执行脚本语言插件过程中返回数据，同时将返回的异构媒体资源元数据整合为一致性数据结构。On the other hand, the present invention provides a system for processing metadata of Internet media resources, the system includes: a plug-in management module, a script language interpreter and a data storage module, wherein the plug-in management module is used to analyze the description file of the script language plug-in , to identify and distinguish the scripting language plug-ins, obtain the description information and resource information of each plug-in, establish the data structure and store relevant information; the scripting language interpreter is used to run the scripting language plug-ins, and obtain and parse Internet media resources by running the scripting language plug-ins Metadata information; the data storage module is used to realize the return of data during the execution of the script language plug-in, and at the same time integrate the returned heterogeneous media resource metadata into a consistent data structure.
优选地，脚本语言解释器具体用于：运行脚本语言插件，解析互联网媒体资源商的门户网站的网页数据或开放接口获取相应的媒体资源元数据。Preferably, the scripting language interpreter is specifically configured to: run the scripting language plug-in, analyze the webpage data of the portal website of the Internet media resource provider or open an interface to obtain corresponding media resource metadata.
优选地，脚本语言解释器具体用于：运行脚本语言插件，通过第三方开发接口获取相应的媒体资源元数据。Preferably, the scripting language interpreter is specifically configured to: run the scripting language plug-in, and acquire corresponding media resource metadata through a third-party development interface.
本发明利用脚本语言无需编译的特点，实现脚本语言插件的动态加载和更新；同时实时获取媒体资源元数据，避免存在数据滞后的问题。The invention utilizes the feature that the script language does not need to be compiled to realize the dynamic loading and updating of the script language plug-in; at the same time, the metadata of the media resource is obtained in real time to avoid the problem of data lag.
附图说明Description of drawings
图1为本发明实施例提供的互联网媒体资源元数据的处理方法应用场景示意图；FIG. 1 is a schematic diagram of an application scenario of a method for processing metadata of Internet media resources provided by an embodiment of the present invention;
图2为本发明实施例提供的互联网媒体资源元数据的处理系统结构示意图；FIG. 2 is a schematic structural diagram of a processing system for Internet media resource metadata provided by an embodiment of the present invention;
图3为本发明实施例提供的互联网媒体资源元数据处理方法流程图；Fig. 3 is the flowchart of the method for processing Internet media resource metadata provided by the embodiment of the present invention;
图4是互联网媒体资源元数据的处理系统工作流程示意图。Fig. 4 is a schematic diagram of the workflow of the system for processing metadata of Internet media resources.
具体实施方式detailed description
下面通过附图和实施例，对本发明的技术方案做进一步的详细描述。The technical solutions of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments.
图1为本发明实施例提供的互联网媒体资源元数据的处理方法应用场景示意图。如图1所示，互联网媒体资源数据的处理系统在启动时首先进行初始化操作，搜索当前可用插件，解析描述文件，初始化各个插件的状态。上述脚本语言插件包括多个脚本语言文件、一个描述文件和多个资源文件，通过描述文件和资源文件将脚本语言插件的功能描述可视化展现给用户。脚本语言插件根据执行指令获取相应的媒体资源元数据，例如，获取互联网媒体资源商的门户网站的网页数据，通过解析操作获取相关媒体资源元数据；或者，通过互联网媒体资源商的开放接口获取相关媒体资源元数据；又或者，通过第三方接口获取相关媒体资源元数据。FIG. 1 is a schematic diagram of an application scenario of a method for processing metadata of Internet media resources provided by an embodiment of the present invention. As shown in Figure 1, the Internet media resource data processing system first performs initialization operations when starting up, searches for currently available plug-ins, parses description files, and initializes the status of each plug-in. The above-mentioned scripting language plug-in includes multiple scripting language files, a description file and multiple resource files, and the function description of the scripting language plug-in is visually displayed to the user through the description file and the resource file. The scripting language plug-in obtains the corresponding media resource metadata according to the execution instructions, for example, obtains the web page data of the portal website of the Internet media resource provider, and obtains the relevant media resource metadata through the parsing operation; or obtains the relevant media resource metadata through the open interface of the Internet media resource provider. Media resource metadata; or, obtain relevant media resource metadata through a third-party interface.
互联网媒体资源数据的处理系统支持脚本语言插件的校验、安装、卸载、运行、停止和更新；脚本语言插件的更新文件存放在脚本插件升级服务器上，互联网媒体资源数据的处理系统通过获取脚本插件升级服务器上的插件版本号，与本地版本号进行比较；如果存在高版本插件，下载并更新高版本插件。The Internet media resource data processing system supports the verification, installation, uninstallation, operation, stop and update of the script language plug-in; the update file of the script language plug-in is stored on the script plug-in upgrade server, and the Internet media resource data processing system obtains the script plug-in Upgrade the plug-in version number on the server and compare it with the local version number; if there is a higher-version plug-in, download and update the higher-version plug-in.
脚本语言插件的描述文件示例如下，是一个获取新浪视频媒体元数据信息的脚本语言插件的描述文件，内容包括插件的id，名字，版本，开发者信息，python脚本文件名称，插件描述等相关信息。描述文件采用XML文件格式。An example of a description file for a scripting language plug-in is as follows. It is a description file for a scripting language plug-in that obtains Sina video media metadata information. The content includes plug-in id, name, version, developer information, python script file name, plug-in description and other related information . The description file adopts XML file format.
获取新浪视频元数据的python脚本语言插件的部分代码如下。通过下载和解析网页数据获取到媒体内容元数据信息，包括：媒体内容的评分、类型、导演、主演和简介等元数据信息。Part of the code of the python scripting language plug-in for obtaining Sina video metadata is as follows. The metadata information of the media content is obtained by downloading and parsing the web page data, including: the rating, type, director, leading role and profile of the media content and other metadata information.
图2为本发明实施例提供的互联网媒体资源元数据的处理系统结构示意图。如图2所示，该系统包括插件管理模块31、脚本语言解释器32和数据存储模块33。FIG. 2 is a schematic structural diagram of a system for processing metadata of Internet media resources provided by an embodiment of the present invention. As shown in FIG. 2 , the system includes a plug-in management module 31 , a script language interpreter 32 and a data storage module 33 .
插件管理模块31用于通过搜索配置的文件路径，通过解析脚本语言插件的描述文件，对脚本语言插件进行识别和区分，获取每个插件的描述信息和资源信息，建立数据结构并存储相关信息。The plug-in management module 31 is used to identify and distinguish the script language plug-ins by searching the configured file paths and analyzing the description files of the script language plug-ins, obtain description information and resource information of each plug-in, establish a data structure and store related information.
脚本语言解释器32用于初始化预定的脚本语言插件，通过运行脚本语言插件获取和解析互联媒体资源元数据信息，并提供插件脚本语言对其它模块的回调能力。The scripting language interpreter 32 is used to initialize a predetermined scripting language plug-in, obtain and analyze the metadata information of the Internet media resource by running the scripting language plug-in, and provide the callback capability of the plug-in scripting language to other modules.
具体地，脚本语言插件根据执行指令，获取相应的媒体资源元数据，具体可以有三种方式：Specifically, the scripting language plug-in obtains the corresponding media resource metadata according to the execution instruction, specifically in three ways:
第一种方式，脚本语言插件获取互联网媒体资源商的门户网站的网页数据，通过解析获取相关媒体资源元数据；In the first way, the scripting language plug-in obtains the webpage data of the portal website of the Internet media resource provider, and obtains relevant media resource metadata through analysis;
第二种方式，脚本语言插件通过互联网媒体资源商的开放接口获取相关媒体资源元数据；In the second way, the scripting language plug-in obtains relevant media resource metadata through the open interface of the Internet media resource provider;
第三种方式，脚本语言插件通过第三方开发接口获取相关媒体资源元数据。In the third way, the scripting language plug-in obtains relevant media resource metadata through a third-party development interface.
数据存储模块33用于实现执行脚本语言插件过程中返回的数据，同时将返回的异构媒体资源元数据整合处理为一致性数据结构，提供给其它模块使用。The data storage module 33 is used to realize the data returned during the execution of the scripting language plug-in, and at the same time integrate and process the returned heterogeneous media resource metadata into a consistent data structure for use by other modules.
图3为本发明实施例提供的互联网媒体资源元数据处理方法流程图。如图3所示，该方法包括以下步骤：FIG. 3 is a flowchart of a method for processing metadata of Internet media resources provided by an embodiment of the present invention. As shown in Figure 3, the method includes the following steps:
步骤1，互联网媒体资源元数据的处理系统启动时首先进行初始化操作，搜索当前可用插件，解析描述文件，初始化各个插件的状态；Step 1, when the Internet media resource metadata processing system starts, it first performs an initialization operation, searches for currently available plug-ins, parses description files, and initializes the status of each plug-in;
步骤2，互联网媒体资源元数据的处理系统在进行聚合解析媒体资源分类项目时，根据具体分类项目传递相应的参数给插件；插件通过解析参数获得执行指令；Step 2, the Internet media resource metadata processing system transmits corresponding parameters to the plug-in according to the specific classification items when performing aggregation and parsing of the media resource classification items; the plug-in obtains execution instructions by parsing the parameters;
步骤3，插件根据执行指令，从资源站点获取相应的媒体资源元数据，具体可以有三种方式：In step 3, the plug-in obtains the corresponding media resource metadata from the resource site according to the execution instruction. Specifically, there are three ways:
(1)插件获取互联网媒体资源商的门户网站的网页数据，通过解析获取相关媒体资源元数据；(1) The plug-in obtains the webpage data of the portal website of the Internet media resource provider, and obtains relevant media resource metadata through analysis;
(2)插件通过互联网媒体资源商的开放接口获取相关媒体资源元数据；(2) The plug-in obtains relevant media resource metadata through the open interface of the Internet media resource provider;
(3)插件通过第三方开发接口获取相关媒体资源元数据；(3) The plug-in obtains relevant media resource metadata through a third-party development interface;
步骤4，插件将获取到的媒体资源元数据返回给互联网媒体资源元数据的处理系统，互联网媒体资源元数据的处理系统将数据整合为一致性数据结构，聚合后数据可视化呈现给用户；Step 4, the plug-in returns the acquired media resource metadata to the Internet media resource metadata processing system, and the Internet media resource metadata processing system integrates the data into a consistent data structure, and the aggregated data is visualized and presented to the user;
步骤5，互联网媒体资源元数据的处理系统清理当前插件调用所占资源，为下一次调用做准备。Step 5, the Internet media resource metadata processing system cleans up the resources occupied by the current plug-in call, and prepares for the next call.
图4是互联网媒体资源元数据的处理系统工作流程示意图。如图4所示，该流程包括以下步骤：Fig. 4 is a schematic diagram of the workflow of the system for processing metadata of Internet media resources. As shown in Figure 4, the process includes the following steps:
步骤1，互联网媒体资源元数据的处理系统启动时首先检测插件是否存在更新，如存在则进行更新相应插件；Step 1, when the Internet media resource metadata processing system is started, it first detects whether there is an update to the plug-in, and if so, updates the corresponding plug-in;
具体地，通过脚本插件升级服务器获取插件版本号，与本地插件版本号进行比较。如果存在高版本插件，下载并更新高版本插件。Specifically, the script plug-in upgrade server obtains the plug-in version number, and compares it with the local plug-in version number. If there is a higher version plug-in, download and update the higher version plug-in.
步骤2，互联网媒体资源元数据的处理系统进行初始化工作，启动插件模块并读入插件，同时初始化脚本语言解释器，初始化成功，进入等待调用阶段；Step 2, the Internet media resource metadata processing system performs initialization work, starts the plug-in module and reads in the plug-in, and initializes the script language interpreter at the same time, the initialization is successful, and enters the waiting call stage;
步骤3，当用户查看项目时，调用与列表项所对应的插件并传递字符串标记作为参数；Step 3, when the user views the item, call the plug-in corresponding to the list item and pass the string tag as a parameter;
步骤4，插件通过解析参数获得执行指令，通过媒体资源商或是第三方获取并解析媒体资源元数据，将元数据返回给互联网媒体资源元数据的处理系统；Step 4, the plug-in obtains the execution instruction by parsing the parameters, obtains and parses the media resource metadata through the media resource provider or a third party, and returns the metadata to the Internet media resource metadata processing system;
步骤5，互联网媒体资源元数据的处理系统将数据提供给调用者，通过合适的形式进行呈现；Step 5, the Internet media resource metadata processing system provides the data to the caller and presents it in a suitable form;
步骤6，互联网媒体资源元数据的处理系统清理本次插件执行所占资源，等待下次调用。Step 6, the Internet media resource metadata processing system cleans up the resources occupied by the plug-in execution this time, and waits for the next call.
本发明实施例利用脚本语言无需编译的特点，实现脚本语言插件的动态加载和更新；同时实时获取媒体资源元数据，避免存在数据滞后的问题。The embodiment of the present invention utilizes the feature that the script language does not need to be compiled to realize the dynamic loading and updating of the script language plug-in; at the same time, the metadata of the media resource is obtained in real time to avoid the problem of data lag.
最后需要说明的是，以上实施例仅用以说明本发明的技术方案而非限制。尽管参照实施例对本发明进行了详细说明，本领域的普通技术人员应当理解，对本发明的技术方案进行修改或者等同替换，都不脱离本发明技术方案的精神和范围，其均应涵盖在本发明的权利要求范围当中。Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than limit it. Although the present invention has been described in detail with reference to the embodiments, those skilled in the art should understand that modifications or equivalent replacements to the technical solutions of the present invention do not depart from the spirit and scope of the technical solutions of the present invention, and all of them should be included in the scope of the present invention. within the scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410676051.6ACN104363237B (en) | 2014-11-21 | 2014-11-21 | Method and system for processing metadata of Internet media resources |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410676051.6ACN104363237B (en) | 2014-11-21 | 2014-11-21 | Method and system for processing metadata of Internet media resources |
| Publication Number | Publication Date |
|---|---|
| CN104363237A CN104363237A (en) | 2015-02-18 |
| CN104363237Btrue CN104363237B (en) | 2017-09-19 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410676051.6AExpired - Fee RelatedCN104363237B (en) | 2014-11-21 | 2014-11-21 | Method and system for processing metadata of Internet media resources |
| Country | Link |
|---|---|
| CN (1) | CN104363237B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104811776B (en)* | 2015-04-09 | 2018-02-02 | 小米科技有限责任公司 | Multi-medium play method and device |
| US9692815B2 (en)* | 2015-11-12 | 2017-06-27 | Mx Technologies, Inc. | Distributed, decentralized data aggregation |
| CN105471984A (en)* | 2015-11-23 | 2016-04-06 | 深圳创维－Rgb电子有限公司 | Network resource integration platform and method |
| CN114116044B (en)* | 2021-11-02 | 2024-12-17 | 杭州网易云音乐科技有限公司 | Multimedia resource processing method, device, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6148336A (en)* | 1998-03-13 | 2000-11-14 | Deterministic Networks, Inc. | Ordering of multiple plugin applications using extensible layered service provider with network traffic filtering |
| CN101441567A (en)* | 2008-11-18 | 2009-05-27 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for supporting multiple-language user interface in mobile terminal |
| CN101699445A (en)* | 2009-11-13 | 2010-04-28 | 曾玄杰 | Media playing management method, device and system |
| CN102141922A (en)* | 2010-01-29 | 2011-08-03 | 腾讯科技（深圳）有限公司 | Micro kernel pluggable program application system and implementation method thereof |
| CN103036871A (en)* | 2012-11-19 | 2013-04-10 | 北京奇虎科技有限公司 | Support device and method of application plug-in of browser |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6148336A (en)* | 1998-03-13 | 2000-11-14 | Deterministic Networks, Inc. | Ordering of multiple plugin applications using extensible layered service provider with network traffic filtering |
| CN101441567A (en)* | 2008-11-18 | 2009-05-27 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for supporting multiple-language user interface in mobile terminal |
| CN101699445A (en)* | 2009-11-13 | 2010-04-28 | 曾玄杰 | Media playing management method, device and system |
| CN102141922A (en)* | 2010-01-29 | 2011-08-03 | 腾讯科技（深圳）有限公司 | Micro kernel pluggable program application system and implementation method thereof |
| CN103036871A (en)* | 2012-11-19 | 2013-04-10 | 北京奇虎科技有限公司 | Support device and method of application plug-in of browser |
| Publication number | Publication date |
|---|---|
| CN104363237A (en) | 2015-02-18 |
| Publication | Publication Date | Title |
|---|---|---|
| JP6416374B2 (en) | Fast rendering of websites containing dynamic content and old content | |
| CN105183912B (en) | Abnormal log determines method and apparatus | |
| CN110858172B (en) | A method and device for generating automatic test code | |
| CN103279507B (en) | Webpage spider operational method and system | |
| US10936645B2 (en) | Method and apparatus for generating to-be-played multimedia content | |
| CA2865187A1 (en) | Method and system relating to salient content extraction for electronic content | |
| US10452730B2 (en) | Methods for analyzing web sites using web services and devices thereof | |
| US11263062B2 (en) | API mashup exploration and recommendation | |
| US9560160B1 (en) | Prioritization of the delivery of different portions of an image file | |
| CN104363237B (en) | Method and system for processing metadata of Internet media resources | |
| CN102662966A (en) | Method and system for obtaining subject-oriented dynamic page content | |
| CN113076294B (en) | Information sharing method and device | |
| CN112988583B (en) | Method and device for testing grammar compatibility of database | |
| CN102207967B (en) | Method and system for automatically providing new browser plugin | |
| CN105704177A (en) | UA identification method and device | |
| CN103294717B (en) | Web page opening method and device based on double-kernel browser | |
| CN110298000A (en) | Acquisition methods, terminal device and the medium of page parameter | |
| CN105260459B (en) | Searching method and device | |
| US20140129490A1 (en) | Image url-based junk detection | |
| CN108989074A (en) | Programme upgrade method and program upgrade apparatus | |
| CN104021170A (en) | Information acquiring method and cloud server | |
| CN104217021B (en) | Reading server, terminal device and its method for showing reading content | |
| CN111782244A (en) | Configuration file update method, device, computer equipment and storage medium | |
| US10599740B1 (en) | Program code streaming | |
| CN110134377B (en) | Data request processing method, device and equipment of power industry management information system |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20170919 Termination date:20201121 |