技术领域technical field
本发明涉及内容分发网络技术领域，特别是指一种基于CDN节点的缓存集中管理系统。The present invention relates to the technical field of content distribution network, in particular to a CDN node-based centralized cache management system.
背景技术Background technique
随着互联网业务布局的逐渐成熟，网络接入模式的逐渐丰富，使得网络规模得以高速增长，然而，基础网络建设始终跟不上网络业务需求的增长。为了使得用户能够及时、快速地访问网络中的相关内容，CDN技术应运而生。With the gradual maturity of the Internet business layout and the gradual enrichment of network access modes, the network scale has grown rapidly. However, the basic network construction has not been able to keep up with the growth of network business needs. In order to enable users to access relevant content in the network in a timely and fast manner, CDN technology has emerged as the times require.
CDN的全称是Content Distribution/Delivery Network，即内容分发网络，其原理是通过在现有的互联网中增加一层新的网络架构，将网站的内容发布到最接近用户的缓存节点，使用户可以就近取得所需的内容，减少延迟，解决Internet网络拥挤的状况。CDN是建立并覆盖在互联网Internet之上、由分布在不同区域的结点服务器群组成的虚拟网络，是在已有的Internet网络结构基础上构建的应用层“增值”网络，也是一种提供透明服务的中间层，它利用分布式缓存/复制、负载均衡、流量工程和客户端重定向等技术，专门提供各种网络内容分布和服务发送的功能，包括动态地部署网络内容到边缘，根据网络内容处理通信量，将访问请求转发给最优服务器，从而使得用户能以最快的速度，从最接近用户的地方获得所需的信息，可解决网络拥塞，提高响应速度和服务质量，特别是在流媒体和动态内容传输方面有着其它技术无可比拟的优势。The full name of CDN is Content Distribution/Delivery Network, that is, content distribution network. Its principle is to publish the content of the website to the cache node closest to the user by adding a new layer of network architecture to the existing Internet, so that users can Get the content you want, reduce latency, and resolve Internet congestion. CDN is a virtual network that is established and covered on the Internet and is composed of node server groups distributed in different regions. It is an application layer "value-added" network built on the basis of the existing Internet network structure. The middle layer of transparent services, which uses technologies such as distributed caching/replication, load balancing, traffic engineering, and client redirection, to provide various network content distribution and service delivery functions, including dynamically deploying network content to the edge, according to The network content handles the traffic and forwards the access request to the optimal server, so that the user can obtain the required information from the place closest to the user at the fastest speed, which can solve network congestion, improve response speed and service quality, especially It has incomparable advantages over other technologies in terms of streaming media and dynamic content transmission.
但是，目前存在的内容分发网络随着缓存节点的不断增加，对各个节点的性能数据和业务数据的采集能力不足，不仅使得传输的数据量巨大，造成数据展示的滞后，而且无法实现高效的缓存集中管控。同时，目前缓存节点的升级和系统配置，都需要工作人员前往各个机房进行现场操作，不仅效率低下，而且浪费人力物力。However, with the continuous increase of caching nodes, the current content distribution network has insufficient ability to collect performance data and business data of each node, which not only makes the huge amount of data transmitted, but also causes the lag of data display, and cannot realize efficient caching Centralized control. At the same time, the current upgrade of cache nodes and system configuration require staff to go to each computer room for on-site operations, which is not only inefficient, but also wastes manpower and material resources.
发明内容Contents of the invention
有鉴于此，本发明的目的在于提出一种基于CDN节点的缓存集中管理系统，能够实现缓存的高效管理。In view of this, the purpose of the present invention is to propose a centralized cache management system based on CDN nodes, which can realize efficient cache management.
基于上述目的本发明提供的一种基于CDN节点的缓存集中管理系统，包含以下功能模块中的一个或多个：Based on the above purpose, a CDN node-based centralized cache management system provided by the present invention includes one or more of the following functional modules:
网元管理模块，用于发现缓存节点、接收并处理缓存节点上包含的硬件性能信息和缓存节点信息，并把这些节点以及硬件性能信息和缓存节点信息展示在系统中；The network element management module is used to discover cache nodes, receive and process hardware performance information and cache node information contained in cache nodes, and display these nodes, hardware performance information and cache node information in the system;
拓扑管理模块，用于显示整个CDN网络节点的拓扑结构；The topology management module is used to display the topology structure of the entire CDN network nodes;
性能管理模块，与性能采集器连接，用于采集缓存节点设备的性能数据；The performance management module is connected with the performance collector for collecting the performance data of the cache node device;
故障管理模块，用于针对性能信息配置告警监控；A fault management module, configured to configure alarm monitoring for performance information;
报表管理模块，用于根据性能管理模块中采集的运行数据生成业务报表；The report management module is used to generate business reports according to the operation data collected in the performance management module;
系统管理模块，用于安全管理、密码修改和系统配置；System management module for security management, password modification and system configuration;
所述网元管理模块与所述拓扑管理模块和所述性能管理模块连接；所述性能管理模块与所述性能采集器和所述故障管理模块连接；所述网元管理模块、所述性能管理模块、所述故障管理模块、所述报表管理模块和所述系统管理模块均与数据库连接；The network element management module is connected to the topology management module and the performance management module; the performance management module is connected to the performance collector and the fault management module; the network element management module, the performance management module, the fault management module, the report management module and the system management module are all connected to the database;
所述系统采用集中-边缘的分层架构：在集中层和边缘层分别抽取一个或多个需要的功能模块，组成独立的管理系统，并部署在各个缓存节点上，进行单个缓存节点的管理和控制。The system adopts a centralized-edge layered architecture: extract one or more required functional modules at the centralized layer and the edge layer to form an independent management system, and deploy it on each cache node to manage and manage a single cache node. control.
优选的，所述网元管理模块还用于实现缓存节点的缓存策略的远程配置，以及缓存节点软件版本的远程升级。Preferably, the network element management module is also used to realize the remote configuration of the cache policy of the cache node and the remote upgrade of the software version of the cache node.
优选的，所述网元管理模块还用于定义缓存内容策略，所述缓存内容策略包括主动推送和被动拉取；所述主动推送通过缓存集中管理系统将源站的内容主动推送到指定的缓存节点中去；所述被动拉取依据用户访问热点超过设定值，则触发将源站内容被动拉取到缓存节点中。Preferably, the network element management module is also used to define a cache content policy, the cache content policy includes active push and passive pull; the active push actively pushes the content of the source station to the specified cache through the cache centralized management system node; the passive pull is triggered to passively pull the content of the source site to the cache node based on the fact that the user's access hotspot exceeds the set value.
优选的，所述拓扑管理模块还用于在网元管理模块检测到各缓存节点发生变化或信息变动时，整体拓扑结构也相应变化。Preferably, the topology management module is further configured to change the overall topology structure accordingly when the network element management module detects that each cache node changes or information changes.
进一步，所述系统还包括接口模块；Further, the system also includes an interface module;
所述接口模块包含以下一组或多组接口；The interface module includes the following one or more sets of interfaces;
第一组接口，用于连接网元管理模块和性能管理模块，分别为：The first group of interfaces are used to connect the network element management module and the performance management module, respectively:
第十一接口，用于网元新增时，为每个网元创建性能监视实例；The eleventh interface is used to create a performance monitoring instance for each network element when a new network element is added;
第十二接口，用于根据网元标识，向性能管理模块查询采集的性能指示数据；The twelfth interface is used to query the collected performance indication data from the performance management module according to the network element identifier;
第十三接口，用于网元删除时，删除性能监视实例；The thirteenth interface is used to delete the performance monitoring instance when the network element is deleted;
第十四接口，用于网元删除时，删除性能监视数据；The fourteenth interface is used to delete the performance monitoring data when the network element is deleted;
第二组接口，用于连接网元管理模块和拓扑管理模块，分别为：The second group of interfaces is used to connect the network element management module and the topology management module, respectively:
第二十一接口，用于网元新增时，通知拓扑管理模块新增拓扑元素；The twenty-first interface is used for notifying the topology management module of adding a topology element when adding a network element;
第二十二接口，用于网元删除时，通知拓扑管理模块删除拓扑元素；The twenty-second interface is used to notify the topology management module to delete the topology element when the network element is deleted;
第二十三接口，用于网元信息修改时，通知拓扑管理模块修改相应信息；The twenty-third interface is used to notify the topology management module to modify the corresponding information when the network element information is modified;
第三组接口，用于连接性能管理模块和故障管理模块，分别为：The third group of interfaces is used to connect the performance management module and the fault management module, respectively:
第三十一接口，用于产生新的告警；The thirty-first interface is used to generate a new alarm;
第三十二接口，用于消除告警；The thirty-second interface is used to eliminate the alarm;
第三十三接口，用于告警查询，查询当前对应指标是否产生告警；The thirty-third interface is used for alarm query, querying whether the current corresponding indicator generates an alarm;
第四组接口，用于连接性能管理模块和性能采集器，分别为：The fourth group of interfaces is used to connect the performance management module and the performance collector, which are:
第四十一接口，用于性能监视实例变更事件，通知性能采集器更新性能监视实例缓存数据；The forty-first interface is used for the change event of the performance monitoring instance, and notifies the performance collector to update the cached data of the performance monitoring instance;
第四十二接口，用于性能监视实例全量同步事件，通知性能采集器全量更新性能监视实例缓存数据；The forty-second interface is used for the full synchronization event of the performance monitoring instance, and notifies the performance collector to update the cache data of the performance monitoring instance in full;
第四十三接口，用于性能数据实时上报，监控器向性能管理模块上报实时数据。The forty-third interface is used for real-time reporting of performance data, and the monitor reports real-time data to the performance management module.
从上面所述可以看出，本发明提供的基于CDN节点的缓存集中管理系统通过采用分层架构的设计方式，使得能够根据不同地区的网络条件和用户的使用习惯等因素，实现集中-边缘的分域自治的管理方式。这样，不仅使得边缘一层的设备实现自我管理，而且减少了网络数据传输量，提高了数据传输效率。From the above, it can be seen that the CDN node-based centralized cache management system provided by the present invention adopts a layered architecture design method, so that it can realize centralized-edge management according to factors such as network conditions in different regions and user habits. Domain-based autonomous management. In this way, not only the devices at the edge layer can realize self-management, but also reduce the amount of network data transmission and improve the efficiency of data transmission.
附图说明Description of drawings
图1为本发明提供的基于CDN节点的缓存集中管理系统的功能模块之间的连接示意图；Fig. 1 is the schematic diagram of the connection between the functional modules of the CDN node-based cache centralized management system provided by the present invention;
图2为本发明提供的基于CDN节点的缓存集中管理系统的报表管理模块的原理图；Fig. 2 is the schematic diagram of the report management module of the cache centralized management system based on CDN node provided by the present invention;
图3为本发明提供的基于CDN节点的缓存集中管理系统与外部设备的连接示意图；Fig. 3 is the schematic diagram of the connection between the CDN node-based centralized cache management system and external equipment provided by the present invention;
图4为本发明提供的基于CDN节点的缓存集中管理系统中网元管理模块与拓扑管理模块的信息交互示意图；4 is a schematic diagram of information interaction between the network element management module and the topology management module in the CDN node-based cache centralized management system provided by the present invention;
图5为本发明提供的基于CDN节点的缓存集中管理系统的基于软件架构的原理图；Fig. 5 is a schematic diagram based on the software architecture of the CDN node-based cache centralized management system provided by the present invention;
图6为本发明提供的基于CDN节点的缓存集中管理系统的多数据库切换的原理图；Fig. 6 is the schematic diagram of multi-database switching of the cache centralized management system based on CDN node provided by the present invention;
图7为本发明提供的基于CDN节点的缓存集中管理系统的信息交互的原理图；FIG. 7 is a schematic diagram of information interaction of the CDN node-based centralized cache management system provided by the present invention;
图8为本发明提供的基于CDN节点的缓存集中管理系统在非分布式部署时的系统结构示意图；8 is a schematic diagram of the system structure of the CDN node-based centralized cache management system in non-distributed deployment provided by the present invention;
图9为本发明提供的基于CDN节点的缓存集中管理系统在分布式部署时的系统结构示意图。FIG. 9 is a schematic diagram of the system structure of the CDN node-based centralized cache management system in distributed deployment provided by the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案和优点更加清楚明白，以下结合具体实施例，并参照附图，对本发明进一步详细说明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.
需要说明的是，本发明实施例中所有使用“第一”和“第二”等相关的表述均是为了区分两个相同名称非相同的实体或者非相同的参量，可见“第一”“第二”仅为了表述的方便，不应理解为对本发明实施例的限定，后续实施例对此不再一一说明。It should be noted that all related expressions such as "first" and "second" in the embodiments of the present invention are used to distinguish two entities with the same name but different parameters or different parameters. It can be seen that "first" and "second" "two" is only for the convenience of expression, and should not be understood as a limitation on the embodiments of the present invention, and the subsequent embodiments will not describe them one by one.
参照图1所示，为本发明提供的基于CDN节点的缓存集中管理系统的功能模块之间的连接示意图。所述基于CDN节点的缓存集中管理系统包含以下功能模块中的一个或多个：Referring to FIG. 1 , it is a schematic diagram of connection between functional modules of the centralized cache management system based on CDN nodes provided by the present invention. The centralized cache management system based on CDN nodes includes one or more of the following functional modules:
网元管理模块101，用于发现缓存节点、接收并处理缓存节点上包含的硬件性能信息和缓存节点信息，并把这些节点以及硬件性能信息和缓存节点信息展示在系统中；The network element management module 101 is configured to discover cache nodes, receive and process hardware performance information and cache node information contained in cache nodes, and display these nodes, hardware performance information and cache node information in the system;
拓扑管理模块102，用于显示整个CDN网络节点的拓扑结构；A topology management module 102, configured to display the topology of the entire CDN network node;
其中，节点的拓扑结构不仅真实准确地反映了实际缓存节点之间的物理连接关系，而且通过可视化地展现在系统中，能够观察各种网络设备及资源的实际运行、使用与分布主要情况。Among them, the node topology not only truly and accurately reflects the physical connection relationship between the actual cache nodes, but also can be visualized in the system to observe the actual operation, use and distribution of various network devices and resources.
性能管理模块103，与性能采集器连接，用于采集缓存节点设备的性能数据；The performance management module 103 is connected with the performance collector for collecting the performance data of the cache node device;
其中，性能数据的主要性能指标有节点系统的连接数、缓存命中率、响应时间等参数。性能管理模块103可根据实际的使用需要，设置性能模版按最小周期，如天、月、年来汇聚性能数据，给运维人员提供真实可靠的运行数据。Among them, the main performance indicators of performance data include the number of connections of the node system, cache hit rate, response time and other parameters. The performance management module 103 can set performance templates according to actual usage needs to collect performance data in the minimum period, such as days, months, and years, to provide operation and maintenance personnel with real and reliable operation data.
故障管理模块104，用于针对性能信息配置告警监控；A fault management module 104, configured to configure alarm monitoring for performance information;
其中，当监控数据超过预先设定的监控阀值时，系统根据监控阀值上报告警信息，并显示在故障管理页面以及首页上。另外，故障管理模块104还支持以邮件和短信的方式通知给管理员，以方便管理员及时处理系统中的故障。Among them, when the monitoring data exceeds the preset monitoring threshold, the system reports alarm information according to the monitoring threshold, and displays it on the fault management page and the home page. In addition, the fault management module 104 also supports notifying the administrator by email and short message, so as to facilitate the administrator to deal with the fault in the system in time.
报表管理模块105，用于根据性能管理模块103中采集的运行数据生成业务报表；A report management module 105, configured to generate a business report according to the operating data collected in the performance management module 103;
其中，所述报表管理模块105根据性能管理模块103采集的运行数据，按天、月、年生成可视化的业务报表，包括：时段流量分布报表、地域流量分布报表、域名流量分布报表、故障分布统计、故障处理统计报表等。Wherein, the report management module 105 generates visualized business reports by day, month, and year according to the operation data collected by the performance management module 103, including: time period traffic distribution report, regional traffic distribution report, domain name traffic distribution report, fault distribution statistics , Troubleshooting Statistical Report, etc.
系统管理模块106，用于安全管理、密码修改和系统配置。当然，还可以相应设置其他常用功能。其中，安全管理包括用户基本信息管理、账号管理和角色管理。系统配置指的是对缓存集中管理系统的安全进行管理，如用户登录错误次数、失败锁定时间、登录未操作时间等参数设置。The system management module 106 is used for security management, password modification and system configuration. Of course, other commonly used functions can also be set accordingly. Among them, security management includes basic user information management, account management and role management. System configuration refers to the management of the security of the centralized cache management system, such as parameter settings such as the number of user login errors, failed lockout time, and login inactive time.
上述各个功能模块的连接方式为：所述网元管理模块101分别与拓扑管理模块102和性能管理模块103连接。所述性能管理模块103还分别与性能采集器1031和故障管理模块104连接。所述网元管理模块101、所述性能管理模块103、所述故障管理模块104、所述报表管理模块105和所述系统管理模块106均连接到数据库中。The above-mentioned functional modules are connected in the following manner: the network element management module 101 is connected to the topology management module 102 and the performance management module 103 respectively. The performance management module 103 is also connected to the performance collector 1031 and the fault management module 104 respectively. The network element management module 101 , the performance management module 103 , the fault management module 104 , the report management module 105 and the system management module 106 are all connected to a database.
所述系统采用集中-边缘的分层架构：在集中层和边缘层分别抽取一个或多个需要的功能模块，组成独立的管理系统，并部署在各个缓存节点上，进行单个缓存节点的管理和控制。具体的：在系统的集中层抽取所述网元管理模块101、性能管理模块103和所述报表管理模块105组成集中层的缓存管理主系统，在系统的边缘层抽取性能采集器1031作为独立的边缘层的缓存管理子系统。实际进行缓存集中管理时，边缘层的缓存管理子系统在边缘层的节点上采集缓存数据并且将处理后的缓存数据传送到主系统中，进行后一步的处理，例如：生成报表等等。The system adopts a centralized-edge layered architecture: extract one or more required functional modules at the centralized layer and the edge layer to form an independent management system, and deploy it on each cache node to manage and manage a single cache node. control. Specifically: the network element management module 101, the performance management module 103 and the report management module 105 are extracted at the centralized layer of the system to form the main cache management system of the centralized layer, and the performance collector 1031 is extracted at the edge layer of the system as an independent Cache management subsystem at the edge layer. When actually performing centralized cache management, the cache management subsystem at the edge layer collects cache data on the nodes at the edge layer and transmits the processed cache data to the main system for subsequent processing, such as generating reports and so on.
由上述实施例可知，由于不同地区的网络条件差异、用户习惯差异等因素，导致各个地区的节点配置和关注的指标可能出现不同，进而加大了节点的缓存集中管理的难度，而且现有的管理系统将全量获取分布在各地的网元信息后，在本地进行处理，这样导致在网络中传输的数据量较大，造成数据展示滞后。而本发明的所述基于CDN节点的缓存集中管理系统通过采用分层架构的设计原理，也即实现了集中-边缘的分层架构，不仅能够让边缘一层的设备自行管理自己的节点功能和性能；而且采用分层架构后，在边缘层将数据进行计算、处理并生成管理系统最终需要的数据后，才将处理的数据传输至集中管理系统。这样，能够大大减少了网络中数据的传输量，进一步提高了系统的传输效率。It can be seen from the above embodiments that due to factors such as differences in network conditions and user habits in different regions, the configuration of nodes and the indicators of concern in different regions may be different, which in turn increases the difficulty of centralized management of node caches, and the existing After the management system obtains all the network element information distributed in various places, it will process it locally, which will result in a large amount of data transmitted in the network, resulting in a lag in data display. The CDN node-based centralized cache management system of the present invention adopts the design principle of a layered architecture, that is, realizes a centralized-edge layered architecture, which not only allows devices at the edge layer to manage their own node functions and Performance; and after adopting a layered architecture, the edge layer calculates, processes and generates the data ultimately required by the management system before transmitting the processed data to the centralized management system. In this way, the amount of data transmission in the network can be greatly reduced, and the transmission efficiency of the system can be further improved.
参照图2所示，为本发明提供的基于CDN节点的缓存集中管理系统的报表管理模块的原理图。所述网元管理模块101、所述性能管理模块103和所述故障管理模块104将信息传送到数据库中后，所述报表管理模块105通过对数据进行抽取和统计计算等，获得相应数据的报表。用户能够实时查询统计数据和报表文件。Referring to FIG. 2 , it is a schematic diagram of the report management module of the centralized cache management system based on CDN nodes provided by the present invention. After the network element management module 101, the performance management module 103, and the fault management module 104 transmit the information to the database, the report management module 105 obtains a report of the corresponding data by extracting and statistically calculating the data, etc. . Users can query statistical data and report files in real time.
实际使用时，可以根据用户的使用需要，选择一个或者多个功能模块的组合进行使用，例如：可以只需要网元管理模块101，也可以同时包含网元管理模块101和拓扑管理模块102。这样，不仅使得系统的架构和组成更加灵活，而且可以通过抽取各个功能模块，组成单独的管理系统并部署在各个缓存节点上，进行单个缓存节点的管控。最终，提高了系统管理的效率和可靠性。In actual use, one or more functional modules can be selected for use according to user needs. For example, only the network element management module 101 may be required, or both the network element management module 101 and the topology management module 102 may be included. In this way, not only the architecture and composition of the system are more flexible, but also a separate management system can be formed by extracting various functional modules and deployed on each cache node to manage and control a single cache node. Ultimately, the efficiency and reliability of system management is improved.
进一步，所述网元管理模块101还用于实现缓存节点的缓存策略的远程配置，以及缓存节点软件版本的远程升级。所述缓存策略是指由CDN管理员指定的在缓存服务器上可以缓存哪些资源、资源的缓存有效期、资源的缓存方式。这样，系统管理员可以根据实际的使用需要相应调整系统的缓存策略，使得系统能够准确并且高效地实现缓存的集中管理。Further, the network element management module 101 is also used to implement remote configuration of caching policies of caching nodes and remote upgrade of software versions of caching nodes. The cache policy refers to which resources can be cached on the cache server, the cache validity period of the resources, and the cache mode of the resources specified by the CDN administrator. In this way, the system administrator can adjust the caching policy of the system accordingly according to the actual use needs, so that the system can accurately and efficiently realize the centralized management of the cache.
进一步，所述网元管理模块101还用于定义缓存内容策略，所述缓存内容策略包括主动推送和被动拉取；所述主动推送通过缓存集中管理系统将源站的内容主动推送到指定的缓存节点中去；所述被动拉取依据用户访问热点超过设定值，则触发将源站内容被动拉取到缓存节点中。所述源站是指需要CDN对其进行加速的网站，比如新浪、腾讯等网站。这样，通过定义缓存内容策略，使得系统能够保证所需内容准确传到缓存节点中，也即提高系统的稳定性。Further, the network element management module 101 is also used to define a cache content policy, and the cache content policy includes active push and passive pull; the active push actively pushes the content of the source station to the specified cache through the cache centralized management system node; the passive pull is triggered to passively pull the content of the source site to the cache node based on the fact that the user's access hotspot exceeds the set value. The source site refers to a website that requires CDN to accelerate it, such as websites such as Sina and Tencent. In this way, by defining the cache content policy, the system can ensure that the required content is accurately delivered to the cache nodes, that is, the stability of the system is improved.
参照图3所示，为本发明提供的基于CDN节点的缓存集中管理系统与外部设备的连接示意图。网元管理模块101是本发明的缓存集中管理系统的核心功能模块，也称为节点管理模块。CDN网络的整体架构大致可以描述为中心节点201下挂各级负载均衡(SLB，serverloading balance)202，各级负载均衡202下挂多台服务器203作为缓存节点，最终实现CDN网络的加速服务。本发明所述的基于CDN节点的缓存集中管理系统正是针对这种网络架构而产生，对中心节点201和各级缓存节点的信息进行管理和调度。具体为：所述网元管理模块101能够向中心节点201查询各级负载均衡设备202的基本信息，同时向各级负载均衡设备202查询服务器203的基本信息。这样，所述基于CDN节点的缓存集中管理系统实现了CDN网络中缓存的集中管理。Referring to FIG. 3 , it is a schematic diagram of the connection between the CDN node-based centralized cache management system and external devices provided by the present invention. The network element management module 101 is the core functional module of the centralized cache management system of the present invention, also called a node management module. The overall architecture of the CDN network can be roughly described as a central node 201 connected to various levels of load balancing (SLB, server loading balance) 202, and multiple servers 203 connected to the various levels of load balancing 202 as cache nodes, and finally realize the accelerated service of the CDN network. The CDN node-based centralized cache management system described in the present invention is produced for this kind of network architecture, and manages and schedules the information of the central node 201 and cache nodes at all levels. Specifically, the network element management module 101 can query the central node 201 for the basic information of the load balancing devices 202 at all levels, and at the same time query the load balancing devices 202 for the basic information of the servers 203 . In this way, the centralized cache management system based on CDN nodes realizes the centralized management of cache in the CDN network.
参照图4所示，所述拓扑管理模块102还用于在网元管理模块101检测到各缓存节点发生变化或信息变动时，整体拓扑结构也相应变化。具体流程为：当网元管理模块101检测到网元发生增加、删除或修改时，也即网元的信息数据发生变更，此时所述拓扑管理模块102中的的拓扑数据表和拓扑数据缓存信息也会随之发生更新。另外，拓扑数据缓存还定时与数据库同步数据以保持最新数据的一致性。若用户想了解最新的拓扑结构和信息，可以通过拓扑页面定时从拓扑数据缓存中获取最新的拓扑数据。这样，能够提高系统显示数据的实时有效性，而且使得系统具有较好的交互功能。Referring to FIG. 4 , the topology management module 102 is also configured to change the overall topology structure accordingly when the network element management module 101 detects that each cache node changes or information changes. The specific process is: when the network element management module 101 detects that a network element is added, deleted or modified, that is, the information data of the network element changes, the topology data table and topology data cache in the topology management module 102 Information will be updated accordingly. In addition, the topology data cache also regularly synchronizes data with the database to maintain the consistency of the latest data. If users want to know the latest topology structure and information, they can periodically obtain the latest topology data from the topology data cache through the topology page. In this way, the real-time validity of the data displayed by the system can be improved, and the system has better interactive functions.
在本发明一个优选的实施例中，所述系统还包括接口模块；所述接口模块包含以下一组或多组接口；In a preferred embodiment of the present invention, the system further includes an interface module; the interface module includes the following one or more sets of interfaces;
第一组接口，用于连接网元管理模块和性能管理模块，分别为：The first group of interfaces are used to connect the network element management module and the performance management module, respectively:
第十一接口，用于网元新增时，为每个网元创建性能监视实例；The eleventh interface is used to create a performance monitoring instance for each network element when a new network element is added;
第十二接口，用于根据网元标识，向性能管理模块查询采集的性能指示数据；The twelfth interface is used to query the collected performance indication data from the performance management module according to the network element identifier;
第十三接口，用于网元删除时，删除性能监视实例；The thirteenth interface is used to delete the performance monitoring instance when the network element is deleted;
第十四接口，用于网元删除时，删除性能监视数据；The fourteenth interface is used to delete the performance monitoring data when the network element is deleted;
第二组接口，用于连接网元管理模块和拓扑管理模块，分别为：The second group of interfaces is used to connect the network element management module and the topology management module, respectively:
第二十一接口，用于网元新增时，通知拓扑管理模块新增拓扑元素；The twenty-first interface is used for notifying the topology management module of adding a topology element when adding a network element;
第二十二接口，用于网元删除时，通知拓扑管理模块删除拓扑元素；The twenty-second interface is used to notify the topology management module to delete the topology element when the network element is deleted;
第二十三接口，用于网元信息修改时，通知拓扑管理模块修改相应信息；The twenty-third interface is used to notify the topology management module to modify the corresponding information when the network element information is modified;
第三组接口，用于连接性能管理模块和故障管理模块，分别为：The third group of interfaces is used to connect the performance management module and the fault management module, respectively:
第三十一接口，用于产生新的告警；The thirty-first interface is used to generate a new alarm;
第三十二接口，用于消除告警；The thirty-second interface is used to eliminate the alarm;
第三十三接口，用于告警查询，查询当前对应指标是否产生告警；The thirty-third interface is used for alarm query, querying whether the current corresponding indicator generates an alarm;
第四组接口，用于连接性能管理模块和性能采集器，分别为：The fourth group of interfaces is used to connect the performance management module and the performance collector, which are:
第四十一接口，用于性能监视实例变更事件，通知性能采集器更新性能监视实例缓存数据；The forty-first interface is used for the change event of the performance monitoring instance, and notifies the performance collector to update the cached data of the performance monitoring instance;
第四十二接口，用于性能监视实例全量同步事件，通知性能采集器全量更新性能监视实例缓存数据；The forty-second interface is used for the full synchronization event of the performance monitoring instance, and notifies the performance collector to update the cache data of the performance monitoring instance in full;
第四十三接口，用于性能数据实时上报，监控器向性能管理模块上报实时数据。The forty-third interface is used for real-time reporting of performance data, and the monitor reports real-time data to the performance management module.
实际中，所述接口模块是根据选用的功能模块相应设置的，例如：在系统中只选用了网元管理模块101、拓扑管理模块102和所述性能管理模块103，则所述接口模块只包含第一组接口和第二组接口。In practice, the interface modules are set according to the selected functional modules. For example, if only the network element management module 101, the topology management module 102 and the performance management module 103 are selected in the system, the interface modules only include The first set of interfaces and the second set of interfaces.
参照图5所示，为本发明提供的基于CDN节点的缓存集中管理系统的基于软件架构的原理图。也即从软件层面来实现本发明所述的系统。具体的，所示系统包括：用户交互层、后端服务层和应用程序编程接口层；所述应用程序编程接口层用于连接用户交互层和后端服务层。Referring to FIG. 5 , it is a schematic diagram based on software architecture of the CDN node-based cache centralized management system provided by the present invention. That is, the system described in the present invention is realized from the software level. Specifically, the system shown includes: a user interaction layer, a backend service layer, and an application programming interface layer; the application programming interface layer is used to connect the user interaction layer and the backend service layer.
其中，所述用户交互层(UI层)，用于呈现页面元素或者与用户实现交互。所述用户交互层是系统的前台，包括Java服务页面(JSP)、网络脚本语言(JS)以及Java实现的action。所述后端服务层(AS层)是系统的后台，用于后台的业务处理、数据访问、持久化。应用程序编程接口层用于通过接口连接用户交互层和后端服务层，包含界面(interface)和数据结构(data model)。Wherein, the user interaction layer (UI layer) is used to present page elements or realize interaction with users. The user interaction layer is the foreground of the system, including Java Service Page (JSP), Web Scripting Language (JS) and actions implemented by Java. The back-end service layer (AS layer) is the background of the system and is used for background business processing, data access, and persistence. The application programming interface layer is used to connect the user interaction layer and the back-end service layer through the interface, including the interface (interface) and the data structure (data model).
所述管理系统采用Strust框架或Strust2框架中的《模型-视图-控制器》模式实现web页面与Java代码的分离；采用接口隔离的设计原则，并利用Spring框架的依赖注入功能，使得用户交互层与后端服务层解耦；远程或本地通信机制通过Spring框架中的service(即，服务层)文件配置进行控制，而不依赖于Java代码的修改。The management system adopts the "model-view-controller" pattern in the Strut framework or Strust2 framework to realize the separation of web pages and Java codes; adopts the design principle of interface isolation, and utilizes the dependency injection function of the Spring framework to make the user interaction layer Decoupled from the back-end service layer; the remote or local communication mechanism is controlled through the service (ie, service layer) file configuration in the Spring framework, and does not depend on the modification of the Java code.
其中，Strust框架是一种开源框架，能够减少开发时间，Strust2是Strust的下一代产品。《模型-视图-控制器》(MVC，Model-View-Controller)是一种软件设计典范，用一种业务逻辑、数据、界面显示分离的方法组织代码，将业务逻辑聚集到一个部件里面，在改进和个性化定制界面及用户交互的同时，不需要重新编写业务逻辑。所述接口隔离原则(ISP--Interface Segregation Principle)定义为：客户端不应该依赖它不需要的接口；一个类对另一个类的依赖应该建立在最小的接口上。所述Spring框架是一个开源框架，目的是使用Spring的分层架构，分层架构允许使用者选择使用哪一个组件，同时为应用程序开发提供集成的框架。所述依赖注入(Dependency Injection)把符合依赖关系的对象通过JavaBean属性或者构造函数传递给需要的对象。所述解耦也即将系统之间的耦合关系解除。Among them, the Strut framework is an open source framework that can reduce development time, and Strut2 is the next-generation product of Strut. "Model-View-Controller" (MVC, Model-View-Controller) is a model of software design. It uses a method of separating business logic, data, and interface display to organize code and gather business logic into one component. Improve and personalize custom interfaces and user interactions without rewriting business logic. The interface segregation principle (ISP--Interface Segregation Principle) is defined as: the client should not rely on interfaces it does not need; the dependence of a class on another class should be established on the smallest interface. The Spring framework is an open source framework, the purpose of which is to use Spring's layered architecture, which allows users to choose which component to use and provides an integrated framework for application development. The dependency injection (Dependency Injection) transfers objects conforming to the dependency relationship to required objects through JavaBean properties or constructors. The decoupling also means releasing the coupling relationship between the systems.
系统为分布式部署时，用Spring框架的远程方法调用功能实现模块之间跨Java虚拟机的通信；系统为非分布式部署时，通过调用本地应用程序编程接口实现模块之间的信息交互。这样，能够极大提高系统管理的效率。When the system is deployed in a distributed manner, the remote method call function of the Spring framework is used to realize the communication between the modules across the Java virtual machine; when the system is deployed in a non-distributed manner, the information interaction between the modules is realized by calling the local application programming interface. In this way, the efficiency of system management can be greatly improved.
其中，所述分布式部署是将数据分散的存储于多台独立的机器设备上，采用可扩展的系统结构，利用多台存储服务器分担存储负荷，利用位置服务器定位存储信息，不但解决了传统集中式存储系统中单存储服务器的瓶颈问题，还提高了系统的可靠性、可用性和扩展性。所述远程方法调用(Remote Method Invocation，RMI)用Java实现的，且大大增强了Java开发分布式应用的能力。系统引入Java虚拟机(Java Virtual Machine)后，Java语言在不同平台上运行时不需要重新编译。Java语言使用Java虚拟机屏蔽了与具体平台相关的信息，使得Java语言编译程序只需生成在Java虚拟机上运行的目标代码(字节码)，就可以在多种平台上不加修改地运行。Among them, the distributed deployment is to disperse and store data on multiple independent machines and devices, adopt a scalable system structure, use multiple storage servers to share storage load, and use location servers to locate and store information, which not only solves the problem of traditional centralized It solves the bottleneck problem of a single storage server in a storage system, and improves the reliability, availability and scalability of the system. The remote method invocation (Remote Method Invocation, RMI) is realized by Java, and greatly enhances the ability of Java to develop distributed applications. After the system introduces the Java Virtual Machine (Java Virtual Machine), the Java language does not need to be recompiled when running on different platforms. The Java language uses the Java virtual machine to shield the information related to the specific platform, so that the Java language compiler only needs to generate the object code (byte code) that runs on the Java virtual machine, and it can run on various platforms without modification. .
在本发明一个较佳的实施例中，参照图5所示，所述后端服务层包括：In a preferred embodiment of the present invention, as shown in FIG. 5, the backend service layer includes:
服务层，用于实现系统主要的业务逻辑处理以及实现与应用程序编程接口层的通讯接口，供用户交互层调用；The service layer is used to realize the main business logic processing of the system and realize the communication interface with the application programming interface layer, which is called by the user interaction layer;
数据访问层，是一个数据访问接口，与数据库连接，处于业务逻辑与数据库资源中间，用于实现与业务数据表在数据库中的增、删及查询的功能；The data access layer is a data access interface, connected to the database, located between business logic and database resources, and used to realize the functions of adding, deleting and querying business data tables in the database;
持久化层，引入第三方持久化框架MyBatis，用于实现多数据库的切换。所述持久化层是将程序数据在持久状态和瞬时状态间转换的机制。通俗的讲，就是瞬时数据(比如内存中的数据，是不能永久保存的)持久化为持久数据(比如持久化至数据库中，能够长久保存)。The persistence layer introduces the third-party persistence framework MyBatis for switching between multiple databases. The persistence layer is the mechanism for transitioning program data between persistent and transient states. In layman's terms, it means that transient data (such as data in memory, which cannot be stored permanently) is persisted to persistent data (such as persisting to a database, which can be stored for a long time).
其中，所述MyBatis框架是支持普通结构化查询语言的查询、存储过程和高级映射的优秀持久层框架。且MyBatis使用简单的可扩展标记语言(XML)或注解用于配置和原始映射，将接口和Java的POJOs(Plain Old Java Objects，普通的Java对象)映射成数据库中的记录。Among them, the MyBatis framework is an excellent persistence layer framework that supports queries, stored procedures and advanced mappings of common structured query languages. And MyBatis uses simple Extensible Markup Language (XML) or annotations for configuration and original mapping, and maps interfaces and Java POJOs (Plain Old Java Objects, ordinary Java objects) into records in the database.
进一步，参照图6所示，所述多数据库切换的步骤包括：Further, as shown in FIG. 6, the step of switching between multiple databases includes:
将结构化查询语言(SQL)中的语句存储在配置文件中，实现数据访问层的代码与结构化查询语言中的语句的分离；Store the statements in the structured query language (SQL) in the configuration file to realize the separation of the code of the data access layer and the statements in the structured query language;
将结构化查询语言中的语句按照不同数据库的版本进行区分，每种数据库对应一套结构化查询语言中的语句配置文件；所述语句配置文件按照功能模块进行划分，且存储在不同的可扩展标记语言(XML)文件中；The statements in the structured query language are distinguished according to the versions of different databases, and each database corresponds to a set of statement configuration files in the structured query language; the statement configuration files are divided according to functional modules and stored in different scalable In a markup language (XML) file;
通过修改所述语句配置文件切换数据库连接(JDBC)驱动以及对应数据库的结构化查询语言文件，实现多数据库切换。Multi-database switching is realized by modifying the statement configuration file to switch the database connection (JDBC) driver and the structured query language file of the corresponding database.
参照图7所示，为本发明提供的基于CDN节点的缓存集中管理系统的信息交互的原理图。用户通过用户交互层访问系统，后端服务层与数据库连接，监控(probe)层监听缓存节点上报的数据，实现对缓存节点性能指标的采集、计算、汇聚等比较耗费系统性能的功能。当系统为分布式部署时，可以采用Spring框架的远程方法调用功能，实现模块之间跨Java虚拟机的通信；而当系统为非分布式部署时，能够通过调用本地应用程序编程接口实现模块之间的信息交互。这样，不仅能够支持多种灵活的部署方式，而且大大提高了系统处理数据的效率。Referring to FIG. 7 , it is a schematic diagram of information interaction of the CDN node-based centralized cache management system provided by the present invention. Users access the system through the user interaction layer, the back-end service layer is connected to the database, and the monitoring (probe) layer listens to the data reported by the cache nodes to realize the collection, calculation, and aggregation of cache node performance indicators, which consume system performance. When the system is deployed in a distributed manner, the remote method call function of the Spring framework can be used to realize the communication between the modules across the Java virtual machine; when the system is deployed in a non-distributed manner, the module can be realized by calling the local application programming interface exchange of information between them. In this way, it not only supports multiple flexible deployment methods, but also greatly improves the efficiency of the system in processing data.
参照图8和图9所示，当系统采用非分布式部署时，将用户交互层、应用程序编程接口层、后端服务层打包在一个war包中，且部署在一个Java虚拟机中。而当系统采用分布式部署时，将用户交互层打包成war包，后端服务层打包成jar包，应用程序编程接口层同时打包成war包和jar包中；将用户交互层和后端服务层分别部署在两个Java虚拟机中，且通过远程方法调用功能实现Java虚拟机的接口调用。Referring to Figures 8 and 9, when the system adopts non-distributed deployment, the user interaction layer, application programming interface layer, and back-end service layer are packaged in a war package and deployed in a Java virtual machine. When the system adopts distributed deployment, the user interaction layer is packaged into a war package, the back-end service layer is packaged into a jar package, and the application programming interface layer is packaged into a war package and a jar package at the same time; the user interaction layer and the back-end service Layers are deployed in two Java virtual machines respectively, and the interface calls of the Java virtual machines are implemented through the remote method call function.
所属领域的普通技术人员应当理解：以上任何实施例的讨论仅为示例性的，并非旨在暗示本公开的范围(包括权利要求)被限于这些例子；在本发明的思路下，以上实施例或者不同实施例中的技术特征之间也可以进行组合，步骤可以以任意顺序实现，并存在如上所述的本发明的不同方面的许多其它变化，为了简明它们没有在细节中提供。因此，凡在本发明的精神和原则之内，所做的任何省略、修改、等同替换、改进等，均应包含在本发明的保护范围之内。Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only, and is not intended to imply that the scope of the present disclosure (including claims) is limited to these examples; under the idea of the present invention, the above embodiments or Combinations between technical features in different embodiments are also possible, steps may be carried out in any order, and there are many other variations of the different aspects of the invention as described above, which are not presented in detail for the sake of brevity. Therefore, any omissions, modifications, equivalent replacements, improvements, etc. within the spirit and principles of the present invention shall be included within the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610057351.5ACN105577822B (en) | 2016-01-27 | 2016-01-27 | Caching centralized management system based on CDN node |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610057351.5ACN105577822B (en) | 2016-01-27 | 2016-01-27 | Caching centralized management system based on CDN node |
| Publication Number | Publication Date |
|---|---|
| CN105577822A CN105577822A (en) | 2016-05-11 |
| CN105577822Btrue CN105577822B (en) | 2018-10-12 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610057351.5AActiveCN105577822B (en) | 2016-01-27 | 2016-01-27 | Caching centralized management system based on CDN node |
| Country | Link |
|---|---|
| CN (1) | CN105577822B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI845309B (en) | 2023-05-19 | 2024-06-11 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI880691B (en)* | 2023-05-19 | 2025-04-11 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI884752B (en)* | 2023-05-19 | 2025-05-21 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI888078B (en)* | 2023-05-19 | 2025-06-21 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10582227B2 (en) | 2016-01-15 | 2020-03-03 | Vid Scale, Inc. | Scalable coding based video distribution |
| CN106656568A (en)* | 2016-11-17 | 2017-05-10 | 上海斐讯数据通信技术有限公司 | Alarm synchronization topology display method and device |
| CN110431804B (en)* | 2017-04-14 | 2021-07-09 | 华为技术有限公司 | Content deployment method and distribution controller |
| CN107391688A (en)* | 2017-07-25 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of construction method and device of the virtualization network management platform based on web |
| CN108667916B (en)* | 2018-04-24 | 2021-08-13 | 百度在线网络技术（北京）有限公司 | Data access method and system for Web application |
| CN111818142A (en)* | 2020-06-28 | 2020-10-23 | 深圳市高德信通信股份有限公司 | CDN cache clearing management system |
| CN112256351B (en)* | 2020-10-26 | 2023-11-17 | 卫宁健康科技集团股份有限公司 | Method for realizing Feign component, method and device for calling micro-service |
| CN112333029B (en)* | 2020-11-23 | 2023-05-30 | 网易（杭州）网络有限公司 | Network architecture configuration information generation method and device, storage medium and electronic equipment |
| CN112929456B (en)* | 2021-05-11 | 2022-04-01 | 杭州又拍云科技有限公司 | A centralized back-to-source and source site abnormal state protection method |
| CN113556385A (en)* | 2021-06-28 | 2021-10-26 | 深圳市高德信通信股份有限公司 | CDN supervision and management system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102437964A (en)* | 2010-11-17 | 2012-05-02 | 华为技术有限公司 | Method and device for issuing business as well as communication system |
| CN103905923A (en)* | 2014-03-20 | 2014-07-02 | 深圳市同洲电子股份有限公司 | Content caching method and device |
| CN104320410A (en)* | 2014-11-11 | 2015-01-28 | 南京优速网络科技有限公司 | All-service CDN system based on HTTP and working method thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102437964A (en)* | 2010-11-17 | 2012-05-02 | 华为技术有限公司 | Method and device for issuing business as well as communication system |
| CN103905923A (en)* | 2014-03-20 | 2014-07-02 | 深圳市同洲电子股份有限公司 | Content caching method and device |
| CN104320410A (en)* | 2014-11-11 | 2015-01-28 | 南京优速网络科技有限公司 | All-service CDN system based on HTTP and working method thereof |
| Title |
|---|
| 电力CDN业务需求分析及网络体系架构研究;王一蓉等;《电信科学》;20150520;正文第4-6页* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI845309B (en) | 2023-05-19 | 2024-06-11 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI880691B (en)* | 2023-05-19 | 2025-04-11 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI884752B (en)* | 2023-05-19 | 2025-05-21 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| TWI888078B (en)* | 2023-05-19 | 2025-06-21 | 端點智能科技有限公司 | Method for dynamically switching content delivery network |
| Publication number | Publication date |
|---|---|
| CN105577822A (en) | 2016-05-11 |
| Publication | Publication Date | Title |
|---|---|---|
| CN105577822B (en) | Caching centralized management system based on CDN node | |
| KR101336512B1 (en) | Distributed management monitoring system, monitoring method and creating method thereof | |
| CN102571420B (en) | Method and system for network element data management | |
| CN102779185B (en) | High-availability distribution type full-text index method | |
| CN101370030B (en) | Resource load stabilization method based on contents duplication | |
| Bronson et al. | {TAO}:{Facebook’s} distributed data store for the social graph | |
| CN105389315B (en) | A kind of dynamic web page update method and device | |
| EP1604486B1 (en) | Relational model for management information in network devices | |
| CN103559570B (en) | A kind of failure wave-recording main station information management system | |
| CN103036736B (en) | A kind of configuration equipment monitoring system based on data source and method | |
| CN106709003A (en) | Hadoop-based mass log data processing method | |
| CN107256178A (en) | Container management platform | |
| CN107800808A (en) | A kind of data-storage system based on Hadoop framework | |
| CN103024060A (en) | Open type cloud computing monitoring system for large scale cluster and method thereof | |
| US11157514B2 (en) | Topology-based monitoring and alerting | |
| CN104320410A (en) | All-service CDN system based on HTTP and working method thereof | |
| CN108540367B (en) | Message processing method and system | |
| CN112463755B (en) | System and method for storage and reading of heterogeneous IoT big data based on HDFS | |
| CN104933188A (en) | Data synchronism system and method of patent individuation index | |
| CN105512283A (en) | Data quality management and control method and device | |
| CN103905234A (en) | Method and system for improving resource availability in distributed system | |
| CN110706125A (en) | Water conservancy big data analysis information service system and platform service system | |
| CN115766527A (en) | Business analysis system and method based on API gateway inlet and outlet flow under trusted environment | |
| CN113535519B (en) | Monitoring alarm method | |
| CN109165022A (en) | A kind of big data cluster dispositions method, system, medium and equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |