CN111385357A - A network resource management method and related device - Google Patents
A network resource management method and related deviceDownload PDFInfo
- Publication number
- CN111385357A CN111385357ACN202010143223.9ACN202010143223ACN111385357ACN 111385357 ACN111385357 ACN 111385357ACN 202010143223 ACN202010143223 ACN 202010143223ACN 111385357 ACN111385357 ACN 111385357A
- Authority
- CN
- China
- Prior art keywords
- path
- information
- domain name
- terminal
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/14—Network analysis or design
- H04L41/142—Network analysis or design using statistical or mathematical methods
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/45—Network directories; Name-to-address mapping
- H04L61/4505—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols
- H04L61/4511—Network directories; Name-to-address mapping using standardised directories; using standardised directory access protocols using domain name system [DNS]
Landscapes
- Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Algebra (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Pure & Applied Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
Description
Translated fromChinese技术领域technical field
本申请涉及计算机技术领域，尤其涉及一种网络资源的管理方法以及相关装置。The present application relates to the field of computer technologies, and in particular, to a method for managing network resources and related devices.
背景技术Background technique
域名系统(Domain Name System，DNS)服务是一项基础网络设施。用户访问域名，首先要获取到服务IP，需向本地域名系统(Local Domain Name System，LDNS)发起请求，LDNS通过递归请求，向权威DNS请求。对权威DNS来说，通过答复LDNS请求，回应不同服务IP，可将用户请求引导至相应设备上，服务用户请求的同时，也对用户流量作了调度控制。Domain Name System (Domain Name System, DNS) service is a basic network facility. When a user accesses a domain name, first to obtain the service IP, he needs to initiate a request to the Local Domain Name System (LDNS), and the LDNS requests the authoritative DNS through a recursive request. For authoritative DNS, by replying to LDNS requests and responding to different service IPs, user requests can be directed to the corresponding devices. While serving user requests, user traffic is also scheduled and controlled.
一般，为了减轻网络设备的负载情况，可以根据本地域名系统LDNS的运营商地理属性，采取就近原则调度。即以同一片运营商地理属性的用户作为调度对象，进行网络资源的负载均衡。Generally, in order to reduce the load of network equipment, scheduling can be based on the proximity principle according to the operator's geographical attribute of the local domain name system LDNS. That is, users with the same geographical attribute of the operator are used as scheduling objects to perform load balancing of network resources.
但是，由于实际场景中流量分布不均，当单域名流量达到T级别以上，片区用户基数大，需求流量存在过大的问题。权威DNS答复此类请求时，存在最大答复资源数不满足需求的状况，造成调度精度及控制力下降，影响网络资源调度的稳定性和精确性。However, due to the uneven distribution of traffic in the actual scenario, when the traffic of a single domain name exceeds the T level, the user base in the area is large, and the demand traffic is too large. When authoritative DNS replies to such requests, there is a situation that the maximum number of reply resources does not meet the demand, resulting in a decrease in scheduling accuracy and control, and affecting the stability and accuracy of network resource scheduling.
发明内容SUMMARY OF THE INVENTION
有鉴于此，本申请提供一种网络资源的管理的方法，可以有效避免在大流量的场景中调度不稳定的问题，提高网络资源的管理过程的稳定性和精确性。In view of this, the present application provides a method for managing network resources, which can effectively avoid the problem of unstable scheduling in a large-traffic scenario, and improve the stability and accuracy of a network resource management process.
本申请第一方面提供一种网络资源的管理的方法，可以应用于服务器中包含网络资源的管理功能的系统或程序中，具体包括：获取多个终端的用户访问日志；A first aspect of the present application provides a method for managing network resources, which can be applied to a system or program that includes a management function of network resources in a server, and specifically includes: acquiring user access logs of multiple terminals;
确定所述用户访问日志对应的路径信息，所述路径信息包括本地域名系统中的前端缓存服务器、所述本地域名系统中的后端递归服务器和权威域名系统的关联关系；Determine the path information corresponding to the user access log, where the path information includes the association relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system;
根据所述路径信息的相似度进行聚类，以得到路径簇；Clustering is performed according to the similarity of the path information to obtain path clusters;
根据所述终端对于所述路径簇的隶属关系调度网络资源，所述隶属关系基于所述终端对于所述路径簇中对应路径的访问次数之间的比例确定。The network resources are scheduled according to the affiliation of the terminal to the path cluster, and the affiliation is determined based on the ratio between the access times of the terminal to the corresponding path in the path cluster.
可选的，在本申请一些可能的实现方式中，所述根据所述路径信息的相似度进行聚类，以得到路径簇，包括：Optionally, in some possible implementations of the present application, the clustering is performed according to the similarity of the path information to obtain path clusters, including:
确定所述路径信息的特征向量，所述特征向量用于指示所述前端缓存服务器与所述后端递归服务器的关联关系；determining a feature vector of the path information, where the feature vector is used to indicate an association relationship between the front-end cache server and the back-end recursive server;
根据所述特征向量的相似度进行聚类，以得到路径簇。Clustering is performed according to the similarity of the feature vectors to obtain path clusters.
可选的，在本申请一些可能的实现方式中，所述确定所述路径信息的特征向量，包括：Optionally, in some possible implementations of the present application, the determining the feature vector of the path information includes:
确定所述路径信息中指示的后端递归服务器；determining the backend recursive server indicated in the path information;
分别根据所述路径信息中指示的后端递归服务器为键遍历对应的前端缓存服务器，以生成路径特征；Traverse the corresponding front-end cache server as a key according to the back-end recursive server indicated in the path information, respectively, to generate a path feature;
根据所述路径特征之间的相似性生成所述特征向量。The feature vector is generated according to the similarity between the path features.
可选的，在本申请一些可能的实现方式中，所述确定所述路径信息的特征向量，包括：Optionally, in some possible implementations of the present application, the determining the feature vector of the path information includes:
控制所述终端向所述本地域名系统发送测试指令，以得到所述后端递归服务器和所述前端缓存服务器的对应关系；Controlling the terminal to send a test instruction to the local domain name system to obtain the correspondence between the back-end recursive server and the front-end cache server;
根据所述后端递归服务器和所述前端缓存服务器的对应关系进行聚类，以得到所述特征向量。Clustering is performed according to the correspondence between the back-end recursive server and the front-end cache server to obtain the feature vector.
可选的，在本申请一些可能的实现方式中，所述根据所述终端对于所述路径簇的隶属关系调度网络资源，包括：Optionally, in some possible implementation manners of the present application, the scheduling of network resources according to the affiliation of the terminal to the path cluster includes:
确定所述路径簇对应的路径集合；determining a path set corresponding to the path cluster;
获取所述终端分别对于所述路径集合中路径的访问信息；acquiring access information of the terminal to the paths in the path set respectively;
根据所述访问信息确定所述隶属关系；determining the affiliation based on the access information;
基于所述隶属关系进行网络资源的调度。Scheduling of network resources is performed based on the affiliation.
可选的，在本申请一些可能的实现方式中，所述基于所述隶属关系进行网络资源的调度，包括：Optionally, in some possible implementation manners of the present application, the scheduling of network resources based on the affiliation includes:
获取实时流量信息；Get real-time traffic information;
基于所述隶属关系确定资源分配信息；determining resource allocation information based on the affiliation;
根据所述资源分配信息和所述实时流量信息确定偏差信息，以指示所述权威域名系统进行网络资源调度。Deviation information is determined according to the resource allocation information and the real-time traffic information to instruct the authoritative domain name system to perform network resource scheduling.
可选的，在本申请一些可能的实现方式中，所述基于所述隶属关系确定资源分配信息，包括：Optionally, in some possible implementation manners of the present application, the determining of resource allocation information based on the affiliation includes:
确定所述权威域名系统的网络资源处理阈值；determining the network resource processing threshold of the authoritative domain name system;
根据所述隶属关系对所述网络资源处理阈值进行分配，以得到所述资源分配信息。Allocate the network resource processing threshold according to the affiliation to obtain the resource allocation information.
可选的，在本申请一些可能的实现方式中，所述确定所述权威域名系统的网络资源处理阈值，包括：Optionally, in some possible implementation manners of the present application, the determining of the network resource processing threshold of the authoritative domain name system includes:
确定所述终端对应的权重信息；determining the weight information corresponding to the terminal;
根据所述权重信息确定所述权威域名系统对于所述终端的网络资源处理阈值。The network resource processing threshold of the authoritative domain name system for the terminal is determined according to the weight information.
可选的，在本申请一些可能的实现方式中，所述确定所述用户访问日志对应的路径信息，包括：Optionally, in some possible implementation manners of the present application, the determining the path information corresponding to the user access log includes:
控制所述用户访问日志对应的终端进行递归查询，以得到所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系；Controlling the terminal corresponding to the user access log to perform a recursive query, so as to obtain the association relationship between the terminal and the front-end cache server, and the association relationship between the back-end recursive server and the authoritative domain name system;
控制边缘服务器向所述前端缓存服务器向所述权威域名系统发送探询报文，以得到所述前端缓存服务器与所述后端递归服务器的关联关系；Controlling the edge server to send an inquiry message to the authoritative domain name system to the front-end cache server, so as to obtain the association relationship between the front-end cache server and the back-end recursive server;
根据所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系和所述前端缓存服务器与所述后端递归服务器的关联关系确定所述路径信息。The path information is determined according to the association between the terminal and the front-end cache server, the association between the back-end recursive server and the authoritative domain name system, and the association between the front-end cache server and the back-end recursive server .
可选的，在本申请一些可能的实现方式中，所述获取多个终端的用户访问日志，包括：Optionally, in some possible implementations of the present application, the obtaining user access logs of multiple terminals includes:
获取终端的归属信息；Obtain the attribution information of the terminal;
根据所述归属信息信息筛选满足预设条件的所述用户访问日志，所述预设条件基于归属信息中不同维度的相似性确定。The user access logs satisfying a preset condition are screened according to the attribution information, and the preset condition is determined based on the similarity of different dimensions in the attribution information.
可选的，在本申请一些可能的实现方式中，所述获取多个终端的用户访问日志，包括：Optionally, in some possible implementations of the present application, the obtaining user access logs of multiple terminals includes:
响应于所述终端发送的调度请求确定关联终端集合；determining a set of associated terminals in response to a scheduling request sent by the terminal;
获取所述关联终端集合中多个终端的用户访问日志。Obtain user access logs of multiple terminals in the associated terminal set.
可选的，在本申请一些可能的实现方式中，所述网络资源的管理方法应用于区块链设备，所述区块链设备为区块链中的节点。Optionally, in some possible implementation manners of the present application, the method for managing network resources is applied to a blockchain device, and the blockchain device is a node in a blockchain.
本申请第二方面提供一种网络资源的管理的装置，包括：获取单元，用于获取多个终端的用户访问日志；A second aspect of the present application provides an apparatus for managing network resources, including: an acquisition unit configured to acquire user access logs of multiple terminals;
确定单元，用于确定所述用户访问日志对应的路径信息，所述路径信息包括本地域名系统中的前端缓存服务器、所述本地域名系统中的后端递归服务器和权威域名系统的关联关系；a determining unit, configured to determine path information corresponding to the user access log, where the path information includes the association relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system;
聚类单元，用于根据所述路径信息的相似度进行聚类，以得到路径簇；a clustering unit, configured to perform clustering according to the similarity of the path information to obtain path clusters;
管理单元，用于根据所述终端对于所述路径簇的隶属关系调度网络资源，所述隶属关系基于所述终端对于所述路径簇中对应路径的访问次数之间的比例确定。and a management unit, configured to schedule network resources according to the affiliation of the terminal to the path cluster, where the affiliation is determined based on the ratio of the access times of the terminal to the corresponding path in the path cluster.
可选的，在本申请一些可能的实现方式中，所述聚类单元，具体用于确定所述路径信息的特征向量，所述特征向量用于指示所述前端缓存服务器与所述后端递归服务器的关联关系；Optionally, in some possible implementations of the present application, the clustering unit is specifically configured to determine a feature vector of the path information, where the feature vector is used to indicate that the front-end cache server and the back-end recurse. The relationship of the server;
所述聚类单元，具体用于根据所述特征向量的相似度进行聚类，以得到路径簇。The clustering unit is specifically configured to perform clustering according to the similarity of the feature vectors to obtain path clusters.
可选的，在本申请一些可能的实现方式中，所述聚类单元，具体用于确定所述路径信息中指示的后端递归服务器；Optionally, in some possible implementations of the present application, the clustering unit is specifically configured to determine the back-end recursive server indicated in the path information;
所述聚类单元，具体用于分别根据所述路径信息中指示的后端递归服务器为键遍历对应的前端缓存服务器，以生成路径特征；The clustering unit is specifically configured to traverse the corresponding front-end cache servers according to the back-end recursive servers indicated in the path information as keys to generate path features;
所述聚类单元，具体用于根据所述路径特征之间的相似性生成所述特征向量。The clustering unit is specifically configured to generate the feature vector according to the similarity between the path features.
可选的，在本申请一些可能的实现方式中，所述聚类单元，具体用于控制所述终端向所述本地域名系统发送测试指令，以得到所述后端递归服务器和所述前端缓存服务器的对应关系；Optionally, in some possible implementations of the present application, the clustering unit is specifically configured to control the terminal to send a test instruction to the local domain name system, so as to obtain the back-end recursive server and the front-end cache. The corresponding relationship of the server;
所述聚类单元，具体用于根据所述后端递归服务器和所述前端缓存服务器的对应关系进行聚类，以得到所述特征向量。The clustering unit is specifically configured to perform clustering according to the correspondence between the back-end recursive server and the front-end cache server to obtain the feature vector.
可选的，在本申请一些可能的实现方式中，所述管理单元，具体用于确定所述路径簇对应的路径集合；Optionally, in some possible implementation manners of the present application, the management unit is specifically configured to determine a path set corresponding to the path cluster;
所述管理单元，具体用于获取所述终端分别对于所述路径集合中路径的访问信息；The management unit is specifically configured to acquire access information of the terminal to the paths in the path set respectively;
所述管理单元，具体用于根据所述访问信息确定所述隶属关系；the management unit, specifically configured to determine the affiliation according to the access information;
所述管理单元，具体用于基于所述隶属关系进行网络资源的调度。The management unit is specifically configured to schedule network resources based on the affiliation.
可选的，在本申请一些可能的实现方式中，所述管理单元，具体用于获取实时流量信息；Optionally, in some possible implementations of the present application, the management unit is specifically configured to acquire real-time traffic information;
所述管理单元，具体用于基于所述隶属关系确定资源分配信息；the management unit, specifically configured to determine resource allocation information based on the affiliation;
所述管理单元，具体用于根据所述资源分配信息和所述实时流量信息确定偏差信息，以指示所述权威域名系统进行网络资源调度。The management unit is specifically configured to determine deviation information according to the resource allocation information and the real-time traffic information, so as to instruct the authoritative domain name system to perform network resource scheduling.
可选的，在本申请一些可能的实现方式中，所述管理单元，具体用于确定所述权威域名系统的网络资源处理阈值；Optionally, in some possible implementation manners of the present application, the management unit is specifically configured to determine the network resource processing threshold of the authoritative domain name system;
所述管理单元，具体用于根据所述隶属关系对所述网络资源处理阈值进行分配，以得到所述资源分配信息。The management unit is specifically configured to allocate the network resource processing threshold according to the affiliation to obtain the resource allocation information.
可选的，在本申请一些可能的实现方式中，所述管理单元，具体用于确定所述终端对应的权重信息；Optionally, in some possible implementation manners of the present application, the management unit is specifically configured to determine the weight information corresponding to the terminal;
所述管理单元，具体用于根据所述权重信息确定所述权威域名系统对于所述终端的网络资源处理阈值。The management unit is specifically configured to determine the network resource processing threshold of the terminal by the authoritative domain name system according to the weight information.
可选的，在本申请一些可能的实现方式中，所述确定单元，具体用于控制所述用户访问日志对应的终端进行递归查询，以得到所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系；Optionally, in some possible implementations of the present application, the determining unit is specifically configured to control the terminal corresponding to the user access log to perform a recursive query, so as to obtain the association relationship between the terminal and the front-end cache server, the association relationship between the back-end recursive server and the authoritative domain name system;
所述确定单元，具体用于控制边缘服务器向所述前端缓存服务器向所述权威域名系统发送探询报文，以得到所述前端缓存服务器与所述后端递归服务器的关联关系；The determining unit is specifically configured to control the edge server to send an inquiry message to the authoritative domain name system to the front-end cache server, so as to obtain the association relationship between the front-end cache server and the back-end recursive server;
所述确定单元，具体用于根据所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系和所述前端缓存服务器与所述后端递归服务器的关联关系确定所述路径信息。The determining unit is specifically configured to determine the relationship between the terminal and the front-end cache server, the relationship between the back-end recursive server and the authoritative domain name system, and the relationship between the front-end cache server and the back-end recursive server. The associated relationship determines the path information.
可选的，在本申请一些可能的实现方式中，所述获取单元，具体用于获取终端的归属信息；Optionally, in some possible implementation manners of the present application, the obtaining unit is specifically configured to obtain the attribution information of the terminal;
所述获取单元，具体用于根据所述归属信息信息筛选满足预设条件的所述用户访问日志，所述预设条件基于归属信息中不同维度的相似性确定。The acquiring unit is specifically configured to filter the user access logs that satisfy a preset condition according to the attribution information, and the preset condition is determined based on the similarity of different dimensions in the attribution information.
可选的，在本申请一些可能的实现方式中，所述获取单元，具体用于响应于所述终端发送的调度请求确定关联终端集合；Optionally, in some possible implementation manners of the present application, the acquiring unit is specifically configured to determine a set of associated terminals in response to a scheduling request sent by the terminal;
所述获取单元，具体用于获取所述关联终端集合中多个终端的用户访问日志。The acquiring unit is specifically configured to acquire user access logs of multiple terminals in the associated terminal set.
本申请第三方面提供一种计算机设备，包括：存储器、处理器以及总线系统；所述存储器用于存储程序代码；所述处理器用于根据所述程序代码中的指令执行上述第一方面或第一方面任一项所述的网络资源的管理的方法。A third aspect of the present application provides a computer device, including: a memory, a processor, and a bus system; the memory is used for storing program codes; the processor is used for executing the above-mentioned first aspect or the first aspect according to instructions in the program codes The method for managing network resources according to any one of the one aspect.
本申请第四方面提供一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述第一方面或第一方面任一项所述的网络资源的管理的方法。A fourth aspect of the present application provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer causes the computer to execute the first aspect or any one of the first aspects. A method for the management of network resources.
从以上技术方案可以看出，本申请实施例具有以下优点：As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:
通过获取多个终端的用户访问日志；然后确定用户访问日志对应的路径信息，其中路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；进而根据路径信息的相似度进行聚类，以得到路径簇；并根据终端对于路径簇的隶属关系调度网络资源。从而实现了基于用户需求进行网络资源调度的过程，解决了域名流量过大造成设备流量承载过高的问题，提高了负载均衡能力以及稳定性；且基于用户需求进行调度粒度更细，使得在调度时可以做到充分使用容量而不跑超容量，提高了网络资源调度的精确度。By obtaining user access logs of multiple terminals; then determining the path information corresponding to the user access logs, wherein the path information includes the association relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system; Then, clustering is performed according to the similarity of the path information to obtain the path cluster; and network resources are scheduled according to the affiliation of the terminal to the path cluster. In this way, the process of network resource scheduling based on user needs is realized, the problem of excessive domain name traffic caused by excessive traffic load on devices is solved, and the load balancing capability and stability are improved; At the same time, the capacity can be fully used without overcapacity, which improves the accuracy of network resource scheduling.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only It is an embodiment of the present application. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without any creative effort.
图1为网络资源的管理系统运行的网络架构图；Fig. 1 is a network architecture diagram of the operation of the management system of network resources;
图2为本申请实施例提供的一种网络资源的管理的系统架构图；FIG. 2 is a system architecture diagram of a network resource management provided by an embodiment of the present application;
图3为本申请实施例提供的一种网络资源的管理的方法的流程图；3 is a flowchart of a method for managing network resources provided by an embodiment of the present application;
图4为本申请实施例提供的一种网络资源管理方法的场景示意图；FIG. 4 is a schematic diagram of a scenario of a network resource management method provided by an embodiment of the present application;
图5为本申请实施例提供的另一种网络资源的管理的方法的流程图；5 is a flowchart of another method for managing network resources provided by an embodiment of the present application;
图6为本申请实施例提供的另一种网络资源管理方法的场景示意图；FIG. 6 is a schematic diagram of a scenario of another network resource management method provided by an embodiment of the present application;
图7为本申请实施例提供的一种网络资源管理装置的结构示意图；FIG. 7 is a schematic structural diagram of a network resource management apparatus provided by an embodiment of the present application;
图8为本申请实施例提供的一种服务器的结构示意图；FIG. 8 is a schematic structural diagram of a server according to an embodiment of the present application;
图9A为本申请实施例提供的一种数据共享系统；FIG. 9A provides a data sharing system according to an embodiment of the present application;
图9B为本申请实施例提供的一种区块链的组成；FIG. 9B is the composition of a blockchain provided by this embodiment of the application;
图9C为本申请实施例提供的一种区块链节点的输入信息示意图。FIG. 9C is a schematic diagram of input information of a blockchain node according to an embodiment of the present application.
具体实施方式Detailed ways
本申请实施例提供了一种网络资源的管理的方法以及相关装置，可以应用于终端设备中包含网络资源的管理功能的系统或程序中，通过获取多个终端的用户访问日志；然后确定用户访问日志对应的路径信息，其中路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；进而根据路径信息的相似度进行聚类，以得到路径簇；并根据终端对于路径簇的隶属关系调度网络资源。从而实现了基于用户需求进行网络资源调度的过程，解决了域名流量过大造成设备流量承载过高的问题，提高了负载均衡能力以及稳定性；且基于用户需求进行调度粒度更细，使得在调度时可以做到充分使用容量而不跑超容量，提高了网络资源调度的精确度。The embodiments of the present application provide a network resource management method and related apparatus, which can be applied to a system or program including a network resource management function in a terminal device, by acquiring user access logs of multiple terminals; The path information corresponding to the log, wherein the path information includes the relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system; and then clustering according to the similarity of the path information to obtain the path cluster; and schedule network resources according to the affiliation of the terminal to the path cluster. In this way, the process of network resource scheduling based on user needs is realized, the problem of excessive domain name traffic caused by excessive traffic load on devices is solved, and the load balancing capability and stability are improved; At the same time, the capacity can be fully used without overcapacity, which improves the accuracy of network resource scheduling.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例例如能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“对应于”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the application described herein can, for example, be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "corresponding to", and any variations thereof, are intended to cover non-exclusive inclusion, eg, a process, method, system, product or device comprising a series of steps or units not necessarily limited to those expressly listed but may include other steps or units not expressly listed or inherent to these processes, methods, products or devices.
首先，对本申请实施例中可能出现的一些名词进行解释。First, some terms that may appear in the embodiments of the present application are explained.
域名系统(Domain Name System，DNS)：一种分布式网络目录服务，主要用于域名与IP地址的相互转换，以及控制因特网的电子邮件的发送。Domain Name System (DNS): A distributed network directory service, which is mainly used for mutual conversion between domain names and IP addresses, and for controlling the sending of e-mails on the Internet.
权威域名系统：用于域名解析，对特定域名持有最终管理权限。Authoritative Domain Name System: It is used for domain name resolution and holds the ultimate management authority for specific domain names.
边缘服务器(Outer Center，OC)：分散在用户侧的节点，为用户提供就近内容服务。Edge server (Outer Center, OC): Nodes scattered on the user side to provide users with nearby content services.
最大传输单元(Maximum Transmission Unit，MTU)：通信双方对报文大小的约定限制。Maximum transmission unit (Maximum Transmission Unit, MTU): The agreed limit on the size of the message by both parties in the communication.
本地域名系统(Local Domain Name System，LDNS)：运营商设置在用户本地的服务节点。Local Domain Name System (Local Domain Name System, LDNS): a service node set by the operator locally at the user.
前端缓存服务器(Front_ldns)：LDNS服务节点的缓存DNS，面向用户。Front-end cache server (Front_ldns): The cache DNS of the LDNS service node, facing users.
后端递归服务器(Back_ldns)：LDNS服务节点的递归DNS，面向权威DNS。Back-end recursive server (Back_ldns): The recursive DNS of the LDNS service node, facing the authoritative DNS.
应理解，本申请提供的网络资源的管理方法可以应用于终端设备中包含网络资源的管理功能的系统或程序中，例如调度系统平台，具体的，网络资源的管理系统可以运行于如图1所示的网络架构中，如图1所示，是网络资源的管理系统运行的网络架构图，如图可知，网络资源的管理系统可以提供与多个信息源的网络资源的管理，终端通过网络建立与服务器的连接，向服务器发送需求的网络资源，服务器进行调度管理后进行网络资源的分配；可以理解的是，图1中示出了多种终端设备，在实际场景中可以有更多或更少种类的终端设备参与到网络资源的管理的过程中，具体数量和种类因实际场景而定，此处不做限定，另外，图1中示出了一个服务器，但在实际场景中，也可以有多个服务器的参与，特别是在多内容应用交互的场景中，具体服务器数量因实际场景而定。It should be understood that the network resource management method provided by the present application can be applied to a system or program that includes a network resource management function in a terminal device, such as a scheduling system platform. Specifically, the network resource management system can run as shown in FIG. 1 . In the shown network architecture, as shown in Figure 1, it is the network architecture diagram of the operation of the network resource management system. As can be seen from the figure, the network resource management system can provide management of network resources with multiple information sources, and the terminal is established through the network. The connection with the server sends the required network resources to the server, and the server allocates network resources after scheduling and management; A small number of terminal devices participate in the process of managing network resources, and the specific number and type are determined by the actual scenario, which is not limited here. In addition, Figure 1 shows a server, but in the actual scenario, it can also be There are multiple servers involved, especially in the scenario of multi-content application interaction, the specific number of servers depends on the actual scenario.
可以理解的是，上述网络资源的管理系统可以运行于个人移动终端，例如：作为DNS调度系统这样的应用，也可以运行于服务器，还可以作为运行于第三方设备以提供网络资源的管理，以得到信息源的网络资源的管理处理结果；具体的网络资源的管理系统可以是以一种程序的形式在上述设备中运行，也可以作为上述设备中的系统部件进行运行，还可以作为云端服务程序的一种，具体运作模式因实际场景而定，此处不做限定。It can be understood that the above-mentioned network resource management system can run on personal mobile terminals, for example, as an application such as a DNS scheduling system, can also run on a server, and can also run on a third-party device to provide management of network resources to Obtain the management and processing results of the network resources of the information source; the specific network resource management system can be run in the above-mentioned device in the form of a program, or can be run as a system component in the above-mentioned device, and can also be used as a cloud service program. The specific operation mode depends on the actual scene, which is not limited here.
随着4G普及，移动互联网发展，直播视频等大流量业务发展，市场上的带宽翻倍增长。单域名流量已然跨过T级别，5G阶段大流量增长趋势仍将沿续。大宗流量使得调度规模增大，粒度见长，给设备负载，带宽成本控制带来挑战。With the popularization of 4G, the development of mobile Internet, and the development of high-traffic services such as live video, the bandwidth in the market has doubled. The traffic of a single domain name has already crossed the T level, and the growth trend of large traffic in the 5G stage will continue. Bulk traffic increases scheduling scale and granularity, which brings challenges to device load and bandwidth cost control.
IPV6的发展进一步加剧了调度粒度方面的影响。DNS报文大小控制在最小物理链路MTU(500～520),则权威DNS答复LDNS请求的报文内容IP个数被限定在有限个数内，一般设为15个IP，此时DNS交互过程效率最高。IPV6网络中，IPV6地址4倍于IPV4，进一步限制了报文所容纳IP个数。如何解决IP存在承担流量需求过载的风险成为难题。The development of IPV6 further exacerbates the impact of scheduling granularity. The size of the DNS packet is controlled at the minimum physical link MTU (500~520), and the number of IPs in the packet content of the authoritative DNS reply to the LDNS request is limited to a limited number, generally set to 15 IPs. At this time, the DNS interaction process Most efficient. In the IPV6 network, the IPV6 address is 4 times that of the IPV4, which further limits the number of IP addresses that can be accommodated in the packet. How to solve the risk of IP being overloaded with traffic demand has become a difficult problem.
域名系统服务是一项基础网络设施。用户访问域名，首先要获取到服务IP，需向LDNS发起请求，LDNS通过递归请求，向权威DNS请求。对权威DNS来说，通过答复LDNS请求，回应不同服务IP，可将用户请求引导至相应设备上，服务用户请求的同时，也对用户流量作了调度控制。Domain Name System service is an infrastructure network facility. To access a domain name, a user must first obtain a service IP and initiate a request to the LDNS, which requests the authoritative DNS through recursive requests. For authoritative DNS, by replying to LDNS requests and responding to different service IPs, user requests can be directed to the corresponding devices. While serving user requests, user traffic is also scheduled and controlled.
一般，为了减轻网络设备的负载情况，可以根据本地域名系统LDNS的运营商地理属性，采取就近原则调度。即以同一片运营商地理属性的用户作为调度对象，进行网络资源的负载均衡。Generally, in order to reduce the load of network equipment, scheduling can be based on the proximity principle according to the operator's geographical attribute of the local domain name system LDNS. That is, users with the same geographical attribute of the operator are used as scheduling objects to perform load balancing of network resources.
但是，由于实际场景中流量分布不均，当单域名流量达到T级别以上，片区用户基数大，需求流量存在过大的问题。权威DNS答复此类请求时，存在最大答复资源数不满足需求的状况，造成调度精度及控制力下降，影响网络资源调度的稳定性和精确性。However, due to the uneven distribution of traffic in the actual scenario, when the traffic of a single domain name exceeds the T level, the user base in the area is large, and the demand traffic is too large. When authoritative DNS replies to such requests, there is a situation that the maximum number of reply resources does not meet the demand, resulting in a decrease in scheduling accuracy and control, and affecting the stability and accuracy of network resource scheduling.
为了解决上述问题，本申请提出了一种网络资源的管理的方法，该方法应用于图2所示的网络资源的管理的系统框架中，如图2所示，为本申请实施例提供的一种网络资源的管理的系统架构图，即对于每个LDNS基于路径簇(ldns_id)再次进行划分使得在进行网络资源管理时，权威DNS可以根据ldns_id的流量需求进行资源的调度，从而精确的与边缘服务器进行交互实现调度过程。In order to solve the above problems, the present application proposes a method for managing network resources, which is applied to the system framework for managing network resources shown in FIG. 2 . As shown in FIG. 2 , a method provided by an embodiment of the present application This is a system architecture diagram for the management of network resources, that is, for each LDNS is divided again based on the path cluster (ldns_id), so that during network resource management, the authoritative DNS can schedule resources according to the traffic demand of ldns_id, so as to accurately communicate with the edge The server interacts to implement the scheduling process.
可以理解的是，将LDNS划分为ldns_id的依据是终端(User_ip)、前端缓存服务器(Front_ldns)、后端递归服务器(Back_ldns)之间的关联关系；其中Front_ldns面向用户，Back_ldns面向权威DNS，即权威DNS的来访对象是Back_ldns。通过将具有相似用户群体的Back_ldns划分为同一个ldns_id，ldns_id所服务的用户群里是较为稳定的，则其背后的流量也较为稳定。而用户群体数量较为庞大，由于与用户直接关联的是Front_ldns，则用户对应的Front_ldns也较为固定，则推出具有相似Front_ldns的Back_ldns划分为同一个ldns_id，从而实现LDNS基于用户需求的划分过程。It can be understood that the basis for dividing LDNS into ldns_id is the relationship between the terminal (User_ip), the front-end cache server (Front_ldns), and the back-end recursive server (Back_ldns). The visiting object of DNS is Back_ldns. By dividing Back_ldns with similar user groups into the same ldns_id, the user group served by ldns_id is relatively stable, and the traffic behind it is also relatively stable. The number of user groups is relatively large. Since Front_ldns is directly related to users, the corresponding Front_ldns of users are also relatively fixed, so Back_ldns with similar Front_ldns are divided into the same ldns_id, so as to realize the division process of LDNS based on user needs.
可以理解的是，图2中示出了两个终端、两个LDNS以及两个OC，但在实际场景中，可以有更多或更少的数量，具体数量因实际场景而定。It can be understood that two terminals, two LDNSs and two OCs are shown in FIG. 2 , but in an actual scenario, there may be more or less numbers, and the specific number depends on the actual scenario.
可以理解的是，本申请所提供的方法可以为一种程序的写入，以作为硬件系统中的一种处理逻辑，也可以作为一种网络资源管理装置，采用集成或外接的方式实现上述处理逻辑。作为一种实现方式，该网络资源管理装置通过获取多个终端的用户访问日志；然后确定用户访问日志对应的路径信息，其中路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；进而根据路径信息的相似度进行聚类，以得到路径簇；并根据终端对于路径簇的隶属关系调度网络资源。从而实现了基于用户需求进行网络资源调度的过程，解决了域名流量过大造成设备流量承载过高的问题，提高了负载均衡能力以及稳定性；且基于用户需求进行调度粒度更细，使得在调度时可以做到充分使用容量而不跑超容量，提高了网络资源调度的精确度。It can be understood that the method provided by this application can be written as a program as a processing logic in a hardware system, or can be used as a network resource management device to implement the above processing in an integrated or external manner. logic. As an implementation manner, the network resource management device obtains user access logs of multiple terminals; then determines path information corresponding to the user access logs, wherein the path information includes the front-end cache server in the local domain name system and the back-end cache server in the local domain name system. The association relationship between the terminal recursive server and the authoritative domain name system; further clustering is performed according to the similarity of the path information to obtain the path cluster; and the network resources are scheduled according to the affiliation of the terminal to the path cluster. In this way, the process of network resource scheduling based on user needs is realized, the problem of excessive domain name traffic caused by excessive traffic load on devices is solved, and the load balancing capability and stability are improved; At the same time, the capacity can be fully used without overcapacity, which improves the accuracy of network resource scheduling.
结合上述流程架构，下面将对本申请中网络资源的管理的方法进行介绍，请参阅图3，图3为本申请实施例提供的一种网络资源的管理的方法的流程图，该网络资源的管理的方法可以应用于图2所示架构中的权威DNS，本申请实施例至少包括以下步骤：With reference to the above process architecture, the method for managing network resources in the present application will be introduced below. Please refer to FIG. 3 . FIG. 3 is a flowchart of a method for managing network resources provided by an embodiment of the present application. The method can be applied to the authoritative DNS in the architecture shown in FIG. 2, and the embodiment of the present application includes at least the following steps:
301、权威DNS获取多个终端的用户访问日志。301. The authoritative DNS obtains user access logs of multiple terminals.
本实施例中，终端即为与用户交互的设备，可以是手机、便携式电脑等；用户可以通过终端进行需求的网络服务，从而产生对应的用户访问日志；其中，用户访问日志可以是根据当前多个终端的数据流提取而得的，也可以是历史数据整合而成。In this embodiment, the terminal is the device that interacts with the user, which can be a mobile phone, a portable computer, etc.; the user can perform required network services through the terminal, thereby generating a corresponding user access log; wherein, the user access log can be based on the current It is obtained by extracting the data stream of each terminal, or it can be integrated with historical data.
可选的，由于在域名管理中，不同的运营商对应着不同的数据，故可以获取终端的归属信息，然后根据归属信息信息筛选满足预设条件的用户访问日志，例如：筛选用户访问日志中指示与用户处于同一省份同一运营商的用户访问日志；从而提高了数据的针对性，便于网络资源的管理。Optionally, since different operators correspond to different data in the domain name management, the attribution information of the terminal can be obtained, and then the user access logs that meet the preset conditions can be filtered according to the attribution information, for example: filtering the user access logs Indicates the user access log of the same operator in the same province as the user; thus improving the pertinence of the data and facilitating the management of network resources.
在一种可能的场景中，多个终端的网络数据可能存在一定的关联，为保证调度对象的完整性，可以响应于终端发送的调度请求确定关联终端集合，然后获取关联终端集合中多个终端的用户访问日志，从而提高了调度对象的准确性。In a possible scenario, the network data of multiple terminals may be related to a certain extent. In order to ensure the integrity of the scheduling object, a set of associated terminals can be determined in response to a scheduling request sent by the terminal, and then multiple terminals in the set of associated terminals can be obtained. user access logs, thereby improving the accuracy of scheduling objects.
302、权威DNS确定用户访问日志对应的路径信息。302. The authoritative DNS determines path information corresponding to the user access log.
本实施例中，路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；下面结合附图对该关联关系进行说明，如图4所示，为本申请实施例提供的一种网络资源管理方法的场景示意图，图中示出了LDNS节点为参照，其分为前端缓存服务器Front_ldns、后端缓存服务器Back_ldns，其中Front_ldns面向用户，Back_ldns面向权威DNS，即权威DNS的来访对象是Back_ldns。本实施例中，将LDNS划分为ldns_id的依据是User_ip、Front_ldns、Back_ldns之间的关联关系。In this embodiment, the path information includes the association relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system; the association relationship is described below with reference to the accompanying drawings, as shown in FIG. 4 . , a schematic diagram of a scenario of a network resource management method provided by an embodiment of the present application, the figure shows an LDNS node as a reference, which is divided into a front-end cache server Front_ldns and a back-end cache server Back_ldns, wherein Front_ldns is oriented to users, and Back_ldns is oriented to authority DNS, the visiting object of authoritative DNS is Back_ldns. In this embodiment, the basis for dividing the LDNS into ldns_id is the association relationship among User_ip, Front_ldns, and Back_ldns.
具体的，通过将具有相似用户群体的Back_ldns划分为同一个ldns_id，ldns_id所服务的用户群里是较为稳定的，则其背后的流量也较为稳定。而用户群体数量较为庞大，由于与用户直接关联的是Front_ldns，则用户对应的Front_ldns也较为固定，则推出具有相似Front_ldns的Back_ldns划分为同一个ldns_id，从而实现LDNS基于用户需求的划分过程，例如：图4中Back_ldns 1、Back_ldns 2、Back_ldns 3面向的用户相似，则划分为同一ldns_id。Specifically, by dividing Back_ldns with similar user groups into the same ldns_id, the user groups served by the ldns_id are relatively stable, and the traffic behind them is also relatively stable. The number of user groups is relatively large. Since Front_ldns is directly related to users, the corresponding Front_ldns of users are also relatively fixed, so Back_ldns with similar Front_ldns are introduced to be divided into the same ldns_id, so as to realize the division process of LDNS based on user needs, for example: In Figure 4,
可选的，路径信息可以是权威DNS内存储的历史信息，也可以是进行实时探测获取的，具体的，可以控制用户访问日志对应的终端进行递归查询，以得到终端与前端缓存服务器的关联关系、后端递归服务器与权威域名系统的关联关系；对应的，控制边缘服务器向前端缓存服务器向权威域名系统发送探询报文，以得到前端缓存服务器与后端递归服务器的关联关系；进而根据终端与前端缓存服务器的关联关系、后端递归服务器与权威域名系统的关联关系和前端缓存服务器与后端递归服务器的关联关系确定路径信息。Optionally, the path information may be historical information stored in the authoritative DNS, or may be acquired by real-time detection. Specifically, the terminal corresponding to the user access log can be controlled to perform recursive query to obtain the association relationship between the terminal and the front-end cache server. , the relationship between the back-end recursive server and the authoritative domain name system; correspondingly, the edge server is controlled to send an inquiry message to the front-end cache server to the authoritative domain name system, so as to obtain the relationship between the front-end cache server and the back-end recursive server; The relationship between the front-end cache server, the relationship between the back-end recursive server and the authoritative domain name system, and the relationship between the front-end cache server and the back-end recursive server determine the path information.
可以理解的是，控制终端进行递归查询的过程可以是权威DNS发起的，也可以是权威DNS中的网络资源管理插件发起的，还可以是终端应用响应于用户的操作发起的，具体方式因实际场景而定。It can be understood that the process of controlling the terminal to perform a recursive query can be initiated by the authoritative DNS, or by the network resource management plug-in in the authoritative DNS, or by the terminal application in response to the user's operation. The specific method depends on the actual situation. Depends on the scene.
303、权威DNS根据路径信息的相似度进行聚类，以得到路径簇。303. The authoritative DNS performs clustering according to the similarity of the path information to obtain a path cluster.
本实施例中，路径簇(ldns_id)即为具有相似路径特征的多条路径的集合，其中，路径特征即为路径中涉及的设备之间的关联关系，例如Front_ldns、Back_ldns以及终端。在一种可能的场景中，LDNS中包含Front_ldns1和Front_ldns 2，以及Back_ldns1。终端可以通过访问Front_ldns1，然后访问Back_ldns1，即可进行与权威DNS的数据交互，该过程为路径1(ldnsip1)；终端还可以通过访问Front_ldns2，然后访问Back_ldns1，即可进行与权威DNS的数据交互，该过程为路径2(ldnsip2)；由于ldnsip1和ldnsip2指示的终端都通过Back_ldns1访问权威DNS，则可以将ldnsip1和ldnsip2归为同一类路径，即ldnsip1和ldnsip2的集合为一个路径簇。In this embodiment, the path cluster (ldns_id) is a set of multiple paths with similar path features, wherein the path feature is the association relationship between devices involved in the path, such as Front_ldns, Back_ldns, and terminals. In one possible scenario, LDNS contains Front_ldns1 and
具体的，路径信息的相似度可以是基于路径信息的特征向量进行的，下面结合图4，对特征向量的形成进行说明，首先以Back_ldns为键，Front_ldns为值，产生如下特征向量：Specifically, the similarity of the path information can be performed based on the feature vector of the path information. The following describes the formation of the feature vector with reference to Figure 4. First, with Back_ldns as the key and Front_ldns as the value, the following feature vector is generated:
Back_ldns1(Front_ldns1,Front_ldns 2,Front_ldns3,Front_ldns4)Back_ldns1 (Front_ldns1,
Back_ldns2(Front_ldns1,Front_ldns2)Back_ldns2(Front_ldns1,Front_ldns2)
Back_ldns3(Front_ldns5,Front_ldns6)Back_ldns3(Front_ldns5,Front_ldns6)
然后，三者进行两两比较，相似个数为值；其中Back_ldns1和Back_ldns1比较，值为4，Back_ldns1和Back_ldns2比较，值为2，以此类推，最终产生特征向量：Then, the three are compared in pairs, and the number of similarities is the value; the value of Back_ldns1 and Back_ldns1 is compared, and the value is 4, and the value of Back_ldns1 and Back_ldns2 is compared, and the value is 2, and so on, and finally the feature vector is generated:
ldnsip1(4,2,0)ldnsip1(4,2,0)
ldnsip2(2,2,0)ldnsip2(2,2,0)
ldnsip3(0,0,2)ldnsip3(0,0,2)
进一步的，根据特征向量相似度，进行聚类，则可聚为以下两个路径簇ldns_id0和ldns_id1：Further, according to the similarity of feature vectors, clustering can be clustered into the following two path clusters ldns_id0 and ldns_id1:
ldns_id0：ldnsip1，ldnsip2ldns_id0: ldnsip1, ldnsip2
ldns_id1：ldnsip3ldns_id1: ldnsip3
可以理解的是，特征向量即指示了Front_ldns和Back_ldns的对应关系，故还可以通过控制终端向本地域名系统发送测试指令，例如www.encode(User_ip，Front_ldns).test.com，以得到后端递归服务器和前端缓存服务器的对应关系；然后根据后端递归服务器和前端缓存服务器的对应关系进行聚类，以得到特征向量。由于测试得到的数据会将(User_ip,Front_ldns,Back_ldns)进行强关联，使得路径信息的拓扑关系关联更直接，进而使得数据更清晰。It can be understood that the feature vector indicates the corresponding relationship between Front_ldns and Back_ldns, so you can also send a test command to the local domain name system through the control terminal, such as www.encode(User_ip, Front_ldns).test.com, to get the backend recursion The corresponding relationship between the server and the front-end cache server; and then clustering is performed according to the corresponding relationship between the back-end recursive server and the front-end cache server to obtain the feature vector. Since the data obtained from the test will strongly correlate (User_ip, Front_ldns, Back_ldns), the topological relationship of the path information is more directly associated, thereby making the data clearer.
304、权威DNS根据终端对于路径簇的隶属关系调度网络资源。304. The authoritative DNS schedules network resources according to the affiliation of the terminal to the path cluster.
本实施例中，隶属关系基于终端对于路径簇中对应路径的访问次数之间的比例确定。这是由于流量需求是根据用户和ldns_id的隶属关系，并结合实时线上流量统计产生。In this embodiment, the affiliation is determined based on the ratio between the access times of the terminal to the corresponding path in the path cluster. This is because the traffic demand is generated based on the affiliation between the user and ldns_id, combined with real-time online traffic statistics.
可以理解的是，一个用户可能对应多个Front_ldns，则该用户可同时隶属多个ldns_id，通过统计用户访问ldns_id的概率，即可计算出用户和ldns_id的隶属关系，具体的，首先确定路径簇对应的路径集合；然后获取终端分别对于路径集合中路径的访问信息；并根据访问信息确定隶属关系；进而基于隶属关系进行网络资源的调度。It can be understood that a user may correspond to multiple Front_ldns, and the user can belong to multiple ldns_id at the same time. By counting the probability of users accessing ldns_id, the affiliation between the user and ldns_id can be calculated. Specifically, first determine the corresponding path cluster. Then obtain the access information of the terminal to the paths in the path set respectively; and determine the affiliation according to the access information; and then schedule network resources based on the affiliation.
例如：一个用户7次访问ldnsip1，2次访问ldnsip2，1次访问ldnsip3，则用户和ldns_id的隶属度关系为ldns_id0:9，ldns_id1:1，即ldns_id0与ldns_id1的网络资源分配比为9:1；若有10G的流量需求，则其中9G来自ldns_id0，1G来自ldns_id1，进而调度边缘服务器进行相应的流量分配。For example, if a user visits ldnsip1 7 times,
在实际场景中，还可以基于事实的流量分配进行流量调整，即首先获取实时流量信息；然后基于隶属关系确定资源分配信息；进而根据资源分配信息和实时流量信息确定偏差信息，即调整比例，从而指示权威域名系统进行网络资源调度。In actual scenarios, traffic adjustment can also be performed based on the actual traffic allocation, that is, first obtain real-time traffic information; then determine resource allocation information based on membership relationship; and then determine deviation information according to resource allocation information and real-time traffic information, that is, adjust the ratio, thereby Instructs the authoritative DNS for network resource scheduling.
可选的，由于权威DNS可能出现网络资源处理能力有限的情况，此时，可以基于权威DNS的网络资源处理阈值，进行基于隶属关系的分配过程，从而得到资源分配信息。Optionally, since the authoritative DNS may have limited network resource processing capability, at this time, an allocation process based on affiliation may be performed based on the network resource processing threshold of the authoritative DNS, thereby obtaining resource allocation information.
在一种可能的场景中，相关人员还可以对流量分配进行限流，例如在流量控制的场景中，首先确定终端对应的权重信息；然后根据权重信息确定权威域名系统对于终端的网络资源处理阈值，从而提高了网络资源管理的灵活性。In a possible scenario, the relevant personnel can also limit the flow of traffic allocation. For example, in the scenario of traffic control, first determine the weight information corresponding to the terminal; then determine the network resource processing threshold of the authoritative domain name system for the terminal according to the weight information , thereby improving the flexibility of network resource management.
结合上述实施例可知，通过获取多个终端的用户访问日志；然后确定用户访问日志对应的路径信息，其中路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；进而根据路径信息的相似度进行聚类，以得到路径簇；并根据终端对于路径簇的隶属关系调度网络资源。从而实现了基于用户需求进行网络资源调度的过程，解决了域名流量过大造成设备流量承载过高的问题，提高了负载均衡能力以及稳定性；且基于用户需求进行调度粒度更细，使得在调度时可以做到充分使用容量而不跑超容量，提高了网络资源调度的精确度。Combining the above embodiments, it can be known that by obtaining the user access logs of multiple terminals; then determine the path information corresponding to the user access logs, wherein the path information includes the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system and the authoritative The association relationship of the domain name system; further, clustering is performed according to the similarity of the path information to obtain the path cluster; and network resources are scheduled according to the affiliation of the terminal to the path cluster. In this way, the process of network resource scheduling based on user needs is realized, the problem of excessive domain name traffic caused by excessive traffic load on devices is solved, and the load balancing capability and stability are improved; At the same time, the capacity can be fully used without overcapacity, which improves the accuracy of network resource scheduling.
上述实施例介绍了网络资源的管理的过程，其中，介绍了路径信息可以是实时获取的，下面对该场景进行说明；请参阅图5，图5为本申请实施例提供的另一种网络资源的管理的方法的流程图，本申请实施例至少包括以下步骤：The above embodiment introduces the process of network resource management, wherein it is introduced that the path information can be acquired in real time, and the scenario is described below; please refer to FIG. 5 , which is another kind of network provided by this embodiment of the application. A flowchart of a method for resource management, the embodiment of the present application includes at least the following steps:
501、终端发起调度。501. The terminal initiates scheduling.
本实施例中，终端可以响应于权威DNS发送的调度指令进行调度的过程；也可以响应于终端应用的发起，具体的可以是用户手动触发的，也可以是客户端应用自动发起的。In this embodiment, the terminal may perform the scheduling process in response to the scheduling instruction sent by the authoritative DNS; it may also respond to the initiation of the terminal application, which may be manually triggered by the user or automatically initiated by the client application.
502、终端向本地域名系统发送迭代请求。502. The terminal sends an iteration request to the local domain name system.
503、本地域名系统进行递归查询。即发起统一资源定位符(Uniform ResourceLocator，URL)携带User_ip的HTTP请求。503. The local domain name system performs a recursive query. That is, an HTTP request in which a uniform resource locator (Uniform ResourceLocator, URL) carries User_ip is initiated.
504、本地域名系统向权威域名系统发送查询请求。其中，查询请求用于指示LDNS通过递归查询访问权威DNS。504. The local domain name system sends a query request to the authoritative domain name system. The query request is used to instruct the LDNS to access the authoritative DNS through recursive query.
505、权威域名系统确定访问信息。其中，权威DNS根据URL解析出User_ip，结合来访的Back_ldns，生成User_ip和Back_ldns的关联信息，即访问信息。505. The authoritative domain name system determines the access information. The authoritative DNS resolves the User_ip according to the URL, and combines the visiting Back_ldns to generate the associated information between the User_ip and the Back_ldns, that is, the access information.
506、边缘服务器和权威域名系统之间发起路径测试。例如边缘OC下发dig@Front_ldns www.encode(Front_ldns).test.com命令，使报文定向经Front_ldns节点，通过其相应的Back_ldns，然后到达权威DNS；从而得到Front_ldns和Back_ldns的关联关系。506. A path test is initiated between the edge server and the authoritative domain name system. For example, the edge OC issues the dig@Front_ldns www.encode(Front_ldns).test.com command, so that the packets are directed through the Front_ldns node, pass through its corresponding Back_ldns, and then reach the authoritative DNS; thus, the association between Front_ldns and Back_ldns is obtained.
507、权威域名系统确定特征向量。权威DNS获取到Front_ldns和Back_ldns的关联关系后，以Back_ldns为键，Front_ldns为值，产生特征向量。507. The authoritative domain name system determines the feature vector. After the authoritative DNS obtains the relationship between Front_ldns and Back_ldns, it uses Back_ldns as the key and Front_ldns as the value to generate a feature vector.
508、权威域名系统确定调度信息。即权威DNS根据实时用户访问日志，及上述User_ip和Back_ldns的关联信息,Front_ldns和Back_ldns的关联关系，计算路径簇的组成,进而求出ldns_id之间比例。508. The authoritative domain name system determines the scheduling information. That is, authoritative DNS calculates the composition of path clusters according to the real-time user access log, the association information between User_ip and Back_ldns, and the association between Front_ldns and Back_ldns, and then calculates the ratio between ldns_id.
509、权威域名系统和边缘服务器之间发起网络资源调度。509. Initiate network resource scheduling between the authoritative domain name system and the edge server.
本实施例中，根据上述ldns_id之间比例进行流量分配；另外还可以根据线上偏差反馈信息，实时校正ldns_id比例。In this embodiment, the traffic distribution is performed according to the ratio between the above-mentioned ldns_id; in addition, the ratio of ldns_id may be corrected in real time according to the online deviation feedback information.
下面结合一种具体的场景，对网络资源的调度过程进行说明，如图6所示，是本申请实施例提供的另一种网络资源管理的场景示意图。图中示出了通过上述步骤501-508可以得到路径簇信息、用户信息和用户访问日志。The scheduling process of network resources is described below with reference to a specific scenario, as shown in FIG. 6 , which is a schematic diagram of another network resource management scenario provided by an embodiment of the present application. The figure shows that the path cluster information, user information and user access log can be obtained through the above steps 501-508.
其中，路径簇信息中指示了路径簇1(ldns_id 60048)包含的LDNS的IP为60.174.56.5；路径簇2(ldns_id 60049)包含的LDNS的IP为120.10.32.7，120.10.32.8，120.10.32.11；Wherein, the path cluster information indicates that the IP of the LDNS included in the path cluster 1 (ldns_id 60048) is 60.174.56.5; the IP of the LDNS included in the path cluster 2 (ldns_id 60049) is 120.10.32.7, 120.10.32.8, 120.10.32.11;
而用户信息可以通过客户端发送请求指令http://encode(userip).learn.com，得到用户的IP地址为32.1.23.3，其对应的后端递归服务器(back_dns)的地址为60.174.56.5。For user information, the client can send the request command http://encode(userip).learn.com, and the user's IP address is 32.1.23.3, and the address of the corresponding back-end recursive server (back_dns) is 60.174.56.5.
另外，通过用户访问日志可以得到用户的IP地址为32.1.23.3，访问域名(domain)为dldir1.qq.com，大小为1024B；其实时需求为dldir1.qq.com需求2.8G。将上述信息进行离线计算，结合用户的访问情况得到同省同运营商路径簇之间的比例参数为0:0.25；60048:0.38；60049:0.37；从而得到调度信息并分发给OC进行网络资源的调度；在调度的同时，OC还会反馈当前实时的分配情况，并进行偏差计算，以使得权威DNS调整网络资源分配的比例。In addition, through the user access log, it can be obtained that the user's IP address is 32.1.23.3, the access domain name (domain) is dldir1.qq.com, and the size is 1024B; the real-time demand is 2.8G for dldir1.qq.com. The above information is calculated offline, combined with the user's access situation, the ratio parameters between the path clusters of the same province and the same operator are obtained as 0:0.25; 60048:0.38; 60049:0.37; thus the scheduling information is obtained and distributed to the OC for network resource scheduling ; While scheduling, the OC will also feed back the current real-time allocation situation, and perform deviation calculation, so that the authoritative DNS can adjust the proportion of network resource allocation.
结合上述实施例可见，由于调度粒度的缩小，解决了域名流量过大造成设备流量承载过高的问题，提高负载均衡能力。且由于调度精度提高，使得在调度时可以做到充分使用容量而不跑超容量，节省成本。Combining the above embodiments, it can be seen that due to the reduction of the scheduling granularity, the problem of excessively high traffic load on the device caused by the excessive domain name traffic is solved, and the load balancing capability is improved. And because the scheduling accuracy is improved, the capacity can be fully used during scheduling without running over the capacity, saving costs.
为了更好的实施本申请实施例的上述方案，下面还提供用于实施上述方案的相关装置。请参阅图7，图7为本申请实施例提供的一种网络资源管理装置的结构示意图，网络资源管理装置700包括：In order to better implement the above solutions of the embodiments of the present application, related devices for implementing the above solutions are also provided below. Please refer to FIG. 7. FIG. 7 is a schematic structural diagram of a network resource management apparatus according to an embodiment of the present application. The network
获取单元701，用于获取多个终端的用户访问日志；an obtaining
确定单元702，用于确定所述用户访问日志对应的路径信息，所述路径信息包括本地域名系统中的前端缓存服务器、所述本地域名系统中的后端递归服务器和权威域名系统的关联关系；A determining
聚类单元703，用于根据所述路径信息的相似度进行聚类，以得到路径簇；
管理单元704，用于根据所述终端对于所述路径簇的隶属关系调度网络资源，所述隶属关系基于所述终端对于所述路径簇中对应路径的访问次数之间的比例确定。The
可选的，在本申请一些可能的实现方式中，所述聚类单元703，具体用于确定所述路径信息的特征向量，所述特征向量用于指示所述前端缓存服务器与所述后端递归服务器的关联关系；Optionally, in some possible implementations of the present application, the
所述聚类单元703，具体用于根据所述特征向量的相似度进行聚类，以得到路径簇。The
可选的，在本申请一些可能的实现方式中，所述聚类单元703，具体用于确定所述路径信息中指示的后端递归服务器；Optionally, in some possible implementations of the present application, the
所述聚类单元703，具体用于分别根据所述路径信息中指示的后端递归服务器为键遍历对应的前端缓存服务器，以生成路径特征；The
所述聚类单元703，具体用于根据所述路径特征之间的相似性生成所述特征向量。The
可选的，在本申请一些可能的实现方式中，所述聚类单元703，具体用于控制所述终端向所述本地域名系统发送测试指令，以得到所述后端递归服务器和所述前端缓存服务器的对应关系；Optionally, in some possible implementations of the present application, the
所述聚类单元703，具体用于根据所述后端递归服务器和所述前端缓存服务器的对应关系进行聚类，以得到所述特征向量。The
可选的，在本申请一些可能的实现方式中，所述管理单元704，具体用于确定所述路径簇对应的路径集合；Optionally, in some possible implementation manners of the present application, the
所述管理单元704，具体用于获取所述终端分别对于所述路径集合中路径的访问信息；The
所述管理单元704，具体用于根据所述访问信息确定所述隶属关系；The
所述管理单元704，具体用于基于所述隶属关系进行网络资源的调度。The
可选的，在本申请一些可能的实现方式中，所述管理单元704，具体用于获取实时流量信息；Optionally, in some possible implementation manners of the present application, the
所述管理单元704，具体用于基于所述隶属关系确定资源分配信息；The
所述管理单元704，具体用于根据所述资源分配信息和所述实时流量信息确定偏差信息，以指示所述权威域名系统进行网络资源调度。The
可选的，在本申请一些可能的实现方式中，所述管理单元704，具体用于确定所述权威域名系统的网络资源处理阈值；Optionally, in some possible implementation manners of the present application, the
所述管理单元704，具体用于根据所述隶属关系对所述网络资源处理阈值进行分配，以得到所述资源分配信息。The
可选的，在本申请一些可能的实现方式中，所述管理单元704，具体用于确定所述终端对应的权重信息；Optionally, in some possible implementation manners of the present application, the
所述管理单元704，具体用于根据所述权重信息确定所述权威域名系统对于所述终端的网络资源处理阈值。The
可选的，在本申请一些可能的实现方式中，所述确定单元702，具体用于控制所述用户访问日志对应的终端进行递归查询，以得到所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系；Optionally, in some possible implementations of the present application, the determining
所述确定单元702，具体用于控制边缘服务器向所述前端缓存服务器向所述权威域名系统发送探询报文，以得到所述前端缓存服务器与所述后端递归服务器的关联关系；The determining
所述确定单元702，具体用于根据所述终端与所述前端缓存服务器的关联关系、所述后端递归服务器与所述权威域名系统的关联关系和所述前端缓存服务器与所述后端递归服务器的关联关系确定所述路径信息。The determining
可选的，在本申请一些可能的实现方式中，所述获取单元701，具体用于获取终端的归属信息；Optionally, in some possible implementation manners of the present application, the obtaining
所述获取单元701，具体用于根据所述归属信息信息筛选满足预设条件的所述用户访问日志，所述预设条件基于归属信息中不同维度的相似性确定。The obtaining
可选的，在本申请一些可能的实现方式中，所述获取单元701，具体用于响应于所述终端发送的调度请求确定关联终端集合；Optionally, in some possible implementation manners of the present application, the obtaining
所述获取单元701，具体用于获取所述关联终端集合中多个终端的用户访问日志。The acquiring
通过获取多个终端的用户访问日志；然后确定用户访问日志对应的路径信息，其中路径信息包括本地域名系统中的前端缓存服务器、本地域名系统中的后端递归服务器和权威域名系统的关联关系；进而根据路径信息的相似度进行聚类，以得到路径簇；并根据终端对于路径簇的隶属关系调度网络资源。从而实现了基于用户需求进行网络资源调度的过程，解决了域名流量过大造成设备流量承载过高的问题，提高了负载均衡能力以及稳定性；且基于用户需求进行调度粒度更细，使得在调度时可以做到充分使用容量而不跑超容量，提高了网络资源调度的精确度。By obtaining user access logs of multiple terminals; then determining the path information corresponding to the user access logs, wherein the path information includes the association relationship between the front-end cache server in the local domain name system, the back-end recursive server in the local domain name system, and the authoritative domain name system; Then, clustering is performed according to the similarity of the path information to obtain the path cluster; and network resources are scheduled according to the affiliation of the terminal to the path cluster. In this way, the process of network resource scheduling based on user needs is realized, the problem of excessive domain name traffic caused by excessive traffic load on devices is solved, and the load balancing capability and stability are improved; At the same time, the capacity can be fully used without overcapacity, which improves the accuracy of network resource scheduling.
本申请实施例还提供了一种服务器，请参阅图8，图8是本申请实施例提供的一种服务器的结构示意图，该服务器800可因配置或性能不同而产生比较大的差异，可以包括一个或一个以上中央处理器(central processing units，CPU)822(例如，一个或一个以上处理器)和存储器832，一个或一个以上存储应用程序842或数据844的存储介质830(例如一个或一个以上海量存储设备)。其中，存储器832和存储介质830可以是短暂存储或持久存储。存储在存储介质830的程序可以包括一个或一个以上模块(图示没标出)，每个模块可以包括对服务器中的一系列指令操作。更进一步地，中央处理器822可以设置为与存储介质830通信，在服务器800上执行存储介质830中的一系列指令操作。An embodiment of the present application also provides a server. Please refer to FIG. 8 . FIG. 8 is a schematic structural diagram of a server provided by an embodiment of the present application. The
服务器800还可以包括一个或一个以上电源826，一个或一个以上有线或无线网络接口850，一个或一个以上输入输出接口858，和/或，一个或一个以上操作系统841，例如Windows ServerTM，Mac OS XTM，UnixTM,LinuxTM，FreeBSDTM等等。
上述实施例中由图像渲染装置所执行的步骤可以基于该图8所示的计算机设备结构。The steps performed by the image rendering apparatus in the above embodiments may be based on the computer device structure shown in FIG. 8 .
本申请实施例中还提供一种计算机可读存储介质，该计算机可读存储介质中存储有网络资源管理指令，当其在计算机上运行时，使得计算机执行如前述图2至图6所示实施例描述的方法中网络资源管理装置所执行的步骤。Embodiments of the present application further provide a computer-readable storage medium, where network resource management instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium runs on a computer, the computer executes the implementation as shown in FIG. 2 to FIG. 6 above. Steps performed by the network resource management apparatus in the method described in the example.
本申请实施例中还提供一种包括网络资源管理指令的计算机程序产品，当其在计算机上运行时，使得计算机执行如前述图2至图6所示实施例描述的方法中网络资源管理装置所执行的步骤。Embodiments of the present application also provide a computer program product including a network resource management instruction, which, when running on a computer, causes the computer to execute the method described in the method described in the foregoing embodiments shown in FIG. 2 to FIG. 6 by the network resource management apparatus. steps to perform.
本申请实施例还提供了一种网络资源管理系统，所述网络资源管理系统可以包含图7所描述实施例中的网络资源管理装置，或者图8所描述的服务器。An embodiment of the present application further provides a network resource management system, where the network resource management system may include the network resource management apparatus in the embodiment described in FIG. 7 , or the server described in FIG. 8 .
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的系统，装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.
在本申请所提供的几个实施例中，应该理解到，所揭露的系统，装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，网络资源管理装置，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read-onlymemory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a network resource management device, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, removable hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program codes.
在一种可能的场景中，本申请中的网络资源管理的方法应用于区块链设备中，即权威DNS、LDNS或终端为区块链设备，且该区块链设备为区块链中的节点，下面结合附图进行说明；参见图9A所示的数据共享系统，数据共享系统900是指用于进行节点与节点之间数据共享的系统，该数据共享系统中可以包括多个节点901，多个节点901可以是指数据共享系统中各个客户端。每个节点901在进行正常工作可以接收到输入信息，并基于接收到的输入信息维护该数据共享系统内的共享数据。为了保证数据共享系统内的信息互通，数据共享系统中的每个节点之间可以存在信息连接，节点之间可以通过上述信息连接进行信息传输。例如，当数据共享系统中的任意节点接收到输入信息时，数据共享系统中的其他节点便根据共识算法获取该输入信息，将该输入信息作为共享数据中的数据进行存储，使得数据共享系统中全部节点上存储的数据均一致。In a possible scenario, the method for network resource management in this application is applied to a blockchain device, that is, the authoritative DNS, LDNS or terminal is a blockchain device, and the blockchain device is a blockchain device in the blockchain. Nodes are described below in conjunction with the accompanying drawings; referring to the data sharing system shown in FIG. 9A, the data sharing system 900 refers to a system for sharing data between nodes, and the data sharing system may include a plurality of
对于数据共享系统中的每个节点，均具有与其对应的节点标识，而且数据共享系统中的每个节点均可以存储有数据共享系统中其他节点的节点标识，以便后续根据其他节点的节点标识，将生成的区块广播至数据共享系统中的其他节点。每个节点中可维护一个如下表所示的节点标识列表，将节点名称和节点标识对应存储至该节点标识列表中。其中，节点标识可为IP(Internet Protocol，网络之间互联的协议)地址以及其他任一种能够用于标识该节点的信息，表1中仅以IP地址为例进行说明。For each node in the data sharing system, there is a corresponding node identifier, and each node in the data sharing system can store the node identifiers of other nodes in the data sharing system, so that according to the node identifiers of other nodes, Broadcast the generated blocks to other nodes in the data sharing system. Each node can maintain a node ID list as shown in the following table, and store the node name and node ID in the node ID list correspondingly. The node identifier may be an IP (Internet Protocol, protocol for interconnection between networks) address and any other information that can be used to identify the node. Table 1 only takes the IP address as an example for description.
表1节点名称与节点标识的对应关系Table 1 Correspondence between node names and node identifiers
数据共享系统中的每个节点均存储一条相同的区块链。区块链由多个区块组成，参见图9B，区块链由多个区块组成，创始块中包括区块头和区块主体，区块头中存储有输入信息特征值、版本号、时间戳和难度值，区块主体中存储有输入信息；创始块的下一区块以创始块为父区块，下一区块中同样包括区块头和区块主体，区块头中存储有当前区块的输入信息特征值、父区块的区块头特征值、版本号、时间戳和难度值，并以此类推，使得区块链中每个区块中存储的区块数据均与父区块中存储的区块数据存在关联，保证了区块中输入信息的安全性。Every node in the data sharing system stores an identical blockchain. The blockchain consists of multiple blocks, see Figure 9B, the blockchain consists of multiple blocks, the founding block includes a block header and a block body, and the block header stores the input information feature value, version number, timestamp and difficulty value, the input information is stored in the block body; the next block of the genesis block takes the genesis block as the parent block, the next block also includes the block header and the block body, and the block header stores the current block The characteristic value of input information, the characteristic value of the block header of the parent block, the version number, the timestamp and the difficulty value, and so on, so that the block data stored in each block in the blockchain is the same as that in the parent block. The stored block data is associated, which ensures the security of the input information in the block.
在生成区块链中的各个区块时，参见图9C，区块链所在的节点在接收到输入信息时，对输入信息进行校验，完成校验后，将输入信息存储至内存池中，并更新其用于记录输入信息的哈希树；之后，将更新时间戳更新为接收到输入信息的时间，并尝试不同的随机数，多次进行特征值计算，使得计算得到的特征值可以满足下述公式：When generating each block in the blockchain, referring to Figure 9C, when the node where the blockchain is located receives the input information, it verifies the input information, and after the verification is completed, the input information is stored in the memory pool, And update its hash tree used to record the input information; after that, update the update timestamp to the time when the input information was received, and try different random numbers, and perform the eigenvalue calculation multiple times, so that the calculated eigenvalue can satisfy the The following formula:
SH4256(SHA256(version+prev_hash+merkle_root+ntime+nbits+x))＜TARGETSH4256(SHA256(version+prev_hash+merkle_root+ntime+nbits+x))＜TARGET
其中，SHA256为计算特征值所用的特征值算法；version(版本号)为区块链中相关区块协议的版本信息；prev_hash为当前区块的父区块的区块头特征值；merkle_root为输入信息的特征值；ntime为更新时间戳的更新时间；nbits为当前难度，在一段时间内为定值，并在超出固定时间段后再次进行确定；x为随机数；TARGET为特征值阈值，该特征值阈值可以根据nbits确定得到。Among them, SHA256 is the eigenvalue algorithm used to calculate the eigenvalue; version (version number) is the version information of the relevant block protocol in the blockchain; prev_hash is the block header eigenvalue of the parent block of the current block; merkle_root is the input information The characteristic value of ; ntime is the update time of the update timestamp; nbits is the current difficulty, which is a fixed value within a period of time, and is determined again after a fixed period of time; x is a random number; TARGET is the characteristic value threshold, the characteristic value of The value threshold can be determined according to nbits.
这样，当计算得到满足上述公式的随机数时，便可将信息对应存储，生成区块头和区块主体，得到当前区块。随后，区块链所在节点根据数据共享系统中其他节点的节点标识，将新生成的区块分别发送给其所在的数据共享系统中的其他节点，由其他节点对新生成的区块进行校验，并在完成校验后将新生成的区块添加至其存储的区块链中。In this way, when the random number satisfying the above formula is obtained by calculation, the information can be stored correspondingly, the block header and the block body can be generated, and the current block can be obtained. Subsequently, the node where the blockchain is located sends the newly generated block to other nodes in the data sharing system where it is located according to the node identifiers of other nodes in the data sharing system, and the newly generated block is verified by other nodes. , and add the newly generated block to its stored blockchain after verification is complete.
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the present application.
Claims (15)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143223.9ACN111385357B (en) | 2020-03-04 | 2020-03-04 | A network resource management method, device, computer equipment and storage medium |
| CN202011278376.0ACN112261153B (en) | 2020-03-04 | 2020-03-04 | Network resource management method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010143223.9ACN111385357B (en) | 2020-03-04 | 2020-03-04 | A network resource management method, device, computer equipment and storage medium |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011278376.0ADivisionCN112261153B (en) | 2020-03-04 | 2020-03-04 | Network resource management method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111385357Atrue CN111385357A (en) | 2020-07-07 |
| CN111385357B CN111385357B (en) | 2021-04-27 |
Family
ID=71218598
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011278376.0AActiveCN112261153B (en) | 2020-03-04 | 2020-03-04 | Network resource management method and related device |
| CN202010143223.9AActiveCN111385357B (en) | 2020-03-04 | 2020-03-04 | A network resource management method, device, computer equipment and storage medium |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011278376.0AActiveCN112261153B (en) | 2020-03-04 | 2020-03-04 | Network resource management method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN112261153B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113079226A (en)* | 2021-06-04 | 2021-07-06 | 北京达佳互联信息技术有限公司 | Domain name allocation method, device, server and storage medium |
| CN113342612A (en)* | 2021-06-25 | 2021-09-03 | 长江存储科技有限责任公司 | Abnormal access behavior detection method, device, equipment and readable storage medium |
| CN113660699A (en)* | 2021-06-30 | 2021-11-16 | 齐喝彩(常熟)信息科技有限公司 | A kind of intelligent cluster networking method, device and electronic equipment |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115277573B (en)* | 2022-08-09 | 2024-09-13 | 康键信息技术（深圳）有限公司 | Load balancing processing method and device for issuing application task |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102123100A (en)* | 2008-02-05 | 2011-07-13 | 华为技术有限公司 | Method and device for maintaining routing information |
| CN103037442A (en)* | 2011-09-29 | 2013-04-10 | 中国移动通信集团江苏有限公司 | Method and system for achieving flow separation scheduling |
| CN105357335A (en)* | 2015-11-25 | 2016-02-24 | 中国互联网络信息中心 | DNS authority log information mining processing method |
| CN108494891A (en)* | 2018-02-28 | 2018-09-04 | 网宿科技股份有限公司 | A kind of domain name analytic method, server and system |
| US10142386B2 (en)* | 2014-10-29 | 2018-11-27 | DLVR, Inc. | Determining manifest file data used in adaptive streaming video delivery |
| CN110612708A (en)* | 2017-05-09 | 2019-12-24 | 思科技术公司 | Routing network traffic based on performance |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754640B (en)* | 2013-12-26 | 2019-01-08 | 中国移动通信集团公司 | A kind of network resource scheduling method and network resource management server |
| US9426171B1 (en)* | 2014-09-29 | 2016-08-23 | Amazon Technologies, Inc. | Detecting network attacks based on network records |
| CN105376344B (en)* | 2015-11-26 | 2019-01-04 | 中国互联网络信息中心 | A kind of analytic method and system of recurrence name server relevant to source address |
| CN105574539B (en)* | 2015-12-11 | 2018-09-21 | 中国联合网络通信集团有限公司 | A kind of DNS log analysis methods and device |
| CN107071089B (en)* | 2017-05-18 | 2020-09-15 | 腾讯科技（深圳）有限公司 | Scheduling control method, device and system |
| CN110213227B (en)* | 2019-04-24 | 2020-12-22 | 华为技术有限公司 | A kind of network data flow detection method and device |
- 2020
- 2020-03-04CNCN202011278376.0Apatent/CN112261153B/enactiveActive
- 2020-03-04CNCN202010143223.9Apatent/CN111385357B/enactiveActive
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102123100A (en)* | 2008-02-05 | 2011-07-13 | 华为技术有限公司 | Method and device for maintaining routing information |
| CN103037442A (en)* | 2011-09-29 | 2013-04-10 | 中国移动通信集团江苏有限公司 | Method and system for achieving flow separation scheduling |
| US10142386B2 (en)* | 2014-10-29 | 2018-11-27 | DLVR, Inc. | Determining manifest file data used in adaptive streaming video delivery |
| CN105357335A (en)* | 2015-11-25 | 2016-02-24 | 中国互联网络信息中心 | DNS authority log information mining processing method |
| CN110612708A (en)* | 2017-05-09 | 2019-12-24 | 思科技术公司 | Routing network traffic based on performance |
| CN108494891A (en)* | 2018-02-28 | 2018-09-04 | 网宿科技股份有限公司 | A kind of domain name analytic method, server and system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113079226A (en)* | 2021-06-04 | 2021-07-06 | 北京达佳互联信息技术有限公司 | Domain name allocation method, device, server and storage medium |
| CN113079226B (en)* | 2021-06-04 | 2021-10-15 | 北京达佳互联信息技术有限公司 | Domain name allocation method, device, server and storage medium |
| CN113342612A (en)* | 2021-06-25 | 2021-09-03 | 长江存储科技有限责任公司 | Abnormal access behavior detection method, device, equipment and readable storage medium |
| CN113660699A (en)* | 2021-06-30 | 2021-11-16 | 齐喝彩(常熟)信息科技有限公司 | A kind of intelligent cluster networking method, device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111385357B (en) | 2021-04-27 |
| CN112261153B (en) | 2021-07-13 |
| CN112261153A (en) | 2021-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111385357B (en) | A network resource management method, device, computer equipment and storage medium | |
| US12289656B2 (en) | Method and system for performing charging processing on network slice customer, and related device | |
| CN113810304B (en) | A load balancing method, device, equipment and computer storage medium | |
| CN109547517B (en) | Method and device for scheduling bandwidth resources | |
| US9635149B2 (en) | Method and apparatus for dynamic association of terminal nodes with aggregation nodes and load balancing | |
| US9621512B2 (en) | Dynamic network action based on DHCP notification | |
| CN112825527A (en) | Service node distribution method and device based on MEC and related server | |
| CN109040243A (en) | A kind of message processing method and device | |
| WO2012065531A1 (en) | Method, device, and system for implementing relay selection | |
| CN114726796A (en) | Flow control method, gateway and switch | |
| WO2016180188A1 (en) | Distributed link establishment method, apparatus and system | |
| CN103401799A (en) | Method and device for realizing load balance | |
| CN106027354A (en) | Backflow method and device for VPN (Virtual Private Network) client | |
| CN105743781A (en) | VRRP load balancing method and VRRP load balancing device | |
| CN115665262A (en) | A request processing method, device, electronic device and storage medium | |
| WO2022078330A1 (en) | Domain name recursive query method and apparatus, and recursive server and dns system | |
| EP2874368B1 (en) | Method and device for generating aggregate layer networkmap and aggregate layer costmap | |
| CN113904984B (en) | Data transmission method suitable for SAP and B2B system | |
| CN111641698B (en) | Data statistical method, system, equipment and storage medium | |
| HK40025919A (en) | Method and apparatus for managing network resources, computer device and storage medium | |
| HK40025919B (en) | Method and apparatus for managing network resources, computer device and storage medium | |
| WO2022068484A1 (en) | Service chain address pool slicing method, device and system | |
| CN103178985A (en) | Network device polling method, system and device | |
| CN115622943B (en) | Data distribution method, device, system, equipment and medium | |
| CN112291340B (en) | Service allocation method, controller and virtual network element |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code | Ref country code:HK Ref legal event code:DE Ref document number:40025919 Country of ref document:HK | |
| GR01 | Patent grant | ||
| GR01 | Patent grant |