Movatterモバイル変換


[0]ホーム

URL:


CN111966449B - Virtual machine backup management method, system, terminal and storage medium - Google Patents

Virtual machine backup management method, system, terminal and storage medium
Download PDF

Info

Publication number
CN111966449B
CN111966449BCN202010693786.5ACN202010693786ACN111966449BCN 111966449 BCN111966449 BCN 111966449BCN 202010693786 ACN202010693786 ACN 202010693786ACN 111966449 BCN111966449 BCN 111966449B
Authority
CN
China
Prior art keywords
backup
virtual machine
time
pool
trend
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010693786.5A
Other languages
Chinese (zh)
Other versions
CN111966449A (en
Inventor
李青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Metabrain Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co LtdfiledCriticalSuzhou Inspur Intelligent Technology Co Ltd
Priority to CN202010693786.5ApriorityCriticalpatent/CN111966449B/en
Publication of CN111966449ApublicationCriticalpatent/CN111966449A/en
Application grantedgrantedCritical
Publication of CN111966449BpublicationCriticalpatent/CN111966449B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本发明提供一种虚拟机备份管理方法、系统、终端及存储介质,包括:接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;采集目标虚拟机在一个备份周期内的资源利用率;利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份。本发明通过对虚拟机运行状态的进行分析和计算,自动为虚拟机选择合适的存储介质和存储策略,减少人工干预,提高备份效率和均衡备份存储池的负载,且能够减少在虚拟机运行压力大时进行备份,缩短备份时间,减少丢失数据的风险。

Figure 202010693786

The present invention provides a virtual machine backup management method, system, terminal and storage medium, including: receiving a backup cycle sent by a target virtual machine, where the target virtual machine is any virtual machine in a cluster; collecting the target virtual machine in a backup cycle The resource utilization rate within the current cycle; the Markov chain is used to predict the time when the operating pressure is the smallest within the backup time range of this cycle according to the resource utilization rate; at the time when the operating pressure is the smallest, the state is selected according to the amount of data to be backed up by the target virtual machine The matching backup pool backs up the target virtual machine. By analyzing and calculating the running state of the virtual machine, the present invention automatically selects a suitable storage medium and storage strategy for the virtual machine, reduces manual intervention, improves the backup efficiency and balances the load of the backup storage pool, and can reduce the running pressure of the virtual machine. Back up when it is big, shorten the backup time and reduce the risk of data loss.

Figure 202010693786

Description

Translated fromChinese
一种虚拟机备份管理方法、系统、终端及存储介质A virtual machine backup management method, system, terminal and storage medium

技术领域technical field

本发明涉及虚拟机集群技术领域,具体涉及一种虚拟机备份管理方法、系统、终端及存储介质。The invention relates to the technical field of virtual machine clusters, in particular to a virtual machine backup management method, system, terminal and storage medium.

背景技术Background technique

在虚拟化平台中,虚拟机是最活跃的主体和核心,虚拟机平稳运行、数据的安全和完整是用户比较关心的问题。虚拟化平台一般会提供HA、快照等多种技术保持虚拟机业务运行的连续性和稳定性,但仍无法避免因意外造成的数据丢失,比如虚拟机介质损坏、误删除、数据意外覆盖等。虚拟机备份能保存虚拟机任意快照点的数据和状态,可在本地或异地存储这些数据,在生产环境发生灾难或者人工操作失误时,能够利用原数据进行恢复,降低损失。因此,备份一直是虚拟化平台保护虚拟机必不可少的解决方案。In a virtualization platform, the virtual machine is the most active subject and core. The smooth running of the virtual machine and the security and integrity of the data are the issues that users are more concerned about. Virtualization platforms generally provide HA, snapshot and other technologies to maintain the continuity and stability of virtual machine business operations, but data loss due to accidents cannot be avoided, such as virtual machine media damage, accidental deletion, and accidental data overwriting. Virtual machine backup can save the data and state of any snapshot point of the virtual machine, and can store these data locally or off-site. In the event of a disaster or manual operation error in the production environment, the original data can be used to restore and reduce losses. Therefore, backup has always been an essential solution for virtualization platforms to protect virtual machines.

虚拟化和云产品中广泛应用备份技术,用户可根据自身需求对虚拟机备份,采用按时备份、按天备份或者手工操作立即备份,根据虚拟机配置、状态和备份情况,系统自行选择全量或者增量备份。虚拟化平台的备份系统一般由以下五部分组成:备份数据、备份介质、备份通道、备份引擎、备份策略。备份数据即需要备份的数据文件。备份介质即备份数据最终存储的物理介质。备份通道连接备份数据和备份介质,通过备份引擎将备份数据写入备份介质,而备份策略决定启动备份的时机和备份的类型等。Backup technology is widely used in virtualization and cloud products. Users can back up virtual machines according to their own needs, using on-time backup, daily backup, or immediate backup by manual operation. volume backup. The backup system of the virtualization platform generally consists of the following five parts: backup data, backup medium, backup channel, backup engine, and backup strategy. Backup data is the data file that needs to be backed up. The backup medium is the physical medium on which the backup data is ultimately stored. The backup channel connects the backup data and the backup medium, and writes the backup data to the backup medium through the backup engine. The backup policy determines the timing and type of backup.

现有的备份机制可以保障虚拟机数据的完整性,但是管理备份有两个问题:Existing backup mechanisms can guarantee the integrity of virtual machine data, but there are two problems with managing backups:

一是备份介质有多种,不同介质根据其特性有不同的适用场景(如,备份一体机有高并发、无传输速率限制、适合小文件的特点,磁盘库具有恢复数据较快、数据可永久保存的特点),管理人员需清晰了解每种介质的特性和优缺点,为虚拟机选择最优的备份方案,以提高备份效率。若备份环境复杂,且虚拟机数量较大时,管理备份较为复杂;二是现有的备份策略较为单调,比如按固定时间间隔对虚拟机进行备份,不考虑当前虚拟机状态以及CPU、内存等的使用情况,在使用压力较大时执行备份可能会造成备份时间较长,且易丢失数据。First, there are many kinds of backup media, and different media have different applicable scenarios according to their characteristics (for example, the backup all-in-one machine has the characteristics of high concurrency, no transmission rate limit, and is suitable for small files, and the disk library has the characteristics of fast data recovery and permanent data recovery. The management personnel need to clearly understand the characteristics, advantages and disadvantages of each medium, and choose the optimal backup solution for the virtual machine to improve the backup efficiency. If the backup environment is complex and the number of virtual machines is large, it is more complicated to manage backup; second, the existing backup strategy is relatively monotonous, such as backing up virtual machines at regular intervals, regardless of the current state of the virtual machine, CPU, memory, etc. When the usage pressure is high, performing backups may result in longer backup times and data loss.

发明内容SUMMARY OF THE INVENTION

针对现有技术的上述不足,本发明提供一种虚拟机备份管理方法、系统、终端及存储介质,以解决上述技术问题。In view of the above shortcomings of the prior art, the present invention provides a virtual machine backup management method, system, terminal and storage medium to solve the above technical problems.

第一方面,本发明提供一种虚拟机备份管理方法,包括:In a first aspect, the present invention provides a virtual machine backup management method, including:

接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;receiving a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;

采集目标虚拟机在一个备份周期内的资源利用率;Collect the resource utilization of the target virtual machine in a backup cycle;

利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;Use the Markov chain to predict the moment when the operating pressure is the least within the backup time range of the current cycle according to the resource utilization rate;

在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份。At the moment when the operating pressure is the least, according to the amount of data to be backed up on the target virtual machine, a backup pool with matching status is selected to back up the target virtual machine.

进一步的,所述所述利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻,包括:Further, the use of the Markov chain to predict the moment when the operating pressure is the smallest within the backup time range of the current cycle according to the resource utilization rate includes:

设置监控时间间隔并设置备份时间的可调范围,根据周期备份时刻和所述可调范围生成周期备份时间范围;Set the monitoring time interval and set the adjustable range of the backup time, and generate the periodic backup time range according to the periodic backup time and the adjustable range;

将一个备份周期分割为多个监控时间间隔,获取每个时间间隔的资源占用率,所述资源占用率包括CPU使用率、内存使用率和磁盘使用率;Divide a backup cycle into multiple monitoring time intervals, and obtain the resource occupancy rate of each time interval, where the resource occupancy rate includes CPU usage, memory usage, and disk usage;

记录一个备份周期内相邻两个时间间隔的资源占用率变化趋势,所述变化趋势包括上升趋势、持平趋势、下降趋势;Record the change trend of the resource occupancy rate in two adjacent time intervals in a backup period, and the change trend includes an upward trend, a flat trend, and a downward trend;

统计所述备份周期内的各种变化趋势的出现概率,根据所述各种变化趋势的出现概率生成马尔科夫链模型;Count the occurrence probability of various change trends in the backup period, and generate a Markov chain model according to the occurrence probability of the various change trends;

利用所述马尔科夫模型预测所述本周期备份时间范围内所有相邻时间间隔的资源占用率各种变化趋势的出现概率,并将上升趋势出现概率低于预设阈值的相邻时间间隔的资源使用率变化趋势标记为合适备份;Use the Markov model to predict the occurrence probability of various changing trends of the resource occupancy rate in all adjacent time intervals within the backup time range of the current cycle, and calculate the occurrence probability of the adjacent time intervals in which the upward trend occurrence probability is lower than the preset threshold. Resource usage trends are marked as suitable backups;

筛选出两种以上资源使用率变化趋势标记为合适备份的目标相邻时间间隔,并提取所述目标相邻时间间隔的间隔时刻,将所述间隔时刻作为运行压力最小的时刻输出。Screening out two or more target adjacent time intervals marked as suitable backups with changing trends of resource usage, extracting the interval time of the target adjacent time interval, and outputting the interval time as the time when the operating pressure is the smallest.

进一步的,所述根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份,包括:Further, selecting a backup pool with matching status according to the amount of data to be backed up on the target virtual machine to back up the target virtual machine includes:

获取各备份池所属的备份介质类型,标记各备份池的备份介质类型;Obtain the backup media type to which each backup pool belongs, and mark the backup media type of each backup pool;

根据目标虚拟机的待备份数据量选取匹配的备份介质类型;Select the matching backup media type according to the amount of data to be backed up on the target virtual machine;

根据匹配备份介质类型和备份池标记,筛选出备份池。Filter out backup pools based on matching backup media types and backup pool tags.

进一步的,所述方法还包括:Further, the method also includes:

定期采集各备份池的可用空间容量和各备份池的备份等待时间;Periodically collect the free space capacity of each backup pool and the backup waiting time of each backup pool;

计算所有备份池的可用空间容量的平均值,并将可用空间容量不超过平均值的备份池标记为容量待调;Calculate the average of the free space capacity of all backup pools, and mark the backup pools whose free space capacity does not exceed the average value as the capacity to be adjusted;

计算所有备份池的备份等待时间的平均值,并将备份等待时间在平均值以上的备份池标记为时间待调;Calculate the average of the backup waiting time of all backup pools, and mark the backup pools whose backup waiting time is above the average as the time to be adjusted;

检测集群虚拟机与备份池之间的通讯压力,在通讯压力低于预设阈值时将同时带有容量待调标记和时间待调标记的备份池中的备份数据迁出,并将迁出数据迁入不带有待调标记的备份池。Detect the communication pressure between the cluster virtual machine and the backup pool. When the communication pressure is lower than the preset threshold, it will migrate the backup data in the backup pool with the capacity to be adjusted mark and the time to be adjusted mark at the same time, and migrate the data out. into a backup pool that does not have a pending flag.

第二方面,本发明提供一种虚拟机备份管理系统,包括:In a second aspect, the present invention provides a virtual machine backup management system, including:

任务接收单元,配置用于接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;a task receiving unit, configured to receive a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;

信息采集单元,配置用于采集目标虚拟机在一个备份周期内的资源利用率;an information collection unit, configured to collect the resource utilization rate of the target virtual machine in a backup period;

趋势预测单元,配置用于利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;a trend prediction unit, configured to use the Markov chain to predict the moment when the operating pressure is the smallest within the backup time range of the current cycle according to the resource utilization rate;

备份执行单元,配置用于在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份。The backup execution unit is configured to select a backup pool with matching status to back up the target virtual machine according to the amount of data to be backed up by the target virtual machine at the moment when the operating pressure is the least.

进一步的,所述趋势预测单元包括:Further, the trend prediction unit includes:

间隔设置模块,配置用于设置监控时间间隔并设置备份时间的可调范围,根据周期备份时刻和所述可调范围生成周期备份时间范围;The interval setting module is configured to set the monitoring time interval and set the adjustable range of the backup time, and generate the periodic backup time range according to the periodic backup time and the adjustable range;

参数采集模块,配置用于将一个备份周期分割为多个监控时间间隔,获取每个时间间隔的资源占用率,所述资源占用率包括CPU使用率、内存使用率和磁盘使用率;a parameter collection module, configured to divide a backup cycle into multiple monitoring time intervals, and obtain the resource occupancy rate of each time interval, where the resource occupancy rate includes CPU usage, memory usage and disk usage;

趋势记录模块,配置用于记录一个备份周期内相邻两个时间间隔的资源占用率变化趋势,所述变化趋势包括上升趋势、持平趋势、下降趋势;a trend recording module, configured to record the change trend of the resource occupancy rate in two adjacent time intervals in a backup period, and the change trend includes an upward trend, a flat trend, and a downward trend;

概率统计模块,配置用于统计所述备份周期内的各种变化趋势的出现概率,根据所述各种变化趋势的出现概率生成马尔科夫链模型;A probability statistics module, configured to count the occurrence probability of various change trends in the backup period, and generate a Markov chain model according to the occurrence probability of the various change trends;

趋势预测模块,配置用于利用所述马尔科夫模型预测所述本周期备份时间范围内所有相邻时间间隔的资源占用率各种变化趋势的出现概率,并将上升趋势出现概率低于预设阈值的相邻时间间隔的资源使用率变化趋势标记为合适备份;The trend prediction module is configured to use the Markov model to predict the occurrence probability of various changing trends of the resource occupancy rate of all adjacent time intervals in the backup time range of the current cycle, and set the occurrence probability of the upward trend to be lower than a preset value The trend of resource usage change in adjacent time intervals of the threshold is marked as suitable backup;

时刻筛选模块,配置用于筛选出两种以上资源使用率变化趋势标记为合适备份的目标相邻时间间隔,并提取所述目标相邻时间间隔的间隔时刻,将所述间隔时刻作为运行压力最小的时刻输出。The time screening module is configured to screen out two or more target adjacent time intervals marked as suitable backups by the change trend of resource usage, and extract the interval time of the target adjacent time interval, and use the interval time as the minimum operating pressure time output.

进一步的,所述备份执行单元包括:Further, the backup execution unit includes:

类型获取模块,配置用于获取各备份池所属的备份介质类型,标记各备份池的备份介质类型;The type acquisition module is configured to acquire the backup media type to which each backup pool belongs, and mark the backup media type of each backup pool;

类型匹配模块,配置用于根据目标虚拟机的待备份数据量选取匹配的备份介质类型;A type matching module, configured to select a matching backup medium type according to the amount of data to be backed up of the target virtual machine;

备份筛选模块,配置用于根据匹配备份介质类型和备份池标记,筛选出备份池。The backup filter module is configured to filter out backup pools based on matching backup media types and backup pool tags.

进一步的,所述系统还包括:Further, the system also includes:

定期监控单元,配置用于定期采集各备份池的可用空间容量和各备份池的备份等待时间;The regular monitoring unit is configured to periodically collect the free space capacity of each backup pool and the backup waiting time of each backup pool;

容量计算单元,配置用于计算所有备份池的可用空间容量的平均值,并将可用空间容量不超过平均值的备份池标记为容量待调;The capacity calculation unit is configured to calculate the average value of the available space capacity of all backup pools, and mark the backup pools whose available space capacity does not exceed the average value as the capacity to be adjusted;

时间计算单元,配置用于计算所有备份池的备份等待时间的平均值,并将备份等待时间在平均值以上的备份池标记为时间待调;The time calculation unit is configured to calculate the average value of the backup waiting time of all backup pools, and mark the backup pool whose backup waiting time is above the average value as the time to be adjusted;

数据均衡单元,配置用于检测集群虚拟机与备份池之间的通讯压力,在通讯压力低于预设阈值时将同时带有容量待调标记和时间待调标记的备份池中的备份数据迁出,并将迁出数据迁入不带有待调标记的备份池。The data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool. When the communication pressure is lower than the preset threshold, it will migrate the backup data in the backup pool with the capacity to be adjusted mark and the time to be adjusted mark at the same time. , and migrate the migrated data into the backup pool without the flag to be transferred.

第三方面,提供一种终端,包括:In a third aspect, a terminal is provided, including:

处理器、存储器,其中,processor, memory, which,

该存储器用于存储计算机程序,The memory is used to store computer programs,

该处理器用于从存储器中调用并运行该计算机程序,使得终端执行上述的终端的方法。The processor is used to call and run the computer program from the memory, so that the terminal executes the above-mentioned method of the terminal.

第四方面,提供了一种计算机存储介质,所述计算机可读存储介质中存储有指令,当其在计算机上运行时,使得计算机执行上述各方面所述的方法。In a fourth aspect, a computer storage medium is provided, and instructions are stored in the computer-readable storage medium, which, when executed on a computer, cause the computer to perform the methods described in the above aspects.

本发明的有益效果在于,The beneficial effect of the present invention is that,

本发明提供的虚拟机备份管理方法、系统、终端及存储介质,通过智能预测虚拟机运行压力最小的时刻,然后自动为虚拟机筛选匹配的备份池,进行虚拟机备份。本发明通过对虚拟机运行状态的进行分析和计算,自动为虚拟机选择合适的存储介质和存储策略,减少人工干预,提高备份效率和均衡备份存储池的负载,且能够减少在虚拟机运行压力大时进行备份,缩短备份时间,减少丢失数据的风险。The virtual machine backup management method, system, terminal and storage medium provided by the present invention intelligently predict the time when the virtual machine running pressure is the least, and then automatically select a matching backup pool for the virtual machine to perform virtual machine backup. By analyzing and calculating the running state of the virtual machine, the invention automatically selects a suitable storage medium and storage strategy for the virtual machine, reduces manual intervention, improves the backup efficiency and balances the load of the backup storage pool, and can reduce the running pressure of the virtual machine. Back up when it is big to shorten the backup time and reduce the risk of data loss.

此外,本发明设计原理可靠,结构简单,具有非常广泛的应用前景。In addition, the present invention has reliable design principle and simple structure, and has a very wide application prospect.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. In other words, other drawings can also be obtained based on these drawings without creative labor.

图1是本发明一个实施例的方法的示意性流程图。FIG. 1 is a schematic flowchart of a method according to an embodiment of the present invention.

图2是本发明一个实施例的方法的虚拟机备份的示意性流程图。FIG. 2 is a schematic flowchart of virtual machine backup in a method according to an embodiment of the present invention.

图3是本发明一个实施例的方法的马尔科夫链模型的示意图。FIG. 3 is a schematic diagram of a Markov chain model of the method of an embodiment of the present invention.

图4是本发明一个实施例的方法的动态调整备份池负载的示意性流程图。FIG. 4 is a schematic flow chart of dynamically adjusting the load of a backup pool in a method according to an embodiment of the present invention.

图5是本发明一个实施例的系统的示意性框图。FIG. 5 is a schematic block diagram of a system according to an embodiment of the present invention.

图6为本发明实施例提供的一种终端的结构示意图。FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

具体实施方式Detailed ways

为了使本技术领域的人员更好地理解本发明中的技术方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。In order to make those skilled in the art better understand the technical solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

图1是本发明一个实施例的方法的示意性流程图。其中,图1执行主体可以为一种虚拟机备份管理系统。FIG. 1 is a schematic flowchart of a method according to an embodiment of the present invention. The executive body of FIG. 1 may be a virtual machine backup management system.

如图1所示,该方法100包括:As shown in FIG. 1, the method 100 includes:

步骤110,接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;Step 110: Receive a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;

步骤120,采集目标虚拟机在一个备份周期内的资源利用率;Step 120, collecting resource utilization of the target virtual machine in a backup period;

步骤130,利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;Step 130, using the Markov chain to predict the moment when the operating pressure is the smallest within the backup time range of the current cycle according to the resource utilization rate;

步骤140,在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份。Step 140 , at the moment when the operating pressure is the smallest, select a backup pool with matching status to back up the target virtual machine according to the amount of data to be backed up by the target virtual machine.

具体的,所述虚拟机备份管理方法包括:Specifically, the virtual machine backup management method includes:

请参考图2,虚拟机备份的过程包括以下步骤:Referring to Figure 2, the process of virtual machine backup includes the following steps:

(1)创建备份管理节点。(1) Create a backup management node.

在云平台创建一个特殊的虚拟机(备份管理节点),不同的备份介质添加到云平台后,创建不同的备份存储池,备份管理虚拟机监控这些备份存储池的连接状态、可用容量等信息。在发明的其他实施方式中,备份管理解决可以是物理机。Create a special virtual machine (backup management node) on the cloud platform. After adding different backup media to the cloud platform, create different backup storage pools. The backup management virtual machine monitors the connection status and available capacity of these backup storage pools. In other embodiments of the invention, the backup management solution may be a physical machine.

(2)监控云平台中所有的备份存储池,记录其可使用空间和备份需要等待的时长。(2) Monitor all backup storage pools in the cloud platform, record their usable space and the waiting time for backup.

(3)待备份的虚拟机下发周期备份计划,设定预期的备份周期时长。(3) A periodic backup plan is issued for the virtual machine to be backed up, and an expected backup period duration is set.

(4)在备份周期时间段内监控虚拟机的CPU、内存、磁盘I/O等的运行情况,计算出该虚拟机的马尔可夫模型。(4) Monitor the running conditions of the virtual machine's CPU, memory, disk I/O, etc. during the backup period, and calculate the Markov model of the virtual machine.

在备份周期的一段时间内备份管理节点记录该虚拟机的CPU、内存、磁盘IO等,利用马尔科夫链预测虚拟机运行压力小的时间,动态微调执行备份时间。During the backup period, the backup management node records the CPU, memory, disk IO, etc. of the virtual machine, uses the Markov chain to predict the time when the virtual machine is under low operating pressure, and dynamically fine-tunes the backup time.

下面以CPU为例阐述计算预测的过程。The following describes the process of calculating the prediction by taking the CPU as an example.

设置一个较小的时间间隔t0,在备份周期内,记录虚拟机CPU、内存、磁盘I/O的压力变化趋势。假设当前CPU使用率是Ut,前一个时间间隔的使用率是Ut-t0,后一个时间间隔虚拟机的CPU使用率是Ut+t0,CPU使用率的状态有下列几种情况:Ut-t0>Ut记录当前状态趋势是使用率下降,Ut-t0=Ut记录当前状态趋势是使用率持平,Ut-t0<Ut记录当前状态趋势是使用率上升;Set a small time interval t0, and record the pressure change trend of the virtual machine CPU, memory, and disk I/O during the backup cycle. Assuming that the current CPU usage is Ut, the usage of the previous time interval is Ut-t0, and the CPU usage of the virtual machine in the next time interval is Ut+t0, the status of the CPU usage is as follows: Ut-t0> Ut records that the current state trend is that the utilization rate is decreasing, Ut-t0=Ut records that the current state trend is that the utilization rate is flat, and Ut-t0<Ut records that the current state trend is that the utilization rate is increasing;

当前状态StatenowCurrent stateStatenowUt-t0>UtUt-t0>Ut使用率下降(DOWN)Usage down (DOWN)Ut-t0=UtUt-t0=Ut使用率持平(FLAT)Flat usage (FLAT)Ut-t0<UtUt-t0<Ut使用率上升(UP)Usage Up (UP)

类似的,根据Ut+t0和Ut的大小确定使用率下一个状态趋势如下表:Similarly, according to the size of Ut+t0 and Ut , the next state trend of the usage rate is determined as follows:

下个状态State<sub>next</sub>Next state State<sub>next</sub>Ut+t0>UtUt+t0>Ut使用率上升(UP)Usage Up (UP)Ut+t0=UtUt+t0=Ut使用率持平(FLAT)Flat usage (FLAT)Ut+t0<UtUt+t0<Ut使用率下降(DOWN)Usage down (DOWN)

记录每个时间间隔t0记录从当前状态Statenow到下个状态Statenext的变化趋势,接近一个备份周期后,统计每个变化趋势的概率,形成一个简单的马尔可夫链模型和它的状态转换矩阵,模型如图3所示。Record each time interval t0 to record the change trend from the current state Statenow to the next state Statenext, after approaching a backup period, count the probability of each change trend to form a simple Markov chain model and its state transition matrix, The model is shown in Figure 3.

根据马尔科夫链模型,转换为如下的状态矩阵:According to the Markov chain model, it is converted into the following state matrix:

Figure BDA0002590317760000091
Figure BDA0002590317760000091

假设计划备份点是时间Ti,我们允许存在一个偏差范围a提前开始备份或者推后备份,每隔一个小的时间间隔t,计算虚拟机CPU下个时间间隔的使用率趋势;根据马尔可夫链的特性,某一时刻使用率的趋势至依赖与它的前一个状态,即Assuming that the planned backup point is time Ti, we allow a deviation range a to start the backup in advance or postpone the backup, and every small time interval t, calculate the usage trend of the virtual machine CPU in the next time interval; according to the Markov chain The characteristics of , the trend of the usage rate at a certain time is dependent on its previous state, that is

P(Ti+t|Ti-a,…,Ti-2t,Ti-t,Ti)P(Ti +t|Ti -a,...,Ti -2t,Ti -t,Ti )

=P(Ti+t|Ti)P(Ti+t|Ti-a,…,Ti-2t,Ti-t,Ti)=P(Ti+t|Tt)=P(Ti +t|Ti )P(Ti +t|Ti -a,...,Ti -2t,Ti -t,Ti )=P(Ti +t|Tt )

给定初始值后,可计算在计划备份时间点附近的虚拟机CPU使用率状态趋势的概率。当CPU使用率持平或者下降趋势概率大于设定阈值时,设置一个标记VMCPU状态表示合适备份。Given an initial value, the probability of a virtual machine's CPU usage state trend around the planned backup time point can be calculated. When the CPU usage is flat or the probability of a downward trend is greater than the set threshold, set a flag VMCPU state to indicate a suitable backup.

同样步骤,计算虚拟机内存使用率、磁盘I/O的马尔可夫模型,标记VMRAM,VMdisk状态,当同一个时刻至少存在两个状态都标记为合适备份,可以开始备份,否则重新计算后一个时间间隔的状态,直至趋势满足。In the same step, calculate the Markov model of virtual machine memory usage and disk I/O, mark VMRAM and VMdisk status, when at least two statuses are marked as suitable backup at the same time, you can start backup, otherwise recalculate the latter one The status of the time interval until the trend is satisfied.

在计划周期备份时间点到来前,开始计算虚拟机是否压力较小,适合备份,如果适合备份,则根据虚拟机磁盘数据增量大小,选择一个备份池下发备份任务,完成备份,如果不合适,则推后一个时间间隔,继续计算,直至推后至一个适合备份的时间,开始备份。Before the scheduled backup time point, start to calculate whether the virtual machine has less pressure and is suitable for backup. If it is suitable for backup, select a backup pool according to the incremental size of the virtual machine disk data to issue the backup task and complete the backup. If it is not suitable, Then push back a time interval and continue to calculate until a time suitable for backup is pushed back to start backup.

(5)评估备份池状态,根据写入磁盘数据量的大小,选择适合的备份介质,同一种介质选择可用备份空间较大和备份压力较小的备份存储写入备份数据。(5) Evaluate the status of the backup pool, and select a suitable backup medium according to the amount of data written to the disk. For the same medium, choose a backup storage with larger available backup space and less backup pressure to write the backup data.

此外,步骤(2)中除监控各备份池外,还对所有备份池进行动态调整。动态调整备份池负载的过程如图4所示:In addition, in step (2), in addition to monitoring each backup pool, all backup pools are also dynamically adjusted. The process of dynamically adjusting the backup pool load is shown in Figure 4:

备份管理节点监控,每隔一个时间间隔,记录依次备份池的可使用空间大小,以及在该备份池备份的虚拟机需要等待的时间;The backup management node is monitored, and every time interval, the usable space size of the backup pool and the waiting time for the virtual machines backed up in the backup pool are recorded;

一段时间后计算备份池的平均可使用空间,以及平均需要等待的时间。查询云平台的网络负载,在负载较低时,按照技术方案中的方法选择一个高负载的备份池,迁出部分备份到低负载的备份池;如果平台网络负载较高,则推迟一段时间后再次查询平台负载,直至负载较低时开始迁移,具体迁移方法如下:Calculate the average available space of the backup pool and the average waiting time after a period of time. Query the network load of the cloud platform, when the load is low, select a high-load backup pool according to the method in the technical solution, and move out some backups to the low-load backup pool; if the platform network load is high, delay for a period of time Query the platform load again until the migration starts when the load is low. The specific migration method is as follows:

设置A(i,space)表示备份池i的可使用空间,小于平均值标记为1,大于等于平均值记0,设置A(i,wt)表示在备份池i备份虚拟机等待时间,大于平均等待时间标记为1,小于等于平均等待时间记为0;备份存储池i减负的需求表示为N(i.n),Setting A(i, space) means the usable space of backup pool i, if it is less than the average value, it is marked as 1, and if it is greater than or equal to the average value, it is marked as 0. Setting A(i, wt) means the waiting time of backup virtual machine in backup pool i, which is greater than the average. The waiting time is marked as 1, and the average waiting time less than or equal to 0 is recorded as0 ;

N(i.n)=A(i,space)+A(i,wt)N(in) = A(i, space) + A(i, wt)

检测云平台各主机和存储间的通讯压力,压力较小时,备份管理节点查看N(i.n)=2的备份存储池,按照可使用空间从低到高排序,选择可用空间最低的备份池中的备份迁出,在N(i.n)≤1的备份池中选择可使用空间较高的备份池迁入。Detect the communication pressure between each host of the cloud platform and the storage. When the pressure is low, the backup management node checks the backup storage pool with N(in) = 2, sorts it according to the available space from low to high, and selects the backup pool with the lowest available space. For backup migration, select a backup pool with higher available space among backup pools with N(in) ≤ 1 to migrate in.

如图5所示,该系统500包括:As shown in Figure 5, the system 500 includes:

任务接收单元510,配置用于接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;The task receiving unit 510 is configured to receive a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;

信息采集单元520,配置用于采集目标虚拟机在一个备份周期内的资源利用率;The information collection unit 520 is configured to collect the resource utilization rate of the target virtual machine in a backup period;

趋势预测单元530,配置用于利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;The trend prediction unit 530 is configured to use the Markov chain to predict, according to the resource utilization rate, the moment when the operating pressure is the least within the backup time range of the current cycle;

备份执行单元540,配置用于在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份。The backup execution unit 540 is configured to select a backup pool with matching status according to the amount of data to be backed up of the target virtual machine to back up the target virtual machine at the moment when the operating pressure is the least.

可选地,作为本发明一个实施例,,所述趋势预测单元包括:Optionally, as an embodiment of the present invention, the trend prediction unit includes:

间隔设置模块,配置用于设置监控时间间隔并设置备份时间的可调范围,根据周期备份时刻和所述可调范围生成周期备份时间范围;The interval setting module is configured to set the monitoring time interval and set the adjustable range of the backup time, and generate the periodic backup time range according to the periodic backup time and the adjustable range;

参数采集模块,配置用于将一个备份周期分割为多个监控时间间隔,获取每个时间间隔的资源占用率,所述资源占用率包括CPU使用率、内存使用率和磁盘使用率;a parameter collection module, configured to divide a backup cycle into multiple monitoring time intervals, and obtain the resource occupancy rate of each time interval, where the resource occupancy rate includes CPU usage, memory usage and disk usage;

趋势记录模块,配置用于记录一个备份周期内相邻两个时间间隔的资源占用率变化趋势,所述变化趋势包括上升趋势、持平趋势、下降趋势;a trend recording module, configured to record the change trend of the resource occupancy rate in two adjacent time intervals in a backup period, and the change trend includes an upward trend, a flat trend, and a downward trend;

概率统计模块,配置用于统计所述备份周期内的各种变化趋势的出现概率,根据所述各种变化趋势的出现概率生成马尔科夫链模型;A probability statistics module, configured to count the occurrence probability of various change trends in the backup period, and generate a Markov chain model according to the occurrence probability of the various change trends;

趋势预测模块,配置用于利用所述马尔科夫模型预测所述本周期备份时间范围内所有相邻时间间隔的资源占用率各种变化趋势的出现概率,并将上升趋势出现概率低于预设阈值的相邻时间间隔的资源使用率变化趋势标记为合适备份;The trend prediction module is configured to use the Markov model to predict the occurrence probability of various changing trends of the resource occupancy rate of all adjacent time intervals in the backup time range of the current cycle, and set the occurrence probability of the upward trend to be lower than a preset value The trend of resource usage change in adjacent time intervals of the threshold is marked as suitable backup;

时刻筛选模块,配置用于筛选出两种以上资源使用率变化趋势标记为合适备份的目标相邻时间间隔,并提取所述目标相邻时间间隔的间隔时刻,将所述间隔时刻作为运行压力最小的时刻输出。The time screening module is configured to screen out two or more target adjacent time intervals marked as suitable backups by the change trend of resource usage, and extract the interval time of the target adjacent time interval, and use the interval time as the minimum operating pressure time output.

可选地,作为本发明一个实施例,所述备份执行单元包括:Optionally, as an embodiment of the present invention, the backup execution unit includes:

类型获取模块,配置用于获取各备份池所属的备份介质类型,标记各备份池的备份介质类型;The type acquisition module is configured to acquire the backup media type to which each backup pool belongs, and mark the backup media type of each backup pool;

类型匹配模块,配置用于根据目标虚拟机的待备份数据量选取匹配的备份介质类型;A type matching module, configured to select a matching backup medium type according to the amount of data to be backed up of the target virtual machine;

备份筛选模块,配置用于根据匹配备份介质类型和备份池标记,筛选出备份池。The backup filter module is configured to filter out backup pools based on matching backup media types and backup pool tags.

可选地,作为本发明一个实施例,所述系统还包括:Optionally, as an embodiment of the present invention, the system further includes:

定期监控单元,配置用于定期采集各备份池的可用空间容量和各备份池的备份等待时间;The regular monitoring unit is configured to periodically collect the free space capacity of each backup pool and the backup waiting time of each backup pool;

容量计算单元,配置用于计算所有备份池的可用空间容量的平均值,并将可用空间容量不超过平均值的备份池标记为容量待调;The capacity calculation unit is configured to calculate the average value of the available space capacity of all backup pools, and mark the backup pools whose available space capacity does not exceed the average value as the capacity to be adjusted;

时间计算单元,配置用于计算所有备份池的备份等待时间的平均值,并将备份等待时间在平均值以上的备份池标记为时间待调;The time calculation unit is configured to calculate the average value of the backup waiting time of all backup pools, and mark the backup pool whose backup waiting time is above the average value as the time to be adjusted;

数据均衡单元,配置用于检测集群虚拟机与备份池之间的通讯压力,在通讯压力低于预设阈值时将同时带有容量待调标记和时间待调标记的备份池中的备份数据迁出,并将迁出数据迁入不带有待调标记的备份池。The data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool. When the communication pressure is lower than the preset threshold, it will migrate the backup data in the backup pool with the capacity to be adjusted mark and the time to be adjusted mark at the same time. , and migrate the migrated data into the backup pool without the flag to be transferred.

图6为本发明实施例提供的一种终端600的结构示意图,该终端600可以用于执行本发明实施例提供的虚拟机备份管理方法。FIG. 6 is a schematic structural diagram of a terminal 600 according to an embodiment of the present invention, where the terminal 600 may be used to execute the virtual machine backup management method provided by the embodiment of the present invention.

其中,该终端600可以包括:处理器610、存储器620及通信单元630。这些组件通过一条或多条总线进行通信,本领域技术人员可以理解,图中示出的服务器的结构并不构成对本发明的限定,它既可以是总线形结构,也可以是星型结构,还可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。The terminal 600 may include: aprocessor 610 , amemory 620 and acommunication unit 630 . These components communicate through one or more buses. Those skilled in the art can understand that the structure of the server shown in the figure does not constitute a limitation of the present invention. It can be either a bus structure, a star structure, or a More or fewer components than shown may be included, or some components may be combined, or a different arrangement of components.

其中,该存储器620可以用于存储处理器610的执行指令,存储器620可以由任何类型的易失性或非易失性存储终端或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。当存储器620中的执行指令由处理器610执行时,使得终端600能够执行以下上述方法实施例中的部分或全部步骤。Wherein, thememory 620 can be used to store the execution instructions of theprocessor 610, and thememory 620 can be realized by any type of volatile or non-volatile storage terminal or their combination, such as static random access memory (SRAM), electrical Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk . When the execution instructions in thememory 620 are executed by theprocessor 610, the terminal 600 is enabled to execute some or all of the steps in the following method embodiments.

处理器610为存储终端的控制中心,利用各种接口和线路连接整个电子终端的各个部分,通过运行或执行存储在存储器620内的软件程序和/或模块,以及调用存储在存储器内的数据,以执行电子终端的各种功能和/或处理数据。所述处理器可以由集成电路(Integrated Circuit,简称IC)组成,例如可以由单颗封装的IC所组成,也可以由连接多颗相同功能或不同功能的封装IC而组成。举例来说,处理器610可以仅包括中央处理器(Central Processing Unit,简称CPU)。在本发明实施方式中,CPU可以是单运算核心,也可以包括多运算核心。Theprocessor 610 is the control center of the storage terminal, using various interfaces and lines to connect various parts of the entire electronic terminal, by running or executing the software programs and/or modules stored in thememory 620, and calling the data stored in the memory, To perform various functions of the electronic terminal and/or process data. The processor may be composed of an integrated circuit (Integrated Circuit, IC for short), for example, may be composed of a single packaged IC, or may be composed of a plurality of packaged ICs connected with the same function or different functions. For example, theprocessor 610 may only include a central processing unit (Central Processing Unit, CPU for short). In the embodiment of the present invention, the CPU may be a single computing core, or may include multiple computing cores.

通信单元630,用于建立通信信道,从而使所述存储终端可以与其它终端进行通信。接收其他终端发送的用户数据或者向其他终端发送用户数据。Thecommunication unit 630 is used for establishing a communication channel, so that the storage terminal can communicate with other terminals. Receive user data sent by other terminals or send user data to other terminals.

本发明还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,该程序执行时可包括本发明提供的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。The present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include some or all of the steps in the embodiments provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, ROM for short) or a random access memory (English: random access memory, RAM for short).

因此,本发明,本实施例所能达到的技术效果可以参见上文中的描述,此处不再赘述。Therefore, in the present invention, the technical effects that can be achieved by this embodiment can be referred to the above description, which will not be repeated here.

本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中如U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质,包括若干指令用以使得一台计算机终端(可以是个人计算机,服务器,或者第二终端、网络终端等)执行本发明各个实施例所述方法的全部或部分步骤。Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention can be embodied in the form of software products in essence or in the parts that make contributions to the prior art. The computer software products are stored in a storage medium such as a USB flash drive, a mobile Hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes, including several instructions to make a computer terminal (It may be a personal computer, a server, or a second terminal, a network terminal, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.

本说明书中各个实施例之间相同相似的部分互相参见即可。尤其,对于终端实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例中的说明即可。It is sufficient to refer to each other for the same and similar parts among the various embodiments in this specification. In particular, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for related parts, please refer to the description in the method embodiment.

在本发明所提供的几个实施例中,应该理解到,所揭露的系统和方法,可以通过其它的方式实现。例如,以上所描述的系统实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,系统或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided by the present invention, it should be understood that the disclosed system and method may be implemented in other manners. For example, the system embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection between systems or units, and may be in electrical, mechanical or other forms.

所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

尽管通过参考附图并结合优选实施例的方式对本发明进行了详细描述,但本发明并不限于此。在不脱离本发明的精神和实质的前提下,本领域普通技术人员可以对本发明的实施例进行各种等效的修改或替换,而这些修改或替换都应在本发明的涵盖范围内/任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应所述以权利要求的保护范围为准。Although the present invention has been described in detail in conjunction with the preferred embodiments with reference to the accompanying drawings, the present invention is not limited thereto. Without departing from the spirit and essence of the present invention, those of ordinary skill in the art can make various equivalent modifications or substitutions to the embodiments of the present invention, and these modifications or substitutions should all fall within the scope of the present invention/any Those skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should all be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (8)

Translated fromChinese
1.一种虚拟机备份管理方法,其特征在于,包括:1. a virtual machine backup management method, is characterized in that, comprises:接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;receiving a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;采集目标虚拟机在一个备份周期内的资源利用率;Collect the resource utilization of the target virtual machine in a backup cycle;利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;Use the Markov chain to predict the moment when the operating pressure is the least within the backup time range of the current cycle according to the resource utilization rate;在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份;At the moment when the operating pressure is the least, selecting a backup pool with matching status according to the amount of data to be backed up by the target virtual machine to back up the target virtual machine;所述所述利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻,包括:The use of the Markov chain to predict the moment when the operating pressure is the smallest within the backup time range of the current cycle according to the resource utilization rate includes:设置监控时间间隔并设置备份时间的可调范围,根据周期备份时刻和所述可调范围生成周期备份时间范围;Set the monitoring time interval and set the adjustable range of the backup time, and generate the periodic backup time range according to the periodic backup time and the adjustable range;将一个备份周期分割为多个监控时间间隔,获取每个时间间隔的资源占用率,所述资源占用率包括CPU使用率、内存使用率和磁盘使用率;Divide a backup cycle into multiple monitoring time intervals, and obtain the resource occupancy rate of each time interval, where the resource occupancy rate includes CPU usage, memory usage, and disk usage;记录一个备份周期内相邻两个时间间隔的资源占用率变化趋势,所述变化趋势包括上升趋势、持平趋势、下降趋势;Record the change trend of the resource occupancy rate in two adjacent time intervals in a backup period, and the change trend includes an upward trend, a flat trend, and a downward trend;统计所述备份周期内的各种变化趋势的出现概率,根据所述各种变化趋势的出现概率生成马尔科夫链模型;Count the occurrence probability of various change trends in the backup period, and generate a Markov chain model according to the occurrence probability of the various change trends;利用所述马尔科夫链 模型预测所述本周期备份时间范围内所有相邻时间间隔的资源占用率各种变化趋势的出现概率,并将上升趋势出现概率低于预设阈值的相邻时间间隔的资源使用率变化趋势标记为合适备份;The Markov chain model is used to predict the occurrence probability of various changing trends of resource occupancy rate in all adjacent time intervals within the current backup time range, and the occurrence probability of the upward trend is lower than the preset threshold for adjacent time intervals The trend of resource usage changes is marked as a suitable backup;筛选出两种以上资源使用率变化趋势标记为合适备份的目标相邻时间间隔,并提取所述目标相邻时间间隔的间隔时刻,将所述间隔时刻作为运行压力最小的时刻输出。Screening out two or more target adjacent time intervals marked as suitable backups with changing trends of resource usage, extracting the interval time of the target adjacent time interval, and outputting the interval time as the time when the operating pressure is the smallest.2.根据权利要求1所述的方法,其特征在于,所述根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份,包括:2. The method according to claim 1, characterized in that, selecting a backup pool that matches the state according to the amount of data to be backed up by the target virtual machine to back up the target virtual machine, comprising:获取各备份池所属的备份介质类型,标记各备份池的备份介质类型;Obtain the backup media type to which each backup pool belongs, and mark the backup media type of each backup pool;根据目标虚拟机的待备份数据量选取匹配的备份介质类型;Select the matching backup media type according to the amount of data to be backed up on the target virtual machine;根据匹配备份介质类型和备份池标记,筛选出备份池。Filter out backup pools based on matching backup media types and backup pool tags.3.根据权利要求1所述的方法,其特征在于,所述方法还包括:3. The method according to claim 1, wherein the method further comprises:定期采集各备份池的可用空间容量和各备份池的备份等待时间;Periodically collect the free space capacity of each backup pool and the backup waiting time of each backup pool;计算所有备份池的可用空间容量的平均值,并将可用空间容量不超过平均值的备份池标记为容量待调;Calculate the average of the free space capacity of all backup pools, and mark the backup pools whose free space capacity does not exceed the average value as the capacity to be adjusted;计算所有备份池的备份等待时间的平均值,并将备份等待时间在平均值以上的备份池标记为时间待调;Calculate the average of the backup waiting time of all backup pools, and mark the backup pools whose backup waiting time is above the average as the time to be adjusted;检测集群虚拟机与备份池之间的通讯压力,在通讯压力低于预设阈值时将同时带有容量待调标记和时间待调标记的备份池中的备份数据迁出,并将迁出数据迁入不带有待调标记的备份池。Detect the communication pressure between the cluster virtual machine and the backup pool. When the communication pressure is lower than the preset threshold, it will migrate the backup data in the backup pool with the capacity to be adjusted mark and the time to be adjusted mark at the same time, and migrate the data out. into a backup pool that does not have a pending tag.4.一种虚拟机备份管理系统,其特征在于,包括:4. A virtual machine backup management system, comprising:任务接收单元,配置用于接收目标虚拟机发送的备份周期,所述目标虚拟机为集群中的任意虚拟机;a task receiving unit, configured to receive a backup period sent by a target virtual machine, where the target virtual machine is any virtual machine in the cluster;信息采集单元,配置用于采集目标虚拟机在一个备份周期内的资源利用率;an information collection unit, configured to collect the resource utilization rate of the target virtual machine in a backup period;趋势预测单元,配置用于利用马尔科夫链根据所述资源利用率预测本周期备份时间范围内的运行压力最小的时刻;a trend prediction unit, configured to use the Markov chain to predict the moment when the operating pressure is the smallest within the backup time range of the current cycle according to the resource utilization rate;备份执行单元,配置用于在所述运行压力最小的时刻,根据目标虚拟机待备份数据量选取状态匹配的备份池对目标虚拟机进行备份;A backup execution unit, configured to select a backup pool with matching status to back up the target virtual machine according to the amount of data to be backed up by the target virtual machine at the moment when the operating pressure is the smallest;所述趋势预测单元包括:The trend prediction unit includes:间隔设置模块,配置用于设置监控时间间隔并设置备份时间的可调范围,根据周期备份时刻和所述可调范围生成周期备份时间范围;The interval setting module is configured to set the monitoring time interval and set the adjustable range of the backup time, and generate the periodic backup time range according to the periodic backup time and the adjustable range;参数采集模块,配置用于将一个备份周期分割为多个监控时间间隔,获取每个时间间隔的资源占用率,所述资源占用率包括CPU使用率、内存使用率和磁盘使用率;a parameter collection module, configured to divide a backup cycle into multiple monitoring time intervals, and obtain the resource occupancy rate of each time interval, where the resource occupancy rate includes CPU usage, memory usage and disk usage;趋势记录模块,配置用于记录一个备份周期内相邻两个时间间隔的资源占用率变化趋势,所述变化趋势包括上升趋势、持平趋势、下降趋势;a trend recording module, configured to record the change trend of the resource occupancy rate in two adjacent time intervals in a backup period, and the change trend includes an upward trend, a flat trend, and a downward trend;概率统计模块,配置用于统计所述备份周期内的各种变化趋势的出现概率,根据所述各种变化趋势的出现概率生成马尔科夫链模型;A probability statistics module, configured to count the occurrence probability of various change trends in the backup period, and generate a Markov chain model according to the occurrence probability of the various change trends;趋势预测模块,配置用于利用所述马尔科夫链 模型预测所述本周期备份时间范围内所有相邻时间间隔的资源占用率各种变化趋势的出现概率,并将上升趋势出现概率低于预设阈值的相邻时间间隔的资源使用率变化趋势标记为合适备份;The trend prediction module is configured to use the Markov chain model to predict the occurrence probability of various changing trends of the resource occupancy rate of all adjacent time intervals in the backup time range of the current cycle, and set the occurrence probability of the upward trend lower than the predicted value. The resource usage change trend of adjacent time intervals with the threshold value is marked as a suitable backup;时刻筛选模块,配置用于筛选出两种以上资源使用率变化趋势标记为合适备份的目标相邻时间间隔,并提取所述目标相邻时间间隔的间隔时刻,将所述间隔时刻作为运行压力最小的时刻输出。The time screening module is configured to filter out two or more target adjacent time intervals marked as suitable backups by the change trend of resource usage, and extract the interval time of the target adjacent time interval, and use the interval time as the minimum operating pressure time output.5.根据权利要求4所述的系统,其特征在于,所述备份执行单元包括:5. The system according to claim 4, wherein the backup execution unit comprises:类型获取模块,配置用于获取各备份池所属的备份介质类型,标记各备份池的备份介质类型;The type acquisition module is configured to acquire the backup media type to which each backup pool belongs, and mark the backup media type of each backup pool;类型匹配模块,配置用于根据目标虚拟机的待备份数据量选取匹配的备份介质类型;A type matching module, configured to select a matching backup medium type according to the amount of data to be backed up of the target virtual machine;备份筛选模块,配置用于根据匹配备份介质类型和备份池标记,筛选出备份池。The backup filter module is configured to filter out backup pools based on matching backup media types and backup pool tags.6.根据权利要求4所述的系统,其特征在于,所述系统还包括:6. The system of claim 4, wherein the system further comprises:定期监控单元,配置用于定期采集各备份池的可用空间容量和各备份池的备份等待时间;The regular monitoring unit is configured to periodically collect the free space capacity of each backup pool and the backup waiting time of each backup pool;容量计算单元,配置用于计算所有备份池的可用空间容量的平均值,并将可用空间容量不超过平均值的备份池标记为容量待调;The capacity calculation unit is configured to calculate the average value of the available space capacity of all backup pools, and mark the backup pools whose available space capacity does not exceed the average value as the capacity to be adjusted;时间计算单元,配置用于计算所有备份池的备份等待时间的平均值,并将备份等待时间在平均值以上的备份池标记为时间待调;The time calculation unit is configured to calculate the average value of the backup waiting time of all backup pools, and mark the backup pool whose backup waiting time is above the average value as the time to be adjusted;数据均衡单元,配置用于检测集群虚拟机与备份池之间的通讯压力,在通讯压力低于预设阈值时将同时带有容量待调标记和时间待调标记的备份池中的备份数据迁出,并将迁出数据迁入不带有待调标记的备份池。The data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool. When the communication pressure is lower than the preset threshold, it will migrate the backup data in the backup pool with the capacity to be adjusted mark and the time to be adjusted mark at the same time. , and migrate the migrated data into the backup pool without the flag to be transferred.7.一种终端,其特征在于,包括:7. A terminal, characterized in that, comprising:处理器;processor;用于存储处理器的执行指令的存储器;memory for storing instructions for execution of the processor;其中,所述处理器被配置为执行权利要求1-3任一项所述的方法。wherein the processor is configured to perform the method of any one of claims 1-3.8.一种存储有计算机程序的计算机可读存储介质,其特征在于,该程序被处理器执行时实现如权利要求1-3中任一项所述的方法。8. A computer-readable storage medium storing a computer program, characterized in that, when the program is executed by a processor, the method according to any one of claims 1-3 is implemented.
CN202010693786.5A2020-07-172020-07-17Virtual machine backup management method, system, terminal and storage mediumActiveCN111966449B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202010693786.5ACN111966449B (en)2020-07-172020-07-17Virtual machine backup management method, system, terminal and storage medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202010693786.5ACN111966449B (en)2020-07-172020-07-17Virtual machine backup management method, system, terminal and storage medium

Publications (2)

Publication NumberPublication Date
CN111966449A CN111966449A (en)2020-11-20
CN111966449Btrue CN111966449B (en)2022-05-31

Family

ID=73360549

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202010693786.5AActiveCN111966449B (en)2020-07-172020-07-17Virtual machine backup management method, system, terminal and storage medium

Country Status (1)

CountryLink
CN (1)CN111966449B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112306758B (en)*2020-12-242021-04-02深圳市科力锐科技有限公司Backup success rate prediction method, device, equipment and storage medium
CN113297009B (en)*2021-05-252023-05-02深圳前海微众银行股份有限公司Information backup method, equipment, platform and storage medium
CN113778649A (en)*2021-09-142021-12-10杭州沃趣科技股份有限公司 A method, device, device and medium for dynamic scheduling of multiple backup tasks
CN114003065B (en)*2021-10-152024-03-19湖北三江航天红林探控有限公司Dual-pressure transmitter redundancy design method based on air pressure prediction

Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20120323853A1 (en)*2011-06-172012-12-20Microsoft CorporationVirtual machine snapshotting and analysis
CN109272047A (en)*2018-09-272019-01-25山东理工大学It is a kind of to meet the Hidden Markov Model state construction and parameter training method that light multicast resource is predicted
CN110187990A (en)*2019-05-312019-08-30东北大学 A Dynamic Reliability Evaluation Method for Virtual Machine Hybrid Standby Based on Mode Transfer
CN111352700A (en)*2020-02-292020-06-30苏州浪潮智能科技有限公司Method, system, terminal and storage medium for online migration of virtual machine across clouds

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20120323853A1 (en)*2011-06-172012-12-20Microsoft CorporationVirtual machine snapshotting and analysis
CN109272047A (en)*2018-09-272019-01-25山东理工大学It is a kind of to meet the Hidden Markov Model state construction and parameter training method that light multicast resource is predicted
CN110187990A (en)*2019-05-312019-08-30东北大学 A Dynamic Reliability Evaluation Method for Virtual Machine Hybrid Standby Based on Mode Transfer
CN111352700A (en)*2020-02-292020-06-30苏州浪潮智能科技有限公司Method, system, terminal and storage medium for online migration of virtual machine across clouds

Also Published As

Publication numberPublication date
CN111966449A (en)2020-11-20

Similar Documents

PublicationPublication DateTitle
CN111966449B (en)Virtual machine backup management method, system, terminal and storage medium
US11397648B2 (en)Virtual machine recovery method and virtual machine management device
US8352429B1 (en)Systems and methods for managing portions of files in multi-tier storage systems
CN109271435B (en)Data extraction method and system supporting breakpoint continuous transmission
US8949187B1 (en)Systems and methods for creating and managing backups based on health information
US7681001B2 (en)Storage system
CN105574141B (en)Method and device for carrying out data migration on database
US20120078846A1 (en)Systems and methods of managing virtual storage resources
WO2019109854A1 (en)Data processing method and device for distributed database, storage medium, and electronic device
CN103197988A (en)Data backup and recovery method, device and database system
CN112506698B (en) Method, system, terminal and storage medium for data reconstruction and recovery of small files
CN111666266A (en)Data migration method and related equipment
CN117632860A (en)Method and device for merging small files based on Flink engine and electronic equipment
CN117472652A (en)Data backup method, device and system of cloud computing operation and maintenance platform
CN118260021A (en)Container energy-saving elastic expansion and contraction method, system and medium based on time sequence prediction
CN114610567A (en)Container monitoring method, network device and storage medium
CN119396346A (en) Method, device, equipment and storage medium for disk space management
CN111475334B (en) TiDB database maintenance method, device, computer equipment and storage medium
CN113553216A (en)Data recovery method and device, electronic equipment and storage medium
CN114296649B (en)Inter-cloud service migration system
CN102681650B (en)The storage system of a kind of Energy control power-economizing method and correspondence thereof
CN115291806A (en) A processing method, device, electronic device and storage medium
CN112506428B (en)Storage defragmentation time adjustment method, system, terminal and storage medium
CN118838759A (en)AI intelligent-based operational data operation and maintenance processing method and system
CN111858528B (en) A BMC log collection and management method, system, terminal and storage medium

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant
CP03Change of name, title or address

Address after:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province

Patentee after:Suzhou Yuannao Intelligent Technology Co.,Ltd.

Country or region after:China

Address before:Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province

Patentee before:SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd.

Country or region before:China


[8]ページ先頭

©2009-2025 Movatter.jp