Summary of the invention
The invention provides a kind of disposal route and system of data, for effectively having improved the utilization factor of hardware resource, and improved speed and the efficiency in backup and archiving process.
First aspect of the present invention is to provide a kind of disposal route of data, comprising:
Obtain the very first time window that the first storage medium is corresponding;
Every described very first time window, trigger described the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to described first kind incremental data;
Obtain the second time window that the second storage medium is corresponding;
Every described the second time window, to be stored in described the first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data, and described Equations of The Second Kind incremental data is moved to the second storage medium from described the first storage medium, then record the second storage time corresponding to described Equations of The Second Kind incremental data;
Wherein, described the second time window is greater than described very first time window; The performance of described the second storage medium is lower than the performance of described the first storage medium.
Another aspect of the present invention is to provide a kind of disposal system of data, comprising: the treatment facility of data and at least two storage mediums, and wherein, the treatment facility of described data comprises:
Preserve module, for preserving the mapping relations of storage medium and time window;
Time window acquisition module, for obtaining the very first time window that the first storage medium is corresponding;
Data storage trigger module, for every described very first time window, triggers described the first storage medium and obtains and store first kind incremental data corresponding to raw data;
Logging modle, for recording the first storage time corresponding to described first kind incremental data;
Described time window acquisition module is also for obtaining the second time window that the second storage medium is corresponding;
Data merge processing module also for every described the second time window, will be stored in described the first storage medium, and all first kind incremental datas that the age of incremental data is greater than the second Preset Time section merge rear generation Equations of The Second Kind incremental data;
Transferring module, for moving to the second storage medium by described Equations of The Second Kind incremental data from described the first storage medium;
Described logging modle is also for recording the second storage time corresponding to described Equations of The Second Kind incremental data;
Wherein, described the second time window is greater than described very first time window; The performance of described the second storage medium is lower than the performance of described the first storage medium.
Technique effect of the present invention is: by every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data, every the second time window corresponding to the second storage medium, to be stored in the first storage medium, and all first kind incremental datas that the age of incremental data is greater than this first Preset Time section merge rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved to the second storage medium from the first storage medium, record again the second storage time corresponding to this Equations of The Second Kind incremental data, with respect to what fix in prior art, and equal BACKUP TIME window and time of filing window, because this second time window is greater than very first time window, thereby reduced the frequency of filing, saved system resource, and can carry out union operation by being stored in when Equations of The Second Kind incremental data in the first storage medium moves to the second storage medium, thereby effectively reduced the conceptual data amount of the incremental data of data backup and/or filing, saved the disk space that backup or filing are used, therefore solve the problem of the wasting of resources in prior art, promoted speed and the efficiency of backup and/or filing.
Embodiment
Fig. 1 is the process flow diagram of an embodiment of the disposal route of data of the present invention, as shown in Figure 1, the treatment facility that the executive agent of the present embodiment is data, the method comprises:
Step 101, obtain the very first time window that the first storage medium is corresponding.
In the present embodiment, time window refers to the time interval between adjacent storage time.
In embodiments of the present invention, the first storage medium can corresponding a plurality of time windows, when described the first storage medium is preset with a plurality of time window, obtain one of them time window as very first time window corresponding to described the first storage medium.Concrete, can from a plurality of time windows, select one of them as very first time window corresponding to described the first storage medium according to concrete user's request or other conditions.
Step 102, every very first time window, trigger this first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data.
Step 103, obtain the second time window that the second storage medium is corresponding.
Step 104, every this second time window, to be stored in this first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved to the second storage medium from this first storage medium, then record the second storage time corresponding to this Equations of The Second Kind incremental data.
Wherein, this second time window is greater than very first time window; The performance of this second storage medium is lower than the performance of the first storage medium.In addition, the present invention does not limit the first Preset Time section, can need to arrange arbitrarily according to actual conditions.
In the present embodiment, for instance, the first storage medium can be specially solid state hard disc (Solid State Drive; Be called for short: SSD), the second storage medium can be specially serial connecting small computer system interface (Serial Attached Small Computer System Interface; Be called for short: SAS) hard disk.Or the first storage medium can be SAS hard disk, the second storage medium can be Serial Advanced Technology Attachment (Serial Advanced Technology Attachment; Be called for short: SATA) hard disk.
The first storage medium (as SSD) described in the present embodiment obtains and stores first kind incremental data corresponding to raw data and specifically refers to that the controller of SSD obtains and store first kind incremental data corresponding to raw data, first kind incremental data described in the embodiment of the present invention refers in very first time window, the data that change with respect to raw data;
The Equations of The Second Kind incremental data that all first kind incremental datas are merged to rear generation described in the embodiment of the present invention refers to that these data are with respect to the incremental data of raw data at the second time window constantly.
In addition, in the present embodiment, the disposal route of data can be applied in the backup of data and/or the filing of data is processed.For instance, Fig. 2 is that the disposal route of data is applied in the principle schematic that the incremental backup of data is processed, as shown in Figure 2, this raw data is specially disk partition, comprise respectively 9 subregions, when initial, the data of storing in 9 subregions are respectively a, b, c, d, e, f, g, h and i.In addition, very first time window can be specially the first BACKUP TIME window, and the second time window can be specially the second BACKUP TIME window, and wherein, for the first storage medium, its corresponding very first time window is 1 day; For the second storage medium, the second time window of its correspondence is 1 week.The first Preset Time section is also 1 week.The specific implementation of the disposal route of these data is: when first day, triggering the first storage medium, to obtain and store first kind incremental data corresponding to raw data be a1, wherein, this a1 is change/incremental data of raw data a, and records the first storage time (being equivalent to BACKUP TIME) that this a1 is corresponding.During second day, triggering the first storage medium, to obtain and store first kind incremental data corresponding to raw data be b1, and wherein, this b1 is change/incremental data of raw data b, and records the first storage time that this b1 is corresponding.Follow-up the like, repeat no more.While it should be noted that the 3rd day, triggering first kind incremental data corresponding to raw data that the first storage medium obtains and store is a2+c1, and wherein, raw data a is changed to a2.
Every the second time window, trigger the second storage medium and obtain and store the Equations of The Second Kind incremental data in the first storage medium, this Equations of The Second Kind incremental data be for will be stored in the first storage medium, and the age of incremental data all first kind incremental datas of being greater than the second time window merge the data of rear generation.In other words, to back up in the first storage medium, and the age of first kind incremental data is greater than all first kind incremental datas of a week and merges rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is backuped to the second storage medium from the first storage medium.
As shown in Figure 2, for data a in Equations of The Second Kind incremental data, be not the a1 of first day, but the a2 of the 3rd day, in other words, before merging, the variation total amount of 7 days is 8 delta datas, after merging, the variation total amount of 7 days is only 7 delta datas, therefore, when incremental data is moved to the second storage medium by the first storage medium, because the second time window is greater than very first time window, it is the summation that Equations of The Second Kind incremental data total amount is less than the first kind incremental data of first 7 days, therefore reduced the total amount that needs the incremental data of migration, be equivalent to reduce hard disk, expending of the resource such as CPU and internal memory, improved the efficiency of whole filing.
In the present embodiment, by every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data, every i time window corresponding to i storage medium, to be stored in the first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved to the second storage medium from the first storage medium, record again the second storage time corresponding to this Equations of The Second Kind incremental data, with respect to what fix in prior art, and equal BACKUP TIME window and time of filing window, because this second time window is greater than very first time window, thereby reduced the frequency of filing, saved system resource, and can carry out union operation by being stored in when Equations of The Second Kind incremental data in the first storage medium moves to the second storage medium, thereby effectively reduced the conceptual data amount of the incremental data of data backup and/or filing, saved the disk space that backup or filing are used, therefore solve the problem of the wasting of resources in prior art, promoted speed and the efficiency of backup and/or filing.
It should be noted that and of the present inventionly the quantity of storage medium is not limited, according to the needs of actual conditions, the storage medium of varying number is set arbitrarily.
Fig. 3 is the process flow diagram of another embodiment of the disposal route of data of the present invention, disposal route with data is applied in the backup of data and the processing of filing, and the quantity of storage medium be 4 for example, introduce in detail the technical scheme of the present embodiment, as shown in Figure 3, the method for the present embodiment comprises:
Step 201, obtain the very first time window that the first storage medium is corresponding, and every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, then record the first storage time corresponding to this first kind incremental data.
Concrete, in the present embodiment, very first time window is 1 hour; This first storage medium is SSD.
Step 202, obtain the second time window that the second storage medium is corresponding, and every the second time window, to be stored in the first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved to the second storage medium from the first storage medium, then record the second storage time corresponding to this Equations of The Second Kind incremental data.
Wherein, Equations of The Second Kind incremental data be for will be stored in the first storage medium, and the age of incremental data all first kind incremental datas of being greater than the second time window merge the data of rear generation.
Concrete, in the present embodiment, this second storage medium is SAS hard disk.The second time window is specially 1 day, and the first Preset Time section is 1 day.In addition, by triggering the first storage medium, the first kind incremental data of obtaining and storing for first hour to the 24 hour is merged to rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved in the second storage medium, thereby the backup of the incremental data of realization from the first storage medium to the second storage medium.
Step 203, obtain the 3rd time window that the 3rd storage medium is corresponding, and every the 3rd time window, to be stored in the second storage medium, and all Equations of The Second Kind incremental datas that the age of incremental data is greater than the second Preset Time section merge the 3rd class incremental data of rear generation, and the 3rd class incremental data is moved to the 3rd storage medium from the second storage medium, then record the 3rd storage time corresponding to the 3rd class incremental data.
Wherein, the 3rd class incremental data be for will be stored in the second storage medium, and the age of incremental data all Equations of The Second Kind incremental datas of being greater than the 3rd time window merge the data of rear generation.
Concrete, in the present embodiment, the 3rd storage medium is SATA hard disk.The 3rd time window is specially 1 week, and the second Preset Time section is 2 days.In addition, by triggering the Equations of The Second Kind incremental data that the second storage medium obtains first day to the store in 7 days, merge rear generation the 3rd class incremental data, and the 3rd class incremental data is moved in the 3rd storage medium, thereby realize from the filing of the incremental data of the second storage medium to the three storage mediums.
Step 204, obtain the 4th time window that the 4th storage medium is corresponding, and every the 4th time window, to be stored in the 3rd storage medium, and all the 3rd class incremental datas that the age of incremental data is greater than the 3rd Preset Time section merge rear generation the 4th class incremental data, and the 4th class incremental data is moved to the 4th storage medium from the 3rd storage medium, then record the 4th storage time corresponding to the 4th class incremental data.
Wherein, the 4th class incremental data be for will be stored in the 3rd storage medium, and the age of incremental data all the 3rd class incremental datas of being greater than the 4th time window merge the data of rear generation.
Concrete, in the present embodiment, the 4th storage medium is special-purpose SATA hard disk.The 4th time window is specially 1 year, and the 3rd Preset Time section is January.In addition, by triggering the 3rd storage medium, the first the 3rd class incremental data of obtaining and storing for thoughtful the one 2 week is merged to rear generation the 4th class incremental data, and the 4th class incremental data is moved in the 4th storage medium, thereby realize from the filing of the incremental data of the 3rd storage medium to the four storage mediums.
In addition, in the present embodiment, the 4th storage medium can be specially the SATA hard disk of special-purpose filing.SATA hard disk that it should be noted that this special use filing only starts when filing data read and write, other times can be in dormant state, thereby has effectively improved the serviceable life of the SATA hard disk that this special use files.
Also it should be noted that, the first Preset Time section in the present embodiment, the second Preset Time section and the 3rd Preset Time section can equate also can be unequal, in the present embodiment, do not limit, except above-mentioned illustrational, can also need to arrange arbitrarily according to actual conditions.
In the present embodiment, by every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data, every i time window corresponding to i storage medium, trigger i storage medium and obtain and store the i class incremental data in i-1 storage medium, and record i storage time corresponding to described i class incremental data, wherein, these i class storage data are for being stored in i-1 storage medium, and all i-1 class incremental datas that the age of incremental data is greater than i-1 Preset Time section merge the data of rear generation, because i time window is greater than i-1 time window, with respect to what fix in prior art, and equal BACKUP TIME window and time of filing window, the present invention has reduced the data volume of the incremental data of data backup and/or filing, therefore solved the problem of the wasting of resources in prior art, speed and the efficiency of backup and/or filing have been promoted, and then lower total all costs (the Total Cost of Ownership of acquisition, be called for short: TCO) and higher data protection efficiency.Wherein, i is integer, and i is more than or equal to 2.
Further, in yet another embodiment of the present invention, on the basis of above-described embodiment, the method can further include:
This very first time window, the second time window and/or the 3rd time window are upgraded to processing.
Fig. 4 is the structural representation of an embodiment of the disposal system of data of the present invention, as shown in Figure 4, the system of the present embodiment comprises: the treatment facility 11 of data and at least two storage mediums 12, in the present embodiment, when storage medium 12 is two, and while being the first storage medium and the second storage medium, the treatment facility 11 of data comprises: preserve module 111, time window acquisition module 112, data storage trigger module 113, logging modle 114, data merging processing module 115 and transferring module 116; Wherein, preserve module 111 for preserving the mapping relations of storage medium and time window; Time window acquisition module 112 is for obtaining the very first time window that the first storage medium is corresponding; Data storage trigger module 113, for every very first time window, triggers this first storage medium and obtains and store first kind incremental data corresponding to raw data; Logging modle 114 is for recording the first storage time corresponding to this first kind incremental data; Time window acquisition module 112 is also for obtaining the second time window that the second storage medium is corresponding; Data merge processing module 115 also for every this second time window, will be stored in this first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data; Transferring module 116 is for moving to the second storage medium by this Equations of The Second Kind incremental data from described the first storage medium; Logging modle 114 is also for recording the second storage time corresponding to described Equations of The Second Kind incremental data.Concrete, this second time window is greater than very first time window; The performance of this second storage medium is lower than the performance of the first storage medium.
In embodiments of the present invention, timewindow acquisition module 112, specifically for when described the first storage medium is preset with a plurality of time window, obtains one of them time window as very first time window corresponding to described the first storage medium.
The disposal system of the present embodiment data can execution graph 1 or 2 shown in the technical scheme of embodiment of the method, it is similar that it realizes principle, repeats no more herein.
In the present embodiment, by every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data, every i time window corresponding to i storage medium, to be stored in the first storage medium, and all first kind incremental datas that the age of incremental data is greater than the first Preset Time section merge rear generation Equations of The Second Kind incremental data, and this Equations of The Second Kind incremental data is moved to the second storage medium from the first storage medium, record again the second storage time corresponding to this Equations of The Second Kind incremental data, with respect to what fix in prior art, and equal BACKUP TIME window and time of filing window, because this second time window is greater than very first time window, and the Equations of The Second Kind incremental data being stored in the first storage medium is moved to the second storage medium, thereby effectively reduced the conceptual data amount of the incremental data of data backup and/or filing, saved the disk space that backup or filing are used, therefore solved the problem of the wasting of resources in prior art, speed and the efficiency of backup and/or filing have been promoted.
Further, in another embodiment, on above-mentioned basis embodiment illustrated in fig. 4, timewindow acquisition module 112 is also for obtaining the 3rd time window that the 3rd storage medium is corresponding; Data mergeprocessing module 115 also for every the 3rd time window, will be stored in this second storage medium, and all Equations of The Second Kind incremental datas that the age of incremental data is greater than the second Preset Time section merge rear generation the 3rd class incremental data; Transferringmodule 116 is also for moving to the 3rd storage medium by the 3rd class incremental data from this second storage medium;Logging modle 114 is also for recording the 3rd storage time corresponding to the 3rd class incremental data; Wherein, the 3rd time window is greater than this second time window; The performance of the 3rd storage medium is greater than the performance of this second storage medium.
Further, the treatment facility 11 of the data in this system also comprises: update module, and for this very first time window, the second time window, the 3rd time window, the first Preset Time section and/or the second Preset Time section are upgraded to processing.
It should be noted that and of the present inventionly the quantity of storage medium is not limited, according to the needs of actual conditions, the storage medium of varying number is set arbitrarily.
In the present embodiment, by every very first time window, trigger the first storage medium and obtain and store first kind incremental data corresponding to raw data, and record the first storage time corresponding to this first kind incremental data, every i time window corresponding to i storage medium, trigger i storage medium and obtain and store the i class incremental data in i-1 storage medium, and record i storage time corresponding to described i class incremental data, wherein, these i class storage data are for being stored in i-1 storage medium, and all i-1 class incremental datas that the age of incremental data is greater than i-1 Preset Time section merge the data of rear generation, because i time window is greater than i-1 time window, with respect to what fix in prior art, and equal BACKUP TIME window and time of filing window, the present invention has reduced the data volume of the incremental data of data backup and/or filing, therefore solved the problem of the wasting of resources in prior art, speed and the efficiency of backup and/or filing have been promoted, and then lower total all costs (the Total Cost of Ownership of acquisition, be called for short: TCO) and higher data protection efficiency.Wherein, i is integer, and i is more than or equal to 2.
In addition, this storage medium comprise following one or several: SSD, SAS hard disk, SATA hard disk and special-purpose SATA hard disk.
One of ordinary skill in the art will appreciate that: all or part of step that realizes above-mentioned each embodiment of the method can complete by the relevant hardware of programmed instruction.Aforesaid program can be stored in a computer read/write memory medium.This program, when carrying out, is carried out the step that comprises above-mentioned each embodiment of the method; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.
Finally it should be noted that: each embodiment, only in order to technical scheme of the present invention to be described, is not intended to limit above; Although the present invention is had been described in detail with reference to aforementioned each embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or some or all of technical characterictic is wherein equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.