Movatterモバイル変換


[0]ホーム

URL:


US9740534B2 - System for controlling resources, control pattern generation apparatus, control apparatus, method for controlling resources and program - Google Patents

System for controlling resources, control pattern generation apparatus, control apparatus, method for controlling resources and program
Download PDF

Info

Publication number
US9740534B2
US9740534B2US14/761,800US201414761800AUS9740534B2US 9740534 B2US9740534 B2US 9740534B2US 201414761800 AUS201414761800 AUS 201414761800AUS 9740534 B2US9740534 B2US 9740534B2
Authority
US
United States
Prior art keywords
resources
control
virtual
virtual system
control pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/761,800
Other versions
US20150363240A1 (en
Inventor
Seiichi Koizumi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cloud Byte LLC
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC CorpfiledCriticalNEC Corp
Assigned to NEC CORPORATIONreassignmentNEC CORPORATIONASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).Assignors: KOIZUMI, SEIICHI
Publication of US20150363240A1publicationCriticalpatent/US20150363240A1/en
Application grantedgrantedCritical
Publication of US9740534B2publicationCriticalpatent/US9740534B2/en
Assigned to NEC Asia Pacific Pte Ltd.reassignmentNEC Asia Pacific Pte Ltd.ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).Assignors: NEC CORPORATION
Assigned to IP WAVE PTE LTD.reassignmentIP WAVE PTE LTD.ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).Assignors: NEC Asia Pacific Pte Ltd.
Assigned to CLOUD BYTE LLC.reassignmentCLOUD BYTE LLC.ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS).Assignors: IP WAVE PTE LTD.
Activelegal-statusCriticalCurrent
Adjusted expirationlegal-statusCritical

Links

Images

Classifications

Definitions

Landscapes

Abstract

A system for controlling the resources includes a control pattern generation unit for generating a plurality of control patterns from a virtual system model, produced by modeling the behaviors of a network element and a server of a virtual system operating on a virtual datacenter, and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual systems. The control patterns prove candidates for control commands to network resources and server resources of the virtual systems. The system for controlling the resources also includes a control unit for carrying out prediction of a service level, using the control patterns, selecting such control pattern that satisfies the service level of the virtual systems and that also satisfies a preset standard or reference for selection, from among the control patterns, with the use of the result of prediction, and putting the control pattern selected to use.

Description

REFERENCE TO RELATED APPLICATION
The present application is a National Stage Entry of PCT/JP2014/052239 filed Jan. 31, 2014, which is based on and claims the benefit of the priority of Japanese Patent Application No. 2013-018202 filed on Feb. 1, 2013, the disclosures of all of which are incorporated herein in their entirety by reference.
TECHNICAL FIELD
The present invention relates to a system for controlling resources, an apparatus for generating a control pattern, a control apparatus, a method for controlling resources and a program. More particularly, it relates to a system for controlling resources, an apparatus for generating a control pattern, a control apparatus, a method for controlling the resources and a program, in which control is exercised on resources allocated to a virtual system operating on a virtual datacenter.
BACKGROUND
In a cloud platform, such as IaaS (Infrastructure as a Service), a plurality of virtual datacenters for users, referred to below as (vDCs), reside together, that is, the virtual datacenters are run as they share physical resources on the cloud platform, and a diversity of virtual systems, such as Web servers or systems for distribution of animated pictures, are run on the vDCs.
The use states of these virtual systems are changing with time. Hence, there is known an autonomous control technique which causes the quantities of allocation of server resources, such as virtual CPUs (Central Processing Units) or memories, to be changed in real-time in keeping with the changing use states.
Patent Literature 1 shows a system for brokering resources, in which priority levels for services allocated to respective nodes of resources are associatively set for the nodes of resources, and in which the priority levels set for the respective nodes of resources are updated to higher levels with lapse of processing time of the respective services rendered by the nodes. If there are no vacant nodes of resources to be allocated to a new service, the service(s) allocated to one of a first node of resources and a second node of resources, the services are already allocated to, is changed over to the new service, providing that the node of resources, for which the service has thus been changed over to the new service, has an as-updated priority level lower than the other node of resources.
Patent Literature 2 shows a communication service control system in which the transmission priority level and the call loss ratio are synthesized together to differentiate the service level to implement multiple classes of the quality levels of communication services. It is stated inPatent Literature 2 that the communication service control system includes a transmission control means, controlling the information transmission over a network, based on the transmission priority level, a management means for resources and an admission control means. The management means for resources causes a threshold value of the quantity of resources to be stored in a memory in which the threshold value is correlated with the values of preset multiple admission priority levels of requests for exploiting the communication services. In more detail, the threshold value stored in the memory becomes greater the higher the values of the preset multiple admission priority levels. If there is made a request(s) for exploiting the communication services, the admission control means sums the quantity of use of the resources requested to the current quantity of use of the resources by links used for the communication services of interest. The admission control means then reads out from the memory the threshold value of the quantity of resources corresponding to the admission priority level of the request(s) for use of the resources in question, and compares the so read out threshold value to the sum of the quantities of use of the resources. If the sum of the quantities of use of the resources is not greater than the threshold value, the admission control means admits the request(s) for use. If otherwise, the admission control means refuses the request(s) for use. It is stated that, with the disclosed communication service control system, the standard or reference of the quantity of residual resources that may be admitted is varied for communication services of the same transmission priority level in dependence upon the admission priority level to differentiate the communication quality levels of the communication services having the same transmission priority level. It is also stated that, by so doing, communication services can be provided at a plurality of communication quality levels resulting from combination of the transmission control which is based on the transmission priority level with the admission control which is based on the admission priority level.
Patent Literature 3 shows a distributed work flow simulation system which takes into consideration the influence of resource sharing in a distributed work flow system that manages the flow of business processing by a plurality of work flow execution units.
Non-Patentliteratures 1, 2 introduce a technique, termed OpenFlow, enabling dynamic control of network resources.
PATENT LITERATURE
  • Patent Literature 1: JP Patent 4557949
  • Patent Literature 2: JP Patent 4627461
  • Patent Literature 3: JP Patent 4872702
NON PATENT LITERATURE
  • Non-Patent Literature 1: Nick McKeown and seven others, “OpenFlow: Enabling Innovation in Campus Networks”, [online], [retrieved on January 9, Heisei25 (2013)], Internet <URL:http:/www.openflow.org/documents/openflow-wp-latest.pdf>
  • Non-Patent Literature 2: “OpenFlow Switch Specification” Version 1.3.1 (Wire Protocol 0x04), [online], [retrieved on January 9, Heisei25 (2013)], Internet <URL: http://www.opennetworking.org/images/stories/downloads/specification/openflow-spec-v1.3.1.pdf>
SUMMARY
The following analysis is given by the present invention. In a virtual system operating on a virtual datacenter, mentioned above, there is a demand for such control that reduces the quantity of consumption of resources to as small a value as possible as the service level of performance is maintained. To this end, deciding at which time and in which quantity the server resources and the network resources are to be allocated as well as reflecting the result of the decision has been a requirement.
In this connection, the above mentionedPatent Literatures 1, 2 suffer a drawback that desirable results may not necessarily be obtained should they be put to use in allocating the resources for the virtual system on the vDC. For example, in the system for brokering the resources according toPatent literature 1, it is possible to allocate resources to the nodes of resources, however, the network resources are not taken into consideration. On the other hand, in the communication service control system ofPatent Literature 2, it is possible to optimize network resources, however, the server resources are not taken into consideration.
It is an object of the present invention to provide a system for controlling the resources, an apparatus for generating a control pattern, a control apparatus, a method for controlling resources, and a program, in which it is possible to contribute to more efficient distribution of resources to virtual systems operating on a virtual datacenter.
In a first aspect, there is provided a system for controlling the resources including a control pattern generation unit that generates a plurality of control patterns from a virtual system model, produced by modeling the behaviors of a network element(s) and a server(s) of a virtual system(s) operating on a virtual datacenter(s), and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), with the control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), and a control unit that carries out prediction of a service level, with the use of the control patterns, selecting, with the use of the result of prediction, such control pattern that satisfies the service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns, and putting the control pattern selected to use.
In a second aspect, there is provided a control pattern generating apparatus for generating a plurality of control patterns from a virtual system model(s), produced by modeling the behaviors of a network element(s) and a server(s) of a virtual system(s) operating on a virtual datacenter(s), and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), with the control patterns proving candidates for control commands to network resources and server resources of the virtual system(s).
In a third aspect, there is provided a control apparatus that carries out prediction of a service level, using a plurality of control patterns, with the control patterns proving candidates for control commands to network resources and server resources of a virtual system(s), selects, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns, and puts the control pattern selected to use.
In a fourth aspect, there is provided a method for controlling resources comprising generating a plurality of control patterns from a virtual system model(s), produced by modeling the behaviors of a network element(s) and a server(s) of a virtual system(s) operating on a virtual datacenter(s), and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), with the control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), carrying out prediction of a service level, with the use of the plurality of control patterns, selecting, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns, and putting the control pattern selected to use. The present method is bound up with a particular machine which is a system for controlling the resources that controls resources allocated to the virtual system(s) operating on the virtual datacenter(s).
In a fifth aspect, there is provided a program that causes a computer, making up a system for controlling the resources, to perform a processing of generating a plurality of control patterns from a virtual system model(s), produced by modeling the behaviors of a network element(s) and a server(s) of a virtual system(s) operating on a virtual datacenter(s), and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), with the control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), and a processing of carrying out prediction of a service level, with the use of the plurality of control patterns, selecting, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns, and putting the control pattern selected to use. The present program can be recorded on a computer-readable (non-transient) recording medium. That is, the present invention can be implemented as a computer program product.
The meritorious effects of the present invention are summarized as follows.
According to the present invention, resources can be efficiently allocated to the virtual system(s) operating on the virtual datacenter(s). That means that the present invention transforms the prior art structure into the a virtual system(s) in which resources are optimally allocated.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic view showing a configuration of an exemplary embodiment according to the present disclosure.
FIG. 2 is a schematic view showing a system configuration of anexemplary embodiment 1 according to the present disclosure.
FIG. 3 is a functional block diagram showing a detailed configuration of theexemplary embodiment 1 according to the present disclosure.
FIG. 4 is a schematic view showing an example virtual system operating on a virtual datacenter (vDC).
FIG. 5 is a flowchart showing the operation (processing of generation of a control pattern) of a system for controlling the resources of theexemplary embodiment 1 according to the present disclosure.
FIG. 6 is a flowchart showing the operation (autonomous control) of the system for controlling the resources of theexemplary embodiment 1 according to the present disclosure.
FIG. 7 is a tabular view showing an example of the monitoring information of the virtual system operating on the virtual datacenter (vDC).
FIG. 8 is a graph showing the virtual system ofFIG. 4.
FIG. 9 is a schematic view showing the construction information of the virtual system shown inFIG. 8.
FIG. 10 is a tabular view showing an example of an equation for prediction generated by the system for controlling the resources of theexemplary embodiment 1 according to the present disclosure.
FIG. 11 is a schematic view showing an example system model generated by the system for controlling the resources of theexemplary embodiment 1 according to the present disclosure.
FIG. 12 shows two example resource allocation policies.
FIG. 13 is a schematic view showing resource allocation change policies for matching corresponding to the resource allocation policies ofFIG. 12.
FIG. 14 is a schematic view showing a control pattern obtained on applying the resource allocation change policy (changing over load balancers) ofFIG. 12 to the virtual system model ofFIG. 11.
FIG. 15 is a graph showing the control pattern ofFIG. 14.
FIG. 16 is a schematic view showing a control pattern obtained on applying the resource allocation change policy (addition of server resources for DB) ofFIG. 12 to the virtual system model ofFIG. 11.
FIG. 17 is a schematic view continuing toFIG. 16.
FIG. 18 is a graph showing the control pattern ofFIG. 16 andFIG. 17.
FIG. 19 is a graph showing other example resource allocation change policies.
FIG. 20 is a graph showing further example resource allocation change policies.
FIG. 21 is a tabular view showing example results of simulation made using the control pattern shown inFIG. 14,FIG. 16 andFIG. 17.
FIG. 22 is a tabular view showing example service level designations of virtual systems operating on the virtual datacenters (vDCs).
FIG. 23 is a tabular view showing control patterns already evaluated (selected).
FIG. 24 is a graph showing another virtual system for illustrating the selection of control patterns.
FIG. 25 is a graph showing candidates for resource allocation change policies applicable to the virtual system shown inFIG. 24.
FIG. 26 is a schematic view for illustrating the results of the simulation with the use of the control pattern generated using the resource allocation change policies ofFIG. 25 and a candidate selected.
PREFERRED MODES
Initially, a summary of an exemplary embodiment of the present disclosure will be described with reference to the drawings. It should be noted that symbols for referencing the drawings are entered in the summary merely as examples to assist in understanding but are not intended to limit the present disclosure to the mode illustrated.
A preferred form of the present disclosure may be implemented by a controlpattern generation unit11, configured for producing a plurality of control patterns, and acontrol unit12, configured for controlling a virtual system using one selected out of the control patterns, as shown inFIG. 1. The control patterns are to become candidates of control commands to network resources and server resources of the virtual system.
More specifically, the controlpattern generation unit11 generates a plurality of control patterns from a virtual system model and from policies of changes of the allocation of resources to the virtual system. The virtual system model has been generated by modeling the behaviors of network elements and servers of the virtual system operating on a virtual datacenter. The control patterns are to become candidates of control commands to the network resources and server resources of the virtual system.
Thecontrol unit12 predicts service levels, using the above mentioned multiple control patterns. Then, based on predicted results, the control unit selects and applies such a one of the multiple control patterns which will satisfy the service levels of the virtual system as well as satisfying a preset standard or reference.
As the preset standard or reference, such a one that may lead to use of the control pattern which will minimize the quantity of consumption of the network resources as well as server resources, may be used, in which case the quantity of the use of the resources of the virtual system in question may be minimized. This may lead to an increased quantity of resources that can be allocated to other virtual datacenters (vDCs) or other virtual systems.
The above mentioned preset standard or reference is not limited to such standard or reference which will lead to use of the smallest quantity of consumption of the resources used. For example, such control pattern may be selected which will lead to a decreased quantity of consumption of whichever one of server resources or network resources that is higher in priority level in consideration of states of global tightness of the resources. Such a control pattern may also be selected which will be in keeping with the anticipated state at some future time in consideration of the statistically estimated service demand or the network traffic.
Thus, the preferred form of the present disclosure, described above, may enable optimum allocation of network and server resources. In addition, the preferred form of the present disclosure enables management costs of the virtual systems on the virtual datacenters (vDCs) to be reduced. The reason is that, since the allocated quantities of the server resources and network resources can automatically be controlled, it is possible to reduce the work load on management operators.
[Exemplary Embodiment 1 ]
Anexemplary embodiment 1 of the present disclosure will now be described in detail with reference to the drawings.FIG. 2 shows a system configuration of anexemplary embodiment 1 of the present disclosure. Referring toFIG. 2, there is shown a configuration including a plurality ofvirtual datacenters400, co-residing on a cloud platform, a virtualresource management unit300, configured for allocating resources to the virtual system(s) on thevirtual datacenter400, and a system for controlling theresources100, in a state interconnected over a network.
FIG. 3 depicts a block diagram showing a detailed configuration of theexemplary embodiment 1 of the present disclosure. A virtual datacenter (vDC)400 provides a plurality of users of the virtual datacenter with a virtual system(s) composed by a virtual appliance(s) and a virtual server(s).
FIG. 4 shows an example virtual system which the virtual datacenter (vDC)400 may provide for virtual datacenter users. In the example ofFIG. 4, there is shown a configuration including a firewall, controlling the communication between the Internet and the virtual system, a load balancer, distributing accesses from the side Internet to a plurality of Web servers, an application server and a database server (DB server). The application server and the DB server render services in response to a request(s) from the Web server(s). It should be noted that these units do not have to be physically independent and may be constructed by a virtual entity or entities. For example, the Web servers, application server or the DB server may be virtual servers constructed by server virtualization techniques. On the other hand, the firewall or the load balancer may be implemented by a particular switch or switches according to theNon-Patent Literatures 1, 2 provided that the switch or switches is configured for operating like the firewall or the load balancer.
The virtualresource management unit300 performs the functions of managing the quantities of resources allocated to the virtual system on thevirtual datacenter400 or monitoring the use states of the virtual system. Specifically, the virtualresource management unit300 includes a virtual serverresource management unit301, a virtual networkresource management unit302 and a virtual datacenter (vDC)monitoring unit303. The virtual serverresource management unit301 manages the resources of the virtual servers, such as the above mentioned Web servers, application server or DB server, and the virtual networkresource management unit302 manages network resources. ThevDC monitoring unit303 outputs use states of the virtual system to a vDCmonitoring information memory304 at a preset time interval to provide monitoring functions for the virtual system.
The system for controlling theresources100 includes a controlpattern generation unit110 and anautonomous control unit120, and provides the function of generating control patterns which will prove candidates for control commands as well as the function of selecting one control pattern which is in keeping with the operating state of the virtual system, so as to change the allocation of the resources through the virtual resource management unit.
AvDC construction memory201 stores the construction information of the virtual system operating on the virtual datacenter (vDC) configured to be controlled by the system for controlling theresources100. The construction information is shown for example inFIG. 7 andFIG. 8.
A resource allocationchange policy memory203 stores resource allocation change policies that may be applied to components making up the virtual system. See for exampleFIG. 13,FIG. 15 andFIG. 16. By the way, the values of consumption of resources, quantifying the additional resources, needed for control, are set in the resource allocation change policies. For example, see the field of the quantities of consumption of resources ofFIG. 14.
The controlpattern generation unit110 includes a predictionequation generation unit111, amodel generation unit112 and a controlpattern derivation unit113.
The predictionequation generation unit111 takes out the component information of components being predicted, such as virtual appliances or virtual servers of the virtual systems, from the construction information of the virtual system stored in thevDC construction memory201. The prediction equation generation unit then generates an equation of prediction from which to find the processing time following the changing of the quantities of the resources allocated to the respective components. The equation of prediction can be generated with the use of multivariate statistics based on the real processing time per unit request of each virtual appliance or virtual server and on the monitoring information for the quantities of resources already allocated. The processing time as being the result of the prediction can be obtained by entering the number of concurrent requests for processing anticipated at the time of the prediction as well as the quantities of allocated resources.
Themodel generation unit112 synthesizes the equation of prediction into the construction information of the virtual system stored in thevDC construction memory201 to generate a virtual system model which is an abstraction of the behaviors of the virtual system operating within the virtual datacenter (vDC).
The controlpattern derivation unit113 selects the resource allocation change policies that may be applied to the virtual system model and synthesizes the resource allocation change policies to the system model to generate a plurality of control patterns which may prove candidates of the contents of control commands. The controlpattern derivation unit113 stores the control patterns generated in acontrol pattern memory101.
Theautonomous control unit120 includes asimulation execution unit121, a controlpattern evaluation unit122 and a controlpattern exercising unit123. From the control patterns, the monitoring information for the virtual system on the virtual datacenter (vDC) and from the service level information of the virtual system, the autonomous control unit selects an optimum control pattern for the server resources and the network resources and applies or exercises the so selected optimum control pattern. The information concerning the quantities of consumption of resources may be appended as necessary to the control patterns.
Thesimulation execution unit121 takes out the control patterns of the virtual system being simulated from thecontrol pattern memory101 and enters the contents of the vDC monitoring information to simulate the behavior of the respective control patterns to predict the average processing time. The results simulated are stored in asimulation result memory124.
Using a preset control pattern selection rule, the controlpattern evaluation unit122 selects the control pattern to be applied or exercised from among the respective control patterns predicted by thesimulation execution unit121. In the subject exemplary embodiment, it is assumed that there is set a control pattern selection rule stating that such a control pattern is to be selected that the average processing time will satisfy the service level stored in aservice level memory202 and the quantity of consumption of resources will be minimal. The results of evaluation by the controlpattern evaluation unit122 are stored in an evaluatedcontrol pattern memory125.
The controlpattern exercising unit123 resolves the control pattern, selected by the controlpattern evaluation unit122, into a server resource control command and a network resource control command, and informs the virtualresource management unit300 about the resolution so as to change the allocation of the resources.
It should be noted that respective parts (processing unit) of the system for controlling the resources, shown inFIG. 1, may be implemented by a computer program that causes a computer(s) making up the system for controlling the resources to execute the above mentioned processing operations using the computer hardware. It should also be noted that components expressed as ‘means’ may also be expressed as ‘members’ or ‘units’ to denote units of the hardware, units of component parts by a computer program, or system component units.
The operation of the subject exemplary embodiment will now be described in detail with reference to the drawings. Initially, the processing of generating a control pattern by the system for controlling the resources according to theexemplary embodiment 1 will be explained by referring to a flowchart ofFIG. 5.
[Procedure of Generating a Control Pattern]
FIG. 5 depicts a flowchart showing the operation of the system for controlling the resources of theexemplary embodiment 1 of the present disclosure (the processing of generating the control pattern). Referring toFIG. 5, the predictionequation generation unit111 of the controlpattern generation unit110 initially takes out, from thevDC construction memory201, the information concerning the virtual servers and the virtual appliances that make up the virtual system operating on the virtual datacenter (vDC). The prediction equation generation unit then generates an equation of prediction that may be used to find the processing time for each of the virtual servers and the virtual appliances (loop of step A1 to step A4).
Specifically, the predictionequation generation unit111 takes out the monitoring information of a virtual system of interest from the vDCmonitoring information memory304, and acquires the processing time per a request made to the virtual server or the virtual appliance, an equation of prediction for which is being formed. The prediction equation generation unit also acquires an average number of requests within the processing time, while also acquiring, from thevDC construction memory201, the quantities of memory resources as well as the number of CPU cores, etc. allocated to the virtual servers or the virtual appliances, the equations of prediction for which are being formed (step A2).
The predictionequation generation unit111 formulates an equation showing the relationship among the per-request processing time, an average number of concurrent requests within the processing time, and the quantities of resources. The prediction equation generation unit stores the so formulated equation for prediction in a prediction equation memory114 (step A3).
To generate the equation for prediction, a method shown inPatent Literature 3, for example, may be used. The following equation for prediction:
T=γM+δ
may be obtained, where T is the processing time for the virtual server or the virtual appliance, an equation for prediction for which is being produced, M is an average number of concurrent requests, and γ, δ are coefficient and a constant used for expression as an equation.
Then, using the virtual system construction information, taken out from thevDC construction memory201, and the above mentioned equation for prediction, themodel generation unit112 generates a virtual system model for each of the virtual systems, the virtual system models for which are being generated (loop of steps A5 to A7).
Specifically, themodel generation unit112 takes out the equation for prediction from theprediction equation memory114 and appends it to the construction information of the virtual system, the virtual system model for which is being generated. This generates a virtual system model(s), which is then stored in a model memory115 (step A6).
The controlpattern derivation unit113 then collates the virtual system models, taken out from themodel memory115, against the resource allocation change policies, stating the method for changing the resource allocation, taken out from the resource allocationchange policy memory203. This selects the resource allocation change policies that may be applied to respective virtual systems (loop of steps A8 to A10).
Specifically, the controlpattern derivation unit113 pattern-matches the resource allocation change policies against the virtual system model, taken out from themodel memory115, so as to select the matching resource allocation change policy or policies (step A9).
The controlpattern derivation unit113 synthesizes the resource allocation change policy or policies, applicable to the virtual system model, taken out from themodel memory115, to one another so as to generate a control pattern(s) which is to prove a candidate for the content of the control command for the relevant system. The control pattern derivation unit stores the so generated control pattern(s) in the control pattern memory101 (loop of steps A11 to A13). By the way, the quantities of consumption of resources of the respective control pattern(s) are also associated with the control pattern(s) stored in thecontrol pattern memory101 for storage together with the control pattern(s). In the subject exemplary embodiment, a sum of the quantities of consumption of resources of the resource allocation change policies synthesized is used as the quantity of consumption of resources of the control pattern(s).
Referring to the flowchart ofFIG. 6, the autonomous control operation by the system for controlling the resources of theexemplary embodiment 1 will now be explained.
[Procedure of Generation of Control Patterns]
FIG. 6 depicts a flowchart showing the operation (autonomous control) of a system for controlling the resources of theexemplary embodiment 1 of the present disclosure. Referring toFIG. 6, thesimulation execution unit121 of theautonomous control unit120 reads out a set of control patterns concerning the virtual system operating on the virtual datacenter (vDC) from thecontrol pattern memory101, while taking out the latest monitoring information of the virtual system from the vDCmonitoring information memory304. Thesimulation execution unit121 simulates the total of the control patterns to predict the average processing time for each control pattern to store the results of the simulation in the simulation result memory124 (step B1).
The controlpattern evaluation unit122 then takes out the results of the simulation from thesimulation result memory124, while taking out the service level designation of the virtual system in question from theservice level memory202, so as to decide whether or not the average processing time is less than the service level (step B2).
If the result of the decision indicates that the average processing time exceeds the service level, that is, fails to satisfy the service level, the controlpattern evaluation unit122 exempts the control pattern from the candidates to be applied (step B3).
The controlpattern evaluation unit122 compares the control patterns, having the average processing time less than the service level, to one another, and selects the control pattern with the least quantity of consumption of resources, as an example. The control pattern evaluation unit stores the so selected control pattern in the evaluated control pattern memory125 (step B4). This selects the control pattern that is in keeping with the latest operating states of the virtual system.
The controlpattern exercising unit123 then takes out the selected control pattern from thecontrol pattern memory101 based on the information stored in the evaluatedcontrol pattern memory125. The controlpattern exercising unit123 resolves the control pattern into a server resource control command and a network resource control command, and issues control commands to the virtual serverresource management unit301 and to the virtual networkresource management unit302. This changes the allocation of resources to the virtual system on the virtual datacenter (vDC).
According to the subject exemplary embodiment, described above, theautonomous control unit120 selects and applies the optimum control pattern in keeping with the latest operating states of the virtual system on the virtual datacenter (vDC), so that it is possible to optimize allocation of resources to the virtual system.
The operation of theexemplary embodiment 1 of the present disclosure will supplementarily be explained using more concrete examples. In the explanation to follow, it is supposed that a virtual system having, as components, virtual appliances and virtual servers, such as firewalls, load balancers, Web servers, application servers and DB servers, is in operation on the virtual datacenter (vDC), as shown inFIG. 4. By the virtual appliances are meant virtual machines, operating as network appliances, such as firewalls or load balancers. ThevDC monitoring unit303 monitors the operating states of the present system from component to component to store the monitored result in the vDCmonitoring information memory304.
FIG. 7 shows examples of the monitoring information stored in the vDCmonitoring information memory304. In the examples ofFIG. 7, the monitoring information for the Web server (Web1) as well as the firewall (FW1) is stored in a virtual datacenter having a virtual data center ID (vDCID) equal to 1. In the examples ofFIG. 7, if a number of request(s) are concurrently processed in a component, the number of the requests being concurrently processed is recorded as the average number of the concurrently processed requests.
If a modeling technique, typified by Petri Net, is used, the present virtual system can be expressed by a directed bipartite graph in which a component is represented by a transition and a corresponding message by a place (circle), as shown inFIG. 8. It is only sufficient that the construction information equivalent to this directed bipartite graph is stored in thevDC construction memory201.
FIG. 9 shows the construction information of the virtual system stored in thevDC construction memory201. In the example ofFIG. 9, places are first defined and components of the virtual system of the virtual datacenter vDC are stated as transitions. Next, the information representing the concerting relationship (relationship of interconnections) among these places and transitions is stored.
[Processing of Control Pattern Generation]
Based on the above premises, the processing of generating the control pattern will be explained. Initially, the predictionequation generation unit111 of the controlpattern generation unit110 takes out the construction information of the virtual system shown inFIG. 9 from thevDC construction memory201. Then, using the names of the virtual servers and the virtual appliances, such as FW1 and Web1, stated as transitions in the above construction information, as keys, the predictionequation generation unit111 takes out the monitoring information of relevant components from the vDCmonitoring information memory304. The predictionequation generation unit111 then gets the processing time of requests of the components and the average number of the requests made within the processing time. The predictionequation generation unit111 also acquires, from thevDC construction memory201, the quantities of resources already allocated, such as the memory storage capacity or the number of CPU cores allocated to the virtual servers and appliances. Then, using the multivariate statistics, the predictionequation generation unit111 formulates the relationship among the processing time per request, the average number of concurrent requests within the processing time and the quantities of resources, as an equation of prediction.
FIG. 10 shows example equations of prediction generated by the predictionequation generation unit111 and stored in theprediction equation memory114. In the examples ofFIG. 10, the following equation of prediction:
T_web1=α3*X_p04/(γ3*cpu3+δ3*ram3)+β3
is formed, where X_p04 is the number of concurrent requests in Web1, cpu3 the number of allocated virtual CPU cores and ram3 a parameter representing an allocated RAM memory storage capacity. α3, γ3, δ3 and β3 are coefficients and an intercept as found by the multivariate statistics. By the way, there are cases where the component, such as Web server “Web1”, receives requests of different sorts. In such case, the processing time for these requests may be separately calculated and weighted averaging taken of the so calculated processing time. Or, if the requests are of different sorts but there is no difference in the processing time, the requests may be handled as requests of the same sort.
Themodel generation unit112 introduces the equation of prediction taken out from theprediction equation memory114 into the construction information of the virtual system, taken out from thevDC construction memory201, shown inFIG. 9, to generate a virtual system model, which is then stored in themodel memory115.
FIG. 11 shows an example virtual system model generated by themodel generation unit112 and stored in themodel memory115. In the example ofFIG. 11, the equation of prediction is added to each component of the construction information of the virtual system shown inFIG. 9.
The controlpattern derivation unit113 then collates the virtual system model, shown inFIG. 11, against the resource allocation change policies, so as to extract the resource allocation change policy or policies applicable to the virtual system model of interest.
FIG. 12 depicts a diagram showing resource allocation change policies A, B applicable to a load balancer on the virtual system. The resource allocation change policies are shown in the same way as the above mentioned Petri Net. The resource allocation change policy A ofFIG. 12 changes over a load balancer to a single flow controller (FC1) and two load balancers. The resource allocation change policy B ofFIG. 12 adds resources (memory and the number of CPU cores) to a load balancer.
FIG. 13 depicts a tabular view showing resource allocation change policies equivalent to the resource allocation change policies shown inFIG. 12. An example shown inFIG. 13 shows entries in which not only the policy IDs and policy names but also the information concerning patterns of application used in matching against the virtual system, detailed contents of the resource allocation change policies and the quantities of consumption of resources in case of using the resource allocation change policies ofFIG. 12, are correlated to one another.
By matching the patterns of application of the resource allocation change policy or policies, shown inFIG. 13, against the virtual system model, shown inFIG. 11, it is possible to extract the resource allocation change policy or policies applicable to the virtual system model in question. For example, the resource allocation change policy A shown inFIG. 12 andFIG. 13, in which a load balancer is changed over to one flow controller and two load balancers, matches the construction information concerning the load balancer in the virtual system model shown inFIG. 11. In similar manner, the resource allocation change policy B shown inFIG. 12 andFIG. 13, in which resources of a server for DB are added, matches the construction information concerning the DB server in the virtual system model shown inFIG. 11.
The controlpattern derivation unit113 synthesizes the resource allocation change policy or policies, obtained as described above, to generate the control pattern.FIG. 14 shows an example in which just the resource allocation change policy A of changing over the load balancer shown inFIG. 12 andFIG. 13 is applied to the virtual system model shown inFIG. 11.FIG. 15 depicts a graph equivalent toFIG. 14.
In similar manner,FIG. 16 andFIG. 17 show an example in which both the resource allocation change policy A of changing over a load balancer and the resource allocation change policy B of adding resources of the server for DB, shown inFIG. 12 andFIG. 13, are applied to the virtual system model shown inFIG. 11.FIG. 18 depicts a graph equivalent toFIG. 16 andFIG. 17. By the way, in the example ofFIG. 16, both the resource allocation change policy A of changing over the load balancer and the resource allocation change policy B of adding resources to the load balancer, shown inFIG. 12 andFIG. 13, are applied. Hence, the quantity of consumption of resources is equal to the sum of the consumption of the resources of the respective resource allocation change policies, that is, equal to “6”.
In addition, the controlpattern derivation unit113 formulates a control pattern in which just the resource allocation change policy B of adding the server resources for DB shown inFIG. 12 andFIG. 13 is applied to the virtual system model shown inFIG. 11.
In the above example, it is assumed that the number of the resource allocation change policies is two, only for simplicity of explanation. The resource allocation change policies may be broken down into a wide variety of patterns, as shown inFIG. 19 andFIG. 20. For example,FIG. 19 shows, likeFIG. 12, a resource allocation change policy in which a clone is added to a component by way of scale-out as well as a resource allocation change policy in which resources are added to a component. A resource allocation change policy, shown in an upper part ofFIG. 20, adds not only a clone but also a flow controller to a component to exercise path control. A resource allocation change policy, shown in a lower part ofFIG. 20, adds a flow controller ahead of a component to exercise flow control. The controlpattern derivation unit113 uses these resource allocation change policies alone or in combination to generate a control pattern(s).
[Sequence of Autonomous Control]
The autonomous control processing, referred to above, will now be explained. Thesimulation execution unit121 of theautonomous control unit120 reads out, from thecontrol pattern memory101, a set of control patterns of a virtual system, as a subject of the autonomous control, as shown inFIG. 14,FIG. 16 andFIG. 17. Moreover, thesimulation execution unit121 takes out, from the vDCmonitoring information memory304, the latest monitoring information (the information continuing for 30 minutes) of a firewall part of the monitoring information of the virtual system in question so as to deliver the so taken out information to the virtual system. The simulation execution unit delivers the information as input to the respective control patterns to predict the average processing time of each control pattern.FIG. 21 shows the result of the simulation of the control patterns by thesimulation execution unit121 shown inFIG. 14,FIG. 16 andFIG. 17.
The controlpattern evaluation unit122 takes out the result of the simulation from thesimulation result memory124, while also taking out the service level designations of the virtual system, shown inFIG. 22, from theservice level memory202, in order decide whether or not the average processing time predicted for the case of using each control pattern is below the service level.
If, as a result of the above decision, the average processing time of one or more control patterns exceeds a service level, the controlpattern evaluation unit122 exempts the control pattern(s) from the set of applicable candidates. The controlpattern evaluation unit122 compares the control patterns, having average processing time less than the service level, one to another, and selects the control pattern having the least consumption of resources.
For example, if the service level is set at 50 (seconds), as shown inFIG. 22, both of the control patterns ofFIG. 21 may be said to satisfy the service level. Thus, the controlpattern evaluation unit122 compares the result of the simulation shown inFIG. 21 to select the control pattern of the control pattern ID of ‘pattern1’ having the least quantity of consumption of resources.
FIG. 23 shows an example of the information on the control patterns already evaluated. The information is stored in the evaluated control patterns has been stored in the evaluatedcontrol pattern memory125. The controlpattern exercising unit123 takes out the information on the control pattern, which is the control pattern already evaluated, from thecontrol pattern memory101, and issues a control command to the virtual serverresource management unit301 and the virtual networkresource management unit302 of theresource management unit300. As a result, the virtual system, having resources allocated as shown inFIG. 8, now has resources allocated as shown inFIG. 15. The new post-change allocation of the resources has been selected based on the results of prediction by thesimulation execution unit121, and hence satisfies the service level required of the virtual system in question, as well as minimizing the quantity of consumption of resources.
Another example virtual system will now be explained in connection with selection of the control pattern.FIG. 24 depicts a directed bipartite graph showing a virtual system.FIG. 25 shows certain example resource allocation change policies applicable to the above virtual system. Acandidate1 is an example resource allocation change policy in which a load balancer and a clone Web server are added to a Web server in a virtual system. Acandidate2 is an example resource allocation change policy in which the performance of the Web server in a virtual system is reinforced. Acandidate3 is an example resource allocation change policy in which a flow controller is arranged in a pre-stage of a Web server in a virtual system and in which limitations are imposed on the number of connections.
An upper part ofFIG. 26 shows the results of service level prediction by thesimulation execution unit121 for cases where a control pattern generated with the use of each one of the above candidates is applied. If, for example, the service level is set at 5 (seconds), thecandidate3 is a control pattern that is not down to the service level, and hence is exempted from use as the control pattern. The controlpattern evaluation unit122 then compares thecandidates1 and2 to each other to select thecandidate2 with the lesser quantity of consumption of resources. As a result, the allocation of resources to the virtual system shown inFIG. 24 is changed over to that in which the Web server performance has been reinforced, as shown in a lower part ofFIG. 26.
Although a preferred exemplary embodiment of the present invention has been described above, the present invention is not to be restricted to this particular mode, such that further changes, substitutions or adjustments may be made within the range not departing from the basic technical concept of the invention. For example, there is no limitation to the network configuration or the number of elements used in the above described exemplary embodiment.
Also, in the above described exemplary embodiment, it has been set out that such a control pattern with the least quantity of the consumption of resources is to be selected out of the control patterns satisfying the service level. However, the control pattern may also be selected with the use of some other standard or reference. For example, even if a control pattern has the least quantity of the consumption of resources, but the service level predicted of the control pattern is extremely close to the required service level, such control pattern may not be selected. By so doing, it is possible to select such control pattern that is able to satisfy the service level even though the number of request has increased beyond the latest monitoring value.
It is also to possible select a control pattern as either the server resources or the network resources are prioritized in consideration of the redundant capacity of the overall system. For example, if there are two control patterns that will increase the quantity of consumption of resources by “2”, and the server resources are higher in tolerability or allowance, such a control pattern selection standard or reference that selects the control pattern that will increase the server resources by “2” may be used. In addition, when there are a control pattern that will increase the quantity of consumption of resources by “3” and a control pattern that will increase the quantity of consumption of resources by “2”, such a control pattern selection standard or reference may be used in which the control pattern that has a greater quantity of consumption of resources but that will not increase the quantity of consumption of network resources is selected.
In the above described exemplary embodiment, it has been stated that the latest monitoring information is used as input values to carry out the simulation. It is also possible to use statistics information or a variety of correction values to carry out simulation to higher precision.
Also, in the above described exemplary embodiment, such a resource allocation change policy is used in which allocation of resources is changed in an increasing direction. It is however also possible to use a resource allocation change policy in which allocation of resources is changed in a decreasing direction. In such case, the graph shown on the right side ofFIG. 12 is a pattern of application and the graph shown on the left side ofFIG. 12 is a resource allocation change policy. In this case, the quantity of consumption of resources will have a negative value.
Finally, certain referred modes of the present invention will be summarized.
[Mode 1]
  • (Reference is made to the system for controlling the resources according to the first aspect).
    [Mode 2]
The system for controlling the resources according tomode 1, wherein,
the control pattern generation unit generates a plurality of control patterns for each of the virtual systems of the virtual datacenters co-residing on a cloud platform;
the control unit selects the control pattern(s) for the virtual system(s) of each virtual datacenter and putting the control pattern(s) to use.
[Mode 3]
The system for controlling the resources according tomode 1 or 2, wherein,
the preset standard or reference for selection is such a one that selects, from among a plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources.
[Mode 4]
The system for controlling the resources according to any one ofmodes 1 to 3, wherein,
the preset standard or reference for selection is such a one that selects, from among a plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources of the server resources or the network resources, whichever are higher in the priority level.
[Mode 5]
The system for controlling the resources according to any one ofmodes 1 to 4, wherein,
the control pattern generation unit includes
a prediction equation generation unit that generates, for each of the network element(s) and the server(s) of the virtual system(s), operating on the virtual datacenter(s), an equation of prediction for predicting the processing time for the case of having changed the resources allocated based on the quantity of resources already allocated and on the results of measurement of processing time for the case of using the quantity of resources already allocated;
a virtual system model generation unit that generates the virtual system model(s) using the construction information of the virtual system(s) operating on the virtual datacenter(s) and also using the equation of prediction generated by the prediction equation generation unit; and
a control pattern derivation unit that synthesizes a configuration included in the virtual system model generated by the virtual system model generation unit and the resource allocation change policy applicable together so as to form the control pattern.
[Mode 6]
The system for controlling the resources according to any one ofmodes 1 to 5, wherein,
the control unit includes
a simulation execution unit that executes simulation of predicting a service level using the plurality of the control patterns;
a control pattern evaluation unit that selects, based on the result of the simulation, such control pattern that satisfies the service level of the virtual system as well as satisfying the preset standard or reference; and
a control pattern applying unit that changes the allocation of the network resources and the server resources in accordance with the selected control pattern.
[Mode 7]
The system for controlling the resources according to any one ofmodes 1 to 6, wherein,
a resource allocation change policy or policies for carrying out path control and flow control is among the resource allocation change policies.
[Mode 8]
  • (Reference is made to the apparatus for generating a control pattern according to the second aspect).
    [Mode 9]
  • (Reference is made to the control apparatus according to the third aspect).
    [Mode 10]
  • (Reference is made to the method for controlling resources according to the fourth aspect).
    [Mode 11]
  • (Reference is made to the program according to the fifth aspect).
It should be noted that the modes 8 to themode 11 may be expanded to themodes 2 to 7 as is themode 1.
The disclosures of the above mentioned Patent Literatures and Non-Patent Literatures are to be incorporated herein by reference. The exemplary embodiments or Examples may be modified or adjusted within the concept of the total disclosures of the present invention, inclusive of claims, based on the fundamental technical concept of the invention. A series of combinations or selections of elements herein disclosed (elements of claims, Examples and drawings) may be made within the context of the claims of the present invention. That is, the present invention may include a wide variety of changes or corrections that may occur to those skilled in the art in accordance with the total disclosures inclusive of the claims and the drawings as well as the technical concept of the invention. In particular, it should be understood that any optional numerical figures or sub-ranges contained in the ranges of numerical values set out herein ought to be construed to be specifically stated even in the absence of explicit statements.

Claims (20)

The invention claimed is:
1. A system for controlling resources comprising:
a control pattern generation unit that generates a plurality of control patterns from virtual system model(s), produced by modeling the behaviors of network element(s) and server(s) of virtual system(s) operating on virtual datacenter(s), and from a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), the plurality of control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), wherein the control pattern generation unit includes:
a prediction equation generation unit that generates, for each of the network element(s) and the server(s) of the virtual system(s), operating on the virtual datacenter(s), an equation of prediction for predicting the processing time for the case of having changed the resources allocated based on the quantity of resources already allocated and on the results of measurement of processing time for the case of using the quantity of resources already allocated;
a virtual system model generation unit that generates the virtual system model(s) using the construction information of the virtual system(s) operating on the virtual datacenter(s) and also using the equation of prediction generated by the prediction equation generation unit; and
a control pattern derivation unit that synthesizes a configuration included in the virtual system model(s) generated by the virtual system model generation unit and the resource allocation change policy applicable together so as to form the control pattern; and
a control unit that carries out prediction of a service level, with the use of the plurality of control patterns, selecting, with the use of the result of prediction, such control pattern that satisfies the service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns, and putting the selected control pattern to use, wherein the control unit includes:
a simulation execution unit that exercises simulation of predicting a service level using the plurality of the control patterns;
a control pattern evaluation unit that selects, based on the result of the simulation, such control pattern that satisfies the service level of the virtual system as well as the preset standard or reference; and
a control pattern applying unit that changes an allocation of the network resources and the server resources in accordance with the selected control pattern.
2. The system for controlling the resources according toclaim 1, wherein,
the control pattern generation unit generates the plurality of control patterns for each of the virtual system(s) of the virtual datacenter(s) co-residing on a cloud platform;
the control unit selecting the control pattern(s) for the virtual system(s) of each virtual datacenter and putting the control pattern(s) to use.
3. The system for controlling the resources according toclaim 1, wherein,
the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources.
4. The system for controlling the resources according toclaim 1, wherein,
the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources of the server resources or the network resources, whichever are higher in the priority level.
5. The system for controlling the resources according toclaim 1, wherein,
a resource allocation change policy or policies for carrying out path control and flow control is among the resource allocation change policies.
6. A method for controlling resources comprising:
(a) generating a plurality of control patterns from virtual system model(s), produced by modeling the behaviors of network element(s) and server(s) of virtual system(s) operating on virtual datacenter(s), the plurality of control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), wherein generating the plurality of control patterns from the virtual system model(s) includes:
generating, for each of the network element(s) and the server(s) of the virtual system(s), operating on the virtual datacenter(s), an equation of prediction for predicting the processing time for the case of having changed the resources allocated based on the quantity of resources already allocated and on the results of measurement of processing time for the case of using the quantity of resources already allocated;
generating the virtual system model(s) using the construction information of the virtual system(s) operating on the virtual datacenter(s) and also using the generated equation of prediction; and
synthesizing a configuration included in the generated virtual system model(s) and a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), so as to form the control pattern;
(b) carrying out prediction of a service level, by exercising simulation using the plurality of control patterns;
(c) selecting, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns; and
(d) putting the selected control pattern to use by changing an allocation of the network resources and the server resources in accordance with the selected control pattern.
7. The method ofclaim 6, further comprising:
generating the plurality of control patterns for each of the virtual system(s) of the virtual datacenter(s) co-residing on a cloud platform; and
selecting the control pattern(s) for the virtual system(s) of each virtual datacenter and putting the control pattern(s) to use.
8. The method ofclaim 6, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources.
9. The method ofclaim 6, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources of the server resources or the network resources, whichever are higher in the priority level.
10. The method ofclaim 6, wherein a resource allocation change policy or policies for carrying out path control and flow control is among the resource allocation change policies.
11. A non-transitory computer-readable recording medium storing thereon a program that causes a computer, making up a system for controlling the resources, to perform a processing of:
(a) generating a plurality of control patterns from virtual system model(s), produced by modeling the behaviors of network element(s) and server(s) of virtual system(s) operating on virtual datacenter(s), the plurality of control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), wherein generating the plurality of control patterns from the virtual system model(s) includes:
generating, for each of the network element(s) and the server(s) of the virtual system(s), operating on the virtual datacenter(s), an equation of prediction for predicting the processing time for the case of having changed the resources allocated based on the quantity of resources already allocated and on the results of measurement of processing time for the case of using the quantity of resources already allocated;
generating the virtual system model(s) using the construction information of the virtual system(s) operating on the virtual datacenter(s) and also using the generated equation of prediction; and
synthesizing a configuration included in the generated virtual system model(s) and a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), so as to form the control pattern;
(b) carrying out prediction of a service level, by exercising simulation using the plurality of control patterns;
(c) selecting, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns; and
(d) putting the selected control pattern to use by changing an allocation of the network resources and the server resources in accordance with the selected control pattern.
12. The non-transitory computer-readable recording medium ofclaim 11, wherein the program further causes the computer to perform a processing of:
generating the plurality of control patterns for each of the virtual system(s) of the virtual datacenter(s) co-residing on a cloud platform; and
selecting the control pattern(s) for the virtual system(s) of each virtual datacenter and putting the control pattern(s) to use.
13. The non-transitory computer-readable recording medium ofclaim 11, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources.
14. The non-transitory computer-readable recording medium ofclaim 11, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources of the server resources or the network resources, whichever are higher in the priority level.
15. The non-transitory computer-readable recording medium ofclaim 11, wherein a resource allocation change policy or policies for carrying out path control and flow control is among the resource allocation change policies.
16. A system for controlling resources comprising:
one or more processors; and
one or more memories storing program(s) that causes the one or more processors to perform a processing of:
(a) generating a plurality of control patterns from virtual system model(s), produced by modeling the behaviors of network element(s) and server(s) of virtual system(s) operating on virtual datacenter(s), the plurality of control patterns proving candidates for control commands to network resources and server resources of the virtual system(s), wherein generating the plurality of control patterns from the virtual system model(s) includes:
generating, for each of the network element(s) and the server(s) of the virtual system(s), operating on the virtual datacenter(s), an equation of prediction for predicting the processing time for the case of having changed the resources allocated based on the quantity of resources already allocated and on the results of measurement of processing time for the case of using the quantity of resources already allocated;
generating the virtual system model(s) using the construction information of the virtual system(s) operating on the virtual datacenter(s) and also using the generated equation of prediction; and
synthesizing a configuration included in the generated virtual system model(s) and a resource allocation change policy stipulating a policy or policies of change of allocation of resources to the virtual system(s), so as to form the control pattern;
(b) carrying out prediction of a service level, by exercising simulation using the plurality of control patterns;
(c) selecting, with the use of the result of prediction, such control pattern that satisfies a service level of the virtual system(s) and that also satisfies a preset standard or reference for selection, from among the plurality of control patterns; and
(d) putting the selected control pattern to use by changing an allocation of the network resources and the server resources in accordance with the selected control pattern.
17. The system ofclaim 16, wherein the program(s) further causes the one or more processors to perform a processing of:
generating the plurality of control patterns for each of the virtual system(s) of the virtual datacenter(s) co-residing on a cloud platform; and
selecting the control pattern(s) for the virtual system(s) of each virtual datacenter and putting the control pattern(s) to use.
18. The system ofclaim 16, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources.
19. The system ofclaim 16, wherein the preset standard or reference for selection is such a one that selects, from among the plurality of the control patterns satisfying the service level, such a control pattern having a lesser quantity of consumption of resources of the server resources or the network resources, whichever are higher in the priority level.
20. The system ofclaim 16, wherein a resource allocation change policy or policies for carrying out path control and flow control is among the resource allocation change policies.
US14/761,8002013-02-012014-01-31System for controlling resources, control pattern generation apparatus, control apparatus, method for controlling resources and programActive2034-09-10US9740534B2 (en)

Applications Claiming Priority (3)

Application NumberPriority DateFiling DateTitle
JP20130182022013-02-01
JP2013-0182022013-02-01
PCT/JP2014/052239WO2014119719A1 (en)2013-02-012014-01-31Resource control system, control pattern generation device, control device, resource control method and program

Publications (2)

Publication NumberPublication Date
US20150363240A1 US20150363240A1 (en)2015-12-17
US9740534B2true US9740534B2 (en)2017-08-22

Family

ID=51262416

Family Applications (1)

Application NumberTitlePriority DateFiling Date
US14/761,800Active2034-09-10US9740534B2 (en)2013-02-012014-01-31System for controlling resources, control pattern generation apparatus, control apparatus, method for controlling resources and program

Country Status (5)

CountryLink
US (1)US9740534B2 (en)
EP (1)EP2953024A1 (en)
JP (1)JP6380110B2 (en)
CN (1)CN104981782B (en)
WO (1)WO2014119719A1 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US10097410B2 (en)*2014-06-262018-10-09Vmware, Inc.Methods and apparatus to scale application deployments in cloud computing environments
CN107637037B (en)2015-04-072021-09-28安博科技有限公司System and method for virtual interfaces and advanced intelligent routing in a global virtual network
WO2017147331A1 (en)*2016-02-242017-08-31Alibaba Group Holding LimitedUser behavior-based dynamic resource adjustment
US10796035B1 (en)*2016-03-212020-10-06EMC IP Holding Company LLCComputing system with simulated hardware infrastructure to support development and testing of management and orchestration software
US20200013107A1 (en)*2017-03-302020-01-09Nec CorporationRecommendation system, method, apparatus and program
US11095617B2 (en)2017-12-042021-08-17Nicira, Inc.Scaling gateway to gateway traffic using flow hash
US11347561B1 (en)*2018-04-302022-05-31Vmware, Inc.Core to resource mapping and resource to core mapping
JP2019211890A (en)*2018-06-012019-12-12日本電信電話株式会社Device and method for managing resource reservations
US20200106714A1 (en)2018-09-282020-04-02Element Ai Inc.System and method for managing network resources
US11184234B2 (en)*2019-04-162021-11-23Ciena CorporationSelf-optimizing fabric architecture and self-assembling network
CN115004215B (en)*2020-01-242025-07-01发那科株式会社 Data collection device
US11635981B2 (en)*2020-08-252023-04-25Microsoft Technology Licensing, LlcVirtualizing shared computing resources
US12113773B2 (en)2021-06-072024-10-08VMware LLCDynamic path selection of VPN endpoint
US12107834B2 (en)2021-06-072024-10-01VMware LLCMulti-uplink path quality aware IPsec
US11863514B2 (en)2022-01-142024-01-02Vmware, Inc.Performance improvement of IPsec traffic using SA-groups and mixed-mode SAs
US11956213B2 (en)2022-05-182024-04-09VMware LLCUsing firewall policies to map data messages to secure tunnels
US20230388180A1 (en)*2022-05-312023-11-30Microsoft Technology Licensing, LlcTechniques for provisioning workspaces in cloud-based computing platforms

Citations (33)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20070006218A1 (en)*2005-06-292007-01-04Microsoft CorporationModel-based virtual system provisioning
JP2007028035A (en)2005-07-142007-02-01Nippon Telegr & Teleph Corp <Ntt> Communication service control system, method and program
US20070220149A1 (en)*2006-03-152007-09-20Masanori KawashimaLoad balance control method and load balance control apparatus in data-processing system
JP2007305101A (en)2006-04-102007-11-22Fujitsu Ltd Resource brokering program, recording medium recording the program, resource brokering apparatus, and resource brokering method
US20070271560A1 (en)*2006-05-182007-11-22Microsoft CorporationDeploying virtual machine to host based on workload characterizations
US20080034093A1 (en)*2006-08-012008-02-07Hiromi SutouSystem and method for managing resources
US20080163194A1 (en)*2007-01-022008-07-03Daniel Manuel DiasMethod and apparatus for deploying a set of virtual software resource templates to a set of nodes
US20080172673A1 (en)*2007-01-152008-07-17International Business Machines CorporationPrediction based resource matching for grid environments
JP2008203934A (en)2007-02-162008-09-04Nec CorpDistributed workflow simulation system, method and program
US20080221941A1 (en)*2007-03-092008-09-11Ludmila CherkasovaSystem and method for capacity planning for computing systems
US20080270595A1 (en)*2007-04-302008-10-30Jerome RoliaSystem and method for generating synthetic workload traces
US20080271039A1 (en)*2007-04-302008-10-30Jerome RoliaSystems and methods for providing capacity management of resource pools for servicing workloads
WO2009144822A1 (en)2008-05-302009-12-03富士通株式会社Device configuration information management program, device configuration information management device, and device configuration information management method
US20100050172A1 (en)*2008-08-222010-02-25James Michael FerrisMethods and systems for optimizing resource usage for cloud-based networks
US20100199267A1 (en)*2009-01-302010-08-05Jerome RoliaSizing an infrastructure configuration optimized for a workload mix using a predictive model
US20100281478A1 (en)*2009-05-012010-11-04Microsoft CorporationMultiphase virtual machine host capacity planning
US20110214124A1 (en)*2010-02-262011-09-01James Michael FerrisSystems and methods for generating cross-cloud computing appliances
US20110307901A1 (en)*2009-01-302011-12-15Blanding William HSystem and method for integrating capacity planning and workload management
US8087025B1 (en)*2004-06-302011-12-27Hewlett-Packard Development Company, L.P.Workload placement among resource-on-demand systems
US8104038B1 (en)*2004-06-302012-01-24Hewlett-Packard Development Company, L.P.Matching descriptions of resources with workload requirements
US8117613B2 (en)*2009-04-082012-02-14Microsoft CorporationOptimized virtual machine migration mechanism
US20120060167A1 (en)*2010-09-082012-03-08Salsburg Michael AMethod and system of simulating a data center
US20120284380A1 (en)*2011-05-032012-11-08International Business Machines CorporationIdentifying optimal virtual machine images in a networked computing environment
US20120284408A1 (en)*2011-05-042012-11-08International Business Machines CorporationWorkload-aware placement in private heterogeneous clouds
US20130138812A1 (en)*2011-11-252013-05-30Marcos Dias De AssuncaoSystem, method and program product for cost-aware selection of templates for provisioning shared resources
US20130185433A1 (en)*2012-01-132013-07-18Accenture Global Services LimitedPerformance interference model for managing consolidated workloads in qos-aware clouds
US8555287B2 (en)*2006-08-312013-10-08Bmc Software, Inc.Automated capacity provisioning method using historical performance data
US8627309B2 (en)*2010-02-252014-01-07Microsoft CorporationAutomated deployment and servicing of distributed applications
US20140019965A1 (en)*2012-07-132014-01-16Douglas M. NeuseSystem and method for automated assignment of virtual machines and physical machines to hosts with right-sizing
US8645529B2 (en)*2010-10-062014-02-04Infosys LimitedAutomated service level management of applications in cloud computing environment
US20140095693A1 (en)*2012-09-282014-04-03Caplan Software Development S.R.L.Automated Capacity Aware Provisioning
US8756307B1 (en)*2007-07-302014-06-17Hewlett-Packard Development Company, L.P.Translating service level objectives to system metrics
US8806487B2 (en)*2011-01-142014-08-12Nec Laboratories America, Inc.Calculating virtual machine resource utilization information

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
JP2010218307A (en)*2009-03-172010-09-30Hitachi LtdDistributed calculation controller and method
JP5556507B2 (en)*2010-08-302014-07-23富士通株式会社 Virtual machine management program, virtual machine management method, and virtual machine management apparatus
CN102004671B (en)*2010-11-152013-03-13北京航空航天大学Resource management method of data center based on statistic model in cloud computing environment

Patent Citations (35)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US8087025B1 (en)*2004-06-302011-12-27Hewlett-Packard Development Company, L.P.Workload placement among resource-on-demand systems
US8104038B1 (en)*2004-06-302012-01-24Hewlett-Packard Development Company, L.P.Matching descriptions of resources with workload requirements
US20070006218A1 (en)*2005-06-292007-01-04Microsoft CorporationModel-based virtual system provisioning
JP2007028035A (en)2005-07-142007-02-01Nippon Telegr & Teleph Corp <Ntt> Communication service control system, method and program
US20070220149A1 (en)*2006-03-152007-09-20Masanori KawashimaLoad balance control method and load balance control apparatus in data-processing system
JP2007249445A (en)2006-03-152007-09-27Hitachi Ltd Method and apparatus for controlling load distribution in cluster system
JP2007305101A (en)2006-04-102007-11-22Fujitsu Ltd Resource brokering program, recording medium recording the program, resource brokering apparatus, and resource brokering method
US20070271560A1 (en)*2006-05-182007-11-22Microsoft CorporationDeploying virtual machine to host based on workload characterizations
US20080034093A1 (en)*2006-08-012008-02-07Hiromi SutouSystem and method for managing resources
JP2008033852A (en)2006-08-012008-02-14Hitachi Ltd Resource management system and method
US8555287B2 (en)*2006-08-312013-10-08Bmc Software, Inc.Automated capacity provisioning method using historical performance data
US20080163194A1 (en)*2007-01-022008-07-03Daniel Manuel DiasMethod and apparatus for deploying a set of virtual software resource templates to a set of nodes
US20080172673A1 (en)*2007-01-152008-07-17International Business Machines CorporationPrediction based resource matching for grid environments
JP2008203934A (en)2007-02-162008-09-04Nec CorpDistributed workflow simulation system, method and program
US20080221941A1 (en)*2007-03-092008-09-11Ludmila CherkasovaSystem and method for capacity planning for computing systems
US20080271039A1 (en)*2007-04-302008-10-30Jerome RoliaSystems and methods for providing capacity management of resource pools for servicing workloads
US20080270595A1 (en)*2007-04-302008-10-30Jerome RoliaSystem and method for generating synthetic workload traces
US8756307B1 (en)*2007-07-302014-06-17Hewlett-Packard Development Company, L.P.Translating service level objectives to system metrics
WO2009144822A1 (en)2008-05-302009-12-03富士通株式会社Device configuration information management program, device configuration information management device, and device configuration information management method
US20100050172A1 (en)*2008-08-222010-02-25James Michael FerrisMethods and systems for optimizing resource usage for cloud-based networks
US20100199267A1 (en)*2009-01-302010-08-05Jerome RoliaSizing an infrastructure configuration optimized for a workload mix using a predictive model
US20110307901A1 (en)*2009-01-302011-12-15Blanding William HSystem and method for integrating capacity planning and workload management
US8117613B2 (en)*2009-04-082012-02-14Microsoft CorporationOptimized virtual machine migration mechanism
US20100281478A1 (en)*2009-05-012010-11-04Microsoft CorporationMultiphase virtual machine host capacity planning
US8627309B2 (en)*2010-02-252014-01-07Microsoft CorporationAutomated deployment and servicing of distributed applications
US20110214124A1 (en)*2010-02-262011-09-01James Michael FerrisSystems and methods for generating cross-cloud computing appliances
US20120060167A1 (en)*2010-09-082012-03-08Salsburg Michael AMethod and system of simulating a data center
US8645529B2 (en)*2010-10-062014-02-04Infosys LimitedAutomated service level management of applications in cloud computing environment
US8806487B2 (en)*2011-01-142014-08-12Nec Laboratories America, Inc.Calculating virtual machine resource utilization information
US20120284380A1 (en)*2011-05-032012-11-08International Business Machines CorporationIdentifying optimal virtual machine images in a networked computing environment
US20120284408A1 (en)*2011-05-042012-11-08International Business Machines CorporationWorkload-aware placement in private heterogeneous clouds
US20130138812A1 (en)*2011-11-252013-05-30Marcos Dias De AssuncaoSystem, method and program product for cost-aware selection of templates for provisioning shared resources
US20130185433A1 (en)*2012-01-132013-07-18Accenture Global Services LimitedPerformance interference model for managing consolidated workloads in qos-aware clouds
US20140019965A1 (en)*2012-07-132014-01-16Douglas M. NeuseSystem and method for automated assignment of virtual machines and physical machines to hosts with right-sizing
US20140095693A1 (en)*2012-09-282014-04-03Caplan Software Development S.R.L.Automated Capacity Aware Provisioning

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"OpenFlow Switch Specification" Version 1.3.1 (Wire Protocol 0×04), Sep. 6, 2012.
International Search Report for PCT Application No. PCT/JP2014/052239, mailed on Mar. 18, 2014.
Nick McKeown and seven others, "OpenFlow: Enabling Innovation in Campus Networks", Mar. 14, 2008.

Also Published As

Publication numberPublication date
US20150363240A1 (en)2015-12-17
CN104981782A (en)2015-10-14
JP6380110B2 (en)2018-08-29
WO2014119719A1 (en)2014-08-07
EP2953024A1 (en)2015-12-09
JPWO2014119719A1 (en)2017-01-26
CN104981782B (en)2019-03-26

Similar Documents

PublicationPublication DateTitle
US9740534B2 (en)System for controlling resources, control pattern generation apparatus, control apparatus, method for controlling resources and program
Gouareb et al.Virtual network functions routing and placement for edge cloud latency minimization
Rankothge et al.Towards making network function virtualization a cloud computing service
Yoshida et al.MORSA: A multi-objective resource scheduling algorithm for NFV infrastructure
CN110011863B (en)Network bandwidth resource balanced scheduling method and device
Rankothge et al.Experimental results on the use of genetic algorithms for scaling virtualized network functions
CN113348651A (en)Dynamic inter-cloud placement of sliced virtual network functions
CN105122772A (en) Exchange server state and client information via headers for request management and load balancing
Tajiki et al.CECT: computationally efficient congestion-avoidance and traffic engineering in software-defined cloud data centers
Tajiki et al.Optimal Qos-aware network reconfiguration in software defined cloud data centers
Lin et al.Column generation based service function chaining embedding in multi-domain networks
Reis et al.A biased random‐key genetic algorithm for OSPF and DEFT routing to minimize network congestion
Dezhabad et al.Learning-based dynamic scalable load-balanced firewall as a service in network function-virtualized cloud computing environments
Leivadeas et al.Balancing delay and cost in virtual network function placement and chaining
Baresi et al.PAPS: A framework for decentralized self-management at the edge
Farkiani et al.Prioritized deployment of dynamic service function chains
Mahdizadeh et al.Task scheduling and load balancing in SDN-based cloud computing: A review of relevant research
Bolodurina et al.Development and research of models of organization distributed cloud computing based on the software-defined infrastructure
Gharbaoui et al.An experimental study on latency-aware and self-adaptive service chaining orchestration in distributed NFV and SDN infrastructures
Shang et al.Network congestion-aware online service function chain placement and load balancing
CN113490279A (en)Network slice configuration method and device
Garg et al.Heuristic and reinforcement learning algorithms for dynamic service placement on mobile edge cloud
Beshley et al.Traffic engineering and QoS/QoE supporting techniques for emerging service-oriented software-defined network
Zhou et al.Balancing load: An adaptive traffic management scheme for microservices
Gadre et al.Centralized approaches for virtual network function placement in SDN-enabled networks

Legal Events

DateCodeTitleDescription
ASAssignment

Owner name:NEC CORPORATION, JAPAN

Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KOIZUMI, SEIICHI;REEL/FRAME:036117/0503

Effective date:20150624

STCFInformation on status: patent grant

Free format text:PATENTED CASE

MAFPMaintenance fee payment

Free format text:PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment:4

ASAssignment

Owner name:NEC ASIA PACIFIC PTE LTD., SINGAPORE

Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEC CORPORATION;REEL/FRAME:063349/0459

Effective date:20230414

ASAssignment

Owner name:IP WAVE PTE LTD., SINGAPORE

Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEC ASIA PACIFIC PTE LTD.;REEL/FRAME:066376/0276

Effective date:20240118

ASAssignment

Owner name:CLOUD BYTE LLC., DELAWARE

Free format text:ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IP WAVE PTE LTD.;REEL/FRAME:067944/0332

Effective date:20240305

MAFPMaintenance fee payment

Free format text:PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment:8


[8]ページ先頭

©2009-2025 Movatter.jp