US20140040473A1 - Optimization scheduler for deploying applications on a cloud - Google Patents

Abstract

A system is provided to deploy a computing application on a cloud using optimization criteria. The system comprises a launch request detector to detect a request to launch a computing application within a virtualization service, an application requirement detector to determine application requirement for the computing application, a cloud resource inventory detector to determine cloud resource inventory, an optimization requirement detector, a matching module, and a configuration module. The optimization requirement detector may be configured to determine an optimization requirement. The matching module may be configured to perform matching of the application requirement with the resource inventory based on the optimization requirement. The configuration module may be configured to generate an optimized application deployment configuration based on the result of the matching and cause launching of the computing application within the virtualization service using the optimized application deployment configuration.

Description

• This disclosure relates generally to the technical fields of software and/or hardware technology and, in one example embodiment, to system and method to deploy a computing application on a cloud using optimized configuration.
BACKGROUND
• The approaches described in this section could be pursued, but are not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
• The phrase “cloud computing” refers to an architectural paradigm, in which computation is moved from local servers to a remote service that provides computation as a commodity or utility. A “cloud” is typically a large collection of shared commodity computation resources that can be interchangeably provisioned in response to clients' computation requests. Cloud computing is frequently used in software-as-a-service (SaaS) application architectures and may be viewed as an implementation choice for application deployment that leverages shared resources and improved cost structure of the cloud. A cloud computing approach may be used to implement a variety of computational paradigms, such as virtual machines, jobs, remote procedure calls, traditional servers, etc.
BRIEF DESCRIPTION OF DRAWINGS
• Embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
• FIG. 1 is a block diagram showing an architecture within which a method and system to provision and manage a computing application deployed on a cloud may be implemented, in accordance with an example embodiment;
• FIG. 2 is a diagrammatic representation of an example application requirement and an example resource inventory that may be used for determining a resource model, in accordance with an example embodiment;
• FIG. 3 is a diagrammatic representation of application description, deployment description, and infrastructure description, in accordance with an example embodiment;
• FIG. 4 is a block diagram illustrating some components of a smart scheduler, in accordance with an example embodiment;
• FIG. 5 is a flow chart illustrating a method for determining an optimized configuration for deploying a computing application on a cloud, in accordance with an example embodiment; and
• FIG. 6 is a diagrammatic representation of a machine in the example form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
DETAILED DESCRIPTION
• In the following detailed description, numerous specific claimed details are set forth to provide a thorough understanding of subject matter. However, it will be understood by those skilled in the art that claimed subject matter may be practiced without these specific details. In other instances, methods, apparatuses or systems that would be known by one of ordinary skill have not been described in detail so as not to obscure claimed subject matter.
• Some portions of the detailed description which follow are presented in terms of algorithms or symbolic representations of operations on binary digital signals stored within a memory of a specific apparatus or special purpose computing device or platform. In the context of this particular specification, the term specific apparatus or the like includes a general purpose computer once it is programmed to perform particular functions pursuant to instructions from program software. Algorithmic descriptions or symbolic representations are examples of techniques used by those of ordinary skill in the signal processing or related arts to convey the substance of their work to others skilled in the art. An algorithm is here, and generally, considered to be a self-consistent sequence of operations or similar signal processing leading to a desired result. In this context, operations or processing involve physical manipulation of physical quantities. Typically, although not necessarily, such quantities may take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared or otherwise manipulated. It has proven convenient at times, principally for reasons of common usage, to refer to such signals as bits, data, values, elements, symbols, characters, terms, numbers, numerals or the like. It should be understood, however, that all of these or similar terms are to be associated with appropriate physical quantities and are merely convenient labels. Unless specifically stated otherwise, as apparent from the following discussion, it is appreciated that throughout this specification discussions utilizing terms such as “processing,” “computing,” “calculating,” “determining” or the like refer to actions or processes of a specific apparatus, such as a special purpose computer or a similar special purpose electronic computing device. In the context of this specification, therefore, a special purpose computer or a similar special purpose electronic computing device is capable of manipulating or transforming signals, typically represented as physical electronic or magnetic quantities within memories, registers, or other information storage devices, transmission devices, or display devices of the special purpose computer or similar special purpose electronic computing device.
• A computing application (also referred as merely an application) may be made available to users by deploying the application on one or more virtual instances of a machine running on a cloud, i.e., within a public virtualization space, such as, e.g., the virtualization space provided by Amazon Elastic Compute Cloud (EC2) service. The manner in which an application can be deployed on a cloud depends on application requirement with respect to resources on one hand, and also on the availability of resources (resource inventory) that can be provided to the application by the virtualization service provider. A virtualization service provider may also be referred to a cloud provider. Often, more than a single application deployment configuration may satisfy application requirement given a particular resource inventory. For example, an application may be deployed on a cloud using varying number of virtual instances of a machine, the application may be deployed using different or multiple virtualization service providers, the virtual instance of a machine running the application (or one or more components of an application) may be started and stopped according to the need of the users, etc. One of these different application deployment configurations may be most cost effective (e.g., deploying the application on a fewer number of virtual instances of a machine), while another application deployment configuration may be characterized by greater performance at a higher cost (e.g., deploying the application on a greater number of virtual instances of a machine).
• In one embodiment, method and system are provided to determine the optimized configuration for deploying the application on a cloud based on a determined optimization goal. The optimization goal may be, e.g., the lowest cost, higher availability of the application to users, greater reliability, etc. The optimized configuration may be determined by matching application requirement with a resource model. A resource model, also termed resource inventory, may describe what type of resources (e.g., CPU, Disk, Memory, and Network) can be made available to the application, their capacity, and their usage charge. A system to determine the optimized configuration for deploying an application on a cloud may be termed a smart scheduler.
• Application requirement may be provided to the smart scheduler together with a request to launch the application or, alternatively, the application may be registered with the smart scheduler, such that the application requirement information is obtained and stored at a location accessible by the smart scheduler prior to any launch request. A smart scheduler may also be configured to obtain resource inventory with respect to one or more cloud providers. In one embodiment, he resource inventory may be captured, e.g., by accessing a web site of the provider of a virtualization service. The optimization goal information may be provided to the smart scheduler, e.g., together with the request to launch an application or at the time when (and if) the application is registered with the smart scheduler.
• The requested application is launched on a cloud by instructing the cloud provider to access one or more machine images containing the application description and load the one or more machine images onto the physical machines provided by the cloud provider and make it accessible to the user via a network. A machine image is a read-only boot image that is used for launching an instance of a virtual machine running one or more components of the requested computing application. One or more machine images representing a computing application may be provided to a network storage system (e.g., AmazonS3) by a control server (also referred to as a controller).
• A system that provisions and manages a computing application hosted on one or more virtual instances of a machine may be referred to as a hosted service system. A hosted service system may include a smart scheduler and may be configured to provide automated administration of a computing application, replacing the administration tasks that would otherwise be performed by the customer when running in an on-premise production deployment. The technology within an example hosted service system may hide the behavior of the underlying virtualization service, and provide instances of a computing application that are substantially indistinguishable (e.g., in terms of reliability, security, and performance) from local on-premise deployments of the computing application. For example, a hosted service system may provision and manage computing applications such as a generic content server, Adobe® LiveCycle® Enterprise Suite (ES) and Adobe® ConnectPro® offered by Adobe Systems Incorporated, etc. While embodiments of the smart scheduler are described with reference to Amazon EC2 service, other virtualization services may be utilized.
• In operation, a user can access a provider's web site and request to launch a computing application that can be deployed remotely on a plurality of virtual instances of a machine (on a cloud) such that the user no longer is required to deploy the computing application locally, within their own data center, on their own hardware. A request may be triggered by a user, e.g., by activating a visual control such as a “Start” button presented on a web page. When a smart scheduler provided at the hosted service system receives a request to launch a computing application on a cloud, the smart scheduler, in response, determines application requirement and a resource model based on a cloud resource inventory, and determines an optimized application deployment configuration. Then, a call is made to the application programming interface (API) associated with the virtualization service to trigger the loading of one or more machine images associated with the requested computing application using the optimized application deployment configuration. For example, the smart scheduler can instruct the virtualization service host to start ten small-capacity servers rather than five greater-capacity servers, if the ten-server configuration offers to the application the same CPU power at a lower cost. The smart scheduler may also be configured to instruct the virtualization service host to start a CPU-intensive task using a first virtualization service and start an I/O-intensive task using a different virtualization service, based on respective pricing models of the two virtualization service providers. The smart scheduler may also be configured to provide an instruction to start both the database server and the application server associated with a computing application in the same virtual network if it is determined that such configuration may lower the bandwidth cost.
• An example architecture within which method and system to provision and manage a clustered computing application hosted by a plurality of virtual nodes may be implemented is described with reference to an architecture diagram illustrated inFIG. 1. Thearchitecture100 may include aclient computer system110 and a hostedservice system120. In one example embodiment, the hostedservice system120 is to provision and manage an enterprise SaaS product utilizing a cloud-based computing service as a virtualization infrastructure. Cloud-based computing services, as shown inFIG. 1, are provided by avirtualization service host130 and anetwork storage service140. In one embodiment, a hostedservice system120 utilizes Amazon EC2 as a virtualization service and Amazon Simple Storage Service (Amazon S3) as a network storage service. In some embodiments, the hostedservice system120 may utilize more than one virtualization service host, e.g., one host being Amazon EC2 and another host provided by Adobe Systems Incorporated. Theclient computer system110 and the hostedservice system120 may be in communication with each other via a communications network that may be a public network (e.g., the Internet).
• Thevirtualization service host130 may load acomputing application132 onto a cloud. Thecomputing application132 may be accessed by theclient110 via abrowser application112. As mentioned above, a user in control of theclient computer system110 may send a request to the hostedservice system120 to load the computing application. The request may be initiated via auser interface122 provided by the hostedservice system120 to theclient computer system110 via thebrowser application112.
• Theuser interface122, in one embodiment, provides both an end-user's and a system administrator's view of thecomputing application132 and also permits issuing control operations to thecomputing application132 and permits viewing the resulting changes in the state of thecomputing application132. For example, where the computing application is a content server, an end-user may manipulate various electronic forms. Theuser interface122 may also serve as a source of information for the hostedservice system120, including documentation, downloads, and support. Theuser interface122, in one embodiment, uses Adobe® Flex® software, offered by Adobe Systems Incorporated, as the user interface technology for the implementation of the user interface. Theuser interface122, in one embodiment, uses an XML (Extensible Markup Language)-based representational state transfer (REST) style secure communications protocol to synchronize its operations with acontrol server124. A request to access theuser interface122 may be authenticated using one of a variety of authentication techniques.
• The request from theclient computer system110 to load thecomputing application132 is received at thecontrol server124, which responds to the request by activating anaccess interface134 provided by thevirtualization service host130. Thecontrol server124, in one example embodiment, provides coordination between the components of thearchitecture100, provides administration and monitoring of thevirtualization service host130, and also may be configured to audit system usage and resource allocation with respect to thecomputing application132. Thecontrol server124 includes a database to store information pertaining to various aspects of system usage. Thecontrol server124, in one embodiment, runs within a standard Hypertext Transfer Protocol Secure (HTTPS)-compliant web server and may be deployed as a publically accessible web application that is available outside a firewall. Thecontrol server124, in one embodiment, is implemented using Ruby on Rails™ technology.
• Thevirtualization service host130 accesses thestorage144 of thenetwork storage system140 to obtain one or more machine images in order to load the associatedcomputing application132. The machine images can be uploaded to the network storage system by thecontrol server124 utilizing anaccess interface142 provided with thenetwork storage system140. The hostedservice system120 further includes asecure networking client126 to provide a bidirectional, encrypted, compressed connection between a machine in the end-user's secure network environment (e.g., the client computer system110) and one or more instances of a virtual machine running within the virtualization infrastructure (the computing application132). Thenetworking client126 manages various aspects of transmission control protocol (TCP) traffic forwarding, encryption, and network discovery, such that the user can access thecomputing application132 as if it was running locally on the user's machine. In this mode, the user's network security envelope is extended to surround thecomputing application132 using comparable levels of encryption and protection against network security threats.
• In one example embodiment, thecontrol server124 comprises asmart scheduler125. Thesmart scheduler125 may be configured to determine an optimized configuration for launching a computing application on a cloud by matching the application resource requirement with the cloud resource model, based on the optimization requirement. The optimization requirement may be based on the need to lower the cost of using the virtualization service, based on the need to increase the bandwidth available to the computing application, to reduce latency, or some other optimization goals. Adiagrammatic representation200 of an example application requirement and an example resource inventory that may be used for determining the resource model is shown inFIG. 2. As shown inFIG. 2, an application requirement (AppRequirement) comprises interaction pattern among application pools, where a pool may be executing on one or more instances of a virtual machine with a load balance (“LB”) being used as a front end for processing users requests. A “pool” is a group of machines that provide the same functionality to its clients. If the client workload is too high for the capacity the pool offers, the controller may issue an instruction to grow the pool by adding more members into the pool. The pools size is thus proportional to its processing capacity. Application requirement also comprises an application descriptor, which is the specification of the service-level requirement. Overall parameters of the application descriptor include optimization goal (also referred to as optimization requirement), inter-pool dependencies, and inter-pool bandwidth requirement. Pool parameters of the application descriptor include VM (virtual machine) requirement, minimum/maximum pool size, bandwidth and latency requirement, and security requirement. Resource inventory, as shown inFIG. 2, may indicate which cloud providers are available, which data centers (DSc) are provided by each cloud provider and the number and type of virtual instances of a machine that can be provided by each cloud provider. Resource inventory may be expressed utilizing inventory descriptors, such as machine capacity, network capacity, machine cost, and network cost. For example, if the application requires K amount of CPU power and the resource model indicates that a class-A machine can offer B units of CPU power, then the smart scheduler may determine that at least K/B machines would be necessary in order to meet the CPU requirement of the application.
• FIG. 3 is a block diagram illustrating parameters that may be used for generating deployment parameters for a computing application (“Deploy Desc”) using parameters describing application requirement of a computing application (“App Desc”) and parameters describing cloud resource inventory (“Infra Desc”). Symbols “+,” “*,” and “?” describe the number of repetitions permitted with respect to the associated parameter. The “+” symbol indicates one to many parameters, the “*” symbol indicates zero to multiple parameters, and “?” indicates zero to one parameters. Some components of thesmart scheduler125 are described with reference toFIG. 4.
• FIG. 4 is a block diagram illustrating asystem400 for determining an optimized configuration for deploying a computing application on a cloud, according to one example embodiment. As shown inFIG. 4, thesystem400 includes alaunch request detector402, anapplication requirement detector404, a cloudresource inventory detector406, anoptimization requirement detector408, amatching module410, and aconfiguration module412. Thelaunch request detector402 may be configured to detect a request to launch a computing application within a virtualization service. Theapplication requirement detector404 may be configured to determine application requirement for the computing application. The application requirement may comprise a list of components of the computing application, relationship among the components, bandwidth and latency requirement, security requirement, etc. The cloudresource inventory detector406 may be configured to determine cloud resource inventory and generate a cloud resource model. Cloud resource inventory provides information indicating resources that can be made available to the computing application within the virtualization service. Theoptimization requirement detector408 may be configured to determine an optimization requirement. The optimization requirement comprises one or more parameters indicating optimization criteria, such as, e.g., a requirement associated with the cost of using virtualization service, performance and availability of the computing application, etc. Thematching module410 may be configured to perform matching of the application requirement with the resource inventory based on the optimization requirement. Theconfiguration module412 may be configured to generate an optimized application deployment configuration based on the result of the matching and cause launching of the computing application within the virtualization service using the optimized application deployment configuration. The optimized application deployment configuration may include information indicating one or more virtualization service providers to be utilized for launching the computing application within the virtualization service, one or more virtualization service providers to be utilized for launching the computing application within the virtualization service, type and capacity of each virtual machine to be executing one or more components of the computing application, etc. Example operations performed by thesystem400 are discussed below with reference toFIG. 5.
• FIG. 5 is a flow chart illustrating amethod500 for determining an optimized configuration for deploying a computing application on a cloud, in accordance with an example embodiment. Themethod500 may be performed by processing logic that may comprise hardware, software (such as run on a general purpose computer system programmed to perform particular functions pursuant to instructions from program software or on a dedicated machine), or a combination of both. The processing logic, according to example embodiments, may reside in or comprise any of the modules shown inFIG. 4.
• As shown inFIG. 5, themethod500 commences withoperation510, where thelaunch request detector402 ofFIG. 4 detects a request to launch a computing application on a cloud (within a virtualization service). Atoperation520, theapplication requirement detector404 ofFIG. 4 determines application requirement for the computing application. Atoperation530, the cloudresource inventory detector406 ofFIG. 4 determines cloud resource inventory. As mentioned above, the cloud resource model indicates resources that can be made available to the computing application within the virtualization service. Atoperation540, theoptimization requirement detector408 ofFIG. 4 determines an optimization requirement associated with the computing application. The optimization requirement may be provided to the smart scheduler (that may be implemented as thesystem400 ofFIG. 4) by an administrator. The optimization requirement comprises one or more parameters indicating optimization criteria, such as, for example, lowest cost or highest performance. Atoperation550, thematching module410 ofFIG. 4 performs matching of the application requirement with the resource inventory based on the optimization requirement. Atoperation560, theconfiguration module412 ofFIG. 4 generates an optimized application deployment configuration based on the result of the matching and causes launching of the computing application within the virtualization service using the optimized application deployment configuration.
• FIG. 6 is a diagrammatic representation of a machine in the example electronic form of acomputer system600 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed. In various embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a portable music player (e.g., a portable hard drive audio device such as an “Moving Picture Experts Group (MPEG) Layer 3” (MP3) player), a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
• Theexample computer system600 includes a processor602 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both), amain memory604 and astatic memory606, which communicate with each other via abus608. Thecomputer system600 may further include a video display unit610 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). Thecomputer system600 also includes an alphanumeric input device612 (e.g., a keyboard), a user interface (UI) cursor control device614 (e.g., a mouse), adisk drive unit616, a signal generation device618 (e.g., a speaker) and anetwork interface device620.
• Thedisk drive unit616 includes a computer-readable (or machine-readable) medium622 on which is stored one or more sets of instructions and data structures (e.g., software624) embodying or utilized by any one or more of the methodologies or functions described herein. Thesoftware624 may also reside, completely or at least partially, within themain memory604 and/or within theprocessor602 during execution thereof by thecomputer system600, themain memory604 and theprocessor602 also constituting machine-readable media.
• Thesoftware624 may further be transmitted or received over anetwork626 via thenetwork interface device620 utilizing any one of a number of well-known transfer protocols (e.g., Hyper Text Transfer Protocol (HTTP)).
• While the machine-readable medium622 is shown in an example embodiment to be a single medium, the term “machine-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “machine-readable medium” shall also be taken to include any medium that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention, or that is capable of storing or encoding data structures utilized by or associated with such a set of instructions. The term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media. Such medium may also include, without limitation, hard disks, floppy disks, flash memory cards, digital video disks, random access memory (RAMs), read only memory (ROMs), and the like.
• Thus, method and system to deploy a computing application on a cloud have been described. While some example approaches described herein may be used with ADOBE® products, the techniques described herein may be utilized beneficially with various other products.
• The embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware. Although embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims (21)

1. A method comprising:

detecting at a host computer system, a request to launch a computing application within a virtualization service, the request received by a scheduler of the host computing system;

determining, by the scheduler, an application requirement for the computing application;

determining, by the scheduler, a cloud resource inventory, the cloud resource inventory indicating resources available for executing the computing application within the virtualization service;

determining, by the scheduler, an optimization requirement, the optimization requirement comprising one or more parameters indicating optimization criteria associated with a cost to use the resources available for executing the computing application within the virtualization service;

matching, by the scheduler, the application requirement with resources of the cloud resource inventory that satisfy the optimization requirement to provide a matching result;

generating an optimized application deployment configuration based on the matching result by calling, via the scheduler, an application programming interface of the virtualization service to trigger loading of one or more machine images associated with the requested computing application using the optimized application deployment configuration; and causing launching of the computing application within the virtualization service using the loaded one or more machine images.

2. The method ofclaim 1, wherein the optimized application deployment configuration indicates one or more virtualization service providers to be utilized for launching the computing application within the virtualization service.

3. The method ofclaim 1, wherein the optimized application deployment configuration indicates the number of instances of a virtual machine to be started to launch the computing application.

4. The method ofclaim 1, wherein the optimized application deployment configuration indicates type and capacity of each virtual machine to be executing one or more components of the computing application.

5. The method ofclaim 1, wherein the application requirement comprises a list of components of the computing application and relationship among the components.

6. The method ofclaim 1, wherein the application requirement comprises information indicating bandwidth and latency requirement for the components of the computing application.

7. The method ofclaim 1, wherein the application requirement comprises information indicating security requirement for the components of the computing application.

8. (canceled)

9. The method ofclaim 1, wherein the optimization requirement is associated with performance of the computing application.

10. The method ofclaim 1, wherein the virtualization service is provided by a first provider and a second provider, wherein a first component of the computing application is to be launched on an instance of a virtual machine provided by the first provider and a second component of the computing application is to be launched on an instance of a virtual machine provided by the second provider.

11. A computer-implemented system comprising:

a memory coupled to one or more processors, the one or more processors implementing a scheduler comprising:

a launch request detector to detect a request to launch a computing application within a virtualization service;

an application requirement detector to determine an application requirement for the computing application;

a cloud resource inventory detector to determine cloud resource inventory, the cloud resource inventory indicating resources available for executing the computing application within the virtualization service;

an optimization requirement detector to determine an optimization requirement, the optimization requirement comprising one or more parameters indicating optimization criteria associated with a cost to use the resources available for executing the computing application within the virtualization service;

a matching module to perform matching of the application requirement with resources of the cloud resource inventory that satisfy the optimization requirement to provide a matching result; and

a configuration module to:

generate an optimized application deployment configuration based on the matching result by calling an application programming interface of the virtualization service to trigger loading of one or more machine images associated with the requested computing application using the optimized application deployment configuration, and

cause launching of the computing application within the virtualization service using the loaded one or more machine images.

12. The system ofclaim 11, wherein the optimized application deployment configuration indicates one or more virtualization service providers to be utilized for launching the computing application within the virtualization service.

13. The system ofclaim 11, wherein the optimized application deployment configuration indicates the number of instances of a virtual machine to be started to launch the computing application.

14. The system ofclaim 11, wherein the optimized application deployment configuration indicates type and capacity of each virtual machine to be executing one or more components of the computing application.

15. The system ofclaim 11, wherein the application requirement comprises a list of components of the computing application and relationship among the components.

16. The system ofclaim 11, wherein the application requirement comprises information indicating bandwidth and latency requirement for the components of the computing application.

17. The system ofclaim 11, wherein the application requirement comprises information indicating security requirement for the components of the computing application.

18. (canceled)

19. The system ofclaim 11, wherein the virtualization service is provided by a first provider and a second provider, wherein a first component of the computing application is to be launched on an instance of a virtual machine provided by the first provider and a second component of the computing application is to be launched on an instance of a virtual machine provided by the second provider.

20. A machine-readable non-transitory medium having instruction data to cause a machine to perform operations comprising:

detect a request received by a scheduler of a host computing system to launch a computing application within a virtualization service;

determine, by the scheduler, an application requirement for the computing application;

determine, by the scheduler, a cloud resource inventory, the cloud resource inventory indicating resources available for executing the computing application within the virtualization service;

determine, by the scheduler, an optimization requirement, the optimization requirement comprising one or more parameters indicating optimization criteria associated with a cost to use the resources available for executing the computing application within the virtualization service;

match, by the scheduler, he application requirement with resources of the cloud resource inventory that satisfy the optimization requirement to provide a matching result; and

generate an optimized application deployment configuration based on the matching result by calling, via the scheduler, an application programming interface of the virtualization service to trigger loading of one or more machine images associated with the requested computing application using the optimized application deployment configuration; and

cause launching of the computing application within the virtualization service using the loaded one or more machine images.

21. The machine-readable non-transitory medium ofclaim 20, wherein the generated optimized application deployment configuration is based on a matching result associated with matching cost-effective resources of the cloud resource inventory that satisfy the optimization requirement to the application requirement.

Images