US20010023442A1 - Method and system for storing load balancing information with an http cookie - Google Patents

Abstract

A method and system for inserting and examining Cookies in the data streams of HTTP connections for the purpose of persistently directing HTTP connections to the same destination. The present invention enables a network transmission device, e.g., a router or controller, to reliably and efficiently direct subsequent HTTP connections from the same client to the same server (destination) for accessing the requested resources. There are four modes for employing the Cookie to persistently direct HTTP connections. The associative mode inserts a Cookie into an HTTP response that uniquely identifies the client so that when a client's subsequent HTTP request is compared to a table, the HTTP request will be routed to a previously selected destination associated with the client. The passive mode inserts Cookie information into an HTTP response that uniquely identifies a previously selected destination such as a node server so that when a client's subsequent HTTP request is examined, it will be provided to the previously selected destination. In the rewrite mode, a network transmission device manages the destination information that is rewritten over blank Cookie information generated by the destination producing the HTTP response. The insert mode enables a network transmission device to insert and remove Cookie information in the data packets for HTTP requests and responses prior to processing by the destination. The Cookie information can include a time stamp. Other types of Cookies include priority, path and hops.

Description

FIELD OF THE INVENTION
• This application relates generally to distributing the load demand between servers on a network, and, more specifically, to employing an HTTP cookie to balance the load demand between servers on a wide area network of geographically distributed servers such as the Internet.[0001]
BACKGROUND OF THE INVENTION
• Generally, it has proven difficult to reliably and efficiently load balance the demand for access to resources, e.g., a web-based application, email and streamed multimedia data, on a wide area network (WAN). One prior art attempt employed a look up table for storing a relationship mapping between a client's ip address and the ip address of the actual server that provided access to the resources for a domain name/ip address request. This table was usually held in the memory of a server array controller that managed several node servers that could provide access to the resources associated with the client's request. Typically, the server array controller would employ a load balancing technique to select and map the ip address of one of the managed node servers to the client's actual ip address and store this mapped relationship with a time stamp in the table. In this way, when a client repeated an request before the expiration of the time stamp, the controller would use the mapping stored in the table to automatically connect the client to the previously selected (load balanced) node server.[0002]
• Additionally, if the time stamp had expired, the server array controller would again perform the load balancing technique to select one of the managed node servers to provide the actual access to the resources associated with the request. Each time the load balancing technique was performed, the controller would update the table to include a new time stamp and a new mapping of the client's unique ip address to the currently selected node server's ip address.[0003]
• For a relatively small number of client requests, the above described prior art solution could reduce the demand on server array controller resources because the controller did not always have to perform a load balancing technique for each client request that occurred before the expiration of the time stamp. Instead, the controller only performed the load balancing technique for a new client request or when the time stamp for a previous client request was expired. However, since all of the table entries had to be kept in the memory of the server array controller to be used effectively, the available controller resources for load balancing and managing several node servers decreased in proportion to an increase in the number of client requests. To ensure that table entries were not lost when the server array controller lost power or was rebooted, a copy of the table would be stored on a secondary storage medium. Also, under heavy load conditions, the secondary storage medium was often not fast enough to store the copy of table entries before the server array controller shut down.[0004]
• Another significant problem with the prior art approach was that the client's ip address was not always unique. Although some clients might have their own unique ip address, many others used random virtual client ip addresses provided by a large Internet Service Provider (ISP), e.g., the America On-Line Corporation, to connect to the Internet. Since only a portion of a large ISP's clients are typically connected at any one time, a large ISP usually employs a proxy cache to randomly assign a relatively small number of virtual client ip addresses to the currently “on-line” (customers) clients. Typically, a proxy cache will assign one of the virtual client ip addresses to a client on a first available basis each time the client connects to the ISP and starts a session on the Internet. From the discussion above, it is apparent that when a client used a large ISP to connect to a WAN such as the Internet, the prior art did not provide an effective method for persistently mapping a client's relationship to the server that was selected to provide access to resources associated with a request.[0005]
• Therefore, it is desirable to provide a method and system for automatically providing a persistent mapping of a previously selected destination for a domain name/ip address request. Preferably, the present invention employs a Cookie in a Hyper Text Transport Protocol (HTTP) data stream to identify a relationship between a previously selected destination and a client's HTTP request. The present invention overcomes many of the limitations of the prior art caused by the direct mapping of an actual destination ip address to a client's ip address.[0006]
SUMMARY OF THE INVENTION
• In accordance with the present invention, a method for load balancing access to a resource identified in an HTTP request. The method includes: (1) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie may include information that indicates a destination for accessing the resource identified in the HTTP request; (2) when the Cookie is included in the HTTP request, sending the HTTP request to the destination that is indicated by the Cookie's information; (3) generating an HTTP response at the destination, the HTTP response providing access to the requested resource; (4) inserting a copy of the information in the Cookie; and (5) sending the HTTP response with the copy of the information in the Cookie to the sender of the HTTP request, so that a subsequent HTTP request to access the resource will include another Cookie with information indicating that the resource is accessible at the destination.[0007]
• In accordance with other aspects of the present invention, the method provides for sending the HTTP request to a server array controller that manages a plurality of node servers. The server array controller selects one of the plurality of node servers to receive the HTTP request based on the information in the Cookie. The selected node server is associated with the destination and generates the HTTP response that includes the copy of the information in the Cookie.[0008]
• In accordance with yet other aspects of the present invention, the method provides for including an identifier with the copy of the information in the Cookie. The identifier associates the selected node server with the destination. The identifier may be encoded by a mathematical product such as a hash value. Also, a time stamp may be generated by the node server, server array controller or any network transmission device and included in the HTTP response.[0009]
• In accordance with additional aspects of the present invention, the method provides for employing a selected node server to generate the HTTP response and includes a blank identifier in the copy of the information in the Cookie. In this case, the server array controller may write the identifier over the blank identifier in the copy of the information in the Cookie. The method may also provide for changing an expiration date for the time stamp relative to the number of HTTP requests sent to the server array controller over a period of time. The expiration date for the time stamp can be increased when the number of HTTP requests sent to the server array controller are greater than a determined value over a period of time. Alternatively, the expiration date for the time stamp may be decreased when the number of HTTP requests sent to the server array controller are less than a determined value over a period of time.[0010]
• In accordance with other aspects of the present invention, the method provides for employing the server array controller to select one of the plurality of node servers to receive the HTTP request and generate the HTTP response providing access to the requested resource when the Cookie is not included in the HTTP request. The present invention provides for sending an HTTP response to the sender of the HTTP request with information for creating another Cookie, so that a subsequent HTTP request to access the resource will include the other Cookie with information indicating that the selected node server is the destination for accessing the requested resource.[0011]
• In accordance with still other aspects of the present invention, the method provides for employing the server array controller to balance the load demand on the plurality of node servers by determining the optimal node server to receive the HTTP request and generate the HTTP response. The server array controller may employ one of a plurality of functions to determine the optimal node server to balance the load demand. These functions include round trip time, round robin, least connections, packet completion rate, quality of service, server array controller packet rate, topology, global availability, hops, static ratio and dynamic ratio.[0012]
• In accordance with additional aspects of the present invention, until the HTTP request is provided to the server array controller, the method provides for employing the server array controller to buffer communication between the sender and the destination. Also, when the HTTP request is provided to the server array controller, replaying in consecutive order the buffered communication to at least one of the plurality of node servers that is associated with the destination.[0013]
• In accordance with other aspects of the present invention, a plurality of Cookies may be included with the HTTP request. Each Cookie can have a different type that indicates how the information included in a Cookie is to be utilized. The different types of Cookie include priority, path and hops. The path type of Cookie includes information indicating all of the interim destinations between the sender and the destination for an HTTP request. The interim destinations include a router, host machine, server array controller, firewall, node server and client. The hops type of Cookie includes information indicating a portion of the interim destinations between the sender and the destination for an HTTP request. The priority type of Cookie includes information indicating when the HTTP request and/or response associated with the Cookie is to be processed prior to the processing of other HTTP communications. The priority type of Cookie may include an indication that identifies a priority for processing the HTTP request and/or response prior to the processing of the other HTTP communications.[0014]
• In accordance with yet other aspects of the present invention, wherein the sender may include a client, server and host machine. Also, the destination can include a host machine, server array controller, router, node server, firewall and client.[0015]
• In accordance with the present invention, another method for load balancing access to a resource identified in an HTTP request, comprising: (1) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie including information that identifies a sender of the HTTP request; (2)[0016]
• when the Cookie is included in the HTTP request, comparing the information identifying the sender to a table of at least one destination, the HTTP request being sent to a destination that is associated with the identified sender in the table; (3)[0017]
• generating an HTTP response at the destination, the HTTP response providing access to the requested resource and including a copy of the information in the Cookie; and (4) sending the HTTP response with the copy of the information in the Cookie to the identified sender of the HTTP request, so that a subsequent HTTP request to access the resource from the identified sender will include another Cookie with information that identifies the sender of the subsequent HTTP request.[0018]
• In accordance with other aspects of the present invention, the other method provides for employing a server array controller that manages a plurality of node servers. The server array controller comparing the information identifying the sender to a destination that is associated with the identified sender in the table. The destination can be one of the node servers managed by the server array controller.[0019]
• In accordance with yet additional aspects of the present invention, a system which implements substantially the same functionality in substantially the same manner as the methods described above is provided.[0020]
• In accordance with other additional aspects of this invention, a computer-readable medium that includes computer-executable instructions may be used to perform substantially the same methods as those described above is provided.[0021]
BRIEF DESCRIPTION OF THE DRAWINGS
• The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same become better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:[0022]
• FIG. 1A is a schematic overview of a system for processing an HTTP request that does not include a Cookie;[0023]
• FIG. 1B is a schematic overview of a system for processing an HTTP request that does include a Cookie;[0024]
• FIG. 2A is a flow chart showing an overview for processing an HTTP request that does not include a Cookie;[0025]
• FIG. 2B is a flow chart illustrating an overview for processing an HTTP request that does include a Cookie;[0026]
• FIG. 3A is a flow chart showing an associative mode for processing an HTTP request that does not include a Cookie;[0027]
• FIG. 3B is a flow chart illustrating an associative mode for processing an HTTP request that does include a Cookie;[0028]
• FIG. 4A is a flow chart showing a passive mode for processing an HTTP request that does not include a Cookie;[0029]
• FIG. 4B is a flow chart illustrating a passive mode for processing an HTTP request that does include a Cookie;[0030]
• FIG. 5A is a flow chart showing a rewrite mode for processing an HTTP request that does not include a Cookie;[0031]
• FIG. 5B is a flow chart illustrating a rewrite mode for processing an HTTP request that does include a Cookie;[0032]
• FIG. 6A is a flow chart showing an insert mode for processing an HTTP request that does not include a Cookie;[0033]
• FIG. 6B is a flow chart illustrating an insert mode for processing an HTTP request that does include a Cookie;[0034]
• FIGS.[0035]7A-7C show exemplary code fragments of HTTP requests that include Cookies;
• FIGS. 7D and 7E illustrate exemplary code fragments of HTTP responses that include information for setting Cookies at the senders of the associated HTTP requests;[0036]
• FIG. 8 shows the buffering of communication between a client and a node server by a proxy server; and[0037]
• FIG. 9 illustrates an exemplary computer system for the client.[0038]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
• The present invention is directed to inserting and examining HTTP Cookies in the data streams of HTTP connections for the purpose of persistently directing HTTP connections to the same destination. The present invention enables a network transmission device, e.g., a router, to reliably and conveniently direct subsequent HTTP connections from the same client to the same server for accessing requested resources.[0039]
• HTTP is an application level protocol for transferring resources across the Internet, e.g., a network data object or server, and it is specified by the URL. The Hyper Text Mark-up Language (HTML) is a simple data format that is used to create hypertext documents that are supported by the HTTP protocol. Together, these standards have contributed to create the World Wide Web (WWW) on the Internet. The WWW is a globally accessible and platform-independent hypermedia information system that has become a central access point to applications and services for people around the world.[0040]
• A Cookie is a general mechanism, i.e., protocol, which server side connections can use to both store and retrieve information on the client side of the connection. The addition of a simple, persistent, client-side state significantly extends the capabilities of Internet-based client/server application programs. A server, when returning a HTTP object to a client, may also send a piece of state information which the client may store. Included in that state object is a description of the range of Uniform Resource Locators (URLs) for which the returned state is valid. Any future HTTP requests made by the client which fall in that range will include a transmittal of the current values of the state object form the client back to the sender. This state object is called a “Cookie,” for no compelling reason.[0041]
• The Cookie mechanism provides a powerful tool that enables different types of application programs to be written for Internet-based environments. For example, a service program could use a Cookie to send back registration information and free the client from retyping a user identification number for each connection to the service. Also, an Internet site could store user preferences for a client and have the client supply those preferences each time that the client connected to the site.[0042]
• Generally, a Cookie is introduced to the client by including information with a Set-Cookie command in a header as part of an HTTP response. An example of the Set-Cookie command included in an HTTP response header is listed below.[0043]
• <HEADER>[0044]
• Set-Cookie: NAME=VALUE; expires=DATE;[0045]
• path=PATH; domain=DOMAIN_NAME; secure[0046]
• </HEADER>[0047]
• When a client's browser program is requesting a URL from an HTTP server on the Internet, the browser will match the requested URL against all of the URLs stored in the client's Cookies. If the requested URL matches any of the stored URLs, a line containing the name/value pairs of all matching Cookies will be included in the HTTP request. An exemplary line in a Cookie for an HTTP request could be included as follows: Cookie: NAME1=OPAQUE_STRING1; NAME2=OPAQUE_STRING2.[0048]
• A Cookie is typically used to save the state of a relationship between a client and a server. However, in some cases, the saved state of the relationship may create a load balancing problem. For example, each node server that is managed by a load balancing server array controller may not always share the same state relationship with the client that is saved in the Cookie. In this case, the controller must persistently send a repeated client HTTP request to the same node server because it is difficult to recreate the same state relationship in another server during the HTTP request/response session.[0049]
• Although the saved state relationship in a Cookie can create a load balancing problem, the present invention uses the Cookie mechanism to offer a solution to this problem by enabling a network transmission device, e.g., a switch, Internet router, and/or a server array controller, to insert and/or examine Cookies in the data streams of HTTP connections for the purpose of reliably, conveniently and persistently directing connections to the same destination, e.g., a node server. Preferably, the network transmission device actively inserts data into or modifies the HTTP data stream from a server so that a Cookie can be saved by the client indicating the state relationship between the client and the server. In this way, the transmission device can use the Cookie returned in a subsequent client HTTP request to direct the current connection to the same server.[0050]
System Overview
• FIG. 1A illustrates a[0051]system overview100A of the data flow for an HTTP request/response for accessing resources associated with a domain name resolved into an Internet protocol (ip) address or an ip address that is directly provided by aclient10. In this example, theclient10 starts a session by connecting with an ISP102 (located in Chicago, Ill.) over a communication medium. For example, the client may connect to the local ISP through a telephone modem, cable modem and/or satellite connection. Thelocal ISP102 usually provides a local domain name system (DNS)server106 that communicates with other servers on the WAN for resolving a domain name request into an ip address when the client provides a domain name for accessing resources.
• The[0052]client10 sends anHTTP request108A to thelocal ISP102 for access to resources associated with an ip address that is either resolved or directly provided. Aproxy server104 will assign and add its first available virtual client ip address to theHTTP request108A, so that theclient10 is identifiable during the current session. In the case where theHTTP request108A identifies a domain name associated with the resource instead of an ip address, thelocal DNS server106 employs a distributed database to resolve the domain name into the ip address for the requested resource.
• The[0053]proxy server104 sends theHTTP request108A over theInternet110 to adata center112 located in Seattle, Wash., which is identified to be associated with the requested domain name (“domain.com”) or ip address. Arouter114, (optional)firewall116,server array controller118 and an intranet ofN node servers120 are disposed at thedata center112. Theserver array controller118 is used to manage and load balance network traffic on the intranet ofnode servers120.
• In one embodiment, the[0054]server array controller118 intelligently distributes web site connections across arrays (pools) of node servers, transparent firewalls, transparent cache servers, routers as well as other router-like devices. Thecontroller118 may manage connections to multiple Internet or intranet sites, and it can support a wide variety of Internet protocols and services such as TCP/IP (transmission control protocol/Internet protocol) and HTTP. It is understood that the TCP/IP protocol actually represents a suite of communications protocols that are used to connect hosts on the Internet.
• Each node server is defined by a specific combination of a node address and a node port number on the intranet behind the[0055]server array controller118 which can monitor several aspects of the node servers. Thecontroller118 can load balance each connection to the intranet of node servers by selecting a unique ip address for a node server to provide optimal access to a requested resource.
• The selected node server will provide access to the requested resource in an HTTP response that is sent by the[0056]server array controller118 over theInternet110 to the virtual client ip address at theLocal ISP102. The HTTP response includes a SET_COOKIE command in the header of the response which includes information identifying the actual node server on the intranet behind theserver array controller118. The client accesses the requested resource in the HTTP response received from theLocal ISP102.
• FIG. 1B illustrates a[0057]system overview100B of substantially the same data stream flow as shown in FIG. 1A. Except that theclient10 is providing anHTTP request108B which includes a Cookie uniquely identifying a relationship between the previously selected node server and the client requesting access to the resource. So long as the Cookie is not expired, theserver array controller118 will automatically direct the HTTP request to the destination (node server) identified by the information in the Cookie. Thus, theserver array controller118 can use the information in the Cookie to reliably and efficiently load balance client demands for access to requested resources.
Logic Overview
• In FIG. 2A, an[0058]overview122 is shown of the general logic flow for an HTTP request that does not include a Cookie identifying the actual node server that will provide access to the requested resource. Moving from a start block, the logic steps to ablock124 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock126, theclient10 transmits the HTTP request to theserver array controller118 without a Cookie identifying the node server that will provide access to the requested resource.
• Flowing to a[0059]block128, theserver array controller118 makes a load balancing determination and selects the optimal node server to provide access to the requested resource and routes the HTTP request to the selected node server. Theserver array controller118 may employ any one of several different types of load balancing methods to analyze metric information and optimally balance client HTTP requests (load demand). These load balancing methods include round trip time, round robin, least connections, packet completion rate, quality of service, server array controller packet rate, topology, global availability, hops, static ratio and dynamic ratio.
• Stepping to a[0060]block130, the selected node server generates an HTTP response that enables theclient10 to access the requested resource. The selected node server transmits the generated HTTP response to theserver array controller118 which retransmits the response to theclient10 along with information included with a SET_COOKIE command that enables the particular ip address of the selected node server to be identified. Depending upon the mode of the present invention that is selected, the SET_COOKIE command may be inserted in the header of the HTTP response by theserver array controller118 and/or the selected node server. Next, The logic moves to an end block and terminates.
• FIG. 2B shows an[0061]overview132 for processing an HTTP request that includes a Cookie with information that can be used to identify the destination that was previously selected to provide access to the requested resources. Moving from a start block, the logic steps to ablock134 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 associated with the node server identified in the Cookie. Advancing to ablock136, theclient10 transmits the HTTP request to theserver array controller118 along with the Cookie and its information. The logic flows to ablock138 where theserver array controller118 uses the information included in the Cookie to route the HTTP request directly to the ip address of the node server that was previously selected to provide access to the requested resources.
• Next, the logic moves to a[0062]block140 where the selected node server generates an HTTP response for accessing the requested resources and provides this HTTP response to theserver array controller118. Thecontroller118 retransmits the HTTP response to theclient10 along with a SET_COOKIE command that includes information that can be used to identify a relationship between the client and the destination (node server) that will provide access to the requested resources. The logic moves to an end block and terminates. The present invention thus enables theserver array controller118 to use the information in the Cookie to quickly, reliably and efficiently load balance client demands for access to requested resources.
• Although not shown, another embodiment of the present invention enables the[0063]server array controller118 to vary the expiration date of the time stamp included with HTTP requests and responses. When the load demand on theserver array controller118 increases, the controller may increase the period of time (expiration date) before the time stamp expires. Alternatively, when the load on theserver array controller118 decreases, the controller may decrease the period of time before the time stamp expires. By varying the expiration dates of the time stamps, theserver array controller118 may control the number of times that the controller performs load balancing determinations within a period of time. Also, when only a few destinations can provide access to the requested resource, theserver array controller118 may set the time stamp expiration date to one year or more.
• The present invention provides at least four different modes of operation for inserting information in an HTTP response and examining Cookies in an HTTP request for uniquely identifying a relationship between the client and a selected destination such as a node server to provide access to the requested resources. These modes of operation include associative, passive, rewrite and insert.[0064]
Associative Mode
• In FIG. 3A, an[0065]overview142 of an “associative” mode for processing an HTTP response without a Cookie is illustrated. Moving from a start block, the logic steps to ablock144 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock146, theclient10 transmits the HTTP request to theserver array controller118.
• The logic flows to a[0066]block148 where theserver array controller118 receives the HTTP request and makes a load balancing determination to select the optimal node server to provide access to the requested resource. After selecting the optimal node server, theserver array controller118 routes the HTTP request to the selected node server.
• The logic steps to a[0067]block150 where the selected node server generates an HTTP response that provides access to the requested resource. The selected node server transmits the HTTP response to theserver array controller118. Theserver array controller118 inserts a SET_COOKIE command with information uniquely identifying theclient10 into the HTTP response's header. Thecontroller118 retransmits the HTTP response and the Cookie information to theclient10.
• Alternatively, the selected node server may include the SET_COOKIE command in the HTTP response's header with blank information. In this case, the[0068]server array controller118 rewrites this blank information with information that uniquely identifies theclient10 and retransmits the “rewritten” HTTP response to the client.
• Next, the logic flows to a[0069]block152 where theserver array controller118 maps the identified client and the ip address of the selected node server into a table that is stored in the memory of the controller. The logic moves to an end block and terminates. Additionally, it is understood that the SET_COOKIE command causes the client to store the Cookie information that uniquely identifies the client, so that when the same HTTP request is repeated by the client, this stored Cookie information will be used to create a Cookie that is included with the repeated HTTP request.
• FIG. 3B shows an[0070]overview154 of an “associative” mode for processing an HTTP request that includes a Cookie with information that can be used to identify theclient10. The Cookie for an HTTP request may be provided from a previous HTTP request/response exchange as illustrated in FIG. 3A above. It is also envisioned that another facility may be employed to create a Cookie for the HTTP request that includes information identifying theclient10. In this example, the information included in the Cookie enables theserver array controller118 to uniquely identify theclient10 and a mapped relationship to a previously selected node server. Moving from a start block, the logic steps to ablock156 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at an ip address provided by the client. Advancing to ablock158, the HTTP request along with the Cookie is transmitted from theclient10 to theserver array controller118.
• The logic will move to a[0071]block162 where theserver array controller118 will access the table held in its memory and identify the mapped relationship between the client and the previously selected node server for accessing the requested resources. Using the mapped relationship in the table, thecontroller118 will provide the HTTP request to the previously selected node server. The logic flows to ablock168 where the node server generates an HTTP response which includes a SET_COOKIE command with information that can be used to uniquely identify theclient10 requesting access to the resources at the ip address of the selected node server. The logic moves to ablock170 where theserver array controller118 updates another time stamp stored in the table which is associated with the mapping of the relationship between the client and the selected node server. Next, the logic moves to an end block and terminates.
• Alternatively, in another embodiment, the node server could include a SET_COOKIE command with blank information in the generated HTTP response. In this case, the[0072]server array controller118 would rewrite the blank information to include other information that uniquely identifies theclient10 requesting access to the resources at the ip address of the selected node server.
• In summary, the associative mode provides for inserting a Cookie into an HTTP response that uniquely identifies the client so that when a client's subsequent HTTP request is compared to a table, this subsequent HTTP request will be provided to a previously selected destination. The present invention thus enables the[0073]server array controller118 to use the information in the Cookie to load balance client demands for access to requested resources. Additionally, it is understood that the associative mode puts most of the load for processing an HTTP request on theserver array controller118 relative to the load placed on a previously selected node server that is managed by the controller.
Passive Mode
• In FIG. 4A, an[0074]overview172 of a “passive” mode for processing an HTTP request/response is illustrated. Moving from a start block, the logic steps to ablock174 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock176, theclient10 transmits the HTTP request to theserver array controller118.
• The logic flows to a[0075]block178 where theserver array controller118 receives the HTTP request and makes a load balancing determination to select the optimal node server to provide access to the requested resource. After selecting the optimal node server, theserver array controller118 provides the HTTP request to the selected node server. The logic steps to ablock180 where the selected node server generates an HTTP response that includes Cookie information identifying the selected node server, i.e., a SET_COOKIE command is inserted into the header of the HTTP response. The selected node server provides the HTTP response along with the inserted Cookie information to theserver array controller118. Theserver array controller118 provides the HTTP response with the Cookie information to theclient10. Next, the logic moves to an end block and terminates. Additionally, it is understood that the SET_COOKIE command causes the client to store Cookie information that identifies the previously selected destination, e.g., a node server, so that when the same HTTP request is repeated by the client, this stored Cookie information will be used to create a Cookie that is included with the repeated HTTP request.
• FIG. 4B shows an[0076]overview182 of a “passive” mode for processing an HTTP request that includes a Cookie with information identifying a previously selected node server for providing access to requested resources. Moving from a start block, the logic steps to ablock184 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock186, the HTTP request along with the Cookie is transmitted from theclient10 to theserver array controller118.
• The logic moves to a[0077]block190 where theserver array controller118 will use the information included in the Cookie to provide the HTTP request to the previously selected node server. The logic steps to ablock194 where the selected node server generates an HTTP response including Cookie information that identifies the selected node server. The selected node server provides the HTTP response with the Cookie information to theserver array controller118. Theserver array controller118 retransmits the HTTP response with the Cookie information to theclient10. Next, the logic moves to an end block and terminates.
• In summary, the passive mode provides for inserting Cookie information into an HTTP response that uniquely identifies a previously selected destination, such as a node server, so that when a client's subsequent HTTP request is examined, it can be efficiently provided to the previously selected destination. The present invention thus enables the[0078]server array controller118 to use the information in the Cookie to load balance client demands for access to requested resources. Also, the passive mode puts most of the load for processing an HTTP request on a node server relative to the load placed on aserver array controller118 managing the node server.
Rewrite Mode
• In FIG. 5A, an[0079]overview200 of a “rewrite” mode for processing an HTTP response is illustrated. Moving from a start block, the logic steps to ablock202 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock204, theclient10 transmits the HTTP request to theserver array controller118.
• The logic flows to a[0080]block206 where theserver array controller118 receives the HTTP request and makes a load balancing determination to select the optimal node server to provide access to the requested resource. After selecting the optimal node server, theserver array controller118 routes the HTTP request to the selected node server. The logic steps to ablock208 where the selected node server generates an HTTP response that includes blank Cookie information, i.e., a SET_COOKIE command is inserted into the header of the HTTP response without information identifying the selected node server. The selected node server provides the HTTP response with the blank Cookie information to theserver array controller118. The logic moves to ablock210 where thecontroller118 rewrites the blank Cookie information to identify the node server selected to provide access to the requested resources. Theserver array controller118 transmits the HTTP response and the rewritten Cookie information to theclient10. Next, the logic moves to an end block and terminates.
• FIG. 5B shows an[0081]overview212 of a “rewrite” mode for processing an HTTP request that includes a Cookie with information for identifying a node server previously selected to provide access to the requested resources. Moving from a start block, the logic steps to ablock214 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at an ip address provided by the client. Advancing to ablock216, the HTTP request along with the Cookie is transmitted from theclient10 to theserver array controller118.
• The logic will move to a[0082]block220 where theserver array controller118 will use the information included in the Cookie to identify the previously selected node server and route the HTTP request to this node server. The logic steps to ablock224 where the selected node server generates an HTTP response that includes blank Cookie information. The selected node server provides the HTTP response along with the inserted blank Cookie information to theserver array controller118. The logic steps to ablock226 where theserver array controller118 rewrites the blank Cookie information to include other information that identifies the selected node server. Next, the logic moves to an end block and terminates.
• In the rewrite mode, the[0083]server array controller118 manages the other “destination” information that is rewritten over the blank Cookie information. The rewrite mode roughly divides the load for processing an HTTP request/response between aserver array controller118 and a selected node server that is managed by the controller. The rewrite mode places a portion of this load on the selected node server to insert the blank Cookie in an HTTP response and another portion of this load on aserver array controller118 for rewriting the blank Cookie information to include other information that identifies the selected destination (node server). One advantage of the rewrite mode is that a plurality of node servers managed by theserver array controller118 may have the same content related to inserting blank Cookie information into an HTTP response. In this way, updates to the plurality of node servers are more easily provided because each node server can have the same content. Also, since the other information identifying the destination will occupy the same space as the blank Cookie information that was written over, the actual data packet containing the HTTP response does not have to change in size.
Insert Mode
• In FIG. 6A, an[0084]overview228 of an “insert” mode for processing an HTTP request/response is illustrated. Moving from a start block, the logic steps to ablock230 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at the ip address provided by the client. Advancing to ablock232, theclient10 transmits the HTTP request to theserver array controller118 at the primary ip address.
• The logic flows to a[0085]block234 where theserver array controller118 receives the HTTP request and makes a load balancing determination to select the optimal node server to provide access to the requested resource. Theserver array controller118 provides the HTTP request to the selected node server. The logic steps to ablock236 where the selected node server generates an HTTP response and provides the generated HTTP response to theserver array controller118. The logic moves to ablock238 where theserver array controller118 rewrites the data packet(s) containing the HTTP response so that Cookie information identifying the node server selected to provide access to the requested resources can be inserted into the data packet. The logic flows to ablock240 where theserver array controller118 provides to theclient10 the rewritten data packet that includes the HTTP response and the inserted Cookie information. Next, the logic moves to an end block and terminates.
• FIG. 6B shows an[0086]overview242 of an “insert” mode for processing an HTTP request that includes a Cookie with information identifying a node server previously selected to provide access to the requested resources. Moving from a start block, the logic steps to ablock244 where a TCP/IP handshake is performed between theclient10 and theserver array controller118 at an ip address provided by the client. Advancing to ablock246, the HTTP request along with the Cookie is transmitted from theclient10 to theserver array controller118.
• The logic will move to a[0087]block250 where theserver array controller118 will use the information included in the Cookie to identify the previously selected node server. Theserver array controller118 will rewrite the data packet(s) containing the HTTP response. Theserver array controller118 will provide the rewritten data packet(s) containing the HTTP response to theclient10. The logic steps to ablock254 where the selected node server generates an HTTP response and provides the HTTP response to theserver array controller118. The logic moves to ablock256 where theserver array controller118 rewrites the data packet(s) containing the HTTP response to insert Cookie information into the response's header for identifying the node server selected to provide access to the requested resources. The logic flows to ablock258 where theserver array controller118 transmits to the client10 a rewritten data packet that includes the HTTP response and the newly inserted Cookie information. Next, the logic moves to an end block and terminates.
• The insert mode enables a[0088]server array controller118 to load balance client demands for access to requested resources by inserting and removing Cookie information in the data packets for HTTP requests and responses prior to processing by the destination (selected node server). In the insert mode, all of the load for inserting and examining Cookie information and rewriting data packets is placed on theserver array controller118 and none of this load is put on the node servers managed by the controller.
Exemplary Cookie Code Fragments
• In FIGS.[0089]7A-7E, exemplary embodiments of HTML code fragments are shown that illustrate Cookie information included with an HTTP request/response. FIG. 7A shows an exemplary code fragment for anHTTP request260 that includes Cookie information identifying a server that previously provided access to the requested resources. FIG. 7B illustrates an exemplary code fragment for anHTTP request262 that contains blank Cookie information that does not identify theclient10 or a previously selected destination such as a node server. FIG. 7C shows an exemplary code fragment for anHTTP request264 that includes Cookie information identifying theclient10 that previously requested access to the requested resources. FIG. 7D illustrates an exemplary code fragment for anHTTP response266 that includes Cookie information identifying a server that previously provided access to the requested resources. FIG. 7E shows an exemplary code fragment for anHTTP response267 that includes Cookie information identifying the client requesting access to the resources provided by the server.
Proxy Server Buffering
• FIG. 8 illustrates an overview of how certain data packets between the client and a selected[0090]node server274 are buffered and replayed by a server array controller'sproxy server270. A rectangular graphical representation of theproxy server270 is vertically disposed along the center portion of this figure. Also, positioned along the center line of the developed length of theproxy server270 is a time line271 that starts with an initial value of “zero” near the top of the graphical representation of the proxy server. On the left side of theproxy server270 is a graphical representation of aclient272 transmitting and receiving data packets along the developed length (and time line271) of the proxy server. Similarly on the right side of theproxy server270 is a graphical representation of anode server274 transmitting and receiving data packets along the developed length of the proxy server.
• Starting at the top left side of the figure, the[0091]client10 is transmitting and receiving three separate groups of data packets with theproxy server270. First, aTCP SYN276A data packet is transmitted from theclient272 to theproxy server270, which is followed by an exchange of TCP SYN/ACK.ACK278A data packets. Next, aHTTP REQUEST280A data packet is transmitted to the proxy server by the client.
• All three groups of data packets are buffered and stored by the[0092]proxy server270 until theHTTP REQUEST280A is received by the proxy server. Then, the server array controller will examine the data packet(s) associated with theHTTP REQUEST280A to determine if it includes Cookie information that identifies the client and/or a destination that previously provided access to the requested resources.
• Once the Cookie determination is made, the[0093]proxy server270 will sequentially replay the transmitting and receiving of the three groups of data packets with the selectednode server274. On the right side of the graphical representation of theproxy server270, these three groups of data packets are replayed between theproxy server270 and thenode server274. First, aTCP SYN276B data packet is transmitted from theproxy server270 to thenode server274, followed by an exchange of TCP SYN/ACK.ACK278B data packets and next aHTTP REQUEST280B data packet is transmitted to thenode server274 by theproxy server270.
• Moving further down the length of the graphical representation of the[0094]proxy server270, a data packet(s) for anHTTP RESPONSE282A is provided to theproxy server270 by the selectednode server274. Theproxy server270 immediately replays this data packet to theclient272 inHTTP RESPONSE282B. Next, theclient272 exchanges TCP FIN.ACK.FIN.ACK284B data packets with theproxy server270. Theproxy server270 immediately replays these data packets to thenode server274 as TCP FIN.ACK.FIN.ACK284A data packets.
• It is important to note that the present invention only employ the[0095]proxy server270 to buffer and store data packets until the HTTP request is received. Once the HTTP request is received, the proxy server will replay all of the buffered data packets for the selectednode server274 and switch to a forwarding mode for subsequent data packets, i.e., the proxy server will immediately replay all subsequent data packets transmitted by theclient272 to the selected node server.
System Configuration
• FIG. 9 illustrates a system for the[0096]client10 comprising components of a computer suitable for executing an application program embodying the present invention. In FIG. 5, aprocessor12 is coupled bi-directionally to amemory14 that encompasses read only memory (ROM) and random access memory (RAM). ROM is typically used for storing processor specific machine code necessary to bootup thecomputer comprising client10, to enable input and output functions, and to carry out other basic aspects of its operation. Prior to running any application program, the machine language code comprising the program is loaded into RAM withinmemory14 and then executed byprocessor12.Processor12 is coupled to adisplay16 on which the visualization of the HTML response discussed above is presented to a user. Often, programs and data are retained in a nonvolatile memory media that may be accessed by a compact disk-read only memory (CD-ROM) drive, compact disk-read/write memory (CD-R/W) drive, optical drive, digital versatile disc (DVD) drive, hard drive, tape drive and floppy disk drive, all generally indicated byreference numeral18 in FIG. 9. Anetwork interface22 couples theprocessor12 to a wide area network such as the Internet.
• As noted above, the present invention can be distributed for use on the computer system for the[0097]client10 as machine instructions stored on a memory media such as afloppy disk24 that is read by the floppy disk drive. The program would then typically be stored on the hard drive so that when the user elects to execute the application program to carry out the present invention, the machine instructions can readily be loaded intomemory14. Control of the computer and selection of options and input of data are implemented usinginput devices20, which typically comprise a keyboard and a pointing device such as a mouse (neither separately shown). Further details of system for theclient10 and of the computer comprising it are not illustrated, since they are generally well known to those of ordinary skill in the art. Additionally, although not shown, computer systems for thenode server120 and theserver array controller118 could be configured in substantially the same way as the computer system for theclient10 illustrated here, albeit different in other ways.
Cookie Types
• It is further envisioned that other types of Cookies may be used to identify a path that would be used to exchange data packets between the client and a destination such as a host machine, firewall, router or a node server managed by a server array controller. A “path” type of Cookie could be used to indicate the actual route and interim destinations that the data packets must use to travel between the client (source side) and the destination (supply side). For example, the path Cookie could indicate the individual routers that must be used to send data packets containing the HTTP requests and/or HTTP responses between the client and the destination.[0098]
• A “hops” type of Cookie could be used to indicate an intermediate destination in the route the data packets must use to travel between the client and the destination. For example, a hops cookie could indicate a particular router that must always be used to send data packets containing the HTTP requests and/or HTTP responses between the client and the destination.[0099]
• A “priority” type of Cookie may be used to indicate a priority for processing a data packet containing an HTTP request ahead of other data packets. Also, each priority Cookie could include a range of values indicating a level of priority. In this way, a data packet containing an HTTP request and a priority Cookie with the high priority value would be processed (sent) ahead of other data packets that contained HTTP requests and lower priority Cookies.[0100]
• A “load balancing” Cookie could be used to indicate the load balancing method that the server array controller should perform to select the optimal node server to provide access to the resources when an HTTP request does not include a current Cookie with information identifying a destination. It is also envisioned that multiple types of Cookies and information could be included in HTTP requests and HTTP responses.[0101]
• Additionally, it is envisioned that a unique identification of a client or a destination may be represented as encoded information in the Cookie. The result of an equation or a hash value or may be used to encode the destination uniquely identified in the Cookie. A hash value (or simply hash) is a number generated from a string of text. The hash is substantially smaller than the text itself, and it is generated by a formula in such a way that it is extremely unlikely that some other text will produce the same hash value. Generally, the sender generates a hash of a message, encrypts the hash, and sends it with the message itself The recipient then decrypts both the message and the hash, produces another hash from the received message, and compares the two hashes. If they're the same, there is a very high probability that the message was transmitted intact. A hash provides a quickly determinable value in the Cookie for identifying a relationship between the client and the destination.[0102]
• An exemplary equation for directly determining the ip address of a selected node server (N) is as follows:[0103]
• ip4=N% 256;
• ip3=((N−ip4)/256) % 256;
• ip2=((N−ip4−ip3*256)/(256*256) % 256;
• ip1=((N−ip4−ip3*256−ip2*256*256)/(256*256*256)) % 256;
• Where the ip address for N=ip1*256*256*256+ip2*256*256+ip3*256+ip4.[0104]
• While the preferred embodiment of the invention has been illustrated and described, it will be appreciated that various changes can be made therein without departing from the spirit and scope of the invention.[0105]

Claims (37)

The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:

1. Method for load balancing access to a resource identified in a hyper text transport protocol (HTTP) request, comprising:

(a) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie including information that indicates a destination for accessing the resource identified in the HTTP request;

(b) when the Cookie is included in the HTTP request, sending the HTTP request to the destination that is indicated by the Cookie's information;

(c) generating an HTTP response at the destination, the HTTP response providing access to the requested resource;

(d) inserting a copy of the information in the Cookie into the HTTP response; and

(e) sending the HTTP response with the copy of the information in the Cookie to the sender of the HTTP request, so that a subsequent HTTP request to access the resource will include another Cookie with information indicating that the resource is accessible at the destination.

2. The method of

claim 1

, further comprising:

(a) sending the HTTP request to a server array controller that manages a plurality of node servers; and

(b) employing the server array controller to select one of the plurality of node servers to receive the HTTP request based on the information in the Cookie, the selected node server being associated with the destination.

3. The method of

claim 2

, wherein the selected node server generates the HTTP response.

4. The method of

claim 3

, further comprising including an identifier with the copy of the information in the Cookie, the identifier associating the selected node server with the destination.

5. The method of

claim 4

, further comprising encoding the identifier.

6. The method of

claim 5

, further comprising employing a mathematical product to encode the identifier.

7. The method of

claim 6

, wherein the mathematical product includes a hash value.

8. The method of

claim 4

, further comprising generating a time stamp that is included in the HTTP response.

9. The method of

claim 4

, further comprising

(a) employing the server array controller to insert the copy of the information in the Cookie into the HTTP response; and

(b) employing the server array controller to rewrite a data packet that includes the HTTP response and the copy of the information in the Cookie.

10. The method of

claim 4

, wherein the selected node server generates the HTTP response and includes a blank identifier in the copy of the information in the Cookie.

11. The method of

claim 10

, further comprising employing the server array controller to write the identifier over the blank identifier in the copy of the information in the Cookie.

12. The method of

claim 4

, further comprising employing the selected node server to include the copy of the information in the Cookie with the generated HTTP response.

13. The method of

claim 8

, wherein the selected node server generates the time stamp that is included in the HTTP response.

14. The method of

claim 8

, wherein the server array controller generates the time stamp that is included in the HTTP response.

15. The method of

claim 8

, further comprising changing an expiration date for the time stamp relative to the number of HTTP requests sent to the server array controller over a period of time.

16. The method of

claim 15

, wherein the expiration date for the time stamp is increased when the number of HTTP requests sent to the server array controller are greater than a determined value over the period of time.

17. The method of

claim 15

, wherein the expiration date for the time stamp is decreased when the number of HTTP requests sent to the server array controller are less than a determined value over the period of time.

18. The method of

claim 2

, further comprising:

(a) when the Cookie is not included in the HTTP request, employing the server array controller to select one of the plurality of node servers to receive the HTTP request and generate the HTTP response providing access to the requested resource; and

(b) sending the HTTP response from the selected node server to the sender of the HTTP request, the HTTP response including information for creating another Cookie at the sender, so that a subsequent HTTP request to access the resource will include the other Cookie with information indicating that the selected node server is the destination for accessing the requested resource.

19. The method of

claim 18

, further comprising employing the server array controller to balance the load demand on the plurality of node servers by determining the optimal node server to receive the HTTP request and generate the HTTP response.

20. The method of

claim 19

, wherein the server array controller employs at least one of a plurality of functions to determine the optimal node server to balance the load demand on the plurality of node servers, the plurality of functions round trip time, round robin, least connections, packet completion rate, quality of service, server array controller packet rate, topology, global availability, hops, static ratio and dynamic ratio.

21. The method of

claim 2

, further comprising

(a) until the HTTP request is provided to the server array controller, employing the server array controller to buffer communication between the sender and the destination; and

(b) when the HTTP request is provided to the server array controller, replaying in consecutive order the buffered communication to at least one of the plurality of node servers that is associated with the destination.

22. The method of

claim 1

, further comprising including a plurality of Cookies in the HTTP request, each Cookie having a different type.

23. The method of

claim 22

, further comprising determining a type for each Cookie, the type of each Cookie indicating how the information included in each Cookie is to be utilized.

24. The method of

claim 23

, wherein the type of each Cookie includes priority, path and hops.

25. The method of

claim 24

, wherein the path type of Cookie includes information indicating all of the interim destinations between the sender and the destination, the interim destinations including a router, host machine, server array controller, firewall, node server and client.

26. The method of

claim 24

, wherein the hops type of Cookie includes information indicating at least one interim destination between the sender and the destination, the interim destinations including a router, host machine, server array controller, firewall, node server and client.

27. The method of

claim 24

, wherein the priority type of Cookie includes information indicating when the HTTP request and the HTTP response is to be processed prior to the processing of another HTTP request and another HTTP response.

28. The method of

claim 24

, further comprising including an indication in the information that identifies a priority for processing the HTTP request and the HTTP response prior to the processing of the other HTTP request and HTTP response.

29. The method of

claim 1

, wherein the sender includes a client, server and host machine.

30. The method of

claim 1

, wherein the destination includes a host machine, server array controller, router, node server, firewall and client.

31. Method for load balancing access to a resource identified in a hyper text transport protocol (HTTP) request, comprising:

(a) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie including information that identifies a sender of the HTTP request;

(b) when the Cookie is included in the HTTP request, comparing the information identifying the sender to a table of at least one destination, the HTTP request being sent to a destination that is associated with the identified sender in the table;

(c) generating an HTTP response at the destination, the HTTP response providing access to the requested resource

(d) inserting a copy of the information in the Cookie into the HTTP response; and

(e) sending the HTTP response with the copy of the information in the Cookie to the identified sender of the HTTP request, so that a subsequent HTTP request to access the resource from the identified sender will include another Cookie with information that identifies the sender of the subsequent HTTP request.

32. The method of

claim 31

, further comprising a server array controller that manages a plurality of node servers, wherein the server array controller compares the information identifying the sender to the destination that is associated with the identified sender in the table, the destination being one of the node servers managed by the server array controller.

33. The method of

claim 32

, further comprising employing the server array controller to insert the copy of the information in the Cookie into the HTTP response.

34. The method of

claim 32

, further comprising

(a) employing the node server to insert blank information into the HTTP response; and

(b) employing the server array controller to rewrite the blank information to include the copy of the information in the Cookie, the server array controller sending the HTTP response with the copy of the information in the Cookie to the sender identified in the HTTP request.

35. A system for load balancing access to a resource indicated in a hyper text transport protocol (HTTP) request, comprising:

(a) a memory for storing logical instructions; and

(b) a processor for executing the logical instructions stored in the memory, the execution of the logical instructions causing functions to be performed, including:

(i) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie including information that indicates a destination for accessing the resource identified in the HTTP request;

(ii) when the Cookie is included in the HTTP request, sending the HTTP request to the destination that is indicated by the Cookie's information;

(iii) generating an HTTP response at the destination, the HTTP response providing access to the requested resource;

(iv) inserting a copy of the information in the Cookie into the HTTP response; and

(v) sending the HTTP response with the copy of the information in the Cookie to the sender of the HTTP request, so that a subsequent HTTP request to access the resource will include another Cookie with information indicating that the resource is accessible at the destination.

36. A system for load balancing access to a resource indicated in a hyper text transport protocol (HTTP) request, comprising:

(a) a memory for storing logical instructions; and

(b) a processor for executing the logical instructions stored in the memory, the execution of the logical instructions causing functions to be performed, including:

(i) examining an HTTP request to determine when a Cookie is included with the HTTP request, the Cookie including information that identifies a sender of the HTTP request;

(ii) when the Cookie is included in the HTTP request, comparing the information identifying the sender to a table of at least one destination, the HTTP request being sent to a destination that is associated with the identified sender in the table;

(iii) generating an HTTP response at the destination, the HTTP response providing access to the requested resource;

(iv) inserting a copy of the information in the Cookie into the HTTP response; and

(v) sending the HTTP response with the copy of the information in the Cookie to the identified sender of the HTTP request, so that a subsequent HTTP request to access the resource from the identified sender will include another Cookie with information that identifies the sender of the subsequent HTTP request.

37. A computer readable medium having computer-executable instructions for performing the methods recited in claims1,2 or31.

Images