|Publication number||US6389448 B1|
|Application number||US 09/565,259|
|Publication date||May 14, 2002|
|Filing date||May 5, 2000|
|Priority date||Dec 6, 1999|
|Also published as||WO2001040962A1|
|Publication number||09565259, 565259, US 6389448 B1, US 6389448B1, US-B1-6389448, US6389448 B1, US6389448B1|
|Inventors||Leonard Primak, John Gnip, Gene R. Volovich|
|Original Assignee||Warp Solutions, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (23), Referenced by (140), Classifications (9), Legal Events (4) |
|External Links: USPTO, USPTO Assignment, Espacenet|
System and method for load balancing
US 6389448 B1
A system for distributing load between multiple servers where more than one server in a sever cluster receives a request for connection from a client and each server makes a determination of whether or not to respond to the request. Software modules running on the servers monitor and communicate relative abilities of each server to respond to client requests. Each server responding to a percentage of client requests corresponding to its relative ability to respond.
What is claimed:
1. A system for distributing load within a network, comprising:
at least one cluster having a plurality of servers connected to each other, each server in said cluster being addressable by a common network address; and
a load balancing module in each server for calculating a connection value for each connection request addressed to said network address and for accepting a connection request as a function of available capacity of said respective server with respect to overall available capacity of said cluster and the connection value associated with said connection request.
2. The system of claim 1, wherein said connection value being within a predefined range of values.
3. The system of claim 2, wherein said module in said each server transmits the available capacity of said each server to other servers in said cluster and determines the overall available capacity from the available capacity of said plurality of servers in said cluster.
4. The system of claim 3, wherein said module in said each server determines a sub-range within said predefined range of values as a function of the available capacity of said each server with respect to the overall available capacity, each sub-range not overlapping with another sub-range.
5. The system of claim 4, wherein said connection value being a pseudo-random number; and wherein said module accepts only connection request having a connection value within the sub-range of said associated server.
6. The system of claim 2, further comprising a coordinating device; wherein said module in said each server transmits the available capacity of said each server to said coordinating device which determines the overall available capacity from the available capacity of said plurality of servers in said cluster.
7. The system of claim 6, wherein said coordinating device determines for said each server a sub-range within said predefined range of values as a function of the available capacity of said each server with respect to the overall available capacity, each sub-range not overlapping with another sub-range.
8. The system of claim 7, wherein said connection value being a pseudo-random number; and wherein said module accepts only connection request having a connection value within the sub-range of said associated server.
9. The system of claim 1, wherein said network is either a TCP/IP network or a system network architecture (SNA) network.
10. The system of claim 1, wherein said available capacity of said each server is function of at least one of the following: server's processing or CPU capacity, CPU load, number of concurrent processes or tasks being performed, and number of existing connections.
11. A system for distributing load within a network, comprising:
at least one cluster having a plurality of servers connected to each other, each server in said cluster being addressable by a common network address;
a plurality of routers for routing connection requests to said plurality of servers, each server in said cluster connected to said at least one router; and
a load balancing module in each server for calculating a connection value for each connection request addressed to said network address and for accepting a connection request from a router as a function of available capacity of said respective server with respect to overall available capacity of servers connected to said router and the connection value associated with said connection request.
12. The system of claim 11, wherein said connection value being within a predefined range of values.
13. The system of claim 12, wherein said module in each server connected to said router transmits the available capacity of said each server to other servers connected said router and determines the overall available capacity from the available capacity of the servers connected to said router.
14. The system of claim 13, wherein said module in said each server connected to said router determines a sub-range within said predefined range of values as a function of the available capacity of said each server with respect to the overall available capacity, each subrange not overlapping with another sub-range.
15. The system of claim 14, wherein said connection value being a pseudo-random number; and wherein said module accepts only connection request having a connection value within the sub-range of said associated server.
16. A method for distributing load within a network comprising at least one cluster having a plurality of servers connected to each other, each server in said cluster being addressable by a common network address, comprising the steps of:
calculating a connection value for each connection request addressed to said network address by said each server; and
accepting a connection request by a server as a function of the connection value associated with said connection request and available capacity of said server with respect to overall available capacity of said cluster.
17. The method of claim 16, wherein said connection value being within a predefined range of values.
18. The method of claim 17, further comprising the steps of:
transmitting the available capacity of said server to other servers in said cluster; and
determining by each server the overall available capacity from the available capacity of said plurality of servers in said cluster.
19. The method of claim 18, further comprising the step of determining a sub-range within said predefined range of values for said each server as a function of the available capacity of said each server with respect to the overall available capacity, each sub-range not overlapping with another sub-range.
20. The method of claim 19, wherein said connection value being a pseudo-random number; and wherein said module accepts only connection request having a connection value within the sub-range of said associated server.
This application is a continuation-in-part of U.S. provisional patent application Serial No. 60/169,196, filed Dec. 6, 1999, which is incorporated by reference in its entirety.
BACKGROUND OF THE INVENTION
The invention relates to the field of data packet management. More specifically, the invention relates to the regulating data packets to and from a cluster or group of data servers.
The evolution over the past 20 years of digital communications technology has resulted in the current distributed client-server data networks, the most well known of which is the Internet. In these distributed client-server networks, multiple clients are able to access and share data stored on servers located at various points or nodes through a given network. In the case of the Internet, a client computer is able to access data stored on a server located at any point on the planet, as long as the server is also connected to the Internet.
With the rapid proliferation in use of distributed data networks such as the Internet, more and more clients from around the world are attempting to connect to and extract data stored on a finite number of servers. Those establishing and maintaining the servers containing the desired data, such as web pages from popular web sites, are finding it difficult to insure that all the clients attempting to access data will be able to do so. A given server can only connect with a finite number of clients at the same time. The number of simultaneous connections a given server can support is a function of the server's computational, storage and communications capabilities. In situations where the number of clients attempting to access data stored on a server exceeds the server's capacity, some clients either will not be able to connect or will be dropped by the server. In other cases where a server is overwhelmed by client requests for data, the server may cease to function altogether.
As a partial solution to the situation described above, server operators will typically deploy multiple mirrored servers, each having data identical to that stored on all the other servers. The mirrored servers are typically connected to the same network and are referred to as a server cluster. In conjunction with the multiple mirrored servers, a load balancer is typically used. When a client attempts to connect to and access data from a server cluster, the client's request is first received by the load balancer which determines which of the servers is best suited to handle the client's request. Various load balancing solutions are commercially available and each uses different techniques and criteria for determining to which server to direct a client's request. However, the common characteristic for each of the currently available solutions is that they all attempt to pick a server which is most capable of responding to the client's request.
An inherent drawback with the load balancing solutions available today is that they all require a device generally referred to as a load balancer. As described above, the load balancer is the first point of contact for each client attempting to access data on the server cluster, and therefore, the maximum rate at which the entire server cluster can receive and respond to client requests is limited by the throughput of the load balancer. It is foreseeable that the number of client requests for data may exceed a load balancer's ability to properly route the requests, and requests will be ignored or dropped despite the fact that the server cluster has sufficient capacity to handle all the request. Another drawback of the currently available load balancers is that when they malfunction, their entire server cluster becomes inoperative.
U.S. Pat. No. 6,006,259 relates to an Internet Protocol (IP) network clustering system wherein it attempts to address the above-mentioned drawbacks by distributing the load balancing responsibilities to all of the servers in the server cluster. However, it does not address the problem of balancing the load between non-uniformly loaded servers in the server cluster. That is, the system considers the available capacity (or the current load) of the server cluster as a group, but not the available capacity of the individual servers in the server cluster. For example, if one server is operating at 90% capacity and another server is operating at 60% capacity, it is desirable that the load balancing system directs more traffic to the lightly loaded server. The present invention advantageously balances load between the servers in the server cluster by directing traffic based on the available capacity of the individual servers in the server cluster.
OBJECTS AND SUMMARY OF THE INVENTION
Therefore, it is an object of the present to overcome the disadvantages of the above-described systems by providing a system and technique for balancing or distributing load between the servers in a server cluster. The present invention is a network load balancing system which is highly scalable and optimizes packet throughput by dynamically distributing the load between the servers in a server cluster.
The present invention includes a server cluster comprising a plurality of servers, with all servers having the same network address, and each server having a load balancing module to generate a connection value for each connection request. A particular server in the server cluster accepts and processes the network connection request based on the connection value. That is, each server is associated with a non-overlapping range of connection values and accepts only connection requests having connection values within that range. The range associated with each server is dynamically adjusted based on the available capacity of each server in the server cluster to thereby dynamically balance the load between the servers.
The servers are connected to the network in parallel such that each server receives every connection request, such as a synchronizing segment or packet (SYN) for transmission control protocol/internet protocol (TCP/IP) connection, substantially at the same time. The SYN packet is the first segment or packet sent by the TCP protocol and is used to synchronize the two ends of a connection in preparation for opening a connection. The load balancing modules on the servers communicate with each other to determine each server's relative ability to accept a new connection (i.e., available capacity).
Various other objects of the present invention will become readily apparent from the ensuing detailed description of the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The following detailed description, given by way of example, and not intended to limit the present invention solely thereto, will be best be understood in conjunction with the accompanying drawings:
FIG. 1 is a diagram illustrating a network configuration of the present invention;
FIG. 2a is a diagram showing the incorporation of an embodiment of the present invention in the Internet;
FIG. 2b is a diagram showing the incorporation of another embodiment of the present invention in the Internet;
FIG. 3 is a diagram showing the sub-range of each server in the server cluster of FIG. 2a;
FIG. 4a is a block diagram illustrating the flow of a SYN Packet within a server according to the present invention;
FIG. 4b is a flow diagram illustrating the operation of the load balancing module of FIG. 4a;
FIG. 5 is a diagram showing a client computer connected to the server cluster of FIG. 2a;
FIG. 6 is a block diagram illustrating a server cluster according to the present invention within a multi-router topology; and
FIG. 7 is a plot of a pseudo-random number generation function.
DETAILED DESCRIPTION OF THE INVENTION
The present invention is readily implemented using presently available communication apparatuses and electronic components. The invention finds ready application in virtually all data communications system, including but not limited to the Internet, private or public communication networks, wireless networks, satellite networks, cable networks or other online global broadcast networks.
Turning now to FIG. 1, there is illustrated an example of a TCP/IP network incorporating the load balancing system of the present invention. It is appreciated that the load balancing system of the present invention is not limited to the TCP/IP network, it finds ready application in virtually all data networks employing any conventional data protocol, such as the system network architecture (SNA), CCCIT X.25, etc. A client computer 60 is connected to a router 30 that is connected to servers 10(a)-(c). The client computer 60 accesses data stored on the servers 10(a)-(c) via the router 30. Each server 10 has a unique real IP address and shares a common virtual IP address with all of the servers in the server cluster, e.g., 22.214.171.124. The client computer 60 connects to one of the server in the server cluster by transmitting a connection request. Typically, the connection request is in the form a SYN packet addressed to the server's IP address. After receiving the SYN packet from the client computer 60, the router 30 multicasts the SYN packet to all of the servers 10(a)-(c).
Turning now to FIGS. 2a and 2 b, each SYN packet received by the server is evaluated by a load balancing module 12, preferably a software module, resident in each server 10. The evaluation process involves calculating a pseudo-random number for each SYN packet and determining the relative availability of each server. The load-balancing module 12 either passes the SYN packet onto the server's TCP stack or discards the request based on its evaluation of the SYN packet. The load balancing module 12 calculates a pseudo-random number or a connection value using a portion of the SYN packet as an input. Preferably, the pseudo-random number generation function is characterized by an even probability distribution over a fixed range of values and a zero probability outside the range. FIG. 7 shows an example of a sequence of pseudo-random numbers generated by a suitable pseudo-random number generation function. The pseudo-random number generated for each SYN packet may have substantially equal probability of being any value within a range defined by the pseudo-random number generation function. It is appreciated that the load balancing module 12 may utilize any conventional random generator to calculate the pseudo-random number. Also, it is appreciated that every server in the cluster calculates the identical connection value for each SYN packet.
The relative availability of a server is a function of its overall capacity and current load. It is appreciated that different versions of the servers may have different processing power or capacity. Preferably, an agent program or application 14 resident on each server collects the availability information. The agent 14 can collect the availability information by monitoring one or more of server's internal conditions which affect the server's ability to establish connections with the client computers 60. The monitored conditions may include, but are not limited to, the server's processing (or CPU) capacity, CPU load, number of concurrent processes or tasks being performed, and the number of existing connections. The agent 14 can also monitor other conditions such as the server's internal temperature and power consumption using instruments connected or resident in the server. It is appreciated that electronic temperature gauges and other instruments capable of transmitting readings directly to an application resident on a general purpose computer, i.e., server, are well known to one skilled in the art.
In an embodiment of the present invention as shown in FIG. 4a, the agent 14 records the availability information of its associated server in a pre-defined memory location 16. The agent 14 can periodically transmit the availability information of its associated server either to other servers in the cluster (FIG. 2a) or to a coordinating device 20 (FIG. 2b). As shown in FIG. 2a, each agent 14 broadcasts its respective availability information to all of the servers in the cluster. Alternatively, as shown in FIG. 2b, each agent 14 transmits its respective availability information only to the coordinating device 20. It is appreciated that the coordinating device 20 may be a server or a general purpose computer.
Turning now to an example illustrated in FIG. 3 and the flow diagram in FIG. 4b, the load balancing module 12 resident on each server 10 generates a range of connection values from 0 to 32,000 for each SYN packet at step 401. In other words, every SYN packet has a connection value or number that is between 0 and 32,000, and each connection value is accepted by only one server in the cluster.
Although, the SYN packet is transmitted to each server in the cluster, only one server, namely the associated load balancing module 12, accepts and establishes a connection to the client computer 60 based on the connection value of the SYN packet. The load balancing module 12 on each server compares the connection value of a given SYN Packet to its respective assigned sub-range of connection values at step 402. If the connection value of the SYN packet is within the server's assigned sub-range, the associated load balancing module 12 forwards the SYN packet to the TCP stack and the server accepts the connection request from the client computer 60 that transmitted this SYN packet at step 403. However, if the connection value of the SYN packet is not within the server's assigned sub-range, the associated load balancing module 12 will then simply discard the SYN packet at step 404.
For example, in FIG. 3, the servers 10(a) accepts SYN packet having a connection value between its assigned sub-range of 0 to 10,000, and server 10(b) accepts SYN packet having a connection value between its assigned sub-range 10,001 to 20,000. If the SYN packet has a connection value of 16,000, then the SYN packet will be accepted only by the server 10(b), and discarded by servers 10(a) and 19(c).
Preferably, the assigned sub-range is not static, but dynamically adjusts as a function of each server's availability with respect to the overall capacity of the server cluster. Each server's agent 14 continuously or periodically transmits the server's availability information either to other servers in the cluster or to a coordinating device 20, for example once every two seconds. As this information is received, the sub-range for each server is continuously recalculated such that the size of each server's sub-range is in proportion with that server's availability. For example, a server having 30% of the total availability of a server cluster would be assigned a sub-range whose size would be about 30% of the total range. Given that the connection values for SYN packets are evenly distributed across the entire range, that would result in about 30% of the connection values falling within that server's sub-range, and about 30% of all connection being accepted by that server. Other server's in the cluster are assigned and continually reassigned sub-ranges similarly. If a given server becomes inoperative, the sub-ranges of other servers in the cluster will expand to cover the area no longer covered by the down server. Also, during the transition period wherein the servers are assigned new sub-range of connection values, a given connection value may be associated with more than one server. In such scenario, the connection request may be accepted by two servers, but only one connection will be generally established since most conventional network protocols have mechanism to resolve such conflict. For example, under TCP/IP protocol, two servers transmit their own SYN acknowledgement (ACK) packets to the client computer 60 associated with the SYN packet. The client computer 60 accepts only one SYN ACK packet and rejects the other SYN ACK packet, thereby establishing a single connection between the server cluster and the client computer 60.
In one embodiment of the present invention, each server receives the availability information from each other server and determines its own sub-range. Based on availability information from its own agent 14 and other agents 14 associated with other servers in the cluster, each load balancing module 12 calculates a new sub-range of connection values that it will accept. Alternatively, the coordinating device 20 determines and transmits a new sub-range for each server based on all of the availability information from each server 10. The coordinating device 20 or each server in the cluster continually adjusts the sub-range for each server to reflect the servers' availabilities to accept new connections.
In accordance with another embodiment of the present invention, as shown in FIG. 6, the servers are arranged within a multi-router topology. That is, the network routes the data traffic to the servers in the server cluster via multiple routers 30. The multiple-router topology of FIG. 6 increases the reliability of the network in that the servers can receive traffic from multiple routers. For example, the server 10(c) in FIG. 6 is connected to routers 30(a) and 30(b), thereby providing overlapping server coverage. The router 30(a) transmits packets, such as SYN packet, addressed to virtual IP address 126.96.36.199 to the servers 10 via network 1.2 and the router 30(b) transmits packets addressed to virtual IP address 188.8.131.52 to the servers 10 via network 1.3. Due to the overlapping router coverage, servers may have two different real IP addresses, e.g., server 10(c) has real IP addresses of 184.108.40.206 and 220.127.116.11 respectively for routers 30(a) and 30(b). It is well known in the art that multiple network interface cards (NIC) can be installed in the server to assign multiple real IP addresses to the server, each NIC being uniquely associated with a single real IP address. It is appreciated that each server 10 in the server cluster receives not only packets addressed to its real IP addresses, but also packets addressed to its virtual IP address.
On initiation, the routers 30(a) and 30(b) broadcast address resolution protocol (ARP) packets to map (or convert) virtual IP addresses, such as 18.104.22.168, to real IP addresses. ARP packets are generally used to dynamically bind a virtual (or high level) IP address to a real (or low-level physical hardware) IP address. For example, server 10(c) can answer the ARP with a multicast Ethernet address, such as 01:00:5E:75:C9:3E/IP 22.214.171.124, to which servers 10(a)-(f) subscribe. Thereafter, the real IP addresses corresponding to the virtual IP address is stored in the router's ARP cache, and all incoming packets destined for the virtual IP address 126.96.36.199 are multicast to the corresponding real IP addresses (or Ethernet addresses). This effectively sends the incoming packets to all of the servers in the server cluster.
While the present invention has been particularly described with respect to the illustrated embodiment, it will be appreciated that various alterations, modifications and adaptations may be made on the present disclosure, and are intended to be within the scope of the present invention. It is intended that the appended claims be interpreted as including the embodiment discussed above, those various alternatives, which have been described, and all equivalents thereto.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4748558||May 1, 1986||May 31, 1988||Hitachi, Ltd.||Load balancing control method for a loosely coupled multi-processor system and a device for realizing same|
|US5459837||Apr 21, 1993||Oct 17, 1995||Digital Equipment Corporation||System to facilitate efficient utilization of network resources in a computer network|
|US5740371||Mar 18, 1996||Apr 14, 1998||International Business Machines Corporation||Load balancing of connections to parallel servers|
|US5774660||Aug 5, 1996||Jun 30, 1998||Resonate, Inc.||World-wide-web server with delayed resource-binding for resource-based load balancing on a distributed resource multi-node network|
|US5774668||Jun 7, 1995||Jun 30, 1998||Microsoft Corporation||System for on-line service in which gateway computer uses service map which includes loading condition of servers broadcasted by application servers for load balancing|
|US5828847||Apr 19, 1996||Oct 27, 1998||Storage Technology Corporation||Dynamic server switching for maximum server availability and load balancing|
|US5864535||Sep 18, 1996||Jan 26, 1999||International Business Machines Corporation||Network server having dynamic load balancing of messages in both inbound and outbound directions|
|US5881238||Feb 10, 1997||Mar 9, 1999||International Business Machines Corporation||System for assignment of work requests by identifying servers in a multisystem complex having a minimum predefined capacity utilization at lowest importance level|
|US5898870||Dec 13, 1996||Apr 27, 1999||Hitachi, Ltd.||Load balancing for a parallel computer system by employing resource utilization target values and states|
|US5915095||Aug 8, 1995||Jun 22, 1999||Ncr Corporation||Method and apparatus for balancing processing requests among a plurality of servers based on measurable characteristics off network node and common application|
|US5933596||Feb 19, 1997||Aug 3, 1999||International Business Machines Corporation||Multiple server dynamic page link retargeting|
|US5933606||Feb 19, 1997||Aug 3, 1999||International Business Machines Corporation||Dynamic link page retargeting using page headers|
|US5951694||Feb 3, 1997||Sep 14, 1999||Microsoft Corporation||Method of redirecting a client service session to a second application server without interrupting the session by forwarding service-specific information to the second server|
|US5983227 *||Jun 12, 1997||Nov 9, 1999||Yahoo, Inc.||Dynamic page generator|
|US5991808||Jun 2, 1997||Nov 23, 1999||Digital Equipment Corporation||Task processing optimization in a multiprocessor system|
|US6006259||Nov 20, 1998||Dec 21, 1999||Network Alchemy, Inc.||Method and apparatus for an internet protocol (IP) network clustering system|
|US6006264||Mar 30, 1998||Dec 21, 1999||Arrowpoint Communications, Inc.||Method and system for directing a flow between a client and a server|
|US6014660||Dec 9, 1996||Jan 11, 2000||Sun Microsystems, Inc.||Method and apparatus for client-sensitive name resolution using DNS|
|US6041307||Jan 23, 1998||Mar 21, 2000||Lucent Technologies Inc.||Technique for effectively managing resources in a network|
|US6070191 *||Oct 17, 1997||May 30, 2000||Lucent Technologies Inc.||Data distribution techniques for load-balanced fault-tolerant web access|
|US6078943 *||Feb 7, 1997||Jun 20, 2000||International Business Machines Corporation||Method and apparatus for dynamic interval-based load balancing|
|US6173322 *||Jun 5, 1997||Jan 9, 2001||Silicon Graphics, Inc.||Network request distribution based on static rules and dynamic performance data|
|US6212565 *||Aug 26, 1998||Apr 3, 2001||Sun Microsystems, Inc.||Apparatus and method for improving performance of proxy server arrays that use persistent connections|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US6658473 *||Feb 25, 2000||Dec 2, 2003||Sun Microsystems, Inc.||Method and apparatus for distributing load in a computer environment|
|US6667980 *||Jan 10, 2000||Dec 23, 2003||Sun Microsystems, Inc.||Method and apparatus for providing scalable services using a packet distribution table|
|US6718383 *||Jun 2, 2000||Apr 6, 2004||Sun Microsystems, Inc.||High availability networking with virtual IP address failover|
|US6728780||Jun 2, 2000||Apr 27, 2004||Sun Microsystems, Inc.||High availability networking with warm standby interface failover|
|US6732186||Jun 2, 2000||May 4, 2004||Sun Microsystems, Inc.||High availability networking with quad trunking failover|
|US6754716||Feb 11, 2000||Jun 22, 2004||Ensim Corporation||Restricting communication between network devices on a common network|
|US6763479||Jun 2, 2000||Jul 13, 2004||Sun Microsystems, Inc.||High availability networking with alternate pathing failover|
|US6779039 *||Mar 31, 2000||Aug 17, 2004||Avaya Technology Corp.||System and method for routing message traffic using a cluster of routers sharing a single logical IP address distinct from unique IP addresses of the routers|
|US6788692 *||Jun 1, 1999||Sep 7, 2004||Nortel Networks Limited||Network switch load balancing|
|US6859929 *||Nov 2, 2000||Feb 22, 2005||Unisys Corporation||Method for server metafarm configuration optimization|
|US6880089||Mar 31, 2000||Apr 12, 2005||Avaya Technology Corp.||Firewall clustering for multiple network servers|
|US6880156 *||Jul 27, 2000||Apr 12, 2005||Hewlett-Packard Development Company. L.P.||Demand responsive method and apparatus to automatically activate spare servers|
|US6909691||Aug 7, 2000||Jun 21, 2005||Ensim Corporation||Fairly partitioning resources while limiting the maximum fair share|
|US6922832 *||Dec 12, 2000||Jul 26, 2005||Lockheed Martin Corporation||Execution of dynamic services in a flexible architecture for e-commerce|
|US6928481 *||May 5, 2000||Aug 9, 2005||International Business Machines Corporation||Method, apparatus and program to optimize the network distribution of digital information based on hierarchical grouping of server topology and code distribution|
|US6947977 *||Jun 8, 2001||Sep 20, 2005||Metadigm Llc||Scalable transaction system for a network environment|
|US6948003||Mar 15, 2000||Sep 20, 2005||Ensim Corporation||Enabling a service provider to provide intranet services|
|US6950849 *||Nov 1, 2000||Sep 27, 2005||Hob Gmbh & Co. Kg||Controlling load-balanced access by user computers to server computers in a computer network|
|US6970932 *||Dec 14, 1999||Nov 29, 2005||Microsoft Corporation||Non-delegable client requests to servers storing local information only|
|US6976258||Nov 30, 1999||Dec 13, 2005||Ensim Corporation||Providing quality of service guarantees to virtual hosts|
|US6985937||May 11, 2000||Jan 10, 2006||Ensim Corporation||Dynamically modifying the resources of a virtual server|
|US7020698 *||Nov 29, 2000||Mar 28, 2006||Lucent Technologies Inc.||System and method for locating a closest server in response to a client domain name request|
|US7035921 *||Nov 14, 2000||Apr 25, 2006||Hewlett-Packard Development Company, L.P.||Method of and apparatus for providing web service using a network of servers|
|US7043759||Aug 16, 2001||May 9, 2006||Mazu Networks, Inc.||Architecture to thwart denial of service attacks|
|US7051115 *||Apr 19, 2001||May 23, 2006||Lenovo (Singapore) Pte. Ltd.||Method and apparatus for providing a single system image in a clustered environment|
|US7055173||Apr 1, 2000||May 30, 2006||Avaya Technology Corp.||Firewall pooling in a network flowswitch|
|US7080148 *||Sep 30, 2002||Jul 18, 2006||America Online, Inc.||Translating switch and method|
|US7085829 *||Dec 31, 2001||Aug 1, 2006||Innomedia, Pte Ltd.||Method and system for an intelligent proxy server for workload balancing by workload shifting|
|US7089301 *||Aug 11, 2000||Aug 8, 2006||Napster, Inc.||System and method for searching peer-to-peer computer networks by selecting a computer based on at least a number of files shared by the computer|
|US7117263 *||Feb 1, 2000||Oct 3, 2006||Hewlett-Packard Development Company, L.P.||Apparatus and method for processing requests from an external queue in a TCP/IP-based application system|
|US7120704 *||Jan 31, 2002||Oct 10, 2006||International Business Machines Corporation||Method and system for workload balancing in a network of computer systems|
|US7124440||Aug 16, 2001||Oct 17, 2006||Mazu Networks, Inc.||Monitoring network traffic denial of service attacks|
|US7127625 *||Sep 4, 2003||Oct 24, 2006||Hewlett-Packard Development Company, L.P.||Application management based on power consumption|
|US7152112 *||Oct 24, 2005||Dec 19, 2006||Microsoft Corporation||Non-delegable client requests to servers storing local information only|
|US7203747 *||May 25, 2001||Apr 10, 2007||Overture Services Inc.||Load balancing system and method in a multiprocessor system|
|US7210147 *||Oct 5, 2000||Apr 24, 2007||Veritas Operating Corporation||IP virtualization|
|US7213264||Jan 31, 2002||May 1, 2007||Mazu Networks, Inc.||Architecture to thwart denial of service attacks|
|US7216154 *||Nov 28, 2000||May 8, 2007||Intel Corporation||Apparatus and method for facilitating access to network resources|
|US7225147 *||Mar 28, 2003||May 29, 2007||Metadigm Llc||Scalable transaction system for a network environment|
|US7243351 *||Dec 17, 2002||Jul 10, 2007||International Business Machines Corporation||System and method for task scheduling based upon the classification value and probability|
|US7278159||Aug 16, 2001||Oct 2, 2007||Mazu Networks, Inc.||Coordinated thwarting of denial of service attacks|
|US7284067 *||Feb 20, 2002||Oct 16, 2007||Hewlett-Packard Development Company, L.P.||Method for integrated load balancing among peer servers|
|US7290055 *||Oct 10, 2003||Oct 30, 2007||Sun Microsystems, Inc.||Multi-threaded accept mechanism in a vertical perimeter communication environment|
|US7313598 *||Jun 13, 2002||Dec 25, 2007||Cisco Technology, Inc.||Method and apparatus for partial replication of directory information in a distributed environment|
|US7340532 *||Feb 7, 2001||Mar 4, 2008||Akamai Technologies, Inc.||Load balancing array packet routing system|
|US7346702||Aug 23, 2001||Mar 18, 2008||Voltaire Ltd.||System and method for highly scalable high-speed content-based filtering and load balancing in interconnected fabrics|
|US7349348||Apr 2, 2001||Mar 25, 2008||Cisco Technologies, Inc.||Method and apparatus for determining a network topology in the presence of network address translation|
|US7363656||Nov 3, 2003||Apr 22, 2008||Mazu Networks, Inc.||Event detection/anomaly correlation heuristics|
|US7380019 *||Mar 17, 2004||May 27, 2008||Hitachi, Ltd.||Path control method|
|US7389510||Nov 6, 2003||Jun 17, 2008||International Business Machines Corporation||Load balancing of servers in a cluster|
|US7398317 *||Sep 5, 2001||Jul 8, 2008||Mazu Networks, Inc.||Thwarting connection-based denial of service attacks|
|US7421511 *||Jul 20, 2004||Sep 2, 2008||Hitachi, Ltd.||Path control method|
|US7512688 *||Aug 16, 2002||Mar 31, 2009||Hitachi, Ltd.||PPPoE network system that can distribute connection requests from PPPoE client terminals to specific PPPoE servers|
|US7548945 *||Jun 29, 2005||Jun 16, 2009||Nokia Corporation||System, network device, method, and computer program product for active load balancing using clustered nodes as authoritative domain name servers|
|US7596618 *||Dec 7, 2004||Sep 29, 2009||Hewlett-Packard Development Company, L.P.||Splitting a workload of a node|
|US7636325||Dec 7, 2004||Dec 22, 2009||Hewlett-Packard Development Company, L.P.||Determining highest workloads for nodes in an overlay network|
|US7650393 *||Apr 25, 2005||Jan 19, 2010||Hitachi, Ltd.||Information processing system and method|
|US7689685 *||Sep 26, 2003||Mar 30, 2010||International Business Machines Corporation||Autonomic monitoring for web high availability|
|US7702806||Aug 16, 2001||Apr 20, 2010||Riverbed Technology, Inc.||Statistics collection for network traffic|
|US7707295 *||May 3, 2002||Apr 27, 2010||Foundry Networks, Inc.||Connection rate limiting|
|US7707301 *||Aug 15, 2002||Apr 27, 2010||Huawei Technologies Co., Ltd.||Method and apparatus for equalizing load of streaming media server|
|US7734795||Jun 12, 2006||Jun 8, 2010||Aol Inc.||Translating switch and method|
|US7734814||Mar 3, 2008||Jun 8, 2010||Akamai Technologies, Inc.||Decrypting load balancing array system|
|US7743134||Aug 16, 2001||Jun 22, 2010||Riverbed Technology, Inc.||Thwarting source address spoofing-based denial of service attacks|
|US7743214||Jun 20, 2006||Jun 22, 2010||Mark Adams||Generating storage system commands|
|US7743415||Jan 31, 2002||Jun 22, 2010||Riverbed Technology, Inc.||Denial of service attacks characterization|
|US7760653||Oct 26, 2004||Jul 20, 2010||Riverbed Technology, Inc.||Stackable aggregation for connection based anomaly detection|
|US7774482||May 3, 2002||Aug 10, 2010||Foundry Networks, Inc.||Connection rate limiting for server load balancing and transparent cache switching|
|US7870271||Oct 3, 2005||Jan 11, 2011||Charles Frank||Disk drive partitioning methods and apparatus|
|US7886023 *||Apr 2, 2001||Feb 8, 2011||Cisco Technology, Inc.||Method and apparatus for a minimalist approach to implementing server selection|
|US7886299 *||Feb 14, 2005||Feb 8, 2011||Hitachi, Ltd.||Method of dynamically balancing workload of a storage system|
|US7916631 *||Mar 28, 2005||Mar 29, 2011||Microsoft Corporation||Load balancing in set top cable box environment|
|US7916727||Jan 31, 2006||Mar 29, 2011||Rateze Remote Mgmt. L.L.C.||Low level storage protocols, systems and methods|
|US7929534||Jun 28, 2004||Apr 19, 2011||Riverbed Technology, Inc.||Flow logging for connection-based anomaly detection|
|US7958259 *||Apr 8, 2008||Jun 7, 2011||Hitachi, Ltd.||Storage controller and method for determining client appropriateness|
|US7984147 *||Dec 29, 2000||Jul 19, 2011||Hewlett-Packard Development Company, L.P.||Apparatus and method for identifying a requested level of service for a transaction|
|US7984182 *||Jul 5, 2007||Jul 19, 2011||Brother Kogyo Kabushiki Kaisha||Node device, information transfer processing program, and network participation processing method and the like|
|US7996529||Mar 24, 2010||Aug 9, 2011||International Business Machines Corporation||System for autonomic monitoring for web high availability|
|US8001254||Apr 28, 2010||Aug 16, 2011||Aol Inc.||Translating switch and method|
|US8005918||Dec 16, 2002||Aug 23, 2011||Rateze Remote Mgmt. L.L.C.||Data storage devices having IP capable partitions|
|US8095681 *||Jan 10, 2006||Jan 10, 2012||Hitachi, Ltd.||Load balancing server and system|
|US8104042||May 6, 2008||Jan 24, 2012||International Business Machines Corporation||Load balancing of servers in a cluster|
|US8180921 *||May 28, 2002||May 15, 2012||Intel Corporation||Method and apparatus for load balancing|
|US8234378||Oct 20, 2005||Jul 31, 2012||Microsoft Corporation||Load balancing in a managed execution environment|
|US8387132||Oct 6, 2009||Feb 26, 2013||Rateze Remote Mgmt. L.L.C.||Information packet communication with virtual objects|
|US8396956 *||Sep 29, 2010||Mar 12, 2013||Cisco Technology, Inc.||Mobility service clustering using network service segments|
|US8433808 *||Feb 1, 2011||Apr 30, 2013||Juniper Networks, Inc.||Learning values of transmission control protocol (TCP) options|
|US8443220 *||Sep 17, 2009||May 14, 2013||International Business Machines Corporation||Automated voltage control for scheduled server outage in server cluster by determining future workload increase for remaining servers based upon service level objectives and determining associated voltage adjustments|
|US8473578||Jul 28, 2011||Jun 25, 2013||Rateze Remote Mgmt, L.L.C.||Data storage devices having IP capable partitions|
|US8477609 *||Mar 12, 2010||Jul 2, 2013||F5 Networks, Inc.||Method and system for scaling network traffic managers|
|US8479057||Nov 3, 2003||Jul 2, 2013||Riverbed Technology, Inc.||Aggregator for connection based anomaly detection|
|US8484656 *||Mar 12, 2007||Jul 9, 2013||Citrix Systems, Inc.||Systems and methods for providing global server load balancing of heterogeneous devices|
|US8504719 *||Jun 7, 2010||Aug 6, 2013||Akamai Technologies, Inc.||Load balancing array system with URL modification so that content is served by a content delivery network|
|US8504879||Nov 3, 2003||Aug 6, 2013||Riverbed Technology, Inc.||Connection based anomaly detection|
|US8527639||Aug 18, 2000||Sep 3, 2013||Cisco Technology, Inc.||Content server selection for accessing content in a content distribution network|
|US8533729||Jan 29, 2008||Sep 10, 2013||Alibaba Group Holding Limited||Distributed task system and distributed task management method|
|US8553542||Jul 12, 2011||Oct 8, 2013||Fs Networks, Inc.||Method and system for scaling network traffic managers using connection keys|
|US8554929||May 3, 2002||Oct 8, 2013||Foundry Networks, Llc||Connection rate limiting for server load balancing and transparent cache switching|
|US8566445||Mar 29, 2012||Oct 22, 2013||Intel Corporation||Method and apparatus for load balancing|
|US8572228||May 21, 2010||Oct 29, 2013||Foundry Networks, Llc||Connection rate limiting for server load balancing and transparent cache switching|
|US8578053 *||Apr 26, 2005||Nov 5, 2013||Fujitsu Limited||NAS load balancing system|
|US8583449 *||Mar 22, 2004||Nov 12, 2013||Avaya Inc.||Method and apparatus for providing network based load balancing of medical image data|
|US8589480 *||May 24, 2011||Nov 19, 2013||Sony Computer Entertainment America Llc||Automatic performance and capacity measurement for networked servers|
|US8726363||Jan 31, 2012||May 13, 2014||Rateze Remote Mgmt, L.L.C.||Information packet communication with virtual objects|
|US8819252||May 3, 2002||Aug 26, 2014||Foundry Networks, Llc||Transaction rate limiting|
|US8825832 *||Jul 21, 2004||Sep 2, 2014||Hewlett-Packard Development Company, L.P.||Method and system for managing connections|
|US8966010||Aug 9, 2005||Feb 24, 2015||Jordaan Consulting Ltd. I, Llc||Scalable transaction system for a network environment|
|US9025592 *||May 21, 2008||May 5, 2015||Telefonaktiebolaget L M Ericsson (Publ)||Blade cluster switching center server and method for signaling|
|US9026651||Sep 26, 2013||May 5, 2015||Sony Computer Entertainment America Llc||Automatic performance and capacity measurement for networked servers|
|US20010034792 *||Feb 7, 2001||Oct 25, 2001||Swildens Eric Sven-Johan||Decrypting load balancing array system|
|US20020059451 *||Aug 23, 2001||May 16, 2002||Yaron Haviv||System and method for highly scalable high-speed content-based filtering and load balancing in interconnected fabrics|
|US20020069279 *||Dec 29, 2000||Jun 6, 2002||Romero Francisco J.||Apparatus and method for routing a transaction based on a requested level of service|
|US20020073134 *||Dec 12, 2000||Jun 13, 2002||Barnett Janet A.||Execution of dynamic services in a flexible architecture for e-commerce|
|US20020152310 *||Apr 12, 2001||Oct 17, 2002||International Business Machines Corporation||Method and apparatus to dynamically determine the optimal capacity of a server in a server farm|
|US20040064586 *||Sep 30, 2002||Apr 1, 2004||Weigand Gilbert G.||Translating switch and method|
|US20040117794 *||Dec 17, 2002||Jun 17, 2004||Ashish Kundu||Method, system and framework for task scheduling|
|US20040125956 *||Dec 31, 2002||Jul 1, 2004||Heiderscheit David D.||Location document system|
|US20040133626 *||Dec 17, 2003||Jul 8, 2004||International Business Machines Corporation||Selecting a preferred server from groups of servers based on geographical information obtained from the requesting client|
|US20040160975 *||Jan 21, 2004||Aug 19, 2004||Charles Frank||Multicast communication protocols, systems and methods|
|US20040205374 *||Nov 3, 2003||Oct 14, 2004||Poletto Massimiliano Antonio||Connection based anomaly detection|
|US20040215688 *||Dec 16, 2002||Oct 28, 2004||Charles Frank||Data storage devices having ip capable partitions|
|US20040221190 *||Nov 3, 2003||Nov 4, 2004||Roletto Massimiliano Antonio||Aggregator for connection based anomaly detection|
|US20050027875 *||Aug 15, 2002||Feb 3, 2005||Xuelai Deng||Method and appartatus for equalizing load of streaming media server|
|US20050055590 *||Sep 4, 2003||Mar 10, 2005||Farkas Keith Istvan||Application management based on power consumption|
|US20050080885 *||Sep 26, 2003||Apr 14, 2005||Imran Ahmed||Autonomic monitoring for web high availability|
|US20050102676 *||Nov 6, 2003||May 12, 2005||International Business Machines Corporation||Load balancing of servers in a cluster|
|US20050125539 *||Oct 10, 2003||Jun 9, 2005||Sunay Tripathi||Multi-threaded accept mechanism in a vertical perimeter communication environment|
|US20100251008 *||Jun 7, 2010||Sep 30, 2010||Eric Sven-Johan Swildens||Decrypting Load Balancing Array System|
|US20110022676 *||Jan 27, 2011||Allan Thomson||Mobility service clustering using network service segments|
|US20110067033 *||Sep 17, 2009||Mar 17, 2011||International Business Machines Corporation||Automated voltage control for server outages|
|US20110124342 *||May 21, 2008||May 26, 2011||Oliver Speks||Blade Cluster Switching Center Server and Method for Signaling|
|US20120303694 *||May 24, 2011||Nov 29, 2012||Sony Computer Entertainment Inc.||Automatic performance and capacity measurement for networked servers|
|US20130117455 *||Jul 5, 2012||May 9, 2013||Avaya Communication Israel Ltd||Splicing Persistent Connections|
|USRE42214||Dec 13, 2007||Mar 8, 2011||Pawan Goyal||Providing quality of service guarantees to virtual hosts|
|USRE43051||Dec 27, 2011||Digital Asset Enterprises, L.L.C.||Enabling a service provider to provide intranet services|
|USRE44918||Aug 15, 2002||May 27, 2014||Huawei Technologies Co., Ltd.||Method and apparatus for equalizing load of streaming media server|
|CN101282260B||Apr 5, 2007||Apr 20, 2011||中兴通讯股份有限公司||Method and system for distributing load of flow medium server|
|WO2002017034A2 *||Aug 23, 2001||Feb 28, 2002||Voltaire Advanced Data Securit||System and method for highly scalable high-speed content-based filtering and load balancing in interconnected fabrics|
|WO2003003233A1 *||Jun 27, 2002||Jan 9, 2003||Capital One Financial Corp||Systems and methods for accessing data|
|WO2004061646A1 *||Dec 4, 2003||Jul 22, 2004||Motorola Inc||Location document system|
|May 5, 2000||AS||Assignment|
|Nov 30, 2005||REMI||Maintenance fee reminder mailed|
|May 15, 2006||LAPS||Lapse for failure to pay maintenance fees|
|Jul 11, 2006||FP||Expired due to failure to pay maintenance fee|
Effective date: 20060514