WO2003042855A1 - System for reducing server loading during content delivery - Google Patents

System for reducing server loading during content delivery Download PDF

Info

Publication number
WO2003042855A1
WO2003042855A1 PCT/US2002/036562 US0236562W WO03042855A1 WO 2003042855 A1 WO2003042855 A1 WO 2003042855A1 US 0236562 W US0236562 W US 0236562W WO 03042855 A1 WO03042855 A1 WO 03042855A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
server
proxy server
client
proxy
Prior art date
Application number
PCT/US2002/036562
Other languages
French (fr)
Inventor
Kaushik Barde
Richard Hartman
Gopinath Rebala
Original Assignee
One Touch Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by One Touch Systems, Inc. filed Critical One Touch Systems, Inc.
Publication of WO2003042855A1 publication Critical patent/WO2003042855A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • H04L67/5651Reducing the amount or size of exchanged application data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • H04L67/5682Policies or rules for updating, deleting or replacing the stored data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/10015Access to distributed or replicated servers, e.g. using brokers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/288Distributed intermediate devices, i.e. intermediate devices for interaction with other intermediate devices on the same level

Definitions

  • the present invention relates generally to electronic multimedia exchange, and, more particularly, to reducing server load during content delivery.
  • the World Wide Web is a system of Internet servers that support specially formatted documents.
  • the documents are formatted in a script called HTML (HyperText Markup Language) that supports links to anything that is capable of being transmitted digitally over the Internet, such as documents, graphics, audio files, video files and the like.
  • HTML HyperText Markup Language
  • the client terminal For a transaction on the WWW between a client terminal ana a nost server, the client terminal retrieves a web object from the host server.
  • the host server is identified through a Uniform Resource Locator (URL), which is the global address of documents and other resources on the WWW.
  • the client terminal normally accesses the Internet through an Internet Access Service Provider (IASP).
  • IASP Internet Access Service Provider
  • a cache located within the IASP network, functions as an intermediary in transactions involving retrieval of objects from servers by a client terminal.
  • the cache within the IASP saves a copy of aretrieved object for itself when the object is moved from the server to the requesting client terminal.. This caching operation is transparent to the user and, under normal circumstances, does not result in substantial delay fro.u die copying operation.
  • the copying operation is performed simultaneously with the retrieval from the server and the delivery to the client terminal.
  • the cache within the IASP network satisfies subsequent requests for objects that are stored therein, thereby obviating the necessity of retrieving the object from the original server. This reduces the delay as perceived by the user to access the object and saves bandwidth on links that connect the IASP network to the Internet.
  • HTTP is the underlying protocol used by the World Wide Web. HTTP defines how messages are formatted and transmitted and what actions web servers and browsers should take in response to various commands. Direct browsing by multiple clients to a particular site using HTTP tends to result in overloading of the host.
  • the copy of the object stored in the cache may differ from the object in the server if the latter is modified after the initial request for the object.
  • the copy of the object provided to the requesting client from the cache may not be current.
  • a server load reduction system includes a master URL containing data.
  • the system further includes a proxy browser, which conducts a browse operation to request the data contained in the master URL. This browse operation is conducted through a proxy server.
  • the proxy server is capable of receiving the data from the master URL.
  • the proxy server includes logic operative to record and distribute the data to a client server. Logic contained in the proxy browser is operative to notify a client server to load the data when the proxy server contains all of the data.
  • FIGURE 1 is a perspective view of a server load reduction system in accordance with an embodiment of the present invention.
  • FIGURE 2 is a schematic diagram of a server load reduction system in accordance with an embodiment of the present invention.
  • FIGURE 3 is a block diagram of a server load reduction system in accordance with an embodiment of the present invention.
  • the present invention is illustrated with respect to a server load reduction system, particularly suited to electronic multimedia transfer and storage. However, the present invention is applicable to various other uses that may require reduction of server loads, as will be understood by persons skilled in the art.
  • FIGURE 1 a perspective view of a server load reduction system 10, in accordance with one embodiment of the present invention, is illustrated.
  • the system 10 includes a group of users 12 from the same client operating a group of user terminals 13 and downloading the same master URL 14 from the WWW 16, as will be understood by one skilled in the art.
  • the current invention is browser type independent. In other words, one of the users may run Netscape NavigatorTM while another runs Internet ExplorerTM 1 .
  • the client system 18 activates and downloads the data from the master URL 14 for storage and use in the group of user terminals 13, as will be discussed later.
  • the load reduction system 10 includes a master Uniform Resource Locator (URL) 14.
  • the URL is the global address of a set of documents and other resources on the WWW 16.
  • a group of computer users 12 for a specific client browse to a particular HTTP site, that site is subjected to large amounts of loading proportional to the number of clients attempting access.
  • one client downloads the entire master URL 14 and then accesses the client proxy server 28 rather than the master URL 14, thus freeing the master URL 14 for other clients.
  • the unicast section includes a proxy browser 30, a proxy server 28, a client server 32 (first client server), a keypad manager 34 and a control message 36 for the client group of user terminals 13.
  • the unicast section transmits a portion of the data in the master URL 14 to the group of user terminals 13, as will be discussed later.
  • the multicast section includes the proxy browser 30, the proxy server 28, the client server 32, a multicast server 38, a multicast client server 40 (second client server), a multicast client storage location 41 with a browser cache 42, and a connection 43 to the group of user terminals 13.
  • the multicast section transmits the entire contents of the master URL 14 to the group of user terminals 13, as will be discussed later.
  • the system 10 includes a proxy browser 30, which facilitates WWW searching.
  • the proxy browser 30 functions as follows: the client initiates a browse command on the client server 32, which sends a command to the proxy browser 30 to load a particular URL (e.g. www.xyz.com), which subsequently sends a URL request (browse operation) 44 through the proxy server 28.
  • a particular URL e.g. www.xyz.com
  • the proxy browser 30 conducts a first browse operation to request a portion of the data contained in the master URL 14.
  • the proxy browser 30 then sends a unicast signal containing the portion of the master URL 14 through the client server 32 and to the keypad manager 34, which funnels control messages to the client terminal 13, as will be understood by one skilled in the art.
  • the client terminal 13 views the portion of the master URL 14 and decides whether to download the entire master URL 14. If the client affirmatively signals the proxy browser 30 to download the entire master URL 14, the multicast section activates and the proxy browser 30 downloads the data contained in the master URL to 14 the proxy server 28.
  • the proxy browser 30 contains logic operative to notify a multicast server 38 to load the data when the proxy server 28 contains all of the master URL data.
  • the multicast server 38 loads the specified URL when the proxy server 28 has received and stored all of the URLs and data associated
  • the multicast server then sends the data to the multicast client storage location 41 through multicast channels 46, as will be understood by one skilled in the art.
  • the browser cache 42 attached to the multicast client storage location 41, receives and stores the master URL data for access and use by the group of computer users 12.
  • the system 10 also includes a proxy server 28.
  • the embodied proxy server 28 has an internal proxy server cache 29 in which it stores files for future requests from the proxy browser 30.
  • the proxy server 28 contains logic operative to record the master URL data.
  • the proxy server 28 also contains logic operative to signal the proxy server cache 29 when a portion of the master URL 14 is modified. When signaled, the proxy server 28 reloads the data contained in the master URL 14.
  • the proxy server 28 also includes a distribution mechanism, which distributes the data to the client server 32.
  • FIGURE 3 in view of FIGURES 1 and 2, a block diagram of a server load reduction system 10, in accordance with one embodiment of the present invention, is illustrated.
  • the logic starts in operation block 52 when the client conducts a browse operation (through the proxy browser 30) to find a master URL 14.
  • a dete ⁇ nination is then made in inquiry block 60 whether the proxy server 28 contains all the master URL data. For a negative response, operation block 58 reactivates; and the proxy server 28 continues to receive master URL data.
  • operation block 62 activates, and the proxy browser 30 notifies the client server 32 to download the data from the proxy server.
  • the client conducts a browse operation with the proxy browser 30 to load a desired master URL 14.
  • the unicast portion of the system activates and a portion of the master URL 14 is stored in the proxy server 28.
  • the proxy server 28 notifies the client server 32. The client is then free to view the portion of the master URL without requiring multicast operations.
  • the multicast portion of the system activates. Subsequently, the proxy browser 30 requests all the data contained in the master URL 14, and that data is received in the proxy server 28.
  • the proxy server 28 then sends the data via multicast lines 48 to the multicast server 38 which stores the data and notifies the multicast client server 40 when the multicast server 38 contains all of the data in the master URL 14.
  • the multicast client server 40 then receives the data through multicast signal lines 46 and stores the master URL data in a browser cache 42.
  • the group of user terminals 13, associated with the client, then load portions of the master URL 14 as desired by the group of computer users 12.
  • the multicast and unicast portions of the invention may function independently or jointly, as embodied, depending on the amount of information in the master URL 14.
  • the unicast section sufficiently transfers the data to the group of user terminals 13.
  • the multicast section provides a greater number of open data transfer channels and therefore substantially increases data flow.

Abstract

A server load reduction system includes a master URL (14) containing data. The system further includes a proxy browser (30), which conducts a browse operation to request the data contained in the master URL (52). This browse operation is conducted through a proxy server (28). The proxy server is capable of receiving the data from the master URL (56, 58). The proxy server (28) includes logic operative to record and distribute (32) the data to a client server (32).The logic contained in the proxy browser (28) is operative to notify a client server (32) to load the data when the proxy server (28) contains all of the data (60, 62).

Description

System For Reducing Server Loading During Content Delivery
Technical Field
[0001] The present invention relates generally to electronic multimedia exchange, and, more particularly, to reducing server load during content delivery.
Background
[0002] The World Wide Web (WWW) is a system of Internet servers that support specially formatted documents. The documents are formatted in a script called HTML (HyperText Markup Language) that supports links to anything that is capable of being transmitted digitally over the Internet, such as documents, graphics, audio files, video files and the like. There are several applications called "web browsers" that simplify access to the WWW. Two notable examples are Netscape Navigator™ and Microsoft's Internet Explorer™.
[0003] For a transaction on the WWW between a client terminal ana a nost server, the client terminal retrieves a web object from the host server. The host server is identified through a Uniform Resource Locator (URL), which is the global address of documents and other resources on the WWW. The client terminal normally accesses the Internet through an Internet Access Service Provider (IASP). A cache, located within the IASP network, functions as an intermediary in transactions involving retrieval of objects from servers by a client terminal. The cache within the IASP saves a copy of aretrieved object for itself when the object is moved from the server to the requesting client terminal.. This caching operation is transparent to the user and, under normal circumstances, does not result in substantial delay fro.u die copying operation. The copying operation is performed simultaneously with the retrieval from the server and the delivery to the client terminal. [0004] The cache within the IASP network satisfies subsequent requests for objects that are stored therein, thereby obviating the necessity of retrieving the object from the original server. This reduces the delay as perceived by the user to access the object and saves bandwidth on links that connect the IASP network to the Internet. HTTP is the underlying protocol used by the World Wide Web. HTTP defines how messages are formatted and transmitted and what actions web servers and browsers should take in response to various commands. Direct browsing by multiple clients to a particular site using HTTP tends to result in overloading of the host.
[0005] A further problem currently exists with satisfying subsequent requests for an object from the cache. The copy of the object stored in the cache may differ from the object in the server if the latter is modified after the initial request for the object. When this occurs, the copy of the object provided to the requesting client from the cache may not be current.
[0006] The disadvantages associated with current, server download techniques have made it apparent that a new technique for downloading objects is needed. Given a host server web page, the new technique should allow multiple clients to rapidly and efficiently download the entire page. The new technique should also update cached information to minimize outdated information transfers. The present invention is directed to these ends.
Summary of the Invention
[0007] It is an object of the present invention to provide a system for allowing multiple clients to rapidly and efficiently download entire web pages. It is another object of the present invention to update cached information to minimize outdated information transfers.
[0008] In accordance with the present invention, a server load reduction system is disclosed. The server load reduction system includes a master URL containing data. The system further includes a proxy browser, which conducts a browse operation to request the data contained in the master URL. This browse operation is conducted through a proxy server. The proxy server is capable of receiving the data from the master URL. The proxy server includes logic operative to record and distribute the data to a client server. Logic contained in the proxy browser is operative to notify a client server to load the data when the proxy server contains all of the data.
[0009] Additional advantages and features of the present invention will become apparent from the description that follows and may be realized by the instrumentalities and combinations particularly pointed out in the appended claims, taken in conjunction with the accompanying drawings.
Brief Description Of The Drawings
[0010] For amore complete understanding of the invention, there will now be described some embodiments thereof, given by way of example, reference being made to the accompanying drawings, in which:
[0011] FIGURE 1 is a perspective view of a server load reduction system in accordance with an embodiment of the present invention;
[0012] FIGURE 2 is a schematic diagram of a server load reduction system in accordance with an embodiment of the present invention; and
[0013] FIGURE 3 is a block diagram of a server load reduction system in accordance with an embodiment of the present invention.
Detailed Description Of The Preferred Embodiment
[0014] The present invention is illustrated with respect to a server load reduction system, particularly suited to electronic multimedia transfer and storage. However, the present invention is applicable to various other uses that may require reduction of server loads, as will be understood by persons skilled in the art.
[0015] Referring to FIGURE 1, a perspective view of a server load reduction system 10, in accordance with one embodiment of the present invention, is illustrated. The system 10 includes a group of users 12 from the same client operating a group of user terminals 13 and downloading the same master URL 14 from the WWW 16, as will be understood by one skilled in the art. The current invention is browser type independent. In other words, one of the users may run Netscape Navigator™ while another runs Internet Explorer™1. After the client group of users 12 requests the master URL 14 through the group of user terminals 13, the client system 18 activates and downloads the data from the master URL 14 for storage and use in the group of user terminals 13, as will be discussed later.
[0016] Referring to FIGURE 2, a schematic diagram of a server load reduction system 10, in accordance with one embodiment of the present invention, is illustrated. The load reduction system 10 includes a master Uniform Resource Locator (URL) 14. The URL is the global address of a set of documents and other resources on the WWW 16. When a group of computer users 12 for a specific client browse to a particular HTTP site, that site is subjected to large amounts of loading proportional to the number of clients attempting access. For the current embodiment, one client downloads the entire master URL 14 and then accesses the client proxy server 28 rather than the master URL 14, thus freeing the master URL 14 for other clients.
[0017] This system 10 operates ideally with both unicast and multicast sections. The unicast section includes a proxy browser 30, a proxy server 28, a client server 32 (first client server), a keypad manager 34 and a control message 36 for the client group of user terminals 13. The unicast section transmits a portion of the data in the master URL 14 to the group of user terminals 13, as will be discussed later.
[0018] The multicast section includes the proxy browser 30, the proxy server 28, the client server 32, a multicast server 38, a multicast client server 40 (second client server), a multicast client storage location 41 with a browser cache 42, and a connection 43 to the group of user terminals 13. The multicast section transmits the entire contents of the master URL 14 to the group of user terminals 13, as will be discussed later.
[0019] As previously mentioned, the system 10 includes a proxy browser 30, which facilitates WWW searching. The proxy browser 30 functions as follows: the client initiates a browse command on the client server 32, which sends a command to the proxy browser 30 to load a particular URL (e.g. www.xyz.com), which subsequently sends a URL request (browse operation) 44 through the proxy server 28.
[0020] The proxy browser 30 conducts a first browse operation to request a portion of the data contained in the master URL 14. The proxy browser 30 then sends a unicast signal containing the portion of the master URL 14 through the client server 32 and to the keypad manager 34, which funnels control messages to the client terminal 13, as will be understood by one skilled in the art. The client terminal 13 then views the portion of the master URL 14 and decides whether to download the entire master URL 14. If the client affirmatively signals the proxy browser 30 to download the entire master URL 14, the multicast section activates and the proxy browser 30 downloads the data contained in the master URL to 14 the proxy server 28.
[0021] The proxy browser 30 contains logic operative to notify a multicast server 38 to load the data when the proxy server 28 contains all of the master URL data. In other words, the multicast server 38 loads the specified URL when the proxy server 28 has received and stored all of the URLs and data associated
* with the master URL 14 and when the client has received a command from the proxy browser 30 to load the master URL. The data transfer is ideally conducted through SERGE, which is a reliable information transfer system for multicast systems, as will be understood by one skilled in the art. The multicast server then sends the data to the multicast client storage location 41 through multicast channels 46, as will be understood by one skilled in the art. The browser cache 42, attached to the multicast client storage location 41, receives and stores the master URL data for access and use by the group of computer users 12.
[0022] As previously mentioned, the system 10 also includes a proxy server 28. The embodied proxy server 28 has an internal proxy server cache 29 in which it stores files for future requests from the proxy browser 30. The proxy server 28 contains logic operative to record the master URL data. The proxy server 28 also contains logic operative to signal the proxy server cache 29 when a portion of the master URL 14 is modified. When signaled, the proxy server 28 reloads the data contained in the master URL 14. The proxy server 28 also includes a distribution mechanism, which distributes the data to the client server 32.
[0023] Referring to FIGURE 3 in view of FIGURES 1 and 2, a block diagram of a server load reduction system 10, in accordance with one embodiment of the present invention, is illustrated. The logic starts in operation block 52 when the client conducts a browse operation (through the proxy browser 30) to find a master URL 14.
[0024] A determination is then made in inquiry block 54 whether the URL is the desired master URL. For a negative response, the logic flows again through operation block 52 until a positive response is obtained. [0025] For a positive response, operation block 56 activates; and the proxy browser 30 requests the data stored in the master URL 14. Subsequently, operation block 58 activates, and the proxy server 28 receives the master URL data.
[0026] A deteπnination is then made in inquiry block 60 whether the proxy server 28 contains all the master URL data. For a negative response, operation block 58 reactivates; and the proxy server 28 continues to receive master URL data.
[0027] Otherwise, operation block 62 activates, and the proxy browser 30 notifies the client server 32 to download the data from the proxy server.
[0028] In operation, in view of FIGURES 1,2 and 3, the client conducts a browse operation with the proxy browser 30 to load a desired master URL 14. When a potential master URL is found, the unicast portion of the system activates and a portion of the master URL 14 is stored in the proxy server 28. When the portion of the master URL 14 is completely stored in the proxy server 28, the proxy server 28 notifies the client server 32. The client is then free to view the portion of the master URL without requiring multicast operations.
[0029] When the client decides that the potential master URL is the desired master URL 14, the multicast portion of the system activates. Subsequently, the proxy browser 30 requests all the data contained in the master URL 14, and that data is received in the proxy server 28. The proxy server 28 then sends the data via multicast lines 48 to the multicast server 38 which stores the data and notifies the multicast client server 40 when the multicast server 38 contains all of the data in the master URL 14. The multicast client server 40 then receives the data through multicast signal lines 46 and stores the master URL data in a browser cache 42. The group of user terminals 13, associated with the client, then load portions of the master URL 14 as desired by the group of computer users 12.
[0030] It is to be understood that the multicast and unicast portions of the invention may function independently or jointly, as embodied, depending on the amount of information in the master URL 14. For small quantities of data, the unicast section sufficiently transfers the data to the group of user terminals 13. For larger quantities of data, the multicast section provides a greater number of open data transfer channels and therefore substantially increases data flow.
[0031] From the foregoing, it can be seen that there has been brought to the art a new and improved server load reduction system 10. It is to be understood that the preceding description of the preferred embodiment is merely illustrative of some of the many specific embodiments that represent applications of the principles of the present invention. Numerous and other arrangements would be evident to those skilled in the art without departing from the scope of the invention as defined by the following claims:

Claims

What Is Claimed Is:
1. A server load reduction system including a master URL containing data comprising: a proxy server comprising a proxy server cache and a distribution mechanism, said proxy server adapted to receive the data from the master URL, said proxy server comprising logic operative to record the data in a proxy server cache, said proxy server further comprising a distribution mechanism for distributing the data to a client server; and a proxy browser adapted to conduct a browse operation to request the data contained in the master URL, said browse operation conducted through said proxy server, said proxy browser containing logic operative to notify said client server to load the data when said proxy server contains all of the data.
2. A server load reduction system according to claim 1 wherein said client server is associated with a group of user terniinals such that said group of user terminals download said data.
3. A server load reduction system according to claim 2 wherein at least two members of said group of user terminals operate different web browser programs.
4. A server load reduction system according to claim 1 wherein said proxy server further comprises a multicast proxy server.
5. A server load reduction system according to claim 1 wherein the data is transferred to said client from said proxy server through a SERGE transport system.
6. A server load reduction system according to claim 1 wherein said proxy server further comprises logic operative to signal said proxy server to update said proxy server cache when the data is modified.
7. A method for reduction of server load comprising: conducting a browse operation with a proxy browser to find a master URL; requesting data contained in said master URL for use by a first client; receiving said data in a proxy server; storing said data in said proxy server; and notifying a first client server when said proxy server contains all of said data.
8. A method according to claim 7 wherein requesting data contained in said master URL further comprises requesting data contained in said master URL for use by a second client.
9. A method according to claim 7 wherein notifying further comprises notifying a second client server when said proxy server contains all of said data.
10. method according to claim 7 further comprising the step of updating said proxy server to contain substantially current master URL data.
11. A method for reduction of server load comprising: conducting a browse operation with a proxy browser to find a master URL; requesting a unicast portion of data contained in said master URL for use by a first client; receiving said unicast portion of said data in a proxy server; storing said unicast portion of said data in said proxy server; notifying a first client server when said proxy server contains all of said unicast portion of said data; requesting a multicast portion of said data contained in said master URL for use by said first client; receiving said multicast portion of said data in said proxy server; and notifying a second client server when said proxy server contains all of said multicast portion of said data.
12. A method according to claim 11 wherein requesting said unicast portion of said data contained in said master URL further comprises requesting said unicast portion of said data contained in said master URL for use by a second client.
13. A method according to claim 12 wherein requesting said multicast portion of said data contained in said master URL further comprises requesting said multicast portion of said data contained in said master URL for use by said second client.
14. A method according to claim 11 further comprising downloading said multicast portion of said data to said first client server.
15; A method according to claim ll wherem notifying said first client server when said proxy server contains all of said unicast portion of said data further comprises notifying said second client server when said proxy server contains all of said unicast portion of said data.
16. A method according to claim 11 further comprising downloading said multicast portion of said data to said second client server.
17. A method according to claim 11 further comprising the step of updating said first proxy server to contain substantially current master URL data.
PCT/US2002/036562 2001-11-13 2002-11-13 System for reducing server loading during content delivery WO2003042855A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/010,507 US7149809B2 (en) 2001-11-13 2001-11-13 System for reducing server loading during content delivery
US10/010,507 2001-11-13

Publications (1)

Publication Number Publication Date
WO2003042855A1 true WO2003042855A1 (en) 2003-05-22

Family

ID=21746066

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/036562 WO2003042855A1 (en) 2001-11-13 2002-11-13 System for reducing server loading during content delivery

Country Status (2)

Country Link
US (1) US7149809B2 (en)
WO (1) WO2003042855A1 (en)

Families Citing this family (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7360075B2 (en) 2001-02-12 2008-04-15 Aventail Corporation, A Wholly Owned Subsidiary Of Sonicwall, Inc. Method and apparatus for providing secure streaming data transmission facilities using unreliable protocols
US7353380B2 (en) * 2001-02-12 2008-04-01 Aventail, Llc, A Subsidiary Of Sonicwall, Inc. Method and apparatus for providing secure streaming data transmission facilities using unreliable protocols
US7383329B2 (en) 2001-02-13 2008-06-03 Aventail, Llc Distributed cache for state transfer operations
US7383345B2 (en) * 2002-09-04 2008-06-03 Darby & Mohaine L.L.C. Client-server emulation supporting multicast transmissions of media objects
US8316293B2 (en) 2006-03-27 2012-11-20 Research In Motion Limited System and method for rendering presentation pages based on locality
US8028090B2 (en) 2008-11-17 2011-09-27 Amazon Technologies, Inc. Request routing utilizing client location information
US7991910B2 (en) 2008-11-17 2011-08-02 Amazon Technologies, Inc. Updating routing information based on client location
US8321568B2 (en) 2008-03-31 2012-11-27 Amazon Technologies, Inc. Content management
US8601090B1 (en) 2008-03-31 2013-12-03 Amazon Technologies, Inc. Network resource identification
US8533293B1 (en) 2008-03-31 2013-09-10 Amazon Technologies, Inc. Client side cache management
US8606996B2 (en) 2008-03-31 2013-12-10 Amazon Technologies, Inc. Cache optimization
US8447831B1 (en) 2008-03-31 2013-05-21 Amazon Technologies, Inc. Incentive driven content delivery
US7970820B1 (en) 2008-03-31 2011-06-28 Amazon Technologies, Inc. Locality based content distribution
US7962597B2 (en) 2008-03-31 2011-06-14 Amazon Technologies, Inc. Request routing based on class
US8156243B2 (en) 2008-03-31 2012-04-10 Amazon Technologies, Inc. Request routing
US9407681B1 (en) 2010-09-28 2016-08-02 Amazon Technologies, Inc. Latency measurement in resource requests
US9912740B2 (en) 2008-06-30 2018-03-06 Amazon Technologies, Inc. Latency measurement in resource requests
US7925782B2 (en) 2008-06-30 2011-04-12 Amazon Technologies, Inc. Request routing using network computing components
US8060616B1 (en) 2008-11-17 2011-11-15 Amazon Technologies, Inc. Managing CDN registration by a storage provider
US8521880B1 (en) 2008-11-17 2013-08-27 Amazon Technologies, Inc. Managing content delivery network service providers
US8073940B1 (en) 2008-11-17 2011-12-06 Amazon Technologies, Inc. Managing content delivery network service providers
US8732309B1 (en) 2008-11-17 2014-05-20 Amazon Technologies, Inc. Request routing utilizing cost information
US8065417B1 (en) 2008-11-17 2011-11-22 Amazon Technologies, Inc. Service provider registration by a content broker
US8122098B1 (en) 2008-11-17 2012-02-21 Amazon Technologies, Inc. Managing content delivery network service providers by a content broker
US8412823B1 (en) 2009-03-27 2013-04-02 Amazon Technologies, Inc. Managing tracking information entries in resource cache components
US8521851B1 (en) 2009-03-27 2013-08-27 Amazon Technologies, Inc. DNS query processing using resource identifiers specifying an application broker
US8688837B1 (en) 2009-03-27 2014-04-01 Amazon Technologies, Inc. Dynamically translating resource identifiers for request routing using popularity information
US8756341B1 (en) 2009-03-27 2014-06-17 Amazon Technologies, Inc. Request routing utilizing popularity information
US8782236B1 (en) 2009-06-16 2014-07-15 Amazon Technologies, Inc. Managing resources using resource expiration data
US8397073B1 (en) 2009-09-04 2013-03-12 Amazon Technologies, Inc. Managing secure content in a content delivery network
US8433771B1 (en) 2009-10-02 2013-04-30 Amazon Technologies, Inc. Distribution network with forward resource propagation
US9495338B1 (en) 2010-01-28 2016-11-15 Amazon Technologies, Inc. Content distribution network
US8756272B1 (en) 2010-08-26 2014-06-17 Amazon Technologies, Inc. Processing encoded content
US9712484B1 (en) 2010-09-28 2017-07-18 Amazon Technologies, Inc. Managing request routing information utilizing client identifiers
US10958501B1 (en) 2010-09-28 2021-03-23 Amazon Technologies, Inc. Request routing information based on client IP groupings
US8924528B1 (en) 2010-09-28 2014-12-30 Amazon Technologies, Inc. Latency measurement in resource requests
US8930513B1 (en) 2010-09-28 2015-01-06 Amazon Technologies, Inc. Latency measurement in resource requests
US8468247B1 (en) 2010-09-28 2013-06-18 Amazon Technologies, Inc. Point of presence management in request routing
US8819283B2 (en) 2010-09-28 2014-08-26 Amazon Technologies, Inc. Request routing in a networked environment
US9003035B1 (en) 2010-09-28 2015-04-07 Amazon Technologies, Inc. Point of presence management in request routing
US10097398B1 (en) 2010-09-28 2018-10-09 Amazon Technologies, Inc. Point of presence management in request routing
US8938526B1 (en) 2010-09-28 2015-01-20 Amazon Technologies, Inc. Request routing management based on network components
US8577992B1 (en) 2010-09-28 2013-11-05 Amazon Technologies, Inc. Request routing management based on network components
US8452874B2 (en) 2010-11-22 2013-05-28 Amazon Technologies, Inc. Request routing processing
US9391949B1 (en) 2010-12-03 2016-07-12 Amazon Technologies, Inc. Request routing processing
US8626950B1 (en) 2010-12-03 2014-01-07 Amazon Technologies, Inc. Request routing processing
US10467042B1 (en) 2011-04-27 2019-11-05 Amazon Technologies, Inc. Optimized deployment based upon customer locality
US8904009B1 (en) 2012-02-10 2014-12-02 Amazon Technologies, Inc. Dynamic content delivery
US10021179B1 (en) 2012-02-21 2018-07-10 Amazon Technologies, Inc. Local resource delivery network
US9172674B1 (en) 2012-03-21 2015-10-27 Amazon Technologies, Inc. Managing request routing information utilizing performance information
US10623408B1 (en) 2012-04-02 2020-04-14 Amazon Technologies, Inc. Context sensitive object management
US9154551B1 (en) 2012-06-11 2015-10-06 Amazon Technologies, Inc. Processing DNS queries to identify pre-processing information
US9525659B1 (en) 2012-09-04 2016-12-20 Amazon Technologies, Inc. Request routing utilizing point of presence load information
US9323577B2 (en) 2012-09-20 2016-04-26 Amazon Technologies, Inc. Automated profiling of resource usage
US9135048B2 (en) 2012-09-20 2015-09-15 Amazon Technologies, Inc. Automated profiling of resource usage
US10205698B1 (en) 2012-12-19 2019-02-12 Amazon Technologies, Inc. Source-dependent address resolution
US9294391B1 (en) 2013-06-04 2016-03-22 Amazon Technologies, Inc. Managing network computing components utilizing request routing
US10097448B1 (en) 2014-12-18 2018-10-09 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10091096B1 (en) 2014-12-18 2018-10-02 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10033627B1 (en) 2014-12-18 2018-07-24 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10225326B1 (en) 2015-03-23 2019-03-05 Amazon Technologies, Inc. Point of presence based data uploading
US9819567B1 (en) 2015-03-30 2017-11-14 Amazon Technologies, Inc. Traffic surge management for points of presence
US9887932B1 (en) 2015-03-30 2018-02-06 Amazon Technologies, Inc. Traffic surge management for points of presence
US9887931B1 (en) 2015-03-30 2018-02-06 Amazon Technologies, Inc. Traffic surge management for points of presence
US9832141B1 (en) 2015-05-13 2017-11-28 Amazon Technologies, Inc. Routing based request correlation
US10616179B1 (en) 2015-06-25 2020-04-07 Amazon Technologies, Inc. Selective routing of domain name system (DNS) requests
US10097566B1 (en) 2015-07-31 2018-10-09 Amazon Technologies, Inc. Identifying targets of network attacks
US9794281B1 (en) 2015-09-24 2017-10-17 Amazon Technologies, Inc. Identifying sources of network attacks
US9742795B1 (en) 2015-09-24 2017-08-22 Amazon Technologies, Inc. Mitigating network attacks
US9774619B1 (en) 2015-09-24 2017-09-26 Amazon Technologies, Inc. Mitigating network attacks
US10270878B1 (en) 2015-11-10 2019-04-23 Amazon Technologies, Inc. Routing for origin-facing points of presence
US10257307B1 (en) 2015-12-11 2019-04-09 Amazon Technologies, Inc. Reserved cache space in content delivery networks
US10049051B1 (en) 2015-12-11 2018-08-14 Amazon Technologies, Inc. Reserved cache space in content delivery networks
US10348639B2 (en) 2015-12-18 2019-07-09 Amazon Technologies, Inc. Use of virtual endpoints to improve data transmission rates
US10075551B1 (en) 2016-06-06 2018-09-11 Amazon Technologies, Inc. Request management for hierarchical cache
US10110694B1 (en) 2016-06-29 2018-10-23 Amazon Technologies, Inc. Adaptive transfer rate for retrieving content from a server
US9992086B1 (en) 2016-08-23 2018-06-05 Amazon Technologies, Inc. External health checking of virtual private cloud network environments
US10033691B1 (en) 2016-08-24 2018-07-24 Amazon Technologies, Inc. Adaptive resolution of domain name requests in virtual private cloud network environments
US10469513B2 (en) 2016-10-05 2019-11-05 Amazon Technologies, Inc. Encrypted network addresses
US10831549B1 (en) 2016-12-27 2020-11-10 Amazon Technologies, Inc. Multi-region request-driven code execution system
US10372499B1 (en) 2016-12-27 2019-08-06 Amazon Technologies, Inc. Efficient region selection system for executing request-driven code
US10938884B1 (en) 2017-01-30 2021-03-02 Amazon Technologies, Inc. Origin server cloaking using virtual private cloud network environments
US10503613B1 (en) 2017-04-21 2019-12-10 Amazon Technologies, Inc. Efficient serving of resources during server unavailability
US11075987B1 (en) 2017-06-12 2021-07-27 Amazon Technologies, Inc. Load estimating content delivery network
US10447648B2 (en) 2017-06-19 2019-10-15 Amazon Technologies, Inc. Assignment of a POP to a DNS resolver based on volume of communications over a link between client devices and the POP
US10574520B2 (en) * 2017-07-12 2020-02-25 Verizon Digital Media Services Inc. Dynamic runtime reconfiguration of servers
US10742593B1 (en) 2017-09-25 2020-08-11 Amazon Technologies, Inc. Hybrid content request routing system
US10592578B1 (en) 2018-03-07 2020-03-17 Amazon Technologies, Inc. Predictive content push-enabled content delivery network
US10862852B1 (en) 2018-11-16 2020-12-08 Amazon Technologies, Inc. Resolution of domain name requests in heterogeneous network environments
US11025747B1 (en) 2018-12-12 2021-06-01 Amazon Technologies, Inc. Content request pattern-based routing system

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7266686B1 (en) * 1996-05-09 2007-09-04 Two-Way Media Llc Multicasting method and apparatus
US5935207A (en) * 1996-06-03 1999-08-10 Webtv Networks, Inc. Method and apparatus for providing remote site administrators with user hits on mirrored web sites
US5774660A (en) * 1996-08-05 1998-06-30 Resonate, Inc. World-wide-web server with delayed resource-binding for resource-based load balancing on a distributed resource multi-node network
US5991306A (en) * 1996-08-26 1999-11-23 Microsoft Corporation Pull based, intelligent caching system and method for delivering data over a network
US6351775B1 (en) * 1997-05-30 2002-02-26 International Business Machines Corporation Loading balancing across servers in a computer network
US6886013B1 (en) * 1997-09-11 2005-04-26 International Business Machines Corporation HTTP caching proxy to filter and control display of data in a web browser
US6470386B1 (en) * 1997-09-26 2002-10-22 Worldcom, Inc. Integrated proxy interface for web based telecommunications management tools
US6351467B1 (en) * 1997-10-27 2002-02-26 Hughes Electronics Corporation System and method for multicasting multimedia content
US6098093A (en) * 1998-03-19 2000-08-01 International Business Machines Corp. Maintaining sessions in a clustered server environment
US6385642B1 (en) * 1998-11-03 2002-05-07 Youdecide.Com, Inc. Internet web server cache storage and session management system
US6389462B1 (en) * 1998-12-16 2002-05-14 Lucent Technologies Inc. Method and apparatus for transparently directing requests for web objects to proxy caches
US6463447B2 (en) * 1998-12-16 2002-10-08 Rstar Corporation Optimizing bandwidth consumption for document distribution over a multicast enabled wide area network
US6542964B1 (en) * 1999-06-02 2003-04-01 Blue Coat Systems Cost-based optimization for content distribution using dynamic protocol selection and query resolution for cache server
US6658463B1 (en) * 1999-06-10 2003-12-02 Hughes Electronics Corporation Satellite multicast performance enhancing multicast HTTP proxy system and method
EP1219065B1 (en) * 1999-11-16 2007-02-21 Koninklijke Philips Electronics N.V. Multicast transmission method and system
US6754699B2 (en) * 2000-07-19 2004-06-22 Speedera Networks, Inc. Content delivery and global traffic management network system
US20020073167A1 (en) * 1999-12-08 2002-06-13 Powell Kyle E. Internet content delivery acceleration system employing a hybrid content selection scheme
US6957229B1 (en) * 2000-01-10 2005-10-18 Matthew Graham Dyor System and method for managing personal information
US6539406B1 (en) * 2000-02-17 2003-03-25 Conectron, Inc. Method and apparatus to create virtual back space on an electronic document page, or an electronic document element contained therein, and to access, manipulate and transfer information thereon
US20040049598A1 (en) * 2000-02-24 2004-03-11 Dennis Tucker Content distribution system
US6748447B1 (en) * 2000-04-07 2004-06-08 Network Appliance, Inc. Method and apparatus for scalable distribution of information in a distributed network
US7343422B2 (en) * 2000-04-28 2008-03-11 Adara Networks, Inc. System and method for using uniform resource locators to map application layer content names to network layer anycast addresses
US6917960B1 (en) * 2000-05-05 2005-07-12 Jibe Networks Intelligent content precaching
US20020019828A1 (en) * 2000-06-09 2002-02-14 Mortl William M. Computer-implemented method and apparatus for obtaining permission based data
US6978306B2 (en) * 2000-08-10 2005-12-20 Pts Corporation Multi-tier video delivery network
US6983324B1 (en) * 2000-10-23 2006-01-03 International Business Machines Corporation Dynamic modification of cluster communication parameters in clustered computer system
US7062567B2 (en) * 2000-11-06 2006-06-13 Endeavors Technology, Inc. Intelligent network streaming and execution system for conventionally coded applications
US7188145B2 (en) * 2001-01-12 2007-03-06 Epicrealm Licensing Llc Method and system for dynamic distributed data caching
US20020129159A1 (en) * 2001-03-09 2002-09-12 Michael Luby Multi-output packet server with independent streams

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Key strategic and functional considerations in choosing a knowledge sharing solution", ONE TOUCH KNOWLEDGE SYSTEMS, 3 December 2001 (2001-12-03), pages 1 - 24, XP002960191 *
"OneTouch 5/manager", 5 August 2002 (2002-08-05), pages 1 - 2, XP002960192 *
SYNNES ET AL.: "Distributed education using the mStar environment", 1997, pages 1 - 7, XP002960193 *

Also Published As

Publication number Publication date
US7149809B2 (en) 2006-12-12
US20030093511A1 (en) 2003-05-15

Similar Documents

Publication Publication Date Title
US7149809B2 (en) System for reducing server loading during content delivery
US6041355A (en) Method for transferring data between a network of computers dynamically based on tag information
US7243122B2 (en) Computer implemented method and apparatus for fulfilling a request for information content with a user-selectable version of a file containing that information content
US6253234B1 (en) Shared web page caching at browsers for an intranet
US8447876B2 (en) Content timing method and system
US6192398B1 (en) Remote/shared browser cache
US6623527B1 (en) Method for providing a document with a button for a network service
US6981210B2 (en) Self-maintaining web browser bookmarks
US6112231A (en) Server to cache protocol for improved web performance
EP1206100B1 (en) Communication system for retrieving web content
CN100511220C (en) Method and system for maintaining data in distributed caches
US6480893B2 (en) Web serving system
US7082476B1 (en) System and method of optimizing retrieval of network resources by identifying and substituting embedded symbolic host name references with network addresses in accordance with substitution policies
US6101328A (en) System for preventing multiple instances of the same dynamic executable module
US6272484B1 (en) Electronic document manager
US20010051927A1 (en) Increasing web page browsing efficiency by periodically physically distributing memory media on which web page data are cached
US20010054084A1 (en) Method and system for communication in the usenet
US6256669B1 (en) Method and apparatus for bandwidth characterization and reporting in web browsers
CZ289563B6 (en) Server computer connectable to a network and operation method thereof
CA2279581A1 (en) Data transfer method
EP1446734A2 (en) Method, system, and software for transmission of information
US8204962B2 (en) Method for queued overlap transfer of files
AU8771598A (en) A distributed system and method for prefetching objects
CN1234086C (en) System and method for high speed buffer storage file information
US6532492B1 (en) Methods, systems and computer program products for cache management using admittance control

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP