WO2002091712A1 - Scalable resource discovery and reconfiguration for distributed computer networks - Google Patents

Scalable resource discovery and reconfiguration for distributed computer networks

Info

Publication number
WO2002091712A1
WO2002091712A1 PCT/GB2002/001281 GB0201281W WO02091712A1 WO 2002091712 A1 WO2002091712 A1 WO 2002091712A1 GB 0201281 W GB0201281 W GB 0201281W WO 02091712 A1 WO02091712 A1 WO 02091712A1
Authority
WO
WIPO (PCT)
Prior art keywords
resource request
node
user
user node
network
Prior art date
Application number
PCT/GB2002/001281
Other languages
French (fr)
Inventor
Christopher Richard Vincent
Original Assignee
International Business Machines Corporation
Ibm United Kingdom Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corporation, Ibm United Kingdom Limited filed Critical International Business Machines Corporation
Priority to DE60208659T priority Critical patent/DE60208659T2/en
Priority to JP2002588054A priority patent/JP3851275B2/en
Priority to EP02706962A priority patent/EP1386471B1/en
Priority to KR1020037013118A priority patent/KR100613053B1/en
Publication of WO2002091712A1 publication Critical patent/WO2002091712A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/10Network architectures or network communication protocols for network security for controlling access to devices or network resources
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40Network security protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2463/00Additional details relating to network architectures or network communication protocols for network security covered by H04L63/00
    • H04L2463/102Additional details relating to network architectures or network communication protocols for network security covered by H04L63/00 applying security measure for e-commerce
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0407Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the identity of one or more communicating identities is hidden
    • H04L63/0421Anonymous communication, i.e. the party's identifiers are hidden from the other party or parties, e.g. using an anonymizer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

  • the present invention relates to computer networks, and more specifically to a framework for scalable resource discovery and dynamic reconfiguration in distributed computer networks.
  • Computer networks such as the Internet allow users to share resources such as files and hardware.
  • the expansion of the Internet and the adoption of standards for the World Wide Web have made the viewing and downloading of files by a user almost effortless.
  • the user need not know any programming languages.
  • By simply running an Internet browser the user only needs to point and click to view and download desired files.
  • the availability of such programs allows for easy collaboration and file sharing among like-minded individuals separated by great distances over a distributed computer network, which can literally span the entire globe.
  • a distributed computer network is set up to have a client/server framework.
  • each user is a client that can access a server node over the network and, with the proper authorization, publish files to the server node. Once a file is published to the server node, other clients on the network can access the server node to view or download the file.
  • the server node can allow a client to automatically send a file to another client that is reachable over the network. The client simply sends the file to the server node along with information identifying the desired recipient, and the server node sends the file on to the corresponding client.
  • the server node can also be used to allow the clients to share hardware resources such as a printer.
  • the server node is charged with providing security.
  • the server node must ensure that only authorized clients can use the network resources (e.g., download files), and that only proper files are published.
  • the server node represents a single point of failure.
  • the server node must be of industrial strength and have redundant systems to prevent system shutdowns and data loss. Further, because all client-to-client resource transfers pass through the server node, the adding of another client to the network puts an additional burden on the server node and degrades network performance.
  • the server node requires authentication before allowing a client to access network resources. Once the client has provided authentication credentials, the server node can easily log all of the network activity of the client. For example, the server node could keep a log of all files uploaded and downloaded by the client. Even if access by unauthenticated clients is allowed, the server node can use any of various unique identification techniques to track client activity over time. For example, the server node can place a unique cookie on the client and later use the cookie to identify the client each time it accesses the server node.
  • a virtual network In such a network, a user node connects to one or more known hosts that are participating in a highly interconnected virtual network. Then, the user node itself becomes a host node that can respond to requests for resources and available hosts. Each user in the network forwards resource requests to all known neighboring nodes, so as to potentially propagate each request throughout the entire network.
  • the Gnutella system employs such a viral network framework. Gnutella has a published network protocol and provides users a client/server application (available at http://gnutella.wego.com) that allows each user to act as a host node in a file sharing network. The Gnutella system can be used to securely distribute commercial content that is protected by encryption and licensing.
  • Viral networks are based on peer-to-peer communication.
  • Peer-to-peer is a communications model in which each party has similar capabilities and either party may initiate a communication session.
  • the Gnutella application employs peer-to-peer communication to allow users to exchange files with one another over the Internet.
  • the peer-to-peer model used in a viral network relies on each peer (i.e., user node) having knowledge of at least one of the other peers in the network. When searching for a resource such as a file, a peer sends a resource request to other known peers, which in turn pass it on to their known peers and so on to propagate the request throughout the network.
  • a peer that has the resource and receives the request can send the resource (or a message indicating its availability) back to the requesting peer. Because such a framework offers independence from a centralized network authority (e.g., server node), users in a viral network have enhanced privacy and the single point of failure is eliminated.
  • a centralized network authority e.g., server node
  • FIG. 1 shows an exemplary viral network.
  • Each node in the network represents a user that acts both as a client and host, and is connected with one or more other nodes.
  • a first node 210 desires a particular resource (e.g., file)
  • the first node 210 issues a request to all known nodes 202, 204, 206, and 208, which in turn do the same.
  • the request reaches a second node 212 by being passed in succession through nodes 208, 216, and 218. If the second node 212 has the requested resource, it responds by sending an appropriate message to the first node 210 (e.g., back the same path that the request traversed).
  • the first node 210 can initiate a direct peer-to-peer connection with the second node 212 in order to download the resource. Throughout the viral network, any number of such resource requests, acknowledgments, and transfers can occur simultaneously.
  • the Gryphon system (described at http://www.research.ibm.com/gryphon) has been developed by the assignee of the present invention.
  • This system provides a content-based subscription service and performs message brokering by merging the features of distributed publish/subscribe communications and database technology.
  • an information flow graph that specifies the selective delivery of events, the transformation of events, and the generation of new events.
  • Figure 2 shows an exemplary content-based publish-subscribe messaging infrastructure that utilizes information flow graphs.
  • stocks trades derived from two information sources NYSE and NASDAQ are combined, transformed, filtered and delivered to subscribing clients.
  • one user 312 may subscribe to the message-brokering server 302 and request to receive all stock trades on both the NYSE and NASDAQ that have a value of over one million dollars.
  • the message broker 302 receives raw stock trade information such as price and volume from the NYSE 324 and NASDAQ 326.
  • the server 302 Based on the information request of the user 312, the server 302 merges the stock trade information from the two sources, transforms the raw price and volume information into value information for each trade, and then filters the derived values to produce the subset of trades that are valued at over one million dollars.
  • each subscribing user e.g., nodes 304, 306, and 308 specifies its own criteria, and the message-brokering server 302 performs information selection, transformation, filtering, and delivery in order to provide each user with the requested information.
  • a scalable messaging infrastructure is provided to address scalability and performance issues, while most features of a decentralized network are preserved.
  • At least one publish-subscribe server node is provided in a decentralized network not as a central authority, but as a messaging infrastructure layer.
  • a decentralized network not as a central authority, but as a messaging infrastructure layer.
  • scalability can be achieved in a decentralized network.
  • One embodiment of the present invention provides a method for discovering resources in a network of user nodes. According to the method, a resource request to be published is received at a first user node of the network, and it is determined whether or not to send the resource request to a server node. When it is determined not to send the resource request to the server node, the resource request is forwarded to a second user node of the network through a direct connection. When it is determined to send the resource request to the server node, the resource request is sent to the server node for publication. In a preferred embodiment, the determination of whether or not to send the resource request to
  • Another embodiment of the present invention provides a user node for use in a computer network of the type that includes user nodes and at least one server node, with each of the user nodes being connected to at least one other user node through a direct connection.
  • the user node includes a receiving interface for receiving a resource request to be published, control means for deciding whether or not to send the resource request to the server node, and at least one transmitting interface for selectively forwarding the resource request to a second user node of the network through a direct connection or sending the resource request to the server node for publication.
  • the transmitting interface forwards the resource request to the second user node when the control means decides not to send the resource request to the server node, and sends the resource request to the server node for publication when the control means decides to send the resource request to the server node.
  • the control means randomly selects one of the other user nodes of the network to be the second user node to which the resource request is forwarded.
  • Figure 1 is a diagram of an exemplary viral network
  • Figure 2 is a diagram of an exemplary content-based publish-subscribe messaging infrastructure
  • Figure 3 is a diagram of scalable network framework according to a preferred embodiment of the present invention
  • Figure 4 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a first embodiment of the present invention
  • Figure 5 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a second embodiment of the present invention
  • Figure 6 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a third embodiment of the present invention.
  • Figure 7 is a diagram of scalable network framework showing an exemplary implementation of part of the process of Figure 6;
  • Figure 8 is a diagram of scalable network framework showing an exemplary implementation of another part of the process of Figure 6.
  • FIG. 3 shows a scalable network framework according to a preferred embodiment of the present invention.
  • the framework includes a publish-subscribe server node 402 and multiple user nodes (e.g., 404, 406, and 410) .
  • the server node 402 can be implemented by a single server or by a "server cloud" that is made up of any number of servers.
  • the individual servers of such a server cloud can be connected to one another and to the Internet in various ways and can even be separated by great distances so as to provide an appropriate level of service and advantageous features such as data and path redundancy.
  • a user node 416 joins the network by contacting the publish-subscribe server node 402 and subscribing to certain "channels" of messages. Additionally, the joining user node 416 solicits connections and then directly connects with at least one other user node 410, 418, and 420 (e.g., based on some criteria such as geographic location, connection speed, or common interests) . In this manner, all of the user nodes in the network are connected to the centralized publish-subscribe server node for messaging (not shown for clarity) and to one another through peer-to-peer connections that form a decentralized viral-type resource sharing network.
  • FIG. 4 is a flow chart of a process for obtaining a resource within such a scalable network framework in accordance with a first embodiment of the present invention.
  • a resource e.g., file
  • a resource request (or query) is sent to the server node 402 (step S10), and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S12) .
  • a second user node 422 that receives the request and is willing to provide the resource contacts the first user node 416 (step S14), and the first and second user nodes 416 and 422 set up a peer-to-peer connection to provide the requested resource to the first user node 416 (step S16) .
  • the publish-subscribe messaging infrastructure layer allows a resource request to reach nodes that are separated from the requesting node by a direct-connect path that includes a very large number of intermediary nodes.
  • the publish-subscribe messaging infrastructure supports two types of "channels", or shared data streams.
  • the first type of channel is a "node discovery channel” that is used to support the discovery of other user nodes in the decentralized network.
  • a user node announces itself using the publish-subscribe messaging infrastructure of the server node.
  • a join announcement from the new user node is routed via the server node to one or more of the node discovery channels to solicit connections from other user nodes.
  • the publish-subscribe infrastructure functions as a general purpose transport layer (like a layer above IP) that establishes connections to other user nodes to accomplish the broadcasting of join announcements.
  • join announcements can be divided among individual node discovery channels based on categories such as geographic location, network connection speed, types of resources available, and/or common interests.
  • the new user node can discover remote user nodes (both geographically and with respect to network hops) and when connecting can favor nodes with the desired type of resources or acceptable connectivity attributes.
  • each join announcement is only sent to the user nodes subscribed to certain channels, the user nodes of a very large network are not constantly flooded with join announcements.
  • the second type of channel is a "resource request channel” that is used to optimize the publication of resource requests.
  • the server node publishes each resource request by sending it to all of the user nodes that are subscribed to a particular channel (or channels) .
  • These resource request channels can be divided into a rich taxonomy of resource types in order to allow the user nodes to effectively filter out undesired requests.
  • the use of resource request channels allows a resource request to only reach a relevant subset of user nodes (i.e., those that subscribe to the relevant channel or channels) .
  • a user node that only desires to share technical documentation is not bombarded with requests for multimedia content.
  • the user node and/or the server node can determine the channel or channels on which to publish an individual announcement or resource request.
  • a channel exists merely by virtue of being published to by a user node.
  • any user node can create a new resource channel and then promote its availability for subscription in any conventional manner (e.g., through a web site, newsgroup, television, or direct mail advertising) .
  • FIG. 5 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a second embodiment of the present invention.
  • a resource e.g., file
  • a resource request is sent to the server node 402 (step S10) , and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S12) .
  • the first node 416 also sends the resource request to all of the user nodes 410, 418, and 420 to which it is connected in the decentralized network.
  • each user node that receives the request passing it on to the user nodes to which it is connected so as to propagate the request through the user nodes of the decentralized network (step Sll) .
  • the request reaches a second user node 404 by being passed in succession through nodes 410 and 414.
  • each user node that receives the resource request from the server node e.g., user node 422 also sends the resource request to all of the user nodes to which it is connected in the decentralized network.
  • the second user node 404 If the second user node 404 receives the request (either through user node propagation or from the server node) and is willing to provide the resource, the second user node 404 contacts the first user node 416 (step S14), and a peer-to-peer connection is set up to share the requested resource (step S16) .
  • resource requests are both published through the messaging infrastructure layer (as in the first embodiment) and propagated through the user nodes of the decentralized network. Because this dual path process offers an alternative to the request propagation path that passes through the centralized server node, the single point of failure is eliminated. In other words, the resource request is propagated to other user nodes even when the server node is down. Further, in the second embodiment, it is not necessary for all of the user nodes to be connected to, or even know about the presence of, the publish-subscribe infrastructure. Such a user node can merely forward resource requests to all of the user nodes to which it is connected. This feature allows the second embodiment to be implemented in an existing network without requiring the modification of all user nodes.
  • FIG. 6 is a flow chart of a process for obtaining a resource within such a scalable network framework in accordance with a third embodiment of the present invention.
  • resource requests are not sent directly to the server node in order to give enhanced privacy to the requesting user node.
  • the requesting first user node 410 sends a resource request to a second user node 414 to which it is connected in the decentralized network (step S20) , as shown by the dashed arrows in Figure 7.
  • the second user node 414 determines whether to send the request to the publish-subscribe server node 402 or to another user node to which it is connected in the decentralized network (step S22) .
  • all of the user nodes are connected to the centralized publish-subscribe server node for messaging (not shown for clarity) . If it is decided not to send to the server node 402, then the second user node 414 forwards the resource request to another user node 420 to which it is connected (step S20) , as shown in Figure 7. This forwarding process is repeated with each user node that receives the resource request making the same determination (step S22) .
  • the resource request is sent to the server node 402 (step S24), and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S26 ) .
  • each determination of whether or not to send the request to the publish- subscribe server node is a "random" decision made by the user node based on a weighting factor of between 0 and 1 that gives the probability that the request will be sent to the server node. For example, if the weighting factor is 0.25, then there is a 25% chance that the user node will send the request to the server node and a 75% chance that the request will be forwarded to another user node. Thus, on average a weighting factor of 0.25 should cause resource requests to be forwarded to other user nodes three times before being sent to the publish-subscribe server node. The value of the weighting factor is set based on factors such as the desired level of privacy.
  • the weighting factor can be a fixed value that is used throughout the network or can be set by the user nodes on a per message basis. Other criteria such as a maximum number of forwards or a maximum elapsed time can also be incorporated into the determination that is made by each user node receiving the request.
  • the determination of whether or not to send the request to the publish- subscribe server node is made based on some other criteria such as a fixed number of forwards. For example, in one embodiment each resource request is always forwarded through three user nodes and then sent to the publish-subscribe server node. Preferably, whenever a resource request is to be forwarded on to another user node, the choice of which other user node will receive the forwarded request is made through a random selection of one of the user nodes to which the forwarding user node is connected.
  • a fourth user node 422 that receives the request and is willing to provide the resource contacts the first user node 410. More specifically, as shown in Figure 8 the fourth user node 422 sends a response to the third user node 416 (step S28), which had sent the resource request to the server node 402 for publication. The third user node 416 forwards the response to the user node 420 from which it received the resource request, and this forwarding process is repeated until the response reaches the first user node 410 (step S30) . At this point, the first user node 416 can contact the fourth user node 422 to set up a direct peer-to-peer connection to share the requested resource (step S32) .
  • the response from the user node having the resource contains metadata concerning the resource match.
  • the requesting user node evaluates the metadata and then decides whether to make a direct connection with the responding node to share the resource itself (e.g., download the requested file). If multiple responses are received, the requesting user node can evaluate the metadata in each response and then select one or more of the responding user nodes based on any criteria (e.g., past experience, order received, connection speed, or physical location) .
  • responses from user nodes having the resource are routed through existing connections (such as the one the request had traversed through the server node) , and a new point-to-point connection is only established to actually transfer the resource. Otherwise, with each responding user node initiating a new point-to-point connection, the user node receiving the responses could be overwhelmed whenever a large number of responses are received.
  • the server node could set up a matching "one-time" response channel or a permanent response channel to be used by user nodes responding to the resource request. The publishing of responses over a permanent response channel would facilitate "passive" user nodes that archive responses of possible interest for future use.
  • the third embodiment offers privacy to requesting user nodes.
  • the actual user node requesting a resource remains anonymous to the server node, so the server node cannot keep track of which users are sharing (or even requesting) which resources.
  • a user node that actually provides the resource has knowledge of the resource sharing and the identity of the requesting node.
  • the use of a publish-subscribe messaging infrastructure layer allows for efficient resource discovery in a network having a very large number of user nodes.
  • the present invention allows scalability to be achieved in a decentralized network while enhanced user privacy is maintained.
  • every message i.e., resource request or response
  • every message is assigned a unique identification number.
  • one embodiment employs an algorithm developed by Microsoft Corporation that allows each user node to individually generate globally-unique message identifiers (GUIDs) that are very likely to be globally unique.
  • GUIDs globally-unique message identifiers
  • each user node must store (e.g., in a table) at least a limited history of forwarded messages in order to allow responses (possibly including the resource itself) to reach the user node that sent a message through the same path.
  • some embodiments include a mechanism to prevent the looping of a resource request.
  • the globally- unique message identifiers GUIDs and node history tables can easily be used to create an anti-looping mechanism.
  • one embodiment of the present invention includes both the randomized request forwarding of the third embodiment and the dual propagation/publication of the second embodiment.
  • Other design choices, such as network protocols, forwarding criteria, and membership criteria, could easily be adapted.
  • the present invention can be realized in hardware, software, or a combination of hardware and software. Any kind of computer system - or other apparatus adapted for carrying out the methods described herein - is suited.
  • a typical combination of hardware and software could be a general purpose computer system with a computer program that, when loaded and executed, controls the computer system such that it carries out the methods described herein.
  • the present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which - when loaded in a computer system - is able to carry out these methods.
  • a "computer program” includes any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code, or notation; and b) reproduction in a different material form.
  • Each computer system may include one or more computers and a computer readable medium that allows the computer to read data, instructions, messages, or message packets, and other computer readable information from the computer readable medium.
  • the computer readable medium may include non-volatile memory such as ROM, Flash memory, a hard or floppy disk, a CD-ROM, or other permanent storage. Additionally, a computer readable medium may include volatile storage such as RAM, buffers, cache memory, and network circuits. Furthermore, the computer readable medium may include computer readable information in a transitory state medium such as a network link and/or a network interface (including a wired network or a wireless network) that allow a computer to read such computer readable information.

Abstract

A method is provided for discovering resources in a network of user nodes. According to the method, a resource request to be published is received at a first user node of the network, and it is determined (e.g., randomly) whether or not to send the resource request to a server node. When it is determined not to send the resource request to the server node, the resource request is forwarded to a second user node of the network through a direct connection. When it is determined to send the resource request to the server node, the resource request is sent to the server node for publication. Also provided is a user node for use in a computer network of the type that includes user nodes and at least one server node, with each user node being connected to at least one other user node through a direct connection.

Description

SCALABLE RESOURCE DISCOVERY AND RECONFIGURATION FOR DISTRIBUTED COMPUTER NETWORKS
Field of the Invention
The present invention relates to computer networks, and more specifically to a framework for scalable resource discovery and dynamic reconfiguration in distributed computer networks.
Background of the Invention
Computer networks such as the Internet allow users to share resources such as files and hardware. The expansion of the Internet and the adoption of standards for the World Wide Web have made the viewing and downloading of files by a user almost effortless. The user need not know any programming languages. By simply running an Internet browser, the user only needs to point and click to view and download desired files. The availability of such programs allows for easy collaboration and file sharing among like-minded individuals separated by great distances over a distributed computer network, which can literally span the entire globe.
Conventionally, a distributed computer network is set up to have a client/server framework. In particular, each user is a client that can access a server node over the network and, with the proper authorization, publish files to the server node. Once a file is published to the server node, other clients on the network can access the server node to view or download the file. Additionally, the server node can allow a client to automatically send a file to another client that is reachable over the network. The client simply sends the file to the server node along with information identifying the desired recipient, and the server node sends the file on to the corresponding client. The server node can also be used to allow the clients to share hardware resources such as a printer.
With such a client/server framework, the server node is charged with providing security. For example, the server node must ensure that only authorized clients can use the network resources (e.g., download files), and that only proper files are published. Additionally, the server node represents a single point of failure. Thus, in any client/server environment in which reliability is required, the server node must be of industrial strength and have redundant systems to prevent system shutdowns and data loss. Further, because all client-to-client resource transfers pass through the server node, the adding of another client to the network puts an additional burden on the server node and degrades network performance.
In such a client/server framework, the clients have little privacy. Typically, the server node requires authentication before allowing a client to access network resources. Once the client has provided authentication credentials, the server node can easily log all of the network activity of the client. For example, the server node could keep a log of all files uploaded and downloaded by the client. Even if access by unauthenticated clients is allowed, the server node can use any of various unique identification techniques to track client activity over time. For example, the server node can place a unique cookie on the client and later use the cookie to identify the client each time it accesses the server node.
One solution to some of the drawbacks of the conventional client/server framework is provided by a "viral" network. In such a network, a user node connects to one or more known hosts that are participating in a highly interconnected virtual network. Then, the user node itself becomes a host node that can respond to requests for resources and available hosts. Each user in the network forwards resource requests to all known neighboring nodes, so as to potentially propagate each request throughout the entire network. For example, the Gnutella system employs such a viral network framework. Gnutella has a published network protocol and provides users a client/server application (available at http://gnutella.wego.com) that allows each user to act as a host node in a file sharing network. The Gnutella system can be used to securely distribute commercial content that is protected by encryption and licensing.
Viral networks are based on peer-to-peer communication. Peer-to-peer is a communications model in which each party has similar capabilities and either party may initiate a communication session. For example, the Gnutella application employs peer-to-peer communication to allow users to exchange files with one another over the Internet. The peer-to-peer model used in a viral network relies on each peer (i.e., user node) having knowledge of at least one of the other peers in the network. When searching for a resource such as a file, a peer sends a resource request to other known peers, which in turn pass it on to their known peers and so on to propagate the request throughout the network. A peer that has the resource and receives the request can send the resource (or a message indicating its availability) back to the requesting peer. Because such a framework offers independence from a centralized network authority (e.g., server node), users in a viral network have enhanced privacy and the single point of failure is eliminated.
Figure 1 shows an exemplary viral network. Each node in the network represents a user that acts both as a client and host, and is connected with one or more other nodes. When a first node 210 desires a particular resource (e.g., file), the first node 210 issues a request to all known nodes 202, 204, 206, and 208, which in turn do the same. For example, the request reaches a second node 212 by being passed in succession through nodes 208, 216, and 218. If the second node 212 has the requested resource, it responds by sending an appropriate message to the first node 210 (e.g., back the same path that the request traversed). Because a node having the requested resource has been identified, the first node 210 can initiate a direct peer-to-peer connection with the second node 212 in order to download the resource. Throughout the viral network, any number of such resource requests, acknowledgments, and transfers can occur simultaneously.
While viral networks offer enhanced privacy and eliminate a single point of failure, the framework has drawbacks related to scalability. In a large, decentralized viral network, efficient resource discovery breaks down as the number of participating nodes increases. More specifically, a resource request can only propagate from node to node, and each node only propagates the request to a relatively small number of other nodes. To control network traffic and prevent unreasonable response times, a practical system must employ a "time-to-live" or some limit on the number of times a request can be forwarded (i.e., a maximum number of peer hops). This effectively disconnects any two nodes or groups of nodes that are separated by a path that would require a request to propagate through an unreasonably large number of intermediary nodes. Further, any such limit on request propagation makes it impossible to perform an exhaustive search for a resource, because such a search would require the request to be propagated to all of the nodes in the network.
Additionally, there has recently been proposed a content-based publish-subscribe messaging infrastructure that utilizes an information flow graph. For example, the Gryphon system (described at http://www.research.ibm.com/gryphon) has been developed by the assignee of the present invention. This system provides a content-based subscription service and performs message brokering by merging the features of distributed publish/subscribe communications and database technology. At the core of the Gryphon system is an information flow graph that specifies the selective delivery of events, the transformation of events, and the generation of new events.
Figure 2 shows an exemplary content-based publish-subscribe messaging infrastructure that utilizes information flow graphs. In this system, stocks trades derived from two information sources NYSE and NASDAQ are combined, transformed, filtered and delivered to subscribing clients. For example, one user 312 may subscribe to the message-brokering server 302 and request to receive all stock trades on both the NYSE and NASDAQ that have a value of over one million dollars. The message broker 302 receives raw stock trade information such as price and volume from the NYSE 324 and NASDAQ 326.
Based on the information request of the user 312, the server 302 merges the stock trade information from the two sources, transforms the raw price and volume information into value information for each trade, and then filters the derived values to produce the subset of trades that are valued at over one million dollars. In a similar manner, each subscribing user (e.g., nodes 304, 306, and 308) specifies its own criteria, and the message-brokering server 302 performs information selection, transformation, filtering, and delivery in order to provide each user with the requested information.
While the publish-subscribe messaging infrastructure of Figure 2 provides good scalability for a messaging system with a large number of users, as in the conventional client/server framework the users have little privacy. All users must identify themselves when subscribing to the system and all information is delivered to the user through the centralized server. Thus, the centralized server can easily maintain a log of all users of the system and the exact information that each desires and receives. The centralized message-brokering server also represents a single point of failure for the system.
DISCLOSURE OF THE INVENTION
A scalable messaging infrastructure is provided to address scalability and performance issues, while most features of a decentralized network are preserved. At least one publish-subscribe server node is provided in a decentralized network not as a central authority, but as a messaging infrastructure layer. Thus, scalability can be achieved in a decentralized network. One embodiment of the present invention provides a method for discovering resources in a network of user nodes. According to the method, a resource request to be published is received at a first user node of the network, and it is determined whether or not to send the resource request to a server node. When it is determined not to send the resource request to the server node, the resource request is forwarded to a second user node of the network through a direct connection. When it is determined to send the resource request to the server node, the resource request is sent to the server node for publication. In a preferred embodiment, the determination of whether or not to send the resource request to the server node is a random decision made by the first user node.
Another embodiment of the present invention provides a user node for use in a computer network of the type that includes user nodes and at least one server node, with each of the user nodes being connected to at least one other user node through a direct connection. The user node includes a receiving interface for receiving a resource request to be published, control means for deciding whether or not to send the resource request to the server node, and at least one transmitting interface for selectively forwarding the resource request to a second user node of the network through a direct connection or sending the resource request to the server node for publication. The transmitting interface forwards the resource request to the second user node when the control means decides not to send the resource request to the server node, and sends the resource request to the server node for publication when the control means decides to send the resource request to the server node. In one preferred embodiment, the control means randomly selects one of the other user nodes of the network to be the second user node to which the resource request is forwarded.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
Figure 1 is a diagram of an exemplary viral network;
Figure 2 is a diagram of an exemplary content-based publish-subscribe messaging infrastructure; Figure 3 is a diagram of scalable network framework according to a preferred embodiment of the present invention;
Figure 4 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a first embodiment of the present invention;
Figure 5 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a second embodiment of the present invention;
Figure 6 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a third embodiment of the present invention;
Figure 7 is a diagram of scalable network framework showing an exemplary implementation of part of the process of Figure 6; and
Figure 8 is a diagram of scalable network framework showing an exemplary implementation of another part of the process of Figure 6.
DETAILED DESCRIPTION OF THE INVENTION
Figure 3 shows a scalable network framework according to a preferred embodiment of the present invention. As shown, the framework includes a publish-subscribe server node 402 and multiple user nodes (e.g., 404, 406, and 410) . In embodiments of the present invention, the server node 402 can be implemented by a single server or by a "server cloud" that is made up of any number of servers. The individual servers of such a server cloud can be connected to one another and to the Internet in various ways and can even be separated by great distances so as to provide an appropriate level of service and advantageous features such as data and path redundancy.
Within this framework, a user node 416 joins the network by contacting the publish-subscribe server node 402 and subscribing to certain "channels" of messages. Additionally, the joining user node 416 solicits connections and then directly connects with at least one other user node 410, 418, and 420 (e.g., based on some criteria such as geographic location, connection speed, or common interests) . In this manner, all of the user nodes in the network are connected to the centralized publish-subscribe server node for messaging (not shown for clarity) and to one another through peer-to-peer connections that form a decentralized viral-type resource sharing network.
Figure 4 is a flow chart of a process for obtaining a resource within such a scalable network framework in accordance with a first embodiment of the present invention. Whenever a first user node 416 in the network desires a resource (e.g., file), a resource request (or query) is sent to the server node 402 (step S10), and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S12) . A second user node 422 that receives the request and is willing to provide the resource contacts the first user node 416 (step S14), and the first and second user nodes 416 and 422 set up a peer-to-peer connection to provide the requested resource to the first user node 416 (step S16) . In this manner, the publish-subscribe messaging infrastructure layer allows a resource request to reach nodes that are separated from the requesting node by a direct-connect path that includes a very large number of intermediary nodes.
Thus, in the scalable network framework provided by the present invention, efficient resource discovery is maintained when the number of user nodes in the network increases. At the same time, the resources themselves are not published to the server and the actual resource sharing does not involve the server, so the demands on the server are less than in the conventional client/server framework. Furthermore, because each search request is published to all of the user nodes that subscribe to the relevant channel, it is possible to perform an exhaustive (or at least very extensive) search for the requested resource within an acceptable time frame in a network that contains a very large number of user nodes .
In preferred embodiments, the publish-subscribe messaging infrastructure supports two types of "channels", or shared data streams. The first type of channel is a "node discovery channel" that is used to support the discovery of other user nodes in the decentralized network. To join the network, a user node announces itself using the publish-subscribe messaging infrastructure of the server node. In particular, a join announcement from the new user node is routed via the server node to one or more of the node discovery channels to solicit connections from other user nodes. Thus, the publish-subscribe infrastructure functions as a general purpose transport layer (like a layer above IP) that establishes connections to other user nodes to accomplish the broadcasting of join announcements. Such join announcements can be divided among individual node discovery channels based on categories such as geographic location, network connection speed, types of resources available, and/or common interests. Thus, the new user node can discover remote user nodes (both geographically and with respect to network hops) and when connecting can favor nodes with the desired type of resources or acceptable connectivity attributes. Further, because each join announcement is only sent to the user nodes subscribed to certain channels, the user nodes of a very large network are not constantly flooded with join announcements.
The second type of channel is a "resource request channel" that is used to optimize the publication of resource requests. As explained above, the server node publishes each resource request by sending it to all of the user nodes that are subscribed to a particular channel (or channels) . These resource request channels can be divided into a rich taxonomy of resource types in order to allow the user nodes to effectively filter out undesired requests. Further, rather than reaching every user node in the network, the use of resource request channels allows a resource request to only reach a relevant subset of user nodes (i.e., those that subscribe to the relevant channel or channels) .
Thus, a user node that only desires to share technical documentation is not bombarded with requests for multimedia content. Depending on the application, the user node and/or the server node can determine the channel or channels on which to publish an individual announcement or resource request. Further, in preferred embodiments, a channel exists merely by virtue of being published to by a user node. Thus, any user node can create a new resource channel and then promote its availability for subscription in any conventional manner (e.g., through a web site, newsgroup, television, or direct mail advertising) .
Figure 5 is a flow chart of a process for obtaining a resource within a scalable network framework in accordance with a second embodiment of the present invention. Whenever a first user node 416 in the network desires a resource (e.g., file), a resource request is sent to the server node 402 (step S10) , and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S12) . Additionally, in the second embodiment the first node 416 also sends the resource request to all of the user nodes 410, 418, and 420 to which it is connected in the decentralized network. This process is repeated with each user nodes that receives the request passing it on to the user nodes to which it is connected, so as to propagate the request through the user nodes of the decentralized network (step Sll) . For example, the request reaches a second user node 404 by being passed in succession through nodes 410 and 414. Further, in some embodiments each user node that receives the resource request from the server node (e.g., user node 422) also sends the resource request to all of the user nodes to which it is connected in the decentralized network. If the second user node 404 receives the request (either through user node propagation or from the server node) and is willing to provide the resource, the second user node 404 contacts the first user node 416 (step S14), and a peer-to-peer connection is set up to share the requested resource (step S16) .
Thus, in the second embodiment resource requests are both published through the messaging infrastructure layer (as in the first embodiment) and propagated through the user nodes of the decentralized network. Because this dual path process offers an alternative to the request propagation path that passes through the centralized server node, the single point of failure is eliminated. In other words, the resource request is propagated to other user nodes even when the server node is down. Further, in the second embodiment, it is not necessary for all of the user nodes to be connected to, or even know about the presence of, the publish-subscribe infrastructure. Such a user node can merely forward resource requests to all of the user nodes to which it is connected. This feature allows the second embodiment to be implemented in an existing network without requiring the modification of all user nodes.
Figure 6 is a flow chart of a process for obtaining a resource within such a scalable network framework in accordance with a third embodiment of the present invention. In this embodiment, resource requests are not sent directly to the server node in order to give enhanced privacy to the requesting user node. Whenever a resource (e.g., file) is desired in the third embodiment, the requesting first user node 410 sends a resource request to a second user node 414 to which it is connected in the decentralized network (step S20) , as shown by the dashed arrows in Figure 7. The second user node 414 then determines whether to send the request to the publish-subscribe server node 402 or to another user node to which it is connected in the decentralized network (step S22) . Preferably, all of the user nodes are connected to the centralized publish-subscribe server node for messaging (not shown for clarity) . If it is decided not to send to the server node 402, then the second user node 414 forwards the resource request to another user node 420 to which it is connected (step S20) , as shown in Figure 7. This forwarding process is repeated with each user node that receives the resource request making the same determination (step S22) . When a third user node 416 decides to send to the server node 402, the resource request is sent to the server node 402 (step S24), and the server node 402 publishes the resource request by sending it to all of the user nodes that are subscribed to the channel corresponding to that type of request (step S26 ) .
In preferred embodiments, each determination of whether or not to send the request to the publish- subscribe server node is a "random" decision made by the user node based on a weighting factor of between 0 and 1 that gives the probability that the request will be sent to the server node. For example, if the weighting factor is 0.25, then there is a 25% chance that the user node will send the request to the server node and a 75% chance that the request will be forwarded to another user node. Thus, on average a weighting factor of 0.25 should cause resource requests to be forwarded to other user nodes three times before being sent to the publish-subscribe server node. The value of the weighting factor is set based on factors such as the desired level of privacy. Further, the weighting factor can be a fixed value that is used throughout the network or can be set by the user nodes on a per message basis. Other criteria such as a maximum number of forwards or a maximum elapsed time can also be incorporated into the determination that is made by each user node receiving the request.
In further embodiments, the determination of whether or not to send the request to the publish- subscribe server node is made based on some other criteria such as a fixed number of forwards. For example, in one embodiment each resource request is always forwarded through three user nodes and then sent to the publish-subscribe server node. Preferably, whenever a resource request is to be forwarded on to another user node, the choice of which other user node will receive the forwarded request is made through a random selection of one of the user nodes to which the forwarding user node is connected.
After the resource request is published by the server node 402, a fourth user node 422 that receives the request and is willing to provide the resource contacts the first user node 410. More specifically, as shown in Figure 8 the fourth user node 422 sends a response to the third user node 416 (step S28), which had sent the resource request to the server node 402 for publication. The third user node 416 forwards the response to the user node 420 from which it received the resource request, and this forwarding process is repeated until the response reaches the first user node 410 (step S30) . At this point, the first user node 416 can contact the fourth user node 422 to set up a direct peer-to-peer connection to share the requested resource (step S32) .
In preferred embodiments, the response from the user node having the resource contains metadata concerning the resource match. When the response is received, the requesting user node evaluates the metadata and then decides whether to make a direct connection with the responding node to share the resource itself (e.g., download the requested file). If multiple responses are received, the requesting user node can evaluate the metadata in each response and then select one or more of the responding user nodes based on any criteria (e.g., past experience, order received, connection speed, or physical location) .
Additionally, in preferred embodiments, responses from user nodes having the resource are routed through existing connections (such as the one the request had traversed through the server node) , and a new point-to-point connection is only established to actually transfer the resource. Otherwise, with each responding user node initiating a new point-to-point connection, the user node receiving the responses could be overwhelmed whenever a large number of responses are received. Alternatively, the server node could set up a matching "one-time" response channel or a permanent response channel to be used by user nodes responding to the resource request. The publishing of responses over a permanent response channel would facilitate "passive" user nodes that archive responses of possible interest for future use.
Because resource requests are forwarded through one or more other user nodes rather than being sent directly to the server node, the third embodiment offers privacy to requesting user nodes. The actual user node requesting a resource remains anonymous to the server node, so the server node cannot keep track of which users are sharing (or even requesting) which resources. As in a conventional viral network, in the third embodiment only a user node that actually provides the resource has knowledge of the resource sharing and the identity of the requesting node. Further, unlike a conventional viral network, in the third embodiment the use of a publish-subscribe messaging infrastructure layer allows for efficient resource discovery in a network having a very large number of user nodes. Thus, the present invention allows scalability to be achieved in a decentralized network while enhanced user privacy is maintained.
The embodiments of the present invention described above require some mechanism for identifying individual messages. In preferred embodiments, every message (i.e., resource request or response) is assigned a unique identification number. For example, one embodiment employs an algorithm developed by Microsoft Corporation that allows each user node to individually generate globally-unique message identifiers (GUIDs) that are very likely to be globally unique. Additionally, each user node must store (e.g., in a table) at least a limited history of forwarded messages in order to allow responses (possibly including the resource itself) to reach the user node that sent a message through the same path. Further, some embodiments include a mechanism to prevent the looping of a resource request. For example, the globally- unique message identifiers GUIDs and node history tables can easily be used to create an anti-looping mechanism.
While the embodiments of the present invention described above relate to a single server node, multiple publish-subscribe server nodes can be provided in the network to further minimize "point of failure" concerns. Further, competing providers may coexist in the network by operating different server nodes and competing for user node subscriptions. Additionally, the features of the different embodiments described above can be combined for further applications. For example, one embodiment of the present invention includes both the randomized request forwarding of the third embodiment and the dual propagation/publication of the second embodiment. Other design choices, such as network protocols, forwarding criteria, and membership criteria, could easily be adapted.
The present invention can be realized in hardware, software, or a combination of hardware and software. Any kind of computer system - or other apparatus adapted for carrying out the methods described herein - is suited. A typical combination of hardware and software could be a general purpose computer system with a computer program that, when loaded and executed, controls the computer system such that it carries out the methods described herein.
The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which - when loaded in a computer system - is able to carry out these methods. In the present context, a "computer program" includes any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code, or notation; and b) reproduction in a different material form.
Each computer system may include one or more computers and a computer readable medium that allows the computer to read data, instructions, messages, or message packets, and other computer readable information from the computer readable medium. The computer readable medium may include non-volatile memory such as ROM, Flash memory, a hard or floppy disk, a CD-ROM, or other permanent storage. Additionally, a computer readable medium may include volatile storage such as RAM, buffers, cache memory, and network circuits. Furthermore, the computer readable medium may include computer readable information in a transitory state medium such as a network link and/or a network interface (including a wired network or a wireless network) that allow a computer to read such computer readable information.

Claims

1. A method for discovering resources in a network of user nodes, said method comprising the steps of: receiving a resource request to be published at a first user node of the network; determining whether or not to send the resource request to a server node; forwarding the resource request to a second user node of the network through a direct connection, when it is determined not to send the resource request to the server node; and sending the resource request to the server node for publication, when it is determined to send the resource request to the server node.
2. A method as claimed in claim 1, wherein in the determining step, the determination of whether or not to send the resource request to the server node is a random decision made by the first user node.
3. A method as claimed in claim 2, wherein in the determining step, the random decision is made based on a weighting factor corresponding to the probability that the first user node will decide to send the resource request to the server node.
4. A method as claimed in claim 1, wherein the forwarding step includes the sub-steps of: randomly selecting one of the user nodes to which the first user node is connected to be the second user node; and forwarding the resource request from the first user node to the second user node through a direct connection.
5. A method as claimed in claim 1, further comprising the step of publishing the resource request to at least some of the user nodes of the network via the server node.
6. A method as claimed in claim 5, wherein in the publishing step, the server node publishes the resource request to all of the user nodes of the network that are subscribed to one or more selected resource request channels .
7. A method as claimed in claim 1, further comprising the step of repeating the steps of determining and forwarding until in the determining step a user node that received the resource request decides to send the resource request to the server node.
8. A method as claimed in claim 1, further comprising the steps of: sending the resource request to be published from a requesting user node, which desires the request resource, to the first user node; and sending an identical resource request from the requesting user node to all of the user nodes to which the requesting user node is connected through direct connections.
9. A machine-readable medium encoded with a program for discovering resources in a network of user nodes, said program containing instructions for performing the steps of: receiving a resource request to be published at a first user node of the network; determining whether or not to send the resource request to a server node; forwarding the resource request to a second user node of the network through a direct connection, when it is determined not to send the resource request to the server node; and sending the resource request to the server node for publication, when it is determined to send the resource request to the server node.
10. A machine-readable medium as claimed in claim 9, wherein in the determining step, the determination of whether or not to send the resource request to the server node is a random decision made by the first user node.
11. A machine-readable medium as claimed in claim 10, wherein in the determining step, the random decision is made based on a weighting factor corresponding to the probability that the first user node will decide to send the resource request to the server node.
12. A machine-readable medium as claimed in claim 9, wherein the forwarding step includes the sub- steps of: randomly selecting one of the user nodes to which the first user node is connected to be the second user node; and forwarding the resource request from the first user node to the second user node through a direct connection.
13. A machine-readable medium as claimed in claim 9, wherein said program further contains instructions for performing the step of publishing the resource request to at least some of the user nodes of the network via the server node.
14. A machine-readable medium as claimed in claim 13, wherein in the publishing step, the server node publishes the resource request to all of the user nodes of the network that are subscribed to one or more selected resource request channels.
15. A machine-readable medium as claimed in claim 9, wherein said program further contains instructions for performing the step of repeating the steps of determining and forwarding until in the determining step a user node that received the resource request decides to send the resource request to the server node.
16. A machine-readable medium as claimed in claim 9, wherein said program further contains instructions for performing the steps of: sending the resource request to be published from a requesting user node, which desires the request resource, to the first user node; and sending an identical resource request from the requesting user node to all of the user nodes to which the requesting user node is connected through direct connections .
17. A user node for use in a computer network of the type that includes a plurality of user nodes and at least one server node, with each of the user nodes being connected to at least one other user node through a direct connection, said user node comprising: a receiving interface for receiving a resource request to be published; control means for deciding whether or not to send the resource request to the server node; and at least one transmitting interface for selectively forwarding the resource request to a second user node of the network through a direct connection or sending the resource request to the server node for publication, wherein the transmitting interface forwards the resource request to the second user node when the control means decides not to send the resource request to the server node, and sends the resource request to the server node for publication when the control means decides to send the resource request to the server node.
18. A user node as claimed in claim 17, wherein the control means randomly decides whether or not to send the resource request to the server node .
19. A user node as claimed in claim 18, wherein the control means randomly decides based on a weighting factor.
20. A user node as claimed in claim 17, wherein the control means randomly selects one of the other user nodes of the network to be the second user node to which the resource request is forwarded.
PCT/GB2002/001281 2001-05-07 2002-03-18 Scalable resource discovery and reconfiguration for distributed computer networks WO2002091712A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DE60208659T DE60208659T2 (en) 2001-05-07 2002-03-18 SCALABLE RESOURCE DETECTION AND RECONFIGURATION FOR DISTRIBUTED COMPUTER NETWORKS
JP2002588054A JP3851275B2 (en) 2001-05-07 2002-03-18 Scalable resource discovery and reconfiguration of distributed computer networks
EP02706962A EP1386471B1 (en) 2001-05-07 2002-03-18 Scalable resource discovery and reconfiguration for distributed computer networks
KR1020037013118A KR100613053B1 (en) 2001-05-07 2002-03-18 Scalable resource discovery reconfiguration for distributed computer networks

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/850,343 2001-05-07
US09/850,343 US20020165948A1 (en) 2001-05-07 2001-05-07 Scalable resource discovery and reconfiguration for distributed computer networks

Publications (1)

Publication Number Publication Date
WO2002091712A1 true WO2002091712A1 (en) 2002-11-14

Family

ID=25307875

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2002/001281 WO2002091712A1 (en) 2001-05-07 2002-03-18 Scalable resource discovery and reconfiguration for distributed computer networks

Country Status (9)

Country Link
US (2) US20020165948A1 (en)
EP (1) EP1386471B1 (en)
JP (1) JP3851275B2 (en)
KR (1) KR100613053B1 (en)
CN (1) CN100417158C (en)
AT (1) ATE315871T1 (en)
DE (1) DE60208659T2 (en)
TW (1) TWI222287B (en)
WO (1) WO2002091712A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006510091A (en) * 2002-12-09 2006-03-23 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Method and apparatus for retrieving data in a peer-to-peer network

Families Citing this family (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7797375B2 (en) * 2001-05-07 2010-09-14 International Business Machines Corporat System and method for responding to resource requests in distributed computer networks
US20030165139A1 (en) * 2001-08-15 2003-09-04 Tsu-Wei Chen Packet routing via payload inspection
US7545805B2 (en) * 2001-08-15 2009-06-09 Precache, Inc. Method and apparatus for content-based routing and filtering at routers using channels
US7551629B2 (en) * 2002-03-28 2009-06-23 Precache, Inc. Method and apparatus for propagating content filters for a publish-subscribe network
US20040083305A1 (en) * 2002-07-08 2004-04-29 Chung-Yih Wang Packet routing via payload inspection for alert services
US7606916B1 (en) * 2003-11-10 2009-10-20 Cisco Technology, Inc. Method and apparatus for load balancing within a computer system
US7761569B2 (en) * 2004-01-23 2010-07-20 Tiversa, Inc. Method for monitoring and providing information over a peer to peer network
US7827603B1 (en) * 2004-02-13 2010-11-02 Citicorp Development Center, Inc. System and method for secure message reply
US7647394B2 (en) * 2005-02-15 2010-01-12 Microsoft Corporation Scaling UPnP v1.0 device eventing using peer groups
US7640329B2 (en) * 2005-02-15 2009-12-29 Microsoft Corporation Scaling and extending UPnP v1.0 device discovery using peer groups
US8200563B2 (en) * 2005-09-23 2012-06-12 Chicago Mercantile Exchange Inc. Publish and subscribe system including buffer
US20070165519A1 (en) * 2006-01-13 2007-07-19 George David A Method and apparatus for re-establishing anonymous data transfers
US20070199077A1 (en) * 2006-02-22 2007-08-23 Czuchry Andrew J Secure communication system
US8190682B2 (en) * 2006-03-31 2012-05-29 Amazon Technologies, Inc. Managing execution of programs by multiple computing systems
EP1881676B1 (en) * 2006-07-20 2008-12-17 Alcatel Lucent Distributed presence management in peer-to-peer networks
KR101402886B1 (en) * 2006-08-10 2014-06-02 톰슨 라이센싱 Method for the diffusion of information in a distributed network
US7991910B2 (en) 2008-11-17 2011-08-02 Amazon Technologies, Inc. Updating routing information based on client location
US8028090B2 (en) 2008-11-17 2011-09-27 Amazon Technologies, Inc. Request routing utilizing client location information
US8601090B1 (en) 2008-03-31 2013-12-03 Amazon Technologies, Inc. Network resource identification
US8606996B2 (en) 2008-03-31 2013-12-10 Amazon Technologies, Inc. Cache optimization
US8533293B1 (en) 2008-03-31 2013-09-10 Amazon Technologies, Inc. Client side cache management
US8321568B2 (en) 2008-03-31 2012-11-27 Amazon Technologies, Inc. Content management
US7962597B2 (en) 2008-03-31 2011-06-14 Amazon Technologies, Inc. Request routing based on class
US7970820B1 (en) 2008-03-31 2011-06-28 Amazon Technologies, Inc. Locality based content distribution
US8447831B1 (en) 2008-03-31 2013-05-21 Amazon Technologies, Inc. Incentive driven content delivery
US9912740B2 (en) 2008-06-30 2018-03-06 Amazon Technologies, Inc. Latency measurement in resource requests
US9407681B1 (en) 2010-09-28 2016-08-02 Amazon Technologies, Inc. Latency measurement in resource requests
US7925782B2 (en) 2008-06-30 2011-04-12 Amazon Technologies, Inc. Request routing using network computing components
US8073940B1 (en) 2008-11-17 2011-12-06 Amazon Technologies, Inc. Managing content delivery network service providers
US8122098B1 (en) 2008-11-17 2012-02-21 Amazon Technologies, Inc. Managing content delivery network service providers by a content broker
US8732309B1 (en) 2008-11-17 2014-05-20 Amazon Technologies, Inc. Request routing utilizing cost information
US8521880B1 (en) 2008-11-17 2013-08-27 Amazon Technologies, Inc. Managing content delivery network service providers
KR101030095B1 (en) * 2009-02-03 2011-04-20 주식회사 웰게이트 Method of distributed peer-discovery in wireless peer to peer network
US8688837B1 (en) 2009-03-27 2014-04-01 Amazon Technologies, Inc. Dynamically translating resource identifiers for request routing using popularity information
US8412823B1 (en) 2009-03-27 2013-04-02 Amazon Technologies, Inc. Managing tracking information entries in resource cache components
US8756341B1 (en) 2009-03-27 2014-06-17 Amazon Technologies, Inc. Request routing utilizing popularity information
US8521851B1 (en) 2009-03-27 2013-08-27 Amazon Technologies, Inc. DNS query processing using resource identifiers specifying an application broker
JP5537651B2 (en) 2009-04-15 2014-07-02 株式会社 Itec Tokyo Communication method in IEEE 802.11 wireless LAN environment
US8782236B1 (en) 2009-06-16 2014-07-15 Amazon Technologies, Inc. Managing resources using resource expiration data
US8397073B1 (en) 2009-09-04 2013-03-12 Amazon Technologies, Inc. Managing secure content in a content delivery network
US8433771B1 (en) 2009-10-02 2013-04-30 Amazon Technologies, Inc. Distribution network with forward resource propagation
US9495338B1 (en) 2010-01-28 2016-11-15 Amazon Technologies, Inc. Content distribution network
US20120005274A1 (en) * 2010-07-02 2012-01-05 Electronics And Telecommunications Research Institute System and method for offering cloud computing service
US8819283B2 (en) 2010-09-28 2014-08-26 Amazon Technologies, Inc. Request routing in a networked environment
US10958501B1 (en) 2010-09-28 2021-03-23 Amazon Technologies, Inc. Request routing information based on client IP groupings
US8468247B1 (en) 2010-09-28 2013-06-18 Amazon Technologies, Inc. Point of presence management in request routing
US8577992B1 (en) 2010-09-28 2013-11-05 Amazon Technologies, Inc. Request routing management based on network components
US10097398B1 (en) 2010-09-28 2018-10-09 Amazon Technologies, Inc. Point of presence management in request routing
US9003035B1 (en) 2010-09-28 2015-04-07 Amazon Technologies, Inc. Point of presence management in request routing
US9712484B1 (en) 2010-09-28 2017-07-18 Amazon Technologies, Inc. Managing request routing information utilizing client identifiers
US8452874B2 (en) 2010-11-22 2013-05-28 Amazon Technologies, Inc. Request routing processing
US9313159B2 (en) 2011-03-24 2016-04-12 Red Hat, Inc. Routing messages exclusively to eligible consumers in a dynamic routing network
US9021131B2 (en) 2011-03-24 2015-04-28 Red Hat, Inc. Identifying linked message brokers in a dynamic routing network
US9137189B2 (en) * 2011-03-24 2015-09-15 Red Hat, Inc. Providing distributed dynamic routing using a logical broker
US10467042B1 (en) 2011-04-27 2019-11-05 Amazon Technologies, Inc. Optimized deployment based upon customer locality
US9432218B2 (en) 2011-07-28 2016-08-30 Red Hat, Inc. Secure message delivery to a transient recipient in a routed network
US8904009B1 (en) 2012-02-10 2014-12-02 Amazon Technologies, Inc. Dynamic content delivery
US10021179B1 (en) 2012-02-21 2018-07-10 Amazon Technologies, Inc. Local resource delivery network
CN110147282A (en) * 2012-03-05 2019-08-20 联想(北京)有限公司 A kind of method and electronic equipment obtaining hardware resource
US8811950B2 (en) * 2012-03-30 2014-08-19 Qualcomm Incorporated Methods and apparatus for controlling devices with no or limited WWAN capability in peer to peer communication
US10623408B1 (en) 2012-04-02 2020-04-14 Amazon Technologies, Inc. Context sensitive object management
US9154551B1 (en) 2012-06-11 2015-10-06 Amazon Technologies, Inc. Processing DNS queries to identify pre-processing information
US9525659B1 (en) 2012-09-04 2016-12-20 Amazon Technologies, Inc. Request routing utilizing point of presence load information
US9323577B2 (en) 2012-09-20 2016-04-26 Amazon Technologies, Inc. Automated profiling of resource usage
US10205698B1 (en) 2012-12-19 2019-02-12 Amazon Technologies, Inc. Source-dependent address resolution
KR20140098606A (en) * 2013-01-31 2014-08-08 한국전자통신연구원 Node discovery system and method using publish-subscribe communication middleware
US9294391B1 (en) 2013-06-04 2016-03-22 Amazon Technologies, Inc. Managing network computing components utilizing request routing
US8769610B1 (en) * 2013-10-31 2014-07-01 Eventure Interactive, Inc. Distance-modified security and content sharing
US10091096B1 (en) 2014-12-18 2018-10-02 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10097448B1 (en) 2014-12-18 2018-10-09 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10033627B1 (en) 2014-12-18 2018-07-24 Amazon Technologies, Inc. Routing mode and point-of-presence selection service
US10225326B1 (en) 2015-03-23 2019-03-05 Amazon Technologies, Inc. Point of presence based data uploading
US9819567B1 (en) 2015-03-30 2017-11-14 Amazon Technologies, Inc. Traffic surge management for points of presence
US9887931B1 (en) 2015-03-30 2018-02-06 Amazon Technologies, Inc. Traffic surge management for points of presence
US9887932B1 (en) 2015-03-30 2018-02-06 Amazon Technologies, Inc. Traffic surge management for points of presence
US9832141B1 (en) 2015-05-13 2017-11-28 Amazon Technologies, Inc. Routing based request correlation
US10097566B1 (en) 2015-07-31 2018-10-09 Amazon Technologies, Inc. Identifying targets of network attacks
US9742795B1 (en) 2015-09-24 2017-08-22 Amazon Technologies, Inc. Mitigating network attacks
US9794281B1 (en) 2015-09-24 2017-10-17 Amazon Technologies, Inc. Identifying sources of network attacks
US9774619B1 (en) 2015-09-24 2017-09-26 Amazon Technologies, Inc. Mitigating network attacks
US10270878B1 (en) 2015-11-10 2019-04-23 Amazon Technologies, Inc. Routing for origin-facing points of presence
US10049051B1 (en) 2015-12-11 2018-08-14 Amazon Technologies, Inc. Reserved cache space in content delivery networks
US10257307B1 (en) 2015-12-11 2019-04-09 Amazon Technologies, Inc. Reserved cache space in content delivery networks
US10348639B2 (en) 2015-12-18 2019-07-09 Amazon Technologies, Inc. Use of virtual endpoints to improve data transmission rates
US10075551B1 (en) 2016-06-06 2018-09-11 Amazon Technologies, Inc. Request management for hierarchical cache
US10110694B1 (en) 2016-06-29 2018-10-23 Amazon Technologies, Inc. Adaptive transfer rate for retrieving content from a server
US9992086B1 (en) 2016-08-23 2018-06-05 Amazon Technologies, Inc. External health checking of virtual private cloud network environments
US10033691B1 (en) 2016-08-24 2018-07-24 Amazon Technologies, Inc. Adaptive resolution of domain name requests in virtual private cloud network environments
US10505961B2 (en) 2016-10-05 2019-12-10 Amazon Technologies, Inc. Digitally signed network address
US10372499B1 (en) 2016-12-27 2019-08-06 Amazon Technologies, Inc. Efficient region selection system for executing request-driven code
US10831549B1 (en) 2016-12-27 2020-11-10 Amazon Technologies, Inc. Multi-region request-driven code execution system
US10938884B1 (en) 2017-01-30 2021-03-02 Amazon Technologies, Inc. Origin server cloaking using virtual private cloud network environments
US10503613B1 (en) 2017-04-21 2019-12-10 Amazon Technologies, Inc. Efficient serving of resources during server unavailability
US11075987B1 (en) 2017-06-12 2021-07-27 Amazon Technologies, Inc. Load estimating content delivery network
US10447648B2 (en) 2017-06-19 2019-10-15 Amazon Technologies, Inc. Assignment of a POP to a DNS resolver based on volume of communications over a link between client devices and the POP
US10742593B1 (en) 2017-09-25 2020-08-11 Amazon Technologies, Inc. Hybrid content request routing system
US10592578B1 (en) 2018-03-07 2020-03-17 Amazon Technologies, Inc. Predictive content push-enabled content delivery network
US10862852B1 (en) 2018-11-16 2020-12-08 Amazon Technologies, Inc. Resolution of domain name requests in heterogeneous network environments
US11025747B1 (en) 2018-12-12 2021-06-01 Amazon Technologies, Inc. Content request pattern-based routing system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001024386A1 (en) * 1999-09-29 2001-04-05 Motorola Inc. Method and apparatus in a wireless transceiver for seeking and transferring information available from a network server

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4445171A (en) 1981-04-01 1984-04-24 Teradata Corporation Data processing systems and methods
US4412285A (en) * 1981-04-01 1983-10-25 Teradata Corporation Multiprocessor intercommunication system and method
US4814979A (en) * 1981-04-01 1989-03-21 Teradata Corporation Network to transmit prioritized subtask pockets to dedicated processors
US4945471A (en) * 1981-04-01 1990-07-31 Teradata Corporation Message transmission system for selectively transmitting one of two colliding messages based on contents thereof
JPS6056799A (en) * 1983-09-08 1985-04-02 本田技研工業株式会社 Heavy material loading jig
CA1260151A (en) 1985-06-11 1989-09-26 Frank D. Bartocci Propagation of network queries through superior- subordinate and peer-peer data distribution relationships
GB2345157B (en) * 1998-12-23 2003-06-18 Ibm Publish and subscribe data processing apparatus, method and computer program product with declaration of a unique publisher broker
US5826269A (en) * 1995-06-21 1998-10-20 Microsoft Corporation Electronic mail interface for a network server
US5870605A (en) * 1996-01-18 1999-02-09 Sun Microsystems, Inc. Middleware for enterprise information distribution
US5873084A (en) 1996-01-18 1999-02-16 Sun Microsystems, Inc. Database network connectivity product
US5819032A (en) * 1996-05-15 1998-10-06 Microsoft Corporation Electronic magazine which is distributed electronically from a publisher to multiple subscribers
US5970231A (en) * 1996-11-27 1999-10-19 Pen Industries, Inc. Electronic newspaper and electronic publishing medium
US6446116B1 (en) * 1997-06-30 2002-09-03 Sun Microsystems, Inc. Method and apparatus for dynamic loading of a transport mechanism in a multipoint data delivery system
US6216132B1 (en) * 1997-11-20 2001-04-10 International Business Machines Corporation Method and system for matching consumers to events
US6324587B1 (en) * 1997-12-23 2001-11-27 Microsoft Corporation Method, computer program product, and data structure for publishing a data object over a store and forward transport
US6636886B1 (en) * 1998-05-15 2003-10-21 E.Piphany, Inc. Publish-subscribe architecture using information objects in a computer network
US7136645B2 (en) * 1998-10-09 2006-11-14 Netmotion Wireless, Inc. Method and apparatus for providing mobile and other intermittent connectivity in a computing environment
US6228022B1 (en) 1998-10-28 2001-05-08 Sdgi Holdings, Inc. Methods and instruments for spinal surgery
US6829770B1 (en) * 1999-02-23 2004-12-07 Microsoft Corporation Object connectivity through loosely coupled publish and subscribe events
US6725281B1 (en) * 1999-06-11 2004-04-20 Microsoft Corporation Synchronization of controlled device state using state table and eventing in data-driven remote device control model
US6405191B1 (en) * 1999-07-21 2002-06-11 Oracle Corporation Content based publish-and-subscribe system integrated in a relational database system
GB2354847A (en) * 1999-09-28 2001-04-04 Ibm Publish/subscribe data processing with subscription points for customised message processing
US6742023B1 (en) * 2000-04-28 2004-05-25 Roxio, Inc. Use-sensitive distribution of data files between users
US6732237B1 (en) * 2000-08-29 2004-05-04 Oracle International Corporation Multi-tier caching system
US7114003B2 (en) * 2000-10-18 2006-09-26 Nortel Networks Limited Content networks

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001024386A1 (en) * 1999-09-29 2001-04-05 Motorola Inc. Method and apparatus in a wireless transceiver for seeking and transferring information available from a network server

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ACCETTA M: "RFC 887 - Resource Location Protocol", IETF RFC, December 1983 (1983-12-01), XP002159790 *
ANONYMOUS: "A Process for Authorized Service Discovery in Distributed Computing Environments", RESEARCH DISCLOSURE, no. 429, 1 January 2000 (2000-01-01), Havant, UK, article No. 429131, pages 168, XP002212114 *
GUTTMAN E ET AL: "RFC 2608 - Service Location Protocol, Version 2", IETF RFC, June 1999 (1999-06-01), XP002193190 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006510091A (en) * 2002-12-09 2006-03-23 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Method and apparatus for retrieving data in a peer-to-peer network

Also Published As

Publication number Publication date
EP1386471A1 (en) 2004-02-04
KR100613053B1 (en) 2006-08-16
US20020165948A1 (en) 2002-11-07
JP2004532471A (en) 2004-10-21
US7783762B2 (en) 2010-08-24
DE60208659T2 (en) 2006-08-24
US20070014302A1 (en) 2007-01-18
JP3851275B2 (en) 2006-11-29
TWI222287B (en) 2004-10-11
EP1386471B1 (en) 2006-01-11
DE60208659D1 (en) 2006-04-06
CN100417158C (en) 2008-09-03
KR20030097821A (en) 2003-12-31
CN1489857A (en) 2004-04-14
ATE315871T1 (en) 2006-02-15

Similar Documents

Publication Publication Date Title
EP1386471B1 (en) Scalable resource discovery and reconfiguration for distributed computer networks
EP1386467B1 (en) System and method for responding to resource requests in distributed computer networks
US7418509B2 (en) Method and apparatus for a distributed server tree
US7640246B2 (en) Method and system for providing content
US7782866B1 (en) Virtual peer in a peer-to-peer network
RU2420898C2 (en) Optimising communication using scalable peer groups
US7177929B2 (en) Persisting node reputations in transient network communities
US20020165815A1 (en) Online marketplace with anonymous communication
US20040122906A1 (en) Authorizing message publication to a group of subscribing clients via a publish/subscribe service
US7373394B1 (en) Method and apparatus for multicast cloud with integrated multicast and unicast channel routing in a content distribution network
US20080080392A1 (en) Virtual peer for a content sharing system
US20030187918A1 (en) Interminable peer relationships in transient communities
CA2477197A1 (en) Secured and access controlled peer-to-peer resource sharing method and apparatus
US9871754B2 (en) Communicating messages between publishers and subscribers in a mesh routing network
EP1491026A1 (en) Dynamic addressing in transient networks
EP1719326B1 (en) Method for improving peer to peer network communication
JP2010505196A (en) Multiple peer groups for efficiently scalable computing
KR101984007B1 (en) A method for providing the information on the content which other user receives in p2p network-based content delivery service
Ragab et al. Service-oriented autonomous decentralized community communication technique for a complex adaptive information system
US20050030892A1 (en) System for providing network load distribution
Junginger et al. Peer‐To‐Peer Middleware
Stäber et al. Using onion routing to secure peer-to-peer supported business collaboration
IAB RFC 5694: Peer-to-Peer (P2P) Architecture: Definition, Taxonomies, Examples, and Applicability

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 028044711

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 1020037013118

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2002588054

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2002706962

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2002706962

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWG Wipo information: grant in national office

Ref document number: 2002706962

Country of ref document: EP