|Publication number||US6966058 B2|
|Application number||US 10/170,881|
|Publication date||Nov 15, 2005|
|Filing date||Jun 12, 2002|
|Priority date||Jun 12, 2002|
|Also published as||US20030233648, WO2003107181A1|
|Publication number||10170881, 170881, US 6966058 B2, US 6966058B2, US-B2-6966058, US6966058 B2, US6966058B2|
|Inventors||William J. Earl, Terry G. Hahn, Dhanabal Ekambaram|
|Original Assignee||Agami Systems, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (12), Non-Patent Citations (1), Referenced by (168), Classifications (8), Legal Events (10)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates generally to distributed computing systems, and more particularly to a system and method for managing software upgrades and downgrades in a highly scalable, distributed computing system. The present invention performs sequential or “rolling” software upgrades in a distributed computing system in a manner that allows the entire system to remain operable and available during the upgrade process.
Distributed computing systems, such as distributed file systems, typically include several system severs or components that are interconnected through a network. The various servers and components of the system run software that controls and manages the various operations of the computing system. Periodically, new upgrades, releases, additions or patches may be created for the software running on the system. For the system to operate properly, this new software must be loaded onto all of the servers and components of the system.
In order to upgrade the currently running software in any prior distributed computing system, the system is temporarily shut down and/or made unavailable. Once the system is stopped, the software upgrades, releases, additions and/or patches are loaded onto all system components, and the system is rebooted. This process undesirably causes the distributed computing system to be inoperable or unavailable for significant periods of time during the upgrade process (i.e., until the upgrade is complete throughout the system), thereby depriving users of the system from accessing and operating the system until the upgrade is complete.
It is therefore desirable to provide a system and method for managing software upgrades in a distributed computing system, which performs software upgrades in the distributed computing system, while allowing the system to remain operable and accessible throughout the upgrade process. Accordingly, the present invention provides a system and method for managing software in a distributed computing system having a plurality of nodes, which performs software upgrades in a sequential or “rolling” manner (e.g., node by node), thereby allowing the distributed computing system to remain operable and available throughout the upgrade process.
One non-limiting advantage of the present invention is that it provides a system and method for managing software upgrades in a distributed computing system, which performs software upgrades in a sequential or rolling manner, such that the distributed computing system remains accessible throughout the upgrade process.
Another non-limiting advantage of the present invention is that it provides a system and method for performing rolling software upgrades in a distributed file system having multiple components or resources.
Another non-limiting advantage of the present invention is that it performs rolling upgrades on a distributed computing system by installing a software release on a boot server and then, one by one, rebooting the various components of the system with the new software. The system assigns a “protected” status to any fault-tolerant component that has a “mirror” or duplicate component that is temporarily unavailable. The system will not reboot any protected components until their fault-tolerant status is recovered.
Another non-limiting advantage of the present invention is that it provides a rolling software upgrade model for a distributed computing system that also supports rolling downgrades releases, to back out of an upgrade which proves undesirable or unsatisfactory.
According to one aspect of the present invention, a system is disclosed for managing a software upgrade in a distributed computing system having a plurality of nodes that provide at least one fault-tolerant service. The system includes at least one server which is communicatively connected to the plurality of nodes and which is adapted to receive a software release, and to upgrade each of the plurality of nodes with the software release in a sequential manner, whereby the at least one fault-tolerant service remains available while the software upgrade is in progress.
According to a second aspect of the invention, a method is provided for managing a software upgrade in a distributed computing system having a plurality of nodes that provide at least one fault-tolerant service. The method includes the steps of: receiving a new software release; and upgrading each of the plurality of nodes with the new release in a sequential manner, whereby the at least one fault-tolerant service remains available while the software upgrade is in progress.
According to a third aspect of the present invention, a method is provided for managing a software upgrade in a distributed file system having a plurality of nodes that provide a plurality of fault-tolerant services. The method includes the steps of: receiving a new software release; determining whether the new software release is compatible with a current release running on the distributed file system; initiating a rolling upgrade process if the new release is compatible; performing the rolling upgrade process by sequentially loading and rebooting each of the plurality of nodes with the new software release; and ensuring that the plurality of fault-tolerant services remains available throughout the rolling upgrade process.
These and other features and advantages of the invention will become apparent by reference to the following specification and by reference to the following drawings.
The present invention will now be described in detail with reference to the drawings, which are provided as illustrative examples of the invention so as to enable those skilled in the art to practice the invention. The present invention may be implemented using software, hardware, and/or firmware or any combination thereof, as would be apparent to those of ordinary skill in the art. The preferred embodiment of the present invention will be described herein with reference to an exemplary implementation of a fault-tolerant distributed file storage system. However, the present invention is not limited to this exemplary implementation, but can be practiced in any distributed computing system that includes multiple hosts, resources or components that run software that may be upgraded periodically.
I. General System Architecture
Referring now to
It should be appreciated that in alternate embodiments the SMS/boot server pair 116 a, 116 b may comprise a plurality of disparate devices that perform one or more of the foregoing functions. For example, the system may include separate dedicated boot servers and/or separate dedicated SMS servers. In the following discussion, the SMS/boot server pair 116 a, 116 b may be collectively referred to as the SMS/boot server 116, and the CDB pair 114 a, 114 b may be collectively referred to as the CDB 114. Furthermore, the term “n” is used herein to indicate an indefinite plurality, so that the number “n” when referred to one component does not necessarily equal the number “n” of a different component. For example, the number of service nodes 130 a-130 n need not, but may, equal the number of services 120 a-120 n.
Each service node 130 a-130 n within system 100 is connected by use of an interface (e.g., 160 a 1-160 an, 160 b 1-160 bn, 160 n 1-160 nn) to at least a pair of switching fabrics 110 a-110 n, which may comprise for example, but without limitation, switched Internet Protocol (IP) based networks, buses, wireless networks or other suitable interconnect mechanisms. Switching fabrics 110 a-110 n can provide connectivity to any number of service nodes, boot servers, and/or function-specific servers such as the SMS/boot server pair 116 a, 116 b.
In the preferred embodiment, each service node 130 a-130 n in system 100 may include at least one service process 103 a-103 n, which can be, for example but without limitation, a gateway process, metadata process, or storage process for a file system. Each service node 130 a-130 n provides a fault-tolerant service and preferably includes a primary service instance (e.g., service nodes 130 a 1-n 1) and one or more backup service instances (e.g., service nodes 130 a 2-n 2). The primary service instance and its one or more backup service instances are substantially identical (e.g., have substantially identical components, functions and content), and in most cases reside on separate physical machine to ensure independent failure, thereby avoiding the primary service instance and its one or more backup service instances failing together. The primary and backup services may maintain fault-tolerance using a suitable checkpointing technique, such as that described in U.S. patent application Ser. No. 09/997,877, entitled “Fault Tolerance Using Logical Checkpointing in Computing Systems,” which is assigned to the present assignee and which is fully and completely incorporated herein by reference.
Services 120 a-120 n typically provide different functions within a distributed computing system. For example, but without limitation, one service may provide a distributed, scalable, and fault-tolerant metadata service (MDS), while another may provide a distributed, scalable gateway service (GS), a distributed scalable bit file storage service (BSS), or some other service. Examples of metadata, gateway and storage services are described in U.S. patent application Ser. No. 09/709,187, entitled “Scalable Storage System,” which is assigned to the present assignee, and which is fully and completely incorporated herein by reference.
Each service node 130 a-130 n in system 100 may also include life support service (LSS) processes 102 a-102 n. The LSS processes monitor the state and operability of the components and services of the distributed computing system 100 (e.g., whether each of the components is functioning properly). This state and operability information may be communicated to the SMS/boot server 116, which may utilize the information in order to place a “protected” status on certain components or nodes during the upgrade process in order to ensure that all system services and information remain available throughout the upgrade process. The use of this protected status in the upgrade procedure is more fully and completely discussed below in Section II.C. The SMS/boot server 116 may also use the state and operability information to determine how system resources should be allocated or modified to achieve certain user-selected performance attributes and functionality, as discussed in the above-referenced, co-pending U.S. Patent Application, entitled “System and Method for Managing a Distributed Computing System.” The function of the LSS system is fully and completely described in co-pending United States Patent Application, entitled “System and Method for Monitoring the State and Operability of Components in Distributed Computing Systems,” which is assigned to the present assignee, and which is fully and completely incorporated herein by reference.
Each service node 130 a-130 n in system 100 also includes an SMS agent process 101 a-101 n, which is a managed entity used by the SMS/boot server 116 to remotely manage a service node (e.g., to start, stop, and reboot a service node). Each agent may include fault-tolerant software loading mechanisms that can be remotely directed by the SMS/boot server 116 to load the necessary software onto the nodes. In one embodiment, the software for all nodes is stored in two separate boot server portions of the SMS/boot server 116.
It should be noted that the components of the service nodes may receive messages directly from the SMS/boot server 116 and from other components through the switching fabric 110 a-110 n, or alternatively, such messages may be mediated by another layer of communication software 104 a-104 n, according to a known or suitable mediation scheme.
In accordance with the principles of the present invention, the foregoing nodes and services are provided for purposes of illustration only and are not limiting. The resources of the system 100 may be used for any function or service, for example but not limited to, a highly scalable, fault-tolerant storage system. Furthermore, while only three services (i.e., services 120 a, 120 b, 120 n), and two SMS/boot servers (i.e., servers 116 a, 116 b) are shown, many more of each of these services and servers may be connected to one another via switching fabrics, according to the present invention.
II. Operation of the System
Referring now to
A. Installing New Software Releases
Once the software is received, the SMS/boot server 116 may check the software to ensure that it is complete (e.g., that all necessary components are present) and that no other noticeable errors exist, as shown in step 320.
The new release may then be installed onto all active SMS/boot servers 116, as shown in step 330. In one embodiment, a software release may take the form of a gzip-compressed tar archive file. The release may be installed by unpacking it with a “tar-zx” command (or the equivalent cpio command, if appropriate). The release will preferably include fully qualified names, so that it installs in the correct place in a file tree. A system administration command to install software (e.g., “install_software”) may be entered through an administrative interface (e.g., interface 230) to initiate or perform the installation. The implementation of the command will repeat the installation on all SMS/boot servers 116 (e.g., by copying the software from the first machine on which it is installed to the others). This may involve keeping a temporary copy on first machine until it is installed on all locations.
In the preferred embodiment, new software releases, which may include software patches are labeled with a unique identifier (e.g., a 64-bit identifier). A release may be installed in a distinct subtree on a boot server (e.g., on SMS/boot server 116 a, 116 b), and may not be considered suitable for further use until it has been installed on all active boot machines. For example, a new release may be stored under an assigned directory on a boot server, in a subtree corresponding to the unique identifier of the release. The subtree may include various directories which constitute a constant part of the release, such as binary and library directories. The release may contain all software, including kernel and other base system components, not just the proprietary software of the related distributed computing system. Architecture-specific components, such as executables, may be grouped under their own directories.
Each subtree may contain a file (e.g., a release identifier file) that identifies the release (e.g., as a hexadecimal string), and, on any executing machine, a file of the same name gives the current release identifier for software executing on that machine. The identity of the release(s) running on the nodes of system 100 may be maintained in a releases node or portion of the CDB 114.
After a copy of the new software is installed on each boot server, a management command records the presence of the new release by creating a node that identifies the release in the CDB 114, as shown in step 340. The node corresponding to the release that is presently being run by the system 100 may be assigned an attribute “_current”, which identifies the release as the current release being run by the system 100.
A new software release may also comprise a delta patch release. A delta patch release may contain a file entitled “DeltaPatchRelease”. When installing a release, the SMS/boot server 116 will first look for the existence of such a file. If present, the SMS/boot server 116 will first extract the file and process it, before unpacking the release as usual. In the preferred embodiment, the file may contain lines in three formats. First, a line of the form “BaseRelase nnn” specifies the release on which the patch is based. If release “nnn” is not installed, the SMS/boot server 116 will refuse to install the patch. Otherwise, the SMS/boot server 116 will clone the base release directory tree as the tree for the patch release, and hard-link all files from the base directory tree into corresponding locations in the patch release tree. The SMS/boot server 116 will then search for lines of the form “Delete xxx”, and delete files “xxx” which may be included within the patch release tree, in order to remove unnecessary files. The SMS/boot server 116 will then search for lines of the form “Rename xxx yyy” which may be included within the patch release tree, and rename files “xxx” to “yyy” within the patch release tree, in order to conform to the new release. The SMS/boot server 116 will then proceed to unpack the release as usual. Those of ordinary skill in the art will appreciate that this process and patch configuration will enable rapid distribution of relatively small fixes via slow communication links, such as modems.
The patch may also include a “PostInstallation” script, which provides instructions for the SMS/boot server 116 to perform after an installation is complete. The SMS/boot server 116 may search for this “PostInstallation” script at the top level of the installed software, and if it is present, run it to perform any post-installation operations, such as reconstructing the boot images for the non-boot servers (to avoid having to include those images in patch releases).
Users (e.g., system administrators) may be allowed to selectively install a particular patch. Patches, however, are mutually exclusive at runtime. For example, since a given release specifies those releases from which is an upgrade, one can only change from release A to patch A1 and then patch A2 if A2 is an upgrade from A1, which is in turn an upgrade from A. In the preferred embodiment, the system will normally maintain patches cumulatively, so that each new patch is a superset of any previous patch on the same base. If branches arise, then one would normally be unable to switch from one branch to another without downgrading to a common ancestor or upgrading to a common descendant, as will be appreciated by those skilled in the art.
B. Initiating Software Upgrades
In the preferred embodiment, upgrade requests and status information regarding the upgrade requests are recorded and maintained in the CDB 114. Entries may be created and viewed through an administrative interface (e.g., interface 230), and may be deleted by administrative request. In one embodiment, each entry may include the following attributes:
Hexadecimal release identifier to change from
Hexadecimal release identifier to change to
(present only if cancellation is requested)
(present only if request has been cancelled)
(present only if processing request has started)
(present only if processing request has completed)
(present only if processing request has failed; value is
a failure status indication)
In the preferred embodiment, “Cancelled”, “Failed”, and “Completed” are mutually exclusive. The system may allow a user (e.g., a system administrator) to only set attributes for “ToRelease” and “CancelRequested”. The other attributes may be set during request processing (including cancellation processing). Downgrade requests are allowed, subject to constraints described below in Section II.D.
In step 420, the SMS/boot server 116 determines whether the new release or upgrade is compatible with the software presently running on the system. SMS/boot server 116 may perform this step by comparing compatibility information contained in the new software release to the identity of the software release(s) that is currently running on the system.
If each node of the system is not running a compatible release, the SMS/boot server 116 will check the CDB 114 to determine whether a request to upgrade to a compatible release is in progress, as shown in step 430. If such a request is not in progress, the upgrade procedure will terminate, as shown in step 440. If, however, the SMS/boot server 116 detects that an upgrade request to a compatible release is in progress, an upgrade request to the new release may be queued for execution after the current upgrade is completed, as shown in step 450. After the request in progress is completed, as shown in step 460, the SMS/boot server will initiate the rolling upgrade procedure, as shown in step 470.
In this manner, the system will not execute a rolling upgrade if any element of the system is not running software which is either upward compatible with or identical to the desired release. If and/or when the new release is and/or becomes compatible with the current release, the rolling upgrade procedure is initiated, as shown in step 470.
In one embodiment, a user may also request the cancellation of an upgrade by use of a system administration command (e.g., “cancel_software_change”), identifying the sequence number of the request as an argument. In one embodiment, cancellation will only take effect if processing of the request has not yet started, i.e., only if the rolling upgrade has not been initiated in step 470. A system administration command, “remove_software”, with the identifier of the release as an argument, may be used to remove installed software. The command will refuse to remove a release which is marked as the currently selected software, or which any boot machine is currently executing.
C. Performing Rolling Software Upgrades
The “protected” status may be assigned and stored as an attribute of the nodes under the “hosts” section of the CDB 114. Protected status may be assigned to a node to temporarily protect the node from rebooting if the node contains the only active copy of a fault-tolerant service or data. In this context, the terms fault-tolerant “service” and fault-tolerant “data” may be used interchangeably. For example, a service, such as bit file storage service (BSS), will comprise data, such as a plurality of data files. If a copy of any of the service or its data is determined to be the only copy left, then the service/data will be considered to have lost its fault-tolerant status.
The “protected” status may be activated and maintained by use of the LSS and the SMS/boot server 116 (and/or by other management entities, such as agents of the SMS). In the preferred embodiment, protected status is assigned to protect any service or data that has lost its duplicate or backup copy within the system (i.e., lost its fault-tolerant status). Particularly, the LSS monitors the status of the various nodes, resources and services of the system 100. If any node, resource or service fails or becomes unavailable, the LSS notifies the SMS/boot server 116 (e.g., by updating a relational table). The SMS/boot server 116 then determines which service(s) and/or data are no longer available. For example, if a particular node has failed, the SMS/boot server 116 determines which services and/or data were provided by or stored on the failed node. (This information may be stored within one or more relational tables or matrixes within the CDB 114). The SMS/boot server 116 then locates the corresponding node(s) that provides and/or stores the surviving copy or instance of the disabled service(s) and/or data (e.g., by use of the one or more relational tables or matrixes within the CDB 114), and assigns a protected status to all nodes which provide or store the surviving copy of the service or data. For example and without limitation, if a bit file storage service (BSS) disk fails, the LSS system will notify the SMS/boot server 116, which will protect the disk(s) containing the surviving copy of the stored data, thereby preventing the reboot of any node containing any of the data until fault tolerance is restored. In this manner, no service or data provided by the distributed computing system will be unavailable during the rolling upgrade process (i.e., at least one copy of all services and data will always remain available).
Referring back to
The “next” node referred to in step 660 may be selected in any manner, based on any suitable or desired priority system. In one embodiment, an administrator may specify an ordering of upgrades of components through an administrative interface (e.g., interface 230). For example, an administrator might select to upgrade all of one class of component, such as a BSS, before upgrading other classes of components.
If, in step 620, the SMS/boot server 116 detects that the selected node is running the active software release, it proceeds to step 670. The SMS/boot server 116 then determines whether all retry indicators are “off” or cleared and whether all nodes in the system are running the active release. The SMS/boot server 116 may perform this step by checking the CDB 114. If the SMS/boot server 116 detects that one or more retry indicators are set or that any nodes are not running the active release, it proceeds to the next node (step 660), and repeats steps 620-670. Once all the retry indicators are “off” and all nodes are running the active release, the upgrade procedure will terminate, as shown in step 680.
The presence of failed servers does not affect the upgrade process, as long as the SMS/boot server 116 and CDB 114 are properly updated. Particularly, the SMS/boot server 116 will effectively “skip over” or ignore any failed servers during the upgrade process. However, it should be appreciated that if a failed server contains one of two instances of a service or data, the failure of that node will cause any other node providing the surviving copy of the service or data to be “protected”. If the failed server is down for an extended period of time (e.g., more than some predetermined period of time), the SMS/boot server 116 may replace it with a spare machine or node, by copying all of the information from the active node(s) to the new node(s), and then rebooting the new node(s) with the upgraded software.
D. Downgrade Requests
Downgrade requests may be entered via the system administration command “downgrade_software”, with a release identifier as its argument. The downgrade process is substantially similar to the afore-described upgrade process. Specifically, the SMS/boot sever 116 will only initiate the downgrade request if the request is for a release which is compatible with the presently operating software. This may be determined by comparing the target release to information contained in the presently running release. Particularly, each software release may include a “DowngradeReleases” file in the top of its subtree (e.g., in the same format as the “UpgradeReleases” file), providing the set of release identifiers to which it may be downgraded. If the downgrade request is for a release that is found in the “DowngradeReleases” file, the SMS/boot server 116 will initiate the downgrade request.
The SMS/boot server 116 will perform the downgrade in a sequential or rolling manner (e.g., in a manner substantially similar to method 600). That is, the SMS/boot server 116 will downgrade each node in the system, one at a time, and will “skip over” any “protected” nodes. The SMS/boot server 116 will set a retry indicator for the protected nodes, and will continue the process until all nodes have been downgraded. In one embodiment, a given node is downgraded by shutting down all services on the node other than the LSS and the SMS Agent, and then executing a “downgrade-release” script with the target release identifier as an argument. The “downgrade-release” script is effective to downgrade the software to the target release. Once the “downgrade-release” script has completed, it signals completion by making an update in a table (e.g., a “ReleaseLevel” table) within the LSS, giving the destination release level, and then “shuts down” the node. When the SMS/boot server 116 notices that the node has shutdown, it records the node as being at the target release level (e.g., within the CDB 114), conveys that information to the boot servers, and reboots the machine. In the case of a boot machine, the downgrade script adjusts the boot machine's own configuration to use the new release on next boot before shutting down the system.
In this manner, the present invention provides a system and method for managing software upgrades in a distributed computing system that performs software upgrades on a node by node basis, in a manner which allows all services and data provided by the distributed computing system to remain available throughout the upgrade process. The system and method will automatically protect any node that provides the only instance of a service or data during the upgrade process, thereby preventing the node from being rebooted until fault tolerance is restored. In this manner, all services and information will remain available during the upgrade process. In a similar manner, the present invention is further able to perform software downgrades throughout the system in a manner which allows the system and all of its components to remain available throughout the downgrade process.
Although the present invention has been particularly described with reference to the preferred embodiments thereof, it should be readily apparent to those of ordinary skill in the art that changes and modifications in the form and details may be made without departing from the spirit and scope of the invention. For example, it should be understood that Applicant's invention is not limited to the exemplary methods that are illustrated in
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5664186 *||May 8, 1995||Sep 2, 1997||International Business Machines Corporation||Computer file management and backup system|
|US5717917 *||Feb 7, 1995||Feb 10, 1998||Mitsubishi Denki Kabushiki Kaisha||Method of controlling information on data links and apparatus for controlling information on data links|
|US5742829 *||Mar 10, 1995||Apr 21, 1998||Microsoft Corporation||Automatic software installation on heterogeneous networked client computer systems|
|US5754785 *||Apr 27, 1995||May 19, 1998||General Datacomm||Communications network equipment|
|US5859969 *||Jan 11, 1996||Jan 12, 1999||Fujitsu Limited||Remote installation system and method|
|US6080207 *||Jun 4, 1998||Jun 27, 2000||Gateway 2000, Inc.||System and method of creating and delivering software|
|US6105073 *||May 30, 1996||Aug 15, 2000||Unisys Corp.||Method for packing/unpacking C operations to/from RPC compatible format using the RPC protocol to operate remotely with an object-oriented repository|
|US6324692 *||Jul 28, 1999||Nov 27, 2001||Data General Corporation||Upgrade of a program|
|US6349408 *||Jun 30, 1998||Feb 19, 2002||Sun Microsystems, Inc.||Techniques for implementing a framework for extensible applications|
|US6529938 *||Aug 6, 1999||Mar 4, 2003||International Business Machines Corporation||Method, system, and program for executing operations on a client in a network environment|
|US6560614 *||Nov 12, 1999||May 6, 2003||Xosoft Inc.||Nonintrusive update of files|
|US6594735 *||Dec 28, 1998||Jul 15, 2003||Nortel Networks Limited||High availability computing system|
|1||PCT Written Opinion dated Apr. 20, 2004 corresponding to PCT/US03/18619 filed on Jun. 11, 2003.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7356577 *||Jun 12, 2003||Apr 8, 2008||Samsung Electronics Co., Ltd.||System and method for providing an online software upgrade in load sharing servers|
|US7379419 *||Aug 13, 2003||May 27, 2008||Samsung Electronics Co., Ltd.||Apparatus and method for performing an online software upgrade of resource servers|
|US7444430 *||Oct 28, 2003||Oct 28, 2008||Canon Kabushiki Kaisha||Terminal apparatus and control method thereof|
|US7478381||Dec 15, 2003||Jan 13, 2009||Microsoft Corporation||Managing software updates and a software distribution service|
|US7499988 *||Oct 16, 2003||Mar 3, 2009||International Business Machines Corporation||Method for SAN-based BOS install volume group|
|US7509636 *||Dec 15, 2003||Mar 24, 2009||Microsoft Corporation||System and method for updating files utilizing delta compression patching|
|US7518986||Nov 16, 2005||Apr 14, 2009||Juniper Networks, Inc.||Push-based hierarchical state propagation within a multi-chassis network device|
|US7552262 *||Aug 31, 2005||Jun 23, 2009||Juniper Networks, Inc.||Integration of an operative standalone router into a multi-chassis router|
|US7552432 *||Jul 12, 2004||Jun 23, 2009||Canon Kabushiki Kaisha||Information processing apparatus, information processing method, and control program|
|US7574481||Dec 20, 2000||Aug 11, 2009||Microsoft Corporation||Method and system for enabling offline detection of software updates|
|US7574706 *||Dec 15, 2003||Aug 11, 2009||Microsoft Corporation||System and method for managing and communicating software updates|
|US7584385 *||Dec 22, 2006||Sep 1, 2009||Xerox Corporation||Method and system for customer support|
|US7606241||Aug 12, 2005||Oct 20, 2009||Juniper Networks, Inc.||Extending standalone router syntax to multi-chassis routers|
|US7743008 *||Dec 8, 2004||Jun 22, 2010||International Business Machines Corporation||Adaptive management method with workflow control|
|US7747999||Sep 26, 2005||Jun 29, 2010||Juniper Networks, Inc.||Software installation in a multi-chassis network device|
|US7757226 *||Mar 17, 2004||Jul 13, 2010||Oracle International Corporation||Method and mechanism for performing a rolling upgrade of distributed computer software|
|US7804769||Dec 1, 2005||Sep 28, 2010||Juniper Networks, Inc.||Non-stop forwarding in a multi-chassis router|
|US7857222||Aug 16, 2007||Dec 28, 2010||Hand Held Products, Inc.||Data collection system having EIR terminal interface node|
|US7899930||Feb 8, 2008||Mar 1, 2011||Juniper Networks, Inc.||Integration of an operative standalone router into a multi-chassis router|
|US7921419 *||May 12, 2004||Apr 5, 2011||Oracle International Corporation||Method and mechanism for managing incompatible changes in a distributed system|
|US7992142 *||Oct 4, 2002||Aug 2, 2011||Ericsson, Ab||Communications networks|
|US8010082||Oct 19, 2005||Aug 30, 2011||Seven Networks, Inc.||Flexible billing architecture|
|US8025233||Dec 27, 2010||Sep 27, 2011||Hand Held Products, Inc.||Data collection system having EIR terminal interface node|
|US8040902||Oct 19, 2009||Oct 18, 2011||Juniper Networks, Inc.||Extending standalone router syntax to multi-chassis routers|
|US8064583||Sep 21, 2006||Nov 22, 2011||Seven Networks, Inc.||Multiple data store authentication|
|US8069166||Feb 27, 2006||Nov 29, 2011||Seven Networks, Inc.||Managing user-to-user contact with inferred presence information|
|US8078158||Jun 26, 2008||Dec 13, 2011||Seven Networks, Inc.||Provisioning applications for a mobile device|
|US8082364||Mar 28, 2011||Dec 20, 2011||Juniper Networks, Inc.||Managing state information in a computing environment|
|US8107921||Jan 11, 2008||Jan 31, 2012||Seven Networks, Inc.||Mobile virtual network operator|
|US8116214||Nov 30, 2005||Feb 14, 2012||Seven Networks, Inc.||Provisioning of e-mail settings for a mobile terminal|
|US8127342||Sep 23, 2010||Feb 28, 2012||Seven Networks, Inc.||Secure end-to-end transport through intermediary nodes|
|US8132166 *||Jun 14, 2007||Mar 6, 2012||Red Hat, Inc.||Methods and systems for provisioning software|
|US8135857||Sep 26, 2005||Mar 13, 2012||Juniper Networks, Inc.||Centralized configuration of a multi-chassis router|
|US8149691||Mar 25, 2009||Apr 3, 2012||Juniper Networks, Inc.||Push-based hierarchical state propagation within a multi-chassis network device|
|US8166164||Oct 14, 2011||Apr 24, 2012||Seven Networks, Inc.||Application and network-based long poll request detection and cacheability assessment therefor|
|US8185891 *||Jun 14, 2007||May 22, 2012||Red Hat, Inc.||Methods and systems for provisioning software|
|US8190701||Nov 1, 2011||May 29, 2012||Seven Networks, Inc.||Cache defeat detection and caching of content addressed by identifiers intended to defeat cache|
|US8204953||Nov 1, 2011||Jun 19, 2012||Seven Networks, Inc.||Distributed system for cache defeat detection and caching of content addressed by identifiers intended to defeat cache|
|US8209709||Jul 5, 2010||Jun 26, 2012||Seven Networks, Inc.||Cross-platform event engine|
|US8271530||May 12, 2004||Sep 18, 2012||Oracale International Corporation||Method and mechanism for managing and accessing static and dynamic data|
|US8271975||Feb 17, 2012||Sep 18, 2012||Red Hat, Inc.||Method and system for provisioning software|
|US8291076||Mar 5, 2012||Oct 16, 2012||Seven Networks, Inc.||Application and network-based long poll request detection and cacheability assessment therefor|
|US8297508||Sep 15, 2011||Oct 30, 2012||Hand Held Products, Inc.||Data collection system having EIR terminal interface node|
|US8316098||Nov 20, 2012||Seven Networks Inc.||Social caching for device resource sharing and management|
|US8326985||Nov 1, 2011||Dec 4, 2012||Seven Networks, Inc.||Distributed management of keep-alive message signaling for mobile network resource conservation and optimization|
|US8352914 *||Feb 18, 2009||Jan 8, 2013||Accenture Global Services Limited||Impact analysis of software change requests|
|US8356080||Jan 15, 2013||Seven Networks, Inc.||System and method for a mobile device to use physical storage of another device for caching|
|US8364181||Dec 10, 2007||Jan 29, 2013||Seven Networks, Inc.||Electronic-mail filtering for mobile devices|
|US8370831 *||Jun 29, 2010||Feb 5, 2013||Juniper Networks, Inc.||Software installation in a multi-chassis network device|
|US8412675||Feb 24, 2006||Apr 2, 2013||Seven Networks, Inc.||Context aware data presentation|
|US8417823||Nov 18, 2011||Apr 9, 2013||Seven Network, Inc.||Aligning data transfer to optimize connections established for transmission over a wireless network|
|US8438633||Dec 18, 2006||May 7, 2013||Seven Networks, Inc.||Flexible real-time inbox access|
|US8468126||Dec 14, 2005||Jun 18, 2013||Seven Networks, Inc.||Publishing data in an information community|
|US8468515||Dec 12, 2006||Jun 18, 2013||Hewlett-Packard Development Company, L.P.||Initialization and update of software and/or firmware in electronic devices|
|US8479189||Apr 11, 2003||Jul 2, 2013||Hewlett-Packard Development Company, L.P.||Pattern detection preprocessor in an electronic device update generation system|
|US8483048||Sep 23, 2010||Jul 9, 2013||Juniper Networks, Inc.||Non-stop forwarding in a multi-chassis router|
|US8484314||Oct 14, 2011||Jul 9, 2013||Seven Networks, Inc.||Distributed caching in a wireless network of content delivered for a mobile application over a long-held request|
|US8494510||Dec 6, 2011||Jul 23, 2013||Seven Networks, Inc.||Provisioning applications for a mobile device|
|US8516474 *||Jul 31, 2009||Aug 20, 2013||Alcatel Lucent||Method and system for distributing an upgrade among nodes in a network|
|US8526940||Dec 6, 2004||Sep 3, 2013||Palm, Inc.||Centralized rules repository for smart phone customer care|
|US8539040||Feb 28, 2012||Sep 17, 2013||Seven Networks, Inc.||Mobile network background traffic data management with optimized polling intervals|
|US8539123||Oct 6, 2011||Sep 17, 2013||Honeywell International, Inc.||Device management using a dedicated management interface|
|US8549587||Feb 14, 2012||Oct 1, 2013||Seven Networks, Inc.||Secure end-to-end transport through intermediary nodes|
|US8555273||Sep 17, 2004||Oct 8, 2013||Palm. Inc.||Network for updating electronic devices|
|US8556174||Oct 29, 2012||Oct 15, 2013||Hand Held Products, Inc.||Data collection system having EIR terminal interface node|
|US8561086||May 17, 2012||Oct 15, 2013||Seven Networks, Inc.||System and method for executing commands that are non-native to the native environment of a mobile device|
|US8572587||Feb 27, 2009||Oct 29, 2013||Red Hat, Inc.||Systems and methods for providing a library of virtual images in a software provisioning environment|
|US8578361||Feb 27, 2011||Nov 5, 2013||Palm, Inc.||Updating an electronic device with update agent code|
|US8612968||Sep 26, 2008||Dec 17, 2013||Red Hat, Inc.||Methods and systems for managing network connections associated with provisioning objects in a software provisioning environment|
|US8621075||Apr 27, 2012||Dec 31, 2013||Seven Metworks, Inc.||Detecting and preserving state for satisfying application requests in a distributed proxy and cache system|
|US8621123||Oct 6, 2011||Dec 31, 2013||Honeywell International Inc.||Device management using virtual interfaces|
|US8635339||Aug 22, 2012||Jan 21, 2014||Seven Networks, Inc.||Cache state management on a mobile device to preserve user experience|
|US8693494||Mar 31, 2008||Apr 8, 2014||Seven Networks, Inc.||Polling|
|US8700728||May 17, 2012||Apr 15, 2014||Seven Networks, Inc.||Cache defeat detection and caching of content addressed by identifiers intended to defeat cache|
|US8701103 *||Oct 31, 2007||Apr 15, 2014||Wal-Mart Stores, Inc.||Method and system for minimizing or eliminating downtime when updating a website|
|US8713177||May 30, 2008||Apr 29, 2014||Red Hat, Inc.||Remote management of networked systems using secure modular platform|
|US8738050||Jan 7, 2013||May 27, 2014||Seven Networks, Inc.||Electronic-mail filtering for mobile devices|
|US8750123||Jul 31, 2013||Jun 10, 2014||Seven Networks, Inc.||Mobile device equipped with mobile network congestion recognition to make intelligent decisions regarding connecting to an operator network|
|US8752044||Jul 27, 2007||Jun 10, 2014||Qualcomm Incorporated||User experience and dependency management in a mobile device|
|US8761756||Sep 13, 2012||Jun 24, 2014||Seven Networks International Oy||Maintaining an IP connection in a mobile network|
|US8774844 *||Apr 8, 2011||Jul 8, 2014||Seven Networks, Inc.||Integrated messaging|
|US8775631||Feb 25, 2013||Jul 8, 2014||Seven Networks, Inc.||Dynamic bandwidth adjustment for browsing or streaming activity in a wireless network based on prediction of user behavior when interacting with mobile applications|
|US8782204||Nov 28, 2008||Jul 15, 2014||Red Hat, Inc.||Monitoring hardware resources in a software provisioning environment|
|US8782222||Sep 5, 2012||Jul 15, 2014||Seven Networks||Timing of keep-alive messages used in a system for mobile network resource conservation and optimization|
|US8787947||Jun 18, 2008||Jul 22, 2014||Seven Networks, Inc.||Application discovery on mobile devices|
|US8793305||Dec 13, 2007||Jul 29, 2014||Seven Networks, Inc.||Content delivery to a mobile device from a content service|
|US8799410||Apr 13, 2011||Aug 5, 2014||Seven Networks, Inc.||System and method of a relay server for managing communications and notification between a mobile device and a web access server|
|US8799511||Jun 11, 2010||Aug 5, 2014||Juniper Networks, Inc.||Synchronizing state information between control units|
|US8805334||Sep 5, 2008||Aug 12, 2014||Seven Networks, Inc.||Maintaining mobile terminal information for secure communications|
|US8805425 *||Jan 28, 2009||Aug 12, 2014||Seven Networks, Inc.||Integrated messaging|
|US8811952||May 5, 2011||Aug 19, 2014||Seven Networks, Inc.||Mobile device power management in data synchronization over a mobile network with or without a trigger notification|
|US8812695||Apr 3, 2013||Aug 19, 2014||Seven Networks, Inc.||Method and system for management of a virtual network connection without heartbeat messages|
|US8831561||Apr 28, 2011||Sep 9, 2014||Seven Networks, Inc||System and method for tracking billing events in a mobile wireless network for a network operator|
|US8832228||Apr 26, 2012||Sep 9, 2014||Seven Networks, Inc.||System and method for making requests on behalf of a mobile device based on atomic processes for mobile network traffic relief|
|US8838744||Jan 28, 2009||Sep 16, 2014||Seven Networks, Inc.||Web-based access to data objects|
|US8838783||Jul 5, 2011||Sep 16, 2014||Seven Networks, Inc.||Distributed caching for resource and mobile network traffic management|
|US8839412||Sep 13, 2012||Sep 16, 2014||Seven Networks, Inc.||Flexible real-time inbox access|
|US8843153||Nov 1, 2011||Sep 23, 2014||Seven Networks, Inc.||Mobile traffic categorization and policy for network use optimization while preserving user experience|
|US8849902||Jun 24, 2011||Sep 30, 2014||Seven Networks, Inc.||System for providing policy based content service in a mobile network|
|US8861354||Dec 14, 2012||Oct 14, 2014||Seven Networks, Inc.||Hierarchies and categories for management and deployment of policies for distributed wireless traffic optimization|
|US8862657||Jan 25, 2008||Oct 14, 2014||Seven Networks, Inc.||Policy based content service|
|US8868753||Dec 6, 2012||Oct 21, 2014||Seven Networks, Inc.||System of redundantly clustered machines to provide failover mechanisms for mobile traffic management and network resource conservation|
|US8868803||Aug 28, 2013||Oct 21, 2014||Honeywell Internation Inc.||Managing data communication between a peripheral device and a host|
|US8873411||Jan 12, 2012||Oct 28, 2014||Seven Networks, Inc.||Provisioning of e-mail settings for a mobile terminal|
|US8874761||Mar 15, 2013||Oct 28, 2014||Seven Networks, Inc.||Signaling optimization in a wireless network for traffic utilizing proprietary and non-proprietary protocols|
|US8886176||Jul 22, 2011||Nov 11, 2014||Seven Networks, Inc.||Mobile application traffic optimization|
|US8893110||Apr 26, 2012||Nov 18, 2014||Qualcomm Incorporated||Device management in a network|
|US8903954||Nov 22, 2011||Dec 2, 2014||Seven Networks, Inc.||Optimization of resource polling intervals to satisfy mobile device requests|
|US8904380 *||Feb 4, 2013||Dec 2, 2014||Juniper Networks, Inc.||Software installation on a multi-chassis network device|
|US8909192||Aug 11, 2011||Dec 9, 2014||Seven Networks, Inc.||Mobile virtual network operator|
|US8909202||Jan 7, 2013||Dec 9, 2014||Seven Networks, Inc.||Detection and management of user interactions with foreground applications on a mobile device in distributed caching|
|US8909759||Oct 12, 2009||Dec 9, 2014||Seven Networks, Inc.||Bandwidth measurement|
|US8914002||Aug 11, 2011||Dec 16, 2014||Seven Networks, Inc.||System and method for providing a network service in a distributed fashion to a mobile device|
|US8918503||Aug 28, 2012||Dec 23, 2014||Seven Networks, Inc.||Optimization of mobile traffic directed to private networks and operator configurability thereof|
|US8918564||Dec 30, 2013||Dec 23, 2014||Honeywell International Inc.||Device management using virtual interfaces|
|US8925818||Oct 14, 2013||Jan 6, 2015||Hand Held Products, Inc.||Data collection system having EIR terminal interface node|
|US8930936||Nov 6, 2012||Jan 6, 2015||International Business Machines Corporation||Loading remote binaries onto a write-protected device|
|US8943492 *||Dec 28, 2012||Jan 27, 2015||Blackberry Limited||Method and system for generating a reverse binary patch|
|US8966066||Oct 12, 2012||Feb 24, 2015||Seven Networks, Inc.||Application and network-based long poll request detection and cacheability assessment therefor|
|US8977755||Dec 6, 2012||Mar 10, 2015||Seven Networks, Inc.||Mobile device and method to utilize the failover mechanism for fault tolerance provided for mobile traffic management and network/device resource conservation|
|US8984581||Jul 11, 2012||Mar 17, 2015||Seven Networks, Inc.||Monitoring mobile application activities for malicious traffic on a mobile device|
|US8989728||Sep 7, 2006||Mar 24, 2015||Seven Networks, Inc.||Connection architecture for a mobile network|
|US9002828||Jan 2, 2009||Apr 7, 2015||Seven Networks, Inc.||Predictive content delivery|
|US9003385 *||Mar 9, 2012||Apr 7, 2015||Red Hat, Inc.||Software release|
|US9009250||Dec 7, 2012||Apr 14, 2015||Seven Networks, Inc.||Flexible and dynamic integration schemas of a traffic management system with various network operators for network traffic alleviation|
|US9021021||Dec 10, 2012||Apr 28, 2015||Seven Networks, Inc.||Mobile network reporting and usage analytics system and method aggregated using a distributed traffic optimization system|
|US9021461 *||Feb 25, 2014||Apr 28, 2015||Wal-Mart Stores, Inc.||Method and system for minimizing or eliminating downtime when updating a website|
|US9043433||May 25, 2011||May 26, 2015||Seven Networks, Inc.||Mobile network traffic coordination across multiple applications|
|US9043731||Mar 30, 2011||May 26, 2015||Seven Networks, Inc.||3D mobile user interface with configurable workspace management|
|US9043779 *||Oct 15, 2013||May 26, 2015||International Business Machines Corporation||Loading remote binaries onto a write-protected device|
|US9047142||Dec 16, 2010||Jun 2, 2015||Seven Networks, Inc.||Intelligent rendering of information in a limited display environment|
|US9047582 *||Oct 4, 2002||Jun 2, 2015||Ca, Inc.||Methods and systems for managing enterprise assets|
|US9049179||Jan 20, 2012||Jun 2, 2015||Seven Networks, Inc.||Mobile network traffic coordination across multiple applications|
|US9053055||Dec 11, 2014||Jun 9, 2015||Honeywell International||Device management using virtual interfaces cross-reference to related applications|
|US9055102||Aug 2, 2010||Jun 9, 2015||Seven Networks, Inc.||Location-based operations and messaging|
|US9060032||May 9, 2012||Jun 16, 2015||Seven Networks, Inc.||Selective data compression by a distributed traffic management system to reduce mobile data traffic and signaling traffic|
|US9065765||Oct 8, 2013||Jun 23, 2015||Seven Networks, Inc.||Proxy server associated with a mobile carrier for enhancing mobile traffic management in a mobile network|
|US9077630||Jul 8, 2011||Jul 7, 2015||Seven Networks, Inc.||Distributed implementation of dynamic wireless traffic policy|
|US9081638||Apr 25, 2014||Jul 14, 2015||Qualcomm Incorporated||User experience and dependency management in a mobile device|
|US9084105||Apr 19, 2012||Jul 14, 2015||Seven Networks, Inc.||Device resources sharing for network resource conservation|
|US9100297||Aug 20, 2008||Aug 4, 2015||Red Hat, Inc.||Registering new machines in a software provisioning environment|
|US9100873||Sep 14, 2012||Aug 4, 2015||Seven Networks, Inc.||Mobile network background traffic data management|
|US9131397||Jun 6, 2013||Sep 8, 2015||Seven Networks, Inc.||Managing cache to prevent overloading of a wireless network due to user activity|
|US20020078142 *||Dec 20, 2000||Jun 20, 2002||Microsoft Corporation||Method and system for enabling offline detection of software updates|
|US20040088399 *||Oct 28, 2003||May 6, 2004||Makoto Minari||Terminal apparatus and control method thereof|
|US20040158605 *||Feb 10, 2003||Aug 12, 2004||International Business Machines Corporation||Domain-wide reset agents|
|US20040210582 *||May 12, 2004||Oct 21, 2004||Oracle International Corporation||Method and mechanism for managing and accessing static and dynamic data|
|US20040253956 *||Jun 12, 2003||Dec 16, 2004||Samsung Electronics Co., Ltd.||System and method for providing an online software upgrade in load sharing servers|
|US20050028173 *||Jul 12, 2004||Feb 3, 2005||Canon Kabushiki Kaisha||Information processing apparatus, information processing method, and control program|
|US20050036443 *||Aug 13, 2003||Feb 17, 2005||Samsung Electronics Co., Ltd.||Apparatus and method for performing an online software upgrade of resource servers|
|US20050083749 *||Oct 16, 2003||Apr 21, 2005||International Business Machines Corp.||Method for SAN-based BOS install volume group|
|US20050108288 *||Oct 4, 2002||May 19, 2005||Paul Hartshorne||Communications networks|
|US20050114853 *||Nov 26, 2003||May 26, 2005||Glider Joseph S.||Software upgrade and downgrade in systems with persistent data|
|US20050132348 *||Dec 15, 2003||Jun 16, 2005||Meulemans Michael E.||System and method for managing and communicating software updates|
|US20050132349 *||Dec 15, 2003||Jun 16, 2005||Jason Roberts||System and method for a software distribution service|
|US20050210461 *||Mar 17, 2004||Sep 22, 2005||Oracle International Corporation||Method and mechanism for performing a rolling upgrade of distributed computer software|
|US20050251523 *||May 7, 2004||Nov 10, 2005||Oracle International Corporation||Minimizing downtime for application changes in database systems|
|US20050257211 *||May 12, 2004||Nov 17, 2005||Oracle International Corporation||Method and mechanism for managing incompatible changes in a distributed system|
|US20060020801 *||Dec 8, 2004||Jan 26, 2006||International Business Machines Corporation||Adaptive management method with workflow control|
|US20080288938 *||Jun 14, 2007||Nov 20, 2008||Dehaan Michael||Methods and systems for provisioning software|
|US20100153908 *||Feb 18, 2009||Jun 17, 2010||Accenture Global Services Gmbh||Impact analysis of software change requests|
|US20110029965 *||Feb 3, 2011||Lamba Jaideep S||Method and system for distributing an upgrade among nodes in a network|
|US20120174089 *||Mar 9, 2012||Jul 5, 2012||Milner Stephen D||Method and an apparatus to conduct software release|
|US20130125109 *||Dec 28, 2012||May 16, 2013||Research In Motion Limited||Method and system for generating a reverse binary patch|
|US20140130031 *||Oct 15, 2013||May 8, 2014||International Business Machines Corporation||Loading remote binaries onto a write-protected device|
|US20140173566 *||Feb 25, 2014||Jun 19, 2014||Wal-Mart Stores, Inc.||Website update method and system|
|USRE45348||Mar 16, 2012||Jan 20, 2015||Seven Networks, Inc.||Method and apparatus for intercepting events in a communication system|
|WO2012016409A1 *||Dec 15, 2010||Feb 9, 2012||Zte Corporation||Terminal upgrade method, terminal upgrade downgrade method and upgrade management center|
|U.S. Classification||717/171, 717/176, 714/1, 709/223|
|International Classification||G06F9/44, G06F9/445|
|Jun 12, 2002||AS||Assignment|
Owner name: ZAMBEEL, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:EARL, WILLIAM J.;HAHN, TERRY G.;EKAMBARAM, DHANABAL;REEL/FRAME:013004/0218
Effective date: 20020610
|Dec 11, 2002||AS||Assignment|
Owner name: GATX VENTURES, INC., CALIFORNIA
Free format text: SECURITY AGREEMENT;ASSIGNOR:ZAMBEEL, INC.;REEL/FRAME:013969/0675
Effective date: 20021206
|May 14, 2003||AS||Assignment|
Owner name: STORAD, INC., CALIFORNIA
Free format text: TRANSFER STATEMENT;ASSIGNOR:ZAMBEEL, INC.;REEL/FRAME:014216/0769
Effective date: 20030430
|May 16, 2003||AS||Assignment|
Owner name: GATX VENTURES, INC., CALIFORNIA
Free format text: REAFFIRMATION AND GRANT OF SECURITY INTEREST PATENTS.;ASSIGNOR:STORAD, INC.;REEL/FRAME:014093/0248
Effective date: 20030430
|Jun 9, 2004||AS||Assignment|
Owner name: AGAMI SYSTEMS, INC., CALIFORNIA
Free format text: CHANGE OF NAME;ASSIGNOR:STORAD, INC.;REEL/FRAME:015436/0674
Effective date: 20040312
|Jun 6, 2008||AS||Assignment|
Owner name: HERCULES TECHNOLOGY GROWTH CAPITAL, INC., CALIFORN
Free format text: SECURITY AGREEMENT;ASSIGNOR:AGAMI SYSTEMS, INC.;REEL/FRAME:021050/0675
Effective date: 20080530
|Aug 1, 2008||AS||Assignment|
Owner name: STILES, DAVID, CALIFORNIA
Free format text: SECURITY AGREEMENT;ASSIGNOR:HERCULES TECHNOLOGY GROWTH CAPITAL, INC.;REEL/FRAME:021328/0080
Effective date: 20080801
|May 25, 2009||REMI||Maintenance fee reminder mailed|
|Nov 15, 2009||LAPS||Lapse for failure to pay maintenance fees|
|Jan 5, 2010||FP||Expired due to failure to pay maintenance fee|
Effective date: 20091115