|Publication number||US7844036 B2|
|Application number||US 11/503,580|
|Publication date||Nov 30, 2010|
|Filing date||Aug 14, 2006|
|Priority date||Aug 14, 2006|
|Also published as||US8306195, US20080066009, US20110066892|
|Publication number||11503580, 503580, US 7844036 B2, US 7844036B2, US-B2-7844036, US7844036 B2, US7844036B2|
|Inventors||Kenneth C. Gardner, Craig R. Powers, Robert Charles Holcomb, Kendall J. Cosby, Tana Christine Jackson, Charles A. Vazac, Matthew Solnit, Michael Hemmert|
|Original Assignee||Soasta, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (15), Referenced by (32), Classifications (23), Legal Events (2)|
|External Links: USPTO, USPTO Assignment, Espacenet|
The present invention relates generally to electronic communication technology, more particularly, to automated systems and methods for testing and/or demonstrating aspects or features of message-based, intranet, Internet, or browser-based applications.
Information technology is now routinely used by many enterprises to receive, process, and provide information via widely accessible electronic communications networks, such as the Internet. Yet most information technology systems will begin to deny service, or fail to process message traffic efficiently, when communications traffic exceeds a processing capacity of the system. Such failures in communication can significantly impair the operations of an enterprise in many ways.
Enterprises increasingly deploy Service Oriented Architecture (SOA) systems to expand their capabilities, increase their responsiveness to internal and external requests, and improve operational productivity. SOA is now being widely used to efficiently implement new Internet-based business processes, Web Services and other information processing protocols. SOA applications are often easily generated using commercially available Web Service orchestration tools in which message flow pathways are defined in accordance with intentional business logic.
Most SOA-based information technology systems and networks can integrate capabilities from an expanding and increasingly rich selection of available public services. Unfortunately, the communications burden placed on SOA systems that provide services via the Internet can be difficult to forecast. Almost any SOA system connected to the Internet will receive unpredictable levels of message traffic. The communications traffic capability of many SOA applications, even on a private network, such as the Intranet, can be difficult and expensive to test, measure or estimate. These difficulties in testing SOA applications are becoming increasingly problematic. The functionality and quality of web services is important, especially given that these services are often used for critical business applications. A consumer ordering a book from an on-line retailer, for example, needs to feel assured that the service will respond promptly and accurately to a specific request.
Prior art systems often require building a single use or disposable end-to-end system for testing the capacity of a website. For example, a web-services provider (such as a bank, an on-line retailer, or an electronic dating service) may need to know how many simultaneous user requests can come to their website given their website's configuration (i.e., its hardware, software, and connection to the Internet). Thousands of messages may be received by a particular website in any given moment, and software developers need to control the sequence, the timing, and the tempo of these messages to adequately performance-test the website's capacity. Similarly, there is a need for correctness testing of SOA-based applications.
Traditionally, developers have executed this type of test by building a long series of messages—typically using Extensible Mark-Up Language (XML) messages, which are messages in a human readable language format for tagging documents that are used by web services, to simulate real-world traffic. These XML messages are typically assembled by hand, using a programming language such as Perl or JAVA. Unfortunately, the testing process is highly prone to errors because even the smallest error (such as a difference in letter case) can invalidate the entire test. It is also an arduous and expensive process to write these scripts. Maintaining the scripts and updating them to reflect system changes is also a difficult process.
The present invention will be understood more fully from the detailed description that follows and from the accompanying drawings, which however, should not be taken to limit the invention to the specific embodiments shown, but are for explanation and understanding only.
In the following description specific details are set forth, such as device types, system configurations, protocols, methods, etc., in order to provide a thorough understanding of the present invention. However, persons having ordinary skill in the relevant arts will appreciate that these specific details may not be needed to practice the present invention.
According to one embodiment of the present invention, a visual or graphical user interface (GUI) is provided to allow business analysts, sales engineers, programmers, and other users (including non-programmers) to quickly build and maintain complex testing and demonstration scenarios for composite, message based applications, such as Web Services and SOA systems. The GUI is based on building blocks that allow a user to compose a test scenario by dragging and dropping various messages (in the form of icons or visual metaphors) onto different locations of the user interface screen. To facilitate understanding, the process of editing or assembling a procedure to generate complex, parallel message streams targeted at a message-based application may be considered analogous to the “cut-and-paste” process of editing or assembling a song, movie, or multi-media presentation in digital media presentation tools.
In accordance with a specific embodiment, messages may be combined into “clips” that can be reused. Clips are placed into “tracks” within “compositions” (with a set of rules to govern sequence, timing, and dependencies) utilizing a GUI with drag-and-drop capabilities. A user may also access the underlying message complexity. In this manner, a user may create sophisticated compositions that generate complex parallel message streams for testing and demonstration purposes.
As used herein, selecting a graphical element includes placing a cursor on the graphical element (i.e., screen icon) and pressing a key on a selecting device, (e.g., a mouse 23) when cursor is visually positioned by display screen 20 on graphical elements. Dragging and dropping a graphical element includes placing a cursor on graphical element and pressing the select key on a selecting device, e.g., a select key 25 of mouse 23, when the cursor is visually positioned by display screen 20 on the graphical element, and then manipulating mouse 23 to position the cursor on another graphical element and then releasing select key 25. Mouse 23 may include a tracking module 24 to sense movement of mouse 23 along a substantially planar surface. Mouse 23 is also typically configured to enable a user of device 10 to drag and drop icons visually presented on display screen 20. Display screen 20 is coupled with the display screen interface 13. Processor subsystem 11 directs an image presented on display screen 20 by sending imaging information to display screen interface 13.
Media reader 22 is configured to read computer readable instructions stored by a computer readable media. According to one embodiment of the invention, a series of test electronic messages are provided by device 10 in response to processor subsystem 11 executing one or more sequences of instructions contained in memory 18. Such instructions may be read into memory 18 from another computer-readable medium, such as media 214 (see
The term “computer-readable medium” as used herein refers to any medium that participates in providing instructions to processor subsystem 11 for execution. Such medium may take many forms, including but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, optical or magnetic disks, such as media 214. Volatile media includes dynamic memory, such as system memory 18. Transmission media includes coaxial cable, copper wire and fiber optic lines, including the wires that comprise internal communications bus 19. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to processor 11 for execution. For example, the instructions may initially be carried on a magnetic disk of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to network device 10 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on internal communications bus 19. Internal communications bus 19 carries the data to system memory 18, from which processor 11 retrieves and executes the instructions. The instructions received by system memory 18 may optionally be stored on media 14 either before or after execution by processor 11.
A user may utilize GUI 26 to create complex message streams along a timeline and/or in sequence to test and/or demonstrate web services, such as a website. Thousands of messages may be put together into a composition, which can be played out according to a particular sequence, timing, and tempo that a user creates using various components of GUI 26. A composition in the context of the present application is simply a test or demonstration (which may comprise multiple messages organized in message clips) that may be played out to a particular target, such as a website.
For example, an online banking service may want to know its service capacity limits, i.e., how many simultaneous user service requests are possible until the website no longer functions or performs adequately. To test this capability, a user can utilize GUI 26 to create thousands of messages (i.e., user requests for online banking) and place them in a drag-and-drop fashion on a “play” composition screen of GUI 26. A user may then play the composition to test the capacity of the online banking service by pressing a single command button. By way of specific example, the composition may cause one request (in the form of a message to the on-line banking service) to be sent to the website in a first second of test operation, two requests the next second, three requests the third second, and so on, until performance begins to suffer appreciably, the service completely crashes, or some other problem caused by timing is discovered.
Login screen 27 is the first screen of GUI 26 seen by the user when the application is first invoked. Screen 27 is used to log onto the application by entering appropriate user identification (ID) and password information. After the user enters his user identification and password information into the login screen, the user may then access file manager 28.
File manager 28 enables the user to create, select, examine, modify, and execute a particular composition for execution on a target. In the course of so doing, the user may proceed from file manager 28 to any of the other editors/viewers including transition editor 29, composition editor 30, clip editor 31, target editor 33 and results viewer 34. Results viewer 34 visually presents information, values, and measurements obtained, generated or associated with one or more sessions of a composition. Basically, results viewer 34 is the module that informs the user—by a visual display of information on screen 20—of the performance and behavior of a server, and/or other addressees of electronic test message clips sent in the execution of one or more compositions.
The file manager user interface component provides a user with the ability to perform any one of a plurality of operations associated with the creation and execution of the composition comprising a plurality of parallel message streams. As described in more detail below, each message stream is organized in a track that includes a sequence of message clips. In one embodiment, the file manager user interface component has an administratively configured set of user privileges that control access to the operations by a given user.
In one embodiment, composition editor 30 comprises a module that allows a user to generate or edit a particular composition. In one embodiment, a composition consists of one or more parallel “tracks.” In the context of the present application, a “track” is an individual timeline or sequence of message clips that contains messages to be sent. Message clips may be placed in tracks to define their sequencing, timing, and dependencies. Parallel tracks in a composition may thus be divided into “bands”. The types of different bands include sequenced bands and time-based bands. A sequenced band contains sequenced message clips that are arranged to show the start-dependencies of the clips; that is, which clips must complete before another clip may be started. In contrast, a time-based band contains time-based message clips. These clips may be arranged on a time-scale to show when they are to be started, based upon the elapsed time from the start of the band. In one embodiment, a composition may contain any mixture or combination of sequenced and/or time-based bands, in any order. Typically, each band is completed before the next band starts.
An example of a composition layout that utilizes a combination of sequenced and time-based bands is an initial sequenced band that sends messages required to set up the test environment, followed by a time-based or sequenced band that performs the actual test, then followed by a final sequenced band that sends the messages required to terminate the test or clean-up after the test. For instance, if a user wanted to test a customer relations management system, setting up the test environment might first involve inserting all the customers needed to run the test. The test may then perform some operation on the customers, such as testing to see if their addresses could be changed. Finally, a clean-up operation after the test may involve removing all of the customers from the database.
In one embodiment, composition editor 30 enables a user to set the length of time of an execution of a composition, and to link a composition to other compositions, thereby permitting sequential, repetitive and/or simultaneous executions of one or more compositions (also referred to as “playlists”). Composition editor 30 thus allows a user to structure a composition to have one or more tracks and to structure one or more tracks to have one or more bands.
A specific implementation of composition editor 30 provides a user with the ability to add a new track and delete an existing track; to set a track's name, description, or tip text; to disable/enable a track; to define a new band and delete an existing band; to add a new message clip (linked, embedded or created “on-the-fly”); to delete an existing message clip; to move an existing message clip to a different location within a track, or to a different track; to adjust the size of an existing message clip; to randomize or otherwise modify the timing of an existing clip; to edit an existing message clip (drills into the clip editor); to change the displayed name, tip text, description, or thumbnail image of an existing message clip; and to cut/copy/paste tracks and message clips.
Compositions may be stored in whole or in part in the system memory 18 and/or the computer readable media 14. The user may add message clips to bands using computer mouse 23 by dragging and dropping icons onto band icons as described below in reference to
The user may move from composition editor 30 to message clip editor 31 or message editor 32 utilizing the GUI described herein. Message editor 32 is utilized by a user to generate or edit/modify messages. In the context of the present application, a “message” generally refers to a unit of data that can be sent via an electronics communications network, e.g., network 218, to another computational or communications system or device, e.g., to server 206 or 208. By way of example, a message could represent a communication sent to a queuing system, a REST call, or a HTTP request. A message could also be instantiated entirely or partially as a single operation, such as a web service call in any one of a variety of forms, e.g., XML, JMS, HTML, JSON, etc.
Message clips comprise a set of one or more messages that includes a specification of the timing and/or dependencies within that set of messages. In one embodiment, message clips may be shared by multiple compositions. Time-based execution delays may be built into a message clip, wherein two messages may be instantiated at different start times, as gauged from a start time of the message clip. It is also possible to create a dependent group of messages within the time-based clips that specifies that the first message in the group is to be sent at a specified time, but the remaining messages in the group are then to be sent one at a time only after a prior message has completed. The instantiation of messages within a message clip may be sequentially organized with dependencies, wherein one or more messages are not instantiated until one or more other messages within message clip have been executed.
A “transition” may optionally be inserted between each message. In the context of the present application a “transition” generally refers to a set of specified actions to be taken between the prior and the next message. Transitions may also be specified to execute upon certain events, such as “start of Track”, “start of Clip”, “failure of Message send”, and so forth. A transition can be associated with a specific message. In one implementation, transition editor 29 allows a user to encode transitions that specify conditional actions to be taken between two message clips; that is, the actions are taken or executed between two message clips only when certain events or conditions occur. Transition editor 29 may also be used to edit properties, values or qualities of a message or a message clip. Transition editor 29 may also be used to write to log files, run JAVA code, etc.
Target editor 33 may be utilized to provide message clips with addresses to which message clips will attempt to communicate, and also to provide information about the allowable formatting of the data to be sent. A target is an item in the repository that represents the identity of a type of external application or system to which messages can be sent, such as a web service, a network address, a SOA service, a message queue, one or more servers (e.g., a Web Server), or any other type of computational or communications system or device that a user desires to test and/or demonstrate. A target may be defined as having multiple instances. A “target location” is the definition of a particular instance of a target, such as a specific individual implementation of a Web Service. The target location contains a complete specification of the physical location of an implementation of a target so that message streams can be sent to that target. The various locations of a particular target may be defined and edited using a target editor GUI. Note that in one embodiment target locations are defined for each target; that is, the location is part of the target—target locations are not independent items in the repository.
Message clip editor 31 is a portion or page of the GUI that allows a user to create and edit message clips. Messages may be presented in multiple ways. In addition, a user may switch among different views of a clip while viewing or editing it. For example, one view of a message clip may show messages within a clip according to the order in which they are to be sent. For time-based clips, the start time of each message may be displayed with numbers above the message. For sequenced clips, no times are shown, and the display illustrates dependencies (which messages must be sent before the next message may be sent). When nested clips are shown within the clip, the size of the nested clip may be the same size as the size of an individual message.
In one implementation, message clip views provide a way to create and edit the name of a clip; an optional description text (which may contain any text the user desires); an optional tip text line (a single line of text that is shown when the user is choosing from lists of clips elsewhere in the system); and an optional thumbnail image (i.e., an image used for display purposes when the clip is shown in other displays, such as the composition editor 30). Message clip editor 31 also allows user to add a new target/location pair, i.e., the destination of the message; delete an existing target/location pair; pick a different location for an existing target/location pair; change the local name for an existing target/location pair; and replace an existing target/location pair with a different target/location pair.
Workspace 41 also contains a left-hand side navigator menu area 42, with menu items such as “Preferences,” “Repository,” “Compositions,” etc. Clicking on an item in the list shows some sort of summary display (on the right-hand side of the window) appropriate to the item type. Operations on items may be performed through the summary display on the right-hand side of workspace 41. Thus, a user may select from individual menu items in menu area 42 to open a new page in the GUI. Note that in the described embodiment, the repository items seen by a user depends upon their administratively assigned privileges/permissions. Administrators can see all items
The example of
A “Composition Summary” area 44 for “Composition 3” is also provided. Summary area 44 indicates the state of a selected composition state (i.e., “failed”), and may include specifics such as start time, a total time it took to play the composition, the number of messages and transitions within the composition, and other information.
Messages may be any type of electronic message. For example, message 51 may comprise instructions to log into a particular web service. Message 52 might comprise an instruction such as “add a customer whose name is Benjamin and whose email address is email@example.com.” Message 53 might comprise an instruction such as “fetch me the customer name Benjamin” (to test whether the user gets the name back, as he should if the system is working properly), and so forth. Messages are visually defined using the GUI in the order the user specifies them to be sent. Once defined, messages may be saved as a reproducible composition which may be played and replayed. In the above example, the web service being tested by the composition either succeeds or fails accordingly.
In addition, message clips placed in a composition may be linked. When a user places a message clip within a composition, he may simply refer to it by name (i.e., if a particular message clip has already been created and a user would like to use the same message clip). If this message clip is changed by user, then anyone who subsequently uses this same message clip by name in a composition sees that change. Such a message clip is called a linked message clip. The composition may point to or select a message clip by name in order to have it played. An icon may be used to let a user know of a particular message clip within a composition is linked or embedded.
A user may also utilize message clips within other message clips in a nested fashion, such as message clip 58, which is another message clip being included within message clip 50. Nested message clips allow a user to reuse message clips within other message clips. Clips can also be used multiple times by placing a clip icon in a track multiple times. Nested Clips may be used to build up re-usable units of work based on smaller units.
Message clip editor 31 may be used to edit message clips such as those illustrated in
In the time-based message clips of
Control panel area 74 contains a set of arrows 75 that allow a user to play a composition, to backtrack to an earlier portion of composition, and/or fast forward to a part of the composition that has not yet been played. A user may browse and edit a composition using Resource and Clip Editor buttons 92 & 93, respectively, shown at the right-hand side of control panel area 74. A continuous play button 90 in control panel area 74 allows a user to play the composition over and over again. A digital clock (shown just to the right of button 90) may optionally be included in control panel field 74 to track elapsed time since the beginning of the composition. In this example, 31 minutes and 15 seconds have elapsed since the start of play. A portion of control panel area 74 also indicates how many messages have been sent since the start of play and at what speed messages are being played. According to the example illustrated by
In one implementation, one or more control buttons may be included that allow a user to change the speed at which messages are applied—in other words, to send messages to various destinations faster or slower than 1× speed. In addition, a special “goal seeking” command icon or button may be included to run a composition over and over, each time at a progressively faster pace and/or volume, until the target device (e.g., a server or application) fails or crashes. The point in the test where the target fails may be stored and visually displayed via the GUI in a report that includes statistics on the response time of the target under test. Such a feature is useful in determining the capacity or robustness of a particular target or target/location pair.
In the example of
Note that transitions may occur at various points in a message clip. For example, a transition 84 is shown occurring between icons 83 & 85; a transition 86 occurs between icons 85 and 87; and a transition 88 occurs between icons 87 & 89. A user may scroll to the left and right to see additional messages (not shown in this view) in T1 timed message clip 1. Although messages are illustrated being sent to Google and Yahoo servers in
A scroll button 94 in control panel area 74 allows a user to scroll the visual field of the user interface left or right. A view pull-down button 96 allows a user to view message clips in a variety of different ways. The view in
A user may edit message clips by clicking on various options provided in the navigator menu area. In this example, user has clicked on “Clip Builder” to make changes and/or create new messages and transitions within the T1 timed clip 1. A user who wants to create a new message in the T1 timed clip 1 may click on the musical note icon under the “New” heading in control panel field 74. A user may click on the gear wheel icon (under the musical note icon) to create a new transition. User may also click on “Targets” to change and/or edit the message targets (i.e., the Google and/or Yahoo servers) defined in T1 timed clip 1.
A user may also click on the “Properties” selection to change, edit or create message properties, which are name-value pairs. The user may specify that when a composition is played property values are to be substituted into messages before they are sent, and are to be extracted from message responses when they are received. For example, when the message represented by icon 81 to “create Account” is played, this message may take a data item that was returned from the operation and put it into a property for reuse later. For instance, the Google server may return an account number after receiving the message represented by icon 81 to “create Account” that may be placed in a property. Thereafter, the message represented by icon 82 to “update Account” reads that property and uses that data to determine which account to update. This property setting and retrieval can also involve simple value modification such as “MyInt+1”; or “CurrentDate.year;( )” or “MyString.last (5)”, or even pulling in values from environment variables or other external sources. Through control panel 74 the user may also specify that a script (or “macro”) may be executed before the message is sent and after the response is received. These scripts may also set and/or fetch these property values. In addition, transitions placed between messages in the clip may include scripts that fetch and set these property values.
In the example of
In the example of
In the embodiment illustrated by
The “outputs” section of the message editor is information that is expected to be received back from the server after the server receives the “create Account” message. A user could select the “account ID” of the “outputs” section and specify that it is to be placed into a property when the message response is received. For instance, after a user sends the “create Account” message to the Google server, the server may send an account ID for the new account holder back to the system, where it is stored in the “outputs” section of the message editor. The next sequenced message clip “update Account” may then extract the value in this property (e.g., account ID number) and send that value or data item in its message.
“Grid” button 155 and “XML” button 156 provide two different ways of viewing a particular message, e.g., “create Account”. A user may click on “XML” button 156 to view raw data. Alternatively, in the example of
In a control panel area 74 of
Transitions may comprise special logic between two messages in a message clip. For example, if a first message sent to a server requests an account ID from the server, and the account ID received back from the server is encrypted in a secret form that needs to be decrypted or transformed in some way in order to send in the next message, then a transition between these two message may include a script to decrypt or transform the account ID.
In the embodiment shown, a user may set values into properties (e.g., arithmetic computations) in a set properties field 101. A conditional splitter 102 allows a user to express “if-then-else” logical conditions. For instance, a script processor field 103 on the left side of the screen shot could be the “then” portion of the statement, with script processor fields 104 and 105 on the right side of the screen shot specifying the “else” portion. Nested transition field 106 may be used to execute a subroutine (i.e., a transition that calls another transition).
The example of
Practitioners in the art will appreciate that there are numerous events that may occur during the play out of a composition (e.g., composition starting, ending, a track starting, a clip starting, a clip failing, etc.). For each of these events, a user may use transition editor to specify a conditional transition to be executed when a specified event occurs. For instance, user may create a transition to be executed every time a particular message clip begins playing. Or, user may create a transition to be executed every time a particular message send fails.
If the composition is to be halted, then the test is stopped, i.e., the execution of the composition is ended (block 137). Alternatively, the composition may continue to be played (block 136), repeating the above steps of receiving results and monitoring for a failure. Additionally in block 136, performance statistics may be archived before continuing with the test. Eventually, the composition ends one way or another (block 137), after which time the results are archived in a report (block 138) and returned to user (block 139).
It should be understood that elements of the present invention may also be provided as a computer program product which may include a machine-readable medium having stored thereon instructions which may be used to program a computer (e.g., a processor or other electronic device) to perform a sequence of operations. Alternatively, the operations may be performed by a combination of hardware and software. The machine-readable medium may include, but is not limited to, floppy diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, magnet or optical cards, or other type of machine-readable medium suitable for storing electronic instructions.
Additionally, although the present invention has been described in conjunction with specific embodiments, numerous modifications and alterations are well within the scope of the present invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5724525 *||Mar 28, 1995||Mar 3, 1998||Scientific-Atlanta, Inc.||System and method for remotely selecting subscribers and controlling messages to subscribers in a cable television system|
|US5945986 *||May 19, 1997||Aug 31, 1999||University Of Illinois At Urbana-Champaign||Silent application state driven sound authoring system and method|
|US6025853 *||Mar 24, 1995||Feb 15, 2000||3Dlabs Inc. Ltd.||Integrated graphics subsystem with message-passing architecture|
|US6092043 *||Jun 26, 1997||Jul 18, 2000||Dragon Systems, Inc.||Apparatuses and method for training and operating speech recognition systems|
|US6134582 *||May 26, 1998||Oct 17, 2000||Microsoft Corporation||System and method for managing electronic mail messages using a client-based database|
|US6817010 *||Dec 27, 2000||Nov 9, 2004||International Business Machines Corporation||Monitoring messages during execution of a message flow|
|US6959013 *||Sep 24, 1999||Oct 25, 2005||Nokia Mobile Phones Limited||Communication network|
|US7376902 *||Feb 13, 2003||May 20, 2008||Sap Ag||User interface for alerts|
|US7464121 *||Jan 6, 2006||Dec 9, 2008||International Business Machines Corporation||Apparatus for sending a sequence of asynchronous messages to the same member of a clustered consumer|
|US7478035 *||Oct 31, 2000||Jan 13, 2009||Eclarity, Inc.||Verbal classification system for the efficient sending and receiving of information|
|US7594238 *||Dec 1, 2004||Sep 22, 2009||Fujitsu Limited||Apparatus and method for displaying plurality of messages in groups to reduce burden on operators|
|US7607169 *||Dec 2, 2002||Oct 20, 2009||Arcsight, Inc.||User interface for network security console|
|US7689455 *||May 16, 2005||Mar 30, 2010||Olista Ltd.||Analyzing and detecting anomalies in data records using artificial intelligence|
|US7693947 *||Jun 9, 2006||Apr 6, 2010||Mcafee, Inc.||Systems and methods for graphically displaying messaging traffic|
|US20080066009 *||Aug 14, 2006||Mar 13, 2008||Soasta, Inc.||Visual test automation tool for message-based applications, web applications and SOA systems|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8140986 *||Sep 27, 2007||Mar 20, 2012||International Business Machines Corporation||Generating test scenarios using reusable triggers indicating graphical user interface (GUI) elements and actions|
|US8306195 *||Nov 15, 2010||Nov 6, 2012||Soasta, Inc.||Visual test automation tool for message-based applications, web applications and SOA systems|
|US8341462||Jul 19, 2010||Dec 25, 2012||Soasta, Inc.||System and method for provisioning and running a cross-cloud test grid|
|US9021362||Mar 14, 2013||Apr 28, 2015||Soasta, Inc.||Real-time analytics of web performance using actual user measurements|
|US9142253 *||Jun 8, 2007||Sep 22, 2015||Apple Inc.||Associating keywords to media|
|US9154611||Mar 30, 2012||Oct 6, 2015||Soasta, Inc.||Functional test automation for gesture-based mobile applications|
|US9229842||Jun 8, 2012||Jan 5, 2016||Soasta, Inc.||Active waterfall charts for continuous, real-time visualization of website performance data|
|US9251035||Feb 9, 2012||Feb 2, 2016||Soasta, Inc.||Load test charts with standard deviation and percentile statistics|
|US9436579||Jul 19, 2010||Sep 6, 2016||Soasta, Inc.||Real-time, multi-tier load test results aggregation|
|US9450834 *||Oct 1, 2013||Sep 20, 2016||Soasta, Inc.||Animated globe showing real-time web user performance measurements|
|US9495473||Nov 18, 2010||Nov 15, 2016||Soasta, Inc.||Analytic dashboard with user interface for producing a single chart statistical correlation from source and target charts during a load test|
|US20080155459 *||Jun 8, 2007||Jun 26, 2008||Apple Inc.||Associating keywords to media|
|US20080190266 *||Feb 6, 2008||Aug 14, 2008||Samsung Electronics Co. Ltd.||Method and terminal for playing and displaying music|
|US20090089688 *||Sep 27, 2007||Apr 2, 2009||International Business Machines Corporation||Generating test scenarios using reusable triggers indicating graphical user interface (gui) elements and actions|
|US20110066892 *||Nov 15, 2010||Mar 17, 2011||Soasta, Inc.||Visual test automation tool for message-based applications, web applications and SOA systems|
|US20120246515 *||Mar 21, 2012||Sep 27, 2012||Janova LLC||Scalable testing tool for graphical user interfaces object oriented system and method|
|US20130097307 *||Oct 18, 2011||Apr 18, 2013||Soasta, Inc.||Session template packages for automated load testing|
|US20140033055 *||Oct 1, 2013||Jan 30, 2014||Soasta, Inc.||Animated Globe Showing Real-Time Web User Performance Measurements|
|US20150356001 *||Aug 4, 2014||Dec 10, 2015||Ebay Inc.||Unit test automation for business rules and applications|
|USD691167||Nov 25, 2012||Oct 8, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD691168||Nov 25, 2012||Oct 8, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692451||Nov 25, 2012||Oct 29, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692452||Nov 25, 2012||Oct 29, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692453||Nov 25, 2012||Oct 29, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692454||Nov 25, 2012||Oct 29, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692911||Nov 25, 2012||Nov 5, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD692912||Nov 25, 2012||Nov 5, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD693845||Nov 26, 2012||Nov 19, 2013||Mcafee, Inc.||Computer having graphical user interface|
|USD722613||Jan 18, 2013||Feb 17, 2015||Mcafee Inc.||Computer display screen with graphical user interface|
|USD772288 *||May 13, 2015||Nov 22, 2016||Vixlet LLC||Display screen with computer icons|
|USD772928||May 13, 2015||Nov 29, 2016||Vixlet LLC||Display screen with computer icons|
|USD775198 *||May 13, 2015||Dec 27, 2016||Vixlet LLC||Display screen with icons|
|U.S. Classification||379/88.08, 715/752, 709/206, 715/809|
|Cooperative Classification||G06F11/3414, H04L41/22, G06F11/3684, G06F11/3664, H04L12/2697, G06F11/3495, H04L43/50, G06F11/3688, H04L41/0253, G06F8/34|
|European Classification||H04L12/26T, G06F11/36E, G06F11/34C2, G06F11/36T2D, G06F11/36T2E, G06F8/34, H04L41/02G1, H04L43/50|
|Aug 14, 2006||AS||Assignment|
Owner name: SOASTA, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GARDNER, KENNETH C.;POWERS, CRAIG R.;HOLCOMB, ROBERT CHARLES;AND OTHERS;REEL/FRAME:018181/0700;SIGNING DATES FROM 20060811 TO 20060812
Owner name: SOASTA, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GARDNER, KENNETH C.;POWERS, CRAIG R.;HOLCOMB, ROBERT CHARLES;AND OTHERS;SIGNING DATES FROM 20060811 TO 20060812;REEL/FRAME:018181/0700
|May 30, 2014||FPAY||Fee payment|
Year of fee payment: 4