WO2006133218A2 - Asp for web analytics including a real-time segmentation workbench - Google Patents

Asp for web analytics including a real-time segmentation workbench Download PDF

Info

Publication number
WO2006133218A2
WO2006133218A2 PCT/US2006/021977 US2006021977W WO2006133218A2 WO 2006133218 A2 WO2006133218 A2 WO 2006133218A2 US 2006021977 W US2006021977 W US 2006021977W WO 2006133218 A2 WO2006133218 A2 WO 2006133218A2
Authority
WO
WIPO (PCT)
Prior art keywords
web analytics
data
service provider
application service
client
Prior art date
Application number
PCT/US2006/021977
Other languages
French (fr)
Other versions
WO2006133218A3 (en
Inventor
Brett Michael Error
Original Assignee
Omniture, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omniture, Inc. filed Critical Omniture, Inc.
Priority to JP2008514974A priority Critical patent/JP2008546105A/en
Priority to EP06772335A priority patent/EP1894121A4/en
Priority to AU2006255068A priority patent/AU2006255068A1/en
Priority to CA002610953A priority patent/CA2610953A1/en
Publication of WO2006133218A2 publication Critical patent/WO2006133218A2/en
Publication of WO2006133218A3 publication Critical patent/WO2006133218A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising

Definitions

  • This invention relates generally to systems and methods for web analytics.
  • the present invention relates to an application service provider system and methods for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis.
  • Web analytics refers to the analysis of data created by website usage. For instance, web analytics can be used to mine visitor traffic data. A variety of visitor traffic data is measured such as what browser is being used, what links on a given web page were selected, whether a product was purchase, etc. There are number of web analytics tools presently available such as Site Catalyst version 11 from Omniture of Orem, Utah. These tools are able to capture data on website usage, and responsive to a user's request display a variety of different metrics on website usage such fallout/conversion, A/B testing, etc. [0004] One prior art method for presenting web analytics data to the user is on-line reporting.
  • on-line reporting can provide data at relatively high speeds and has some presentation flexibility using an HTML format, it significantly limits the data that is available to the user.
  • the data is provided by extracting data from a database using in a set number of pre-defined reports.
  • the user's ability to segregate the data, produce different reports, and look at the data with different combinations of metrics is severely limited.
  • the problem with such on-line systems is that the user does not have the flexibility to get the data they desire and based on different slices of a metric.
  • Another method for presenting web traffic data to the user is by providing access to the data warehouse or database.
  • Such an approach gives the user the ability to slice and manipulate the data as they desire to provide the reports that are most valuable to them.
  • Such direct access also provides them with the flexibility to answer any question about the data presented, such system are typically very complex and difficult to use.
  • a non-technical user cannot interact, query and generated the reports needed.
  • business users work with a database programmer to extract and format the data as needed from the data warehouses.
  • such systems can be slow when there are many users trying to access the same date warehouse.
  • the system of the present invention provides an application service provider system for retrieving and displaying web analytic data, or segmentation workbench.
  • the present invention preferably comprises a server and several client computing devices.
  • the server includes a web analytics tool.
  • Each of the clients preferably includes a web analytics client for communication with the server.
  • This architecture is particularly advantageous because the users are able to have rich functionality of a web analytics tool including the segmentation workbench and access to the data in real time.
  • the application service provider system is architecture allows web analytics service to be provided to users with an application service provider where the web traffic information for different users can be segregated and share a single server while communicating with different clients of different user companies.
  • the present invention also includes a number of methods for retrieving and presenting web analytics data.
  • Figure 1 is a block diagram of a first embodiment of a system for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis according to the present invention.
  • Figure 2 is a block diagram of a second embodiment of an exemplary embodiment of the system for providing a segmentation workbench on a real-time basis in a client/server architecture.
  • Figure 3 is a block diagram of a third embodiment of a system for providing a segmentation workbench for web analytics according to the present invention.
  • Figure 4 is a block diagram of a preferred embodiment of a workbench network according to the present invention.
  • Figure 5 is a diagram of the data relationships and their presentation by the segmentation workbench.
  • Figure 6 illustrates an exemplary embodiment for a workbench tool bar.
  • Figure 7 A to 7V are exemplary graphical user interfaces provided by the segmentation workbench of the present invention.
  • the present invention provides an application service provider model for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis.
  • the present invention advantageously combines the best features of on-line reporting systems and direct access to data warehouse with an application service provider segmentation workbench that: 1) provides fast access to the data in real time, 2) is easy for the user to manipulate and filter the data, and 3) is flexible and allows the user to present the data in numerous desired formats.
  • a segmentation workbench system 100 of the present invention providing web analytics analysis capability using a first computing device 102 and a second computing device 104 is shown in Figure 1.
  • the system 100 preferably includes a first computing device 102, a network 104 and a second computing device 106.
  • the present invention will now be described in the context of a single first computing device 102 communicating with a single second computing device 106 for ease of understanding and convenience; however, a more typical application may be first computing device 102 communicating with many second computing devices 106.
  • the present invention provides a web analytics tool with flexibility and speed that operates using the network 104, the first computing device 102 and the second computing device 106.
  • the first computing device 102 is a conventional computing device such as a server and includes a connection to the network via line 110 and is capable of executing various programs such as the present invention.
  • the first computing device 102 preferably includes storage devices for temporary and permanent storage such as memory and hard disk drive arrays.
  • the first computing device 102 includes applications, programs and other code executable on the first computing device 102.
  • the computing device 102 preferably includes a web analytics tool 112 and operates as a web server for web analytics and reporting for providing data from a data set representing interaction with web pages such as SiteCatlyst V.I 1 provided by Omniture of Orem, Utah.
  • the web analytics tool 112 also includes a segmentation workbench; the functionality it provides, the user interfaces it generates and its operation in disclosed in detail below. When operating on the first computing device 102 these tools provide data to the second computing device 106 for presentation to the user. An exemplary display of such information by the second computing device 106 is shown below with reference to Figures 5 et seq.
  • the network 104 is any one of a conventional type such as the Internet, a local area network (LAN), wireless network, or a wide area network (WAN).
  • the network has predefined protocols for sending packets of data between devices coupled to the network 104.
  • the network 104 may be of any conventional types and have any one of various topologies.
  • the second computing device 106 is a conventional computing device such as a personal computer, but also includes programs or code providing the segmentation workbench capability of the present invention.
  • the second computing device 106 includes a web analytics client 114 responsive to the web analytics tool 112 of the first computing device 202 and user input to meet the web analytics and reporting needs of the user.
  • Figure 2 illustrates how the present invention may be used in a client/server architecture to optimize the communication between a server 202 and several client computing devices 1-n 206a-206n.
  • the present invention preferably uses an application service provider system 204 to provide the web analytics functionality. While only a single server 202 is shown, the application service provider system 204 could include a plurality of web servers, various other servers and backend architectures to provide the web analytics functionality according to an application service provider model.
  • the server 202 preferably comprises a web analytics tool 212 similar to that of Figure 1. With multiple client computing devices 206a-206n, the network connections of each greatly increase the amount of data that must be transferred.
  • Each of the clients 206a-206n preferably includes a web analytics client 214 for communication with the server 202.
  • This architecture is particularly advantageous because the users are able to have rich functionality of a web analytics tool and access to the data in real time. Moreover, this architecture allows web analytics service to be provided to users with an application service provider where the web traffic information for different users can be segregated and share a single server while communicating with different clients of different user companies. The architecture that supports this model is described in more detail below.
  • FIG 3 there is shown an example architecture 300 for practicing the present invention according to the third embodiment.
  • One skilled in the art will recognize that the invention can be practiced using other embodiments that differ from the examples shown.
  • Workbench Java client 301 runs on a personal computer 106/206 for viewing and interacting with website usage reports. Client 301 sends reports to display 307 (or other output device) for output to the user.
  • Workbench network 302 is a centralized network for handling and responding to client requests for data on website usage.
  • the user interface is implemented using a known environment such as Macromedia Flex, Java, DHTML, or any combination thereof.
  • the components shown in Figure 3 operate as follows.
  • workbench Java client 301 sends query 303 to network 302, specifying which reports are requested, and optionally specifying one or more filters for the reports.
  • query 303 is in XML format.
  • hashed data 304 that contains an encoded representation of the report data.
  • hashed data 304 may specify, in hash coded terms, the number of visitors that were using a specific web browser and that visited the website within a specified time period. This hashed data 304 is received by client 301.
  • Client 301 stores, in local cache 309, a list of previously received and decoded hash codes, so that it can correctly interpret a hash code that it has encountered previously, hi one embodiment, local cache 309 is cleared at the end of a session, so that only those codes previously received in the same session are stored in cache 309. In other embodiments, local cache 309 is implemented in a more persistent or less persistent fashion, depending on user needs.
  • client 301 Upon receiving hashed data 304, client 301 consults cache 309; if cache 309 contains the hash code(s) in data 304 (in other words, if client 301 has previously received data containing the same hash code), client 301 can interpret the meaning of the hash-coded data without any further communication with network 302. If hash code(s) from data 304 is/are not present in cache 309, client 301 sends hash query 305 to network 302; network 302 responds by sending hash translation 306 to client 301. Hash translation 306 provides client 301 with the meaning of hash terms (for example, specifying that hash term #299 signifies a user using Internet Explorer 6.0). In one embodiment, client 301 stores this meaning in cache 309 for future use.
  • cache 309 contains the hash code(s) in data 304 (in other words, if client 301 has previously received data containing the same hash code), client 301 can interpret the meaning of the hash-coded data without any further communication with network
  • client 301 Once client 301 has received sufficient data to generate a report, it sends a report 308 to display 307 for output to the user. In one embodiment, if some hash meanings have not yet been received, client 301 still sends report 308, and report 308 states that certain hash terms are unknown. In another embodiment, client 301 displays an error message and/or waits until more complete hash meaning data is available.
  • the user can interact with the displayed report 308 via user input device 330 such as a mouse, keyboard, or the like.
  • user input device 330 such as a mouse, keyboard, or the like.
  • the user can click on areas within report 308; when the user clicks on an area that can be interpreted as a filter, client 301 generates and sends a new query 303 containing the new report filter criteria.
  • the above process then repeats, and an updated report 308 is sent to display 307.
  • Network 302 includes any number of front-end web servers 401 that receive queries 303, 305 from client 301, and any number of back-end servers 402 that obtain data from storage, analyze the obtained data, and send report data back to client 301.
  • Back-end servers 402 send an appropriate data set to client 301 based on the filter request. For example, if a filter request specifies that the user is only interested in visitors that used a particular web browser, back-end servers 402 remove the data that does not match the specified criterion, and only forward to client 301 the data that does match.
  • back-end servers 402 are applying a movable filter bar to the data set, maintaining consistency in the views into the data while changing the size of the data set according to the filter request.
  • Database 403 contains website visitation data, which in one embodiment is stored in a binary format stored in some storage medium such as a hard drive. Li one embodiment, the website visitation data is broken up into files, or "bricks", to facilitate extraction of portions of the data. When servers 402 extract data from database 403, they are provided with specific bricks that match the criteria.
  • back-end servers 402 extract data from database 403 that contains web visitation logs and/or statistics
  • servers 402 obtain data from database 403 that represents a snapshot of website visitation over a specified time period.
  • Servers 402 then store this website visitation data in temporary local storage (such as random access memory), using for example a binary format that is encoded according to a hash algorithm so as to minimize bandwidth usage.
  • this binary format is identical to the format used in database 403, so that no file format translation need be performed when servers 402 extract data from database 403. Servers 402 and then apply filters as requested, and send the filtered data to client 301.
  • back-end servers 402 whenever the user requests a broader date range for website visitation data, back-end servers 402 perform a new data extraction from database 403. However, when the user narrows the date range from a previously specified range, no new data extraction is performed; rather back-end servers 402 filter the previously extracted data according to the new filter parameters.
  • the segmentation workbench allows users to mine sampled Data Warehouse data in real-time.
  • the segmentation workbench provides a fast, responsive way for users to perform advanced analysis on data warehouse-style data via a graphical user interface. Users can launch various pre-packaged reports onto a single workspace and easily click on any data item to filter the entire result set by that item. This allows users to quickly answer questions such as "What were the top referrers that drove visits in which the user purchased Item X or Item Y and viewed the Clearance Sale page?" The results are returned almost instantaneously, enabling users to analyze the effects of combinations of factors.
  • the basic functionality provided by the segmentation workbench is to allow users select various reports, add items to the filter from within those reports, and quickly see the resulting change based on this virtual "WHERE" clause.
  • the web analytics tool provides Page View, Visit and Visitor groupings that support the virtual "WHERE” clauses. All dimensions (Browsers, Products, etc.) technically offer the visit, visitor (hourly, daily, weekly, monthly, quarterly, yearly) and page view metrics, as well as the commerce metrics.
  • the workbench supports various dimensions and metric, example of which are provided in Appendix A and B, respectively.
  • a particular advantage of the segmentation workbench is that it is able to return a response to a query or change to a report in real-time using sampled data from the data warehouse.
  • real-time we refer here to the ability of the segmentation workbench to gather and display results within seconds for most filters, more specifically within 2 to 3 seconds.
  • segmentation workbench is presentation of data as well as making it downloadable.
  • the workbench allows the user to download the Segmentation Workbench results in the standard download formats (currently HTML, PDF, RTF, Excel, CSV), at the window level, hi one embodiment, a reportlet is downloadable in all of the standard download formats. The downloaded report shows the filter and data set information.
  • the workbench also provides for PDF download of the workbench canvas (WYSIWYG) or a download of the workbench canvas to a spreadsheet where each report window is a different worksheet.
  • Figure 5 is a high level overview of the data relationships and their presentation by the segmentation workbench.
  • a user can select any available report from the Reports menu, which launches a report window on the workbench "canvas.” The user can also right-click at any time on the canvas to launch the Reports menu. When a report is launched, a mini version of that report is immediately displayed. The report window displays the default metric(s), and the data will be sorted by that metric, the system 300 defaults to visits. The user can customize the Default metric in the canvas Display Options, and even set them on a per-report basis. The user can change the metric(s) and add additional metrics (up to 10). The default number of data rows shown is 10, but the user can adjust this in the canvas Display Options.
  • the reports are provided in windows or containers that have functionality similar to common windows.
  • the reports include the ability to drag edges to change the height and width; ability to minimize, delete, and maximize; ability to reposition/rearrange windows on the canvas by dragging the window title bar.
  • the reports include: functionality to allow the user to drag the column margins to resize column width, data shown in the reports always reflects the current filter; and resizing or moving saves state, such that if the user does a hard refresh on the browser, the canvas looks the same.
  • the workbench also allows the creation of custom reports.
  • the workbench creates a "custom" report that allows the user to build a custom report with Date, Metric and Dimension axis (similar to Data Extract or the Excel Client Data Blocks).
  • the workbench allows the user to switch between these reports or views, by providing a series of icons as will be shown in the drawings for switching between any of the views.
  • the present invention In addition to the concept of a workbench canvas, the present invention also maintains a corresponding project.
  • a user saves a project the data set, filters, reports, and canvas appearance are all preserved.
  • a user opens a saved project everything should look exactly as he left it. For example, if a user loaded data in January 2005, then on January 15 saved the project, and then opened that project again on Jan 18...in this case, the data set is technically different. The user is either warned that the user cannot specify a data set date range that includes time in the future or the workbench loads data up through January 18, and warns the user that data shown has changed because more data was added to the data set.
  • the workbench auto-saves the project every 5 minutes.
  • the user can customize this auto-save frequency. Also, this can be combined with a limited versioning system, such that users could theoretically "undo" changes to the last version.
  • the workbench ever ends a session with the user (due to inactivity), it first saves everything as-is so that next time the user can begin where he left off. If the user has been inactive in a workbench for 15 minutes, the application prompts the user, asking him if he wants to continue to use the workbench. If the user doesn't respond to the prompt within 5 minutes, then the application saves the project for the user to access later, and will free up the workbench slot. The application updates the display, indicating that it prompted the user and did not receive a response, so it saved the project and has closed the workbench.
  • the canvas also enables the workbench canvas to provide user definable data filters.
  • the workbench allows the user to apply two types of canvas filters: date and segment.
  • the user can filter the data by date, and the workbench preferably allows the user selects several different over-time or trended reports. The default is to force the same level of granularity for all reports.
  • the user can also customize the granularity on a per-report basis.
  • the user can filter the data by segment. Using tools such as a segment builder interface as described in co-pending U.S. Patent Application No.
  • the user can create segment definition for grouping and filtering the data.
  • the workbench allows the user to select a segment to be used in filtering - e.g., a user can click on the funnel icon next to an element, which automatically adds that element to the filter.
  • the funnel icon is a toggle switch to add-to-filter or remove-from-filter. Right- clicking on the funnel icon will show an options menu that allows the user to choose functional options such as Change to "AND,” Change to "OR, or "Remove from filter”
  • the workbench allows the user to set the sampling rate for the raw data that is used to generate the data warehouse or set used by the workbench.
  • the workbench interface can be combined with other user interfaces provided by the web analytics tool 112/212 such as also the Data Warehouse interface.
  • the workbench also the user to "Undo" actions or versions as was briefly noted above.
  • the workbench also the user to store their working environment. The user can save everything associated with the workbench view - including report suite, date range, sample rate, etc.
  • Figure 6 illustrates a diagram of exemplary embodiment for a workbench tool bar that can be added to other user interfaces, and that also shows the screens or interfaces that the user transitions to based on selection of the buttons in the workbench tool bar.
  • Figure 7A to TV exemplary graphical user interfaces provided by the segmentation workbench of the present invention will be shown and described.
  • Figure 7 A is a graphical user interface that is displayed in response to the data warehouse tab.
  • Figure 7B is a graphical user interface that is displayed if the user does not have a license and is not an administrator.
  • the user interface directs the user to contact their local administrator to find out about the workbench service.
  • Figure 7C is a graphical user interface that is displayed if the user has a license. The purpose of this page is to explain to first-time users what the workbench is, and allow them to transition into using it.
  • Figure 7D is a graphical user interface that is displayed if the user has workbench license, but no servers are available (concurrent license model only).
  • the web analytics tool 112/212 continues to reserve the user's place in the queue as long as they remain on this page. If the user wants to leave this page and continue to remain in the queue, the web analytics tool 112/212 reserves the user's place and simply notifies the user via email when a workbench becomes available for use. This allows the user to leave this page or even log out of web analytics tool 112/212.
  • the web analytics tool 112/212 sends the availability notification, an example of which is shown in Figure 7E, and workbench reserves my login for 15 minutes. If the user does not access the workbench within those 15 minutes, the workbench will become available for others to use.
  • Figure 7F is a graphical user interface that is displayed if the user has workbench license, but no servers are available (dedicated user license model only). If the user is an administrator, he can see the session length for each of the current workbench users. If the user is an administrator, when he moves the cursor over the user names, a tooltip will display the user's company if the company differs from the one he's currently logged into. The status bar could just be an animated gif that takes a predetermined time to fill. Every predetermined time, the page will refresh and the status bar will continue to fill.
  • Figure 7 G is a graphical user interface that is displayed if actually has access to both license models but there are no servers available in either group (highly unlikely scenario).
  • Figure 7H is a graphical user interface that is displayed where the user has workbench user license and server is available, but the user doesn't have any existing projects (all first-time users).
  • the user interface provides load time estimates / recommendations on this screen.
  • Figure 71 is a graphical user interface that is displayed where the user has workbench user license, a server is available, and the user has existing projects. If a user has an existing project, the workbench defaults to the "load last project” option, since it's highly likely they'll want to continue where they left off. If the workbench detects that the user left last time without saving his final changes, then the "Open last auto-saved project version” option is displayed. If the user saved his final changes, then that "Open last auto-saved" option should be replaced with: "Open most recent project: [project name]”.
  • Figure 7J is a graphical user interface that is displayed when the workbench data is being loaded.
  • Figure 7K is a graphical user interface for a blank workbench canvas. Until at least a single report and at least a single filter is applied, the "To begin" text is be displayed by the user interface. Once a report and filter are applied, the "To begin" text either disappears or changes to a dark color. To begin using the workbench, the user selects reports by clicking on the Reports button above to launch the Reports palette, or right-click anywhere on this canvas. Then the user clicks on the Filter button above to apply date or segment filters to your report data.
  • Figure 7L is a graphical user interface for a blank workbench canvas with different parts of the workbench canvas parts labeled. This illustrates the main functional components of the workbench.
  • the Workbench toolbar allows a number of operations including: Create new project, Open existing project, Save project, Print canvas, Download canvas (for example in PDF or Excel), Display Options (with default number of rows and metrics), Help, Clear canvas, Update canvas.
  • An Auto-update option enabled means that clicking on the filter icons (the "funnels") takes effect immediately. If the auto-update option is disabled, then the user can click on several filter icons, and the hit the "Update” button for all changes to take effect at once. The default is to "Auto-update”.
  • An example user interface for the Auto update functionality is shown in Figure 7M.
  • Figure 7N is a graphical representation of an exemplary user interface for reports.
  • the report windows general components including: Tabs to select views, a Toolbar, an Options section (yellow subheader in the online reports), Graphs and Tables.
  • the user can customize the report window with Dashboard functionality to show or hide graph, table, etc.
  • the user can click the "x" to remove any section where applicable.
  • To get the section back the user can right-click within the window and choose "Show Graph", "Show Details Table", etc.
  • the user can click on a "Display Options" icon in the report window toolbar. It is possible for a user to remove all sections and have an "empty" report window.
  • the report window is empty, then text appears that instructs the user on how to display sections (similar to the canvas behavior on start-up).
  • the active window is shown in a visually distinct manner such as in a Different window color, with brighter icons and controls, or bold in the report list in the header.
  • Segment Builder launches or comes into focus. If a user clicks on the date filter text, then the calendar palette launches or comes into focus. If a user clicks on any of the reports listed, then that report comes into focus. Windows don't change size unless the user specifically resizes them. Scrollbars will appear where needed.
  • Figure 70 is a graphical representation of an exemplary user interface for reports with the reports menu open. The user can right-click anywhere on the canvas to select the desired report.
  • Figure 7P is a graphical representation of an exemplary user interface for the date filter.
  • the Range tab is similar to the standard calendar, except the "Run Report” button text will display "Apply Date”.
  • Figure 7Q is a graphical representation of an exemplary user interface for the segmentation filter.
  • the "Apply Segment” button applies whatever is currently shown in this palette when selected. So, for example, the user can actually clear any active segment filter by clearing the canvas in the builder and then clicking "Apply Segment”.
  • Figure 7R is a graphical representation of an exemplary user interface for the metric selector popup window. Any of the applicable option selectors are available within the workbench. For example, the Ranked metric selector is shown. If the Trended view is supported, then the "Select Items to Trend" popup will need to be available, etc.
  • Figures 7S and 7T are a graphical representation of an exemplary user interface for the Save and Open dialogs windows.
  • Figure 7U is a graphical representation of an exemplary user interface for the Report window detail.
  • Figure 7V is a graphical representation of an exemplary user interface for a pop up window for setting the permissions or define a group.
  • Administrators can create groups that have access to the Segmentation Workbench. In this way, they can control who has access to which report suites for the workbench. Administrators can put certain people in the "concurrent licenses" group, and other people in the "shared cluster” group (assuming that the company has purchased some of both). If the company doesn't have licenses, then the Information Page option is listed.
  • back-end servers 402 may have a variety of topologies and arrangements. Variations upon and modifications to the preferred embodiments are provided for by the present invention.

Abstract

An application service provider system for retrieving and displaying web analytic data, or segmentation workbench, comprises a server and several client computing devices. The server includes a web analytics tool. Each of the clients preferably includes a web analytics client for communication with the server. The application service provider system is architecture allows web analytics service to be provided to users with an application service provider where the web traffic information for different users can be segregated and share a single server while communicating with different clients of different user companies. The present invention also includes a number of methods for retrieving and presenting web analytics data.

Description

ASP FOR WEB ANALYTICS INCLUDING A REAL-TIME SEGMENTATION WORKBENCH
Inventor:
Brett M. Error
CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of U.S. Provisional Application No.
60/688,167, filed June 6, 2005, entitled "ASP For Web Analytics Including A Real-Time Segmentation Workbench," by Brett M. Error, and U.S. Patent Application No. 11/422,129, filed June 5, 2006, entitled "ASP for Web Analytics Including a Real-Time Segmentation Workbench," by Brett M. Error, both of which are incorporated by reference in their entirety.
BACKGROUND OF THE INVENTION
Field of the Invention
[0002] This invention relates generally to systems and methods for web analytics.
More particularly, the present invention relates to an application service provider system and methods for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis.
Description of the Related Art
[0003] Web analytics refers to the analysis of data created by website usage. For instance, web analytics can be used to mine visitor traffic data. A variety of visitor traffic data is measured such as what browser is being used, what links on a given web page were selected, whether a product was purchase, etc. There are number of web analytics tools presently available such as Site Catalyst version 11 from Omniture of Orem, Utah. These tools are able to capture data on website usage, and responsive to a user's request display a variety of different metrics on website usage such fallout/conversion, A/B testing, etc. [0004] One prior art method for presenting web analytics data to the user is on-line reporting. While on-line reporting can provide data at relatively high speeds and has some presentation flexibility using an HTML format, it significantly limits the data that is available to the user. Typically, the data is provided by extracting data from a database using in a set number of pre-defined reports. The user's ability to segregate the data, produce different reports, and look at the data with different combinations of metrics is severely limited. Thus while the user is able to view data on web traffic, it is often not the data that is most valuable to the user. Therefore, the problem with such on-line systems is that the user does not have the flexibility to get the data they desire and based on different slices of a metric.
[0005] Another method for presenting web traffic data to the user is by providing access to the data warehouse or database. Such an approach gives the user the ability to slice and manipulate the data as they desire to provide the reports that are most valuable to them. Such direct access also provides them with the flexibility to answer any question about the data presented, such system are typically very complex and difficult to use. hi many cases, despite the availability of general database tools and user interfaces, a non-technical user cannot interact, query and generated the reports needed. Typically, business users work with a database programmer to extract and format the data as needed from the data warehouses. Moreover, such systems can be slow when there are many users trying to access the same date warehouse.
[0006] Thus, there is a need for an application service provider model for providing a segmentation workbench for manipulation and display of web traffic data that solves the above shortcomings of the prior art such as real-time delivery of data.
SUMMARY OF THE INVENTION
[0007] The system of the present invention provides an application service provider system for retrieving and displaying web analytic data, or segmentation workbench. The present invention preferably comprises a server and several client computing devices. The server includes a web analytics tool. Each of the clients preferably includes a web analytics client for communication with the server. This architecture is particularly advantageous because the users are able to have rich functionality of a web analytics tool including the segmentation workbench and access to the data in real time. The application service provider system is architecture allows web analytics service to be provided to users with an application service provider where the web traffic information for different users can be segregated and share a single server while communicating with different clients of different user companies. The present invention also includes a number of methods for retrieving and presenting web analytics data.
THE BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Figure 1 is a block diagram of a first embodiment of a system for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis according to the present invention.
[0009] Figure 2 is a block diagram of a second embodiment of an exemplary embodiment of the system for providing a segmentation workbench on a real-time basis in a client/server architecture.
[0010] Figure 3 is a block diagram of a third embodiment of a system for providing a segmentation workbench for web analytics according to the present invention.
[0011] Figure 4 is a block diagram of a preferred embodiment of a workbench network according to the present invention.
[0012] Figure 5 is a diagram of the data relationships and their presentation by the segmentation workbench.
[0013] Figure 6 illustrates an exemplary embodiment for a workbench tool bar.
[0014] Figure 7 A to 7V are exemplary graphical user interfaces provided by the segmentation workbench of the present invention.
DETAILED DESCRIPTION OF THE EMBODIMENTS
[0015] The present invention provides an application service provider model for providing a segmentation workbench for manipulation and display of web traffic data on a real-time basis. The present invention advantageously combines the best features of on-line reporting systems and direct access to data warehouse with an application service provider segmentation workbench that: 1) provides fast access to the data in real time, 2) is easy for the user to manipulate and filter the data, and 3) is flexible and allows the user to present the data in numerous desired formats. Basic System
[0016] A segmentation workbench system 100 of the present invention providing web analytics analysis capability using a first computing device 102 and a second computing device 104 is shown in Figure 1. The system 100 preferably includes a first computing device 102, a network 104 and a second computing device 106. The present invention will now be described in the context of a single first computing device 102 communicating with a single second computing device 106 for ease of understanding and convenience; however, a more typical application may be first computing device 102 communicating with many second computing devices 106. In general, the present invention provides a web analytics tool with flexibility and speed that operates using the network 104, the first computing device 102 and the second computing device 106.
[0017] The first computing device 102 is a conventional computing device such as a server and includes a connection to the network via line 110 and is capable of executing various programs such as the present invention. The first computing device 102 preferably includes storage devices for temporary and permanent storage such as memory and hard disk drive arrays. The first computing device 102 includes applications, programs and other code executable on the first computing device 102. The computing device 102 preferably includes a web analytics tool 112 and operates as a web server for web analytics and reporting for providing data from a data set representing interaction with web pages such as SiteCatlyst V.I 1 provided by Omniture of Orem, Utah. The web analytics tool 112 also includes a segmentation workbench; the functionality it provides, the user interfaces it generates and its operation in disclosed in detail below. When operating on the first computing device 102 these tools provide data to the second computing device 106 for presentation to the user. An exemplary display of such information by the second computing device 106 is shown below with reference to Figures 5 et seq.
[0018] The network 104 is any one of a conventional type such as the Internet, a local area network (LAN), wireless network, or a wide area network (WAN). The network has predefined protocols for sending packets of data between devices coupled to the network 104. The network 104 may be of any conventional types and have any one of various topologies. [0019] The second computing device 106 is a conventional computing device such as a personal computer, but also includes programs or code providing the segmentation workbench capability of the present invention. The second computing device 106 includes a web analytics client 114 responsive to the web analytics tool 112 of the first computing device 202 and user input to meet the web analytics and reporting needs of the user.
Client/Server Architecture
[0020] Referring now to Figure 2, a second embodiment of the present invention is shown. Figure 2 illustrates how the present invention may be used in a client/server architecture to optimize the communication between a server 202 and several client computing devices 1-n 206a-206n. The present invention preferably uses an application service provider system 204 to provide the web analytics functionality. While only a single server 202 is shown, the application service provider system 204 could include a plurality of web servers, various other servers and backend architectures to provide the web analytics functionality according to an application service provider model. The server 202 preferably comprises a web analytics tool 212 similar to that of Figure 1. With multiple client computing devices 206a-206n, the network connections of each greatly increase the amount of data that must be transferred. Each of the clients 206a-206n preferably includes a web analytics client 214 for communication with the server 202. This architecture is particularly advantageous because the users are able to have rich functionality of a web analytics tool and access to the data in real time. Moreover, this architecture allows web analytics service to be provided to users with an application service provider where the web traffic information for different users can be segregated and share a single server while communicating with different clients of different user companies. The architecture that supports this model is described in more detail below.
Application Service Provider Architecture
[0021] Referring now to Figure 3, there is shown an example architecture 300 for practicing the present invention according to the third embodiment. One skilled in the art will recognize that the invention can be practiced using other embodiments that differ from the examples shown.
[0022] Workbench Java client 301 runs on a personal computer 106/206 for viewing and interacting with website usage reports. Client 301 sends reports to display 307 (or other output device) for output to the user. Workbench network 302 is a centralized network for handling and responding to client requests for data on website usage.
[0023] In one embodiment, the user interface is implemented using a known environment such as Macromedia Flex, Java, DHTML, or any combination thereof.
[0024] hi one embodiment, the components shown in Figure 3 operate as follows. When a report is to be displayed, workbench Java client 301 sends query 303 to network 302, specifying which reports are requested, and optionally specifying one or more filters for the reports. In one embodiment, query 303 is in XML format.
[0025] hi response to query 303, the workbench network 302 returns hashed data 304 that contains an encoded representation of the report data. For example, hashed data 304 may specify, in hash coded terms, the number of visitors that were using a specific web browser and that visited the website within a specified time period. This hashed data 304 is received by client 301.
[0026] Client 301 stores, in local cache 309, a list of previously received and decoded hash codes, so that it can correctly interpret a hash code that it has encountered previously, hi one embodiment, local cache 309 is cleared at the end of a session, so that only those codes previously received in the same session are stored in cache 309. In other embodiments, local cache 309 is implemented in a more persistent or less persistent fashion, depending on user needs.
[0027] Upon receiving hashed data 304, client 301 consults cache 309; if cache 309 contains the hash code(s) in data 304 (in other words, if client 301 has previously received data containing the same hash code), client 301 can interpret the meaning of the hash-coded data without any further communication with network 302. If hash code(s) from data 304 is/are not present in cache 309, client 301 sends hash query 305 to network 302; network 302 responds by sending hash translation 306 to client 301. Hash translation 306 provides client 301 with the meaning of hash terms (for example, specifying that hash term #299 signifies a user using Internet Explorer 6.0). In one embodiment, client 301 stores this meaning in cache 309 for future use.
[0028] Once client 301 has received sufficient data to generate a report, it sends a report 308 to display 307 for output to the user. In one embodiment, if some hash meanings have not yet been received, client 301 still sends report 308, and report 308 states that certain hash terms are unknown. In another embodiment, client 301 displays an error message and/or waits until more complete hash meaning data is available.
[0029] The user can interact with the displayed report 308 via user input device 330 such as a mouse, keyboard, or the like. The user can click on areas within report 308; when the user clicks on an area that can be interpreted as a filter, client 301 generates and sends a new query 303 containing the new report filter criteria. The above process then repeats, and an updated report 308 is sent to display 307.
[0030] Referring now to Figure 4, there is shown an example of an architecture for workbench network 302 according to one embodiment. Network 302 includes any number of front-end web servers 401 that receive queries 303, 305 from client 301, and any number of back-end servers 402 that obtain data from storage, analyze the obtained data, and send report data back to client 301. Back-end servers 402 send an appropriate data set to client 301 based on the filter request. For example, if a filter request specifies that the user is only interested in visitors that used a particular web browser, back-end servers 402 remove the data that does not match the specified criterion, and only forward to client 301 the data that does match. Conceptually, back-end servers 402 are applying a movable filter bar to the data set, maintaining consistency in the views into the data while changing the size of the data set according to the filter request.
[0031] Database 403 contains website visitation data, which in one embodiment is stored in a binary format stored in some storage medium such as a hard drive. Li one embodiment, the website visitation data is broken up into files, or "bricks", to facilitate extraction of portions of the data. When servers 402 extract data from database 403, they are provided with specific bricks that match the criteria.
[0032] hi one embodiment, when the user requests a report showing website visitation data for a specified time period, back-end servers 402 extract data from database 403 that contains web visitation logs and/or statistics, hi one embodiment, servers 402 obtain data from database 403 that represents a snapshot of website visitation over a specified time period. Servers 402 then store this website visitation data in temporary local storage (such as random access memory), using for example a binary format that is encoded according to a hash algorithm so as to minimize bandwidth usage. In one embodiment, this binary format is identical to the format used in database 403, so that no file format translation need be performed when servers 402 extract data from database 403. Servers 402 and then apply filters as requested, and send the filtered data to client 301.
[0033] In one embodiment, whenever the user requests a broader date range for website visitation data, back-end servers 402 perform a new data extraction from database 403. However, when the user narrows the date range from a previously specified range, no new data extraction is performed; rather back-end servers 402 filter the previously extracted data according to the new filter parameters.
Segmentation Workbench Functionality
[0034] The segmentation workbench client 301 and the workbench network 302
(referred to collectively below as the segmentation workbench) allow users to mine sampled Data Warehouse data in real-time. The segmentation workbench provides a fast, responsive way for users to perform advanced analysis on data warehouse-style data via a graphical user interface. Users can launch various pre-packaged reports onto a single workspace and easily click on any data item to filter the entire result set by that item. This allows users to quickly answer questions such as "What were the top referrers that drove visits in which the user purchased Item X or Item Y and viewed the Clearance Sale page?" The results are returned almost instantaneously, enabling users to analyze the effects of combinations of factors.
[0035] The basic functionality provided by the segmentation workbench is to allow users select various reports, add items to the filter from within those reports, and quickly see the resulting change based on this virtual "WHERE" clause. The web analytics tool provides Page View, Visit and Visitor groupings that support the virtual "WHERE" clauses. All dimensions (Browsers, Products, etc.) technically offer the visit, visitor (hourly, daily, weekly, monthly, quarterly, yearly) and page view metrics, as well as the commerce metrics. The workbench supports various dimensions and metric, example of which are provided in Appendix A and B, respectively. [0036] A particular advantage of the segmentation workbench is that it is able to return a response to a query or change to a report in real-time using sampled data from the data warehouse. By real-time, we refer here to the ability of the segmentation workbench to gather and display results within seconds for most filters, more specifically within 2 to 3 seconds.
[0037] Another advantage of the segmentation workbench is that it is presentation of data as well as making it downloadable. The workbench allows the user to download the Segmentation Workbench results in the standard download formats (currently HTML, PDF, RTF, Excel, CSV), at the window level, hi one embodiment, a reportlet is downloadable in all of the standard download formats. The downloaded report shows the filter and data set information. The workbench also provides for PDF download of the workbench canvas (WYSIWYG) or a download of the workbench canvas to a spreadsheet where each report window is a different worksheet.
Workbench User Interface Functionality
[0038] Figure 5 is a high level overview of the data relationships and their presentation by the segmentation workbench.
[0039] A user can select any available report from the Reports menu, which launches a report window on the workbench "canvas." The user can also right-click at any time on the canvas to launch the Reports menu. When a report is launched, a mini version of that report is immediately displayed. The report window displays the default metric(s), and the data will be sorted by that metric, the system 300 defaults to visits. The user can customize the Default metric in the canvas Display Options, and even set them on a per-report basis. The user can change the metric(s) and add additional metrics (up to 10). The default number of data rows shown is 10, but the user can adjust this in the canvas Display Options.
[0040] The reports are provided in windows or containers that have functionality similar to common windows. For example, the reports include the ability to drag edges to change the height and width; ability to minimize, delete, and maximize; ability to reposition/rearrange windows on the canvas by dragging the window title bar. Further, the reports include: functionality to allow the user to drag the column margins to resize column width, data shown in the reports always reflects the current filter; and resizing or moving saves state, such that if the user does a hard refresh on the browser, the canvas looks the same. Various report views (taking the concepts familiar to the user in the standard online reports) are available including: View, Ranked, Over Time, Trended, Fall-out report, C&A, Graphical, Most Improved, Gantt, Tabular, Raw Data and Flexible. The workbench also allows the creation of custom reports. The workbench creates a "custom" report that allows the user to build a custom report with Date, Metric and Dimension axis (similar to Data Extract or the Excel Client Data Blocks). Furthermore, the workbench allows the user to switch between these reports or views, by providing a series of icons as will be shown in the drawings for switching between any of the views.
[0041] In addition to the concept of a workbench canvas, the present invention also maintains a corresponding project. The can save and later re-open a workbench project. When a user saves a project, the data set, filters, reports, and canvas appearance are all preserved. When a user opens a saved project, everything should look exactly as he left it. For example, if a user loaded data in January 2005, then on January 15 saved the project, and then opened that project again on Jan 18...in this case, the data set is technically different. The user is either warned that the user cannot specify a data set date range that includes time in the future or the workbench loads data up through January 18, and warns the user that data shown has changed because more data was added to the data set. Users can share workbench projects with other users. The owner can save over the original shared project (application should alert the user and remind her that she is saving the "networked" version). Non-owners can open shared projects, but any auto-save should actually apply to their own copy. When they explicitly click "Save project", they are prompted that they're using a shared project and can save their own copy in their own folder. Any time the user tries to leave an unsaved, altered project, the workbench prompts him: "Any changes that you have made will be lost. Are you sure you want to proceed?" For example, if the user clicks the "New Project" icon or the "Open Project" icon, the application prompts him appropriately. Workbench performs an "auto-save" on open projects periodically. By default, the workbench auto-saves the project every 5 minutes. The user can customize this auto-save frequency. Also, this can be combined with a limited versioning system, such that users could theoretically "undo" changes to the last version. If the workbench ever ends a session with the user (due to inactivity), it first saves everything as-is so that next time the user can begin where he left off. If the user has been inactive in a workbench for 15 minutes, the application prompts the user, asking him if he wants to continue to use the workbench. If the user doesn't respond to the prompt within 5 minutes, then the application saves the project for the user to access later, and will free up the workbench slot. The application updates the display, indicating that it prompted the user and did not receive a response, so it saved the project and has closed the workbench.
[0042] The canvas also enables the workbench canvas to provide user definable data filters. The workbench allows the user to apply two types of canvas filters: date and segment. The user can filter the data by date, and the workbench preferably allows the user selects several different over-time or trended reports. The default is to force the same level of granularity for all reports. The user can also customize the granularity on a per-report basis. The user can filter the data by segment. Using tools such as a segment builder interface as described in co-pending U.S. Patent Application No. 11/313,445, filed December 20, 2005, entitled, "Creation Of Segmentation Definitions" which is incorporated herein by reference, the user can create segment definition for grouping and filtering the data. The workbench allows the user to select a segment to be used in filtering - e.g., a user can click on the funnel icon next to an element, which automatically adds that element to the filter. In one embodiment, the funnel icon is a toggle switch to add-to-filter or remove-from-filter. Right- clicking on the funnel icon will show an options menu that allows the user to choose functional options such as Change to "AND," Change to "OR, or "Remove from filter"
[0043] Finally, there are additional features provided by the workbench. For example, the workbench allows the user to set the sampling rate for the raw data that is used to generate the data warehouse or set used by the workbench. The workbench interface can be combined with other user interfaces provided by the web analytics tool 112/212 such as also the Data Warehouse interface. The workbench also the user to "Undo" actions or versions as was briefly noted above. The workbench also the user to store their working environment. The user can save everything associated with the workbench view - including report suite, date range, sample rate, etc.
[0044] Figure 6 illustrates a diagram of exemplary embodiment for a workbench tool bar that can be added to other user interfaces, and that also shows the screens or interfaces that the user transitions to based on selection of the buttons in the workbench tool bar. [0045] Referring now to Figure 7A to TV, exemplary graphical user interfaces provided by the segmentation workbench of the present invention will be shown and described.
[0046] Figure 7 A is a graphical user interface that is displayed in response to the data warehouse tab.
[0047] Figure 7B is a graphical user interface that is displayed if the user does not have a license and is not an administrator. The user interface directs the user to contact their local administrator to find out about the workbench service.
[00100] Figure 7C is a graphical user interface that is displayed if the user has a license. The purpose of this page is to explain to first-time users what the workbench is, and allow them to transition into using it.
[0048] Figure 7D is a graphical user interface that is displayed if the user has workbench license, but no servers are available (concurrent license model only). The web analytics tool 112/212 continues to reserve the user's place in the queue as long as they remain on this page. If the user wants to leave this page and continue to remain in the queue, the web analytics tool 112/212 reserves the user's place and simply notifies the user via email when a workbench becomes available for use. This allows the user to leave this page or even log out of web analytics tool 112/212. The web analytics tool 112/212 sends the availability notification, an example of which is shown in Figure 7E, and workbench reserves my login for 15 minutes. If the user does not access the workbench within those 15 minutes, the workbench will become available for others to use.
[0049] Figure 7F is a graphical user interface that is displayed if the user has workbench license, but no servers are available (dedicated user license model only). If the user is an administrator, he can see the session length for each of the current workbench users. If the user is an administrator, when he moves the cursor over the user names, a tooltip will display the user's company if the company differs from the one he's currently logged into. The status bar could just be an animated gif that takes a predetermined time to fill. Every predetermined time, the page will refresh and the status bar will continue to fill. [0050] Figure 7 G is a graphical user interface that is displayed if actually has access to both license models but there are no servers available in either group (highly unlikely scenario).
[0051] Figure 7H is a graphical user interface that is displayed where the user has workbench user license and server is available, but the user doesn't have any existing projects (all first-time users). The user interface provides load time estimates / recommendations on this screen.
[0052] Figure 71 is a graphical user interface that is displayed where the user has workbench user license, a server is available, and the user has existing projects. If a user has an existing project, the workbench defaults to the "load last project" option, since it's highly likely they'll want to continue where they left off. If the workbench detects that the user left last time without saving his final changes, then the "Open last auto-saved project version" option is displayed. If the user saved his final changes, then that "Open last auto-saved..." option should be replaced with: "Open most recent project: [project name]".
[0053] Figure 7J is a graphical user interface that is displayed when the workbench data is being loaded.
[0054] Figure 7K is a graphical user interface for a blank workbench canvas. Until at least a single report and at least a single filter is applied, the "To begin..." text is be displayed by the user interface. Once a report and filter are applied, the "To begin..." text either disappears or changes to a dark color. To begin using the workbench, the user selects reports by clicking on the Reports button above to launch the Reports palette, or right-click anywhere on this canvas. Then the user clicks on the Filter button above to apply date or segment filters to your report data.
[0055] Figure 7L is a graphical user interface for a blank workbench canvas with different parts of the workbench canvas parts labeled. This illustrates the main functional components of the workbench. The Workbench toolbar allows a number of operations including: Create new project, Open existing project, Save project, Print canvas, Download canvas (for example in PDF or Excel), Display Options (with default number of rows and metrics), Help, Clear canvas, Update canvas. An Auto-update option enabled means that clicking on the filter icons (the "funnels") takes effect immediately. If the auto-update option is disabled, then the user can click on several filter icons, and the hit the "Update" button for all changes to take effect at once. The default is to "Auto-update". An example user interface for the Auto update functionality is shown in Figure 7M.
[00101] Figure 7N is a graphical representation of an exemplary user interface for reports. The report windows general components including: Tabs to select views, a Toolbar, an Options section (yellow subheader in the online reports), Graphs and Tables. The user can customize the report window with Dashboard functionality to show or hide graph, table, etc. The user can click the "x" to remove any section where applicable. To get the section back, the user can right-click within the window and choose "Show Graph", "Show Details Table", etc. Or, the user can click on a "Display Options" icon in the report window toolbar. It is possible for a user to remove all sections and have an "empty" report window. If the report window is empty, then text appears that instructs the user on how to display sections (similar to the canvas behavior on start-up). The active window is shown in a visually distinct manner such as in a Different window color, with brighter icons and controls, or bold in the report list in the header. The filter icons ("funnels") are used to apply any filter by clicking on the funnel icon in the report window and implies an "OR Visits where [dimension] = [selected item]" If the user has launched duplicate reports (Browsers, in this example), then numbers are added after the duplicate window names to differentiate them. If the user clicks on any link in the Reports or Filter description section, the applicable window comes into focus (or launches if necessary). If a user clicks on a segment filter element, then the Segment Builder launches or comes into focus. If a user clicks on the date filter text, then the calendar palette launches or comes into focus. If a user clicks on any of the reports listed, then that report comes into focus. Windows don't change size unless the user specifically resizes them. Scrollbars will appear where needed.
[0056] Figure 70 is a graphical representation of an exemplary user interface for reports with the reports menu open. The user can right-click anywhere on the canvas to select the desired report.
[0057] Figure 7P is a graphical representation of an exemplary user interface for the date filter. The Range tab is similar to the standard calendar, except the "Run Report" button text will display "Apply Date".
[0058] Figure 7Q is a graphical representation of an exemplary user interface for the segmentation filter. The "Apply Segment" button applies whatever is currently shown in this palette when selected. So, for example, the user can actually clear any active segment filter by clearing the canvas in the builder and then clicking "Apply Segment".
[0059] Figure 7R is a graphical representation of an exemplary user interface for the metric selector popup window. Any of the applicable option selectors are available within the workbench. For example, the Ranked metric selector is shown. If the Trended view is supported, then the "Select Items to Trend" popup will need to be available, etc.
[0060] Figures 7S and 7T are a graphical representation of an exemplary user interface for the Save and Open dialogs windows.
[0061] Figure 7U is a graphical representation of an exemplary user interface for the Report window detail.
[0062] Figure 7V is a graphical representation of an exemplary user interface for a pop up window for setting the permissions or define a group. Administrators can create groups that have access to the Segmentation Workbench. In this way, they can control who has access to which report suites for the workbench. Administrators can put certain people in the "concurrent licenses" group, and other people in the "shared cluster" group (assuming that the company has purchased some of both). If the company doesn't have licenses, then the Information Page option is listed.
[0063] While the present invention has been described with reference to certain preferred embodiments, those skilled in the art will recognize that various modifications may be provided. For example, back-end servers 402 may have a variety of topologies and arrangements. Variations upon and modifications to the preferred embodiments are provided for by the present invention.
Appendix A
Example Dimensions
Figure imgf000018_0001
Figure imgf000019_0001
Figure imgf000020_0001
Appendix B
Example Metrics
Figure imgf000022_0001
Figure imgf000023_0001
Appendix C
Report Organization
Current status in online reports:
Figure imgf000024_0001
Figure imgf000025_0001
Figure imgf000026_0001
Figure imgf000027_0001
Figure imgf000028_0001
Figure imgf000029_0001
Audience-centric approach:
Figure imgf000030_0001
GeoSegmentation r Cities
Regions
Countries
U.S. DMA U.S. States
L
Visitor Profile
Top Level Domains Domains Full Domains ~ZΪP/Postal Codes" ~ States
Time Zones Languages
User Home Page Last 100 Visitors Visitor Detail
What technologies do they use?
Technology
Browser Types
Figure imgf000031_0001
Figure imgf000031_0002
Web Searches
All Search Engines Paid Search
Engines
Natural Search
Engines "AΪfSearch"
Keywords Paid Search
! Keywords Natural Search
Keywords
Figure imgf000032_0001
Referrers
Original Referring
Domains
Referring Domains Referrers
Campaigns
Tracking Code Creative Elements Campaigns
Campaign Classifications
Have they been here before?
Visitor Loyalty
Return Frequency Visit Number Customer Loyalty
Figure imgf000032_0002
Figure imgf000032_0003
Paths Analysis
Entries & Exits
Original Entry Pages Entry Pages Exit Links Exit Pages
Figure imgf000032_0004
Complete Paths Full Paths Longest Paths
Figure imgf000033_0001
Path Length Single-page Visits Time Spent per Visit
Advanced Analysis
Fall-out Next Page Next Page Flow PathFinder Previous Page Previous Page Flow
What role did a particular page, link or site section play?
Page / Link / Site Section Analysis
Page Analysis
Page Value (Top Pages)
Page Summary
Clicks to Page
Pages not found
Reloads
Time Spent on Page
Link Analysis
File Downloads
Custom Links
Custom Insight
Analysis
Top Site Sections Top Servers
Top Pages viewed by Key Visitors
Top Custom Insight X
Top Custom Insight Evar
What did they purchase? How long did they wait before purchasing?
Commerce Analysis
Products
Products Cross Sell Categories
J
Sales Cycle
Days before first purchase '
Days since last purchase Visit Number - special
Figure imgf000034_0001
Figure imgf000034_0002
time?
Site Traffic
Page Views
Key Visitor Page
Views
Hourly Unique
Visitors
Daily Unique
Visitors
Monthly Unique Visitors
Quarterly Unique
Visitors Weekly Unique
Visitors Yearly Unique
Visitors
~VΪsϊts " Return Visits Daily Return Visits
Customer Traffic
Daily Unique
Customers
Monthly Unique Customers
, Quarterly Unique
Customers
Weekly Unique
Customers
Yearly Unique
Customers
Commerce
Events
Conversions &
Averages
Revenue
Orders
Units
Cart Additions
Figure imgf000035_0001
Cart Opens Cart Removals Cart Views Checkouts
Custom Insight
Events
Custom Event X

Claims

WHAT IS CLAIMED IS:
1. A system for providing user customizable web analytics data, the system comprising:
an application service provider including an web analytics tool for receiving queries and sending web analytics data in real time, the application service provider having an input and an output; and
a web analytics client having an input and output, the web analytics client operable on a computing device to present web analytics data, to receive input from a user, and to communicate with the application service provider, the web analytics client having an input and an output coupled to the output and the input of the application service provider.
2. The system of claim 1, further comprising a second web analytics client having an input and output, the second web analytics client adapted to present web analytics data, to receive input from a user, and to communicate with the application service provider, the second web analytics client having an input and an output coupled to the output and the input of the application service provider.
3. The system of claim 1, wherein the web analytics client and the application service provider are coupled by a network.
4. The system of claim 1, wherein the application service provider includes a workbench network for storing and providing web analytics data, the workbench network responsive to queries from the web analytics client.
5. The system of claim 4, further comprising a database storing web analytics data, the database coupled to the workbench network to provide web analytics data, and wherein the workbench network stores a sampled subset of the web analytics data stored in the database.
6. The system of claim 4, further comprising:
a plurality of front end servers having an plurality of inputs and an plurality of outputs, each front end server capable of communicating with the web analytics client, the front end servers for receiving and servicing queries from the web analytics client; and
a plurality of backend servers having a plurality of inputs and a plurality of outputs, each of the backend server capable of communicating with a database and at least two of the plurality of front end servers, the plurality of backend servers for obtaining data from storage, analyzing obtained data, and send report data.
7. The system of claim 6, wherein the plurality of backend servers filter data based on requests received from the web analytics client.
8. The system of claim 1, wherein real time is 5 seconds or less.
9. The system of claim 1, wherein the web analytics client includes a module to generate a report user interface that includes a canvas and selectable filters.
10. The system of claim 9, wherein the filters are one from the group of date filters and segmentation filters.
11. The system of claim 9, wherein the filters are customizable by the user.
12. A device for providing user customizable web analytics data, the device comprising an application service provider including an web analytics tool for receiving queries and sending web analytics data in real time, the application service provider having an input and an output, the application service provider capable of generating and sending user customizable reports including the web analytics data.
13. The device of claim 12 wherein the application service provider operates on a computing device, and wherein the input and output of the application service provider are adapted to communicate with client devices over a network.
14. The device of claim 12, wherein the application service provider includes a workbench network for storing and providing web analytics data, the workbench network responsive to queries from client devices.
15. The device of claim 14 further comprising a database storing web analytics data, the database coupled to the workbench network to provide web analytics data, and wherein the workbench network stores a sampled subset of the web analytics data stored in the database.
16. The system of claim 14, further comprising:
a plurality of front end servers having an plurality of inputs and an plurality of outputs, each front end server capable of communicating with the client device, the front end servers for receiving and servicing queries from the client device; and
a plurality of backend servers having a plurality of inputs and a plurality of outputs, each of the backend server capable of communicating with a database and at least two of the plurality of front end servers, the plurality of backend servers for obtaining data from storage, analyzing obtained data, and send report data.
17. The device of claim 16, wherein the plurality of backend servers filter data based on requests received from the client device.
18. The device of claim 14, wherein real time is 5 seconds or less.
19. A method for providing user customizable web analytics data to a client device by a web analytics application service provider, the method comprising:
establishing a communication connection between the client device and the web analytics application service provider;
identifying a set of web analytics data;
loading the identified set of web analytics data on the web analytics application service provider;
applying a filter to the loaded web analytics data;
generating a filtered set of web analytics data; and
providing the filtered set of web analytics data to the client device.
20. The method of claim 19 wherein establishing a communication connection between the client device and the web analytics application service provider comprises a user logging into the web analytics application service provider, and verifying a license associated with the client device.
21. The method of claim 19 wherein identifying the set of web analytics data comprising loading a set of web analytics data that was previously stored by in the web analytics application service provider.
22. The method of claim 19 wherein loading the identified set of web analytics data on the web analytics application service provider comprises sampling web analytics data from a database and storing the sampled data on a server upon which the web analytics application service provider operates.
23. The method of claim 19 wherein the steps of applying and generating are performed in real time.
24. The method of claim 23 wherein real time is 5 or fewer seconds.
25. The method of claim 19 wherein the step of providing the filtered set of web analytics data to the client device includes providing a report for displaying the filtered data.
26. The method of claim 25 wherein the report is a canvas capable of displaying a plurality of filtered data sets.
27. The method of claim 19 further comprising:
applying a second filter to the filtered set of web analytics data;
generating a updated set of web analytics data; and
providing the updated set of web analytics data to the client device.
28. The method of claim 27wherein the steps of applying, generating and providing are performed in real time.
29. The method of claim 28 wherein real time is 5 or fewer seconds.
PCT/US2006/021977 2005-06-06 2006-06-06 Asp for web analytics including a real-time segmentation workbench WO2006133218A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2008514974A JP2008546105A (en) 2005-06-06 2006-06-06 Application service provider for web analytics with real-time segmentation workbench
EP06772335A EP1894121A4 (en) 2005-06-06 2006-06-06 Asp for web analytics including a real-time segmentation workbench
AU2006255068A AU2006255068A1 (en) 2005-06-06 2006-06-06 ASP for web analytics including a real-time segmentation workbench
CA002610953A CA2610953A1 (en) 2005-06-06 2006-06-06 Asp for web analytics including a real-time segmentation workbench

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US68816705P 2005-06-06 2005-06-06
US60/688,167 2005-06-06
US11/422,129 US8341259B2 (en) 2005-06-06 2006-06-05 ASP for web analytics including a real-time segmentation workbench
US11/422,129 2006-06-05

Publications (2)

Publication Number Publication Date
WO2006133218A2 true WO2006133218A2 (en) 2006-12-14
WO2006133218A3 WO2006133218A3 (en) 2009-04-16

Family

ID=37499055

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/021977 WO2006133218A2 (en) 2005-06-06 2006-06-06 Asp for web analytics including a real-time segmentation workbench

Country Status (6)

Country Link
US (1) US8341259B2 (en)
EP (1) EP1894121A4 (en)
JP (1) JP2008546105A (en)
AU (1) AU2006255068A1 (en)
CA (1) CA2610953A1 (en)
WO (1) WO2006133218A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011028715A1 (en) * 2009-09-02 2011-03-10 Google Inc. Method and system for generating and sharing dataset segmentation schemes
US8359313B2 (en) 2009-10-20 2013-01-22 Google Inc. Extensible custom variables for tracking user traffic
EP2595060A1 (en) * 2011-11-18 2013-05-22 The Boeing Company Server-side web analytics system and method
US8549019B2 (en) 2009-05-26 2013-10-01 Google Inc. Dynamically generating aggregate tables
US8554699B2 (en) 2009-10-20 2013-10-08 Google Inc. Method and system for detecting anomalies in time series data
US8583584B2 (en) 2009-10-20 2013-11-12 Google Inc. Method and system for using web analytics data for detecting anomalies
US8751544B2 (en) 2009-09-02 2014-06-10 Google Inc. Method and system for pivoting a multidimensional dataset
US9305105B2 (en) 2009-05-26 2016-04-05 Google Inc. System and method for aggregating analytics data

Families Citing this family (160)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101019115B (en) 2004-03-18 2012-04-18 安德鲁·彼得·利布曼 A novel media file access and storage solution for multi-workstation/multi-platform non-linear video editing systems
US7483975B2 (en) * 2004-03-26 2009-01-27 Arbitron, Inc. Systems and methods for gathering data concerning usage of media data
US7882447B2 (en) 2005-03-30 2011-02-01 Ebay Inc. Method and system to determine area on a user interface
US7992135B1 (en) 2006-06-26 2011-08-02 Adobe Systems Incorporated Certification of server-side partner plug-ins for analytics and privacy protection
US8352917B2 (en) * 2006-06-26 2013-01-08 Adobe Systems Incorporated Web-beacon plug-ins and their certification
US8396834B2 (en) * 2006-10-10 2013-03-12 International Business Machines Corporation Real time web usage reporter using RAM
US8239522B1 (en) 2006-11-16 2012-08-07 Adobe Systems Incorporated Dynamic variables for tracking wireless device website usage
US8024651B1 (en) 2007-01-30 2011-09-20 Adobe Systems Incorporated Data visualization using tables integrated with hierarchical pie charts
US8160909B2 (en) * 2007-02-06 2012-04-17 Digital River, Inc. Site optimizer
US7822755B2 (en) * 2007-03-06 2010-10-26 Yahoo! Inc. Methods of processing and segmenting web usage information
US8352318B2 (en) * 2007-05-29 2013-01-08 Digital River, Inc. Exclusivity in internet marketing campaigns system and method
US20090006478A1 (en) * 2007-06-25 2009-01-01 Digital River, Inc. Days and Visits to Transaction Metrics System and Method
CN102084338B (en) * 2008-04-14 2016-01-20 安德鲁·利布曼 For the new media file of multi-platform non-linear video editing systems
NZ588792A (en) * 2008-04-24 2013-02-22 Movideo Pty Ltd Generating an interface including selectable resource items and displaying usage data of resources
CN102132269A (en) * 2008-06-19 2011-07-20 安德鲁·利布曼 A novel media file access and storage solution for multi-workstation/multi-platform non-linear video editing systems
US8090679B2 (en) * 2008-06-30 2012-01-03 Microsoft Corporation Method for measuring web site performance
US8984390B2 (en) 2008-09-15 2015-03-17 Palantir Technologies, Inc. One-click sharing for screenshots and related documents
US8560675B2 (en) * 2009-04-01 2013-10-15 Comscore, Inc. Determining projection weights based on a census data
US8713536B2 (en) * 2009-06-11 2014-04-29 Webtrends, Inc. Method and system for constructing a customized web analytics application
US8234370B2 (en) * 2009-06-30 2012-07-31 International Business Machines Corporation Determining web analytics information
US9104695B1 (en) 2009-07-27 2015-08-11 Palantir Technologies, Inc. Geotagging structured data
US8996986B2 (en) 2010-01-11 2015-03-31 Ensighten, Inc. Enhanced delivery of content and program instructions
US9268547B2 (en) 2010-01-11 2016-02-23 Ensighten, Inc. Conditional logic for delivering computer-executable program instructions and content
US20110225287A1 (en) * 2010-03-12 2011-09-15 Webtrends Inc. Method and system for distributed processing of web traffic analytics data
US9450834B2 (en) * 2010-07-19 2016-09-20 Soasta, Inc. Animated globe showing real-time web user performance measurements
US9262393B2 (en) * 2010-08-31 2016-02-16 Salesforce.Com, Inc. Method and system for providing simplified form filling in an on-demand service
CA3007662A1 (en) 2010-12-30 2012-07-05 Ensighten, Inc. Online privacy management
US9003552B2 (en) 2010-12-30 2015-04-07 Ensighten, Inc. Online privacy management
US20120188249A1 (en) * 2011-01-26 2012-07-26 Raytheon Company Distributed graph system and method
JP6166254B2 (en) 2011-04-08 2017-07-19 リープマン, アンドリューLIEBMAN, Andrew Project sharing system, computer-readable storage medium, and computer-implemented method
US9547693B1 (en) 2011-06-23 2017-01-17 Palantir Technologies Inc. Periodic database search manager for multiple data sources
US8732574B2 (en) 2011-08-25 2014-05-20 Palantir Technologies, Inc. System and method for parameterizing documents for automatic workflow generation
US9165308B2 (en) 2011-09-20 2015-10-20 TagMan Inc. System and method for loading of web page assets
US20130111393A1 (en) * 2011-10-28 2013-05-02 Sap Ag Modeling reports directly from data sources
WO2013126084A2 (en) 2012-02-21 2013-08-29 Ensighten, Inc. Graphical overlay related to data mining and analytics
US9798768B2 (en) 2012-09-10 2017-10-24 Palantir Technologies, Inc. Search around visual queries
US9317490B2 (en) 2012-09-19 2016-04-19 TagMan Inc. Systems and methods for 3-tier tag container architecture
US9348677B2 (en) 2012-10-22 2016-05-24 Palantir Technologies Inc. System and method for batch evaluation programs
US9251324B2 (en) * 2012-12-13 2016-02-02 Microsoft Technology Licensing, Llc Metadata driven real-time analytics framework
US9501507B1 (en) 2012-12-27 2016-11-22 Palantir Technologies Inc. Geo-temporal indexing and searching
US10140664B2 (en) 2013-03-14 2018-11-27 Palantir Technologies Inc. Resolving similar entities from a transaction database
US10275778B1 (en) 2013-03-15 2019-04-30 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive investigation based on automatic malfeasance clustering of related data in various data structures
US8924388B2 (en) 2013-03-15 2014-12-30 Palantir Technologies Inc. Computer-implemented systems and methods for comparing and associating objects
US8903717B2 (en) 2013-03-15 2014-12-02 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US8930897B2 (en) 2013-03-15 2015-01-06 Palantir Technologies Inc. Data integration tool
US8909656B2 (en) 2013-03-15 2014-12-09 Palantir Technologies Inc. Filter chains with associated multipath views for exploring large data sets
US8855999B1 (en) 2013-03-15 2014-10-07 Palantir Technologies Inc. Method and system for generating a parser and parsing complex data
US8868486B2 (en) 2013-03-15 2014-10-21 Palantir Technologies Inc. Time-sensitive cube
US8799799B1 (en) 2013-05-07 2014-08-05 Palantir Technologies Inc. Interactive geospatial map
US9335897B2 (en) 2013-08-08 2016-05-10 Palantir Technologies Inc. Long click display of a context menu
US9646276B2 (en) * 2013-08-23 2017-05-09 AppDynamics, Inc. Dashboard for dynamic display of distributed transaction data
US8689108B1 (en) * 2013-09-24 2014-04-01 Palantir Technologies, Inc. Presentation and analysis of user interaction data
US9785317B2 (en) 2013-09-24 2017-10-10 Palantir Technologies Inc. Presentation and analysis of user interaction data
US8938686B1 (en) 2013-10-03 2015-01-20 Palantir Technologies Inc. Systems and methods for analyzing performance of an entity
US8812960B1 (en) 2013-10-07 2014-08-19 Palantir Technologies Inc. Cohort-based presentation of user interaction data
US9116975B2 (en) 2013-10-18 2015-08-25 Palantir Technologies Inc. Systems and user interfaces for dynamic and interactive simultaneous querying of multiple data stores
US8832594B1 (en) 2013-11-04 2014-09-09 Palantir Technologies Inc. Space-optimized display of multi-column tables with selective text truncation based on a combined text width
US9105000B1 (en) 2013-12-10 2015-08-11 Palantir Technologies Inc. Aggregating data from a plurality of data sources
US10579647B1 (en) 2013-12-16 2020-03-03 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US10025834B2 (en) 2013-12-16 2018-07-17 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US10356032B2 (en) 2013-12-26 2019-07-16 Palantir Technologies Inc. System and method for detecting confidential information emails
US8832832B1 (en) 2014-01-03 2014-09-09 Palantir Technologies Inc. IP reputation
US8935201B1 (en) 2014-03-18 2015-01-13 Palantir Technologies Inc. Determining and extracting changed data from a data source
US9836580B2 (en) 2014-03-21 2017-12-05 Palantir Technologies Inc. Provider portal
US9619557B2 (en) 2014-06-30 2017-04-11 Palantir Technologies, Inc. Systems and methods for key phrase characterization of documents
US9129219B1 (en) 2014-06-30 2015-09-08 Palantir Technologies, Inc. Crime risk forecasting
US9535974B1 (en) 2014-06-30 2017-01-03 Palantir Technologies Inc. Systems and methods for identifying key phrase clusters within documents
US9256664B2 (en) 2014-07-03 2016-02-09 Palantir Technologies Inc. System and method for news events detection and visualization
US20160026923A1 (en) 2014-07-22 2016-01-28 Palantir Technologies Inc. System and method for determining a propensity of entity to take a specified action
US9390086B2 (en) 2014-09-11 2016-07-12 Palantir Technologies Inc. Classification system with methodology for efficient verification
US9501851B2 (en) 2014-10-03 2016-11-22 Palantir Technologies Inc. Time-series analysis system
US9767172B2 (en) 2014-10-03 2017-09-19 Palantir Technologies Inc. Data aggregation and analysis system
US9785328B2 (en) 2014-10-06 2017-10-10 Palantir Technologies Inc. Presentation of multivariate data on a graphical user interface of a computing system
US9229952B1 (en) 2014-11-05 2016-01-05 Palantir Technologies, Inc. History preserving data pipeline system and method
US9043894B1 (en) 2014-11-06 2015-05-26 Palantir Technologies Inc. Malicious software detection in a computing system
US9219787B1 (en) 2014-11-26 2015-12-22 Ensighten, Inc. Stateless cookie operations server
US9553918B1 (en) 2014-11-26 2017-01-24 Ensighten, Inc. Stateful and stateless cookie operations servers
US9483546B2 (en) 2014-12-15 2016-11-01 Palantir Technologies Inc. System and method for associating related records to common entities across multiple lists
US10362133B1 (en) 2014-12-22 2019-07-23 Palantir Technologies Inc. Communication data processing architecture
US10552994B2 (en) 2014-12-22 2020-02-04 Palantir Technologies Inc. Systems and interactive user interfaces for dynamic retrieval, analysis, and triage of data items
US9348920B1 (en) 2014-12-22 2016-05-24 Palantir Technologies Inc. Concept indexing among database of documents using machine learning techniques
US10452651B1 (en) 2014-12-23 2019-10-22 Palantir Technologies Inc. Searching charts
US9335911B1 (en) 2014-12-29 2016-05-10 Palantir Technologies Inc. Interactive user interface for dynamic data analysis exploration and query processing
US9817563B1 (en) 2014-12-29 2017-11-14 Palantir Technologies Inc. System and method of generating data points from one or more data stores of data items for chart creation and manipulation
US11302426B1 (en) 2015-01-02 2022-04-12 Palantir Technologies Inc. Unified data interface and system
US9727560B2 (en) 2015-02-25 2017-08-08 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US9891808B2 (en) 2015-03-16 2018-02-13 Palantir Technologies Inc. Interactive user interfaces for location-based data analysis
US9886467B2 (en) 2015-03-19 2018-02-06 Plantir Technologies Inc. System and method for comparing and visualizing data entities and data entity series
US9348880B1 (en) 2015-04-01 2016-05-24 Palantir Technologies, Inc. Federated search of multiple sources with conflict resolution
US10103953B1 (en) 2015-05-12 2018-10-16 Palantir Technologies Inc. Methods and systems for analyzing entity performance
US10628834B1 (en) 2015-06-16 2020-04-21 Palantir Technologies Inc. Fraud lead detection system for efficiently processing database-stored data and automatically generating natural language explanatory information of system results for display in interactive user interfaces
US9418337B1 (en) 2015-07-21 2016-08-16 Palantir Technologies Inc. Systems and models for data analytics
US9392008B1 (en) 2015-07-23 2016-07-12 Palantir Technologies Inc. Systems and methods for identifying information related to payment card breaches
US9996595B2 (en) 2015-08-03 2018-06-12 Palantir Technologies, Inc. Providing full data provenance visualization for versioned datasets
US9456000B1 (en) 2015-08-06 2016-09-27 Palantir Technologies Inc. Systems, methods, user interfaces, and computer-readable media for investigating potential malicious communications
US9600146B2 (en) 2015-08-17 2017-03-21 Palantir Technologies Inc. Interactive geospatial map
US9671776B1 (en) 2015-08-20 2017-06-06 Palantir Technologies Inc. Quantifying, tracking, and anticipating risk at a manufacturing facility, taking deviation type and staffing conditions into account
US11150917B2 (en) 2015-08-26 2021-10-19 Palantir Technologies Inc. System for data aggregation and analysis of data from a plurality of data sources
US9485265B1 (en) 2015-08-28 2016-11-01 Palantir Technologies Inc. Malicious activity detection system capable of efficiently processing data accessed from databases and generating alerts for display in interactive user interfaces
US10706434B1 (en) 2015-09-01 2020-07-07 Palantir Technologies Inc. Methods and systems for determining location information
US9639580B1 (en) 2015-09-04 2017-05-02 Palantir Technologies, Inc. Computer-implemented systems and methods for data management and visualization
US9984428B2 (en) 2015-09-04 2018-05-29 Palantir Technologies Inc. Systems and methods for structuring data from unstructured electronic data files
US9576015B1 (en) 2015-09-09 2017-02-21 Palantir Technologies, Inc. Domain-specific language for dataset transformations
US9424669B1 (en) 2015-10-21 2016-08-23 Palantir Technologies Inc. Generating graphical representations of event participation flow
US10223429B2 (en) 2015-12-01 2019-03-05 Palantir Technologies Inc. Entity data attribution using disparate data sets
US10706056B1 (en) 2015-12-02 2020-07-07 Palantir Technologies Inc. Audit log report generator
US9514414B1 (en) 2015-12-11 2016-12-06 Palantir Technologies Inc. Systems and methods for identifying and categorizing electronic documents through machine learning
US9760556B1 (en) 2015-12-11 2017-09-12 Palantir Technologies Inc. Systems and methods for annotating and linking electronic documents
US10114884B1 (en) 2015-12-16 2018-10-30 Palantir Technologies Inc. Systems and methods for attribute analysis of one or more databases
US10373099B1 (en) 2015-12-18 2019-08-06 Palantir Technologies Inc. Misalignment detection system for efficiently processing database-stored data and automatically generating misalignment information for display in interactive user interfaces
US10871878B1 (en) 2015-12-29 2020-12-22 Palantir Technologies Inc. System log analysis and object user interaction correlation system
US9792020B1 (en) 2015-12-30 2017-10-17 Palantir Technologies Inc. Systems for collecting, aggregating, and storing data, generating interactive user interfaces for analyzing data, and generating alerts based upon collected data
US10698938B2 (en) 2016-03-18 2020-06-30 Palantir Technologies Inc. Systems and methods for organizing and identifying documents via hierarchies and dimensions of tags
US9652139B1 (en) 2016-04-06 2017-05-16 Palantir Technologies Inc. Graphical representation of an output
US10068199B1 (en) 2016-05-13 2018-09-04 Palantir Technologies Inc. System to catalogue tracking data
US10007674B2 (en) 2016-06-13 2018-06-26 Palantir Technologies Inc. Data revision control in large-scale data analytic systems
US10545975B1 (en) 2016-06-22 2020-01-28 Palantir Technologies Inc. Visual analysis of data using sequenced dataset reduction
US10909130B1 (en) 2016-07-01 2021-02-02 Palantir Technologies Inc. Graphical user interface for a database system
US10552002B1 (en) 2016-09-27 2020-02-04 Palantir Technologies Inc. User interface based variable machine modeling
US10726507B1 (en) 2016-11-11 2020-07-28 Palantir Technologies Inc. Graphical representation of a complex task
US9842338B1 (en) 2016-11-21 2017-12-12 Palantir Technologies Inc. System to identify vulnerable card readers
US10318630B1 (en) 2016-11-21 2019-06-11 Palantir Technologies Inc. Analysis of large bodies of textual data
US11250425B1 (en) 2016-11-30 2022-02-15 Palantir Technologies Inc. Generating a statistic using electronic transaction data
GB201621434D0 (en) 2016-12-16 2017-02-01 Palantir Technologies Inc Processing sensor logs
US9886525B1 (en) 2016-12-16 2018-02-06 Palantir Technologies Inc. Data item aggregate probability analysis system
US10249033B1 (en) 2016-12-20 2019-04-02 Palantir Technologies Inc. User interface for managing defects
US10728262B1 (en) 2016-12-21 2020-07-28 Palantir Technologies Inc. Context-aware network-based malicious activity warning systems
US11373752B2 (en) 2016-12-22 2022-06-28 Palantir Technologies Inc. Detection of misuse of a benefit system
US10360238B1 (en) 2016-12-22 2019-07-23 Palantir Technologies Inc. Database systems and user interfaces for interactive data association, analysis, and presentation
US10721262B2 (en) 2016-12-28 2020-07-21 Palantir Technologies Inc. Resource-centric network cyber attack warning system
US10762471B1 (en) 2017-01-09 2020-09-01 Palantir Technologies Inc. Automating management of integrated workflows based on disparate subsidiary data sources
US10133621B1 (en) 2017-01-18 2018-11-20 Palantir Technologies Inc. Data analysis system to facilitate investigative process
US10509844B1 (en) 2017-01-19 2019-12-17 Palantir Technologies Inc. Network graph parser
US10515109B2 (en) 2017-02-15 2019-12-24 Palantir Technologies Inc. Real-time auditing of industrial equipment condition
US10581954B2 (en) 2017-03-29 2020-03-03 Palantir Technologies Inc. Metric collection and aggregation for distributed software services
US10866936B1 (en) 2017-03-29 2020-12-15 Palantir Technologies Inc. Model object management and storage system
US10133783B2 (en) 2017-04-11 2018-11-20 Palantir Technologies Inc. Systems and methods for constraint driven database searching
US10563990B1 (en) 2017-05-09 2020-02-18 Palantir Technologies Inc. Event-based route planning
US10698894B2 (en) 2017-05-12 2020-06-30 Microsoft Technology Licensing, Llc Generating reports for enterprise pages based upon instrumentation data generated by client computing devices
US10606872B1 (en) 2017-05-22 2020-03-31 Palantir Technologies Inc. Graphical user interface for a database system
US10795749B1 (en) 2017-05-31 2020-10-06 Palantir Technologies Inc. Systems and methods for providing fault analysis user interface
US10956406B2 (en) 2017-06-12 2021-03-23 Palantir Technologies Inc. Propagated deletion of database records and derived data
US11216762B1 (en) 2017-07-13 2022-01-04 Palantir Technologies Inc. Automated risk visualization using customer-centric data analysis
US10430444B1 (en) 2017-07-24 2019-10-01 Palantir Technologies Inc. Interactive geospatial map and geospatial visualization systems
US11281726B2 (en) 2017-12-01 2022-03-22 Palantir Technologies Inc. System and methods for faster processor comparisons of visual graph features
US10877984B1 (en) 2017-12-07 2020-12-29 Palantir Technologies Inc. Systems and methods for filtering and visualizing large scale datasets
US11314721B1 (en) 2017-12-07 2022-04-26 Palantir Technologies Inc. User-interactive defect analysis for root cause
US10783162B1 (en) 2017-12-07 2020-09-22 Palantir Technologies Inc. Workflow assistant
US10769171B1 (en) 2017-12-07 2020-09-08 Palantir Technologies Inc. Relationship analysis and mapping for interrelated multi-layered datasets
US11263382B1 (en) 2017-12-22 2022-03-01 Palantir Technologies Inc. Data normalization and irregularity detection system
US10877654B1 (en) 2018-04-03 2020-12-29 Palantir Technologies Inc. Graphical user interfaces for optimizations
US10754822B1 (en) 2018-04-18 2020-08-25 Palantir Technologies Inc. Systems and methods for ontology migration
US10885021B1 (en) 2018-05-02 2021-01-05 Palantir Technologies Inc. Interactive interpreter and graphical user interface
US10754946B1 (en) 2018-05-08 2020-08-25 Palantir Technologies Inc. Systems and methods for implementing a machine learning approach to modeling entity behavior
US11119630B1 (en) 2018-06-19 2021-09-14 Palantir Technologies Inc. Artificial intelligence assisted evaluations and user interface for same
US11126638B1 (en) 2018-09-13 2021-09-21 Palantir Technologies Inc. Data visualization and parsing system
US11294928B1 (en) 2018-10-12 2022-04-05 Palantir Technologies Inc. System architecture for relating and linking data objects
US11190603B2 (en) 2019-03-15 2021-11-30 International Business Machines Corporation Intelligent sampling of data generated from usage of interactive digital properties
US11947447B2 (en) * 2019-05-03 2024-04-02 Rainforest Qa, Inc. Systems and methods for evaluating product testing
US11567929B2 (en) * 2020-02-06 2023-01-31 Adobe Inc. Stitching event data using identity mappings

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1155262A (en) * 1997-08-05 1999-02-26 Hitachi Cable Ltd Remote network monitor device
US6285997B1 (en) * 1998-11-16 2001-09-04 International Business Machines Corporation Query optimization with deferred update and autonomous sources
US8271487B1 (en) * 1999-11-23 2012-09-18 Koninklijke Philips Electronics N.V. Hypervideo tracking and reporting system
JP2001195357A (en) * 2000-01-11 2001-07-19 Interactive Solutions:Kk Access history detection system and access history detection method
AU2001217524A1 (en) * 2000-01-12 2001-07-24 Jupiter Media Metrix, Inc. System and method for estimating prevalence of digital content on the world-wide-web
JP2002117206A (en) * 2000-07-28 2002-04-19 Toshiba Corp Web viewer analysis method, web viewer analysis program, recording medium and web viewer analysis system
US7216149B1 (en) * 2000-08-18 2007-05-08 International Business Machines Corporation Gathering enriched web server activity data of cached web content
JP2003058562A (en) * 2001-08-02 2003-02-28 Ncr Internatl Inc Method for dynamically constructing analysis by utilizing predictive model computer under analysis environment of interactive business
US20030154442A1 (en) * 2002-02-13 2003-08-14 Karen Papierniak Visualization tool for web analytics
US7143365B2 (en) * 2002-06-18 2006-11-28 Webtrends, Inc. Method and apparatus for using a browser to configure a software program
JP2004126937A (en) * 2002-10-02 2004-04-22 Nippon Telegr & Teleph Corp <Ntt> Access status display system, access state reference terminal, access state providing server, access state display method and access state display program
JP4260516B2 (en) * 2003-03-28 2009-04-30 富士通エフ・アイ・ピー株式会社 Advertisement distribution method, advertisement acquisition program
US8423634B2 (en) * 2004-05-24 2013-04-16 Neustar, Inc. System and method for determining cost of website performance

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of EP1894121A4 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9305105B2 (en) 2009-05-26 2016-04-05 Google Inc. System and method for aggregating analytics data
US8549019B2 (en) 2009-05-26 2013-10-01 Google Inc. Dynamically generating aggregate tables
WO2011028715A1 (en) * 2009-09-02 2011-03-10 Google Inc. Method and system for generating and sharing dataset segmentation schemes
US8412719B1 (en) 2009-09-02 2013-04-02 Google Inc. Method and system for segmenting a multidimensional dataset
US8751544B2 (en) 2009-09-02 2014-06-10 Google Inc. Method and system for pivoting a multidimensional dataset
US8543591B2 (en) 2009-09-02 2013-09-24 Google Inc. Method and system for generating and sharing dataset segmentation schemes
US8554699B2 (en) 2009-10-20 2013-10-08 Google Inc. Method and system for detecting anomalies in time series data
US8583584B2 (en) 2009-10-20 2013-11-12 Google Inc. Method and system for using web analytics data for detecting anomalies
US8972332B2 (en) 2009-10-20 2015-03-03 Google Inc. Method and system for detecting anomalies in web analytics data
US8359313B2 (en) 2009-10-20 2013-01-22 Google Inc. Extensible custom variables for tracking user traffic
US8713170B2 (en) 2011-11-18 2014-04-29 The Boeing Company Server-side web analytics system and method
EP2595060A1 (en) * 2011-11-18 2013-05-22 The Boeing Company Server-side web analytics system and method
EP3457285A1 (en) * 2011-11-18 2019-03-20 The Boeing Company Server-side web analytics system and method

Also Published As

Publication number Publication date
EP1894121A2 (en) 2008-03-05
CA2610953A1 (en) 2006-12-14
WO2006133218A3 (en) 2009-04-16
AU2006255068A1 (en) 2006-12-14
EP1894121A4 (en) 2010-06-16
US8341259B2 (en) 2012-12-25
US20070011304A1 (en) 2007-01-11
JP2008546105A (en) 2008-12-18

Similar Documents

Publication Publication Date Title
US8341259B2 (en) ASP for web analytics including a real-time segmentation workbench
US10318598B2 (en) One-click segmentation definition
US9171093B2 (en) User interface providing summary information or a status pane in a web analytics tool
JP5130222B2 (en) Website visit data set comparison
JP4620348B2 (en) User interface for web browser
JP5129742B2 (en) A technique for incrementally adding segmentation criteria to a dataset
US20120151329A1 (en) On-page manipulation and real-time replacement of content
EP1122661A1 (en) Improvements relating to data distribution
CN101233508B (en) One-click segmentation definition
CN101495996A (en) Asp for Web analytics including a real-time segmentation workbench

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680026631.4

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
ENP Entry into the national phase

Ref document number: 2008514974

Country of ref document: JP

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2610953

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006772335

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006255068

Country of ref document: AU

ENP Entry into the national phase

Ref document number: 2006255068

Country of ref document: AU

Date of ref document: 20060606

Kind code of ref document: A