WO2001022196A2 - Method and system for controlling a complementary user interface on a display surface - Google Patents

Method and system for controlling a complementary user interface on a display surface Download PDF

Info

Publication number
WO2001022196A2
WO2001022196A2 PCT/US2000/026118 US0026118W WO0122196A2 WO 2001022196 A2 WO2001022196 A2 WO 2001022196A2 US 0026118 W US0026118 W US 0026118W WO 0122196 A2 WO0122196 A2 WO 0122196A2
Authority
WO
WIPO (PCT)
Prior art keywords
region
user interface
display
displayed
operating system
Prior art date
Application number
PCT/US2000/026118
Other languages
French (fr)
Other versions
WO2001022196A3 (en
Inventor
D. David Nason
J. Scott Campbell
Philip Brooks
Carson Kaan
Thomas C. O'rourke
James Warnock
John Easton
Original Assignee
Xsides Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xsides Corporation filed Critical Xsides Corporation
Priority to AU79851/00A priority Critical patent/AU7985100A/en
Publication of WO2001022196A2 publication Critical patent/WO2001022196A2/en
Publication of WO2001022196A3 publication Critical patent/WO2001022196A3/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G1/00Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data
    • G09G1/06Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows
    • G09G1/14Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows the beam tracing a pattern independent of the information to be displayed, this latter determining the parts of the pattern rendered respectively visible and invisible
    • G09G1/16Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows the beam tracing a pattern independent of the information to be displayed, this latter determining the parts of the pattern rendered respectively visible and invisible the pattern of rectangular co-ordinates extending over the whole area of the screen, i.e. television type raster
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G1/00Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data
    • G09G1/06Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows
    • G09G1/14Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows the beam tracing a pattern independent of the information to be displayed, this latter determining the parts of the pattern rendered respectively visible and invisible
    • G09G1/16Control arrangements or circuits, of interest only in connection with cathode-ray tube indicators; General aspects or details, e.g. selection emphasis on particular characters, dashed line or dotted line generation; Preprocessing of data using single beam tubes, e.g. three-dimensional or perspective representation, rotation or translation of display pattern, hidden lines, shadows the beam tracing a pattern independent of the information to be displayed, this latter determining the parts of the pattern rendered respectively visible and invisible the pattern of rectangular co-ordinates extending over the whole area of the screen, i.e. television type raster
    • G09G1/165Details of a display terminal using a CRT, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2310/00Command of the display device
    • G09G2310/02Addressing, scanning or driving the display screen or processing steps related thereto
    • G09G2310/0232Special driving of display border areas
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/02Networking aspects
    • G09G2370/027Arrangements and methods specific for the display of internet documents

Definitions

  • the present invention relates to a method and system for controlling the display of information on a display surface and, in particular, to computer software that displays one or more user interfaces that can coexist with a standard user interface provided by the computer system.
  • Fig. 1 is a block diagram of a first embodiment of the present invention.
  • Fig. 2 is a block diagram of a second embodiment of the present invention.
  • Fig. 3 is a diagram of a standard display with an overscan user interface on all four borders of the display.
  • Fig. 4 is a block diagram of the basic components of the present invention.
  • Fig. 5 is a diagram of a cursor or pointer within the overscan user interface and the hotspot above it within the standard display.
  • Fig. 6 is a diagram of the usable border within the vertical overscan and the horizontal overscan surrounding the standard display.
  • Fig. 7 is an overview flow diagramshowing the operation of a preferred embodiment of the present invention.
  • Fig. 8 is a flow diagram of the sub-steps in Identify Display step 102 of Fig. 7.
  • Fig. 9 is a flow diagram of the sub-steps of changing the display resolution step 114 of Fig. 7.
  • Fig. 10 is a flow diagram of the sub-steps in the Paint the Display step 120 of Fig. 7.
  • Fig. 11 is a flow diagram of the sub-steps of Enable Linear Addressing step
  • Fig. 12 is a flow diagram of the sub-steps of the Process Message Loop of Fig. 7.
  • Fig. 13 is a flow diagram of the sub-steps of the Check Mouse and Keyboard Events step 184 in Fig. 12.
  • Fig. 14 is a flow diagram of the sub-steps of the Change Emulation Resolution step 115 in Fig. 7.
  • Fig. 15 is a diagram of a standard display of the prior art.
  • Fig. 16 is a diagram of a standard display with an overscan user interface in the bottom overscan area.
  • Fig. 17 is a diagram of a standard display including a desktop, an overscan user interface in the bottom overscan area and a context sensitive browser on the side.
  • Fig. 18 is a diagram of a standard display with an overscan user interface in the bottom and on the right overscan area.
  • Fig. 19 is a line drawing of a parallel GUI according to an example embodiment.
  • Fig. 20 is a simplified example of a menu tree.
  • Fig. 21 is a line drawing of a parallel GUI with an accessory container or cartridge.
  • Embodiments of the present invention provide computer-based methods and systems for displaying information on a display surface.
  • embodiments display information in a manner that is complementary to the resident operating system.
  • the information displayed may be coexistent with a user interface provided by the resident operating system.
  • embodiments may be embedded into a resident operating system and provide a primary interface to a display surface.
  • Embodiments provide a technique for controlling allocation and content of display space among one or more user interfaces, operating systems or applications permitting an application or parallel graphical user interface (GUI) to operate outside the desktop, the area designated for display of the operating system interface and it's associated applications.
  • GUI graphical user interface
  • a computer operating under the control of any utility operating system such as Microsoft WindowsTM, Linux, Apple O/S or Unix may have the allocation of visible display controlled by techniques of the present invention.
  • the operating system desktop may be scaled and/or moved to a specific area of the display permitting a parallel (or complementary) GUI to operate in the open area.
  • An example embodiment of the present invention may be an application operating under the primary or utility operating system or it may be combined with an operating system kernel to control the display and content in the parallel display.
  • a technique for adding and using a parallel graphical user interface adjacent to the standard user graphical display interface, for example in the border beyond the standard screen display area.
  • Conventional video systems such as VGA, SVGA and XGA video systems, include a defined border surrounding the display area. The original purpose of this border was to allow adequate time for the horizontal and vertical retrace of the electron gun in a cathode ray tube display.
  • the border which can be controlled as a user interface is a portion of what is known as the "overscan”.
  • Example embodiments include a method for presenting one or more additional or secondary user interfaces, for example, in the overscan area surrounding the conventional user interface display often called the desktop.
  • the electron gun in a CRT When the electron gun in a CRT retraces to the left of the screen or the top of the screen, it requires a significant amount of time relative to the presentation of a scanned line of data. During the retrace, the electron gun is turned off ("blanked"). If the blanking time required for the retrace is equal to the amount of time available, there is no usable overscan. However, modern monitors have become much faster in their retrace speeds, leaving a significant amount of time when the electron gun need not be blanked, allowing a displayable border. In the prior art, although the border is usually "black" (the gun is turned off), it is well known how to specify that the border shall be given any one of six colors. Standard BIOS allows a specification of this color.
  • the desired color is simply specified in one of the registers for the video controller. Typically no data for this color is stored in the buffer of video memory for the display.
  • An example embodiment of the present invention establishes an additional video buffer for the border and allows this buffer to be written with display data like the regular display buffer.
  • the display area is thereby expanded, on one or more edges, to provide a visible area previously invisible.
  • the pixels within this newly visible area of the display are made accessible to programs through an application programming interface (API) component of example embodiments of the present invention.
  • API application programming interface
  • a program incorporating a parallel graphical user interface may be displayed in the previously blanked area of the display, functionally increasing the accessible area of the display without hardware modification. In other cases the desktop may be increased or decreased to non-standard sizes
  • Other example embodiments of the present invention include a method for displaying an image on a video display system in an area outside of the primary display area generated by the video display system.
  • Two dimensions define the standard display area, each specifying a number of pixels. Selecting a video "mode" specifies these dimensions.
  • the method can be accomplished by adjusting parameters for the video display system to increase the number of pixels in at least one dimension of the display system.
  • the number of pixels which is added is less than or equal to the difference between the number of pixels specified in the video mode and a maximum number of pixels which the video display system can effectively display. Any such difference is defined here as the overscan area.
  • the overscan area may be the difference between the current desktop video mode and the display capability of the display device or more specifically, any portion of video memory unused when the operating system is in a given screen dimension. Because most interface displays are created by writing a desired image to a buffer or memory for the video display, the method requires allocating additional video display memory for the increased pixels. The image written to such memory is then displayed by the system alongside the original display area.
  • only the vertical dimension is increased and the overscan user interface is presented above or below the primary display area.
  • the horizontal dimension may be increased and the overscan user interface displayed to the right or the left of the primary display area.
  • the interface image may be displayed on any or all of the four sides of the primary display area.
  • a parallel (or complementary) GUI is provided that includes access to existing search engines and browsers.
  • the parallel GUI includes a search engine and/or browser.
  • a search engine and/or browser may be opened in either the overscan space or a space within or over the operating system user interface.
  • Embodiments of the present invention provide methods and systems for displaying information on a display surface in a manner that complements the display metaphor and technology provided by a resident operating system.
  • a complementary user interface is made operable within an existing system or is provided as a stand-alone environment.
  • the complementary user interface may coexist as a secondary graphical user interface ("GUI") with a primary user interface, such as conventional desktop GUI provided by the resident operating system.
  • GUI graphical user interface
  • the complementary user interface provided by such embodiments may be used, for example, to provide additional display screen real estate or to provide quick or continuous (“sticky”) access to selected applications.
  • the new user interface may provide access to a wide variety of capabilities, including, for example, continuous access to a user's favorite network locations on, for example, the Internet.
  • programming mechanisms and interfaces in a video display and control system such as computer system 7 or settop box 8 provide one or more parallel GUIs such as space 2C and/or space 4 in aTM display area such as display area 1 or display area 9 by providing access and visibility to a portion of the display otherwise ignored and/or inaccessible (hereinafter "overscan area").
  • Display areas such as display area 1 or display area 9 may be created on any type of analog or digital display hardware including but not limited to CRT, TFT, LCD and flat panel.
  • Alternate display content controller 6 interacts with the computer utility operating system 5B and hardware drivers 5C to control allocation of display space 1 and create and control one or more parallel graphical user interfaces such as context sensitive network browser (CSNB) 2 and internet pages 2A and 2B adjacent the operating system desktop 3.
  • Alternate display content controller 6 may be incorporated in either hardware or software.
  • an alternate display content controller may be an application running on the computer operating system, or may include an operating system kernel of varying complexity ranging from dependent on the utility operating system for hardware system services to a parallel system independent of the utility operating system and capable of supporting dedicated applications.
  • the alternate display content controller may also include content and operating software such as JAVA delivered over the Internet I or any other LAN.
  • the alternate display content controller may also be included in a television decoder/settop box such as box 8 to permit two or more parallel graphical user interfaces such as pages 9A and 9B to be displayed simultaneously.
  • Methods and systems of the present invention may be compatible with conventional television formats such as NTSC, PAL, PAL-C, SECAM and MESECAM.
  • content and software may be delivered over any conventional delivery medium 10 including but not limited to over the air broadcast signals 10A, cable IOC, optical fiber, and satellite 10B.
  • Fig.'s 1 and 2 will be referenced in more detail below.
  • Fig. 15 shows an example of a standard prior art display desktop generated by a Microsoft Windows 95TM operating system.
  • the desktop 31 Within the desktop 31 are the taskbar 32 and desktop icons 33.
  • a graphical user interface image is painted onto one or more of the sides of the overscan area as shown in Fig. 3.
  • Fig. 3 is a depiction of a Super VGA (SVGA) display with the addition of a graphical bar user interface displayed in the overscan area.
  • the overscan user interface bar 30 is defined to reside outside the borders of the "desktop" display area 31.
  • the display is modified to include a graphical user interface 30 in a bar 20-pixels high below the bottom edge.
  • the display is modified to include a graphical user interface in four bars each 20-pixels high/wide outside each of the four display edges: a bottom bar 30, a left side bar 34, a right side bar 36, and a top bar 38.
  • the overscan interface may include, and is not limited to, buttons, menus, application output controls (such as a "ticker window"), animations, and user input controls (such as edit boxes). Because the overscan interface is not obscured by other applications running within the standard desktop, the overscan interface may be constantly visible or it may toggle between visible and invisible states based upon any of a number of programming parameters (including, but not limited to, the state of the active window, the state of a toggle button, etc.).
  • Fig. 4 is a block diagram of the basic components of the present invention.
  • the operating system 63 Within the software component S are the operating system 63 and one or more applications such as application 61. Within the protected modes of modern systems, applications 61 do not have direct access to the video or Graphics Drivers 64 or hardware components such as the video card 66 which contains the video chipset 66A, 66B and 66C. Abstraction layers such as Application Interface (API) 60, and/or Direct API 62, provide limited access, often through the operating system 63.
  • API Application Interface
  • API Direct API
  • Embodiments of the present invention provide a technique for painting and accessing an area of the computer display not accessible, or used, in the operative desktop graphics modes.
  • the primary display area "desktop” is usually assigned by the operating system to be one of a set of pre-determined video "modes" such as those laid out in Tables 1 and 2 below, each of which is predefined at a specific pixel resolution.
  • the accessible area of the computer display may not be modified except by selecting another of the available predefined modes.
  • a displayed image is "overscanned". That is, the displayed video buffer data occupies less than the entire drivable screen size.
  • the drivable screen size is determined by the total amount of video memory and the operative video display characteristics.
  • the width of the usable overscan border depends on the amount of the horizontal overscan 52 reduced by the horizontal blanking 54 and the amount of the vertical overscan 53 reduced by the vertical blanking 55.
  • the nominal horizontal scan rate is 31.5 KHz (31,500 times per second) with a vertical scan rate of 60 Hz (60 frames per second). So the number of lines in one frame is 31,500/60, or 525. Because only 480 lines of data need to be displayed, there are 525-480, or 45, lines available for vertical overscan. Leaving a more than adequate margin for retrace, which requires only 2 lines worth of time, the preferred embodiment uses 20 lines for the alternate display. Thus the additional 23 unused but available lines may be used to increase the size of the operating system desktop to some non-standard size while still allowing two lines for retrace, or may be left blank, or may be used for one or more additional alternate parallel user interface displays.
  • the information display methods of a preferred embodiment of the present invention can be accomplished by achieving three requirements: (1) to address and modify the visible resolution of the video display system such that portions of the overscan area are visible as shown in Fig. 6,
  • Fig. 7 provides an example flow diagram of an implementation of a preferred embodiment of the present invention meeting the requirements described above.
  • the environment of this implementation is a standard Microsoft Windows 95TM operating environment, using Microsoft Visual C and Microsoft MASM for the development platform.
  • Microsoft Windows 95TM operating environment using Microsoft Visual C and Microsoft MASM for the development platform.
  • embodiments can perform on other other platforms and within other environments.
  • embodiments could be implemented within any graphical interface environment, such as X- Windows, OSF Motif, Apple OS, a Java OS, and others in which similar video standards (VGA, SVGA, XGA, 8514/ A) are practiced.
  • Type step 102 the program attempts to determine the display type, and current location in memory used by the display driver, in order to determine the size and locations of any display modifications to be made, e.g. to the size and location of overscan area(s) to be used.
  • the program first queries the hardware registry in Query Hardware Registry, step 131, to attempt to determine the registered display type. If successful, the program then determines compatibility information in Display Type Supported, step 135, to verify that the program supports that display type and determine memory allocation information.
  • the program may use an alternate approach, shown as subroutine Query hardware, steps 135 in Fig. 8, to query the BIOS, in step 134, and the video chipset 66, in step 136, for similar information as described immediately below.
  • BIOS is to be accessed in step 134
  • physical memory is first allocated in Allocate Physical Memory, step 132, and accessed using Microsoft's DPMI (DOS Protected Mode Interface) to map it to the linear memory address in which the BIOS resides in Use DPMI to assign BIOS linear address to physical memory, step 133.
  • DPMI DOS Protected Mode Interface
  • the program queries the BIOS in Read BIOS block, Search for VGA/XVA type and manufacturer ID, step 134. If successful, the driver and chipset are then further queried to determine the display type and memory location in Query driver/chipset for exact chipset, step 136.
  • compatibility information does not indicate a standard VGA, SVGA,
  • this routine returns a failure. If a known chipset manufacturer's identification is found, the driver and/or chipset may be queried with manufacturer-specific routines, step 136, to identify and initialize, as necessary, the specific chipset.
  • step 104 the program was unable to finally unable to identify the display type, either because the registry query in step 131 or the hardware query in step 135 was unsuccessful, the user may be prompted at Run in windowed mode, step 116, as to whether the program should continue to run as a standard "application bar” or "toolbar". The program may either exit or proceed to run as a toolbar on the desktop.
  • the controller registers 6H, 16H, 11H, 10H, 12H and 15H as shown in Fig.
  • CR registers 6H, 16H, 1 IH, 10H, 12H and 15H are first unlocked, as indicated in Unlock CRTC registers, step 108 in Fig. 7, to make them writeable. They are unlocked by clearing bit 7 in controller register 1 IH.
  • Addressing of video memory is accomplished through one of several means.
  • One is to use the standard VGA 64 Kb "hardware window", moving it along the video memory buffer 67 (Fig. 4) in 64Kb increments as necessary.
  • One example method is to enable linear addressing by querying the video chipset for the linear window position address, step 138 of Fig. 11. This 32-bit offset in memory allows the program to map the linear memory to a physical address, steps 140 and 142 of Figure 11, that can be manipulated programmatically.
  • step 114 and Fig. 9 the program can modify the size of the display, step 114 and Fig. 9, to include the border areas.
  • This routine first checks to determine whether or not the system is running in "toolbar" mode, step 144, and, if so, returns true. If not, it then determines whether to reset all registers and values to their original state, effectively returning the display to its original appearance, step 152. The determination is based upon a number of parameters, such as whether the current resolution, step 146, reflects a standard value or previous programmatic manipulation, step 148. If a standard resolution is already set, the variables are reset to include the specified border areas, step 150. The CR registers are adjusted, step 154, to modify the scanned and blanked areas of the display. If the top or side areas are modified, existing video memory is moved accordingly in step 162 of Fig. 10.
  • the program may prompt the user to determine whether "emulation" mode, step 13, or windowed mode step 116 should be used or if the program should exit at step 124.
  • embodiments of the present invention can be viewed as techniques for adding a secondary GUI by reconfiguring the actual display mode to add a modified, non-standard GUI mode in which the standard display size or resolution has been adjusted to include a secondary display in addition to the primary display.
  • a standard 640x480 display is modified in accordance with techniques of the present invention to become a larger display, one section of which corresponds to the original 640x480 display while another section corresponds to a 640x25 secondary GUI display.
  • resources are allocated for a secondary GUI by fooling the video driver into going to larger resolution. This technique automatically guarantees that enough space is kept clean, since the video driver allocates system resources according to the resolution that the video driver believes it will be operating in.
  • To operate one or more secondary user interfaces in one or more areas of the screen it is necessary to have the memory that was associated in video memory or in the frame buffer with that location, contiguously below the primary surface free and available.
  • the secondary user interface application may run such applet whenever resolutions will be switched, initializing the chip set pertinent to that particular applet. If the application finds an applet pertinent to the current particular chip set it will be launched.
  • the applet or minidriver initializes itself, performs the necessary changes to the driver's video resolution tables, forces a reenable, and sufficient space is subsequently available for one or more secondary user interfaces.
  • the driver allocates video memory as needed for the primary display according to the data on the UCCO resolution tables. Therefore, the modified values result in a larger allocation.
  • the driver will allow no outside access to the allocated memory.
  • the application can be sure that no internal or external use of the allocated memory location can conflict with the secondary user interface.
  • This method ensures that system resources will be allocated for one or more secondary user interfaces by writing an applet that would address the video driver in such a way as to force the video driver, on its next reenable, to allocate video memory sufficient for a resolution higher than the actual operating system resolution. This may also be done by modifying each instance of the advertised mode tables, and thus creating a screen size larger than the primary user interface screen size.
  • This technique has an additional benefit of eliminating the need to prevent the driver from actually shifting into the specified larger resolution, handing the primary user interface a larger display surface resolution.
  • the "hardware mode table,” a variant of the aforementioned video resolution tables, is not advertised and not accessible. Therefore, when the driver validates the new resolution, checking against the hardware mode table, it will always fail and therefore refuse to shift into that resolution. Because this technique modified the advertised video resolution tables early enough in the driver's process, allocated memory was modified, and memory addresses set before the failure in validate mode. Subsequently when the CRTCs are modified, in step 114, the driver is reserving sufficient memory for one or more secondary user interfaces and not making it available for any other process or purpose.
  • an enveloping driver is installed to sit above the existing driver and shims itself in between the hardware abstraction layer and the actual video driver in order to be able to handle all calls to the video driver and modify the driver and the driver's tables in a much more generic fashion rather than in a chipset specific fashion.
  • the enveloping driver shims into the primary video driver, transparently passing calls back and forth to the primary video driver.
  • the enveloping driver finds the video resolution tables in the primary video driver which may be in a number of locations within the driver.
  • the enveloping driver modifies the tables (for example, increasing 800 by 600 to 800 by 620). A 1024 by 768 table entry may become 1024 by 800.
  • the primary driver cannot validate the new resolution and therefore cannot actually change the display setting.
  • the driver allocated memory, allocated the cache space, determined memory address and moved cache and offscreen buffers as necessary. So the primary driver never uses all the space allocated, and will never draw in that space.
  • methods of the present invention may include three primary steps, finding or producing unused video memory, creating or expanding the overscan area, and putting data in the overscan area.
  • the step of finding or producing the unused video memory requires a review of the contents of the Controller Registers, the CR registers, used by VGA compatible chip sets or graphic boards to identify where the overscan area, the blanking, the vertical and horizontal total and the sinking should be set.
  • the CR defines the desktop display, how its synched, where it's laid out left and right, how much buffer area there would be on each side, where it would be stored within the video memory area.
  • a review of the contents of the CR data registers therefore fully defines and allows one to control the potential location and size of the overscan area.
  • the CRs may currently be used directly for systems with video display resolutions up to and including 1024 pixels in any dimension, that is, resolutions which can be defined in the generally accepted VGA standards by 10 bits per register.
  • new data is written into the CR using standard techniques such as the Inp and Outp, functions.
  • a standard video port and MMIO functions may also be used to modify the CRs.
  • 11 bits may be needed to properly define the resolution. There is currently no standard way in which the 11 th bit location is defined. Therefore, at a resolution above 1280 by 1024, for example, an understanding about the video card itself, particularly how the 11 bits representing the resolution are stored, is currently required and will be described below in greater detail.
  • the display is preferrably immediately reset to the appropriate resolution defaults, or the CR queried to determine if the total screen resolution as understood by the video card and drivers differs from the screen resolution known by the operating system display interface.
  • An overscan bar may already be displayed if the total screen resolution is not equal to one of the standard VGA or SVGA resolutions. In particular, if the total screen resolution is equal to a standard VGA/SVGA resolution plus the area required for the overscan bar or is greater than the resolution reported by the operating system display interface, the display is reset.
  • the resolution or display area can be extended in several different ways.
  • the overscan area can be added to the bottom, the top, or the right of the current display area, and optionally, the display area can be repositioned so that the overscan bar can remain centered in appearance.
  • the overscan area can be added anywhere and the original or desktop display area can be centered to improve appearance.
  • the height width of the display area required for the overscan bar is presented adjacent the desktop area stored in the CR and the combination is written into the CR, overwriting the previous data.
  • the screen typically shows a quick flash as it is placed in a different mode, including the desktop display area as well as a parallel GUI such as a display bar in the overscan area.
  • a black mask can be positioned over the new areas. The new menu data can then be safely written on top of the black mask so that the user never sees memory "garbage”.
  • a set of class objects is used, all derived from a common base class corresponding to the above described VGA-generic technique.
  • the first mechanism is an implementation of the VGA-generic technique. Using this mechanism, no information specific to a video-card is necessary, other than ensuring VGA support.
  • API application programming interface
  • primary and secondary surfaces are allocated. The new display data in the CR is simply the physical address at the start of the primary surface plus the number of pixels defined by the screen size.
  • Allocation of the primary surface will always be based on the entire screen display. Given the linear address of the allocated primary surface, from which a physical address can be derived, it can be extrapolated that the physical address of the location in video memory immediately adjacent to the primary surface is represented by the sum of the number of bytes of memory used to maintain the primary surface in memory plus the value of the physical address of the primary surface.
  • the size of the primary surface as represented in video memory can be determined. For example, the system looks in the CRs for the resolution of the screen, 800 by 600, in terms of number of bits per pixel, or bytes per pixel. Then any data stored in the CR representing any horizontal synching space is added. This is the true scan line length. The scan line length is a more accurate measurement of the width in a given resolution.
  • the physical address of the allocated secondary surface is derived from its linear address.
  • the allocated secondary surface is, in fact, allocated in the memory space contiguous to the primary surface (the value of the secondary surface physical address is equal to the value of the primary surface physical address plus the size of the primary), the secondary surface is determined to be the location in memory for the overscan display. If, however, the above is not true and the secondary surface is not contiguous to the primary surface, another approach mechanism is required.
  • the first mechanism determines how much physical area to allocate for the desktop allowing adjacent area for parallel GUI secondary space beyond that to display in the overscan area.
  • the newly allocated area will be the very first block of memory available. If this block immediately follows the primary surface, the physical address will correspond to the value associated with the physical address of the primary surface, plus the size of the primary surface. If that is true, the memory blocks are contiguous, this VGA-generic mechanism can be used.
  • VGA-generic mechanism If this first, VGA-generic mechanism cannot be used, the video card and driver name and version information retrieved from the hardware registry and BIOS, as described earlier, is used in conjunction with a look-up table to determine the best alternatives among the remaining mechanisms.
  • the table includes a set of standards keyed to the list of driver names found in the hardware registry.
  • a class object specific to the video chipset is instantiated based, directly or indirectly, on the VGA-generic object. If the hardware look up does not result in a reliable match, a reliability, or confidence, fudge factor may be used.
  • the hardware look up determines that an XYZ-brand device of some kind is being used, but the particular XYZ device named is not found in the look up table, a generic model from that chipset manufacturer many often be usable. If no information is available, the user may get a message indicating that the hardware is not supported and that the program cannot run in the overscan area. The user may then be queried to determine if the system should be operated in the "application- toolbar" mode, which basically runs with exactly the same functionality but in a windowed environment within the desktop rather than in the overscan area outside the desktop.
  • the next alternative mechanism uses surface overlays. The first step to this approach is to determine if the system will support surface overlays. A call is made to the video driver to determine what features are supported and what other factors are required. If surface overlays are supported, for example, there may be a scaling factor required.
  • a particular video card in a given machine using 2 megabytes of video RAM, might support unsealed surface overlays at 1024x768 at 8 bits per pixel, but not at 1024x768 at 16 bits per pixel because the bandwidth of the video card or the speed of the card, coupled with the relatively small amount of video memory would not be sufficient to draw a full width overlay. It is often horizontal scaling that is at issue, preventing the driver from drawing a full width overlay. An overlay is literally an image that is drawn on top of the primary surface. It is not a secondary surface, which is described above. Typically, the system sends its signal from the video driver to the hardware such that it merges the two signals together, overlaying a second signal on top of the first.
  • a secondary surface is allocated sufficient in size to encompass the normal desktop display area plus the overscan area to be used for display of the overscan bar or bars.
  • the allocated secondary surface does not have to be located contiguous in memory to the primary surface.
  • these approaches use more video memory than the others.
  • the first step is to allocate a secondary surface sufficient in size to contain the video display (the primary surface) plus the overscan area to be used. If the allocation fails, that means that there is not enough video memory to accomplish the task and this set of mechanisms is skipped and the next alternative tried.
  • a timer of very small granularity is used to execute a simple memory copy of in the contents of the primary surface onto the appropriate location of this secondary surface. The timer executes the copy at approximately 85 times per second.
  • This set of alternative mechanisms is a variant that uses the system page tables. This mechanism queries the system page tables to determine the current GDI surface address, that is, the physical address in the page table for the primary surface. A secondary surface is then created large enough to hold all of what is in the video memory plus the memory required for the overscan bar to be displayed. This surface address is then pushed into the system page table and asserted as the GDI surface address.
  • GDI reads from or writes to the primary surface through the driver, it actually reads from or writes the new, larger surface.
  • the overscan bar program can, subsequently, modify the area of the surface not addressed by GDI.
  • the original primary surface can be de-allocated and the memory usage reclaimed.
  • This mechanism being more memory-efficient than the previously described mechanism, is the preferred alternative. But the page tables solution will not work correctly on a chipset that includes a coprocessor device. If the initial device query reveals that the device does include a coprocessor, this variant mechanism will not be attempted.
  • VGA-generic mechanisms may vary when the video card requires more than ten bits to represent the video resolution in the CR. Some instances may require 11 bits.
  • Such registers typically do not use contiguous bytes, but use extension bits to designate the address information for the higher order bits.
  • the eleventh bit is usually specified in an extended CR register and the extended CR registers are usually chip specific.
  • a variation of the surface overlay mechanism includes a scaling factor, as described above. This alternative is handled in specific implementations through derived class objects and may be the preferred solution in certain situations.
  • FIG. 14 Another implementation of this technology uses a "hooking" mechanism as shown in Fig. 14. After the display driver is identified through the hardware registry or the BIOS, as described above, certain programming interface entry points into the driver are hooked such as at step 117. In other words, when the video system device interface, Windows GDI for example, calls those entry points into the display driver, the program can take the opportunity to modify the parameters being passed to the display driver, and/or to modify the values being returned from the display driver.
  • Windows GDI for example
  • the overscan bar program can allocate screen area in different ways in step 119:
  • step 121 by intercepting a resolution change request and identifying the next-higher supported screen resolution and passing that higher resolution to the display driver, then, when the display driver acknowledges the change, intercepting the returned value, which would reflect the new resolution, and actually returning the original requested resolution instead.
  • GDI requests a change from 640x480 resolution to 800x600 resolution; the overscan program intercepts the request and modifies it to change the display driver to the next supported resolution higher than
  • 800x600 say 1024x768.
  • the display driver will change the screen resolution to 1024x768 and return that new resolution.
  • the overscan program intercepts the return and instead passes the original request, 800x600, to GDI.
  • the display driver has allocated and displays a 1024x768 area of memory.
  • GDI and Windows will display the desktop in an 800x600 area of that display, leaving areas on the right and bottom edges of the screen available to the overscan program.
  • step 123 by intercepting only the return from the display driver and modifying the value to change the operating system's understanding of the actual screen resolution. For example, GDI requests a change from 800x600 resolution to 1024x768 resolution.
  • the overscan program intercepts the returned acknowledgment, subtracting 32 before passing the return on to GDI.
  • the display driver has allocated and displays a 1024x768 area of memory. GDI and Windows will display the desktop in an
  • the overscan bar program can display by: (1) using standard API calls to render the bar to an off-screen buffer, as described in the next section, and then hooking the "BitBlt" function entry point into the display driver in order to modify the offset and size parameters and subsequently redirect the BitBlt to the area outside of that which the API believes is onscreen.
  • the program determines the linear addresses for the off- desktop memory location(s) left available to it, and can render directly to those memory locations.
  • Phase 2 of the methods of embodiments of the present invention begins by painting the new images into a standard off-screen buffer, step 118, as is commonly used in the art, and making the contents visible, step 120, as described in Fig. 10. If the program is in "toolbar" mode, step 156, the off-screen buffer is painted into the standard window client space, step 166, and made visible, step 164, using generic windowing-system routines. Otherwise, the linear window position address is mapped, step 158, as described in Fig. 11 which has been previously explained. Once the linear memory is mapped to a physical memory address, step 142, the contents of the off-screen display buffer can be copied into the video buffer directly, step 154 of Fig. 10, or painted as to a secondary surface.
  • the preferred embodiment application includes a standard application message loop, step 122, which processes system and user events.
  • An example of a minimum functionality process loop is in Fig. 12.
  • the application handles a minimal set of system events, such as painting requests, step 170, system resolution changes, step 172, and activation/deactivation, step 174.
  • user events such as key or mouse events
  • step 184 detailed in Fig. 13.
  • System paint messages are handled by painting as appropriate into the off-screen buffer, step 178, and painting the window or display buffer, step 180, as appropriate, as described earlier in Fig. 10.
  • System resolution messages are received whenever the system or user changes the screen or color resolution.
  • the programs reset all registers to the correct new values, then change the display resolution, step 182, as earlier described in Fig. 9, to reflect the new resolution modified. User messages are ignored when the program is not the active application.
  • Fig. 13 describes a method of implementing user-input events.
  • cursor or mouse support there are three alternative mechanisms used to implement cursor or mouse support so that the user has a pointing device input tool within the overscan area user interface.
  • GDI's "cliprect” is modified to encompass the overscan bar's display area. That keeps the operating system from clipping the cursor as it moves into the overscan area. This change doesn't necessarily make the cursor visible or provide event feedback to the application, but is the first step.
  • Some current Windows applications continually reset the cliprect. It is a standard programming procedure to reset the cliprect after use or loss of input focus. Some applications use the cliprect to constrain the mouse to a specific area as may be required by the active application. Whenever the overscan display bar interface receives the input focus it reasserts the cliprect, making it large enough for the mouse to travel down into the overscan space.
  • the mouse can generate messages to the operating system reflecting motion within the expansion area.
  • GDI does not draw the cursor outside what it understands to be its resolution, however, and does not pass "out-of-bounds" event messages on to an application.
  • the overscan program uses a VxD device driver, and related callback function, to make hardware driver calls at ring zero to monitor the actual physical deltas, or changes, in the mouse position and state. Every mouse position or state change is returned as an event to the program which can graphically represent the position within the menu display bar.
  • An alternative mechanism avoids the need to expand the cliprect in order to avoid conflict with a class of device drivers that use the cliprect to facilitate virtual display panning.
  • the overscan program can determine "delta's", changes in position and state. Whenever the cursor touches the very last row or column of pixels on the standard display, it is constrained there by setting the cliprect to a rectangle comprised of only that last row or column. A "virtual" cursor position is derived from the deltas available from the input device. The actual cursor is hidden and a virtual cursor representation is explicitly displayed at the virtual coordinates to provide accurate feedback to the user. If the virtual coordinates move back onto the desktop from the overscan area, the cliprect is cleared, the virtual representation removed, and the actual cursor restored onto the screen.
  • a third alternative mechanism creates a transparent window that overlaps the actual Windows desktop display area by a predefined number of pixels, for example, two or four pixels. If the mouse enters that small, transparent area, the program hides the cursor. A cursor image is then displayed within the overscan bar area, at the same X-coordinate but at a Y-coordinate correspondingly offset into the overscan area. If a two-pixel overlap area is used, this method uses a granularity of two. Accordingly, this API-only approach provides only limited vertical granularity. This alternative mechanism assures that all implementations will have some degree of mouse-input support, even when cliprect and input device driver solutions fail.
  • Fig. 7 describes the cleanup mechanisms executed when the program is closed, step 124.
  • the display is reset to the original resolution, step 126, and the CR registers are reset to their original values, step 128, and locked, step 130.
  • alternate display content controller 6 may be modified and controlled.
  • Alternate display content controller 6 may be launched as a service, as an application, or as a user application.
  • alternate display content controller 6 may be launched as a service within the registry of utility operating system 5B.
  • the first kind of application is launched in the Run section in the registry, and the user application may be initiated from the Start Up Group within the Start button.
  • alternate display content controller 6 may be initiated any time from the first thing after graphics mode is enabled to the very last thing initiated.
  • alternate display content controller 6 may be visible shortly after utility operating system 5B such as Windows actually addresses the display, and how soon after depends on where alternate display content controller 6 is put it in the order of the things that will be launched as services. It may be possible to put alternate display content controller 6 so that it launches as essentially the first service and thus would launch almost at the same time as the drivers, very, very shortly after the drivers are launched. Accordingly, it is possible to have the screen change from text mode to graphics, draw the colored background, immediately re-display with the overscan addressed and a parallel GUI such as CSNB 2 display the very close to the same time as taskbar.
  • alternate display content controller 6 may be visible in display space 1 shortly after icons appear.
  • Example Secondary User Interfaces The following descriptions provide example user interfaces that can be implemented using methods and techniques of the present invention.
  • Appendices A, B, C, D, and E, incorporated herein by reference, include source code, descriptions, and visuals demonstrating many of these user interfaces, including for example, the XsidesTM application environment implement by The Pixel Company.
  • XsidesTM includes, among other capabilities, a cylindrical visualization of a secondary user interface, a Portal feature, and a Web Jump (NetSpace) feature that offers Internet browsing and searching capabilities.
  • the Portal feature can include any type of textual or graphical content envisioned by its implementer.
  • One example use of a portal area, as a personal information manager, is discussed in detail in Appendix D.
  • One skilled in the art will recognize that many other user interfaces can be realized by the methods, systems, and techniques of the present invention and that these interfaces may be available in conjunction with one another.
  • XsidesTM Application Environment Overview One skilled in the art will recognize that many other user interfaces can be realized
  • the XsidesTM environment is an embodiment of the methods and systems of the present invention. It offers a user interface that is:
  • Appendix B shows examples of some of these capabilities. Other examples of these capabilities and techniques provided by the user interface are provided in Appendices C and D.
  • XsidesTM is implemented by software that is independent of any underlying systems user interface. It resides "below” the operating system and “above” the drivers (if the system architecture is viewed from the drivers up through the application software). The software communicates directly to the driver level and adjusts video display parameters. It also allows keyboard and mouse events outside of the primary user interface supported by the operating system.
  • the technology can deliver, among other things, Internet content and services, third-party applications, Web browsers, personal Internet portals, advertisements, Web-based client-server applications and electronic program guides (EPGs). Because the xSidesTM Technology enables content and functionality to reside physically outside and control independent of the existing operating systems, such content and functionality do not interfere with and cannot be covered by the operating system or the applications that reside on the desktop.
  • the xSidesTM Technology is able to support interactive content and applications in a persistent fashion outside of the operating system because it resides outside of the operating system's control. Specifically, xSidesTM resides within an abstraction layer "below" the operating system and "above” the device drivers. As such, xSidesTM can adjust the parameters for the video display system, can increase the number of pixels and scan lines and can enable keyboard and mouse events within the xSidesTM area. This allows xSidesTM to dramatically resize the existing desktop, if desired, "uncovering" the majority of the display area around any or all four sides of the desktop, which we can then use to display content and applications.
  • An application programming interface (“API”) to the xSidesTM Technology allows developers to rapidly develop applications that take advantage of these unique characteristics of the technology.
  • the technology can potentially address every user of an Internet-enabled computer or TV worldwide.
  • consumer electronics operating systems i.e., Microsoft CE
  • portable daily planners and set-top boxes further expands our market opportunity.
  • the first products of xSidesTM Technology will be variations of co-branded mini-portals, which reside on the user's display area and feature the content and applications of our strategic partners. These products initially appear on the bottom of a computer screen as a thin cylinder icon (the "control bar") containing a series of control buttons.
  • the control bar is comprised of a number of faces, which we call “SidesTM,” each of which can contain different combinations of content, applications and graphics (hence the name xSidesTM). The user can easily rotate from one SideTM to the next with mouse clicks to view and access the different content present on a given SideTM.
  • the ability to rotate the xSidesTM interface to different faces expands the available computer display real estate and allows for compatibility among products licensed to different partners, enabling users to easily view and access whatever content they want.
  • the control buttons can perform a variety of tasks, including launching a Web connection or application, displaying tickers and banners of server- delivered content, or can allow the user to launch functions running in an additional xSidesTM display area called the xSidesTM Portal.
  • the xSidesTM Portal is an Internet display area below the xSidesTM control bar which can contain any html-based image or application, including email and instant messaging input and output, calendar and address book information, ISP controls, ad-banners, electronic programming guides and Web-based client-server applications.
  • the xSidesTM Portal is initially being used to build personal "desktop" Internet portals, which will be customized and distributed by Internet content and commerce providers, fee-based and free Internet service providers (ISPs), PC based Web application developers (ISVs) and hardware OEMs.
  • ISPs Internet service providers
  • ISVs PC based Web application developers
  • hardware OEMs hardware OEMs
  • merge An important feature of our xSidesTM products is the function we call "merge.” Merge allows users to upgrade their existing xSidesTM products to subsequent versions and to add or remove additional faces to their control bar at will. Essentially, merge enables users to make their xSidesTM product a convenient, one-stop destination for all of their favorite content and services. This is not only important and attractive to users, but also to our strategic partners who are able to introduce multiple faces, as well as upgrade their users to new applications and functionality over time. Although merge provides product convenience and flexibility for both users and strategic partners, in one preferred embodiment neither the original faces nor the persistent logos on an xSidesTM product can be "de-merged," giving strategic partners additional incentive to distribute the products.
  • the xSidesTM Technology adjusts parameters for the video display system to increase the number of pixels in at least one dimension of the display system and on one or more edges of the desktop. • Establishes additional video memory buffers for the newly visible area -
  • the number of scan lines and pixels which need to be added to the display is set by xSidesTM so that the video display system can display within the physical limitations of video RAM and monitor refresh.
  • display area 26 includes a parallel GUI 28 according to embodiments of the present invention.
  • Display area 26 may be located anywhere on screen 24S of video monitor 24.
  • display area 26 may be located adjacent edge 24T or edge 24B.
  • display area 26 may be located adjacent edge 24L or edge 24R.
  • Aspect ratio 34 of parallel GUI 28 is the relationship between dimension 32 measured along long axis L and dimension 30 expressed as 34:1 where aspect ratio 34 is determined by equation 36.
  • Aspect ratio 34 dimension 32 ⁇ dimension 30
  • parallel GUI 28 includes bar 38 surrounded by area 28 A.
  • Bar 38 may include one or more containers or cartridges such as cartridge 86 of Fig. 20.
  • Area 28A may be any color; in the example embodiment, area 28 A is black.
  • Bar 38 may be composed of separate elements such as title area 40, one or more help areas such as help area 42 and or help area 56, one or more rotators such as rotator 44 and or rotator 48, and one or more buttons such as button 46, button 50, ticker 52 and button 54.
  • a button may be depressible such as button 46 or non-depressible such as button 40.
  • a depressible button such as button 46 may perform an associated action and display highlighting when selected and clicked on using any conventional pointing device such as mouse 22.
  • a non-depressible button such as button 40 may act as a label and or initiate apparent rotation of the elements of bar 38 to the right of button 40 along with all the associated sound, apparent motion, and highlighting as described below.
  • button frame 62 may be changed such as by changing its color and thus the apparent intensity of emitted light.
  • the change evoked in a button frame such as button frame 62 may be localized to a portion of the button frame such as corner 62 A.
  • a 'mouse over' condition causes light to apparently emit from the lower left corner of the button frame such as corner 62B.
  • Clicking on or 'mouse down' condition of a depressible button such as button 46 may evoke apparent movement of the button and or apparent lighting changes adjacent the effected button.
  • 'mouse down' of a depressible button such as button 46 causes button 46 to apparently move into bar 38 and an apparent increase of light from behind button frame 62. Apparent motion and light emission changes may be accomplished by any conventional means.
  • buttons 46 Following a click on or 'mouse down' condition of a depressible button such as button 46 a 'mouse up' condition is initiated thus completing a button selection cycle.
  • a 'mouse up' condition may initiate an action such a hyperlink or launch an application associated with the acting button such as button 46.
  • a 'mouse up' condition may cause a button such as button 46 to reverse the apparent motion caused by the prior 'mouse down' condition, thus as in the prior example, button 46 apparently springs back out of bar 38 into alignment with bar 38.
  • a highlighting change of a selected button may also be included.
  • a post selection highlighting is the same as the earlier described 'mouse over' highlighting and is maintained until another button such as button 54 is selected or some other action within parallel GUI 28 is initiated.
  • Actuation of a complete button selection cycle on a non-depressible button such as button 50, a title button such as title area 40, or on a rotator such as rotator 44 may initiate rotation about long axis L of the display area.
  • a click of right mouse button 22R initiates rotation of 38 in a first direction D and a click of left mouse button 22L initiates rotation of 38 in a second direction U, opposite first direction D.
  • sound may be used to enhance the experience and thus heighten the similarity of a virtual metaphor to a real 3-dimensional device.
  • sound 66 may issue from the computer system, sound 66 may resemble a sound or sounds issued from a real device such as a subtle mechanical click. Any other appropriate sound or sounds may also be used.
  • a non-depressible button such as button 50 may be used a title button or a placeholder, and thus may not invoke a utility, URL or any other function if subjected to a complete button selection cycle. Accordingly, no highlighting or other special indicia would accompany a 'mouse over' condition of a non-depressible button such as button 50.
  • a non-depressible button such as button 50 may include the functionality of a rotator such as rotator 44 or 48.
  • a complete button selection cycle on such a non-depressible button would result in the apparent rotation of non-depressible button 50 and all the elements of bar 38 to its right such as ticker 52 and button 60.
  • Tickers such as ticker 52 may be dynamic reading areas within a cartridge such as cartridge 86 as shown in Fig. 20. Scrolling updateable text such as text 53 can be displayed and the text reading area can also be dynamically linked to launch an application or URL.
  • a ticker such as ticker 52 may be as long as a single button or any combination of multiple buttons.
  • the text such as text 53 that is displayed may be scrolling or otherwise made to move through ticker window 52A. In a currently preferred embodiment of the present invention text enters ticker window 52A at right side 52R and scrolls to the left to left side 52L.
  • the scrolling text such as text 53 may repeat in a loop at the end of the text string. Ticker text such as text 53 may be updated locally or over a network.
  • a ticker such as ticker 52 may activate a hyperlink through a network when ticker 52 is clicked on, or subjected to a complete button cycle.
  • Menu 70 includes title bands 72, 74, 76, 78 and 80 which correspond to title area 40, button 46, button 50, ticker 52 and button 54 respectively.
  • Rotators 44 and 48 are represented by bands 82 and 84, respectively.
  • title area 40 includes 6 containers or cartridges, cartridges 86, 87, 88, 89, 90 and cartridge 91. Many more cartridges and titles may be available, the number of cartridges or titles available may only be limited by the resources of the computer.
  • Cartridges such as cartridge 90 or cartridge 91 may include accessories such as a web browser or media player or any other accessory.
  • Accessories for a cartridge such as cartridge 90 may be installed for use with system software, or they may be components of the software implementing the parallel GUI, or they may be available via a network. Referring now to Fig. 21, parallel GUI 28 is shown with accessory cartridge
  • Accessory cartridge 90 may include function specific actuators such as fast forward or next track for a CD player.
  • a section of accessory cartridge 90 or any other cartridge selected may also be dedicated to a single function such as web browser 92, to permit the browser to remain visible at all times that parallel GUI software is running.
  • Cartridges such as cartridges 86-91 may be pre-loaded with links and accessories.
  • the elements or buttons of a cartridge may be blank for loading by a user through a "merge" capability (see Appendix E).
  • User cartridge(s) may include access to applications, documents, files, or network links such as URLs and or embedded functions.
  • Some embedded functions which may be launched from a cartridge may include a browser, an MP3 player, instant messaging, trading notices for marketplace functions, alerts for auction results and or trades, agent checking regarding price comparison searches.
  • User items such as applications, documents, files, or network links may be added to a user button via any conventional method such as copy and paste or drag and drop functions of system software or of any web browser.
  • user buttons may be renamed or cleared in any conventional manner.
  • a parallel GUI such as parallel GUI 28 may also include a help function.
  • Help screens or menus may be implemented in any conventional manner.
  • a map of the contents and organization of bar 38 may be provided in the form of a menu or tree such as menu 70 of Fig. 20.
  • Menu 70 and other help screens may extend from display area 26 in any conventional manner.
  • display area 26 includes 4 preset actuators 94. Activation of a complete button cycle on an actuator such as actuator 96 will rotate bar 38 to a pre-selected position.
  • a user may initially load, change or delete a preset setting associated with an actuator such as actuator 96.
  • the software implementing the parallel GUI may also include a screen saver component such as idle component 96. If parallel GUI 28 is notified that the system software is in idle, rather than blanking display area 26 as in some conventional techniques, parallel GUI 28 may auto rotate through all possible cartridge displays of menu 70. When the system software returns to active mode, bar 38 will automatically return to the last active position prior to idle. If parallel GUI 28 is oriented with a title cartridge, such as cartridge 86 with title 86A visible on title area 40, a complete button cycle of title area 40 as described above may result in apparent rotation of bar 38 and thus display an adjacent cartridge such as cartridge 87 or cartridge 85 (not shown). Title area 40 may also include all buttons and rotators to the right of title area 40 as well.
  • a title cartridge such as cartridge 86 with title 86A visible on title area 40
  • Title area 40 may also include all buttons and rotators to the right of title area 40 as well.
  • a complete button cycle of title area 40 changes the visible title such as title 86 and apparently rotates elements of bar 38 to the right of title area 40 such as rotator 44, rotator 48, button 46, button 50, ticker 52 and button 54.
  • the result of changing a cartridge and thus the title visible in title area 40 is that as cartridge 87 is visible, title 87A may be visible as well as a set of it's subordinate titles such as titles 87B, 87C, 87D and 87E. Additional cycling of title area 40 will result in display of additional cartridges and thus additional titles of band 72 such as titles 88 A and 89A.
  • a merge function may be included to allow cartridges such as cartridges 86-91 to be added to an existing parallel GUI such as parallel GUI 28.
  • a cartridge such as cartridge 86 may be added or merged with any existing cartridges in a parallel GUI such as parallel GUI 28 using any conventional technique such as copy and paste or drag and drop.
  • a merged cartridge such as cartridge 86 may be added between any two adjacent cartridges such as cartridges 88 and 89.
  • existing cartridges may be reordered using a conventional sort function. New cartridges may be merged or added to an existing parallel GUI from any conventional media such as magnetic storage media, optical storage media, or from network resources such as the Internet, or any local or intranet network.
  • a delete and or a sort function may also be included to permit a user to organize or personalize a bar such as bar 38 in parallel GUI according to their own wishes consistent with the parallel GUI software.
  • a user may go to a specific Internet site to peruse the applications available to be merged into the parallel GUI.
  • One such application is an application providing access to weather information over the WEB.
  • the user selects the application to be merged, and the parallel GUI automatically determines a set of cartridges provided by the application.
  • the parallel GUI software then merges the determined set of cartridges into the current data structure used to store data on the currently loaded cartridges.
  • any conventional data structure may be used, including arrays, hash tables, linked lists, and trees.
  • a data structure that allows easy replacement of entire cartridges, (such as cartridges stored as branches of a tree) is used.
  • the parallel GUI software may then update any related data structures whose information depends upon knowledge of the current set of available cartridges.
  • the technique of controlling the allocation of display area 1 is used to open a context sensitive network browser 2 (CSNB) adjacent but not interfering with operating system desktop 3 and/or parallel graphical user interface 4.
  • a display controller such as alternate display content controller 6 may include CSNB 2 thus permitting the browser to create and control a space for itself on display 1 which may not be overwritten by utility operating system 5B.
  • the combined controller/browser may be an application running on the computer operating system, or may include an operating system kernel of varying complexity ranging from dependent on the utility operating system for hardware system services to a parallel system independent of the utility operating system and capable of supporting dedicated applications.
  • the alternate display content controller/browser may also include content and operating software such as JAVA delivered over the Internet I or any other LAN.
  • Context sensitive interface such as network browser 2 may respond to movement and placement of cursor IC controlled by a pointing device such as mouse 1M anywhere on display area 1. The generation and control of a cursor across two or more parallel graphical user interfaces was described previously. The location of cursor IC will trigger CSNB 2 to retrieve appropriate and related network pages such as web page 2A. CSNB 2 may store the last X number of CSNB enabled network addresses for display offline. In a currently preferred embodiment of the present invention, X is ten pages. If a user is examining a saved CSNB enabled page offline, a mouse click on the page or a link on the page will initiate the users dial-up sequence and establish an online connection.
  • alternate display content controller 6 may include a browser or search engine.
  • space 2C may include an edit input box 2D.
  • Edit input box 2D may include conventional functionality's such as edit, copy, paste, etc..
  • a user may enter a URL into edit input box 2D using any conventional input device and then select a button to launch or initiate alternate display content controller 6 as a browser. This may be accomplished by using objects and or drivers from utility operating system 5B.
  • Initiating alternate display content controller 6 as a browser would include a simple window to display the URL as a live HTML document with all conventional functionality. By implementing alternate display content controller 6 as a little applet that uses that DLL, it may slide on, or slide off. Thus initiating alternate display content controller 6 as a browser is like a window into the Internet.
  • a user may enter any text into edit input box 2D using any conventional input device and then select a button to launch or initiate alternate display content controller 6 as a search engine.
  • search By entering a search string and selecting "search” and enter any string and click on “search” and pass that to any number from one to whatever or existing search engines, and subsequently have the search string acted on by one or more selected search engines and or by alternate display content controller 6 as a search engine. Resulting in multiple different windows appearing in some sort of stacked or cascaded or tiled format, with the different searches within them.
  • alternate display content controller 6 as a search engine or browser, the results or HTML document may be displayed in any overscan area or on the desktop.
  • a context sensitive network browser such as CSNB
  • tools 14 may also include a suite of tools such as tools 14 that may or may not have fixed locations on the browser space.
  • tools may include but are not limited to e-mail, chat, buddy lists and voice.
  • spaces such as desktop 14 A, web page 14B, secondary GUI 14C and browser 13 may be arranged in any convenient manner.
  • Hooking Mechanism The following describes the hooking mechanism used with xSides (an example embodiment) on an Intel 80386 (or greater) processor. This description of the Intel processor operations are simplified for clarity. This hooking mechanism is expected to work on most, if not all, compatible processors currently available.
  • the interrupt descriptor table associates each interrupt with a descriptor for the instructions that service the associated event. For example, when a software interrupt (INT 3) is generated (and interrupts are enabled), the Intel processor will suspend what it was currently doing, look up in the IDT for the appropriate entry (or interrupt vector) for the address of the code to execute to service this interrupt.
  • the code is known as the Interrupt Service Routine (ISR). It will start executing the ISR. When a Return From Interrupt instruction (IRET) is executed by the ISR, the processor will resume what is was doing prior to the interrupt.
  • ISR Interrupt Service Routine
  • the Intel 80386 microprocessor provides a set of system registers that are normally used for debugging purposes. The are technically referred to as Debug Registers. These registers allow control over execution of code as well as access over data.
  • Debug Registers These registers allow control over execution of code as well as access over data.
  • Registers are used in conjunction with exception code. There are four addresses registers (i. e.
  • DR7 control register
  • DR7 is used to control the type of access to a memory location that will generate an interrupt. For example, an exception can be raised for reading and or writing a specific memory location or executing a memory location (i. e. Code execution).
  • DR6 status register
  • the xSides implementation preferably first sets up the IDT to point our ISR to process INT 1 interrupts. Next, the address of the code that you want to hook (or the memory location of data, as in this case) is programmed into one of the address registers and the appropriate bits within the control register are set. When the x86 processor executes this instruction (or touches the memory location of data), the processor generates an INT 1. The processor will then invoke the Interrupt 1 ISR (as described above.) At this point, the ISR can do almost any kind of processor, code or data manipulation. When complete, the ISR executes an IRET instruction and the processor starts execution after the point of the INT 1 occurrence. Note that the interrupt code has no knowledge of the interruption.
  • This mechanism is expected to move the memory address used on some video systems for cache or hardware cursor. This should allow us to push the percentage of systems that support "overscan” mode to around 90% (in that this mechanism should work on approximately that number of machines).
  • API's application programming interfaces
  • API's application programming interfaces
  • Microsoft's DirectX and/or DirectDraw in place of the CRT Controller registers and/or direct access to the display buffer.
  • API's applications programming interfaces
  • Microsoft's DirectX and/or DirectDraw capable of direct driver and/or hardware manipulation, to create a second virtual display surface on the primary display with the same purpose, to display a separate and unobscured graphical user interface.
  • VxDs virtual device drivers
  • These could also include an API to provide applications with an interface to the modified display.
  • This technique may be used to control the desktop (i.e. Windows) to easily enable the desktop to operate in virtually any non-standard size limited only by the capability of the display hardware.
  • This may be in combination with parallel graphical user interface displays or exclusively to maximize the primary operating system desktop display area. This may not require any modification to the operating system.
  • the visual display area is conventionally defined by the values maintained in the CRTC registers on the chip and available to the driver.
  • the normally displayed area is defined by VGA standards, and subsequently by SVGA standards, to be a preset number of modes, each mode including a particular display resolution which specifies the area of the display in which the desktop can be displayed.
  • the desktop can only be displayed in this area because Windows does not directly read/write the video memory, rather it uses programming interface calls to the video driver. And the video driver simply reads/writes using an address that happens to be in video memory. So the value this mechanism needs to realize is the value the video card and driver assert is available for painting. This value is queried from the registers, modified by specific amounts and rewritten to the card. Subsequently, present embodiments change the area of writable visible display space without informing the operating system's display interface of the change
  • Embodiments of the present invention don't necessarily change the CRTCs to add just to the bottom. Preferably the top is also moved up a little. This keeps the displayed interfaces centered within the drivable display area. For example, rather than just add thirty- two scan lines to the bottom, the top of the display area is moved up by sixteen lines.
  • embodiments of the present invention depend solely upon the ability to change the CRTCs to modify the visible display area.
  • Alternative mechanisms define other methods of creating and accessing visible areas of the screen that are outside the dimensions of the desktop accessed by the operating system's display interface.
  • the secondary GUI may be positioned in areas not normally considered the conventional overscan area.
  • the secondary GUI may be positioned in a small square exactly in the center of the normal display in order to provide a service required by the particular system and application.
  • the techniques of reading and rewriting screen display information can be used to maintain the primary GUI information, or portions of it, in an additional memory and selectively on a timed, computed, interactive, or any or other basis, replace a portion of the primary GUI with the secondary GUI such as a pop-up, window, or any other display space.
  • a security system may require the ability to display information to a user without regard to the status of the computer system and/or require the user to make a selection, such as call for help by clicking on "911?".
  • Embodiments of the present invention could provide a video display buffer in which a portion of the primary GUI interface was continuously recorded and displayed in a secondary GUI for example in the center of the screen. Under non-emergency conditions, the secondary GUI would then be effectively invisible in that the user would not notice anything except the primary GUI.
  • an alarm monitor could cause the secondary GUI to present the "911?" to the user by overwriting the copy of the primary display stored in the secondary GUI memory.
  • a database of photographs may be stored and one recalled in response to an incoming phone call in which caller ID identified a phone number associated with a database photo entry.
  • embodiments of the present invention may provide one or more secondary user interfaces which may be useful whenever it is more convenient or desirable to control a portion of the total display, either outside the primary display in an unused area such as overscan or even in a portion of the primary GUI directly or by time division multiplexing, directly by communication with the video memory, or by bypassing at least a portion of the video memory to create a new video memory.
  • methods and systems of the present invention may provide one or more secondary user interfaces outside of the control of the system, such as the operating system, which controls the primary GUI. Additional user interfaces may be used for a variety of different purposes. For example, a secondary user interface may be used to provide simultaneous access to the Internet, full motion video, and a conference channel.
  • a secondary user interface may be dedicated to a local network or multiple secondary user interfaces may provide simultaneous access and data for one or more networks to which a particular computer may be connected.
  • Figure 1 xSidesTM resides outside of the computer desktop.
  • Figure 2 xSidesTM initially launches as a cylinder icon with rotating sides.
  • FIG. 3 The "PORTAL" button launches the xSidesTM Portal area.
  • FIG. 4 The xSidesTM Portal can contain any html-based image or application. Below are generic examples of an electronic programming guide and personal information management systems.
  • Section 1 xSides Portal Design & Feature Guidelines 4
  • Section 2 xSides SinglePack Design & Feature Guidelines 10
  • the xSides product initially appears on the bottom of a computer screen as a thin cylinder icon ("the control bar") containing a series of control buttons (see Page 8, Fig. 4).
  • the control bar is comprised of a number of faces, which we call “SidesTM,” each of which can contain different combinations of content, applications and graphics (hence the name "xSidesTM").
  • the user can easily rotate from one Side to the next with mouse clicks to view and access the different content present on a given Side.
  • xSides includes an additional display area called the xSidesTM Portal (see Figure 1). This portal expands below the bar and presents an area for companies to display HTML content (email, banner ads, tickers) outside of Windows. There are no design restrictions placed on content that goes into this portal display area.
  • xSides is designed to deliver a wide selection of consumer products available through a number of distribution sources such as online,
  • a skin is the packaging of graphical elements that make up a singular visual presentation style of xSides. These elements include a set of buttons (which exists on each xSide face), tickers etc. xSides products allow partners to modify their look and feel by either adopting one of the skins provided by The Pixel Company, or by designing their own.
  • the SinglePack product includes the xSides Portal feature and allows partners to build an xSides product that modifies functions of the latest Pixel technology, such as site launching, ticker messaging, and Help functions. Partners can modify the look and feel of xSides within defined parameters (outlined by The Pixel Company), or they can work directly with
  • PrePack contains The Pixel Company's pre-packaged partners as content on the bar.
  • the PrePack version will have limited functionality and modification abilities.
  • the xSides technology includes an expanded area where partners can display HTML content (tickers, links, banner ads).
  • the xSides Portal is available to strategic and content partners who wish to provide products and services to their users in an area that is always available and visible-without getting in the way of computer and Web functionality.
  • the Portal area functions exclusively with the xSides control bar (see Section 2, p. 10).
  • the xSides Portal launches underneath the bar, and responds to xSides commands, such as open, close, refresh, etc.
  • xSides itself functions as stated in Section 2 (p.10) of this document.
  • the Portal area will always be 70 pixels high x the horizontal resolution of the screen, minus 20 pixels on the right hand side of the Portal area reserved for user controls.
  • Constant Distributor logo The left-hand side of the xSides bar will display the Distributor's logo at all times and will remain visible throughout all rotations and uses of each of the bar's faces.
  • the xSides Portal gives users access to Web applications, sites and resource links, and tickers. Tickers display scrolling text that, when clicked on, can launch an associated Web page. Text and hyperlinks can be updated as defined in each Partner's contract
  • a user opens an xSides product which includes the Portal area, it can launch into its maximized view. This open option may be turned off by the user as well.
  • Each xSides control bar with the Portal feature will have a prominent "Portal” button on the Side. Once the product has been installed, the user clicks this button to show, refresh or hide the xSides Portal area.
  • Each Portal area also has a familiar "X" box in the upper right-hand corner. Clicking here will either launch the Portal, or make it retreat to show simply the desktop, and the xSides bar.
  • xSides Single Pack xSides provides Partners the option of changing the look and feel of xSides within The Pixel Company's guidelines. A specific set of buttons, or "skins,” give Partners a space to customize the way they appear on the xSides bar. Partners may also work with Pixel to have a unique skin built for them, on a for-hire basis, and time/resource permitting. The following restrictions apply to xSides presentation and function:
  • control bar will be the same for all xSides products. This will enable users to mix-and-match xSides bars as they wish, and as they discover new xSides applications in the marketplace.
  • Each xSides product will include two additional Sides--a "User” Side and a Help/Support Side. (See “User Cartridge” and “Upgrade and Support” sections, p. 17, 18.)
  • Preset Buttons The preset function allows users to "bookmark" specific Sides. Users can set a their selection (CD Player, News & Sports, etc) by right-clicking on the preset button when that particular Side is visible. Once this has been done, users can return to their pre-set destination by left-clicking on that button. Preset Buttons change color once a setting is saved.
  • Help/? When the user clicks on the Help/? button, a pop-up window is launched that contains Welcome, Map, Preferences, Help, and About xSides information.
  • Rotators When clicked, Rotators turn the portion of the bar to the right of the Rotator; left click turns to the next Side, right click turns back.
  • Pixel logo When cursing over over the Pixel Company/xSides logo, this animated graphic will rotate.
  • the logo button when clicked, links to The Pixel Company Web site.
  • the xSides PrePack design will use the standard xSides look, as shown in the example above--with the same feature functionality as the xSides Single Pack.
  • Partner Logo Partner logo is displayed here. A left mouse click links to Partner's Web page.
  • Non-Action buttons function only as title buttons or place holders. They don't launch or highlight and cannot be depressed with a mouse down or keyboard command.
  • Action buttons are depressible and launch Web links They highlight and function as described under Button Highlighting. (See “xSides Functions” section).
  • Ticker Tickers display scrolling text and, when clicked on, can link to an connecting Web page. Text and hyperlinks can be updated as defined in each partner's contract.
  • the xSides logo and branding is incorporated into the design of the product and the product's download button(s).
  • the xSides/Pixel logo and branding signify that a company uses The Pixel Company's patented technology.
  • the logo and branding can be used to enhance partner marketing materials, including brochures, presentations, and advertisements.
  • the Pixel C ⁇ and xSides logo and branding must be used according to the guidelines outlined in the deliverables. Any deviation from these guidelines must be approved by The Pixel Company.
  • the xSides bar appears, and the Distributor or Sub-Distributor cartridge is displayed-unless the user has set a different startup category under Preferences, accessed through the red "?” button
  • the Welcome screen appears when the cursor is moved anywhere over the xSides bar
  • Rotation Action The Rotator turns different elements of the bar A left-click turns the bar upward to the next face, and a right-click turns it downward to the previous one
  • the Rotator is the strip located on the left side of the bar, to the right of the red Help '"? "
  • the buttons to the right of the Rotator is the section that turns and changes
  • Action Buttons Action Buttons, when clicked, launch an associated function-application, URL, document, CD player, etc Buttons with no action function as title areas only, have no associated hyperlink, and do not highlight
  • Ticker Tickers display scrolling text and, when clicked on, can activate a hyperlink to launch an associated Web page Text and hyperlinks for tickers can be changed and updated Users will receive ⁇ he updated Ticker text and URL when they connect to the Web, and xSides is running on their machines
  • Pop-Up Window A pop-up window will launch when the user clicks on the "?” button. The pop-up will have tabs such as Welcome, Help, About, Map, and Preferences.
  • Screen Saver Mode The xSides bar slowly rotates through all content when the computer is in Screen Saver mode.
  • Pop-Up Help When the cursor rests over a button, a pop-up window appears.
  • Pop-up Help contain sub-level menus, descriptive text, and more.
  • the xSides upgrade/merge functionality provides some control and flexibility to the user, keeping the application fresh, useful and personalized, one side at a time.
  • xSides technology is designed to be delivered a la carte to users, with the advanced ability to allow users to add new product features and merge any xSides branded products they choose to any other previously installed xSides product(s). Users will be able to upgrade and merge their xSides products via download from our partners', or an xSides web site (under construction). The user will have full discretion to download any number of xSides products.
  • the Distribution partner maintains persistent branding and content throughout this merging situation.
  • the Distributor's logo and content remains in their current location no matter what other cartridges have been added or deleted. To remove the distributor branding and content, the user must completely uninstall the product.
  • xSides provides Partners the option of changing the look and feel of xSides within The Pixel Company's guidelines.
  • a specific set of buttons, or “themes,” gives Partners a space to customize the way they appear on the xSides bar.
  • Partners may also work with Pixel to have a unique theme built for them, on a for-hire basis, and time/resource permitting.
  • buttons are found in the User cartridge in xSides. This Cartridge allow users to customize buttons to suit their needs. xSides products come with seven User buttons
  • Buttons can be added to User Cartridges in a number of ways. Users may add links thereby creating buttons by dragging and dropping (or copying and pasting) into user button frame.
  • Additional bonus User bars can be added to the User Cartridge when installing another Partner cartridge (each partner cartridge contains a User section The new User bar is added, titled with the partner's name, containing the link that was just selected.
  • Each xSides product has a cartridge specifically designated for support and upgrade use. Using these cartridges the user can access links to frequently asked questions, upgrade pages where other xSides products can be found, and receive news and information about xSides products.
  • This cartridge has one rotation containing a combination of button links and tickers.
  • the xSides product will contain a cartridge that will allow Internet searching, browsing, and display outside of the desktop screen.
  • the user will be able to "jump" to areas of the Web without needing to be online, or a browser running.
  • Full navigation function is available to the user in a. "full view” mode, which presents the Web in the largest display window ever developed.
  • Search The bar will first launch in Search mode. This mode will present a side of the bar that holds an entry field for the user to type in search requests, or URL Jump requests.
  • search There will be two search functions: Search and Ask.
  • the Search function will launch the default browser, initiate the search using the default search engine, and display the results.
  • Ask will accept plain English language requests and post results.
  • the user can jump to any location by typing in a standard URL request with either "http:” or "www.” at the beginning of the request. If the user presses the Enter key, the program will recognize this as either a search or jump request, and initiate the action.
  • a "Full View” button will change the look of the bar, so that full Web navigation functions are displayed.
  • the default browser When the user types a request in the Input Field, the default browser will be launched in Full View, a pure Web display area with no navigation bars. The user will now navigate using the buttons in the xSides area. Clicking on the Full View button again allows the user to return to Search View.
  • This button performs a search on the information typed into the input field.
  • xSides' Web Jump will work with the user's default browser application The user will launch the xSides Web Jump while in one of three states
  • the xSides browser will launch the user's default browser and will mirror its functionality consistent with the user's understanding and expectation Therefore, Web Jump will tie into the information stored on the system registry files, or in the shared data files of the user's default browser
  • Scenario #1 The user is working offline With the xSides browser displayed on the bottom of the screen, the user types a question into the input field and hits Search The logon sequence will begin and a Full View Web window will fill the screen The user will then navigate by using the controls on the browser bar (The user will actually be using his default browser functionality, even though its recognizable function bars wilt not be visible )
  • Scenario #2 The user is online and has no browser running Same as above, except no logon sequence
  • Scenario #3 The user is online and has browser running xSides browser will duplicate functions of the Web browser, including Favorites, Home, and other user oriented information The user will be able to access the same information, in the same display format, by clicking on the same button in each area
  • the xSides "Favorites" area will read files from the user's default browser As new URL links are added to the user's default browser, they are also added to the xSides Favorites section, and visa versa Clicking on the Favorites button in the xSides Browser area will bring up the same dialogue box as those in I E or Netscape
  • Pop up Help may contain cascading menus, descriptive text, etc
  • Both the Search bar and the Browsing bar will have a A Full View button displayed on the right of the Input Field.
  • the screen will expand so the entire viewing ares will be filled with the Web window, without any borders, toolbars, navigation buttons, etc.
  • xSides Search mode with Standard browser functionality With Search mode the user's default browser will function normally. Users will now simply have the choice of having a Full View mode, in addition to the standard maximize and minimize modes within Windows. When the user is in the Search bar and clicks the Full View button, xSides will rotate to the Full View browsing controls where the user can navigate the web with an expanded Browser viewing area.
  • This project is designed to convert the calendar and other appropriate features/tools from the Apartment; plus new tools, into an extended (portal) side for the xSides bar. These features/tools fall under the category of Personal Information Management. The title of the actual side is still up in the air at this point.
  • Min Processor 486DX/66 PC (Pentium® or higher recommended)
  • the user will download a single xSides side that is the PIM or will download a prepack that includes the PIM or another name yet to be determined, that denotes the idea of managing their personal information.
  • a prepack that includes the PIM or another name yet to be determined, that denotes the idea of managing their personal information.
  • the category title area on the left-hand side of the side will contain the title: "PIM” or "Info Manager” or another name to be specified.
  • the Info Manager side includes the following buttons from left to right: Calendar, Contacts, Calculator, Memo, Daily News, Newsstand, Apartment. With the exception of the Apartment button, if a user clicks on a button, it causes the associated portal to appear in the portal area beneath the bar. (Clicking on the Apartment button causes the Apartment to launch full screen in the browser above the bar.)
  • the first button to the right of the category title area will be labeled "Calendar”.
  • the Calendar button When the user clicks on the Calendar button the following information will appear from left to right, in the extended portal area below the bar:
  • the current date is displayed on the left side of the Calendar portal area.
  • Clicking on the Full-Size link causes the existing calendar to launch in a browser window above the bar for a more extensive view of events.
  • Clicking on the To-do List causes the user's ongoing To-Do list to appear in the portal area in the same space where the Scheduled Events list appears.
  • This section is non-date specific, and can be prioritized.
  • This area is also scrollable and includes the same edit controls as the Scheduled Events list: ADD, EDIT SELECTED AND DELETE SELECTED.
  • To the right of the To-Do list is a 100 x 70 banner ad space.
  • the next button to the right is the Contacts button. When the user clicks on this button it will launch their address book in the portal area. They will see the following features, from left to right, in the portal area below the bar:
  • the alphabetical directory has controls to ADD, EDIT SELECTED and DELETE SELECTED.
  • To add a name the user clicks ADD. This presents the current calendar's ADD/CHANGE form. They then fill in the information and click on SUBMIT ENTRY CHANGES.
  • To EDIT an entry the user selects a listing in the box to the right and then clicks on EDIT SELECTED. This brings up the Add/Change form for that listing.
  • DELETE a listing the user selects the listing and then clicks on DELETE SELECTED.
  • the next window presents the Search by Name feature. This is part of the functionality of the existing calendar.
  • the user types in a first or last name and clicks on search to search their directory of contacts.
  • the results appear in the scrollable listing area to the left.
  • the next button to the right of Contacts is the Calculator button. When the user clicks on this button they will see the following features, from left to right, in the portal area:
  • To the right of the display is an onscreen representation of a traditional keypad.
  • the user can enter numbers and functions here by clicking on a number or function on the onscreen keypad or by using their actual keypad.
  • the next section to the right consists of a series of pull down menus used to create conversions for example; the user could select miles in the left-hand column and feet in the right hand column.
  • the Calculate button the answer appears in the space below.
  • the fourth button on the PIM bar launches the Memo feature in the portal area. This is a tool the user can use to write short notes about any topic to themselves. It could be a list of gifts to buy or a book they heard about or design ideas, etc.
  • the Memo portal from left to right includes the following:
  • the white area is the space where the user enters their memo content.
  • Each memo has a number, (like a page number), associated with it. The user can select a number from the list across the top of the Input Retrieval area to see a specific memo.
  • a user can also retrieve a memo using the Search area. They simply type a word they remember using in the memo, into the Search box and click on the Search button. The result of the Search appears in the white area. They use the Search Results button to page through various pages of results. 2.1.6 Daily News:
  • the Fifth button on the bar is Daily News Clicking on this button presents the headlines from the current MO Daily News to appear in the portal area We already have this functionality working for the genenc beta so all that may be required here is a slight design change to make this feature appear consistent with the rest of the PIM portals
  • the Daily News portal will contain a menu listing each of the major sections of the Daily, such as News, Sports, Weather, etc (Please disregard the beige menu on the far left This will not be included )
  • the sixth button on the PIM side is the NewsStand button. Clicking on this button presents a graphic of the current MO newsstand (also called magazine rack) to appear in the portal area. Each magazine links directly to that publication's online ezine or publication. We already have this functionality working for the generic beta and the design should be final.
  • the last button on the PIM side is the Apartment button. Clicking on this button launches the Apartment full screen in a browser above the bar. This Apartment would be the same as the current Apartment offered through MO.
  • xSides Distributor A has an Entertainment Category
  • xSides Distributor B has an Entertainment category
  • distribution B will replace distributor A's Entertainment category
  • Deletion will be allowed When the Marketplace version is available and installed by the user. Deletion will happen by User choice at the Side level after the application has been installed and they have connected to Marketplace through the xSides interface in Help/Pref/Map/Marketplace area. The user will be presented with a list of currently installed bars along side the other bars the user can install, This dialog also provides that the user can select from the list of currently installed bars and select to remove them.

Abstract

An alternate display content controller provides a technique for controlling a video display separately from and in addition to the content displayed on the operating system display surface. Where the display is a computer monitor, the alternate display content controller interacts with the computer utility operating system and hardware drivers to control allocation of display space and create and control one or more parallel graphical user interfaces adjacent the operating system desktop. An alternate display content controller may be incorporated in either hardware or software. As software, an alternate display content controller may be an application running on the computer operating system, or may include an operating system kernel of varying complexity ranging from dependent on the utility operating system for hardware system services to a parallel system independent of the utility operating system and capable of supporting dedicated applications. The alternate display content controller may also include content and operating software delivered over the internet or any other LAN. The alternate display content controller may also be included in a television decoder/settop box to permit two or more parallel graphical user interfaces to be displayed simultaneously.

Description

METHOD AND SYSTEM FOR CONTROLLING A COMPLEMENTARY USER INTERFACE ON A DISPLAY SURFACE
TECHNICAL FIELD
The present invention relates to a method and system for controlling the display of information on a display surface and, in particular, to computer software that displays one or more user interfaces that can coexist with a standard user interface provided by the computer system.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a block diagram of a first embodiment of the present invention. Fig. 2 is a block diagram of a second embodiment of the present invention.
Fig. 3 is a diagram of a standard display with an overscan user interface on all four borders of the display.
Fig. 4 is a block diagram of the basic components of the present invention.
Fig. 5 is a diagram of a cursor or pointer within the overscan user interface and the hotspot above it within the standard display.
Fig. 6 is a diagram of the usable border within the vertical overscan and the horizontal overscan surrounding the standard display.
Fig. 7 is an overview flow diagramshowing the operation of a preferred embodiment of the present invention. Fig. 8 is a flow diagram of the sub-steps in Identify Display step 102 of Fig. 7.
Fig. 9 is a flow diagram of the sub-steps of changing the display resolution step 114 of Fig. 7.
Fig. 10 is a flow diagram of the sub-steps in the Paint the Display step 120 of Fig. 7. Fig. 11 is a flow diagram of the sub-steps of Enable Linear Addressing step
112 of Fig. 7.
Fig. 12 is a flow diagram of the sub-steps of the Process Message Loop of Fig. 7. Fig. 13 is a flow diagram of the sub-steps of the Check Mouse and Keyboard Events step 184 in Fig. 12.
Fig. 14 is a flow diagram of the sub-steps of the Change Emulation Resolution step 115 in Fig. 7. Fig. 15 is a diagram of a standard display of the prior art.
Fig. 16 is a diagram of a standard display with an overscan user interface in the bottom overscan area.
Fig. 17 is a diagram of a standard display including a desktop, an overscan user interface in the bottom overscan area and a context sensitive browser on the side. Fig. 18 is a diagram of a standard display with an overscan user interface in the bottom and on the right overscan area.
Fig. 19 is a line drawing of a parallel GUI according to an example embodiment.
Fig. 20 is a simplified example of a menu tree. Fig. 21 is a line drawing of a parallel GUI with an accessory container or cartridge.
SUMMARY OF THE INVENTION
Embodiments of the present invention provide computer-based methods and systems for displaying information on a display surface. When a resident operating system is present, embodiments display information in a manner that is complementary to the resident operating system. The information displayed may be coexistent with a user interface provided by the resident operating system. In addition, embodiments may be embedded into a resident operating system and provide a primary interface to a display surface.
Embodiments provide a technique for controlling allocation and content of display space among one or more user interfaces, operating systems or applications permitting an application or parallel graphical user interface (GUI) to operate outside the desktop, the area designated for display of the operating system interface and it's associated applications. In an example embodiment, a computer operating under the control of any utility operating system such as Microsoft Windows™, Linux, Apple O/S or Unix may have the allocation of visible display controlled by techniques of the present invention. The operating system desktop may be scaled and/or moved to a specific area of the display permitting a parallel (or complementary) GUI to operate in the open area. An example embodiment of the present invention may be an application operating under the primary or utility operating system or it may be combined with an operating system kernel to control the display and content in the parallel display.
Also, in some embodiments, a technique is provided for adding and using a parallel graphical user interface adjacent to the standard user graphical display interface, for example in the border beyond the standard screen display area. Conventional video systems, such as VGA, SVGA and XGA video systems, include a defined border surrounding the display area. The original purpose of this border was to allow adequate time for the horizontal and vertical retrace of the electron gun in a cathode ray tube display. However, with the advent of LCD displays and as retrace speeds have increased in modern monitors, it is now possible to present a user interface display in this border. The border which can be controlled as a user interface is a portion of what is known as the "overscan". Example embodiments include a method for presenting one or more additional or secondary user interfaces, for example, in the overscan area surrounding the conventional user interface display often called the desktop.
When the electron gun in a CRT retraces to the left of the screen or the top of the screen, it requires a significant amount of time relative to the presentation of a scanned line of data. During the retrace, the electron gun is turned off ("blanked"). If the blanking time required for the retrace is equal to the amount of time available, there is no usable overscan. However, modern monitors have become much faster in their retrace speeds, leaving a significant amount of time when the electron gun need not be blanked, allowing a displayable border. In the prior art, although the border is usually "black" (the gun is turned off), it is well known how to specify that the border shall be given any one of six colors. Standard BIOS allows a specification of this color. The desired color is simply specified in one of the registers for the video controller. Typically no data for this color is stored in the buffer of video memory for the display. An example embodiment of the present invention establishes an additional video buffer for the border and allows this buffer to be written with display data like the regular display buffer. The additional video buffer is often present but unused in the graphics systems of most computers because video memory is usually implemented in sizes that are powers of 2 e.g. "512K", whereas standard desktop dimensions are not "e.g. 640x480=300K". The display area is thereby expanded, on one or more edges, to provide a visible area previously invisible. The pixels within this newly visible area of the display are made accessible to programs through an application programming interface (API) component of example embodiments of the present invention. A program incorporating a parallel graphical user interface may be displayed in the previously blanked area of the display, functionally increasing the accessible area of the display without hardware modification. In other cases the desktop may be increased or decreased to non-standard sizes.
Other example embodiments of the present invention include a method for displaying an image on a video display system in an area outside of the primary display area generated by the video display system. Two dimensions define the standard display area, each specifying a number of pixels. Selecting a video "mode" specifies these dimensions. The method can be accomplished by adjusting parameters for the video display system to increase the number of pixels in at least one dimension of the display system. The number of pixels which is added is less than or equal to the difference between the number of pixels specified in the video mode and a maximum number of pixels which the video display system can effectively display. Any such difference is defined here as the overscan area. Thus, the overscan area may be the difference between the current desktop video mode and the display capability of the display device or more specifically, any portion of video memory unused when the operating system is in a given screen dimension. Because most interface displays are created by writing a desired image to a buffer or memory for the video display, the method requires allocating additional video display memory for the increased pixels. The image written to such memory is then displayed by the system alongside the original display area.
In other example embodiments, only the vertical dimension is increased and the overscan user interface is presented above or below the primary display area. Alternatively, the horizontal dimension may be increased and the overscan user interface displayed to the right or the left of the primary display area. Similarly, the interface image may be displayed on any or all of the four sides of the primary display area.
In still other example embodiments, a parallel (or complementary) GUI is provided that includes access to existing search engines and browsers. In another embodiment, the parallel GUI includes a search engine and/or browser. A search engine and/or browser may be opened in either the overscan space or a space within or over the operating system user interface.
These and other features and advantages of embodiments of the present invention will become further apparent from the detailed description and accompanying figures that follow.
DESCRIPTION OF THE INVENTION
Embodiments of the present invention provide methods and systems for displaying information on a display surface in a manner that complements the display metaphor and technology provided by a resident operating system. Using techniques of embodiments of the present invention, a complementary user interface is made operable within an existing system or is provided as a stand-alone environment. The complementary user interface may coexist as a secondary graphical user interface ("GUI") with a primary user interface, such as conventional desktop GUI provided by the resident operating system. The complementary user interface provided by such embodiments may be used, for example, to provide additional display screen real estate or to provide quick or continuous ("sticky") access to selected applications. The new user interface may provide access to a wide variety of capabilities, including, for example, continuous access to a user's favorite network locations on, for example, the Internet.
Referring now to Fig.'s 1 and 2, in a preferred embodiment, programming mechanisms and interfaces in a video display and control system such as computer system 7 or settop box 8 provide one or more parallel GUIs such as space 2C and/or space 4 in a™ display area such as display area 1 or display area 9 by providing access and visibility to a portion of the display otherwise ignored and/or inaccessible (hereinafter "overscan area"). Display areas such as display area 1 or display area 9 may be created on any type of analog or digital display hardware including but not limited to CRT, TFT, LCD and flat panel.
Alternate display content controller 6 interacts with the computer utility operating system 5B and hardware drivers 5C to control allocation of display space 1 and create and control one or more parallel graphical user interfaces such as context sensitive network browser (CSNB) 2 and internet pages 2A and 2B adjacent the operating system desktop 3. Alternate display content controller 6 may be incorporated in either hardware or software. As software, an alternate display content controller may be an application running on the computer operating system, or may include an operating system kernel of varying complexity ranging from dependent on the utility operating system for hardware system services to a parallel system independent of the utility operating system and capable of supporting dedicated applications. The alternate display content controller may also include content and operating software such as JAVA delivered over the Internet I or any other LAN.
The alternate display content controller may also be included in a television decoder/settop box such as box 8 to permit two or more parallel graphical user interfaces such as pages 9A and 9B to be displayed simultaneously. Methods and systems of the present invention may be compatible with conventional television formats such as NTSC, PAL, PAL-C, SECAM and MESECAM. In this configuration content and software may be delivered over any conventional delivery medium 10 including but not limited to over the air broadcast signals 10A, cable IOC, optical fiber, and satellite 10B.
Fig.'s 1 and 2 will be referenced in more detail below.
Fig. 15 shows an example of a standard prior art display desktop generated by a Microsoft Windows 95™ operating system. Within the desktop 31 are the taskbar 32 and desktop icons 33. In a preferred embodiment of the present invention, a graphical user interface image is painted onto one or more of the sides of the overscan area as shown in Fig. 3. Fig. 3 is a depiction of a Super VGA (SVGA) display with the addition of a graphical bar user interface displayed in the overscan area. The overscan user interface bar 30 is defined to reside outside the borders of the "desktop" display area 31. In Fig. 16, the display is modified to include a graphical user interface 30 in a bar 20-pixels high below the bottom edge. In Fig. 3, the display is modified to include a graphical user interface in four bars each 20-pixels high/wide outside each of the four display edges: a bottom bar 30, a left side bar 34, a right side bar 36, and a top bar 38.
The overscan interface may include, and is not limited to, buttons, menus, application output controls (such as a "ticker window"), animations, and user input controls (such as edit boxes). Because the overscan interface is not obscured by other applications running within the standard desktop, the overscan interface may be constantly visible or it may toggle between visible and invisible states based upon any of a number of programming parameters (including, but not limited to, the state of the active window, the state of a toggle button, etc.).
Fig. 4 is a block diagram of the basic components of the present invention. Within the software component S are the operating system 63 and one or more applications such as application 61. Within the protected modes of modern systems, applications 61 do not have direct access to the video or Graphics Drivers 64 or hardware components such as the video card 66 which contains the video chipset 66A, 66B and 66C. Abstraction layers such as Application Interface (API) 60, and/or Direct API 62, provide limited access, often through the operating system 63.
Embodiments of the present invention provide a technique for painting and accessing an area of the computer display not accessible, or used, in the operative desktop graphics modes. In the Microsoft Windows environments (including Microsoft Window 95 and derivatives, and Microsoft Windows NT 4.0 and derivatives) and other contemporary operating environments, the primary display area "desktop" is usually assigned by the operating system to be one of a set of pre-determined video "modes" such as those laid out in Tables 1 and 2 below, each of which is predefined at a specific pixel resolution. Thus, the accessible area of the computer display may not be modified except by selecting another of the available predefined modes.
TABLE 1 : ROM BIOS VIDEO MODES
Figure imgf000009_0001
Figure imgf000010_0001
Figure imgf000011_0001
As shown in Fig. 6, a displayed image is "overscanned". That is, the displayed video buffer data occupies less than the entire drivable screen size. The drivable screen size is determined by the total amount of video memory and the operative video display characteristics. The width of the usable overscan border depends on the amount of the horizontal overscan 52 reduced by the horizontal blanking 54 and the amount of the vertical overscan 53 reduced by the vertical blanking 55.
In a first preferred embodiment, only a border at the bottom of the standard display area is used. Consequently, only the vertical control parameters for the cathode ray tube (CRT) controller, shown as Control Registers 6H, 16H, 11H, 10H, 12H and 15H in Fig. 4 need to be adjusted. These parameters and others are shown in Table 3 below:
TABLE 3: VERTICAL TIMING PARAMETERS FOR CR PROGRAMMING.
Figure imgf000012_0001
In the standard 640x480 graphics mode, the nominal horizontal scan rate is 31.5 KHz (31,500 times per second) with a vertical scan rate of 60 Hz (60 frames per second). So the number of lines in one frame is 31,500/60, or 525. Because only 480 lines of data need to be displayed, there are 525-480, or 45, lines available for vertical overscan. Leaving a more than adequate margin for retrace, which requires only 2 lines worth of time, the preferred embodiment uses 20 lines for the alternate display. Thus the additional 23 unused but available lines may be used to increase the size of the operating system desktop to some non-standard size while still allowing two lines for retrace, or may be left blank, or may be used for one or more additional alternate parallel user interface displays.
The information display methods of a preferred embodiment of the present invention can be accomplished by achieving three requirements: (1) to address and modify the visible resolution of the video display system such that portions of the overscan area are visible as shown in Fig. 6,
(2) to address and modify the video display contents for the visible portion of the overscan area, and (3) to provide an application programming interface (API) or other mechanism to allow applications to implement this functionality.
Fig. 7, and the additional details and sub-steps provided in Fig.'s 8-13, provides an example flow diagram of an implementation of a preferred embodiment of the present invention meeting the requirements described above. The environment of this implementation is a standard Microsoft Windows 95™ operating environment, using Microsoft Visual C and Microsoft MASM for the development platform. One skilled in the art will recognize that other embodiments can perform on other other platforms and within other environments. For example, embodiments could be implemented within any graphical interface environment, such as X- Windows, OSF Motif, Apple OS, a Java OS, and others in which similar video standards (VGA, SVGA, XGA, 8514/ A) are practiced. The reference books PC Video Systems by Richard Wilton, published by Microsoft Press and Programmer's Guide to the EGA, VGA, and Super VGA Cards by Richard F. Ferrano, published by Addison Wesley provide more than adequate background information to implement an embodiment in a Windows environment. Referring now in particular to Fig. 7, upon initialization, at Identify Display
Type step 102, the program attempts to determine the display type, and current location in memory used by the display driver, in order to determine the size and locations of any display modifications to be made, e.g. to the size and location of overscan area(s) to be used.
As described in further detail in Fig. 8, the program first queries the hardware registry in Query Hardware Registry, step 131, to attempt to determine the registered display type. If successful, the program then determines compatibility information in Display Type Supported, step 135, to verify that the program supports that display type and determine memory allocation information.
If the hardware registry information is unavailable, as determined in step 131, or the display type determined in step 131 is unsupported as determined by step 104, the program may use an alternate approach, shown as subroutine Query hardware, steps 135 in Fig. 8, to query the BIOS, in step 134, and the video chipset 66, in step 136, for similar information as described immediately below.
If the BIOS is to be accessed in step 134, physical memory is first allocated in Allocate Physical Memory, step 132, and accessed using Microsoft's DPMI (DOS Protected Mode Interface) to map it to the linear memory address in which the BIOS resides in Use DPMI to assign BIOS linear address to physical memory, step 133.
Thereafter, the program queries the BIOS in Read BIOS block, Search for VGA/XVA type and manufacturer ID, step 134. If successful, the driver and chipset are then further queried to determine the display type and memory location in Query driver/chipset for exact chipset, step 136.
If the compatibility information does not indicate a standard VGA, SVGA,
XGA, or 8514/A signature, step 134, this routine returns a failure. If a known chipset manufacturer's identification is found, the driver and/or chipset may be queried with manufacturer-specific routines, step 136, to identify and initialize, as necessary, the specific chipset.
If, at step 104, the program was unable to finally unable to identify the display type, either because the registry query in step 131 or the hardware query in step 135 was unsuccessful, the user may be prompted at Run in windowed mode, step 116, as to whether the program should continue to run as a standard "application bar" or "toolbar". The program may either exit or proceed to run as a toolbar on the desktop.
Returning now to Fig. 8, if a supported display type is detected, the program then determines the screen borders to be accessed in Identify borders to display in overscan, step 106, based upon user preferences, and determines, as necessary, whether sufficient video memory exists to make the necessary display changes. For example, if the screen is currently set to a 1024x768 resolution at 16 bits-per-pixel, and the program is to include four graphical interface bars, one on each edge, with each bar 20 pixels deep, the program preferrably checks that video memory is greater than 1.7MB (required number of bytes = Pixels Width * BitsPerPixel * PixelsHeight). The controller registers 6H, 16H, 11H, 10H, 12H and 15H as shown in Fig. 4 and detailed in Table 3, may be accessed through standard input/output ports, using standard inp/outp functions. The CR registers 6H, 16H, 1 IH, 10H, 12H and 15H are first unlocked, as indicated in Unlock CRTC registers, step 108 in Fig. 7, to make them writeable. They are unlocked by clearing bit 7 in controller register 1 IH.
Addressing of video memory, step 112, is accomplished through one of several means. One is to use the standard VGA 64 Kb "hardware window", moving it along the video memory buffer 67 (Fig. 4) in 64Kb increments as necessary. One example method is to enable linear addressing by querying the video chipset for the linear window position address, step 138 of Fig. 11. This 32-bit offset in memory allows the program to map the linear memory to a physical address, steps 140 and 142 of Figure 11, that can be manipulated programmatically.
At this point the program can modify the size of the display, step 114 and Fig. 9, to include the border areas. This routine first checks to determine whether or not the system is running in "toolbar" mode, step 144, and, if so, returns true. If not, it then determines whether to reset all registers and values to their original state, effectively returning the display to its original appearance, step 152. The determination is based upon a number of parameters, such as whether the current resolution, step 146, reflects a standard value or previous programmatic manipulation, step 148. If a standard resolution is already set, the variables are reset to include the specified border areas, step 150. The CR registers are adjusted, step 154, to modify the scanned and blanked areas of the display. If the top or side areas are modified, existing video memory is moved accordingly in step 162 of Fig. 10.
If any of the foregoing routines returns a failure, the program may prompt the user to determine whether "emulation" mode, step 13, or windowed mode step 116 should be used or if the program should exit at step 124.
In its simplest form, embodiments of the present invention can be viewed as techniques for adding a secondary GUI by reconfiguring the actual display mode to add a modified, non-standard GUI mode in which the standard display size or resolution has been adjusted to include a secondary display in addition to the primary display. For example, a standard 640x480 display is modified in accordance with techniques of the present invention to become a larger display, one section of which corresponds to the original 640x480 display while another section corresponds to a 640x25 secondary GUI display.
There are various techniques or mechanisms required for modifying the system to include the secondary GUI, depending upon the requirements of the secondary GUI and upon the present circumstances of the unmodified system.
In another embodiment of the present invention system, resources are allocated for a secondary GUI by fooling the video driver into going to larger resolution. This technique automatically guarantees that enough space is kept clean, since the video driver allocates system resources according to the resolution that the video driver believes it will be operating in. To operate one or more secondary user interfaces in one or more areas of the screen it is necessary to have the memory that was associated in video memory or in the frame buffer with that location, contiguously below the primary surface free and available. By writing a series of small applets specific to hardware known to have system resource allocation problems for a secondary user interface, the secondary user interface application may run such applet whenever resolutions will be switched, initializing the chip set pertinent to that particular applet. If the application finds an applet pertinent to the current particular chip set it will be launched. The applet or minidriver initializes itself, performs the necessary changes to the driver's video resolution tables, forces a reenable, and sufficient space is subsequently available for one or more secondary user interfaces. When reenabled, the driver allocates video memory as needed for the primary display according to the data on the UCCO resolution tables. Therefore, the modified values result in a larger allocation. Once the driver has allocated memory necessary for the primary surface, the driver will allow no outside access to the allocated memory. Thus by fooling the driver into believing that it needs to allocate sufficient memory for a resolution exactly x bytes larger than the current resolution where x is the size of one or more secondary user interfaces, the application can be sure that no internal or external use of the allocated memory location can conflict with the secondary user interface.
This method ensures that system resources will be allocated for one or more secondary user interfaces by writing an applet that would address the video driver in such a way as to force the video driver, on its next reenable, to allocate video memory sufficient for a resolution higher than the actual operating system resolution. This may also be done by modifying each instance of the advertised mode tables, and thus creating a screen size larger than the primary user interface screen size.
This technique has an additional benefit of eliminating the need to prevent the driver from actually shifting into the specified larger resolution, handing the primary user interface a larger display surface resolution. The "hardware mode table," a variant of the aforementioned video resolution tables, is not advertised and not accessible. Therefore, when the driver validates the new resolution, checking against the hardware mode table, it will always fail and therefore refuse to shift into that resolution. Because this technique modified the advertised video resolution tables early enough in the driver's process, allocated memory was modified, and memory addresses set before the failure in validate mode. Subsequently when the CRTCs are modified, in step 114, the driver is reserving sufficient memory for one or more secondary user interfaces and not making it available for any other process or purpose. In yet another embodiment of the present invention, an enveloping driver is installed to sit above the existing driver and shims itself in between the hardware abstraction layer and the actual video driver in order to be able to handle all calls to the video driver and modify the driver and the driver's tables in a much more generic fashion rather than in a chipset specific fashion. The enveloping driver shims into the primary video driver, transparently passing calls back and forth to the primary video driver. The enveloping driver finds the video resolution tables in the primary video driver which may be in a number of locations within the driver. The enveloping driver modifies the tables (for example, increasing 800 by 600 to 800 by 620). A 1024 by 768 table entry may become 1024 by 800.
Like the previously described embodiment, the primary driver cannot validate the new resolution and therefore cannot actually change the display setting. As a result, the driver allocated memory, allocated the cache space, determined memory address and moved cache and offscreen buffers as necessary. So the primary driver never uses all the space allocated, and will never draw in that space. As stated earlier, methods of the present invention may include three primary steps, finding or producing unused video memory, creating or expanding the overscan area, and putting data in the overscan area.
The step of finding or producing the unused video memory requires a review of the contents of the Controller Registers, the CR registers, used by VGA compatible chip sets or graphic boards to identify where the overscan area, the blanking, the vertical and horizontal total and the sinking should be set. The CR defines the desktop display, how its synched, where it's laid out left and right, how much buffer area there would be on each side, where it would be stored within the video memory area. A review of the contents of the CR data registers therefore fully defines and allows one to control the potential location and size of the overscan area.
In order to accomplish the step of creating or expanding the overscan area, the CRs may currently be used directly for systems with video display resolutions up to and including 1024 pixels in any dimension, that is, resolutions which can be defined in the generally accepted VGA standards by 10 bits per register. To expand the overscan area, new data is written into the CR using standard techniques such as the Inp and Outp, functions. A standard video port and MMIO functions may also be used to modify the CRs.
At greater resolutions, 11 bits may be needed to properly define the resolution. There is currently no standard way in which the 11th bit location is defined. Therefore, at a resolution above 1280 by 1024, for example, an understanding about the video card itself, particularly how the 11 bits representing the resolution are stored, is currently required and will be described below in greater detail.
When expanding the overscan, it is important to make sure a previous overscan bar is not already displayed, possibly from a previous crash or other unexpected problem. Either the display is preferrably immediately reset to the appropriate resolution defaults, or the CR queried to determine if the total screen resolution as understood by the video card and drivers differs from the screen resolution known by the operating system display interface. An overscan bar may already be displayed if the total screen resolution is not equal to one of the standard VGA or SVGA resolutions. In particular, if the total screen resolution is equal to a standard VGA/SVGA resolution plus the area required for the overscan bar or is greater than the resolution reported by the operating system display interface, the display is reset.
Once the display area or resolution as stored in the CR is determined, the resolution or display area can be extended in several different ways. The overscan area can be added to the bottom, the top, or the right of the current display area, and optionally, the display area can be repositioned so that the overscan bar can remain centered in appearance. Alternatively, the overscan area can be added anywhere and the original or desktop display area can be centered to improve appearance. In any event, the height width of the display area required for the overscan bar is presented adjacent the desktop area stored in the CR and the combination is written into the CR, overwriting the previous data.
The screen typically shows a quick flash as it is placed in a different mode, including the desktop display area as well as a parallel GUI such as a display bar in the overscan area. As soon as that change occurs, a black mask can be positioned over the new areas. The new menu data can then be safely written on top of the black mask so that the user never sees memory "garbage".
There is typically a few seconds of load time during which a simple message can be displayed, such as "Loading...", to avoid confusing the user.
There are a number of mechanisms by which this may be done. A set of class objects is used, all derived from a common base class corresponding to the above described VGA-generic technique.
The first mechanism is an implementation of the VGA-generic technique. Using this mechanism, no information specific to a video-card is necessary, other than ensuring VGA support. Using standard application programming interface (API) routines, primary and secondary surfaces are allocated. The new display data in the CR is simply the physical address at the start of the primary surface plus the number of pixels defined by the screen size.
Allocation of the primary surface will always be based on the entire screen display. Given the linear address of the allocated primary surface, from which a physical address can be derived, it can be extrapolated that the physical address of the location in video memory immediately adjacent to the primary surface is represented by the sum of the number of bytes of memory used to maintain the primary surface in memory plus the value of the physical address of the primary surface.
Once the physical address of the primary surface is known, the size of the primary surface as represented in video memory can be determined. For example, the system looks in the CRs for the resolution of the screen, 800 by 600, in terms of number of bits per pixel, or bytes per pixel. Then any data stored in the CR representing any horizontal synching space is added. This is the true scan line length. The scan line length is a more accurate measurement of the width in a given resolution.
Next, the physical address of the allocated secondary surface is derived from its linear address. In the case where the allocated secondary surface is, in fact, allocated in the memory space contiguous to the primary surface (the value of the secondary surface physical address is equal to the value of the primary surface physical address plus the size of the primary), the secondary surface is determined to be the location in memory for the overscan display. If, however, the above is not true and the secondary surface is not contiguous to the primary surface, another approach mechanism is required.
To summarize, the first mechanism determines how much physical area to allocate for the desktop allowing adjacent area for parallel GUI secondary space beyond that to display in the overscan area. The newly allocated area will be the very first block of memory available. If this block immediately follows the primary surface, the physical address will correspond to the value associated with the physical address of the primary surface, plus the size of the primary surface. If that is true, the memory blocks are contiguous, this VGA-generic mechanism can be used.
If this first, VGA-generic mechanism cannot be used, the video card and driver name and version information retrieved from the hardware registry and BIOS, as described earlier, is used in conjunction with a look-up table to determine the best alternatives among the remaining mechanisms. The table includes a set of standards keyed to the list of driver names found in the hardware registry. A class object specific to the video chipset is instantiated based, directly or indirectly, on the VGA-generic object. If the hardware look up does not result in a reliable match, a reliability, or confidence, fudge factor may be used. For example, if the hardware look up determines that an XYZ-brand device of some kind is being used, but the particular XYZ device named is not found in the look up table, a generic model from that chipset manufacturer many often be usable. If no information is available, the user may get a message indicating that the hardware is not supported and that the program cannot run in the overscan area. The user may then be queried to determine if the system should be operated in the "application- toolbar" mode, which basically runs with exactly the same functionality but in a windowed environment within the desktop rather than in the overscan area outside the desktop. The next alternative mechanism uses surface overlays. The first step to this approach is to determine if the system will support surface overlays. A call is made to the video driver to determine what features are supported and what other factors are required. If surface overlays are supported, for example, there may be a scaling factor required.
For example, a particular video card in a given machine, using 2 megabytes of video RAM, might support unsealed surface overlays at 1024x768 at 8 bits per pixel, but not at 1024x768 at 16 bits per pixel because the bandwidth of the video card or the speed of the card, coupled with the relatively small amount of video memory would not be sufficient to draw a full width overlay. It is often horizontal scaling that is at issue, preventing the driver from drawing a full width overlay. An overlay is literally an image that is drawn on top of the primary surface. It is not a secondary surface, which is described above. Typically, the system sends its signal from the video driver to the hardware such that it merges the two signals together, overlaying a second signal on top of the first.
If a system can not support unsealed overlays, perhaps because of bandwidth issues or memory issues, this mechanism is not desirable. It is not rejected, but becomes a lower priority alternative. For example, if the scaling factor is below .1, then the normal bar can be drawn and it will be clipped closer to the edge. If the scaling factor is more than 10%, another approach mechanism is required
In the next set of alternative mechanisms, a secondary surface is allocated sufficient in size to encompass the normal desktop display area plus the overscan area to be used for display of the overscan bar or bars. Using these mechanisms, the allocated secondary surface does not have to be located contiguous in memory to the primary surface. However, these approaches use more video memory than the others.
The first step is to allocate a secondary surface sufficient in size to contain the video display (the primary surface) plus the overscan area to be used. If the allocation fails, that means that there is not enough video memory to accomplish the task and this set of mechanisms is skipped and the next alternative tried. After the new block of memory is allocated, a timer of very small granularity is used to execute a simple memory copy of in the contents of the primary surface onto the appropriate location of this secondary surface. The timer executes the copy at approximately 85 times per second. Within this set of alternative mechanisms is a variant that uses the system page tables. This mechanism queries the system page tables to determine the current GDI surface address, that is, the physical address in the page table for the primary surface. A secondary surface is then created large enough to hold all of what is in the video memory plus the memory required for the overscan bar to be displayed. This surface address is then pushed into the system page table and asserted as the GDI surface address.
Thereafter, when GDI reads from or writes to the primary surface through the driver, it actually reads from or writes the new, larger surface. The overscan bar program can, subsequently, modify the area of the surface not addressed by GDI. The original primary surface can be de-allocated and the memory usage reclaimed. This mechanism, being more memory-efficient than the previously described mechanism, is the preferred alternative. But the page tables solution will not work correctly on a chipset that includes a coprocessor device. If the initial device query reveals that the device does include a coprocessor, this variant mechanism will not be attempted.
Other variations of the above-described mechanisms are accounted for in derived class objects. For example, the VGA-generic mechanisms may vary when the video card requires more than ten bits to represent the video resolution in the CR. Some instances may require 11 bits. Such registers typically do not use contiguous bytes, but use extension bits to designate the address information for the higher order bits.
In this example, the eleventh bit is usually specified in an extended CR register and the extended CR registers are usually chip specific. Similarly, a variation of the surface overlay mechanism includes a scaling factor, as described above. This alternative is handled in specific implementations through derived class objects and may be the preferred solution in certain situations.
Another implementation of this technology uses a "hooking" mechanism as shown in Fig. 14. After the display driver is identified through the hardware registry or the BIOS, as described above, certain programming interface entry points into the driver are hooked such as at step 117. In other words, when the video system device interface, Windows GDI for example, calls those entry points into the display driver, the program can take the opportunity to modify the parameters being passed to the display driver, and/or to modify the values being returned from the display driver.
By hooking the "ReEnable" function in the display driver, at step 117, the overscan bar program can allocate screen area in different ways in step 119:
(1) In step-up mode, step 121, by intercepting a resolution change request and identifying the next-higher supported screen resolution and passing that higher resolution to the display driver, then, when the display driver acknowledges the change, intercepting the returned value, which would reflect the new resolution, and actually returning the original requested resolution instead. For example, GDI requests a change from 640x480 resolution to 800x600 resolution; the overscan program intercepts the request and modifies it to change the display driver to the next supported resolution higher than
800x600, say 1024x768. The display driver will change the screen resolution to 1024x768 and return that new resolution. The overscan program intercepts the return and instead passes the original request, 800x600, to GDI. The display driver has allocated and displays a 1024x768 area of memory. GDI and Windows will display the desktop in an 800x600 area of that display, leaving areas on the right and bottom edges of the screen available to the overscan program.
(1) In shared mode, step 123, by intercepting only the return from the display driver and modifying the value to change the operating system's understanding of the actual screen resolution. For example, GDI requests a change from 800x600 resolution to 1024x768 resolution. The overscan program intercepts the returned acknowledgment, subtracting 32 before passing the return on to GDI. The display driver has allocated and displays a 1024x768 area of memory. GDI and Windows will display the desktop in an
1024x736 area of that display, leaving an area on the bottom edge of the screen available to the overscan bar program. After hooking, the overscan bar program can display by: (1) using standard API calls to render the bar to an off-screen buffer, as described in the next section, and then hooking the "BitBlt" function entry point into the display driver in order to modify the offset and size parameters and subsequently redirect the BitBlt to the area outside of that which the API believes is onscreen.
(1) using mechanisms of primary and secondary surface addresses, described earlier, the program determines the linear addresses for the off- desktop memory location(s) left available to it, and can render directly to those memory locations.
Phase 2 of the methods of embodiments of the present invention begins by painting the new images into a standard off-screen buffer, step 118, as is commonly used in the art, and making the contents visible, step 120, as described in Fig. 10. If the program is in "toolbar" mode, step 156, the off-screen buffer is painted into the standard window client space, step 166, and made visible, step 164, using generic windowing-system routines. Otherwise, the linear window position address is mapped, step 158, as described in Fig. 11 which has been previously explained. Once the linear memory is mapped to a physical memory address, step 142, the contents of the off-screen display buffer can be copied into the video buffer directly, step 154 of Fig. 10, or painted as to a secondary surface.
The preferred embodiment application includes a standard application message loop, step 122, which processes system and user events. An example of a minimum functionality process loop is in Fig. 12. Here the application handles a minimal set of system events, such as painting requests, step 170, system resolution changes, step 172, and activation/deactivation, step 174. Here, too, is where user events, such as key or mouse events, may be handled, step 184, detailed in Fig. 13. System paint messages are handled by painting as appropriate into the off-screen buffer, step 178, and painting the window or display buffer, step 180, as appropriate, as described earlier in Fig. 10. System resolution messages are received whenever the system or user changes the screen or color resolution. The programs reset all registers to the correct new values, then change the display resolution, step 182, as earlier described in Fig. 9, to reflect the new resolution modified. User messages are ignored when the program is not the active application.
Fig. 13 describes a method of implementing user-input events. In this embodiment, there are three alternative mechanisms used to implement cursor or mouse support so that the user has a pointing device input tool within the overscan area user interface.
In the preferred mechanism, GDI's "cliprect" is modified to encompass the overscan bar's display area. That keeps the operating system from clipping the cursor as it moves into the overscan area. This change doesn't necessarily make the cursor visible or provide event feedback to the application, but is the first step.
Some current Windows applications continually reset the cliprect. It is a standard programming procedure to reset the cliprect after use or loss of input focus. Some applications use the cliprect to constrain the mouse to a specific area as may be required by the active application. Whenever the overscan display bar interface receives the input focus it reasserts the cliprect, making it large enough for the mouse to travel down into the overscan space.
Once the cliprect has been expanded, the mouse can generate messages to the operating system reflecting motion within the expansion area. GDI does not draw the cursor outside what it understands to be its resolution, however, and does not pass "out-of-bounds" event messages on to an application. The overscan program uses a VxD device driver, and related callback function, to make hardware driver calls at ring zero to monitor the actual physical deltas, or changes, in the mouse position and state. Every mouse position or state change is returned as an event to the program which can graphically represent the position within the menu display bar. An alternative mechanism avoids the need to expand the cliprect in order to avoid conflict with a class of device drivers that use the cliprect to facilitate virtual display panning. Querying the mouse input device directly the overscan program can determine "delta's", changes in position and state. Whenever the cursor touches the very last row or column of pixels on the standard display, it is constrained there by setting the cliprect to a rectangle comprised of only that last row or column. A "virtual" cursor position is derived from the deltas available from the input device. The actual cursor is hidden and a virtual cursor representation is explicitly displayed at the virtual coordinates to provide accurate feedback to the user. If the virtual coordinates move back onto the desktop from the overscan area, the cliprect is cleared, the virtual representation removed, and the actual cursor restored onto the screen.
A third alternative mechanism creates a transparent window that overlaps the actual Windows desktop display area by a predefined number of pixels, for example, two or four pixels. If the mouse enters that small, transparent area, the program hides the cursor. A cursor image is then displayed within the overscan bar area, at the same X-coordinate but at a Y-coordinate correspondingly offset into the overscan area. If a two-pixel overlap area is used, this method uses a granularity of two. Accordingly, this API-only approach provides only limited vertical granularity. This alternative mechanism assures that all implementations will have some degree of mouse-input support, even when cliprect and input device driver solutions fail.
Fig. 7 describes the cleanup mechanisms executed when the program is closed, step 124. The display is reset to the original resolution, step 126, and the CR registers are reset to their original values, step 128, and locked, step 130.
In another embodiment of the present invention, the launching or initiating of alternate display content controller 6 may be modified and controlled. Alternate display content controller 6 may be launched as a service, as an application, or as a user application. As a service, alternate display content controller 6 may be launched as a service within the registry of utility operating system 5B. The first kind of application is launched in the Run section in the registry, and the user application may be initiated from the Start Up Group within the Start button. Thus, alternate display content controller 6 may be initiated any time from the first thing after graphics mode is enabled to the very last thing initiated.
Launched as a service, alternate display content controller 6 may be visible shortly after utility operating system 5B such as Windows actually addresses the display, and how soon after depends on where alternate display content controller 6 is put it in the order of the things that will be launched as services. It may be possible to put alternate display content controller 6 so that it launches as essentially the first service and thus would launch almost at the same time as the drivers, very, very shortly after the drivers are launched. Accordingly, it is possible to have the screen change from text mode to graphics, draw the colored background, immediately re-display with the overscan addressed and a parallel GUI such as CSNB 2 display the very close to the same time as taskbar. Launched as a run-line application, alternate display content controller 6 may be visible in display space 1 shortly after icons appear.
Example Secondary User Interfaces The following descriptions provide example user interfaces that can be implemented using methods and techniques of the present invention. Appendices A, B, C, D, and E, incorporated herein by reference, include source code, descriptions, and visuals demonstrating many of these user interfaces, including for example, the Xsides™ application environment implement by The Pixel Company. Xsides™ includes, among other capabilities, a cylindrical visualization of a secondary user interface, a Portal feature, and a Web Jump (NetSpace) feature that offers Internet browsing and searching capabilities. The Portal feature can include any type of textual or graphical content envisioned by its implementer. One example use of a portal area, as a personal information manager, is discussed in detail in Appendix D. One skilled in the art will recognize that many other user interfaces can be realized by the methods, systems, and techniques of the present invention and that these interfaces may be available in conjunction with one another. Xsides™ Application Environment Overview
The Xsides™ environment is an embodiment of the methods and systems of the present invention. It offers a user interface that is:
• always visible and accessible • technically scalable
• able to "overtake" the desktop
• merge-able
• able to provide highly secure data transmissions
• easy to use • small (<1.5 MB to download)
Appendix B shows examples of some of these capabilities. Other examples of these capabilities and techniques provided by the user interface are provided in Appendices C and D.
Xsides™ is implemented by software that is independent of any underlying systems user interface. It resides "below" the operating system and "above" the drivers (if the system architecture is viewed from the drivers up through the application software). The software communicates directly to the driver level and adjusts video display parameters. It also allows keyboard and mouse events outside of the primary user interface supported by the operating system. The technology can deliver, among other things, Internet content and services, third-party applications, Web browsers, personal Internet portals, advertisements, Web-based client-server applications and electronic program guides (EPGs). Because the xSides™ Technology enables content and functionality to reside physically outside and control independent of the existing operating systems, such content and functionality do not interfere with and cannot be covered by the operating system or the applications that reside on the desktop.
The xSides™ Technology is able to support interactive content and applications in a persistent fashion outside of the operating system because it resides outside of the operating system's control. Specifically, xSides™ resides within an abstraction layer "below" the operating system and "above" the device drivers. As such, xSides™ can adjust the parameters for the video display system, can increase the number of pixels and scan lines and can enable keyboard and mouse events within the xSides™ area. This allows xSides™ to dramatically resize the existing desktop, if desired, "uncovering" the majority of the display area around any or all four sides of the desktop, which we can then use to display content and applications. An application programming interface ("API") to the xSides™ Technology allows developers to rapidly develop applications that take advantage of these unique characteristics of the technology.
The technology can potentially address every user of an Internet-enabled computer or TV worldwide. In addition, the proliferation of consumer electronics operating systems (i.e., Microsoft CE) in such devices as portable daily planners and set-top boxes further expands our market opportunity..
The first products of xSides™ Technology will be variations of co-branded mini-portals, which reside on the user's display area and feature the content and applications of our strategic partners. These products initially appear on the bottom of a computer screen as a thin cylinder icon (the "control bar") containing a series of control buttons. The control bar is comprised of a number of faces, which we call "Sides™," each of which can contain different combinations of content, applications and graphics (hence the name xSides™). The user can easily rotate from one Side™ to the next with mouse clicks to view and access the different content present on a given Side™. The ability to rotate the xSides™ interface to different faces expands the available computer display real estate and allows for compatibility among products licensed to different partners, enabling users to easily view and access whatever content they want. The control buttons can perform a variety of tasks, including launching a Web connection or application, displaying tickers and banners of server- delivered content, or can allow the user to launch functions running in an additional xSides™ display area called the xSides™ Portal. The xSides™ Portal is an Internet display area below the xSides™ control bar which can contain any html-based image or application, including email and instant messaging input and output, calendar and address book information, ISP controls, ad-banners, electronic programming guides and Web-based client-server applications. The xSides™ Portal is initially being used to build personal "desktop" Internet portals, which will be customized and distributed by Internet content and commerce providers, fee-based and free Internet service providers (ISPs), PC based Web application developers (ISVs) and hardware OEMs.
An important feature of our xSides™ products is the function we call "merge." Merge allows users to upgrade their existing xSides™ products to subsequent versions and to add or remove additional faces to their control bar at will. Essentially, merge enables users to make their xSides™ product a convenient, one-stop destination for all of their favorite content and services. This is not only important and attractive to users, but also to our strategic partners who are able to introduce multiple faces, as well as upgrade their users to new applications and functionality over time. Although merge provides product convenience and flexibility for both users and strategic partners, in one preferred embodiment neither the original faces nor the persistent logos on an xSides™ product can be "de-merged," giving strategic partners additional incentive to distribute the products.
The following summarizes the five basic functions performed by our xSides™
Technology:
• Expands the display surface around the desktop to a previously unused area - The xSides™ Technology adjusts parameters for the video display system to increase the number of pixels in at least one dimension of the display system and on one or more edges of the desktop. • Establishes additional video memory buffers for the newly visible area -
The number of scan lines and pixels which need to be added to the display is set by xSides™ so that the video display system can display within the physical limitations of video RAM and monitor refresh.
• Allows the buffers to be written into like any regular display buffer - The buffers are allocated and locked in order to prevent them from being corrupted by the video display system.
• Allows keyboard and mouse events within the xSides™ area - These events can now occur outside of the desktop, whereas before they were recognized only by the operating system. • Secures the xSides™ area - Since the xSides™ area communicates directly to the driver level without having to communicate through the operating system, transactions, emails, and other data transfers are more secure than in an environment where the data transfer occurs through multiple layers of an operating system where corruption and infiltration can occur.
Xsides™ Example Cylindrical User Interface Referring now to Fig. 19, display area 26 includes a parallel GUI 28 according to embodiments of the present invention. Display area 26 may be located anywhere on screen 24S of video monitor 24. For example, with long axis L oriented horizontally display area 26 may be located adjacent edge 24T or edge 24B. Alternatively, with long axis L oriented vertically, display area 26 may be located adjacent edge 24L or edge 24R. Aspect ratio 34 of parallel GUI 28 is the relationship between dimension 32 measured along long axis L and dimension 30 expressed as 34:1 where aspect ratio 34 is determined by equation 36.
36 -» Aspect ratio 34 = dimension 32 ÷ dimension 30
According to a preferred embodiment of the present invention, parallel GUI 28 includes bar 38 surrounded by area 28 A. Bar 38 may include one or more containers or cartridges such as cartridge 86 of Fig. 20. Area 28A may be any color; in the example embodiment, area 28 A is black. Bar 38 may be composed of separate elements such as title area 40, one or more help areas such as help area 42 and or help area 56, one or more rotators such as rotator 44 and or rotator 48, and one or more buttons such as button 46, button 50, ticker 52 and button 54. A button may be depressible such as button 46 or non-depressible such as button 40. A depressible button such as button 46 may perform an associated action and display highlighting when selected and clicked on using any conventional pointing device such as mouse 22. A non-depressible button such as button 40 may act as a label and or initiate apparent rotation of the elements of bar 38 to the right of button 40 along with all the associated sound, apparent motion, and highlighting as described below.
During a 'mouse over' condition, that is when a pointer such as arrow 64 is moved over a depressible button such as button 46, the appearance of button frame 62 may be changed such as by changing its color and thus the apparent intensity of emitted light. The change evoked in a button frame such as button frame 62 may be localized to a portion of the button frame such as corner 62 A. Preferably, a 'mouse over' condition causes light to apparently emit from the lower left corner of the button frame such as corner 62B.
Clicking on or 'mouse down' condition of a depressible button such as button 46 may evoke apparent movement of the button and or apparent lighting changes adjacent the effected button. Preferably, 'mouse down' of a depressible button such as button 46 causes button 46 to apparently move into bar 38 and an apparent increase of light from behind button frame 62. Apparent motion and light emission changes may be accomplished by any conventional means.
Following a click on or 'mouse down' condition of a depressible button such as button 46 a 'mouse up' condition is initiated thus completing a button selection cycle. A 'mouse up' condition may initiate an action such a hyperlink or launch an application associated with the acting button such as button 46. Additionally, a 'mouse up' condition may cause a button such as button 46 to reverse the apparent motion caused by the prior 'mouse down' condition, thus as in the prior example, button 46 apparently springs back out of bar 38 into alignment with bar 38. At the conclusion of a button selection cycle, a highlighting change of a selected button may also be included. In one embodiment, a post selection highlighting is the same as the earlier described 'mouse over' highlighting and is maintained until another button such as button 54 is selected or some other action within parallel GUI 28 is initiated. Actuation of a complete button selection cycle on a non-depressible button such as button 50, a title button such as title area 40, or on a rotator such as rotator 44 may initiate rotation about long axis L of the display area. In one embodiment a click of right mouse button 22R initiates rotation of 38 in a first direction D and a click of left mouse button 22L initiates rotation of 38 in a second direction U, opposite first direction D. Accompanying a complete button selection cycle as described above, sound may be used to enhance the experience and thus heighten the similarity of a virtual metaphor to a real 3-dimensional device. In one embodiment, sound 66 may issue from the computer system, sound 66 may resemble a sound or sounds issued from a real device such as a subtle mechanical click. Any other appropriate sound or sounds may also be used. A non-depressible button such as button 50 may be used a title button or a placeholder, and thus may not invoke a utility, URL or any other function if subjected to a complete button selection cycle. Accordingly, no highlighting or other special indicia would accompany a 'mouse over' condition of a non-depressible button such as button 50. In an alternate embodiment, a non-depressible button such as button 50 may include the functionality of a rotator such as rotator 44 or 48. Thus a complete button selection cycle on such a non-depressible button would result in the apparent rotation of non-depressible button 50 and all the elements of bar 38 to its right such as ticker 52 and button 60.
Tickers such as ticker 52 may be dynamic reading areas within a cartridge such as cartridge 86 as shown in Fig. 20. Scrolling updateable text such as text 53 can be displayed and the text reading area can also be dynamically linked to launch an application or URL. A ticker such as ticker 52 may be as long as a single button or any combination of multiple buttons. The text such as text 53 that is displayed may be scrolling or otherwise made to move through ticker window 52A. In a currently preferred embodiment of the present invention text enters ticker window 52A at right side 52R and scrolls to the left to left side 52L. The scrolling text such as text 53 may repeat in a loop at the end of the text string. Ticker text such as text 53 may be updated locally or over a network. A ticker such as ticker 52 may activate a hyperlink through a network when ticker 52 is clicked on, or subjected to a complete button cycle. Referring now to Fig. 20, an example of a menu tree that may be displayed and accessed through parallel GUI 28 is shown. Menu 70 includes title bands 72, 74, 76, 78 and 80 which correspond to title area 40, button 46, button 50, ticker 52 and button 54 respectively. Rotators 44 and 48 are represented by bands 82 and 84, respectively. In this example, title area 40 includes 6 containers or cartridges, cartridges 86, 87, 88, 89, 90 and cartridge 91. Many more cartridges and titles may be available, the number of cartridges or titles available may only be limited by the resources of the computer. Cartridges such as cartridge 90 or cartridge 91 may include accessories such as a web browser or media player or any other accessory. Accessories for a cartridge such as cartridge 90 may be installed for use with system software, or they may be components of the software implementing the parallel GUI, or they may be available via a network. Referring now to Fig. 21, parallel GUI 28 is shown with accessory cartridge
90 visible. Accessory cartridge 90 may include function specific actuators such as fast forward or next track for a CD player. A section of accessory cartridge 90 or any other cartridge selected may also be dedicated to a single function such as web browser 92, to permit the browser to remain visible at all times that parallel GUI software is running.
Cartridges such as cartridges 86-91 may be pre-loaded with links and accessories. Alternatively, the elements or buttons of a cartridge may be blank for loading by a user through a "merge" capability (see Appendix E). User cartridge(s) may include access to applications, documents, files, or network links such as URLs and or embedded functions. Some embedded functions which may be launched from a cartridge may include a browser, an MP3 player, instant messaging, trading notices for marketplace functions, alerts for auction results and or trades, agent checking regarding price comparison searches. User items such as applications, documents, files, or network links may be added to a user button via any conventional method such as copy and paste or drag and drop functions of system software or of any web browser. Preferably, user buttons may be renamed or cleared in any conventional manner.
A parallel GUI such as parallel GUI 28 may also include a help function. Help screens or menus may be implemented in any conventional manner. A map of the contents and organization of bar 38 may be provided in the form of a menu or tree such as menu 70 of Fig. 20. Menu 70 and other help screens may extend from display area 26 in any conventional manner. In one embodiment, in which menu 70 is visible extending away from edge 26T thus allowing bar 38 to remain visible, actuation of a complete button cycle on a title such as title 87C will initiate rotation of bar 38 to bring cartridge 87 and title 87C to visibility on bar 38. In a one embodiment of the present invention, display area 26 includes 4 preset actuators 94. Activation of a complete button cycle on an actuator such as actuator 96 will rotate bar 38 to a pre-selected position. A user may initially load, change or delete a preset setting associated with an actuator such as actuator 96.
The software implementing the parallel GUI may also include a screen saver component such as idle component 96. If parallel GUI 28 is notified that the system software is in idle, rather than blanking display area 26 as in some conventional techniques, parallel GUI 28 may auto rotate through all possible cartridge displays of menu 70. When the system software returns to active mode, bar 38 will automatically return to the last active position prior to idle. If parallel GUI 28 is oriented with a title cartridge, such as cartridge 86 with title 86A visible on title area 40, a complete button cycle of title area 40 as described above may result in apparent rotation of bar 38 and thus display an adjacent cartridge such as cartridge 87 or cartridge 85 (not shown). Title area 40 may also include all buttons and rotators to the right of title area 40 as well. In an alternate embodiment, a complete button cycle of title area 40 changes the visible title such as title 86 and apparently rotates elements of bar 38 to the right of title area 40 such as rotator 44, rotator 48, button 46, button 50, ticker 52 and button 54. The result of changing a cartridge and thus the title visible in title area 40 is that as cartridge 87 is visible, title 87A may be visible as well as a set of it's subordinate titles such as titles 87B, 87C, 87D and 87E. Additional cycling of title area 40 will result in display of additional cartridges and thus additional titles of band 72 such as titles 88 A and 89A.
If title 89A is visible in band 72, execution of a complete button cycle on rotator 44 corresponding to band 82 will cause apparent rotation of bar 38 at button 46 corresponding to band 74 including everything to the right of button 46. Subsequent button cycles of a rotator such as rotator 44 cause titles which appear on button 46 to sequentially cycle through titles 89B, 89C, 89D, 89E and 89F with a new title appearing after each button cycle.
In one preferred embodiment, a merge function may be included to allow cartridges such as cartridges 86-91 to be added to an existing parallel GUI such as parallel GUI 28. (See Appendix E.) A cartridge such as cartridge 86 may be added or merged with any existing cartridges in a parallel GUI such as parallel GUI 28 using any conventional technique such as copy and paste or drag and drop. A merged cartridge such as cartridge 86 may be added between any two adjacent cartridges such as cartridges 88 and 89. Similarly, existing cartridges may be reordered using a conventional sort function. New cartridges may be merged or added to an existing parallel GUI from any conventional media such as magnetic storage media, optical storage media, or from network resources such as the Internet, or any local or intranet network. A delete and or a sort function may also be included to permit a user to organize or personalize a bar such as bar 38 in parallel GUI according to their own wishes consistent with the parallel GUI software.
For example, a user may go to a specific Internet site to peruse the applications available to be merged into the parallel GUI. One such application is an application providing access to weather information over the WEB. The user selects the application to be merged, and the parallel GUI automatically determines a set of cartridges provided by the application. The parallel GUI software then merges the determined set of cartridges into the current data structure used to store data on the currently loaded cartridges. One skilled in the art will recognize that any conventional data structure may be used, including arrays, hash tables, linked lists, and trees. Preferably, a data structure that allows easy replacement of entire cartridges, (such as cartridges stored as branches of a tree) is used. The parallel GUI software may then update any related data structures whose information depends upon knowledge of the current set of available cartridges.
NetSpace
Referring again to Fig. 1, in an alternate embodiment of the present invention, the technique of controlling the allocation of display area 1 is used to open a context sensitive network browser 2 (CSNB) adjacent but not interfering with operating system desktop 3 and/or parallel graphical user interface 4. A display controller such as alternate display content controller 6 may include CSNB 2 thus permitting the browser to create and control a space for itself on display 1 which may not be overwritten by utility operating system 5B. The combined controller/browser may be an application running on the computer operating system, or may include an operating system kernel of varying complexity ranging from dependent on the utility operating system for hardware system services to a parallel system independent of the utility operating system and capable of supporting dedicated applications. The alternate display content controller/browser may also include content and operating software such as JAVA delivered over the Internet I or any other LAN. There may also be more than one context sensitive network browser and more than one parallel graphical user interface in addition to the operating system desktop.
Context sensitive interface such as network browser 2 may respond to movement and placement of cursor IC controlled by a pointing device such as mouse 1M anywhere on display area 1. The generation and control of a cursor across two or more parallel graphical user interfaces was described previously. The location of cursor IC will trigger CSNB 2 to retrieve appropriate and related network pages such as web page 2A. CSNB 2 may store the last X number of CSNB enabled network addresses for display offline. In a currently preferred embodiment of the present invention, X is ten pages. If a user is examining a saved CSNB enabled page offline, a mouse click on the page or a link on the page will initiate the users dial-up sequence and establish an online connection.
In an alternate embodiment, alternate display content controller 6 may include a browser or search engine. In an alternate embodiment of the present invention, space 2C may include an edit input box 2D. Edit input box 2D may include conventional functionality's such as edit, copy, paste, etc.. A user may enter a URL into edit input box 2D using any conventional input device and then select a button to launch or initiate alternate display content controller 6 as a browser. This may be accomplished by using objects and or drivers from utility operating system 5B. Initiating alternate display content controller 6 as a browser would include a simple window to display the URL as a live HTML document with all conventional functionality. By implementing alternate display content controller 6 as a little applet that uses that DLL, it may slide on, or slide off. Thus initiating alternate display content controller 6 as a browser is like a window into the Internet.
Secondly, a user may enter any text into edit input box 2D using any conventional input device and then select a button to launch or initiate alternate display content controller 6 as a search engine. By entering a search string and selecting "search" and enter any string and click on "search" and pass that to any number from one to whatever or existing search engines, and subsequently have the search string acted on by one or more selected search engines and or by alternate display content controller 6 as a search engine. Resulting in multiple different windows appearing in some sort of stacked or cascaded or tiled format, with the different searches within them. Using alternate display content controller 6 as a search engine or browser, the results or HTML document may be displayed in any overscan area or on the desktop.
Referring now to Fig 17, a context sensitive network browser such as CSNB
13 may also include a suite of tools such as tools 14 that may or may not have fixed locations on the browser space. Such tools may include but are not limited to e-mail, chat, buddy lists and voice. As shown, spaces such as desktop 14 A, web page 14B, secondary GUI 14C and browser 13 may be arranged in any convenient manner.
Hooking Mechanism The following describes the hooking mechanism used with xSides (an example embodiment) on an Intel 80386 (or greater) processor. This description of the Intel processor operations are simplified for clarity. This hooking mechanism is expected to work on most, if not all, compatible processors currently available.
Interrupt Descriptor Table
The interrupt descriptor table (IDT) associates each interrupt with a descriptor for the instructions that service the associated event. For example, when a software interrupt (INT 3) is generated (and interrupts are enabled), the Intel processor will suspend what it was currently doing, look up in the IDT for the appropriate entry (or interrupt vector) for the address of the code to execute to service this interrupt. The code is known as the Interrupt Service Routine (ISR). It will start executing the ISR. When a Return From Interrupt instruction (IRET) is executed by the ISR, the processor will resume what is was doing prior to the interrupt.
Debug Registers
The Intel 80386 microprocessor provides a set of system registers that are normally used for debugging purposes. The are technically referred to as Debug Registers. These registers allow control over execution of code as well as access over data. The Debug
Registers are used in conjunction with exception code. There are four addresses registers (i. e.
Four different locations of code and/or data) (DR0, DR1, DR2, and DR3). There is a control register (DR7) that can be programmed to selectively enable the address registers. In addition, DR7 is used to control the type of access to a memory location that will generate an interrupt. For example, an exception can be raised for reading and or writing a specific memory location or executing a memory location (i. e. Code execution).
Finally, there is a status register (DR6) that is used to detect and determine the debug exception, (i. e. What address register generated the exception). When enabled and the data criterion is met, the x86 processor generates an Interrupt 1 (INT 1).
How this mechanism is used The xSides implementation preferably first sets up the IDT to point our ISR to process INT 1 interrupts. Next, the address of the code that you want to hook (or the memory location of data, as in this case) is programmed into one of the address registers and the appropriate bits within the control register are set. When the x86 processor executes this instruction (or touches the memory location of data), the processor generates an INT 1. The processor will then invoke the Interrupt 1 ISR (as described above.) At this point, the ISR can do almost any kind of processor, code or data manipulation. When complete, the ISR executes an IRET instruction and the processor starts execution after the point of the INT 1 occurrence. Note that the interrupt code has no knowledge of the interruption.
This mechanism is expected to move the memory address used on some video systems for cache or hardware cursor. This should allow us to push the percentage of systems that support "overscan" mode to around 90% (in that this mechanism should work on approximately that number of machines).
Additional Alternative Embodiments
1. Utilizing the VESA BIOS Extensions (VBE) in place of the CRT Controller registers (Fig. 5) to determine the linear window position address, step 138, as necessary.
2. Utilizing API's (application programming interfaces) 62 capable of direct driver and/or hardware manipulation, such as Microsoft's DirectX and/or DirectDraw, in place of the CRT Controller registers and/or direct access to the display buffer.
3. Utilizing API's (applications programming interfaces) 62, such as Microsoft's DirectX and/or DirectDraw, capable of direct driver and/or hardware manipulation, to create a second virtual display surface on the primary display with the same purpose, to display a separate and unobscured graphical user interface.
4. Utilizing modifications in the video subsystem of the operating system 63 in place of the CRT Controller registers and/or DirectX access to the display buffer. 5. Utilizing modifications in the video subsystem of the operating system
63 to create a second virtual display surface on the primary display with the same purpose, to display a separate and unobscured graphical user interface.
6. Building this functionality into the actual video drivers 64 and/or mini- drivers. Microsoft Windows provides support for virtual device drivers, VxDs, which could also directly interface with the hardware and drivers. These could also include an API to provide applications with an interface to the modified display.
7. Incorporating the same functionality, with or without the VGA registers, into the BIOS and providing an API to allow applications an interface to the modified display. 8. Incorporating the same functionality into hardware devices, such as monitor itself, with hardware and/or software interfaces to the CPU.
9. This technique may be used to control the desktop (i.e. Windows) to easily enable the desktop to operate in virtually any non-standard size limited only by the capability of the display hardware. This may be in combination with parallel graphical user interface displays or exclusively to maximize the primary operating system desktop display area. This may not require any modification to the operating system.
In overview, the visual display area is conventionally defined by the values maintained in the CRTC registers on the chip and available to the driver. The normally displayed area is defined by VGA standards, and subsequently by SVGA standards, to be a preset number of modes, each mode including a particular display resolution which specifies the area of the display in which the desktop can be displayed.
The desktop can only be displayed in this area because Windows does not directly read/write the video memory, rather it uses programming interface calls to the video driver. And the video driver simply reads/writes using an address that happens to be in video memory. So the value this mechanism needs to realize is the value the video card and driver assert is available for painting. This value is queried from the registers, modified by specific amounts and rewritten to the card. Subsequently, present embodiments change the area of writable visible display space without informing the operating system's display interface of the change
Embodiments of the present invention don't necessarily change the CRTCs to add just to the bottom. Preferably the top is also moved up a little. This keeps the displayed interfaces centered within the drivable display area. For example, rather than just add thirty- two scan lines to the bottom, the top of the display area is moved up by sixteen lines. Nor do embodiments of the present invention depend solely upon the ability to change the CRTCs to modify the visible display area. Alternative mechanisms define other methods of creating and accessing visible areas of the screen that are outside the dimensions of the desktop accessed by the operating system's display interface.
From a consideration of the specifications, drawings, and claims, other embodiments and variations methods and systems of the present invention will be apparent to one skilled in the art of computer science.
In particular, the secondary GUI may be positioned in areas not normally considered the conventional overscan area. For example, the secondary GUI may be positioned in a small square exactly in the center of the normal display in order to provide a service required by the particular system and application. In fact, the techniques of reading and rewriting screen display information can be used to maintain the primary GUI information, or portions of it, in an additional memory and selectively on a timed, computed, interactive, or any or other basis, replace a portion of the primary GUI with the secondary GUI such as a pop-up, window, or any other display space. As a simple example, a security system may require the ability to display information to a user without regard to the status of the computer system and/or require the user to make a selection, such as call for help by clicking on "911?". Embodiments of the present invention could provide a video display buffer in which a portion of the primary GUI interface was continuously recorded and displayed in a secondary GUI for example in the center of the screen. Under non-emergency conditions, the secondary GUI would then be effectively invisible in that the user would not notice anything except the primary GUI.
Under the appropriate emergency conditions, an alarm monitor could cause the secondary GUI to present the "911?" to the user by overwriting the copy of the primary display stored in the secondary GUI memory. Alternatively, a database of photographs may be stored and one recalled in response to an incoming phone call in which caller ID identified a phone number associated with a database photo entry.
In general, embodiments of the present invention may provide one or more secondary user interfaces which may be useful whenever it is more convenient or desirable to control a portion of the total display, either outside the primary display in an unused area such as overscan or even in a portion of the primary GUI directly or by time division multiplexing, directly by communication with the video memory, or by bypassing at least a portion of the video memory to create a new video memory. In other words, methods and systems of the present invention may provide one or more secondary user interfaces outside of the control of the system, such as the operating system, which controls the primary GUI. Additional user interfaces may be used for a variety of different purposes. For example, a secondary user interface may be used to provide simultaneous access to the Internet, full motion video, and a conference channel. A secondary user interface may be dedicated to a local network or multiple secondary user interfaces may provide simultaneous access and data for one or more networks to which a particular computer may be connected. Although specific embodiments of, and examples for, the present invention are described herein for illustrative purposes, it is not intended that the invention be limited to these embodiments. Equivalent methods, structures, processes, steps, and other modifications within the spirit of the invention fall within the scope of the invention. Also, those skilled in this art will understand how to make changes and modifications to the present invention to meet their specific requirements or conditions. For example, the teachings provided herein of the present invention can be applied to other types of computer systems, including those that control non-integrated display surfaces. In addition, the teachings may be applied to other types of devices that have display surfaces and other organizations of computer operating systems and environments. These and other changes may be made to the invention in light of the above detailed description. Accordingly, the invention is not limited by the disclosure.
Figure imgf000044_0001
Figure 1: xSides™ resides outside of the computer desktop.
Figure imgf000045_0001
Figure 2: xSides™ initially launches as a cylinder icon with rotating sides.
Figure imgf000046_0001
Figure 3: The "PORTAL" button launches the xSides™ Portal area.
Figure imgf000046_0002
Figure imgf000047_0001
46
Figure imgf000048_0001
Figure imgf000048_0003
Figure imgf000048_0004
Figure 4: The xSides™ Portal can contain any html-based image or application. Below are generic examples of an electronic programming guide and personal information management systems.
Figure imgf000049_0001
Can Overtake the Desktop
Figure imgf000050_0001
Primary Initial Product:
xSides™ PortalPack
Figure imgf000051_0001
Figure imgf000052_0001
Desktop Mini-Portals
- We provide the code, they provide the content
- Best location - increased duration -► revenues
- Partners promote and distribute to their users
Free ISP Interfaces
- Persistent display area that is user-friendly
- With FullView, users can gain browsing area
- Distinct competitive advantage in commodity world
xSides v.2.2
Product Spec
Including Portal and Web Jump Features
Edited, 8/16/99 12:00pm
xSides V. 2,2 Product Spec
Table of Contents:
Overall Descriptions and Definitions
Section 1 : xSides Portal Design & Feature Guidelines 4
1.1 Descriptions and Definitions 5
1.2 Suggested Space Use Guidelines 6
1.3 Sample Portal Implementations 7
1.4 User Interaction Guidelines 8
Section 2: xSides SinglePack Design & Feature Guidelines 10
2.1 The xSides SinglePack Product 11
2.2 Design and Feature Reouirements 12
2.3 Function Requirements 14
2.4 Design and Button Function 16
2.5 SinglePack User Cartridge Function 17
2.6 Upgrade and Support Function 18
Section 3 xSides™ "Web Jump" Design and Feature Guidelines 19
3.1 : "Web Jump" Description 20
3.2: Operations 21
3.3: Appearance & Action Requirements. Search Mode 22
3.4: Appearance & action Requirements. General 23
3.5: Web Jump Behavior Guidelines 24
Descriptions and Definitions
The following document outlines the function and design specifications of xSides, a cutting-edge
Pixel Company Product .
Our xSides™ Technology enables users and strategic partners to deliver and access content and applications in an area of the computer display which is outside and independent of the computer's operating system. The xSides enabled area cannot be obscured at any time by the Microsoft desktop or any of the applications present therein.
The xSides product initially appears on the bottom of a computer screen as a thin cylinder icon ("the control bar") containing a series of control buttons (see Page 8, Fig. 4). The control bar is comprised of a number of faces, which we call "Sides™," each of which can contain different combinations of content, applications and graphics (hence the name "xSides™").
The user can easily rotate from one Side to the next with mouse clicks to view and access the different content present on a given Side.
The minimum number of Sides in each xSides product is three: one for partner content; one for Help, FAQ and Web support; and one for User Buttons that may be modified and manipulated by the user. (See User Cartridge Function, p. 17.) xSides includes an additional display area called the xSides™ Portal (see Figure 1). This portal expands below the bar and presents an area for companies to display HTML content (email, banner ads, tickers) outside of Windows. There are no design restrictions placed on content that goes into this portal display area. xSides is designed to deliver a wide selection of consumer products available through a number of distribution sources such as online,
PCs, set-top boxes, etc. Therefore, a partner's specific xSides implementation will be able to exist with other such products in this space.
Each partner can create its own "skin.'' A skin is the packaging of graphical elements that make up a singular visual presentation style of xSides. These elements include a set of buttons (which exists on each xSide face), tickers etc. xSides products allow partners to modify their look and feel by either adopting one of the skins provided by The Pixel Company, or by designing their own.
xSides is available to partners in two versions:
1. xSides SinglePack: The SinglePack product includes the xSides Portal feature and allows partners to build an xSides product that modifies functions of the latest Pixel technology, such as site launching, ticker messaging, and Help functions. Partners can modify the look and feel of xSides within defined parameters (outlined by The Pixel Company), or they can work directly with
The Pixel Company to design new, partner-specific design guidelines. Function, size, and number of cartridges will be restricted.
2. xSides PrePack: PrePack contains The Pixel Company's pre-packaged partners as content on the bar. The PrePack version will have limited functionality and modification abilities.
Section 1
xSides Portal
Design
Figure imgf000056_0001
Feature Guidelines
.1 : The xSides Portal: Descriptions and Definitions
The xSides technology includes an expanded area where partners can display HTML content (tickers, links, banner ads). The xSides Portal is available to strategic and content partners who wish to provide products and services to their users in an area that is always available and visible-without getting in the way of computer and Web functionality.
The Portal area functions exclusively with the xSides control bar (see Section 2, p. 10). The xSides Portal launches underneath the bar, and responds to xSides commands, such as open, close, refresh, etc. xSides itself functions as stated in Section 2 (p.10) of this document.
The Portal area will always be 70 pixels high x the horizontal resolution of the screen, minus 20 pixels on the right hand side of the Portal area reserved for user controls.
There are no restrictions on design look and feel for content presented in the xSides portal display area. Content partners may work with The Pixel Company to create their own unique design. There are space-use guidelines (p.6) to follow.
Figure imgf000057_0001
Figure 1
.2: xSides Portal Suggested Space-Use Guidelines
Design specifications are kept open to respond to the requirements of each Partner. However, for product design consistency, the following guidelines should be considered when standard xSides Portal functionality is presented.
1. Background The xSides bar should sit on a black background of the overscan area in which it resides.
2. Constant Distributor logo The left-hand side of the xSides bar will display the Distributor's logo at all times and will remain visible throughout all rotations and uses of each of the bar's faces.
3. Portal Content logo This logo will remain until the user displays another xSides Portal.
4. Application or link areas The xSides Portal gives users access to Web applications, sites and resource links, and tickers. Tickers display scrolling text that, when clicked on, can launch an associated Web page. Text and hyperlinks can be updated as defined in each Partner's contract
5. Banner display area Several banner sizes are supported in this areas if the Partner chooses to include them.
Figure imgf000058_0001
Figure 2
1.3: Sample xSides Portal Implementations
Unlimited new products may also exist n the xSides Portal area These may include a Calendar and Personal Information Manager (PIM), Stock tickers, etc Here are just a few more examples of different Portal implementations
Figure imgf000059_0001
.4: xSides Portal: User Interaction Guidelines
Minimizing the xSides Portal
The first time a user opens an xSides product which includes the Portal area, it can launch into its maximized view. This open option may be turned off by the user as well. Each xSides control bar with the Portal feature will have a prominent "Portal" button on the Side. Once the product has been installed, the user clicks this button to show, refresh or hide the xSides Portal area. Each Portal area also has a familiar "X" box in the upper right-hand corner. Clicking here will either launch the Portal, or make it retreat to show simply the desktop, and the xSides bar.
Figure imgf000060_0001
Figure 3
Maximizing xSides Portal Again
When the xSides Portal is in its minimized state (i.e., turned off), the user clicks on the Portal button to bring xSides Portal back to its full viewing size.
Figure imgf000060_0002
Figure 4
xSides Portal: User Interaction Guidelines, continued
Quick-Jump Feature Between Portals
Users may install and merge several xSides products with Portals. Once this is done, users will be able to quickly jump between them by using a cascading menu system accessible through the xSides logo on the right hand side of the bar.
Figure imgf000061_0001
Figure 5
Section 2
xSides SinglePack Design
Figure imgf000062_0001
Feature Guidelines
.1 : The xSides SinglePack Product
xSides Single Pack xSides provides Partners the option of changing the look and feel of xSides within The Pixel Company's guidelines. A specific set of buttons, or "skins," give Partners a space to customize the way they appear on the xSides bar. Partners may also work with Pixel to have a unique skin built for them, on a for-hire basis, and time/resource permitting. The following restrictions apply to xSides presentation and function:
• The size of the control bar will be the same for all xSides products. This will enable users to mix-and-match xSides bars as they wish, and as they discover new xSides applications in the marketplace.
• Each xSides product will include two additional Sides--a "User" Side and a Help/Support Side. (See "User Cartridge" and "Upgrade and Support" sections, p. 17, 18.)
• The user will be able to remove this application from the computer screen by exiting and/or uninstalling the program from their system, either as part of a larger group of xSides cartridges, or as a stand-alone product.
• xSides products have a limited set of buttons and functionality that must be present and supported in every instance of the product, in addition to Partner-defined buttons.
• The xSide product must be able to rotate.
The xSide product must contain logos.
.2: xSides Design and Feature Requirements
1. Preset Buttons The preset function allows users to "bookmark" specific Sides. Users can set a their selection (CD Player, News & Sports, etc) by right-clicking on the preset button when that particular Side is visible. Once this has been done, users can return to their pre-set destination by left-clicking on that button. Preset Buttons change color once a setting is saved.
2. Category The major category titles are displayed here, and clicking on then switches categories.
3. Help/? When the user clicks on the Help/? button, a pop-up window is launched that contains Welcome, Map, Preferences, Help, and About xSides information.
4. Rotator When clicked, Rotators turn the portion of the bar to the right of the Rotator; left click turns to the next Side, right click turns back.
5. Pixel logo When cursing over over the Pixel Company/xSides logo, this animated graphic will rotate. The logo button, when clicked, links to The Pixel Company Web site.
Figure 6
1. 2. 3. 4. s.
Please Note: The xSides PrePack design will use the standard xSides look, as shown in the example above--with the same feature functionality as the xSides Single Pack.
Figure '
.2: xSides Design and Feature Requirements, Coot.
6. Partner Logo Partner logo is displayed here. A left mouse click links to Partner's Web page.
7. Non-Action buttons Non-Action buttons function only as title buttons or place holders. They don't launch or highlight and cannot be depressed with a mouse down or keyboard command.
8. Action buttons Action buttons are depressible and launch Web links They highlight and function as described under Button Highlighting. (See "xSides Functions" section).
9. Ticker Tickers display scrolling text and, when clicked on, can link to an connecting Web page. Text and hyperlinks can be updated as defined in each partner's contract.
10. Exit / (X) When the user clicks on the Exit button (X), a window appears that confirms the user's choice to exit xSides.
Figure imgf000065_0001
Figure 8
Note:
Logo and Branding Guidelines: The xSides logo and branding is incorporated into the design of the product and the product's download button(s). The xSides/Pixel logo and branding signify that a company uses The Pixel Company's patented technology. The logo and branding can be used to enhance partner marketing materials, including brochures, presentations, and advertisements. The Pixel Cα and xSides logo and branding must be used according to the guidelines outlined in the deliverables. Any deviation from these guidelines must be approved by The Pixel Company.
2.3: xSides Function Requirements
Startup Sequence: Once the user has downloaded, installed, and launched the xSides program, the user is prompted by a dialog box to decide how they want the product to load The default here is for automatic load during the Windows boot sequence While the product software loads, a text message is displayed in the horizontal blank area just below the Task Bar, informing the user that the program is "Adding Overscan Area to Display" or "Initializing xSides Display " (xSides
Figure imgf000066_0001
startup does not interfere with the display of startup sequence of Windows )
At Startup: Following one of the above text messages, the xSides bar appears, and the Distributor or Sub-Distributor cartridge is displayed-unless the user has set a different startup category under Preferences, accessed through the red "?" button The first time xSides runs, the Welcome screen appears when the cursor is moved anywhere over the xSides bar
Rotation Action: The Rotator turns different elements of the bar A left-click turns the bar upward to the next face, and a right-click turns it downward to the previous one The Rotator is the strip located on the left side of the bar, to the right of the red Help '"? " The buttons to the right of the Rotator is the section that turns and changes
Action Buttons: Action Buttons, when clicked, launch an associated function-application, URL, document, CD player, etc Buttons with no action function as title areas only, have no associated hyperlink, and do not highlight
Ticker Tickers display scrolling text and, when clicked on, can activate a hyperlink to launch an associated Web page Text and hyperlinks for tickers can be changed and updated Users will receive ϊhe updated Ticker text and URL when they connect to the Web, and xSides is running on their machines
Button Highlighting: Mouse over At "mouse over," a lighting effect appears in the lower-left corner of the button frame Mouse down When the left mouse button is depressed, highlighting indicates that the xSides button is depressed Mouse up: When the left mouse is released, the function is activated, and the xSides button appears to spring back, reverting to "mouse over" state, described above
Figure imgf000066_0002
2.3: xSides Function Requirements (cont.)
Sound: A subtle sound effect accompanies the rotating action of the bar, to enhance the xSides experience. Pop-Up Window: A pop-up window will launch when the user clicks on the "?" button. The pop-up will have tabs such as Welcome, Help, About, Map, and Preferences.
Screen Saver Mode: The xSides bar slowly rotates through all content when the computer is in Screen Saver mode. Pop-Up Help When the cursor rests over a button, a pop-up window appears. Pop-up Help contain sub-level menus, descriptive text, and more.
Upgrade Path and Merging: The xSides upgrade/merge functionality provides some control and flexibility to the user, keeping the application fresh, useful and personalized, one side at a time. xSides technology is designed to be delivered a la carte to users, with the advanced ability to allow users to add new product features and merge any xSides branded products they choose to any other previously installed xSides product(s). Users will be able to upgrade and merge their xSides products via download from our partners', or an xSides web site (under construction). The user will have full discretion to download any number of xSides products.
The Distribution partner maintains persistent branding and content throughout this merging situation. The Distributor's logo and content remains in their current location no matter what other cartridges have been added or deleted. To remove the distributor branding and content, the user must completely uninstall the product.
: xSides Design Themes
xSides provides Partners the option of changing the look and feel of xSides within The Pixel Company's guidelines. A specific set of buttons, or "themes," gives Partners a space to customize the way they appear on the xSides bar. Partners may also work with Pixel to have a unique theme built for them, on a for-hire basis, and time/resource permitting.
Figure imgf000068_0001
(Example of different product "Themea")
Figure 9
Figure imgf000068_0002
2.5: xSides User Cartridge Function
Description: User buttons are found in the User cartridge in xSides. This Cartridge allow users to customize buttons to suit their needs. xSides products come with seven User buttons
Buttons can be added to User Cartridges in a number of ways. Users may add links thereby creating buttons by dragging and dropping (or copying and pasting) into user button frame.
Additional bonus User bars can be added to the User Cartridge when installing another Partner cartridge (each partner cartridge contains a User section The new User bar is added, titled with the partner's name, containing the link that was just selected.
To clear a User button, right-click on the button, then left-click on "Delete" in the pop-up menu that appears; or, select and highlight a User button and press the DEL key on your keyboard.
To rename a User button, right-click on that button, then left-click on "Rename" in the pop-up menu that appears. Type the new name in the field that appears, then hit "Enter" on your keyboard or click on "Yes" in the pop-up menu. To cancel the change, hit "No."
Figure imgf000069_0001
Figure 10
2.6: xSides Upgrade and Support Function
Description: Each xSides product has a cartridge specifically designated for support and upgrade use. Using these cartridges the user can access links to frequently asked questions, upgrade pages where other xSides products can be found, and receive news and information about xSides products.
This cartridge has one rotation containing a combination of button links and tickers.
Figure imgf000070_0001
Figure 11
2.7: Screen Saver Function
Description: All xSides products will remain on screen at all times, even when the screen saver is activated. The xSides bar and portal will function as specified, slowly rotating through all content.
Figure imgf000070_0002
Figure imgf000071_0001
Section 3
xSides Web Jump Design and Feature Guidelines
Figure imgf000071_0002
: xSides "Web Jump" Description
The xSides product will contain a cartridge that will allow Internet searching, browsing, and display outside of the desktop screen. The user will be able to "jump" to areas of the Web without needing to be online, or a browser running. Full navigation function is available to the user in a. "full view" mode, which presents the Web in the largest display window ever developed.
Figure imgf000072_0001
Sample images of the various looks and feels
Figure 12
3.2: xSides Web Jump: Operations
Two Modes of Use: The xSides "Web Jump" bar will operate in two modes: Search and Browse.
Search: The bar will first launch in Search mode. This mode will present a side of the bar that holds an entry field for the user to type in search requests, or URL Jump requests. There will be two search functions: Search and Ask. The Search function will launch the default browser, initiate the search using the default search engine, and display the results. Ask will accept plain English language requests and post results.
The user can jump to any location by typing in a standard URL request with either "http:" or "www." at the beginning of the request. If the user presses the Enter key, the program will recognize this as either a search or jump request, and initiate the action.
A "Full View" button will change the look of the bar, so that full Web navigation functions are displayed.
Figure imgf000073_0001
Figure 13
"Browse" When the ull View" button is pressed, the right-hand side of the xSides bar will display a similar row of browser with "Full View" function buttons. These will display navigation tools that lets the user move easily around the Web. These functions are further described in the "Appearance" section.
When the user types a request in the Input Field, the default browser will be launched in Full View, a pure Web display area with no navigation bars. The user will now navigate using the buttons in the xSides area. Clicking on the Full View button again allows the user to return to Search View.
Figure imgf000073_0002
Figure 14 Note: All Example xSides Layouts: Specific location of functional buttons may vary according to partner requirements
3: xSides Web Jump: Appearance & Action Requirements. Search Mode
Designed to provide quick jumps to the internet, the user will be able to type in several types of requests and then jump out to the Net to have the action immediately taken. The first face of the Web Jump cartridge the User sees is "Search Mode". The following lists the functions accessed on the Web Jump cartridge.
1. "Title" This is your xSides browser
2. "Rotator" This takes the user to the Search mode.
3. "Input field" This is where the user types in all searches, queries, and URLs.
4. "Search" This button performs a search on the information typed into the input field
5. "Go!" This takes the user to the URL location typed into the input field.
6. "Add to favorites" User clicks this button to put the Web page currently in use into a Favorites or Bookmarks folder.
7. "Open Favorites" Brings up the folder with favorite (bookmarked) sites.
8. "Full View" This launches the browser in Full Screen Mode, and toggles Full View off as well.
2. 3. 4. 5. 6. 7. 8.
Figure imgf000074_0001
Figure 15 Note: Example xSides Layout: Specific location of functional buttons may vary according to partner requirements
4: xSides Web Jump: Appearance & Action Regs. Browser Mode
1. "Title" This is your xSides browser.
2. "Rotator" This takes the user to the Search mode.
3. " Back" This button takes the user back to previous Web page
4. "Stop" This button stops whatever Web access action is in progress.
5. "Forward" This button takes the user forward to previously viewed, but "next" web page
6. "Reload"( Refresh) This reloads, or refreshes, the currently viewed Web page.
7. "Home" This button takes the user to their designated home page.
8. "Print" This button provides browser print functionality.
9. "Input field" This is where the user types in all searches, queries, and URLs.
10. "Search" This button performs a search on the information typed into the input field.
11. "Go" This takes the user to the URL location typed into the input field.
12. "Add to favorites" User clicks this button to put the Web page currently in use into a Favorites or Bookmarks folder.
13. "Open Favorites" Brings up the folder with favorite (bookmarked) sites.
14. "Full View" This button changes the mode to Full View or Regular browser view.
Figure imgf000075_0001
3.5: The xSides Web Jump: Behavior Guidelines
Starting up: xSides' Web Jump will work with the user's default browser application The user will launch the xSides Web Jump while in one of three states
1 Offline, and no browser running
2 Online, and no browser running
3 Online, with another browser running
The xSides browser will launch the user's default browser and will mirror its functionality consistent with the user's understanding and expectation Therefore, Web Jump will tie into the information stored on the system registry files, or in the shared data files of the user's default browser
Scenario #1 The user is working offline With the xSides browser displayed on the bottom of the screen, the user types a question into the input field and hits Search The logon sequence will begin and a Full View Web window will fill the screen The user will then navigate by using the controls on the browser bar (The user will actually be using his default browser functionality, even though its recognizable function bars wilt not be visible )
Scenario #2 - The user is online and has no browser running Same as above, except no logon sequence
Scenario #3 - The user is online and has browser running xSides browser will duplicate functions of the Web browser, including Favorites, Home, and other user oriented information The user will be able to access the same information, in the same display format, by clicking on the same button in each area
Handling Favorites The xSides "Favorites" area will read files from the user's default browser As new URL links are added to the user's default browser, they are also added to the xSides Favorites section, and visa versa Clicking on the Favorites button in the xSides Browser area will bring up the same dialogue box as those in I E or Netscape
Handling "Home" A user's start page, the place he goes to first when surfing the Web wilt be shared between the xSides browser and the user's default browser settings xSides Browser will read the registry to deliver the same URL location Pop-Up Help When the mouse cursor rests over a button, a pop-up window appears Pop up Help may contain cascading menus, descriptive text, etc
3.5: xSides Web Jump: Behavior Guidelines, Cont.
Switching Between Full View and Various Sizes of the Regular Browser:
The user will be able to switch between viewing default browser in Full View mode or regular browser display. Both the Search bar and the Browsing bar will have a A Full View button displayed on the right of the Input Field. When the user clicks on this button, the screen will expand so the entire viewing ares will be filled with the Web window, without any borders, toolbars, navigation buttons, etc. The user clicks the button to toggle between this Full and regular a Web views.
1. xSides Search mode with Standard browser functionality. With Search mode the user's default browser will function normally. Users will now simply have the choice of having a Full View mode, in addition to the standard maximize and minimize modes within Windows. When the user is in the Search bar and clicks the Full View button, xSides will rotate to the Full View browsing controls where the user can navigate the web with an expanded Browser viewing area.
ioϋsws I 'or.tøba ressfKβScfeπ am iΛ n ii S ™
Figure imgf000077_0001
(Standard browser state)
2. xSides Full View mode with Expanded Browser viewing area. When the user wants to return to their standard browser viewing mode they click on the Full View button again and it will rotate the control bar back to the search bar and display their default browser.
Figure imgf000077_0002
S p' Φf fntf PlthillE.lt
Figure imgf000077_0003
_ . , -ΛΛ'."--.', , Ki . J.* us.
Figure imgf000077_0004
!; i ■■■ vssussA'WT **: tφ*»mtKBffvsfmmB m) a>. »r,
(Full View browser state)
Figure 16
PIM side for the xSides™ bar
Rev. 5
(Personal Information Manager)
Product Specification
September ?, 1999
The Pixel Company
Table of Contents
Functional Specification 3 Overview 3 Hardware 3
1211 Cbent Side 3
1212 Server Side 3
122 Software 3
1221 Server Side 3
1222 Client Side 3 End User Features in general 4 UI Analysis 4 1 PIM side for xSides Bar (from left to nght) 4
211 PIM/Info Manager side buttons 4 212 Calendar button 4
2121 Current Date 5
2122 Go To Today 5
2123 Monthly calendar 5
2124 Full-Size Calendar 5
2125 Events 6
Figure imgf000079_0001
2127 Small Ad Space 8
213 Contacts Button 9
2131 Address Book (An alphabetical directory for personal contacts list) 9
2132 Search by Name 10
2133 Contacts Help 10
2134 Clear 10
214 Calculator Button 10
2141 Display 11
2142 Display Area 11
2143 Onscreen Keypad 1 ]
2144 Additional Calculations 11
2145 Constants 11
2146 Conversions 11
2147 Small banner ad 11
215 Memo 12
2151 Memo Input/Retneval area 12
2152 Search Area 12
216 Daily News 13
217 Ne sStand 14
218 Apartment Button 15
1 Functional Specification
1.1 Overview
This project is designed to convert the calendar and other appropriate features/tools from the Apartment; plus new tools, into an extended (portal) side for the xSides bar. These features/tools fall under the category of Personal Information Management. The title of the actual side is still up in the air at this point.
1.2 Hardware
1.2.1.1 Client Side
Internet access and provider
Min Processor: 486DX/66 PC (Pentium® or higher recommended)
3MB of free hard drive space
20MB of RAM; (24MB of RAM recommended for Win95)
24 MB of RAM (32 MB recommended) for Win98
Monitor: VGA (with standard resolutions)
Mouse and Keyboard support.
Recommended for single-monitor systems
Direct X Support (installer will install if needed)
Modem
1.2.1.2 Server Side
. WWW server
• SQL database server
1.2.2 Software
1.2.2.1 Server Side
• Database(s) to support the calendar, Distributor and Instant Alert.
• SQL 6.5 or 7.0
• IIS 4.0+
• User Registration
1.2.2.2 Client Side
• Windows 95 or 98 or Windows NT Operating System • Install detects whether client system needs to have additional support software installed.
1.3 End User Features in general:
The user will download a single xSides side that is the PIM or will download a prepack that includes the PIM or another name yet to be determined, that denotes the idea of managing their personal information. By enabling users to store and access personal information, it is hoped that the PEM side will increase stickiness for the xSides bar.
Users will be able to access their own personal address book through this side as well as maintain their own personal calendar. With the use of Instant Alert, they can, if they wish, be notified in advance of events listed on their personal calendar either through email or a desktop pop-up window. They will also be able to access a calculator; a portal for writing and finding memos - notes the user generates about any topic; links to headlines from our Daily News, the magazine rack; and the Apartment, which would not consist of a portal but would launch full screen above the bar.
2 UI Analysis
2.1 PIM side for xSides Bar: (from left to right)
2.1.1 PIM/lnfo Manager side buttons:
The category title area on the left-hand side of the side will contain the title: "PIM" or "Info Manager" or another name to be specified. The Info Manager side includes the following buttons from left to right: Calendar, Contacts, Calculator, Memo, Daily News, Newsstand, Apartment. With the exception of the Apartment button, if a user clicks on a button, it causes the associated portal to appear in the portal area beneath the bar. (Clicking on the Apartment button causes the Apartment to launch full screen in the browser above the bar.)
2.1.2 Calendar button:
The first button to the right of the category title area will be labeled "Calendar". When the user clicks on the Calendar button the following information will appear from left to right, in the extended portal area below the bar:
Figure imgf000082_0001
2.1.2.1 Current Date.
The current date is displayed on the left side of the Calendar portal area.
2.1.2.2 Go To Today:
Clicking on the Go To Today button on the Calendar portal causes the current day's date to highlight on the monthly calendar and presents the current days scheduled events in the portal area to the right.
2.1.2.3 Monthly calendar
A small current monthly calendar, with the current date highlighted appears to the right of the current date.
2.1.2.4 Full-Size Calendar:
Clicking on the Full-Size link causes the existing calendar to launch in a browser window above the bar for a more extensive view of events.
Figure imgf000083_0001
Full Size (existing) Calendar.
2.1.2.5 Events:
Clicking on the Events link causes the Scheduled Events list to appear to the right, in the portal area. This list presents the information from the hourly section (blue and white section), of the users' full view calendar. This section is scrollable and presents controls to ADD, EDIT SELECTED and DELETE SELECTED. If the user clicks on ADD, they will be presented with the ADD EVENT/APPOINTMENT page of the existing calendar. The user selects an item to edit or delete, by highlighting it. Clicking on DELETE SELECTED will automatically delete the record of this event. Clicking on EDIT SELECTED will pop up the EDIT EVENT/APPOINTMENT page of the existing calendar, showing the current information for that particular event.
Figure imgf000084_0001
Add Event/ Appointment Page.
2.12.6 To Do List:
Clicking on the To-do List, causes the user's ongoing To-Do list to appear in the portal area in the same space where the Scheduled Events list appears. This section is non-date specific, and can be prioritized. This area is also scrollable and includes the same edit controls as the Scheduled Events list: ADD, EDIT SELECTED AND DELETE SELECTED.
Calendar Portal showing To-Do list.
Figure imgf000084_0002
To DELETE an item on the To Do list, the user will first need to select it by highlighting. Clicking on EDIT SELECTED or ADD presents the EDIT or ADD TO TO-DO LIST pop up dialogue box (es).
Figure imgf000085_0001
Add/Edit To-Do List interface
2.1.2.7 Small Ad Space:
To the right of the To-Do list is a 100 x 70 banner ad space.
2.1.3 Contacts Button:
The next button to the right is the Contacts button. When the user clicks on this button it will launch their address book in the portal area. They will see the following features, from left to right, in the portal area below the bar:
Figure imgf000086_0001
Contacts Portal
2.1.3.1 Address Book: (An alphabetical directory for personal contacts list)
The user clicks on a letter or the # sign to see listings for people whose last name begins with the selected letter or a number. These names are displayed in the scrollable box to the right of the alphabetical listing. The alphabetical directory has controls to ADD, EDIT SELECTED and DELETE SELECTED. To add a name, the user clicks ADD. This presents the current calendar's ADD/CHANGE form. They then fill in the information and click on SUBMIT ENTRY CHANGES. To EDIT an entry, the user selects a listing in the box to the right and then clicks on EDIT SELECTED. This brings up the Add/Change form for that listing. To DELETE a listing, the user selects the listing and then clicks on DELETE SELECTED.
The user can see the following information, per listing:
Name; home phone number; work phone number; email address; cell phone number; pager; fax and home and work addresses. 2.1.3.2 Search by Name
The next window presents the Search by Name feature. This is part of the functionality of the existing calendar. The user types in a first or last name and clicks on search to search their directory of contacts. The results appear in the scrollable listing area to the left.
2.1.3.3 Contacts Help
Links to the Help for the Address book. (*This will need to be modified for this version of Address Book/Calendar.)
2.1.3.4 Clear
Clicking on this button clears the current search.
2.1.4 Calculator Button:
The next button to the right of Contacts is the Calculator button. When the user clicks on this button they will see the following features, from left to right, in the portal area:
Figure imgf000087_0001
2.1.4.1 Display:
There are two display modes for the calculator: Business and Scientific. Business display mode lists the numbers in a column and keeps a simple running tally. Scientific display mode display actual calculations in a list.Actual Display:
2.14.2 Display Area:
This is the next area to the right where either mode: Business or Scientific can be displayed.
2.1.4.3 Onscreen Keypad:
To the right of the display is an onscreen representation of a traditional keypad. The user can enter numbers and functions here by clicking on a number or function on the onscreen keypad or by using their actual keypad.
2.1.4.4 Additional Calculations:
The next section to the right (currently titled: "title:" contains additional calculations the user may wish to select.
2.1.4.5 Constants:
To the right of Calculation is Constants. A list of constants the user may with to select.
2.1.4.6 Conversions:
The next section to the right consists of a series of pull down menus used to create conversions for example; the user could select miles in the left-hand column and feet in the right hand column. When the user clicks on the Calculate button, the answer appears in the space below.
2.1.4.7 Small banner ad:
There is space for a small banner ad on the right-hand side of the portal.
2.1.5 Memo:
The fourth button on the PIM bar launches the Memo feature in the portal area. This is a tool the user can use to write short notes about any topic to themselves. It could be a list of gifts to buy or a book they heard about or design ideas, etc. The Memo portal from left to right includes the following:
Figure imgf000089_0001
2.1.5.1 Memo Input/Retneval area:
The white area is the space where the user enters their memo content. Each memo has a number, (like a page number), associated with it. The user can select a number from the list across the top of the Input Retrieval area to see a specific memo.
2.15.2 Search Area:
A user can also retrieve a memo using the Search area. They simply type a word they remember using in the memo, into the Search box and click on the Search button. The result of the Search appears in the white area. They use the Search Results button to page through various pages of results. 2.1.6 Daily News:
The Fifth button on the bar is Daily News Clicking on this button presents the headlines from the current MO Daily News to appear in the portal area We already have this functionality working for the genenc beta so all that may be required here is a slight design change to make this feature appear consistent with the rest of the PIM portals
Figure imgf000090_0001
The Daily News portal will contain a menu listing each of the major sections of the Daily, such as News, Sports, Weather, etc (Please disregard the beige menu on the far left This will not be included )
2.1.7 NewsStand:
The sixth button on the PIM side is the NewsStand button. Clicking on this button presents a graphic of the current MO newsstand (also called magazine rack) to appear in the portal area. Each magazine links directly to that publication's online ezine or publication. We already have this functionality working for the generic beta and the design should be final.
Figure imgf000091_0001
ewsstan porta 2.1.8 Apartment Button:
• The last button on the PIM side is the Apartment button. Clicking on this button launches the Apartment full screen in a browser above the bar. This Apartment would be the same as the current Apartment offered through MO.
This is a quick description of xSides Conversion and Merge - drawn from the development spec for xSides:
1.1 End User Features
Version 2.2 of xSides should accomplish and provide the following:
(Please Note: the old data structure is contained in an ini, the new data structure is contained in a "Markup file" - inis will not go forward in xSides after conversion).
1 Conversion of Old Data Structures (MySpace 2.1) to New Data Structures (xSides 2.2+) Conversion of old data structures will happen with a separate executable that resides in the same installed directory as the xSides executable, the new executable is called converter.exe.
Conversion process: a) Each and every time the xSides executable (pixels.exe) is launched it will check to see if there are any ini or mark-up files of and older version or format that need to be converted to the newest data format. b) If ini or mark-up files exist that need to be converted pixels.exe will call converter.exe to make the old data structures match the new data structures and write it into the new data file: pixels.dat
2 Merging data
To provide the ability to have dynamic xSides content the ability to merge new cartridges and portals into xSides will be added. Merge process: a) After the xSides executable has performed any conversion of data files that may need to be done, it performs a further check to see if there are any newly downloaded pixels.dat files to be merged with the current pixels.dat. (Pixels.dat files contain data structures for xSides bar and portal areas.) b) Pixels.exe will merge the previously existing xSides data and the new xSides cartridge(s) data into a single data tree. And write the newly merged markup file (pixels.dat) in the appropriate install directory. c) Merging will happen at the Platinum level of xSides, such that if duplicate data at this level, Category Name ('"Where" in the ini/markup), is present in merging bars, the newest data will replace previous data. Any unique data will be merged as a new Platinum category into the existing category list.
In All of these scenarios the following would be true:
• Merging will happen at the Platinum level. Example:
If xSides Distributor A has an Entertainment Category, and xSides Distributor B has an Entertainment category, when the user already has distribution A installed then downloads distribution B, distribution B will replace distributor A's Entertainment category.
• The most recently downloaded distribution of the xSides bar will take precedence in the merging (replacing duplicate sides with most recently downloaded) - except if it is not the most recent version of the application.
• When Cartridges are the unique at the Platinum level between distributions - unique cartridges will be retained.
• Cartridges will always maintain the original associated distributor's logo.
• Deletion: will be allowed When the Marketplace version is available and installed by the user. Deletion will happen by User choice at the Side level after the application has been installed and they have connected to Marketplace through the xSides interface in Help/Pref/Map/Marketplace area. The user will be presented with a list of currently installed bars along side the other bars the user can install, This dialog also provides that the user can select from the list of currently installed bars and select to remove them.
• There are no limits to the number of cartridges the user may install to their xSides bar. In the case of xSides SDK versions - there should be a statement that the could be a performance hit it they have more than ll instMeα-t • When merge takes place and new content and cartridges are added - all associated pop-up help and cascading menus will also be merged - with the exception of the original distributor area - controled by original distributor - not other subsequent distributors. d) For version 2.2 new bars will be placed at the end of the list. (Alphabetical order will not be maintained with the newly merged bars in this first version of merge). e) After the conversion and merge are complete, xSides will launch reading and displaying the newly merged data.
Figure imgf000095_0001
Figure imgf000095_0002
Figure imgf000096_0001
Figure imgf000097_0001
Figure imgf000098_0001

Claims

Claims
1. A method for modifying the display of a secondary user interface on a video display system to include a portal area, the video display system having a total displayable area that includes a first region and a second region, the first region controlled by a computer operating system which presents a user interface that occupies at least a portion of the first region, the second region located outside of the first region and outside of the control of the operating system, the secondary user interface being displayed in the second region, comprising: upon receiving an indication to display a portal area; increasing the size of the second region by reallocating the total displayable area between the first region and the second region, such that the first region decreases in size in a manner that is transparent to the operating system; allocating a first portion of the enlarged second region to the secondary user interface and a second portion to the portal area; redisplaying the secondary user interface in the first portion of the enlarged second region; determining an indication of content to display in the portal area; and loading and displaying the indicated content in the portal area.
2. The method of claim 1 wherein the content that is loaded and displayed in the portal area is a user interface for a personal information management system.
3. The method of claim 2 wherein the personal information management system includes a calendar for scheduling events.
4. The method of claim 1 wherein the content that is loaded and displayed in the portal area is an html-based image.
5. The method of claim 1 wherein the content that is loaded and displayed in the portal area is an application that communicates over a network.
6. The method of claim 5 wherein the network is the Internet.
7. The method of claim 1 wherein the content that is loaded and displayed in the portal area is a user interface for instant messaging.
8. The method of claim 1 wherein the content that is loaded and displayed in the portal area is an advertisement.
9. The method of claim 1 wherein the content that is loaded and displayed in the portal area is a user interface for an electronic mail application.
10. The method of claim 1 wherein the content that is loaded and displayed in the portal area contains textual or graphical information.
11. The method of claim 1 wherein the content that is loaded and displayed in the portal area is an application that invokes a programming interface of the code that controls the second region to modify characteristics of the second region.
12. The method of claim 1 wherein the content that is loaded and displayed in the portal area is an electronic program guide.
13. The method of claim 1, further comprising: dynamically determining a component of the secondary user interface that is potentially new or updated; integrating the determined component into the secondary user interface.
14. A device for modifying the display of a secondary user interface on a video display system to include a portal area, the video display system having a total displayable area that includes a first region and a second region, the first region controlled by a computer operating system which presents a user interface that occupies at least a portion of the first region, the second region located outside of the first region and outside of the control of the operating system, the secondary user interface being displayed in the second region, comprising: a display adjustment mechanism that, upon receiving an indication to display a portal area, increases the size of the second region by reallocating the total displayable area between the first region and the second region, such that the first region decreases in size in a manner that is transparent to the operating system; a region allocation system that allocates a first portion of the enlarged second region to the secondary user interface and a second portion to the portal area causing the secondary user interface to be redisplayed in the first portion of the enlarged second region; and a portal management system that determines an indication of content to display in the portal area and loads and displays the indicated content in the portal area.
15. The device of claim 14 wherein the content that is loaded and displayed in the portal area is a user interface for a personal information management system.
16. The device of claim 15 wherein the personal information management system includes a calendar for scheduling events.
17. The device of claim 14 wherein the content that is loaded and displayed in the portal area is an html-based image.
18. The device of claim 14 wherein the content that is loaded and displayed in the portal area is an application that communicates over a network.
19. The device of claim 18 wherein the network is the Internet.
20. The device of claim 14 wherein the content that is loaded and displayed in the portal area is a user interface for instant messaging.
21. The device of claim 14 wherein the content that is loaded and displayed in the portal area is an advertisement.
22. The device of claim 14 wherein the content that is loaded and displayed in the portal area is a user interface for an electronic mail application.
23. The device of claim 14 wherein the content that is loaded and displayed in the portal area contains textual or graphical information.
24. The device of claim 14 wherein the content that is loaded and displayed in the portal area is an application that invokes a programming interface of the code that controls the second region to modify characteristics of the second region.
25. The device of claim 14 wherein the content that is loaded and displayed in the portal area is an electronic program guide.
26. The device of claim 14, further comprising: a user interface merge facility that dynamically determines a component of the secondary user interface that is potentially new or updated and integrates the determined component into the secondary user interface.
27. A computer readable memory medium containing instructions for controlling a computer processor to modify the display of a secondary user interface on a video display system to include a portal area, the video display system having a total displayable area that includes a first region and a second region, the first region controlled by a computer operating system which presents a user interface that occupies at least a portion of the first region, the second region located outside of the first region and outside of the control of the operating system, the secondary user interface being displayed in the second region, by: upon receiving an indication to display a portal area; increasing the size of the second region by reallocating the total displayable area between the first region and the second region, such that the first region decreases in size in a manner that is transparent to the operating system; allocating a first portion of the enlarged second region to the secondary user interface and a second portion to the portal area; redisplaying the secondary user interface in the first portion of the enlarged second region; determining an indication of content to display in the portal area; and loading and displaying the indicated content in the portal area.
28. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is a user interface for a personal information management system.
29. The computer readable memory medium of claim 28 wherein the personal information management system includes a calendar for scheduling events.
30. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is an html-based image.
31. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is an application that communicates over a network.
32. The computer readable memory medium of claim 31 wherein the network is the Internet.
33. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is a user interface for instant messaging.
34. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is an advertisement.
35. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is a user interface for an electronic mail application.
36. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area contains textual or graphical information.
37. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is an application that invokes a programming interface of the code that controls the second region to modify characteristics of the second region.
38. The computer readable memory medium of claim 27 wherein the content that is loaded and displayed in the portal area is an electronic program guide.
39. The computer readable memory medium of claim 27, further comprising instructions for controlling the computer processor by: dynamically determining a component of the secondary user interface that is potentially new or updated; integrating the determined component into the secondary user interface.
40. A method in a computer system for updating a secondary user interface that is displayed in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, the secondary user interface containing at least one cartridge, the cartridge having a plurality of user interface components that provide access to behavior of the secondary user interface, comprising: dynamically determining an indication of a cartridge that is potentially new or updated; and transparently integrating the plurality of user interface components of the indicated cartridge into the secondary user interface, thereby modifying the secondary user interface.
41. The method of claim 40 wherein the indicated cartridge has a plurality of faces, and wherein the integration of the plurality of user interface components merges the faces into the secondary interface.
42. The method of claim 41 wherein each face provides a group of related behaviors.
43. The method of claim 41 wherein a face that is merged overwrites an existing face of the secondary interface.
44. The method of claim 41 wherein a face that is merged provides a new behavior of the secondary interface.
45. A device for updating a secondary user interface that is displayed in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, the secondary user interface containing at least one cartridge, the cartridge having a plurality of user interface components that provide access to behavior of the secondary user interface, comprising: a merge mechanism that, dynamically determines an indication of a cartridge that is potentially new or updated; and transparently integrates the plurality of user interface components of the indicated cartridge into the secondary user interface, thereby modifying the secondary user interface.
46. The device of claim 45 wherein the indicated cartridge has a plurality of faces, and wherein the integration of the plurality of user interface components merges the faces into the secondary interface.
47. The device of claim 46 wherein each face provides a group of related behaviors.
48. The device of claim 46 wherein a face that is merged overwrites an existing face of the secondary interface.
49. The device of claim 46 wherein a face that is merged provides a new behavior of the secondary interface.
50. A computer readable memory containing instructions for controlling a computer processor to update a secondary user interface that is displayed in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, the secondary user interface containing at least one cartridge, the cartridge having a plurality of user interface components that provide access to behavior of the secondary user interface, by: dynamically determining an indication of a cartridge that is potentially new or updated; and transparently integrating the plurality of user interface components of the indicated cartridge into the secondary user interface, thereby modifying the secondary user interface.
51. The computer readable memory medium of claim 50 wherein the indicated cartridge has a plurality of faces, and wherein the integration of the plurality of user interface components merges the faces into the secondary interface.
52. The computer readable memory medium of claim 51 wherein each face provides a group of related behaviors.
53. The computer readable memory medium of claim 51 wherein a face that is merged overwrites an existing face of the secondary interface.
54. The computer readable memory medium of claim 51 wherein a face that is merged provides a new behavior of the secondary interface.
55. A method in a computer system for displaying the result of accessing data over a network in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, comprising: receiving an indication of the location of data on the network; using the indication to retrieve data; and displaying the retrieved data in the second region, so that the retrieved data is not overwritten by the user interface controlled by the operating system.
56. The method of claim 55 wherein the indication of the location of data on the network is obtained from a search function.
57. The method of claim 55 wherein the indication of the location of data on the network is obtained from a specific network location.
58. The method of claim 57 wherein the specific network location is specified using a URL .
59. The method of claim 55, further comprising: upon receiving an indication to display the retrieved data in a large area, displaying the retrieved data in a third region that overlays the first region instead of displaying the retrieved data in the second region, the third region being outside of the control of the operating system; and displaying user interface components in the second region that control the display of the retrieved data in the third region.
60. The method of claim 59 wherein the user interface components control access to the network.
61. The method of claim 59 wherein the network is the Internet.
62. A device for displaying the result of accessing data over a network in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, comprising: a network access mechanism that, receives an indication of the location of data on the network; uses the indication to retrieve data; and displays the retrieved data in the second region, so that the retrieved data is not overwritten by the user interface controlled by the operating system.
63. The device of claim 62 wherein the indication of the location of data on the network is obtained from a search function.
64. The device of claim 62 wherein the indication of the location of data on the network is obtained from a specific network location.
65. The device of claim 64 wherein the specific network location is specified using a URL .
66. The device of claim 62, wherein the network access mechanism, upon receiving an indication to display the retrieved data in a large area, displays the retrieved data in a third region that overlays the first region instead of displaying the retrieved data in the second region, the third region being outside of the control of the operating system; and displays user interface components in the second region that control the display of the retrieved data in the third region.
67. The device of claim 66 wherein the user interface components control access to the network.
68. The device of claim 66 wherein the network is the Internet.
69. A computer readable memory medium that contains instructions for controlling a computer processor to display the result of accessing data over a network in a second region of a video display system that is located outside of a first region of the video display system, the first region controlled by a computer operating system which presents a user interface in at least a portion of the first region, the second region being outside of the control of the operating system, by: receiving an indication of the location of data on the network; using the indication to retrieve data; and displaying the retrieved data in the second region, so that the retrieved data is not overwritten by the user interface controlled by the operating system.
70. The method of claim 69 wherein the indication of the location of data on the network is obtained from a search function.
71. The method of claim 69 wherein the indication of the location of data on the network is obtained from a specific network location.
72. The method of claim 71 wherein the specific network location is specified using a URL .
73. The method of claim 69, further comprising: upon receiving an indication to display the retrieved data in a large area, displaying the retrieved data in a third region that overlays the first region instead of displaying the retrieved data in the second region, the third region being outside of the control of the operating system; and displaying user interface components in the second region that control the display of the retrieved data in the third region.
74. The method of claim 73 wherein the user interface components control access to the network.
75. The method of claim 73 wherein the network is the Internet.
PCT/US2000/026118 1999-09-21 2000-09-21 Method and system for controlling a complementary user interface on a display surface WO2001022196A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU79851/00A AU7985100A (en) 1999-09-21 2000-09-21 Method and system for controlling a complementary user interface on a display surface

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15528899P 1999-09-21 1999-09-21
US60/155,288 1999-09-21

Publications (2)

Publication Number Publication Date
WO2001022196A2 true WO2001022196A2 (en) 2001-03-29
WO2001022196A3 WO2001022196A3 (en) 2001-12-27

Family

ID=22554820

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/026118 WO2001022196A2 (en) 1999-09-21 2000-09-21 Method and system for controlling a complementary user interface on a display surface

Country Status (4)

Country Link
US (3) US6630943B1 (en)
AU (1) AU7985100A (en)
TW (1) TW490652B (en)
WO (1) WO2001022196A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003073239A2 (en) * 2002-02-27 2003-09-04 Gemstar Development Corporation Two-way communications link at sub-operating system level

Families Citing this family (119)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3633415B2 (en) * 2000-01-14 2005-03-30 日本電気株式会社 GUI control method and apparatus, and recording medium
DE10040680A1 (en) * 2000-08-19 2002-02-28 Philips Corp Intellectual Pty TV with additional functions
US20020059377A1 (en) * 2000-11-14 2002-05-16 Jagadish Bandhole Collaborative computing systems using dynamic computing environments
US20040204988A1 (en) * 2001-11-16 2004-10-14 Willers Howard Francis Interactively communicating selectively targeted information with consumers over the internet
US20030101065A1 (en) * 2001-11-27 2003-05-29 International Business Machines Corporation Method and apparatus for maintaining conversation threads in electronic mail
US7363590B2 (en) * 2001-11-27 2008-04-22 International Business Machines Corporation Calendar bar interface for electronic mail interaction
US7802207B2 (en) * 2001-12-13 2010-09-21 Nvidia International, Inc. System, method, and article of manufacture for generating a customizable network user interface
USRE48596E1 (en) 2002-01-16 2021-06-15 Intel Corporation Interface engine providing a continuous user interface
US6957392B2 (en) * 2002-01-16 2005-10-18 Laszlo Systems, Inc. Interface engine providing a continuous user interface
US20030142140A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Adjusting the tint of a translucent window to convey status
US6954905B2 (en) * 2002-01-28 2005-10-11 International Business Machines Corporation Displaying transparency characteristic aids
US7146573B2 (en) * 2002-01-28 2006-12-05 International Business Machines Corporation Automatic window representation adjustment
US20030142141A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Displaying specified resource usage
US20030142137A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Selectively adjusting the order of windows in response to a scroll wheel rotation
US20030142133A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Adjusting transparency of windows to reflect recent use
US20030142143A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Varying heights of application images to convey application status
US20030142149A1 (en) * 2002-01-28 2003-07-31 International Business Machines Corporation Specifying audio output according to window graphical characteristics
US20030174169A1 (en) * 2002-01-31 2003-09-18 Tiwari Rajesh K. Porting screens designed for a higher resolution HMI to a lower resolution HMI
US7343565B2 (en) * 2002-03-20 2008-03-11 Mercurymd, Inc. Handheld device graphical user interfaces for displaying patient medical records
TW594573B (en) * 2002-12-02 2004-06-21 Tatung Corp Method for building up customized desktop of web page
US8749561B1 (en) 2003-03-14 2014-06-10 Nvidia Corporation Method and system for coordinated data execution using a primary graphics processor and a secondary graphics processor
CA2537229C (en) * 2003-05-14 2012-10-16 Collaborative Sciences And Technology, Inc. Persistent portal
US9715678B2 (en) 2003-06-26 2017-07-25 Microsoft Technology Licensing, Llc Side-by-side shared calendars
US7707255B2 (en) 2003-07-01 2010-04-27 Microsoft Corporation Automatic grouping of electronic mail
US8799808B2 (en) 2003-07-01 2014-08-05 Microsoft Corporation Adaptive multi-line view user interface
US7669140B2 (en) * 2003-08-21 2010-02-23 Microsoft Corporation System and method for providing rich minimized applications
US8302111B2 (en) 2003-11-24 2012-10-30 Time Warner Cable Inc. Methods and apparatus for hardware registration in a network device
US7266726B1 (en) 2003-11-24 2007-09-04 Time Warner Cable Inc. Methods and apparatus for event logging in an information network
US8196044B2 (en) * 2004-01-05 2012-06-05 Microsoft Corporation Configuration of user interfaces
WO2005074397A2 (en) * 2004-02-05 2005-08-18 Kings Information & Network Computer security apparatus and method using security input device driver
US9213538B1 (en) 2004-02-06 2015-12-15 Time Warner Cable Enterprises Llc Methods and apparatus for display element management in an information network
SE0400875D0 (en) * 2004-04-01 2004-04-01 Teleca Software Solutions Ab A terminal for navigating documents
WO2005098588A1 (en) * 2004-04-05 2005-10-20 Matsushita Electric Industrial Co., Ltd. Display screen management unit
US7996785B2 (en) * 2004-06-30 2011-08-09 Microsoft Corporation Systems and methods for integrating application windows in a virtual machine environment
US8255828B2 (en) 2004-08-16 2012-08-28 Microsoft Corporation Command user interface for displaying selectable software functionality controls
US7703036B2 (en) 2004-08-16 2010-04-20 Microsoft Corporation User interface for displaying selectable software functionality controls that are relevant to a selected object
US9015621B2 (en) 2004-08-16 2015-04-21 Microsoft Technology Licensing, Llc Command user interface for displaying multiple sections of software functionality controls
US8146016B2 (en) 2004-08-16 2012-03-27 Microsoft Corporation User interface for displaying a gallery of formatting options applicable to a selected object
US7895531B2 (en) 2004-08-16 2011-02-22 Microsoft Corporation Floating command object
US7747966B2 (en) 2004-09-30 2010-06-29 Microsoft Corporation User interface for providing task management and calendar information
US8726168B2 (en) * 2004-12-04 2014-05-13 Adobe Systems Incorporated System and method for hiding latency in computer software
JP4794232B2 (en) * 2004-12-06 2011-10-19 株式会社Sokudo Substrate processing equipment
US7665031B2 (en) * 2004-12-08 2010-02-16 Microsoft Corporation Method and system of taskbar button interfaces
US7613954B2 (en) * 2004-12-21 2009-11-03 National Instruments Corporation Test executive with stack corruption detection
US8107010B2 (en) 2005-01-05 2012-01-31 Rovi Solutions Corporation Windows management in a television environment
US20060184895A1 (en) * 2005-02-17 2006-08-17 Dolph Blaine H Visibly persisting one or more computer desktop windows
US20060218505A1 (en) * 2005-03-28 2006-09-28 Compton Anthony K System, method and program product for displaying always visible audio content based visualization
US20060253794A1 (en) * 2005-05-03 2006-11-09 Wilson David R Internet-Based Affinity Marketing Method Including a Desktop Customizable Toolbar
US8743019B1 (en) 2005-05-17 2014-06-03 Nvidia Corporation System and method for abstracting computer displays across a host-client network
US8239882B2 (en) 2005-08-30 2012-08-07 Microsoft Corporation Markup based extensibility for user interfaces
US8689137B2 (en) 2005-09-07 2014-04-01 Microsoft Corporation Command user interface for displaying selectable functionality controls in a database application
US9542667B2 (en) 2005-09-09 2017-01-10 Microsoft Technology Licensing, Llc Navigating messages within a thread
US8627222B2 (en) 2005-09-12 2014-01-07 Microsoft Corporation Expanded search and find user interface
US20070070094A1 (en) * 2005-09-29 2007-03-29 Lim Ruth A Graphical user interface for managing native display resolution from a distance
US7565682B2 (en) * 2005-10-31 2009-07-21 Microsoft Corporation Web service UI information guide
US8806363B1 (en) * 2005-11-22 2014-08-12 Google Inc. Framed user interface
US7612786B2 (en) * 2006-02-10 2009-11-03 Microsoft Corporation Variable orientation input mode
US8930834B2 (en) * 2006-03-20 2015-01-06 Microsoft Corporation Variable orientation user interface
US20070226275A1 (en) * 2006-03-24 2007-09-27 George Eino Ruul System and method for transferring media
US8139059B2 (en) * 2006-03-31 2012-03-20 Microsoft Corporation Object illumination in a virtual environment
US8775704B2 (en) 2006-04-05 2014-07-08 Nvidia Corporation Method and system for communication between a secondary processor and an auxiliary display subsystem of a notebook
US20070271520A1 (en) * 2006-05-19 2007-11-22 Sun Microsystems, Inc. Method for transforming a graphical user interface
US8605090B2 (en) 2006-06-01 2013-12-10 Microsoft Corporation Modifying and formatting a chart using pictorially provided chart elements
US9727989B2 (en) 2006-06-01 2017-08-08 Microsoft Technology Licensing, Llc Modifying and formatting a chart using pictorially provided chart elements
US20070284429A1 (en) * 2006-06-13 2007-12-13 Microsoft Corporation Computer component recognition and setup
US20070294371A1 (en) * 2006-06-15 2007-12-20 Petri John E Method for determining input focus for web pages having aggregated content
US8001613B2 (en) * 2006-06-23 2011-08-16 Microsoft Corporation Security using physical objects
US20080040692A1 (en) * 2006-06-29 2008-02-14 Microsoft Corporation Gesture input
US7665033B2 (en) * 2006-08-31 2010-02-16 Sun Microsystems, Inc. Using a zooming effect to provide additional display space for managing applications
US7971136B2 (en) * 2007-03-21 2011-06-28 Endless Spaces Ltd. System and method for dynamic message placement
US8762880B2 (en) 2007-06-29 2014-06-24 Microsoft Corporation Exposing non-authoring features through document status information in an out-space user interface
US8484578B2 (en) 2007-06-29 2013-07-09 Microsoft Corporation Communication between a document editor in-space user interface and a document editor out-space user interface
US7930645B2 (en) * 2007-08-09 2011-04-19 Yahoo! Inc. Systems and methods for providing a persistent navigation bar in a word page
US8850351B2 (en) * 2007-09-25 2014-09-30 Ati Technologies Ulc Method and tool for virtual desktop management
US7926072B2 (en) * 2007-10-01 2011-04-12 Spring Design Co. Ltd. Application programming interface for providing native and non-native display utility
US8397207B2 (en) * 2007-11-26 2013-03-12 Microsoft Corporation Logical structure design surface
US20090199120A1 (en) * 2008-02-01 2009-08-06 Moaec, Inc. Customizable, reconfigurable graphical user interface
US9588781B2 (en) 2008-03-31 2017-03-07 Microsoft Technology Licensing, Llc Associating command surfaces with multiple active components
US9665850B2 (en) 2008-06-20 2017-05-30 Microsoft Technology Licensing, Llc Synchronized conversation-centric message list and message reading pane
US8402096B2 (en) 2008-06-24 2013-03-19 Microsoft Corporation Automatic conversation techniques
US8736617B2 (en) * 2008-08-04 2014-05-27 Nvidia Corporation Hybrid graphic display
US9954976B2 (en) * 2008-11-03 2018-04-24 Viavi Solutions Inc. System and method for remotely displaying data
US8451222B2 (en) * 2008-11-05 2013-05-28 Ipc Systems, Inc. Converged desktop between a PC and a trading turret
US8799425B2 (en) * 2008-11-24 2014-08-05 Nvidia Corporation Configuring display properties of display units on remote systems
US9037992B2 (en) * 2008-12-29 2015-05-19 International Business Machines Corporation System and method for changing system modes
US9075559B2 (en) * 2009-02-27 2015-07-07 Nvidia Corporation Multiple graphics processing unit system and method
US9046983B2 (en) 2009-05-12 2015-06-02 Microsoft Technology Licensing, Llc Hierarchically-organized control galleries
WO2010141748A1 (en) * 2009-06-03 2010-12-09 The Sagecos Group, Inc. Using layers to construct graphical user interfaces
US9135675B2 (en) * 2009-06-15 2015-09-15 Nvidia Corporation Multiple graphics processing unit display synchronization system and method
US8766989B2 (en) * 2009-07-29 2014-07-01 Nvidia Corporation Method and system for dynamically adding and removing display modes coordinated across multiple graphics processing units
US20110063305A1 (en) * 2009-09-16 2011-03-17 Nvidia Corporation Co-processing techniques on heterogeneous graphics processing units
US8780122B2 (en) * 2009-09-16 2014-07-15 Nvidia Corporation Techniques for transferring graphics data from system memory to a discrete GPU
US9111325B2 (en) * 2009-12-31 2015-08-18 Nvidia Corporation Shared buffer techniques for heterogeneous hybrid graphics
MY178854A (en) * 2009-12-14 2020-10-21 Mimos Berhad A device for controlling display of content
US9830889B2 (en) 2009-12-31 2017-11-28 Nvidia Corporation Methods and system for artifically and dynamically limiting the display resolution of an application
US10397639B1 (en) 2010-01-29 2019-08-27 Sitting Man, Llc Hot key systems and methods
US8655944B2 (en) 2010-10-05 2014-02-18 Microsoft Corporation Website compatibility shims
US20120124474A1 (en) * 2010-11-11 2012-05-17 Rovi Technologies Corporation User presentation settings for multiple media user interfaces
US9600785B2 (en) * 2011-01-31 2017-03-21 International Business Machines Corporation Automatically generated and updated graphical rendering of processes
US10417018B2 (en) 2011-05-27 2019-09-17 Microsoft Technology Licensing, Llc Navigation of immersive and desktop shells
US8924885B2 (en) * 2011-05-27 2014-12-30 Microsoft Corporation Desktop as immersive application
US9843665B2 (en) 2011-05-27 2017-12-12 Microsoft Technology Licensing, Llc Display of immersive and desktop shells
US20140104137A1 (en) * 2012-10-16 2014-04-17 Google Inc. Systems and methods for indirectly associating logical and physical display content
US9818379B2 (en) 2013-08-08 2017-11-14 Nvidia Corporation Pixel data transmission over multiple pixel interfaces
USD749610S1 (en) * 2013-09-03 2016-02-16 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD749109S1 (en) * 2013-09-03 2016-02-09 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
US9842532B2 (en) 2013-09-09 2017-12-12 Nvidia Corporation Remote display rendering for electronic devices
KR101548228B1 (en) * 2013-12-27 2015-08-28 주식회사 케이티 Apparatus for synchronizing user interface based on user state and method thereof
EP2953370A1 (en) * 2014-06-05 2015-12-09 Ziggo B.V. Minimizing input lag in a remote GUI TV application
US9513671B2 (en) 2014-08-01 2016-12-06 Microsoft Technology Licensing, Llc Peripheral retention device
US10191986B2 (en) 2014-08-11 2019-01-29 Microsoft Technology Licensing, Llc Web resource compatibility with web applications
US9705637B2 (en) 2014-08-19 2017-07-11 Microsoft Technology Licensing, Llc Guard band utilization for wireless data communication
US9397723B2 (en) 2014-08-26 2016-07-19 Microsoft Technology Licensing, Llc Spread spectrum wireless over non-contiguous channels
US9424048B2 (en) 2014-09-15 2016-08-23 Microsoft Technology Licensing, Llc Inductive peripheral retention device
CN106557321A (en) * 2016-11-17 2017-04-05 交控科技股份有限公司 A kind of Dynamic Graph display packing and device based on track traffic
US11716558B2 (en) 2018-04-16 2023-08-01 Charter Communications Operating, Llc Apparatus and methods for integrated high-capacity data and wireless network services
US11129213B2 (en) 2018-10-12 2021-09-21 Charter Communications Operating, Llc Apparatus and methods for cell identification in wireless networks
US11129171B2 (en) 2019-02-27 2021-09-21 Charter Communications Operating, Llc Methods and apparatus for wireless signal maximization and management in a quasi-licensed wireless system
US11026205B2 (en) 2019-10-23 2021-06-01 Charter Communications Operating, Llc Methods and apparatus for device registration in a quasi-licensed wireless system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0419765A1 (en) * 1989-09-29 1991-04-03 International Business Machines Corporation Color television window expansion and overscan correction for high-resolution raster graphics displays
EP0564174A2 (en) * 1992-03-31 1993-10-06 International Business Machines Corporation Method and system for visual presentation of data in a data processing system
EP0747805A1 (en) * 1995-06-07 1996-12-11 SONY ELECTRONICS INC. (a Delaware corporation) Window management
WO1999027517A1 (en) * 1997-11-21 1999-06-03 The Pixel Company Secondary user interface

Family Cites Families (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2096866B (en) 1981-04-10 1985-02-20 Philips Electronic Associated Improvements relating to character display
DE3381300D1 (en) 1983-03-31 1990-04-12 Ibm IMAGE ROOM MANAGEMENT AND PLAYBACK IN A PART OF THE SCREEN OF A VIRTUAL MULTIFUNCTIONAL TERMINAL.
US4558413A (en) * 1983-11-21 1985-12-10 Xerox Corporation Software version management system
US5163024A (en) 1983-12-30 1992-11-10 Texas Instruments Incorporated Video display system using memory with parallel and serial access employing serial shift registers selected by column address
US4586035A (en) 1984-02-29 1986-04-29 International Business Machines Corporation Display terminal with a cursor responsive virtual distributed menu
US4649499A (en) 1984-03-07 1987-03-10 Hewlett-Packard Company Touchscreen two-dimensional emulation of three-dimensional objects
US4710761A (en) 1985-07-09 1987-12-01 American Telephone And Telegraph Company, At&T Bell Laboratories Window border generation in a bitmapped graphics workstation
US4868765A (en) 1986-01-02 1989-09-19 Texas Instruments Incorporated Porthole window system for computer displays
US4899136A (en) 1986-04-28 1990-02-06 Xerox Corporation Data processor having a user interface display with metaphoric objects
US5394521A (en) 1991-12-09 1995-02-28 Xerox Corporation User interface with multiple workspaces for sharing display system objects
US5072412A (en) 1987-03-25 1991-12-10 Xerox Corporation User interface with multiple workspaces for sharing display system objects
US5001697A (en) 1988-02-10 1991-03-19 Ibm Corp. Method to automatically vary displayed object size with variations in window size
US5036315A (en) * 1988-09-06 1991-07-30 Spectragraphics, Inc. Simultaneous display of interleaved windowed video information from multiple asynchronous computers on a single video monitor
US4947257A (en) * 1988-10-04 1990-08-07 Bell Communications Research, Inc. Raster assembly processor
US5146556A (en) 1988-10-11 1992-09-08 Next Computer, Inc. System and method for managing graphic images
US4972264A (en) 1989-06-19 1990-11-20 International Business Machines Corporation Method and apparatus for viewing an overscanned image
US5060170A (en) 1989-08-09 1991-10-22 International Business Machines Corp. Space allocation and positioning method for screen display regions in a variable windowing system
US5167030A (en) 1989-08-23 1992-11-24 Helix Software Company, Inc. System for dynamically allocating main memory to facilitate swapping of terminate and stay resident communication program to increase available memory space
JP3245655B2 (en) 1990-03-05 2002-01-15 インキサイト ソフトウェア インコーポレイテッド Workspace display processing method
US5202961A (en) 1990-06-08 1993-04-13 Apple Computer, Inc. Sequential information controller
US5305435A (en) 1990-07-17 1994-04-19 Hewlett-Packard Company Computer windows management system and method for simulating off-screen document storage and retrieval
US5367623A (en) 1990-09-25 1994-11-22 Sharp Kabushiki Kaisha Information processing apparatus capable of opening two or more windows on screen, one window containing a page and other windows containing supplemental information
JPH05181443A (en) * 1991-07-01 1993-07-23 Seiko Epson Corp Computer
US5237669A (en) 1991-07-15 1993-08-17 Quarterdeck Office Systems, Inc. Memory management method
US5500934A (en) 1991-09-04 1996-03-19 International Business Machines Corporation Display and control system for configuring and monitoring a complex system
US5418572A (en) 1992-04-29 1995-05-23 Quantel Limited Method of and apparatus for displaying images at different rates
JPH06167966A (en) 1992-06-15 1994-06-14 Seiko Epson Corp Display circuit
KR960003880B1 (en) 1992-10-12 1996-03-23 엘지전자주식회사 Caption display control apparatus and the method thereof
US5673403A (en) * 1992-11-13 1997-09-30 International Business Machines Corporation Method and system for displaying applications of different operating systems on a single system using the user interface of the different operating systems
US6091430A (en) 1993-03-31 2000-07-18 International Business Machines Corporation Simultaneous high resolution display within multiple virtual DOS applications in a data processing system
CA2095448C (en) 1993-05-04 1998-05-05 Phillip J. Beaudet Window management system utilizing icons and miniature windows
US5619226A (en) 1993-07-01 1997-04-08 Intel Corporation Scaling image signals using horizontal and vertical scaling
US5652851A (en) 1993-07-21 1997-07-29 Xerox Corporation User interface technique for producing a second image in the spatial context of a first image using a model-based operation
US5631825A (en) 1993-09-29 1997-05-20 Dow Benelux N.V. Operator station for manufacturing process control system
JP2972510B2 (en) 1993-11-25 1999-11-08 株式会社日立製作所 Document creation device
US5825357A (en) 1993-12-13 1998-10-20 Microsoft Corporation Continuously accessible computer system interface
US5421009A (en) 1993-12-22 1995-05-30 Hewlett-Packard Company Method of remotely installing software directly from a central computer
US5513342A (en) 1993-12-28 1996-04-30 International Business Machines Corporation Display window layout system that automatically accommodates changes in display resolution, font size and national language
US6185629B1 (en) 1994-03-08 2001-02-06 Texas Instruments Incorporated Data transfer controller employing differing memory interface protocols dependent upon external input at predetermined time
US5651127A (en) 1994-03-08 1997-07-22 Texas Instruments Incorporated Guided transfers with variable stepping
US5521614A (en) 1994-04-29 1996-05-28 Cirrus Logic, Inc. Method and apparatus for expanding and centering VGA text and graphics
US5831609A (en) * 1994-06-17 1998-11-03 Exodus Technologies, Inc. Method and system for dynamic translation between different graphical user interface systems
US5568603A (en) 1994-08-11 1996-10-22 Apple Computer, Inc. Method and system for transparent mode switching between two different interfaces
US5555364A (en) 1994-08-23 1996-09-10 Prosoft Corporation Windowed computer display
KR970005940B1 (en) 1994-09-30 1997-04-22 대우전자 주식회사 Monitor on-screen display device
US5619639A (en) * 1994-10-04 1997-04-08 Mast; Michael B. Method and apparatus for associating an image display area with an application display area
US5764964A (en) 1994-10-13 1998-06-09 International Business Machines Corporation Device for protecting selected information in multi-media workstations
US5838334A (en) 1994-11-16 1998-11-17 Dye; Thomas A. Memory and graphics controller which performs pointer-based display list video refresh operations
US6002411A (en) 1994-11-16 1999-12-14 Interactive Silicon, Inc. Integrated video and memory controller with data processing and graphical processing capabilities
US6067098A (en) 1994-11-16 2000-05-23 Interactive Silicon, Inc. Video/graphics controller which performs pointer-based display list video refresh operation
US6008803A (en) 1994-11-29 1999-12-28 Microsoft Corporation System for displaying programming information
US5621428A (en) 1994-12-12 1997-04-15 Auravision Corporation Automatic alignment of video window on a multimedia screen
US5617526A (en) 1994-12-13 1997-04-01 Microsoft Corporation Operating system provided notification area for displaying visual notifications from application programs
US5473745A (en) 1994-12-14 1995-12-05 International Business Machines Corporation Exposing and hiding a title bar behind its window using a visual cue
US5745762A (en) 1994-12-15 1998-04-28 International Business Machines Corporation Advanced graphics driver architecture supporting multiple system emulations
US5621904A (en) 1995-01-24 1997-04-15 Intel Corporation Method and apparatus for avoiding overlapped windows and a gutter space
JP3517301B2 (en) * 1995-03-28 2004-04-12 富士通株式会社 Virtual screen display processing system
AR000593A1 (en) 1995-04-26 1997-07-10 Wink Communications Inc Intreactive information system and method for determining broadcaster information
US5867178A (en) 1995-05-08 1999-02-02 Apple Computer, Inc. Computer system for displaying video and graphic data with reduced memory bandwidth
US5680323A (en) 1995-06-23 1997-10-21 Canon Information Systems, Inc. Multimedia player
US5704050A (en) 1995-06-29 1997-12-30 International Business Machine Corp. Snap control for relocating elements of a graphical user interface
US5757386A (en) 1995-08-11 1998-05-26 International Business Machines Corporation Method and apparatus for virtualizing off-screen memory of a graphics engine
US5742797A (en) 1995-08-11 1998-04-21 International Business Machines Corporation Dynamic off-screen display memory manager
TW302453B (en) 1995-08-25 1997-04-11 Ibm
US5838296A (en) 1995-08-31 1998-11-17 General Instrument Corporation Apparatus for changing the magnification of video graphics prior to display therefor on a TV screen
US5940610A (en) 1995-10-05 1999-08-17 Brooktree Corporation Using prioritized interrupt callback routines to process different types of multimedia information
JPH09106336A (en) 1995-10-11 1997-04-22 Sharp Corp Method for displaying plural display images within display window of information processor
JPH09114443A (en) 1995-10-20 1997-05-02 Seiko Epson Corp Video scaling device
US5793438A (en) 1995-11-13 1998-08-11 Hyundai Electronics America Electronic program guide with enhanced presentation
JP2001525951A (en) 1995-12-08 2001-12-11 テルコーディア テクノロジーズ インコーポレイテッド Method and system for placing advertisements in a computer network
US5940077A (en) 1996-03-29 1999-08-17 International Business Machines Corporation Method, memory and apparatus for automatically resizing a window while continuing to display information therein
US5745109A (en) 1996-04-30 1998-04-28 Sony Corporation Menu display interface with miniature windows corresponding to each page
US6148346A (en) 1996-06-20 2000-11-14 Peerless Systems Imaging Products, Inc. Dynamic device driver
KR0174152B1 (en) 1996-07-02 1999-04-01 삼성전자 주식회사 Image size adjusting apparatus of pigital display monitor
US5771042A (en) 1996-07-17 1998-06-23 International Business Machines Corporation Multi-size control for multiple adjacent workspaces
AU3908297A (en) 1996-08-06 1998-02-25 Starsight Telecast Incorporated Electronic program guide with interactive areas
KR100256443B1 (en) 1996-08-16 2000-06-01 윤종용 Multimedia display device
US5847709A (en) 1996-09-26 1998-12-08 Xerox Corporation 3-D document workspace with focus, immediate and tertiary spaces
US5796393A (en) * 1996-11-08 1998-08-18 Compuserve Incorporated System for intergrating an on-line service community with a foreign service
US5870767A (en) 1996-11-22 1999-02-09 International Business Machines Corporation Method and system for rendering hyper-link information in a printable medium from a graphical user interface
US6081262A (en) * 1996-12-04 2000-06-27 Quark, Inc. Method and apparatus for generating multi-media presentations
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control
US5874958A (en) 1997-03-31 1999-02-23 Sun Microsystems, Inc. Method and apparatus for accessing information and items across workspaces
US6072483A (en) 1997-06-02 2000-06-06 Sony Corporation Active frame scroll interface
US6025841A (en) 1997-07-15 2000-02-15 Microsoft Corporation Method for managing simultaneous display of multiple windows in a graphical user interface
US6018332A (en) 1997-11-21 2000-01-25 Ark Interface Ii, Inc. Overscan user interface
US6337717B1 (en) 1997-11-21 2002-01-08 Xsides Corporation Alternate display content controller
US6639613B1 (en) * 1997-11-21 2003-10-28 Xsides Corporation Alternate display content controller
US6686936B1 (en) * 1997-11-21 2004-02-03 Xsides Corporation Alternate display content controller
KR100253002B1 (en) 1997-11-28 2000-04-15 구자홍 Image processing apparatus and method for display in dtv
JPH11167478A (en) 1997-12-02 1999-06-22 Yokogawa Electric Corp Warning display method and distributed control system using it
US6434532B2 (en) 1998-03-12 2002-08-13 Aladdin Knowledge Systems, Ltd. Interactive customer support for computer programs using network connection of user machine
US6437809B1 (en) 1998-06-05 2002-08-20 Xsides Corporation Secondary user interface
US6426762B1 (en) 1998-07-17 2002-07-30 Xsides Corporation Secondary user interface
US6320577B1 (en) 1998-11-03 2001-11-20 Agilent Technologies, Inc. System and method for graphically annotating a waveform display in a signal-measurement system
US6356284B1 (en) 1999-03-29 2002-03-12 Powerware Corporation Operating system-independent graphical user interface with sliding panel
US6570595B2 (en) * 1999-06-24 2003-05-27 Xoucin, Inc. Exclusive use display surface areas and persistently visible display of contents including advertisements
US6510451B2 (en) 1999-10-14 2003-01-21 Yodlee.Com, Inc. System for completing a multi-component task initiated by a client involving Web sites without requiring interaction from the client
US6727918B1 (en) * 2000-02-18 2004-04-27 Xsides Corporation Method and system for controlling a complementary user interface on a display surface

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0419765A1 (en) * 1989-09-29 1991-04-03 International Business Machines Corporation Color television window expansion and overscan correction for high-resolution raster graphics displays
EP0564174A2 (en) * 1992-03-31 1993-10-06 International Business Machines Corporation Method and system for visual presentation of data in a data processing system
EP0747805A1 (en) * 1995-06-07 1996-12-11 SONY ELECTRONICS INC. (a Delaware corporation) Window management
WO1999027517A1 (en) * 1997-11-21 1999-06-03 The Pixel Company Secondary user interface

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"COORDINATING MULTIPLE GRAPHICAL USER INTERFACES VIDEO ACCESS" IBM TECHNICAL DISCLOSURE BULLETIN,US,IBM CORP. NEW YORK, vol. 39, no. 5, 1 May 1996 (1996-05-01), pages 7-9, XP000584036 ISSN: 0018-8689 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003073239A2 (en) * 2002-02-27 2003-09-04 Gemstar Development Corporation Two-way communications link at sub-operating system level
WO2003073239A3 (en) * 2002-02-27 2003-12-11 Gemstar Dev Corp Two-way communications link at sub-operating system level

Also Published As

Publication number Publication date
US7340682B2 (en) 2008-03-04
US20040027387A1 (en) 2004-02-12
US20040032423A1 (en) 2004-02-19
AU7985100A (en) 2001-04-24
TW490652B (en) 2002-06-11
WO2001022196A3 (en) 2001-12-27
US6630943B1 (en) 2003-10-07

Similar Documents

Publication Publication Date Title
WO2001022196A2 (en) Method and system for controlling a complementary user interface on a display surface
US6892359B1 (en) Method and system for controlling a complementary user interface on a display surface
WO2000065563A1 (en) Secondary user interface
US20110221765A1 (en) Method and system for controlling a complementary user interface on a display surface
US6091411A (en) Dynamically updating themes for an operating system shell
US5140677A (en) Computer user interface with window title bar mini-icons
US6639613B1 (en) Alternate display content controller
US6686936B1 (en) Alternate display content controller
US8321801B2 (en) Desktop widgets for presentation in a layer
US6429883B1 (en) Method for viewing hidden entities by varying window or graphic object transparency
EP0810536B1 (en) User-controllable persistent browser display pages
US6456307B1 (en) Automatic icon generation
EP0972253B1 (en) Method and apparatus for accessing information and items across multiple workspaces
US7007240B1 (en) Method and system for displaying non-overlapping program and auxiliary windows
EP1031127A1 (en) Secondary user interface
US6388685B1 (en) Method for displaying a window
EP0697647A1 (en) Multimedia digital foil presentation system
WO1999063514A9 (en) Secondary user interface
US7053899B2 (en) Animation packager for an on-line book
WO2001061484A2 (en) Method and system for controlling a complementary user interface on a display surface
WO2002039266A9 (en) Method and system for controlling a complementary user interface on a display surface
JPH05224857A (en) Graphical user interface of data processing system and method for changing size of data input field
AU6395099A (en) Changing advertisement size in response to user interactions

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP