|Publication number||US6990654 B2|
|Application number||US 09/953,050|
|Publication date||Jan 24, 2006|
|Filing date||Sep 14, 2001|
|Priority date||Sep 14, 2000|
|Also published as||US7571426, US20020085020, US20060015847, WO2002023336A1|
|Publication number||09953050, 953050, US 6990654 B2, US 6990654B2, US-B2-6990654, US6990654 B2, US6990654B2|
|Inventors||Thomas J. Carroll, Jr.|
|Original Assignee||Bea Systems, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (5), Non-Patent Citations (16), Referenced by (216), Classifications (6), Legal Events (5)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application claims priority from provisional application “XML-BASED GRAPHICAL USER INTERFACE APPLICATION DEVELOPMENT TOOLKIT”, Application No. 60/232,515, filed Sep. 14, 2000, and incorporated herein by reference.
A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
The invention relates generally to computer graphical user interfaces, and specifically to a system and a method for utilizing an interface library to create application interfaces.
Successful software user interface design requires adherence to rules and heuristics that are traditionally available from user interface design literature and user interface standards guidelines. These rules are typically expressed in everyday human-language, and not in ways that computers can readily understand them. Because of this, the act of creating a user interface that complies to standard guidelines is often an ad-hoc process that suffers because different designers often have different interpretations of the same rules. This in turn leads to results that are not easily reproducible.
Several systems and methods currently exist to allow a programmer to develop a user software application. Such systems or development suites include VISUAL STUDIO™ Integrated Development Environment (hereafter Visual Studio) from Microsoft Corp., DELPHI™ Integrated Development Environment (hereafter Delphi) from Borland Software Corp., and VISUAL CAFÉ™ Integrated Development Environment (hereafter Visual café) from Symantec Corp., together with the programming languages which underlie these development suites, e.g. C, C++, BASIC, or JAVA™ programming language (hereafter Java). However, with all of these development methods, care must be taken to develop the user interface in accordance with the underlying logic of the application. Although separate tools can be used for each aspect of the development process, the developer (or developers) must typically be aware of each aspect so as to achieve consistent results.
To this end, several toolkits including the JAVA Swing toolkit have been developed to assist in the user interface development process. Newer technologies such as the Extensible Markup Language (XML) and document type definition (DTD) have allowed the development of platform- and application-independent interfaces and layouts. Object modeling techniques such as the Unified Modeling Language (UML) assist the developer in visualizing or managing the interface development process.
Further information about these, and related topics can be found in the following references, incorporated herein by reference:
SAX™ (SAX XML Parser, hereafter SAX) http://www.megginson.com/SAX/index.html
As used herein the terms Java™, and SWING™ are trademarks of Sun Microsystems, Inc. The terms Windows™, and VISUAL STUDIO™ are trademarks of Microsoft Corporation. The term DELPHI™ is a trademark of Borland Software Corp. The terms WebLogic™, and WebLogic Server™ are trademarks of BEA Software, Inc. The term VISUAL CAFÉ™ is a trademark of Symantec Corp.
However, each of these tools address only one aspect of the problem—i.e. either the application logic portion or the graphical user interface. There is a general desire in software development to segregate the two goals of the development process (the application logic and the application interface or appearance) so that the underlying application may be reused, and a user interface simply and separately programmed and placed on top.
There is also a desire to have a development system which allows the creation or enforcement of a set of development guidelines, that can then be used to enforce restrictions upon the developer, and thus ensure a level of standardization throughout an organization.
The invention addresses the desire to segregate the various application or software logic, and interface design aspects, of the application development process. Roughly described, the invention relies on declaratively specifying the design of a computer application's user interface. This is in contrast to the current imperative methods of specifying a user interface, that work primarily by developing application code that then constructs the user interface. The invention can be included in an application development system or suite, to allow for the rapid development of graphically-rich applications in a consistent manner. Advantages of the present invention include:
Less Need for Coding
In accordance with one embodiment of the invention, an application's user interface is declaratively specified as an easily-programmed XML document. The XML document is parsed at application compile time, in accordance with a set of predefined rules, to create the application user interface.
Formalization of Good User Interface Design Rules
As used with the invention, the XML documents that describe a user interface are associated with an XML Data Type Definition (DTD) file and an XML Schema. Both the DTD and the Schema are XML documents that formally describe the syntax (a “grammar”) for the XML documents that are then used to describe an application's user interface. These grammars impose the rules of user interface design as further specified within typical user interface standards guidelines such as, The Windows Interface Guidelines for Software Design, The OSF/Motif Style Guide, and the JAVA Look and Feel Design Guidelines. Because the user interfaces are specified declaratively within XML documents, these XML documents can be checked for correctness. In this context “correctness” equals conformance to user interface design guidelines.
Applications May Provide Guidance to User Interface Designers
Since the rules of user interface design are encoded in a manner that a computer can process them (as XML documents), the invention provides a way to construct a computer application that in turn guides user interface developers through the user interface design process. For example, an application can enforce the rules of how user interface elements (menus, toolbars, etc.) are composed, so that the resulting application user interface conforms to the style guidelines of its target environment.
In accordance with one embodiment, the invention comprises a system for generating an application graphical user interface, comprising: a parser, for parsing an application source code file, application interface file, interface grammar file, and interface library, to generate an application graphical user interface; an application source code file for an application, specifying an application logic; an application interface file specifying a plurality of graphical elements within an interface library to be displayed for said application; an interface grammar file specifying rules to be used in parsing said application interface file; and, an interface library comprising a plurality of graphical elements to be retrieved by said parser in accordance with the specifications of said application interface file and said interface grammar file.
In another embodiment the invention comprises a system for development of an application graphical user interface, comprising: means for creating an application source code file specifying an application logic; means for creating an application interface file specifying a plurality of graphical elements within an interface library to be displayed for said application; means for creating an interface grammar file specifying rules to be used in parsing said application interface file; an interface library comprising a plurality of graphical elements to be retrieved in accordance with the specification of said application interface file and said interface grammar file; and, a parser, for parsing said application source code file, said application interface file, and said interface grammar file, retrieving said plurality of graphical elements from said interface library, and generating an application graphical user interface.
In a further embodiment the invention comprises a system for allowing consistency verification of an application user interface for an application in a graphical user interface development system, comprising: an interface library comprising a plurality of graphical elements; means for parsing an application interface file, said application interface file specifying a plurality of graphical elements within said interface library to be displayed for said application; means for parsing an interface grammar file, said interface grammar file specifying rules to be used in parsing said application interface file and retrieving said plurality of graphical elements; and, means for retrieving from said interface library a plurality of graphical elements, in accordance with the rules applied by said interface grammar file during parsing.
Appendix A contains an example of an XML file for use with the invention bliss.xml file.
Appendix B contains the Bliss application's source code.
Appendix C contains the source code for the BEAtitude class of the Joy user interface library.
Roughly described, an embodiment of the invention comprises a system and a method that utilizes a graphical User Interface Library—a collection of JAVA classes and interfaces that take graphical interface definition files (in one embodiment XML documents) as input, and create an application's user interface from the documents' content. This process allows programmers to rapidly create engaging, internationalized graphical user interfaces with significantly less coding than would have been otherwise necessary. In this manner, building an application's user interface requires nothing more than a text editor.
The User Interface Library allows JAVA developers to segregate application logic from application presentation (i.e., the user interface). Using the system, an application's graphical user interface is specified within XML documents. The Interface Library is then used to construct the application's user interface from the contents of the XML documents when the application is started. This allows an application to have multiple presentations (user interfaces) that can be targeted to particular users or groups of users, or to different computing environments (for example, for use in personal computers, personal digital assistants, or cell phones).
The following glossary will be useful in understanding the various description of embodiments of the invention that follows.
Abstract Window Toolkit (AWT)
A library of classes and interfaces for building platform-independent graphical user interfaces for JAVA applications and applets. AWT is a standard component of the Java programming language. The classes within the AWT library map to or “wrap” the user interface components of the host window system.
A type of JAVA application that runs within a web browser. For security reasons, applets run within a secured environment that can constrict what they can do (for example, altering files). JAVA applications run outside of the secured environment and have no restrictions.
See JAVA class.
The area within a main window or dialog window that remains once the window's menu bar, tool bars, command buttons, and status bar have been positioned.
See system clipboard.
An application that allows the user to enter type commands to a computer's operating system.
See user interface component.
A method (subroutine) of a class that is invoked when an instance of the class is created.
A window within an application that is subordinate to the application's main window.
Document Type Definition (DTD)
See XML DTD.
A menu that is displayed from a menu bar.
See XML element.
See XML empty element.
Enterprise Java Bean (EJB)
A software object, written in the JAVA programming language, that runs within an application server and conforms to the Enterprise JAVA Bean standard.
Extensible Style Language (XSL)
An XML grammar used to create documents that describe how to data within XML documents are transformed.
An abstract data type in which values are retrieved by a key string. Ideally, the average time to retrieve an element from a hash table should not increase as the number of elements in the hash table increases.
See JAVA interface.
See User Interface Library
The process of engineering an application so that it can be ported to any language or locale without requiring further re-engineering or re-compilation.
An object-oriented programming language developed by Sun Microsystems, Inc.
In the dava JAVA programming language, a class is a data structure definition that is used to create objects (structured variables). A class is a definition of which objects are members of a class (set) of objects.
In the JAVA programming language, an interface is a class definition that cannot contain state (variables) or behavior (methods). It is an explicit declaration of what operations a class (set) of objects must implement.
JAVA Main Function
In the JAVA programming language, a class may have a function called “main” that can be the starting point of execution for a JAVA application or applet.
In the JAVA programming language, a package is a collection of classes and interfaces. Packages can be hierarchically nested, with packages containing sub-packages. Packages form name-spaces within JAVA.
JAVA Property File
A text file that is associated with a JAVA class. Multiple property files may be associated with a class. The JAVA Runtime Environment (JRE) loads the property files that match the user's language and locale settings. This allows JAVA application's to retrieve values in a language- and locale-independent manner in support of internationalization and localization.
JAVA Runtime Environment (JRE)
Software that executes JAVA applications or applets.
An area that shares a common language and cultural conventions.
The process of enabling an application to be used within a given location by adhering to the location's language and customs.
See JAVA main function.
An application's window that typically contains the application's menus.
A user interface component that typically runs along the top of an application's main window, and typically contains drop-down menus.
See JAVA package.
See UML package diagram.
Software that, using a set of grammatical rules, recognizes the language specified by the grammar.
An atomic (non-divisible) element of an image for display on a screen or similar display device. A pixel is a single dot or square of color.
See JAVA property file.
See drop-down menu.
See UML sequence diagram.
See command shell.
Simple API for XML (SAX)
Standard interface for event-based XML parsing.
Swing User Interface Library
A collection of reusable JAVA classes and interfaces for building cross-platform graphical user interfaces. The SWING library is a standard component of the JAVA programming language. In contrast to the AWT User Interface Library, components within the SWING library do not “wrap” the user interface components provided by the host operating system, but are written completely in JAVA.
A user interface component that is typically located along the bottom edge of a window. It is used to display information like status messages and progress indication.
Sun Microsystems, Inc.
A software and hardware vendor that was a primary developer of JAVA (and currently owns the JAVA trademark).
A memory buffer used to store data that is cut or copied from an application.
See XML tag.
Text Area Component
A user interface component that allows a user to view, and edit, multiple lines of text.
A user interface component that typically contains a group of buttons that represent frequently used features of an application.
UML Package Diagram
A type of diagram defined by the Universal Modeling Language (UML). Package diagrams show collections of classes and their dependencies.
UML Sequence Diagram
A type of diagram defined by the Universal Modeling Language (UML). Sequence diagrams show the messages passed between objects over time.
Unified Modeling Language (UML)
A standard notation for depicting the design of object-oriented software.
Universal Resource Identifier (URI)
Text strings that refer to Internet resources.
User Interface Component
An object within an application that is part of that application's graphical user interface. Components have a visual representation within an application's user interface. Examples include: windows, buttons, labels, menus, etc.
User Interface Library/Interface Library
A collection of reusable JAVA classes and interfaces that allow programmers to build graphical user interface applications where the user interface is declared within XML documents. As described herein, the invention uses an embodiment of a User Interface Library.
A sequence of tab characters, blanks, new lines, carriage returns, or other characters that do not have a visual representation.
A user interface component that is managed by the host computer's graphical user interface presentation manager. A window is an area of the screen that contains an application's components. Windows often are the top-level (root) component of an application's graphical user interface.
World Wide Web Consortium (W3C)
The organizational or industry body that promotes and develops standards for use with the World Wide Web.
Extensible Markup Language: a format for structured data and documents.
A logical unit of XML. A document contains declarations, elements, comments, entity references, character references, and processing instructions.
XML Document Type Definition (DTD)
A formal definition for a type of XML document. The DTD defines a grammar that all XML documents that adhere to the DTD must follow in order for the documents to be considered valid.
Every XML document contains one or more elements. Elements are bounded by start and end tags (or in the case of empty elements, a start tag only). Each element has a type, identified by its name. Elements may contain attributes and content.
XML Empty Element
An XML element that has no content and is bounded by a start tag only (no ending tag).
An identifier within an XML DTD that represents a value.
A sequence of characters that are used to indicate the start and end of an XML element.
Section 1 of this document uses a simple example to define what an embodiment of the User Interface Library of the invention is, and how it works. This section also introduces some concepts—like XML and JAVA user interface development—that the User Interface Library relies upon. Section 2 discusses the architecture of one embodiment of the User Interface Library. This section should help the reader gain a better understanding of what the library does, what its design goals are, and how it has been engineered to meet those goals. Section 3 is aimed primarily at developers who will use the library, and includes a tutorial that walks the reader through the process of using the library to construct a text editor application. The tutorial assumes that the reader is comfortable with the JAVA programming language and XML. Section 4 lists various benefits provided by the invention. Sections 3 and 4 make occasional reference to the “Joy Interface Library”, or to “Joy” functions. “Joy” is a specific example of one embodiment of the invention.
The convention used within this document is that excerpts of programming code, the names of programming items (like class names and method names), commands, file and directory names are set in fixed-width courier font.
1. Operation of the Invention
A high-level logical overview or schematic of a system used to operate the invention is shown in
An embodiment of the User Interface Library relies on the classes and interfaces provided by JAVA's AWT and SWING libraries. The Interface Library parses the contents of XML documents and uses that information to create and configure SWING user interface components.
A JAVA application's graphical user interface is composed of a hierarchy of components. Window components are at the top level. They contain child components, which contain other components, and so on. The hierarchy of components within the user interface shown in
XML documents are made up of or comprised of elements, which can be nested within each other. Tags determine the contents of an element within an XML document. In one embodiment, a tag is a piece of text that appears within angle brackets. The following code example (also shown in
<tag>The element's content</tag>
This example shows the most common type of XML element, one that starts with a begin tag (<tag>) and ends with an end tag (</tag>). Tags are enclosed within angle brackets (< >) with ending tags beginning with a less than sign followed by a slash (</). Data between tags are the element's content. In addition to content, an XML element may also have attributes. Attributes are name-value pairs that are placed within an element's starting tag. The following example code (also shown in
<tag attribute1=“value1” attribute2=“value2”> The
A single tag can also be used to represent XML elements. Elements represented by a single tag are herein referred to as empty elements because they do not contain any content. However, they may contain attributes. The following code (also shown in
<tag attribute 1=“value1” attribute2=“value2”/>
An empty element begins with a less than (<)sign, followed by the element's name (“tag” in the preceding example). White space (any combination of tab characters, blanks, new lines, etc.) separates the name of the element from its attributes (if any). An empty element is ended by a slash followed by a greater than sign (/>).
The User Interface Library takes various (i.e. a plurality of) XML elements from XML documents and creates a user interface that corresponds to the document's elements. Referring to the XML document from
An embodiment of the User Interface Library takes one or more XML documents as input into the parsing or rendering process, so as to generate a graphical user interface. Each XML document refers to an XML DTD that specifies the answers to the following questions:
Within the XML shown in
opaque %booleanValues; “false”
indicates that the opaque attribute can have one of the following values: true, false, yes, no, on, or off, with off being the default value.
Many of the attributes shown in
One embodiment of the User Interface Library comprises a set of Java classes and interfaces. Appendix C illustrates an example of such classes and interfaces as placed within a Java package called com.bea.joy. This package is the root package for the library, and includes the library's main class, called BEAtitude. The BEAtitude class relies on the Simple API for XML (SAX) library. SAX is a class library defined by the World Wide Web Consortium (W3C) for dealing with a stream of XML content. In one embodiment the Interface Library utilizes Sun Microsystems' implementation of the SAX library, although it will be evident that other interface library implementations can be used. The SAX library is used to read XML documents and to parse or render their content. The XML parser within the SAX library notifies the main (BEAtitude) class whenever it recognizes an XML element and its attributes. The BEAtitude class, in turn, notifies other classes within the Interface Library when the parser recognizes an element. In this particular embodiment, the library's design segregates the classes within the Interface Library into three sub-packages called: com.bea.joy.elements, com.bea.joy.components, and com.bea.joy.event.
The classes within the com.bea.joy.elements package represent various elements within XML documents. These classes are responsible for creating and configuring the actual user interface components that correspond to the elements in the XML document. The com.bea.joy.components package contains classes which define the user interface components that the classes in the com.bea.joy.elements package create. The com.bea.joy.event package contains classes used by the User Interface Library to notify an application of events that occur when the Interface Library constructs a user interface.
For example, in a situation in which a <mainWindow> tag is encountered by the XML parser, the parser notifies the BEAtitude class, which in turn notifies the MainWindowElement class within the com.bea.joy.elements package. The MainWindowElement class creates a main window component, and uses the values of the mainwindow element's attributes to configure or render the main window component.
The UML sequence diagram shown in
The library's extensibility takes advantage of the internationalization and localization features inherent in the JAVA language itself. Within JAVA, a class can have an associated property file. A property file is a text file that contains name-value pairs. The property file is loaded into the JAVA runtime environment along with its associated class. A JAVA class can retrieve the values specified within a property file by their name. In one embodiment of the invention, the BEAtitude class uses this property file lookup mechanism to find out which class' create method it should call for an XML element.
The create method is passed three parameters:
In the example depicted in
The Interface Library utilizes an event-driven architecture in order to increase processing speed and reduce memory requirements. In this manner, the BEAtitude class does not need to construct an in-memory copy of the XML documents that it processes. Instead, it simply creates and configures the proper GUI components in response to messages it receives from the XML parser while the parser is processing the XML documents.
The benefits of this type of architecture include its flexibility and extensibility. Developers can extend the library so that it creates new types of user interface components, and enforces different user interface guidelines. They can do this without having to alter the library's source code. Developers can also extend the User Interface Library to handle new XML elements simply by adding new entries into the BEAtitude class' property file. Developers can also supply their own DTDs because the Interface Library does not depend on a particular DTD.
As it is used herein, a DTD effectively specifies a grammar that XML documents must then conform to. Because XML documents fed into the Interface Library are used to construct a user interface, the documents' DTDs further define a grammar for the resulting user interface. In this manner, the DTDs become a formal specification of user interface guidelines that the Interface Library enforces. For example, the default DTD included in the Interface Library (joy.dtd) and shown in
The process begins by creating the XML document for the Bliss application's user interface. Using a text editor, an empty text file called Bliss.xml is created (the full Bliss.xml file is included in Appendix A, while the source code for the application is included in Appendix B). The XML standard requires that all XML documents begin with an XML declaration, and that declaration must be the very first thing within the document, so the following text is inserted at the start of the document:
This is the XML document's declaration. In particular, it specifies that the document conforms to the XML version 1.0 specification (the latest version of the XML specification at the time that this document was written). The XML specification also requires that an XML document type declaration (DTD) must follow the XML declaration. The DTD specifies the document's type and the grammatical rules that the document adheres to. In this example, the Joy library's default document type definition is used., but it will be evident to one skilled in the art that the Interface Library is not limited to using a particular DTD. Indeed, any DTD may be substituted. For example, it may be desirable to have this flexibility to allow the Interface Library to enforce a particular set or plurality of user interface standards. In this example, to use the Joy DTD, the following line is inserted into the document after the XML declaration:
3. Development of a Sample Application
This section includes a tutorial that demonstrates how JAVA programmers can use the User Interface Library in accordance with an embodiment of the invention. In this tutorial, a particular embodiment of the invention and of the User Interface Library, herein referred to as “Joy”,is used to construct a simple text editor application. This simple editor application allows users to open a text file, view the contents of the file, edit the file, and save any changes. As referred to herein the application is called “Bliss”.
This simple exemplary application will allow the user to carry out the following actions.
To use the Interface Library to create the application, it is necessary for the developer to create two files. The first file is an XML document
<!DOCTYPE joy SYSTEM
The URL within quotes signifies the file that contains the Joy library's DTD. This URL may (and typically will) be different on other systems, depending on where the Joy library is installed on that system. Instead of a URL a fixed file locator (eg, c:\dtd\joy.dtd) could be used.
Because we are using the Joy DTD, the first element within the document must be the <joy> element. The DTD defines what attributes the <joy> element can have, and what elements can be nested within a <joy> element.
At the time of writing, the SWING User Interface Library (which an embodiment of the User Interface Library is built upon) currently supports four different user interface standards (look-and-feels). These include: Metal, Motif, Windows, and Macintosh. The valid values for the lookAndFeel attribute are defined by the lookAndFeels entity.
The rest of the elements that will later be added to this file will be inserted between the <joy> element's start and end tags. These additional elements will define the actions and components that make up the Bliss application's user interface.
The Joy DTD specifies that action elements must appear in the XML document before any elements that represent user interface components (as shown in the definition of the <joy> element shown in
<!DOCTYPE joy SYSTEM
Actions are used to tie an application's user interface to an application's logic (i.e to the application logic source code). An application can ask the library for the actions that were previously defined in the XML documents which the library had processed during parsing. An application can then register to be notified when these actions or events occur, and can define what particular application logic can be executed when an action occurs. Applications can also enable or disable actions. Disabling an action disables all components associated with that action. Correspondingly, enabling an action enables all components associated with that action. Limiting the interaction between the user interface and the application logic to actions provides a number of benefits, in that the visual arrangement or “look-and-feel” of components in the user interface can be modified without disturbing the underlying application logic. Also, the underlying application logic can be reused without requiring a new user interface (for example, the application logic can be placed inside an Enterprise JAVA Bean).
In accordance with one embodiment, action elements are empty, and cannot contain other elements. They must also have or include a name attribute. The value of this name attribute is used to associate components with the action. Other attributes may be optional; these include in this example icon, rolloverIcon, statusIcon, and statusMessage. These attributes are used to specify default values for the corresponding attributes of components that are associated with the action. For example, the system may be instructed to specify that the menu item and button defined in
This specifies that the default value for the icon attribute of any component element associated with the action named open is images/open—folder16×16bw.gif. The default values specified within an action element can be overridden by an element that refers to the action. For example, if it was desired that the button defined in
As it would be provided to a developer, the User Interface Library includes sample or default icons.
statusMessage=“Display information about this
statusMessage=“Copy the selected text to the
statusMessage=“Move the selected text to the
statusMessage=“Delete the selected text.”/>
statusMessage=“Quit this application.”/>
statusMessage=“Open an existing document.”/>
statusMessage=“Paste the text in the clipboard
into the document.”/>
statusMessage=“Create a new document.”/>
statusMessage=“Save this document.”/>
statusMessage=“Save this document to a
Now that the application's actions have been defined, the application's graphical components need to be defined. In the example here, the application's user interface comprises a main window that contains a menu bar with drop-down menus, a toolbar with buttons, a scrollable text editor, and a status bar.
The XML example code shown above defines a main window for the application that will be centered on the user's screen when it first appears. The main window will initially be 600 pixels wide by 400 pixels high, its title will be “Bliss,” and its title bar icon will be a BEA Systems, Inc. logo. The XML also specifies that the main window will generate the action named ‘exit’ when the user closes it. Next, a menu bar, a tool bar, and a client area are added to the main window. To do this, the following lines are added between the start and end tags of the <mainwindow> element:
The client area of the main window is the area of the main window that is left over or remains after space has been allocated to the main window's menu bar, toolbars, and status bar. Now the drop-down menus are defined in the main window's menu bar by inserting the following into the Bliss.xml file between the starting and ending tags of the <menuBar> element:
The above XML defines the application's three pull-down menus.
public class Bliss
public Bliss( )
IUserInterfaceBuilder guiBuilder =
Joy.createUserInterfaceBuilder ( );
guiBuilder.buildUserInterface ( “Bliss.xml” );
catch ( IOException exception )
public static void main ( String astrArgs )
Bliss bliss = new Bliss ( ) ;
Typically, this file can be saved in the same directory as the Bliss.xml file. The JAVA source code above provides a minimum necessary to illustrate and test the XML file parsing process. It contains a main method that is called when the application is started. The main method creates an instance of the Bliss class. The Bliss class' constructor calls the createUserInterfaceBuilder method of the Joy class, which returns an object that will build the application's user interface. The application then calls the createUserInterface method of the builder object, passing to it the name of the XML file that defines the application's user interface. The createUserInterface method throws an IOException if it cannot find the file, or if it cannot read the file. It will be evident to one skilled in the art that the JAVA file shown above is merely an illustration, and that other, more complex, source code and application logic can incorporate or embody the features of the invention while remaining within the spirit and scope of the invention.
The application is now compiled by running the following command within a command shell whose current working directory is the same directory where the Bliss.java file is stored.
javac -classpath .;\beadev\src;\xml-tr2\xml.jar
The directories \beadev\src and \xml-tr2\xml.jar may (and typically will) be different for the particular computer system on which the devlopment suite is deployed. The first directory specifies the root directory where the User Interface Library is located. The second directory specifies the location of an XML library, for example Sun Microsystem's XML library. The above command is applicable to Microsoft Windows NT systems. On other operating systems—particularly variants of UNIX—the backslashes (\) must be replaced with forward slashes (/). Once the command is run without errors, a file called Bliss.class will be created within the directory. The application can then be executed by entering the following command:
java -classpath .;\beadev\src;\xml-
There may be a need to alter the previous command to match differences between operating systems and the locations of the Interface Library and the XML library (i.e. Sun Microsystem's XML library). Once this command is executed—again, assuming that no errors are encountered—the Bliss application's user interface is generated. Notice that this particular application is merely given for exemplary or illustrative purposes and doesn't actually do much. This is because, although the application's actions have been defined, the application's logic for handling those actions has not at this point yet been written. For example, the application cannot be stopped from the application's user interface (closing the application's main window hides the window, but it does not stop the application). Without these features, to stop the application, it would be necessary to go to the command shell the application was started, and press CTRL+C or the interrupt key.
To account for this, now that the application's user interface has been built, logical code can be added to the application that will enable it to react to actions. To get the application to do something useful, two things must be done. First, the application needs to get references to some of the components created by the Joy library. Second, the application needs to register that it wants to be notified when actions occur. The first step is accomplished by using the addComponentCreatedListener (listener) method of the IUserInterfaceBuilder interface. The signature for this method follows:
public void addComponentCreatedListener( String
ComponentCreatedListener listener )
The first parameter is the name of a component, while the second parameter is a listener object that the Interface Library notifies when it creates a component whose name matches the first parameter. The Interface Library notifies the listener object by calling the listener's componentCreated method.
The componentCreated method has the following signature:
public void componentCreated ( ComponentCreatedEvent
The ComponentCreatedEvent class provides a method that allows the listener to determine what component was created. This method is called getCreatedComponent, (getComponent) and has the following signature:
public Component getCreatedComponent( )
With these methods (Listener and getComponent), the Bliss application can obtain a reference to any named component that the Interface Library creates. Next, the application needs to be notified when actions happen. The IUserInterfaceBuilder interface provides a method to do this. The method's signature is:
public void addActionListener( String strActionName, ActionListener listener )
where the second parameter is an object that wants to be notified when an action occurs, and the first parameter is the name of the action that the listener wants to be notified of. In order for this method to work, it must be called on a IUserInterfaceBuilder object before the IUserInterfaceBuilder object's create user interface method is called. After the addActionListener method is called, the listener object's actionPerformed method will be called whenever an action with the given name occurs.
In this example, the first action the application will handle is an ‘exit’ or ‘close’ action. The lines below are inserted into the Bliss.xml file.
public class Bliss
public Bliss ( )
BEAtitude guiBuilder = new BEAtitude ( );
new ActionListener ( )
public void actionPerformed (ActionEvent event )
System.exit ( 0 );
} ) ;
IUserInterfaceBuilder guiBuilder =
Joy.createUserInterfaceBuilder ( );
catch ( IOException exception )
exception.printStackTrace ( );
public static void main ( String astrArgs )
Bliss bliss = new Bliss ( ) ;
Now the application is again compiled and run. This time, the application stops executing whenever the ‘Exit’ menu item in the ‘File’ menu is selected, or the application's main window is closed. In order to handle the application's other actions the application needs to manipulate its text area component. The lines in the following source code fragment are added to the Bliss.java file. These lines create a data member of the Bliss class that is used to hold a reference to the application's text area component. It also initializes this data member by getting a reference to the text area component from the User Interface Library.
public class Bliss
private JTextArea m—TextArea = null;
public Bliss ( )
IUserInterfaceBuilder guiBuilder =
Joy.createUserInterfaceBuilder ( );
new ComponentCreatedListener ( )
public void componentCreated
( ComponentCreatedEvent event )
(JTextArea) event.getCreatedComponent ( );
} ) ;
Next, a dialog window will be added to the application that displays information about the application when the user selects the application's ‘About Bliss’ menu item from the application's ‘Help’ menu. The application's about dialog will use the image file named bliss—splash.jpg which is located in the User Interface Library's images directory. To define the about dialog, the following XML is added to the Bliss.xml file, before the end tag of the <mainwindow> element.
In order to have the about dialog defined above appear when the user selects the “About Bliss” menu item in the application's “Help” pull-down menu, the application needs to get a reference to the about dialog window component, and be notified of when the “about” action occurs. To allow this, the following import statement is first added to the Bliss.java file:
followed by the following data member declaration:
private JDialog m—AboutDialog = null;
Then the following is added to the Bliss class' constructor, before it calls the buildUserInterface method:
new ComponentCreatedListener ( )
public void componentCreated
( ComponentCreatedEvent event )
(JDialog)event.getCreatedComponent ( );
} ) ;
new ActionListener ( )
public void actionPerformed (ActionEvent event)
m—AboutDialog.setVisible ( true );
} ) ;
The application is compiled and run again. When the “About Bliss” menu item is selected from the “Help” menu, the sample window or graphical display illustrated in
4.1 Benefits for Developers
This section discusses the benefits and advantages provided by the invention for software application developers.
An application's GUI can be described by XML documents, rather than having to build the user interface through JAVA programming.
Faster Development, Support for Rapid Prototyping
Changing an application's user interface does not require recompiling the application. Developers can edit the XML documents, and immediately see the results when they re-run their application.
Greater Independence of User Interface from Application Logic
The library allows programmers to segregate an application's user interface from its core functionality. The user interface is described within XML documents that define user actions. The application's non-user interface code is notified when actions occur.
Support for Internationalization and Customization
The library is built on top of JAVA's internalization and localization features. Because the application logic is freed from the user interface, it is easier to modify the user interface for different languages and locales without disrupting the application's core logic.
Code Re-Use, Formal Specification of GUI Standards
The User Interface Library allows user interfaces to be specified at a higher level of abstraction than if they were written in a programming language. For example, the default DTD defines that an application must contain one main window that can have a menu bar and a toolbar. It also ties components together, for example, ensuring a component's status information is displayed within a window's status bar. It also provides higher-level constructs that are made up of collections of components (for example, dialog windows, main windows, tree view navigators, etc.)
The Interface Library can be extended to handle new XML elements and new GUI components without having to be re-compiled. New XML elements, and the classes that create the element's corresponding user interface components are specified within the library's property file.
The classes that are responsible for providing a user interface (the components) and the classes that are responsible for creating the components (the elements) are segregated into separate packages. The responsibility for processing XML rests solely with the element classes. Providing a graphical user interface relies solely with the component classes (they have no knowledge of XML or how they were constructed). This allows programmers to concentrate on their application's logic, and on solving application domain problems rather than low-level user interface design and construction issues.
One embodiment of the Interface Library of the invention is based on the SWING API. A programmer who is familiar with SWING can immediately use the invention as thus embodied. All user interface components created by the Interface Library are returned as SWING classes. This means that a programmer can treat these components as standard SWING components. Programmers do not have to learn new class hierarchies and methods; they can treat objects created by the Interface Library as regular SWING objects created in the traditional way, by calling their constructors.
Other interface libraries can be used to greatly expand the applicability of the invention and the methods therein to other types of systems.
4.2 Benefits for End-Users
This section discusses the benefits and advantages provided by the invention for application end-users.
The Interface Library enforces a common look-and-feel that users are familiar with. This can reduce training time for users.
The Interface Library relies on an event-driven processing model. It does not create or manage an in-memory data structure that represents the contents of the XML documents that it processes. This saves processing time and memory usage. After the XML documents are parsed, the only new objects that exist in memory are the user interface components created by the library.
The Interface Library allows an entire application's user interface to be transmitted as an XML document to the user's web browser, or possibly to their personal digital assistants and cell phones.
5. Logical System Architecture
A high-level logical overview or schematic of a system used to operate the invention is shown in
The development suite includes an interface class library 106, from which the application source code 102 selects graphical elements appropriately specified by the user interface definition file 104. Actions are used to tie an application's user interface to an application's logic. An application or application source code 102 can ask the library for the actions that are defined in the user interface definition file which the library had processed during compilation. An application can then register to be notified when these actions or events occur, and can define what particular application logic can be executed when an action occurs. Applications can also enable or disable actions.
A grammar file 108 determines rules and dependencies to be applied during the compilation/parsing process, and ensures consistency throughout the graphical user interface development process. The grammar file may be in some embodiments be a document type definition (DTD) file or an XML schema (XSD) file. In some embodiments a property file 110 can be used to map to a subset of graphical elements within the user interface definition file 104. The property file 110 can be a text file that is associated with a particular class (for example a Java class), and multiple property files may be associated with each class. At runtime the system loads the property files that match the user's language and locale settings. This feature allows applications to retrieve values in a language- and locale-independent manner, in support of internationalization and localization requirements.
In certain implementations the parser and library may considered a single entity—in which case the act of calling the library functions initiates or includes the parsing process.
As described above, the XML documents taken as input by the library specify which user interface components should be created (i.e. the content of the user interface). However, the XML documents also contain attributes that specify how the components should be arranged (i.e. their presentation). The goal of XML and XSL is to separate content from presentation. In some embodiments the graphical interface library can be extended so that the layout of components is expressed within XSL style sheets. This would allow the same graphical user interface specification to have different appearances. This would be useful when the same graphical user interface application needs to be accessed from various devices like personal computers, personal digital assistants, or cell phones.
The User Interface Library has been used by the inventor to create a GUI builder application. The application allows users to graphically construct XML documents that describe a user interface. The application, code-named Rapture, allows users to build an application's user interface by dragging components from a palette and dropping them onto a window.
In other embodiments the invention can be used to form a personalized graphical applications interface. Using a thin client, for example a personal digital assistant device (PDA) or a wireless phone, a user may log onto or access an online resource. Since the application logic code is static but the functionality and appearance of the application is dependent on the XML file, the online resource may supply XML documents specific to that user (by, for example, reading the users login details). In this manner each client device, each user, and indeed each client device/user combination may access the same resource using the same application but receive different information, presented by a different graphical interface, and tailored to their requirements.
The foregoing description of preferred embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to the practitioner skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical application, thereby enabling others skilled in the art to understand the invention for various embodiments and with various modifications that are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalence.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5450540||Dec 16, 1992||Sep 12, 1995||Apple Computer, Inc.||Graphical interface for interacting constrained actors|
|US5495567||Jul 20, 1993||Feb 27, 1996||Ricoh Company Ltd.||Automatic interface layout generator for database systems|
|US5973682||Oct 17, 1997||Oct 26, 1999||Sony Corporation||Method and apparatus for indicating functional areas of a graphical user interface|
|US6230117||Mar 23, 1998||May 8, 2001||International Business Machines Corporation||System for automated interface generation for computer programs operating in different environments|
|US6237136||Dec 2, 1997||May 22, 2001||National Instruments Corporation||System and method for automatically creating source code example files for an application program in a plurality of programming languages|
|1||Begg et al. "Intelligent Graphical Interface Design: Designing and Interactive Control Room User Interface." IEEE. pp. 3128-3232. 1995.|
|2||http://developer.java.sun.com/developer/, Jan. 2002.|
|6||http://www.megginson.com/SAX/index.html, Nov. 2001.|
|8||http://www.w3.org (Home Page), Dec. 2001.|
|9||http://www.w3.org (Home Page).|
|10||http://www.w3.org/XML/, Apr. 1997.|
|12||http://www.w3.org/XML/1998/06/xmlspec-report-19980910.htm, Sep. 1998.|
|14||M. Fowler, K. Scott, and G. Booch, UML Distilled: Applying the Standard Object Modeling Language, Addison-Wesley Publishing Co., Reading, MA (1997). (Table of Contents Only).|
|15||Schafer. "Graphical Interactions with an Automatic Programming System." IEEE. pp. 575-591. 1988.|
|16||Topley, Kim. Core Java Foundation Classes. Upper Saddle River, NJ: Prentice-Hall, 1998. (Table of Contents Only).|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7366991 *||Dec 12, 2002||Apr 29, 2008||Microsoft Corporation||Method and system for providing an extensible user interface|
|US7401331 *||Aug 9, 2002||Jul 15, 2008||Wu-Hon Francis Leung||Method to add new software features without modifying existing code|
|US7464367 *||Jul 14, 2003||Dec 9, 2008||Microsoft Corporation||Method and system for designing customizable applications and user-interfaces based on user-defined policies and metadata|
|US7533372 *||Aug 5, 2003||May 12, 2009||Microsoft Corporation||Cross language migration|
|US7577935 *||Jan 28, 2005||Aug 18, 2009||Matthew T. Reynolds||Generative programming system and method employing focused grammars|
|US7603657 *||Dec 28, 2001||Oct 13, 2009||Oracle International Corporation||Customization of client-server interaction in an internet application|
|US7607141||Sep 7, 2004||Oct 20, 2009||Microsoft Corporation||Systems and methods for support of various processing capabilities|
|US7620650 *||Jan 25, 2006||Nov 17, 2009||Microsoft Corporation||Method and apparatus for maintaining relationships between parts in a package|
|US7634775||Sep 10, 2004||Dec 15, 2009||Microsoft Corporation||Sharing of downloaded resources|
|US7650591 *||Jan 22, 2004||Jan 19, 2010||Bea Systems, Inc.||Marshaling and un-marshaling data types in XML and Java|
|US7668728||Apr 29, 2005||Feb 23, 2010||Microsoft Corporation||Time polynomial arrow-debreu market equilibrium|
|US7681114 *||Nov 22, 2004||Mar 16, 2010||Bridgeborn, Llc||Method of authoring, deploying and using interactive, data-driven two or more dimensional content|
|US7681138 *||Jul 11, 2006||Mar 16, 2010||Siemens Aktiengesellschaft||Use of a reusable control software whose user interface and communication connection are established via an external description-based configuration at run time|
|US7707024||May 23, 2002||Apr 27, 2010||Microsoft Corporation||Method, system, and apparatus for converting currency values based upon semantically labeled strings|
|US7707496||May 9, 2002||Apr 27, 2010||Microsoft Corporation||Method, system, and apparatus for converting dates between calendars and languages based upon semantically labeled strings|
|US7711550||Apr 29, 2003||May 4, 2010||Microsoft Corporation||Methods and system for recognizing names in a computer-generated document and for providing helpful actions associated with recognized names|
|US7712024||Jul 16, 2001||May 4, 2010||Microsoft Corporation||Application program interfaces for semantically labeling strings and providing actions based on semantically labeled strings|
|US7716163||Jul 17, 2001||May 11, 2010||Microsoft Corporation||Method and system for defining semantic categories and actions|
|US7716676||Jun 25, 2002||May 11, 2010||Microsoft Corporation||System and method for issuing a message to a program|
|US7739588||Jun 27, 2003||Jun 15, 2010||Microsoft Corporation||Leveraging markup language data for semantically labeling text strings and data and for providing actions based on semantically labeled text strings and data|
|US7742048||May 23, 2002||Jun 22, 2010||Microsoft Corporation||Method, system, and apparatus for converting numbers based upon semantically labeled strings|
|US7752235||Jan 25, 2006||Jul 6, 2010||Microsoft Corporation||Method and apparatus for maintaining relationships between parts in a package|
|US7755786||Sep 7, 2004||Jul 13, 2010||Microsoft Corporation||Systems and methods for support of various processing capabilities|
|US7770102||Jun 6, 2000||Aug 3, 2010||Microsoft Corporation||Method and system for semantically labeling strings and providing actions based on semantically labeled strings|
|US7770124||Feb 11, 2005||Aug 3, 2010||Microsoft Corporation||Using a description language to build a management system|
|US7778816||Apr 24, 2001||Aug 17, 2010||Microsoft Corporation||Method and system for applying input mode bias|
|US7783614||Feb 13, 2003||Aug 24, 2010||Microsoft Corporation||Linking elements of a document to corresponding fields, queries and/or procedures in a database|
|US7788590||Sep 26, 2005||Aug 31, 2010||Microsoft Corporation||Lightweight reference user interface|
|US7788602||Jul 16, 2001||Aug 31, 2010||Microsoft Corporation||Method and system for providing restricted actions for recognized semantic categories|
|US7827546 *||Dec 9, 2003||Nov 2, 2010||Microsoft Corporation||Mechanism for downloading software components from a remote source for use by a local software application|
|US7836094||Jan 25, 2006||Nov 16, 2010||Microsoft Corporation||Method and apparatus for maintaining relationships between parts in a package|
|US7849439 *||Jan 19, 2005||Dec 7, 2010||Ixia||Application-generic sequence diagram generator driven by a non-proprietary language|
|US7865871 *||Dec 10, 2003||Jan 4, 2011||Oracle International Corporation||Generating code to be deployed in an application server by introspecting an input class included in an archive file|
|US7877727||Aug 18, 2006||Jan 25, 2011||Bitrouter||Hierarchical state programming with a markup language|
|US7895530 *||Aug 30, 2004||Feb 22, 2011||Change Tools, Inc.||User definable interface system, method, support tools, and computer program product|
|US7937664||Apr 29, 2008||May 3, 2011||Microsoft Corporation||Method and system for providing an extensible user interface|
|US7992085||May 15, 2007||Aug 2, 2011||Microsoft Corporation||Lightweight reference user interface|
|US8015506||Jan 24, 2007||Sep 6, 2011||Microsoft Corporation||Customizing a menu in a discovery interface|
|US8024648||Feb 12, 2009||Sep 20, 2011||Microsoft Corporation||Planar mapping of graphical elements|
|US8090611||Feb 10, 2010||Jan 3, 2012||Open Text S.A.||System, method, and computer program product for enabling workflow applications|
|US8112714||Jan 24, 2007||Feb 7, 2012||Microsoft Corporation||Customizing application page loading in a discovery interface|
|US8122350||Mar 21, 2008||Feb 21, 2012||Microsoft Corporation||Packages that contain pre-paginated documents|
|US8132114 *||Feb 27, 2008||Mar 6, 2012||Accenture Global Services Limited||Graphical user interface typing and mapping system|
|US8151276||Feb 27, 2008||Apr 3, 2012||Accenture Global Services Gmbh||Test script transformation analyzer with change guide engine|
|US8185917||Feb 27, 2008||May 22, 2012||Accenture Global Services Limited||Graphical user interface application comparator|
|US8225234 *||Feb 27, 2004||Jul 17, 2012||Oracle International Corporation||Method for utilizing look and feel in a graphical user interface|
|US8239882||Aug 30, 2005||Aug 7, 2012||Microsoft Corporation||Markup based extensibility for user interfaces|
|US8245144||Jun 27, 2008||Aug 14, 2012||Microsoft Corporation||Object model for a user interface|
|US8255828||Sep 30, 2004||Aug 28, 2012||Microsoft Corporation||Command user interface for displaying selectable software functionality controls|
|US8302014||Jun 11, 2010||Oct 30, 2012||Microsoft Corporation||Merging modifications to user interface components while preserving user customizations|
|US8307336 *||Mar 30, 2005||Nov 6, 2012||Oracle America, Inc.||Mechanism for enabling a set of output from a functional component to be presented on different types of clients|
|US8365147 *||Feb 27, 2008||Jan 29, 2013||Accenture Global Services Limited||Test script transformation architecture|
|US8370399||Jun 28, 2007||Feb 5, 2013||Microsoft Corporation||Building, viewing, and manipulating schema sets|
|US8375313||Jun 1, 2010||Feb 12, 2013||Oracle International Corporation||User interface generation with scoring|
|US8402096||Jun 24, 2008||Mar 19, 2013||Microsoft Corporation||Automatic conversation techniques|
|US8407583 *||Dec 2, 2009||Mar 26, 2013||Fuji Xerox Co., Ltd.||Information processing apparatus, information processing method, computer-readable medium and computer data signal|
|US8429527||Jul 12, 2006||Apr 23, 2013||Open Text S.A.||Complex data merging, such as in a workflow application|
|US8458662||Feb 27, 2008||Jun 4, 2013||Accenture Global Services Limited||Test script transformation analyzer with economic cost engine|
|US8484578||Jun 27, 2008||Jul 9, 2013||Microsoft Corporation||Communication between a document editor in-space user interface and a document editor out-space user interface|
|US8516442 *||Feb 27, 2008||Aug 20, 2013||Accenture Global Services Limited||Graphical user interface metadata evolution tool|
|US8572570||Jun 10, 2010||Oct 29, 2013||Accenture Global Services Limited||Assisted compositional reasoning for test scripts|
|US8589787 *||Oct 13, 2004||Nov 19, 2013||American Express Travel Related Services Company, Inc.||Centralized field rendering system and method|
|US8605090||Jun 1, 2006||Dec 10, 2013||Microsoft Corporation||Modifying and formatting a chart using pictorially provided chart elements|
|US8620938||Feb 23, 2007||Dec 31, 2013||Microsoft Corporation||Method, system, and apparatus for routing a query to one or more providers|
|US8627222||May 9, 2006||Jan 7, 2014||Microsoft Corporation||Expanded search and find user interface|
|US8635521 *||Jan 24, 2007||Jan 21, 2014||Microsoft Corporation||Customizing applications in a discovery interface|
|US8638333||Oct 6, 2009||Jan 28, 2014||Microsoft Corporation||Modifying and formatting a chart using pictorially provided chart elements|
|US8639723||Mar 11, 2009||Jan 28, 2014||Microsoft Corporation||Spooling strategies using structured job information|
|US8645175||Jul 12, 2006||Feb 4, 2014||Open Text S.A.||Workflow system and method for single call batch processing of collections of database records|
|US8661332||Apr 30, 2004||Feb 25, 2014||Microsoft Corporation||Method and apparatus for document processing|
|US8661408 *||Nov 23, 2009||Feb 25, 2014||Michael James Psenka||Integrated development environment and methods of using the same|
|US8671338||Jan 12, 2009||Mar 11, 2014||Bridgeborn Llc||Authoring, deploying and using interactive, data-driven two or more dimensional content|
|US8689137||Apr 10, 2006||Apr 1, 2014||Microsoft Corporation||Command user interface for displaying selectable functionality controls in a database application|
|US8706708 *||Oct 26, 2007||Apr 22, 2014||Microsoft Corporation||Providing contextually sensitive tools and help content in computer-generated documents|
|US8719773||Jan 14, 2009||May 6, 2014||Open Text S.A.||Workflow data binding|
|US8762880||Jun 27, 2008||Jun 24, 2014||Microsoft Corporation||Exposing non-authoring features through document status information in an out-space user interface|
|US8799353||Mar 30, 2009||Aug 5, 2014||Josef Larsson||Scope-based extensibility for control surfaces|
|US8799808||May 21, 2004||Aug 5, 2014||Microsoft Corporation||Adaptive multi-line view user interface|
|US8839139||May 11, 2010||Sep 16, 2014||Microsoft Corporation||User interface for providing task management and calendar information|
|US8839144 *||Dec 29, 2010||Sep 16, 2014||Sap Ag||Add and combine reports|
|US8863010 *||Dec 27, 2005||Oct 14, 2014||Sap Ag||Linking user interface design environment and application development environment|
|US8972874 *||Jan 23, 2012||Mar 3, 2015||Accenture Global Services Limited||Graphical user interface typing and mapping system|
|US8994985||Jan 20, 2011||Mar 31, 2015||Canon Kabushiki Kaisha||Systems and methods for updating printing device capabilities|
|US9015621||Feb 17, 2009||Apr 21, 2015||Microsoft Technology Licensing, Llc||Command user interface for displaying multiple sections of software functionality controls|
|US9015624||Feb 15, 2011||Apr 21, 2015||Microsoft Corporation||Floating command object|
|US9046983||May 12, 2009||Jun 2, 2015||Microsoft Technology Licensing, Llc||Hierarchically-organized control galleries|
|US9092137||Sep 10, 2009||Jul 28, 2015||Oracle International Corporation||Customization of client-server interaction in an internet application|
|US9098473||May 4, 2012||Aug 4, 2015||Microsoft Technology Licensing, Llc||Accessing an out-space user interface for a document editor program|
|US9098837||Feb 9, 2008||Aug 4, 2015||Microsoft Technology Licensing, Llc||Side-by-side shared calendars|
|US9141314||Jan 5, 2012||Sep 22, 2015||Canon Kabushiki Kaisha||Systems and methods for updating a user interface for a printing device|
|US9223477||Aug 27, 2012||Dec 29, 2015||Microsoft Technology Licensing, Llc||Command user interface for displaying selectable software functionality controls|
|US9286612||Jun 4, 2013||Mar 15, 2016||Applications In Internet Time, Llc||Integrated change management unit|
|US9329838 *||Sep 10, 2004||May 3, 2016||Open Text S.A.||User-friendly data binding, such as drag-and-drop data binding in a workflow application|
|US9338114||Feb 18, 2013||May 10, 2016||Microsoft Technology Licensing, Llc||Automatic conversation techniques|
|US9342272||Mar 2, 2009||May 17, 2016||Open Text S.A.||Custom and customizable components, such as for workflow applications|
|US9348490 *||Sep 14, 2012||May 24, 2016||Ca, Inc.||User interface with configuration, registration, and runtime selection of views|
|US9384005 *||Aug 27, 2009||Jul 5, 2016||Adobe Systems Incorporated||Systems and methods for dynamic configuration of client-side development environments through use of application servers|
|US9395958||Apr 4, 2014||Jul 19, 2016||Open Text S.A.||Systems and methods for drag-and-drop data binding|
|US9471332 *||Oct 19, 2004||Oct 18, 2016||International Business Machines Corporation||Selecting graphical component types at runtime|
|US9513781||Dec 27, 2013||Dec 6, 2016||Microsoft Technology Licensing, Llc||Expanded search and find user interface|
|US9542667||Jan 13, 2006||Jan 10, 2017||Microsoft Technology Licensing, Llc||Navigating messages within a thread|
|US9542686||Nov 4, 2015||Jan 10, 2017||Applications In Internet Time, Llc||Integrated change management unit|
|US9588781||Mar 31, 2008||Mar 7, 2017||Microsoft Technology Licensing, Llc||Associating command surfaces with multiple active components|
|US9619116||Jun 24, 2013||Apr 11, 2017||Microsoft Technology Licensing, Llc||Communication between a document editor in-space user interface and a document editor out-space user interface|
|US9645698||Mar 23, 2012||May 9, 2017||Microsoft Technology Licensing, Llc||User interface for displaying a gallery of formatting options applicable to a selected object|
|US9665850||Jun 20, 2008||May 30, 2017||Microsoft Technology Licensing, Llc||Synchronized conversation-centric message list and message reading pane|
|US9690448||Sep 14, 2012||Jun 27, 2017||Microsoft Corporation||User interface for displaying selectable software functionality controls that are relevant to a selected object|
|US9690450||Sep 19, 2013||Jun 27, 2017||Microsoft Corporation||User interface for displaying selectable software functionality controls that are relevant to a selected object|
|US9697181||Oct 23, 2013||Jul 4, 2017||Iii Holdings 1, Llc||Centralized field rendering system and method|
|US9715678||Jun 26, 2003||Jul 25, 2017||Microsoft Technology Licensing, Llc||Side-by-side shared calendars|
|US9727989||Jan 8, 2014||Aug 8, 2017||Microsoft Technology Licensing, Llc||Modifying and formatting a chart using pictorially provided chart elements|
|US20020007309 *||Apr 24, 2001||Jan 17, 2002||Micrsoft Corporation||Method and system for providing electronic commerce actions based on semantically labeled strings|
|US20020029304 *||Jul 17, 2001||Mar 7, 2002||Microsoft Corporation||Method and system for defining semantic categories and actions|
|US20020035581 *||Jul 16, 2001||Mar 21, 2002||Microsoft Corporation||Application program interfaces for semantically labeling strings and providing actions based on semantically labeled strings|
|US20020087591 *||Jul 16, 2001||Jul 4, 2002||Microsoft Corporation||Method and system for providing restricted actions for recognized semantic categories|
|US20020108099 *||Oct 11, 2001||Aug 8, 2002||Charles Paclat||Method for developing business components|
|US20020178008 *||Apr 24, 2001||Nov 28, 2002||Microsoft Corporation||Method and system for applying input mode bias|
|US20030160821 *||Feb 7, 2003||Aug 28, 2003||Jeong-Kwan Yoon||Graphic user interface modification method and recorded media thereof|
|US20030196165 *||Apr 16, 2003||Oct 16, 2003||Samsung Electronics Co., Ltd. Of Republic Of Korea||Information storage medium on which interactive contents version information is recorded, and recording and/or reproducing method and apparatus|
|US20030204481 *||Jun 27, 2002||Oct 30, 2003||International Business Machines Corporation||Method and system for visually constructing XML schemas using an object-oriented model|
|US20030212982 *||May 9, 2002||Nov 13, 2003||International Business Machines Corporation||Message compiler for internationalization of application programs|
|US20030220795 *||May 23, 2002||Nov 27, 2003||Microsoft Corporation||Method, system, and apparatus for converting currency values based upon semantically lableled strings|
|US20030229608 *||Jun 6, 2002||Dec 11, 2003||Microsoft Corporation||Providing contextually sensitive tools and help content in computer-generated documents|
|US20030237049 *||Jun 25, 2002||Dec 25, 2003||Microsoft Corporation||System and method for issuing a message to a program|
|US20040001099 *||Jun 27, 2002||Jan 1, 2004||Microsoft Corporation||Method and system for associating actions with semantic labels in electronic documents|
|US20040002937 *||Jun 27, 2002||Jan 1, 2004||Microsoft Corporation||System and method for providing namespace related information|
|US20040162833 *||Feb 13, 2003||Aug 19, 2004||Microsoft Corporation||Linking elements of a document to corresponding fields, queries and/or procedures in a database|
|US20040172584 *||Feb 28, 2003||Sep 2, 2004||Microsoft Corporation||Method and system for enhancing paste functionality of a computer software application|
|US20040183832 *||Mar 16, 2004||Sep 23, 2004||Alcatel||Extensible graphical user interface development framework|
|US20040216086 *||Jan 22, 2004||Oct 28, 2004||David Bau||XML types in Java|
|US20040243971 *||Aug 12, 2002||Dec 2, 2004||Leung Wu-Hon Francis||Method to add new software features without modifying existing code|
|US20040268237 *||Jun 27, 2003||Dec 30, 2004||Microsoft Corporation||Leveraging markup language data for semantically labeling text strings and data and for providing actions based on semantically labeled text strings and data|
|US20050005243 *||Feb 27, 2004||Jan 6, 2005||Olander Daryl B.||Method for utilizing look and feel in a graphical user interface|
|US20050015745 *||Jul 14, 2003||Jan 20, 2005||Microsoft Corporation||Method and system for designing customizable applications and user-interfaces based on user-defined policies and metadata|
|US20050033718 *||Aug 5, 2003||Feb 10, 2005||Microsoft Corporation||Cross language migration|
|US20050055633 *||Oct 21, 2004||Mar 10, 2005||Microsoft Corporation||Methods and systems for dynamically creating user interfaces|
|US20050066287 *||Sep 10, 2004||Mar 24, 2005||Tattrie Scott I.||User-friendly data binding, such as drag-and-drop data binding in a workflow application|
|US20050066304 *||Sep 10, 2004||Mar 24, 2005||Captaris, Inc.||Custom and customizable components, such as for workflow applications|
|US20050091601 *||Mar 6, 2003||Apr 28, 2005||Raymond Michelle A.||Interaction design system|
|US20050097574 *||Oct 30, 2003||May 5, 2005||Microsoft Corporation||Modular, robust, component user interface framework|
|US20050114764 *||Nov 25, 2003||May 26, 2005||Gudenkauf John C.||Producing a page of information based on a dynamic edit form and one or more transforms|
|US20050132266 *||Nov 22, 2004||Jun 16, 2005||Ambrosino Timothy J.||Method of authoring, deploying and using interactive, data-driven two or more dimensional content|
|US20050132339 *||Dec 10, 2003||Jun 16, 2005||Jonathan Maron||Code generation facility|
|US20050182617 *||Feb 17, 2004||Aug 18, 2005||Microsoft Corporation||Methods and systems for providing automated actions on recognized text strings in a computer-generated document|
|US20050183073 *||Jan 28, 2005||Aug 18, 2005||Reynolds Matthew T.||Generative programming system and method employing focused grammars|
|US20050193361 *||Feb 27, 2004||Sep 1, 2005||Vitanov Kamen B.||System and method for presentation of wireless application data using repetitive UI layouts|
|US20050193370 *||Feb 27, 2004||Sep 1, 2005||Goring Brian R.||System and method for interactive wireless applications with conditional UI controls and screen navigation|
|US20050193380 *||Feb 27, 2004||Sep 1, 2005||Vitanov Kamen B.||System and method for executing wireless applications using common UI components from a UI repository|
|US20050198610 *||Mar 3, 2004||Sep 8, 2005||Ulf Fildebrandt||Providing and using design time support|
|US20050234874 *||Oct 13, 2004||Oct 20, 2005||American Express Travel Related Services Company, Inc.||Centralized field rendering system and method|
|US20050243355 *||Sep 7, 2004||Nov 3, 2005||Microsoft Corporation||Systems and methods for support of various processing capabilities|
|US20050246384 *||Aug 6, 2004||Nov 3, 2005||Microsoft Corporation||Systems and methods for passing data between filters|
|US20050246724 *||Sep 7, 2004||Nov 3, 2005||Microsoft Corporation||Systems and methods for support of various processing capabilities|
|US20050251735 *||Apr 30, 2004||Nov 10, 2005||Microsoft Corporation||Method and apparatus for document processing|
|US20050268291 *||May 27, 2005||Dec 1, 2005||International Business Machines Corporation||Specifying user interface interactions for controls in a data driven system|
|US20060005174 *||Jul 1, 2004||Jan 5, 2006||International Business Machines Corporation||Defining hierarchical structures with markup languages and reflection|
|US20060026555 *||Jul 13, 2004||Feb 2, 2006||International Business Machines Corporation||Method and apparatus to support multiple hierarchical architectures|
|US20060036965 *||Sep 30, 2004||Feb 16, 2006||Microsoft Corporation||Command user interface for displaying selectable software functionality controls|
|US20060085754 *||Oct 19, 2004||Apr 20, 2006||International Business Machines Corporation||System, apparatus and method of selecting graphical component types at runtime|
|US20060085763 *||Dec 5, 2005||Apr 20, 2006||Change Tools, Inc.||System and method for using an interface|
|US20060149758 *||Jan 25, 2006||Jul 6, 2006||Microsoft Corporation||Method and Apparatus for Maintaining Relationships Between Parts in a Package|
|US20060149785 *||Jan 25, 2006||Jul 6, 2006||Microsoft Corporation||Method and Apparatus for Maintaining Relationships Between Parts in a Package|
|US20060161890 *||Jan 19, 2005||Jul 20, 2006||Green Kenneth M||Application-generic sequence diagram generator driven by a non-proprietary language|
|US20060184878 *||Feb 11, 2005||Aug 17, 2006||Microsoft Corporation||Using a description language to provide a user interface presentation|
|US20060248538 *||Sep 18, 2003||Nov 2, 2006||Josef Dietl||Xml interfaces in unified rendering|
|US20070055936 *||Aug 30, 2005||Mar 8, 2007||Microsoft Corporation||Markup based extensibility for user interfaces|
|US20070055943 *||Apr 10, 2006||Mar 8, 2007||Microsoft Corporation||Command user interface for displaying selectable functionality controls in a database applicaiton|
|US20070073652 *||Sep 26, 2005||Mar 29, 2007||Microsoft Corporation||Lightweight reference user interface|
|US20070149036 *||Dec 27, 2005||Jun 28, 2007||Filip Misovski||Linking user interface design environment and application development environment|
|US20070150821 *||Dec 22, 2005||Jun 28, 2007||Thunemann Paul Z||GUI-maker (data-centric automated GUI-generation)|
|US20070169015 *||Dec 7, 2005||Jul 19, 2007||Sbc Knowledge Ventures, L.P.||Web services development automation toolkit with test case driver and customized configuration file|
|US20070180432 *||Dec 28, 2001||Aug 2, 2007||Peter Gassner||Customization of client-server interaction in an internet application|
|US20070234223 *||Aug 30, 2004||Oct 4, 2007||Leavitt Joseph M||User definable interface system, method, support tools, and computer program product|
|US20070234308 *||Mar 7, 2006||Oct 4, 2007||Feigenbaum Barry A||Non-invasive automated accessibility validation|
|US20070250335 *||Jan 31, 2007||Oct 25, 2007||Brian Hodges||Workflow applications|
|US20070276689 *||May 11, 2007||Nov 29, 2007||Kirk Slone||Workflow data binding|
|US20080016466 *||Jul 11, 2006||Jan 17, 2008||Siemens Aktiengesellschaft||Use of a reusable control software whose user interface and communication connection are established via an external description-based configuration at run time|
|US20080021886 *||May 15, 2007||Jan 24, 2008||Microsoft Corporation||Lingtweight reference user interface|
|US20080046812 *||Oct 26, 2007||Feb 21, 2008||Jeff Reynar||Providing contextually sensitive tools and help content in computer-generated documents|
|US20080046817 *||Aug 18, 2006||Feb 21, 2008||Bitrouter||Hierarchical state programming with a markup language|
|US20080077852 *||Jan 24, 2007||Mar 27, 2008||Microsoft Corporation||Customizing applications in a discovery interface|
|US20080126938 *||Jan 24, 2007||May 29, 2008||Microsoft Corporation||Customizing application page loading in a discovery interface|
|US20080126984 *||Jan 24, 2007||May 29, 2008||Microsoft Corporation||Customizing a menu in a discovery interface|
|US20080133553 *||Jun 28, 2007||Jun 5, 2008||Microsoft Corporation||Building, viewing, and manipulating schema sets|
|US20080155431 *||Dec 20, 2006||Jun 26, 2008||Sap Ag||User interface supporting processes with alternative paths|
|US20080178125 *||Jan 23, 2007||Jul 24, 2008||Microsoft Corporation||Providing dynamic content in a user interface in an application|
|US20080256133 *||Apr 4, 2008||Oct 16, 2008||Richad Frankland||Integrated Change Management Unit|
|US20090019380 *||Jun 30, 2008||Jan 15, 2009||Hitachi, Ltd.||Device and method for supporting graphical user interface application development|
|US20090094526 *||Apr 29, 2008||Apr 9, 2009||Microsoft Corporation||Method and system for providing an extensible user interface|
|US20090210861 *||Feb 20, 2008||Aug 20, 2009||Mariana Alupului||Dita doclet tool and method for extracting and analyzing api documentation|
|US20090217100 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Test script transformation analyzer with economic cost engine|
|US20090217182 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Graphical user interface typing and mapping system|
|US20090217250 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Graphical user interface metadata evolution tool|
|US20090217302 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Test script transformation architecture|
|US20090217303 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Test script transformation analyzer with change guide engine|
|US20090217309 *||Feb 27, 2008||Aug 27, 2009||Accenture Global Services Gmbh||Graphical user interface application comparator|
|US20090249339 *||Mar 31, 2008||Oct 1, 2009||Microsoft Corporation||Associating command surfaces with multiple active components|
|US20090300472 *||Jan 12, 2009||Dec 3, 2009||Bridgeborn Llc||Method of authoring, deploying and using interactive, data-driven two or more dimensional content|
|US20090319924 *||Jan 14, 2009||Dec 24, 2009||Captaris, Inc.||Workflow data binding|
|US20090327912 *||Sep 10, 2009||Dec 31, 2009||Oracle International Corporation||Customization of client-server interaction in an internet application|
|US20090327922 *||Jun 27, 2008||Dec 31, 2009||Microsoft Corporation||Object Model for A User Interface|
|US20100070945 *||Mar 2, 2009||Mar 18, 2010||Tattrie Scott I||Custom and customizable components, such as for workflow applications|
|US20100142406 *||Feb 11, 2010||Jun 10, 2010||Goring Bryan R||System and method for building component applications using metadata defined mapping between message and data domains|
|US20100180226 *||Mar 17, 2010||Jul 15, 2010||Microsoft Corporation||User Interface for Displaying Selectable Software Functionality Controls that are Relevant to a Selected Object|
|US20100268793 *||May 11, 2010||Oct 21, 2010||Microsoft Corporation||Method and System for Semantically Labeling Strings and Providing Actions Based on Semantically Labeled Strings|
|US20100325530 *||Dec 2, 2009||Dec 23, 2010||Fuji Xerox Co., Ltd.||Information processing apparatus, information processing method, computer-readable medium and computer data signal|
|US20110126170 *||Nov 23, 2009||May 26, 2011||Michael James Psenka||Integrated Development Environment and Methods of Using the Same|
|US20110137702 *||Feb 10, 2010||Jun 9, 2011||Brian Hodges||Workflow applications|
|US20110296322 *||May 6, 2011||Dec 1, 2011||Savraj Singh Dhanjal||Markup Based Extensibility for User Interfaces|
|US20120124494 *||Jan 23, 2012||May 17, 2012||Accenture Global Services Limited||Graphical user interface typing and mapping system|
|US20120174013 *||Dec 29, 2010||Jul 5, 2012||Stefan Kraus||Add and combine reports|
|US20140082155 *||Sep 14, 2012||Mar 20, 2014||Ca, Inc.||User interface with configuration, registration, and runtime selection of views|
|US20140258933 *||Mar 26, 2014||Sep 11, 2014||Microsoft Corporation||Exposing non-authoring features through document status information in an out-space user interface|
|US20140282369 *||Mar 14, 2014||Sep 18, 2014||Adminovate, Inc.||Software application generator|
|US20140289738 *||Aug 27, 2009||Sep 25, 2014||Adobe Systems Incorporated||Systems and Methods for Dynamic Configuration of Client-Side Development Environments Through Use of Application Servers|
|USD754704||Aug 18, 2014||Apr 26, 2016||Kohler Co.||Display screen with graphical user interface|
|U.S. Classification||717/109, 715/234, 715/762|
|Jan 11, 2002||AS||Assignment|
Owner name: BEA SYSTEMS, INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARROLL, JR., THOMAS J.;REEL/FRAME:012472/0173
Effective date: 20011116
|Mar 16, 2009||FPAY||Fee payment|
Year of fee payment: 4
|Oct 15, 2010||AS||Assignment|
Owner name: ORACLE INTERNATIONAL CORPORATION, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BEA SYSTEMS, INC.;REEL/FRAME:025192/0244
Effective date: 20101008
|Mar 13, 2013||FPAY||Fee payment|
Year of fee payment: 8
|Jul 13, 2017||FPAY||Fee payment|
Year of fee payment: 12