WO2004023293A1 - Guiアプリケーション開発支援装置、gui表示装置、および方法、並びにコンピュータ・プログラム - Google Patents
Guiアプリケーション開発支援装置、gui表示装置、および方法、並びにコンピュータ・プログラム Download PDFInfo
- Publication number
- WO2004023293A1 WO2004023293A1 PCT/JP2003/011035 JP0311035W WO2004023293A1 WO 2004023293 A1 WO2004023293 A1 WO 2004023293A1 JP 0311035 W JP0311035 W JP 0311035W WO 2004023293 A1 WO2004023293 A1 WO 2004023293A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- cursor
- component
- state
- program
- gui
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/38—Creation or generation of source code for implementing user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Definitions
- the present invention relates to a GU I application development support device, a GU I display device and method, and a computer program. More specifically, GU I application development that enhances visual effects by displaying an animation on the cursor displayed in the graphical user interface (GU I) and enables easy display of cursor position or cursor movement.
- the present invention relates to a support device, a GUI display device, and a computer program. Background art
- GUI graphical 'user interface
- various functions such as arrangement of input buttons, setting of data input fields, or processing at the time of pressing a button are set, and image setting of various display screens is performed.
- Programs written in the J ava language are converted to computer- and platform-independent byte code (B yte C ode) as the J ava executable file format, and read by the J ava virtual machine (J ava VM).
- the Machine language conversion (interpreter) is performed and executed on various devices.
- J ava in order to easily create application software in a short time, prepare the software parts (components) that do not need recompilation in advance, and combine the parts to create a program. .
- J a v a technology to reuse these parts (J a v a b e n s) is built.
- Parts are set in units of various components such as windows displayed on the display, buttons, lists, combo boxes, text input fields, etc. These parts (components) have attributes such as button shape, layout information, etc. "Properties” as information, “Method” as processing as a result of actions for parts, and further, when actions for parts such as data arrival, interrupt occurrence, property change, method call, etc. occur, An “event” is defined as a function to notify the event. These “properties”, “methods” and “events” are considered as the configuration requirements of parts in J av a b ans.
- the minimum program unit for execution of J ava is called “class (c 1 a s;)”, and one or more classes generate a J ava program.
- a class has variables (V ar i a 1 e) as data and methods (M t h o d) as actions.
- the program components set as this class can be transferred to a PC or information appliance via a network such as the Internet or LAN, for example, and stored on the side of the device storing the class file.
- a JVa virtual machine that is not dependent on can run programs stored in class files.
- the important element of GU I is the cursor or border.
- the cursor or pointer moves based on input information from, for example, a mouse as a user input device, a keyboard, or a cross key such as a remote control, and shows valid input position information.
- cursor is used as a generic term for concepts including cursor and pointer.
- the display of the cursor position in the conventional device is performed by, for example, a bar indicating a cursor, or a reverse display of a designated area, or an icon blinking, etc. It is a common aspect to be done.
- a file storing display image data corresponding to a cursor is set, and a display mode defined in the file, for example, a repetition of a blinking pattern, or execution of a specific image data display It has been configured.
- the image of such a cursor is mainly associated with specific image data, and is fixed regardless of the state of the cursor. Therefore, there is a problem that it is difficult for the user to distinguish, for example, whether the cursor is staying or moving.
- various information appliances are assumed to be devices equipped with a GUI, but these information appliances can execute cursor movement instructions freely in all directions like a mouse on a PC.
- the movement control of the cursor is often performed only by the combination of movement instruction keys for up, down, left, and right four directions used in remote controls and the like and the decision key.
- the cursor movement instruction based on such a simple input device is performed, the movement of the cursor is not necessarily performed linearly with respect to the cursor movement target point, and the cursor movement by the user's operation; Mismatch with the user's viewpoint movement causes problems such as losing the cursor movement.
- GUI graphical user interface
- GUI application development support device that supports the development of a GUI application that has cursor display information on a graphical user interface (GUI).
- GUI graphical user interface
- a graphic expression program file storing a program relating to graphic expression in a cursor or a cursor setting component; an image storage section storing animation 'image data readable according to execution of the graphic expression program;
- An editing processing unit that executes processing of associating image data read out at the time of execution of the parameter representation program according to the component state at the cursor or cursor setting position;
- the GUI application development support device is characterized in that Furthermore, in one embodiment of the GUI application development support device of the present invention, the editing processing unit associates, with the focus state component in the cursor setting state, an animation having direction information indicating a possible direction of cursor movement. It is characterized by having a configuration for executing processing. Furthermore, in one embodiment of the GUI application development support device of the present invention, the editing processing unit associates the forcible state in which the cursor is set to the component with the cursor movement state for moving between components. The present invention is characterized by having a configuration capable of setting different read image data.
- the editing processing unit may be configured to set different readout image data in association with each component state of the cursor or the cursor setting position. It is characterized by having. Further, in one embodiment of the GUI application development support device of the present invention, the editing processing unit combines a logic component corresponding to the component and a graphic expression component including the graphic expression program file to generate a GUI. It is characterized in that it is configured to generate a component and to generate a GUI component in which image data corresponding to a cursor or a component state is associated with the graphic expression component. Furthermore, according to a second aspect of the present invention,
- a G U I display device that executes an animated representation of a cursor or set G U I component on a display
- a focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination;
- a focus manager that executes cursor movement processing according to cursor movement destination designation information determined by the focus navigator
- the image forming the animation includes an image having direction information indicating a direction in which the cursor can be moved, and the focus object has a focus state.
- the present invention is characterized in that it is configured to execute an animation display process based on an image having the direction information for a component in the above.
- the focus object is composed of different images in the focus state where the cursor is set to the component and the cursor movement state where the component moves between components.
- a G U I application program generation method that generates a G U I application with cursor display information on a graphical user interface (G U I),
- the editing processing step associates an animation having direction information indicating a possible direction of cursor movement for the focus state component in the cursor setting state. It is characterized by including the step of performing processing. Further, in one embodiment of the GUI application program generation method of the present invention, the editing processing step is associated with each of a focus state in which the cursor is set to a component and a cursor movement state moving between components. , Setting different readout image data. Furthermore, in one embodiment of the GUI application program generation method of the present invention, the editing processing step is performed at the cursor or cursor setting position. It is characterized by including the step of setting different read image data in correspondence with each of the component states.
- the editing processing step combines the logic component corresponding to the component and the graphic expression component including the graphic expression program file to generate the GUI.
- the method may include the steps of generating a component and generating a GUI component in which image data corresponding to a cursor or a component state is associated with the graphics expression component.
- the images constituting the animation include an image having direction information indicating a direction in which the cursor can be moved
- the animation display step includes:
- the present invention is characterized in that an animation display process based on an image having the direction information is performed on a component in the active state.
- the animation display step is different from the focus state in which the cursor is set to the component and the cursor movement state in which the component moves between components. It is characterized in that it performs an animation display process consisting of Furthermore, the fifth aspect of the present invention is
- GUI graphical user interface
- a computer program that performs an animated display process of a G U I component set with a cursor or cursor on a display.
- a graphic expression program file storing a program relating to graphic expression in a cursor or cursor setting component and animation that can be read out according to execution of the graphic expression program ' It has an image storage section storing image data, and an editing processing section that executes an associating process of image data read out at the time of execution of the graphics expression program according to the component state of the cursor or cursor setting position,
- the editing processing unit is configured to be able to set different readout image data in association with each component state of the cursor or the cursor setting position in the editing processing unit, so an animation according to the cursor state can be freely set.
- the focus state component in the cursor setting state it is possible to execute the process of associating the animation having the direction information indicating the possible directions of the cursor movement. It becomes possible to provide a simple GUI.
- the logic part of the component and the graphic representation part are separated and configured, a GUI component based on the logical part and the graphic representation part is generated, and the cursor is displayed on the graphic representation part.
- the system is configured to have an animation execution function based on an image according to the component state, it is possible to easily set or change the animation aspect of the component or the cursor by processing independent of the logic part.
- the search process is executed by the search engine based on the force-sol move instruction input information, the force-sol move destination is determined, and the determined move-destination instruction information of the cursor is determined. According to, the cursor movement process is performed, and the animation display process is performed according to the cursor or the state of the GUI component to which the cursor is set along with the cursor movement.
- the configuration is such that an animation display process is performed, which is an image having direction information indicating a direction in which the cursor can be moved, so that a GUI easy for the user to operate is realized.
- the computer 'program' of the present invention is, for example, a storage medium, provided in a computer readable form, to a general-purpose computer 'system capable of executing various program' codes, a communication medium such as a storage of CDFD, MO, etc. It is a computer program that can be provided by a medium or a communication medium such as a network. By providing such a program in a computer readable form, processing according to the program can be realized on a computer system.
- a system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to those in the same case.
- FIG. 1 is a diagram showing an example of a hardware configuration of a G U I application development support device of the present invention.
- FIG. 2 shows a functional configuration of the GUI application development support apparatus of the present invention. It is a lock figure.
- FIG. 3 is a sequence diagram for explaining the processing sequence of the G U I application development support device of the present invention.
- FIG. 4 is a sequence diagram for explaining the processing sequence of the G U I application development support device of the present invention.
- FIG. 5 is a view for explaining an example of the file configuration required to execute the processing of the G U I application development support device of the present invention.
- FIG. 6 is a view for explaining a display example of the G U I component generated in the G U I application development support device of the present invention.
- FIG. 7 is a view for explaining a display example of the G U I component generated in the G U I application development support device of the present invention.
- FIG. 8 is a diagram for explaining an example of animation setting processing corresponding to each state of the component executed in the GUI application development support device of the present invention.
- FIG. 9 is a block diagram showing a functional configuration for setting animation processing of components in the GUI application development support device of the present invention.
- FIG. 10 is a diagram for explaining an example of animation execution processing corresponding to the state of the component generated in the G U I application development support device of the present invention.
- FIG. 11 is a block diagram showing a configuration for executing a cursor-compatible image data setting processing function in the GUI application development support apparatus of the present invention.
- FIG. 12 is a block diagram showing a configuration for executing cursor movement and image data display processing corresponding to a cursor in the G U I display device of the present invention.
- FIG. 13 is a view showing an example of the configuration of a remote controller capable of instructing cursor movement attached to a GUI mounted device.
- FIG. 14 is a diagram showing an example of animation display accompanying cursor movement on the GUI display.
- FIG. 15 is a diagram showing an example of cursor movement between components in the GU I display.
- FIG. 16 is a diagram showing an example of displaying a cursor movable direction identification mark of a component on the GU I display.
- FIG. 17 is a diagram of a flowchart for explaining the move destination determination and moveable direction information display procedure in the cursor move process.
- FIG. 18 is a block diagram showing a configuration example of the GU I display device.
- GU I application development support device 1 0 0 0 0 The main processing unit controller (CPU (Central Processing Unit) 1 0 1) executes various GU I application development programs under control of the operating system (OS). Do.
- the CPU 101 executes, for example, program creation processing based on the Java language, specifically, setting of the function of each component to be set on the GU I screen, such as a button, combo box, etc., display image Perform setting processing etc.
- C PU 1 0 1 is interconnected with other components by bus 1 0 7.
- the memory 102 is a storage device used for storing program code executed by the CPU 1 or for temporarily storing work data being executed.
- the memory 102 shown in the figure is a non-volatile memory such as a ROM and a DRAM. Including both volatile memory.
- Graphics Processing Chip 150 is a chip that incorporates a dedicated processing circuit that performs coloring processing for various GU I components.
- a display controller '0 3 as a display control unit is a dedicated controller for actually processing a drawing command issued by the CPU 1 0 1.
- the display data processed by the display controller 103 is, for example, once written to a frame buffer (not shown) and then displayed on the screen by the display 108.
- a frame buffer not shown
- an image reproduced from the HDD (1 1 1) and an image processed by the CPU 1 1 are displayed on the display 10 8 so that the user can view the presented screen.
- An input device interface 104 is a device for connecting a user input device such as a keyboard 1 0 9 or a mouse 1 1 0 to the GU I application development support device 1 0 0.
- the user can input a command for processing or displaying an image through the keyboard 109 or the mouse 110.
- Network 'interface 105 is a local area network such as LAN (Local Area Network) or even an Internet, in accordance with a predetermined communication protocol such as Ethernet, according to a predetermined communication protocol such as Ethernet. Can be connected to a wide area network like
- multiple host terminals and servers are connected in a transparent manner to create a distributed computing environment.
- delivery services such as software programs and data contents can be provided. For example, it is possible to download image data from another server in which moving images, still images, etc. are stored to the HDD (1 1 1) via the network.
- the external device interface 106 connects external devices such as a digital camera, hard disk drive (HDD) 111 and media drive 112 to the GU I application development support device 100 A device for
- the HDD 111 is an external storage device on which a magnetic disk as a storage medium is fixedly mounted, and is excellent in terms of storage capacity and data transfer speed. Access is also possible. For example, it is possible to install a program or program that puts software 'program' on an executable state. In the HDD 111, the operating system program to be executed by the CPU 101, the application program, the device driver, etc. are stored in a non-volatile manner.
- the media drive 112 is used to load portable media 160 such as a compact disc (CD), a magneto-optical disc (MO), and a digital versatile disc (DVD) and to access the data recording surface of the medium.
- portable media 160 such as a compact disc (CD), a magneto-optical disc (MO), and a digital versatile disc (DVD)
- Portable media 160 is primarily for the purpose of backing up software 'programs and data' files, etc. as computer readable data, and for the purpose of moving them between systems (ie including distribution 'sales'). used. Application programs for performing various processes can be physically distributed and distributed among multiple devices using these portable media.
- the apparatus as shown in Fig. 1 can be realized as a compatible machine or a succeeding machine of a personal 'computer ⁇ PC / AT (Personal Computer / Advanced Technology)' of IMB Inc. Of course, it has another architecture. It is also possible to apply a different computer [2. Functional configuration]
- GUI application development support of the present invention for developing a GUI application by separately configuring the logic part of each component set in the graphical 'user interface (GU I) and the graphic representation part
- GUI I graphical 'user interface
- the GU I application development support device of the present invention can be configured as various buttons (combo box, list, window, text 1, box, etc.) set on the screen as a user interface (components ) Has a part storage unit 200 stored for.
- Part storage unit 200 is a logic component storage unit 201, a graphic expression component storage unit (simple) 202, and a graphics table It has an existing parts storage unit (Ritch) 203.
- the logical component storage unit 201 stores logical information on various components (components) such as buttons, combo boxes, lists, windows, text boxes, etc. set on the screen as user interfaces. It is a part. For example, if it is a button, it is configured as a software program component that defines functions such as processing when the button is turned on and processing when the button is turned off.
- the graphic representation part storage unit (simple) 202 and the graphic representation part storage unit (rich) 203 store the display image information of the component, that is, the graphic representation program It is configured as a software program component that stores
- the graphic expression part storage unit (simple) 202 and the graphic expression part storage unit (rich) 203 are parts storing programs for executing different graphic expressions.
- the image data storage unit 205 stores, for example, image data such as ⁇ pg and gif. By associating these image data with the graphic representation parts of each component, animation display based on the image data according to various operations of the component becomes possible. These animation setting processes will be described later.
- the operator as the developer of the GUI application program executes various data inputs to the editing processing unit 210 via the data input / output unit 220 and each component such as a button, a combo box, etc. Configure GUI components by setting one function, graphic image.
- the component creation processing execution program is, for example, one class (Fattary class) of the Java program.
- the editing processing unit 210 executes a factory class to create various components.
- the processing in the editing processing unit 210 is processing executed under control of C PU 101 in the hardware configuration diagram of FIG.
- Parts are, for example, “properties” as attribute information such as button shape and layout information, “methods” as processing as a result of an action on a part, and an action on a part Eg, data arrival, interrupt generation
- the editing processing unit 210 edits as an GU I component that defines an "event” as a function to notify an event to another part when a raw, property change, method call, etc. occurs.
- the editing processing unit 2 1 0 is a property editing unit 2 1 1 for editing properties set in a part (component), a method editing unit 2 1 2 for editing methods, and a event editing unit 2 1 3 for editing events. Have.
- the operator When setting the appearance of the GU I component to be generated, that is, the graphic representation, the operator inputs L o o k & F e e 1 package specification data to the editing processing unit 210 that executes the Fata class. That is, specify either "rich” or "simple".
- the factory class is executed in the editing processing unit 210, and the graphic representation component storage unit (simple) 202 or the graphic representation component storage unit (rich) 20 according to the designated data. From 3), read out any corresponding program parts and create a component together with the read parts of the logical part storage unit 201.
- the button component when generating a GU I component for a button, the button component is read from the logic component storage unit 201 storing the component storing the logic information about the component (component), F ee 1 package specification data, that is, according to the specification data of either “rich” or “simple”, graphics representation component storage unit (simple) 202 or graphics representation expression component storage unit Read out the graphic expression program storage part of the button from 2 0 3 3, combine the logic part and either the “Litch” or “Simple” graphic expression part, Generate a button component.
- the logic component storage unit 201 storing the component storing the logic information about the component (component), F ee 1 package specification data, that is, according to the specification data of either “rich” or “simple”, graphics representation component storage unit (simple) 202 or graphics representation expression component storage unit Read out the graphic expression program storage part of the button from 2 0 3 3, combine the logic part and either the “Litch” or “Simple” graphic expression part, Generate a button component
- the same editing process is performed for various parts (components), such as combo boxes, lists, windows, text boxes, etc., in addition to the buttons, and after the editing process, the set GU I application program is stored.
- the GU I stored in the unit 22 1 and executed by the program execution unit 22 2 is displayed on the display unit 2 2 3.
- an example was described in which only two types of parts storing the graphic expression program were set as “simple” and “rich”, but these types are set to any number of 3 or more.
- the operator can input the specified data of one of the set graphic expression parts, select the graphic expression parts according to the specified data, and create various GU I components. .
- Fig. 3 is a diagram showing the processing sequence for generating the GU I component by selecting the "simple" graphic representation part.
- FIG. 3 from the left, processing of the operator, GU I generation application, component factory, graphic representation portion, and logic portion are shown.
- the processing of the graphic representation part and the logic part is to execute the program stored in the readout part of the graphic representation part storage part (simple) 202 and the logic part storage part 201 shown in FIG.
- these processes and the process of the component factory are executed in the editing process unit 210 shown in FIG.
- step S101 the operator inputs a GU I component generation command (C re ate) to the GU I generation application.
- GU I component generation command C reate
- component types for example, component types such as "button”, “list”, “combo box”, “radio button” and “window” are specified. It is input with the data.
- step S 102 the “Look & Feel” designation for specifying a graphic expression from the operator is output to the component factory via the application.
- "Simple” is specified as "Look &Feel”.
- step S103 the application outputs a component generation command to the component factory. This command includes identification data indicating the component type specified in the previous step S101.
- step S104 the component factory outputs a component generation instruction (C reate) to the graphic expression portion (simple) and the logic portion from the component factory, and according to the storage portion of the logic portion and the graphic expression portion, Component generation is performed.
- a component generation instruction C reate
- the process from step S105 shows the process sequence when the application processes a component, for example, an instruction to open a "window" as a component.
- the open processing instruction of the component is passed to the logic part, and based on the execution of the program of the logic part, the paint (Paint) instruction is passed to the graphics representation part (simple).
- the graphic representation part executes the paint process of the component according to the input instruction from the logic part.
- FIG. 3 From left, the processes of the operator, G U I generation application, component fatigue, graphic expression part, and logic part are shown. As in FIG. 3, the processing of the graphic representation part and the logic part is stored in the readout part of the graphic representation part storage part (simple) 202 and the logic part storage part 201 shown in FIG. These processes, which correspond to the execution of a program, and the process of component factories are executed in the editing processing unit 210 shown in FIG.
- step S201 the operator inputs a GU I component generation command (C reate) to the GU I generation application.
- Ru a GU I component generation command
- data specifying component type for example, component type such as “button”, “list”, “combo box”, “radio button”, “window”, etc.
- component type such as “button”, “list”, “combo box”, “radio button”, “window”, etc.
- step S202 the “Look & Feel” specification for specifying a graphic expression from the operator is output to the component factory via the application.
- “ritch” is specified as “Look & Feel J”.
- step S203 the application outputs a component generation command to the component factory.
- This command includes identification data indicating the component type specified in the previous step S201.
- step S204 a component generation instruction (C reate) is output from the component factory to the graphics representation part (simple) and the logic part, and a storage program for the logic part and graphics representation part (rich) is generated. Component generation is performed according to the program.
- the processing at step S205 and the following shows the processing sequence when an application processes a component, for example, an open processing instruction of "window" as the component.
- the open processing instruction of the component from the application is passed to the graphic expression part, and the animation is executed (S2 0 6) based on the execution of the animation program stored in the graphic expression part. .
- step S 2 07 the open processing instruction is passed to the logic part, and based on the execution of the program of the logic part, the paint (P aint) instruction is passed to the graphics representation part (simple), The component part (litch) performs the painting process of the component according to the input instruction from the logic part.
- a GU I component For example, as an example of a GU I component, the following files are required as files for configuring a button control [B u t t c o n] component as an icon having a button function as a GU I component.
- the class indicates the execution unit program of JaVa.
- Figure 5 shows the directory structure of each of the above files.
- Java a logic part of this button as a customo 1 kit as a remote kit under a certain GU I application [application], and a CC omponent F actor.
- Look & F eeel File No. [laf] contains a class that implements Look & Feel as a graphic expression part of B uttcon n.
- Java a button control, that is, a class corresponding to the above-mentioned graphic expression part.
- image data file [image] buttcon_n orma 1 off.
- the GU I application program executes processing that applies the processing program and image data contained in each of these files according to the user's input information. Specifically, both the various function execution processes according to the program of the logic component class and the various darafix expression processes according to the program of the graphics expression component class are executed.
- Figure 6 shows an example in which each component is generated and displayed by applying a graphical representation part (simple). The explanation will be made by taking the button 3 1 1 and the combo box 3 1 2 as examples of GU I components.
- buttons 31 and 31 When the button 31 is operated, for example, button on / off or focus setting, that is, cursor setting, processing based on the button on / off operation is executed by processing of the logic part of the button component. Furthermore, for example, by a paint command from the logic part, the graphics representation part (simple) is executed to perform the paint processing, that is, the processing for changing the display color of the button.
- Combo box 3 1 2 operation eg combo box 3 1 2 open
- processing based on the open / close operation of the combo box is executed by the processing of the logic part of the combo box component.
- the graphic representation part (simple) of the combo box component is executed by, for example, a paint command from the logic part, and the paint processing, that is, the processing of changing the display color of the combo bottus is performed.
- Figure 7 shows an example of generating and displaying each component by applying a graphic expression part (Ritchi).
- the button 320 and the combo box 330 will be described as G U I components.
- buttons 320 When the button 320 is operated, for example, the button is turned on or off, or the focus setting, that is, the cursor setting is performed, in addition to the painting process described above, processing of the graphic representation portion (liter) of the button component is performed. , Animation 3 2 1 3 2 2 execution is done. Although it is difficult to understand in the figure, in (b) and (c), an animation in which ripples spread around the button is performed. Note that processing based on the on / off operation of the button is executed by the processing of the logic part. Furthermore, when the operation of the combo box 330 is performed, for example, opening or closing the combo box 330, the processing based on the open / close operation of the combo box is executed by processing the logic part of the combo box component.
- the animations 3 3 1 and 3 3 2 are executed as processing of the graphic representation part (Litch) of the combo box component.
- an animation set so as to spread downward at the bottom of the combo box is executed.
- FIG. 8 is a diagram showing a processing screen for setting image data for executing an animation on a component.
- Component specification column 3 5 1 is set with component [Button (B utton)], image data setting column 3 5 2 is configured at the bottom, and the state of the component, that is, Normal (N orma 1), ON (O n), Off (O ff), Focus (Focus), etc.
- the call image (J peg) in each component state has a configuration that can be set individually.
- the focus (Focus) is set, the cursor is set to the component and it is in the state of being able to operate such as on or off.
- the animation index 'method is called and executed according to the program defined in the graphic expression component.
- the J peg images 1 1 to 2 1 are read from the image file [I mage] by executing the animation index method, and the image of the button displayed based on these multiple images is displayed as an animation. Be done.
- an off (O ⁇ f) process is performed, the image file [I mage] to J peg images 3 1 to 3 8 are read and GU I displayed based on these multiple images.
- the image of the button is displayed as an animation.
- the component state is an example having four states of normal (N orma 1), on (O n), off (O ff), and focus (F ocus).
- the state definition is not limited to this, and may be defined as shown below, for example, and may be configured to set image data according to each state.
- the non-active state refers to the case where the display is in a state that is not displayed in the window that is not the operation target. In this way, it is possible to set individual image files corresponding to processing for each component, and it is possible to freely set the optimal animation expression according to various processing.
- the figure shows an example of setting an animation for a button, but animation settings corresponding to various processes are also possible for other components.
- the animation at the time of opening in the combo box, the animation at the time of closing, etc. are set individually by individually selecting and setting the image from the image file.
- the GU I application development support device for executing the animation display setting process by setting the image data corresponding to the state of each component described above is realized by the configuration described above with reference to FIG. 1 and FIG.
- the processing configuration limited to the function for executing the setting processing of the image file according to each component state will be described with reference to the block diagram shown in FIG.
- the GU I application development support device stores component storage units that store various components such as buttons, combo boxes, lists, windows, text boxes, etc., set on the screen as a user interface.
- the component storage unit 400 has a logic component storage unit 401 as a software program component that defines the processing function of the component, and a graphic representation of the component. It has a graphic expression part storage unit 402 as a software program part.
- the graphic expression parts execute plural kinds of graphic expressions such as simple, straight and so on. Can be configured as several different parts.
- the image data storage unit 403 is an animation index called by the execution of the graphic representation class as a program stored in the graphic representation component stored in the graphic representation component storage unit 402 according to the “method”. It stores image data to be read out.
- the image data is, for example, a data file of j P eg, g i ⁇ , etc., and corresponds to each of the graphic expression components stored in the graphic expression component storage unit 402.
- the operator as the developer of the GUI application program executes various data inputs to the editing processing unit 410 via the data input / output unit 420, and the function of each component such as a button, a combo box, etc.
- the component creation processing execution program is, for example, one class (Fattary class) of a program of JaVa.
- the editing processing unit 410 executes the factory class to create various components. Note that the processing in the editing processing section 4 1 0 is processing that is executed under control of C PU 1 0 1 in the hardware configuration diagram of FIG. 1.
- the editing processing unit 410 executes an associating process of image data to be read according to the state of the component. This is done as part of the component's Properties, Methods, and Events editing process.
- the operator inputs L o o k & F e e 1 package specification data to the editing processing section 4 1 0 that executes the Fata class when setting the appearance of the G U I component to be generated, that is, the graphic representation. That is, either “Ritch” or “Simple” is specified, and furthermore, as described with reference to FIG. 8, the image data to be read out is set according to the state of the component.
- a GUI application program having various components is generated, and the generated GUI application program is stored in the program storage unit 42 1, and the program execution unit 42 2
- the generated GU I is displayed on the display unit 4 2 3.
- the animation display process is executed by the graphics expression class 511 of the graphic expression component included in the button component.
- the animation index 'method is called according to the program specified in graphic representation class 5 1 1 and is set in the setting process described earlier with reference to FIG. 8 from the image file [I mage] 5 1 2 J peg images 1 1 to 2 1 are read, and the image of the displayed button based on these multiple images is displayed as animation 5 1 4.
- the image file [I mage] 5 1 2 is set as an image file storage unit by securing a partial area of the memory 102, HDD 11 and other storage means of the hardware configuration shown in FIG. And can be stored.
- Animation of components can be set easily by changing the call image data.
- animation settings such as causing the tongue to distort the concavo-convex shape, changing the color, etc., as the on / off operation.
- the graphic representation component storage unit is a simple, rich, etc. same component, for example, a plurality of graphics representations storing different graphic representation processing execution programs even with buttons. Parts are prepared.
- the graphic representation component storage unit is a simple, rich, etc. same component, for example, a plurality of graphics representations storing different graphic representation processing execution programs even with buttons. Parts are prepared.
- the example in Fig. 2 only two types, simple and rich, are shown, but it is also possible to set multiple graphics presentation parts, such as rich 1, rich 2, ... and so on.
- Each of these graphics representation parts can be mapped to a different individual read image file, and even if the button has the same function, it is applied according to the first Look & Feel 1 package specification.
- the graphic expression component to be selected is determined, and the animation set in association with the component is displayed. Therefore, various different animation displays can be performed according to L o o k and F e e l package specification.
- each component such as button and combo box has a logic part and a graphic expression part as separate software programs.
- the graphic expression program is a file of several kinds such as simple, branch etc. Have a selectable configuration.
- a cursor is used as a general term for identification indication indicating a designated position on a window, and will be described as including, for example, the concept of a pointer, a cursor and the like.
- the cursor is in various component positions, such as a button, list, or combo box, the component is said to be in focus.
- the state of the component specifically, for example, when the component is a button, the button component is in the push state or in the focus state, etc.
- the image file individually set according to the state of is read out, and the animation display is executed according to the read image file.
- the cursor is used not only when the cursor is at a particular component, ie when the component is in focus, but also when moving between components, for example when moving the cursor from one button component to another Also perform animation expressions.
- the process for setting these various animations according to the component state of the cursor or cursor setting position is almost the same process as the process of setting the image file according to the above-mentioned component state.
- the GUI application development support device that can execute this setting process is realized by the configuration described above with reference to FIGS. 1 and 2, but the image file setting process according to the cursor
- the processing configuration limited to the functions for executing will be described with reference to the block diagram shown in FIG.
- the GUI application development support device stores the parts storage unit that stores various components such as buttons, combo boxes, lists, windows, text boxes, etc. set on the screen as user interfaces.
- the component storage unit 5 60 has a logical component storage unit 5 6 1 and a graphic expression component storage unit 5 6 2.
- the graphic representation part storage unit 5 62 2 includes a cursor-compatible graphic representation program file storing a program for graphic representation in a cursor or cursor setting component.
- the image data storage unit 563 is a storage unit that stores an animation 'image data that can be read out according to the execution of the graphics rendering program.
- the image data storage unit 563 has a cursor image, an image when the cursor is set to the component, that is, an image at the time of setting the focus, and a movable direction of the cursor set to the component described later. Contains an arrow (arrow) display image for displaying an arrow (arrow).
- the image data is, for example, an image data file such as jpeg or gif.
- the operator as the developer of the GUI application program executes various data, commands, and parameter inputs to the editing processing unit 5700 via the data input / output unit 5800, and the cursor or cursor setting position is Executes matching processing of image data to be read according to the component status.
- a focus navigator for executing a search process by a search engine based on cursor movement instruction input information to determine a cursor movement destination and cursor movement direction information for a cursor determined by a focus navigator. Then, execute the process to set the cursor control program and the focus manager that executes the cursor movement process, and select the only cursor movement destination for the focus navigator based on the cursor movement instruction input information. Execute the process of setting the solution destination selection algorithm. Details of the focus navigator and focus manager will be described later.
- the editing processing unit 570 executes processing of associating an image having direction information indicating a direction in which the cursor can be moved with respect to the focus state component in the cursor setting state. Note that the processing in the editing processing unit 560 is processing executed under the control of C PU 101 in the hardware configuration diagram of FIG.
- a GUI application program having various components is generated, the generated GUI application program is stored in the program storage unit 51, and is executed by the program execution unit 582.
- the generated GUI is displayed on the display unit 583.
- the configuration for executing the image formation processing that is, the functional configuration for executing the processing in the GUI-equipped device such as the information home appliance or the GUI display device will be described with reference to the block diagram in FIG.
- the focus object 601 is a program file having a program in which a cursor or a cursor expression at the cursor position is described.
- the focus manager 602 executes cursor movement processing in accordance with the cursor's movement destination designation information input from the focus navigator 600, and executes the execution instruction of the definition to the focus object 600. It is a management program that executes processing such as notification.
- the focus navigator 630 has a search engine 640 and executes search processing by the search engine 600 based on user input from the input unit such as mouse and cross key, and moves the cursor to the move destination. Is determined, and the move destination information etc. of the determined cursor are output to the focus manager 602.
- the focus navigator 600 executes cursor movement destination determination processing according to a cursor movement destination selection algorithm that selects the only cursor movement destination based on cursor movement instruction input information.
- the cursor movement instruction input information is, for example, movement direction instruction information in any of four directions, up, down, left, or right.
- the cursor movement destination selection algorithm executed by the focus navigator 6 0 3 is, for example, in the direction corresponding to the movement direction instruction information. This is an algorithm that determines the only component from multiple existing components as the cursor movement destination.
- a remote controller having an output unit such as an infrared ray can be used as a user input device for specifying the movement of the cursor.
- An example of the configuration of the remote controller is shown in Figure 13.
- the controller shown in FIG. 13 has a power supply switch 7 0 1 for a control device having a GUI, an output unit 70 2 configured by an infrared output means, a display 7 0 3, and input buttons 7 0 for various designations.
- 4 ⁇ Has a four-way controller 7 0 5 with cursor up / down / left / right movement instruction function.
- the controller shown in FIG. 13 is only an example, and various configurations are possible according to the functions of the GUI-equipped device.
- the input unit is not limited to the remote controller, but may be an input unit integrated with the GUI-equipped device itself.
- a cursor movement processing sequence accompanied by animation expression will be described.
- the focus navigator 630 receives the input information.
- the focus navigator 630 executes a destination search process to which the search engine 604 is applied based on the input information.
- the focus navigator 6 0 3 determines the destination component based on the search results of the search engine 6 0 4.
- Various modes can be applied to the movement destination determination process mode, and these specific examples will be described later.
- the focus navigator 6003 When the move destination is determined, the focus navigator 6003 outputs a move destination instruction to the focus manager 602, and the focus manager 602 executes cursor movement processing toward the move destination. Further, the focus manager 602 outputs an animation execution instruction to the focus object 601, and the focus object 601 reads the image processing program, that is, the image file set corresponding to the cursor. Execute processing and display processing. Through this series of processing, cursor movement processing in which the animation expression is executed is performed.
- Figure 14 shows an example of animation expression when moving the cursor.
- the animation execution process is performed based on the readout of image data by the focus object.
- the cursor moves from the button 7 2 1 displayed on the device play to the button 7 2 2, the focus state of the button 7 2 1 is released, and the button 7 2 2 is brought into focus state.
- the example of a display of a series ((a)-(d)) of up to is shown.
- a rectangular frame similar to the button shape is sequentially generated in the cursor movement direction, and an animation expression is executed in which the rear rectangular frame disappears as the cursor moves.
- These animation representations are due to the image data read by the focus object.
- the setting of this image data is an animation display based on the image data set by the process similar to the setting process of the image data corresponding to the state of the component described above with reference to FIG. .
- the focus navigator 6 0 3 is a remote controller, as shown in Figure 1 3 Alternatively, it receives an input from the cross key as an input unit of the device itself, and determines a cursor movement destination by search processing to which the search engine 604 is applied based on the input information.
- An example of processing for determining a cursor movement destination will be described with reference to FIG.
- Figure 15 shows two different processing examples (a) and (b). Both show a process example when a cursor is positioned at the button 7 51 and the button 7 5 1 is in focus, and a user input for designating movement to the right is generated.
- Figure 15 (a) is an example in which the button A at the top of the buttons A to C on the right of the button 7 5 1 is determined as the move destination.
- Figure 15 (b) is the button This is an example in which the middle button B is selected as the movement destination among the buttons A to C located to the right of 7 5 1.
- Figure 15 (a) shows the process of selecting the button in the top row from the buttons in the right direction of the button 7 51. This process is performed by the focus navigator 63 for each button component. It is executed based on the coordinate position information (X, Y). For example, the button in the right direction of the button 75 1 is selected by the X coordinate of the button 7 51 and the X coordinate of each button component, and the selected coordinate is selected from among the ⁇ coordinates. Determine the largest one of as the cursor movement destination.
- Figure 15 (b) shows the process of selecting the button closest to the button 7 5 1 from the buttons in the right direction of the button 7 5 1 and this process is performed by the focus navigator 6 0 3
- How to decide the destination based on the user input information depends on the program executed by the focus navigator 630 and the search engine 604.
- the user input information Various destination decision algorithms based on the destination can be set. For example, as described above, among a plurality of components existing in the direction corresponding to the movement direction indication information, an algorithm for selecting a component located at the shortest distance from the current cursor setting component may be used. Among the components present in the direction, An algorithm or the like for selecting the component at the end can be set. These algorithm setting processes are executed by the editing processing unit 570 (see FIG. 11) in the GUI application development support device.
- the move destination search processing by the focus navigator 603 is not executed. Determine the move destination according to the move destination setting information of.
- the focus navigator executes the move destination determination process to which the search engine is applied based on the input information, and further acquires information on the movable directions of each component, and the component which has become in focus state. It is possible to display graphic images such as arrows (arrows) that indicate the direction in which the cursor can move.
- This image display processing program can be set as a force to be set to the parallax expression component corresponding to the component described above, or as a focus object corresponding to a single solution.
- FIG.16 An example of arrow display is shown in Fig.16.
- movable components of the cursor are present in four directions, up, down, left, and right.
- an arrow (arrow) indicating that there are components movable in four directions, up, down, left, and right, is displayed.
- the cursor movable component from the button component 7 8 2 in focus exists in the upper and right two directions.
- an arrow is displayed indicating that there are components movable in two directions, up and to the right.
- buttons 783 in the focused state there is a movable component of the force source only in the downward direction. For components in this state, arrows are displayed only downward.
- the button component 7 84 in the focus state the movable component of the cursor exists only in the upward direction. For components in this state, arrows are displayed only upward.
- step S301 it is determined whether or not there is an input from the input unit such as the cross key, and if there is an input, the process proceeds to step S302 and the component at the cursor current position indicates a move destination indication. It is determined whether or not there is dynamic information, for example, whether or not the logical part file of the component contains destination component information. If there is information, the process proceeds to step S310 to determine the move destination according to the move information, and in step S307, cursor movement is performed on the determined move destination.
- step S302 If it is determined in step S302 that the component in focus does not have the information indicating the move destination instruction, the process proceeds to step S303, and the move destination search by the search engine based on the user input information is executed.
- step S304 the focus navigator determines the destination based on the search result of the search engine. Further, in step S305, the focus navigator acquires cursor movable direction information of the movement destination component based on the component arrangement information of the four directions around the movement destination component.
- step S306 the move destination information determined by the focus navigator and the movable direction information of the move destination component are passed to the focus manager, and in step S307, the cursor move processing for the move destination is executed. Do.
- step S308 the focus manager determines whether cursor moveable direction information of the movement destination component has been received from the focus navigator. If not received, the process is ended. • Outputs a processing execution instruction of identification information (for example, an arrow) based on movable direction information to the focus object, and the focus object executes an animation of arrow display according to the input instruction.
- identification information for example, an arrow
- the focus object selects the image data in accordance with the movable direction information input from the focus manager, and for example, consists of the image in which the arrow is set in the movable direction described above with reference to FIG. Execute animation display.
- GUI graphical user interface
- FIG. 18 shows one example thereof, and shows a configuration example of a G U I display device having a configuration capable of receiving a moving image via a network or reading it from a storage medium and reproducing it.
- the GUI display unit 800 shown in FIG. 18 has a communication interface 801 for receiving Internet distribution data or broadcast data etc., and can transmit HTML documents, moving image contents etc. from the data distribution site.
- a storage medium interface 8002 is an interface for data transfer with various storage media 820 such as a DVD, flash memory, etc., and various contents such as image data are processed with the storage medium 820. It is an interface that inputs and outputs between devices 800.
- the decoding / encode processing unit 800 When the content transmitted from the image distribution site or the content stored in the storage medium 820 is encoded, the decoding / encode processing unit 800 performs decoding processing, Under the control of the display control unit 800, display is performed on the display unit 810.
- various commands by the user or the above-mentioned cursor movement instruction information are input from the controller 81 1, received by the receiving unit 8 0 7, and output to the control unit (C PU) 800 4.
- the control unit 804 executes various processes in accordance with the logic parts, graphic representation parts, etc. corresponding to the above-described components.
- focus management processing that is, processing for determining the movement destination component of the power source accompanying cursor movement is executed.
- focus object executes the animation display processing by the image data whose movable direction is indicated by an arrow, for example.
- the storage unit in the GUI display device 800 is a storage unit used for storage of received data, storage of various processing programs, storage of a preset display image program, or a storage area as a work area in the CPU 800.
- the timer 86 is used to measure the execution time of various programs in GUI processing.
- the series of processes described in the specification can be performed by hardware, software, or a combination of both.
- the program that records the processing sequence is installed in the memory in the computer built into the dedicated hardware and executed, or a general-purpose computer that can execute various processing. It is possible to install and run a program.
- the program can be recorded in advance on a hard disk as a recording medium or ROM (Read Only Memory).
- the program may be a flexible disk, a compact disk read only memory (CD-ROM), a magneto-optical disk (MO) disk, a removable disk such as a magnetic disk or semiconductor memory, and a DVD (digital virtual disk). It can be stored (recorded) temporarily or permanently on a recording medium.
- Such removable recording media can be provided as so-called package software.
- the program is installed on the computer from the removable recording medium as described above, and is also wirelessly transferred from the download site to the computer, or wired to the computer via a network such as a LAN (Local Area Network) or the Internet.
- the computer can receive the transferred program and install it on a recording medium such as a built-in hard disk.
- the GUI application development support apparatus of the present invention is a graphics expression program file storing a program related to graphic expression in a cursor or cursor setting component, and a graphics expression program file.
- the image data storage unit storing animation data that can be read out according to execution and the image data correspondence processing read out at the time of execution of the graphics expression program are executed according to the component state of the cursor or cursor setting position. Since the editing processing unit is configured to be able to set different readout image data in correspondence with each component state at the cursor or cursor setting position, the editing processing unit responds to the force state. And animation to it is possible to freely set, it is possible to perform GUI equipped optimal cursor corresponding compatible with equipment animation setting process easily. Furthermore, according to the configuration of the present invention, with regard to the focus state component in the cursor setting state, the processing of associating the animation having the direction information indicating the possible directions of the cursor movement is enabled to be performed. It is possible to provide a simple GUI.
- the logic part of the component and the graphic representation part are separated and configured, and a GUI component based on the logic part and the graphic representation part is generated, and an image corresponding to the cursor or component state is displayed on the graphic representation part. Since it is configured to have an animation execution function based on the above, it is possible to easily set or change the aspect of component and cursor animation by processing independent of the logic part. Furthermore, in the GUI display device according to the present invention, the search process by the search engine is executed based on the cursor movement instruction input information, the cursor movement destination is determined, and the cursor movement destination is determined according to the determined cursor movement destination indication information.
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03794136A EP1536323A4 (en) | 2002-09-06 | 2003-08-29 | DEVICE FOR SUPPORTING THE DEVELOPMENT OF A GRAPHICAL USER INTERFACE APPLICATION, GRAPHICAL USER INTERFACE DISPLAY DEVICE, METHOD AND COMPUTER PROGRAM |
AU2003261821A AU2003261821A1 (en) | 2002-09-06 | 2003-08-29 | Gui application development support device, gui display device, method, and computer program |
US10/494,557 US7870511B2 (en) | 2002-09-06 | 2003-08-29 | GUI application development supporting device, GUI display device, method, and computer program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2002261353A JP3755499B2 (ja) | 2002-09-06 | 2002-09-06 | Guiアプリケーション開発支援装置、gui表示装置、および方法、並びにコンピュータ・プログラム |
JP2002-261353 | 2002-09-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2004023293A1 true WO2004023293A1 (ja) | 2004-03-18 |
Family
ID=31973122
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2003/011035 WO2004023293A1 (ja) | 2002-09-06 | 2003-08-29 | Guiアプリケーション開発支援装置、gui表示装置、および方法、並びにコンピュータ・プログラム |
Country Status (7)
Country | Link |
---|---|
US (1) | US7870511B2 (ja) |
EP (1) | EP1536323A4 (ja) |
JP (1) | JP3755499B2 (ja) |
KR (1) | KR100975458B1 (ja) |
CN (1) | CN1293465C (ja) |
AU (1) | AU2003261821A1 (ja) |
WO (1) | WO2004023293A1 (ja) |
Families Citing this family (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7568161B2 (en) * | 2003-08-13 | 2009-07-28 | Melia Technologies, Ltd | Overcoming double-click constraints in a mark-up language environment |
KR100608679B1 (ko) * | 2004-01-08 | 2006-08-02 | 삼성전자주식회사 | 객체의 이동 방향을 표시하는 디스플레이 장치 및 방법 |
JP4630672B2 (ja) * | 2004-01-23 | 2011-02-09 | キヤノン株式会社 | アクセス制御装置及びアクセス制御方法及びアクセス制御プログラム |
US20050177525A1 (en) * | 2004-02-06 | 2005-08-11 | Apple John R. | Sales and service offer method and apparatus |
US7490295B2 (en) * | 2004-06-25 | 2009-02-10 | Apple Inc. | Layer for accessing user interface elements |
US7293040B2 (en) * | 2005-02-11 | 2007-11-06 | Sybase, Inc. | System and methodology for database migration between platforms |
US7788248B2 (en) * | 2005-03-08 | 2010-08-31 | Apple Inc. | Immediate search feedback |
WO2007096004A1 (en) * | 2006-02-27 | 2007-08-30 | Robert Bosch Gmbh | Video retrieval system, method and computer program for surveillance of moving objects |
US8793620B2 (en) * | 2011-04-21 | 2014-07-29 | Sony Computer Entertainment Inc. | Gaze-assisted computer interface |
US7595810B2 (en) * | 2006-03-22 | 2009-09-29 | Apple Inc. | Methods of manipulating a screen space of a display device |
KR100886767B1 (ko) * | 2006-12-29 | 2009-03-04 | 엔에이치엔(주) | 지유아이 검색 서비스 제공 방법 및 시스템 |
KR100877066B1 (ko) * | 2007-01-22 | 2009-01-09 | 삼성전자주식회사 | Layout 구조를 이용한 GUI 위짓 구성 장치 및이를 운영하는 방법 |
US8131033B2 (en) | 2007-07-25 | 2012-03-06 | Sectra Ab | Sensitivity lens for assessing uncertainty in image visualizations of data sets, related methods and computer products |
JP4556972B2 (ja) * | 2007-08-24 | 2010-10-06 | ブラザー工業株式会社 | 操作画像表示装置及びプログラム |
CN101446894B (zh) * | 2007-11-27 | 2012-12-12 | 飞跃中科(台州)数控系统有限公司 | 一种基于家用电脑绣花机的嵌入式图形系统 |
US20090284532A1 (en) * | 2008-05-16 | 2009-11-19 | Apple Inc. | Cursor motion blurring |
US8823723B2 (en) * | 2008-08-07 | 2014-09-02 | Mitsubishi Electric Corporation | Semiconductor integrated circuit device, facility appliance control device, and appliance state display apparatus |
WO2011029155A1 (en) * | 2009-09-11 | 2011-03-17 | Botanical Extracts Pty Ltd | A system and method for interfacing buyers and sellers of goods and/or services |
JP5177120B2 (ja) * | 2009-11-10 | 2013-04-03 | 株式会社デンソー | 遠隔操作デバイス用表示制御装置 |
US20110199388A1 (en) * | 2010-02-17 | 2011-08-18 | Samsung Electronics Co., Ltd. | Method and apparatus for configuring graphical effect in a mobile terminal |
US20110252371A1 (en) * | 2010-04-13 | 2011-10-13 | Sony Corporation | System and method for fast boot of computer |
JP5715133B2 (ja) * | 2010-07-23 | 2015-05-07 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | アニメーション描画装置、アニメーション描画プログラム、及びアニメーション描画方法 |
JP5569271B2 (ja) * | 2010-09-07 | 2014-08-13 | ソニー株式会社 | 情報処理装置、情報処理方法およびプログラム |
JP5836062B2 (ja) * | 2010-11-08 | 2015-12-24 | 株式会社東芝 | 医用情報処理装置及び情報検索装置 |
JP2012128662A (ja) * | 2010-12-15 | 2012-07-05 | Samsung Electronics Co Ltd | 表示制御装置、プログラムおよび表示制御方法 |
US8549399B2 (en) * | 2011-01-18 | 2013-10-01 | Apple Inc. | Identifying a selection of content in a structured document |
KR101228216B1 (ko) * | 2011-04-25 | 2013-01-31 | 엔에이치엔(주) | Css 스프라이트 처리 방법 및 장치 |
US9400584B2 (en) | 2011-09-09 | 2016-07-26 | Microsoft Technology Licensing, Llc | Alias selection in multiple-aliased animations |
US9952755B2 (en) * | 2011-09-13 | 2018-04-24 | Sony Interactive Entertainment Inc. | Information processing device, information processing method, data structure of content file, GUI placement simulator, and GUI placement setting assisting method |
US10115217B2 (en) | 2011-10-28 | 2018-10-30 | Microsoft Technology Licensing, Llc | Layering animation properties in higher level animations |
JP5903276B2 (ja) * | 2012-01-04 | 2016-04-13 | 富士通株式会社 | 表示制御プログラム及び該装置 |
JP5967942B2 (ja) * | 2012-01-17 | 2016-08-10 | 東芝アルパイン・オートモティブテクノロジー株式会社 | 光ディスク表示装置 |
JP5367191B2 (ja) * | 2012-04-17 | 2013-12-11 | シャープ株式会社 | メニュー表示装置、メニュー表示方法、メニュー表示プログラム、メニュー表示装置を備えたテレビジョン受像機、及び、記録媒体 |
JP5778231B2 (ja) * | 2012-04-17 | 2015-09-16 | シャープ株式会社 | メニュー表示装置、メニュー表示方法、メニュー表示プログラム、メニュー表示装置を備えたテレビジョン受像機、及び、記録媒体 |
US8972864B2 (en) * | 2013-02-13 | 2015-03-03 | Microsoft Technology Licensing, Llc | Website list navigation |
US10120540B2 (en) * | 2013-03-14 | 2018-11-06 | Samsung Electronics Co., Ltd. | Visual feedback for user interface navigation on television system |
JP6020383B2 (ja) * | 2013-08-09 | 2016-11-02 | 株式会社島津製作所 | 表示・実行操作補助プログラム |
JP2016062267A (ja) * | 2014-09-17 | 2016-04-25 | リコーイメージング株式会社 | 表示処理装置およびその方法 |
JP6343544B2 (ja) * | 2014-10-17 | 2018-06-13 | 矢崎総業株式会社 | 車両用操作表示装置 |
CN104598112B (zh) | 2015-01-23 | 2019-01-18 | 小米科技有限责任公司 | 按钮交互方法和装置 |
JP6558380B2 (ja) * | 2017-01-23 | 2019-08-14 | トヨタ自動車株式会社 | 車両用入力装置、入力装置、及び、車両用入力装置の制御方法 |
KR102392716B1 (ko) * | 2019-10-23 | 2022-04-29 | 구글 엘엘씨 | 뷰포인트 위치에 기초하는 콘텐츠 애니메이션 커스터마이제이션 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0916370A (ja) * | 1995-06-29 | 1997-01-17 | Victor Co Of Japan Ltd | 表示オブジェクト選択方式 |
JPH10124246A (ja) * | 1996-10-25 | 1998-05-15 | Sony Corp | 表示制御装置 |
JP2002149144A (ja) * | 2000-11-14 | 2002-05-24 | Yamaha Corp | ビデオプロジェクタおよび処理装置 |
Family Cites Families (78)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4698625A (en) * | 1985-05-30 | 1987-10-06 | International Business Machines Corp. | Graphic highlight adjacent a pointing cursor |
US4847605A (en) * | 1987-04-27 | 1989-07-11 | International Business Machines Corporation | Picking in a graphics system |
US5214414A (en) * | 1991-04-12 | 1993-05-25 | International Business Machines Corp. | Cursor for lcd displays |
US6046722A (en) * | 1991-12-05 | 2000-04-04 | International Business Machines Corporation | Method and system for enabling blind or visually impaired computer users to graphically select displayed elements |
US5655093A (en) * | 1992-03-06 | 1997-08-05 | Borland International, Inc. | Intelligent screen cursor |
US5757358A (en) * | 1992-03-31 | 1998-05-26 | The United States Of America As Represented By The Secretary Of The Navy | Method and apparatus for enhancing computer-user selection of computer-displayed objects through dynamic selection area and constant visual feedback |
WO1993022758A1 (en) * | 1992-05-07 | 1993-11-11 | Kensington Microware Limited | Method and apparatus for cursor positioning |
US5448693A (en) * | 1992-12-29 | 1995-09-05 | International Business Machines Corporation | Method and system for visually displaying information on user interaction with an object within a data processing system |
US5488685A (en) * | 1993-01-27 | 1996-01-30 | Apple Computer, Inc. | Method and apparatus for providing visual cues in a graphic user interface |
US5754178A (en) * | 1993-03-03 | 1998-05-19 | Apple Computer, Inc. | Method and apparatus for improved feedback during manipulation of data on a computer controlled display system |
US6212577B1 (en) * | 1993-03-03 | 2001-04-03 | Apple Computer, Inc. | Method and apparatus for improved interaction with an application program according to data types and actions performed by the application program |
US5808604A (en) * | 1994-03-10 | 1998-09-15 | Microsoft Corporation | Apparatus and method for automatically positioning a cursor on a control |
US5564004A (en) * | 1994-04-13 | 1996-10-08 | International Business Machines Corporation | Method and system for facilitating the selection of icons |
US5544299A (en) * | 1994-05-02 | 1996-08-06 | Wenstrand; John S. | Method for focus group control in a graphical user interface |
US5880729A (en) * | 1994-05-16 | 1999-03-09 | Apple Computer, Inc. | Graphical user interfaces having animated control elements |
AU2591995A (en) * | 1994-05-16 | 1995-12-05 | Apple Computer, Inc. | A system and method for customizing appearance and behavior of graphical user interfaces |
US5611040A (en) * | 1995-04-05 | 1997-03-11 | Microsoft Corporation | Method and system for activating double click applications with a single click |
US5673401A (en) * | 1995-07-31 | 1997-09-30 | Microsoft Corporation | Systems and methods for a customizable sprite-based graphical user interface |
US5687331A (en) * | 1995-08-03 | 1997-11-11 | Microsoft Corporation | Method and system for displaying an animated focus item |
US5990862A (en) * | 1995-09-18 | 1999-11-23 | Lewis; Stephen H | Method for efficient input device selection of onscreen objects |
US5767835A (en) * | 1995-09-20 | 1998-06-16 | Microsoft Corporation | Method and system for displaying buttons that transition from an active state to an inactive state |
US5784056A (en) * | 1995-12-29 | 1998-07-21 | Sun Microsystems, Inc. | System and method for temporally varying pointer icons |
US5880733A (en) * | 1996-04-30 | 1999-03-09 | Microsoft Corporation | Display system and method for displaying windows of an operating system to provide a three-dimensional workspace for a computer system |
US5867175A (en) * | 1996-05-24 | 1999-02-02 | Microsoft Corporation | Method and apparatus for scriping animation |
US6034689A (en) * | 1996-06-03 | 2000-03-07 | Webtv Networks, Inc. | Web browser allowing navigation between hypertext objects using remote control |
US5796404A (en) * | 1996-07-01 | 1998-08-18 | Sun Microsystems, Inc. | Computer system having alphanumeric keyboard access to objects in graphical user interface |
US6867790B1 (en) * | 1996-08-09 | 2005-03-15 | International Business Machines Corporation | Method and apparatus to conditionally constrain pointer movement on a computer display using visual cues, controlled pointer speed and barriers on the display which stop or restrict pointer movement |
US6337702B1 (en) * | 1996-10-23 | 2002-01-08 | International Business Machines Corporation | Method and system for graphically indicating a valid input within a graphical user interface |
US6018345A (en) * | 1997-02-18 | 2000-01-25 | International Business Machines Corporation | Cursor change indication of links in document interface |
US6137487A (en) * | 1997-02-24 | 2000-10-24 | International Business Machines Corporation | Method and apparatus for manipulating graphical objects in a data processing system |
US5898432A (en) * | 1997-03-12 | 1999-04-27 | Mitel Corporation | Animated cursor |
US5963191A (en) * | 1997-03-25 | 1999-10-05 | International Business Machines Corporation | Method and system for denying graphical pointer access to a widget of a data processing system graphical user interface |
US6097390A (en) * | 1997-04-04 | 2000-08-01 | International Business Machines Corporation | Progress-indicating mouse pointer |
US6222537B1 (en) * | 1997-07-29 | 2001-04-24 | International Business Machines Corporation | User interface controls for a computer system |
US6067085A (en) * | 1997-08-08 | 2000-05-23 | International Business Machines Corp. | Method and apparatus for displaying a cursor on a display |
JPH1165811A (ja) * | 1997-08-11 | 1999-03-09 | Internatl Business Mach Corp <Ibm> | マウス・カーソルを表示する情報処理装置、マウス・カーソル、及びマウス・カーソルを表示する情報処理装置の制御方法 |
JPH1173294A (ja) * | 1997-08-25 | 1999-03-16 | Internatl Business Mach Corp <Ibm> | ポインティング装置およびその方法 |
US6072485A (en) * | 1997-08-28 | 2000-06-06 | Microsoft Corporation | Navigating with direction keys in an environment that permits navigating with tab keys |
JP4208273B2 (ja) * | 1997-09-24 | 2009-01-14 | キヤノン株式会社 | 情報処理装置、ユーザインタフェース制御方法および記憶媒体 |
US6249284B1 (en) * | 1998-04-01 | 2001-06-19 | Microsoft Corporation | Directional navigation system in layout managers |
US6285374B1 (en) * | 1998-04-06 | 2001-09-04 | Microsoft Corporation | Blunt input device cursor |
US6100871A (en) * | 1998-04-29 | 2000-08-08 | Multitude, Inc. | Dynamic pointer having time-dependent informational content |
US6892360B1 (en) * | 1998-08-05 | 2005-05-10 | Sun Microsystems, Inc. | Focus traversal mechanism for graphical user interface widgets |
US6362840B1 (en) * | 1998-10-06 | 2002-03-26 | At&T Corp. | Method and system for graphic display of link actions |
US6614457B1 (en) * | 1998-10-27 | 2003-09-02 | Matsushita Electric Industrial Co., Ltd. | Focus control device that moves a focus in a GUI screen |
GB2348520B (en) * | 1999-03-31 | 2003-11-12 | Ibm | Assisting user selection of graphical user interface elements |
WO2000073970A2 (en) * | 1999-05-19 | 2000-12-07 | Nicholas James J | Cursor movable interactive message |
US20020057285A1 (en) * | 2000-08-04 | 2002-05-16 | Nicholas James J. | Non-intrusive interactive notification system and method |
JP3477675B2 (ja) * | 1999-06-04 | 2003-12-10 | インターナショナル・ビジネス・マシーンズ・コーポレーション | ポインタ操作の補助方法 |
US6971071B1 (en) * | 1999-06-10 | 2005-11-29 | Microsoft Corporation | System and method for implementing an image ancillary to a cursor |
US6954196B1 (en) * | 1999-11-22 | 2005-10-11 | International Business Machines Corporation | System and method for reconciling multiple inputs |
NZ519616A (en) * | 1999-12-24 | 2002-10-25 | Siemens Ltd | A portable symbol for establishing a telephone call where data and software is copied with the symbol |
GB2357945A (en) * | 1999-12-30 | 2001-07-04 | Nokia Corp | Navigating a focus around a display device |
US6762767B2 (en) * | 2000-04-06 | 2004-07-13 | Microsoft Corporation | Theme aware management using fusion |
US6981229B1 (en) * | 2000-04-28 | 2005-12-27 | Alias Systems Corp. | System for dynamically mapping input device movement as a user's viewpoint changes |
US6545666B1 (en) * | 2000-05-30 | 2003-04-08 | Agilent Technologies, Inc. | Devices, systems and methods for positioning cursor on display device |
US6717600B2 (en) * | 2000-12-15 | 2004-04-06 | International Business Machines Corporation | Proximity selection of selectable item in a graphical user interface |
GB2370739A (en) * | 2000-12-27 | 2002-07-03 | Nokia Corp | Flashlight cursor for set-top boxes |
JP3881179B2 (ja) * | 2001-02-14 | 2007-02-14 | 三菱電機株式会社 | ユーザインタフェース設計装置 |
US6642947B2 (en) * | 2001-03-15 | 2003-11-04 | Apple Computer, Inc. | Method and apparatus for dynamic cursor configuration |
US6947062B2 (en) * | 2001-07-23 | 2005-09-20 | Koninklijke Philips Electronics N.V. | Seamlessly combined freely moving cursor and jumping highlights navigation |
US20030052919A1 (en) * | 2001-09-06 | 2003-03-20 | Tlaskal Martin Paul | Animated state machine |
US7010761B2 (en) * | 2001-10-18 | 2006-03-07 | Sony Computer Entertainment America Inc. | Controller selectable hyperlinks |
US7370281B2 (en) * | 2002-02-22 | 2008-05-06 | Bea Systems, Inc. | System and method for smart drag-and-drop functionality |
US7181700B2 (en) * | 2002-06-04 | 2007-02-20 | Sun Microsystems, Inc. | Method and system for simulating hypetext markup language control components with graphical control components |
US7197717B2 (en) * | 2002-06-04 | 2007-03-27 | Microsoft Corporation | Seamless tabbed focus control in active content |
US20030231218A1 (en) * | 2002-06-14 | 2003-12-18 | Lou Amadio | System and method for indicating the focused control on a graphical user interface |
US7242387B2 (en) * | 2002-10-18 | 2007-07-10 | Autodesk, Inc. | Pen-mouse system |
US7134089B2 (en) * | 2002-11-13 | 2006-11-07 | Microsoft Corporation | Directional focus navigation |
US7142192B2 (en) * | 2002-12-12 | 2006-11-28 | Nvidia Corporation | Cursor locator for multi-monitor systems |
US7173623B2 (en) * | 2003-05-09 | 2007-02-06 | Microsoft Corporation | System supporting animation of graphical display elements through animation object instances |
US20050015730A1 (en) * | 2003-07-14 | 2005-01-20 | Srimanth Gunturi | Systems, methods and computer program products for identifying tab order sequence of graphically represented elements |
US20050091604A1 (en) * | 2003-10-22 | 2005-04-28 | Scott Davis | Systems and methods that track a user-identified point of focus |
US8230366B2 (en) * | 2003-10-23 | 2012-07-24 | Apple Inc. | Dynamically changing cursor for user interface |
US7480863B2 (en) * | 2003-11-26 | 2009-01-20 | International Business Machines Corporation | Dynamic and intelligent hover assistance |
US7503012B2 (en) * | 2004-01-13 | 2009-03-10 | International Business Machines Corporation | Invoking user designated actions based upon selected computer content |
US20050231512A1 (en) * | 2004-04-16 | 2005-10-20 | Niles Gregory E | Animation of an object using behaviors |
US7958460B2 (en) * | 2007-10-30 | 2011-06-07 | International Business Machines Corporation | Method for predictive drag and drop operation to improve accessibility |
-
2002
- 2002-09-06 JP JP2002261353A patent/JP3755499B2/ja not_active Expired - Fee Related
-
2003
- 2003-08-29 AU AU2003261821A patent/AU2003261821A1/en not_active Abandoned
- 2003-08-29 KR KR1020047006796A patent/KR100975458B1/ko not_active IP Right Cessation
- 2003-08-29 CN CNB038019469A patent/CN1293465C/zh not_active Expired - Fee Related
- 2003-08-29 US US10/494,557 patent/US7870511B2/en not_active Expired - Fee Related
- 2003-08-29 EP EP03794136A patent/EP1536323A4/en not_active Ceased
- 2003-08-29 WO PCT/JP2003/011035 patent/WO2004023293A1/ja active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0916370A (ja) * | 1995-06-29 | 1997-01-17 | Victor Co Of Japan Ltd | 表示オブジェクト選択方式 |
JPH10124246A (ja) * | 1996-10-25 | 1998-05-15 | Sony Corp | 表示制御装置 |
JP2002149144A (ja) * | 2000-11-14 | 2002-05-24 | Yamaha Corp | ビデオプロジェクタおよび処理装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP1536323A4 * |
Also Published As
Publication number | Publication date |
---|---|
KR20050030618A (ko) | 2005-03-30 |
CN1613057A (zh) | 2005-05-04 |
EP1536323A1 (en) | 2005-06-01 |
JP2004102497A (ja) | 2004-04-02 |
US20050091615A1 (en) | 2005-04-28 |
AU2003261821A1 (en) | 2004-03-29 |
US7870511B2 (en) | 2011-01-11 |
CN1293465C (zh) | 2007-01-03 |
JP3755499B2 (ja) | 2006-03-15 |
EP1536323A4 (en) | 2007-11-21 |
KR100975458B1 (ko) | 2010-08-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2004023293A1 (ja) | Guiアプリケーション開発支援装置、gui表示装置、および方法、並びにコンピュータ・プログラム | |
KR100296717B1 (ko) | 펑션 선택 방법 및 장치, 펑션을 선택하기 위한 제어 프로그램을 저장한 기억 매체, 오브젝트 조작 방법 및 장치, 오브젝트를 조작하기 위한 제어 프로그램을 저장한 기억 매체, 복합 아이콘을 저장한 기억 매체 | |
WO2004023295A1 (ja) | Guiアプリケーション開発支援装置および方法、並びにコンピュータ・プログラム | |
US8458608B2 (en) | Focus state themeing | |
KR100975457B1 (ko) | Gui 어플리케이션 개발 지원 장치, gui 어플리케이션 프로그램 생성 방법 및 컴퓨터 판독가능한 기록매체 | |
US20030067497A1 (en) | Method and device for modifying a pre-existing graphical user interface | |
JP2939021B2 (ja) | ウィンドウ管理情報入出力装置 | |
US7739620B1 (en) | Method of setting alternate style assignments to menu elements of an application | |
US20070091095A1 (en) | Computer executable graphic method of generating animation elements | |
JP3835589B2 (ja) | 作画装置および作画プログラムを記録したコンピュータ読み取り可能な記録媒体 | |
JPH10240487A (ja) | ウインドウ画面の表示方法及び記録媒体 | |
WO2004023296A1 (ja) | Gui表示装置、guiアプリケーション開発支援装置、および方法、並びにコンピュータ・プログラム | |
JP3551112B2 (ja) | マルチメディア・シナリオ編集装置及びマルチメディア・シナリオ編集プログラムを記録した記録媒体 | |
JP3732776B2 (ja) | 電子測定装置 | |
US20210149545A1 (en) | Systems for navigating a three-dimensional model with a handheld controller | |
JP2008027228A (ja) | マンマシン装置 | |
Kulseth et al. | User interface issues for evolving open systems | |
JPH11242470A (ja) | Cadシステムにおける形状データの表示方法およびその方法をコンピュータに実行させるためのプログラムを記録したコンピュータ読み取り可能な記録媒体 | |
JPH10177476A (ja) | メニュー作成装置、メニュー作成方法およびメニュー作 成用プログラムを記憶した記憶媒体 | |
JPH06214710A (ja) | タブレットメニューの登録方法 | |
JP2007052678A (ja) | 階層構造表示装置、階層構造表示方法、プログラムおよび記録媒体 | |
JPH05134832A (ja) | メニユー表示装置 | |
JP2007248579A (ja) | 画面編集方法および画面編集装置 | |
JPH1195969A (ja) | ウィンドウシステム制御装置 | |
Freeman | Using the ListView Control |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003794136 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020047006796 Country of ref document: KR |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 20038019469 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10494557 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2003794136 Country of ref document: EP |