WO2006126050A1 - Improved graphical user interface for mobile communications terminal - Google Patents

Improved graphical user interface for mobile communications terminal Download PDF

Info

Publication number
WO2006126050A1
WO2006126050A1 PCT/IB2006/001272 IB2006001272W WO2006126050A1 WO 2006126050 A1 WO2006126050 A1 WO 2006126050A1 IB 2006001272 W IB2006001272 W IB 2006001272W WO 2006126050 A1 WO2006126050 A1 WO 2006126050A1
Authority
WO
WIPO (PCT)
Prior art keywords
display screen
mobile terminal
digital
focused
representation
Prior art date
Application number
PCT/IB2006/001272
Other languages
French (fr)
Inventor
Kongqiao Wang
Rong Tao
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Priority to EP06755881.7A priority Critical patent/EP1886210B1/en
Priority to JP2008512933A priority patent/JP2008542867A/en
Publication of WO2006126050A1 publication Critical patent/WO2006126050A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality

Definitions

  • the present invention relates to mobile telecommunication and more particularly to a mobile terminal with a digital objects browser, and an associated method and computer program product .
  • a mobile (cellular) telephone for a telecommunications system like GSM, UMTS, D-AMPS or CDMA2000 is a common example of a mobile terminal according to the above.
  • the conventional user interface of mobile telephones was limited to a display, a keypad, a speaker and a microphone.
  • the mobile terminals of those times were predominantly used for speech communication (telephone calls) , and therefore a simple, character- based user interface involving a small, monochrome display and a keypad sufficed.
  • mobile terminals have been provided with various features and services in addition to speech communication.
  • Such features and services include, for instance, contacts/- phonebook, calendar, electronic messaging, video games, still image capture, video recording, audio (music) playback, etc.
  • the image browser in current mobile terminals typically presents a compact representation of the available images, e.g. the images stored at a particular current level in the hierarchical file structure or image data- base, in an ordered manner on the display screen.
  • the compact representation may typically be either the file names/image names of the images, or a thumbnail version of each image.
  • a thumbnail version of an image is a small-sized, quality-reduced version of the original image.
  • a thumbnail is not completely legible, but it nevertheless gives the user a sense of the overall nature of the image - e.g. image hue, image style, etc.
  • the ordered manner in which such thumbnails are presented on the display screen typically follows either a linear row or a grid structure.
  • thumbnails are shown in n rows, each row containing m thumbnails, therefore allowing simultaneous presentation of n x m thumbnails on the display screen. If the file names/image names are shown instead of the thumbnails, they are typically presented in a list on the display screen.
  • WO 2004/023283 discloses a graphical user interface system for a device such as an interactive television set-up box, a hand-held computer or a mobile terminal.
  • a scrollable menu of selectable menu options are shown on the display screen in the form of a series of panels, or icons, along an essentially semi-circular path. Each panel or icon represents a respective selectable menu option. The user can scroll between different panels by pressing left and right arrow keys.
  • a cursor which focuses on a currently "highlighted" panel is shifted accordingly.
  • the entire series of panels are shifted in the opposite direction, so that the focused panel is repositioned at a centered location at the bottom of the semi-circular path.
  • a focused panel is selected, or, more precisely, the menu option represented by that panel is selected, by pressing a dedicated selection key such as Enter.
  • the menu is hierarchical, i.e. each panel on the uppermost (root) level represents a folder which in itself may contain subfolders and/or selectable panels on a lower level. The user moves between different levels in this hierarchical menu by way of up and down arrow keys.
  • All panels are shown for the current level in the menu system, and furthermore the parent panel (but only that) of a currently focused panel is shown.
  • An advantage of providing the digital objects, i.e. the selectable panels, along a curved path rather than in a one or two dimensional linear structure is that it allows a larger number of objects to fit withing the available area on the display screen. Moreover, it is believed to be a representation which is intuitive and user-friendly.
  • WO 2004/023283 has a number of shortcomings .
  • the solution proposed in WO 2004/023283 is not particularly suitable for a digital object browser, since apart from the limited-sized panels themselves, it does not provide any clear information about the particulars of each available digital object.
  • the solution proposed in WO 2004/023283 lacks an expedient way of presenting, for convenient selection by the user, operations that are available for each digital object when it is focused.
  • a first aspect of the invention is a mobile terminal having a controller, a display and an input device connected to said controller, and a digital object browser for browsing among a plurality of available digital objects, a first representation and a second representation of each of said plurality of digital objects being presentable on a display screen of said display, said controller being adapted to cause said digital object browser to present said first representations of said plurality of digital objects along a predefined path on said display screen, the first representation of a focused one of said digital objects being shown in a focus area on said display screen; present, for said focused one of said digital objects, the second representation thereof in a preview area on said display screen; and in response to a user input given on said input device, perform a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said
  • the digital objects are images
  • the first representations are thumbnail versions of said images
  • the second representation is a reduced version of the image whose thumbnail version is shown in said focus area.
  • the reduced version may be larger, in at least one of image size, resolution or color depth, than the corresponding thumbnail version.
  • the first representation of the focused digital object may be shown in a front view, whereas the first representations of digital objects other than the focused one may be shown as perspective views.
  • the digital objects are images, only the focused thumbnail is shown in front view, whereas all other thumbnails are shown in perspective views, which occupy less space on the display screen than a front view.
  • use of the available display area may be optimized by showing the first representations of digital objects other than the focused one as front views, as with the focused digital object, however at smaller image size(s) than that of the focused digital object.
  • Use of the available display area on the display screen may be further optimized by letting the predefined path follow a non-linear (i.e., curved) geometrical curve, such as a circle or ellipse, or a segment thereof.
  • the digital objects are preferably arranged in a sequential order along the predefined path. Still more digital objects may be fitted onto the display screen at one and the same time by arranging the digital objects along two, three or even more predefined paths on the display screen. Such paths may or may not be inter- connected to each other depending on implementation. If two paths are interconnected, an object which is scrolled beyond an end point of a first path may be scrolled onto a second path at a start point thereof, and vice versa.
  • the first representation of a hitherto not presented digital object may appear at an opposite start point (or end point) of the predefined path, in a scrolling manner which is familiar per se.
  • the focus area on said display screen is fixed, i.e. it has a static position on said display screen. This is beneficial, since a more static display screen is less tiring and more intuitive to a user .
  • the predefined path may advantageously be symmetrical around at least one symmetry axis, wherein said static position of said focus area on said display screen is located at an intersection of said path and said symmetry axis .
  • the input device may comprise a multi-way input device such as a 4/5-way navigation key or a joystick.
  • Said controller may be adapted, upon receiving a first type of user input, such as a first-way actuation of the multi-way input device, to cause scrolling of said first representations in a first direction along said path, and said controller may be adapted, upon receiving a second type of user input, such as a second-way actuation of the multi-way input device, to cause scrolling of said first representations in a second direction along said path, said second direction being opposite to said first direction.
  • the controller may be adapted to cause presentation on said display screen of a menu having a plurality of menu options representing different available operations on said focused one of said digital objects.
  • "operations on said focused one of said digital objects” may include any type of operation on digital objects which is normally available for controlling, processing, modifying, communicating or interacting with the digital objects in question.
  • this arrangement provides an expedient way of presenting, for convenient selection by the user, the operations which are available for each image when it is focused.
  • Such operations on images may include, but is not limited to, open, delete, edit, send, rename, show details, etc.
  • the menu options of said menu are preferably selectable by said multi-way input device.
  • the controller is adapted to cause said digital object browser to present information associated with said focused one of said digital objects in a description area on said display screen.
  • this arrangement gives the user additional information about the particulars of each available digital object (apart from the visual appearance information provided by the thumbnail and preview of the image, when the digital objects are images) .
  • the presented information associated with said focused one of said digital objects may advantageously include information about said focused object's location in the storage structure - e.g. hierarchical index number, file name including file system path, etc.
  • the presented information may exclude such hierarchical storage information and simply consist in a name or index number representing the focused object.
  • the mobile terminal may be a mobile phone adapted for use in a mobile telecommunications network in compli- ance with a mobile telecommunications standard such as GSM, UMTS, D-AMPS or CDMA2000.
  • the mobile terminal may also or alternatively be a device selected from the group consisting of a digital notepad, a personal digital assistant and a hand-held computer .
  • At least some of the plurality of available digital objects may be stored in local memory in the mobile terminal. Additionally or alternatively, for a mobile terminal comprising a wireless communication interface to at least either a mobile telecommunications network or an external device, at least some of said plurality of available digital objects may be stored in said mobile telecommunications network or said external device and may be accessible to said controller and said digital object browser through said wireless communication interface. Thus, the user of the mobile terminal may use its digital object browser to browse among locally stored objects and/or remotely stored objects, depending on implementation.
  • a second aspect of the invention is a digital object browsing method for a mobile terminal having a display with a display screen, a first representation and a second representation of each of a plurality of available digital objects being presentable on said display screen, the method involving the steps of: presenting said first representations of said plurality of digital objects along a predefined path on said display screen, the first representation of a focused one of said digital objects being shown in a focus area on said display screen; presenting, for said focused one of said digital objects, the second representation thereof in a preview area on said display screen; and in response to a user input, performing a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said focused one of said digital objects to another digital object by presenting in said focus area the first representation of said another digital object, as well as updating said preview area correspondingly by presenting therein the second representation of said another digital object.
  • a third aspect of the invention is a computer program product directly loadable into a memory of a processor, the computer program product comprising program code for performing the method according to the second aspect.
  • the second and third aspects may essentially have the same or corresponding features and advantages as the first aspect.
  • the controller may be a CPU ("Central Processing Unit"), DSP ("Digital Signal Processor") or any other electronic programmable logic device or combination of devices .
  • the display may be any commercially available type of display screen suitable for use in mobile terminals, including but not limited to a color TFT LCD display.
  • Fig 1 is a schematic illustration of a telecommunication system, including a mobile terminal, a mobile telecommunications network and a couple of other devices, as an example of an environment in which the present invention may be applied.
  • Fig 2 is a schematic front view illustrating a mobile terminal according to a first embodiment, and in particular some external components that are part of a user interface towards a user of the mobile terminal.
  • Fig 3 is a schematic front view illustrating a mobile terminal according to a second embodiment.
  • Fig 4 is a schematic block diagram representing the internal component and software structure of a mobile terminal, which may be e.g. any of the embodiments shown in Figs 2 and 3.
  • Figs 5a-5e are schematic display screen illustrations of the digital object browser according to one embodiment of the present invention.
  • Figs 5f-5g are schematic display screen illustra- tions of a digital object browser according to an alternative embodiment of the present invention.
  • Fig 1 illustrates one example of a telecommuni- cations system in which the invention may be applied.
  • various telecommunications services such as voice calls, data calls, facsimile transmissions, music transmissions, still image transmissions, video transmissions, electronic message transmissions and electronic commerce may be performed between a mobile terminal 100 according to the present invention and other devices, such as another mobile terminal 106, a PDA 112, a WWW server 122 and a stationary telephone 132.
  • a mobile terminal 100 may or may not be available; the invention is not limited to any particular set of services in this respect.
  • the mobile terminal 100 is provided with a digital object browser, which may be used by a user of the mobile terminal 100 to browse among local digital objects 126, which are stored locally in or at the mobile terminal 100, and/or among remote digital objects 126', which are stored at a remote location, e.g. in a remote database 124 coupled to the WWW server 122.
  • the mobile terminals 100, 106 are connected to a mobile telecommunications network 110 through RF links 102, 108 via base stations 104, 109.
  • the mobile telecommunications network 110 may be in compliance with any commercially available mobile telecommunications standard, such as GSM, UMTS, D-AMPS or CDMA2000.
  • the mobile telecommunications network 110 is opera- tively connected to a wide area network 120, which may be Internet or a part thereof.
  • a wide area network 120 which may be Internet or a part thereof.
  • client computers and server computers including WWW server 122, may be con- nected to the wide area network 120.
  • a public switched telephone network (PSTN) 130 is connected to the mobile telecommunications network 110 in a familiar manner.
  • Various telephone terminals including stationary telephone 132, are connected to the PSTN 130.
  • a first embodiment 200 of the mobile terminal 100 is illustrated in more detail in Fig 2.
  • the mobile terminal 200 comprises an apparatus housing 201, a loudspeaker 202, a display 203, a set of keys 204 which may include a keypad of common ITU-T type (alpha-numerical keypad), and a microphone 205.
  • the mobile terminal 200 comprises various internal components, the more important of which are illustrated in Fig 4 and will be described later.
  • External components 202-205 are all part of the user interface of the mobile terminal.
  • the user interface involves a multi- way input device 210 in the form of a joystick, the handle of which may be actuated by the user in a plurality of directions 212/214 so as to command navigating operations, i.e. to navigate in corresponding directions among information 206 shown on display 203, in a manner which is conventional per se for joystick-equipped mobile terminals.
  • the navigation directions may be 4 in number, as indicated by solid arrows 212 in Fig 2, and may be distributed orthogonally in an "up, down, left, right” or “north, south, west, east” fashion with respect to a base plane which is essentially coincidental or parallel with the display 203 or the front surface of apparatus housing 201.
  • the navigation directions may be 8 in number, as indicated by dashed lines 214 together with solid arrows 212 in Fig 2a, and may be distributed around a virtual circle in aforesaid base plane with successive 45° displacements, representing corresponding actuations of the joystick handle by the user.
  • the user may also perform a selecting operation among information 206 by actuating the joystick 210 in a direction perpendicular to the base plane, e.g. by depressing the joystick at its top. Depending on implementation, this will either cause displacement of the entire joystick handle, or will cause depression of a joystick select button. In some embodiments such a joystick select button may be located at the top of the joystick handle; in others it may be mounted next to the joystick handle on the base plane.
  • the multi-way input device is implemented as a 5- way navigation key 310 which is can be actuated (depressed) at different circumferential positions 312, that represent different navigation directions, so as to generate navigating operations in similarity with the description above for the embodiment of Fig 2.
  • a selecting operation may be commanded by depressing the 5-way key 310 at is center 314.
  • the other components 301- 305 are preferably identical with or equivalent to components 201-205 of Fig 2.
  • the digital object browser is an image browser 450 for digital images 426.
  • the image browser 450 is implemented as a software application.
  • the upper part of Fig 4 illustrates a typical display layout for the image browser 450 when used for browsing images on the display screen 500 of the mobile terminal's display 436.
  • the image browser 450, its display screen layout and the particulars of its functionality will be described in more detail later.
  • the mobile terminal has a controller 400 which is responsible for the overall operation of the mobile terminal and is preferably implemented by any commercially available CPU ("Central Processing Unit"), DSP ("Digital Signal Processor") or any other electronic programmable logic device.
  • the controller 400 has associated electronic memory 402 such as RAM memory, ROM memory, EEPROM memory, flash memory, hard disk, or any combination thereof.
  • the memory 402 is used for various purposes by the controller 400, one of them being for storing data and program instructions for various software in the mobile terminal.
  • the data may include a plurality of images 426, which are accessible for browsing in the image browser 450, as will be described below.
  • the software includes a real-time operating system 420, man-machine interface (MMI) drivers 434, an application handler 432 as well as various applications.
  • MMI man-machine interface
  • the applications include aforesaid image browser 450 as well as various other applications 460-470, such as a contacts (phonebook) application, a messaging application, a calendar application, a control panel application, a camera application, a mediaplayer, one or more video games, a notepad application, etc.
  • a contacts (phonebook) application such as a contacts (phonebook) application, a messaging application, a calendar application, a control panel application, a camera application, a mediaplayer, one or more video games, a notepad application, etc.
  • the MMI drivers 434 cooperate with the display 436 (which may be identical to the display 203 of Fig 2 or the display 303 of Fig 3) , a joystick 438 (which may be identical to the joystick 210 of Fig 2) as well as various other I/O devices such as a microphone, a speaker, a vibrator, a keypad (e.g. the set of keys 204 of Fig 2), a ringtone generator, an LED indicator, volume controls, etc.
  • a user may operate the mobile terminal through the man-machine interface thus formed, which in the disclosed embodiment is of the very common kind known as GUI (graphical user interface) .
  • GUI graphical user interface
  • the software also includes various modules, protocol stacks, drivers, etc., which are commonly designated as 430 and which provide communication services (such as transport, network and connectivity) for an RF interface 406, and optionally a Bluetooth interface 408 and/or an IrDA interface 410.
  • the RF interface 406 comprises an internal or external antenna as well as appropriate radio circuitry for establishing and maintaining a wireless link to a base station (e.g. the link 102 and base station 104 in Fig 1) .
  • the radio circuitry comprises a series of analog and digital electronic components, together forming a radio receiver and transmitter. These components include, i.a., band pass filters, amplifiers, mixers, local oscillators, low pass filters, AD/DA converters, etc.
  • the mobile terminal may be provided with other wireless interfaces than the ones mentioned above, including but not limited to WLAN and HomeRF. Any one of such other wireless interfaces, or aforementioned optional interfaces 408 and 410, may be used for estab- lishing and communicating over the wireless link 114 to the nearby device 112 of Fig 1.
  • the mobile terminal also has a SIM card 404 and an associated reader.
  • the SIM card 404 comprises a processor as well as local work and data memory.
  • a user of the mobile terminal may use the image browser to browse among a plurality of available digital images, either stored locally in memory 402 or externally at a remote location (cf remote digital objects 126' of Fig 1) .
  • remote digital objects 126' of Fig 1 For reasons of clarity and simplicity, the rest of this description will refer only to the locally stored images, referred to as 126 in Fig 1 and 426 in Fig 4, in a non-limiting way.
  • the images 426 may have several different origins; they may for instance have been captured as still photographs in a camera application, or have been created in an image editor or paint tool application, or have been downloaded into memory 402 from a remote location over any available communication interface in the mobile terminal (RF interface 406, etc) . Combinations of these origins are of course possible, so that some of the available images 426 are locally captured photographs, whereas others are created in an image editor, etc.
  • the images are conveniently stored as files in a hierarchical file system, which is managed by the real-time operating system 420 and which may include also other types of objects.
  • the images 426 may be stored in a database managed by the image browser 450. Still one alternative would be to store the images 426 as a simple non-hierarchical sequence of objects in memory 402.
  • image size, color depth, etc, of the images 402 may generally be selected from any existing image standard, compressed or non- compressed, including but not limited to JPEG, GIF, TIFF or plain bit map.
  • the user may enter the image browser in any available way, for instance by selecting a menu option, etc, in the user interface formed by operating system 420 and MMI drivers 434.
  • the image browser will allow the user to select the desired current folder in any of several different ways which are well known per se. For instance, the user may press a dedicated key (such as a menu key or option key) on the keypad 204, 304 to invoke a list of available operations, including one option for selecting the current folder. For the rest of this description it is assumed that the user has selected the desired current folder in any available way.
  • the display screen 500 of the display 436 is used by the image browser 450 in the following way.
  • a plurality of available images is selected among the images 426 in memory 402.
  • a first representation in the form of a thumbnail image 512 is presented along a curved path 510.
  • the path 510 - which is visibly illustrated in dashed style in Fig 4 but which preferably is invisible in an actual implementation - essentially has the shape of a semi-ellipse.
  • any such shape is symmetrical around a symmetry axis 514 which may be coincident with a vertical center axis of the display screen 500.
  • thumbnails 512 are arranged along a curved path rather than a (recti-) linear, more thumbnails may be shown simultaneously on the display screen 500 than if the path would have been straight.
  • Use of the available display area on the display screen 500 is optimized further in the disclosed embodiment by showing all thumbnails 512 in perspective views rather than ordinary front views, except for a currently focused image 522 which is shown in front view at a focus area 520.
  • the focus area 520 is fixed, i.e. has a static position on the display screen, at an intersection of the thumbnail path 510 and its symmetry axis 514.
  • the thumbnails 512 may have been produced on beforehand and stored in memory 402, in association with the respective full-scale images 426. Even the perspective effect of the thumbnails may be pre-processed in this manner. Thus, in such implementations, the image browser 450 only has to read the pre- processed thumbnails 512 from memory 402 and arrange them along the curved path 510 for presentation.
  • the thumb- nails, and their perspective effects are not pre-stored, one reason being to save valuable storage space in memory 402.
  • a second reason is that the perspective is different between individual thumbnails, as appears from Fig 4. As seen in Fig 4, the perspective effect is strongest for thumbnails remote from the centered focused image 522, and grows less and less strong the closer the particular thumbnail gets to the focused image. Therefore, producing also the perspective effect on beforehand makes little sense in this case, since the perspective effects will anyway have to be recalculated each time the sequence of thumbnails 512 is scrolled in either direction.
  • each image 426 that is to be represented on the display screen 500 is read from memory 402 by the image browser 450.
  • the thus read image is processed by appropriate image processing algorithms included in or available to the application software that defines the image browser 450, so as to produce a corresponding, small-sized, low-quality thumbnail in perspective view, which is then immediately presented along the curved path 510. Whether or not thumb- nails are to be pre-produced or produced "on the fly” is a trade-off which will have to be considered for each implementation .
  • a preview 532 is shown for the full-scale image 426 which is currently focused and the thumbnail
  • the preview 532 is a reduced version of this focused full-scale image 426.
  • the reduced version is larger in image size, and preferably also resolution and/or color depth, than the corresponding thumbnail version 522, thus giving the user a legible preview 532 of the focused image 522 in the preview area 530.
  • the previews of all available images 426 may be produced on beforehand and stored in memory 402, or may be processed on the fly by the image browser 450 when the particular image becomes focused and its thumbnail 522 appears in the focus area 520.
  • the focus area 520 functions like a static- positioned cursor that indicates which one of the thumbnails 512 that is currently focused and previewed in the preview area 530.
  • a description 542 of the focused image 522 is provided for the benefit of the user in a description area 540 on the display screen 500.
  • the description area 540 is advantageously located in the lowermost region of the display screen 500, in vertical alignment with the focus area 520 and preview area 530 around the symmetry axis 514.
  • the description 542 serves to provide a different kind of information about the focused object than the strictly visual (i.e., image-like) information provided by the focused image's thumbnail 522 and preview 532.
  • the description 542 is advantageously an index number and/or a filename of the focused image, with or without information that relates to the focused image's location in the hierarchical or otherwise ordered storage structure in memory 402, e.g. a file system path.
  • an index number may simply be "13", indicating that the focused image 522 is number 13 among the available images in the currently selected folder in a local file system in memory 402, whereas a file name with file system path may look like "MyPhone : ⁇ Images ⁇ Summer_2004 ⁇ P00113. jpg" .
  • Figs 5a and 5b illustrate how the contents of the display screen 500 change when the user commands scrolling of the thumbnails 512 by one (1) step to the right.
  • arrows 550 L and 550 R indicate the possible scrolling directions, i.e. to the left and to the right, for the user.
  • Fig 5a the currently focused image is denoted A, and its nearest neighbors along the thumbnail path 510 are denoted B and D (to the left of the focused image 522), and C and E (to the right of the focused image 522) .
  • the preview of A is shown at 532, and the description thereof is shown at 542.
  • the user may command scrolling. For instance, such user input may be given by actuating the joystick 210 (Fig 2) or 5-way key 310 (Fig 3) in its left or right navigation direction.
  • thumbnails 512 are moved one position to the right (anti-clockwise rotation) along the thumbnail path 510.
  • the formerly focused thumbnail A is shifted out of focus into the position that was formerly held by thumbnail C.
  • thumbnail C moves one step to the position formerly held by thumbnail E, etc. , i.e. all thumb- nails at this side are shifted one step away from the focus area.
  • all thumbnails are shifted one step closer to the focus area, and thumbnail A's nearest left-hand neighbor B is shifted into the focus area 520 and becomes the focused image 522.
  • the preview of A is replaced by the preview of B at 532, and the description of A is replaced by the description of B at 542.
  • the farthest thumbnail on the right side of the focus area 520 disappears as the thumbnails are scrolled into the state shown in Fig 5b, whereas a new thumbnail for a formerly not represented image 426 will be provided and shown at the farthest position along the thumbnail path 510 on the left side of the focus area 520 in Fig 5b.
  • Figs 5c and 5d illustrate another advantageous feature of the disclosed embodiment, namely providing convenient access for the user to a pop-up menu of opera- tions that are available for the focused image 522.
  • a pop-up menu bar 524 is displayed to the very right of the focused image 522.
  • the pop-up menu bar 524 may be shown automatically as soon as the focused image 522 appears in the fo'cus area 520, or alternatively a user action is required (such as a select action on the joystick 210 of Fig 2, or by depressing the 5-way navi- gation key 310 of Fig 3 at its center 314) to cause presentation of the pop-up menu bar 524 on the display screen 500.
  • the first alternative has an advantage in that it does not steal attention from the focused image 522, and nor does it partly hide the nearest right-hand neighbor thumbnail (C in Fig 5c) , before the user actively chooses to bring about the pop-up menu bar 524.
  • the second alternative has an advantage in that it is more intuitive and convenient, at least to an inexperienced user, since it shows the pop-up menu bar 524 automatically, thereby clearly indicating the availability of various operations on the focused image 522.
  • a small left-arrow 523 in the pop-up menu bar 524 indicates that the user has to perform a navigate-left action on the input device 428 (tilting the joystick handle to the left or depressing the 5-way key to the left at its rim portion, etc) .
  • a list of available menu items or options 528 will be shown in a pop-up menu 526 immediately to the right of the pop-up menu bar 524, as seen in Fig 5d.
  • the pop-up menu 526 is brought forward, its top menu item 528a is highlighted. The user may scroll in the pop-up menu 526 by way of the input device 438, e.g.
  • menu items currently not displayed in the pop-up menu 526, may be indicated by a downward- pointing arrow 529 and made available by performing a navigate-down action on the input device 438 when the lowermost menu item is highlighted, thereby causing down- wards scrolling of the list of menu items 528.
  • a selecting action for instance any of the ones described in the preceding paragraph
  • the user may select the highlighted menu item, wherein the associated operation will be performed by the image browser 450 in cooperation with the application handler 432 and operating system 420.
  • the image browser 450 will present a enlarged version of the focused image 522 on essentially the entire display screen 500, or a majority thereof.
  • This larger version of the focused image is considerably larger in image size, and optionally resolution and/or color depth, than the preview 532.
  • the image browser 450 will place a function call to an image editor application (included among applications 460-470 in Fig 4), wherein the application handler will invoke this image editor and instruct it to activate itself with the particular image among images 426 that is represented by the focused thumbnail 522 in Fig 5d.
  • Selecting the menu item Send may correspondingly invoke a messaging application and prepare for trans- mittal of the image in question as an attachment in an electronic message such as email or MMS.
  • the menu item Details will provide further informa- tion on the focused image, e.g. detailed file name including file system path, size, image type, creation or edit date and time, etc.
  • menu items 528 illustrated in Fig 5d are only exemplifying.
  • the pop-up menu 526 may be hierarchical, i.e. so that any one of the first-level menu items 528 may lead to a second-level pop-up menu of menu items when the user performs a navigate-right action on the input device 438.
  • Fig 5e serves to give a less schematic illustration of how the display screen 500 may look like in an actual implementation .
  • Figs 5f and 5g illustrate another embodiment of the invention and, in more particular, how the contents of the display screen 500 change when the user commands scrolling of the thumbnails 512 by one (1) step to the right.
  • This embodiment is similar to the one described above for Figs 4 and 5a-5e, expect for the following difference.
  • a description of the focused image A is given (corresponding to the description which for the previous embodiment was shown in the description area 542, e.g. an index, filename, etc, of the currently focused image) .
  • This alternative embodiment has an advantage in that display space is saved, thanks to the elimination of a separate description area for presentation of a description of the currently focused image.
  • the image browsing method as described for the embodiments disclosed above may advantageously be implemented as a computer program product which may be installed by a manufacturer, distributor, end-user, etc, in a mobile terminal's memory (e.g. memory 402 of Fig 4) .
  • Such computer program will include program code that when executed by a processor in the mobile terminal (e.g. controller 400 of Fig 4) will perform the image browser functionality described above.
  • the digital object browser may alternatively be a browser for other types of digital objects, including but not limited to video sequences, text documents, spreadsheet documents, html (hypertext markup language) documents, wml (wireless markup language) documents or even audio sequences.
  • the particulars of the second representation shown in the preview area will of course depend on the actual type of the document and may require processing which is special for the type in question. For instance, if the object is a html document, the processing required to provide a preview may involve interpreting the html code and present- ing a compact, low-resolution version of the document specified by the html code in the preview area.
  • objects that are non-visual in nature e.g.
  • the first representation as well as the second representation will contain visual information that as clearly as possible conveys to the user a sense of the non-visual contents of the objects.
  • this may for instance include presenting a song title, artist name, album name and/or duration, or parts of the lyrics, or even a subset of musical notes that defines a well-recognized part of the audio sequence (e.g. the chorus of a song) .

Abstract

A mobile terminal has a controller (400) , a display (436) and an input device (438) connected to the controller, and a digital object browser (450) for browsing among a plurality of available digital objects (426) . A first representation (512) and a second representation (532) of each of the digital objects are presentable on a display screen (500) . The first representations of the digital objects are presented along a predefined path (510) on the display screen, the first representation (522) of a focused one of the digital objects being shown in a focus area (520) on the display screen. For the focused digital object, the second representation (532) thereof is presented in a preview area (530) on the display screen. In response to a user input given on the input device, a desired scrolling operation is performed among the first representations presented, thereby shifting the positions of the first representations on the display screen along the path accordingly, updating the focus area to reflect a change in focus from the focused digital object to another digital object by presenting in the focus area the first representation of the other digital object, as well as updating the preview area correspondingly by presenting therein the second representation of the other digital object.

Description

IMPROVED GRAPHICAL USER INTERFACE FOR MOBILE COMMUNICATIONS TERMINAL
Field of the Invention
The present invention relates to mobile telecommunication and more particularly to a mobile terminal with a digital objects browser, and an associated method and computer program product .
Background of the Invention
A mobile (cellular) telephone for a telecommunications system like GSM, UMTS, D-AMPS or CDMA2000 is a common example of a mobile terminal according to the above. For many years, the conventional user interface of mobile telephones was limited to a display, a keypad, a speaker and a microphone. The mobile terminals of those times were predominantly used for speech communication (telephone calls) , and therefore a simple, character- based user interface involving a small, monochrome display and a keypad sufficed. In recent times, mobile terminals have been provided with various features and services in addition to speech communication. Such features and services include, for instance, contacts/- phonebook, calendar, electronic messaging, video games, still image capture, video recording, audio (music) playback, etc. This expansion or broadening of the usability of mobile terminals has led to more sophisti- cated graphical user interfaces, typically involving a larger, high-resolution color display and a multi-way input device such as a joystick or a 4/5-way navigation key.
As the mobile terminals become more and more advanced, it is generally desired to present more and more information on the display. However, this is in conflict with strong market demands for miniaturized mobile terminals; a small overall apparatus size of the mobile terminals also restricts the size of the display. Therefore, available display area on the display screen of the display has been a limited resource and is expected to remain so also in the future. Whenever several objects are to be presented simultaneously on the display screen, it is believed to be an advantage if such presentation can be made in a compact manner (allowing presentation of many objects at the same time) with as good as possible legibility of the individual objects.
This is particularly relevant when the digital objects are digital images. It is observed that many if not all new mobile terminals currently sold are equipped with an image browser and a digital camera. The user of such a mobile terminal typically stores and manages his captured images in a hierarchical file structure stored internally in the memory of the mobile terminal, or even in a more advanced image database. Some models of mobile terminals moreover allow the user to access, and even download, images provided at a remote server, etc, over the mobile telecommunications network or another data network associated therewith, such as the Internet. It is foreseen that such image browsing capability will continue to be an important factor for market success for mobile terminals in the future.
The image browser in current mobile terminals typically presents a compact representation of the available images, e.g. the images stored at a particular current level in the hierarchical file structure or image data- base, in an ordered manner on the display screen. The compact representation may typically be either the file names/image names of the images, or a thumbnail version of each image. As is well known in this technical field, a thumbnail version of an image is a small-sized, quality-reduced version of the original image. Often, a thumbnail is not completely legible, but it nevertheless gives the user a sense of the overall nature of the image - e.g. image hue, image style, etc. The ordered manner in which such thumbnails are presented on the display screen typically follows either a linear row or a grid structure. In the latter case, the thumbnails are shown in n rows, each row containing m thumbnails, therefore allowing simultaneous presentation of n x m thumbnails on the display screen. If the file names/image names are shown instead of the thumbnails, they are typically presented in a list on the display screen. WO 2004/023283 discloses a graphical user interface system for a device such as an interactive television set-up box, a hand-held computer or a mobile terminal. A scrollable menu of selectable menu options are shown on the display screen in the form of a series of panels, or icons, along an essentially semi-circular path. Each panel or icon represents a respective selectable menu option. The user can scroll between different panels by pressing left and right arrow keys. In response to this, a cursor which focuses on a currently "highlighted" panel is shifted accordingly. When the cursor has been shifted a certain number of positions in one of the scrolling directions, the entire series of panels are shifted in the opposite direction, so that the focused panel is repositioned at a centered location at the bottom of the semi-circular path. A focused panel is selected, or, more precisely, the menu option represented by that panel is selected, by pressing a dedicated selection key such as Enter. In one embodiment, the menu is hierarchical, i.e. each panel on the uppermost (root) level represents a folder which in itself may contain subfolders and/or selectable panels on a lower level. The user moves between different levels in this hierarchical menu by way of up and down arrow keys. All panels (provided that they fit within the available display area) are shown for the current level in the menu system, and furthermore the parent panel (but only that) of a currently focused panel is shown. An advantage of providing the digital objects, i.e. the selectable panels, along a curved path rather than in a one or two dimensional linear structure is that it allows a larger number of objects to fit withing the available area on the display screen. Moreover, it is believed to be a representation which is intuitive and user-friendly. However, WO 2004/023283 has a number of shortcomings .
Firstly, the solution proposed in WO 2004/023283 is not particularly suitable for a digital object browser, since apart from the limited-sized panels themselves, it does not provide any clear information about the particulars of each available digital object. In addition, the solution proposed in WO 2004/023283 lacks an expedient way of presenting, for convenient selection by the user, operations that are available for each digital object when it is focused.
Secondly, the present inventors have realized that the solution proposed in WO 2004/023283 does not make optimal use of the available display area.
Furthermore, the information provided as regards a focused object's whereabouts, relative to the hierarchical or otherwise ordered structure in which it is stored, is indicated only in a very limited way (immediately pre- ceding level only, parent object only) .
Similar, but simpler, graphical user interfaces with menu option icons along a curved path are disclosed in US-6,411,307 and WO 02/39712.
Summary of the Invention
In view of the above, an objective of the invention is to solve or at least reduce the problems discussed above. This is generally achieved by the attached independent patent claims . A first aspect of the invention is a mobile terminal having a controller, a display and an input device connected to said controller, and a digital object browser for browsing among a plurality of available digital objects, a first representation and a second representation of each of said plurality of digital objects being presentable on a display screen of said display, said controller being adapted to cause said digital object browser to present said first representations of said plurality of digital objects along a predefined path on said display screen, the first representation of a focused one of said digital objects being shown in a focus area on said display screen; present, for said focused one of said digital objects, the second representation thereof in a preview area on said display screen; and in response to a user input given on said input device, perform a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said focused one of said digital objects to another digital object by presenting in said focus area the first representation of said another digital object, as well as updating said preview area correspondingly by presenting therein the second representation of said another digital object.
To avoid any confusion, it is to be observed that whereas the first representations of said plurality of digital objects are shown simultaneously on the display screen, this is not the case for the second representa- tions . Thus, a plurality of second representations are not shown simultaneously on the display screen. In fact, preferably only one is shown at a time, in the preview area, namely the one that represents the focused one of the digital objects. Advantageously, the digital objects are images, the first representations are thumbnail versions of said images, and the second representation is a reduced version of the image whose thumbnail version is shown in said focus area. The reduced version may be larger, in at least one of image size, resolution or color depth, than the corresponding thumbnail version. This has the benefit of both allowing many thumbnails to be presented at the same time on the display screen (to give the user an overview of the images that are available) , and simultaneously giving the user a legible preview of the focused image in the preview area. To further optimize the use of the available display area on the display screen, the first representation of the focused digital object may be shown in a front view, whereas the first representations of digital objects other than the focused one may be shown as perspective views. Thus, when the digital objects are images, only the focused thumbnail is shown in front view, whereas all other thumbnails are shown in perspective views, which occupy less space on the display screen than a front view. Alternatively, use of the available display area may be optimized by showing the first representations of digital objects other than the focused one as front views, as with the focused digital object, however at smaller image size(s) than that of the focused digital object. Use of the available display area on the display screen may be further optimized by letting the predefined path follow a non-linear (i.e., curved) geometrical curve, such as a circle or ellipse, or a segment thereof. The digital objects are preferably arranged in a sequential order along the predefined path. Still more digital objects may be fitted onto the display screen at one and the same time by arranging the digital objects along two, three or even more predefined paths on the display screen. Such paths may or may not be inter- connected to each other depending on implementation. If two paths are interconnected, an object which is scrolled beyond an end point of a first path may be scrolled onto a second path at a start point thereof, and vice versa.
There may be more digital objects available for browsing than the plurality for which the first repre- sentations are presented along the predefined path. In such a case, as one object is scrolled beyond one end point (or start point) of the predefined path, and its first representation consequently disappears from the display screen, the first representation of a hitherto not presented digital object may appear at an opposite start point (or end point) of the predefined path, in a scrolling manner which is familiar per se.
In one embodiment, the focus area on said display screen is fixed, i.e. it has a static position on said display screen. This is beneficial, since a more static display screen is less tiring and more intuitive to a user .
In this embodiment, the predefined path may advantageously be symmetrical around at least one symmetry axis, wherein said static position of said focus area on said display screen is located at an intersection of said path and said symmetry axis .
The input device may comprise a multi-way input device such as a 4/5-way navigation key or a joystick. Said controller may be adapted, upon receiving a first type of user input, such as a first-way actuation of the multi-way input device, to cause scrolling of said first representations in a first direction along said path, and said controller may be adapted, upon receiving a second type of user input, such as a second-way actuation of the multi-way input device, to cause scrolling of said first representations in a second direction along said path, said second direction being opposite to said first direction. Upon receiving a third type of user input, such as a third-way actuation of aforesaid multi-way input device, the controller may be adapted to cause presentation on said display screen of a menu having a plurality of menu options representing different available operations on said focused one of said digital objects. As used herein, "operations on said focused one of said digital objects" may include any type of operation on digital objects which is normally available for controlling, processing, modifying, communicating or interacting with the digital objects in question. Thus, when the digital objects are images, this arrangement provides an expedient way of presenting, for convenient selection by the user, the operations which are available for each image when it is focused. Such operations on images may include, but is not limited to, open, delete, edit, send, rename, show details, etc. The menu options of said menu are preferably selectable by said multi-way input device.
In one embodiment, the controller is adapted to cause said digital object browser to present information associated with said focused one of said digital objects in a description area on said display screen. Hence, this arrangement gives the user additional information about the particulars of each available digital object (apart from the visual appearance information provided by the thumbnail and preview of the image, when the digital objects are images) . When the digital objects have a location in a hierarchical or otherwise ordered storage structure, the presented information associated with said focused one of said digital objects may advantageously include information about said focused object's location in the storage structure - e.g. hierarchical index number, file name including file system path, etc. Alternatively, the presented information may exclude such hierarchical storage information and simply consist in a name or index number representing the focused object. The mobile terminal may be a mobile phone adapted for use in a mobile telecommunications network in compli- ance with a mobile telecommunications standard such as GSM, UMTS, D-AMPS or CDMA2000.
The mobile terminal may also or alternatively be a device selected from the group consisting of a digital notepad, a personal digital assistant and a hand-held computer .
At least some of the plurality of available digital objects may be stored in local memory in the mobile terminal. Additionally or alternatively, for a mobile terminal comprising a wireless communication interface to at least either a mobile telecommunications network or an external device, at least some of said plurality of available digital objects may be stored in said mobile telecommunications network or said external device and may be accessible to said controller and said digital object browser through said wireless communication interface. Thus, the user of the mobile terminal may use its digital object browser to browse among locally stored objects and/or remotely stored objects, depending on implementation.
A second aspect of the invention is a digital object browsing method for a mobile terminal having a display with a display screen, a first representation and a second representation of each of a plurality of available digital objects being presentable on said display screen, the method involving the steps of: presenting said first representations of said plurality of digital objects along a predefined path on said display screen, the first representation of a focused one of said digital objects being shown in a focus area on said display screen; presenting, for said focused one of said digital objects, the second representation thereof in a preview area on said display screen; and in response to a user input, performing a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said focused one of said digital objects to another digital object by presenting in said focus area the first representation of said another digital object, as well as updating said preview area correspondingly by presenting therein the second representation of said another digital object.
A third aspect of the invention is a computer program product directly loadable into a memory of a processor, the computer program product comprising program code for performing the method according to the second aspect.
The second and third aspects may essentially have the same or corresponding features and advantages as the first aspect.
Other objectives, features and advantages of the present invention will appear from the following detailed disclosure, from the attached dependent claims as well as from the drawings.
The controller may be a CPU ("Central Processing Unit"), DSP ("Digital Signal Processor") or any other electronic programmable logic device or combination of devices . The display may be any commercially available type of display screen suitable for use in mobile terminals, including but not limited to a color TFT LCD display.
Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to "a/an/the [element, device, component, means, step, etc]" are to be interpreted openly as referring to at least one instance of said element, device, component, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated. Brief Description of the Drawings
Embodiments of the present invention will now be described in more detail, reference being made to the enclosed drawings, in which:
Fig 1 is a schematic illustration of a telecommunication system, including a mobile terminal, a mobile telecommunications network and a couple of other devices, as an example of an environment in which the present invention may be applied.
Fig 2 is a schematic front view illustrating a mobile terminal according to a first embodiment, and in particular some external components that are part of a user interface towards a user of the mobile terminal. Fig 3 is a schematic front view illustrating a mobile terminal according to a second embodiment.
Fig 4 is a schematic block diagram representing the internal component and software structure of a mobile terminal, which may be e.g. any of the embodiments shown in Figs 2 and 3.
Figs 5a-5e are schematic display screen illustrations of the digital object browser according to one embodiment of the present invention.
Figs 5f-5g are schematic display screen illustra- tions of a digital object browser according to an alternative embodiment of the present invention.
Detailed Description of the Invention
Fig 1 illustrates one example of a telecommuni- cations system in which the invention may be applied. In the telecommunication system of Fig 1, various telecommunications services such as voice calls, data calls, facsimile transmissions, music transmissions, still image transmissions, video transmissions, electronic message transmissions and electronic commerce may be performed between a mobile terminal 100 according to the present invention and other devices, such as another mobile terminal 106, a PDA 112, a WWW server 122 and a stationary telephone 132. It is to be noticed that for different embodiments of the mobile terminal 100, different ones of the telecommunications services referred to above may or may not be available; the invention is not limited to any particular set of services in this respect. More importantly in this context, the mobile terminal 100 according to the present invention is provided with a digital object browser, which may be used by a user of the mobile terminal 100 to browse among local digital objects 126, which are stored locally in or at the mobile terminal 100, and/or among remote digital objects 126', which are stored at a remote location, e.g. in a remote database 124 coupled to the WWW server 122. The mobile terminals 100, 106 are connected to a mobile telecommunications network 110 through RF links 102, 108 via base stations 104, 109. The mobile telecommunications network 110 may be in compliance with any commercially available mobile telecommunications standard, such as GSM, UMTS, D-AMPS or CDMA2000.
The mobile telecommunications network 110 is opera- tively connected to a wide area network 120, which may be Internet or a part thereof. Various client computers and server computers, including WWW server 122, may be con- nected to the wide area network 120.
A public switched telephone network (PSTN) 130 is connected to the mobile telecommunications network 110 in a familiar manner. Various telephone terminals, including stationary telephone 132, are connected to the PSTN 130. A first embodiment 200 of the mobile terminal 100 is illustrated in more detail in Fig 2. As is well known in the art, the mobile terminal 200 comprises an apparatus housing 201, a loudspeaker 202, a display 203, a set of keys 204 which may include a keypad of common ITU-T type (alpha-numerical keypad), and a microphone 205. In addition, but not shown in Fig 2, the mobile terminal 200 comprises various internal components, the more important of which are illustrated in Fig 4 and will be described later. External components 202-205 are all part of the user interface of the mobile terminal.
Furthermore, the user interface involves a multi- way input device 210 in the form of a joystick, the handle of which may be actuated by the user in a plurality of directions 212/214 so as to command navigating operations, i.e. to navigate in corresponding directions among information 206 shown on display 203, in a manner which is conventional per se for joystick-equipped mobile terminals. The navigation directions may be 4 in number, as indicated by solid arrows 212 in Fig 2, and may be distributed orthogonally in an "up, down, left, right" or "north, south, west, east" fashion with respect to a base plane which is essentially coincidental or parallel with the display 203 or the front surface of apparatus housing 201. Alternatively, the navigation directions may be 8 in number, as indicated by dashed lines 214 together with solid arrows 212 in Fig 2a, and may be distributed around a virtual circle in aforesaid base plane with successive 45° displacements, representing corresponding actuations of the joystick handle by the user.
The user may also perform a selecting operation among information 206 by actuating the joystick 210 in a direction perpendicular to the base plane, e.g. by depressing the joystick at its top. Depending on implementation, this will either cause displacement of the entire joystick handle, or will cause depression of a joystick select button. In some embodiments such a joystick select button may be located at the top of the joystick handle; in others it may be mounted next to the joystick handle on the base plane.
Referring now to Fig 3, a second embodiment 300 of the mobile terminal 100 is illustrated. In this embodi- ment, the multi-way input device is implemented as a 5- way navigation key 310 which is can be actuated (depressed) at different circumferential positions 312, that represent different navigation directions, so as to generate navigating operations in similarity with the description above for the embodiment of Fig 2. Furthermore, a selecting operation may be commanded by depressing the 5-way key 310 at is center 314. The other components 301- 305 are preferably identical with or equivalent to components 201-205 of Fig 2.
The internal component and software structure of a mobile terminal according to one embodiment, which for instance may be any of the aforementioned embodiments, will now be described with reference to Fig 4. In this embodiment, the digital object browser is an image browser 450 for digital images 426. The image browser 450 is implemented as a software application. The upper part of Fig 4 illustrates a typical display layout for the image browser 450 when used for browsing images on the display screen 500 of the mobile terminal's display 436. The image browser 450, its display screen layout and the particulars of its functionality will be described in more detail later.
The mobile terminal has a controller 400 which is responsible for the overall operation of the mobile terminal and is preferably implemented by any commercially available CPU ("Central Processing Unit"), DSP ("Digital Signal Processor") or any other electronic programmable logic device. The controller 400 has associated electronic memory 402 such as RAM memory, ROM memory, EEPROM memory, flash memory, hard disk, or any combination thereof. The memory 402 is used for various purposes by the controller 400, one of them being for storing data and program instructions for various software in the mobile terminal. The data may include a plurality of images 426, which are accessible for browsing in the image browser 450, as will be described below. The software includes a real-time operating system 420, man-machine interface (MMI) drivers 434, an application handler 432 as well as various applications. The applications include aforesaid image browser 450 as well as various other applications 460-470, such as a contacts (phonebook) application, a messaging application, a calendar application, a control panel application, a camera application, a mediaplayer, one or more video games, a notepad application, etc.
The MMI drivers 434 cooperate with the display 436 (which may be identical to the display 203 of Fig 2 or the display 303 of Fig 3) , a joystick 438 (which may be identical to the joystick 210 of Fig 2) as well as various other I/O devices such as a microphone, a speaker, a vibrator, a keypad (e.g. the set of keys 204 of Fig 2), a ringtone generator, an LED indicator, volume controls, etc. As is commonly known, a user may operate the mobile terminal through the man-machine interface thus formed, which in the disclosed embodiment is of the very common kind known as GUI (graphical user interface) .
The software also includes various modules, protocol stacks, drivers, etc., which are commonly designated as 430 and which provide communication services (such as transport, network and connectivity) for an RF interface 406, and optionally a Bluetooth interface 408 and/or an IrDA interface 410. The RF interface 406 comprises an internal or external antenna as well as appropriate radio circuitry for establishing and maintaining a wireless link to a base station (e.g. the link 102 and base station 104 in Fig 1) . As is well known to a man skilled in the art, the radio circuitry comprises a series of analog and digital electronic components, together forming a radio receiver and transmitter. These components include, i.a., band pass filters, amplifiers, mixers, local oscillators, low pass filters, AD/DA converters, etc. The mobile terminal may be provided with other wireless interfaces than the ones mentioned above, including but not limited to WLAN and HomeRF. Any one of such other wireless interfaces, or aforementioned optional interfaces 408 and 410, may be used for estab- lishing and communicating over the wireless link 114 to the nearby device 112 of Fig 1.
The mobile terminal also has a SIM card 404 and an associated reader. As is commonly known, the SIM card 404 comprises a processor as well as local work and data memory.
Referring again to the upper part of Fig 4, the image browser 450 will be described in more detail. As previously explained, a user of the mobile terminal may use the image browser to browse among a plurality of available digital images, either stored locally in memory 402 or externally at a remote location (cf remote digital objects 126' of Fig 1) . For reasons of clarity and simplicity, the rest of this description will refer only to the locally stored images, referred to as 126 in Fig 1 and 426 in Fig 4, in a non-limiting way.
The images 426 may have several different origins; they may for instance have been captured as still photographs in a camera application, or have been created in an image editor or paint tool application, or have been downloaded into memory 402 from a remote location over any available communication interface in the mobile terminal (RF interface 406, etc) . Combinations of these origins are of course possible, so that some of the available images 426 are locally captured photographs, whereas others are created in an image editor, etc. The images are conveniently stored as files in a hierarchical file system, which is managed by the real-time operating system 420 and which may include also other types of objects. Alternatively, the images 426 may be stored in a database managed by the image browser 450. Still one alternative would be to store the images 426 as a simple non-hierarchical sequence of objects in memory 402.
As to the file format, image size, color depth, etc, of the images 402, these may generally be selected from any existing image standard, compressed or non- compressed, including but not limited to JPEG, GIF, TIFF or plain bit map.
The user may enter the image browser in any available way, for instance by selecting a menu option, etc, in the user interface formed by operating system 420 and MMI drivers 434. Moreover, in case the images 426 are stored in a certain folder in a hierarchical file system, the image browser will allow the user to select the desired current folder in any of several different ways which are well known per se. For instance, the user may press a dedicated key (such as a menu key or option key) on the keypad 204, 304 to invoke a list of available operations, including one option for selecting the current folder. For the rest of this description it is assumed that the user has selected the desired current folder in any available way.
As seen in Fig 4, the display screen 500 of the display 436 is used by the image browser 450 in the following way. A plurality of available images is selected among the images 426 in memory 402. For each of these plurality of images, a first representation in the form of a thumbnail image 512 is presented along a curved path 510. In the disclosed embodiment, the path 510 - which is visibly illustrated in dashed style in Fig 4 but which preferably is invisible in an actual implementation - essentially has the shape of a semi-ellipse. However, various other geometrical shapes are possible for the path 510. Advantageously, any such shape is symmetrical around a symmetry axis 514 which may be coincident with a vertical center axis of the display screen 500. Since the thumbnails 512 are arranged along a curved path rather than a (recti-) linear, more thumbnails may be shown simultaneously on the display screen 500 than if the path would have been straight. Use of the available display area on the display screen 500 is optimized further in the disclosed embodiment by showing all thumbnails 512 in perspective views rather than ordinary front views, except for a currently focused image 522 which is shown in front view at a focus area 520. The focus area 520 is fixed, i.e. has a static position on the display screen, at an intersection of the thumbnail path 510 and its symmetry axis 514.
In some implementations, the thumbnails 512 may have been produced on beforehand and stored in memory 402, in association with the respective full-scale images 426. Even the perspective effect of the thumbnails may be pre-processed in this manner. Thus, in such implementations, the image browser 450 only has to read the pre- processed thumbnails 512 from memory 402 and arrange them along the curved path 510 for presentation.
In the disclosed embodiment, though, the thumb- nails, and their perspective effects, are not pre-stored, one reason being to save valuable storage space in memory 402. A second reason is that the perspective is different between individual thumbnails, as appears from Fig 4. As seen in Fig 4, the perspective effect is strongest for thumbnails remote from the centered focused image 522, and grows less and less strong the closer the particular thumbnail gets to the focused image. Therefore, producing also the perspective effect on beforehand makes little sense in this case, since the perspective effects will anyway have to be recalculated each time the sequence of thumbnails 512 is scrolled in either direction.
Such varying perspective between different thumbnails is an advantageous feature. This allows even more thumbnails to be shown on the display screen 500 at the same time, without jeopardizing the legibility to any considerable extent, since the more centered thumbnails are shown at a low perspective angle, or even none (as is the case with the focused image 522 in the disclosed embodiment) . It is to be noticed that the focused image itself is also a thumbnail image representing its associated full-scale image in memory 402. Thus, in the disclosed embodiment, each image 426 that is to be represented on the display screen 500 is read from memory 402 by the image browser 450. The thus read image is processed by appropriate image processing algorithms included in or available to the application software that defines the image browser 450, so as to produce a corresponding, small-sized, low-quality thumbnail in perspective view, which is then immediately presented along the curved path 510. Whether or not thumb- nails are to be pre-produced or produced "on the fly" is a trade-off which will have to be considered for each implementation .
Specifically for the focused image 522, in a preview area 530 a preview 532 is shown for the full-scale image 426 which is currently focused and the thumbnail
522 of which is shown in the focus area 520. The preview 532 is a reduced version of this focused full-scale image 426. The reduced version is larger in image size, and preferably also resolution and/or color depth, than the corresponding thumbnail version 522, thus giving the user a legible preview 532 of the focused image 522 in the preview area 530.
As is the case with the thumbnails, the previews of all available images 426 may be produced on beforehand and stored in memory 402, or may be processed on the fly by the image browser 450 when the particular image becomes focused and its thumbnail 522 appears in the focus area 520. When another thumbnail 512 is scrolled into the focus area 520, the preview of the formerly focused image is replaced with a preview of the new focused image. Thus, the focus area 520 functions like a static- positioned cursor that indicates which one of the thumbnails 512 that is currently focused and previewed in the preview area 530. In the disclosed embodiment, a description 542 of the focused image 522 is provided for the benefit of the user in a description area 540 on the display screen 500. As seen in Fig 4, the description area 540 is advantageously located in the lowermost region of the display screen 500, in vertical alignment with the focus area 520 and preview area 530 around the symmetry axis 514. The description 542 serves to provide a different kind of information about the focused object than the strictly visual (i.e., image-like) information provided by the focused image's thumbnail 522 and preview 532. The description 542 is advantageously an index number and/or a filename of the focused image, with or without information that relates to the focused image's location in the hierarchical or otherwise ordered storage structure in memory 402, e.g. a file system path. For instance, an index number may simply be "13", indicating that the focused image 522 is number 13 among the available images in the currently selected folder in a local file system in memory 402, whereas a file name with file system path may look like "MyPhone : \Images\Summer_2004\P00113. jpg" . Figs 5a and 5b illustrate how the contents of the display screen 500 change when the user commands scrolling of the thumbnails 512 by one (1) step to the right. In Fig 5a, arrows 550L and 550R indicate the possible scrolling directions, i.e. to the left and to the right, for the user. In Fig 5a, the currently focused image is denoted A, and its nearest neighbors along the thumbnail path 510 are denoted B and D (to the left of the focused image 522), and C and E (to the right of the focused image 522) . As explained above, the preview of A is shown at 532, and the description thereof is shown at 542. Now, by giving a certain user input on the input device 438, the user may command scrolling. For instance, such user input may be given by actuating the joystick 210 (Fig 2) or 5-way key 310 (Fig 3) in its left or right navigation direction.
Assuming that the user gives a user input to command scrolling to the right, the image browser 450 will receive this user input and promptly act to update the display screen so that it will have the contents shown in Fig 5b. As is seen in Fig 5b, all thumbnails 512 are moved one position to the right (anti-clockwise rotation) along the thumbnail path 510. The formerly focused thumbnail A is shifted out of focus into the position that was formerly held by thumbnail C. At the right side of the focus area 520, thumbnail C moves one step to the position formerly held by thumbnail E, etc. , i.e. all thumb- nails at this side are shifted one step away from the focus area. At the left side, on the other hand, all thumbnails are shifted one step closer to the focus area, and thumbnail A's nearest left-hand neighbor B is shifted into the focus area 520 and becomes the focused image 522.
Moreover, the preview of A is replaced by the preview of B at 532, and the description of A is replaced by the description of B at 542. If not all available images 426 in the current folder, etc., were represented by thumbnails 512 in Fig 5a, the farthest thumbnail on the right side of the focus area 520 disappears as the thumbnails are scrolled into the state shown in Fig 5b, whereas a new thumbnail for a formerly not represented image 426 will be provided and shown at the farthest position along the thumbnail path 510 on the left side of the focus area 520 in Fig 5b.
Of course, if the user instead gives a user input in Fig 5a to perform a one-step scrolling to the left, all updates on the display screen will reflect this, so that the thumbnails are shifted one step to the left (clockwise) along the path 512, etc.
Figs 5c and 5d illustrate another advantageous feature of the disclosed embodiment, namely providing convenient access for the user to a pop-up menu of opera- tions that are available for the focused image 522. As seen in Fig 5c, a pop-up menu bar 524 is displayed to the very right of the focused image 522. The pop-up menu bar 524 may be shown automatically as soon as the focused image 522 appears in the fo'cus area 520, or alternatively a user action is required (such as a select action on the joystick 210 of Fig 2, or by depressing the 5-way navi- gation key 310 of Fig 3 at its center 314) to cause presentation of the pop-up menu bar 524 on the display screen 500. The first alternative has an advantage in that it does not steal attention from the focused image 522, and nor does it partly hide the nearest right-hand neighbor thumbnail (C in Fig 5c) , before the user actively chooses to bring about the pop-up menu bar 524. On the other hand, the second alternative has an advantage in that it is more intuitive and convenient, at least to an inexperienced user, since it shows the pop-up menu bar 524 automatically, thereby clearly indicating the availability of various operations on the focused image 522.
A small left-arrow 523 in the pop-up menu bar 524 indicates that the user has to perform a navigate-left action on the input device 428 (tilting the joystick handle to the left or depressing the 5-way key to the left at its rim portion, etc) . Following this, a list of available menu items or options 528 will be shown in a pop-up menu 526 immediately to the right of the pop-up menu bar 524, as seen in Fig 5d. When the pop-up menu 526 is brought forward, its top menu item 528a is highlighted. The user may scroll in the pop-up menu 526 by way of the input device 438, e.g. by navigate-up and navigate-down actions on joystick 210 or 5-way navigation key 310, thereby causing another menu item 528 to become highlighted. Further menu items, currently not displayed in the pop-up menu 526, may be indicated by a downward- pointing arrow 529 and made available by performing a navigate-down action on the input device 438 when the lowermost menu item is highlighted, thereby causing down- wards scrolling of the list of menu items 528. By performing a selecting action (for instance any of the ones described in the preceding paragraph) on the input device 438, the user may select the highlighted menu item, wherein the associated operation will be performed by the image browser 450 in cooperation with the application handler 432 and operating system 420. For instance, in the disclosed embodiment, if the selected menu item 528 is Open (528a in Fig 5d) , the image browser 450 will present a enlarged version of the focused image 522 on essentially the entire display screen 500, or a majority thereof. This larger version of the focused image is considerably larger in image size, and optionally resolution and/or color depth, than the preview 532.
If the selected menu item 528 is Edit, the image browser 450 will place a function call to an image editor application (included among applications 460-470 in Fig 4), wherein the application handler will invoke this image editor and instruct it to activate itself with the particular image among images 426 that is represented by the focused thumbnail 522 in Fig 5d. Selecting the menu item Send may correspondingly invoke a messaging application and prepare for trans- mittal of the image in question as an attachment in an electronic message such as email or MMS.
The menu item Details will provide further informa- tion on the focused image, e.g. detailed file name including file system path, size, image type, creation or edit date and time, etc.
The meaning of the remaining menu items is believed to be self-explanatory and needs no further description herein. Of course, the menu items 528 illustrated in Fig 5d are only exemplifying. Furthermore, the pop-up menu 526 may be hierarchical, i.e. so that any one of the first-level menu items 528 may lead to a second-level pop-up menu of menu items when the user performs a navigate-right action on the input device 438. Fig 5e serves to give a less schematic illustration of how the display screen 500 may look like in an actual implementation .
Figs 5f and 5g illustrate another embodiment of the invention and, in more particular, how the contents of the display screen 500 change when the user commands scrolling of the thumbnails 512 by one (1) step to the right. This embodiment is similar to the one described above for Figs 4 and 5a-5e, expect for the following difference. As seen in Fig 5f, for the currently focused image A, there is no presentation of its thumbnail at 522. Instead, at 522, a description of the focused image A is given (corresponding to the description which for the previous embodiment was shown in the description area 542, e.g. an index, filename, etc, of the currently focused image) . This alternative embodiment has an advantage in that display space is saved, thanks to the elimination of a separate description area for presentation of a description of the currently focused image. The image browsing method as described for the embodiments disclosed above may advantageously be implemented as a computer program product which may be installed by a manufacturer, distributor, end-user, etc, in a mobile terminal's memory (e.g. memory 402 of Fig 4) . Such computer program will include program code that when executed by a processor in the mobile terminal (e.g. controller 400 of Fig 4) will perform the image browser functionality described above.
Even if the digital object browser has been de- scribed above as a browser for digital images, it may alternatively be a browser for other types of digital objects, including but not limited to video sequences, text documents, spreadsheet documents, html (hypertext markup language) documents, wml (wireless markup language) documents or even audio sequences. The particulars of the second representation shown in the preview area will of course depend on the actual type of the document and may require processing which is special for the type in question. For instance, if the object is a html document, the processing required to provide a preview may involve interpreting the html code and present- ing a compact, low-resolution version of the document specified by the html code in the preview area. For objects that are non-visual in nature, e.g. audio sequences, the first representation as well as the second representation will contain visual information that as clearly as possible conveys to the user a sense of the non-visual contents of the objects. For an audio sequence, this may for instance include presenting a song title, artist name, album name and/or duration, or parts of the lyrics, or even a subset of musical notes that defines a well-recognized part of the audio sequence (e.g. the chorus of a song) .
The invention has mainly been described above with reference to a few embodiments. However, as is readily appreciated by a person skilled in the art, other embodi- ments than the ones disclosed above are equally possible within the scope of the invention, as defined by the appended patent claims .

Claims

1. A mobile terminal (100; 200; 300) having a controller (400), a display (203; 303; 436) and an input device (210; 310; 438) connected to said controller, and a digital object browser (450) for browsing among a plurality of available digital objects (126; 126'; 426), characterized by a first representation (512) and a second represen- tation (532) of each of said plurality of digital objects being presentable on a display screen (500) of said display, and by said controller being adapted to cause said digital object browser to present said first representations of said plurality of digital objects along a predefined path (510) on said display screen, the first representation (522) of a focused one of said digital objects being shown in a focus area (520) on said display screen; present, for said focused one of said digital objects, the second representation (532) thereof in a preview area (530) on said display screen; and in response to a user input given on said input device, perform a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said focused one of said digital objects to another digital object by presenting in said focus area the first representation of said another digital object, as well as updating said preview area correspondingly by presenting therein the second representation of said another digital object.
2. A mobile terminal as defined in claim 1, wherein the digital objects (126; 126'; 426) are images, the first representations are thumbnail versions (512) of said images, and the second representation is a reduced version (532) of the image whose thumbnail version (512) is shown in said focus area (520) .
3. A mobile terminal as defined in claim 2, wherein said reduced version (532) is larger, in at least one of image size, resolution or color depth, than the corresponding thumbnail version (522) .
4. A mobile terminal as defined in any preceding claim, wherein the first representation (522) of said focused digital object is shown in a front view on said display screen (500) , whereas the first representations (512) of digital objects other than the focused one are shown as perspective views on said display screen.
5. A mobile terminal as defined in any preceding claim, wherein said predefined path (510) follows a nonlinear geometrical curve.
6. A mobile terminal as defined in any preceding claim, wherein said focus area (520) on said display screen (500) is fixed, i.e. has a static position on said display screen.
7. A mobile terminal as defined in claim 5 and 6, wherein said path (510) is symmetrical around at least one symmetry axis (514) and said static position of said focus area on said display screen (500) is located at an intersection of said path and said symmetry axis.
8. A mobile terminal as defined in any preceding claim, wherein said controller (400) is adapted, upon receiving a first type of user input from said input device (210; 310; 438), to cause scrolling of said first representations (512) in a first direction (550L) along said path (510) , and said controller is adapted, upon receiving a second type of user input from said input device, to cause scrolling of said first representations in a second direction (550R) along said path, said second direction being opposite to said first direction.
9. A mobile terminal as defined in claim 8, said controller (400) being adapted, upon receiving a third type of user input from said input device (210; 310; 438), to cause presentation on said display screen (500) of a menu (526) having a plurality of menu options (528) representing different available operations on said focused one of said digital objects (126; 126'; 426).
10. A mobile terminal as defined in claim 8 or 9, wherein said input device comprises a multi-way input device (210; 310) such as a 4/5-way navigation key or a joystick, said first and second types of user input being first-way and second-way actuations of said multi-way input device.
11. A mobile terminal as defined in any preceding claim, wherein said controller (400) is adapted to cause said digital object browser (450) to present information (542) associated with said focused one of said digital objects in a description area (540) on said display screen (500) .
12. A mobile terminal as defined in any preceding claim, in the form of a mobile phone (100) adapted for use in a mobile telecommunications network (110) .
13. A mobile terminal as defined in any preceding claim, in the form of a device selected from the group consisting of a digital notepad, a personal digital assistant and a hand-held computer.
14. A mobile terminal as defined in any preceding claim, the terminal comprising a local memory (402), wherein at least some of said plurality of available digital objects (126; 426) are stored in said local memory .
15. A mobile terminal as defined in any preceding claim, the terminal comprising a wireless communication interface (406-410) to at least either a mobile tele- communications network (110) or an external device (122), wherein at least some of said plurality of available digital objects (126') are stored in said mobile telecommunications network or said external device and are accessible to said controller (400) and said digital object browser (450) through said wireless communication interface .
16. A mobile terminal as defined in claim 11, the digital objects (126; 126'; 426) having a location in a hierarchical or otherwise ordered storage structure, wherein the presented information (542) associated with said focused one of said digital objects includes information about said focused object's location in the storage structure.
17. A digital object browsing method for a mobile terminal (100; 200; 300) having a display (203; 303; 436) with a display screen (500) , a first representation (512) and a second representation (532) of each of a plurality of available digital objects (126; 126'; 426) being presentable on said display screen, the method comprising : presenting said first representations of said plurality of digital objects along a predefined path (510) on said display screen, the first representation (522) of a focused one of said digital objects being shown in a focus area (520) on said display screen; presenting, for said focused one of said digital objects, the second representation (532) thereof in a preview area (530) on said display screen; and in response to a user input, performing a desired scrolling operation among the first representations presented, thereby shifting the positions of the first representations on said display screen along said path accordingly, updating said focus area to reflect a change in focus from said focused one of said digital objects to another digital object by presenting in said focus area the first representation of said another digital object, as well as updating said preview area correspondingly by presenting therein the second representation of said another digital object.
18. A computer program product directly loadable into a memory of a processor, the computer program product comprising program code for performing the method according to claim 17.
PCT/IB2006/001272 2005-05-27 2006-05-15 Improved graphical user interface for mobile communications terminal WO2006126050A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP06755881.7A EP1886210B1 (en) 2005-05-27 2006-05-15 Improved graphical user interface for mobile communications terminal
JP2008512933A JP2008542867A (en) 2005-05-27 2006-05-15 Improved graphical user interface for mobile communication terminals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/140,490 2005-05-27
US11/140,490 US7797641B2 (en) 2005-05-27 2005-05-27 Mobile communications terminal and method therefore

Publications (1)

Publication Number Publication Date
WO2006126050A1 true WO2006126050A1 (en) 2006-11-30

Family

ID=36997215

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/001272 WO2006126050A1 (en) 2005-05-27 2006-05-15 Improved graphical user interface for mobile communications terminal

Country Status (5)

Country Link
US (1) US7797641B2 (en)
EP (1) EP1886210B1 (en)
JP (1) JP2008542867A (en)
RU (1) RU2007145218A (en)
WO (1) WO2006126050A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008142614A1 (en) * 2007-05-24 2008-11-27 Nokia Corporation Webpage history view
EP2439937A1 (en) * 2010-10-11 2012-04-11 France Telecom Method for communicating a big amount of information on a unique screen
CN103226397A (en) * 2012-01-25 2013-07-31 三星电子株式会社 Method for operating three-dimensional handler and terminal supporting the same
US8578297B2 (en) 2007-12-20 2013-11-05 Canon Kabushiki Kaisha Method of browsing media items using thumbnails
US8631351B2 (en) 2008-06-29 2014-01-14 Microsoft Corporation Providing multiple degrees of context for content consumed on computers and media players
EP2443542A4 (en) * 2009-06-19 2014-07-23 Google Inc User interface visualizations
WO2016195940A3 (en) * 2015-06-05 2017-01-12 Apple Inc. Synchronized content scrubber
WO2017209584A1 (en) 2016-06-03 2017-12-07 Samsung Electronics Co., Ltd. Method and apparatus for displaying content
US10430027B2 (en) 2014-09-29 2019-10-01 Ntt Docomo, Inc. Display control device, program, and image display method
US10613731B2 (en) 2014-05-08 2020-04-07 Naver Corporation Apparatus and method for displaying information on web page based on scrolling speed

Families Citing this family (242)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100600750B1 (en) * 2004-07-27 2006-07-14 엘지전자 주식회사 Mobile Communication Terminal Having dual camera
US7721197B2 (en) * 2004-08-12 2010-05-18 Microsoft Corporation System and method of displaying content on small screen computing devices
US8001476B2 (en) 2004-11-16 2011-08-16 Open Text Inc. Cellular user interface
US8418075B2 (en) 2004-11-16 2013-04-09 Open Text Inc. Spatially driven content presentation in a cellular environment
US20070234232A1 (en) * 2006-03-29 2007-10-04 Gheorghe Adrian Citu Dynamic image display
US8370769B2 (en) 2005-06-10 2013-02-05 T-Mobile Usa, Inc. Variable path management of user contacts
US8370770B2 (en) * 2005-06-10 2013-02-05 T-Mobile Usa, Inc. Variable path management of user contacts
US7685530B2 (en) 2005-06-10 2010-03-23 T-Mobile Usa, Inc. Preferred contact group centric interface
US8359548B2 (en) * 2005-06-10 2013-01-22 T-Mobile Usa, Inc. Managing subset of user contacts
US8225231B2 (en) 2005-08-30 2012-07-17 Microsoft Corporation Aggregation of PC settings
US7966577B2 (en) 2005-10-11 2011-06-21 Apple Inc. Multimedia control center
USRE47016E1 (en) 2005-12-29 2018-08-28 Ozmis Pty. Ltd. Method and system for display data on a mobile terminal
US8245142B2 (en) 2005-12-29 2012-08-14 Ozmiz Pty. Ltd. Method and system for displaying data on a mobile terminal
US7509588B2 (en) 2005-12-30 2009-03-24 Apple Inc. Portable electronic device with interface reconfiguration mode
US8732597B2 (en) * 2006-01-13 2014-05-20 Oracle America, Inc. Folded scrolling
US8693549B2 (en) * 2006-01-16 2014-04-08 Electronics And Telecommunications Research Institute Method and apparatus for selective inter-layer prediction on macroblock basis
US7459624B2 (en) 2006-03-29 2008-12-02 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US8601063B2 (en) * 2006-03-31 2013-12-03 Blackberry Limited Method for presenting an attachment within an email message
US7640311B2 (en) * 2006-03-31 2009-12-29 Research In Motion Limited Method for viewing non-image attachments on a portable electronic device
US7511723B2 (en) * 2006-03-31 2009-03-31 Research In Motion Limited Method for requesting and viewing an attachment image on a portable electronic device
US8296684B2 (en) 2008-05-23 2012-10-23 Hewlett-Packard Development Company, L.P. Navigating among activities in a computing device
US8683362B2 (en) 2008-05-23 2014-03-25 Qualcomm Incorporated Card metaphor for activities in a computing device
US8255281B2 (en) 2006-06-07 2012-08-28 T-Mobile Usa, Inc. Service management system that enables subscriber-driven changes to service plans
JP2008060731A (en) * 2006-08-29 2008-03-13 Olympus Imaging Corp Camera, output image selection method, and program
US10313505B2 (en) * 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US8564544B2 (en) * 2006-09-06 2013-10-22 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US20080065992A1 (en) * 2006-09-11 2008-03-13 Apple Computer, Inc. Cascaded display of video media
JP5025217B2 (en) * 2006-10-02 2012-09-12 京セラ株式会社 Information processing apparatus, information processing method, and information processing program
WO2008052301A1 (en) * 2006-10-31 2008-05-08 Research In Motion Limited Controlling display images on a mobile device
FR2908578B1 (en) * 2006-11-10 2011-05-06 Archos METHOD AND SYSTEM FOR PERFORMING TRANSACTIONS FROM PORTABLE ELECTRONIC DEVICES CONNECTED TO A COMMUNICATION NETWORK, AND ASSOCIATED PORTABLE ELECTRONIC APPARATUS
AU2006252196B2 (en) 2006-12-21 2009-05-14 Canon Kabushiki Kaisha Scrolling Interface
AU2006252194B2 (en) * 2006-12-21 2010-02-11 Canon Kabushiki Kaisha Scrolling Interface
AU2006252191B2 (en) * 2006-12-21 2009-03-26 Canon Kabushiki Kaisha Scrolling Interface
JP4945236B2 (en) * 2006-12-27 2012-06-06 株式会社東芝 Video content display device, video content display method and program thereof
US8519964B2 (en) 2007-01-07 2013-08-27 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US8762882B2 (en) 2007-02-05 2014-06-24 Sony Corporation Information processing apparatus, control method for use therein, and computer program
JP4887184B2 (en) * 2007-03-02 2012-02-29 株式会社リコー Display processing apparatus, display processing method, and display processing program
JP4843532B2 (en) * 2007-03-14 2011-12-21 株式会社リコー Display processing apparatus, display processing method, and display processing program
KR101417769B1 (en) * 2007-04-16 2014-08-07 삼성전자주식회사 Methods for managing user contents in communication terminal
KR20080097059A (en) * 2007-04-30 2008-11-04 삼성전자주식회사 Methods for managing user contents of communication terminal
US8201096B2 (en) * 2007-06-09 2012-06-12 Apple Inc. Browsing or searching user interfaces and other aspects
US8678896B2 (en) 2007-06-14 2014-03-25 Harmonix Music Systems, Inc. Systems and methods for asynchronous band interaction in a rhythm action game
EP2173444A2 (en) 2007-06-14 2010-04-14 Harmonix Music Systems, Inc. Systems and methods for simulating a rock band experience
US9772751B2 (en) 2007-06-29 2017-09-26 Apple Inc. Using gestures to slide between user interfaces
KR101445645B1 (en) * 2007-08-03 2014-10-01 삼성전자주식회사 Broadcast receiver and user input device having function to match items and method thereof
JP5355872B2 (en) 2007-08-15 2013-11-27 ソニー株式会社 Information processing apparatus, information processing method, and program
US9619143B2 (en) 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US8619038B2 (en) 2007-09-04 2013-12-31 Apple Inc. Editing interface
US11126321B2 (en) 2007-09-04 2021-09-21 Apple Inc. Application menu user interface
US20090063542A1 (en) * 2007-09-04 2009-03-05 Bull William E Cluster Presentation of Digital Assets for Electronic Devices
US7941758B2 (en) * 2007-09-04 2011-05-10 Apple Inc. Animation of graphical objects
KR101398134B1 (en) * 2007-10-04 2014-05-20 엘지전자 주식회사 Apparatus and method for playing moving-picture in mobile terminal
KR20090050577A (en) * 2007-11-16 2009-05-20 삼성전자주식회사 User interface for displaying and playing multimedia contents and apparatus comprising the same and control method thereof
US20090204915A1 (en) * 2008-02-08 2009-08-13 Sony Ericsson Mobile Communications Ab Method for Switching Desktop Panels in an Active Desktop
US8122372B2 (en) * 2008-04-17 2012-02-21 Sharp Laboratories Of America, Inc. Method and system for rendering web pages on a wireless handset
JP4481339B2 (en) * 2008-05-16 2010-06-16 シャープ株式会社 Information processing apparatus, information processing method, information processing program, and computer-readable recording medium recording the same
US8607166B2 (en) * 2008-06-06 2013-12-10 Apple Inc. Browsing or searching user interfaces and other aspects
US8516038B2 (en) * 2008-06-06 2013-08-20 Apple Inc. Browsing or searching user interfaces and other aspects
US8762887B2 (en) * 2008-06-06 2014-06-24 Apple Inc. Browsing or searching user interfaces and other aspects
DE102008028023A1 (en) * 2008-06-12 2009-12-17 Siemens Aktiengesellschaft Method for displaying a plurality of image data sets and user interface for displaying a plurality of image data sets
JP4309468B1 (en) * 2008-06-24 2009-08-05 株式会社ビジョナリスト Photo album controller
JP4636131B2 (en) * 2008-07-04 2011-02-23 ソニー株式会社 Information providing apparatus, information providing method, and program
WO2010006054A1 (en) 2008-07-08 2010-01-14 Harmonix Music Systems, Inc. Systems and methods for simulating a rock and band experience
JP4636134B2 (en) * 2008-07-25 2011-02-23 ソニー株式会社 Display control apparatus, display control method, and program
JP4636141B2 (en) * 2008-08-28 2011-02-23 ソニー株式会社 Information processing apparatus and method, and program
JP2010054762A (en) * 2008-08-28 2010-03-11 Sony Corp Apparatus and method for processing information, and program
JP4984174B2 (en) * 2008-08-29 2012-07-25 ソニー株式会社 Information processing apparatus and method, and program
JP4720878B2 (en) * 2008-08-29 2011-07-13 ソニー株式会社 Information processing apparatus and method, and program
US8347230B2 (en) * 2008-09-30 2013-01-01 Apple Inc. Visual presentation of multiple internet pages
US20100082794A1 (en) * 2008-10-01 2010-04-01 Sony Corporation Home network visualization
US20100107100A1 (en) 2008-10-23 2010-04-29 Schneekloth Jason S Mobile Device Style Abstraction
US8411046B2 (en) 2008-10-23 2013-04-02 Microsoft Corporation Column organization of content
KR101513019B1 (en) * 2008-10-27 2015-04-17 엘지전자 주식회사 Mobile terminal and operation method thereof
JP2010147705A (en) * 2008-12-17 2010-07-01 Sharp Corp Television system
JP4655147B2 (en) * 2008-12-26 2011-03-23 ソニー株式会社 Electronic device, map display method, and computer program
US20100192100A1 (en) * 2009-01-23 2010-07-29 Compal Electronics, Inc. Method for operating a space menu and electronic device with operating space menu
JP2010171780A (en) * 2009-01-23 2010-08-05 Murata Machinery Ltd Image processor, and program for the same
US9195317B2 (en) * 2009-02-05 2015-11-24 Opentv, Inc. System and method for generating a user interface for text and item selection
US20100251085A1 (en) * 2009-03-25 2010-09-30 Microsoft Corporation Content and subfolder navigation control
US8893025B2 (en) 2009-03-27 2014-11-18 T-Mobile Usa, Inc. Generating group based information displays via template information
US9355382B2 (en) 2009-03-27 2016-05-31 T-Mobile Usa, Inc. Group based information displays
USD631890S1 (en) 2009-03-27 2011-02-01 T-Mobile Usa, Inc. Portion of a display screen with a user interface
US9210247B2 (en) 2009-03-27 2015-12-08 T-Mobile Usa, Inc. Managing contact groups from subset of user contacts
US8577350B2 (en) 2009-03-27 2013-11-05 T-Mobile Usa, Inc. Managing communications utilizing communication categories
US9195966B2 (en) 2009-03-27 2015-11-24 T-Mobile Usa, Inc. Managing contact groups from subset of user contacts
US9369542B2 (en) 2009-03-27 2016-06-14 T-Mobile Usa, Inc. Network-based processing of data requests for contact information
US8238876B2 (en) 2009-03-30 2012-08-07 Microsoft Corporation Notifications
US8175653B2 (en) 2009-03-30 2012-05-08 Microsoft Corporation Chromeless user interface
US8515497B2 (en) * 2009-04-27 2013-08-20 Kyocera Corporation Voice file name generation for captured images
US8836648B2 (en) 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US8465366B2 (en) 2009-05-29 2013-06-18 Harmonix Music Systems, Inc. Biasing a musical performance input to a part
US8271898B1 (en) * 2009-06-04 2012-09-18 Mellmo Inc. Predictive scrolling
KR100984817B1 (en) * 2009-08-19 2010-10-01 주식회사 컴퍼니원헌드레드 User interface method using touch screen of mobile communication terminal
KR20110037657A (en) * 2009-10-07 2011-04-13 삼성전자주식회사 Method for providing gui by using motion and display apparatus applying the same
WO2011056657A2 (en) 2009-10-27 2011-05-12 Harmonix Music Systems, Inc. Gesture-based user interface
US9981193B2 (en) 2009-10-27 2018-05-29 Harmonix Music Systems, Inc. Movement based recognition and evaluation
KR101631912B1 (en) * 2009-11-03 2016-06-20 엘지전자 주식회사 Mobile terminal and control method thereof
US9230292B2 (en) 2012-11-08 2016-01-05 Uber Technologies, Inc. Providing on-demand services through use of portable computing devices
US9959512B2 (en) 2009-12-04 2018-05-01 Uber Technologies, Inc. System and method for operating a service to arrange transport amongst parties through use of mobile devices
US20110176747A1 (en) * 2010-01-15 2011-07-21 Dumitru Dan Mihai Method and portable electronic device for processing
US8874243B2 (en) 2010-03-16 2014-10-28 Harmonix Music Systems, Inc. Simulating musical instruments
US8516395B2 (en) * 2010-03-30 2013-08-20 Cisco Technology, Inc. One-dimensional representation of a two-dimensional data structure
US8423911B2 (en) 2010-04-07 2013-04-16 Apple Inc. Device, method, and graphical user interface for managing folders
US10788976B2 (en) 2010-04-07 2020-09-29 Apple Inc. Device, method, and graphical user interface for managing folders with multiple pages
EP2579955B1 (en) 2010-06-11 2020-07-08 Harmonix Music Systems, Inc. Dance game and tutorial
US8562403B2 (en) 2010-06-11 2013-10-22 Harmonix Music Systems, Inc. Prompting a player of a dance game
US9358456B1 (en) 2010-06-11 2016-06-07 Harmonix Music Systems, Inc. Dance competition game
US9024166B2 (en) 2010-09-09 2015-05-05 Harmonix Music Systems, Inc. Preventing subtractive track separation
JP5249297B2 (en) * 2010-09-28 2013-07-31 シャープ株式会社 Image editing device
US9160960B2 (en) * 2010-12-02 2015-10-13 Microsoft Technology Licensing, Llc Video preview based browsing user interface
US20120159395A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Application-launching interface for multiple modes
US20120159383A1 (en) 2010-12-20 2012-06-21 Microsoft Corporation Customization of an immersive environment
FR2969332A1 (en) * 2010-12-21 2012-06-22 France Telecom PERFECTED PROCESSING OF GRAPHIC INTERFACE DATA.
US8689123B2 (en) 2010-12-23 2014-04-01 Microsoft Corporation Application reporting in an application-selectable user interface
US8612874B2 (en) 2010-12-23 2013-12-17 Microsoft Corporation Presenting an application change through a tile
US9423951B2 (en) 2010-12-31 2016-08-23 Microsoft Technology Licensing, Llc Content-based snap point
JP2012163925A (en) * 2011-02-09 2012-08-30 Seiko Epson Corp Display control method, display device and electronic apparatus
JP5977922B2 (en) * 2011-02-24 2016-08-24 セイコーエプソン株式会社 Information processing apparatus, information processing apparatus control method, and transmissive head-mounted display apparatus
JP5699681B2 (en) * 2011-02-25 2015-04-15 セイコーエプソン株式会社 Display control method, display device, and electronic apparatus
JP2012190124A (en) * 2011-03-09 2012-10-04 Seiko Epson Corp Display control method, display device, and electronic apparatus
US8954386B2 (en) * 2011-03-22 2015-02-10 Microsoft Corporation Locally editing a remotely stored image
US9383917B2 (en) 2011-03-28 2016-07-05 Microsoft Technology Licensing, Llc Predictive tiling
RU2589395C2 (en) 2011-04-22 2016-07-10 Пепсико, Инк. Dispensing system for beverages with social services capabilities
JP5772202B2 (en) * 2011-05-12 2015-09-02 セイコーエプソン株式会社 Display device, electronic device, and display control method
US9104307B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9658766B2 (en) 2011-05-27 2017-05-23 Microsoft Technology Licensing, Llc Edge gesture
US20120304132A1 (en) 2011-05-27 2012-11-29 Chaitanya Dev Sareen Switching back to a previously-interacted-with application
US9104440B2 (en) 2011-05-27 2015-08-11 Microsoft Technology Licensing, Llc Multi-application environment
US9158445B2 (en) 2011-05-27 2015-10-13 Microsoft Technology Licensing, Llc Managing an immersive interface in a multi-application immersive environment
US8893033B2 (en) 2011-05-27 2014-11-18 Microsoft Corporation Application notifications
US9239890B2 (en) 2011-05-31 2016-01-19 Fanhattan, Inc. System and method for carousel context switching
US9778818B2 (en) 2011-05-31 2017-10-03 Fanhattan, Inc. System and method for pyramidal navigation
US8687023B2 (en) 2011-08-02 2014-04-01 Microsoft Corporation Cross-slide gesture to select and rearrange
US9417754B2 (en) 2011-08-05 2016-08-16 P4tents1, LLC User interface system, method, and computer program product
US20130057587A1 (en) 2011-09-01 2013-03-07 Microsoft Corporation Arranging tiles
US10353566B2 (en) 2011-09-09 2019-07-16 Microsoft Technology Licensing, Llc Semantic zoom animations
US8922575B2 (en) 2011-09-09 2014-12-30 Microsoft Corporation Tile cache
US9557909B2 (en) 2011-09-09 2017-01-31 Microsoft Technology Licensing, Llc Semantic zoom linguistic helpers
US9146670B2 (en) 2011-09-10 2015-09-29 Microsoft Technology Licensing, Llc Progressively indicating new content in an application-selectable user interface
US9244802B2 (en) 2011-09-10 2016-01-26 Microsoft Technology Licensing, Llc Resource user interface
US8933952B2 (en) 2011-09-10 2015-01-13 Microsoft Corporation Pre-rendering new content for an application-selectable user interface
RU2597458C2 (en) * 2011-09-13 2016-09-10 Сони Компьютер Энтертэйнмент Инк. Information processing device, display control method, program and data medium
US10739932B2 (en) * 2011-10-11 2020-08-11 Semi-Linear, Inc. Systems and methods for interactive mobile electronic content creation and publication
US9218704B2 (en) 2011-11-01 2015-12-22 Pepsico, Inc. Dispensing system and user interface
US9645733B2 (en) 2011-12-06 2017-05-09 Google Inc. Mechanism for switching between document viewing windows
US9223472B2 (en) 2011-12-22 2015-12-29 Microsoft Technology Licensing, Llc Closing applications
USD702699S1 (en) 2012-01-19 2014-04-15 Pepsico, Inc. Display screen with graphical user interface
USD696267S1 (en) 2012-01-19 2013-12-24 Pepsico, Inc. Display screen with graphical user interface
USD696264S1 (en) 2012-01-19 2013-12-24 Pepsico, Inc. Display screen with graphical user interface
USD702247S1 (en) 2012-01-19 2014-04-08 Pepsico, Inc. Display screen with graphical user interface
USD703681S1 (en) 2012-01-19 2014-04-29 Pepsico, Inc. Display screen with graphical user interface
USD702698S1 (en) 2012-01-19 2014-04-15 Pepsico, Inc. Display screen with graphical user interface
USD696266S1 (en) 2012-01-19 2013-12-24 Pepsico, Inc. Display screen with graphical user interface
USD696265S1 (en) 2012-01-19 2013-12-24 Pepsico, Inc. Display screen with graphical user interface
US9645724B2 (en) 2012-02-01 2017-05-09 Facebook, Inc. Timeline based content organization
US9235318B2 (en) 2012-02-01 2016-01-12 Facebook, Inc. Transitions among hierarchical user-interface layers
US9557876B2 (en) * 2012-02-01 2017-01-31 Facebook, Inc. Hierarchical user interface
US9128605B2 (en) 2012-02-16 2015-09-08 Microsoft Technology Licensing, Llc Thumbnail-image selection of applications
KR20130119225A (en) * 2012-04-23 2013-10-31 삼성전자주식회사 Display apparatus and method for providing user interface
US20130290116A1 (en) * 2012-04-27 2013-10-31 Yahoo! Inc. Infinite wheel user interface
WO2013169849A2 (en) 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
WO2013169842A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for selecting object within a group of objects
WO2013169865A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
WO2013169846A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for displaying additional information in response to a user contact
EP3264252B1 (en) 2012-05-09 2019-11-27 Apple Inc. Device, method, and graphical user interface for performing an operation in accordance with a selected mode of operation
EP2847659B1 (en) 2012-05-09 2019-09-04 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
CN109298789B (en) 2012-05-09 2021-12-31 苹果公司 Device, method and graphical user interface for providing feedback on activation status
KR101806350B1 (en) 2012-05-09 2017-12-07 애플 인크. Device, method, and graphical user interface for selecting user interface objects
WO2013169851A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for facilitating user interaction with controls in a user interface
AU2013259613B2 (en) 2012-05-09 2016-07-21 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
KR101867513B1 (en) * 2012-05-29 2018-06-15 엘지전자 주식회사 Mobile terminal and control method thereof
US9696879B2 (en) * 2012-09-07 2017-07-04 Google Inc. Tab scrubbing using navigation gestures
US9671233B2 (en) 2012-11-08 2017-06-06 Uber Technologies, Inc. Dynamically providing position information of a transit object to a computing device
CN102968274A (en) * 2012-11-22 2013-03-13 广东欧珀移动通信有限公司 Free screen capturing method and free screen capturing system in mobile device
USD741895S1 (en) * 2012-12-18 2015-10-27 2236008 Ontario Inc. Display screen or portion thereof with graphical user interface
AU2013368441B2 (en) 2012-12-29 2016-04-14 Apple Inc. Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture
CN107831991B (en) 2012-12-29 2020-11-27 苹果公司 Device, method and graphical user interface for determining whether to scroll or select content
US9967524B2 (en) * 2013-01-10 2018-05-08 Tyco Safety Products Canada Ltd. Security system and method with scrolling feeds watchlist
USD704728S1 (en) 2013-02-25 2014-05-13 Pepsico, Inc. Display screen with graphical user interface
USD701875S1 (en) 2013-02-25 2014-04-01 Pepsico, Inc. Display screen with graphical user interface
USD701876S1 (en) 2013-02-25 2014-04-01 Pepsico, Inc. Display screen with graphical user interface
USD707700S1 (en) 2013-02-25 2014-06-24 Pepsico, Inc. Display screen with graphical user interface
USD707701S1 (en) 2013-02-25 2014-06-24 Pepsico, Inc. Display screen with graphical user interface
US9369778B2 (en) * 2013-03-06 2016-06-14 Yahoo! Inc. Video advertisement wall
US10220303B1 (en) 2013-03-15 2019-03-05 Harmonix Music Systems, Inc. Gesture-based music game
US9450952B2 (en) 2013-05-29 2016-09-20 Microsoft Technology Licensing, Llc Live tiles without application-code execution
USD741350S1 (en) 2013-06-10 2015-10-20 Apple Inc. Display screen or portion thereof with animated graphical user interface
KR102076076B1 (en) * 2013-10-11 2020-02-12 (주)휴맥스 Methods and apparatuses of representing content information using sectional notification methods
EP3063608B1 (en) 2013-10-30 2020-02-12 Apple Inc. Displaying relevant user interface objects
EP3126969A4 (en) 2014-04-04 2017-04-12 Microsoft Technology Licensing, LLC Expandable application representation
CN105359055A (en) 2014-04-10 2016-02-24 微软技术许可有限责任公司 Slider cover for computing device
KR102107275B1 (en) 2014-04-10 2020-05-06 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 Collapsible shell cover for computing device
US9880705B2 (en) * 2014-04-28 2018-01-30 Google Llc Methods, systems, and media for navigating a user interface using directional controls
KR102284134B1 (en) * 2014-05-28 2021-07-30 삼성전자주식회사 Display apparatus for displaying and method thereof
US10678412B2 (en) 2014-07-31 2020-06-09 Microsoft Technology Licensing, Llc Dynamic joint dividers for application windows
US10254942B2 (en) 2014-07-31 2019-04-09 Microsoft Technology Licensing, Llc Adaptive sizing and positioning of application windows
US10592080B2 (en) 2014-07-31 2020-03-17 Microsoft Technology Licensing, Llc Assisted presentation of application windows
US10642365B2 (en) 2014-09-09 2020-05-05 Microsoft Technology Licensing, Llc Parametric inertia and APIs
CN106662891B (en) 2014-10-30 2019-10-11 微软技术许可有限责任公司 Multi-configuration input equipment
KR102318610B1 (en) * 2015-01-30 2021-10-28 삼성전자주식회사 Mobile device and displaying method thereof
US10026506B1 (en) 2015-02-06 2018-07-17 Brain Trust Innovations I, Llc System, RFID chip, server and method for capturing vehicle data
JP2016157292A (en) * 2015-02-25 2016-09-01 株式会社キャストルーム Content reproduction device, content reproduction system, and program
US9645732B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US10067653B2 (en) 2015-04-01 2018-09-04 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US20170045981A1 (en) 2015-08-10 2017-02-16 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9860451B2 (en) 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
RU2607611C2 (en) * 2015-06-11 2017-01-10 Нокиа Текнолоджиз Ой User interface
US9652125B2 (en) 2015-06-18 2017-05-16 Apple Inc. Device, method, and graphical user interface for navigating media content
JP2017027258A (en) * 2015-07-17 2017-02-02 フリュー株式会社 Information distribution device, communication terminal, information distribution system, information distribution device control method, communication terminal control method, control program, and recording medium
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10416800B2 (en) 2015-08-10 2019-09-17 Apple Inc. Devices, methods, and graphical user interfaces for adjusting user interface objects
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US9990113B2 (en) 2015-09-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for moving a current focus using a touch-sensitive remote control
US9928029B2 (en) 2015-09-08 2018-03-27 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
USD814507S1 (en) * 2015-11-06 2018-04-03 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
USD813901S1 (en) * 2015-11-06 2018-03-27 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
USD792905S1 (en) 2016-04-01 2017-07-25 Aristocrat Technologies Australia Pty Limited Display screen or portion thereof with transitional graphical user interface
DK201670595A1 (en) 2016-06-11 2018-01-22 Apple Inc Configuring context-specific user interfaces
US11816325B2 (en) 2016-06-12 2023-11-14 Apple Inc. Application shortcuts for carplay
USD936663S1 (en) 2017-06-04 2021-11-23 Apple Inc. Display screen or portion thereof with graphical user interface
USD857033S1 (en) 2017-11-07 2019-08-20 Apple Inc. Electronic device with graphical user interface
US11922006B2 (en) 2018-06-03 2024-03-05 Apple Inc. Media control for screensavers on an electronic device
JP7115219B2 (en) * 2018-10-26 2022-08-09 セイコーエプソン株式会社 Display method and display device
CN109656639B (en) * 2018-12-25 2022-04-15 深圳创维数字技术有限公司 Interface rolling method, device, equipment and medium
USD929440S1 (en) 2019-04-19 2021-08-31 Pepsico, Inc. Display screen or portion thereof with animated graphical user interface
US11675476B2 (en) 2019-05-05 2023-06-13 Apple Inc. User interfaces for widgets
CN111698557B (en) * 2019-07-12 2022-06-24 青岛海信传媒网络技术有限公司 User interface display method and display equipment
US11093108B2 (en) 2019-07-12 2021-08-17 Qingdao Hisense Media Networks Ltd. Method for displaying user interface and display device
JP7331517B2 (en) * 2019-07-23 2023-08-23 セイコーエプソン株式会社 Display method and display device
US11543945B1 (en) * 2020-03-30 2023-01-03 Amazon Technologies, Inc. Accurate local depiction of preview of a program window included in a remote graphical desktop
JP2022027108A (en) * 2020-07-31 2022-02-10 セイコーエプソン株式会社 Image display method, image display device, and display control program
JP2022169973A (en) * 2021-04-28 2022-11-10 セイコーエプソン株式会社 Display control method, display control program, and display control device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1148412A2 (en) * 2000-04-21 2001-10-24 Sony Corporation Managing Data Objects
JP2003330587A (en) * 2002-05-17 2003-11-21 Hitachi Ltd Personal digital assistant device and its operation displaying method
US20040261031A1 (en) 2003-06-23 2004-12-23 Nokia Corporation Context dependent auxiliary menu elements

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3320197B2 (en) * 1994-05-09 2002-09-03 キヤノン株式会社 Image editing apparatus and method
DE69534331T2 (en) * 1994-07-28 2006-01-12 Xerox Corp. Method and device for highlighting the detail of a tree structure
US5880733A (en) * 1996-04-30 1999-03-09 Microsoft Corporation Display system and method for displaying windows of an operating system to provide a three-dimensional workspace for a computer system
US6028600A (en) * 1997-06-02 2000-02-22 Sony Corporation Rotary menu wheel interface
EP1014257A4 (en) * 1997-08-12 2000-10-04 Matsushita Electric Ind Co Ltd Window display
US6266098B1 (en) * 1997-10-22 2001-07-24 Matsushita Electric Corporation Of America Function presentation and selection using a rotatable function menu
GB0027260D0 (en) * 2000-11-08 2000-12-27 Koninl Philips Electronics Nv An image control system
JP2000105772A (en) * 1998-07-28 2000-04-11 Sharp Corp Information managing device
WO2000033572A1 (en) * 1998-11-30 2000-06-08 Sony Corporation Information providing device and method
US6515656B1 (en) * 1999-04-14 2003-02-04 Verizon Laboratories Inc. Synchronized spatial-temporal browsing of images for assessment of content
US7263667B1 (en) * 1999-06-09 2007-08-28 Microsoft Corporation Methods, apparatus and data structures for providing a user interface which facilitates decision making
JP2003528377A (en) * 2000-03-17 2003-09-24 ビジブル. コム インコーポレーティッド 3D space user interface
JP4235393B2 (en) * 2002-03-11 2009-03-11 富士フイルム株式会社 Index image display control device
SE0202664L (en) 2002-09-09 2003-11-04 Zenterio Ab Graphical user interface for navigation and selection from various selectable options presented on a monitor
US20040169688A1 (en) * 2003-02-27 2004-09-02 Microsoft Corporation Multi-directional display and navigation of hierarchical data and optimization of display area consumption
JP4800953B2 (en) 2003-05-15 2011-10-26 コムキャスト ケーブル ホールディングス,エルエルシー Video playback method and system
FI20031433A (en) * 2003-10-03 2005-04-04 Nokia Corp Method for creating menus
US6990637B2 (en) * 2003-10-23 2006-01-24 Microsoft Corporation Graphical user interface for 3-dimensional view of a data collection based on an attribute of the data
US7614007B2 (en) * 2004-01-16 2009-11-03 International Business Machines Corporation Executing multiple file management operations
AU2005203074A1 (en) * 2005-07-14 2007-02-01 Canon Information Systems Research Australia Pty Ltd Image browser
EP1883020B1 (en) * 2006-07-28 2013-05-22 Dassault Systèmes Method and system for navigating in a database of a computer system
US8104048B2 (en) * 2006-08-04 2012-01-24 Apple Inc. Browsing or searching user interfaces and other aspects
US8564543B2 (en) * 2006-09-11 2013-10-22 Apple Inc. Media player with imaged based browsing

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1148412A2 (en) * 2000-04-21 2001-10-24 Sony Corporation Managing Data Objects
JP2003330587A (en) * 2002-05-17 2003-11-21 Hitachi Ltd Personal digital assistant device and its operation displaying method
US20040261031A1 (en) 2003-06-23 2004-12-23 Nokia Corporation Context dependent auxiliary menu elements

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 2003, no. 12 5 December 2003 (2003-12-05) *

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008142614A1 (en) * 2007-05-24 2008-11-27 Nokia Corporation Webpage history view
US8578297B2 (en) 2007-12-20 2013-11-05 Canon Kabushiki Kaisha Method of browsing media items using thumbnails
US8631351B2 (en) 2008-06-29 2014-01-14 Microsoft Corporation Providing multiple degrees of context for content consumed on computers and media players
EP2443542A4 (en) * 2009-06-19 2014-07-23 Google Inc User interface visualizations
EP2439937A1 (en) * 2010-10-11 2012-04-11 France Telecom Method for communicating a big amount of information on a unique screen
FR2965945A1 (en) * 2010-10-11 2012-04-13 France Telecom MONO-SCREEN DISPLAY OF A LARGE QUANTITY OF INFORMATION
CN103226397A (en) * 2012-01-25 2013-07-31 三星电子株式会社 Method for operating three-dimensional handler and terminal supporting the same
EP2620859A1 (en) * 2012-01-25 2013-07-31 Samsung Electronics Co., Ltd Method for operating three-dimensional handler and terminal supporting the same
AU2013200323B2 (en) * 2012-01-25 2015-11-05 Samsung Electronics Co., Ltd. Method for operating three-dimensional handler and terminal supporting the same
US9552671B2 (en) 2012-01-25 2017-01-24 Samsung Electronics Co., Ltd. Method for operating three-dimensional handler and terminal supporting the same
US10613731B2 (en) 2014-05-08 2020-04-07 Naver Corporation Apparatus and method for displaying information on web page based on scrolling speed
US10430027B2 (en) 2014-09-29 2019-10-01 Ntt Docomo, Inc. Display control device, program, and image display method
WO2016195940A3 (en) * 2015-06-05 2017-01-12 Apple Inc. Synchronized content scrubber
US10871868B2 (en) 2015-06-05 2020-12-22 Apple Inc. Synchronized content scrubber
WO2017209584A1 (en) 2016-06-03 2017-12-07 Samsung Electronics Co., Ltd. Method and apparatus for displaying content

Also Published As

Publication number Publication date
EP1886210A1 (en) 2008-02-13
US7797641B2 (en) 2010-09-14
US20060268100A1 (en) 2006-11-30
RU2007145218A (en) 2009-07-10
EP1886210B1 (en) 2018-11-14
JP2008542867A (en) 2008-11-27

Similar Documents

Publication Publication Date Title
EP1886210B1 (en) Improved graphical user interface for mobile communications terminal
EP2192471B1 (en) Improved graphical user interface for mobile communications terminal
EP1677182B1 (en) Display method, portable terminal device, and display program
KR100955253B1 (en) Method and apparatus for interaction with a user interface
JP4243344B2 (en) Mobile communication equipment
KR100959572B1 (en) Re-configuring the standby screen of an electronic device
TWI279720B (en) Mobile communications terminal having an improved user interface and method therefor
EP1104151A2 (en) Mobile station having improved user interface providing application management and other functions
JP5166874B2 (en) Terminal device and program
JP2008525907A (en) Mobile terminal with improved user interface and related method
CN101622593A (en) Multi-state unified pie user interface
JP2000316190A (en) Handset
JP3278628B2 (en) Mobile phone
JP2005352943A (en) Information terminal and display control program
US20040113955A1 (en) Mobile information terminal
JP4347603B2 (en) Display device
JP2000299728A (en) Handset
JP2006211266A (en) Mobile phone
KR20060078775A (en) Ui changing method of mobile phone
JP2002175140A (en) Information processor, menu display method and program storage medium
JP4794750B2 (en) Data display device and data display method
KR101452758B1 (en) Screen display device and method of mobile communication terminal
JP2004295600A (en) Menu selecting device and menu selection method
JP2002342005A (en) Character input method and character input device
JP2002183020A (en) Access management method and portable terminal using the method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 8370/DELNP/2007

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2008512933

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: DE

WWE Wipo information: entry into national phase

Ref document number: 2006755881

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007145218

Country of ref document: RU

WWP Wipo information: published in national office

Ref document number: 2006755881

Country of ref document: EP