|Publication number||US7979801 B2|
|Application number||US 11/428,074|
|Publication date||Jul 12, 2011|
|Filing date||Jun 30, 2006|
|Priority date||Jun 30, 2006|
|Also published as||US20080005652|
|Publication number||11428074, 428074, US 7979801 B2, US 7979801B2, US-B2-7979801, US7979801 B2, US7979801B2|
|Inventors||Vinay Krishnaswamy, Stephane Comeau, Patrick Schreiber, Ramraj Rajkumar|
|Original Assignee||Microsoft Corporation|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (44), Non-Patent Citations (10), Referenced by (16), Classifications (11), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
Slide show applications allow users to generate and display one or more images in sequence. The sequence of images forms a slide show and may have a message or theme, such as a business theme. Some slide show applications allow a user to insert media into one or more images. The media may include text, images or video and may be associated with a hyperlink. In this case, if a user viewing the presentation selects the hyperlink associated with the media, the slide show may perform a task. The task may include navigating to a particular slide, navigating to a web page, or opening up a file using an application corresponding to the file.
The scope of the interactivity provided by slide show applications is limited. An author of a slide show is constrained by structured slideshow authoring templates when generating a slide show. As such, applications for generating a slide show limit a user's choices and freedom when constructing a slide show. Further, slide shows are not suitable for interactive presentations. They are designed for one-way communication of information to an audience. Though a presenter may manipulate slide show features to enhance a slide show experience, slide show applications do not allow for much individual interactivity for members of an audience.
The present technology, roughly described, provides an application for authoring and playback of multi-media presentations. A presentation may include one or more interactive pages of media. The media may include video, text, images, or other content. During playback, the application allows a user to select media in a page of the presentation. In response to receiving input, the application may change the media presented in the current page or provide a new page. A user may thereby explore new media content and navigate through different presentation pages by providing input during playback of a presentation.
Media elements of the presentation may be tagged meta-data. The elements may be considered modules which contain media. An element or module that is tagged is one that contains tag meta-data. Tagged media elements may generate a tag event in response to being selected during playback, perform an action when a tag event occurs, or both. Tag events may be differentiated from each other by tag meta-data associated with the tag. Thus, media elements may perform an action in response to a tag event that has matching meta-data. In some embodiments, other presentation objects may be associated with tags (e.g., contain meta-data associated with a tag) as well.
One embodiment includes providing an interface for authoring a presentation. The authored presentation may have two or more modules contained in at least one frame. A first tag may be selected from a list of tags through the interface in order to add the first tag to a first module. Additionally, the interface can be used to select an action for a second module. The action is configured to be performed by the second module in response to selecting the first module (or any other module having the first tag) during playback of the presentation. When selected during playback, the first module having the first tag data communicates the first tag data to an event handler as part of a triggered tag event. The event handler receives the first tag data, accesses a tag event-action table, and identifies one or more modules (e.g., the second module) configured to perform an action in response to the triggered tag event. Once identified, the one or more modules configured to perform an action in response to the tag event are called by the event handler to perform the actions.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
An application is used to author and/or playback multi-media presentations. A presentation may include one or more interactive pages of video, text, images, or other media. During playback of a presentation, a user may select media in a page of the presentation. In response to receiving the input, the application may change the media presented in the current page of the presentation or provide a new page. A user may thereby explore the media provided in each page and/or navigate between different pages of a presentation during playback.
As discussed herein, a presentation may be comprised of one or more single page frames. Each frame may include one or more modules. Each module may consist of video, images, text or some other type of media. The media of a module may be provided to a user during playback of the presentation. In one embodiment, frames and modules are presentation objects (or objects) which comprise a presentation.
Some media elements of the presentation may be tagged with meta-data. Tagged media elements or modules may either generate a tag event in response to being selected during playback, perform an action when a particular tag event occurs, or both. Tag events are differentiated from each other by meta-data associated with each tag. In this case, media modules may perform an action in response to a tag event having a particular meta-data.
Meta-data added to a module or other presentation object may include a tag name, tag group and/or other tag data. For example, two image modules may contain an image of former United States Presidents Abraham Lincoln and George Washington, respectively. The modules may be tagged with tag name meta-data of “Lincoln” and “Washington”, respectively, and each has tag group meta-data of “Presidents.” User selection of either module during presentation playback would generate a tag event with tag group meta-data of “presidents.” Each module would also generate a tag event with meta-data according to its corresponding tag name.
In another example, a presentation may be a multi-page history tutorial. Each page in the tutorial may be implemented as a one page frame. Each frame may comprise a portion of the tutorial and include one or more modules containing media. For example, the first frame provided to a user during presentation playback may be a greeting page. The greeting page may include text indicating the name of the history tutorial, an image associated with the subject matter of the history tutorial (e.g., for a history tutorial of American Presidents, an image of George Washington may be provided), several images of “buttons” associated with different actions that can be selected by a user from the greeting page, and text associated with each button (e.g., text that reads “new tutorial,” “load saved tutorial,” etc.). Upon receiving input selecting one of the buttons or other modules of the greeting page, a user may navigate to other presentation pages and proceed through the history tutorial.
A presentation object (i.e., a frame or a module) may trigger a tag event in response to a user initiated event or an internal event. User initiated events are associated with received user input, such as user input that selects a module. Internal events may include completion of a timer, loading a module or some other internal event. In some cases, an object may be able to trigger more than one event. For example, placing a cursor over a module may trigger a tag event with meta-data of “Presidents,” while selecting the module with a single click of a mouse device may trigger a tag event with meta-data of “Lincoln.”
An object may perform different actions in response to different tag events. The different actions may be performed in response to detecting tag events with different meta-data. For example, a module may be associated with several images, each of which may be provided as an action performed by a module. Thus, the module may provide an image of president George Washington upon detection of a tag event with meta-data of “Washington,” or provide an image of president Abraham Lincoln upon detection of a tag event with meta-data of “Lincoln.” Processing of tag events is discussed in more detail below.
In one embodiment, an interface is provided for authoring a presentation having two or more modules contained in at least one frame. Though the authoring interface, a user may select a first tag from a list of tags to add to a first module. A user may also select an action for a second module through the interface. The action can be performed in response to selecting the first module having the first tag during playback of the presentation. When selected during playback, the first module having the first tag communicates first tag data to an event handler as part of a triggered tag event. The event handler receives the first tag data and identifies other modules configured to perform an action in response to the tag event, such as the second module. Once identified, modules configured to perform an action in response to the tag event are called to perform the actions.
Authoring and playback of a presentation of the present technology is performed differently than the authoring and playback of slideshows in common slideshow applications. Common slide show applications allow a user to insert media into one or more pages of a slideshow. The media may include text, images or video and may be associated with a hyperlink. In this case, if a user viewing the slideshow selects the hyperlink associated with the inserted media, the slide show may navigate to a particular slide, navigate to a web page, play a video or open a file (such as a word processor file) using the native application for the file. Thus, a media element in a page of a common slideshow may be directly linked to one other media element on the page, another page in the presentation, or to a file. Slide show applications limit a user's choices and freedom when constructing a slide show and the experience provided when viewing a slideshow with this one to one direct link between elements. Unlike common slideshow applications, a presentation of the present technology does not implement a direct link between modules that are selected and those that perform an action. Rather, an event handler (frame manager 246) receives triggered event data (tag data), determines actions to be performed in response to the triggered event, and calls the actions.
In some embodiments, the present technology allows a module to be configured with tag data and trigger a tag event when selected. As a result of the tag event, tag data such as meta-data is sent from the selected module to frame manager 246. Frame manager 246 receives the tag data and accesses a table to identify modules configured to perform an action in response to the triggered tag event. In particular, frame manager 246 determines if any modules are configured to perform an action for the particular tag data received by frame manager 246. For example, if frame manager receives tag data consisting of “Washington,” frame manager will check a tag event-action table to determine if any modules are configured to perform an action in response to a tag event containing the data “Washington.” Once one or more modules are identified from the table, frame manager 246 sends a call to the corresponding modules for the action(s) to be performed. Thus, rather than implementing a single direct link from one module to another module or frame, the present technology allows modules to send events to frame manager 246 without any information as to what action the event will trigger. Frame manager 246 then determines what the triggered action is and calls that action. This allows for an expandable, dynamic authoring and playback system and is not limited by a single link between modules.
Additionally, the data transferred in response to a user selection in an application of the current technology differs from that of common slideshow applications. As discussed in more detail below, tag data which is sent to frame manager 246 when a module is selected may be any data entered by a user. For example, the tag data may be “country”, “Washington” “my dog” or any other string of data. The tag data does not have to be a hyper link, a location or name of another module or file, or any other information which identifies another module. Though tag data is added to one or more modules, the data may be module and media independent—the data is created by a user, not derived from the module or media itself or its location.
Presentation application 112 includes authoring engine 114 and playback engine 116. In some embodiments, authoring engine 114 and playback engine 116 may be implemented using the same software components. An example of presentation application 112 is discussed in more detail below with the respective
Presentation file 118 contains data associated with each frame and module of a presentation. In one embodiment, presentation file 118 includes data in XML format. For each frame in a presentation, the frame data may include information such as background color of the frame, the number of module slots for the frame (indicating the number of modules which are in the frame), tag meta data associated with the frame, and other data. Frame data may also include module data and media data. The module data may include data for each module contained in the particular frame. Module data may include a reference to the media content provided in the frame during playback (image file name, video file name, actual text, a URL to an image or video not contained in the presentation file or other reference), a list of actions that can be performed by the module (e.g., play video, stop video, show image, remove image) during playback, one or more events for which the module will perform an action in response to, tag meta-data configuration information, and/or other data. Tag meta data included in module data of presentation file 118 is discussed in more detail below. Media data included within a presentation file may include data for one or more images, videos, text or other media content provided in a module during playback. In some cases, the media provided by a module during playback may not be contained in a presentation file. In this case, the location of the media may be referenced in file 118. For example, media content of file 118 may be accessed from user data store 122 over network 130.
Presentation manager 244 initializes content manager 249 and frame manager 246. Initialization of managers 249 and 246 may occur upon authoring a presentation file. In some embodiments, presentation manager 244 manages a presentation object associated with the presentation. In this case, when a new presentation file is loaded, presentation manager 244 determines a first activity (the “home” activity) and first frame within the first activity to provide during playback of the presentation. The first activity and frame is then communicated to frame manager 246. As subsequent activities are to be played, presentation manager 244 provides the activities to frame manager 246. Operation of presentation manager 244 is discussed in more detail below.
Activity manager 242 is in communication with presentation manger 244 and frame manager 246, and configures activity data for a presentation. In some embodiments, activity manager 242 also handles the execution of rules within an activity. For example, when a frame implements a quiz, and user selection of presentation modules is to be saved and processed, frame manager 242 stores the received user input and processes the input according to the rule logic. Content manager 249 stores, saves, loads and otherwise processes presentation data. In particular, content manager 249 loads a presentation file to be modified or played, retrieves information from the presentation file and provides the information to presentation manager 244.
Frame manager 246 handles frame transitions, module transitions, module tot module action-event processing, tag action and event processing and other frame tasks. In some embodiments, frame manager 246 tracks the current frame and receives frame events, module events and module state information. Receiving events may include receiving data from a presentation module, parsing the received data and calling an appropriate action on behalf of the presentation module. Because frame manager 246 processes module based events and actions and tag-based events and actions, frame manager 246 may serve as and/or be considered to operate as an event manager. Processing of module events is discussed in more detail below.
Frame manager 246 also handles processing of tag-related events and actions. Frame manager 246 determines whether a module, frame or other presentation object being loaded for display during playback is configured with a tag. If so, frame manager 246 reads the meta-data associated with the tag. After reading the meta-data associated with the tag, frame manager 246 determines that a tag event has occurred and if any presentation object is configured to perform an action in response to the tag event. In one embodiment, frame manager 246 accesses a tag event-action list to determine if any objects are configured to perform an action in response to the tag event. If so, frame manager 246 invokes the corresponding object to perform the action in response to loading the tag. Processing tag-related events and actions during playback is discussed in more detail below with respect to
Transition manager 248 handles transitions between frames in a presentation. In some embodiments, handling frame transitions includes receiving the current frame and next frame from frame manager 246, ending the presentation modules of the current frame, loading the next frame and presentation modules of the next frame, and resuming any presentation modules of the previous frame which are configured as persistent presentation modules. This is discussed in more detail below with respect to step 1365 of
The technology is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the technology include, but are not limited to, personal computers, server computers, hand-held or laptop devices, cell phones, smart phones, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
The technology may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The technology may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
With reference to
Computer 310 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer 310 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by computer 310. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.
The system memory 330 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 331 and random access memory (RAM) 332. A basic input/output system 333 (BIOS), containing the basic routines that help to transfer information between elements within computer 310, such as during start-up, is typically stored in ROM 331. RAM 332 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 320. By way of example, and not limitation,
The computer 310 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only,
The drives and their associated computer storage media discussed above and illustrated in
The computer 310 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 380. The remote computer 380 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 310, although only a memory storage device 381 has been illustrated in
When used in a LAN networking environment, the computer 310 is connected to the LAN 371 through a network interface or adapter 370. When used in a WAN networking environment, the computer 310 typically includes a modem 372 or other means for establishing communications over the WAN 373, such as the Internet. The modem 372, which may be internal or external, may be connected to the system bus 321 via the user input interface 360, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 310, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation,
After authoring the presentation, the presentation may be saved at step 420. In one embodiment, saving the presentation includes generating a presentation file. The presentation file may include data comprising the presentation activities, frames, modules, module to module action-event data, tag meta data, and other data. Once generated, the presentation file may be distributed such that the presentation can be played by other users.
A saved presentation file can be played at step 430. Playback of the presentation may include loading the presentation, instantiating presentation objects, and playback of the presentation by presentation application 112. During playback, presentation application 112 may receive user input selecting different modules. In response to the received user input, a user may accomplish tasks, experience media of different frames and navigate through the presentation. Presentation playback is discussed in more detail below with respect to
Next, a determination is made as to whether an existing presentation file should be loaded at step 520. In one embodiment, presentation application 112 determines if user input is received through authoring interface 119 to generate a new presentation or select an existing presentation. If a new presentation is to be generated, the flowchart of
If an existing presentation file is to be loaded, a presentation file is loaded at step 540. In one embodiment, step 540 may include receiving input through authoring interface 119 selecting a presentation file, loading the selected file, extracting presentation data from the loaded file, and populating authoring interface 119 with presentation data from the file. Loading an existing presentation file is discussed in more detail below with respect to
A user may edit a presentation at step 550. Editing a presentation may include adding, removing or changing presentation activities, frames or modules. Editing may also include configuring module actions and events as well as tag meta-data actions and events. A user may edit a presentation through authoring interface 119. Editing a presentation is discussed in more detail below with respect to
After editing the presentation, a determination is made as to whether the presentation being edited should be saved at step 560. In some embodiments, a presentation should be saved if user input is received through authoring interface 119 indicating the presentation should be saved. In some embodiments, presentation application 112 may automatically save a presentation file in response to a timer event. If at step 560 the presentation is not to be filed, the flowchart of
In one embodiment, content manager 249 may collect the information needed to save the presentation and generate a presentation file. An example of the format or outline of a presentation file is below.
The PackageFile.gxml file is the main manifest file for the presentation. The Activity_Info.xml portion of the file contains data for an activity. The Layout.xaml file contains layout data for a frame, such as the number of modules in the frame, the position of the modules, a background color of the frame, and other data. The Video—1_Property.xml, GamelBtn—2_Property.xml and Game2Btn—3_Property.xml files contain information specific to their corresponding presentation modules, such as identification of the media to present in the module, actions able to be performed by the module, events which when triggered the module will perform an action, meta-data associated with the module, and other data. The back and front persistent frames folders may contain data for the background and foreground of persistent frames provided throughout presentation playback. Media included in either persistent frame may include header and/or footer data to be provided throughout a presentation, background or foreground color information, and other data. The resources folder file contains a list of resources required for the activities of the presentation. For example, the resources folder may contain a list of videos that are included in the presentation, a reference to the images included in the modules of the presentation, and other media files.
A new module object is generated within the new frame object at step 640. The new module object may be generated by frame manager 246 and include default data regarding module size, module position, and other data. After generating a new module, authoring interface 119 is populated with new presentation objects at step 640. Authoring interface 119 is populated with data generated in steps 610-640.
In some embodiments, a new presentation may be generated with a number of objects. These objects may be configured or maintained by content manager 249. The base object is a presentation object. The presentation object may contain the default presentation level settings and properties as well as an initial activity object. In some embodiments, the activity object represents a single activity, a collection of frame objects and a number of methods to add and delete frames. When a new presentation is provided in an authoring interface, the initial frame may be selected in a frame navigator window within an authoring interface. This is discussed in more detail below with respect to
In some cases, rather than create a new presentation file as discussed above with respect to
Activity, frame and module objects are instantiated with presentation file data at step 730. The objects are instantiated by frame manager 246 with data extracted from the presentation file at step 720. Next, authoring interface 119 is populated with presentation objects at step 740. The presentation objects instantiated with the extracted presentation data at step 730 are provided to presentation manager 244, which provides the objects to frame manager 246. Presentation manager 244 and frame manager 246 then populate the authoring interface with the instantiated objects (such as activity objects, frame objects, and module wrapper objects). After authoring interface 119 is populated with presentation data, the presentation may be edited by a use through the interface.
First, authoring interface 119 is provided for authoring a presentation by presentation application 112 at step 805. Interface 119 may be populated with a new or saved presentation file as discussed above with respect to
A determination is made by authoring engine 114 as to whether a frame should be added to a presentation at step 820. If no frame should be added to a presentation, the process continues to step 830. In some embodiments, a frame should be added to a presentation if user input is received through authoring interface 119 to add a frame. If a frame should be added to a presentation, a frame object is configured at step 825. In one embodiment, configuring a new frame includes configuring a background frame, foreground frame and default frame data, such as the default number of module slots in the frame, actions that may be called on the frame, and other information. After adding and configuring a new frame, the process of
A determination is made by authoring engine 114 as to whether a module should be added to a frame of a presentation at step 830. In some embodiments, a module should be added to a presentation if user input is received through authoring interface 119 to add the module. If a module should be added, a module object is added and configured at step 835. Configuring a new module object may include configuring the module as persistent or not, configuring module properties such as size, cropping, position and other data, selecting events to be generated by the module, selecting default actions that the module may call on other components of the presentation, and other configurations. After adding and configuring a new module, the process of
A determination is made by authoring engine 114 as to whether a module event should be associated with an action at step 840. In one embodiment, an event can be associated with an action in response to user input received through authoring interface 119. Configuring an event with a module action is discussed in more detail below with respect to
A determination is made by authoring engine 114 as to whether a tag should be associated with a presentation object at step 850. The presentation object may be a presentation activity, frame, or module. Associating a tag with a presentation object may include adding tag data to a presentation object and/or configuring an object to perform an action upon a tag being loaded. Associating a tag with a presentation object is discussed in more detail below with respect to
Module caller 920 may call actions on other presentation modules. In some embodiments, a presentation module may include one or more methods that implement module events and actions. Module events may be triggered by internal module processes or in response to user input. Examples of user input that initiates an event includes a right click selection of the presentation module, left click selection of the presentation module, positioning a cursor over the presentation module or some other event. Examples of internally generated events include expiration of a timer, completion of a video, and other events. Triggered module events are represented in
A presentation module may call actions on other presentation modules. Actions called by presentation module 910 are represented in
In some embodiments, events and actions may include a parameter. For example, a “final score( )” event may include an integer parameter which indicates a score. Similarly, a “start module video” action may include a parameter of time, indicating at what point the video should be started (e.g., a parameter value of ten may indicate the video should start ten seconds from the beginning).
In some embodiments, an action may be performing a rule. The rule may be implemented by code and have an input, engine and output. The rule input may specify a presentation module or global variable. The rule engine may state a condition or calculation that must be met in order for an output to occur. The rule output may comprise an action, another rule or a change in a variable. For example, a rule may comprise logic of “if score is more than five, start second frame.” In this case, the score is the input, determining if the score is over five is the engine, and starting a second frame is the output. Rule logic may be saved as part of a module objects within a frame object.
After receiving a selection of a triggering module event, an action is selected to correspond to the selected event at step 1030. In one embodiment, in response to receiving a selection of an event, authoring interface 119 may provide a list of actions that the presentation module may perform. A user may select one of the listed actions to associate it with the event selected at step 1020. In some embodiments, upon selecting an event at step 1020, a user may drag the selected presentation module into another presentation module of the current frame, or into another frame. By dragging the current module into a second module, a user indicates that second module should be invoked when the selected event is triggered in the current module.
After receiving selection of the triggering event and corresponding module action, the event and action association are stored at step 1040. In one embodiment, the event-action data is stored within the frame object associated with the selected module. The event-action data includes the selected module, the triggering event, and the corresponding action the module will perform. Frame manager 246 saves the event-action data to the frame object during authoring and processes the events and actions during presentation playback.
For purposes of discussion, the process of
The process of
Meta-data is received for the module to include the tag at step 1110. The meta-data may include tag name data and optionally tag group data and be received through authoring interface 119. In one embodiment, presentation application 112 may maintain a list of tag names. When a user provides input selecting to add a tag to an object, authoring interface 119 provides a list of available tags to the user. The user may select a tag from the provided list or create a new tag. When creating a new tag, a user may type tag information into authoring interface 119. In some embodiments, more than one tag may be associated with a tag group. For example, several image modules may have a tag name of a country in which they provide an image for (e.g., tag names of “United States,” “Afghanistan,” and “Germany”). However, each of them may include tag group information of “country.” To add more than one tag to a module, step 1110 can be performed two or more times before proceeding to step 1115.
Next, the tag meta-data is added to the module object at step 1115. The tag meta-data is added to the module object by frame manager 246. In one embodiment, the module object is in XML code. In this case, the tag meta-data is added to the XML code comprising the module object. After the tag meta-data is added to the module object, a determination is made as to whether the added tag is a new tag at step 1120. In one embodiment, authoring engine 114 compares the tag name added at step 1115 to tags contained in a tag list accessed by presentation application 112. In some embodiments, the tag list is stored as part of the presentation file. If the added tag is contained in the tag list, the process of
A determination is made by authoring engine 114 as to whether a module should be configured to perform an action in response to a triggered tag event at step 1130. In one embodiment, a module action should be configured if input is received through authoring interface 119 indicating that a module should be configured accordingly. If no module is to be configured to perform an action in response to a tag event, the process of
The module object to configure with the tag-based action is selected at step 1135. The module may be selected through authoring interface 119 provided by authoring engine 114. Next, a module action is selected to associate with the tag event at step 1140. In one embodiment, the action may be selected from a module action list. As discussed above, each module object includes a list of actions it may perform. The actions can be based on the media content associated with the module as well as other module features. For example, the actions may include start video, pause video, stop video, show image, hide image, start audio, end audio, show text, hide text, and other actions. Frame manager 246 may access the module action list from each module object and provide it in authoring interface 119. The list of module actions can be provided to a user in a drop down menu or in some other format.
After selecting a module action, a tag event is identified to trigger a module object action at step 1145. As discussed above, a tag event occurs when a module having tag meta-data is selected. When selected, the module provides its tag meta-data to frame manager 246. Frame manager 246 then determines if any other modules are configured to perform an action in response to a tag event for the particular tag meta-data. Thus, identifying a tag event in step 1145 includes identifying tag meta-data such that if another module with the tag meta-data is selected, the present module will perform an action in response to the selection. Thus, when a second module performs a tag action in response to a tag event triggered by a first module, the first and second modules do not communicate directly with each other and are not directly linked together. Rather, they are associated with the same meta-data.
Identifying a tag event at step 1145 may include receiving a selection of tag meta-data from a list of existing tag meta-data or receiving new tag meta-data. Each frame in a presentation maintains a list of the meta-data contained in the modules of the frame. Authoring engine 114 of presentation application 112 may access the meta-data list maintained in each frame object and provide the list through authoring interface 119. Authoring interface 119 may receive a selection of existing meta-data in the list or allow a user to type in new meta-data. If new tag meta-data is received at step 1145, the meta-data is added to the tag list maintained in the frame object as discussed above at step 1125.
Once the tag is identified, the module action selected at step 1140 is associated with the identified tag event at step 1148. In one embodiment, the association is performed by presentation application 112 automatically in response to completion of steps 1135-1145 by a user through authoring interface 119. The association of the tag event to the module action is maintained by frame manager 246. When the presentation is saved, tag event-action associations are saved within the frame object containing the modules involved with each association. After associating the object action to the selected tag, the process of
Frame navigator 1230 provides a representation of the frames within the current activity. In one embodiment, all frames of a presentation are represented in frame navigator 1230. The frames represented are derived from the information provided by content manager 249. Selection of a frame in frame navigator 1230 causes that frame to be provided in workspace window 1240. In some embodiments, frame navigator 1230 provides a visual indicator on the frame representation associated with the frame currently being edited in workspace window 1240. The visual indicator may include a highlight or some other indicator. In the example embodiment illustrated in
Work space window 1240 may allow a user to edit a selected presentation frame, a module within a selected frame, or some other presentation object. The frame being edited in work space window 1240 is the highlighted frame of frame navigator window 1230. The selected frame is presented in work space window 1240 with its corresponding presentation modules. In some embodiments, a module editing interface may be provided for each presentation module in the provided frame. For example, a module editing interface may provide a user with a list of actions that may be performed in response to detection of an event, a list of tags to associate with the module, and other data that can be used to configure a module. A selected frame and its corresponding presentation modules may be edited and/or modified as discussed above with respect to the flowchart of
Components of presentation application 112 are then initialized with the retrieved presentation data at step 1320. In one embodiment, initialization may include content manager provides the retrieved presentation data to presentation manager 244. Presentation manager 244 may provide frame object data to frame manager 246 and activity object data to activity manager 242. For each module object in the presentation, frame manager 246 may call an initialization command. After calling this command, resources and a state value may be retrieved and/or determined for each presentation module. Resources may be retrieved from the presentation file itself, or from a location indicated within the presentation file. A state value may indicate a state at which the presentation module was saved. For example, if a presentation module includes a video, and half of the video had been previously viewed when the presentation was last saved, the state value would indicate this. In one embodiment, the state value would indicate the time into the video at which the video should be played (e.g., 120 seconds into the video). State values are stored by content manager 249 when generating a presentation file.
The presentation file is played at step 1330. In one embodiment, presentation manager 244 provides the initial activity object, initial frame object and initial module objects to frame manager 246. This initial content is then presented as the beginning of the presentation. After playback begins, input may be received selecting a module during presentation playback at step 1340. In some embodiments, the input may be received selecting a frame containing a module rather than a module itself. The input may include positioning a cursor over the module, providing a right click or left click selection of a module, double click selection of a module, or some other input.
After receiving input, the received input is processed by playback engine 116 at step 1350. This step is optional as indicated by the dashed line comprising step 1350 in the flowchart of
If a module selected by user input triggers a module event, module event data is provided from the module object to the frame object containing the module. The module event data may include the module name and the input received by the module which triggered the event. The frame object then communicates the module event data to frame manager 246. Frame manager 246 accesses the module action-event list for the relevant frame and determines what module within the frame is configured to perform an action in response to the module event. Frame manager 246 then initiates the action by sending a command to the module performing the action.
In some cases, information associated with the received input is stored and processed. This may be applicable for modules that provide a game with a score, a quiz wherein user answers in the form of a text string are processed, or other presentation module functions. In this case, the input may cause a counter to be incremented, an input string to be compared to a stored string, or some other task. In response to the processing of the input received, presentation application 112 may perform some action as discussed above.
After processing the input, a determination is made by playback engine 116 as to whether a frame transition is triggered at step 1360. In some cases, a triggered module event may cause a frame transition. The event may be triggered from the user input receive at step 1350 or from an internal event, such as the expiration of a timer, a video running until completion, or some other event. If a frame transition is triggered at step 1360, the frame transition is performed at step 1365. Frame transitions may be handled by frame manager 246 and transition manager 248. In one embodiment, performing a frame transition includes suspending the currently displayed frame by transition manager 248. While suspending the current frame, transition manager 248 may end the modules currently displayed in the current frame. If a module within the current frame is a persistent presentation module (and therefore should be displayed in the subsequent frame), the presentation module may be resumed once the new frame is initiated. After the current frame has been suspended, transition manager 248 retrieves the subsequent frame data and module data from frame manager 246, populates the presentation with the new frame and module data, and begins playback of the subsequent frame and modules contained therein. After performing a frame transition, the flowchart of
A determination is made by playback engine 116 as to whether an activity transition is triggered at step 1370. Similar to a frame transition, an activity transition is triggered by an event triggered by user input or an internal event. If an activity transition is not triggered, the process of
Playback engine 116 determines whether a tag event is detected at step 1380. A tag event may be detected if a module presented during presentation playback contains tag meta-data and is selected by a user. If no tag event is detected, the process of
Frame manager 246 searches a tag event-action list for a matching tag event at step 1392. As discussed above, each frame object contains a list of tag event-actions for the modules within the frame. The list contains a list of tag events that may be triggered by the modules contained with the frame object and the actions performed by other modules contained in response to the particular tag event. Thus, at step 1392, frame manager 246 searches the tag event-action list for the tag event detected at step 1380 of
If a module is configured to perform an action in response to the detected tag event, frame manager 246 instructs the module object to perform an action at step 1396. In some embodiments, if the module is not already being displayed in the current frame of the presentation, the module is loaded into the presentation frame played. In some embodiments wherein the module is already loaded into the presentation, a particular action of the module may be performed. A particular action may include providing an image, hiding an image, changing from one displayed image to another, starting a video, ending a video, or some other action. A symbolic representation of a module that performs an action in response to a tag event is illustrated in
When a first module 1414 is selected, a tag event A 1420 is triggered. The tag event includes sending tag data for the tag event to frame manager 246. This is illustrated by the dotted line comprising tag event A 1420 in
Some examples of processing tag events and actions during presentation playback are now discussed. In a first example, a presentation may provide information for days of a week. The presentation may include a frame which consists of a first module displaying a timeline image and several other modules with other content. Each content module may be tagged with time meta-data and be associated with a different day of the week (tag names of “Monday,” “Tuesday,” etc., all in a tag group of “Time.”) The timeline module may present images (such as an image of the word “Monday,” “Tuesday,” etc.) based on the tagged content module selected by a user. Thus, as a user selects a different content module having meta-data of a certain day of the week, a tag event associated with that module is triggered. Each tag event causes the timeline module to load and provide a different image portraying time information associated with the triggered tag event.
In another example, a presentation may provide information regarding different countries. The presentation may consist of a first frame featuring flags of different countries and several frames associated with a specific country. The flag frame may contain several modules, each containing an image of a different country's flag. Each of the other frames in the presentation provides information for a country associated with one of the flags. From a user point of view during playback, selecting a flag module from the flag frame initiates a frame corresponding to the selected flag. Once the frame corresponding to the selected flag has completed providing content to the user, the presentation may return to the frame containing the flags and await further user input.
To implement the flag-country presentation, each flag module may contain meta-data having a country name. The country frames may each be configured with a tag-based action. Thus, an Argentina flag module may be contained within the flag frame and be tagged with meta-data of “Argentina.” When selected during playback, a tag event with tag meta-data “Argentina” is triggered. A frame regarding the country Argentina is then configured to perform a tag-based action for a tag event having meta-data of “Argentina.” The action may be to begin playback of the frame. Thus, in this case, the tag-based action is to present a new frame for playback in the presentation. After playback of the Argentina frame, the country flag frame may again be presented during playback until a user selects another module of the frame.
In some embodiments, the playback of a presentation may be filtered using one or more tags. For example, a user may playback portions of a presentation associated with a particular tag name or group. By selecting a tag name or group through presentation application 112 at presentation runtime, only frames and modules associated with the specified tags will be provided during playback.
The foregoing detailed description of the technology herein has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the technology to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described embodiments were chosen in order to best explain the principles of the technology and its practical application to thereby enable others skilled in the art to best utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the technology be defined by the claims appended hereto.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5404316 *||Aug 3, 1992||Apr 4, 1995||Spectra Group Ltd., Inc.||Desktop digital video processing system|
|US5832473||Sep 8, 1995||Nov 3, 1998||Starfish Software, Inc.||Information management system with user data-based user interface|
|US5852435 *||Apr 12, 1996||Dec 22, 1998||Avid Technology, Inc.||Digital multimedia editing and data management system|
|US5872573||Dec 30, 1996||Feb 16, 1999||Barlo Graphics N.V.||Method and system for improving legibility of text and graphic objects laid over continuous-tone graphics|
|US5999173 *||Apr 3, 1992||Dec 7, 1999||Adobe Systems Incorporated||Method and apparatus for video editing with video clip representations displayed along a time line|
|US6081262||Dec 4, 1996||Jun 27, 2000||Quark, Inc.||Method and apparatus for generating multi-media presentations|
|US6160549||Jan 21, 1997||Dec 12, 2000||Oracle Corporation||Method and apparatus for generating reports using declarative tools|
|US6369835||May 18, 1999||Apr 9, 2002||Microsoft Corporation||Method and system for generating a movie file from a slide show presentation|
|US6400378 *||Sep 26, 1997||Jun 4, 2002||Sony Corporation||Home movie maker|
|US6408301||Feb 23, 1999||Jun 18, 2002||Eastman Kodak Company||Interactive image storage, indexing and retrieval system|
|US6581051||Jan 7, 2000||Jun 17, 2003||Matsushita Electric Industrial Co., Ltd.||Agent presentation apparatus|
|US6928613 *||Nov 30, 2001||Aug 9, 2005||Victor Company Of Japan||Organization, selection, and application of video effects according to zones|
|US6938032||Apr 13, 2000||Aug 30, 2005||Conjoin, Inc.||Presentation builder|
|US6948124||Dec 20, 2000||Sep 20, 2005||Eastman Kodak Company||Graphical user interface utilizing three-dimensional scatter plots for visual navigation of pictures in a picture database|
|US7103840 *||Aug 29, 2001||Sep 5, 2006||Sony Corporation||Effect adding device, effect adding method, effect adding program, storage medium where effect adding program is stored|
|US7418656 *||Oct 3, 2003||Aug 26, 2008||Adobe Systems Incorporated||Dynamic annotations for electronics documents|
|US7424718 *||Mar 23, 2006||Sep 9, 2008||Verint Americas Inc.||Method and system for presenting events associated with recorded data exchanged between a server and a user|
|US7433497||Jan 23, 2004||Oct 7, 2008||Hewlett-Packard Development Company, L.P.||Stabilizing a sequence of image frames|
|US7453472 *||May 31, 2003||Nov 18, 2008||University Of Utah Research Foundation||System and method for visual annotation and knowledge representation|
|US7526726||Aug 25, 2005||Apr 28, 2009||Adobe Systems Incorporated||System and method for generating presentations|
|US7703017||Jan 5, 2005||Apr 20, 2010||Pioneer Corporation||Program display method, program display apparatus, and program delivery and display system|
|US20020165721||May 4, 2001||Nov 7, 2002||Chang Kenneth H.P.||Real-time control of playback rates in presentations|
|US20030018714||Jul 16, 2002||Jan 23, 2003||Dmytro Mikhailov||Proactive browser system|
|US20030090506||Sep 4, 2002||May 15, 2003||Moore Mike R.||Method and apparatus for controlling the visual presentation of data|
|US20030222900||Mar 18, 2003||Dec 4, 2003||Merk & Co., Inc.||Computer assisted and/or implemented process and system for selecting, storing, and retrieving slides and slidekits, including to a personal folder, for healthcare providers|
|US20040001106||Jun 26, 2002||Jan 1, 2004||John Deutscher||System and process for creating an interactive presentation employing multi-media components|
|US20040039934||Dec 18, 2002||Feb 26, 2004||Land Michael Z.||System and method for multimedia authoring and playback|
|US20040071453||Jul 28, 2003||Apr 15, 2004||Valderas Harold M.||Method and system for producing interactive DVD video slides|
|US20040128691||Sep 10, 2003||Jul 1, 2004||Fuji Xerox Co., Ltd.||Video browsing system, distribution server and browse client|
|US20040168149||Feb 20, 2003||Aug 26, 2004||Cooley Godward Llp||System and method for representation of object animation within presentations of software application programs|
|US20040201610||Nov 13, 2001||Oct 14, 2004||Rosen Robert E.||Video player and authoring tool for presentions with tangential content|
|US20040250205 *||May 21, 2004||Dec 9, 2004||Conning James K.||On-line photo album with customizable pages|
|US20050033657||Jul 23, 2004||Feb 10, 2005||Keepmedia, Inc., A Delaware Corporation||Personalized content management and presentation systems|
|US20050057560||Mar 1, 2004||Mar 17, 2005||Viera Bibr||System and method for building wireless applications with intelligent mapping between user interface and data components|
|US20050081141||Oct 9, 2003||Apr 14, 2005||Einfalt Ehf.||Visual programming system and method|
|US20050154679||Jan 8, 2004||Jul 14, 2005||Stanley Bielak||System for inserting interactive media within a presentation|
|US20050246642||May 3, 2005||Nov 3, 2005||Valderas Harold M||Application for viewing video slide based presentations|
|US20060010217||Jun 3, 2005||Jan 12, 2006||Business Instruments Corp.||System and method for dynamic adaptive user-based prioritization and display of electronic messages|
|US20060050993||Nov 24, 2003||Mar 9, 2006||Stentiford Frederick W||Searching images|
|US20060061595 *||May 31, 2003||Mar 23, 2006||Goede Patricia A||System and method for visual annotation and knowledge representation|
|US20060080610||Oct 12, 2004||Apr 13, 2006||Kaminsky David L||Methods, systems and computer program products for outline views in computer displayable presentations|
|US20070282948||Jun 6, 2006||Dec 6, 2007||Hudson Intellectual Properties, Inc.||Interactive Presentation Method and System Therefor|
|US20100122220||Jul 27, 2009||May 13, 2010||Carl Zeiss Microimaging Gmbh||Method of and apparatus for dynamically generating a user presentation based on database stored rules|
|GB2354920A||Title not available|
|1||Amendment dated Feb. 25, 2011, U.S. Appl. No. 11/424,744, filed Jun. 16, 2006.|
|2||*||Avid Pinnacle Studio Plus 10, Sep. 15, 2005, "Slides".|
|3||Muller, et al., "Visualization and Interaction Techniques of the Visual Metadata Browser VisMeB", University of Konstanz, Germany, http://hci.uni-konstanz.de/downloads/fm-pk-tl-hr-iknow-2003.pdf.|
|4||Muller, et al., "Visualization and Interaction Techniques of the Visual Metadata Browser VisMeB", University of Konstanz, Germany, http://hci.uni-konstanz.de/downloads/fm-pk-tl-hr—iknow—2003.pdf.|
|5||Office Action dated Apr. 11, 2011, U.S. Appl. No. 11/424,744, filed Jun. 16, 2006.|
|6||Office Action dated Oct. 7, 2010, U.S. Appl. No. 11/424,744, filed Jun. 16, 2006.|
|7||*||RealPlayer Plus User Manual, 2000, 24 pages.|
|8||Shih, et al., "A Stepwise Refinement Approach to Multimedia Presentation Designs", Systems, Man, and Cybernetics, Computational Cybernetics and Simulation, vol. 4535, pp. 117-122, 1997 IEEE International Conference on Oct. 12-15, 1997.|
|9||Tanaka et al., "Associating and Presenting Metadata of Digital Archive Objects in Virtual Spaces as Synchronized Multimedia Content", Digital Libraries: Research and Practice, IEEE, pp. 280-287, IEEE, International Conference on Nov. 13-16, 2000, Kyoto.|
|10||Yokota et al., "Multiple Dynamics View Support for Cooperative Work", Database Systems for Advanced Applications, pp. 331-338, Proceedings., 6th International Conference on Apr. 19-21, 1999.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US8621357 *||Jul 2, 2009||Dec 31, 2013||Apple Inc.||Light table for editing digital media|
|US8626322||Jul 2, 2009||Jan 7, 2014||Apple Inc.||Multimedia display based on audio and visual complexity|
|US8775976 *||Nov 9, 2010||Jul 8, 2014||Samsung Electronics Co., Ltd.||Method for setting background screen and mobile terminal using the same|
|US8832555 *||Jul 2, 2009||Sep 9, 2014||Apple Inc.||Framework for slideshow object|
|US9032300||May 7, 2013||May 12, 2015||Apple Inc.||Visual presentation composition|
|US9324373||Nov 21, 2013||Apr 26, 2016||International Business Machines Corporation||Determining updates for a video tutorial|
|US9368155||Jun 26, 2014||Jun 14, 2016||International Business Machines Corporation||Determining updates for a video tutorial|
|US9626068 *||Jun 6, 2013||Apr 18, 2017||Microsoft Technology Licensing, Llc||Automated system for organizing presentation slides|
|US20100124277 *||May 31, 2009||May 20, 2010||Vimicro Corporation||Video encoding with even bit stream|
|US20100168881 *||Jul 2, 2009||Jul 1, 2010||Apple Inc.||Multimedia Display Based on Audio and Visual Complexity|
|US20100169777 *||Jul 2, 2009||Jul 1, 2010||Apple Inc.||Light Table for Editing Digital Media|
|US20100169783 *||Jul 2, 2009||Jul 1, 2010||Apple, Inc.||Framework for Slideshow Object|
|US20100169784 *||Jul 8, 2009||Jul 1, 2010||Apple Inc.||Slide Show Effects Style|
|US20100262492 *||Sep 25, 2007||Oct 14, 2010||Telefonaktiebolaget L M Ericsson (Publ)||Method and arrangement relating to a media structure|
|US20110119625 *||Nov 9, 2010||May 19, 2011||Samsung Electronics Co. Ltd.||Method for setting background screen and mobile terminal using the same|
|US20140365897 *||Jun 6, 2013||Dec 11, 2014||Microsoft Corporation||Automated System for Organizing Presentation Slides|
|U.S. Classification||715/730, 715/753, 715/700, 715/203, 715/201|
|International Classification||G06F3/00, G06F17/00|
|Cooperative Classification||H04L65/1089, G06Q10/10|
|European Classification||H04L29/06M2S4M2, G06Q10/10|
|Sep 13, 2006||AS||Assignment|
Owner name: MICROSOFT CORPORATION, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KRISHNASWAMY, VINAY;COMEAU, STEPHANE;SCHREIBER, PATRICK;AND OTHERS;REEL/FRAME:018244/0587;SIGNING DATES FROM 20060627 TO 20060829
Owner name: MICROSOFT CORPORATION, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KRISHNASWAMY, VINAY;COMEAU, STEPHANE;SCHREIBER, PATRICK;AND OTHERS;SIGNING DATES FROM 20060627 TO 20060829;REEL/FRAME:018244/0587
|Aug 30, 2011||CC||Certificate of correction|
|Dec 9, 2014||AS||Assignment|
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034542/0001
Effective date: 20141014
|Dec 29, 2014||FPAY||Fee payment|
Year of fee payment: 4