|Publication number||US20050005308 A1|
|Application number||US 10/767,930|
|Publication date||Jan 6, 2005|
|Filing date||Jan 29, 2004|
|Priority date||Jan 29, 2002|
|Also published as||US8091111, US20080060001|
|Publication number||10767930, 767930, US 2005/0005308 A1, US 2005/005308 A1, US 20050005308 A1, US 20050005308A1, US 2005005308 A1, US 2005005308A1, US-A1-20050005308, US-A1-2005005308, US2005/0005308A1, US2005/005308A1, US20050005308 A1, US20050005308A1, US2005005308 A1, US2005005308A1|
|Inventors||James Logan, Scott Durgin, Dana Burd|
|Original Assignee||Gotuit Video, Inc.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (57), Referenced by (115), Classifications (84), Legal Events (1)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a non-provisional of and claims the benefit of the filing date of U.S. Provisional Patent Application Ser. No. 60/443,379 filed Jan. 29, 2003
This application is also continuation in part of and claims the benefit of the effective filing date of U.S. application Ser. No. 10/060,001 filed by James D. Logan et al. on Jan. 29, 2002) entitled “Audio and Video Program Recording, Editing and Playback Systems Using Metadata” and published as U.S. patent application Publication No. 2002-0120925 on Aug. 29, 2002.
This application is also a continuation in part of and claims the benefit of the effective filing date of U.S. application Ser. No. 10/165,587 filed by James D. Logan et al. on Jun. 8, 2002 entitled “Audio and Video Program Recording, Editing and Playback Systems Using Metadata” and published as U.S. patent application Publication No. 2003/0093790 A1 on May 15, 2003.
The disclosure of each of the foregoing applications is incorporated herein by reference.
This invention relates generally, although in its broader aspects not exclusively, to methods and apparatus for presenting sports events to television viewers.
The present invention belongs to a family of related systems that use metadata to control the playback of broadcast programming as disclosed in the previously issued patents and published patent applications summarized below. The disclosures of each of the following patents and published applications are hereby incorporated herein by reference.
U.S. Reissue Pat. No. Re 36,801 issued to James D. Logan et al. on Aug. 1, 2000 entitled “Time delayed digital video system using concurrent recording and playback” describes a mechanism for continually storing live television or radio broadcast programs in an addressable digital memory and playing back the broadcast program after a variable delay period under the control of the viewer, permitting the viewer to pause, replay, and fast-forward (skip) live programming.
U.S. Pat. Nos. 5,892,536 and 5,986,692 issued to James D. Logan et al. describe systems which employ metadata to selectively store, manipulate and playback broadcast programming. Some of the arrangements and features disclosed in those two patents may be summarized as follows:
U.S. Pat. Nos. 5,271,811, 5,732,216, and 6,199,076, and co-pending application Ser. No. 09/782,546 filed on Feb. 13, 2001, by James D. Logan et al. describe a program distribution system which incorporates the following features:
U.S. patent application Publication No. 2002/0120925 A1 published on Aug. 29, 2002 (based U.S. application Ser. No. 10/060,001 filed by James D. Logan et al. on Jan. 29, 2002) entitled “Audio and Video Program Recording, Editing and Playback Systems Using Metadata” describes structures and functions used to provide metadata control over the recoding, editing and playback of audio and video programming, including the use of mechanisms at the user's location for creating metadata which may be used in combination with metadata provided by an external source, for editing metadata in various ways at the user's location, for automatically responding to user activity to generate new metadata which characterizes the user's preferences and which serves to automatically identify and describe (or rate) programming segments, and for responding in numerous ways to the available metadata to enhance the utility and enjoyment of available broadcast materials.
U.S. patent application Publication No. 2003/0093790 A1 published on May 15, 2003 (based U.S. application Ser. No. 10/165,587 filed by James D. Logan et al. on Jun. 8, 2002) entitled “Audio and Video Program Recording, Editing and Playback Systems Using Metadata” describes systems for utilizing metadata created either at a central location for shared use by connected users, or at each individual user's location, to enhance user's enjoyment of available broadcast programming content. A variety of mechanisms are employed for automatically and manually identifying and designating programming segments, associating descriptive metadata which the identified segments, distributing the metadata for use at client locations, and using the supplied metadata to selectively record and playback desired programming.
The present invention takes the form of methods and apparatus for recording and replaying a televised sports event in a more format selected by the viewer. Although many of the techniques to be described are used to replay a football game, it should be understood that most of these techniques can in most cases be applied to other sports events as well, including baseball, basketball, hockey, boxing, etc.
In this system, the entire broadcast of a football game is recorded in a storage device which can be accessed by and controlled by the viewer, such as a program storage device in a cable or satellite VOD (video on demand), PVR (personal video recorder), nPVR (network personal video recorder) systems as described under “Platforms,” below. In addition, related program content which supplements the broadcast version of the football game may be made available, such as program content obtained form sources such as league cameras shooting footage for the coaches, interviews and background material on particular players or subjects, tutorial materials for explaining topics which may be unfamiliar to a particular viewer, advertising and promotional materials, and the like.
In the description that follows, user functions are typically selected using a hand held remote control unit (which will be referred to simply as a “remote”), often from menu selections or other visual indicators presented on a conventional television monitor; however, voice commands, touch screens, or other input means, may also be used. Personal computer (PC) systems which are connected to the television set or set top box, and connected to a server by some mechanism such as a Web interface, may be used to retrieve metadata and media content, set up user preferences, make catalog selections, and/or set up system parameters. When a remote or other device employing “buttons” is used, the manner in which buttons are associated with functions can play an important role in making the user interface intuitively easy to use, as illustrated in the examples which follow.
Metadata created either automatically or by human editors after the live sports event but before the playback is employed to identify the starting and ending points of segments of the stored broadcast and supplemental programming. Additional metadata in the form of“playlists” may be used to selectively play back selected sequences of these segments for the viewer, potentially in a different order than the sequence in which the segments were originally broadcast and recorded. In addition, the user is presented with a segment selection guide which is displayed to the viewer and which enables the user to selectively control which segments, or which sequence of segments (playlists), are reproduced. The metadata will typically be created as early as possible, but it is also likely that more metadata will available for any given segment as time passes; therefore the longer a viewer waits to watch the game, the more developed the playlists may become.
In the detailed description which follows, frequent reference will be made to the attached drawings, in which:
The system for recording and playing back sports programming may be used on a variety of different platforms:
Each of the foregoing platforms is described in more detail in U.S. patent application Publication 2003/0093790 A1 published on May 15, 2003. As described there, and in the other patents and applications identified in the “Background” section above, metadata may be created by human editors or by automated techniques which subdivides a program, such as a broadcast sports event, into segments. The metadata identify the location and extent of each segment, and may include text labels or other descriptive information characterizing individual segments. Segments may be described with short text labels (called “slugs,” “tags,” or “labels”) which may be displayed as a segment “index” or “guide” on the television monitor. Using the remote control to generate content navigation and selection commands, user may first select a playlist that presents all or selected parts of a sports program, may jump from segment to segment in either direction, or jump to any desired segment listed in the displayed segment guide, and thereby interactively control the presentation of the event.
As shown in
As shown in
It should be noted that the viewer may elect to return the display to an unobstructed full screen view at any time, and likewise may redisplay the paneled version at any time that the user wishes to view the extra information provided by the metadata, or to navigate to a new segment, or perform some other function. In the fullscreen mode, the short “slug” or a longer description of the segment may be shown (or not, as selected by the viewer) in much the same way that close-caption text appears on screen when requested.
As seen at 220 in
The information panel seen at 209 may be used to present a variety of different kinds of information about the game, including a “chalk talk” description of the play as illustrated at 209. As illustrated at 310 in
The information panel seen at 209 may also be used to present advertising, which may occupy all or part of the information panel, depending on the need to present other information.
In accordance with the invention, playlists supplied to the user by the content provider (such as a cable VOD or satellite provider) can be used to control the presentation of a special version of a sports event. Playlists that can be used to advantage in presenting sports events include the following:
Snap-to-Tackle: This playlist identifies and replays only those segments of a football game which depict play when the ball is in motion. Typically, presenting a football game to a viewer under the control of a “snap-to-tackle” playlist condenses the game down to about twenty minutes. The precise beginning (snap) and ending (tackle) of each play is selected by a human editor using the following guidelines: if players are “in motion” before the play, that footage is left in; if something extraordinary happens after the play, that is left in as well (these tail-endings might include treating an injured player or the handling of a penalty—sometimes skipping to a scene where the referee announces the penalty). Another example of material left in by a snap-to-tackle playlist might be a short celebration after a sack or in the end zone after a score. In both cases (before and after the play), time might be added to allow for the announcer to complete a sentence. Although the editor has discretion to leave in certain material in addition to events which occur during a play, the editor would not delete any of the between the hike and the tackle.
Clock-in-Motion: This playlist presents a condensed version of the game which lasts about an hour and deletes the broadcast time taken for pre-game, halftime, and post-game shows. It also drops timeouts, penalty discussions, and other segments recorded when the game is not in progress and the game's official timekeeper's clock is not moving. Exceptions would be scenes where the referee is announcing a penalty or other important information is being conveyed to the audience.
Highlights: This playlist presents a highly condensed version of the game, showing only the “best” or “most interesting” selected by the human editor to reduce the game to perhaps five minutes in duration.
Most Important Plays: This playlist presents a highly condensed but still “structurally complete” game, showing only the most important plays of each drive (each set of downs). This playlist varies from the Highlights playlist above which shows the best plays regardless of when they occur. For instance all the Highlights action could occur in the fourth quarter. In the Most Important Plays playlist, however, the structure of the game is preserved as some representative plays are shown from each drive. A variant of this playlist would vary the amount of time per play depending on the outcome. For instance, if a pass were dropped, that would have very tight editing. If the pass play was for a first down, more time before and after the play would be left in.
Player Spotlight: In this playlist, the system pulls out and replays segments that are associated with specific players. A segment, or play, can be associated with more than one player and thus be used in multiple, different playlists devoted to different players. To access a particular player, the viewer displays a menu of players corresponding to the active roster. Individual players may be represented by name, picture, position, or any combination of these. The user may then select a playlist that plays only those plays, interviews, etc. that have been identified in the metadata as relating to the selected player of interest.
Other Highlights: Player Spotlights would be one example of “highlights” available using the system. A more generalized model of recombining stored segments would allow viewers to assemble playlists of highlights by player, team, play-type (e.g., hit, pass, or punt), or game situation (e.g. third downs). Furthermore, the highlights could be assembled across a single game, a library of recorded games representing a team's season-to-date, or recordings stored for games recorded across the whole league in the case of play-type, game situation, or other non-player or team construct.
Best Hits: In this playlist, the “best hits” of the game being viewed are replayed. Similarly, other playlists may be used to identify highlights of other types of plays, such as passes/receptions, interceptions, turnovers, kickoffs, etc.
Downs and Yards: The “slugs” or labels presented by this playlist shows the down and yards-to-go (e.g., “3rd and 7 yds”). This is particularly important for viewers whom have not seen the game or do not know the outcome. These viewers may not want the suspense of the game spoiled, and if they are shown a tag that says “quarterback sacked” or “touchdown pass” before they see the play, then the suspense is largely lost. So, tag descriptions that simply tell the field position at the start of the play are less likely to reduce the suspense of the game, particularly when the content is viewed in Fullscreen mode and the user cannot see the other/neighboring tags. Note that this type of playlist concept applies to other sports as well (e.g., a segment description in a baseball playlist might merely identify the inning, a stock car race playlist might indicate lap count, a golf playlist might identify the player and the hole being played. In short, this kind of playlist contains information that is known before the action shown in the segment actually happens, and hides the result of the play itself.
Other Playlists could include:
The complete game, but containing only that content which is rights-approved for post-broadcast and/or on-demand viewing. This is particularly important for cases in which certain parts of the game (e.g., music playing in the stadium or on-air, in-depth coverage or background stories assembled by the broadcaster, etc.) haven't been cleared, so these pieces of content must be excised. This version of a complete game playlist provides an efficient means of presenting the content without producing a fully edited version that removes the uncleared content.
Other sports will have other playlists that apply specifically to that sport. For example, a golf match could have a “hole-by-hole playlist” where the content is re-arranged by hole, and the viewer watches how every player did on that hole before viewing the next hole. Also golf might have a “Player Playlist” where all the shots from that player are shown before viewing shots from another player.
The term “playlist” is typically a continuously-viewed collection of individual video segments, each with a start and end time. However, a playlist can be formed by start times alone, without end times. These start times act as bookmarks into the video. When viewing a “bookmark-type” playlist, the user will see the entire video from start to finish, and not a subset of the video. The viewer can select a segment, or hit the Next or Prev button, to jump to the next segment, but a bookmark-type playlist does not make these jumps automatically. It ignores segment end times and keeps playing. In mechanisms that require the end point of a segment to be known, the bookmark that marks the beginning of the next segment can be used to identify the location of the ending of the prior segment. Thus, unless otherwise apparent from the context, bookmark style playlists provide the same functions and features as playlists which include metadata that identifies both the start and ending, or the stare and duration, of a segment.
It should also be noted that, while a playlist may be used to selectively play back and perhaps reorder the play back of segments, the same effects can be used by employing the metadata to actually create a concatenation of the identified segments as a revised version of the original content. Unless otherwise apparent from the context, then features and functions described in this specification can be applied to metadata playlists, bookmark playlists, or metadata edited, recorded versions of the original sports event content.
Condensed versions of games often eliminate much of the audio track, which can lead to a choppy feel to the presentation. Thus, the metadata included in a playlist may specify a new audio track to be substituted for the original audio presented with each segment. This audio track would be laid down in such a way that there were no “audio seams” that straddled segments. That is, each segment would have a standalone audio track allowing viewers to jump from segment to segment without abrupt breaks in the announcer's flow. New audio segments should be captured or created so that they do not require the context of any particular prior or following segment to be understood, enabling segments to be assembled in a variety of different ways by different playlists such as those listed above.
When in Full Screen Mode (without a visible segment guide being displayed—but with the optional display of the description of the segment currently being shown), the viewer can navigate in the same fashion as in Indexed Mode (when a segment guide is displayed). That is, the viewer can cursor to another segment several segments ahead or behind using the Up or Down arrow keys on the remote, and then pressing the Select Button to view the desired segment. Instead, this navigation could be using a special Next button that is a separate, unused remote control button, or the Next button could be simply an arrow button (e.g., right arrow), without the need to press Select. The picture presentation works the same way in Full Screen Mode that it does in Indexed Mode, but the viewer can't see the name of the segments that are being navigated.
The playlist navigation mechanisms described in U.S. Pat. Nos. 5,271,811, 5,732,216, and 6,199,076 discussed in the background section above may be applied to advantage in performing blind navigation of a sports event playlist.
Replaying the Current Segment: To get to the back to beginning of the currently playing segment when in Full Screen or Indexed Mode, the user would hit the Up arrow and then the Select button. To go back to the beginning of the previous segment for instance, the viewer would hit the up arrow twice and then the Select button. Alternatively, a special Previous button that is a separate, unused remote control button could be employed, or the Previous button could be simply an arrow button (e.g., left arrow), without the need to press Select. When the viewer presses a Previous button, the viewing jumps to the start of the previous segment. If the user is currently viewing video that is within a defined and/or configured number of seconds from the start of a segment, then the jump takes the user to the previous segment in the playlist. However, if the user is currently viewing video in excess of this defined and/or configured value, the jump takes the user to the start of the currently playing segment. This action is similar to that used in conventional CD players and DVD players when browsing and navigating the audio and video tracks on optical discs, and provides a mechanism that is familiar to viewers when applied to the navigation of segments in a playlist.
The Next Button: The viewer may wish to see the game in Full Screen mode without the index being visible. In this mode, the viewer can navigate blindly by skipping ahead to the next segment using the Next button, which advances the viewer ahead to the next segment. Because the Next button would be used so frequently, it is preferable to the Next button be a physical button on the remote, such as the Remote's Select button, or the Next button may be a separate, unused remote control button. Whenever the viewer hits the Select button the video would move on to the next segment while in Full Screen mode. Furthermore, when in Indexed Mode, the Select button would operate in a similar fashion. If the cursor were still on the segment being viewed, hitting the Select Button would advance the video to the next segment. If the viewer, however, had already advanced the cursor to another segment, hitting the Select button would select this highlighted segment, rather than causing the display to move to the next segment on the playlist.
Cross Show Navigation: The system envisions a large database of video being available to viewers consisting of all recent league games and an archive of older games. Viewers could navigate through the database via video hyperlinks displayed on the system's UI in a number of ways. For instance, when watching a Best Hits playlist from the current game, the info-box might display icons representing the players involved in the play. Clicking on these icons might offer viewers the opportunity to see great plays they made in other games. Once a viewer was watching plays from these other games, there would be further opportunities to watch parts of those respective games, or the whole game itself. Another way to navigate would be to invoke the Info button (a physical button on the remote—see below) at any time. This might present opportunities to go to other related games or parts of the video database. This sort of “chain hyperlinking” would allow viewers to peruse the database while watching actual playlists. Other navigation means would be traditional menus of the league or team schedule from which users could access specific games, or menus of cross-game playlists, such as compilations of Best Hits. The context of a scene or play could provide the basis for the hyperlinking; for instance, in the middle of watching a ski race, the user could hyperlink to see how the other skiers performed in the same section of the course currently being viewed. For golf, this could be to see how other players fared when facing the portion of the course.
The hyperlinking itself could be invoked using a special button on the remote control. When the user is presented with an on-screen notification (alert, icon, text, graphic, etc.), pressing the button would activate the hyperlinking to another screen that shows the user the options of to where they can hyperlink (e.g., what relevant playlists are available for viewing).
Transitions Between Segments
Transition interstitials (e.g., graphics, color, audio, and/or video) may be presented to the viewer when browsing the tags within a playlist, jumping between segments (manual or automatically), or switching to another playlist. These interstitials would serve to add context to the viewing experience, so that the user has an indication of how far in time they are jumping forward (the time in question could be displayed as a graphic showing game-clock-time, broadcast-clock-time, or percentage-of-asset being viewed). Other graphical displays might be used, such as a 1 second video of a New England Patriots player rushing from one side of the screen to the other, which would be displayed immediately before the user sees the next discontiguous program segment in a New England Patriots game playlist.
The presentation of such interstitial content can accompany both manual browsing (that is, clicking on index segments or clicking the “next segment” button) as well as automatic browsing (that is, just watching a playlist and having the system automatically make the jump to the next segment). However, the latter automatic-browsing case would benefit more from the addition of the interstitial, since the user is not the one causing the jump in time, and therefore they might be lost without the context supplied by the interstitial.
A user may dynamically select “Preview Mode” in which only the first part (e.g., 10 seconds) of each segment in a playlist before viewing is automatically jumped to the next segment in the playlist. If the user presses a special remote control button (or any one of a number of buttons), play can continue normally and Preview Mode would be temporarily or completely disabled. This mechanism is analogous to the “scan mode” in which car radios scan from station to station, playing each for a brief period, unless the scanning is interrupted so that the user can continue to listen to a program of interest. Alternatively, the system may play a predetermined representative portion of a segment other than the beginning which may be deemed by the metadata provider to provide a better preview of the segment. In that case, when the preview mode is interrupted, playback begins at the beginning of the segment being previewed.
Hierarchical Segment Guides
A segment guide may employ “Segment Groups” to create parent-child relationships. Segment Groups present the playlist's slugs (short on-screen descriptions of the segments in a playlist) in a hierarchy with a number of segments grouped together with a single group label. For example, all the plays within one drive of a football game (or one inning of baseball, one lap of NASCAR, one hole in golf, etc.) would be contained in a Segment Group that has a title representing that football drive along with supplementary information, such as game clock or game quarter (e.g., “Pats Drive 1-Q2”, or “Pats D1 26:30”). Overall, this serves to organize the segments, and makes it efficient for the user to peruse a long playlist by simply looking for the group in which they are interested, and then searching within that group for the play they wish to view. The relationship of Segment Groups to Segments is analogous to the relationship of file folders to files in computer file systems. By organizing segments into groups, the viewer can first search for the desired group, and then find a desired segment within that group, which is much faster than searching a single long list of segments.
Some playlists may have all segment slugs organized in Segment Groups, but other playlists may have only a portion of the segments (or none of the segments) organized in this way. Generally, the most benefit is derived from applying Segment Groups to long playlists that are associated with content that it partitioned by some construct such as innings, periods, drives, holes, laps, etc. Short content often doesn't need a segment group. For instance, a post-game news show might be only have 10 segments with 10 slugs; organizing 10 segments for easy and efficient perusal is not worthwhile since the user can browse them easily enough without the hierarchy of Segment Groups.
Two different methods for the navigation of Segment Groups are provided, and are called “bi-axial” and “show-hide.”
Bi-axial navigation is commonly used to permit VOD subscribers to search for videos available for viewing, and is thus familiar to VOD viewers. Bi-axial navigation can also be applied to advantage to provide a consistent way in which viewers can browse Segments and their Segment Groups. In this application of bi-axial navigation, the user has at his/her disposal four arrow buttons on a remote control (left, right, up, down), and a select key. Using one pair of arrow buttons (either left & right, or up and down), the user can scroll through an on-screen list of Segment Groups that are arranged along the axis that correspond to the buttons they are using (i.e., left & right arrows would scroll through a horizontal list of Segment Groups, and up & down buttons would scroll vertically arranged Segment Groups titles). Once the user finds a particular Segment Group of interest (e.g., a particular drive in a football game they wish to view), they can use the other set of arrow buttons to scroll in the other axis to find a particular segment within the Segment Group (e.g., if left & right scrolls a horizontal Segment Group list, then up & down would scroll a vertical list of segment slugs that reside in that Segment Group). Once the user has located the segment of interest, they press another button (e.g., the Select button on the remote control) to select-and-view the desired segment. Segment Groups titles themselves often benefit from having a small graphic icon next to the Segment Group title to denote more information about the contents of the Segment Group, and to declare the title as being that of a Segment Group in the first place. For example, Segment Groups that are drives in a football game might have a helmet of the team with the ball placed next to the Segment Group title, which tells the user very quickly who has the ball and that it is a drive Segment Group. Another example is that if the drive ended in a touchdown, then a different icon (e.g., goal posts, or a graphic that says “6pts”) could be displayed next to the Segment Group title to denote that the drive ended in a touchdown.
Show-hide navigation is analogous to the opening and closing of file folders used to find files in a computer graphical interface, such as Windows(r). This navigation method provides a familiar way in which a view can locate and play particular Segments and Segment Groups in a hierarchical playlist. The viewer is shown with a list of Segment Groups titles on the screen. The user uses a pair of arrow buttons (either left & right, or up and down) to scroll to a Segment Group of interest, and then they press another button (e.g., Select button, or one of the arrow button not used for scrolling the Segment Groups) to “open” the Segment Group, thereby revealing on-screen the segments that are contained in the selected Segment Group. On-screen, the segments appear in a way that denotes to the user that the segments are contained within the Segment Group. This can be accomplished in a number of ways: listing the segments below and indented from the Segment Group title; listing the segments below and in a different color than the Segment Group; showing an icon next to the segments and/or showing an icon next to the Segment Groups with the icons being different. When the segments are shown on-screen after the Segment Group is “opened”, the segments could animate into place, thereby reinforcing in the user's mind that the segments came from the action of selecting the Segment Group. When the user is done browsing and/or viewing the segments within a particular Segment Group, they have the option of either, a) actively “closing” the segment group by highlighting the Segment Group title and pressing a button (e.g., Select button, or one of the arrow button not used for scrolling the Segment Groups) thereby hiding the on-screen segments that are contained in the selected Segment Group, or b) browsing to a different Segment Group and selecting that Segment Group to “open” which cause implicitly causes the previously “opened” Segment Group to “close”. Segment Group titles can have an icon next to them to denote they are a Segment Group, and the icon can change when a particular Segment Group is “opened” or “closed”. For example, a “+” or sideways-facing arrow could be used when the Segment Group is “closed”, and when the user selects the Segment Group to “open” it and reveal it's segment contents the icon could change to a “−” or downwards-facing-arrow.
The “Mini-Nav Bar” provides a further navigation method which allows a viewer to navigate when the display is in fullscreen mode (that is, the video consumes the entire screen). As noted above under “Blind Navigation, ” the user may navigate in full screen mode without seeing segments descriptions/titles. This isn't always optimal. In fullscreen mode, users will sometimes want to see segment descriptions to know if they care to watch the segment. Displaying the segment titles in fullscreen mode is accomplished through the “Mini-Nav Bar”. This feature is a small graphic bar displayed near or at the bottom of the screen, either as an overlay on-top of the video or as a bar across the bottom that slightly vertically shrinks the video image. The graphic is either always present, or more optimally it appears only when the user presses a remote control button, which can be either a button press that explicitly brings up the Mini-Nav Bar so the user can view it, or a button press (e.g., arrow button) used for segment browsing and the act of segment browsing automatically makes the Mini-Nav Bar appear to display the segment title being selected/browsed to. After a timeout (e.g., several seconds) the Mini-Nav Bar disappears, leaving only fullscreen video.
In the Mini-Nav Bar graphic, one or more segment titles are shown. If more than one segment title is shown, some indication is given to the user that identifies the title to which the user is browsing and/or selecting. That is, a highlight or icon or coloring or some other graphical element is used to denote the segment title that the user is about to select (or has just selected).
Alternatively, the Mini-Nav Bar may appear every time a new segment in the playlist starts to be viewed. So, instead of an explicit button press, or implicit appearance due to browsing in fullscreen mode, the Mini-Nav Bar could be displayed briefly every time the user sees a new segment. This could be entirely without user intervention, as the next segment in the playlist is shown, the Mini-Nav Bar automatically pops up to alert the user that:
The manner in which the Mini-Nav bar is presented may be configured by the viewer or the provider, either dynamically or statically, to control:
Browsing and selecting segments in fullscreen mode with the Mini-Nav Bar could be accomplished in two ways: floating, or fixed. In the floating method of Mini-Nav Bar operation, the user is allowed to browse (e.g., with remote control arrow buttons) to a new segments before they explicitly select it (e.g., with the remote control Select button), thereby jumping to the segment of interest. In the fixed method of Mini-Nav Bar operation, every time the user browses to a new segment (e.g., with remote control arrow buttons), the jump to the new segment automatically occurs. In this way, there is no way to, say, browse and one-step jump from the first quarter to the third quarter of a football game; the operation is more like a Next button (“next, next, next, etc. etc. etc.”) where each segment is seen (that is jumped to).
Interactive TV Capabilities
The Info Button: This button on the remote, on-screen commands, or voice-activated functions would allow the user to branch to additional content from within a given segment. For instance, if the Info button were invoked while watching highlights of a given player, a short menu would appear presenting choices to see this player's highlights from other games. We envision the best way to implement this function would be to hit the right arrow key when the viewer has placed the cursor on the appropriate segment. (This is consistent with a model that using the right arrow takes the viewer to successively greater levels of details.) An “i” could appear to the right of segment slug if there was extra information about the segment to be accessed. If all segments had information, the “i” might appear at the top of the UI or not at all, but not next to every segment.
The additional information will then appear in the information panel below the picture, or in the video space, in which case the video will automatically pause while it is displayed. Hitting the left arrow key removes the additional information from the display.
Running Statistics: Some advanced viewers may be interested in having access to a continuing stream of personalized statistics. For instance, a viewer might wish to see at any moment in a game, either on-demand or in a pushed basis, statistics on: passing yards vs. rushing yards, quarterback ratings, third down conversion ratios, etc. It is envisioned that a viewer could set up a rotating sequence of such statistics with the viewer picking the statistics of interest and the order in which they would toggle through the appropriate window. The viewer could also specify at which times the video would be paused to let the statistics be viewed. Viewers could toggle through the list of statistics in one of the following ways:
Look-Ahead Stories: A certain type of running statistical story would be feasible under a time-shifted scenario-one where the end of the story was known by the system in advance. Thus, if a running back ended up breaking, or coming close to breaking, a record by the end of the game, the system would know that outcome in advance and start to develop that storyline earlier than a live announcer would. Viewers would have the advantage of having displayed for them early in the game a chart showing total yards per-moment in the game versus the record. They would therefore be tipped off that this is a major story without knowing the outcome. Viewers watching the video for the second time, or ones who knew the outcome would have the benefit of following the storyline right from its inception. Whether the record is broken or not, the comparison is fun to watch right up to the end.
Segment-Related Content: Another use would be to use this space to provide a short narrative of what transpired in that particular segment. The text in this space could either be in addition to the segment “slug” (short on-screen segment description normally shown in a list), or could be a continuation of the slug. That is, when a segment is selected and/or highlighted, the first part of the description could be the short description in the segment index listing, and the remaining portion could be the continuation of text in the information area. If the information area is used for text or a narrative describing the segment, this area could be scrollable (i.e., via remote control arrow buttons) by the user if all the text did not fit on the screen, or the application could automatically scroll the text (much like the horizontally moving banner text now often used on news and sports broadcasts, but provided by metadata as part of the playlist).
Chalk Talks: Another segment-related use of interactive TV would be to display a “chalk talk” before, during or after a play. Such diagrams, as illustrated at 209 in
Drive Diagrams In addition to play-specific chalk talks, the system could also offer “drive diagrams” that graphically show the movement of the ball up and down the field. This type of graphic gives the user a “big picture” perspective on the game and would be particularly interesting to viewers watching the condensed game playlists. Viewers would be able to navigate through the video content using these diagrams by first toggling over to the window containing the diagram. Using the arrow keys, viewers could highlight the desired drive and click on it and thus bring up the video associated with the start of that drive.
“Learn The Game” Mode: When a viewer is new to football, or any other sport, it is often hard to learn the game. Using the broadcast itself as a learning medium has two disadvantages—it has to progress at the rate of the live game, limiting the amount of time available to explain events in detail, and it is a one-size-fits-all production, meaning it can't be tailored for the fraction of the audience that is not up to speed on details of the game. With time-shifting and pause capability, the viewer is able to put the system into “learn mode”. In Learn mode, information is conveyed two ways.
For situations where the viewer “pulls” information from the system (i.e. using the Info button), the system would understand that viewer is trying to learn the game and offer the appropriate information as a result. In other situations the system is “pushing” information to the viewer, for instance when the ad banner box is filled with data that the viewer did not necessarily request. In this case, as well, the information would be tailored to the user's level of knowledge.
The information presented could be text, a graphic, a dynamic graphic, or a video clip. The information could also be “standard” or “custom”. Standard information would be static data prepared well in advance and used for multiple games. Custom information would be data created to be associated with a specific moment in a specific game. For instance, a standard video clip could be a video clip showing a typical “face mask” infraction while a custom clip for the same topic could be an edited segment of the currently watched game (that is, a replay of the face mask penalty that was just watched). All these forms of information could be presented on either a push or pull basis. This static database of helpful hints could also be accessed at will through a more elaborate menu scheme. That is, if viewers wished to understand what a clipping penalty was, they wouldn't have to wait for one to occur, but instead would have the option of going to, say, the Options menu, and ferreting out the clip or text explaining this penalty.
Advanced Viewer Mode: In the same way that new football fans would want explanatory metadata about the game, experienced viewers might wish to have more advanced levels of data presented. To this extent, the system would also offer a similar Advanced Mode.
Some of the advanced statistics that might be offered include a summary of penalties so far in the game, a frequency table of which types of plays had been called so far, and a comparison of the types of yardage accumulated by each team.
Games for Viewers: Viewers would also be able to use the system's time-shifted interactive TV functionality to participate in games. In particular, they could pause the picture and enter a “Guess the Play” contest where a multiple-choice question would appear in the information area. Users would toggle to the area and navigate to their selected answer. A bet could be placed in jurisdictions that allowed gambling. In other locations, a virtual bet could be placed where the system would keep track of how much virtual money a viewer had won-such monies being exchangeable for prizes. Other games would involve multiple-choice trivia games.
IP-Based Interactivity: The system may use an Internet connection to retrieve and display text and image data from the web on the information panel alongside the cable-based main video window, or on the full screen. In this mode, the remote and the television may effectively operate as a web browser to allow the user to interactively locate detailed information to which the metadata provides contextual links, participate in games and chat sessions, etc.
When a viewer brings up an information screen, or supplemental programming of any kind, that will become the new focus of attention, the current video presentation should be automatically paused while the user is viewing the requested material. When the user exits this presentation, the video should be automatically put back into Play mode.
Similarly, if the user optionally clicks out (via clicking on the banner ad) to an ad video, the original video that they were watching should be paused and/or bookmarked. When the ad viewing is completed, the user re-joins the original video from the point where they clicked the ad.
Both of these speak to the idea of “pausing” at the point of OPTIONAL departure from the original on-demand content, so that the user returns to the same place.
Additional System Capabilities
Often a viewer will not know, nor want to know, the score of the time-shifted game being reviewed. If the user wishes to be “kept in suspense,” that preference should be ascertained as soon as the viewer entered the game presentation environment. If that preference is expressed, the system will endeavor to mask the outcome of the game from the viewer in one of several ways:
The first technique would have the system not display the to-be-seen portions of the playlist, only listing segments already viewed. In this mode, the viewer would pick the playlist to watch and let it progress in a linear way, only randomly accessing and replaying already-viewed segments, or using the Next button to jump ahead-but only a segment at a time. A segment is not listed in the Index until it has been viewed in its entirety or the viewer has skipped ahead. (If a segment label is displayed in advance, it might well give away the storyline.
A second method would involve using labels for segments that did not contain scoring information. This approach allows a viewer to jump ahead more easily but can still give away a sense of the game by virtue of merely seeing who has the ball, when a kickoff is made, etc.
Using a third method, the system could actually change the segment title that is displayed once the user sees the segment, as described in relation to the Mini-Nav Bar, above. For example, the user might want the suspense of the game kept, and not want to see what was about to happen in the upcoming segment, as described by the segment title (e.g., “Quarterback Sacked”). Consequently, before the segment is shown, a more objective title is shown that won't ruin the suspense (e.g., “4th and 3 yd”). After viewing the segment, the more descriptive segment title that describes the outcome of the outcome would be presented.
Multiple Camera Angles
Although the system can be used to advantage to re-use, simplify, condense, or more easily navigate standard broadcast content, it may also be used to expand on the coverage available in an original broadcast. Additional footage could be obtained from systems designed for multiple camera angle use, network cameras whose shots were not broadcast at a given time; stadium cameras; and league cameras shooting footage for the coaches. While multiple cameras may be used to shoot any one given play, only one can be shown to viewers during normal broadcasts. A second or third, however, could used during replays. In a VOD environment, however, video from more than one camera angle could be stored on the server. The system's default camera angle would be the one used in the broadcast, however, by invoking a command, viewers would be able to select from a menu of available camera angles whenever those were available. It is envisioned that various methods could be implemented to let viewers access the multi-angle feature. These options are similar to those described above for allowing advanced users toggle through a list of statistical presentations. The user could specify the order of which the angles would appear when toggling by going to the set-up section of the Option menu. Each time the Right Arrow (if this was the method of toggling) was hit, the segment would start playing over again using the camera angle first on the list. Viewers could also specify camera angles by type of play or player featured, a feature that can't be offered to live viewers. For instance, a viewer could set up the system so that field goals are always shown with the camera behind the goal posts. Hail Mary passes would always be shown by stepping the camera back to capture the whole field. This latter example would offer the additional drama of tipping the viewer off that a dramatic moment was being set up.
Picture in Picture
A PIP (picture-in-picture) mode presents to or more games at the same time on the same screen. Multiple windows of video may be shown in a picture-in-picture fashion, or one game could be displayed in the main window while one or more secondary video feeds (either different games, or other programming) could be shown in the information space, or some other subsidiary window. Multiple views of the video would be useful in situations showing the game in the main window, while having the cheerleaders, crowd, or coaches shown in the information space. Alternatively, an entirely different game could be shown in the subsidiary window. The user could set up the presentation formats in an Options menu. Once set up, the viewer would then have different viewing “universes” controlled by one remote. When users invoked the standard navigation features such as pause, rewind, or fast-forward, the commands would apply to all the open windows at once (if the programming in the supplemental windows is associated with the context provided by the video feed in the main window. Alternatively, time shifting commands may be applied only to the window that is “in focus.” Multiple camera angles could be invoked in each window in the ways described above. The viewer would have to toggle over to the respective window first, to put it in “focus”, at which point the different cameras could be invoked.
Another possibility for a PIP setup would allow viewers to have more control over the source of the subsidiary images within or adjacent to the main video. Besides other cable broadcast sources (i.e., another game), a video feed or other presentation off the web to be used in the PIP (picture in picture display window). In this way, every viewer could have a unique viewing construct. In particular, relating to sports, a viewer would be able to “rent” a webcam that he or she could control. Thus, if friends were attending a camera, a community could be constructed by keeping a webcam trained on their seats while the game progress.
Multiple Audio Feeds
In addition to multiple camera angles, the system could also offer multiple audio feeds. Viewers could select the standard TV broadcast feed, as well as a radio broadcast feed or the audio broadcast at the stadium. In addition, users could overlay the stadium sound on any given feed for added effect. Another feed could be the audio captured from an on-field mike or a player's helmet. Viewers from different locations may want to select different radio broadcast feeds (e.g., viewers can get the feed of their home-town or favorite announcer).
As described in detail in described in more detail in U.S. patent application Publication 2003/0093790 A1 published on May 15, 2003. the system may employ a “community markup” mechanism that allows users to create special playlists (using the bookmarking feature), and then transmit those playlists to other users who may then view programming under the control of the supplied playlist. As analogous concept is “community audio” whereby one or more viewers, for compensation or for free, would offer their commentary on a game. Thus, a high school coach could add his spoken comments on a game in the system for benefit of his players, or a team player could offer his thoughts. In another case, a celebrity could offer his or her comments. Versions could be created that included comedic comments overlaid on part of the game in the same way that some music video stations offer Pop-Up comments during music videos. In another special version of audio, the new announcer, knowing the outcome of a play and the whole game, could give subtle hints as to what to watch.
Another feature could be the use of audio conferencing, so that viewers could enjoy watching a sporting event in the “virtual” presence of friends and family. The audio conferencing could be accomplished via regular phone, Internet link, or Voice-Over IP, all played through the set-top box and/or television audio.
The system may dynamically configure the playback for the amount of time a viewer indicates that he or she want to spends watching a particular video or playlist (e.g., setting the system to 22 minutes for a football game viewing session; setting for a “Slow”, “Medium”, or “Fast” viewing time on a Highlights Playlist; etc.). With this information, the system could select the playlist with the closest running time to what the user indicated they wished to spend viewing the video. Alternatively, the system could dynamically change a playlist's segment time or number of segments so that the viewer is presented with an overall running time that approximately matches their desired viewing time.
Additionally, the system could have an on-screen option (or a remote control button) that allows the user to request a speed up or slow down in the viewing experience. With this input, the system would dynamically alter the playlist being watched, or else could dynamically change the current playlist's segment times or number of segment, so that the viewer is presented with an overall running time that appropriately matches their desires.
Features Adapted to Sports Events
Other features described in detail in the patents and published applications noted in the background section above, may be adapted to sports programming.
The Vault function, invoked by clicking on the “V” button on the toolbar 220 seen in
Bookmarking, invoked by clicking on the “P” button on the toolbar 220 seen in
Advertising associated with the broadcast of a sports event may be available to view in the sports presentation system. To encourage ad viewing, bookmarks denoting a new segment at the beginning of ads would provide an incentive for viewers to watch ads. Furthermore, the system may require viewers to watch ad content in proportion to the game content viewed. Consumers could opt out of this requirement by paying an extra subscription fee. Under any model, the fast-forward button may be disabled, disabled to prevent skipping over ad content that is associated with a segment, or slowed to discourage ad skipping. Another method to foster some limited ad viewing would be to require that the viewer click the “Next” button several times to get past an ad, with each click taking the viewer to a new position within the ad. The navigation could even be suspended for a brief period at each “stop” to allow the viewer to absorb some part of the ad content. The metadata may mark certain segments as mandatory, preventing them from being skipped except to skip to an entirely different segment, and in this way requiring that ad content be viewed as a condition for viewing designated program content. The metadata could be used to place “required viewing” attribute(s) in ad segments to maximize their effectiveness without hindering the “navigational progress” of the viewer more than necessary.
It is to be understood that the methods and apparatus which have been described above are merely illustrative applications of the principles of the invention. Numerous modifications may be made by those skilled in the art without departing from the true spirit and scope of the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4528589 *||Feb 1, 1984||Jul 9, 1985||Telease, Inc.||Method and system for subscription television billing and access|
|US5057932 *||May 5, 1989||Oct 15, 1991||Explore Technology, Inc.||Audio/video transceiver apparatus including compression means, random access storage means, and microwave transceiver means|
|US5109482 *||Feb 19, 1991||Apr 28, 1992||David Bohrman||Interactive video control system for displaying user-selectable clips|
|US5119507 *||Jul 29, 1991||Jun 2, 1992||Mankovitz Roy J||Receiver apparatus and methods for identifying broadcast audio program selections in a radio broadcast system|
|US5353121 *||Mar 19, 1993||Oct 4, 1994||Starsight Telecast, Inc.||Television schedule system|
|US5436653 *||Apr 30, 1992||Jul 25, 1995||The Arbitron Company||Method and system for recognition of broadcast segments|
|US5485219 *||Apr 18, 1994||Jan 16, 1996||Depromax Limited||Electric service to record transmissions without recording commercials|
|US5610653 *||Apr 24, 1995||Mar 11, 1997||Abecassis; Max||Method and system for automatically tracking a zoomed video image|
|US5634849 *||Apr 12, 1995||Jun 3, 1997||Abecassis; Max||Content-on-demand interactive video method and apparatus|
|US5694163 *||Dec 12, 1996||Dec 2, 1997||Intel Corporation||Method and apparatus for viewing of on-line information service chat data incorporated in a broadcast television program|
|US5710815 *||Jun 7, 1995||Jan 20, 1998||Vtech Communications, Ltd.||Encoder apparatus and decoder apparatus for a television signal having embedded viewer access control data|
|US5732324 *||Sep 19, 1995||Mar 24, 1998||Rieger, Iii; Charles J.||Digital radio system for rapidly transferring an audio program to a passing vehicle|
|US5732516 *||Oct 18, 1996||Mar 31, 1998||Western Highway Products, Inc.||Sign support anchor|
|US5736977 *||Apr 26, 1995||Apr 7, 1998||E-Systems, Inc.||Video real estate information service|
|US5754938 *||Oct 31, 1995||May 19, 1998||Herz; Frederick S. M.||Pseudonymous server for system for customized electronic identification of desirable objects|
|US5838917 *||Oct 1, 1997||Nov 17, 1998||Eagleview Properties, Inc.||Dual connection interactive video based communication system|
|US5844620 *||Nov 29, 1995||Dec 1, 1998||General Instrument Corporation||Method and apparatus for displaying an interactive television program guide|
|US5872588 *||Dec 6, 1995||Feb 16, 1999||International Business Machines Corporation||Method and apparatus for monitoring audio-visual materials presented to a subscriber|
|US5892536 *||Oct 3, 1996||Apr 6, 1999||Personal Audio||Systems and methods for computer enhanced broadcast monitoring|
|US5937331 *||Jul 1, 1996||Aug 10, 1999||Kalluri; Rama||Protocol and system for transmitting triggers from a remote network and for controlling interactive program content at a broadcast station|
|US5986692 *||Dec 15, 1998||Nov 16, 1999||Logan; James D.||Systems and methods for computer enhanced broadcast monitoring|
|US6005603 *||May 15, 1998||Dec 21, 1999||International Business Machines Corporation||Control of a system for processing a stream of information based on information content|
|US6026376 *||Apr 15, 1997||Feb 15, 2000||Kenney; John A.||Interactive electronic shopping system and method|
|US6081830 *||Oct 9, 1997||Jun 27, 2000||Gateway 2000, Inc.||Automatic linking to program-specific computer chat rooms|
|US6088455 *||Jan 7, 1997||Jul 11, 2000||Logan; James D.||Methods and apparatus for selectively reproducing segments of broadcast programming|
|US6118450 *||Apr 3, 1998||Sep 12, 2000||Sony Corporation||Graphic user interface that is usable as a PC interface and an A/V interface|
|US6144375 *||Aug 14, 1998||Nov 7, 2000||Praja Inc.||Multi-perspective viewer for content-based interactivity|
|US6233389 *||Jul 30, 1998||May 15, 2001||Tivo, Inc.||Multimedia time warping system|
|US6243725 *||May 21, 1997||Jun 5, 2001||Premier International, Ltd.||List building system|
|US6262724 *||Apr 15, 1999||Jul 17, 2001||Apple Computer, Inc.||User interface for presenting media information|
|US6357042 *||Jan 22, 1999||Mar 12, 2002||Anand Srinivasan||Method and apparatus for multiplexing separately-authored metadata for insertion into a video data stream|
|US6366296 *||Sep 11, 1998||Apr 2, 2002||Xerox Corporation||Media browser using multimodal analysis|
|US6388958 *||Jun 23, 2000||May 14, 2002||Sony Corporation||Method of building a play list for a recorded media changer|
|US6389467 *||May 2, 2000||May 14, 2002||Friskit, Inc.||Streaming media search and continuous playback system of media resources located by multiple network addresses|
|US6567980 *||Aug 14, 1998||May 20, 2003||Virage, Inc.||Video cataloger system with hyperlinked output|
|US6637029 *||Jun 30, 1998||Oct 21, 2003||Nds Limited||Intelligent electronic program guide|
|US6839880 *||Oct 21, 1999||Jan 4, 2005||Home Debut, Inc.||Electronic property viewing system for providing virtual tours via a public communications network, and a method of exchanging the same|
|US6868440 *||Feb 4, 2000||Mar 15, 2005||Microsoft Corporation||Multi-level skimming of multimedia content using playlists|
|US6990676 *||Mar 17, 1999||Jan 24, 2006||Sony Corporation||Locally stored content previews. Representative of programming content in an electronic programming guide through a graphic image accessed from the hard drive of a set top box|
|US7055166 *||Jan 27, 1999||May 30, 2006||Gotuit Media Corp.||Apparatus and methods for broadcast monitoring|
|US7313808 *||May 5, 2000||Dec 25, 2007||Microsoft Corporation||Browsing continuous multimedia content|
|US20020026496 *||Dec 9, 1997||Feb 28, 2002||Franklin E. Boyer||Electronic-mail reminder for an internet television program guide|
|US20020106191 *||Jan 4, 2002||Aug 8, 2002||Vm Labs, Inc.||Systems and methods for creating a video montage from titles on a digital video disk|
|US20020157101 *||Jul 12, 2001||Oct 24, 2002||Schrader Joseph A.||System for creating and delivering enhanced television services|
|US20020166123 *||Jan 17, 2002||Nov 7, 2002||Microsoft Corporation||Enhanced television services for digital video recording and playback|
|US20030093790 *||Jun 8, 2002||May 15, 2003||Logan James D.||Audio and video program recording, editing and playback systems using metadata|
|US20030095790 *||Dec 31, 2002||May 22, 2003||Joshi Ajit P.||Methods and apparatus for generating navigation information on the fly|
|US20030100965 *||Dec 18, 2002||May 29, 2003||Sitrick David H.||Electronic music stand performer subsystems and music communication methodologies|
|US20030110507 *||Dec 11, 2001||Jun 12, 2003||Koninklijke Philips Electronics N.V.||System for and method of shopping through television|
|US20030182254 *||Mar 21, 2002||Sep 25, 2003||Daniel Plastina||Methods and systems for providing playlists|
|US20030208473 *||Jan 28, 2000||Nov 6, 2003||Lennon Alison Joan||Browsing electronically-accessible resources|
|US20040017389 *||Sep 27, 2002||Jan 29, 2004||Hao Pan||Summarization of soccer video content|
|US20040111465 *||Dec 9, 2002||Jun 10, 2004||Wesley Chuang||Method and apparatus for scanning, personalizing, and casting multimedia data streams via a communication network and television|
|US20040138948 *||Oct 16, 2003||Jul 15, 2004||Stephen Loomis||Apparatus and method for skipping songs without delay|
|US20050149964 *||Sep 29, 2004||Jul 7, 2005||United Video Properties, Inc.||Program guide system with monitoring of advertisement usage and user activities|
|US20050183119 *||Jan 6, 2005||Aug 18, 2005||Klaus Hofrichter||Real-time bookmarking of streaming media assets|
|US20080154628 *||Feb 12, 2008||Jun 26, 2008||Yukihiro Ogawa||System and method, and computer program for managing product reserve|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7206892 *||May 29, 2003||Apr 17, 2007||Lg Electronics Inc.||Method for managing recorded streams in a rewritable recording medium|
|US7671893 *||Jul 27, 2004||Mar 2, 2010||Microsoft Corp.||System and method for interactive multi-view video|
|US7735101||Mar 27, 2007||Jun 8, 2010||Cisco Technology, Inc.||System allowing users to embed comments at specific points in time into media presentation|
|US7738774 *||Jun 7, 2004||Jun 15, 2010||Panasonic Corporation||Recording device and proxy-recording device|
|US7739599||Sep 23, 2005||Jun 15, 2010||Microsoft Corporation||Automatic capturing and editing of a video|
|US7769756||Mar 8, 2007||Aug 3, 2010||Sling Media, Inc.||Selection and presentation of context-relevant supplemental content and advertising|
|US7805534 *||Aug 1, 2006||Sep 28, 2010||France Telecom||Service for personalizing communications by processing audio and/or video media flows|
|US7877776||Jun 7, 2005||Jan 25, 2011||Sling Media, Inc.||Personal media broadcasting system|
|US7917932||Nov 1, 2007||Mar 29, 2011||Sling Media, Inc.||Personal video recorder functionality for placeshifting systems|
|US7945142||Jun 15, 2006||May 17, 2011||Microsoft Corporation||Audio/visual editing tool|
|US7975062||Jan 7, 2007||Jul 5, 2011||Sling Media, Inc.||Capturing and sharing media content|
|US7988560 *||Sep 29, 2005||Aug 2, 2011||Aol Inc.||Providing highlights of players from a fantasy sports team|
|US8010987 *||Jun 1, 2004||Aug 30, 2011||Nds Limited||System for transmitting information from a streamed program to external devices and media|
|US8023800 *||Jun 20, 2007||Sep 20, 2011||Steve Concotelli||Media playback system|
|US8099665 *||Sep 11, 2006||Jan 17, 2012||Apple Inc.||Organizing and sorting media menu items|
|US8146130||Mar 27, 2012||Tivo Inc.||In-band data recognition and synchronization system|
|US8156520||May 30, 2008||Apr 10, 2012||EchoStar Technologies, L.L.C.||Methods and apparatus for presenting substitute content in an audio/video stream using text data|
|US8176424||Oct 19, 2007||May 8, 2012||Lg Electronics Inc.||Encoding method and apparatus and decoding method and apparatus|
|US8185513||Dec 31, 2008||May 22, 2012||Hulu Llc||Method and apparatus for generating merged media program metadata|
|US8196168 *||Nov 16, 2004||Jun 5, 2012||Time Warner, Inc.||Method and apparatus for exchanging preferences for replaying a program on a personal video recorder|
|US8214759||Jun 10, 2010||Jul 3, 2012||Microsoft Corporation||Taskbar media player|
|US8221230 *||Sep 23, 2010||Jul 17, 2012||ProVSports, Inc.||Video gaming device and method of wagering on a virtual football game|
|US8233530||Oct 28, 2008||Jul 31, 2012||International Business Machines Corporation||Video scene matching on return from virtual rendering in a consumer digital video recording device|
|US8244665 *||Jun 16, 2009||Aug 14, 2012||Sony Corporation||Information processing apparatus, information processing method and information processing program|
|US8271553||Oct 19, 2007||Sep 18, 2012||Lg Electronics Inc.||Encoding method and apparatus and decoding method and apparatus|
|US8271554||Oct 19, 2007||Sep 18, 2012||Lg Electronics||Encoding method and apparatus and decoding method and apparatus|
|US8275243 *||Aug 31, 2007||Sep 25, 2012||Georgia Tech Research Corporation||Method and computer program product for synchronizing, displaying, and providing access to data collected from various media|
|US8275814||Jul 12, 2007||Sep 25, 2012||Lg Electronics Inc.||Method and apparatus for encoding/decoding signal|
|US8326127||Jan 30, 2009||Dec 4, 2012||Echostar Technologies L.L.C.||Methods and apparatus for identifying portions of a video stream based on characteristics of the video stream|
|US8358346 *||Jan 28, 2010||Jan 22, 2013||Sony Corporation||Video processing device, video processing method, and program|
|US8421931 *||Dec 27, 2006||Apr 16, 2013||Motorola Mobility Llc||Remote control with user profile capability|
|US8434118 *||May 27, 2004||Apr 30, 2013||Time Warner Cable Enterprises Llc||Playlist menu navigation|
|US8452801||Oct 19, 2007||May 28, 2013||Lg Electronics Inc.||Encoding method and apparatus and decoding method and apparatus|
|US8453056||Oct 31, 2008||May 28, 2013||Microsoft Corporation||Switching of media presentation|
|US8489990 *||Mar 2, 2006||Jul 16, 2013||Rovi Guides, Inc.||Playlists and bookmarks in an interactive media guidance application system|
|US8495678||Dec 5, 2007||Jul 23, 2013||Ol2, Inc.||System for reporting recorded video preceding system failures|
|US8499011||Oct 19, 2007||Jul 30, 2013||Lg Electronics Inc.||Encoding method and apparatus and decoding method and apparatus|
|US8502866 *||Mar 11, 2009||Aug 6, 2013||Illinois Tool Works Inc.||Video recording device for a welder's helmet|
|US8516521 *||Jan 14, 2008||Aug 20, 2013||Verizon Patent And Licensing Inc.||Interactive learning|
|US8527537||Sep 3, 2010||Sep 3, 2013||Hulu, LLC||Method and apparatus for providing community-based metadata|
|US8538914||Jun 7, 2012||Sep 17, 2013||Sony Corporation||Information processing apparatus, information processing method and information processing program|
|US8549574 *||Dec 5, 2007||Oct 1, 2013||Ol2, Inc.||Method of combining linear content and interactive content compressed together as streaming interactive video|
|US8572669||Oct 1, 2009||Oct 29, 2013||Tivo Inc.||In-band data recognition and synchronization system|
|US8601089 *||Aug 5, 2004||Dec 3, 2013||Mlb Advanced Media, L.P.||Media play of selected portions of an event|
|US8621099||Dec 10, 2009||Dec 31, 2013||Sling Media, Inc.||Systems and methods for formatting media content for distribution|
|US8625754 *||Oct 24, 2005||Jan 7, 2014||AT&T Intellectual Property II, L.P. via a transfer from AT&T Corp.||Method and apparatus for providing information associated with embedded hyperlinked images|
|US8631439 *||Apr 6, 2007||Jan 14, 2014||At&T Intellectual Property I, L.P.||Methods, systems, and computer program products for implementing a navigational search structure for media content|
|US8640181 *||Sep 14, 2011||Jan 28, 2014||Mlb Advanced Media, L.P.||Synchronous and multi-sourced audio and video broadcast|
|US8646013||Apr 29, 2011||Feb 4, 2014||Sling Media, Inc.||Identifying instances of media programming available from different content sources|
|US8656435||Aug 7, 2007||Feb 18, 2014||Cisco Technology Inc.||Controlled metadata revelation|
|US8661017||Feb 29, 2012||Feb 25, 2014||Hulu, LLC||Method and apparatus for generating merged media program metadata|
|US8707153 *||Feb 26, 2007||Apr 22, 2014||Cisco Technology, Inc.||Displaying comment data corresponding to a video presentation|
|US8726309||Feb 29, 2012||May 13, 2014||Echostar Technologies L.L.C.||Methods and apparatus for presenting substitute content in an audio/video stream using text data|
|US8726332||Oct 15, 2009||May 13, 2014||Sony Corporation||Broadcast programming delivery apparatus, switcher control method, and computer program product|
|US8782709||Feb 19, 2009||Jul 15, 2014||Hulu, LLC||Method and apparatus for providing a program guide having search parameter aware thumbnails|
|US8793282 *||Apr 14, 2009||Jul 29, 2014||Disney Enterprises, Inc.||Real-time media presentation using metadata clips|
|US8805866||Aug 7, 2013||Aug 12, 2014||Hulu, LLC||Augmenting metadata using user entered metadata|
|US8819724 *||Dec 4, 2006||Aug 26, 2014||Qualcomm Incorporated||Systems, methods and apparatus for providing sequences of media segments and corresponding interactive data on a channel in a media distribution system|
|US8832768||Jan 3, 2014||Sep 9, 2014||Mlb Advanced Media, L.P.||Synchronous and multi-sourced audio and video broadcast|
|US8850479 *||Mar 1, 2006||Sep 30, 2014||Panasonic Corporation||Distribution device and reception device|
|US8874575||Sep 19, 2013||Oct 28, 2014||Sony Computer Entertainment Inc.||Media fingerprinting for social networking|
|US8897616 *||Apr 15, 2008||Nov 25, 2014||Canon Kabushiki Kaisha||Apparatus and method for upconverting content data|
|US8909805 *||Oct 6, 2011||Dec 9, 2014||Electronics And Telecommunications Research Institute||Apparatus and method for providing streaming content|
|US8931023 *||May 21, 2012||Jan 6, 2015||Verizon Patent And Licensing Inc.||Method and system for providing feedback based on monitoring of channels at a customer premise|
|US9003461||Dec 5, 2007||Apr 7, 2015||Ol2, Inc.||Streaming interactive video integrated with recorded video segments|
|US9032465||Dec 5, 2007||May 12, 2015||Ol2, Inc.||Method for multicasting views of real-time streaming interactive video|
|US9055325 *||Nov 11, 2009||Jun 9, 2015||Rovi Guides, Inc.||Systems and methods for providing transport control|
|US9082018 *||Oct 8, 2014||Jul 14, 2015||Google Inc.||Method and system for retroactively changing a display characteristic of event indicators on an event timeline|
|US9092240 *||Sep 10, 2008||Jul 28, 2015||Apple Inc.||Image application performance optimization|
|US9100670||Oct 29, 2013||Aug 4, 2015||Tivo Inc.||In-band data recognition and synchronization system|
|US9108107||Dec 5, 2007||Aug 18, 2015||Sony Computer Entertainment America Llc||Hosting and broadcasting virtual events using streaming interactive video|
|US9113217||Oct 2, 2014||Aug 18, 2015||Sony Computer Entertainment Inc.||Media fingerprinting for social networking|
|US20050010950 *||Jan 23, 2004||Jan 13, 2005||John Carney||System and method for automatically generating a composite video-on-demand content|
|US20050010953 *||Dec 3, 2003||Jan 13, 2005||John Carney||System and method for creating and presenting composite video-on-demand content|
|US20050159220 *||Dec 15, 2004||Jul 21, 2005||Gordon Wilson||Method and interface system for facilitating access to fantasy sports leagues|
|US20050183017 *||Apr 18, 2005||Aug 18, 2005||Microsoft Corporation||Seekbar in taskbar player visualization mode|
|US20060023073 *||Jul 27, 2004||Feb 2, 2006||Microsoft Corporation||System and method for interactive multi-view video|
|US20060269220 *||May 23, 2006||Nov 30, 2006||Sony Corporation||Reproducing system, reproducing apparatus, receiving and reproducing apparatus, and reproducing method|
|US20070136748 *||Feb 26, 2007||Jun 14, 2007||Rodriguez Arturo A||Supplementary data corresponding to a video presentation|
|US20080163301 *||Dec 27, 2006||Jul 3, 2008||Joon Young Park||Remote Control with User Profile Capability|
|US20080235586 *||May 25, 2007||Sep 25, 2008||Hung-Te Chou||Method and related system for multiple displays|
|US20080259205 *||Apr 15, 2008||Oct 23, 2008||Canon Kabushiki Kaisha||Apparatus and method for upconverting content data|
|US20090055383 *||Aug 23, 2007||Feb 26, 2009||Sony Computer Entertainment America Inc.||Dynamic media interaction using time-based metadata|
|US20090183201 *||Jul 16, 2009||Verizon Data Services Inc.||Interactive learning|
|US20090201316 *||Sep 10, 2008||Aug 13, 2009||Nikhil Bhatt||Image Application Performance Optimization|
|US20090231423 *||Mar 11, 2009||Sep 17, 2009||Illinois Tool Works Inc.||Video recording device for a welder's helmet|
|US20100175086 *||Jul 8, 2010||United Video Properties, Inc.||Systems and methods for providing transport control|
|US20100194892 *||Aug 5, 2010||Sony Corporation||Video processing device, video processing method, and program|
|US20100211198 *||Feb 13, 2010||Aug 19, 2010||Ressler Michael J||Tools and Methods for Collecting and Analyzing Sports Statistics|
|US20100318939 *||May 19, 2010||Dec 16, 2010||Samsung Electronics Co., Ltd.||Method for providing list of contents and multimedia apparatus applying the same|
|US20110264530 *||Oct 27, 2011||Bryan Santangelo||Apparatus and methods for dynamic secondary content and data insertion and delivery|
|US20120004018 *||Jan 5, 2012||Reeves Iii Allen N||Video gaming device and method of wagering on a virtual football game|
|US20120308195 *||May 31, 2012||Dec 6, 2012||Michael Bannan||Feedback system and method|
|US20130072307 *||Mar 21, 2013||Brian Heller||Providing highlights of players from a fantasy sports team|
|US20130185398 *||Oct 6, 2011||Jul 18, 2013||Industry-University Cooperation Foundation Korea Aerospace University||Apparatus and method for providing streaming content|
|US20130332830 *||Jun 6, 2012||Dec 12, 2013||Google Inc.||Mobile user interface for contextual browsing while playing digital content|
|US20140105573 *||Aug 29, 2013||Apr 17, 2014||Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno||Video access system and method based on action type detection|
|US20140186012 *||Jan 30, 2013||Jul 3, 2014||Echostar Technologies, Llc||Content-based highlight recording of television programming|
|US20140194173 *||Jan 9, 2013||Jul 10, 2014||Frank C. Nicholas||Method and system for operating and participating in fantasy leagues|
|US20140201778 *||Mar 15, 2013||Jul 17, 2014||Sap Ag||Method and system of interactive advertisement|
|US20140281013 *||Apr 8, 2014||Sep 18, 2014||Electronics And Telecommunications Research Institute||Apparatus and method for providing streaming content|
|US20140325568 *||Apr 2, 2014||Oct 30, 2014||Microsoft Corporation||Dynamic creation of highlight reel tv show|
|EP1629672A2 *||Jun 1, 2004||Mar 1, 2006||NDS Limited||System for transmitting information from a streamed program to external devices and media|
|EP1949681A1 *||Nov 1, 2006||Jul 30, 2008||Microsoft Corporation||Multi-view video delivery|
|EP2036344A2 *||Jun 23, 2006||Mar 18, 2009||TiVo, Inc.||Method and apparatus for creating and viewing customized multimedia segments|
|EP2077524A2 *||Jan 7, 2008||Jul 8, 2009||Voddler, Inc.||Push-pull based content delivery system|
|EP2077524A3 *||Jan 7, 2008||Sep 30, 2009||Voddler, Inc.||Push-pull based content delivery system|
|EP2089883A1 *||Oct 19, 2007||Aug 19, 2009||LG Electronics Inc.||Encoding method and apparatus and decoding method and apparatus|
|EP2090096A1 *||Oct 19, 2007||Aug 19, 2009||LG Electronics, Inc.||Encoding method and apparatus and decoding method and apparatus|
|EP2668552A1 *||Jan 26, 2012||Dec 4, 2013||Netflix, Inc.||Insertion points for streaming video autoplay|
|EP2668552A4 *||Jan 26, 2012||Aug 27, 2014||Netflix Inc||Insertion points for streaming video autoplay|
|EP2745522A1 *||Aug 3, 2012||Jun 25, 2014||Google, Inc.||Video segment presentaton tracking|
|WO2005107399A2 *||May 2, 2005||Nov 17, 2005||Vulcan Inc||Voice control of multimedia content|
|WO2006094131A2 *||Mar 2, 2006||Sep 8, 2006||Guideworks Llc||Playlists and bookmarks in an interactive media guidance application system|
|WO2007056048A1||Nov 1, 2006||May 18, 2007||Microsoft Corp||Multi-view video delivery|
|U.S. Classification||725/135, 348/E05.108, 348/E07.071, 725/139, 725/88, 725/102, 725/32|
|International Classification||G06Q30/00, H04N7/173, H04N5/44, H04N5/445, H04N7/16, H04H20/28|
|Cooperative Classification||H04N21/25891, H04N21/4782, H04N21/47202, H04N21/4335, H04H20/28, H04N21/8586, H04N7/163, H04N21/4331, H04H60/73, H04N21/8549, H04N21/44222, H04N21/482, H04N21/47205, H04N7/17318, H04N21/44008, H04N21/8456, H04N21/8352, H04N21/4438, H04N21/47214, H04N21/6125, H04N21/458, H04N21/4622, H04N21/439, H04N21/4532, H04N21/2543, G06Q30/06, H04N21/84, H04N21/4756, H04N21/4825, H04N21/4147, H04N5/4401, H04H60/27, H04N21/4663, H04N21/812, H04N21/4788, H04N21/8547|
|European Classification||H04N21/466L1, H04N21/475R, H04N21/4788, H04N21/482, H04N21/258U3, H04N21/472D, H04N21/84, H04N21/845T, H04N21/472R, H04N21/858U, H04N21/472E, H04N21/8547, H04N21/458, H04N21/2543, H04N21/462S, H04N21/8352, H04N21/45M3, H04N21/433C, H04N21/482P, H04N21/442E2, H04N21/81C, H04N21/439, H04N21/4147, H04N21/61D3, H04N21/4782, H04N21/44D, H04N21/4335, G06Q30/06, H04N7/16E2, H04N21/8549, H04N21/443W, H04H60/73, H04H20/28, H04N5/44N, H04N7/173B2|
|Sep 12, 2004||AS||Assignment|
Owner name: GOTUIT MEDIA CORP., MASSACHUSETTS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LOGAN, JAMES D.;BURD, DANA;DURGIN, SCOTT A.;REEL/FRAME:015114/0502;SIGNING DATES FROM 20040817 TO 20040819