|Publication number||US20060095410 A1|
|Application number||US 10/989,833|
|Publication date||May 4, 2006|
|Filing date||Nov 16, 2004|
|Priority date||Oct 29, 2004|
|Also published as||US20110066706|
|Publication number||10989833, 989833, US 2006/0095410 A1, US 2006/095410 A1, US 20060095410 A1, US 20060095410A1, US 2006095410 A1, US 2006095410A1, US-A1-20060095410, US-A1-2006095410, US2006/0095410A1, US2006/095410A1, US20060095410 A1, US20060095410A1, US2006095410 A1, US2006095410A1|
|Inventors||Lewis Ostrover, David Bryan|
|Original Assignee||Ostrover Lewis S, Bryan David A|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (17), Referenced by (61), Classifications (19), Legal Events (1)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This is a continuation-in-part of application Ser. No. 10/977,634 filed Oct. 29, 2004 and incorporated herein by reference.
1. Field of Invention
This application pertains to a personal video recorder (PVR) coupled to one or more rendering devices and method of operating the same for receiving, processing, and presenting content responsive to the capabilities and limitations of the rendering device, as well as user preferences, and other criteria.
2. Description of the Prior Art
Presently, content of various kinds can be received over various channels and presented in various formats. One problem that still persists in this field pertains to the fact that, in some instances, content receivers and other similar devices are unable to process content because of their specific capabilities and limitations. That is, certain content receivers are suited to process only certain types of content, and can either present or render other types of content very poorly, or cannot present them at all. For example, a user may have as a receiver a relatively inexpensive desktop computer with a simple, low definition (e.g., 600×800 pixels) black-and-white monitor and no speakers.
This receiver does not have the capability of receiving or playing a program comprising HD video and 6-channel sound.
Another user may have a receiver such as a PDA incorporated into a wristwatch that has the capability of receiving only text messages. This type of receiver device cannot, by itself, process content with non-textual materials, such as still or moving images, or even sounds.
In other instances, a user may have a device capable of receiving various types of content but at least in some instances, he may be interested receiving only content having a certain format and not others. For example, a user of a cellular telephone may be interested in receiving text messages while attending a meeting, even though the cellular telephone may have the capability of receiving audio programs, or even still or moving images. Similarly, a visually impaired user may require that visual and/or textual content be presented as audio signals. Similarly, the driver of an automobile may want to receive at times content only in the form of audio. At other times, other passengers within the same vehicle may want to get content of other kinds of as well.
Another problem is that devices are often unable to determine user preferences. In some situations, the user himself may prefer to receive, store, or play only certain types of content and not others. For example, a user may only be interested in news segments that relate to a certain topic, such as gardening, but is unable to have player devices automatically extract and present only those segments of interest in a larger video program. In another example, similar to e-mail filtering, a user may wish to establish different rules for playing content, such as “view ASAP” or “route content X to folder Y for later examination and possible playback”, and the like.
Yet another problem is that consumer devices must typically be targeted at rather low price points, and as such may not incorporate powerful processing capabilities. In these and other cases, and for other reasons such as providing better quality of service and reducing the traffic in content delivery networks, it may be desirable to shift the burden of content filtering to devices within the delivery networks themselves.
For example, so-called “content smart switches”, such as the Cisco CSS 11000 series, can access information deep in TCP and HTTP packet headers, including, for example, the complete URL and “mobile” cookies that change location within the header between content requests, to select the best site and server to fulfill customer information requests.
The system described in this application includes filtering (transforming, or even just discarding) multimedia information, based not only upon such descriptors as transport-level packet headers, URLs, or cookies, but also upon what is normally considered the application level data within the packets. The invention describes such filtering and related processing in accordance with the receiving device and/or user capabilities and/or user preferences, using a PVR as the filtering means.
The invention also includes optionally locating such filtering capability within devices that reside within the content delivery network, (as “part of the network” and/or as third party servers) wherein said devices act as “mediators” that filter content based upon tags and/or user and/or device capabilities and/or user preferences.
In one embodiment, the content being filtered is a web page that may contain either subject matter that is desirable or subject matter that is not desirable at least for some of the users.
In this application, “content” refers to the wide variety of types or kinds of media used to transmit information and entertainment to people, such as still photographs, motion pictures, videos, audio, text, graphics, drawings, and multi-media combinations of these. “Content” is meant to broadly describe media data independent of physical or logical data format or method of distribution or reception. Content types may be in any physical or logical formats, such as JPEG photographs, MPEG video, audio signals (that could be analog or digital, and may be in a number of different presentation formats, e.g., mono, stereo, multi-channel, MP3), HDTV, DVD-Video, HTML or any other format used to describe, contain or otherwise convey media data. Finally, content is meant to include both cohesively or continuously presented media data, such as a mixed audio-video presentation such as a TV news program, as well as selected portions or excerpts, re-edits of otherwise larger or longer presentations, such as the audio portion, or certain non-contiguous snippets or extracts of a larger TV show. Content may be analog or digital.
Content may be delivered using any transfer method, including recording on a physical storage or portable means such as optical disc or cassette tape, by networks such as the Internet or other online services, and by broadcast such as cable, telephone lines, cellular telephones, satellite communications and various other communication channels. These channels provide diverse means by which a large variety of content from various locations and sites can be accessed. Furthermore, content may be formatted for delivery as a single discrete digital file, in analog form, in several discrete segments or by streaming such as Internet-based digital radio.
A user site is a physical location (that is not necessarily stationary) equipped with a system for receiving, processing and rendering content. As described more fully below, the system at each site consists, in most embodiments, of several devices cooperating to perform one or more of the functions described in order to receive, process and render content to one or more users.
Content can incorporate or be associated with one or more tags or other similar means that includes relevant information. For example, the tags may provide information about the subject matter of the content and/or its type and form of presentation (e.g., whether the content is an audio-visual presentation of a Wagnerian opera, an aural sports report, a text with stock prices similar to a ticker tape, etc). Thus, tags may include data identifying the content by subject matter, title, author, actors, location, etc., the type of content (e.g., whether the content is a multi-media presentation suitable to be shown on an HDTV or black-and-white text that can be displayed in a tiny screen), the type of transport medium (e.g., a Sony DVCAM digital video tape, standard DVD disc, streaming audio, etc) and the type of content format (e.g., an MPEG Audio Layer 3 music file or an Advanced Audio Codec music file). Alternatively, some of the information such as the type of transport medium or content format, can intrinsically provide additional information, such as picture resolution, frame rate, and other factors.
The content tags may also include indicia such as a rating indicating whether the content contains material in accordance with user preferences (for example, materials related to violent or sexually explicit activities). As disclosed in my U.S. Pat. No. 6,351,596, content can also be partitioned into several segments, such as scenes, and each segment can be associated with its own rating tag.
Tags may be embedded in analog media—for example, in the vertical blanking interval of an NTSC video signal—or in wholly digital media, such as in a header to a content file, or in a separately provided file, or incorporated within the content object itself, e.g. as stegotext or a watermark.
Devices that play content may use the tags to affect how and whether the content is processed, stored, presented, or played. Examples of this are digital video recorders such as the TiVo Series2 DVR and the Scientific Atlanta Explorer 8000 DVR. In general, these devices can automatically collect and store broadcast programs that meet user criteria, such as storing all received broadcasts that include the actor Rutger Hauer or storing all first-run episodes of the cable television program “Six Feet Under”.
As disclosed in U.S. Pat. No. 6,351,596, a user or content receiver player may review rating tags prior to processing, storing, or playing content. A receiver may be provided that can be configured to collect for play or storage content with desirable ratings or tags, and to reject content with undesirable ratings or tags. In the case of content with ratings or tags for different segments, a receiver may be configured by a user so that it plays only the segments of the content that have acceptable ratings or tags. Another well-known example of this is the “parental lock” feature of certain televisions or other video viewing devices, which is intended to prevent children from seeing content unsuitable for minors.
In accordance with this invention, in the present system content undergoes several transitions or steps. All content originates from a respective content source and is ultimately distributed to a user or users at one or various user sites. In one embodiment, at each user site, the content is received, processed, and then rendered in a form perceivable by the user(s), in accordance with the content's characteristics that can be determined implicitly from content and/or metadata or additional tags. In another embodiment, content is received from the content source and processed at a remote site before being forwarded to a user site, where it optionally undergoes further processing before being rendered. Tags are significant because they provide information that enables the system to more flexibly and powerfully handle the content, including various functions such receiving, filtering, selecting, storing, prioritizing, transforming, rendering, and presenting the same in light of specific attributes, directions, rights, preferences, etc., in the tags. For example, in a player similar to that discussed in my U.S. Pat. No. 6,351,596, tags can be used to skip undesired parts or play only desired parts of a program. In another embodiment, tags can specify playback at a later time, repeated playback of certain program segments, interposing of segments of other programs from local or remote sources, or the like, or any other nonlinear player actions beyond playing a program linearly from beginning to end.
For example, tags may be employed to cause a processor to transform incoming digital video content form MPEG4 to MPEG2 format. In another example, tags may specify that the incoming information should be converted from text to speech or vice versa. In yet another example, a tag could specify that the incoming video should be summarized (only the highlights, e.g. ‘thumbnail’ frames of video from longer programs, or a line of text from longer text for presentation) before being sent to the player and thence to the user.
In another example, tags may be used by the receiver to reject content based upon user preferences. Tags may also be used to cause the receiver to “retune” to a different information stream, including selecting a substream of an incoming digital stream and/or retuning in the classical sense of monitoring a different frequency band. In fact, multiple tuners or other receiving means could monitor and record multiple channels or ‘information streams’ simultaneously, e.g. the new Sony Vaio shown at CEATEC recently that can record seven television channels simultaneously.
A tag may cause both the receiver and player to operate in synchronism, to achieve the effect of, for example, “splicing together” a program from segments from different information sources. For example, several incoming programs may have segments that are tagged as being of interest for Bob Dylan fans. The user site has a digital token identifying the user as a Bob Dylan fan. Therefore, at the user site, the receiver and player cooperate to record and splice together segments from different programs which have the Bob Dylan tag discussed above. In this case, a match between tag-token associated with the user site and tags from content from different sources drives the processing of the content. Some of the tag-assisted processing may be conditioned on certain events, e.g., of the form “if then” or “if and only if then” etc. A token may denote age, genre preference, rights, privilege, preferred source(s), preferred media type (e.g. mono), etc.
The content is provided to several distribution channels 104 that may include Internet, Intranet, channels, cable networks, WiFi, Bluetooth, broadcasting over the air or via a satellite network, etc. All these distribution channels transmit the content to the user sites 106 electronically. The distribution channels 104 may be one-way, such as in terrestrial analog broadcasts of TV or radio, and they may be two-way, such as with wired or wireless Internet access via DSL, cable, or “plain old telephone services” (POTS). In the case of two-way channels, content may be actively searched for and “pulled” by the user site 106 in response to search criteria. In other instances, the content is pushed by mass broadcast to the user sites. Typical push-type channels including broadcast channels.
Another means of distribution includes recording the content on a physical medium and transporting the medium to the user site 106.
The user site 106 includes one or more devices that perform three functions: receiving the content from the distribution channel, processing the content and rendering or presenting the content in a manner that is perceived by the user.
If the user site consists of a PDA, the receiver device comprises an antenna, demodulator, decision device, and possibly forward error correction decoder and decryptor, and the PDA performs the processing and rendering functions.
If the user site is a cellphone, then the cellphone could perform all three functions. Alternatively, the processing function could be performed entirely or in part by a remote site.
One of the functions that is performed as part of processing is that of gating. The gating process refers to the ability of the user site to process and transmit to the rendering device only content that meets certain criteria. Alternatively, the gating process can be considered to be a filtering process which admits some content and rejects other content, again, based on predetermined criteria. Some of these criteria, and how gating is performed is discussed in more detail below.
Canvassing is also part of the processing function. Canvassing refers to the process of monitoring the content being received to detect aspects of the content in accordance with user preferences and/or device characteristics. Even in push/broadcast mode, there are many potential sources and the user site needs to canvass all these signals for content of interest. Such material and/or related material could then be selected for further processing and/or storage and/or presentation. This can be a two-dimensional process in the sense that a plurality of media (e.g. terrestrial analog radio, satellite digital radio, Internet radio) need to be canvassed across their own frequency spectra.
Finally, as part of processing, if different content is retrieved from several sources, as part of the processing function, each content item is assigned a priority in accordance with user preferences and/or device characteristics. The content is then rendered based on an ordered list generated in accordance with the priority of each content item.
Processing may also involve transforming content from one format to another, if required. This function is required when the content is in an incompatible format. For example, if the content and the rendering device (e.g., the TV monitor) have different resolutions, then the content may have to be up-converted or down converted to match resolutions. Other transformations may involve folding 5.1 or 6 channel sound signals into stereo sound signals or converting content from one format to the other (e.g., spoken word audio to text, or vice versa). Of course, in the alternative, incompatible content may be filtered out or rejected.
System 150 further includes a signal processor (SP) 168 that processes the signals from the receiver devices discussed above. As part of this processing, the SP 168 performs canvassing, gating, prioritizing etc,. as discussed above. The system 150 further includes a CD/DVD player 176, a program selector 178, and a rules memory 180. The program selector receives selections from a user, such as the driver, and/or one or more passengers. The rules memory 180 defines the rules needed by the SP for the canvassing, gating, signal transforming, and prioritizing functions. Signal conditioning and other signal processing required to convert the signals from the receiver devices into output signals suitable for presentation by the rendering devices (discussed below) are also provided by the signal processor 168. The signal processor 168, program selector 178 and memory 180 comprise the processing devices described in
Several devices are also provided for presenting or rendering content to several users within the motor vehicle. One of these devices is a speaker (or earphone) 172. This speaker is positioned so that services primarily the driver. A pair of stereo speakers 172A, 172B are positioned so that they provide sounds both to driver and the passenger sitting next to the driver. Another set of speakers 172C, 172D are placed to provide sounds to passengers in the back seat. Finally, a display 174 is also provided. Preferably, the display 174 is positioned so that it is viewed primarily from the backseat, although it may also be positioned so that it is also viewable by the passenger in the front seat and the driver. The program selector 178 generates commands and designates criteria used by the signal processor 168 to describe which programs, or portions thereof, to accept or reject. These commands or criteria are generated by the program selector in response to rules found in the rule memory 180 as well as in response to input signals from users, including, for example, the driver of the motor vehicle, and/or a passenger.
The system 150 can be used in several operational modes. For example, for short trips, the driver wants to hear information related to a small group of subjects, such as weather, travel and road conditions, and the latest news and stock market reports. These rules and preferences are either selected by the driver or prerecorded in the memory 180. The rules may also require that in this mode, all inputs from the passenger(s) be ignored. The signal processor 168 then selects content known, designated or tagged to meet these criteria. For example, the signal processor 168 selects the AM radio stations designated as carrying news, weather, etc. Moreover, the signal processor 168 provides only low quality sound files suitable for the single speaker 172 since high quality stereo sound is not required in this instance.
At another time, the vehicle is used by one driver and several passengers to go on a long trip. The passengers include some adults who like classical music, some other adults who like shows about gardening and adolescents who like children's stories. This information is again received by the program selector 178 from the passenger input and/or from the rules memory 180. The signal processor 168 searches all the content from the different sources and displays them in a suitable form. That is, the stereo speakers 172A, 172B, 172C, 172D which may, for example, actually comprise multiple sets of speakers embedded into seatbacks or headphones to prevent the sound from each set of stereo speakers used by one vehicle occupant from disturbing other occupants of the vehicle, are used to play stereo sound, the display 174 is used to show video signals, and so on. In this mode, the front occupants can listen to one content and the passengers in the back seat can listen and/or view another content.
In another instance, the motor vehicle is a trailer parked overnight, and all the occupants decide to watch content together on the display 174. Some of the occupants are children. The preferences of the occupants are entered or prerecorded, the signal processor searches for content matching these preferences, and receives content from several sources. The signal processor then selects the content to be rendered based on the rules and priority selected. The tags of the content segments are also monitored by the signal processor 168 and segments with objectionable content are omitted.
Many other rules can be formulated based on different conditions such as the weather, the presence of passengers, the time of day, and many other criteria can be used to define a large number of rules for the operation of the vehicle's multimedia reproduction system.
If more than one content item is available at any one time that meets the criteria set forth by the program selector, then the content is either played in a preselected sequence (determined for example by rules in memory 180—e.g., children's stories played first, followed by gardening programs, and then classical music), by arranging the content in hierarchical order and playing only the top “N” content files, or by using a random rule, or using other criteria. As discussed previously for step 362, a listing or ‘menu’ of the items could also be provided to allow users to select what to schedule what to play in what order. If the system supports simultaneous playback of multiple content, then multiple content, and/or portions thereof, may be played simultaneously. e.g. video or stills from one source and audio from another. If no content is available on line, or if it is so preferred, content is played from CDs or DVDs using player 176.
Another system 200 is shown in
Rules for operating the system are stored in a rules memory 204.
The users enter their preferences and other information in a program selector 206. The system 200 includes several devices that are individually operated by users to obtain the desired contents. Different users may operate the various devices at different parts of the site, or, in some instances, even from the same part. One such device is a large screen HDTV 208. This device may be situated, for example, in a den. Also in the den is a multichannel sound system 210. The sound system 210 can be used to listen to multichannel sound programs, including operas, rock concerts, etc. Or, the sound system 210 and the HDTV screen 208 are used together to view movies or other presentations. Either or both devices 208, 210 are coupled to a set of matched speakers 212A used to deliver multichannel (e.g., 5.1 or 6 channel) audio signals.
In a different part of the house, for example, the kitchen there is provided a small screen TV set 214 playing signals in the NTSC format. Associated with this TV set 214 there is a second set of speakers 212B which delivers lower quality stereo signals. This TV set may be used to provide news shows, soap operas, recipes, etc.
A PC 216 with a monitor 218 and another speaker set 212C is located in an office.
Finally, a PDA or hand-held device 220 is available at the site. The device has its own set of earphones 212D and can be used to listen to various audio signals. It communicates with the microprocessor 202 through a WiFi channel, an IR link, a Bluetooth link, or other wireless means.
The system 200 can be used to receive and render a large variety of content. The content is preferably collected by the microprocessor 202 from the receiver devices 206 and delivered to the individual devices for rendering. In this system, the processing is shared between the microprocessor and each individual device. Rendering is performed by the speakers 212, and/or the various screens described. Importantly, based on the rules from the rules memory 204 and/or the tags associated with the content, the content is distributed to each device based on (A) the capabilities and limitations of each device; and (B) the preferences of the users. For example, on a Sunday afternoon several users may decide to watch football games in the den. The microprocessor 202 runs a search and finds loads of content on football, starting with text messages from individuals, newspaper articles with black-and-white pictures, magazine articles with color pictures, low quality audio streaming programs from AM stations, low quality video signals from various sources and HD quality video signals from other sources. The microprocessor 202 rejects all content that is not suitable for the HDTV screen. At the same time, another user is in the office collecting materials on football for a paper. He is presented with the newspaper and magazine articles with the pictures. Meanwhile, or at another time, another user wants to see a cooking show on souffles in the kitchen. The microprocessor 202 sends to the TV 214 only low quality programs audio-visual programs. The PDA 220 is used to play musical selections, training programs or other audio signals that are stored in its own memory (not shown) or are sent to it by the microprocessor 202.
In the embodiments of
In an alternate embodiment, content may be stored with an attachment that includes program code defining the alternate forms to which the content can be transformed and/or the algorithms that are to be used for transforming the content. In some instances, standard transformation algorithms are stored in the transform engine that may require some transformation parameters. These transformation parameters may be stored together with the content and distributed therewith. Alternatively, the parameters may be obtained separately at a later time.
The content transformation may be performed automatically, e.g., and the transformed content may be cued to follow the presentation of native content, or may be mixed with any native content in any order. Alternatively, when the user wants to get a content at some device, for example, he may receive a message indicating that content in a different format is also available and he is asked to chose whether he wants to have the content transformed and then rendered, or not.
In an alternate embodiment, content is stored and distributed in an encoded or encrypted form that, optionally, may require an activating key. In this manner, a content publisher can safely distribute content without fear of piracy. After the content is received by the microprocessor 202, a known algorithm is used to decode and/or decrypt the content, using the key (if necessary). The content is then sent to the proper device for rendering.
In other instances or embodiments, the content may include one or more algorithms to selectively decode, decrypt or otherwise generate plain (unencoded) content in one of several formats. The format may be selected by the user, or it may be determined by the key supplied. For example, the same content with the proper transformation could be rendered as a HDTV presentation or as a low quality NTSC presentation. The choice may depend on what the user paid for. Alternatively, the content may be supplied with the dialog in a variety of languages. The key provided by the user then selects the language for the dialog.
In the embodiment of
In another embodiment, once content is identified by canvassing, the user may require it to be processed further. For example, in some instances, the user may want the content to be ‘sanitized’ (another form of transformation) by removing objectionable scene or language. Moreover, the user may prefer to have this processing done off site for example by a third party. Content may also be scheduled for processing and/or presentation at later times, as discussed below.
One mode of operation of the receiver device of
In step 304 the rules for the device are obtained. As discussed above, the device rules are determined automatically, are preprogrammed, or are selected by the user. Thus, the rules are dependent on the device characteristics (i.e., what kind of program files can the device process and display) and, optionally, the preferences of the user. These preferences may be permanent (e.g., the user may select to see programs about flowers but never about wrestling) or temporal/temporary (e.g., the user may indicate that he is in the mood for a ballet at a particular time, or every Friday night).
In step 306 the device rules and the program file types are compared. If the program type coincides with the device rules (step 308) then the program is possibly processed, and rendered or otherwise presented to the user in step 310. As part of this step, the program may also be saved for future presentation.
If no match is found in step 306 then the program is ignored (step 312).
The table of
Yet, other devices, such as Internet radios or entertainment devices in cars (such as the one in
As discussed above, the programs, or portions thereof, can be either pushed or pulled from the Internet and are then examined by the gate to determine whether they should be accepted and played, or not.
In step 504 the search is sent out. In step 506 results of the search are obtained. These results include web site addresses and tags. The tags identify the characteristics of the programs, or portions thereof, on the respective the web site, i.e., whether the program, or portion thereof, is an audio file, a text file, a multimedia file, etc.
In step 508 the tags are compared to the characteristics of the device (
If there is no match then in one embodiment the content is discarded or ignored (step 514). If there is a match, the microprocessor can perform one of several different functions. For example, the microprocessor may store the content in a memory (not shown) for presentation at a later time (step 512A). In this embodiment, an index is generated for the user indicative of the content available for presentation. The user can then obtain this stored content at will. In another embodiment, the content is stored and the user gets an immediate announcement indicating that the content is available (step 512B) and requesting instructions as to whether the user wants to receive a presentation of the content immediately, at a later time, etc. Lastly, the content may be automatically and immediately presented to the user (step 512C).
In another alternate embodiment, if no match is found in step 510, an investigation is made to determine if the content should be transformed and fitted to the device characteristics and/or user preferences. For this purpose, in step 514, a check is performed to determine if a transformation process is desired and/or available. If yes, then a check is performed to determine if a transform table is available for the kind of the received content (step 520). If no table is available, then in step 522 a check is performed to determine if there are transform parameters or formulas attached to the content itself. If either there is transform table available, or if transform parameters are found with the content then in step 524 the content is transformed into another format that fits the subject system, either because it is compatible with the system characteristics or because it matches the preferences of the user. The transformed or new content is then handled in steps 512A, B or C in the manner discussed above. Otherwise the content is discarded (step 518) or ignored.
Of course, for a typical search it is expected that a plurality of hits are returned. Each of these hits is then analyzed as set forth in
Next, in step 360 the content may be edited so that the time of presentation is reduced, and/or the amount of space required to store the content is minimized. For example, a content item may include a video presentation of how to grow several different types of flowers, but the user has previously indicated that he wants only content related to daisies. Therefore, in step 360 the content is edited by eliminating all the portions related to the growing of flowers other than daisies. Alternatively, the step of editing 360 could also include compressing the content to a more compact size.
In step 362 the content is stored and in step 364 a content list is updated by including an identification of the content that was just stored.
As discussed above, if the content is not in the proper form, it may be discarded or it may be transformed. The transformation process may be performed to fit the content to a form compatible with the capabilities of the receiver device, and, optionally, to match the user's preferences. The processing for transformation is dependent on the form of the initial content and the final desired form. While in many instances, the process is fairly complex and requires intensive calculations, in some instances, the process may be relatively simple. For example, a user is driving in a car and wants to hear news in general, or wants to hear an audio program on a specific topic, but the received content is a multimedia-type file with both audio and video components. In this case, the transform process can parse the program file by stripping away the undesired component (for example, the video component) and saving and presenting the desirable component (in this case, the audio component) of the program file. Alternatively, the content is transformed from one form to another. For example, an HDTV presentation is transformed into a standard NTSC TV presentation. More drastic transformations can be performed as well. For example, an audio signal can be converted into text, using for example a known speech recognition algorithm. Alternatively, text is converted into speech. Other types of transformations may also be performed.
In step 368 a check is performed as to whether all or only parts of the content need to be retained for further processing. More specifically, in step 368 a process is initiated that isolates one or several components of the received content. For example, the content may be a multimedia presentation, but the user wants to see only the visual part, (i.e., without any sound). However, most audio-video content is transmitted in a form in which the audio and visual components are multiplexed (for example, in time and/or frequency) together, for example, using MPEG transport. In order to obtain only the visual component, in step 370 the content is demultiplexed so that its components are clearly identifiable.
If the content is in the wrong form, it is transformed using a process starting with step 372. In step 372, a check is made as to whether the overall content, or the relevant components, thereof should be further transformed, for example, to suit device limitations. If no further transformations are required, the content, or the relevant components thereof, is decoded in step 374, if necessary. Otherwise, in step 376 the transform parameters are obtained. These transform parameters could be stored in a memory, or can be transmitted along with the media, or may be available from other sources. In step 378 the transformation is performed using the parameters from step 376. In step 374 decoding is performed, if necessary. The transformed content is then processed in the same manner as the standard content starting at step 354 as shown.
As discussed above, the systems described can be used for rendering content to users in different manners. One mode of operation is illustrated in
If in step 404 it is determined that rendering is not required immediately, then the content is stored in step 412.
Once content has been stored, the user can request it at will, which request is received in step 414. in step 416, the list of available content is presented to the user in any suitable form. As discussed above, the list organizes the content using one or more relations therebetween. In step 418 a selection from the table is obtained. In step 420 the requested content, or the content best matching the request is retrieved from memory and processed in step 406. Again, this processing step may include a transformation, if necessary. The content is then prepared in step 408 and rendered in step 410.
In one embodiment, if the content meets the predetermined criteria then the content is transferred to a mass storage means, such as a hard drive 510.
When requested by a user, the content is transferred to an output buffer 512. From this buffer 512, the content is then fed to an output interface 514. Thus, depending on user preferences and other criteria, content is rendered by device 520 either in real time, or at a later time. The output interface sends the content to the rendering device 520. Typically, the rendering device is a multimedia presentation apparatus such as an HDTV system.
If the content does not meet the predetermined criteria, it is simply discarded, for example by deleting the contents of the input buffer 504.
The recorder 500 may be integrated into, or at least connected to a home network that is used to distribute content and other materials to various devices within a home. In this embodiment, the content is received by the input port 502 through the home network 516. The content is then sent to the rendering device 520 (and/or other rendering devices, such as portable music players, etc.) either through the home network 516 or, possibly, through another network 518.
In another embodiment of the invention, the content is partitioned into several segments, each segment having its own tags or other coding means. The filter 506 then determines whether particular segments of the content meet the predetermined criteria. For example, a user may designate content related to animal shows about wolves. If content is received that includes one segment about foxes and the other segment about wolves, then the filter 506 discards the segment about foxes and only saves on the hard drive 510 the segment about wolves. Alternatively, the segment about foxes is saved (either together with the segment on wolves, or separately) for a later presentation.
Similarly, if for some reason the content includes several segments of various types of media, the segments with media compatible with the rendering device 520 are saved, while the others are discarded.
The filtering can be done in real time, and the content can then be stored on the hard drive, streamed to a rendering device, or both. In many cases, the rendering device has sufficient memory to receive the streaming content, and buffer it temporarily. For example, if the rendering device is a TV receiver, it may be able to buffer only a couple of frames. The remaining content is then stored either on the hard drive 510 or the output buffer 512. On the other hand, a portable music player usually has a much larger capacity and can store a large number of songs. Buffering may also be necessary if the rendering device is temporarily unavailable. For example, the rendering device may be occupied with some intensive signal processing, it may be off line, or it may be out of range of the network. Alternatively, buffering may be required because the rendering device may not have sufficient capacity or resources to receive the content in a single data transfer operation.
As mentioned above, in some instances the type of content may not be known and therefore it may be difficult to determine whether the user site has even the capability of rendering the content without some further analysis and processing. According to this invention, in such instances, the content is first downloaded and stored in either the input buffer or the hard drive. The content can then be analyzed the microprocessor 508 as discussed above to determine whether the content should be accepted or not and whether the content can be played as is or whether it needs to be converted. Once this analysis is completed, the content is then discarded, sent to the rendering device, stored for future rendering, or converted into an acceptable type.
In the recorder embodiments discussed so far, the content itself is not transformed. In another embodiment, the content is transformed by the filter 506 so that it is converted to a type that meets the predetermined criteria. For example, some of the characteristics of the content that may be changed include aspect ratio, color bit depth, sound, etc. This embodiment is particularly advantageous in a recorder because the recorder is idle very often (for example, at night) and the microprocessor 508 is free to do the necessary signal processing during this time.
Another type of conversion pertains to the type of content rather then its physical characteristics. For example, a segment of the content may contain material objectionable by the user. The objectionable material is typically identified by an appropriate tag. The PVR transforms this content to eliminate the objectionable material, either by deleting the respective segment(s) or substituting other segment(s). These other segments may be provided by the content distributor, or by a third party.
Alternatively, one or more generic segments may be stored by the PVR and used to replace objectionable segments from the content as needed. In another embodiment, instead of replacing objectionable content segments, the microprocessor 508 analyzes the content, determines what graphic (or audio) portions of the content segments are objectionable, and then mask or replace only the objectionable portions of the content segment with sanitized, generic, or blank material. Again, these sanitized portions may be received from external sources or may be generated internally. Portions may be sanitized by blurring, or scrambling the same.
Of course, while the substitution or deletion of the objectionable portions is taking place, transmission of that content to the rendering device is delayed, as disclosed in U.S. Pat. No. 6,351,596.
One perennial problem with any content distributed through an unsecured channel is that it may contain viruses or other programs that may corrupt the content and even damage the user system. Therefore, in another embodiment, when content is first received, it may be stored in the input buffer or other similar memory means provided for this purpose. In this embodiment, the content is quarantined by the input buffer until the microprocessor 508 scans it to insure that it is safe (i.e., it does not contain any viruses, etc.) Once the content is found to be safe, it is then stored on the hard drive 510 and/or distributed to the rendering device 520 as discussed. Instead of, or in addition to the scanning, the content may be declared to be safe when a message is received from a third party indicating vouching that the content is safe.
In another embodiment, the producer or distributor of the content may decide to release the content to the public only at a certain specific date and time. The content in this case is stored in the input buffer, or other similar means until such time that it can be released, as determined by the microprocessor 508, for example, in response to a separate release signal received from a remote source.
One of the functions of the system may be to prioritize content. This function may also be implemented with a PVR. More particularly, in one embodiment, the PVR acts to prioritize use of home network bandwidth. In this embodiment, attached devices and/or their users are explicitly and/or implicitly assigned priorities at or by the PVR. The PVR monitors the loading on the home network, and if the aggregate bandwidth request of the attached devices exceeds the available PVR output bandwidth capacity, the PVR can take various actions to insure that the aggregate output bandwidth remains at or below its output capacity. For example, the PVR can simply successively terminate output to the lowest priority device/user, until its aggregate output is within capacity. In another embodiment, the PVR can transcode or otherwise convert content to reduce its aggregate output rate. In one variation of this embodiment, all devices/users have their data rates reduced, but lower priority devices/users suffer a greater data rate reduction, until the aggregate data rate is less than or equal to the aggregate PVR output capacity.
In one embodiment, the PVR provides language selection and/or translation service. For example, the PVR, having downloaded multiple language versions of an audio track, and based upon the preferences of the current user and that user's profile, can select a pre-stored Spanish language audio track for presentation to that user. In another embodiment, the PVR automatically translates the audio track from one language to another. For example although the audio track was originally recorded and downloaded to the PVR in English, the PVR is able to translate the audio track into Spanish. In one variation, the PVR automatically retrieves a Spanish language version of the audio track from the Internet. In another variation, the PVR performs language translation off-line. In another variation, the PVR performs language translation in real- or near-real-time.
In another embodiment, the PVR performs the function of a web page server for the home. In this embodiment, the PVR keeps track of the web-surfing history of the attached devices and/or their various users and updates its cached version of web pages recently surfed, by periodically checking the web to see if those pages have changed. The PVR can also acquire, cache, and update relevant web pages based on preferences of all of its attached (e.g., by home network) users. This process can be implemented, in one embodiment, without explicit user specification (e.g., merely by analysis of user actions by the PVR). As in the embodiments previously described, the PVR can filter web pages as a proxy for devices attached to the network 516, 518. For example, the PVR can effectuate parental control of which web pages can be viewed by whom. This may be preferred to, e.g., having inappropriate content filtered at each child's PC, since children may perhaps more easily hack their own PCs, to bypass any filtering software installed by parents.
While the invention has been described with reference to several particular embodiments, it is to be understood that these embodiments are merely illustrative of the principles of the invention. Accordingly, the embodiments described in particular should be considered as exemplary, not limiting, with respect to the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US5912696 *||Dec 23, 1996||Jun 15, 1999||Time Warner Cable||Multidimensional rating system for media content|
|US6351596 *||Jan 7, 2000||Feb 26, 2002||Time Warner Entertainment Co, Lp||Content control of broadcast programs|
|US6684257 *||Oct 15, 1999||Jan 27, 2004||International Business Machines Corporation||Systems, methods and computer program products for validating web content tailored for display within pervasive computing devices|
|US7136874 *||Oct 17, 2002||Nov 14, 2006||Microsoft Corporation||Adaptive menu system for media players|
|US7174512 *||Nov 28, 2001||Feb 6, 2007||Thomson Licensing S.A.||Portal for a communications system|
|US7284046 *||Sep 4, 2002||Oct 16, 2007||At & T Bls Intellectual Property, Inc.||Coordination of communication with devices|
|US20010051559 *||May 24, 2001||Dec 13, 2001||Cohen Michael Alvarez||Custom content delivery for networked exercise equipment|
|US20020053084 *||Oct 22, 2001||May 2, 2002||Escobar George D.||Customized electronic program guide|
|US20020056102 *||Jan 19, 2001||May 9, 2002||Hughes Electronics Corporation||Personal video on-demand system and method|
|US20020059619 *||Jun 7, 2001||May 16, 2002||Metod Lebar||Hybrid central/distributed VOD system with tiered content structure|
|US20020128740 *||Feb 8, 2002||Sep 12, 2002||Kevin Gage||Method and apparatus for playing multimedia audio-visual presentations|
|US20020138838 *||Mar 20, 2002||Sep 26, 2002||Peters Marc Andre||Memory control method for a personal video recording system|
|US20030028890 *||Oct 10, 2001||Feb 6, 2003||Swart William D.||Video and digital multimedia acquisition and delivery system and method|
|US20030145331 *||Jan 31, 2002||Jul 31, 2003||Escobar George D.||Modifying content retrieved from a set-top box|
|US20030208763 *||Nov 22, 2002||Nov 6, 2003||Mcelhatten David||Program guide and reservation system for network based digital information and entertainment storage and delivery system|
|US20040148226 *||Jan 28, 2003||Jul 29, 2004||Shanahan Michael E.||Method and apparatus for electronic product information and business transactions|
|US20040221308 *||Jan 7, 2004||Nov 4, 2004||Cuttner Craig D.||Integrated media viewing environment|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7664113 *||Feb 2, 2007||Feb 16, 2010||Spreadtrum Communications Inc.||Apparatus and methods for system multiplexing and program element identification|
|US7712136||Dec 7, 2006||May 4, 2010||Ironport Systems, Inc.||Controlling a message quarantine|
|US7748038||Dec 6, 2004||Jun 29, 2010||Ironport Systems, Inc.||Method and apparatus for managing computer virus outbreaks|
|US7756930||May 28, 2004||Jul 13, 2010||Ironport Systems, Inc.||Techniques for determining the reputation of a message sender|
|US7836133||May 5, 2006||Nov 16, 2010||Ironport Systems, Inc.||Detecting unwanted electronic mail messages based on probabilistic analysis of referenced resources|
|US7849142||May 27, 2005||Dec 7, 2010||Ironport Systems, Inc.||Managing connections, messages, and directory harvest attacks at a server|
|US7854007||May 5, 2006||Dec 14, 2010||Ironport Systems, Inc.||Identifying threats in electronic messages|
|US7877493||May 5, 2006||Jan 25, 2011||Ironport Systems, Inc.||Method of validating requests for sender reputation information|
|US8171250||Jan 14, 2009||May 1, 2012||Qualcomm Incorporated||Method and apparatus for delivering content based on receivers characteristics|
|US8528029||Nov 8, 2005||Sep 3, 2013||Qualcomm Incorporated||Apparatus and methods of open and closed package subscription|
|US8533358||Nov 8, 2005||Sep 10, 2013||Qualcomm Incorporated||Methods and apparatus for fragmenting system information messages in wireless networks|
|US8538812||Oct 18, 2012||Sep 17, 2013||Jumptap, Inc.||Managing payment for sponsored content presented to mobile communication facilities|
|US8554192||Jan 21, 2013||Oct 8, 2013||Jumptap, Inc.||Interaction analysis and prioritization of mobile content|
|US8560537||Oct 8, 2011||Oct 15, 2013||Jumptap, Inc.||Mobile advertisement syndication|
|US8571570||Nov 8, 2005||Oct 29, 2013||Qualcomm Incorporated||Methods and apparatus for delivering regional parameters|
|US8600836||Nov 8, 2005||Dec 3, 2013||Qualcomm Incorporated||System for distributing packages and channels to a device|
|US8615505||Nov 19, 2012||Dec 24, 2013||Jumptap, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US8615719||Nov 5, 2005||Dec 24, 2013||Jumptap, Inc.||Managing sponsored content for delivery to mobile communication facilities|
|US8620285||Aug 6, 2012||Dec 31, 2013||Millennial Media||Methods and systems for mobile coupon placement|
|US8626736||Nov 19, 2012||Jan 7, 2014||Millennial Media||System for targeting advertising content to a plurality of mobile communication facilities|
|US8631018||Dec 6, 2012||Jan 14, 2014||Millennial Media||Presenting sponsored content on a mobile communication facility|
|US8655891||Nov 18, 2012||Feb 18, 2014||Millennial Media||System for targeting advertising content to a plurality of mobile communication facilities|
|US8660891||Oct 30, 2007||Feb 25, 2014||Millennial Media||Interactive mobile advertisement banners|
|US8666376||Oct 30, 2007||Mar 4, 2014||Millennial Media||Location based mobile shopping affinity program|
|US8688088||Apr 29, 2013||Apr 1, 2014||Millennial Media||System for targeting advertising content to a plurality of mobile communication facilities|
|US8688671||Nov 14, 2005||Apr 1, 2014||Millennial Media||Managing sponsored content based on geographic region|
|US8718449 *||Jun 9, 2008||May 6, 2014||Verizon Patent And Licensing Inc.||Digital video recorder content filtering|
|US8768319||Sep 14, 2012||Jul 1, 2014||Millennial Media, Inc.||Presentation of sponsored content on mobile device based on transaction event|
|US8774777||Apr 29, 2013||Jul 8, 2014||Millennial Media, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US8784206||Apr 14, 2012||Jul 22, 2014||Wms Gaming, Inc.||Modifying presentation of three-dimensional, wagering-game content|
|US8798592||Apr 29, 2013||Aug 5, 2014||Jumptap, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US8805339||Oct 20, 2011||Aug 12, 2014||Millennial Media, Inc.||Categorization of a mobile user profile based on browse and viewing behavior|
|US8812526||Oct 18, 2011||Aug 19, 2014||Millennial Media, Inc.||Mobile content cross-inventory yield optimization|
|US8819659||Mar 29, 2011||Aug 26, 2014||Millennial Media, Inc.||Mobile search service instant activation|
|US8832100||Jan 19, 2006||Sep 9, 2014||Millennial Media, Inc.||User transaction history influenced search results|
|US8843395||Mar 8, 2010||Sep 23, 2014||Millennial Media, Inc.||Dynamic bidding and expected value|
|US8843396||Sep 16, 2013||Sep 23, 2014||Millennial Media, Inc.||Managing payment for sponsored content presented to mobile communication facilities|
|US8893179 *||Nov 8, 2005||Nov 18, 2014||Qualcomm Incorporated||Apparatus and methods for providing and presenting customized channel information|
|US8958779||Aug 5, 2013||Feb 17, 2015||Millennial Media, Inc.||Mobile dynamic advertisement creation and placement|
|US8989718||Oct 30, 2007||Mar 24, 2015||Millennial Media, Inc.||Idle screen advertising|
|US8995968||Jun 17, 2013||Mar 31, 2015||Millennial Media, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US8995973||Jun 17, 2013||Mar 31, 2015||Millennial Media, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US9058406||Oct 29, 2012||Jun 16, 2015||Millennial Media, Inc.||Management of multiple advertising inventories using a monetization platform|
|US9076175||May 10, 2006||Jul 7, 2015||Millennial Media, Inc.||Mobile comparison shopping|
|US9110996||Feb 17, 2014||Aug 18, 2015||Millennial Media, Inc.||System for targeting advertising content to a plurality of mobile communication facilities|
|US20050283837 *||Dec 6, 2004||Dec 22, 2005||Michael Olivier||Method and apparatus for managing computer virus outbreaks|
|US20060031314 *||May 28, 2004||Feb 9, 2006||Robert Brahms||Techniques for determining the reputation of a message sender|
|US20060031359 *||May 27, 2005||Feb 9, 2006||Clegg Paul J||Managing connections, messages, and directory harvest attacks at a server|
|US20060136983 *||Dec 19, 2005||Jun 22, 2006||Lg Electronics Inc.||Apparatus for processing texts in digital broadcast receiver and method thereof|
|US20070028262 *||Jul 29, 2005||Feb 1, 2007||Zermatt Systems, Inc.||Virtual discovery of content available to a device|
|US20070073660 *||May 5, 2006||Mar 29, 2007||Daniel Quinlan||Method of validating requests for sender reputation information|
|US20070073834 *||Nov 8, 2005||Mar 29, 2007||Mark Charlebois||Apparatus and methods for providing and presenting customized channel information|
|US20070078936 *||May 5, 2006||Apr 5, 2007||Daniel Quinlan||Detecting unwanted electronic mail messages based on probabilistic analysis of referenced resources|
|US20070078944 *||Nov 8, 2005||Apr 5, 2007||Mark Charlebois||Apparatus and methods for delivering and presenting auxiliary services for customizing a channel|
|US20070079379 *||May 5, 2006||Apr 5, 2007||Craig Sprosts||Identifying threats in electronic messages|
|US20070083929 *||Dec 7, 2006||Apr 12, 2007||Craig Sprosts||Controlling a message quarantine|
|US20080009268 *||May 8, 2006||Jan 10, 2008||Jorey Ramer||Authorized mobile content search results|
|US20090304350 *||Dec 10, 2009||Verizon Data Services Llc||Digital video recorder content filtering|
|US20100131528 *||Nov 26, 2008||May 27, 2010||Gm Global Technology Operations, Inc.||System and method for identifying attributes of digital media data|
|EP2031931A2 *||Jul 30, 2008||Mar 4, 2009||Postech Academy-Industry Foundation||Resource management method in wireless communication system|
|WO2012115657A1 *||Feb 25, 2011||Aug 30, 2012||Empire Technology Development Llc||Augmented reality presentations|
|U.S. Classification||1/1, 707/999.003|
|Cooperative Classification||H04N21/84, H04N7/163, H04N21/41422, H04N21/4622, H04N21/482, H04N21/4751, H04N21/4532, H04N21/4135|
|European Classification||H04N21/475A, H04N21/84, H04N21/462S, H04N21/41P7, H04N21/45M3, H04N21/414T, H04N21/482, H04N7/16E2|
|Feb 23, 2005||AS||Assignment|
Owner name: WARNER BROS. ENTERTAINMENT INC., CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OSTROVER, LEWIS S.;BRYAN, DAVID ALAN;REEL/FRAME:016304/0935;SIGNING DATES FROM 20041230 TO 20041231