US 20090190028 A1
A system and method for determining the characteristics of a device coupled to a client device are disclosed. A method, according to one embodiment, includes driving a display device with a first video output signal formatted according to a first video interface specification; responsive to driving the display device, soliciting user input based on information included in the first video output signal; determining a characteristic of the display device based on the user input; and driving the display device according to the determined characteristic.
1. A system, comprising:
processing logic configured to effect the presentation of objects on a display screen of a display device that are altered by one or more pipelines, the processing logic configured to solicit a response by a user, the processing logic further configured to, responsive to the user input, determine the de-interlacing capabilities of the display device.
2. The system of
3. The system of
4. The system of
a media memory configured to store one or more consecutive interlaced pictures; and
circuit logic configured to:
access an interlaced pictures from the memory;
process a plurality of lines from a field corresponding to the interlaced picture; and
generate each line of a resulting progressive picture.
5. The system of
6. The system of
7. The system of
8. The system of
9. The system of
a media memory configured to store one or more consecutive interlaced pictures; and
circuit logic configured to:
access plural interlaced pictures from the memory;
process a plurality of lines from plural field corresponding to the plural interlaced pictures; and
generate each line of resulting plural progressive pictures.
10. The system of
11. The system of
12. The system of
13. The system of
14. The system of
15. The system of
16. The system of
17. The system of
18. A method, comprising:
altering one or more objects corresponding to one or more pictures;
de-interlacing by a client device one or more fields corresponding to the altered one or more objects;
outputting the altered objects and the de-interlaced altered objects on a display screen of a display device; and
soliciting user input to determine a quality of one or more rendered displays on the display screen, the one or more rendered displays based on the outputted altered objects that are de-interlaced at the display device and the de-interlaced altered objects provided by the client device.
19. The method of
20. A system, comprising:
means for altering one or more objects;
means for outputting the altered one or more objects on a display screen;
means for soliciting a response by a user in association with the displayed objects; and
means for determining the de-interlacing capabilities of the display device responsive to the user input.
This application is a divisional of U.S. patent application Ser. No. 10/761,777, filed on Jan. 21, 2004, which is incorporated by reference herein in its entirety.
This disclosure relates in general to the field of television systems, and more particularly, to the field of interactive television.
With recent advances in digital transmission technology, subscriber television systems are now capable of providing much more than the traditional analog broadcast video. In implementing enhanced programming, the home communication terminal (“HCT”), otherwise known as the set-top box, has become an important computing device for accessing content services (and content within those services) and navigating a user through a maze of available services. In addition to supporting traditional analog broadcast video functionality, digital HCTs (or “DHCTs”) now also support an increasing number of two-way digital services such as video-on-demand and personal video recording.
Typically, a DHCT is connected to a cable or satellite, or generally, a subscriber television system, and includes hardware and software necessary to provide the functionality of the digital television system at the user's site. Some of the software executed by a DHCT can be downloaded and/or updated via the subscriber television system. Each DHCT also typically includes a processor, input/output capabilities, communication components, and memory, and is connected to a television set or other display device, such as a personal computer. While many conventional DHCTs are stand-alone devices that are externally connected to a television, a DHCT and/or its functionality may be integrated into a television or personal computer or even an audio device such as a programmable radio, as will be appreciated by those of ordinary skill in the art.
Technological advances now permit generation and transmission of a variety of higher resolution pictures and video formats. Coincident with the advancing technology of transmission equipment is the technological improvements of the DHCTs and the television set to receive and display a plurality of video formats. There are a wide range of television sets available today, including the conventional cathode ray tube (CRT) styles, overhead projection, rear projection, liquid crystal display based technology, and plasma television sets that can be mounted on a wall. These variations in television sets often lead to a wide variety of characteristics that affect processing of a television picture for display. A sourced television or video signal is typically processed for display by considering its characteristics, as well as the TV set's characteristics such as the size of the screen, the aspect ratio of the display, and whether the display implements an interlaced or progressive scan format, among other characteristics. Due to the increasing complexity and variation of DHCTs and television sets (and thus a multitude of characteristics to consider in processing a video signal), connecting a television set to, or otherwise communicating with, a DHCT and achieving a viewable picture and a desired display quality is often a challenge to even the most technologically adept. Thus a need exists in the industry to address the aforementioned and/or other deficiencies and/or inadequacies.
The disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
The preferred embodiments of the disclosure now will be described more fully hereinafter with reference to the accompanying drawings. The preferred embodiments of the disclosure include systems and methods that provide an interactive session with a user to determine the characteristics of a television set or other display device coupled to a digital home communication terminal (DHCT).
Video formats can vary in picture size, frame rate, and on whether pictures are progressive or interlaced. A progressive picture constitutes all the lines of a frame whereas an interlaced picture has a top field and bottom field of alternating lines to constitute a complete frame. An interlaced picture is displayed during respective field intervals. Video formats can further vary in other attributes or characteristics such as color format, color primaries, picture width-to-height aspect ratio, and width-to-height aspect ratio of the individual picture elements, or pixels, that make-up the picture.
As a non-limiting example, the video formats of a compressed digital television signal processed in a DHCT for display include formats specified by ATSC (Advanced Television Systems Committee) Digital Television Standard A/54 and include the characteristics described above. An analog television signal such as a NTSC (National Television System Committee) television signal can be processed for display as well.
As there are multiple video formats for a sourced television signal, there are also multiple physical output interfaces or connectors (or similarly, ports) in the DHCT from which a DHCT-processed television signal can be output. The processed signal that is output through a physical output interface complies with the format specification of that interface. An interface specification, such as a video interface specification, can also include mechanisms for providing ancillary data. For example, the provision of close-caption text within a video signal may be part of the video interface specification.
In addition to possible differences in signaling and physical characteristics, video interface specifications can differ in one or more parameters that pertains to the characteristics of the video picture. For instance, parameters that can differ in value in distinct video interface specifications include picture size, frame rate, whether pictures are progressive or interlaced, color format, colorimetry, picture width-to-height aspect ratio, width-to-height aspect ratio of pixels, and if and how ancillary data is provided.
A video interface specification can allow for one or more picture parameters to take different values. For instance, the value of a colorimetry parameter may differ according to the video picture's colorimetry. Furthermore, a video interface specification can support multiple sets of a combination of parameter values that specify the characteristics of the picture. The parameters that can take different values in the multiple sets of a combination of parameters correspond to characteristics that may include picture size, frame rate, whether pictures are progressive or interlaced, color format, colorimetry, picture width-to-height aspect ratio, width-to-height aspect ratio of pixels, and if and where ancillary data is carried. For instance, the SMPTE (Society of Motion Picture and Television Engineers) 274 specification supports multiple input and output picture formats, such as 1920×1080 interlaced or progressive pictures, one of various frame rates, and RGB or YPbPr encoded pixels. SMPTE 296 specifies 1280×720 progressive pictures for input and output.
A physical output interface or connector can further serve to output video signals corresponding to one or more video format specifications. For instance, the physical connector trio used to output component analog video as YPbPr could be configured to output a television signal as an RGB component analog video signal. As another non-limiting example, a physical output interface can be used to output a television signal compliant to SMPTE 274 or SMPTE 296.
It would be understood by those having ordinary skill in the art that other specifications and/or standards can be used that will include the same, fewer, more, or different parameters and yet be considered within the scope of the preferred embodiments of the disclosure. Consequently, a DHCT configured in accordance with the preferred embodiments determines the video formats supported by the television set or other display device connected to the DHCT. Responsive to these determinations, the DHCT can then set its video output format, resolution of graphics overlays, and closed caption support accordingly and process sourced television signals accordingly.
The systems and methods of the preferred embodiments of the disclosure will be described in the context of a subscriber television system, and particularly, a DHCT that is connected to a TV set, although other systems that include communication with an interactive display are considered to be within the scope of the disclosure. Additionally, reference herein will be made to physical output ports with the understanding that physical output ports include ports, connectors, and physical interfaces, including wireless interfaces. Since the preferred embodiments of the disclosure can be understood in the context of a subscriber television system, one such example system is described below, with further description of the DHCT and headend components. Following the description of these components is an example method of the preferred embodiments of the disclosure, followed by some illustrations of some example interactive sessions of a discovery procedure that can be used to determine the display device characteristics to enable a quality picture to be displayed.
The disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those of ordinary skill in the art. Furthermore, all “examples” given herein are intended to be non-limiting and among others not shown but understood to be within the scope of the disclosure.
The DHCT 16 is typically situated at the residence or place of business or recreation of a user and may be a stand-alone unit or integrated into a television set, a personal computer, or other display devices, or an audio device, among other media devices. The DHCT 16 receives content (video, audio and/or other data) from the headend 11 through the network 18 and in some embodiments, provides reverse information to the headend 11 through the network 18.
The headend 11 receives content from one or more content providers (not shown), including local providers. The content is processed and/or stored and then transmitted to client devices such as the DHCT 16 via the network 18. The headend 11 may include one or more server devices (not shown) for providing content to the DHCT 16. The headend 11 and the DHCT 16 cooperate to provide a user with television services via a television set (not shown). The television services may include, for example, broadcast television services, cable television services, premium television services, video-on-demand (VOD) services, and/or pay-per-view (PPV) services, among others.
In a typical system, the programming, services and other information from content providers can be distributed according to a variety of mechanisms. The input signals may be transmitted from sources to the headend 11 via a variety of transmission paths, including satellites (not shown) and terrestrial broadcast transmitters and antennas (not shown). The headend 11 can also receive content from a direct feed source 210 via a direct line 212. Other input sources from content providers include a video camera 214, an analog input source 208, and/or an application server 216. The application server 216 may include more than one line of communication. One or more components such as the analog input source 208, the direct feed source 210, the video camera 214, and the application server 216 can be located external to the headend 11, as shown, or internal to the headend 11 as would be appreciated by one having ordinary skill in the art. The signals provided by the content or programming input sources can include a single content instance (e.g., a program episode or show) or a multiplex that includes several content instances.
The headend 11 generally includes one or more receivers 218 that are each associated with a content source. MPEG (Motion Picture Experts Group) encoders, such as encoder 220, are included for digitally encoding local programming or a real-time feed from the video camera 214 or the like. The encoder 220 outputs the respective compressed video and audio streams corresponding to the analog audio/video signal received at its input. For example, the encoder 220 can output formatted MPEG-2 or MPEG-1 packetized elementary (PES) streams or transport streams compliant to the syntax and semantics of the ISO (International Organization for Standardization) MPEG-2 standard, respectively. The PES or transport streams may be multiplexed with input signals from a switch 230, receiver 218 and control system 232. The multiplexing logic 222 processes the input signals and multiplexes at least a portion of the input signals into a transport stream on connection 240. Analog input source 208 can provide an analog audio/video broadcast signal that can be input into a modulator 227. From the modulator 227, a modulated analog output signal can be combined at combiner 246 along with other modulated signals for transmission into transmission medium 250. Alternatively, analog audio/video broadcast signals from the analog input source 208 can be input into the modulator 228. Alternatively, an analog audio/video broadcast signal can be input directly from the modulator 227 to the transmission medium 250. The analog broadcast content instances are transmitted via respective RF channels, each assigned for transmission of an analog audio/video signal such as NTSC video.
A switch, or switches, such as asynchronous transfer mode (ATM) switch 230, provide an interface to an application server 216. There can be multiple application servers 216 providing a variety of services such as a pay-per-view service, including video on demand (VOD), a data service, an Internet service, a network system, or a telephone system. Service and content providers may download content to an application server located within the STS 10. The application server 216 may be located within the headend 11 or elsewhere within the STS 10, such as in a hub. The various inputs into the headend 11 are then combined with the other information from the control system 232, which is specific to the STS 10, such as local programming and control information, which can include, among other things, conditional access information. The headend 11 contains one or more modulators 228 to convert the received transport streams on connection 240 into modulated output signals suitable for transmission over the transmission medium 250 through the network 18. Each modulator 228 may be a multimodulator including a plurality of modulators, such as, but not limited to, QAM (quadrature amplitude modulation) modulators, that radio frequency modulate at least a portion of the transport streams on connection 240 to become output transport streams on connections 242. The output signals on connections 242 from the various modulators 228 or multimodulators are combined, using equipment such as the combiner 246, for input into the transmission medium 250, which is sent via the in-band delivery path 254 to subscriber locations, such as the DHCT 16.
In one embodiment, the server 216 also provides various types of data on connections 288 a, 288 b to the headend 11. The data, in part, is received by the media access control (MAC) functions 224 that output MPEG transport packets containing data on connections 266 a, 266 b instead of digital audio/video MPEG streams. The control system 232 enables the television system operator to control and monitor the functions and performance of the STS 10. The control system 232 interfaces with various components, via communication link 270, in order to monitor and/or control a variety of functions, including the frequency spectrum lineup of the programming for the STS 10, billing for each subscriber, and conditional access for the content distributed to subscribers. Information, such as conditional access information, is communicated from the control system 232 to the multiplexing logic 222 where it is multiplexed into a transport stream provided on connection 240.
Among other things, the control system 232 provides input to the modulator 228 for setting operating parameters, such as selecting certain content instances or portions of the transport streams for inclusion in one or more output transport stream on connections 242, system specific MPEG table packet organization, and/or conditional access information. Control information and other data can be communicated to hubs and DHCTs 16 via an in-band delivery path 254 or via an out-of-band delivery path 256.
The out-of-band data is transmitted via the out-of-band forward data signal (FDS) 76 of the transmission medium 250 by mechanisms such as, but not limited to, a QPSK (quadrature phase-shift keying) modem array 226. Two-way communication utilizes the reverse data signal (RDS) 80 of the out-of-band delivery path 256. Hubs and DHCTs 16 transmit out-of-band data through the transmission medium 250, and the out-of-band data is received in the headend 11 via the out-of-band RDS 80. The out-of-band data is routed through router 264 to the application server 216 or to the control system 232. The out-of-band control information includes such information as, among many others, a pay-per-view purchase instruction and a pause viewing command from the subscriber location to a video-on-demand type application server located internally or external to the headend 11, such as the application server 216, as well as any other data sent from the DHCT 16 or hubs, all of which will preferably be properly timed.
The control system 232 also monitors, controls, and coordinates all communications in the subscriber television system 10 (
The transmission medium 250 distributes signals from the headend 11 to the other elements in the subscriber television system 10 (
The DHCT 16 preferably includes one or more processors, such as processor 344, which controls the functions of the DHCT 16 via a real-time, multi-threaded operating system (O.S.) 353 that enables task scheduling and switching capabilities. The DHCT 16 also includes a tuner system 345 comprising one or more tuners for tuning into a particular television channel or spacing in the radio-frequency spectrum to display content and for sending and receiving various types of content to and from the headend 11. The tuner system 345 can select from a plurality of transmission signals provided by the subscriber television system 10 (
Referring again to
The signal processing system 314 outputs packetized compressed streams and presents them as input for storage in the storage device 373, or in other implementations, as input to the media engine 330 for decompression by a video decoder (or video decompression engine) 333 and an audio decoder (or audio decompression engine) 332 for display on the TV set 341 via the output system 331 and output connections 340. One having ordinary skill in the art will appreciate that the signal processing system 314 will preferably include other components not shown, including memory, decryptors, samplers, digitizers (e.g., analog-to-digital converters), and multiplexers, among other components. Further, it will be understood that one or more of the components listed above will interface with the processor 344 and/or system memory 349 (and/or dedicated memory for a particular component) to facilitate data transfer and/or processing of the video and/or audio signal for display and/or storage.
The media engine 330 includes the digital video decoder 333, digital audio decoder 332, a memory controller 334, a blitter 337, and the output system 331. The media engine 330 is capable of graphics data generation and graphics data processing capabilities with functional modules such as the blitter 337, which is a functional 2-D (i.e., 2-dimensional) DMA (Direct-Memory-Access) module, often referred to as a blit engine. The functionality in the blitter 337 allows for graphical data or image data stored in a media memory 329 or system memory 349 to be read into the media engine 330, processed, and written back (i.e. output) to memory. The graphical data or image data is read in some predetermined 2-D order, such as raster scan order, and processed in systematic, pipelined-fashion through one or more functional elements in the blitter 337. Processing through the blitter 337 can cause one or more pixels of the input image to be changed to a new value. The output image to memory is representative of a pre-specified set of blitter operations.
During the course of program execution, the processor 344 writes operation settings and/or parameters to registers in the media engine 330 to effect one or more operations in one or more input images to be processed through the blitter 337. Typically, the processor 344 sets the registers prior to invoking the blit operation.
According to the mode set for the blit operation, the number of input pixels read from an input image in a blit operation may be less than, equal to, or more than the number of output pixels produced and written back to memory. According to the mode set in registers, a blit operation may comprise of reading multiple input images to produce an output image, such as an alpha-blending operation on two input images. A blit operation may be also set to produce more than one output image. A blit operation may further be set to process pixels of an input image conditionally (e.g., only if they have a certain value or meet certain conditions).
Blitter functionality further includes a scaling capability that can be employed to effect vertical and/or horizontal scaling of an input image. Thus, an input image can be upscaled or downscaled according to the operational mode and parameters written to the corresponding blitter registers. Such scaling operations can be used to modify the aspect ratio of an input image, for example, from a 4 by 3 aspect (i.e., 4:3) ratio (horizontal to vertical ratio) to a 16 by 9 (i.e., 16:9) aspect ratio. Furthermore, the blitter 337 can be set to perform color conversion or alter the color of an input image.
The scaling functionality in the blitter 337 can be performed with sample-rate converters or scaling filters of multiple taps and phases, as known to those practicing digital signal processing in the state-of-art.
As described previously, the blitter 337 is capable of scaling an input image with a 4:3 aspect-ratio to another aspect-ratio, such as a 16:9, although often at the expense of introducing distortion. The blitter 337 can further be set for the blit operation to crop the boundaries of the input image, prior to conducting the scaling operation, by simply omitting to read (or input) parts of the input image from memory. The blitter 337 can also crop the boundaries of the input image it is processing after conducting the scaling operation by simply omitting to write (or output) parts of the input image to memory. For instance, the blitter 337 is capable of processing an image and cropping it by omitting to write to media memory 329 a pre-specified top and bottom portion or rectangular sections. The left and right exterior portions, or pillars, of an input image can be similarly cropped.
As described previously, the blitter 337 possesses capability to perform color conversion on each pixel of the input graphical data from one color format to another color format. For example, color conversion may comprise converting an input image from an RGB color format to a YPbPr color format, or vice-versa.
Color conversion may also comprise conversion between color primaries specifications, such as from the color primaries specified in ITU-R (International Telecommunication Union-Radiocommunication) Recommendation BT.601 to the color primaries specified ITU-R Recommendation BT.709. In one embodiment, color conversion is employed to create an image that is displayed during an interactive discovery phase to determine the color “temperature” of a TV set or display attached to the DHCT 16.
The blitter 337 further possesses capability to perform a color transformation that represents a non-linear transfer-function from input to output to correct for the perceived intensity (i.e., lightness) of the type of TV set 341 or display driven by the DHCT 16. This color transformation could be for the purpose of what is often called by practitioners in the state of the art as gamma correction (i.e., correction of perceived intensity), or the color transformation can be for other purposes that assist in the TV discovery phase.
All aforementioned blitter operations as well as other blitter operations, as a whole or any combination thereof, may be employed to create images for use during the TV discovery phase.
The media engine 330 processes and feeds data for output via the output system 331 to a television set 341. The output system 331 is configured (e.g., by the processor 344) to convert processed video and graphical pictures that are composited by the media engine 330 to a video signal for output, such signal consistent with the format and signaling specification of a port in the set of physical output ports 340 in the DHCT 16. As an example, the output system 331 includes a digital video encoder (DENC) 336 that converts reconstructed video data (or pictures) fed (or otherwise received) at its input to an analog video signal that is output through a port in the set of physical output ports 340 to drive a TV display connected to the DHCT 16. In one embodiment, the same output video signal is output simultaneously through a plurality of ports in the set of physical output ports 340.
The set of physical output ports 340 may comprise of physical connectors for which one end of a corresponding physical cable is attached to, while the opposite end of the cable is attached to a corresponding physical connector in the TV set 341 (or display). A physical connector in the set of physical output ports 340 may also be a wireless transmitter or emitter device that emits the video signal to a corresponding wireless receiver in the TV set 341. An auxiliary device, such as a second TV display, may be also be connected between the DHCT 16 and the TV set 341 through a second set of corresponding connectors.
A physical connector in the set of physical output ports 340 may also serve as both input and output, as input, or as an asymmetrical output-input port wherein video and audio are output to the TV set 341 and the TV set's display status and/or capabilities, characteristics, or attributes are input to the DHCT 16.
Data is fed to one of the physical output ports 340 sourced from the media engine memory 329 or memory 349 in a manner to produce a raster scan of displayed pixels consistent with the interface or port of the physical output ports 340 in which the display type is connected to the DHCT 16. As is described below, the output system 331, under the direction of a display manager 335 and in cooperation with the processor 344 and operating system 353, provides a formatted signal to one or more ports of the physical output ports 340 that are coupled to corresponding inputs (not shown) at the TV set 341, or at other devices such as a VCR, among others. The physical output ports 340 include a RGB port, a S-Video port, a channel 3/4 port, a baseband port, component analog port, and/or a YPbPr port. TV signals are formatted by the DHCT 16 according to well-known video interface specifications. For example, TV signals routed to the baseband port are formatted by the DHCT 16 according to a baseband video format specification. Baseband video can be analog NTSC (or PAL or SECAM) baseband video. Similarly, TV signals routed to the Ch. 3/4 RF (radio frequency) output port are formatted as RF. The S-video port is for S-video, which is the same as baseband video except that the luminance and chroma are transferred on separate wires. YPrPb is an analog component interface that is popular in early HDTV displays. It couples luminance (Y) and two color difference signals (Pr and Pb) to the display device. The same components when digitized are referred to as Y, Cr and Cb. Other connections of the physical output ports 340 include a digital video interface (DVI) to drive a TV set or display that receives non-compressed digital TV signals at its input, and/or an IEEE-1394 interface (not shown) to drive a TV set or display with a possibly-compressed digital TV signal, among others. DVI is a digital interface often used to transmit HDTV signals to a display. In some embodiments, some interfaces, such as the DVI interface or interfaces or ports not shown, can be bi-directional.
A display buffer (not shown) in media memory 329 is designated for the displayable graphical data. The memory controller 334 in the media engine 330 grants access to transfer data from system memory 349 or other sections of media memory 329 to the display buffer in a timely way that safeguards from the generation of tear artifacts on the TV display. For instance, data transfer can be granted to locations in the display buffer corresponding to locations already passed by the raster-scan ordered data fed from the display buffer into the DENC 336. Thus, data written to the display buffer is always behind (in raster-scan order) the display buffer locations read and fed into the output system 331. Alternatively, data can be written to a secondary display buffer (not shown), also called an off-screen or composition buffer and the display buffer and the off-screen buffer can be logically swapped, for example, during the vertical blanking interval of the output TV signal.
Under the arbitration of the memory controller 334, the audio decoder 332 and the video decoder 333 decode the compressed audio and video signals stored in compressed buffers (not shown) in the media memory 329 to obtain the corresponding audio and video data in an uncompressed format. The reconstructed or uncompressed audio and video data are stored in uncompressed buffers (not shown) in the media memory 329. The process of decoding is coordinated by the memory controller 334 such that each of the decoders 332 and 333 are granted access or authorization every time the respective decoder imports data from or exports data to the media memory 329. Data stored in the decoded buffers may be fed to the output system 331 and the audio output system (not shown) under the arbitration of the memory controller 334. The audio output system may be part of the output system 331 and may include digital-to-analog converters (DACs).
The output system 331, for instance, includes a DENC 336 that provides a video output via physical output ports 340 while the audio DAC (not shown) provides an audio output via an audio connection (not shown). The video signal, which has been converted and possibly composited with graphics, is formatted appropriately for output via the output system 331 in cooperation with the display manager 335, operating system 353, and processor 344, in accordance with a video interface type and a video format of the display device that is receiving the video output (e.g., high definition television (HDTV), NTSC or phase alternate line (PAL)).
The output system 331 comprises capabilities to convert processed video and graphical pictures simultaneously for output. A video display pipeline (VPipe) 338 in the output system 331 receives (or is fed) video pictures from the media memory 329 and processes the pictures for output in a systematic fashion. In one embodiment, the video display pipeline 338 includes (not shown) one or more line buffers and vertical sample-rate converters to effect vertical resizing, horizontal sample-rate converters to effect horizontal resizing, and/or in-line color-conversion capabilities. Furthermore, the video display pipeline 338 may include memory and circuit logic (programmable in some embodiments) to effect picture de-interlacing of interlaced pictures for display as progressive or as larger interlaced pictures. The de-interlacing process may involve the access of the media memory 329 to read a plurality of lines from one or more fields corresponding to one or more consecutive video pictures from a TV signal to process them and generate each line of a converted video picture.
A graphics display pipeline (GPipe) 339 in the output system 331 receives (or is fed) graphical pictures or data from a display buffer in media memory 329 and processes the images for output in a systematic fashion. The graphics display pipeline 339 may include (not shown) one or more line buffers and/or vertical scalers (e.g., sample-rate converters) to effect vertical resizing. The graphics display pipeline 339 can also have horizontal scalers or sample-rate converters to effect horizontal resizing, and/or in-line color-conversion capabilities to effect color conversion.
The output system 331 further includes programmable digital logic and control circuitry (not shown), among other circuitry, to overlay or composite the converted graphical picture at the end of the graphics display pipeline over the converted video picture at the end of the video display pipeline 338 (or vice versa). The converted graphical picture and the converted video picture may be composited with a common center but do not have to be of the same picture resolution. For instance, the converted video picture may span a 1280×720 picture of 16:9 aspect ratio while the graphical picture may span a 960×720 picture of 12:9 (or equivalently 4:3) aspect ratio.
The output system 331 further comprises programmable digital logic and control circuitry (not shown) to enable and disable the video display pipeline 338, to enable and disable the graphics display pipeline 339, and/or to alpha blend the spatially corresponding pixels output by the two respective display pipelines 338,339 to appear as a mix (or translucent) picture that is output to the TV set 341. Some pixels in the graphical picture may have a transparent color value.
The output system 331 preferably generates a TV signal for output to the TV set 341 according to the specification of the video interface used for a particular output port 340. If the video display pipeline 338 is disabled, a graphical picture is displayed on the screen of TV set 341. If the graphical display pipeline 339 is disabled, the video picture (e.g., from a tuned TV channel, from the storage device 373, etc.) is displayed on the TV set 341. In one embodiment, the DHCT 16 performs an interactive discovery session to find the TV set display or TV set characteristics by outputting simultaneously a TV signal through a first output port of the physical output ports 340 and another TV signal through a second output port of the physical output ports 340. For example, a first video display pipeline (not shown) of the video display pipeline 338 in the output system 331 is employed to convert a video picture for output through the aforementioned first output port of the physical output ports 340 and a second video display pipeline (not shown) of the video display pipeline 338 in the output system 331 is employed to convert the same or different video picture for output through the aforementioned second output port of the physical output ports 340.
In another embodiment, a first video display pipeline (not shown) of the video display pipeline 338 and a first graphics display pipeline (not shown) of the graphics display pipeline 339 in the output system 331 are employed during the discovery phase to output a TV signal through an output port (e.g., a first output port) of the physical output ports 340 as either a video picture or as a composition of a video picture and a graphical picture. A second video display pipeline (not shown) of the video display pipeline 338 in the output system 331 is employed to output a TV signal through another (e.g., a second) output port of the physical output ports 340.
In another embodiment, a second graphics display pipeline (not shown) of the graphics display pipeline 339 is also employed (along with a second video display pipeline) during the discovery phase to output a TV signal through the second output port as either a video picture or as a composition of a video picture and a graphical picture.
The DHCT 16 can include one or more storage devices, such as storage device 373, preferably integrated into the DHCT 16 through an interface 375 (e.g., IDE (integrated drive electronics) or SCSI (small computer system interface), etc.), or externally coupled to the DHCT 16 via a communication port 374. The communication port 374 can be a wireless or wired interface, and is for receiving and/or transmitting data to other devices. For instance, the DHCT 16 may feature USB (Universal Serial Bus), Ethernet (for connection to a computer), IEEE-1394 (for connection to media content devices in an entertainment center), serial, and/or parallel ports. The storage device 373 can be optical (e.g. read/write compact disc), but is preferably a hard disk drive. The storage device 373 includes one or more media, such as a hard disk 301. A storage device controller 379 in the storage device 373 of DHCT 16, in cooperation with a device driver 311 and the operating system 353, grants access to write data to or read data from the local storage device 373. The processor 344 can transfer content (e.g., data) from memory 349 to the local storage device 373 or from the local storage device 373 to the memory 349 by communication and acknowledgement with the storage device controller 379.
In one embodiment, data stored, written, and retrieved from the storage device 373 includes one or more images to be processed during a discovery phase to determine the type of TV set or display attached to or otherwise in communication with the DHCT 16 and the characteristics of the TV set or display. Data stored in the storage device 373 can also include one or more sets of audio samples to be played back during the discovery phase. For example, the audio samples can be speech instructions or other types of audio. One or more picture sequences can also to be stored and retrieved in the storage device 373 for use during the discovery phase.
In one embodiment, data stored, written, and retrieved from storage device 373 includes one or more images to be displayed as a graphical picture during a discovery phase to determine the type of TV set or display attached to the DHCT 16 and the characteristics of the same. Data stored in the storage device 373 can also include one or more sets of audio samples to be played back during the discovery phase. One or more picture sequences can also to be stored and retrieved in the storage device 373 for use during the discovery phase. The storage device 373 can include graphical pictures and video picture sequences of different characteristics such as pictures of different picture aspect ratios, different colorimetry, different gammas, and/or different pixel aspect ratio, among other characteristics. Distorted pictures and pictures with, for example, side blank pillars, blank top and bottom rectangular regions, or a box with blanked rectangular regions may also be stored in the storage device 373 for employment during the discovery phase.
The DHCT 16 includes memory 349, which includes volatile and/or non-volatile memory, for storing various applications, modules and data for execution and use by the processor 344. Basic functionality of the DHCT 16 is provided by an operating system 353. Among other things, the operating system 353 includes a resource manager 367 that provides an interface to resources of the DHCT 16 such as, for example, computing resources, and a broadcast file system (BFS) client 343 that cooperates with the BFS server 202 (
Data to be used during the discovery phase can be transmitted to and received by the DHCT 16 as one or more files using the broadcast file system (via BFS server 202 (
One or more programmed software applications, herein referred to as applications, are executed by utilizing the computing resources in the DHCT 16. Note that an application typically includes a client part and a server counterpart that cooperate to provide the complete functionality of the application. The applications may be resident in memory 349 or the storage device 373, or stored in a combination of memory 349 and storage device 373. Applications stored in memory 349 (or storage device 373) are executed by the processor 344 (e.g., a central processing unit or digital signal processor) under the auspices of the operating system 353. Data required as input by an application is stored in memory 349 or the storage device 373 (or a combination) and read by the processor 344 as needed during the course of the application's execution.
Input data may be stored in memory 349 by a secondary application or other source, either internal or external to the DHCT 16, or possibly anticipated by the application and thus created with the application at the time it was generated as a software application. Data generated by an application is stored in memory 349 by the processor 344 during the course of the application's execution, or if required, transferred to the storage device 373 from memory 349 by the processor 344 during the course of the application's execution. The availability of data, location of data, whether in memory 349 or in the local storage device 373, and the amount of data generated by a first application for consumption by a secondary application is communicated by messages. Messages are communicated through the services of the operating system 353, such as interrupt or polling mechanisms or data sharing mechanisms such as semaphores.
An application referred to as a navigator 355 is resident in memory 349. The navigator 355 provides a navigation framework for services provided by the DHCT 16. For instance, the navigator 355 includes core functionality such as volume and configuration settings. The navigator 355 preferably handles signals invoked from the channel navigation buttons on the remote control device 380.
The memory 349 also contains a platform library 356. The platform library 356 is a collection of utilities useful to applications, such as a timer manager, a compression manager, a configuration manager, an HTML parser, a database manager, a widget toolkit, a string manager, and other utilities (not shown). These utilities are accessed by applications via application programming interfaces (APIs) as necessary so that each application does not have to contain these utilities. Two components of the platform library 356 that are shown in
The window manager 359 also maintains, among other things, a user input registry 350 in memory 349 so that when a user enters a key or a command via the remote control device 380 or another input device such as a keyboard or mouse, the user input registry 350 is accessed to determine which of various applications running on the DHCT 16 should receive data corresponding to the input key and in which order.
The SAM client 357 is a client component of a client-server pair of components, with the server component being located in the headend 11, typically in the control system 232 (
In the example DHCT 16 depicted in
An executable program or algorithm corresponding to an operating system (OS) component, or to a client platform component, or to an application, or to respective parts thereof, can reside in and execute out of memory 349 and/or the storage device 373. Likewise, data input into or output from any executable program can reside in memory 349 and/or the storage device 373.
As described above, there are many possible video formats that are received by the DHCT 16 and converted to a television signal compliant with the appropriate video interface specification for the respective port of the physical output ports 340. For example, ATSC includes 18 different video formats, which include parameters for the amount of active lines, total lines, horizontal pixels (e.g., pixels per line), aspect ratio (e.g., 16:9 or 4:3), vertical rate, frame rate, scan type (progressive or interlaced), and type of TV set (e.g., SDTV or HDTV) that a particular format is best suited for. For a TV set capable of sourcing a TV signal through more than one video interface or with a video interface that supports more than one video format, the nature of the picture displayed on a TV screen (or other display screen) can vary depending on what format the DHCT 16 configures the output signal (e.g., output from the output ports 340 to the TV set 341) to be. Accurate assumptions about the characteristics of the TV set 341 or display can be made based on the nature of the picture displayed in response to the video format of the television signal fed to the TV set 341 from the DHCT 16. Although the DHCT 16 does not know what type of TV set it is connected to, nor the characteristics of that TV set, it can output some predefined video formats and query the user about what he or she sees. Based on the response of the user, not only can the DHCT 16 determine the characteristics of the TV set connected (e.g., aspect ratio, color temperature, gamma characteristics, etc.), but also provide for a fine tuning of the picture quality that improves what the user sees. Note that in some embodiments some of these characteristics may be input by the user in response to a query by the DHCT 16 (e.g., the DHCT 16 can prompt questions on the TV display, such as “what type of TV do you have? year made? model number? manufacturer?,” etc.).
Even if characteristics are input by a user, a discovery phase may still be employed where, for example, a TV set 341 has multiple interfaces to receive the output TV signal from the DHCT 16 and the user may have pre-configured the TV set 341 to a user-specific set of preferences. For instance, a user may opt to pre-configure a TV set 341 with a physical screen (e.g., the glass portion of the screen, screen portion of a projection TV, etc.) having a 4:3 aspect ratio using the TV set's settings to display a 16:9 TV signal received from the DHCT 16 in one of multiple configurable displayable ways. That is, the user can set a 16:9 TV signal to be displayed as, for example, a letterboxed picture (e.g., blank top and bottom portions envelope picture), as a distorted picture, or as a full-screen picture without distortion but with the left- and right-most portions cropped.
An interactive session(s) (or application(s)) that serves as a discovery phase according to an embodiment of the disclosure is executed upon power-up, or at other times such as when the user hooks up a different TV set to the DHCT 16, to determine the capabilities of the TV set 341 coupled to the DHCT 16. The discovery phase can be viewed as comprising two phases. Phase I includes determining how the TV set 341 can be driven. The TV set 341 can be a high definition television (HDTV) set, a national television systems committee (NTSC) set, or a PAL set. It is in phase I that the sourced TV signal received at the tuner system 345 of the DHCT 16 is mapped to a corresponding output of the DHCT 16 (and thus corresponding input of a TV set 341). For example, through one or more interactive sessions with the user, the DHCT 16 (or user) may decide that when the DHCT 16 is tuned to SD (standard definition) or NTSC channels, the signal is to be processed and fed through the baseband port or S-video port of the physical output ports 340. Similarly, if the DHCT 16 is tuned to an HD channel, the DHCT 16 (or user) may determine that the signal is to be processed and fed through the YPbPr port or the DVI port of the physical output ports 340. Phase II includes determining additional characteristics of the TV set 341, which serves as a calibration process. For example, it is in phase II that the color temperature, gamma characteristics, and/or de-interlacing characteristics or capabilities, among others, can be verified or determined.
Step 404 includes converting a video or picture sequence according to a defined video interface specification. Representative pictures or video sequences that include the different video formats in ATSC A/54 or SCTE 43, for example, which vary in parameters such as aspect ratio (e.g., 4:3 versus 16:9), TV type (e.g., SDTV versus HDTV), among others, are used during the discovery phase. The video formats are processed for output by appropriately exercising conversion capabilities in the TV output system 331 according to defined categories of parameters for a video output interface and to provide some efficiency in the driving of outputs. The pictures or video sequences (and/or audio) can be provided by the DHCT 16 as a result of real-time or time-shifted (e.g., buffered to the storage device 373) conversion of a TV signal received from the network 18 (
Step 406 includes driving one or more display devices through the physical output port with a video format corresponding to the video interface specification to which the conversion in step 404 was implemented. The DHCT cycles through each video format in response to the user selecting the cycle button 383, or in alternative embodiments, automatically for a defined interval of time, requesting input from the user for each format. The display manager 335, in cooperation with the media engine 330, the operating system 353, memory (e.g., memory 349 and/or media memory 329), and the processor 344, preferably is responsible for cycling the various video formats through the output connections 340 to the inputs of the TV set 341. The cycle is preferably set from the highest resolution to the lowest resolution. For example, the DHCT may output 1080i first, and then output 720p, then 480p, and then 480i. Once a user enters input, it is assumed that the TV set 341 is to be driven at the highest resolution format to minimize degradation of the highest resolution TV set that is sourced. Driving the TV set with a common video format simplifies graphics overlay management by the display manager 335 and operating system 353 as it shortens development cycle and reduces provisions required to support legacy applications. In some embodiments, the DHCT 16 can transmit audio instructions in addition to or in lieu of the video and/or graphics data.
Step 408 includes soliciting a user response based on what is displayed on the TV screen. In one embodiment, the display manager 335, in cooperation with the processor 344, can cause the generation and presentation of various GUI screens to solicit help from a user to determine the type of inputs that are supported by the TV set 341. One purpose for driving the inputs of the TV set 341 is to present a picture on the screen of the TV set 341 along with a GUI screen that enables the user to comment on whether he or she sees any picture on the display. Note that in other embodiments, audio instructions (e.g., such as speech instructions) can be used, alone or in combination with graphics and/or video, to solicit user feedback and/or provide instruction which would facilitate the determination of how the TV set 341 can be driven.
Step 410 includes determining whether user input was received within a defined period of time defined by a fixed or programmable threshold. The failure to receive an inputted response from the user may indicate that the user did not see a screen (e.g., there may not be a connection made by the user or the particular video format cycled through the output port is not supported). If a video format applied to the TV set input was not compatible with the TV set (e.g., a video format that is not compatible with the scan format or other characteristics of the TV set 341), or no connection has been made between the DHCT port and the corresponding TV set port, an out-of-synch picture is likely to be displayed. If the DHCT 16 determines that no user input is received within a predetermined or defined period of time of driving the TV set with a signal having a prescribed video format, the DHCT 16 automatically selects a new port, or another video format for the same output port (e.g., if more than one video format is supported by the selected output port) (step 422), and repeats the process starting at step 404. In some embodiments, selection of the next port is not automatically initiated until a user enters input, regardless of whether instructions or other messaging on the screen is viewable or not, thus omitting the determination step (step 410). For example, instructions in a written user's guide (or by phone) can require a user to enter one type of input (e.g., the cycle button 383,
The programmable threshold that defines the period of time for cycling through the video formats and/or output ports may be programmed and stored in NVM 348 of the DHCT 16. Alternatively, the threshold value can be stored in the storage device 373 of the DHCT 16 or in NVM (not shown) in the remote control device 380. Programming of the threshold value can be performed at a manufacturing facility, by a cable operator from the headend 11 while the DHCT 16 is at a subscriber's or user's premise, or by the subscriber or user.
If a GUI is viewable, suggesting that the cycled video format is both established through a valid connection to the TV set 341 and that the TV set 341 can be driven using that applied video format, step 412 includes mapping the video interface specification and corresponding port with a parameter or parameters of the TV signal, video sequence or picture. In other words, the DHCT 16 stores in memory (e.g., media memory 329, memory 349, and/or the storage device 373,
For formats where a display is generated and viewable by the user, additional formats can be presented through this interactive session to fine-tune what the user is viewing. Step 414 includes applying test sequences for phase II discovery. For example, one category of driving the TV set inputs can be according to the scan format (e.g., interlaced versus progressive). Within an interlaced category, there are multiple video formats (e.g., with differences in resolution (e.g., 1080i, 480i, etc.), aspect ratio, among other parameters). If the TV set 341 has the capability to only receive an input with a progressive scan format, then driving it with an interlaced scan format may result in no displayable screen (e.g., a scrambled picture), thus negating the need to drive the TV set inputs with other video formats under the category of interlaced. The test sequences are received from memory in a manner as described above for step 402, and processed (e.g., altered) in the blitter 337 in cooperation with the display manager 335 and the processor 344 (
Step 416 includes soliciting a user response based on what is displayed on the TV screen. Based on the video format selected and the alteration imposed in step 414, there is an expected effect on the picture presented on the TV screen, and this expected effect is used to generate the appropriate question to the user on the display screen to help determine the characteristic of the TV set 341 (
Step 418 includes determining characteristics of the display device based on the solicited user response. Running through interactive screens shown in
Step 420 includes storing the TV set display characteristics. One or more non-volatile memory (NVM) bits (not shown) in memory 349 (or the characteristics can be stored in the storage device 373,
Step 422 includes selecting another port or another format for the same port, and then the discovery process is repeated again beginning at step 404.
Therefore, during an interactive session that requests input from the user, the DHCT 16 cycles through each video format requesting input from the viewer rather than merely terminating when a first video format category suitable for driving the TV set 341 is determined. Hence, the input from the user preferably does not cease after the user acknowledges being able to view a first viewable display screen, but rather after completion of cycling through all or substantially all video formats.
Note that in some embodiments, phase I can be implemented for all ports and completed before commencing phase II.
Also, in some embodiments, the user may decide on which output port of the physical output ports 340 (
The picture format associated with each channel may be known a priori. For example, the picture format may be obtained or inferred by the processor 344 (
The discovery phase retains (e.g., by saving in memory 349,
In one embodiment, wherein the output mode is fixed to a first picture format, once the user selects an alternate output format from the list of retained output modes, the DHCT 16 (
As is shown in
Other questions can be presented to determine other characteristics. For example, input can be requested from the user on whether visible flicker or certain artifacts are visible to determine if the TV set has an internal line-doubler (i.e., de-interlacer) or to assess the quality of the line doubler versus that of the line doubler of the DHCT 16. Additional questions can be presented to the user to provide user preferences on border color or shade (e.g., the letterbox may be available with different shades of gray to cause the picture brightness to vary and thus enhance the viewer experience).
Additional embodiments can be used for this interactive session between the user and the DHCT 16. In one embodiment, synthesized audio can be played while cycling through the video formats, instructing the user to enter input without any dependence on a displayed GUI. In another embodiment, synthesized audio can be played with a displayed GUI in each cycled video format, and in some embodiments, synthesized audio is repeated if the user's input is not received after an elapsed time greater than a predetermined threshold.
Some embodiments may employ buttons on the DHCT 16 (e.g., light-emitting diodes, or LEDs, such as digital display 502 (
The display manager 335 can be implemented in hardware, software, firmware, or a combination thereof. In the preferred embodiment(s), the display manager 335 is implemented in software or firmware that is stored in a memory and that is executed by a suitable instruction execution system. If implemented in hardware, as in an alternative embodiment, the display manager 335 may be implemented with any or a combination of the following technologies, which are all well known in the art: a discrete logic circuit(s) having logic gates for implementing logic functions upon data signals, an application specific integrated circuit (ASIC) having appropriate combinational logic gates, a programmable gate array(s) (PGA), a field programmable gate array (FPGA), etc.
The display manager 335, which comprises an ordered listing of executable instructions for implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this document, a “computer-readable medium” can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer readable medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. More specific examples (a nonexhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic) having one or more wires, a portable computer diskette (magnetic), a random access memory (RAM) (electronic), a read-only memory (ROM) (electronic), an erasable programmable read-only memory (EPROM or Flash memory) (electronic), an optical fiber (optical), and a portable compact disc read-only memory (CDROM) (optical). Note that the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be emphasized that the above-described embodiments of the present disclosure, particularly, any “preferred embodiments” are merely possible examples of implementations, merely setting forth a clear understanding of the principles of the disclosures. Many variations and modifications may be made to the above-described embodiments of the disclosure without departing substantially from the spirit of the principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of the disclosure and present disclosure and protected by the following claims.