CA2341040A1 - Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals - Google Patents

Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals Download PDF

Info

Publication number
CA2341040A1
CA2341040A1 CA002341040A CA2341040A CA2341040A1 CA 2341040 A1 CA2341040 A1 CA 2341040A1 CA 002341040 A CA002341040 A CA 002341040A CA 2341040 A CA2341040 A CA 2341040A CA 2341040 A1 CA2341040 A1 CA 2341040A1
Authority
CA
Canada
Prior art keywords
bits
super
picture
pictures
gop
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002341040A
Other languages
French (fr)
Inventor
Limin Wang
Ajay Luthra
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Arris Technology Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2341040A1 publication Critical patent/CA2341040A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2365Multiplexing of several video streams
    • H04N21/23655Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115Selection of the code volume for a coding unit prior to coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • H04N19/126Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/152Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162User input
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

The present invention relates to a method and apparatus for allocating bits in a statistical multiplexing system (stat mux). A statistical multiplexer (stat mux) (600) accommodates both compressed and uncompressed video programs using transcoding (640, 650) and encoding (620, 630), respectively. Hierarchical dynamic bit allocation is used, starting from a super GOP level (700, 702, 704, 800, 900), then to a super frame level (902; 904; 908; 909), and then to the regular (individual) frame level (910, 920, 930, 990; 912, 922, 932, 992;
916, 926, 936, 996; 918, 928, 938, 998). At each level, a target number of bits (T1, T2, TL-1, TL) is determined. A target number of bits for a super frame, which is a collection of frames across all channels at a given frame instance (t1, 2t1, 3t1...), is adaptive and is able to address any combination of picture types. Frames of the same picture type for a program are generally assigned the same (or similar) number of bits. Relative program quality can be controlled using a program priority weighting factor (w). Additionally, constraints on target bit rates and minimum and maximum bit rates are provided.

Description

DYNAMIC HIT ALhOGATION FOR STATISTICAL MULTIPLEXING
OF COMPRESSED AND UNCOMPRESSED DIGITAL VIDEO SIGNALS
BACKGROUND OF T'HE INVENTION
The present invention relates to a method and apparatus for allocating bits in a statistical multiplexing system. In particular, an architecture is disclosed far Statistical Multiplexing (stat mux) of both compre~csed and uncompressed video signals.
Dynamic bit a:ll.ocation and rate control are provided. Additionally, upper and lower program bit rates boundariEa are specified to prevent the encoder and decoder buffers from overflowing or underflowing.
With recent advances in digital video compression, such as used in the MPEG-2 standard, and digital. dai~a transmission techniques, it is possible to de:Liver several digitally compressed video programs in the same bandwidth presently occupied by a ;single analog television (TV) channel.
These capabilities provide opportunities for programming service providers (e. g., broadcasters such as CNN, A:BC), network operators (e. g., cable and satellite :network owners), and end users.
In a mufti-program transmission environment, several programs (e. g., channels) are coded, multiplexed and transmitted over a single communication channel. Since these programs share a limited channel capacity, the aggregate bit rate of the programs must be no greater than the communication channel rate. This can be achieved by controlling either each individual program bit rate using independent coding, or the aggregate bit rate using statistical multiplexing, also known as joint coding. A stati:5tical multiplexer is referred to herein as a "stat mux", while statistical multiplexing is referred to as "stat muxing". With independent coding, rate control can only be performed across the time and spatial dimensions of a program. However, in stat muxing or joint coding, control is extended to an additional dimension; that is, the program dimension. As a result, there is greater freedom i.n allocating the channel capacity among programs and therefore more control of picture quality among programs as well as within a program.
However, such systems generally process one picture at a time from each channel (e.g., at a common frame instance), and do not account for the Group of Picture (GOP) configurations of the data streams or the picture type.
A GOP is a group of one or more consecutive pictures. A GOP may contain intra-coded pictures (I-pictures), predictive coded picture (P-pictures) and/or bi-directional predictive coded pictures (B-pictures), for example. Different channels may have different GOP lengths and configurations. A GOP can also consists of ~grogressively refreshed pictures where there are no I-pictures. However., in a P-picture, a portion, e.g. slice, of the picture i.s coded as I-blocks. The location of I-blocks changes from one P-pictura to another.
Moreover, video materials such as films and the like may be pre-compressed and stored for subsequent transmission. These pre-compressed video may be coded at either a constant bit rate (CBR) or a variable bit rate (VBR). This presents difficulties when the scat mux attempts to integrate the pre-compressed program bit streams with the raw, uncompressed digital video sequences.
Accordingly, it would be desirable to have a stat mux system that is able to handle pre-compressed data that is at either a constant bit rate (CBR) or variable bit rate (VBR), along with uncompressed video data.
The stat mux system should use the GOP
structure of the video channels to provide an efficient bit allocation technique.
The stat mux system should further account for the picture type in each GOP in allocating bits.
The scat mux system should assign the same, or similar, number of bits to frames of the same picture type for continuous scenes.
The scat mux system should further account for a relative priority of the channels, as well as the complexity level of each frame.
The stat mux system should be compatible with existing digital video standards such as MPEG-2.
The stat mux system should prevent encoder or decoder buffer overflow or underflow.
The stat mux system should provide constraints on target bit rates, including constraints on overall minimum and maximum bit rates.

WO 00/13419 PCT/US99/16~95 Furthermore, for super GOP and super frame bit allocation schemes, the stat mux system should provide target bit rates, and constraints on the target bit rates, for super GOPS, super frames, and regular frames, as well as constraints on overall minimum and maximum bit rates.
The present invention provides a system having the above and other advantages.

S'UNa2ARY OF THE INVENTION
The present invention relates to a method and apparatus for allocating bits in a stat mux system.
The invention provides a stat mux that 5 accommodates both pre-compressed and uncompressed video programs using transcoding and encoding, respectively.
Additionally, hierarchical dynamic bit allocation is used, starting from a super GOP level, then to a super frame level, and then to the regular (individual) frame level. The concept can be further extended to a sub--frame level, where bits are allocated for a portion of a frame such as a slice, or for a video object plane (VOP) as described in the MPEG-4 standard, for example. At each hierarchical layer, a target number of bits is determined.
A target number of bits (T") for a super frame n, which is a collection of frames across all channels at a given frame instance n, is adaptive and accounts for any combination of picture types.
Moreover, although it is not necessary, it is desirable that frames of the same picture type for a program (for continuous scenes) are assigned the same (or similar) number of bits. To achieve this adaptation in bit allocation, the invention provides a dynamic bit allocation strategy that determines a target number of bits for each program on a frame-by-frame basis according to the previous coding information, such as quantization parameters used, and the resulting number of bits.

WO 00/13419 PCT/US99/16~95 Furthermore, to prevent both encoder and decoder buffers from overflowing or underflowing, constraints arE~ imposed on the compressed bit rate of each program i.n the multi-program transmission environment.
Additionally, program quality can be controlled during stat muxi.ng according to a program priority weighting factor.
Furthermore, target bit rates, and constraints on the target bi.t rates, are provided for super GOPS, super frames, and regular frames. Constraints on overall minimum and maximum bit. rates are also provided.
A particular bit allocation method for digital video in accordance with the present invention processes a plurality L of video programs (e. g., channels} at am encoder, where each program has successive grouf>:~ of pictures (GOPs). Each group of pictures has an associated number of pictures, typically 10-20. The term "picture" refers to a frame or a field. A "super group of pictures" is provided compri.=ping at least one group of pictures from each of thE: L video programs, and having a length of N pictures.
A first tax-get number of bits, T, is calculated for encoding the super group of pictures according to the number of. pictures in the super group of pictures, LxN, and an available capacity of a channel over which the video programs are transmitted, such as a cable television network or satellite broadcast network. Furthermore, each super group of pictures comprises a plurality N of WO 00/13419 PCT/US99/16~95 "super frames", each super frame having L pictures at a common temporal reference point.
A secand target number of bits, T", is calculated for encoding each nth super frame of pictures, where n=1,...,N, according to the first target number of hits, T, and a complexity measure of each 1th picture in the associated n'h super frame, where 1=1,...,L.
A third target number of bits, Tl,n, is calculated for encoding each 1th picture in the associated nth super frame according to the second target number of: bits and the associated complexity measure, and in inverse proportion to a sum of the complexity measures for each picture in the associated nih super frame.
The length N of the super GOP is preferably a least common multiple of the associated number of pictures in each of the groups of pictures. For example, the least common multiple for GOPs with respective lengths of nine and fifteen frames is forty-five.
When different picture types are provided in at least one of the group of pictures, the method comprises the further steps of: providing respective different weighting factors K for the different picture types; and calculating the third target number of bits for encoding each lth picture in the associated nth super frame according to the resper_tive weighting factor thereof.
For example, the different picture types may include I-pictures, P-pictures and/or B-pictures.

WO 00/13419 PCT/US99/16~95 In some ca;~e, a temporal boundary of a group of pictures of at.7_east one of the programs is mis-aligned with a temporal boundary of the super group of pictures such that the super group of pictures comprises a fractional portion of the mis-aligned group of pictures. But, the super GOP lengths are always multiples of program GOP lengths. The invention can bEa used even when the program GOPs are unsynchronized with one another and/or a super GOP.
The method may include the further steps of providing respective weighting factors, w, for the different video programs according to a relative priority thereof=, and calculating the third target number of bits i:or encoding each Ith picture in the associated nth super frame according to the respective weighting factor of the associated Itn video program.
Preferably,, the same complexity measure is used for each picturf~ with a common picture type (e. g., I, P or B) in at. least one of the video programs of the super group of pictures for calculating the second and third target numbers of bits.
Tn particu:lar, the method may include the further steps o:E: defining respective complexity measures for each picture type in each Ith program, and using the rc=_spective complexity measures for calculating the second and third target numbers of bits. Moreover, the respective complexity measures may be updated after encoding each picture.
The method may include the further steps of:
calculating a remaining number of bits available, Tr, for encodinct a remainder of the super frames not yet encoded in t:he super group of pictures after encoding the 1 pictures in one of the super frames, and encoding each remaining super frame not yet encoded in propc>rtion to the remaining number of bits available, Tr.
A buffer asesociated with the encoder receives encoded data from the video programs. Accordingly, maintaining the encoder's buffer level between a minimum and maximum level is important. Thus, the method may include the further steps of adjusting the associated second target number of bits, if necessary, to avaid falling below a minimum level, Rchannel(bpP>-Ben-1, prior to encoding the nth super frame with the associated second target number of bits.
R~nannelcbPf~ is an average number of bits per picture transmitted over the channel; and Ben-i is a fullness level of the buffer after the previous (e.g., (n-1)ch) super frame has been encoded.
For the max:i.mum encoder buffer level, the method may inc:Lude the further step of adjusting the associated second target number of bits, if necessary, t0 aV'Gl.d exceeding R~hannelebpE~+BemaX-Ben-1~
prior to encodir.~g the n'y' super frame with the associated second target number of bits. Here, Bemax is a maximum capacity of the buffer.
Furthermore, the video programs are transmitted over the channel, to a decoder, so it is important to maintain the dec:oder's buffer level within acceptable limits. Prior to encoding the 1th picture in the nth super frame with the associated third target number of bits, the method may include the further step of adjusting the associated third target number of bits, if necessary, to avoid n+N' exceeding a maximum level, ~R~,n, -B~.n_I ; wherein:
n'=n n+N' R; n, is a sum of the number of bits n'=n transmitted for t:he nth through (n+N' ) th pictures for 5 the lth video program;
N' is a decoding delay of the decoder; and Bel,n-n is a fullness level of the buffer after the 1th picture :in the (n-1)ih super frame has been encoded.
10 Prior to encoding the lth picture in the nth super frame with the associated third target number of bits, the method may include the further steps of adjusting the as:~ociated third target number of bits, if necessary, to avoid falling below a minimum level, n+N' Rc ~ Be __ Bd I,n' I,n-1 max n'=n wherein:
n+N' R;.n, is al sum of the number of bits n'=n transmitted for the nth through (n+N')th pictures for the lth video program;

WO 00/13419 PCT/US99/165_95 N' is a decoding delay of the decoder;
Be.>,n-1 is a fullness level of the encoder's buffer after the lt'' picture in the n-1St super frame has been encoded; and BdmaX is a maximum capacity of the decoder's buffer.
Additionally, in many cases it is desirable to maintain the b:i.t rate for each program within predetermined :Lirrlits .
For a minimum rate, the method comprises the further steps of:
determining a minimum average number of bits Rmin for encoding N">1 pictures; and prior to k.=.n.coding the lth picture in the ntn super frame with. the associated third target number of bits, adjusting the associated third target number of bits, i.f necessary, to avoid falling below n-I
n _ N Rn,in n'=n_.N~~
wherein:
n-I
~RI,", is a sum of the number of bits n'=n-N"
transmitted for the (n-N" ) th through (n-1 ) t'' pictures for the 1th video program.
For a maximum rate, the method comprises the further steps of:
determining a maximum average number of bits Rmax for encoding N">1 pictures; and prior to encoding the lth picture in the ntn super frame with the associated third target number of bits, adjusting the associated third target number of bits, if necessary, to avoid exceeding n-- I
~i _ N R",ax ~ Rl,n' n'=n-N"
wherein:
n-1 Rl,n, is a sum of the number of bits n'=n-N"
transmitted for the (n-N")th through (n-1)th pictures for the lth video program.
In a particular application of the invention, the video programs are adapted for communication over a broadband communication network to a decoder population.
The method may include the further step of transcoding pre-compressed video bit stream of a particular one of the plurality L of video programs into another bit stream, wherein the pre-compressed video bit. stream is provided at a different bit rate after transcoding. This transcoding process allows the use of both uncompressed and pre-compressed video source data at a stat mux.
Another method of the present invention is presented for encoding uncompressed video source data, and trans~..~.oding pre-compressed video source data. The method includes the steps of: partially decompressing t:he pre-compressed video source data to obtain corresponding partially uncompressed video data; allocating bits for encoding the uncompressed video source data according to a statistical multiplexing scheme; and allocating bits for transcoding the partially uncompressed video data according to the statistical multiplexing scheme.
The pre-compressed picture data is transcoded such that a bit rate of the pre-compressed picture data is different than a bit rate provided by the associated allocated bits.
Corresponding apparatus structures are also presented.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates an encoding and decoding system in accordance with the present invention.
FIG. 2 illustrates an MPEG encoder for use with uncompressed video data in accordance with the present invention.
FIG. 3 illustrates a transcoder in accordance with the present. invention.
FIG. 4 illustrates a cascaded MPEG
decoder/encoder for use with pre-compressed video data in accordance with the present invention.
FIG. 5 illustrates a simplified transcoder in accordance with the present invention.
FIG. 6 il:lu:~trates a statistical multiplexing encoder in accordance with the present invention.
FIG. 7 illustrates a super GOP construct with aligned program C~OPs in accordance with the present invention.
FIG. 8 illustrates a super GOP construct with non-aligned procrram GOPs in accordance with the present invention.
FIG. 9 illustrates a super frame construct in accordance witl t:he present invention.
FIG. 10 illustrates a decoder in accordance with the present. invention.
FIG. 11 i:Llustrates data stored in an encoder buffer in accordance with the present invention.

DETAILED DESCRIPTION OF THE INVENTION
The present= invention relates to a method and apparatus for allocating bits in a statistical multiplexing system.
5 FIG. 1 illustrates an encoding and decoding system in accordance with the present invention.
One problern with pre-compressed materials is that they could be pre-encoded at any bit rate, either a constant bit rate (CBR) or variable bit 10 rate (VBR). Therefore, to accommodate the pre-compressed programs bit streams in a stat mux system, the corresponding rates have to be changeable. Transcoding is an operation of converting a bit. stream into another bit stream at a 15 different rate.
In FIG. 1, encoders 105 and 110 are provided, along with tran~~c:oders 115 and 120. At a transmitting site 100, such as a headend, encoders 105 and 110 recE:ive uncompressed digital video data, e.g., in the pi};el domain, from respective video programs or channels, program 1 and program 2. The transcoders 115 and 120 receive pre-compressed digital video data from respective compressed programs (e.g., bitstreams) L-1 and L. L is the total number of channels or programs at the encoder.
The encoded data is provided to a MUX 125 for transmission ovE:r a channel, such as a cable television network or satellite broadcast network, using conventional time-multiplexing and/or frequency-multiplexing techniques, for example.

WO 00/13419 PCT/US99/1-6~95 At a decoding site 150, the multiplexed channels are demultiplexed at a DEMUX 155 and may be provided to decoders 160, 165, 170, 175. Typically, only one channel is actually decoded since a viewer usually views only one channel at a time. However, split-screen anti picture-in-picture techniques allow a viewer to view two or more pictures at the same time, in which ease each channel must be decoded.
Moreover, the decoders shown may be independent or implemented using common hardware.
For illustration, decoders 160 and 165 provide the decoded data for programs 1 and 2, respectively, while decoders 1.70 and 175 provide the decoded data for programs L-1. and L, respectively.
The encoders 105 and 110 may be provided as described in F:ICJ. 2, while the transcoders 115 and 120 may be provided as described in FIGS 3-5.
FIG. 2 illustrates an MPEG encoder for use with uncompressed video data in accordance with the present inventic>n. In the encoder 200, a frame decomposition processor 205 decomposes an input video frame int~c> segments such as slices and macroblocks. The pixel data is then provided to a intra/inter mode switch 210, an adder 215, and a Motion Estimation (ME) function 220. The switch 210 selects either t:he current pixel data, or the difference between the current pixel data and pixel data from a previous frame, for processing by a Discrete Cosine Transform (DCT) function 222, quantizer 225, and Variable Length Coding (VLC) function 230. Z~he output of the VLC function 230 is a bitstream that: is transmitted to a decoder. The bitstream includes Motion Vector (MV) data from the ME function 220.
In a feedback path, inverse quantization at a function 235 and an inverse DCT at a function 240 are performed to recover the pixel domain data.
This data is summed with motion compensated data or a null signal at: an adder 245, and the sum thereof is provided to a current Frame Buffer (FB). Data from the current. FB 250 and a previous FB 255 are provided to the ME function and a Motion Compensation (MC') function 260. A switch 265 directs either a. null signal or the output of the MC
function 260 to the adder 245 in response to the intra/inter mode: switch control signal.
FIG. 3 illustrates a transcoder in accordance with the present invention. Uncompressed video is compressed at an encoder 305 at a quantization level (e. g., step size) Q1 to produce data at a bit rate R1. This data, which may be stored on a storage medium for subsequent retrieval, is provided to a transcoder 310, which comprises a cascaded decoder 315 and encoder 317. The data is decoded at the decoder 315 to recover the input video, or a close approximation thereof, due to the lossy nature of the encoding at. encoder 305. The decoded o.r reconstructed data is then encoded at the encoder 317 at a different quantization level QZ to produce data at a bit rate Rz.
Commonly, Rz<R1. For example R1=50 Mbps and Rz=3 Mbps .
The encoded data at rate R2 is then communicated over a channel to a decoder 320 to provide the decoded output video, e.g., for display on a television.
FIG. 4 illustrates a cascaded MPEG
decoder/encode:r for use with pre-compressed video data in accordanr_e with the present invention.
The cascaded MPEG decoder/encoder includes a decoder 400 and an encoder 450. Like-numbered elements of the encoder 450 correspond to the encoder of FIG . <? .
A compressed video bitstream is input to a Variable Length Decoder (VLD) 410, which is a counterpart of t:he VLC 330. An inverse quantizer function 420 processes the output of the VLD 410 using a first quantization step size, Q1. An Inverse DCT (IDC'T) function 430 processes the output of the inverse c;uantizer 420 to provide pixel domain data to an adder 440. This data is summed with either a motion compensation difference signal from MC 455 or a null. signal, according to the position of a switch 460. The output of the adder 440 is provided to the encoder 450 and to a current FB 480 of the decoder 900. The MC function 455 uses data from the current: FB 480 and a previous FB 470 along with MV data from the VLD 410.
The bit output rate of the transcoder 450 is adjusted by changing Qz.
FIG. 5 illustrates a simplified transcoder in accordance with the present invention. Like-numbered elementa of the transcoder 500 correspond to those in the transcoder of FIG. 4. The performance of t:he simplified transcoder is very close to that of: the cascaded transcoder of FIG. 4.
The transcoder saves hardware and processing steps by using only one current FB (Frame Buffer) 480 and previous FB 470, and one DCT function 510 and IDCT
function 520 An adder 530 provides a transform domain difference signal. to the IDCT 520. A switch 540 selects either the transform domain signal from the DCT function 51_0 or a null signal according to an intra/inter mode control signal.
FIG. 6 illustrates a statistical multiplexing system in accordance with the present invention.
The inputs to the encoder 600 can include uncompressed digital video sequences and/or pre-compressed bit streams. The uncompressed digital video sequences, e.g., programs 1 and 2, are encoded by MPEG encoders 620 and 630, respectively, for example. The pre-compressed programs (e. g., bitstreams) L-I. and L are processed by transcoders 640 and 650, respectively. The simplified transcoder configuration of FIG. 5 may be used. The encoded data is provided to a MUX 660 and encoder buffer 670 prior to being transmitted on a channel.
The pre-compressed program data may be retrieved from a storage medium 645, such as magnetic tape or compact disc, or may be received real-time, e.g., from a satellite transmission.
The encoder buffer 670 sends a fullness level signal to the rate control processor 610.
A user interface 608 may communicate with the rate control processor 610, for example to provide information regarding the GOP length and picture types in the different program streams.

The basic :requirement in the stat mux encoder is to provide a :relatively uniform picture quality within a program, and if necessary, also among programs. To achieve this goal, channel capacity is 5 dynamically distributed among programs according to a program priority as well as a frame level program complexity measure.
Each MPEG E=ncoder 620, 630 or transcoder, 640, 650 receives a target number of bits, T1, T2, TL_1 10 and TL, respectively, from a rate control processor 610 at each frame. The rate control processor 610 includes a super GOP level processing function 606, a super frame level processing function 604, a frame level processing function 602, and a complexity 15 processor 605. These processing functions may share common hardware such as memory and processing chips, but are shown individually for simplicity.
The target number of bits for each frame of a program is met by adjusting the quantization 20 parameter in the MPEG encoder or transcoder. The resulting number of compressed bits, R, as well as the average quantization parameter, Q, used for each frame are then rent to th.e rate control processor 610. Specifically, the encoder 620, encoder 630, transcoder 640 and transcoder 650 produce R1, R"
RL_1 and RL bits, respectively, using quantization parameters Q1, ~i2, QL-1 and QL, respectively. The complexity processor 605 calculates corresponding complexity values C using R and Q for each program.
The rate control processor 610 then determines a new target number of bits for each new program frame or picture based on the program complexity at the frame level.
Below, the dynamic bit allocation procedure is detailed. Additional constraints on the target number of bits determined by the rate control processor 610 a:re also discussed to prevent buffer overflow and underflow at the encoder and decoder buffers.
FIG. 7 illustrates a super GOP construct in accordance with the present invention. To summarize the problem, I. video programs (e.g., channels or programming ser~;rices) need to be delivered over a network with a :Fixed channel rate, R~hannel. The L
programs can be either pre-compressed program bit streams, or uncompressed digital video programs.
Furthermore, thc~ L programs can use any GOP
structure, or program GOP length. Additionally, the distance between I or P pictures can be different for the different programs. The GOP length for each ~ program is assumed to be available at the encoding site.
Super GOP and Target Bit Rate The dynamic, bit al.loeation system is hierarchical. At the top level, a "super GOP" is provided. The input programs are divided into super GOPs that have t:he same number of I, P and B
pictures, and therefore each super GOP is assigned the same number of bits. A "super frame" is then provided at each frame instance as a collection of frames, namely one frame from each of the programs at the same timE=_ instant. Bit allocation for the super frames is based on a program complexity measure.
At a frame :level, each regular frame (picture) receives a target number of bits proportional to its complexity measure. To ensure the encoder and decoder buffers never overflow or underflow, and to limit each individual bit rate within a specific range, constraints are applied to the target number of bits for the super frame as well as for each picture.
The L programs shown in FIG 7, e.g., programs l, 2,..., L, are conceptually divided into identical groups, designated super GOP(L,N), in terms of the number of framer of each picture type so that the same number of bits can be assigned to each super GOP. The GOPs of a program do not have to be aligned with thE~ super GOPs, as discussed in connection with FIG. 8, below. That is, a super GOP
boundary may cut: through a program GOP.
But, in either case, each super GOP contains the same number of frames of each picture type from a program. For example, each super GOP may include two I-pictures, eight P-pictures and twenty B-pictures from a specific program. Determination of a super GOP can be made using a priori knowledge of the GOP length i=or each program. An operator may input the relevant data to the encoder using an interface such as a keyboard. Or, it is possible to pre-process the different program streams at an encoder using appropriate buffering capability to determine the GOP length.
For example, in FIG. 7, a first super GOP 700 includes data frames from program 1 (710), program 2 (720), ,..., and program L (790). Each program segment, e.g., '710, 720, and 790 contains a number of complete frames from one or more GOPs as discussed below. A second super GOP 702 includes data frames from program 1 (712), program 2 (722), ..., and program I~ (792). A third super GOP 704 includes data frames from program 1 (714), program 2 (724), ,..., and program L (794). In FIG. 7, the boundaries of th<~ program GOPs do not have to coincide with the boundaries of the super GOPs. FIG.
8 illustrates a super GOP construct with non-aligned program GOPs in accordance with the present invention. Here, the GOPs in each program 1, 2, 3, 4,...,L are not a7::1 aligned with the left and right boundaries of the super GOP 800. For example, the GOPs for progrann 1 (GOP1) are aligned with the boundaries of the super GOP 800. However, the GOPs 2 0 f or programs 2 , 3 , 4 , ... , L , a . g . , GOPZ , GOP3 , GOP9 , ... , and GOPL, respectively, are not aligned with the boundaries of the super GOP 800. Each super GOP
includes at lea:~t one GOP from each program, and may also include fractional portions of the GOPs of each program. Note, However, that the fractional portions of the first and last GOPs for a programs included in a super GOP c:an actually be considered as a complete GOP, a:~ shown in Fig. 8. In other words, a super GOP alway,~ contains an integer number of GOPs of each program. The super GOP length is multiples of program GOP 7.engths. Furthermore, it is assumed that the distribution of picture types in GOPs for a programs is the same.
Here, L i.s the number of programs and N is the length of. each super GOP. Each super GOP{L, N) contains LxN frames. Moreover, there can be many different N that can make super GOPs(L,N) identical in terms of the number of pictures of each type.
However, from an implementation point of view, a small super GOP is preferable. Let N,, 1 = 1,2,...,L, be the GOP length for program 1. N is set equal to the least common multiple (L. C.M. ) of N,, I = 1,2,...,L, i, e. , (1) N=L. C'.M.(N,,NZ,...,N,,).
N, defined in equation (1), is the smallest number which can be divided by all N" I =1,2,...,L. Hence, the super GOPs(L,N) are the smallest identical groups containing the same number of frames of each picture type from each program. For example, considering only two different GOP lengths for N programs, say nine and fifteen, then the super GOP length N=45 (since 9x15=235, the smallest integer that divides 135 is 3, and 135/3=45).
Note that if all the programs 1, 2, 3, ..., L
have the same GGP length, N, the super GOP length will be also equal to N, regardless of whether the program GOPs have the same patterns of I, P and B, or whether they are synchronized.
Since the super GOPs(L,N) with N defined by using equation (1) contain the same number of I, P
and B pictures, the same number of bits, T, is assigned to each super GOP, i.e., ( 2 ) T = ( LxN ) R~"~n~er frame_ rate where R~,,a"~~r is i.n bits/sec. , and frame rate is in frames/sec.
5 Analogous t=o the super frame concept of FIG. 9, below, the frames in each program GOP that is intersected by t:he super GOP boundary is selected as a super GOP boundary frame.
Super Frames and Target Rate 10 FIG. 9 illustrates a super frame construct in accordance with the present invention. Given the target number of. bits, T, for a super GOP (L, N) 900, the next step i~> to determine the distribution of T
over the frames of the super GOP. A "super frame"
15 is defined as a collection of L frames, one from each of L programs taken at the same time instant, or common temporal reference point. For example, at time tl, a super frame 902 includes frames 910, 920, 930, ..., and 990. Similarly, at time 2t1, a super 20 frame 904 includes frames 912, 922, 932, .., and 992.
At time (N-1)t1, a super frame 908 includes frames 916, 926, 936, ..., and 996. At time Ntl, a super frame 909 includes frames 918, 928, 938, ...,. and 998.
Each super GOP contains N super frames. For 25 example, super GOP 900 includes super frames 902, 904, 906, 908 anc9 909. Note that since the L
programs can have any program GOP structure, the L
frames in a super frame can have any picture type, either I, P om B, for example.
Furthermore, program frame complexity can be used to determine a target number of bits for a super frame and an individual frame. A complexity measure, C, may be defined for a frame as the product of they quantization level, Q, used for the frame and the number of bits, R, generated for the frame by using the Q, i.e., (3) C=RQ.
However, it should be understood that any available complexity measure may be used. Let Ql,n,c and Rl,n,t be, respectively, the quantization parameter used for. frame n of program 1 and the corresponding number of bits generated for the frame using Ql,~,t,, where n ranges from one to the number of super frames in a super GOP (e.g., five in the simplified example of FIG. 9), 1 ranges from one to L, and t corresponds to the picture type, I, P or B.
For example, QZ";,B corresponds to program 2, third frame, e.g., i=rame 924, assuming it is a B-picture.
For a super frame n, there can there be L
different frame complexity measures, one for each regular .frame, i..e., ( 4 ) CI,",r = ~r,n,rRr.n,r 1=1 ~ 2,..., L
Furthermore, let Tn be the target number of bits for super frame n. The total number of bits generated from the L regular frames within the super frame n should be close to T", i.e., 1. I.
l,n,r 3 0 ( 5 ) 7;, _ ~, Rr,n,r =
m r=i ~r,n,~
Similarly, the total number of bits generated for all N super frames in a super GOP should be close to the tai°get number of bits, T, assigned for each super GOP, i.e., (6) T=~T, .
For the stat mux system to achieve a more uniform picture quality, ideally, the same quantization parameter should be applied to all the frames. Note that quantization is the only lossy operation in MPEG encoding and plays a critical role in controlling both the picture quality and the bit rate. However, in order to account for the different pict.u:re types (I, P and B), a constant weighting factor, K1,",t, is provided for each picture type t, i.e., (7 ) Q~,n,~ = Xn,n,rQ . where K, ,for I picture ( 8 ) K,,n,, = Kr ,for I' picture K" , for B picture The subscript "t" is an index for the picture type, e.g., I, P or B. This subscript may be omitted in some of the equations herein when its presence is not necessary. It is possible to use the following weighting factors : Kr=KP=1 and KB=1 . 4 .
Furthermore, in many cases, it is desirable for some of the programs to be given a higher priority (e. g., relative number of bits) than others. Thus, the quality level among programs can be controlled.
Again, since quantization is the primary lossy operation, the program quality level can be controlled by controlling quantization.
Specifically, the quantization parameter for program, 1, can be further modulated by a weighting factor, wl, as ( l a ) ~l.n,l wl~I~n.l For programs with higher priority, a smaller weighting factor. is used, and for lower priority programs, a larger weighting factor is used. A
larger quantization level results in coarser step sizes (e. g., a lower quality image), while a smaller quantization level results in finer step sizes (e.g., a higher quality image). Thus, by controlling trte weighting factor, cal, in eqn. (7a), the quantizati.on parameter and, therefore, the quality, is controlled. From equations (5)-(7), the target number of bits for super frame n, Tn, is - C~l.n.r 9 T - ~ w~ K~'n'' T
( ) n !V 1.
-_ C'~,~~>r ~~ ~ 1vr ICr.n.r where the numerator is the sum of the complexity measures for t:he L regular frames in super frame n, and the denominator is the sum of the complexity measures for a7_1 the frames in the current super GOP. In other words, the target number of bits for super frame n, Tn, is proportional to its complexity.
With the above bit allocation equation, computation of the target number of bits for a super frame requires the complexity measures for all the LxN frames within the current super GOP(L,N), i.e., Cl,n,t, -1 - 1,2,...,L and I'l = 1,2,...,N. HOW2Ver, t~'11S
may not be practical or desirable in some cases due to required memory capacity and potential processing delays.
Accordingly, an alternative, simplified bit allocation scheme is provided. First, at each super frame n', only consider the distribution of the remaining bits, '1'r, defined as ( 1 ~ ) Tr = Ti w ~ Rr.n~-r.r m over the remaining super frames from n' to N in the super GOP(L,N). This leads to the bit allocation for super frame n' as .
r.
-, .
C r.n,,r ( 11 ) T , = L~ WJ Kr,n,,r T
rr ~! /, I r r ~Cl,n,t rr=r;r' l =1 w/ Kr,n,r The comple:~ity measures for the previous frames from 1 to n'-1 <3re now no longer necessary in computing the t<~rget number of bits for super frame n', Tn-. At the start of processing a new super GOP, T, is re-sE:t as follows:
(12) T,=T,+T, where T is the 'target number of bits for a new super GOP, and T, on t:he right of the equation, which can be either a positive or negative number, is the number of bits Left from the previous super GOP.
Secondly, in accordance with the present invention, assume that all the future frames of the WO 00/13419 PCT/US99/16~95 same picture type in a program (in a super GOP) have the same complexity measure, i.e., ( 13 ) Cl,n,t = Cn."..~ n _< n S N , which is a reasonable assumption for continuous 5 scenes. For example, the complexity measure of a P-picture in the lth video program of a super GOP may be used as the complexity measure for the following P-picture in the 1th video program in the same super GOP. Advantageously, there is no need to calculate 10 a separate complexity measure for each picture.
Moreover, the present inventors have determined that satisfactory results are achieved when assuming all future frames of the same picture type in a program have the same complexity measure.
15 Now, for each program, only three frame complexity measures are required, each corresponding to one of the three picture types, I, P or B, i:e., C1,I, C1,P, and C_i,s, respectively. The three complexity measures for a program are updated after 20 encoding each frame n'(see eqn. (4)), at least for every picture in a program prior to the last picture in a super GOP. The complexity measures can be estimated or calculated based upon the average quantization parameter used for the previous frame 25 of the same type= (e. g., averaged over a picture), and the number of bits generated for the frame (see eqn. (3)). In other words, the complexity measures are available at the current frame for each program.
The bit allocation strategy for super frame n 30 therefore becomes (14) WO 00/13419 PCT/US99/1.6595 !~ 1 - Cl,n,l ~~ W! Kl,n, y' !, Tn = C!-ll ~ CI,l, CI.B r ~~Nl.r wrK~--~ Nr,r wlKl-+ N!.!i wlK~ ~
Here, 1 . Cl,n,t is the complexity measure corresponding to the picture type tEfI,P,B} of frame n for program 1.
2. Kl.n,, is ~~ constant factor used to compensate for the picture type t of frame n of program 1. It can be either KI, KP or KB, depending upon the picture type.
3. N!,!, Nl,,, and Nl.H are, respectively, the remaining number of I, P and B pictures for program 1 in the super GOP at super frame n.
4. wlis the quality weighting factor for program 1, and i.s determined by the program or network service provider.
Note that t:he numerator on the right side of equation (14) ins the sum of complexity measures for all the frames i_n super frame n. It can be considered a complexity measure for super frame n.
On the other hand, the denominator can be considered as a complexity measure for the entire set of the remaining frames in the super GOP. Hence, equation (14) assigns a super frame a target number of bits proportional to the super frame's complexity measure.

WO 00/13419 PCT/US99/1b595 Constraint on Super Frame Target Rate Referring to the encoder buffer 670 of FIG. 6, the encoder buffer fullness at frame n, Bn, can be calculated as L
( ) a a 15 Bn = ~n_~I -~ ~ Rl,n,t - Rchannei(bpf) r I-I
_~channel _ rate where Rci~~nel(bpf) _ game rate is the average number of bits per frame (bpf) transmitted over the channel.
Let Bt;,axbe the maximum encoder buffer size. Then, to ensure that. the encoder buffer never overflows or underflows, the buffer fullness, B~, must be constrained within the range [O,Bmax~, i.e., ( 16 ) 0 <_ B,',' _< Bmax .
From equations (15) and (16), we have L
( 17 ) 0 ~ ~ n-I + ~ Rl n,t Rchannel(bpf) ~ Bmax i Or I=
L
1'rJ ( 18 ) Rchannel(bpf) Bn-I ~ L.,rRl,n,t ~ Rchannel(bpf) +Bmax Bn-1 ' 1=I
In accordance with the present invention, this is a constraint on the total number of bits generated for super frame n for a given Rc)t~tnel(bpf) ' If the aggregate number of bits can be controlled to meet the target number of bits, i.e., r=I

WO 00/13419 PCTNS99/16~95 the constraint on the total number of bits for a super frame n becomes the constraint on the target number of bits for super frame, i.e., _~ a ~ ~ a _ a ( 2 0 ) Rchannel(6~pf) i,n-1 Tn Rchannel(bpf) + Bmax Bn-I
Hence, befo re starting to encode each super frame n, the target rate determined by equation (14) is checked to determine whether it is in the proper range, and if no~, the target rate is adjusted as follows:
{21) _ a _ a Rchannel(bpf) '~Bn-1 ~ l Tn ~ Rchannel(bpf) Bn-1 Tn Rchannel(bpf) + Bmax Bn-I l~ Tn 7 Rchannel(bpf) + Bmax Bn-1 Tn otherinise Target Rata for Regular Frames Once a target number of bits for a super frame has been set, what remains is to distribute the bits over the regular frames in the super frame. In accordance with t he present invention, the target number of. bits for frame n of program 1, T,,", is 1- C~.n,r u'r K~.n.
(22) T,n = i.
r i ~'lKt.n,~
where the numerator on the right is the complexity measure for frame n of program 1, and the denominator is 'the complexity measure for super frame n. The distribution of T" assigned for super WO 00/13419 PCT/(JS99/16595 frame n over I, regular frames in the super frame is again based upon the complexities of the program frames.
Constraint on Target Rate for Regular Frame In multi-program broadcast applications, several video programs are multiplexed on a single fixed rate transmission channel. Service information inc:Luded in the bit stream, such as packet identifiers (PIDs) provides the necessary navigation infoo~mation to allow a headend server to select the desi~_ed programs for transmission, and to allow a set-top decoder at a user's home to turn to the proper charm<=1 and extract (demultiplex) the packets corresponding to the selected programs, as shown in FIG. 10.
FIG. 10 illustrates a decoder in accordance with the present. invention. Multiplexed data from the transmission channel, such as a cable television network and/or a satellite distribution network, is received by a DEMUR 1000. Based on a default or user selection, a particular program in the multiplex is se7_ected for decoding and display.
Data from ;successive frames of the selected program is provided from the DEMUR 1000 to the decoder buffer 1010, and then to an MPEG decoder 1020, for examp7_e, to recover the program data in the pixel domain, e.g., for a program 1. The decoder 1020 may correspond to the decoder 400 of FIG. 4.

The demultiplexed bit stream is at a variable rate. To ensure that the decoder buffer 1010 does not overflow or underflow when any of the programs are selected, additional restrictions must be 5 imposed at the encoder.
Specifically, assume that program 1 is selected and that the decoding delay is N' frames. The decoding delay is the time a frame spends in the decoder's buffer before being decoded. Let R~~,be 10 the number of bits transmitted for program 1 during the nth frame period, where the superscript "c"
designates "cha:nnel". Then, the decoder buffer will be filled up to a level N' ~l - ~~ c (23) Bo ~R,,"
n=a 15 before any bits are moved out for decoding. The superscript "d." designates "decoder". During the period of frame n>N', the decoder buffer moves R,,n,' bits to the decoder, and receives R;"+N, bits from the channel. The buffer fullness at frame n>N' is 20 therefore given as n+ N' ( 2 4 ) Bn - Bn--I -I- Rl.n+N' Rl,n,! - ~ R! it~ - B~~_I - Rl,n,l ~ Where n'=n n n a ~' - ~ r ( 2 5 ) B~,n __ L R~ n. ' R~ n' n'='d n'=I
can~be considered as the fullness of a virtual encoder buffer for program 1 at frame n. The 25 superscript "e" designates "encoder". Note that R°l,n. is the number of bits transmitted during the interval of frame n' of program 1, not the number of bits used to encode the frame.
Let Bnaxbe the maximum decoder buffer size. To ensure the decoder buffer never overflows or underflow, the buffer fullness, Bn, has to be within the range of [ 0, Bn~ ] , i . a . , (26) 0< B,~ < Bnax From equations ( 2 9 ) and ( 2 6 ) , we have n+ N' ( 27 ) 0 ~ ~ Rl,n' Bl,n-1 RLn,t ~ Bmax r Or n'=n n+ N' n+ N' ( ) ~ <. a d ~ ~ ~ c _ r l.fl 2 8 R7.~r~ - BI,n_I - Bmax Rl,n,t RI,n' BI,n-I .
n'=n n'=n In accordance with the present invention, this is a constraint on the number of bits generated for frame n of program-1. Again, we assume that the bit rate for each program can be controlled to meet its target rate, i.~~., ( 2 9 ) T,.n = R~,a~,r .
The constraint on the number of bits for each individual frame (l,n) becomes the constraint on the target numbex of bits for the frame, i.e., n+N' n+N' c a d ~ ~ ~ c _ a 3 ~ RI.n, - BI.,r_I - Bmax T ,n RI,n, BI,n-I .
n'.n n'--n Hence, before starting to encode each frame n of program l, we need to check if its target rate is within the proper range, and if not, the target rate is adjusted as follows:

(31) n+ N' n+N' c _ a _ d c _ a _ d Rf,n' Bl,n-I Bmax Tl.n ~ ~ Rl.n' Bl,n-I Bmax n'=n i~' n'=n n+N' n+N' _ c _ n c _ a ~,n - ~ RI,n' Bl.n-I 1 TI'n ~ ~ Rl,n' BI,n-1 n'=n n'=n otherwise T,"
Note that B;,~_I is the fullness of a virtual encoder buffer :For program 1 at frame n-1 and hence, it is available at frame n. However, R~.~~,,n'=n,n+1,...,n-,~-N', are the numbers of bits that will be transmitted for program 1 during the intervals of the current and future frames n,n+1,...,n+N'. I~Vith a constant bit/frame channel rate, R;,n.,n'=n,n+1,...,n+N' can be measured in the encoder buffer, as shown in FIG. 11.
FIG. 11 illustrates data stored in an encoder buffer in accordance with the present invention. An encoder buffer may be provided after the VLC 330 in FIGS. 3-5, for a xample. Within each slot window 17=17,17+.1,...,17+N' Of Rchannel(hpf) bits In the encoder buffer, the number of bits for program 1 is R°l,n.
Note that R'l," c:an be zero.
For exampl~a, slot windows n+N' (1110), n+1 (1120), and n (1130) are shown. Slot window n ( 1130 ) includes slots R~l+i,n ( 1132 ) , R~l,n ( 1134 ) , and R~1-l,n (1136) .
When a frame n is encoded, all the compressed bits are moved into the encoder's buffer. This can be accomplished on a program-by-program basis by compressing the entire frame of a program at frame n, moving all of the bits into the encoder's buffer, and processing the next program at the same frame index n, and so forth. Or, processing can occur by processing a portion of a frame, such as a macroblock or slice, at a time. What is important in modeling the encoder's buffer is the number of bits generated for a program in a frame interval.
Constraint on Max and Min Bit Rate 1D The average bit rate over a certain number of frames, N", can be controlled by limiting the target number of bits for each frame within a specific range. This may be desirable, for example, to prevent large fluctuations in the bandwidth consumed by each program. Let Rmax and Rm~~ be the allowed maximum and minimum average number of bits, respectively, over every N" frames. The average number of bits per N" frames up to a frame n therefore has to be in the range of ~Rmin~Rmax~i i.e., ( ) < ._- <
32 R~n~n N~~ Rmax ~ Or n~=~~_ N..
n-I n-I
( 3 3 ) N" R~"~a - ~ R~,n.~ ~ R~.n.r ~ N~ Rmex - ~ R~,~~,r n'=n-N" n =n-N"
This is another constraint on the number of bits for frame n of program 1. Note that R,,,~,,,,n'=n-N",n--N",...,n-1, are all available to the encoder at frame n. Again, assume that the actual n Rl,n,l rate can be made close to the target rate by proper control of the -target number of bits, i.e., ( 3 4 ) T ,n - Rr.t~.t .
The additional constraint on the actual number of bits for frame n then becomes a constraint on its target number o:E bits, i.e., n_I n_I
( 3 5 ) N~ ~ Rmin ~ Rr,n,t ~ Ti.n < N' ~ Rmax ~ Rl,n,t ' tt.=n-N', t~'=n-N"
In summary, in accordance with the present invention, the target number of bits for each individual frame is adjusted as follows:
(36) n-t n-~
N' 1 Rmin ~ ~~l,u',t ~ f T,,n ~ N" Rmin ! ~ Rr.n',t n~=n... N" n.~n-N.' If T ,n = N Rmax ~ ~el,tt',t T~,n J N Rmax ' ~ R/.n',t n'=n.-- N"' n'=n-N"
T,,n otherwise Rate Control Now, the t<~rget number of bits for each frame of_ a program must be met. This can be achieved by adjusting the quantization parameter, Q, in the MPEG
encoder (FIG. 3) and QZ in the transcoder (FIGs A
and 5). The rape control scheme described in ISO/IEC (MPEG-2) "Test Model 5" (TM5), April 1993 may be used, f~o_r example. An alternative rate control scheme !shat is more accurate than TM5 can be found in L. Wang, "Rate Control for MPEG Video Coding", Proc. 'SPIE on Visual Communications and Image Processing, pp.53-64, Taiwan, May 1995, which requires multiple operations of VLC and Q for each f tame .
Accardingl~~r, it can be seen that the present 5 invention provides a method and apparatus for allocating bits in a stat mux system. The invention extends the concept of the stat mux to accommodate both compressed and uncompressed video programs using transcoding and encoding, respectively.
10 Additionally, for super GOP and super frame bit allocation schemes, the invention provides target bit rates, and constraints on the target bit rates, for super GOPS, super frames, and regular frames, as well as constraints on overall minimum and maximum 15 bit rates. Further efficiencies are realized by assuming all pictures of the same type in a program of a super GOP have the same complexity, thereby avoiding the nec=d to calculate and maintain the complexity for each picture in determining the 20 (first, second and third) target number of bits.
A target number of bits, Tn, for a super frame, which is a collection of frames across all channels at a given frame instance, is adaptive and is able to address any combination of picture types. Frames 25 of the same picture type for a program are assigned the same (or sirn:ilar) number of bits. To achieve this. adaptation in bit allocation, the invention provides a dynamic bit allocation strategy which determines a target number of bits for each program 30 on a frame-by-frame basis according to the previous coding information, such as quantization parameters used, and the resulting number of bits.

Hierarchic<~l dynamic bit allocation is used, starting from a super GOP level, then to a super frame level, and then to the individual frame (picture) level. The concept can be further extended to a sub-frame level, where bits are allocated for a portion of a frame such as a slice or Video Object Plane (VOP). At each level, a target number oi= bits is determined.
Furthermore, to prevent the encoder and decoder buffers from overflowing or underflowing, constraints are imposed on the compressed bit rate of each program in the mufti-program transmission environment.
Additionally, program quality can be controlled according to a program priority weighting factor.
Although the invention has been described in connection with various specific embodiments, those skilled in the art will appreciate that numerous adaptations and modifications may be made thereto without departing from the spirit and scope of the invention as set: forth in the claims.
For example, while the invention was discussed in terms of the MPEG-2 standard, it may be adapted for use with other standards which use groups of pictures or analogous constructs with different picture types.

Claims (36)

What is claimed is:
1. A bit allocation method for digital video, comprising the steps of:
providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs);
each GOP having an associated number of pictures;
providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super framers, each super frame having L pictures at a common temporal reference point;
defining a respective complexity measure for each picture type in each 1th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1th picture in the associated n th super frame, where 1=l, ..., L; and calculating a third target number of bits for encoding each 1th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; wherein:
the same complexity measure is used for each picture with a common picture type in at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
2. The method of claim 1, wherein:
the same complexity measure is used for each picture with a common picture type in each of said video programs of said super GOP for calculating the second and third target numbers of bits.
3. The method of claim 1, wherein:
said video programs of said super GOP have a plurality of different picture types.
4. The method of claim 1, wherein:
the complexity measure of a first picture of a given type in said at least one of said video programs is used for each following picture of the same type in said at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
5. The method of claim 1, wherein:
said video programs are adapted for communication ever a broadband communication network to a decoder population.
6. The method of claim 1, wherein:
wherein:
the respective complexity measure for each of said picture types in each l th program is updated after each picture in the l th program prior to the last picture of the super GOP is encoded.
7. A bit allocation method for digital video, comprising the steps of:
providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs);
each GOP having an associated number of pictures;
providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;

wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
defining a respective complexity measure for each picture type in each l th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L;
calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and ~
providing respective weighting factors, w, for the different video programs according to a relative priority thereof; wherein:
said third target number of bits for encoding each l th picture in the associated n th super frame is calculated according to the respective weighting factor of the associated l th video program.
8. A bit allocation method for digital video, comprising the steps of:

providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs) ;
at least one of said video programs comprising uncompressed video data;
each GOP having an associated number of pictures;
processing pre-compressed picture data to obtain partially uncompressed data of at least a particular one of said plurality L of video programs;
providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
defining a respective complexity measure for each picture type in each l th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th, picture in the associated n th super frame, where l=1, ..., L; and calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; wherein:
said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated third target number of bits.
9. A bit allocation method for digital video, comprising the steps of:
providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs):
wherein a buffer associated with said encoder receives encoded data from the video programs, each GOP having an associated number of pictures;
providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
defining a respective complexity measure for each picture type in each l th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L:
calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and prior to encoding the n th super frame with the associated second target number of bits, at least one of the steps of:
(a) adjusting the associated second target number of bits, if necessary, to avoid falling below R channel(bpf)-B e n-1, wherein:
R channel(bpf) is an average number of bits per picture transmitted over said channel; and B e n-1 is a fullness level of said buffer after the n-1 st super frame has been encoded; and (b) adjusting the associated second target number of bits, if necessary, to avoid exceeding R channel (bpf) +B e max-B e n-1 ;
wherein B e max is a maximum capacity of said buffer.
10. A bit allocation method for digital video, comprising the steps of:
providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs);
wherein a buffer associated with said encoder receives encoded data from the video programs, and the video programs are transmitted over a channel to a decoder and stored in a buffer thereat;
each GOP having an associated number of pictures;
providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of said channel;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;

defining a respective complexity measure for each picture type in each l th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L;
calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and prior to encoding the l th picture in the n th super frame with the associated third target number of bits, at least one of the steps of:
(a) adjusting the associated third target number of bits, if necessary, to avoid falling below wherein:

is a sum of the number of bits transmitted for the n th through (n+N') th pictures for the l th video program;
N' is a decoding delay of said decoder;
B e l,n-l is a fullness level of the encoder's buffer after the l th picture in the n-1 st super frame has been encoded; and B d max is a maximum capacity of the decoder's buffer; and (b) adjusting the associated third target number of bits, if necessary, to avoid exceeding
11. A bit allocation method for digital video, comprising the steps of:
providing a plurality L of video programs at an encoder, each program having successive groups of pictures (GOPs);
each GOP having an associated number of pictures;

providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
defining a respective complexity measure for each picture type in each l th program;
calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th picture in the associated n th super frame, where l=l, ..., L;
calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame;
wherein R min is a minimum average number of bits for encoding N">1 pictures; and prior to encoding the l th picture in the n th super frame with the associated third target number of bits, at least one of the steps of:
(a) adjusting the associated third target number of bits, if necessary, to avoid falling below wherein:
is a sum of the number of bits transmitted for the (n-N") th through (n- 1) th pictures for the l th video program; and (b) adjusting the associated third target number of bits, if necessary, to avoid exceeding ;
wherein R max is a maximum average number of bits for encoding N">1 pictures.
12. A method for encoding uncompressed video source data, and transcoding pre-compressed video source data, comprising the steps of:

partially decompressing the pre-compressed video source data to obtain corresponding partially uncompressed video data;
allocating bits for encoding said uncompressed video source data according to a statistical multiplexing scheme; and allocating bits for transcoding said partially uncompressed video data according to said statistical multiplexing scheme;
wherein said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated allocated bits.
13. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
means for calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;

wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
means for defining a respective complexity measure for each picture type in each l th program;
means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L; and means for calculating a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame;
wherein:
the same complexity measure is used for each picture with a common picture type in at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
14. The apparatus of claim 13, wherein:
the same complexity measure is used for each picture with a common picture type in each of said video programs of said super GOP for calculating the second and third target numbers of bits.
15. The apparatus of claim 13, wherein:
said video programs of said super GOP have a plurality of different picture types.
16. The apparatus of claim 13, wherein:
the complexity measure of a first picture of a given type in said at least one of said video programs is used for each following picture of the same type in said at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
17. The apparatus of claim 13, wherein:
said video programs are adapted for communication over a broadband communication network to a decoder population.
18. The apparatus of claim 13, wherein:
the respective complexity measure for each of said picture types in each l th program is updated after each picture in the l th program prior to the last picture of the super GOP is encoded.
19. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
means for calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
means for defining a respective complexity measure for each picture type in each 1 th program;
means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1 th picture in the associated n th super frame, where l=1,..., L;
means for calculating a third target number of bits for encoding each 1 th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and means for providing respective weighting factors, w, for the different video programs according to a relative priority thereof; wherein:
said third target number of bits for encoding each 1 th picture in the associated n th super frame is calculated according to the respective weighting factor of the associated 1 th video program.
20. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), each GOP has an associated number of pictures, and at least one of said video programs comprises uncompressed video data, comprising:
means for processing pre-compressed picture data to obtain partially uncompressed data of at least a particular one of said plurality L of video programs;
means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
means for calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;

wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
means for defining a respective complexity measure for each picture type in each 1 th program;
means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1 th picture in the associated n th super frame, where l=1,...,L; and means for calculating a third target number of bits for encoding each 1 th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame;
wherein:
said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated third target number of bits.
21. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, and wherein a buffer associated with said encoder receives encoded data from the video programs, comprising:
means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
means for calculating a first target number of bits, T, for en coding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
means for defining a respective complexity measure for cacti picture type in each 1 th program;
means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1 th picture in the associated n th super frame, where l=1,..., L;
means for calculating a third target number of bits for encoding each 1 th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and at least one of:

(a) means for adjusting the associated second target number of bits, if necessary, to avoid falling below R channel(bpf)-B e n-1. prior to the n th super frame being encoded with the associated second target number of bits, wherein:
R channel(bpf) is an average number of bits per picture transmitted over said channel; and B e n-1 is a fullness level of said buffer after the n-1st super frame has been encoded; and (b) means for adjusting the associated second target number of bits, if necessary, to avoid exceeding R channel(bpf)+B e max-B e n-1, prior to the n th super frame being encoded with the associated second target number of bits;
wherein B e max is a maximum capacity of said buffer.
22. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, and wherein a buffer associated with said encoder receives encoded data from the video programs, and the video programs are transmitted over a channel to a decoder and stored in a buffer thereat, comprising:
means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;

means for calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of said channel;
wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;
means for defining a respective complexity measure for each picture type in each 1 th program;
means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1 th picture in the associated n th super frame, where 1=1,..., L;
means for calculating a third target number of bits for encoding each 1 th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; and at least one of:
(a) means for adjusting the associated third target number of bits, if necessary, to avoid falling below prior to the 1 th picture in the n th super frame being encoded with the associated third target number of bits, wherein:
is a sum of the number of bits transmitted for the n th through (n+N')th pictures for the 1 th video program;
N' is a decoding delay of said decoder;
B e l,n-1 is a fullness level of the encoder's buffer after the 1 th picture in the n-1st super frame has been encoded; and B d max is a maximum capacity of the decoder's buffer; and (b) means for adjusting the associated third target number of bits, if necessary, to avoid exceeding prior to the 1 th picture in the nth super frame being encoded with the associated third target number of bits.
23. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:

means for providing a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;

means for calculating a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;

wherein each super GOP comprises a plurality N
of super frames, each super frame having L pictures at a common temporal reference point;

means for defining a respective complexity measure for each picture type in each 1th program;

means for calculating a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the complexity measure of each 1th picture in the associated n th super frame, where 1=1, ..., L;

means for calculating a third target number of bits for encoding each 1th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame;

wherein R min is a minimum average number of bits for encoding N">1 pictures; and at least one of:
(a) means for adjusting the associated third target number of bits, if necessary, to avoid falling below prior to the 1th picture in the n th super frame being encoded with the associated third target number of bits, wherein:

is a sum of the number of bits transmitted for the (n-N11)th through (n-1)th pictures for the 1th video program; and (b) means for adjusting the associated third target number of bits, if necessary, to avoid exceeding prior to the 1th picture in the n th super frame being encoded with the associated third target number of bits;
wherein R max is a maximum average number of bits for encoding N1>1 pictures.
24. An apparatus for encoding uncompressed video source data, and transcoding pre-compressed video source data, comprising:
means for partially decompressing the pre-compressed video source data to obtain corresponding partially uncompressed video data;
means for allocating bits for encoding said uncompressed video source data according to a statistical multiplexing scheme; and means for allocating bits for transcoding said partially uncompressed video data according to said statistical multiplexing scheme;
wherein said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated allocated bits.
25. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:

said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;
said complexity processor is adapted to calculate a respective complexity measure for each picture type in each 1th program;
said super frame processor is adapted to calculate a second target number of bits for encoding each 1th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the associated complexity measure of each 1th picture in the associated n th super frame, where 1=1, ..., L; and said frame processor is adapted to calculate a third target number of bits for encoding each 1th picture in the associated n th super frame according to said second target number of bits and the associated complexity measure, and a sum of the complexity measures for each picture in the associated n th super frame; wherein:
the same complexity measure is used for each picture with a common picture type in at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
26. The apparatus of claim 25, wherein:
the same complexity measure is used for each picture with a common picture type in each of said video programs of said super GOP for calculating the second and third target numbers of bits.
27. The apparatus of claim 25, wherein:
said video programs of said super GOP have a plurality of different picture types.
28. The apparatus of claim 25, wherein:
the complexity measure of a first picture of a given type in said at least one of said video programs is used for each following picture of the same type in said at least one of said video programs of said super GOP for calculating the second and third target numbers of bits.
29. The apparatus of claim 25, wherein:

said video programs are adapted for communication over a broadband communication network to a decoder population.
30. The apparatus of claim 25, wherein:
the respective complexity measure for each of said picture types in each lth program is updated after each picture in the lth program prior to the last picture of the super GOP is encoded.
31. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:
said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;
said complexity processor is adapted to calculate a respective complexity measure for each picture type in each l th program;
said super frame processor is adapted to calculate a second target number of bits for encoding each n th super frame of pictures, where n=l,...,N, according to said first target number of bits, T, and the associated complexity measure of each 1 th picture in the associated n th super frame, where l=1,...,L;
said frame processor is adapted to calculate a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity, and a sum of the complexity measures for each picture in the associated n th super frame;
said rate control processor provides respective weighting factors, w, for the different video programs according to a relative priority thereof;
and said frame processor is adapted to calculate said third target number of bits for encoding each l th picture in the associated n th super frame according to the respective weighting factor of the associated l th video program.
32. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), each GOP has an associated number of pictures, and at least one of said video programs comprises uncompressed video data, comprising:
a transcoding processor for processing pre-compressed picture data to obtain partially uncompressed data of at least a particular one of said plurality L of video programs;
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:
said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for.
encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;
said complexity processor is adapted to calculate a respective complexity measure for each picture type in each l th program;
said super frame processor is adapted to calculate a second target number of bits for encoding each n th super frame of pictures, where n=1, ..., N, according to said first target number of bits, T, and the associated complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L;
said frame processor is adapted to calculate a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity, and a sum of the complexity measures for each picture in the associated n th super frame; and said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated third target number of bits.
33. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:
said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for encoding said :super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;
said complexity processor is adapted to calculate a respective complexity measure for each picture type in each l th program;
said super frame processor is adapted to calculate a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the associated complexity measure of each l th picture in the associated n th super frame, where l=1,...,L;
said frame processor is adapted to calculate a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity, and a sum of the complexity measures for each picture in the associated n th super frame;
a buffer associated with said encoder receives encoded data from the video programs;
said super frame processor receives a signal indicative of a fullness level of said buffer;
wherein at least one of:
(a) said super frame processor is adapted to adjust the associated second target number of bits, if necessary, to avoid falling below R channel(bpf)-B e n-1 prior to the n th super frame being encoded with the associated second target number of bits;
R channel(bpf) is an average number of bits per picture transmitted over said channel; and B e n-1 is the fullness level of said buffer after the n-1st super frame has been encoded; and (b) said super frame processor is adapted to adjust the associated second target number of bits, if necessary, to avoid exceeding R channel(bpf)+B e max-B e n-1 prior to the n th super frame being encoded with the associated second target number of bits;
wherein B e max is a maximum capacity of said buffer.
34. A bit allocation apparatus for digital video, wherein a plurality L of video programs are provided at am encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:
said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;

said complexity processor is adapted to calculate a respective complexity measure for each picture type in each l th program;
said super frame processor is adapted to calculate a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the associated complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L;
said frame processor is adapted to calculate a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity, and a sum of the complexity measures for each picture in the associated n th super frame;
a buffer associated with said encoder receives encoded data from the video programs, and the video programs are transmitted over said channel to a decoder and stored in a buffer thereat;
said frame processor receives a signal indicative of a fullness level of the encoder buffer; wherein at least one of:
(a) said frame processor is adapted to adjust the associated third target number of bits, if necessary, to avoid falling below prior to the l th picture in the n th super frame being encoded with the associated third target number of bits;

is a sum of the number of bits transmitted for the n th through (n+N')th pictures for the l th video program;
N' is a decoding delay of said decoder;
B e l,n-1 is a fullness level of the encoder's buffer after the l th picture in the n-1st super frame has been encoded; and B d max is a maximum capacity of the decoder's buffer; and (b) said frame processor is adapted to adjust the associated third target number of bits, if necessary, to avoid exceeding prior to the 1th picture in the n th super frame being encoded with the associated third target dumber of bits.
35. A bile allocation apparatus for digital video, wherein a plurality L of video programs are provided at an encoder, each program has successive groups of pictures (GOPs), and each GOP has an associated number of pictures, comprising:
a rate control processor;
a super GOP processor, a super frame processor, a frame processor, and a complexity processor, each of which is associated with said rate control processor; wherein:
said rate control processor is responsive to a signal defining a super GOP comprising at least one GOP from each of said L video programs, and having a length of N pictures;
said super GOP processor is adapted to calculate a first target number of bits, T, for encoding said super GOP according to the number of pictures in said super GOP, LxN, and an available capacity of a channel over which the video programs are transmitted;
each super GOP comprises a plurality N of super frames, each super frame having L pictures at a common temporal reference point;
said complexity processor is adapted to calculate a respective complexity measure for each picture type in each l th program;

said super frame processor is adapted to calculate a second target number of bits for encoding each n th super frame of pictures, where n=1,...,N, according to said first target number of bits, T, and the associated complexity measure of each l th picture in the associated n th super frame, where l=1, ..., L;
said frame processor is adapted to calculate a third target number of bits for encoding each l th picture in the associated n th super frame according to said second target number of bits and the associated complexity, and a sum of the complexity measures for each picture in the associated n th super frame;
R min is a minimum average number of bits for encoding N">1 pictures; wherein at least one of:
(a) said frame processor is adapted to adjust the associated third target number of bits, if necessary, to avoid falling below prior to the l th picture in the n th super frame being encoded with the associated third target number of bits; and ~~l,n' is a sum of the number of bits transmitted for the (n-N")th through (n-1)th pictures for the l th video program; and (b) said frame processor is adapted to adjust the associated third target number of bits, if necessary, to avoid exceeding N"R max - ~~l,n' prior to the lth picture in the nth super frame being encoded with the associated third target number of bits;
wherein R max is a maximum average number of bits for encoding N" > 1 pictures.
36. An apparatus for encoding uncompressed video source data, and transcoding pre-compressed video source data, comprising:
an encoder;
a transcoder;
a rate control processor associated with said encoder and transcoder; wherein:
said transcoder partially decompresses the pre-compressed video source data to obtain corresponding partially uncompressed video data;

said rate control processor allocates bits to said encoder for encoding said uncompressed video source data according to a statistical multiplexing scheme;
said rate control processor allocates bits to said transcoder for transcoding said partially uncompressed video data according to said statistical multiplexing scheme; and said pre-compressed picture data is transcoded such that a bit rate of said pre-compressed picture data is different than a bit rate provided by the associated allocated bits.
CA002341040A 1998-08-27 1999-07-22 Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals Abandoned CA2341040A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/141,265 1998-08-27
US09/141,265 US6167084A (en) 1998-08-27 1998-08-27 Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals
PCT/US1999/016595 WO2000013419A2 (en) 1998-08-27 1999-07-22 Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals

Publications (1)

Publication Number Publication Date
CA2341040A1 true CA2341040A1 (en) 2000-03-09

Family

ID=22494922

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002341040A Abandoned CA2341040A1 (en) 1998-08-27 1999-07-22 Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals

Country Status (11)

Country Link
US (1) US6167084A (en)
EP (1) EP1108330A2 (en)
JP (1) JP2003517743A (en)
KR (1) KR20010073001A (en)
CN (1) CN1315118A (en)
AR (1) AR020218A1 (en)
AU (1) AU5122399A (en)
BR (1) BR9913202A (en)
CA (1) CA2341040A1 (en)
TW (1) TW454422B (en)
WO (1) WO2000013419A2 (en)

Families Citing this family (195)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5715009A (en) 1994-03-29 1998-02-03 Sony Corporation Picture signal transmitting method and apparatus
US6735253B1 (en) 1997-05-16 2004-05-11 The Trustees Of Columbia University In The City Of New York Methods and architecture for indexing and editing compressed video over the world wide web
SG116400A1 (en) 1997-10-24 2005-11-28 Matsushita Electric Ind Co Ltd A method for computational graceful degradation inan audiovisual compression system.
CA2265089C (en) 1998-03-10 2007-07-10 Sony Corporation Transcoding system using encoding history information
US6859496B1 (en) * 1998-05-29 2005-02-22 International Business Machines Corporation Adaptively encoding multiple streams of video data in parallel for multiplexing onto a constant bit rate channel
JP2995177B1 (en) * 1998-07-10 1999-12-27 株式会社ディジタル・ビジョン・ラボラトリーズ Stream distribution system
TW379503B (en) * 1998-09-15 2000-01-11 Mentor Data System Inc Method and apparatus of video compression and reformatting to increase video channel utilization
JP2000113590A (en) * 1998-10-08 2000-04-21 Pioneer Electronic Corp Information recording device
US6519004B1 (en) * 1998-10-09 2003-02-11 Microsoft Corporation Method for transmitting video information over a communication channel
US6618363B1 (en) 1998-10-09 2003-09-09 Microsoft Corporation Method for adapting video packet generation and transmission rates to available resources in a communications network
US6438136B1 (en) 1998-10-09 2002-08-20 Microsoft Corporation Method for scheduling time slots in a communications network channel to support on-going video transmissions
GB9822087D0 (en) * 1998-10-09 1998-12-02 Snell & Wilcox Ltd Improvements in data compression
US6445701B1 (en) * 1998-10-09 2002-09-03 Microsoft Corporation Channel access scheme for use in network communications
US6507587B1 (en) 1998-10-09 2003-01-14 Microsoft Corporation Method of specifying the amount of bandwidth to reserve for use in network communications
US6434195B1 (en) * 1998-11-20 2002-08-13 General Instrument Corporaiton Splicing of video data in progressively refreshed video streams
US6434197B1 (en) 1999-01-07 2002-08-13 General Instrument Corporation Multi-functional transcoder for compressed bit streams
KR100571307B1 (en) * 1999-02-09 2006-04-17 소니 가부시끼 가이샤 Coding system and its method, coding device and its method, decoding device and its method, recording device and its method, and reproducing device and its method
FR2790899B1 (en) * 1999-03-09 2001-04-20 Thomson Broadcast Systems DEVICE AND METHOD FOR REGULATING THROUGHPUT IN A SYSTEM FOR STATISTICAL MULTIPLEXING OF STREAMS OF IMAGES CODED ACCORDING TO MPEG 2 CODING
US6490250B1 (en) * 1999-03-09 2002-12-03 Conexant Systems, Inc. Elementary stream multiplexer
JP2000261459A (en) * 1999-03-10 2000-09-22 Nec Corp Statistical multiplex transmission system
FI106421B (en) * 1999-03-11 2001-01-31 Nokia Multimedia Network Termi Method and arrangement for combining video images
JP2000305822A (en) * 1999-04-26 2000-11-02 Denso Corp Device for database management and device for database extraction, and method for database management and method for database extraction
JP4287538B2 (en) * 1999-04-30 2009-07-01 パナソニック株式会社 Image signal switching method and apparatus, and digital imaging camera and monitoring system using the same
US6754276B1 (en) * 1999-09-20 2004-06-22 Matsushita Electric Industrial Co., Ltd. System stream creating apparatus which adjusts system clock reference based on total number of pictures to be stored and decoded during certain time period
US6577679B1 (en) * 1999-09-30 2003-06-10 Hewlett-Packard Development Company Lp Method and apparatus for transcoding coded picture signals from object-based coding to block-based coding
JP3694888B2 (en) * 1999-12-03 2005-09-14 ソニー株式会社 Decoding device and method, encoding device and method, information processing device and method, and recording medium
US6674796B1 (en) * 2000-02-14 2004-01-06 Harmonic, Inc. Statistical multiplexed video encoding for diverse video formats
JP2001251616A (en) * 2000-03-02 2001-09-14 Media Glue Corp Method and device for converting multiplexed sound/ moving picture compressing-coded signal, and medium recorded with conversion program
JP2003531533A (en) * 2000-04-18 2003-10-21 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Bitrate allocation in joint bitrate transcoding
JP2001308811A (en) * 2000-04-18 2001-11-02 Mitsubishi Electric Corp Device, system and method for encoding and multiplexing media data
US6493388B1 (en) 2000-04-19 2002-12-10 General Instrument Corporation Rate control and buffer protection for variable bit rate video programs over a constant rate channel
US6404814B1 (en) * 2000-04-28 2002-06-11 Hewlett-Packard Company Transcoding method and transcoder for transcoding a predictively-coded object-based picture signal to a predictively-coded block-based picture signal
US6643327B1 (en) * 2000-05-05 2003-11-04 General Instrument Corporation Statistical multiplexer and remultiplexer that accommodates changes in structure of group of pictures
US20060117340A1 (en) * 2000-05-05 2006-06-01 Ictv, Inc. Interactive cable television system without a return path
US6650705B1 (en) * 2000-05-26 2003-11-18 Mitsubishi Electric Research Laboratories Inc. Method for encoding and transcoding multiple video objects with variable temporal resolution
JP2001339460A (en) * 2000-05-26 2001-12-07 Matsushita Electric Ind Co Ltd Digital transmitting and receiving device
JP4724919B2 (en) * 2000-06-02 2011-07-13 ソニー株式会社 Recording apparatus and recording method, reproducing apparatus and reproducing method, and recording medium
US6931059B1 (en) * 2000-07-14 2005-08-16 Tut Systems, Inc. Rate and delivery time multiplexing for bandwidth optimization
JP4441839B2 (en) * 2000-08-17 2010-03-31 ソニー株式会社 Statistical multiplexing system, statistical multiplexing control device, and statistical multiplexing method
US7418007B1 (en) 2000-09-20 2008-08-26 General Instrument Corporation Method and apparatus for determining a transmission bit rate in a statistical multiplexer
US7039115B1 (en) 2000-09-20 2006-05-02 General Instrument Corporation Processor allocation for channels in a video multi-processor system
US6731685B1 (en) * 2000-09-20 2004-05-04 General Instrument Corporation Method and apparatus for determining a bit rate need parameter in a statistical multiplexer
US6904094B1 (en) * 2000-09-20 2005-06-07 General Instrument Corporation Processing mode selection for channels in a video multi-processor system
US6847656B1 (en) 2000-09-25 2005-01-25 General Instrument Corporation Statistical remultiplexing with bandwidth allocation among different transcoding channels
JP4534106B2 (en) * 2000-12-26 2010-09-01 日本電気株式会社 Video encoding system and method
JP2002209215A (en) * 2001-01-09 2002-07-26 Sony Corp Code quantity control device and method, and image information conversion device and method
JP4203707B2 (en) * 2001-01-31 2009-01-07 日本電気株式会社 A moving picture coding apparatus, a moving picture coding method, and a program using the prior analysis.
US7602847B1 (en) 2001-03-27 2009-10-13 Vixs Systems, Inc. Device and method for compression of a video stream
US20070053428A1 (en) * 2001-03-30 2007-03-08 Vixs Systems, Inc. Managed degradation of a video stream
US8107524B2 (en) * 2001-03-30 2012-01-31 Vixs Systems, Inc. Adaptive bandwidth footprint matching for multiple compressed video streams in a fixed bandwidth network
KR100814431B1 (en) * 2001-04-25 2008-03-18 삼성전자주식회사 Apparatus for transmitting broadcast signal, encoding system for encoding broadcast signal adapted variable bit rate and decoding system thereof
US20050076134A1 (en) * 2001-05-17 2005-04-07 Gil Bialik Apparatus and method for multiple rich media formats video broadcasting
US7773670B1 (en) 2001-06-05 2010-08-10 At+T Intellectual Property Ii, L.P. Method of content adaptive video encoding
US6968006B1 (en) 2001-06-05 2005-11-22 At&T Corp. Method of content adaptive video decoding
US6810086B1 (en) 2001-06-05 2004-10-26 At&T Corp. System and method of filtering noise
AU2002312451A1 (en) * 2001-06-11 2002-12-23 Thomson Licensing S.A. Motion compensation for fine-grain scalable video
US6804299B2 (en) * 2001-06-15 2004-10-12 Microsoft Corporation Methods and systems for reducing requantization-originated generational error in predictive video streams using motion compensation
US9894379B2 (en) * 2001-07-10 2018-02-13 The Directv Group, Inc. System and methodology for video compression
US20050187433A1 (en) * 2001-07-26 2005-08-25 Given Imaging Ltd. In-vivo imaging device providing constant bit rate transmission
US9113846B2 (en) * 2001-07-26 2015-08-25 Given Imaging Ltd. In-vivo imaging device providing data compression
US6959348B1 (en) * 2001-07-30 2005-10-25 Vixs Systems, Inc. Method and system for accessing data
US7675972B1 (en) * 2001-07-30 2010-03-09 Vixs Systems, Inc. System and method for multiple channel video transcoding
WO2003017678A1 (en) * 2001-08-15 2003-02-27 Munich University Of Technology Multiplexed mpeg compression
US6925120B2 (en) * 2001-09-24 2005-08-02 Mitsubishi Electric Research Labs, Inc. Transcoder for scalable multi-layer constant quality video bitstreams
FR2830157A1 (en) * 2001-09-25 2003-03-28 Koninkl Philips Electronics Nv Second video image standard decoding from first MPEG standard video image having inverse quantification and truncation/zero adding/discrete inverse stages providing filtered block/decoded digital words.
FR2831742B1 (en) * 2001-10-25 2004-02-27 Cit Alcatel METHOD FOR TRANSMITTING PACKETS VIA A TELECOMMUNICATIONS NETWORK USING THE IP PROTOCOL
US7139330B1 (en) 2001-10-31 2006-11-21 Vixs Systems, Inc. System for signal mixing and method thereof
US7596127B1 (en) 2001-10-31 2009-09-29 Vixs Systems, Inc. System for allocating data in a communications system and method thereof
US7106715B1 (en) 2001-11-16 2006-09-12 Vixs Systems, Inc. System for providing data to multiple devices and method thereof
US7403564B2 (en) * 2001-11-21 2008-07-22 Vixs Systems, Inc. System and method for multiple channel video transcoding
US7356079B2 (en) 2001-11-21 2008-04-08 Vixs Systems Inc. Method and system for rate control during video transcoding
US7165180B1 (en) 2001-11-27 2007-01-16 Vixs Systems, Inc. Monolithic semiconductor device for preventing external access to an encryption key
KR100851251B1 (en) 2002-01-23 2008-08-08 주식회사 엘지이아이 Apparatus and method for controlling of encoding in a moving picture system
FR2835995B1 (en) * 2002-02-11 2004-05-14 Nextream Sa DEVICE AND METHOD FOR RECODING A VIDEO DATA STREAM
US7190723B2 (en) * 2002-03-27 2007-03-13 Scientific-Atlanta, Inc. Digital stream transcoder with a hybrid-rate controller
US7295610B2 (en) * 2002-03-27 2007-11-13 Scientific-Atlanta, Inc. Hybrid rate control in a digital stream transcoder
AU2003231102A1 (en) * 2002-04-26 2003-11-10 Electronics And Telecommunications Research Institute Method and system for optimal video transcoding based on utility function descriptors
US7310679B1 (en) 2002-04-29 2007-12-18 Vixs Systems Inc. Method and system for transmitting video content while preventing other transmissions in a contention-based network
US7120253B2 (en) * 2002-05-02 2006-10-10 Vixs Systems, Inc. Method and system for protecting video data
US7266133B2 (en) * 2002-11-13 2007-09-04 General Instrument Corporation Methods and apparatus for statistical multiplexing with distributed multiplexers
KR101001232B1 (en) * 2002-11-29 2010-12-17 소니 주식회사 Encoder and its method
KR100950525B1 (en) * 2002-12-02 2010-03-30 삼성전자주식회사 Transcoding apparatus and method, target bit allocation, complexity prediction apparatus and method of picture therein
US20040141555A1 (en) * 2003-01-16 2004-07-22 Rault Patrick M. Method of motion vector prediction and system thereof
US7408989B2 (en) * 2003-01-16 2008-08-05 Vix5 Systems Inc Method of video encoding using windows and system thereof
US7606305B1 (en) 2003-02-24 2009-10-20 Vixs Systems, Inc. Method and system for transcoding video data
US7133452B1 (en) 2003-02-24 2006-11-07 Vixs Systems, Inc. Method and system for transcoding video data
US7327784B2 (en) * 2003-02-24 2008-02-05 Vixs Systems, Inc. Method and system for transcoding video data
US7130350B1 (en) 2003-02-28 2006-10-31 Vixs Systems, Inc. Method and system for encoding and decoding data in a video stream
US6993073B2 (en) * 2003-03-26 2006-01-31 James Foong Optimization software module and method for video compression under MPEG
IL155175A (en) * 2003-03-31 2012-01-31 Given Imaging Ltd Diagnostic device using data compression
JP4196726B2 (en) * 2003-05-14 2008-12-17 ソニー株式会社 Image processing apparatus, image processing method, recording medium, and program
US7327786B2 (en) * 2003-06-02 2008-02-05 Lsi Logic Corporation Method for improving rate-distortion performance of a video compression system through parallel coefficient cancellation in the transform
US7739105B2 (en) * 2003-06-13 2010-06-15 Vixs Systems, Inc. System and method for processing audio frames
US7274740B2 (en) * 2003-06-25 2007-09-25 Sharp Laboratories Of America, Inc. Wireless video transmission system
WO2005011255A2 (en) * 2003-06-26 2005-02-03 Thomson Licensing S.A. Multipass video rate control to match sliding window channel constraints
US7342968B2 (en) * 2003-08-13 2008-03-11 Skystream Networks Inc. Method and system for modeling the relationship of the bit rate of a transport stream and the bit rate of an elementary stream carried therein
US7489726B2 (en) * 2003-08-13 2009-02-10 Mitsubishi Electric Research Laboratories, Inc. Resource-constrained sampling of multiple compressed videos
US7693222B2 (en) 2003-08-13 2010-04-06 Ericsson Television Inc. Method and system for re-multiplexing of content-modified MPEG-2 transport streams using PCR interpolation
US7324592B2 (en) * 2003-08-13 2008-01-29 Mitsubishi Electric Research Laboratories, Inc. Resource-constrained encoding of multiple videos
US7274742B2 (en) * 2003-08-13 2007-09-25 Skystream Networks Inc. Model and model update technique in a system for modeling the relationship of the bit rate of a transport stream and the bit rate of an elementary stream carried therein
WO2005020557A2 (en) * 2003-08-13 2005-03-03 Skystream Networks Inc. Method and system for modeling the relationship of the bit of a transport stream and the bit rate of an elementary stream carried therein
JP2005065122A (en) * 2003-08-19 2005-03-10 Matsushita Electric Ind Co Ltd Dynamic image encoding device and its method
US7263126B2 (en) * 2003-09-15 2007-08-28 Sharp Laboratories Of America, Inc. System and method for transcoding with adaptive bit rate control
US7277101B2 (en) 2003-09-29 2007-10-02 Vixs Systems Inc Method and system for scaling images
US7668396B2 (en) * 2003-09-29 2010-02-23 Vixs Systems, Inc. Method and system for noise reduction in an image
US9325998B2 (en) * 2003-09-30 2016-04-26 Sharp Laboratories Of America, Inc. Wireless video transmission system
US7535959B2 (en) * 2003-10-16 2009-05-19 Nvidia Corporation Apparatus, system, and method for video encoder rate control
US7778326B1 (en) * 2003-12-23 2010-08-17 At&T Intellectual Property Ii, L.P. System and method for dynamically determining multimedia transmission based on communication bandwidth
US7675970B2 (en) * 2004-01-12 2010-03-09 General Instrument Corporation Method and apparatus for processing a bitstream in a digital video transcoder
US7697608B2 (en) * 2004-02-03 2010-04-13 Sony Corporation Scalable MPEG video/macro block rate control
US7406598B2 (en) * 2004-02-17 2008-07-29 Vixs Systems Inc. Method and system for secure content distribution
US8018850B2 (en) * 2004-02-23 2011-09-13 Sharp Laboratories Of America, Inc. Wireless video transmission system
US20050207501A1 (en) * 2004-03-18 2005-09-22 Sony Corporation Method of and system for video bit allocation for scene cuts and scene changes
US8731054B2 (en) * 2004-05-04 2014-05-20 Qualcomm Incorporated Method and apparatus for weighted prediction in predictive frames
US7649937B2 (en) * 2004-06-22 2010-01-19 Auction Management Solutions, Inc. Real-time and bandwidth efficient capture and delivery of live video to multiple destinations
US7526001B2 (en) * 2004-07-26 2009-04-28 General Instrument Corporation Statistical multiplexer having protective features from extraneous messages generated by redundant system elements
US7797723B2 (en) * 2004-10-30 2010-09-14 Sharp Laboratories Of America, Inc. Packet scheduling for video transmission with sender queue control
US8356327B2 (en) * 2004-10-30 2013-01-15 Sharp Laboratories Of America, Inc. Wireless video transmission system
US7784076B2 (en) * 2004-10-30 2010-08-24 Sharp Laboratories Of America, Inc. Sender-side bandwidth estimation for video transmission with receiver packet buffer
EP1829027A1 (en) * 2004-12-15 2007-09-05 Telefonaktiebolaget LM Ericsson (publ) Method and device for encoding mode changing of encoded data streams
GB0428155D0 (en) * 2004-12-22 2005-01-26 British Telecomm Buffer underflow prevention
US20060159171A1 (en) * 2005-01-18 2006-07-20 Nader Mohsenian Buffer-adaptive video content classification
US7421048B2 (en) * 2005-01-20 2008-09-02 Vixs Systems, Inc. System and method for multimedia delivery in a wireless environment
US7609766B2 (en) * 2005-02-08 2009-10-27 Vixs Systems, Inc. System of intra-picture complexity preprocessing
WO2006096612A2 (en) 2005-03-04 2006-09-14 The Trustees Of Columbia University In The City Of New York System and method for motion estimation and mode decision for low-complexity h.264 decoder
JP2008533853A (en) * 2005-03-10 2008-08-21 クゥアルコム・インコーポレイテッド Quasi-constant quality rate control with look-ahead
US8949920B2 (en) * 2005-03-17 2015-02-03 Vixs Systems Inc. System and method for storage device emulation in a multimedia processing system
US7400869B2 (en) * 2005-03-22 2008-07-15 Vixs Systems Inc. System and method for adaptive DC offset compensation in wireless transmissions
US7944968B2 (en) * 2005-04-12 2011-05-17 Lsi Corporation Method for specification of quantized coefficient limit
US7974341B2 (en) * 2005-05-03 2011-07-05 Qualcomm, Incorporated Rate control for multi-layer video design
WO2006127510A2 (en) * 2005-05-21 2006-11-30 Kula Media Group Media distribution over a network
US8074248B2 (en) 2005-07-26 2011-12-06 Activevideo Networks, Inc. System and method for providing video content associated with a source image to a television in a communication network
US7873102B2 (en) * 2005-07-27 2011-01-18 At&T Intellectual Property I, Lp Video quality testing by encoding aggregated clips
CA2616266A1 (en) 2005-09-07 2007-07-05 Vidyo, Inc. System and method for a high reliability base layer trunk
US20070067480A1 (en) * 2005-09-19 2007-03-22 Sharp Laboratories Of America, Inc. Adaptive media playout by server media processing for robust streaming
US7707485B2 (en) 2005-09-28 2010-04-27 Vixs Systems, Inc. System and method for dynamic transrating based on content
US20070112826A1 (en) * 2005-11-10 2007-05-17 Vixs Systems, Inc. Multimedia transcoding based on remaining storage capacity
US7839948B2 (en) * 2005-12-02 2010-11-23 Qualcomm Incorporated Time slicing techniques for variable data rate encoding
JP2009518981A (en) 2005-12-08 2009-05-07 ヴィドヨ,インコーポレーテッド System and method for error resilience and random access in video communication systems
US8436889B2 (en) * 2005-12-22 2013-05-07 Vidyo, Inc. System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers
EP1985116A4 (en) * 2005-12-22 2013-06-05 Vidyo Inc System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers
US9544602B2 (en) * 2005-12-30 2017-01-10 Sharp Laboratories Of America, Inc. Wireless video transmission system
KR101276847B1 (en) 2006-01-12 2013-06-18 엘지전자 주식회사 Processing multiview video
JP5192393B2 (en) 2006-01-12 2013-05-08 エルジー エレクトロニクス インコーポレイティド Multi-view video processing
US8131995B2 (en) * 2006-01-24 2012-03-06 Vixs Systems, Inc. Processing feature revocation and reinvocation
US20070177519A1 (en) * 2006-01-30 2007-08-02 Thomsen Jan H Systems and methods for transcoding bit streams
US8068541B2 (en) * 2006-01-30 2011-11-29 Jan Harding Thomsen Systems and methods for transcoding bit streams
JP4795223B2 (en) * 2006-01-31 2011-10-19 キヤノン株式会社 Image processing device
US8693538B2 (en) 2006-03-03 2014-04-08 Vidyo, Inc. System and method for providing error resilience, random access and rate control in scalable video communications
US7652994B2 (en) * 2006-03-31 2010-01-26 Sharp Laboratories Of America, Inc. Accelerated media coding for robust low-delay video streaming over time-varying and bandwidth limited channels
EP2052546A4 (en) 2006-07-12 2010-03-03 Lg Electronics Inc A method and apparatus for processing a signal
WO2008042852A2 (en) * 2006-09-29 2008-04-10 Vidyo, Inc. System and method for multipoint conferencing with scalable video coding servers and multicast
US8861597B2 (en) * 2006-09-18 2014-10-14 Sharp Laboratories Of America, Inc. Distributed channel time allocation for video streaming over wireless networks
US7885189B2 (en) * 2006-09-20 2011-02-08 Rgb Networks, Inc. Methods and apparatus for rate estimation and predictive rate control
US7652993B2 (en) * 2006-11-03 2010-01-26 Sharp Laboratories Of America, Inc. Multi-stream pro-active rate adaptation for robust video transmission
US20090041100A1 (en) 2006-12-13 2009-02-12 Viasat, Inc. Link aware mobile data network
US7843824B2 (en) * 2007-01-08 2010-11-30 General Instrument Corporation Method and apparatus for statistically multiplexing services
EP2102988A4 (en) 2007-01-09 2010-08-18 Vidyo Inc Improved systems and methods for error resilience in video communication systems
US9826197B2 (en) 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
EP3145200A1 (en) 2007-01-12 2017-03-22 ActiveVideo Networks, Inc. Mpeg objects and systems and methods for using mpeg objects
US8269897B2 (en) * 2007-01-24 2012-09-18 Analogix Semiconductor, Inc. Method and apparatus for video format conversion
US8861591B2 (en) * 2007-05-11 2014-10-14 Advanced Micro Devices, Inc. Software video encoder with GPU acceleration
US8233527B2 (en) * 2007-05-11 2012-07-31 Advanced Micro Devices, Inc. Software video transcoder with GPU acceleration
US8139582B2 (en) * 2007-05-17 2012-03-20 Samsung Electronics Co., Ltd. Method and apparatus for making transport frame and method and apparatus for processing transport frame
US8401086B1 (en) * 2007-12-21 2013-03-19 Ciena Corporation System and method for increasing responsiveness to requests for streaming media
WO2009126785A2 (en) 2008-04-10 2009-10-15 The Trustees Of Columbia University In The City Of New York Systems and methods for image archaeology
US8421840B2 (en) * 2008-06-09 2013-04-16 Vidyo, Inc. System and method for improved view layout management in scalable video and audio communication systems
JP5648800B2 (en) * 2008-06-26 2015-01-07 日本電気株式会社 High quality content generation system, method and program thereof
CN102326400A (en) * 2008-12-19 2012-01-18 汤姆森特许公司 The method of isochronous stream transmission in comprising the multiplexer of external coprocessor
US8671069B2 (en) 2008-12-22 2014-03-11 The Trustees Of Columbia University, In The City Of New York Rapid image annotation via brain state decoding and visual pattern mining
EP2422469A4 (en) * 2009-04-24 2012-10-31 Delta Vidyo Inc Systems, methods and computer readable media for instant multi-channel video content browsing in digital video distribution systems
CA2766148A1 (en) * 2009-06-24 2011-01-13 Delta Vidyo, Inc. System and method for an active video electronic programming guide
US20100333149A1 (en) * 2009-06-24 2010-12-30 Rgb Networks, Inc. Delivery of pre-statistically multiplexed streams in a vod system
WO2011066105A1 (en) * 2009-11-25 2011-06-03 Delta Vidyo, Inc. Iptv presence and interaction protocol
US20110310955A1 (en) * 2010-06-22 2011-12-22 Lei Zhang Method and system for repetition based adaptive video compression
US8630412B2 (en) 2010-08-25 2014-01-14 Motorola Mobility Llc Transport of partially encrypted media
US9167256B2 (en) * 2010-08-31 2015-10-20 Arris Technology, Inc. Method and apparatus for encoding
KR20130138263A (en) 2010-10-14 2013-12-18 액티브비디오 네트웍스, 인코포레이티드 Streaming digital video between video devices using a cable television system
US8934530B2 (en) 2011-02-01 2015-01-13 Vidyo, Inc. Spatial scalability using redundant pictures and slice groups
EP2695388B1 (en) 2011-04-07 2017-06-07 ActiveVideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US10412424B2 (en) 2011-10-19 2019-09-10 Harmonic, Inc. Multi-channel variable bit-rate video compression
US10409445B2 (en) 2012-01-09 2019-09-10 Activevideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US8325821B1 (en) * 2012-02-08 2012-12-04 Vyumix, Inc. Video transcoder stream multiplexing systems and methods
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US9106921B2 (en) * 2012-04-24 2015-08-11 Vixs Systems, Inc Configurable transcoder and methods for use therewith
WO2014145921A1 (en) 2013-03-15 2014-09-18 Activevideo Networks, Inc. A multiple-mode system and method for providing user selectable video content
US9326047B2 (en) 2013-06-06 2016-04-26 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
US10417447B2 (en) * 2015-06-15 2019-09-17 Arris Enterprises Llc Selective display of private user information
US10225211B2 (en) 2017-07-20 2019-03-05 Arris Enterprises Llc Statistical multiplexer with service priority weighting
US10951859B2 (en) 2018-05-30 2021-03-16 Microsoft Technology Licensing, Llc Videoconferencing device and method
CN110753242B (en) * 2019-11-01 2021-10-12 深圳市梦网视讯有限公司 Method and system for adjusting quantization parameters of transcoding slice source frame layer

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5216503A (en) * 1991-12-24 1993-06-01 General Instrument Corporation Statistical multiplexer for a multichannel image compression system
US5506844A (en) * 1994-05-20 1996-04-09 Compression Labs, Inc. Method for configuring a statistical multiplexer to dynamically allocate communication channel bandwidth
US5617142A (en) * 1994-11-08 1997-04-01 General Instrument Corporation Of Delaware Method and apparatus for changing the compression level of a compressed digital signal
EP0756800B1 (en) * 1995-02-22 2000-05-10 Koninklijke Philips Electronics N.V. System for transmitting a plurality of video programs simultaneously through a transmission channel
GB9517130D0 (en) * 1995-08-22 1995-10-25 Nat Transcommunications Ltd Statistical multiplexing
US5963256A (en) * 1996-01-11 1999-10-05 Sony Corporation Coding according to degree of coding difficulty in conformity with a target bit rate
GB9611511D0 (en) * 1996-06-03 1996-08-07 Digi Media Vision Ltd Improvements in or relating to the bit-rate of a signal
US6038256A (en) * 1996-12-31 2000-03-14 C-Cube Microsystems Inc. Statistical multiplexed video encoding using pre-encoding a priori statistics and a priori and a posteriori statistics

Also Published As

Publication number Publication date
JP2003517743A (en) 2003-05-27
AR020218A1 (en) 2002-05-02
AU5122399A (en) 2000-03-21
TW454422B (en) 2001-09-11
CN1315118A (en) 2001-09-26
WO2000013419A2 (en) 2000-03-09
BR9913202A (en) 2002-09-24
KR20010073001A (en) 2001-07-31
EP1108330A2 (en) 2001-06-20
US6167084A (en) 2000-12-26
WO2000013419A3 (en) 2000-06-15

Similar Documents

Publication Publication Date Title
US6167084A (en) Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals
CA2407682C (en) Statistical multiplexer and remultiplexer that accommodates changes in structure of group of pictures
KR100329892B1 (en) Control strategy for dynamically encoding multiple streams of video data in parallel for multiplexing onto a constant bit rate channel
US6038256A (en) Statistical multiplexed video encoding using pre-encoding a priori statistics and a priori and a posteriori statistics
US6192154B1 (en) Two-pass encoding method of digital motion video sequences for constant-or variable bit rate
EP0893027B1 (en) Compressed-video distribution system having a statistical multiplexer with transcoders
US8437389B2 (en) Statistical remultiplexing of compressed video segments
CA2406251A1 (en) Rate control and buffer protection for variable bit rate video programs over a constant rate channel
US7266133B2 (en) Methods and apparatus for statistical multiplexing with distributed multiplexers
EP1217841A2 (en) Bitstream separating and merging system, apparatus, method and computer program product
Wang et al. Bit allocation and constraints for joint coding of multiple video programs
EP1430727A1 (en) Method for generating a scalable encoded video bitstream with a constant quality
EP1320997A2 (en) Statistical remultiplexing with bandwidth allocation among different transcoding channels
US20100150168A1 (en) Method and apparatus for multiplexing of digital video
KR20020077074A (en) Method and device for controlling the quality of video data
Chen Transporting compressed digital video
Nunes et al. Rate control for scenes with multiple arbitrarily shaped video objects
Nunes et al. Object-based rate control for the MPEG-4 visual simple profile
MXPA01001945A (en) Dynamic bit allocation for statistical multiplexing of compressed and uncompressed digital video signals
Aliabad et al. No-reference H. 264/AVC statistical multiplexing for DVB-RCS
Drury et al. Picture quality and multiplex management in digital video broadcasting systems
Teixeira et al. Dynamic bandwidth allocation for an MPEG-2 multiencoder video system
Haskell et al. MPEG-2 Video Coding and Compression

Legal Events

Date Code Title Description
FZDE Discontinued
FZDE Discontinued

Effective date: 20050722