CN1973546B - Reduced resolution update mode for advanced video coding - Google Patents

Reduced resolution update mode for advanced video coding Download PDF

Info

Publication number
CN1973546B
CN1973546B CN2005800140222A CN200580014022A CN1973546B CN 1973546 B CN1973546 B CN 1973546B CN 2005800140222 A CN2005800140222 A CN 2005800140222A CN 200580014022 A CN200580014022 A CN 200580014022A CN 1973546 B CN1973546 B CN 1973546B
Authority
CN
China
Prior art keywords
prediction residual
prediction
sampling
image slices
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2005800140222A
Other languages
Chinese (zh)
Other versions
CN1973546A (en
Inventor
A·图拉皮斯
J·M·博伊斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Research Funding Corp
Original Assignee
Thomson Research Funding Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Research Funding Corp filed Critical Thomson Research Funding Corp
Publication of CN1973546A publication Critical patent/CN1973546A/en
Application granted granted Critical
Publication of CN1973546B publication Critical patent/CN1973546B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/16—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter for a given display mode, e.g. for interlaced or progressive display mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Abstract

There is provided a video encoder, video decoder and corresponding encoding and decoding methods for respectively encoding and decoding video signal data for an image slice. The video encoder includes a slice prediction residual downsampler (645) for downsampling a prediction residual of at least a portion of the image slice prior to transformation and quantization of the prediction residual. The video decoder includes a prediction residual upsampler (715) for upsampling a prediction residual of the image slice.

Description

The reduction resolution update mode that is used for advanced video coding
Government license rights in the research and development that federal government's one-level is subsidized
In the present invention, U.S. government has the permission of received payment, and the requirement title to patent that has the right under limited situation is with rational clause, as the clause that the item id contract No.2003005676B that issues in national standard and technical research institute is provided, issues other people's licence.
The cross reference of related application
Please require U.S. Provisional Application No.60/551 that on March 9th, 2004 submitted to, that be entitled as " the reduction resolution that is used for advanced video coding cut into slices more new model (REDUCED RESOLUTION SLICE UPDATEMODE FOR ADVANCED VIDEO CODING) " in this, the rights and interests of 417 (attorney docket No.PU040073), its content all is combined in herein by reference.
Technical field
The present invention relates generally to video encoder and decoder, more particularly, relate to the reduction resolution that the is used for advanced video coding more new model of cutting into slices.
Background technology
The committee of international telecommunication union telecommunication (ITU-T) H.264 (or joint video team (JVT) or Motion Picture Experts Group (MPEG)-4 advanced video coding (AVC)) standard has introduced several new features, with older standard such as MPEG-2/4 with H.263 compare, it has obtained sizable improvement aspect code efficiency.But though H.264 comprised most of algorithm characteristics of old standard, some feature is abandoned and/or has not been re-used.One of these features are exactly the consideration of already present reduction resolution update mode in H.263.This pattern provides increases the chance that coded picture speed is kept enough subjective qualities simultaneously.This is by use high-resolution to accomplish that with reference to carrying out prediction it also allows to rebuild final image with full resolution with the resolution encoding image that reduces.Find this pattern in H.263 of great use, when particularly in sequence, strenuous exercise being arranged,, and also keep high resolution and quality at stagnant zone simultaneously because its allows encoder to keep high frame rate (therefore improved temporal resolution is arranged).
Though with the grammer of the bit stream of this pattern-coding and basic identical with the full resolution bitstream encoded, the main distinction is how to explain all patterns in the bit stream, and after motion compensation, how considers and add residual information.More particularly, compare with the picture of full resolution coding, the image of this pattern has the macro block of 1/4 quantity, and motion vector data is associated with the piece size 32 * 32 and 16 * 16 rather than 16 * 16 and 8 * 8 of full resolution picture respectively.On the other hand, discrete cosine transform (DCT) and data texturing are associated with 8 * 8 that reduce image in different resolution, and present in order to produce final full images, require oriented up-sampling process.
Though this process may cause the decline of objective quality, this needs the bit minimizing of coding to be compensated from the minimizing quantity (4) because of pattern, exercise data and residual error incessantly.This is particular importance when unusual low bit rate, and this moment, pattern and exercise data may be more much more than residual error.Compare with objective quality, subjective quality is impaired also much smaller.And this process can be regarded as to a certain extent and is similar to before the coding application of low-pass filters on residual error data, but it requires the residual error of transmission all patterns, exercise data and filtering, so efficient is lower.During H.264 this conception of species never is incorporated into, so be not supported aspect notion, methodology or the grammer.
Summary of the invention
The invention solves these and other shortcoming of prior art and unfavorable, the present invention is directed to exploitation and support a kind of reduction resolution that is used for advanced video coding more new model of cutting into slices.Reduction resolution disclosed herein cuts into slices more that new model is specially adapted to, but is not limited to, H.264 (or JVT, or MPEG-4AVC).
According to one aspect of the present invention, provide a kind of video encoder that is used for the video signal data of coded image section.Video encoder comprises the cut prediction residual error to down-sampler, is used for before the transform and quantization prediction residual to the down-sampling prediction residual of parts of images section at least.
According to another aspect of the present invention, provide a kind of video encoder that is used for the video signal data of coded image.This video encoder comprises that macro block ordering parts and cut prediction residual error are to down-sampler.Macro block ordering parts are used for the macro block corresponding to image is arranged in two or more section groups.The cut prediction residual error was used for before the transform and quantization prediction residual to down-sampler, to the down-sampling prediction residual of parts of images section at least.The cut prediction residual error also is used for receiving at least one group of described two or more section groups to down-sampler and carries out to down-sampling.
According to another aspect of the present invention, provide a kind of Video Decoder that is used for the video signal data of decoded picture section.This Video Decoder comprises: the prediction residual upsampler is used for the upwards prediction residual of sampled images section; And adder, be used for the prediction residual to up-sampling is added to the reference of prediction.
Provide a kind of method that is used for the video signal data of coded image section more on the one hand according to of the present invention, this method is included in before the transform and quantization prediction residual step to the prediction residual of down-sampled images section.
According to another aspect of the present invention, provide a kind of method that is used for the video signal data of decoded picture section.This method comprises the steps: the upwards prediction residual of sampled images section, and it is last to be added to the reference of prediction to the prediction residual of up-sampling.
These and other aspect of the present invention, feature and advantage can come into plain view from the following detailed description to example embodiment, and this explanation should be read in conjunction with the accompanying drawings.
Description of drawings
Can understand the present invention better according to following exemplary drawings, accompanying drawing comprises:
Fig. 1 illustrates demonstration macro block and the sub-macroblock partition figure that is used for reduction resolution update (RRU) pattern H.264 according to the principle of the invention;
Fig. 2 illustrates the demonstration sample graph that is used for 8 * 8 infra-frame predictions according to the principle of the invention;
Fig. 3 A and 3B illustrate the make progress diagram of sampling process of the demonstration residual error that is respectively applied for block boundary and is used for interior location according to the principle of the invention;
Fig. 4 A and 4B illustrate as direct_8 * 8_inference_flag and are made as 0 and when being made as 1 respectively, are used for the motion succession figure of Direct Model under for the situation that reduces the resolution and first tabulation 1 and be referenced as full resolution at current slice;
Fig. 5 illustrates the resolution extension figure that is used for 1/4th CLV Common Intermediate Formats (QCIF) resolution picture according to the principle of the invention;
Fig. 6 illustrates the block diagram according to the demonstration video encoder of the principle of the invention;
Fig. 7 illustrates the block diagram according to the demonstration Video Decoder of the principle of the invention;
Fig. 8 illustrates the flow chart according to the demonstration cataloged procedure of the principle of the invention; And
Fig. 9 illustrates the flow chart according to the demonstration decode procedure of the principle of the invention.
Embodiment
The present invention is directed to the reduction resolution that the is used for advanced video coding more new model of cutting into slices.The present invention utilizes at present the notion of reduction resolution update (RRU) pattern supported of standard H.263 by ITU-T, and allows the RRU pattern to be introduced and be used for H.264 (MPEG-4AVC/JVT) video encoding standard of new ITU-T.This pattern provides the chance that not only increases coded picture speed but also keep enough subjective qualities.This is by use high-resolution to accomplish with reference to carrying out prediction with the resolution encoding image that reduces.It allows to rebuild final image with full resolution, and has good quality, though the required bit rate of coded image significantly reduces.Consider and H.264 do not support RRU pattern, the present invention to use several new instrument and notions to realize its RRU with uniqueness.For example, when exploitation was used for H.264 RRU, this notion must be changed, and made it to be fit to the standard of new standard and/or its expansion.This comprises new syntactic element, and (intra) predictive mode in interframe (inter) and the frame is done some change semantic and encoder/decoder architecture.H.264 other tools/features that standard is supported for example based on the influence of the adaptive field/frame pattern of macro block, also will be illustrated and solve in this article.
Below back to back explanation show principle of the present invention.Therefore though being appreciated that those skilled in the art can design does not offer some clarification in this article or illustrates but can implement principle of the present invention and be included in various configurations within its spirit and scope.
All examples and the conditional statement quoted from are intended to teaching purpose herein, with the notion that helps reader understanding's principle of the present invention and the artificial development of invention this area to be contributed, and should be interpreted as being not limited to example and the condition that institute specifically quotes from.
In addition, quote all statements of the principle of the invention, aspect and embodiment herein, with and instantiation, all should comprise the two equivalent of its structure and notion.In addition, these equivalents should comprise at present known equivalent and at the equivalent of developing in the future, that is, can realize any element of being developed of said function, regardless of its structure.
Therefore, for example, those skilled in the art will appreciate that the block diagram representative shown in this paper can be implemented the conceptual view of the illustrative circuit of the principle of the invention.Equally, should be understood that any flow table, flow chart, state transition graph, false code or the like all represent various processes, they can be expressed in computer-readable medium basically, and therefore carry out by computer or processor, no matter whether this computer or processor clearly illustrate.
The function of various elements shown in the accompanying drawing can be by using specialized hardware and can the hardware of executive software provides with suitable software context.When being provided by processor, these functions can be provided by single application specific processor, single shared processing device or a plurality of separate processor (some of them can be shared).In addition, clearly use term " processor " or " controller " to should not be construed as the hardware that special finger can executive software, can imply but be not limited to: digital signal processor (DSP) hardware, be used for read-only memory (ROM), random-access memory (ram) and the nonvolatile memory of storing software.
Other hardware, conventional and/or customization, also can be included.Equally, any switch shown in the accompanying drawing only is conceptual.Their function can be by programmed logic operation, by special logic, by the mutual of program control and special logic or even manually realize, can from context, more specifically be understood by the selectable particular technology of realization person.
In claims of the present invention, the any element that is expressed as the parts that are used to carry out appointed function should comprise any approach of carrying out this function, for example comprise the circuit element combination of a) carrying out this function, or b) any type of software, so comprise firmware, microcode or the like, with the proper circuit combination that is used to carry out this software, to carry out this function.Defined the present invention belongs to the following fact by these claims: all made up in the desired mode of claims and linked together by the function that various described parts provided.Therefore the applicant can provide any parts of these functions to think the equivalent of those parts shown in this paper.
Advantageously, the invention provides a kind of being used in the equipment and the method that H.264 realize reducing resolution update (RRU) pattern.Need are considered some aspect of the codec of relevant this new model.Specifically, need an exploitation new slicing parameter (reduced_resolution_update),, current slice is further divided into the macro block of (RRUwidth*16) * (RRUheight*16) size according to this parameter.H.263 different in is that RRUwidth needn't equal RRUheight.Can comprise additional slicing parameter, more particularly, rru_width_scale=RRUwidth and rru_height_scale=RRUheight, it allows with any required ratio level or vertically reduces resolution.Table 2 shows the H.264 section heading syntax of having considered reduction resolution update (RRU) according to the principle of the invention.
Possible option for example comprises: by 1 level calibration vertical with 2 (macro block (MB) is of a size of 16 * 32), 2 vertical and 1 levels (MB size 32 * 16) or have the MB of size (rru_width_scale*16) * (rru_height_scale*16) usually.
In order not lose generality, RRUwidth=RRUheight=2 and macroblock size are 32 * 32 in the situation about being discussed.In this case, all macroblock partition must be by the vertical calibration with 2 of 2 levels with child partition.Fig. 1 illustrate according to the principle of the invention be used for H.264 reduction resolution update (RRU) pattern demonstration macroblock partition 100 and the diagram of sub-macroblock partition 150.H.263 different is, motion vector data must be divided by 2 with the conformance with standard standard in H.263, and needn't do like this in H.264, and motion vector data can be used full resolution/sub-pixel (subpel) accuracy coding.The macro block of being skipped in P section in this pattern is considered to have 32 * 32 size, and the process that is used to calculate the exercise data of their associations remains unchanged, though need to consider 32 * 32 neighbours now, rather than 16 * 16 neighbours.
Another key difference of the present invention is, though be that optionally data texturing needn't be represented the information from lower resolution image in H.264.Because in-line coding in H.264 is by considering space predicting method, use 4 * 4 or 16 * 16 piece size to carry out, so this can expand to 8 * 8 and 32 * 32 intra-frame prediction block sizes, is similar to inter-frame forecast mode.But, predictive mode still more or less is identical, though will produce prediction signal with more sampling now.Fig. 2 shows the diagram that is used for the demonstration sampling 200 of 8 * 8 infra-frame predictions according to the principle of the invention.Sampling 200 comprises sampling C0-C15, X and R0-R7.For example, for 8 * 8 vertical prediction, existing use sampling C0-C7, and the DC prediction is the average of C0-C7 and R0-R7.And all diagonal predictions also need to consider sampling C8-C15.Similarly expansion can be applicable to 32 * 32 intra prediction modes.
Then residual error data is carried out to down-sampling, and use available identical transform and quantization process in is H.264 encoded.Same process is applied to brightness and chroma samples.During decoding, residual error data needs quilt to up-sampling.Sampling process is only carried out in encoder downwards, and does not therefore need standardization.Upwards sampling process must be mated in encoder, so must standardization.Operable may including but not limited to top sampling method: zeroth order or single order keep, or by the strategy in considering to be similar to H.263.Fig. 3 A and 3B illustrate the make progress diagram of sampling process 300 and 350 of the demonstration residual error that is respectively applied for block boundary and interior location according to the principle of the invention.In Fig. 3 A, the upwards sampling process on the block edge only uses the sampling in the block boundary to calculate upwards sampled value.In Fig. 3 B, within piece inside, all the most contiguous positions are all available, so use the interpolation based on the relative positioning of sampling, for example the bilinear interpolation on two dimension calculates upwards sampled value.
H.264 also consider de-blocking filter in the ring, be added to 4 * 4 block edges.Because at present this forecasting process is applied to 8 * 8 and above piece size, so this process also is modified, to consider 8 * 8 block edges.But should be understood that content of the present invention provided herein, various equivalent modifications can be according to the principle of the invention, when keeping spirit of the present invention, considers to be used for these and other size of the block boundary that adopted.
Difference section in the same picture can have different value reduced_resolution_update, rru_width_scale and rru_height_scale. is added on the slice boundaries owing to encircling interior de-blocking filter, therefore the piece of each side of slice boundaries may be encoded with different resolution. in this case, for the de-blocking filter calculation of parameter, should consider following situation: maximum quantization parameter (QP) value between two adjacent 4 * 4 normal blocks on given 8 * 8 edges, go bulk strength now based on the sum of the nonzero coefficient of two pieces simultaneously.
In order to support flexible macro-block ordering (FMO), concentrate num_slice_groups_minus1 greater than shown in 0 as frame parameter, with reducing resolution update mode, also be necessary the additional parameter of a reduced_resolution_ update_enable by name of transmission in parameter sets.Table 1 illustrates the H.264 frame parameter grammer of having considered reduction resolution update (RRU) according to the principle of the invention.If FMO is arranged, and this parameter do not set, and then do not allow to use to reduce the resolution model section of encoding.In addition, if this parameter is set, then parameter rru_max_width_scale and rru_max_height_scale also need be transmitted.Need these parameters to guarantee that the reflection that is provided supports current reduction resolution macroblock size all the time.In other words, these parameters need meet following condition:
max_width_scale％rru_width_scale＝0，
Max_height_scale%rru_height_scale=0, and
max_width_scale＞0，max_height_scale＞0。
The FMO section group reflection that is transmitted is corresponding to the reduction resolution of minimum permission, corresponding to rru_max_width_scale and rru_max_height_scale.Notice that if use a plurality of macro block resolution, then rru_max_width_scale and rru_max_height_scale need be the multiples of the least common multiple of the possible resolution of institute in the same picture.
H.264 the Direct Model in can be affected, and depends on whether current slice is in the reduction resolution model, or tabulates 1 with reference to whether being in the reduction resolution model, and current slice is not in the reduction resolution model.For the Direct Model situation, when current picture is full resolution for reducing resolution and reference picture, when direct_8 * 8_inference_flag is activated, use the similar approach that in H.264, adopts at present.According to this method, distribute the subregion of colocated by the corresponding angles 4 * 4 (angle is based on the piece index) of only considering 8 * 8 subregions.In our situation, reduce the resolution section if directly belong to, the exercise data that then is used for the subregion of colocated just looks like that direct_8 * 8_inference_flag is set as 1 and is derived like that.This also can be regarded as co-located reference sports ground to down-sampling.Though be not necessary, if direct_8 * 8_inference_flag is set in bit stream, then this process useful application is twice.This process can more be clear that in Fig. 4 A and 4B, these two illustrate as direct_8 * 8_inference_flag and are made as 0 and when being made as 1 respectively, and 400 diagram is inherited in the motion that is used for Direct Model under for the situation that reduces the resolution and first tabulation 1 and be referenced as full resolution at current slice.For current slice be not in reduce resolution model but its first tabulation 1 with reference to being in the situation that reduces resolution model, then need at first all exercise datas to this reduction resolution reference of up-sampling.Can use zeroth order to keep carrying out to the up-sampling exercise data, this is the method for complexity minimum.Other filtering method for example is similar to and is used for the process of residual error data to up-sampling, also can use.
By considering this pattern, other instrument of H.264 some also is affected.More particularly, macroblock adaptive frame/field frame pattern (MB-AFF) is existing needs consideration to use 32 * 64 supermacro block structures.On each encoding block residual error, carry out upwards sampling process.If a picture is encoded, then is a residual error, and therefore in the field, finishes to up-sampling with block encoding.Equally, when using MB-AFF, each piece is with field or frame pattern coding, and their corresponding residual errors are on the scene respectively or frame pattern is carried out to up-sampling.
All work for all possible resolution in order to allow to reduce resolution model, picture is always respectively by vertical and horizontal extension, so that can be eliminated by 16*rru_height_scale and 16*rru_width_scale. for the example of rru_height_scale=rru_width_scale=2, the original resolution of image is HR * VR, image is filled into resolution and equals Hc * Vc, wherein:
H C＝((H R+31)/32)＊32
V C＝((V R+31)/32)＊32
The process that is used for expanded images resolution is similar to H.264 picture dimension to be expanded at present to be eliminated by 16 and is done.Fig. 5 shows the diagram that is used for the resolution extension of 1/4th CLV Common Intermediate Formats (QCIF) resolution picture 500 according to the principle of the invention.
The expansion brightness that is used for the QCIF resolution picture is provided by following formula:
R RRU(X，y)＝R(x′，y′)，
In the formula:
X, the space coordinates of the reference picture of expanding in the y=pixel domain,
X ', the space coordinates of reference picture in y '=pixel domain,
R RRU(x, y)=(x y) locates the pixel value of the reference picture expanded,
R (x ', y ')=locate the pixel value of reference picture at (x ', y '),
If x '=175 are x＞175 and x＜192
=x otherwise
If y '=143 are y＞143 and y＜160
=y otherwise
Similar approach is used to expand chroma samples, but expands to this size half.
Turn to Fig. 6, the demonstration video encoder totally illustrates with Ref. No. 600.The video inputs of encoder 600 is connected with the input of macro block sorting unit 602 in signal communication.The output of macro block sorting unit 602 is connected with the first input end of exercise estimator 605 and the first input end (noninverting) of first adder 610 in signal communication.Second input of exercise estimator 605 is connected with the output of picture reference memory 615 in signal communication.The output of exercise estimator 605 is connected with the first input end of motion compensator 620 in signal communication.Second input of motion compensator 620 is connected with the output of picture reference memory 615 in signal communication.The output of motion compensator is connected with second input (anti-phase) of first adder 610, the first input end (noninverting) of second adder 625 and the first input end of variable length coder (VLC) 695 in signal communication.The output of second adder 625 is connected with the first input end of optional time processor 630 in signal communication.Optionally second input of time processor 630 is connected with another output of picture reference memory 615 in signal communication.Optionally the output of time processor 630 is connected with the input of loop filter 635 in signal communication.The output of loop filter 635 is connected with the input of picture reference memory 615 in signal communication.
610640.640645650.645650.650655.655695660.660665.665670.670625675.625.695600.； Are connected with second switch in signal communication respectively when first switch 640 and are connected with upsampler when being connected with down sample device 645; Formed from the output of first adder 610 to motion compensator 620 the 3rd input and to the signal path of the input of upsampler 675. should be understood that first switch 640 can comprise for the RRU mode decision parts of determining the RRU pattern. macro block sorting unit 602 is arranged in the section group with the macro block of Given Graph picture.
Turn to Fig. 7, the demonstration Video Decoder is totally with Ref. No. 700 expressions.The first input end of decoder 700 is connected with the input of inverted converter/quantizer 710 in signal communication.The output of inverted converter/quantizer 710 is connected with the input of upsampler 715 in signal communication.The output of upsampler 715 is connected with the first input end of adder 720 in signal communication.The output of adder 720 is connected with optional space-time processor 725 in signal communication.The output of space-time processor is connected with the output of decoder 700 in signal communication.If do not adopt space-time processor 725, the output of decoder 700 is come out from the output of adder 720.
Second input of decoder 700 is connected with the first input end of motion compensator 730 in signal communication.The output of motion compensator 730 is connected with second input of adder 720 in signal communication.Adder 720 is used to make up to the prediction residual of up-sampling and the reference of prediction.Second input of motion compensator 730 is connected with first output of reference buffer 735 in signal communication.Second output of reference buffer 735 is connected with space-time processor 725 in signal communication.The input of reference buffer 735 is decoder output.Inverted converter/quantizer 710 input residual error bit streams, and the residual error of output decoder.Reference buffer 735 output reference pictures, and motion compensator 730 output movement compensation prediction.
Decoder implementation shown in Figure 7 can be by using additional treatment element, the for example space-time analysis in encoder, expanded and improved, this with regard to allow we remove some by residual error to down-sampling and the human error introduced of sampling process upwards.
A kind of remodeling of said method is to allow not only to use in slice-level but also in macro-block level to reduce resolution.Though this method can have different remodeling, a kind of method is by using the reference picture indicating device to signal resolution changing.Reference picture can or reduce the transmission implicit expression (for example strange/the idol reference) of resolution residual error or show that ground (for example by the transmission table in the slicing parameter) is associated with full resolution.Reduce residual coding if one 32 * 32 macro block is to use, then single coded block pattern (cbp) is associated with the conversion coefficients of 16 reduction resolution pieces, and be transmitted.Otherwise 4 cbp (or single combination cbp) need be transmitted, and it is associated with 64 full resolution pieces.Notice, work that all pieces in this macro block need to be encoded with same resolution for making this method.This method requires add list of transmission, it can provide relevant calibration or be not the information of current reference, comprise the calibration parameter, be similar to and do at weight estimation at present.
Turn to Fig. 8, the demonstration video coding process is totally with Ref. No. 800 expressions.Process 800 comprises beginning frame 805, and it passes control to loop limit block 810.Circulation of loop limit block 810 beginnings for current block in the image, and pass control to functional block 815.Functional block 815 forms the motion compensated prediction of current block, and passes control to functional block 820.Functional block 820 deducts motion compensated prediction from current macro, with the formation prediction residual, and pass control to functional block 825.Functional block 825 is to the down-sampling prediction residual, and passes control to functional block 830.Functional block 830 transform and quantizations are to the prediction residual of down-sampling, and pass control to functional block 835.Functional block 835 reciprocal transformations and quantitative prediction residual error with the prediction residual of formation coding, and pass control to functional block 840.Functional block 840 is the prediction residual of sample code upwards, and passes control to functional block 845.Functional block 845 will be added to the coded residual of up-sampling in the prediction, with the picture block of formation coding, and pass control to end loop frame 850.End loop frame 850 finishes this circulation, and passes control to end block 855.
Turn to Fig. 9, the demonstration video decoding process is totally with Ref. No. 900 expressions. and decode procedure 900 comprises beginning frame 905, it passes control to circulation for current block in the image of loop limit block 910. loop limit block, 910 beginnings, and pass control to 915 pairs of coded residual of functional block 915. functional blocks and carry out entropy decoding, and pass control to the residual error of functional block 920. functional blocks, 920 reciprocal transformations and quantization decoder, to form coded residual, and pass control to upwards sample code residual error of functional block 925. functional blocks 925, and pass control to functional block 930. functional blocks 930 and will be added to the coded residual of up-sampling in the prediction, to form the picture block of coding, and pass control to 935 these circulations of end of loop limit block 935. loop limit block, and pass control to end block 940.
For these and other feature and advantage of the present invention, those skilled in the relevant art just are easy to understand fully based on the content of this paper.The content that should be understood that this paper can realize with various forms of hardware, software, firmware, application specific processor or their combination.
More preferably, content of the present invention realizes as the combination of hardware and software.In addition, software preferably is embodied as the application program of implementing conscientiously on the program storage element.Application program can upload on the machine that comprises any applicable system structure, and by its execution.Preferably, this machine realizes that on computer platform this computer platform has such as hardware such as one or more CPU (CPU), random-access memory (ram) and I/O (I/O) interfaces.Computer platform also can comprise operating system and micro-instruction code.Various process as herein described and function can be the parts of micro-instruction code, or the part of application program, or their any combination, can be carried out by CPU.In addition, various other peripheral units can be connected to computer platform, for example Fu Jia data storage element and print unit.
Should also be understood that because some shown in the accompanying drawing are formed system components and method preferably realizes with software, thus actual connections between system component or the process function frame may basis to programming mode of the present invention and different.The described content that this paper has been arranged, those skilled in the relevant art just can find out these and similar implementation or configuration of the present invention.
Though in conjunction with the accompanying drawings illustrative embodiment is described, but should understand, the present invention is not limited to these embodiment, and under the prerequisite that does not deviate from scope of the present invention or spirit, those skilled in the relevant art can carry out various changes and modification in these embodiments.All such changes and modifications should be included within the scope of setting forth in the appended claims of the present invention.
pic_parameter_set_rbsp(){ C Descriptor
pic_parameter_set_id 1 ue(v)
seq_parameter_set_id 1 ue(v)
entropy_coding_mode_flag 1 u(1)
pic_order_present_flag 1 u(1)
num_slice_groups_minus1 1 ue(v)
if(num_slice_groups_minus1＞0){
/ * consideration RRU */
pic_parameter_set_rbsp(){ C Descriptor
reduced_resolution_update_enable 1 u(1)
if(！reduced_resolution_update){
rru_max_width_scale 1 u(v)
rru_max_height_scale 1 u(v)
}
/ * reduction resolution update parameter end */
slice_group_map_type 1 ue(v)
if(slicc_group_map_type＝＝0)
for(iGroup＝0；iGroup＜＝num_slice_groups_minus1；iGroup++)
run_length_minus1[iGroup] 1 ue(v)
else if(slice_group_map_type＝＝2)
for(iGroup＝0；iGroup＜num_slice_groups_minus1；iGroup++){
top_left[iGroup] 1 ue(v)
bottom_right[iGroup] 1 ue(v)
}
else if(slice_group_map_type＝＝3|| slice_group_map_type＝＝4|| slice_group_map_type＝＝5){
slice_group_change_direction_flag 1 u(1)
slice_group_change_rate_minus1 1 ue(v)
}else if(slice_group_map_type＝＝6){
pic_parameter_set_rbsp(){ C Descriptor
pic_size_in_map_units_minus1 1 ue(v)
for(i＝0；i＜＝pic_size_in_map_units_minus1；i++)
slice_group_id[i] 1 u(v)
}
}
num_ref_idx_l0_active_minus1 1 ue(v)
num_ref_idx_l1_active_minus1 1 ue(v)
weighted_pred_flag 1 u(1)
weighted_bipred_idc 1 u(2)
Pic_init_qp_minus26/* with respect to 26*/ 1 se(v)
Pic_init_qs_minus26/* with respect to 26*/ 1 se(v)
chroma_qp_index_offset 1 se(v)
deblocking_filter_control_present_flag 1 u(1)
constrained_intra_pred_flag 1 u(1)
redundant_pic_cnt_present_flag 1 u(1)
rbsp_trailing_bits() 1
}
Table 1
slice_header(){ C Descriptor
first_mb_in_slice
2 ue(v)
slice_header(){ C Descriptor
slice_type
2 ue(v)
pic_parameter_set_id 2 ue(v)
frame_num 2 u(v)
/ * reduction resolution update parameter */
reduced_resolution_update 2 u(1)
Below/the * be optional */
if(！reduced_resolution_update){
rru_width_scale 2 u(v)
rru_height_scale 2 u(v)
}
/ * reduction resolution update parameter end */
if(！frame_mbs_only_flag){
field_pic_flag 2 u(1)
if(field_pic_flag)
bottom_field_flag 2 u(1)
}
if(nal_unit_type＝＝5)
idr_pic_id 2 ue(v)
if(pic_order_cnt_type＝＝0){
pic_order_cnt_lsb 2 u(v)
if(pic_order_present_flag&&！field_pic_flag)
delta_pic_order_cnt_bottom 2 se(v)
slice_header(){ C Descriptor
}
if(pic_order_cnt_type＝＝1&&！delta_pic_order_always_zero_flag){
delta_pic_order_cnt[0] 2 se(v)
if(pic_order_present_flag&&！field_pic_flag)
delta_pic_order_cnt[1] 2 se(v)
}
if(redundant_pic_cnt_present_flag)
redundant_pic_cnt 2 ue(v)
if(slice_type＝＝B)
direct_spatial_mv_pred_flag 2 u(1)
if(slice_type＝＝P||slice_type＝＝SP||slice_type＝＝B){
num_ref_idx_active_override_flag 2 u(1)
if(num_ref_idx_active_override_flag){
num_ref_idx_l0_active_minus1 2 ue(v)
if(slice_type＝＝B)
num_ref_idx_l1_active_minus1 2 ue(v)
}
}
ref_pic_list_reordering() 2
if((weighted_pred_flag&&(slice_type＝＝P||slice_type＝＝SP))|| (weighted_bipred_idc＝＝1&&slicc_type＝＝B))
pred_weight_table() 2
if(nal_ref_idc！＝0)
slice_header(){ C Descriptor
dec_ref_pic_marking() 2
if(entropy_coding_mode_flag&&slice_type！＝I&&slice_type！＝SI)
cabac_init_idc 2 ue(v)
slice_qp_delta 2 se(v)
if(slice_type＝＝SP||slice_type＝＝SI){
if(slice_type＝＝SP)
sp_for_switch_flag 2 u(1)
slice_qs_delta 2 se(v)
}
if(deblocking_filter_control_present_flag){
disable_deblocking_filter_idc 2 ue(v)
if(disable_deblocking_filter_idc！＝1){
slice_alpha_c0_offset_div2 2 se(v)
slice_beta_offset_div2 2 se(v)
}
}
if(num_slice_groups_minus1＞0&& slice_group_map_type＞＝3&&slice_group_map_type＜＝5)
slice_group_change_cycle 2 u(v)
}
Table 2

Claims (23)

1. one kind is used for video encoder (600) that the video signal data of image slices is encoded, comprising:
The cut prediction residual error is suitable for optionally being connected with the input of converter (650) to down-sampler (645), and this cut prediction residual error applies different downsampling operation at the horizontal direction of prediction residual with vertical direction to down-sampler (645):
Quantizer (655) is connected with the output of described converter (650); And
Entropy coder (695) is connected with the output of described quantizer (655),
Wherein said cut prediction residual error was used for before the described prediction residual of transform and quantization to down-sampler (645), to the down-sampling prediction residual of the described image slices of part at least.
2. video encoder as claimed in claim 1, wherein said image slices comprise and meet the H.264 video data of standard of the committee of international telecommunication union telecommunication (ITU-T).
3. video encoder as claimed in claim 1, wherein said image slices is divided into image block, and forms prediction residual after the infra-frame prediction of described image block.
4. video encoder as claimed in claim 3 wherein uses one of 8 * 8 and 32 * 32 predictive modes to carry out described infra-frame prediction.
5. video encoder as claimed in claim 1, wherein said image slices is divided into image block, and forms prediction residual after the inter prediction of described image block.
6. Video Decoder that the video signal data that is used for image slices is decoded, described Video Decoder comprises:
Prediction residual upsampler (715) is used for the prediction residual to the described image slices of up-sampling, and this prediction residual upsampler (715) applies different upwards sampling operations at the horizontal direction of prediction residual with vertical direction; And
Combiner (720) is used to make up to the prediction residual of up-sampling and the reference of prediction.
7. Video Decoder as claimed in claim 6, wherein said image slices comprise and meet the H.264 video data of standard of the committee of international telecommunication union telecommunication (ITU-T).
8. Video Decoder as claimed in claim 6, wherein said image slices is divided into image block, and forms described prediction residual after the infra-frame prediction of described image block.
9. Video Decoder as claimed in claim 8 wherein uses one of 8 * 8 and 32 * 32 predictive modes to carry out described infra-frame prediction.
10. Video Decoder as claimed in claim 6, wherein said image slices is divided into image block, and forms described prediction residual after the inter prediction of described image block.
11. a video signal data that is used for image slices carries out Methods for Coding, said method comprising the steps of:
To the prediction residual of the described image slices of down-sampling, this downward sampling step comprises respectively at the horizontal direction of prediction residual and vertical direction and applies the step of different downsampling operations or only one of the horizontal direction of prediction residual and vertical direction are applied in the step of downsampling operation one;
The described prediction residual of conversion; And
Quantize described prediction residual, wherein said step to down-sampling was carried out before described conversion or quantization step.
12. comprising, method as claimed in claim 11, wherein said image slices meet the H.264 video data of standard of the committee of international telecommunication union telecommunication (ITU-T).
13. method as claimed in claim 11, wherein said image slices is divided into image block, and forms described prediction residual after the infra-frame prediction of described image block.
14. method as claimed in claim 13 wherein uses one of 8 * 8 and 32 * 32 predictive modes to carry out described infra-frame prediction.
15. method as claimed in claim 11, wherein said image slices is divided into image block, and forms described prediction residual after the inter prediction of described image block.
16. method as claimed in claim 15 wherein uses 32 * 32 macro blocks and 32 * 32,32 * 16,16 * 32 and 16 * 16 macroblock partition or 16 * 16,16 * 8,8 * 16 and 8 * 8 sub-macroblock partition to carry out described inter prediction.
17. method as claimed in claim 11, wherein said image slices is divided into macro block, and described method comprises the steps: that also described macro block neatly sorts in response to the concentrated parameter of frame parameter.
18. the method that the video signal data that is used for image slices is decoded said method comprising the steps of:
To the prediction residual of the described image slices of up-sampling (925), upwards sampling step (925) comprises respectively at the horizontal direction of prediction residual and vertical direction and applies the step of different upwards sampling operations or only one of the horizontal direction of prediction residual and vertical direction are applied in the step of sampling operation upwards one; And
Combination (930) is to the prediction residual of up-sampling and the reference of prediction.
19. comprising, method as claimed in claim 18, wherein said image slices meet the H.264 video data of standard of the committee of international telecommunication union telecommunication (ITU-T).
20. method as claimed in claim 18, wherein said image slices is divided into image block, and forms described prediction residual after the infra-frame prediction of described image block.
21. method as claimed in claim 20 wherein uses one of 8 * 8 and 32 * 32 predictive modes to carry out described infra-frame prediction.
22. method as claimed in claim 18, wherein said image slices is divided into image block, and forms described prediction residual after the inter prediction of described image block.
23. method as claimed in claim 22 wherein uses 32 * 32 macro blocks and 32 * 32,32 * 16,16 * 32 and 16 * 16 macroblock partition or 16 * 16,16 * 8,8 * 16 and 8 * 8 sub-macroblock partition to carry out described inter prediction.
CN2005800140222A 2004-03-09 2005-03-01 Reduced resolution update mode for advanced video coding Expired - Fee Related CN1973546B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US55141704P 2004-03-09 2004-03-09
US60/551,417 2004-03-09
PCT/US2005/006453 WO2005093661A2 (en) 2004-03-09 2005-03-01 Reduced resolution update mode for advanced video coding

Publications (2)

Publication Number Publication Date
CN1973546A CN1973546A (en) 2007-05-30
CN1973546B true CN1973546B (en) 2010-05-12

Family

ID=34961541

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2005800140222A Expired - Fee Related CN1973546B (en) 2004-03-09 2005-03-01 Reduced resolution update mode for advanced video coding

Country Status (10)

Country Link
US (1) US20070189392A1 (en)
EP (1) EP1730695A2 (en)
JP (1) JP2007528675A (en)
KR (1) KR20060134976A (en)
CN (1) CN1973546B (en)
AU (1) AU2005226021B2 (en)
BR (1) BRPI0508506A (en)
MY (2) MY142188A (en)
WO (1) WO2005093661A2 (en)
ZA (1) ZA200607434B (en)

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1738588B1 (en) 2004-04-02 2018-08-15 Thomson Licensing DTV Complexity scalable video decoding
US20060129729A1 (en) * 2004-12-10 2006-06-15 Hongjun Yuan Local bus architecture for video codec
US8391368B2 (en) * 2005-04-08 2013-03-05 Sri International Macro-block based mixed resolution video compression system
US7680047B2 (en) 2005-11-22 2010-03-16 Cisco Technology, Inc. Maximum transmission unit tuning mechanism for a real-time transport protocol stream
JP5227187B2 (en) * 2006-01-09 2013-07-03 トムソン ライセンシング Method and apparatus for providing a low resolution update mode for multiview video encoding
CN101366284B (en) 2006-01-09 2016-08-10 汤姆森许可贸易公司 The method and apparatus reducing resolution update mode is provided for multiple view video coding
JP4747975B2 (en) * 2006-07-14 2011-08-17 ソニー株式会社 Image processing apparatus and method, program, and recording medium
KR100882949B1 (en) * 2006-08-17 2009-02-10 한국전자통신연구원 Apparatus and method of encoding and decoding using adaptive scanning of DCT coefficients according to the pixel similarity
DE602007014060D1 (en) 2006-08-25 2011-06-01 Thomson Licensing METHOD AND DEVICE FOR PARTITIONING WITH REDUCED RESOLUTION
RU2430485C2 (en) 2006-10-10 2011-09-27 Ниппон Телеграф Энд Телефон Корпорейшн Method of coding and method of decoding video data, device for realising said method, programme for realising said method and data medium for recording said programmes
JP4847890B2 (en) * 2007-02-16 2011-12-28 パナソニック株式会社 Encoding method converter
CN101790848B (en) * 2007-06-29 2016-08-03 法国电信 Distribute to the selection of the decoding functions of decoder
US8457214B2 (en) * 2007-09-10 2013-06-04 Cisco Technology, Inc. Video compositing of an arbitrary number of source streams using flexible macroblock ordering
JP5011138B2 (en) * 2008-01-25 2012-08-29 株式会社日立製作所 Image coding apparatus, image coding method, image decoding apparatus, and image decoding method
JP5519654B2 (en) * 2008-06-12 2014-06-11 トムソン ライセンシング Method and apparatus for video coding and decoding using reduced bit depth update mode and reduced chromaticity sampling update mode
KR20090129926A (en) 2008-06-13 2009-12-17 삼성전자주식회사 Method and apparatus for image encoding by dynamic unit grouping, and method and apparatus for image decoding by dynamic unit grouping
US9204086B2 (en) * 2008-07-17 2015-12-01 Broadcom Corporation Method and apparatus for transmitting and using picture descriptive information in a frame rate conversion processor
CN101715124B (en) * 2008-10-07 2013-05-08 镇江唐桥微电子有限公司 Single-input and multi-output video encoding system and video encoding method
BRPI1011333A2 (en) * 2009-05-29 2016-03-08 Mitsubishi Electric Corp video encoding and decoding device, and video encoding and decoding methods
KR101527085B1 (en) * 2009-06-30 2015-06-10 한국전자통신연구원 Intra encoding/decoding method and apparautus
CN104811719A (en) * 2009-07-01 2015-07-29 汤姆森特许公司 Methods and apparatus for signaling intra prediction for large blocks for video encoders and decoders
JP5604825B2 (en) 2009-08-19 2014-10-15 ソニー株式会社 Image processing apparatus and method
KR101418101B1 (en) * 2009-09-23 2014-07-16 에스케이 텔레콤주식회사 Video Encoding/Decoding Method and Apparatrus in Consideration of Low Frequency Component
CN101710990A (en) * 2009-11-10 2010-05-19 华为技术有限公司 Video image encoding and decoding method, device and encoding and decoding system
JP5605188B2 (en) * 2010-11-24 2014-10-15 富士通株式会社 Video encoding device
CN102065302B (en) * 2011-02-09 2014-07-09 复旦大学 H.264 based flexible video coding method
MX2014000159A (en) 2011-07-02 2014-02-19 Samsung Electronics Co Ltd Sas-based semiconductor storage device memory disk unit.
US20130188686A1 (en) * 2012-01-19 2013-07-25 Magnum Semiconductor, Inc. Methods and apparatuses for providing an adaptive reduced resolution update mode
FR2986395A1 (en) * 2012-01-30 2013-08-02 France Telecom CODING AND DECODING BY PROGRESSIVE HERITAGE
US9491475B2 (en) 2012-03-29 2016-11-08 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
US9451258B2 (en) * 2012-04-03 2016-09-20 Qualcomm Incorporated Chroma slice-level QP offset and deblocking
US9392286B2 (en) 2013-03-15 2016-07-12 Magnum Semiconductor, Inc. Apparatuses and methods for providing quantized coefficients for video encoding
US9794575B2 (en) 2013-12-18 2017-10-17 Magnum Semiconductor, Inc. Apparatuses and methods for optimizing rate-distortion costs in video encoding
US10257524B2 (en) * 2015-07-01 2019-04-09 Mediatek Inc. Residual up-sampling apparatus for performing transform block up-sampling and residual down-sampling apparatus for performing transform block down-sampling
US11153594B2 (en) 2016-08-29 2021-10-19 Apple Inc. Multidimensional quantization techniques for video coding/decoding systems
WO2019009750A1 (en) 2017-07-05 2019-01-10 Huawei Technologies Co., Ltd Apparatus and method for coding panoramic video
CN110337813B (en) 2017-07-06 2023-04-18 三星电子株式会社 Method for encoding/decoding image and apparatus therefor
US10986356B2 (en) 2017-07-06 2021-04-20 Samsung Electronics Co., Ltd. Method for encoding/decoding image and device therefor
WO2019146811A1 (en) * 2018-01-25 2019-08-01 Lg Electronics Inc. Video decoder and controlling method thereof
KR102525578B1 (en) 2018-10-19 2023-04-26 삼성전자주식회사 Method and Apparatus for video encoding and Method and Apparatus for video decoding
US11720997B2 (en) 2018-10-19 2023-08-08 Samsung Electronics Co.. Ltd. Artificial intelligence (AI) encoding device and operating method thereof and AI decoding device and operating method thereof
WO2020080698A1 (en) 2018-10-19 2020-04-23 삼성전자 주식회사 Method and device for evaluating subjective quality of video
WO2020080765A1 (en) 2018-10-19 2020-04-23 Samsung Electronics Co., Ltd. Apparatuses and methods for performing artificial intelligence encoding and artificial intelligence decoding on image
WO2020080665A1 (en) 2018-10-19 2020-04-23 Samsung Electronics Co., Ltd. Methods and apparatuses for performing artificial intelligence encoding and artificial intelligence decoding on image
KR102285738B1 (en) 2018-10-19 2021-08-05 삼성전자주식회사 Method and apparatus for assessing subjective quality of a video
WO2020080873A1 (en) 2018-10-19 2020-04-23 Samsung Electronics Co., Ltd. Method and apparatus for streaming data
WO2020080827A1 (en) 2018-10-19 2020-04-23 Samsung Electronics Co., Ltd. Ai encoding apparatus and operation method of the same, and ai decoding apparatus and operation method of the same
KR102195669B1 (en) * 2018-12-03 2020-12-28 주식회사 리메드 Apparatus for transmitting image
US11290734B2 (en) * 2019-01-02 2022-03-29 Tencent America LLC Adaptive picture resolution rescaling for inter-prediction and display
CN110572654B (en) * 2019-09-27 2024-03-15 腾讯科技（深圳）有限公司 Video encoding and decoding methods and devices, storage medium and electronic device
KR102436512B1 (en) 2019-10-29 2022-08-25 삼성전자주식회사 Method and Apparatus for video encoding and Method and Apparatus for video decoding
KR20210056179A (en) 2019-11-08 2021-05-18 삼성전자주식회사 AI encoding apparatus and operating method for the same, and AI decoding apparatus and operating method for the same
KR20210067788A (en) * 2019-11-29 2021-06-08 삼성전자주식회사 Electronic apparatus, system and control method thereof
KR102287942B1 (en) 2020-02-24 2021-08-09 삼성전자주식회사 Apparatus and method for performing artificial intelligence encoding and artificial intelligence decoding of image using pre-processing
US20220159269A1 (en) * 2020-11-17 2022-05-19 Ofinno, Llc Reduced Residual Inter Prediction
US20220201307A1 (en) 2020-12-23 2022-06-23 Tencent America LLC Method and apparatus for video coding

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5262854A (en) * 1992-02-21 1993-11-16 Rca Thomson Licensing Corporation Lower resolution HDTV receivers
CN1203500A (en) * 1997-03-12 1998-12-30 松下电器产业株式会社 Frequency domain filtering for down conversion of DCT encoded picture
CN1223771A (en) * 1996-06-27 1999-07-21 夏普公司 Picture encoder and picture decoder

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2908208B2 (en) * 1993-11-26 1999-06-21 日本電気株式会社 Image data compression method and image data decompression method
JPH09506193A (en) * 1993-11-30 1997-06-17 ポラロイド コーポレイション Coding method and apparatus for scaling and filtering images using discrete cosine transform
US6141456A (en) * 1997-12-31 2000-10-31 Hitachi America, Ltd. Methods and apparatus for combining downsampling and inverse discrete cosine transform operations
ATE344594T1 (en) * 1998-12-10 2006-11-15 Matsushita Electric Ind Co Ltd ARITHMETIC FILTER DEVICE
US7596179B2 (en) * 2002-02-27 2009-09-29 Hewlett-Packard Development Company, L.P. Reducing the resolution of media data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5262854A (en) * 1992-02-21 1993-11-16 Rca Thomson Licensing Corporation Lower resolution HDTV receivers
CN1223771A (en) * 1996-06-27 1999-07-21 夏普公司 Picture encoder and picture decoder
CN1203500A (en) * 1997-03-12 1998-12-30 松下电器产业株式会社 Frequency domain filtering for down conversion of DCT encoded picture

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ITU-T Recommendation H.263.VIDEO CODING FOR LOW BIT RATE COMMUNICATION.ITU-T DRAFT H.263.1998,1-142. *

Also Published As

Publication number Publication date
AU2005226021A1 (en) 2005-10-06
AU2005226021B2 (en) 2010-05-13
BRPI0508506A (en) 2007-07-31
EP1730695A2 (en) 2006-12-13
MY141817A (en) 2010-06-30
CN1973546A (en) 2007-05-30
ZA200607434B (en) 2008-08-27
WO2005093661A3 (en) 2005-12-29
WO2005093661A2 (en) 2005-10-06
MY142188A (en) 2010-10-15
US20070189392A1 (en) 2007-08-16
KR20060134976A (en) 2006-12-28
JP2007528675A (en) 2007-10-11

Similar Documents

Publication Publication Date Title
CN1973546B (en) Reduced resolution update mode for advanced video coding
RU2694013C1 (en) Improved intra prediction encoding using planar views
JP6526869B2 (en) Adaptive Coding of Prediction Error in Hybrid Video Coding
CN101208957B (en) Method and apparatus for video encoding
CN101040533B (en) Method and apparatus for complexity scalable video encoding and decoding
CN101371584B (en) Method and apparatus for providing reduced resolution update mode for multi-view video coding
JP2022003790A (en) Method and device for determining quantization parameter predictor from multiple adjacent quantization parameters
CN102150427B (en) System and method for video encoding using adaptive loop filter
CN101662682B (en) Video encoding techniques
CN1939067B (en) Method and apparatus for complexity scalable video decoder
CN102271257B (en) Image processing device, method, and program
US20090129474A1 (en) Method and apparatus for weighted prediction for scalable video coding
MX2008000522A (en) Method and apparatus for macroblock adaptive inter-layer intra texture prediction.
KR20120126067A (en) Methods and apparatus for adaptive residual updating of template matching prediction for video encoding and decoding
JP2010135864A (en) Image encoding method, device, image decoding method, and device
Gardos H. 263+: the new itu-t recommendation for video coding at low bit rates
JP2023519939A (en) Slice type in video coding
MXPA06010217A (en) Reduced resolution update mode for advanced video coding

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100512

Termination date: 20120301