|Publication number||US7095445 B2|
|Application number||US 10/001,676|
|Publication date||Aug 22, 2006|
|Filing date||Oct 23, 2001|
|Priority date||Dec 20, 2000|
|Also published as||CN1167266C, CN1360436A, EP1223748A2, EP1223748A3, EP1223748B1, US7098957, US20020080284, US20020136305|
|Publication number||001676, 10001676, US 7095445 B2, US 7095445B2, US-B2-7095445, US7095445 B2, US7095445B2|
|Inventors||Yeong-Taeg Kim, Shin-Haeng Kim|
|Original Assignee||Samsung Electronics Co., Ltd.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (56), Non-Patent Citations (6), Referenced by (18), Classifications (15), Legal Events (4)|
|External Links: USPTO, USPTO Assignment, Espacenet|
Applicants claim the benefit of U.S. Provisional Application No. 60/257,338 entitled “Methods of Detecting Motion in an Interlaced Video Sequence Based on Logical Operation on the Linearly Scaled Motion Information and the Apparatus Therefor,” filed Dec. 20, 2000, U.S. Provisional Application No. 60/257,365 entitled “Methods of Detecting Motion in an Interlaced Video Sequence Utilizing Region-Wise Motion and Apparatus” filed Dec. 20, 2000, and U.S. Provisional Application No. 60/273,100 entitled “Method of Detecting Repetitive Motion In An Interlaced Video Sequence and Apparatus Therefore,” filed Mar. 2, 2001, which applications are incorporated herein by reference.
1. Field of the Invention
The present invention lies in the signal processing field. More specifically, the present invention pertains to a method of detecting motion in an interlaced video sequence. The invention is particularly applicable to the conversion of an interlaced video signal to a progressive frame video signal, whereby regional motion information is utilized to define whether or not the video sequence contains motion or represents still image information. The present invention also pertains to an apparatus for performing the claimed method.
2. Description of the Related Art
In the development of current digital TV (DTV) systems, it is essential to employ a video format conversion unit because of the variety of the video formats adopted in many different DTV standards worldwide. For instance, the ATSC DTV standard system of the North America adopted 1080x1920 interlaced video, 720x1280 progressive video, 720x480 interlaced and progressive video, and so on, as its standard video formats for digital TV broadcasting. Video format conversion refers to a signal processing operation in which an incoming video format is converted to a specified output video format so that the output video can be properly displayed on a displaying device such as a monitor, FLCD, or a Plasma display, which has a fixed resolution.
Video format conversion systems are of significant importance since the conversion can directly affect the visual quality of the video of a DTV receiver. Fundamentally, the video format conversion operation requires advanced algorithms for multi-rate system design, poly-phase filter design, and interlaced-to-progressive scanning rate conversion or simply deinterlacing. Deinterlacing represents an operation that doubles the vertical scanning rate of the interlaced video signal.
Interlaced video in general is a sequence of separately arriving fields, such as A1, A2, A3, etc., where A1, A2, and A3 are interlaced images with Al being a top image, A2 being a bottom image, A3 being the next top image, and so on. The most popular systems currently in use, namely NTSC, PAL, and SECAM are two-field systems, where two consecutive fields (such as the top field Al and the bottom field A2) make up a frame. Each scanned field contains, i.e., updates, every other line of a corresponding frame and the number of lines in the frame is twice the number of lines in each of the fields which contain video information. Typically, the first field is identified with odd-numbered lines and the second field is identified with even-numbered lines. The fields are scanned onto the display screen one after the other at a defined frequency.
By way of example, NTSC scans close to 30 frames (60 fields of interlaced video) per second, with 525 lines per frame, and a horizontal to vertical aspect ratio of 4:3. The frame difference, therefore, is the difference between two fields having the same types (top or bottom) such as A1 and A3, or A2 and A4. PAL and SECAM scan 25 frames per second, with 625 lines per image, and the same aspect ratio of 4:3. As noted, the interlacing in all of these systems is 2:1, i.e., two fields per one frame. The primary reason for the interlacing of the lines between the fields is to reduce flicker in the display. An image that is updated, say, only 30 times a second would allow the human eye to perceive the scanning, because the image information would already start to fade before the next image is scanned onto the screen. When two fields are used, and each contains half of the information, the scanning rate in effect is raised to 60 Hz, and the human eye no longer perceives any flicker.
Deinterlacing refers to the filling of unavailable lines in each of the fields A1, A2, A3, and so on. As a result of deinterlacing, a 60 Hz field sequence (of interlaced video fields) becomes a 60 Hz progressive sequence.
Interlaced video is subject to several intrinsic drawbacks, referred to as artifacts. These include serrated lines that are observed when there is motion between fields, line flickering, raster line visibility, and field flickering. These also apply to DTV (digital TV) receivers. Historically, deinterlacing algorithms have been developed to enhance the video quality of NTSC TV receivers by reducing these intrinsic annoying artifacts of the interlaced video signal. Besides, elaborate deinterlacing algorithms utilizing motion detection or motion compensation provide excellent methods of doubling the vertical scanning rate of the interlaced video signal especially for stationary (motionless) objects in the video signal.
The present invention therefore also relates to the motion detection based deinterlacing operation that can be used for analog and digital TV receivers.
The state of the art includes a variety of deinterlacing algorithms, each having been exploited and studied comprehensively by many researchers during the last decade. Deinterlacing algorithms can be categorized into two classes, namely, 2-D (spatial) deinterlacing algorithms and 3-D (spatio-temporal) deinterlacing algorithms depending on the use of motion information embedded in consecutive interlaced video sequence. Combined spatial and temporal 3-D deinterlacing algorithms based on a motion detection give more pleasing performance than 2-D deinterlacing algorithms. The key point of a 3-D deinterlacing algorithm is how to precisely detect motion in the interlaced video signals. The publications in the following list disclose some of the applicable deinterlacing methods. They may be categorized as follows:
More recently, a new motion detection based deinterlacing method has been described in the following two, commonly assigned patents:
The core of the methods described in the latter two patents is to estimate a motion decision factor based on the frame difference signal and the sample correlation in the vertical direction. These methods provide a way of reducing the visual artifacts that can be possibly arising from false motion detection by utilizing the sample correlation in vertical direction of the sampling point where the value is to be interpolated. A common drawback of those methods, however, is that they do not provide a true motion detection method when there are high frequency components in the vertical direction. In other words, when there are high frequency components in the vertical direction, the methods described in the references  and  will come to the conclusion that motion pictures are processed.
As a consequence, in many instances, those prior art processing methods do not provide for an increase in the vertical resolution even when no real motion is present between fields.
It is accordingly an object of the invention to provide a motion detection method in an interlaced video sequence, which overcomes the above-mentioned disadvantages of the heretofore-known devices and methods of this general type and which provides for a robust method of estimating a motion decision parameter which is associated with the point to point degree of motion in the interlaced video sequence. It is another object of the present invention to disclose a deinterlacing method and apparatus by utilizing the motion decision parameter of the invention.
With the foregoing and other objects in view there is provided, in accordance with the invention, a method of computing a motion decision value for further utilization in a video signal processing system. The method comprises the following steps:
inputting a video signal with an interlaced video sequence;
computing a frame difference signal from a difference between a previous field and a next field in the video sequence;
forming a point-wise motion detection signal from the frame difference signal;
computing a region-wise motion detection signal from the point-wise motion detection signal and an adjacent point-wise motion detection signal delayed by one field; and
forming from the region-wise motion detection signal a motion decision value and outputting the motion decision value for further processing in the video signal processing system.
In accordance with an added feature of the invention, the difference signal is low-pass filtered prior to the step of forming the point-wise motion detection signal.
The low-pass filter may be defined by a low pass filter matrix
where w11, . . . wMNrepresent a set of predetermined coefficients.
In accordance with an additional feature of the invention, the step of forming the point-wise motion detection signal comprises computing
f n(i,h)=l K(d n(i,h))
where fn is the point-wise motion detection signal, i and h define a spatial location of the respective video signal value in a cartesian matrix, lK(•) denotes a linearly scaling function represented as
in which K is a positive constant value, or, alternatively, with the linearly scaling function
where K is still constant and a is a real number.
Various options are available for computing the region-wise motion detection signal from the point-wise motion detection signal. The following equations can be selected
where fn−1 (•) denotes a motion detection signal delayed by one field, med(•) denotes a median operation, max(•) denotes an operation to minimize an error from a false motion detection, and the indices i and h define a spatial location of the respective video signal value in a cartesian matrix.
In accordance with another feature of the invention, the region-wise motion detection signal is low-pass filtered prior to the outputting step. In a preferred embodiment, the region-wise motion detection signal is low-pass filtered to form the motion decision value mn(i,h) by:
where a,b,c,d≧0, and αp,q represents a set of normalized predetermined coefficients of a low pass filter.
The kernel of the low-pass filter may be defined as
With the above objects in view there is also provided, in accordance with the invention, a method of processing interlaced video signals, which comprises:
spatially interpolating a value of the video signal at a given location from a video signal of at least one adjacent location in a given video field;
temporally interpolating the value of the video signal at the given location from a video signal at the same location in temporally adjacent video fields; and
forming a motion decision value for the same location in accordance with the above-outlined method; and
mixing an output signal for the video signal at the given location from the spatially interpolated signal and the temporally interpolated signal and weighting the output signal in accordance with the motion decision value.
In accordance with again an added feature of the invention, the motion decision value is varied between 0 and 1 as a function of an estimate of the degree of motion at the given location and, upon estimating a high degree of motion, heavily weighting the output signal towards the spatially interpolated signal and, upon estimating a low degree of motion, heavily weighting the output signal towards the temporally interpolated signal.
In accordance with again an additional feature of the invention, the spatially interpolated signal is output as the output signal upon estimating a high degree of motion, and the temporally interpolated signal is output as the output signal upon estimating a low degree of motion.
With the above and other objects in view there is also provided, in accordance with the invention, an apparatus for computing a motion decision value in a video processing system. The apparatus comprises:
an input for receiving a video signal with an interlaced video sequence;
difference forming means connected to the input for computing a frame difference signal from a difference between a previous field and a next field of a current field to be deinterlaced;
means for forming a point-wise motion detection signal from the frame difference signal, and for computing a region-wise motion detection signal from the point-wise motion detection signal and an adjacent point-wise motion detection signal delayed by one field; and
means for forming from the region-wise motion detection signal a motion decision value and for outputting the motion decision value for further processing in the video signal processing system.
The apparatus is configured and/or programmed to perform the method outlined above.
A corresponding apparatus of processing interlaced video signals, for example for interlaced to progressive conversion, comprises:
an input for receiving a video signal with an interlaced video sequence of fields;
a spatial interpolator connected to the input and configured to spatially interpolate a value of the video signal at a given location from a video signal of at least one adjacent location in a given video field;
a temporal interpolator connected to the input in parallel with the spatial interpolator for temporally interpolating the value of the video signal at the given location from a video signal at the same location in temporally adjacent video fields; and
a computing apparatus as outlined above connected to the input and in parallel with the spatial interpolator and the temporal interpolator for forming a motion decision value for the same location; and
a mixer connected to receive an output signal from each of the spatial interpolator, the temporal interpolator, and the computing apparatus, the mixer being configured to mix an output signal for the video signal at the given location from the spatially interpolated signal and the temporally interpolated signal in dependence on the motion decision value output by the computing apparatus.
Other features which are considered as characteristic for the invention are set forth in the appended claims.
Although the invention is illustrated and described herein as embodied in a method of detecting motion in an interlaced video sequence based on logical operation on the linearly scaled motion information and an apparatus therefor, it is nevertheless not intended to be limited to the details shown, since various modifications and structural changes may be made therein without departing from the spirit of the invention and within the scope and range of equivalents of the claims.
The construction of the invention, however, together with additional objects and advantages thereof will be best understood from the following description of the specific embodiment when read in connection with the accompanying drawings.
Referring now to the figures of the drawing in detail and first, particularly, to the introductory view of
In order to systematically describe the deinterlacing problem and the methods of the present invention, let xn denote the incoming interlaced video field at a time instant t=n and xn(v,h) denote the associated value of the video signal at the geometrical location (v,h). The variable v represents the vertical location and h represents horizontal location, in the cartesian matrix system commonly applied. By definition, the signal values of xn of the interlaced video signal are available only for the even lines (v=0,2,4, . . . ) if xn is the top field 1. Similarly, the signal values of xn are available only for the odd lines of v (v=1,3,5, . . . ) if xn is the bottom field 2. Conversely, the signal values of xn are not available for odd lines if xn is a top field signal and the signal values of xn are not available for even lines if xn a bottom field.
Based upon the description of the interlaced video signal, deinterlacing problem can be stated as a process to reconstruct or interpolate the non-available signal values of each field. That is, the deinterlacing problem is to reconstruct the signal values of xn at the odd lines (v=1,3,5, . . . ) for the top field xn and to reconstruct the signal values of xn at the even lines (v=0,2,4, . . . ) for the bottom field xn.
For the simple description of the present invention, and to avoid any notational confusion in the disclosure, the deinterlacing problem will be simplified as a process which reconstructs or interpolates the unavailable signal value of xn at the ith line where the signal values of the lines at i±1, i±3, i±5, . . . are available. More simply deinterlacing is to interpolate the value of xn(i,h), which is not originally available. It must be noted that, since xn−1, and xn+1 have a different sampling phase from xn, the signal values of xn−1(i,h) and xn+1(i,h) are available, which is why motion detection can be incorporated with the deinterlacing problem. This relationship is depicted in
The deinterlacing method and an exemplary apparatus of the present invention with preferred embodiments will be better understood from the following description, which will make specific reference to
Referring now to
First, the frame difference signal Dn is computed by taking the difference between the fields in one frame interval as
D n =|x n+1 −x n−1|
which associates with the scene change that occurred between the fields xn+1 and xn−1. The frame difference signal is then low pass filtered to form
d n =LPF(D n)
where LPF(•) represents a low pass filtering process over the input video signal. The M×N kernel, WM×N, in general, of the low pass filter LPF(•), can be expressed as
where (w11, . . . , wMN) represents a set of predetermined coefficients. It should be mentioned that the characteristic of the LPF (•) can be all-pass filter depending on the choice of the kernel WM×N. That is, if the kernel is set as M=N=1, and w111, the LPF(•) becomes an all-pass filter and, thus, dn=Dn.
Next, a point-wise motion detection signal is computed as
f n(i,h)=lK(d n(i,h)) (1)
where lK(•) denotes a linearly scaling function represented as
in which K is a positive constant value. Or, as an alternative method, we can define the scaling function lK(y) as
where a is a real number. Or, more in general, this invention discloses to use the scaling function lK(y) as to be a monotonously increasing function represented as lK(0)=0, lK(y)=1 for y≧K, and
∀0≦y 1 ≦y 2 ≦K,1K(y 1)≦l K(y 2)
which implies lK(y) is monotonously increasing as y increases. Then the region-wise motion detection signal is computed from the point-wise motion detection signal as
φn(i,h)=f n(i,h)+min(f n−1(i−1,h),f n−1(i+1,h)) (2)
where fn−1(•) denotes the one field delayed motion detection signal described in (1). Or, as an alternative method, we define the region-wise motion detection signal as
φn(i,h)=med(f n(i,h),f n−1(i−1,h),f n−1(i+1,h)) (3)
where med(•) denotes a median operation. Or, in order to minimize the error from a false motion detection, we define the region-wise motion detection signal as
φn(i,h)=max(f n(i,h),f n−1(i−1,h),f n−1(i+1,h)) (4)
Finally, the region-wise motion detection signal is low pass filtered to form the motion decision parameter mn(i,h) as
where a,b,c,d≧0, and ap,q represents a set of normalized (i.e.,
predetermined coefficients of a low pass filter. For instance, the kernel of the low pass filter used in (5) can be
The block diagram of
The block diagram of
The block diagram of
The computed motion decision parameter mn(i,h) is then used to mix a spatially interpolated signal and the a temporally interpolated signal, which is described next.
The spatial interpolator 3 spatially interpolates the value of xn(i,h) by using a predetermined algorithm. The temporal interpolator 4 temporally interpolates the value of xn(i,h) by using a predetermined algorithm. The motion decision processor 5 computes the motion decision value, mn(i,h) as disclosed in the foregoing, which represents the degree of the motion at the interpolation location (i,h). Conceptually, the value of the motion decision parameter will be bounded as 0≦mn(i,h)≦1 where mn(i,h)=0 implies “no motion” and mn(i,h)=1 implies “motion”. The mixer 6 mixes the output signal xn s(i,h) of the spatial interpolator 3 and the output signal xn t(i,h) of the temporal interpolator 4 in accordance with the motion decision value. Where xn s(i,h) and xn t(i,h) are the output signal of the spatial interpolator 3 and the output signal of the temporal interpolator 4, respectively, the output signal of the mixer, or, the interpolated signal is represented as
x n(i,h)=(1−m n(i,h))·x n t(i,h)+m n(i,h)·x n s(i,h) (6)
Note that xn(i,h)=xn t(i,h) when mn(i,h)=0(no motion) and xn(i,h)=xn s(v,h) when mn(i,h)=1(motion).
Specific information with regard to the interpolation of interlaced video signals and interlaced to progressive conversion is readily available to those of skill in the pertinent art. The above-noted disclosures, namely U.S. Pat. Nos. 5,943,099 and 5,959,68 1, are specifically incorporated by reference.
Some examples of the spatially interpolated signal xn s(v,h) are
x n s(i,h)=(x n(i−1,h)+x n(i+1,h))/2
which corresponds to a line average and
x n s(i,h)=x n(i−1,h)
which corresponds to a method known as line doubling.
Some examples of temporally interpolated signal xn s(v,h) are
x n t(i,h)=(x n+1(i,h)+x n−1(i,h))/2
x n t(i,h)=x n−1(i,h)
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4661853 *||Nov 1, 1985||Apr 28, 1987||Rca Corporation||Interfield image motion detector for video signals|
|US4933759 *||Apr 27, 1989||Jun 12, 1990||U.S. Philips Corporation||Method of and arrangement for motion detection in an interlaced television picture obtained after film-to-television conversion|
|US5027201 *||Dec 21, 1989||Jun 25, 1991||Rca Licensing Corporation||Motion detection apparatus as for an interlace to non-interlace scan converter|
|US5051826 *||Feb 28, 1990||Sep 24, 1991||Kabushiki Kaisha Toshiba||Vertical edge detection circuit for a television image motion adaptive progressive scanning conversion circuit|
|US5081532 *||Aug 30, 1990||Jan 14, 1992||Zenith Electronics Corporation||Adaptive progressive scan converter|
|US5434627 *||Jan 24, 1992||Jul 18, 1995||British Broadcasting Corporation||Codec for weston clean pal television system|
|US5534935 *||Oct 27, 1994||Jul 9, 1996||Kabushiki Kaisha Toshiba||Processing apparatus for progressive scan generation of a television signal|
|US5600377 *||Sep 9, 1993||Feb 4, 1997||Sony Corporation||Apparatus and method for motion compensating video signals to produce interpolated video signals|
|US5638139 *||Jun 7, 1995||Jun 10, 1997||Texas Instruments Incorporated||Motion adaptive scan-rate conversion using directional edge interpolation|
|US5661525 *||Mar 27, 1995||Aug 26, 1997||Lucent Technologies Inc.||Method and apparatus for converting an interlaced video frame sequence into a progressively-scanned sequence|
|US5796437 *||Dec 6, 1996||Aug 18, 1998||Matsushita Electric Industrial Co., Ltd.||Progressive scanning conversion apparatus|
|US5943099 *||Jan 22, 1997||Aug 24, 1999||Samsung Electronics Co., Ltd.||Interlaced-to-progressive conversion apparatus and method using motion and spatial correlation|
|US5959681||Dec 30, 1996||Sep 28, 1999||Samsung Electronics Co., Ltd.||Motion picture detecting method|
|US6014182 *||Oct 10, 1997||Jan 11, 2000||Faroudja Laboratories, Inc.||Film source video detection|
|US6037986 *||Jul 16, 1996||Mar 14, 2000||Divicom Inc.||Video preprocessing method and apparatus with selective filtering based on motion detection|
|US6061100 *||Sep 30, 1997||May 9, 2000||The University Of British Columbia||Noise reduction for video signals|
|US6072531 *||Nov 4, 1998||Jun 6, 2000||Nec Corporation||Scanning system converting into progressive scanning system regardless of scanning system before coding|
|US6108041 *||Oct 10, 1997||Aug 22, 2000||Faroudja Laboratories, Inc.||High-definition television signal processing for transmitting and receiving a television signal in a manner compatible with the present system|
|US6122017 *||Jan 22, 1998||Sep 19, 2000||Hewlett-Packard Company||Method for providing motion-compensated multi-field enhancement of still images from video|
|US6239842 *||Dec 18, 1998||May 29, 2001||Oplus Technologies Ltd.||Method of de-interlacing video signals using a mixed mode spatial and temporal approximation technique|
|US6266092 *||May 12, 1998||Jul 24, 2001||Genesis Microchip Inc.||Method and apparatus for video line multiplication with enhanced sharpness|
|US6268886 *||Nov 12, 1998||Jul 31, 2001||Lg Electronics Inc.||Apparatus for converting picture format in digital TV and method of the same|
|US6275259 *||Feb 2, 1998||Aug 14, 2001||International Business Machines Corporation||Digital automatic gain control circuit for image system|
|US6288745 *||Oct 13, 1998||Sep 11, 2001||Mitsubishi Denki Kabushiki Kaisha||Scanner line interpolation device|
|US6295091 *||Nov 7, 1997||Sep 25, 2001||Intel Corporation||Method and apparatus for de-interlacing video fields for superior edge preservation|
|US6307560 *||Feb 12, 1999||Oct 23, 2001||Sony Corporation||Classified adaptive spatio-temporal format conversion method and apparatus|
|US6317165 *||Nov 19, 1999||Nov 13, 2001||S3 Graphics Co., Ltd.||System and method for selective capture of video frames|
|US6330032 *||Sep 30, 1999||Dec 11, 2001||Focus Enhancements, Inc.||Motion adaptive de-interlace filter|
|US6331874 *||Jun 29, 1999||Dec 18, 2001||Lsi Logic Corporation||Motion compensated de-interlacing|
|US6340990 *||Mar 31, 1998||Jan 22, 2002||Applied Intelligent Systems Inc.||System for deinterlacing television signals from camera video or film|
|US6348949 *||Dec 22, 1998||Feb 19, 2002||Intel Corporation||Deinterlacing a video signal using a motion detector|
|US6414719 *||May 26, 2000||Jul 2, 2002||Sarnoff Corporation||Motion adaptive median filter for interlace to progressive scan conversion|
|US6418233 *||May 31, 2000||Jul 9, 2002||Sony Corporation||Motion determining apparatus and determining method|
|US6421090 *||Aug 27, 1999||Jul 16, 2002||Trident Microsystems, Inc.||Motion and edge adaptive deinterlacing|
|US6449312 *||Jun 8, 2000||Sep 10, 2002||Motorola, Inc.||Method of estimating motion in interlaced video|
|US6452639 *||Mar 4, 1999||Sep 17, 2002||Sony International (Europe) Gmbh||Raster scan conversion system for interpolating interlaced signals|
|US6452972 *||May 10, 2000||Sep 17, 2002||Texas Instruments Incorporated||Motion detection using field-difference measurements|
|US6459455 *||Aug 31, 1999||Oct 1, 2002||Intel Corporation||Motion adaptive deinterlacing|
|US6483546 *||Aug 20, 1999||Nov 19, 2002||Sony Corporation||Picture information converting apparatus, picture information converting method, and television receiver|
|US6512550 *||Sep 28, 2001||Jan 28, 2003||Lsi Logic Corporation||Motion compensated de-interlacing|
|US6621936 *||Feb 12, 1999||Sep 16, 2003||Sony Corporation||Method and apparatus for spatial class reduction|
|US6630961 *||Jun 30, 2000||Oct 7, 2003||Lg Electronics Inc.||Deinterlacing device and method|
|US6633612 *||Dec 13, 2000||Oct 14, 2003||Genesis Microchip Inc.||Method and apparatus for detecting motion between odd and even video fields|
|US6636267 *||Mar 23, 2000||Oct 21, 2003||Pioneer Corporation||Line interpolation apparatus and line interpolation method|
|US6647062 *||Dec 22, 2000||Nov 11, 2003||Genesis Microchip Inc.||Method and apparatus for detecting motion and absence of motion between odd and even video fields|
|US6754371 *||Dec 7, 1999||Jun 22, 2004||Sony Corporation||Method and apparatus for past and future motion classification|
|US6795123 *||Dec 19, 2001||Sep 21, 2004||Matsushita Electric Industrial Co., Ltd.||Interpolation apparatus, and video signal processing apparatus including the same|
|US6822691 *||Oct 22, 2001||Nov 23, 2004||Samsung Electronics Co., Ltd.||Method of detecting motion in an interlaced video sequence utilizing region by region motion information and apparatus for motion detection|
|US6829013 *||Jul 8, 2002||Dec 7, 2004||Silicon Image, Inc.||Method and apparatus for detecting and smoothing diagonal features in video images|
|US6847405 *||Sep 14, 2001||Jan 25, 2005||Sony Corporation||Motion-adaptive de-interlacing method and system for digital televisions|
|US6859237 *||Mar 14, 2003||Feb 22, 2005||Genesis Microchip Inc.||Film source video detection|
|US6909466 *||Sep 15, 1999||Jun 21, 2005||Micronas Gmbh||Circuit for frame rate conversion using a motion-adaptive method|
|US20020027610 *||Jan 16, 2001||Mar 7, 2002||Hong Jiang||Method and apparatus for de-interlacing video images|
|US20040184541 *||Jan 27, 2004||Sep 23, 2004||Erik Brockmeyer||Optimized data transfer and storage architecture for MPEG-4 motion estimation on multi-media processors|
|US20040196901 *||Mar 30, 2004||Oct 7, 2004||Demos Gary A.||Median filter combinations for video noise reduction|
|US20040202245 *||May 4, 2004||Oct 14, 2004||Mitsubishi Denki Kabushiki Kaisha||Motion compensating apparatus, moving image coding apparatus and method|
|1||A motion adaptive method disclosed in IEEE Transactions on Consumer Electronics, pp. 110-114, May 1990 by C. Markhauser.|
|2||Edge direction dependent deinterlacing method disclosed in the Proc. of the Int. Workshop on HDTV, 1994, by D. Bagni, R. Lancini, and S. Tubaro, S Landi pp. 137-145.|
|3||Nonlinear interpolation based on: FIR median hybrid interpolation disclosed in Pro. of SPIE's Visual Communications and Image Processing, Lausanne, Switzerland, Oct. 1990, pp. 135-142 by A. Lehtonen and M. Renfors.|
|4||Nonlinear interpolation methods based on: a complementary median filter disclosed in Proc. of the Int. Workshop on HDTV, 1994 by H. Blume, I. Schwoerer, and K. Zygis, pp. 127-135.|
|5||Nonlinear interpolation methods based on: a weighted median filter disclosed in the Proc. of IEEE ISCAS, pp. 433-436 Portland, USA, May 1989, by J. Juhola, A. Nieminen, J. Sal, and Y. Neuvo.|
|6||Simple line doubling scheme, vertical filtering edge controlled interpolation method disclosed in the IEEE Transactions on Consumers Electronics, pp. 279-289, Aug. 1989 by D.I. Hentschei.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7265791 *||Sep 26, 2003||Sep 4, 2007||Samsung Electronics Co., Ltd.||Method and apparatus for de-interlacing video signal|
|US7319491 *||Jun 3, 2004||Jan 15, 2008||Canon Kabushiki Kaisha||Method and apparatus for processing motion information|
|US7345708 *||Dec 23, 2003||Mar 18, 2008||Lsi Logic Corporation||Method and apparatus for video deinterlacing and format conversion|
|US7505080 *||Sep 29, 2004||Mar 17, 2009||Imagination Technologies Limited||Motion compensation deinterlacer protection|
|US7515205 *||Nov 30, 2006||Apr 7, 2009||Pixelworks, Inc.||Weighted absolute difference based deinterlace method and apparatus|
|US7659939||Feb 4, 2008||Feb 9, 2010||Lsi Corporation||Method and apparatus for video deinterlacing and format conversion|
|US8031265||Aug 20, 2007||Oct 4, 2011||Texas Instruments Incorporated||System and method for combining interlaced video frames|
|US8494292 *||Jan 22, 2008||Jul 23, 2013||Canon Kabushiki Kaisha||Image processing apparatus|
|US20040246375 *||Jun 3, 2004||Dec 9, 2004||Canon Kabushiki Kaisha||Method and apparatus for processing motion information|
|US20050134730 *||Dec 23, 2003||Jun 23, 2005||Lsi Logic Corporation||Method and apparatus for video deinterlacing and format conversion|
|US20050206786 *||Sep 29, 2004||Sep 22, 2005||Leaback Peter D||Motion compensation deinterlacer protection|
|US20070052843 *||Aug 25, 2004||Mar 8, 2007||Koninklijke Philips Electronics N.V.||Robust de-interlacing of video signals|
|US20080122975 *||Feb 4, 2008||May 29, 2008||Winger Lowell L||Method and apparatus for video deinterlacing and format conversion|
|US20080175499 *||Jan 22, 2008||Jul 24, 2008||Canon Kabushiki Kaisha||Image processing apparatus|
|US20080186406 *||Feb 7, 2007||Aug 7, 2008||Po-Wei Chao||Apparatus for detecting film mode and method thereof|
|US20090051809 *||Aug 20, 2007||Feb 26, 2009||Marshall Charles Capps||System and Method for Combining Interlaced Video Frames|
|CN101969528A *||Oct 14, 2010||Feb 9, 2011||华亚微电子（上海）有限公司||Three-dimensional simulation video signal noise reduction method and filtering device|
|CN101969528B||Oct 14, 2010||Apr 25, 2012||华亚微电子（上海）有限公司||Three-dimensional simulation video signal noise reduction method and filtering device|
|U.S. Classification||348/448, 348/452, 348/701, 348/451, 348/E05.065|
|International Classification||H04N5/44, H04N9/64, H04N5/14, H04N11/20, H04N7/01|
|Cooperative Classification||H04N7/0137, H04N5/144, H04N7/012|
|European Classification||H04N7/01G3, H04N5/14M|
|Oct 23, 2001||AS||Assignment|
Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, YEONG-TAEG;KIM, SHIN-HAENG;REEL/FRAME:012355/0129;SIGNING DATES FROM 20011012 TO 20011015
|Mar 29, 2010||REMI||Maintenance fee reminder mailed|
|Aug 22, 2010||LAPS||Lapse for failure to pay maintenance fees|
|Oct 12, 2010||FP||Expired due to failure to pay maintenance fee|
Effective date: 20100822