Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS20020159525 A1
Publication typeApplication
Application numberUS 10/098,794
Publication dateOct 31, 2002
Filing dateMar 14, 2002
Priority dateMar 15, 2001
Also published asUS6944223
Publication number098794, 10098794, US 2002/0159525 A1, US 2002/159525 A1, US 20020159525 A1, US 20020159525A1, US 2002159525 A1, US 2002159525A1, US-A1-20020159525, US-A1-2002159525, US2002/0159525A1, US2002/159525A1, US20020159525 A1, US20020159525A1, US2002159525 A1, US2002159525A1
InventorsYeong Jeong
Original AssigneeLg Electronics Inc.
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Effective error recovery method using packet loss rate of networks in realtime video transfer system
US 20020159525 A1
Abstract
An error recovery method of a video transfer system includes the steps of: setting a refresh rate on the basis of a packet loss rate of a video frame; and encoding a macro-block of the video frame in an intra mode according to the set refresh rate. Since the effective intra encoding method in consideration of the packet loss rate is provided, the image state of the receiving party can be taken into consideration and a mobile image service of a high picture quality can be provided on a real time basis. In addition, since the error recovery method of a video transfer system of the present invention has the flexible refresh rate considering the image state (the picture quality state) of the receiving party, it is suitable for the error recovery method for a high picture quality video transferring.
Images(3)
Previous page
Next page
Claims(35)
What is claimed is:
1. An error recovery method of a video transfer system comprising the steps of:
setting a refresh rate on the basis of a packet loss rate of a video frame; and
encoding a macro-block of the video frame in an intra mode according to the set refresh rate.
2. The method of claim 1, wherein the refresh rate is set by using the following equation:
REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 ,
wherein INT is an integer and PLR is a packet loss rate.
3. The method of claim 1, wherein the refresh rate is adaptively set according to a packet loss rate of the video frame.
4. The method of claim 1, wherein the refresh rate is linearly set according to a packet loss rate of the video frame.
5. The method of claim 1, wherein, in the encoding step, when the packet loss rate is above a certain value, the macro-blocks in an inter mode without a coefficient are counted, and when the count value reaches a reference packet loss rate, the blocks are encoded in an intra mode.
6. The method of claim 1 further comprising the step of omitting the operation of counting the macro-blocks in the inter mode without a coefficient when the packet loss rate is above a certain value.
7. The method of claim 6, wherein the certain value is 50%.
8. The method of claim 6, wherein the omitting of the counting operation is performed to heighten an encoding efficiency and prevent a blinking phenomenon that a background portion on the screen blinks due to an inter update.
9. The method of claim 1, wherein the refresh rate is set by selecting a random value between ‘0’ and a maximum value as an initial value of a random function.
10. The method of claim 9, wherein the refresh rate is set to prevent a phenomenon that the macro-blocks are sequentially updated, and to update the macro-blocks randomly.
11. An error recovery method of a video transfer system comprising the steps of:
adaptively setting an intra refresh rate on the basis of a packet loss rate of a video frame; and
counting macro-blocks without a coefficient when the packet loss rate is above a certain value, and encoding the blocks in an intra mode when the count value reaches a reference packet loss rate.
12. The method of claim 11, further comprising the step of omitting the operation of counting the macro-blocks in the inter mode without a coefficient when the packet loss rate is above a certain value.
13. The method of claim 12, wherein the omitting of the counting operation is performed to heighten an encoding efficiency and prevent a blinking phenomenon that a background portion on the screen blinks due to an inter update.
14. The method of claim 11, wherein the refresh rate is ate is set by using the following equation:
REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 ,
wherein INT is an integer and PLR is a packet loss rate.
15. The method of claim 11, wherein the refresh rate is linearly set according to a packet loss rate of the video frame.
16. The method of claim 11, wherein the certain value is 50%.
17. The method of claim 11, wherein the refresh rate is set by selecting a random value between ‘0’ and a maximum value as an initial value of a random function.
18. The method of claim 17, wherein the refresh rate is set to prevent a phenomenon that the macro-blocks are sequentially updated, and to update the macro-blocks randomly.
19. An error recovery method of a video transfer system comprising the steps of:
setting an intra refresh rate on the basis of a packet loss rate of a video frame transmitted from a receiving party;
counting macro-blocks in an inter mode without a coefficient when the packet loss rate is above a certain value, and encoding the block in an intra mode when the count value reaches a reference packet loss rate; and
omitting the operation of counting the macro-blocks in the inter mode without a coefficient when the packet loss rate is below a certain value;
wherein the refresh rate is set by using the following equation:
REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 ,
wherein INT is an integer and PLR is a packet loss rate.
20. The method of claim 19, wherein the omitting of the counting operation is performed to heighten an encoding efficiency and prevent a blinking phenomenon that a background portion on the screen blinks due to an inter update.
21. The method of claim 20, wherein the refresh rate is linearly set according to a packet loss rate of the video frame.
22. The method of claim 20, wherein the certain value is 50%.
23. The method of claim 20, wherein the refresh rate is set by selecting a random value between ‘0’ and a maximum value as an initial value of a random function.
24. The method of claim 20, wherein the refresh rate is set to prevent a phenomenon that the macro-blocks are sequentially updated, and to update the macro-blocks randomly.
25. An error recovery method of a video transfer system in which when macro-blocks with a coefficient are transmitted, every 132th macro-block at minimum is forcefully encoded in an intra mode, comprising the steps of:
setting an intra refresh rate on the basis of a packet loss rate of a video frame transmitted from a receiving party; and
counting macro-blocks in an inter mode without a coefficient when the packet loss rate is above a certain value, and encoding the macro-blocks into an intro mode when the count value reaches a reference packet loss rate.
26. The method of claim 25, wherein the refresh rate is set by using the following equation:
REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 ,
wherein INT is an integer and PLR is a packet loss rate.
27. The method of claim 25, further comprising the step of omitting the operation of counting the macro-blocks in the inter mode without a coefficient when the packet loss rate is above a certain value.
28. The method of claim 27, wherein the omitting of the counting operation is performed to heighten an encoding efficiency and prevent a blinking phenomenon that a background portion on the screen blinks due to an inter update.
29. The method of claim 27, wherein the refresh rate is linearly set according to a packet loss rate of the video frame.
30. The method of claim 25, wherein the certain value is 50%.
31. The method of claim 25, wherein the refresh rate is set by selecting a random value between ‘0’ and a maximum value as an initial value of a random function.
32. The method of claim 25, wherein the refresh rate is set to prevent a phenomenon that the macro-blocks are sequentially updated, and to update the macro-blocks randomly.
33. An error recovery method of a video transfer system in which when macro-blocks with a coefficient are transmitted, every 132th macro-block at minimum is forcefully encoded in an intra mode, comprising the steps of:
linearly setting an intra refresh rate on the basis of a packet loss rate of a video frame transmitted form a receiving party;
counting macro-blocks in an inter mode without a coefficient when the packet loss rate is above a certain value, and encoding the macro-blocks into an intro mode when the count value reaches a reference packet loss rate; and
omitting the operation of counting the macro-blocks in the inter mode without a coefficient when the packet loss rate is above a certain value,
wherein the refresh rate is set by using the following equation:
REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 ,
wherein INT is an integer and PLR is a packet loss rate.
34. The method of claim 33, wherein the certain value is 50%.
35. The method of claim 33, wherein the refresh rate is set by selecting a random value between ‘0’ and 132 as an initial value of a random function.
Description
    BACKGROUND OF THE INVENTION
  • [0001]
    1. Field of the Invention
  • [0002]
    The present invention relates to a video transfer system, and more particularly, to an error recovery method of a video transfer system that is capable of preventing a disturbance of a picture quality caused due to a packet delay and a packet loss.
  • [0003]
    2. Description of the Background Art
  • [0004]
    In general, when a mobile image is provided for service on a real time basis through the Internet by using an instrument such as a video phone, a packet delay and a packet loss takes place due to a non-isochronous nature of the Internet, and accordingly, a phenomenon occurs that an image of a frame of the receiving party is broken.
  • [0005]
    The image-damaging phenomenon can be solved to a degree by a post-processing, that is, an error concealment, at the receiving party, but without a method for fundamentally recovering an error, it is difficult to provide a high quality real-time based mobile image service.
  • [0006]
    In an effort to over come the problem of the mobile image service due to the error concealment, there have been proposed error recovery methods such as a re-transmission of a mobile image or a forward error correction. However, these methods are not suitable for a real time processing because they cause a long packet delay time. That is, these methods can't be adopted to such an instrument of a video phone.
  • [0007]
    On the other hand, there has been also provided an intra coding method in which when macro-blocks having a coefficient are transmitted in a general H.263 standard defined as international standard systems of video compression encoding, the macro-block is forcefully encoded in an inter mode (a predictive frame encoding mode) for minimum every 123rd. Encoding the macro-block in an “intra” mode is called an “intra” update.
  • [0008]
    An original purpose of the intra encoding method was to prevent accumulation of a mismatch of an inverse discrete cosine transform (IDCT).
  • [0009]
    But owing to its characteristics that it is not necessary to refer a previous picture, it has been adopted to a system using the most predictive video encoding, so as to be used as an alternative to restore an error or remove a propagation of a temporal error.
  • [0010]
    However, the conventional intra encoding method has the following problem.
  • [0011]
    That is, since it considers only a situation with no packet loss, that is, a situation without an error, the intra encoding method is not proper to be adopted to a video transfer system (the video phone) as it is in the aspect of an effective error restoration.
  • [0012]
    In addition, in case of a video transfer system adopting the conventional intra encoding method has a problem that, in case of a quick motion or when a scene is changed, if an image block is broken to be come a background region (that is, a not coded block), the background region is not intra-updated.
  • [0013]
    That is, the when the macro-block with a coefficient is transmitted, the macro-block can not be forcefully encoded in an intra mode for every 132nd at minimum.
  • [0014]
    Moreover, since a video transfer system adopting the conventional intra encoding method has a fixed refresh rate irrespective of an image state (a picture quality state) of the receiving party, it is not suitable as an error restoration method for a high quality video transfer.
  • SUMMARY OF THE INVENTION
  • [0015]
    Therefore, an object of the present invention is to provide an error recovery method of a video transfer system that is capable of providing a mobile image of an excellent picture quality on a real time basis by controlling a refresh rate in consideration of a packet loss rate of a video frame and an image state of a receiving party.
  • [0016]
    To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described herein, there is provided an error recovery method of a video transfer system including the steps of: setting a refresh rate on the basis of a packet loss rate of a video frame; and encoding a macro-block of the video frame in an intra mode according to the set refresh rate.
  • [0017]
    The foregoing and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0018]
    The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.
  • [0019]
    In the drawings:
  • [0020]
    [0020]FIG. 1 is a graph showing an adaptive intra refresh rate in consideration of a packet loss rate of a video frame in accordance with a preferred embodiment of the present invention;
  • [0021]
    [0021]FIG. 2 is a drawing illustrating an algorithm of a method for counting macro-blocks in accordance with the preferred embodiment of the present invention; and
  • [0022]
    [0022]FIG. 3 is a graph showing an error recovery method of a video transfer system in accordance with the preferred embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • [0023]
    Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
  • [0024]
    Instead of a method of refreshing every 132th blocks with a coefficient when the blocks with a coefficient are transferred, an error recovery method of a video transfer system that is capable of considering a packet loss rate of a video frame and an image state of a receiving party and capable of providing a mobile image of an excellent picture quality on a real time basis will now be described with reference to FIGS. 1 through 3.
  • [0025]
    [0025]FIG. 1 is a graph showing an adaptive intra refresh rate in consideration of a packet loss rate of a video frame in accordance with a preferred embodiment of the present invention.
  • [0026]
    As shown in FIG. 1, as a packet loss rate (PLS) of a video frame is greater, an intra refresh rate becomes linearly small.
  • [0027]
    That is, as the packet loss rate (PLR) of a video frame becomes greater, the refresh rate is linearly small, so that an intra update rate is heightened.
  • [0028]
    For example, if a packet loss rate is 9% (that is, if there is no error), a refresh ratio is 132 (that is, when the 132th macro-block is transmitted, it is refreshed). If a packet loss rate is 50%, a refresh rate is 66 (that is, in case of 66th macro-block transmission, it is refreshed). If a packet loss rate 9s 100%, a refresh rate is 0.
  • [0029]
    In case of the 100% packet loss rate that every packet disappear, every macro-block is encoded in an intra mode.
  • [0030]
    In addition, in case of counting macro-blocks in an intra mode for refreshing, in the past, a count value of macro-blocks in the intra mode and a count value of macro-blocks in an inter mode having a coefficient (that is, a CODED block) were increased one by one.
  • [0031]
    However, comparatively, in the present invention, if the refresh rate is experimentally smaller than 66, that is, if a packet loss rate (PLR) is greater than 50%, macro-blocks in an inter (that is, NOT CODED) mode without a coefficient are counted and when the count value reaches a reference refresh rate, the macro-block in the inter mode is encoded.
  • [0032]
    In other words, if the packet loss rate (PLR) is greater than 50%, macro-blocks in an inter (that is, NOT CODED) mode with a coefficient are counted and when the count value reaches the reference refresh rate, the macro-blocks in the inter mode are encoded in an intra mode, so that a propagation of an error for the background region (NOT CODED block) (that is, an error block remains as a background region) in case of a great packet loss rate (PLR) can be prevented.
  • [0033]
    Meanwhile, in case that the packet loss rate (PLR) is smaller than 50%, a block without a coefficient (a background region) is not counted, so that the encoding efficiency (the encoding bit is increased in case of the intra update) is improved.
  • [0034]
    In addition, incase that the packet loss late (PLR) is smaller than 50%, a background region (a block with a coefficient) is not counted, so that a phenomenon that the background portion is blinking owing to the intra update can be prevented.
  • [0035]
    Though the macro-block (MB) refresh counting method is not defined in the H.263 standard, in the present invention, the macro-block is counted by using a random function so as to improve an efficiency of an error restoration. This will now be described with reference to FIG. 2.
  • [0036]
    [0036]FIG. 2 is a drawing illustrating an algorithm of a method for counting macro-blocks in accordance with the preferred embodiment of the present invention.
  • [0037]
    As shown in FIG. 2, a random value between a minimum value (0) and a maximum (132) is selected as an initial value of the random function, in order to set a refresh rate.
  • [0038]
    Namely, by using a random value between ‘0’ and 132 as an initial value, the macro-blocks within a video frame are randomly updated, rather than being sequentially updated, so that the picture quality can be improved.
  • [0039]
    [0039]FIG. 3 is a graph showing an error recovery method of a video transfer system in accordance with the preferred embodiment of the present invention.
  • [0040]
    As shown in FIG. 3, a packet loss rate (PLR) of the video frame is set, and the set packet loss rate (PLR) is substituted for the below equation 1 to control a refresh rate. The packet loss rate (PLR) is transmitted from the receiving party. REFRESH_RATE = INT [ - ( 132 100 ) PLR ] + 132 equation ( 1 )
  • [0041]
    wherein INT is an integer and the PLR is a packet loss rate. That is, if the packet loss rate (PLR) is high, the refresh rate is controlled to be small, so that the number of macro-blocks to be intra-updated is increased.
  • [0042]
    Accordingly, the propagation of error can be adaptively prevented according to the packet loss rate (PLR), and at the same time, the error restroation (that is, the macro-blocks are counted by using the random function) is performed to thereby improve the picture quality.
  • [0043]
    As so far described, the error recovery method of a video transfer system of the present invention has many advantages.
  • [0044]
    That is, for example, since the effective intra encoding method in consideration of the packet loss rate is provided, the image state of the receiving party can be taken into consideration and a mobile image service of a high picture quality can be provided on a real time basis.
  • [0045]
    In addition, since the error recovery method of a video transfer system of the present invention has the flexible refresh rate considering the image state (the picture quality state) of the receiving party, it is suitable for the error recovery method for a high picture quality video transferring.
  • [0046]
    As the present invention may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the meets and bounds of the claims, or equivalence of such metes and bounds are therefore intended to be embraced by the appended claims.
Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US6151636 *Feb 5, 1998Nov 21, 20003Com CorporationData and media communication through a lossy channel using signal conversion
US20010026677 *May 2, 2001Oct 4, 2001General Instrument CorporationMethods and apparatus for transcoding progressive I-slice refreshed MPEG data streams to enable trick play mode features on a television appliance
US20020172283 *Dec 14, 2000Nov 21, 2002Hirokazu KawakatsuMoving image encoding apparatus
US20030031128 *Mar 5, 2002Feb 13, 2003Jin-Gyeong KimSystems and methods for refreshing macroblocks
US20040114684 *Jan 3, 2002Jun 17, 2004Marta KarczewiczSwitching between bit-streams in video transmission
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US7617436Aug 2, 2005Nov 10, 2009Nokia CorporationMethod, device, and system for forward channel error recovery in video sequence transmission over packet-based network
US7796499May 7, 2004Sep 14, 2010Telefonaktiebolaget L M Ericsson (Publ)Method of and system for video fast update
US8355449 *Dec 30, 2009Jan 15, 2013Nvidia CorporationSystem and method for intra refresh implementation with pseudo random number generation
US8437405Dec 8, 2004May 7, 2013Nvidia CorporationSystem and method for intra refresh implementation
US8665318Mar 16, 2010Mar 4, 2014Google Inc.Digital video coding
US8761253May 28, 2008Jun 24, 2014Nvidia CorporationIntra prediction mode search scheme
US8780984Jul 1, 2011Jul 15, 2014Google Inc.Loss-robust video transmission using plural decoders
US8831099Dec 17, 2008Sep 9, 2014Nvidia CorporationSelecting a macroblock encoding mode by using raw data to compute intra cost
US8838680Aug 10, 2011Sep 16, 2014Google Inc.Buffer objects for web-based configurable pipeline media processing
US8907821Jun 5, 2012Dec 9, 2014Google Inc.Apparatus and method for decoding data
US8929443Jan 9, 2009Jan 6, 2015Microsoft CorporationRecovering from dropped frames in real-time transmission of video over IP networks
US9014265Jan 5, 2012Apr 21, 2015Google Inc.Video coding using edge detection and block partitioning for intra prediction
US9042261Feb 7, 2014May 26, 2015Google Inc.Method and device for determining a jitter buffer level
US9078015Jan 13, 2014Jul 7, 2015Cable Television Laboratories, Inc.Transport of partially encrypted media
US9210424Feb 28, 2013Dec 8, 2015Google Inc.Adaptive prediction block size in video coding
US9293119Jan 6, 2014Mar 22, 2016Nvidia CorporationMethod and apparatus for optimizing display updates on an interactive display device
US9313493Jun 27, 2013Apr 12, 2016Google Inc.Advanced motion estimation
US9383851Jan 6, 2014Jul 5, 2016Nvidia CorporationMethod and apparatus for buffering sensor input in a low power system state
US9432674Feb 2, 2009Aug 30, 2016Nvidia CorporationDual stage intra-prediction video encoding system and method
US9804826Dec 5, 2014Oct 31, 2017Nvidia CorporationParallelization of random number generators
US9807416Sep 21, 2015Oct 31, 2017Google Inc.Low-latency two-pass video coding
US20050138529 *May 7, 2004Jun 23, 2005Per ThorellMethod of and system for video fast update
US20070033494 *Aug 2, 2005Feb 8, 2007Nokia CorporationMethod, device, and system for forward channel error recovery in video sequence transmission over packet-based network
US20090296813 *May 28, 2008Dec 3, 2009Nvidia CorporationIntra prediction mode search scheme
US20100128788 *Dec 30, 2009May 27, 2010Nvidia CorporationSystem and method for intra refresh implementation with pseudo random number generation
US20100150237 *Dec 17, 2008Jun 17, 2010Nvidia CorporationSelecting a macroblock encoding mode
US20100177776 *Jan 9, 2009Jul 15, 2010Microsoft CorporationRecovering from dropped frames in real-time transmission of video over ip networks
US20100195730 *Feb 2, 2009Aug 5, 2010Nvidia CorporationDual stage intra-prediction video encoding system and method
US20100238268 *Mar 16, 2010Sep 23, 2010On2 Technologies Finland OyDigital video coding
CN102547411A *Dec 14, 2010Jul 4, 2012康佳集团股份有限公司Method for transmitting and playing streaming video, and implementation device thereof
CN102572446A *Jan 10, 2012Jul 11, 2012宁波大学Method for concealing entire frame loss error of multi-view video
WO2005055614A1 *Dec 2, 2004Jun 16, 2005Telefonaktiebolaget L M Ericsson (Publ)Method of and system for video fast update
WO2007015125A1 *May 29, 2006Feb 8, 2007Nokia CorporationMethod, device and system for forward channel error recovery in video sequence transmission over packet-based network
WO2012006238A2 *Jul 1, 2011Jan 12, 2012Google Inc.Loss-robust video transmission using two decoders
WO2012006238A3 *Jul 1, 2011Apr 26, 2012Google Inc.Loss-robust video transmission using two decoders
Classifications
U.S. Classification375/240.12, 375/E07.016, 375/E07.013, 375/240.01, 375/240.24, 375/E07.281
International ClassificationH04N19/895, H04N21/2662, H04N21/658, H04N21/24, H04N21/6377, H04N7/12
Cooperative ClassificationH04N19/895, H04N21/2662, H04N21/2402
European ClassificationH04N21/2662, H04N21/24D, H04N21/658, H04N21/6377, H04N7/68
Legal Events
DateCodeEventDescription
Mar 14, 2002ASAssignment
Owner name: LG ELECTRONICS INC., KOREA, REPUBLIC OF
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:JEONG, YEONG AN;REEL/FRAME:012711/0796
Effective date: 20020311
Mar 23, 2009REMIMaintenance fee reminder mailed
Sep 13, 2009LAPSLapse for failure to pay maintenance fees
Nov 3, 2009FPExpired due to failure to pay maintenance fee
Effective date: 20090913