CA2244472C - Circuit for synchronizing picture and method therefor - Google Patents
Circuit for synchronizing picture and method therefor Download PDFInfo
- Publication number
- CA2244472C CA2244472C CA 2244472 CA2244472A CA2244472C CA 2244472 C CA2244472 C CA 2244472C CA 2244472 CA2244472 CA 2244472 CA 2244472 A CA2244472 A CA 2244472A CA 2244472 C CA2244472 C CA 2244472C
- Authority
- CA
- Canada
- Prior art keywords
- picture
- dts
- pts
- value
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
Abstract
A picture decoding synchronizing circuit and a picture decoding synchronizing method are provided. When the decoding synchronization is controlled in units of a picture, in a variable length decoder using the transferred PTS and DTS information, the value obtained by adding the previous DTS to an offset is determined to be the DTS value of the current picture, if errors are generated in the transferred PTS and DTS, considering the errors of the transferred bit stream. If no errors are generated in the PTS or DTS, then the transferred PTS and DTS are determined to be the DTS value of the current picture. By controlling the picture decoding using the determined DTS value, the bit buffer does not underflow or overflow and the decoded data is displayed naturally on a screen.
Description
CIRCUIT FOR SYNCHRONIZING PICTURE AND METHOD THEREFOR
BACKGROUND OF THE INVENTION
1. Field of the Invention The present invention relates to a video decoder, and more particularly, to a s circuit for synchronizing a picture for controlling a decoding synchronism in units of a picture so as not to underflow or overflow a bit buffer for a variable length decoder (VLD), and a method therefor.
BACKGROUND OF THE INVENTION
1. Field of the Invention The present invention relates to a video decoder, and more particularly, to a s circuit for synchronizing a picture for controlling a decoding synchronism in units of a picture so as not to underflow or overflow a bit buffer for a variable length decoder (VLD), and a method therefor.
2. Description of the Related Art In the MPEG-2 (moving picture experts group) system, a picture may be an I (intro-coded) picture, a B (bidirectionally predictive-coded) picture, and a P
(predictive-coded) picture. The MPEG-2 video is coded in units of a frame or units of a field. The I picture~can be decoded regardless of other pictures. The P
picture can be decoded from preceding I or P pictures. The B picture can be decoded from preceding 1 or P pictures and successive I or P pictures. When the ~s input includes all of I, B, and P pictures, it is possible to restore an original picture only by appropriately controlling decoding timing and output timing so the decoding order is dififerent from the output (display) order.
FIG. 1 is a block diagram of a video decoder for describing a conventional picture decoding synchronizing method. In FIG. 1, a packetized elementary Zo stream (PES) decoder 10 parses an input PES stream, outputs a video elementary stream to a bit buffer 20, and outputs a presentation time stamp (PTS) and a decoding time stamp (DTS) to a variable length decoder (VLD) 30. The VLD 30 receives the video elementary stream output from the bit buffer 20 in units of a picture (frame) and determines the point of time at which the picture is to be is decoded according to the parsed PTS and DTS. When both the PTS and the DTS
exist, the DTS is determined to indicate the point in time at which the picture is decoded. When only the PTS exists, the PTS is determined to indicate the point in time at which the picture is decoded.
When the decoding point of time of the picture unit is determined by the VLD 30 using only the PTS and the DTS output from the PES decoder 10, problems occur if the PES stream is damaged by undesirable states such as an error in a transmission channel with respect to the transferred bit stream. If the damaged portion is the PTS or the DTS, the decoding order and the output order s do not coincide with the original decoding order and the output order when the picture decoding is synchronized in units of a picture in the VLD 30 according to the damaged PTS and DTS.
Namely, it is determined whether a predetermined number of pictures are to be discarded without being decoded or the pictures are to be held for a predetermined time in the VLD 30 according to the deviation between the original PTS and DTS and the erroneous PTS and DTS. Accordingly, an unattractive result is obtained when the decoded output is displayed on a screen.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a picture decoding ~s synchronizing circuit, in which a bit buffer does not overflow or underflow because a picture is decoded using a presentation time stamp (PTS) and a decoding time stamp (DTS) if they are undamaged, and otherwise not using them, in a video decoder.
It is another object of the present invention to provide a picture decoding zo method in which the PTS and the DTS are used if they are undamaged, and otherwise not used.
To achieve the first object, there is provided a picture decoding synchronizing circuit, comprising a detector for detecting whether a presentation time stamp (PTS) and a decoding time stamp (DTS) which are transferred through zs an input bit stream are distorted by errors, end outputting a detect signal, a determiner for determining DTS value using a transferred PTS and DTS if no errors are detected from the transferred PTS and DTS according to the detect signal, and determining the DTS value using the value obtained by adding the DTS value of a previous picture to a predetermined offset value, if errors are 3o detected, and a decoder for decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
To achieve the second object, there is provided A picture decoding synchronizing method, comprising the steps of (a) determining whether a presentation time stamp (PTS) and a decoding time stamp (DTS), transferred through an input bit stream, are distorted, (b) determining DTS value using a s transferred PTS and the DTS if no errors are detected in the transferred PTS
and DTS, according to a detect signal, and otherwise, determining the DTS value by adding the DTS value of a previous picture to an offset value, and (c) decoding the input bit stream in units of a picture, in synchronization with a determined DTS
value.
~o BRIEF DESCRIPTION OF THE DRAWINGS
The above objects and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which:
FIG. 1 is a block~diagrarn of a video decoder for describing a conventional ~s picture decoding synchronizing circuit;
FIG. 2 is a block diagram of a picture decoding synchronizing circuit according to an embodiment of the present invention;
FIG. 3 shows a state of the operation of the picture decoding synchronizing circuit shown in FIG. 2 when the PTS and the DTS are normal; and Zo FIG. 4 shows a state of the operation of the picture decoding synchronizing circuit shown in FIG. 2 when there are errors in the PTS and the DTS.
DESCRIPTION OF THE PR~FEF~RED EMBODIMENTS
Hereinafter, preferred embodiments of a picture decoding synchronizing circuit and a picture decoding synchronizing method according to the present zs invention will be described with reference to the attached drawings.
In FIG. 2, when a packeted elementary stream (PES) is input to a PES
decoder 100, the PES decoder 100 parses the PES stream, selects only the PES
packet corresponding to a video elementary stream, removes the header of the selected PES packet, and outputs a video elementary stream. The video 3o elementary stream is written to a bit buffer 110 and is read according to a hold signal and a skip signal, which will be described below.
A variable length decoder (VLD) 120 outputs the signals defined by an MPEG-2 syntax, which are a picture structure (pic struct) signal showing whether a transferred picture is a frame unit or a field unit, a group of pictures (GOP) s header detect(gop_hd det) signal for indicating that a GOP is detected, a temporal reference (tem ref) information showing the order in which the pictures existing in the GOP are displayed, a picture type (pic_type) signal showing whether the pictures input to the VLD 120 are I picture, P picture, or B picture, and a picture header detect (pic hd det) signal indicating that a picture header is detected.
A picture counter 130 receives the picture structure (pic struct) signal, the GOP header detect (gop_hd det) signal, and a picture header detect (pic hd det) signal and counts them in units of a picture. Namely, counting is performed in synchronization with the picture header detect (pic hd detect) signal. If the picture structure (pict struct) signal is "3" (referring to a frame picture), the court value is incremented when every picture header detect(pic hd detect) signal is detected. If not (referring to a field picture), the count value is incremented when every two picture header detect (pic hd detect) signals are detected. Also, the picture counter 130 is synchronized with the picture header detect (pic hd detect) signal and resets the count value to "0" when the GOP header detect Zo (gop hd detect) signal is input. Namely, the picture counter 130 is reset every GOP unit and counts the number of pictures in the GOP.
A DTS generator 150 generates decoded DTS (decoded dts) values used for a decoding in the VLD 120 using the DTS and the PTS parsed by the PES
decoder 100 and a DTS mask (dts mask) signal generated by a mask generator 25 140, and latches it according to the picture header detect (pic hd detect) signal output from the VLD 120.
The mask generator 140 generates the DTS mask (dts mask) signal using the picture type (pic type) signal and the temporal reference (temp ref) information output from the VLD 120, the picture count (pic count) value counted 3o in the picture counter 130 and the decoded DTS (decoded dts) value generated by the DTS generator 150. The DTS mask (dts mask) signal is for showing that errors are generated in the transferred PTS and DTS, and is active from the point in time at which the errors are generated in the transferred PTS and DTS to the point in time at which the first picture (the I picture) of the GOP in which errors are not generated in the transferred PTS and DTS. This will be described in more detail in FIG. 4.
s Since the decoded DTS (decoded dts) value of the current picture is latched according to the picture header detect (plc hd detect) signal in the DTS
generator 150, it is determined whether the DTS mask (dts mask) signal is to be set or reset in the mask generator 140 after the picture header detect (plc hd detect) signal is detected and after a delay of one or two clock cycles.
The decoded DTS (decoded dts) value generated in this way is applied to a subtracter 170. A latch 160 latches a system time clock (STC) increasing at a rate of 90KHz per second (synchronized with a program clock reference (PCR) loaded in the header of a transport packet stream). The subtracter 170 subtracts the decoded DTS (decoded dts) value from the stc value latched in the latch 160, ~s compares the absolute bf the subtracted result with a threshold value, and outputs the compared result to a hold determiner 180 and a skip determiner 190. Here, the threshold value is a predetermined constant (900) and is a limiting value showing the range within which a hold or a skip is allowed.
The hold determiner 180 generates a hold signal for commanding not to zo continue a decoding and to hold, on the basis of the compared result, and outputs the hold signal to the VLD 120. The skip determiner 190 generates a skip signal for commanding not to decode the current picture and discard it, on the basis of the compared result, and outputs the skip signal to the VLD 120.
The point in time at which the hold determiner 180 and the skip determiner zs 190 must determine whether the current picture is to be held or skipped is the point in time at which a plurality of clocks are delayed after the picture header detect (plc hd detect) signal is detected. At this point in time, the hold signal or the skip signal is generated.
A method for determining whether the PTS and the DTS parsed in the PES
3o decoder 100 are distorted by errors, and a method for decoding a picture in synchronization with the DTS value determined in units of a picture, without generating overflow or underflow in the bit buffer 110 in the VLD 120 using the DTS of a picture unit determined according to whether the PTS and DTS have errors, will be described with reference to FIGs. 3 and 4. In the present invention, when the PTS and the DTS are found to be distorted by the errors, they will not be used.
s First, there is the following relationship between the PTS and the DTS, transferred as part of the header of the PES. The DTS is detected in the PES
header and shows when the picture corresponding thereto is to be decoded on the video elementary stream which is the output of the PES decoder 100. The PTS is detected from the PES header and shows when the picture corresponding thereto is to be displayed on a screen. The PTS i~ necessary since the displaying order is different from the decoding order, according to the kind of picture.
The relationship between the DTS and the PTS is determined by the following rule. The relationship between the DTS and the PTS of the I and P
pictures is variable according to the number of B pictures. The DTS and the PTS
are identical in the B picture. The DTS increases with a certain offset in every picture. The offset value is related to the frame rate of the decoded elementary bit stream. For example, when the frame rate is 30, the offset is 90,000130, i.e., 3,000. Here, 90,000 denotes the 90KHz clock used in a video encoder, which is not shown. When the DTS is determined, the PTS is determined by the following Zo equation 1.
[Equation 1]
PTS=N+(temporalreference + 1)xoffset Wherein the offset is 3,000 and N represents the DTS value of the first picture. The temporal reference represents the order in which the pictures existing is in the GOP are displayed.
For example, when nine pictures exist in an arbitrary GOP and two B
pictures exist between the reference pictures (I or P pictures) as shown in FIG.
3(a), the temporal reference information is 2-~0--~1-i5--~3-~4-~8-~6-~7. Here, FIG. 3(a) shows the occupancy of data according to the order in which pictures are input to 3o the bit buffer 110. In "12", I and 2 respectively denote an I picture and the temporal reference information.
FIGs. 3(b) and 3(c) respectively show the DTS and the PTS determined in the video encoder with respect to arbitrary pictures. For example, when the DTS
of the I picture (which is the first picture of the GOP) is N, the DTS of the picture becomes N+3XM and the PTS becomes N+6XM.
In FIGs. 3(d) through 3(h) the picture is ideally decoded by the VLD 120 in s synchronization with the DTS when there is no error in the transferred bit stream, namely, there are no errors in the PTS and the DTS.
In the video encoder, the PTS and the DTS are all transferred in the video encoder only when the values thereof are different from each other in an arbitrary picture. Only the PTS is transferred when the values are equal. Therefore, the DTS is not transferred with respect to the B picture. However, the DTS cannot be transferred without the PTS. The PTS and the DTS do not have to be transferred in every picture. According to the MPEG-2 specification, they only have to be transferred at least once every 0.7sec.
The picture header detect (pic hd det) signal shown in FIG. 3(d) is generated when the decoding of the picture headers is completed in the VLD
120.
The .PTS and the DTS parsed by the PES decoder 100 shown in FIGs. 3(e) and 3(f) are latched according to the picture header detect (pic hd det) signal in the DTS generator 150.
An elementary picture decoding method in a normal state in which there are Zo no errors in the PTS and the DTS is as follows. When the PTS and the DTS of an arbitrary picture are both transferred, the DTS generator 150 determines the DTS
to be the DTS of the picture. When only the PTS is transferred, the DTS
generator 150 determines the PTS to be the DTS and generates the decoded DTS
(decoded dts) value. With respect to the picture not having the PTS and the DTS, 25 the DTS generator 150 determines the value obtained by adding the DTS of the previous picture to the offset as the DTS of the present picture and outputs the decoded DTS (decoded dts) value. As a result, the finally determined DTS is the same as the DTS determined in the video encoder shown in FIG. 3(c).
Also, the latch 160 latches the STC increasing at the rate of 90KHz per 3o second in synchronization with the program code reference (PCR) included in the header of a transport stream (TS) by the picture header detect (pic hd det) signal.
The subtracter 170 subtracts the decoded DTS value from the latched STC value.
When the value is negative, the decoding in the VLD 120 is delayed. When the value is positive, the current picture is not decoded and is discarded.
The subtracter 170 determines whether the result obtained by subtracting the decoded DTS value from the STC value is larger than a threshold value (900).
s For this, the absolute value of the subtraction result is obtained, the absolute value is subtracted from the threshold value, and it is determined whether the result is negative or positive. When the value is positive, since the absolute value is smaller than the threshold value, no hold or skip is generated. When the value is negative, a hold or skip may be generated. After subtracting the absolute value from the threshold value, it is determined whether the skip signal for skipping the current picture or the hold signal for delaying the current picture is to be generated at the point in time (FIG. 3(g)) at which the picture header detect (pic hd det) signal is delayed by a predetermined number of clock cycles.
When a hold signal of logic "low" is generated by the hold determiner 180 as shown in FIG. 3(h) d't the point in time (FIG. 3(g)) a predetermined number of clock cycles after the picture header detect {pic hd det) signal, on the basis of the output of the subtracter 170, the decoding of the input picture is delayed in the VLD 120. When the skip signal is generated by the skip generator 190 after a delay of a determined number of clock cycles from the picture header detect zo (pic hd det) signal, on the bases of the output of the subtracter 170, the does not decode and discards the current pictures input when the skip signal is generated. In FIG. 3, the hold is generated for every picture.
When the VLD 120 completes the decoding of a picture within an offset period, the value obtained by subtracting the decoded DTS value from the STC
zs value is negative. When the absolute value of the subtraction result is outside the range of the threshold value, the VLD 120 generates the hold signal and controls the decoding period of a picture to 1lpicture rate. On the other hand, when the VLD 120 does not complete the decoding of a picture within an offset period, the value obtained by subtracting the decoded DTS value from the STC value is 3o positive. When the absolute value of the subtraction result is outside the range of the threshold value, the VLD 120 generates the skip signal, and does not decode the picture but instead discards it.
So far, a method has been described of synchronizing the decoding of the picture unit in the VLD using the PTS and the DTS in a normal state. From now on, a picture decoding synchronizing method using the PTS and the DTS
considering the errors, which is the purpose of the present invention, will be s described.
The transferred PTS and DTS may not be detected by the PES decoder 100 due to errors. Also, the transferred PTS and DTS may be detected in the PES decoder 100, but erroneously, due to errors.
In the former case, when the picture of the elementary stream corresponding to the undetected PTS and DTS is not damaged by errors, the VLD
120 determines that there is no time stamp in the picture and decodes the picture using the value obtained by adding the DTS of the previous picture to the offset value as the DTS of the picture. When the picture is discarded by the VLD 120 due to error, the hold is generated in the picture corresponding to the PTS
and the ~s DTS according to the PTS and the DTS found in the successive picture, so only as many pictures are undetected by the VLD 120 are not decoded.
However, in the latter case, the problem is serious if the transferred PTS
and DTS are much larger than the original value. Since the PTS and the DTS
have the value of 33 bits, though the PTS and DTS is one bit which is close to the Zo most significant bit (MSB), if the PTS and DTS which is "0" is wrongly detected as "1", there exists a very big difference between the threshold value and the value obtained by subtracting the decoded DTS value from the STC value in the subtracter 170. The decoding can be held for a long time. When the transferred PTS and DTS are smaller than the original value, though the value obtained by is subtracting the decoded DTS value from the STC value is very large, the pictures are skipped until the PTS and the DTS are found. Accordingly, the PTS and DTS
are not seriously affected.
In the present invention, the temporal reference information (tem ref), the picture counter 130, the mask generator 1~0, and the DTS generator 150 are used 3o as shown in FIG. 2 against the case in which the transferred PTS and DTS
are much larger than the original value, as in the latter case. The picture counter 130 performs counting in synchronization with the picture header detect (pic hd det) signal output from the VLD 120. The picture counter 130 is reset to "0" at the first picture in the GOP and increases by "1" at other pictures.
The relationship established among the PTS, the DTS, the temporal reference information, and the output of the picture counter in a GOP is shown in s the following equations 2 and 3.
[Equation 2]
PTS=transferred DTS+(temporal reference -picture count value + 1 ) xoffset [Equation 3]
transferred DTS=previous DTS+offset When the picture input to the VLD 120 is an I or P picture, the condition of equation 2 is not satisfied. When the picture input to the VLD 120 is a B
picture, the condition of equation 3 is not satisfied. Namely, when the current input picture does not satisfy the condition of equations 2 or 3, the PTS and the DTS
transferred from the current input picture to the final picture of the GOP are not used. Also, when the fast picture of the successive GOP is an I picture, the PTS
and xhe DTS exist, and the above conditions are not satisfied, the PTS and the DTS continuously transferred to the GOP are not used. Namely, the PTS and the DTS transferred to all the pictures are discarded until the first picture of the GOP
satisfying the conditions is found.
Zo According to the MPEG specification, the first picture of the GOP is an I
picture. In an I picture, if a time stamp exists, then the PTS and the DTS
must also exist. In FIG. 4, such a relationship is described, employing arbitrary numbers. The transferred PTS and DTS are not detected in the PES decoder 100 due to the errors. The bits of the pictures corresponding to the PTS and the DTS
is are discarded in the VLD 120 due to the errors.
Namely, as shown in FIG. 4(a), the PTS and the DTS of the pictures corresponding to P5 are not transferred and the bits are damaged and discarded in the VLD 120. The PTS of the following B3 picture is detected and the picture header corresponding to the picture is detected. The picture header detect 30 (pic hd det) signal is generated as shown in FIG. 4(b).
Since the transferred PTS is 45,000 as shown in FIG. 4(c) and the picture is a B picture, the DTS generator 150 interprets the PTS as the DTS value.
FIG.
4(d) shows the transferred DTS. FIG. 4(e) shows the value obtained by counting the pictures in the picture counter 130 according to the picture structure (pic struct) signal and the picture header detect (pic he det) signal output from the VLD 120.
s Since the DTS value decoded by the DTS generator 150 with respect to the B3 picture does not satisfy the condition of equation 3, the mask generator generates the DTS mask signal (dts mask) shown in FIG. 4(f) as an active signal of logic "low". The DTS mask (dts mask) signal is maintained in the logic "low"
state until the first I picture of the successive GOP satisfies all the conditions of equations 2 and 3. When the DTS mask (dts mask) signal is in the logic "low"
state, the value obtained by adding the DTS of the previous picture to the offset is used as the decoded DTS value whenever the picture header detect signal is found, without employing the transferred PTS or DTS. Therefore, the DTS
generator 150 outputs the decoded DTS (decoded dts) value as shown in FIG.
4(g).
In the following GOP, when the PTS and the DTS of the first I picture satisfy the conditions of equations 2 and 3, the DTS mask (dts mask) signal is logic "high" in the first I picture of the GOP. The transferred DTS of the first I
picture is decoded as the DTS of the I picture. The VLD 120 performs decoding, ~o holding, or skipping in units of a picture, according to the value obtained by subtracting the decoded DTS value from the STC value and the threshold value when the DTS mask (dts mask) signal is logic "low". When the DTS mask (dts mask) signal shown in FIG. 4(f) is logic "high", the I picture is held as much as the absolute value of the value obtained by subtracting the decoded DTS
value is from the STC value (3,900 in FIG. 4(i)). This is because the value obtained by subtracting the decoded DTS value from the STC value becomes larger than the number of pictures discarded due to the errors in the VLD 120 (1 (P5) in FIG.
4) X
the offset (-3,900 in FIG. 4(i).
FIG. 4(h) shows the STC value latched by the latch 160 according to the 3o picture header detect (pic hd det) signal. FIG. 4(i) shows the value obtained by subtracting the DTS value decoded by the DTS generator 150 from the STC value latched in the latch 160. FIG. 4(j) shows the threshold value (900).
Since the VLD 120 completes decoding all the pictures in a GOP within 3,000, which is the offset value, the value obtained by subtracting the decoded DTS value from the STC is negative as shown in FIG. 4(i). If the absolute value of the subtraction result is outside the range of the threshold value at the s determining point in time shown in FIG. 4(k), the skip or hold is generated.
If not, the decoding is continuously performed. In FIG. 4(i), the VLD 120 temporarily stops when the hold signal of logic "low" is generated by the hold determiner 180.
In the present invention, even when there are errors in the transferred DTS
and PTS, the decoded image data displayed naturally on a screen.
Y
(predictive-coded) picture. The MPEG-2 video is coded in units of a frame or units of a field. The I picture~can be decoded regardless of other pictures. The P
picture can be decoded from preceding I or P pictures. The B picture can be decoded from preceding 1 or P pictures and successive I or P pictures. When the ~s input includes all of I, B, and P pictures, it is possible to restore an original picture only by appropriately controlling decoding timing and output timing so the decoding order is dififerent from the output (display) order.
FIG. 1 is a block diagram of a video decoder for describing a conventional picture decoding synchronizing method. In FIG. 1, a packetized elementary Zo stream (PES) decoder 10 parses an input PES stream, outputs a video elementary stream to a bit buffer 20, and outputs a presentation time stamp (PTS) and a decoding time stamp (DTS) to a variable length decoder (VLD) 30. The VLD 30 receives the video elementary stream output from the bit buffer 20 in units of a picture (frame) and determines the point of time at which the picture is to be is decoded according to the parsed PTS and DTS. When both the PTS and the DTS
exist, the DTS is determined to indicate the point in time at which the picture is decoded. When only the PTS exists, the PTS is determined to indicate the point in time at which the picture is decoded.
When the decoding point of time of the picture unit is determined by the VLD 30 using only the PTS and the DTS output from the PES decoder 10, problems occur if the PES stream is damaged by undesirable states such as an error in a transmission channel with respect to the transferred bit stream. If the damaged portion is the PTS or the DTS, the decoding order and the output order s do not coincide with the original decoding order and the output order when the picture decoding is synchronized in units of a picture in the VLD 30 according to the damaged PTS and DTS.
Namely, it is determined whether a predetermined number of pictures are to be discarded without being decoded or the pictures are to be held for a predetermined time in the VLD 30 according to the deviation between the original PTS and DTS and the erroneous PTS and DTS. Accordingly, an unattractive result is obtained when the decoded output is displayed on a screen.
SUMMARY OF THE INVENTION
It is an object of the present invention to provide a picture decoding ~s synchronizing circuit, in which a bit buffer does not overflow or underflow because a picture is decoded using a presentation time stamp (PTS) and a decoding time stamp (DTS) if they are undamaged, and otherwise not using them, in a video decoder.
It is another object of the present invention to provide a picture decoding zo method in which the PTS and the DTS are used if they are undamaged, and otherwise not used.
To achieve the first object, there is provided a picture decoding synchronizing circuit, comprising a detector for detecting whether a presentation time stamp (PTS) and a decoding time stamp (DTS) which are transferred through zs an input bit stream are distorted by errors, end outputting a detect signal, a determiner for determining DTS value using a transferred PTS and DTS if no errors are detected from the transferred PTS and DTS according to the detect signal, and determining the DTS value using the value obtained by adding the DTS value of a previous picture to a predetermined offset value, if errors are 3o detected, and a decoder for decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
To achieve the second object, there is provided A picture decoding synchronizing method, comprising the steps of (a) determining whether a presentation time stamp (PTS) and a decoding time stamp (DTS), transferred through an input bit stream, are distorted, (b) determining DTS value using a s transferred PTS and the DTS if no errors are detected in the transferred PTS
and DTS, according to a detect signal, and otherwise, determining the DTS value by adding the DTS value of a previous picture to an offset value, and (c) decoding the input bit stream in units of a picture, in synchronization with a determined DTS
value.
~o BRIEF DESCRIPTION OF THE DRAWINGS
The above objects and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which:
FIG. 1 is a block~diagrarn of a video decoder for describing a conventional ~s picture decoding synchronizing circuit;
FIG. 2 is a block diagram of a picture decoding synchronizing circuit according to an embodiment of the present invention;
FIG. 3 shows a state of the operation of the picture decoding synchronizing circuit shown in FIG. 2 when the PTS and the DTS are normal; and Zo FIG. 4 shows a state of the operation of the picture decoding synchronizing circuit shown in FIG. 2 when there are errors in the PTS and the DTS.
DESCRIPTION OF THE PR~FEF~RED EMBODIMENTS
Hereinafter, preferred embodiments of a picture decoding synchronizing circuit and a picture decoding synchronizing method according to the present zs invention will be described with reference to the attached drawings.
In FIG. 2, when a packeted elementary stream (PES) is input to a PES
decoder 100, the PES decoder 100 parses the PES stream, selects only the PES
packet corresponding to a video elementary stream, removes the header of the selected PES packet, and outputs a video elementary stream. The video 3o elementary stream is written to a bit buffer 110 and is read according to a hold signal and a skip signal, which will be described below.
A variable length decoder (VLD) 120 outputs the signals defined by an MPEG-2 syntax, which are a picture structure (pic struct) signal showing whether a transferred picture is a frame unit or a field unit, a group of pictures (GOP) s header detect(gop_hd det) signal for indicating that a GOP is detected, a temporal reference (tem ref) information showing the order in which the pictures existing in the GOP are displayed, a picture type (pic_type) signal showing whether the pictures input to the VLD 120 are I picture, P picture, or B picture, and a picture header detect (pic hd det) signal indicating that a picture header is detected.
A picture counter 130 receives the picture structure (pic struct) signal, the GOP header detect (gop_hd det) signal, and a picture header detect (pic hd det) signal and counts them in units of a picture. Namely, counting is performed in synchronization with the picture header detect (pic hd detect) signal. If the picture structure (pict struct) signal is "3" (referring to a frame picture), the court value is incremented when every picture header detect(pic hd detect) signal is detected. If not (referring to a field picture), the count value is incremented when every two picture header detect (pic hd detect) signals are detected. Also, the picture counter 130 is synchronized with the picture header detect (pic hd detect) signal and resets the count value to "0" when the GOP header detect Zo (gop hd detect) signal is input. Namely, the picture counter 130 is reset every GOP unit and counts the number of pictures in the GOP.
A DTS generator 150 generates decoded DTS (decoded dts) values used for a decoding in the VLD 120 using the DTS and the PTS parsed by the PES
decoder 100 and a DTS mask (dts mask) signal generated by a mask generator 25 140, and latches it according to the picture header detect (pic hd detect) signal output from the VLD 120.
The mask generator 140 generates the DTS mask (dts mask) signal using the picture type (pic type) signal and the temporal reference (temp ref) information output from the VLD 120, the picture count (pic count) value counted 3o in the picture counter 130 and the decoded DTS (decoded dts) value generated by the DTS generator 150. The DTS mask (dts mask) signal is for showing that errors are generated in the transferred PTS and DTS, and is active from the point in time at which the errors are generated in the transferred PTS and DTS to the point in time at which the first picture (the I picture) of the GOP in which errors are not generated in the transferred PTS and DTS. This will be described in more detail in FIG. 4.
s Since the decoded DTS (decoded dts) value of the current picture is latched according to the picture header detect (plc hd detect) signal in the DTS
generator 150, it is determined whether the DTS mask (dts mask) signal is to be set or reset in the mask generator 140 after the picture header detect (plc hd detect) signal is detected and after a delay of one or two clock cycles.
The decoded DTS (decoded dts) value generated in this way is applied to a subtracter 170. A latch 160 latches a system time clock (STC) increasing at a rate of 90KHz per second (synchronized with a program clock reference (PCR) loaded in the header of a transport packet stream). The subtracter 170 subtracts the decoded DTS (decoded dts) value from the stc value latched in the latch 160, ~s compares the absolute bf the subtracted result with a threshold value, and outputs the compared result to a hold determiner 180 and a skip determiner 190. Here, the threshold value is a predetermined constant (900) and is a limiting value showing the range within which a hold or a skip is allowed.
The hold determiner 180 generates a hold signal for commanding not to zo continue a decoding and to hold, on the basis of the compared result, and outputs the hold signal to the VLD 120. The skip determiner 190 generates a skip signal for commanding not to decode the current picture and discard it, on the basis of the compared result, and outputs the skip signal to the VLD 120.
The point in time at which the hold determiner 180 and the skip determiner zs 190 must determine whether the current picture is to be held or skipped is the point in time at which a plurality of clocks are delayed after the picture header detect (plc hd detect) signal is detected. At this point in time, the hold signal or the skip signal is generated.
A method for determining whether the PTS and the DTS parsed in the PES
3o decoder 100 are distorted by errors, and a method for decoding a picture in synchronization with the DTS value determined in units of a picture, without generating overflow or underflow in the bit buffer 110 in the VLD 120 using the DTS of a picture unit determined according to whether the PTS and DTS have errors, will be described with reference to FIGs. 3 and 4. In the present invention, when the PTS and the DTS are found to be distorted by the errors, they will not be used.
s First, there is the following relationship between the PTS and the DTS, transferred as part of the header of the PES. The DTS is detected in the PES
header and shows when the picture corresponding thereto is to be decoded on the video elementary stream which is the output of the PES decoder 100. The PTS is detected from the PES header and shows when the picture corresponding thereto is to be displayed on a screen. The PTS i~ necessary since the displaying order is different from the decoding order, according to the kind of picture.
The relationship between the DTS and the PTS is determined by the following rule. The relationship between the DTS and the PTS of the I and P
pictures is variable according to the number of B pictures. The DTS and the PTS
are identical in the B picture. The DTS increases with a certain offset in every picture. The offset value is related to the frame rate of the decoded elementary bit stream. For example, when the frame rate is 30, the offset is 90,000130, i.e., 3,000. Here, 90,000 denotes the 90KHz clock used in a video encoder, which is not shown. When the DTS is determined, the PTS is determined by the following Zo equation 1.
[Equation 1]
PTS=N+(temporalreference + 1)xoffset Wherein the offset is 3,000 and N represents the DTS value of the first picture. The temporal reference represents the order in which the pictures existing is in the GOP are displayed.
For example, when nine pictures exist in an arbitrary GOP and two B
pictures exist between the reference pictures (I or P pictures) as shown in FIG.
3(a), the temporal reference information is 2-~0--~1-i5--~3-~4-~8-~6-~7. Here, FIG. 3(a) shows the occupancy of data according to the order in which pictures are input to 3o the bit buffer 110. In "12", I and 2 respectively denote an I picture and the temporal reference information.
FIGs. 3(b) and 3(c) respectively show the DTS and the PTS determined in the video encoder with respect to arbitrary pictures. For example, when the DTS
of the I picture (which is the first picture of the GOP) is N, the DTS of the picture becomes N+3XM and the PTS becomes N+6XM.
In FIGs. 3(d) through 3(h) the picture is ideally decoded by the VLD 120 in s synchronization with the DTS when there is no error in the transferred bit stream, namely, there are no errors in the PTS and the DTS.
In the video encoder, the PTS and the DTS are all transferred in the video encoder only when the values thereof are different from each other in an arbitrary picture. Only the PTS is transferred when the values are equal. Therefore, the DTS is not transferred with respect to the B picture. However, the DTS cannot be transferred without the PTS. The PTS and the DTS do not have to be transferred in every picture. According to the MPEG-2 specification, they only have to be transferred at least once every 0.7sec.
The picture header detect (pic hd det) signal shown in FIG. 3(d) is generated when the decoding of the picture headers is completed in the VLD
120.
The .PTS and the DTS parsed by the PES decoder 100 shown in FIGs. 3(e) and 3(f) are latched according to the picture header detect (pic hd det) signal in the DTS generator 150.
An elementary picture decoding method in a normal state in which there are Zo no errors in the PTS and the DTS is as follows. When the PTS and the DTS of an arbitrary picture are both transferred, the DTS generator 150 determines the DTS
to be the DTS of the picture. When only the PTS is transferred, the DTS
generator 150 determines the PTS to be the DTS and generates the decoded DTS
(decoded dts) value. With respect to the picture not having the PTS and the DTS, 25 the DTS generator 150 determines the value obtained by adding the DTS of the previous picture to the offset as the DTS of the present picture and outputs the decoded DTS (decoded dts) value. As a result, the finally determined DTS is the same as the DTS determined in the video encoder shown in FIG. 3(c).
Also, the latch 160 latches the STC increasing at the rate of 90KHz per 3o second in synchronization with the program code reference (PCR) included in the header of a transport stream (TS) by the picture header detect (pic hd det) signal.
The subtracter 170 subtracts the decoded DTS value from the latched STC value.
When the value is negative, the decoding in the VLD 120 is delayed. When the value is positive, the current picture is not decoded and is discarded.
The subtracter 170 determines whether the result obtained by subtracting the decoded DTS value from the STC value is larger than a threshold value (900).
s For this, the absolute value of the subtraction result is obtained, the absolute value is subtracted from the threshold value, and it is determined whether the result is negative or positive. When the value is positive, since the absolute value is smaller than the threshold value, no hold or skip is generated. When the value is negative, a hold or skip may be generated. After subtracting the absolute value from the threshold value, it is determined whether the skip signal for skipping the current picture or the hold signal for delaying the current picture is to be generated at the point in time (FIG. 3(g)) at which the picture header detect (pic hd det) signal is delayed by a predetermined number of clock cycles.
When a hold signal of logic "low" is generated by the hold determiner 180 as shown in FIG. 3(h) d't the point in time (FIG. 3(g)) a predetermined number of clock cycles after the picture header detect {pic hd det) signal, on the basis of the output of the subtracter 170, the decoding of the input picture is delayed in the VLD 120. When the skip signal is generated by the skip generator 190 after a delay of a determined number of clock cycles from the picture header detect zo (pic hd det) signal, on the bases of the output of the subtracter 170, the does not decode and discards the current pictures input when the skip signal is generated. In FIG. 3, the hold is generated for every picture.
When the VLD 120 completes the decoding of a picture within an offset period, the value obtained by subtracting the decoded DTS value from the STC
zs value is negative. When the absolute value of the subtraction result is outside the range of the threshold value, the VLD 120 generates the hold signal and controls the decoding period of a picture to 1lpicture rate. On the other hand, when the VLD 120 does not complete the decoding of a picture within an offset period, the value obtained by subtracting the decoded DTS value from the STC value is 3o positive. When the absolute value of the subtraction result is outside the range of the threshold value, the VLD 120 generates the skip signal, and does not decode the picture but instead discards it.
So far, a method has been described of synchronizing the decoding of the picture unit in the VLD using the PTS and the DTS in a normal state. From now on, a picture decoding synchronizing method using the PTS and the DTS
considering the errors, which is the purpose of the present invention, will be s described.
The transferred PTS and DTS may not be detected by the PES decoder 100 due to errors. Also, the transferred PTS and DTS may be detected in the PES decoder 100, but erroneously, due to errors.
In the former case, when the picture of the elementary stream corresponding to the undetected PTS and DTS is not damaged by errors, the VLD
120 determines that there is no time stamp in the picture and decodes the picture using the value obtained by adding the DTS of the previous picture to the offset value as the DTS of the picture. When the picture is discarded by the VLD 120 due to error, the hold is generated in the picture corresponding to the PTS
and the ~s DTS according to the PTS and the DTS found in the successive picture, so only as many pictures are undetected by the VLD 120 are not decoded.
However, in the latter case, the problem is serious if the transferred PTS
and DTS are much larger than the original value. Since the PTS and the DTS
have the value of 33 bits, though the PTS and DTS is one bit which is close to the Zo most significant bit (MSB), if the PTS and DTS which is "0" is wrongly detected as "1", there exists a very big difference between the threshold value and the value obtained by subtracting the decoded DTS value from the STC value in the subtracter 170. The decoding can be held for a long time. When the transferred PTS and DTS are smaller than the original value, though the value obtained by is subtracting the decoded DTS value from the STC value is very large, the pictures are skipped until the PTS and the DTS are found. Accordingly, the PTS and DTS
are not seriously affected.
In the present invention, the temporal reference information (tem ref), the picture counter 130, the mask generator 1~0, and the DTS generator 150 are used 3o as shown in FIG. 2 against the case in which the transferred PTS and DTS
are much larger than the original value, as in the latter case. The picture counter 130 performs counting in synchronization with the picture header detect (pic hd det) signal output from the VLD 120. The picture counter 130 is reset to "0" at the first picture in the GOP and increases by "1" at other pictures.
The relationship established among the PTS, the DTS, the temporal reference information, and the output of the picture counter in a GOP is shown in s the following equations 2 and 3.
[Equation 2]
PTS=transferred DTS+(temporal reference -picture count value + 1 ) xoffset [Equation 3]
transferred DTS=previous DTS+offset When the picture input to the VLD 120 is an I or P picture, the condition of equation 2 is not satisfied. When the picture input to the VLD 120 is a B
picture, the condition of equation 3 is not satisfied. Namely, when the current input picture does not satisfy the condition of equations 2 or 3, the PTS and the DTS
transferred from the current input picture to the final picture of the GOP are not used. Also, when the fast picture of the successive GOP is an I picture, the PTS
and xhe DTS exist, and the above conditions are not satisfied, the PTS and the DTS continuously transferred to the GOP are not used. Namely, the PTS and the DTS transferred to all the pictures are discarded until the first picture of the GOP
satisfying the conditions is found.
Zo According to the MPEG specification, the first picture of the GOP is an I
picture. In an I picture, if a time stamp exists, then the PTS and the DTS
must also exist. In FIG. 4, such a relationship is described, employing arbitrary numbers. The transferred PTS and DTS are not detected in the PES decoder 100 due to the errors. The bits of the pictures corresponding to the PTS and the DTS
is are discarded in the VLD 120 due to the errors.
Namely, as shown in FIG. 4(a), the PTS and the DTS of the pictures corresponding to P5 are not transferred and the bits are damaged and discarded in the VLD 120. The PTS of the following B3 picture is detected and the picture header corresponding to the picture is detected. The picture header detect 30 (pic hd det) signal is generated as shown in FIG. 4(b).
Since the transferred PTS is 45,000 as shown in FIG. 4(c) and the picture is a B picture, the DTS generator 150 interprets the PTS as the DTS value.
FIG.
4(d) shows the transferred DTS. FIG. 4(e) shows the value obtained by counting the pictures in the picture counter 130 according to the picture structure (pic struct) signal and the picture header detect (pic he det) signal output from the VLD 120.
s Since the DTS value decoded by the DTS generator 150 with respect to the B3 picture does not satisfy the condition of equation 3, the mask generator generates the DTS mask signal (dts mask) shown in FIG. 4(f) as an active signal of logic "low". The DTS mask (dts mask) signal is maintained in the logic "low"
state until the first I picture of the successive GOP satisfies all the conditions of equations 2 and 3. When the DTS mask (dts mask) signal is in the logic "low"
state, the value obtained by adding the DTS of the previous picture to the offset is used as the decoded DTS value whenever the picture header detect signal is found, without employing the transferred PTS or DTS. Therefore, the DTS
generator 150 outputs the decoded DTS (decoded dts) value as shown in FIG.
4(g).
In the following GOP, when the PTS and the DTS of the first I picture satisfy the conditions of equations 2 and 3, the DTS mask (dts mask) signal is logic "high" in the first I picture of the GOP. The transferred DTS of the first I
picture is decoded as the DTS of the I picture. The VLD 120 performs decoding, ~o holding, or skipping in units of a picture, according to the value obtained by subtracting the decoded DTS value from the STC value and the threshold value when the DTS mask (dts mask) signal is logic "low". When the DTS mask (dts mask) signal shown in FIG. 4(f) is logic "high", the I picture is held as much as the absolute value of the value obtained by subtracting the decoded DTS
value is from the STC value (3,900 in FIG. 4(i)). This is because the value obtained by subtracting the decoded DTS value from the STC value becomes larger than the number of pictures discarded due to the errors in the VLD 120 (1 (P5) in FIG.
4) X
the offset (-3,900 in FIG. 4(i).
FIG. 4(h) shows the STC value latched by the latch 160 according to the 3o picture header detect (pic hd det) signal. FIG. 4(i) shows the value obtained by subtracting the DTS value decoded by the DTS generator 150 from the STC value latched in the latch 160. FIG. 4(j) shows the threshold value (900).
Since the VLD 120 completes decoding all the pictures in a GOP within 3,000, which is the offset value, the value obtained by subtracting the decoded DTS value from the STC is negative as shown in FIG. 4(i). If the absolute value of the subtraction result is outside the range of the threshold value at the s determining point in time shown in FIG. 4(k), the skip or hold is generated.
If not, the decoding is continuously performed. In FIG. 4(i), the VLD 120 temporarily stops when the hold signal of logic "low" is generated by the hold determiner 180.
In the present invention, even when there are errors in the transferred DTS
and PTS, the decoded image data displayed naturally on a screen.
Y
Claims (21)
1. A picture decoding synchronizing circuit, comprising:
a detector for detecting whether a presentation time stamp (PTS) and a decoding time stamp (DTS) which are transferred through an input bit stream are distorted by errors, and outputting a detect signal;
a determiner for determining DTS value using a transferred PTS and DTS if no errors are detected from the transferred PTS and DTS according to the detect signal, and determining the DTS value using the value obtained by adding the DTS value of a previous picture to a predetermined offset value, if errors are detected; and a decoder for decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
a detector for detecting whether a presentation time stamp (PTS) and a decoding time stamp (DTS) which are transferred through an input bit stream are distorted by errors, and outputting a detect signal;
a determiner for determining DTS value using a transferred PTS and DTS if no errors are detected from the transferred PTS and DTS according to the detect signal, and determining the DTS value using the value obtained by adding the DTS value of a previous picture to a predetermined offset value, if errors are detected; and a decoder for decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
2. The picture decoding synchronizing circuit of claim 1, wherein the detector comprises:
a picture counter for counting the number of pictures in a group of picture (GOP) unit and outputting a picture count value; and a generator for detecting errors generated in the transferred DTS and PTS
using a picture type signal showing whether an input picture is an I (intra-coded), B (bidirectionally predictive-coded), or P (predictive-coded) picture, temporal reference information showing the display order of the pictures in the GOP, and the picture count value, and generating a detect signal.
a picture counter for counting the number of pictures in a group of picture (GOP) unit and outputting a picture count value; and a generator for detecting errors generated in the transferred DTS and PTS
using a picture type signal showing whether an input picture is an I (intra-coded), B (bidirectionally predictive-coded), or P (predictive-coded) picture, temporal reference information showing the display order of the pictures in the GOP, and the picture count value, and generating a detect signal.
3. The picture decoding synchronizing circuit of claim 2, wherein the detector detects whether the PTS of input I and P pictures satisfies the following condition and, if not, generates a detect signal :
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset.
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset.
4. The picture decoding synchronizing circuit of claim 2, wherein the detector detects whether the DTS of the input B picture satisfies the following condition and, if not, generates a detect signal :
transferred DTS=previous DTS+offset.
transferred DTS=previous DTS+offset.
5. The picture decoding synchronizing circuit of claim 1, wherein the detector generates a detect signal which is active from the current picture to the first picture of the GOP in which no errors are detected in the transferred PTS and DTS, when errors are detected in the PTS and DTS of the current picture.
6. A picture decoding synchronizing circuit, comprising:
an extractor for extracting a video elementary stream, a presentation time stamp (PTS), a decoding time stamp (DTS), and a system time clock (STC) from a transferred bit stream;
a buffer for temporarily storing the video elementary stream;
a variable length decoder for controlling the decoding of the video elementary stream stored in the buffer so that the buffer does not overflow or underflow, parsing the header of the video elementary stream, and outputting temporal reference information, a picture structure signal, a GOP header detect signal, and a picture type signal; and a decoding controller for determining whether errors are generated in the DTS and the PTS and generating control signals for controlling the decoding using a determined DTS value by adding the DTS of the previous picture to an offset value, if the errors are generated.
an extractor for extracting a video elementary stream, a presentation time stamp (PTS), a decoding time stamp (DTS), and a system time clock (STC) from a transferred bit stream;
a buffer for temporarily storing the video elementary stream;
a variable length decoder for controlling the decoding of the video elementary stream stored in the buffer so that the buffer does not overflow or underflow, parsing the header of the video elementary stream, and outputting temporal reference information, a picture structure signal, a GOP header detect signal, and a picture type signal; and a decoding controller for determining whether errors are generated in the DTS and the PTS and generating control signals for controlling the decoding using a determined DTS value by adding the DTS of the previous picture to an offset value, if the errors are generated.
7. The picture decoding synchronizing circuit of claim 6, wherein the decoding controller comprises:
a picture counter which is reset according to the GOP header detect signal, for counting the number of pictures according to the picture structure signal and the picture header detect signal, and outputting a picture counted value;
a first generator for determining whether there are errors in the DTS and the PTS using the picture type signal, temporal reference information, and the picture counted value and generating a mask signal;
a second generator for generating a decoded DTS value by adding the DTS
value of the previous picture to the offset value, if the mask signal is generated and otherwise, generating the decoded DTS value on the basis of the transferred PTS and DTS;
a subtracter for subtracting the decoded DTS value from the STC value, comparing the absolute value of the subtraction result with a threshold value, and outputting a comparison result;
a hold determiner for generating a hold signal commanding the decoding not to proceed according to the comparison result and to hold, and outputting the hold signal to the variable length decoder; and a skip determiner for generating a skip signal commanding the current picture to be discarded without being decoded, according to the comparison result, and outputting the skip signal to the variable length decoder.
a picture counter which is reset according to the GOP header detect signal, for counting the number of pictures according to the picture structure signal and the picture header detect signal, and outputting a picture counted value;
a first generator for determining whether there are errors in the DTS and the PTS using the picture type signal, temporal reference information, and the picture counted value and generating a mask signal;
a second generator for generating a decoded DTS value by adding the DTS
value of the previous picture to the offset value, if the mask signal is generated and otherwise, generating the decoded DTS value on the basis of the transferred PTS and DTS;
a subtracter for subtracting the decoded DTS value from the STC value, comparing the absolute value of the subtraction result with a threshold value, and outputting a comparison result;
a hold determiner for generating a hold signal commanding the decoding not to proceed according to the comparison result and to hold, and outputting the hold signal to the variable length decoder; and a skip determiner for generating a skip signal commanding the current picture to be discarded without being decoded, according to the comparison result, and outputting the skip signal to the variable length decoder.
8. The picture decoding synchronizing circuit of claim 7, wherein the first generator generates the mask signal when the PTS of the input I and P pictures does not satisfy the following condition :
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset .
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset .
9. The picture decoding synchronizing circuit of claim 7, wherein the first generator generates the mask signal when the DTS of the input B picture does not satisfy the following condition :
transferred DTS=previous DTS+offset .
transferred DTS=previous DTS+offset .
10. The picture decoding synchronizing circuit of claim 7, wherein the first generator generates a mask signal which is active from the current picture to the first picture of the GOP in which no errors are generated in the transferred PTS
and DTS, when errors are generated in the PTS and the DTS of the current picture.
and DTS, when errors are generated in the PTS and the DTS of the current picture.
11. The picture decoding synchronizing circuit of claim 7, wherein the point in time at which it is determined whether the hold signal or the skip signal is to be generated in the hold determiner and the skip determiner is a predetermined number of system clock cycles after the picture header detect signal.
12. A picture decoding synchronizing method, comprising the steps of:
(a) determining whether a presentation time stamp (PTS) and a decoding time stamp (DTS), transferred through an input bit stream, are distorted;
(b) determining DTS value using a transferred PTS and the DTS if no errors are detected in the transferred PTS and DTS, according to a detect signal, and otherwise, determining the DTS value by adding the DTS value of a previous picture to an offset value; and (c) decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
(a) determining whether a presentation time stamp (PTS) and a decoding time stamp (DTS), transferred through an input bit stream, are distorted;
(b) determining DTS value using a transferred PTS and the DTS if no errors are detected in the transferred PTS and DTS, according to a detect signal, and otherwise, determining the DTS value by adding the DTS value of a previous picture to an offset value; and (c) decoding the input bit stream in units of a picture, in synchronization with a determined DTS value.
13. The picture decoding synchronizing method of claim 12, wherein the step (a) comprises the steps of:
(a1) counting the number of pictures in a group of picture (GOP) unit and outputting a picture count value; and (a2) detecting errors generated in the transferred DTS and PTS using a picture type signal showing whether an input picture is an I (intra-coded), B
(bidirectionally predictive-coded), or P (predictive-coded) picture, temporal reference information showing the display order of the pictures in the GOP, and the picture count value and generating a detect signal.
(a1) counting the number of pictures in a group of picture (GOP) unit and outputting a picture count value; and (a2) detecting errors generated in the transferred DTS and PTS using a picture type signal showing whether an input picture is an I (intra-coded), B
(bidirectionally predictive-coded), or P (predictive-coded) picture, temporal reference information showing the display order of the pictures in the GOP, and the picture count value and generating a detect signal.
14. The picture decoding synchronizing method of claim 13, wherein it is detected whether the PTS of the input I and P pictures satisfies the following condition, and the detect signal is generated in the step (a2) :
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset .
PTS=transferred DTS+(temporal reference information-picture count value+1)×offset .
15. The picture decoding synchronizing method of claim 13, wherein it is detected whether the DTS of the input B pictures satisfies the following condition, and the detect signal is generated in the step (a2) :
transferred DTS=previous DTS+offset .
transferred DTS=previous DTS+offset .
16. The picture decoding synchronizing method of claim 12, wherein a detect signal is generated which is active from the current picture to the first picture of the GOP in which no errors are generated in the transferred PTS and DTS, when errors are generated in the PTS and the DTS of the current picture in the step (a).
17. A picture decoding synchronizing method, comprising the steps of:
(a) extracting a video elementary stream, a presentation time stamp (PTS), a decoding time stamp (DTS), and a system time clock (STC);
(b) controlling the decoding of the video elementary stream, parsing the header of the video elementary stream, and detecting temporal reference information, a picture structure signal, a GOP header detect signal, and a picture type signal; and (c) determining whether errors are generated in the DTS and the PTS, and when errors are generated, generating control signals for controlling the decoding using a DTS value determined by adding the DTS of a previous picture to an offset value.
(a) extracting a video elementary stream, a presentation time stamp (PTS), a decoding time stamp (DTS), and a system time clock (STC);
(b) controlling the decoding of the video elementary stream, parsing the header of the video elementary stream, and detecting temporal reference information, a picture structure signal, a GOP header detect signal, and a picture type signal; and (c) determining whether errors are generated in the DTS and the PTS, and when errors are generated, generating control signals for controlling the decoding using a DTS value determined by adding the DTS of a previous picture to an offset value.
18. The picture decoding synchronizing method of claim 17, wherein the step (c) comprises the steps of:
(c1) counting the number of pictures in the GOP according to the picture structure signal, the picture header detect signal, and the GOP header detect signal and outputting a picture count value;
(c2) determining whether errors are generated in the DTS and the PTS
using the picture type signal, the temporal reference information, and the picture count value, and generating a mask signal;
(c3) generating a decoded DTS value by adding the DTS value of the previous picture to the offset value if the mask signal is generated, and otherwise, generating the decoded DTS value on the basis of the transferred PTS and DTS;
(c4) subtracting the decoded DTS value from the STC value, comparing the absolute value of the subtraction result with a threshold value and outputting a comparison result;
(c5) generating a hold signal commanding the decoding not to proceed and to hold according to the comparison result; and (c6) generating a skip signal commanding the current picture to be discarded without being decoded, according to the comparison result.
(c1) counting the number of pictures in the GOP according to the picture structure signal, the picture header detect signal, and the GOP header detect signal and outputting a picture count value;
(c2) determining whether errors are generated in the DTS and the PTS
using the picture type signal, the temporal reference information, and the picture count value, and generating a mask signal;
(c3) generating a decoded DTS value by adding the DTS value of the previous picture to the offset value if the mask signal is generated, and otherwise, generating the decoded DTS value on the basis of the transferred PTS and DTS;
(c4) subtracting the decoded DTS value from the STC value, comparing the absolute value of the subtraction result with a threshold value and outputting a comparison result;
(c5) generating a hold signal commanding the decoding not to proceed and to hold according to the comparison result; and (c6) generating a skip signal commanding the current picture to be discarded without being decoded, according to the comparison result.
19. The picture decoding synchronizing method of claim 18, wherein when the PTS of input I and P pictures does not satisfy the following condition, the mask signal is generated in the step (c2):
PTS=transferred DTS+(temporal reference information-picture count value+1)x offset .
PTS=transferred DTS+(temporal reference information-picture count value+1)x offset .
20. The picture decoding synchronizing method of claim 18, wherein when the DTS of an input B picture does not satisfy the following condition, the mask signal is generated in the step (c2):
transferred DTS=previous DTS+offset .
transferred DTS=previous DTS+offset .
21. The picture synchronizing method of claim 17, wherein the mask signal is not generated from the current picture to the first picture of the GOP in which no errors are generated in the transferred PTS and DTS when errors are generated in the PTS and the DTS of the current picture, in the step (c2).
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1019970037984A KR100247978B1 (en) | 1997-08-08 | 1997-08-08 | Picture decoding synchronizing circuit and method therefor |
| KR97-37984 | 1998-08-08 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2244472A1 CA2244472A1 (en) | 2000-02-04 |
| CA2244472C true CA2244472C (en) | 2002-12-03 |
Family
ID=19517140
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA 2244472 Expired - Fee Related CA2244472C (en) | 1997-08-08 | 1998-08-04 | Circuit for synchronizing picture and method therefor |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US6674801B1 (en) |
| EP (1) | EP0896479A3 (en) |
| JP (1) | JP2950376B2 (en) |
| KR (1) | KR100247978B1 (en) |
| CN (1) | CN1135851C (en) |
| CA (1) | CA2244472C (en) |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1069777A4 (en) * | 1999-02-05 | 2009-03-04 | Sony Corp | Encoding system, encoding method, decoding system, decoding method, multiplexing device, multiplexing method, display system and display method |
| FR2797549B1 (en) * | 1999-08-13 | 2001-09-21 | Thomson Multimedia Sa | METHOD AND DEVICE FOR SYNCHRONIZING AN MPEG DECODER |
| JP2001204032A (en) * | 2000-01-20 | 2001-07-27 | Nec Corp | Mpeg decoder |
| JP3569205B2 (en) * | 2000-06-09 | 2004-09-22 | シャープ株式会社 | Recording / playback device |
| US6819715B2 (en) * | 2000-07-25 | 2004-11-16 | Matsushita Electric Industrial Co., Ltd. | Image decoding method, image decoding apparatus, and data storage medium |
| JP4612171B2 (en) * | 2000-10-27 | 2011-01-12 | 株式会社東芝 | Video decoding / playback module, playback time management program, and multimedia information receiving apparatus |
| KR100507881B1 (en) * | 2000-12-22 | 2005-08-18 | 매그나칩 반도체 유한회사 | A bit stream decoder in digital broadcasting receiver system |
| KR100378795B1 (en) * | 2001-04-02 | 2003-04-03 | 엘지전자 주식회사 | Flexible direct mode coding method for b pictures in moving picture |
| JP3565182B2 (en) * | 2001-05-11 | 2004-09-15 | 日本電気株式会社 | Method and method for preventing input of variable length code from being interrupted |
| US7729421B2 (en) | 2002-02-20 | 2010-06-01 | International Business Machines Corporation | Low latency video decoder with high-quality, variable scaling and minimal frame buffer memory |
| US9948977B2 (en) * | 2003-01-09 | 2018-04-17 | Avago Technologies General Ip (Singapore) Pte. Ltd. | System, method, and apparatus for determining presentation time for picture without presentation time stamp |
| JP4586429B2 (en) * | 2004-06-11 | 2010-11-24 | ソニー株式会社 | DATA PROCESSING DEVICE, DATA PROCESSING METHOD, PROGRAM, AND PROGRAM RECORDING MEDIUM |
| CN1295920C (en) * | 2004-07-29 | 2007-01-17 | 联合信源数字音视频技术（北京）有限公司 | Synchronous control device and control method for video elecoding and display |
| JP4536497B2 (en) * | 2004-12-02 | 2010-09-01 | ソニー株式会社 | Data processing apparatus, data processing method, program, program recording medium, and data recording medium |
| FR2883692A1 (en) * | 2005-03-25 | 2006-09-29 | Thomson Licensing Sa | METHOD OF SENDING CONTROL TO A SERVER OF DIGITAL DATA STREAMS AND APPARATUS IMPLEMENTING THE METHOD |
| US8428147B2 (en) * | 2005-07-25 | 2013-04-23 | Thomson Licensing | Method and apparatus for detection and concealment of reference and non-reference video frames |
| KR101114749B1 (en) | 2005-11-11 | 2012-03-05 | 삼성전자주식회사 | Method for processing image data in mpeg-2 ts in order to not occurring blue screen and digital multimedia broadcasting receiver thereof |
| JP2007158461A (en) * | 2005-11-30 | 2007-06-21 | Toshiba Corp | Information reproducing apparatus and method |
| WO2007072252A2 (en) * | 2005-12-23 | 2007-06-28 | Koninklijke Philips Electronics N.V. | Creation of 'trick-play' streams for plaintext, partially, or fully encrypted video streams |
| JP4650894B2 (en) * | 2006-04-03 | 2011-03-16 | 三菱電機株式会社 | Image decoding device |
| US20100158130A1 (en) | 2008-12-22 | 2010-06-24 | Mediatek Inc. | Video decoding method |
| CN102547299A (en) * | 2010-12-30 | 2012-07-04 | 福建星网视易信息系统有限公司 | Audio and video synchronous control method based on moving picture experts group (MPEG)-2 |
| CN106358077B (en) * | 2016-09-29 | 2019-05-10 | 北京奇艺世纪科技有限公司 | A kind of net cast method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5396497A (en) * | 1993-02-26 | 1995-03-07 | Sony Corporation | Synchronization of audio/video information |
| US5559999A (en) * | 1994-09-09 | 1996-09-24 | Lsi Logic Corporation | MPEG decoding system including tag list for associating presentation time stamps with encoded data units |
| US5815634A (en) * | 1994-09-30 | 1998-09-29 | Cirrus Logic, Inc. | Stream synchronization method and apparatus for MPEG playback system |
| US5771075A (en) * | 1994-12-08 | 1998-06-23 | Lg Electronics Inc. | Audio/video synchronizer |
| US5588029A (en) * | 1995-01-20 | 1996-12-24 | Lsi Logic Corporation | MPEG audio synchronization system using subframe skip and repeat |
| KR0137701B1 (en) * | 1994-12-13 | 1998-05-15 | 양승택 | Pes packetizing apparatus of mpeg-2 system |
| JPH09205618A (en) * | 1996-01-29 | 1997-08-05 | Mitsubishi Electric Corp | Dynamic image sound expansion reproduction device and dynamic image sound synchronization controller |
-
1997
- 1997-08-08 KR KR1019970037984A patent/KR100247978B1/en not_active IP Right Cessation
-
1998
- 1998-07-30 JP JP21601198A patent/JP2950376B2/en not_active Expired - Fee Related
- 1998-07-30 CN CNB981167314A patent/CN1135851C/en not_active Expired - Fee Related
- 1998-08-03 EP EP19980306168 patent/EP0896479A3/en not_active Ceased
- 1998-08-04 CA CA 2244472 patent/CA2244472C/en not_active Expired - Fee Related
- 1998-08-10 US US09/131,890 patent/US6674801B1/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| EP0896479A2 (en) | 1999-02-10 |
| CN1135851C (en) | 2004-01-21 |
| US6674801B1 (en) | 2004-01-06 |
| KR100247978B1 (en) | 2000-03-15 |
| JP2950376B2 (en) | 1999-09-20 |
| KR19990015710A (en) | 1999-03-05 |
| JPH11122608A (en) | 1999-04-30 |
| CN1208311A (en) | 1999-02-17 |
| CA2244472A1 (en) | 2000-02-04 |
| EP0896479A3 (en) | 2004-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2244472C (en) | Circuit for synchronizing picture and method therefor | |
| US6034731A (en) | MPEG frame processing method and apparatus | |
| US9467752B2 (en) | Handling video transition errors in video on demand streams | |
| US6449352B1 (en) | Packet generating method, data multiplexing method using the same, and apparatus for coding and decoding of the transmission data | |
| US8144791B2 (en) | Apparatus, method, and medium for video synchronization | |
| US20040264577A1 (en) | Apparatus and method for controlling the synchronization of a video transport stream | |
| KR100359782B1 (en) | Method and Device for the system time clock control from MPEG Decoder | |
| US7940799B2 (en) | Code conversion method and device thereof | |
| US20080007653A1 (en) | Packet stream receiving apparatus | |
| US8359413B2 (en) | Data stream buffer control using reference time and decoding time | |
| US7706400B2 (en) | Transport stream processing device and transport stream processing method | |
| US8004608B2 (en) | Closed captioning data detection system and method | |
| JP4295861B2 (en) | Transcoder device | |
| EP1096804A2 (en) | Video decoding method, video decoding apparatus, and program storage media | |
| US6950443B1 (en) | Encoding apparatus, encoding method, and recording medium storing encoding processing program | |
| US6438318B2 (en) | Method for regenerating the original data of a digitally coded video film, and apparatus for carrying out the method | |
| JP4192995B2 (en) | How to mute the video signal | |
| JPH1093841A (en) | Video synchronizing signal correction device | |
| JP2003339019A (en) | Recording and reproducing apparatus and recording and reproducing method | |
| JP2004128870A (en) | Image decoding and outputting device | |
| JP3881441B2 (en) | Time information evaluation apparatus and evaluation method thereof | |
| JP2838985B2 (en) | Audio video code decoding apparatus and audio video code decoding method | |
| JP2000341696A (en) | Device and method for decoding image | |
| JP3671969B2 (en) | Data multiplexing method and multiple data decoding method | |
| JP2002152678A (en) | Mpeg stream reproducing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20160804 |