|Publication number||USRE37112 E1|
|Application number||US 08/675,148|
|Publication date||Mar 27, 2001|
|Filing date||May 29, 1996|
|Priority date||Apr 18, 1991|
|Also published as||US5319468|
|Publication number||08675148, 675148, US RE37112 E1, US RE37112E1, US-E1-RE37112, USRE37112 E1, USRE37112E1|
|Original Assignee||Matsushita Electric Industrial Co., Ltd.|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (5), Non-Patent Citations (1), Referenced by (1), Classifications (26), Legal Events (3)|
|External Links: USPTO, USPTO Assignment, Espacenet|
1. Field of the Invention
The present invention relates to a signal processing method for bandwidth compression coding of an image signal, and to a recording and reproducing device for recording this information to a recording medium such as an optical disk or a video tape and reproducing the information from this medium.
2. Prior art
Known image signal compression coding methods include in-field, in-frame, inter-field, and inter-frame. Inter-field and inter-frame coding use the correlation between the current field or frame and the fields or frames chronologically before and after the current field or frame to achieve a generally high compression ratio compared with in-field or in-frame compression coding, but requires in-frame or in-field coding to refresh the signal at a regular period because errors, when they occur, are propagated along the time axis.
During scene changes, however, when there is a significant change in the image, there is no time axis correlation between the adjacent fields or frames. Inter-field or inter-frame coding is therefore meaningless, and can actually result in image deterioration under certain circumstances.
Furthermore, the total amount of compression coded information increases and the effective compression ratio therefore decreases when in-field or in-frame coding is extensively used.
The present invention is a signal processing method and recording and reproducing means which digitize an image signal and code the digitized signal by singular or plural in-field, in-frame, inter-field, and inter-frame means. The inter-field or inter-frame coding means is the primary coding device. In-field or in-frame coding is applied at a regular interval to the inter-field or inter-frame coded signal sequence, scene changes are detected and in-field or in-frame coding is mandatorily applied to the field or frame immediately following the scene change, and this field or frame becomes the starting field or frame for the in-field or in-frame coding applied at a regular interval thereafter. The increased data quantity resulting from in-field or frame compression coding is thus compensated for by increasing the compression ratio of the inter-field or inter-frame compression coding means during the regular interval between in-field or frame coding.
The invention is further comprised to absorb the increase in information generated by the field or frame immediately after the scene change by mandatorily coding the field or frame immediately after a scene change by the in-field or in-frame coding means using the same data as that of the immediately preceding field or frame for the field or frame immediately before or after the scene change.
Thus, the field or frame immediately after the scene change is efficiently coded, and the total amount of information produced is not increased.
The present invention will become more fully understood from the detailed description given below and the accompanying diagrams wherein:
FIG. 1 is a block diagram of the preferred embodiment of the present invention,
FIG.FIGS. 2A to 2E are illustrations of the basic compression coding pattern according to the preferred embodiment, and
FIG. 3 is a block diagram of the reproduction processing system for reproducing the image signal.
FIG. 1 is a block diagram of the preferred embodiment of the present invention comprising a coding circuit 1, scene change detection circuit 2, recording circuit 3, and recording/reproducing head 4.
The coding circuit 1 digitizes the image signal and compression codes the signal by means of in-field, in-frame, inter-field, and inter-frame coding used singularly or in combination. The scene change detection circuit 2 detects scene changes. The recording circuit 3 converts the output of the coding circuit 1 to a recording signal. The recording/reproducing head 4 records the output of the recording circuit 3 to the recording medium 5, or as shown in FIG. 3, reproduces the recorded information from the recording medium 5.
In the operation of this device the image signal is primarily compressed by inter-field or inter-frame coding with in-field or in-frame coding applied at a regular interval. Scene changes are detected, and in-field or in-frame coding is mandatorily applied to the field or frame immediately after the scene change. The information is then recorded to the recording medium, or is reproduced therefrom.
The basic compression coding pattern is shown in FIG. 2 (A). In-frame coding is applied at a regular cycle of eight frames. Inter-frame coding is applied to the frames between the in-frame coded frames.
It is common in inter-frame processing to forward the difference between the current and previous frame, but other methods can also be used, including coding the current frame based on the correlation with the previous and following frames. The following description assumes inter-frame processing based on the difference with the preceding frame.
It is first assumed that there is a scene change between the fourth and fifth frames. In this case there is no correlation between the fourth and fifth frames. As such, it would be difficult to obtain a satisfactory compression ratio with inter-frame coding. In the worst case inter-frame coding will actually result in more information than would in-frame coding, and is therefore undesirable.
Therefore, as shown in FIG. 2 (B), in-frame coding is applied to the frame immediately after the scene change, and this frame is also used as the first frame in a new in-frame coding cycle. This successfully prevents image deterioration, but increases the amount of information.
If the ratio between the amount of information in the in-frame and inter-frame coded frames is 3:1, the amount of information resulting from coding frames 1 to 16 inclusive by the method shown in FIG. 2 (A) will be
where K is a constant, and by the method shown in FIG. 2(B) will be
There is thus a 2K increase in the amount of information where K is a constant value expressing data quantity.
This increase is undesirable in a system which transfers or records and reproduces a constant amount of information in a constant period.
It is therefore necessary to reduce the amount of information. A first method to accomplish this is illustrated in FIG. 2 (C). In this method, the amount of information is reduced by reducing the compression ratio to 0.8 to 0.9 from the conventional value of 1 in the inter-frame coded frames 6-12 between the frame 5 mandatorily compressed by in-frame coding due to the scene change immediately therebefore, and frame 13 at the end of the new cycle starting at frame 5. This conforms with the tendency of errors in the frame immediately after a scene change to be difficult to distinguish visually. It is therefore possible to reduce the total data quantity by an amount approximately equal to K.
In a second method additional information is not generated by using as the data for the frame immediately preceding the frame immediately before the scene change the data from the frame two frames before the scene change, or using as the data for the frame two frames after the scene change the data from the frame immediately after the scene change, or by using both of these data substitutions.
Specifically, referring to FIG. 2 (D), frame 4 is identical to frame 3, i.e., the data from the immediately preceding frame is held, and frame 6 is identical to frame 5. This is possible because there is no continuity of motion at the precise moment of the scene change, and there will therefore be no visibly noticeable deterioration of the image when the same data is used for adjacent frames. That case in which the previous frame data is held for the frames before and after the scene change is shown in FIG. 2 (D), and that case in which the data is held for only the preceding frame is shown in FIG. 2 (E). Approximately 2K of data is saved in the former (FIG. 2 (D)) case, and approximately 1K is saved in the latter (FIG. 2 (E)) case.
It is to be noted that it is also possible to only hold the data for the frame immediately after the scene change.
Not also that it would be meaningless to use inter-frame compression coding for the frame immediately before the scene change using data from the following frame because there is no continuity between the two frames. In other words, it is preferable to compression code the frame immediately before a scene change by in-frame compression coding or inter-frame compression coding using only information from the previous frame.
Furthermore, it should be noted that while the invention was described above with specific reference to in-frame and inter-frame processing, the invention shall not be thus limited and the same effect is obtained by in-field and inter-field processing. Furthermore, inter-frame or inter-field processing can also be applied with data interpolated from the fields or frames before and after the current compression field or frame.
In addition, the present embodiment was described as absorbing the increase in data generated immediately by a scene change within the seven frames after the scene change, or by holding the frame data immediately before and/or after a scene change to compensate for the increased data quantity. It is also possible, however, to reduce the amount of information within a given number of frames or period (e.g., one second). This will be in relation to the buffer capacity during coding and decoding.
Moreover, it is necessary to distinguish those frames in which in-frame compression coding was applied at a regular interval and was applied mandatorily due to a scene change. The decoding operation can be greatly simplified in this case by outputting or recording the data with an added bit set HIGH or LOW at a predetermined position in the frame immediately after the scene change.
It is to be noted that when the information resulting from the above process is to be recorded and reproduced by means of an optical disk, video tape, or other packaged medium, the recording circuit 3 and recording/reproducing head 4 shown in FIG. 1 and FIG. 3 are required, but these are not required if the data is simply to be transmitted to another processing device.
Further, FIG. 3 shows a block diagram of the reproduction processing system. Data reproduced by the optical head 4 is converted into reproduction digital image data by the reproducing circuit 6 and the latter is decoded into the image signal by the decoding circuit 7 to output the same from the terminal 8. As stated above, very efficient coding is obtained by processing data before and after a scene change. Upon reproducing the image signal, the conventional reproduction processing system is available in the present system without any changes.
It is thus possible to provide a signal processing method and a recording and reproducing device implementing this method of achieving high image quality, low bit rate image data.
The invention being thus described, it will be obvious that the same may be varied in many ways. Such variations are not to be regarded as a departure from the spirit and scope of the invention, and all such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US4694329 *||Apr 12, 1985||Sep 15, 1987||Corporate Communications Consultants, Inc.||Color correction system and method with scene-change detection|
|US4837618 *||Nov 9, 1987||Jun 6, 1989||Kokusai Denshin Denwa Co., Ltd.||Moving image signal coding system|
|US5049991 *||Feb 20, 1990||Sep 17, 1991||Victor Company Of Japan, Ltd.||Movement compensation predictive coding/decoding method|
|US5194961 *||Nov 21, 1991||Mar 16, 1993||Sony Corporation||Apparatus for locking a reproduced color video signal to a reference color frame signal|
|US5223949 *||Apr 17, 1992||Jun 29, 1993||Matsushita Electric Industrial Co., Ltd.||Coding means for a signal processing system|
|1||Artieri, Alain and Colavin, Oswald, "A Chip Set Core for Image Compression," IEEE on Consumer Electronics, vol. 36, No. 3, pp. 395-402 (Aug. 1990).|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US7031385 *||Oct 2, 2000||Apr 18, 2006||Matsushita Electric Industrial Co., Ltd.||Method and apparatus for detecting scene change of a compressed moving-picture, and program recording medium therefor|
|International Classification||H04N5/92, H04N7/50, H04N7/46, H04N7/36|
|Cooperative Classification||H04N19/61, H04N19/87, H04N19/503, H04N19/107, H04N19/132, H04N19/114, H04N19/177, H04N19/142, H04N19/587, H04N19/179|
|European Classification||H04N7/26A6C6, H04N7/26A8G, H04N7/26A8S, H04N7/26P8, H04N7/50E6, H04N7/26A4C2, H04N7/50, H04N7/50R, H04N7/36D, H04N7/26A4C6, H04N7/46T2|
|Nov 24, 1997||FPAY||Fee payment|
Year of fee payment: 4
|Nov 15, 2001||FPAY||Fee payment|
Year of fee payment: 8
|Nov 14, 2005||FPAY||Fee payment|
Year of fee payment: 12