CA1291816C

CA1291816C - Method of and apparatus for recording and/or reproducing a picture signal and an associated audio signal in/from a record carrier and record carrier obtained by means of the method

Info

Publication number: CA1291816C
Application number: CA000536614A
Authority: CA
Inventors: Balthasar A.G. Van Luyt; Richard Bruno; Jacques Taillade
Original assignee: Philips Gloeilampenfabrieken NV
Current assignee: Koninklijke Philips NV
Priority date: 1986-05-12
Filing date: 1987-05-07
Publication date: 1991-11-05
Anticipated expiration: 2008-11-05
Also published as: KR960001484B1; AU7269087A; DE3769007D1; AR246009A1; AU603742B2; ATE62367T1; CN1008785B; US4794465A; EP0245904B1; KR870011605A; MX164350B; CN87103473A; EP0245904A1; NL8601182A; ES2022299B3; SG56991G; JP2843828B2; JPS62269584A; HK90991A; UA27216C2

Abstract

ABSTRACT: "Method of and apparatus for recording and/or reproducing a picture signal and an associated audio signal and record carrier obtained by means of the method". Finite audio and video signals are subjected to a digitizing code format and converted into blocks of audio and video words respectively. For the transmission of these blocks via a record carrier (2), for example a compact disc, the words are arranged in frames. Each frame has a frame header (8.1) and a data field (8.2). Such a data field contains information words in the form of either audio words or video words. The header indicates whether the associated data field contains audio words or video words. At least two audio signals associated with a video signal are recorded on the record carrier. An example of this is a "slide show" in which the explanatory text is available in two or more languages (e for English, f for French). The frame header of the frames containing an encoded audio signal also indicate to which one of the two or more audio signals the information words in an audio frame belong. Further, reference signals and additional frames (6) are recorded in the record carrier. For each of the two or more audio signals associat-ed with a picture (or video) signal the additional frames contain time information on the time interval between the instant of detection of a reference signal after reading and the instant at which a picture signal read is to be dis-played on a monitor (50). An apparatus for recording or reproducing the above signals is described. (Fig. 7).

Description

"Method of and Apparatus for Recording anc1/or Reproducing a Picture Signal and an Associated Audio Signal in/from a Record Carrier and Record Carrier Obtained by Means of the Method".

The invention relates to a method of recording and/or reproducing a picture signal and an associated audio signal in/from a record carrier, in which during recordin~ the picture signal and the audio signal are encoded to form a first and a second information signa]. respectively comprising information words arranged in frames, each frame comprising a frame header and a data fleld, a data field of a frame comprising a plurality of information words of the picture signal or an audio signal, the header indicating the information signal to which the information words in the data field belongs, after which the frames are recorded on the record carrier; and in which during reproduction the frames are read from the record carrier and are decoded to obtain the picture signal and the associated audio signa].. The invention also relates to an apparatus for carryiny out the method and to a record carrier obtained by means of the method. More in particular, the invention relates to a method of recording and reproducing picture signals and associated audlo signals in the form of digital information in/from a record carrier, such as for example a compact disc.
As is generally known, the compact disc is a record carrier for the storage of digital information, which record carrier can contain a specific number of bits. The first application of the compact disc in the Compact Disc Digital Audio ~:~L81 la System, which is already a few years old envisaged its use as a record carrier for 16-bit PCM-encoded audio signals. For a comprehensive description of this system reference is made to Philips' Technical Review, Vol. 40, 1982, No. 6, in particular the article by J.P.J.

lZ~8~6 Heemskerk et al entitled "Compact disc system aspects and modulation" pages 157 to 164.
A ~econd application envisaged its use as a data ROM for data-processing equipment. A third application which 5 is now being developed and envisages its use as a record carrier for digitized video signals of pictures accompanied by digital audio signals and, if desired, computer data.
The application of the compact disc now envisaged is an interactive use, referred to as "CD-I". Papers on this l0 novel use have already been read at the Micro-soft Conference in Seattle, 3-5 March 1986, namely a paper by D.C. Geest entitled "Standardization of CD-I" and a paper by R. Bruno entitled "New developments in optical media", which was published in the "Philips Koerier" of 13 March l5 1986, pages 1 and 2.
In order to enable a picture to be recorded on a record carrier of the compact-disc type, the picture is divided into a plurality of lines (for example 280 lines) and every line is divided into a plurality of contiguous pic-20 ture elements(for example 384 elements). It is assumed thateach picture element is of uniform brightness and uniform colour. A picture element can be defined completely by a number of picture components; namely the luminance component Y(i,k) and the two colour-difference components U(i,k) 25 and V(i,k) or, which is in principle the same, by the three basic colour components R(i,k), G(i,k) and B(i,k).
Here l is the sequence number of the line and k the sequence number of the picture element on this line (column).
Each of the picture components of a picture 30 element is subjected to a coding, so that for each picture element an information word is obtained, hereinafter referred to as "video word". If PCM coding is applied the picture components of each picture element are encoded separately, i.e. independently of corresponding picture components of 35 other picture elements. However, if the picture components are subjected to a DPCM coding, broadly speaking only the difference between the corresponding picture components of every two successive picture elements is subjected to a 1~

PCM coding. Since encoding such a difference generally requires a smaller number of bits than separate]y encoding each of the picture components, DPCM encoding is applied for each of the picture components in the envisaged new application of the compact disc. This means that each plc-ture element is characterized by a 12-bit video word.
For a most economic use of the capacity of the record carrier the entire block of 280 x 384 video words is transmitted only once. The monitor comprises a picture memory having a number of storage locations which is at least equal to the number of picture elements in the pic-ture. Each storage location is unambiguously associated with a picture element and such a storage location contains the transmitted video word of the relevant picture element.
This picture memory is read out repeatedly in the customary manner in order to display the relevant picture.
It is to be noted that in practice it is not found to be necessary to transmit both the luminance component and the two colour-difference components of each picture element. It is found to be satisfactory to transmi.t the luminance co~nents of each picture element and alternately the colour-difference component U and the colour-difference component V of successive picture elements. This means that each picture element can be characteriæed by an 8-hit video word. More in particular, the first four bits of this video word represent the luminance component of the picture element in DPCM format and the four other bits represent (alternately) one of the two colour-difference components, also in DPCM format. Hereinafter, the totality of video words to be transmitted, which together define a specific ~cture, will be referred to as a "video block".
In the novel application of the compact disc now envisaged, a video block is arranged in frames prior to recording on the record carrier, similarly to the digitized information components, audio and computer data. Each frame comprises, for example, 2352 bytes and each frame is roughly divided into two fie]ds, namely a frame header comprising 24 bytes and a data field of 2328 bytes. The last 280 bytes , . . .

lZ91816 in the data field may be used for error protection and error correction of the other bytes in the data field. This is utilized, for example if the frame contains computer data.
The frame header inter alia comprises synchroniz-ation bytes for byte and bit synchronization, but also indi-cates whether the data in the data field is picture infor-mation, audio information or computer data. These cases are referred to as a video frame, an audio frame and a computer-data frame respectively. The data field of an audio frame comprises 1164 audio words of 16 bits each, whilst the data field of a video frame comprises 2328 video words of 8 bits each.
The novel use of the compact disc now envisaged moreover provides the possibility of choosing from a number of different audio-signal qualities.
- Firstly, there is the quality known from the original use in the Compact Disc Digital Audio system. This results in a compact disc fully packed with audio signals providing approximately 72 minutes of stereo sound of the well-known compact-disc quality (a dynamic range of 9O dB or better).
- Secondly, there is the "hifi music" mode. This possibility provides two stereo channels which are reproducible parallel to each other or four mono channels which are reproducible parallel to each other. A full compact disc then provides approximately 72 minutes of sound per stereo channel. Thus, if on a compact disc only one monosignal should be recorded, it is possible to store 4 x 72 minutes of audio signal on a full compact disc. The quality corresponds to that of a conventional long-play record.
- Thirdly, there is the "midfi music" mode. In this case a full compact disc contains four parallel channels, each channel accommodating a stereo signal of 72 minutes length, or eight channels containing a mono signal of 72 minutes length. The quality corresponds to that of an FM radio transmission.
- A fourth possibi]ity is the "speech" mode. This mode provides 8 parallel channels of stereo or 16 parallel ~291816 channels of mono signal of maximum 72 minutes length on a full compact disc. The quality is the same as that of an AM radio transmission.
As is known, CD digital audio is encoded in accordance with a 16-bit PCM code and the full storage capa-city of the compact disc is necessary for the storage bit of the 72-minute stereo signal.
The three other qualities with which the audio signal can be recorded on the record carrier are realized by means of an 8-bit or 4-:bit ADPCM code (adaptive data pulse code modulation).
These three possibilities require a storage capa-city of 50 %, 25 % and 12.5 % for the storage of the audio information of one channel. The remainder of the storage capacity is then available for the storage of video in-formation, computer data or for other sound channels. In the last-mentioned case it is possible to store speech in different languages in a corresponding number of parallel channels.
20 _ A fifth possibility is to encode the speech phonetically, so that an even longer playing time can be obtained.
The standard phonetic alphabet as specified for the desired language or languages is encoded and recorded on the compact disc together with a set of diphones for the 25 desired language and a resynthesis program by means of which the speech can be resynthesized by joining the diphones to each other. The resulting information density in one channel can be very high and may result in a playing time of over 5000 hours for one full compact disc.
In those cases in which two or more parallel channels are available it is possible, as stated previously, to store the same speech translated in different languages in these channels on the compact disc. This is of particu-lar importance when simultaneously reproducing picture in-formation and associated speech, to provide a possibility ofselecting the language in which said speech is to be reproduced.

129~316 It is the object of the invention to provide steps enab]ing picture information together with one associated audio signal, selected from different audio signals associated wlth the picture information, to be re-produced from the record carrier. The audio signal is then for example a text spoken in a certain language and associated with the picture information (the picture). This picture information is associated with other audio signals, i.e. the same text but spoken in another language (other languages). To this end the invention is characterized in that for recording at least a second audio signal associated with the picture signal the second audio signal is encoded to form a third information signal comprising information words arranged in frames, in that the frame headers of those frames which comprise an encoded audio signal moreover indicates to which of the two or more audio signals the information words in a data field of a frame belong, in that in addition reference signals and additional frames are recorded on the record carrier, which additional frames for each of the two or more audio signals associated with a picture signal contain time information pertaining to the time interval between the instant at which a reference signal is detected after read-out and the instant at which a read-out picture signal is to be displayed on a picture screen, and during reproduction the reference signals and the additional frames are read from the record carrier, the time information associated with one of the audio signals is derived from an additional frame under the influence of a first control signal,and s~bsequently a second control signal is derived from the time information thus derived and from a detected reference signal for displaying a read-out picture signal on a picture screen, and in that only said one audio signal is reproduced under the influence of the first control signal.
The invention is based on the recognition of the fact that, one language being of a more compact nature than the other language, or the successive order of words in a sentence being different for a dfferent language, the ~.2~.8~6 instant of displaying a picture associated with a te~t spoken in a specific language need not be the same as in the case that said text spoken in another language were reproduced. Therefore, for each language the record carrier should contain information on the instants at which successi-ve pictures must be reproduced during a text spoken in a specific language. This information is constituted by the time interval between the instant at which a reference signal appears in the information read from the record carrier and the instant at which a picture is displayed. Thus, in general, this time interval will differ ~or the dif-ferent audio signals (languages). A reference signal may be inserted in, for example, the frame header (for example the sub-header) of an additional frame . Another possibility is to include an associated reference signal for each audio signal (each language) in the frame header (for example, the sub-header) of the first frame which follows the additional frame and which contains information words of the relevant audio signal in a data field.
The time information may be included in the data field of an additional frame. These additional frames are anyway present on the record carrier and contain the program to be read out and stored in the processor of the read apparatus to ensure a correct operation of the apparatus.
The apparatus for recording a picture signal and an associated audio signal, for carrying out the method, comprising - a first input terminal for receiving the picture signal, - a second input terminal for receiving the audio signal, - an encoding unit having a first input and a second input coupled to the first input terminal and the second input terminal respectively, and having an output terminal, which encoding unit is constructed to encode the picture signal and the audio signal to obtain the first information signal and the second information signal respectively in the form of successive information words, which is 12918~L6 constructed to arrange the information words in frames, which is constructed to insert a signal code into the frame header to indicate the information signal to which th~ information words in the data field of the associated frame belong, and which is constructed to produce a sequence of frames on its output, - a recording unit, having an input coupled to the output of the encoding unit, which recording unit is constructed to record the successive frames in the record carrier, is characterized in that the encoding unit is adapted to encode at least a second audio signal associated with the picture signal to form a third information signal in the form of successive in-- formation words, which is adapted to arrange said infor-mation words in frames, which is adapted to insert a signal code into the frame header of frames containing an encoded audio signal to indicate to which of the two or more audio signals the information words in the data fields Ofthese frames belong, in that the encoding unit comprises a reference-signal generator for supplying reference signals, in that the unit is further adapted to generate additional frames, which additional frames contain said time informa-tion for each of the two or more audio signals associated with a picture signal, and which is adapted to produce these additional frames on its output terminal. Such an appara tus may be characterized further in that the encoding unit comprises - an audio encoding unit for encoding an audio signal, having an input coupled to the second input terminal and ha ving an output, - a video encoding unit for encoding a picture signal, having an input coupled to the first input terminal and having an output, - a signal-combination unit having a first input, a second input and a third input coupled to the output of the audio encoding unit, the output of the video encoding unit and the output of the reference-signal generator respectively, and ` 12911316 having an output coupled to the output terminal, in that the encoding unit further has a third input terminal for receiving said time information, which third input terminal is coupled to a fourth input of the signal-combination S unit, and in that the signal-combi.nation unit is adapted to arrange the information words from the audio-encoding unit and the video-encoding unit in the data fields of frames, which is further adapted to insert the signal code into the frame header of frames, and which is adapted to insert the time information into the additonal frames.
An apparatus for reproducing a picture signal and an associated audio signal, for carrying out the method, comprising - a read unit for reading successive frames from the lS record carrier and for supplying said frames to an output, - a decoding unit having an input coupled to the output of the read unit and having a first output and a second output, which decoding unit is constructed to separate frames containing information words of the first information signal and of frames contai.ning information words of the second information signal, which is constructed to decode the first information signal and the second information signal to form the pict.ure signal and the audio signal respectively and which is constructed to supply these si.gnals to a first output terminal and a second output terminal respectively, characterized in that the decoding unit has a control input for receiving the first control signal and in that the decoding unit is adapted to derive, under the influence of the first con-trol signal, one of the two or more audio signals and tosupply this audio signal to its second output terminal, in that the decoding unit is further adapted to extract the reference signals and the additional frames from the information read from the record carrier, to derive the time information associated with the rel.evant audio signal under the influence of the first control signal, to derive the second control signal, and to supply the picture signal to its first output terminal under the influence of said ~2918~6 second control signal.
Such an apparatus may be characterized further in that the decoding unit comprises a signal-separating unit, an audio decoding unit, a video decoding unit, a control unit and a clock si.gnal generator, in that the input terminal is coupled to an input of the signal-separating unit, which has a first output, a second output and a third output coupled to inputs of the video-decoding unit, the audio-l decoding unit and a first input of the control unit res-pectively, in that outputs of the video decoding unit and the audio decoding unit are coupled to the first output terminal and the second output terminal respectively, in that an output of the clock-signal generator is coupled to a second input of the control unit, which has an output coupled to a control input of the video decoding unit, and in that the control input of the decoding unit is coupled to control inputs of the signal-separating unit and the con-trol unit, in that the signal-separating unit is adapted to extract the frames containing the first information signal from the signal read from the record carrier and to supply these frames to the first output, to extract frames containing the relevant audi.o signal under the influence of the first control signal applied to its control.
input and to supply these frames to i.ts second output, which is adapted to extract the xeference signal and the additional frames from the signal read from the record car-rier, and to supply these signals to its third output, in that the control unit is adapted to derive the time in-formation associ.ated with the relevant audi.o signal from30 the additional frames under the influence ~ the first control signal and is adapted to generate the second control signal on its output from the time information derived and by means of the clock signal from the clock signal generator, and in that the video decoding unit is adapted to decode the fi.rst information signal to form a picture signal and is adapted to supply this picture signal to its output under the influence of the second control signal.
Embodiments of the invention will now be described ~291816 in more detail, by way of example, with reference to the accompanying drawings. In the drawings Fig. 1 represents a "slide show" with an associated text which may be spoken in two languages, Fig. 2 shows a record carrier, Fig. 3 shows a number of successive frames in the information stream, Fig. 4 shows the structure of a frame, Fig. 5 represents the time information associated with the two languages, Fig. 6 shows an apparatus for recording and Fig. 7 shows an apparatus for reproducing pictures and associated speech.
Fig. 1 very schematically represents a "slide show"
in which speech is illustrated with pictures. In Fig. 1a the line el on the time axis t very schematically represents an audio signal in the form of a text spoken in a compact language, for example English. In Fig. 1b the line fl very schematically represents the same text but 20 now spoken in a more ornate language, for example French.
The text spoken in English is shorter, from t = 0 to t = t4e, than the text spoken in French. The latter has a length from t = 0 to t = t4fl where t4f > t4e, as is apparent from Fig. l.
The texts el, fl may comprise one sentence or a plurality of sentences. A following text e2~ f2 starts at the instants t5e and t5f respective].y. In order to ensure that the text spoken in the two languages are nevertheless more or less synchroni.sed with each other, for example t5e is selected to be substantially equal to t5f.
The texts el and fl spoken in English and French respectively is illustrated with three pictures Bl, B2 and B3. As a result of the differences in compactness or prolixity between the two languages the pictures for the two languages should not he applied at the same instants.
From Fig. l it is evident that the pictures accompanied hy the English-language text will be applied at an earlier ~29~8~6 instant that when accompanied by the French-language text, because tle ~ tlf~ t2e < t2f a 3e 3f When the picture signals of the three pictures and the two audio signals corresponding to the English 5 English and tlle French text are recorded in the record carrier (compact disc) additional information has to be added in order to ensure that during reproduction the pictures are applied at the correct instants in conformity with the text spoken in one of the languages.
Fig. 2 schematically represents the record carrier (compact disc). The tracks extends over the record carrier 2 from the centre towards the circumference along a spiral path and is also recorded and read from the centre towards the circumference. The first spiral portion 3 between points lS a and b is the lead-in area. This lead-in area contains inter alia information on the contents of the record carrier.
The portion 4 of the track between points b and c contains frames of encoded audio signals, frames of encoded picture signals, frames of computer data and additional frames.
20 These additional frames may be the same as the frames of computer data. The spiral portion to the points c and d is the lead-out area. When the read means (the laser beam) reaches this lead~out area reproduction and energi~.at-ion of the motor by means of which the record carrier is rotated are terminated.
Fig. 3 schematically represents the contents of the track between the points q and h in Fig. 2. The portion is selected in such a way that it contains the (encoded) picture and audio information of the pictures and the text of Fig~ spoken in English and the French language. The first frame 6 in the portion between the points i and k in Fig. 2 is an additional frame comprising a frame header 6.1 and a data field 6.2. The frame header 6.1 is divided into a first part 6.h, also referred to as "header", and a second part 6.s, also referred to as "subheader". The following frames 7,8....etc. are divided in the same way into a frame header comprising a "header" and a "subheader", and a data field. Fig. 4 shows the structure of a frame in .

lZ9i~

more detail. A frame, for example a frame 8, comprises 2352 bytes in total and is divided into a frame header 8.l comprising 24 bytes and a data field 8.2 comprising 2328 bytes.
Further, the frame header 8.l is divided into a 12-byte synchronization field S and a four byte first auxiliary field EH together forming the head 8.h and an p-byte second auxiliary field TH constituting the sub-header. The synchronization field S indicates the beginning of the frame. It comprises one byte which only contains "0"
bits followed by 10 bytes consisting of "l" bits only and finally another byte consisting of "0" bits only. The bytes in the first auxiliary field EH indicate the sequence number of the frame in the track. The second auxiliary field TH
indicates whether the frame is a video frame, an audio frame or a computer-data frame. It is to be noted that a compact disc contains approximately 324/000 (= 72 x 60 x 75) frames in total. This is because a compact disc can contain appro-ximately 72 minutes of music, for which 75 frames per second should be read.
The data field D is divided into data slots DS.For an audio frame these da~ slots are selected in such a way that in each slot one 16-bit audio word of a digital audio signal can be accommodated. For a video frame the 25 data slots are selected in such a way that each slot can contain one 8-bit video word of a digital video signal.
For computer-data frames these data slots also have a length of one byte.
As already stated in the foregoing, each picture is divided into a matrix of 280 x 384 picture elements A(i,k). Herein, i(= 1, 2, ...280) is the sequence number of the line (row) and k (=1, 2, ... 384) is the sequence number of the picture element on said line (column). If for each picture element A(i,k) an eight-bit video word Q5i,k) is transmitted the transmission of a complete picture requires approximately 47 video frames.
If a data field of a frame is filled with infor-mation words of an audio signal recorded with the same 12~18~6 quality as that of the compact Disc Digital Audio system, 75 audio frames contain information for approximately one second of music. This is because, as stated previously, the record carrier is read at a rate of 75 frames per second.
If an audio signal is recorded on the record carrier with a lower sound quality after time compression an encoding, less audio frames are necessary to obtain one second of music (audio signal) after reading, decoding and time expansion. Thus, after reading an audio frame and after conversion of the information in this audio frame into an audio signal it may happen that an audio signal is reproduced during a long time interval whilst a (video) picture should be displayed, for example, somewhere halfway this time interval.
First of all during recording on the record carrier allowance should be therefore made for the fact that all the information necessary for a video picture has already been read from the record carrier prior to the instant at which a video picture should be displayed in the aforementioned time i.nterval during reading and this in-formation is availab]e to be displayed on a picture screen at the instant at which a control signal occurs.
Secondly, it is necessary to have information about the instant at which a picture should be displayed within said time interval. It is not sufficient to insert merely a control signal in the frame header of the relevant audio frame within whose time interval (after time expansion of the information read from the audio frame) a picture occurs.
This is because the picture should not be displayed at the instant at which this control signal in the audio frame is read but at a later instant, somewhere halfway said time interval.
Therefore, the record carrier should contain a control signal, hereinafter referred to as the reference signal, and time information, the time information indi-cating at which instant after a reference signal has been detected during reading, a picture is to be displayed.
This time information may be inserted in one or ` 1~91816 more of the additional frames. This means that for the various languages such an additional frame contains a table listing the time intervals between the instant of detection of the reference signal and the instant of displaying a picture. This table may be inserted in, for example, the data field of an additional frame.
Fig. 5 shows such a table based on the example of Fig. 1. It is assumed that during reading the reference signal for the two languages is detected at the same instant, namely at the instant t = O in the example of Fig.L This is not necessarily so, as will become apparent hereinafter.
The reference signal may be inserted in, for example, the subheader of an additonal frame. The reference signal is then detected after the relevant additional frame has been read. Detection is now effected at the same time for all languages.
Another possibility is to accommodate the reference signal in the subheader of the first frame which follows the additional frame and whose data field contains informat-ion words of the relevant language (the relevant audio sig-nal). This means that for each language an associated reference signal is inserted in the subheader of the first frame which occurs after the additional frame in the data stream and which contains information pertaining to the relevant language. In this case detection for the different languages is effected at different instants~
The reference signal may be inserted in a sub-header, for example as a code word having a specific con-figuration of "ones" and "zeros". After read-out this code word (these code words) can be detected by means of a suitable detector.
Fig. 6 shows an apparatus for recording a picture signal and an associated audio signal. The apparatus com-prises a first input terminal 11 for receiving a picture (or video) signal, a second input terminal 12 for receiving an audio signal, and a third input terminal 13 for receiving the data. The apparatus comprises an encoding unit 23 comprising a number of sections, namely: an audio encoding unit 14, a video encoding unit 15, a data encoding unit 16 and a signal-combination unit 17.
The audio encoding unit 14 is adapted to encode at least two audio signals (associated with the at least two languages) and to arrange these encoded signals in frames. The audio encoding unit 14 comprises two encoding units 14' and 14" arranged in parallel. The audio signal corresponding to the English-language text i5 applied to the sub-input 12' of the encoding unit 14' and is encoded in the encoding unit 14'. The audio signal corresponding to the French-language text is applied to the sub-input 12" of the encoding unit 14" and is encoded in the encoding unit 14". The audio frames applied to the inputs 18 and 19 of the signal-combination unit 17 by the encoding units 14' and 14" are arranged after each other by the signal-combination unit and are serially applied to the output 20.
The encoding units 14' and 14" insert a signal code which indicates with which of the two audio signals (cor-responding to the English or French text) the frames are associated into the sub-header of each audio frame which appear on their ouputs. This means that the encoding unit 14' inserts one signal code corresponding to one audio signal (English) into the sub-headers of all the frames sup-plied by the unit 14' and that the encoding unit 14" inserts the other signal code corresponding to the other audio sig-nal (French) into the sub-headers of all the frames supplied by the unit 14".
Instead of two parallel encoding units 14' and 14"
the audio encoding unit 14 may comprise only one encoding unit. In that case there is only one input terminal 12 instead of the sub-inputs 12' and 12". The audio signals for the two languages should then be applied to the input ter-minal 12 in time-multiplexed form. Obviously, the audio encoding unit 14 should then be capable of separating the time-multiplexed signals, of encoding them separately and of arranging them in frames. Further, the audio encoding unit 14 should then be capable of inserting the correct - ~2918~6 one of the two signal codes into the sub-header of a frame.
The audio encoding unit 14 now combines the data frames to form a serial data stream which is applied to the signal combination unit 17 via a signal line.
The video unit is constructed to encode the video signals applied to the input terminal 11 and to arrange the encoded information in video frames, which are subse-quently applied to the signal combination unit 17 via the input 21.
The data is applied to the data encoding unit 16 via the input terminal 13, which unit encodes the data and arranges the data in data frames which are applied to the input 22 of the signal combination unit 17.
The signal combination unit 17 joins the audio frames, the video frames and the data frames in the correct sequence to each other. On the output 20 this yie]ds a sequence of frames, for example as indicated in Fig. 3, the frame 6 being, for example, a data frame. The frames 7 and 8 are, for example, audio frames, the frame 7 being the 20 audio signal corresponding to (a part of) the English text of Fig. l and the frame 8 being the audio signal correspon-ding to ~a part of) the French text of Fig. l. The frame 9 may be, for example, a video frame. The data applied via the input terminal 13, which data is encoded and arranged in data frames by the encoding unit 16, inter alia contains the afore-mentioned time information (see Fig. 5). Thus, the time information is also encoded by the encoding unit 16 and accommodated in one or more data frames. Suitably, the time information is insert~ in the data field of a data 30 frame, i.e. for example in the data field 6.2 of the data frame 6.
The apparatus shown in Fig. 6 comprises a reference -signal generator 25 which receives a control signal via a control input 26 and, depending on this control signal, 35 supplies a reference signal, which for both languages may be inserted into the sub-header of a data frame, in the present example the data frame 6.
The control signal may be an external signal or may ~29~816 be supplied by a central processing unit of the apparatus (not shown), which also controls the varlous units in the apparatus and provides the timing of the various operations to be performed in the apparatus.
The reference-signal generator 25 supplies the reference signal to the sianal-combination unit 17 via the input 27, which signal-combination unit inserts the referen-ce signal into the sub-header of a data frame applied to the signal-combination unit 17 by the data encoding unit 16.
Obviously, it is also possible to apply the reference signals from the reference-signal generator 25 to the encod-ing unit 16. In that case the encoding unit 16 lnserts the reference signals into the sub-headers of the data frames. If the apparatus inserts the reference signals into the sub-hea-ders of the audio frames, the signal-combination unit 17 is adapted to insert the reference signals supplied by the generator 25 lnto the sub-headers of the first audio frame of each language following the data frame. For the English language the reference signal is then inserted into the frame 7 and for the French language into the frame 8.
The information steam comprising data, audio and video frames and appearing on the output 20 of the signal combination unit 17 is finally applied to the write unit 28 and recorded on the record carrier by the write unit 28 in the manner customary for compact discs.
Fig. 7 shows an apparatus for reproducing a picture signal and an associated audio signal. The apparatus comprises a read unit 30 which reads the information from the record carrier in the manner customary for compact discs and subsequently supplies this information to the input terminal 31 of a decoding unit 32. This decoding unit 32 comprises a signal-separating unit 33, which extracts the audio frames from the information stream applied to its input terminal 34 and supplies these frames to its output 35, which derives the video frames from this in-formation steam and supplies them to its output 36, and which derives the data frames and supplies them to its output 37. A first control signal is applied to a control 12~L8i~;
P~N 11 753 -19- 22-7-1986 input 38. This first control signal may be an external control signal applied by the user of the apparatus.
This signal enables the user to transfer his choice of the language in which the text of Fig. l is to be reproduced to the decoder unit 32 (via the control input 39). Under the influence of this control signal the separating unit 33 selects only those audio frames which contain the audio signal in the desired language and supplies these audio frames to its output 35.
I`he output 35 is coupled to an input 40 of an audio decoding unit 41 having an output 42 coupled to an output terminal 43 of the decoding unit 32. The audio de-coding unit 41 decodes the audio frames in a manner in-verse to the encoding by the audio encoding unit 14 (Fig. 6), so that on the output 42 an analog audio signal appears corresponding to the passage in the relevant language, see Fig. l. By means of a loudspeaker 44 connected to the output terminal 43 this audio signal is rendered audib]e to the user.
The output 36 is coupled to an input 45 of a video decoding unit 46 having an output 47 coupled to an output terminal 48 of the decoding unit 32. The video de-coding unit decodes the video frames in a manner inverse to the codi.ng by the video encoding unit 15. If a full picture, such as the picture Bl in Fig. l, has been decoded by the video decoding unit 46 the picture information of this picture is stored in a memory in the decoding unit.
At the instant at which a second control signal appears, which signal is applied to the control input 49 of the video decoding unit 46, this picture is read out of the memo-ry and supplied, via the output 47, to a display 50 con-nected to the output terminal 48.
The separating unit 33 supplies the data frames to the input 51 of a control unit 52 via the output 37.
In this control unit the data frames are decoded , so that they can be used in the unit 52 for controlling some program steps in the apparatus. The control unit 52 is also adapted to extract the time information from a data field 18~6 (such as 6.2 in Fig. 3) of a data frame, such as the data frame 6 in Fig. 3. Moreover, the first co~kol signal is applied to a control input 53 of the control unit 52. For this purpose, the control input 53 is coupled to the control input 39 for the decoding unit 32.
Under the influence of this first control signal, which indicates the choice of the language in which a text is to be reproduced, the control unit 52 only reads out the time information associated with the selected language. If the English language is selected, the control unit 52 only reads out information in the upper row (designated "e") of the table in Fig. 5.
The control unit has an output 54 to which the second control signal is supplied in order to be applied to the control input 49 of the video-signal decoding unit 46.
Hereinafter, it will be explained how this control signal is derived : first of all, this is done for the situation in which the reference signals are included in the subheaders of the data frames and subsequently for the situation in which the reference signals for each language are separately included in a subheader of an audio frame.
If a reference signal is included in the sub-header of a data frame, the control unit 52 is adapted to derive the reference signal from a data frame applied to i.tsinput 51 (in particular from the sub-header of this data frame, such as the data frame 6 in Fig. 3) and to detect this reference signal. Moreover, the control unit 52 is then adapted, to measure, after detection of the reference signal, the time intervals tle, t2e, t3e and tlf~ t2f~ t3f respectively (see Fig. 5) depending on the selected language and to deliver a second control signal at the instants at which these time intervals have elapsed.
This means that upon receipt of the three second control signals via the input 49 the video decoding unit 46 supplies the three pictures Bl, B2 and B3 from the picture memory (not shown) associated with the decoding unit 47 to the monitor 50 to display them on this monitor at the " ~2~18~6 instants tle (or tlf)/ t2e (or t2f) 3e 3f depending on the selected language.
In the foregoing it is assumed that the control unit 52 detects the reference signal in the sub-header of the data frame 6 at the instant t= O in Fig. l.
- Measuring the time intervals is effected by the control unit 52 by means of a clock signal which is applied to the control unit 52 by a clock-signal generator 55 via the input 56.
However, if a reference signal is included in the subheader of the audio frame the second control signal is derived by the control unit 52 in a different manner.
Detection of the reference signal should now he effected either in the signal separating unit 33 or in the audio de-lS coding unit 41. The most obvious method is to effectdetection in the decoding unit 41, because this decoding unit 41 receives only those audio frames which contain the audio signal in the selected language. This means that there is an additional coupling from the detection device in the decoding unit 41 to a control input 58 of the control unit 52 via the output 57 for supplying a control signal to the control unit 52 at the instant at which the reference signal is detected in the sub-header of an audio frame (which is the frame 7 for the English language and the frame 8 for the French language). The coupling between the output 57 of the decoding unit 41 and the control input 58 of the control unit 52 is indicated in broken lines. After receipt of the detection signal via the input 58 the control unit 52 counts the time inter-vals tl (or tlf)~ t2e (or t2f) and t3e ( 3f)on the selected language, use being made of the clock signal from the generator 55, and at the afore-mentioned instants it supplies the second control signal to the video decoding unit 46 via the input 49, so that the pictures Bl, B2 and R3 can be displayed on the monitor 50 at these instants.
The operation during reading is such that the information transfer is controlled by control signals 1291~3~L6 present in the audio information. The audio information is read in an undisturbed and substantially continuous man-ner. This is to be understood to mean that audio blocks read from the record carrier and subsequently decoded to form audio signals are applied directly to the loudspeaker 44.
However, the transfer of the video information to the monitor 50 is controlled by control signals inserted in the audio information for this purpose.
Further, it is possible to repeat the time infor-mation, the table in Fig. 5 or a part thereof, and insert this into a subsequent data frame (additional frame), for example the additional frame i in Fig. 3, which is the ne~t additional frame in the information stream after the frame 6. This re-insertion of (a part of) the time informat-ion into a subsequent additional frame has the following reason.
It may occur, for example, that the total infor-mation content of the passage in Fig l, in the two languages and together with the information content of the three pictures, is more than can be accommodated in the frames 7, 8 to i-l. This means that the frames j, k, l, ...
should also contain information required for the passage in Fig. l.
If random access to the information on the record carrier is required, reading can be started with the data frame 6 or the data frame i. It is assumed that during reading of the audio frames following the data frame i for example the picture B3 of Fig. l should be displayed on the monitor, whilst reading is started from the data frame i. This means that the data frame i should contain at least the time information associated with the picture R3, i.e~
at least the right-hand column of the table in Fig. 5.
It is to be noted that the scope of the invention is not limited to the em~odiments described in the foregoing.
Various modifications to the embodiments described are possib]e within the scope of the invention as defined in the appended Claims.

Claims

THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE PROPERTY
OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:

1. A method of recording and/or reproducing a pic-ture signal and an associated audio signal in/from a record carrier, in which during recording the picture signal and the audio signal are encoded to form a first and a second information signal respectively comprising information words arranged in frames, each frame comprising a frame header and a data field, a data field of a frame comprising a plurality of information words of the picture signal or an audio signal, the header indicating the information signal to which the information words in the data field belongs, after which the frames are recorded on the record carrier; and in which during reproduction the frames are read from the record carrier and are decoded to obtain the picture signal and the associated audio signal, characterized in that for recording at least a second audio signal associated with the picture signal the second audio signal is encoded to form a third information signal comprising information words arranged in frames, in that the frame headers or those frames which comprise an encoded audio signal moreover indicates to which of the two or more audio signals the information words in a data field of a frame belong, in that in addition reference signals and additional frames are recorded on the record carrier, which additional frames for each of the two or more audio signals associated with a picture signal contain time information pertaining to the time interval between the instant at which a reference signal is detected after read-out and the instant at which a read-out picture signal is to be displayed on a picture screen, and during reproduction the reference signals and the additional frames are read from the record carrier, the time infor-mation associated with one of the audio signals is derived from an additional frame under the influence of a first control signal and subsequently a second control signal is derived from the time information thus derived and from a detected reference signal for displaying a read-out picture signal on a picture screen, and in that only said one audio signal is reproduced under the influence of the first control signal.

2. A method as claimed in Claim 1, characterized in that the reference signal is inserted in the sub-header of an additional frame.

3. A method as claimed in Claim l, characterized in that for each audio signal an associated reference signal is included in the sub-header of the first frame which follows the additional frame and which contains information words of the relevant audio signal in its data field.

4. A method as claimed in any one of the Claims l, 2 or 3, characterized in that time information is included in the data field of an additional frame.

5. An apparatus for recording a picture signal and an associated audio signal in the record carrier, for carrying out the method as claimed in any one of the claims 1 to 3 comprising - a first input terminal for receiving the picture signal, - a second input terminal for receiving the audio signal, - an encoding unit having a first input and a second input coupled to the first input terminal and the second input terminal respectively, and having an output terminal, which encoding unit is constructed to encode the picture signal and the audio signal to obtain the first information signal and the second information signal respectively in the form of successive information words, which is constructed to arrange the information words in frames, which is constructed to insert a signal code into the frame header to indicate the information signal to which the information words in the data field of the associated frame belong, and which is constructed to produce a sequence of frames on its output, - a recording unit, having an input coupled to the output of the encoding unit, which recording unit is constructed to record the successive frames in the record carrier, is characterized in that the encoding unit is adapted to encode at least a second audio signal. associated with the picture signal to form a third information signal in the form of successive in-formation words, which is adapted to arrange said informat-ion words in frames, which is adapted to insert a signal.
code into the frame header of frames containing an encoded audio signal to indicate to which of the two or more audio signals the information words in the data fields of these frames belong, in that the encoding unit comprises a reference-signal generator for supplying reference signals, in that the unit is further adapted to generate additional frames, which additional frames contain said time informat-ion for each of the two or more audio signals associated with a picture signal, and which is adapted to produce these additional frames on its output terminal.

6. An apparatus as claimed in Claim 5, characterized in that the encoding unit comprises - an audio encoding unit for encoding an audio signal, having an input coupled to the second input terminal and having an output, - a video encoding unit for encoding a picture signal, having an input coupled to the first input terminal and having an output, - a signal-combination unit having a first input, a second input and a third input coupled to the output of the audio encoding unit, the output of the video encoding unit and the output of the reference-signal generator respective-ly, and having an output coupled to the output terminal, in that the encoding unit further has a third input terminal for receiving said time information, which third input ter-minal is coupled to a fourth input of the signal-combinat-ion unit, and in that the signal-combination unit is adapted to arrange the information words from the audio-encoding unit and the video-encoding unit in the data fields of frames, which is further adapted to insert the signal code into the frame header of frames, and which is adapted to insert the time information into the additional frames.

7. An apparatus as claimed in Claim 6, for carrying out the method as claimed in Claim 2, characterized in that the signal-combination unit is adapted to insert the reference signal into the sub-header of an additional frame.

8. An apparatus as claimed in Claim 6, for carrying out the method as claimed in Claim 3, characterized in that the signal-combination unit is adapted to insert for each audio signal a reference signal associated with the audio signal into the sub-header of the first frame which follows the additional frame and which contains information words of the relevant audio signal in its data field.

9. An apparatus as claimed in Claim 6, characterized in that the signal-combination unit is adapted to insert the time information into the data field of an additional frame.

10. An apparatus for reproducing a picture signal and an associated audio signal from a record carrier, for carrying out the method as claimed in any one of the Claims 1 to 3 comprising - a read unit for reading successive frames from the record carrier and for supplying said frames to an output, - a decoding unit having an input coupled to the output of the read unit and having a first output and a second output, which decoding unit is constructed to separate frames containing 26a information words of the first information signal and of frames containing information words of the second information signal, which is constructed to decode the first information signal and the second information signal to form the picture signal and the audio signal respectively, and which is constructed to supply these signals to a first output terminal and a second output terminal respectively, characterized in that the decoding unit has a control input for receiving the first control signal and in that the decoding unit is adapted to derive, under the influence of the first con-trol signal, one of the two or more audio signals and to supply this audio signal to its second output terminal, in that the decoding unit is further adapted to extract the reference signals and the additional frames from the information read from the record carrier, to derive the time information associated with the relevant audio signal under the influence of the first control signal, to derive tile second control signal, and to supply the picture signal to its first output terminal under the influence of said second control signal.

11. An apparatus as claimed in Claim 10, characterized in that the decoding unit comprises a signal-separating unit, an audio decoding unit, a video decoding unit, a control unit and a clock signal. generator, in that the input terminal is coupled to an input of the signal-separating unit, which has a first output, a second output and a third output coupled to inputs of the video-decoding unit, the audio-decoding unit and a first input of the control unit respectively, in that outputs of the video decoding unit and the audio decoding unit are coupled to the first output terminal and the second output terminal respectively, in that an output of the clock-signal generator is coupled to a second input. of the control unit, which has an output coupled to a control input of the video decoding unit, and in that the control input of the decoding unit is coupled to control inputs of the signal-separating unit and the control unit, in that the signal-separating unit is adapted to extract the frames containing the first infor-mation signal from the signal read from the record carrier and to supply these frames to the first output, to extract frames containing the relevant audio signal under the influence of the first control signal applied to its con-trol input and to supply these frames to its second output, which is adapted to extract the reference signal and the additional frames from the signal read from the record carrier, and to supply these signals to its third output, in that the control unit is adapted to derive the time information associated with the relevant audio signal from the additional frames under the influence of the first control signal and is adapted to generate the second control signal on its output from the time information derived and by means of the clock signal from the clock signal generator, and in that the video decoding unit is adapted to decode the first information signal to form a picture signal and is adapted to supply this picture signal to its output under the influence of the second control signal.

12. An apparatus as claimed in Claim 11, for carrying out the method as claimed in Claim 2, characterized in that the control unit is adapted to extract the reference signal from the sub-header of an additional frame.

13. An apparatus as claimed in Claim 11, for carrying out the method as claimed in Claim 4, characterized in that the control unit is adapted to extract the time information associated with the relevant audio signal from a data field of an additional frame under the influence of the first control signal.

14. A record carrier obtained by means of the method as claimed in any one of the Claims 1,2 or 3 cha-racterized in that in the record carrier information words of at least three information signals are included in the data fields of data frames, information words of only one of the three or more information signals being included in a data field of a frame, and in that reference signals and additional frames are also recorded in the record carrier, which additional frames contain the time information.