CA2508220A1 - Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream - Google Patents
Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream Download PDFInfo
- Publication number
- CA2508220A1 CA2508220A1 CA002508220A CA2508220A CA2508220A1 CA 2508220 A1 CA2508220 A1 CA 2508220A1 CA 002508220 A CA002508220 A CA 002508220A CA 2508220 A CA2508220 A CA 2508220A CA 2508220 A1 CA2508220 A1 CA 2508220A1
- Authority
- CA
- Canada
- Prior art keywords
- channel
- audio
- channels
- switching
- channel configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 title claims description 16
- 238000000034 method Methods 0.000 title claims description 8
- 238000002156 mixing Methods 0.000 claims description 23
- 108091006146 Channels Proteins 0.000 description 92
- 239000013598 vector Substances 0.000 description 6
- 238000013507 mapping Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 230000005404 monopole Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 230000002730 additional effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 229940000425 combination drug Drugs 0.000 description 1
- 235000009508 confectionery Nutrition 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
- H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S1/00—Two-channel systems
- H04S1/007—Two-channel systems in which the audio signals are in digital form
Abstract
In the MPEG-4 standard ISO/IEC 14496:2001 several audio objects that can be coded with different MPEG-4 format coding types can together form a composed audio system representing a single soundtrack from the several audio substreams. In a receiver the multiple audio objects are decoded separately, but not directly played back to a listener. Instead, transmitted instruction s for mixdown are used to prepare a single soundtrack. Mixdown conflicts can occur in case the audio signals to be combined have different channel number s or configurations. According to the invention an additional audio channel configuration node is used that tags the correct channel configuration information items to the decoded audio data streams to be presented. The invention enables the content provider to set the channel configuration in such a way that the presenter at receiver side can produce a correct channel presentation under all circumstances. An escape code value in the channel configuration data facilitates correct handling of not yet defined channel combinations.
Description
2 PCT/EP2003/013172 Method and Apparatus for processing two or more initially , decoded audio signals received or replayed from a bitstream The invention relates to a method and to an apparatus for s processing two or more initially decoded audio signals re-ceived or replayed from a bitstream, that each have a dif-ferent number of channels and/or different channel configu-rations, and that are combined before being presented in a final channel configuration.
to Background In the MPEG-4 standard ISO/IEC 14496:2001, in particular in is part 3 Audio and in part 1 Systems, several audio objects that can be coded with different MPEG-4 format coding types can together form a composed audio system representing a single soundtrack from the several audio substreams. User interaction, terminal capability, and speaker configuration 2o may be used when determining how to produce a single sound-track from the component objects. Audio composition means mixing multiple individual audio objects to create a single soundtrack, e.g. a single channel or a single stereo pair. A
set of instructions for mixdown is transmitted or trans-2s ferred in the bitstream. In a receiver the multiple audio objects are decoded separately, but not directly played. back to a listener. Instead, the transmitted instructions for mixdown are used to prepare a single soundtrack from the de-coded audio objects. This final soundtrack is then played 3o for the listener.
ISO/IEC 14496:2001 is the second version of the MPEG-4 Audio standard, whereas ISO/IEC 14496 is the first version.
In the above MPEG-4 Audio standard nodes for presenting au-dio are described. Header streams that contain configuration 3s information, which is necessary for decoding the audio sub-streams are transported via MPEG-4 Systems. In a simple au-dio scene the channel configuration of the audio decoder -for example 5.1 multichannel - can be fed inside the Com-positor from one node to the following node so that the channel configuration information can reach the presenter, which is responsible for the correct loudspeaker mapping.
The presenter represents that final part of the audio chain which is no more under the control of the broadcaster or content provider, e.g. an audio amplifier having volume con-trol and the attached loudspeakers.
io 'Node' means a processing step or unit used in the above MPEG-4 standard, e.g. an interface carrying out time syn-chronisation between a decoder and subsequent processing units, or a corresponding interface between the presenter and an upstream processing unit. In general, in ISO/IEC
14496-1:2001 the scene description is represented using a parametric approach. The description consists of an encoded hierarchy or tree of nodes with attributes and other infor-mation including event sources and targets. Leaf nodes in this tree correspond to elementary audio-visual data, 2o whereas intermediate nodes group this material to form au-dio-visual objects, and perform e.g. grouping and transfor-mation on such audio-visual objects (scene description nodes).
Audio decoders either have a predetermined channel configu-a5 ration by definition, or receive e.g. some configuration in-formation items for setting their channel configuration.
Invention Normally, in an audio processing tree the channel configura-tion of the audio decoders can be used for the loudspeaker mapping occurring after passing the sound node, see ISO/IEC
14496-3:2001, chapter 1.6.3.4 Channel Configuration. There-fore, as shown in Fig. 1, an MPEG-4 player implementation passes these information items, that are transmitted within
to Background In the MPEG-4 standard ISO/IEC 14496:2001, in particular in is part 3 Audio and in part 1 Systems, several audio objects that can be coded with different MPEG-4 format coding types can together form a composed audio system representing a single soundtrack from the several audio substreams. User interaction, terminal capability, and speaker configuration 2o may be used when determining how to produce a single sound-track from the component objects. Audio composition means mixing multiple individual audio objects to create a single soundtrack, e.g. a single channel or a single stereo pair. A
set of instructions for mixdown is transmitted or trans-2s ferred in the bitstream. In a receiver the multiple audio objects are decoded separately, but not directly played. back to a listener. Instead, the transmitted instructions for mixdown are used to prepare a single soundtrack from the de-coded audio objects. This final soundtrack is then played 3o for the listener.
ISO/IEC 14496:2001 is the second version of the MPEG-4 Audio standard, whereas ISO/IEC 14496 is the first version.
In the above MPEG-4 Audio standard nodes for presenting au-dio are described. Header streams that contain configuration 3s information, which is necessary for decoding the audio sub-streams are transported via MPEG-4 Systems. In a simple au-dio scene the channel configuration of the audio decoder -for example 5.1 multichannel - can be fed inside the Com-positor from one node to the following node so that the channel configuration information can reach the presenter, which is responsible for the correct loudspeaker mapping.
The presenter represents that final part of the audio chain which is no more under the control of the broadcaster or content provider, e.g. an audio amplifier having volume con-trol and the attached loudspeakers.
io 'Node' means a processing step or unit used in the above MPEG-4 standard, e.g. an interface carrying out time syn-chronisation between a decoder and subsequent processing units, or a corresponding interface between the presenter and an upstream processing unit. In general, in ISO/IEC
14496-1:2001 the scene description is represented using a parametric approach. The description consists of an encoded hierarchy or tree of nodes with attributes and other infor-mation including event sources and targets. Leaf nodes in this tree correspond to elementary audio-visual data, 2o whereas intermediate nodes group this material to form au-dio-visual objects, and perform e.g. grouping and transfor-mation on such audio-visual objects (scene description nodes).
Audio decoders either have a predetermined channel configu-a5 ration by definition, or receive e.g. some configuration in-formation items for setting their channel configuration.
Invention Normally, in an audio processing tree the channel configura-tion of the audio decoders can be used for the loudspeaker mapping occurring after passing the sound node, see ISO/IEC
14496-3:2001, chapter 1.6.3.4 Channel Configuration. There-fore, as shown in Fig. 1, an MPEG-4 player implementation passes these information items, that are transmitted within
3 a received MPEG-4 bitstream, together with the decoder out-put or outputs through the audio nodes AudioSource and Sound2D to the presenter. The channel configuration data ChannelConfig is to be used by the presenter to make the s correct loudspeaker association, especially in case of multi-channel audio (numChan > 1) where the phaseGroup flags in the audio nodes are to be set.
However, when combining or composing audio substreams having different channel assignments, e.g. 5.1 multichannel sur-io round sound and 2.0 stereo, some of the audio nodes (AudioMix, AudioSwitch and AudioFX) defined in the current MPEG-4 standard mentioned above can change the fixed channel assignment that is required for the correct channel repre-sentation, i.e. such audio nodes have a channel-variant be-i5 haviour leading to conflicts in the channel configuration transmission.
A problem to be solved by the invention is to deal properly with such channel configuration conflicts such that the pre-2o senter can replay sound with the correct or the desired channel assignments. This problem is solved by the method disclosed in claim 1. An apparatus that utilises this method is disclosed in claim 3.
2s The invention discloses different but related ways of solv-ing such channel configuration confusion by using channel-variant audio nodes. An additional audio channel configura-tion node is used, or its functionality is added to the ex-isting audio mixing and/or switching nodes. This additional 3o audio channel configuration node tags the correct channel configuration information items to the decoded audio data streams that pass through the Sound2D node to the presenter.
Advantageously, the invention enables the content provider 35 or broadcaster to set the channel configuration in such a way that the presenter at receiver side can produce a cor-
However, when combining or composing audio substreams having different channel assignments, e.g. 5.1 multichannel sur-io round sound and 2.0 stereo, some of the audio nodes (AudioMix, AudioSwitch and AudioFX) defined in the current MPEG-4 standard mentioned above can change the fixed channel assignment that is required for the correct channel repre-sentation, i.e. such audio nodes have a channel-variant be-i5 haviour leading to conflicts in the channel configuration transmission.
A problem to be solved by the invention is to deal properly with such channel configuration conflicts such that the pre-2o senter can replay sound with the correct or the desired channel assignments. This problem is solved by the method disclosed in claim 1. An apparatus that utilises this method is disclosed in claim 3.
2s The invention discloses different but related ways of solv-ing such channel configuration confusion by using channel-variant audio nodes. An additional audio channel configura-tion node is used, or its functionality is added to the ex-isting audio mixing and/or switching nodes. This additional 3o audio channel configuration node tags the correct channel configuration information items to the decoded audio data streams that pass through the Sound2D node to the presenter.
Advantageously, the invention enables the content provider 35 or broadcaster to set the channel configuration in such a way that the presenter at receiver side can produce a cor-
4 rect channel presentation under all circumstances.
An escape code value in the channel configuration data fa-cilitates correct handling of not yet defined channel combi-nations even in case signals having different channel con-s figurations are mixed and/or switched together.
The invention can also be used in any other multi-channel application wherein the received channel data are passed through a post processing unit having the inherent ability to interchange the received channels at reproduction.
io In principle, the inventive method is suited for processing two or more initially decoded audio signals received or re-played from a bitstream, that each have a different number of channels and/or different channel configurations, and 15 that are combined by mixing and/or switching before being presented in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information is attached, and wherein said mixing and/or switching is controlled such 2o that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or fol-lowing said switching is determined by related specific mix-ing and/or switching information provided from a content 2s provider or broadcaster, and wherein to the combined data stream to be presented a correspondingly updated channel configuration information is attached.
3o In principle the inventive apparatus includes:
- at least two audio data decoders that decode audio data received or replayed from a bitstream;
- means for processing the audio signals initially decoded by said audio data decoders, wherein at least two of said 35 decoded audio signals each have a different number of chan-nels and/or a different channel configuration, and wherein said processing includes combination by mixing and/or switching;
- means for presenting the combined audio signals in a final channel configuration, wherein to each one of said initially
An escape code value in the channel configuration data fa-cilitates correct handling of not yet defined channel combi-nations even in case signals having different channel con-s figurations are mixed and/or switched together.
The invention can also be used in any other multi-channel application wherein the received channel data are passed through a post processing unit having the inherent ability to interchange the received channels at reproduction.
io In principle, the inventive method is suited for processing two or more initially decoded audio signals received or re-played from a bitstream, that each have a different number of channels and/or different channel configurations, and 15 that are combined by mixing and/or switching before being presented in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information is attached, and wherein said mixing and/or switching is controlled such 2o that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or fol-lowing said switching is determined by related specific mix-ing and/or switching information provided from a content 2s provider or broadcaster, and wherein to the combined data stream to be presented a correspondingly updated channel configuration information is attached.
3o In principle the inventive apparatus includes:
- at least two audio data decoders that decode audio data received or replayed from a bitstream;
- means for processing the audio signals initially decoded by said audio data decoders, wherein at least two of said 35 decoded audio signals each have a different number of chan-nels and/or a different channel configuration, and wherein said processing includes combination by mixing and/or switching;
- means for presenting the combined audio signals in a final channel configuration, wherein to each one of said initially
5 decoded audio signals a corresponding specific channel con figuration information is attached, - wherein in said processing means said mixing and/or switching is controlled such that in case of non-matching number of channels and/or types of channel configurations io the number and/or configuration of the channels to be output following said mixing and/or following said switching is de-termined by related specific mixing and/or switching infor-mation provided from a content provider or broadcaster, and wherein to the combined data stream fed to said presenting i5 means a correspondingly updated channel configuration infor-mation is attached.
Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
Drawings Exemplary embodiments of the invention are described with 2s reference to the accompanying drawings, which show in:
Fig. 1 Transparent channel configuration information flow in a receiver;
Fig. 2 Channel configuration flow conflicts in a receiver;
Fig. 3 Inventive receiver including an additional node 3o AudioChannelConfig.
Exemplary embodiments 35 In Fig. 2 a first decoder 21 provides a decoded '5.1 mul-tichannel' signal via an AudioSource node or interface 24 to
Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
Drawings Exemplary embodiments of the invention are described with 2s reference to the accompanying drawings, which show in:
Fig. 1 Transparent channel configuration information flow in a receiver;
Fig. 2 Channel configuration flow conflicts in a receiver;
Fig. 3 Inventive receiver including an additional node 3o AudioChannelConfig.
Exemplary embodiments 35 In Fig. 2 a first decoder 21 provides a decoded '5.1 mul-tichannel' signal via an AudioSource node or interface 24 to
6 , a first input Inl of an AudioMix node or mixing stage 27. A
second decoder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input In2 of AudioMix node 27. The AudioMix node 27 represents a multi-channel switch that allows to connect any input channel or channels to any output channel or channels, whereby the ef-fective amplification factors used thereby can have any value between '0'='off' and '1'='on', e.g. '0.5', '0.6' or '0.707'. The output signal from AudioMix node 27 having a to '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28. A third de-coder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28.
The functionality of this AudioSwitch node 28 is similar to that of the AudioMix node 27, except that the 'amplification factors' used therein can have values '0'='off' or '1'='on' only. AudioMix node 27 and Audio switch node 28 are con-trolled by a control unit or stage 278 that retrieves andJor 2o evaluates from the bitstream received from a content pro-vider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes. Audio switch node 28 produces or evaluates se-quences of switching decisions related to the selection of z5 which input channels are to be passed through as which out-put audio channels. The corresponding whichChoice data field specifies the corresponding channel selections versus time instants. The audio output signal from AudioSwitch node 28 having a '2.0 stereo' format is passed via a Sound2D node or 3o interface 29 to the input of a presenter or reproduction stage 20.
In Fig. 2 two different conflicts are shown. The first con-flict occurs in the mix node 27, where a mix of a stereo signal into the surround channels in a 5.1 configuration is 35 shown. The question is, for example, whether the resulting audio output signal should have 5.1 channels, or the 5.1
second decoder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input In2 of AudioMix node 27. The AudioMix node 27 represents a multi-channel switch that allows to connect any input channel or channels to any output channel or channels, whereby the ef-fective amplification factors used thereby can have any value between '0'='off' and '1'='on', e.g. '0.5', '0.6' or '0.707'. The output signal from AudioMix node 27 having a to '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28. A third de-coder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28.
The functionality of this AudioSwitch node 28 is similar to that of the AudioMix node 27, except that the 'amplification factors' used therein can have values '0'='off' or '1'='on' only. AudioMix node 27 and Audio switch node 28 are con-trolled by a control unit or stage 278 that retrieves andJor 2o evaluates from the bitstream received from a content pro-vider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes. Audio switch node 28 produces or evaluates se-quences of switching decisions related to the selection of z5 which input channels are to be passed through as which out-put audio channels. The corresponding whichChoice data field specifies the corresponding channel selections versus time instants. The audio output signal from AudioSwitch node 28 having a '2.0 stereo' format is passed via a Sound2D node or 3o interface 29 to the input of a presenter or reproduction stage 20.
In Fig. 2 two different conflicts are shown. The first con-flict occurs in the mix node 27, where a mix of a stereo signal into the surround channels in a 5.1 configuration is 35 shown. The question is, for example, whether the resulting audio output signal should have 5.1 channels, or the 5.1
7 surround channels should become 2.0 stereo format channels.
In case of selecting a 5.1 output format the straight-forward solution would be to assign input signal L2 to the first output-channel lch and input signal R2 to the second s output channel 2ch. However, there are many other possibili-ties. The content provider or broadcaster could desire to assign input signal L2 to output channel 4ch and input sig-nal R2 to output channel 5ch instead. However, the current version of the above MPEG-4 standard does not allow such to feature .
The second conflict occurs in the sequence of whichChoice data field updates in the AudioSwitch node 28. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se-~5 quentially selected at specified time instants. The time in-stants in the whichChoice data field can be defined by e.g.
every succeeding frame or group of frames, every predeter-mined time period (for instance 5 minutes), each time the content provider or broadcaster has preset or commanded, or 2o upon each mouse click of a user. In the example given in Fig. 2, at a first time instant input signal C1 is connected to output channel 1ch and input signal M is connected to output channel 2ch. At-a second time instant input signal L1 is connected to output channel lch and input signal R1 is 2s connected to output channel 2ch. At a third time instant in-put signal LS1 is connected to output channel lch and input signal RS1 is connected to output channel 2ch. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se-so quentially selected. However, because of the contradictory input information in node 28, no correct output channel con-figuration can be determined automatically based on the cur-rent version of the above MPEG-4 standard.
35 Based on the assumption that the content provider or broad-caster is to solve such conflicts, three inventive solutions
In case of selecting a 5.1 output format the straight-forward solution would be to assign input signal L2 to the first output-channel lch and input signal R2 to the second s output channel 2ch. However, there are many other possibili-ties. The content provider or broadcaster could desire to assign input signal L2 to output channel 4ch and input sig-nal R2 to output channel 5ch instead. However, the current version of the above MPEG-4 standard does not allow such to feature .
The second conflict occurs in the sequence of whichChoice data field updates in the AudioSwitch node 28. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se-~5 quentially selected at specified time instants. The time in-stants in the whichChoice data field can be defined by e.g.
every succeeding frame or group of frames, every predeter-mined time period (for instance 5 minutes), each time the content provider or broadcaster has preset or commanded, or 2o upon each mouse click of a user. In the example given in Fig. 2, at a first time instant input signal C1 is connected to output channel 1ch and input signal M is connected to output channel 2ch. At-a second time instant input signal L1 is connected to output channel lch and input signal R1 is 2s connected to output channel 2ch. At a third time instant in-put signal LS1 is connected to output channel lch and input signal RS1 is connected to output channel 2ch. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se-so quentially selected. However, because of the contradictory input information in node 28, no correct output channel con-figuration can be determined automatically based on the cur-rent version of the above MPEG-4 standard.
35 Based on the assumption that the content provider or broad-caster is to solve such conflicts, three inventive solutions
8 are feasible that are explained in connection with Fig. 3.
A first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input of an AudioMix node or mixing stage 27. A second de-coder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input of AudioMix node 27. The output signal from AudioMix node 27 having a '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28. A
io third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28. The decoders may each include at the input an internal or external decoding buffer. The output signal from AudioSwitch node 28 having a '2.0 stereo' format i5 is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or 2o broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes.
A new audio node, called AudioChannelConfig node 30 is in-troduced between AudioSwitch node 28 and Sound2D node 29.
2s This node has the following properties or function:
AudioChannelConfig{
exposedField SFInt32 numChannel 0 exposedField MFInt32 phaseGroup 0 exposedField MFInt32 channelConfig 0 3o exposedField MFFloat channelLocation 0,0 exposedField MFFloat channelDirection 0,0 exposedField MFInt32 polarityPattern 1 expressed in the MPEG-4 notation. SFInt32, MFInt32 and 35 MFFloat are single field (SF, containing a single value) and multiple field (MF, containing a multiple values and the
A first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input of an AudioMix node or mixing stage 27. A second de-coder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input of AudioMix node 27. The output signal from AudioMix node 27 having a '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28. A
io third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28. The decoders may each include at the input an internal or external decoding buffer. The output signal from AudioSwitch node 28 having a '2.0 stereo' format i5 is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or 2o broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes.
A new audio node, called AudioChannelConfig node 30 is in-troduced between AudioSwitch node 28 and Sound2D node 29.
2s This node has the following properties or function:
AudioChannelConfig{
exposedField SFInt32 numChannel 0 exposedField MFInt32 phaseGroup 0 exposedField MFInt32 channelConfig 0 3o exposedField MFFloat channelLocation 0,0 exposedField MFFloat channelDirection 0,0 exposedField MFInt32 polarityPattern 1 expressed in the MPEG-4 notation. SFInt32, MFInt32 and 35 MFFloat are single field (SF, containing a single value) and multiple field (MF, containing a multiple values and the
9 quantity of values) data types that are defined in ISO/IEC
14772-1:1998, subclause 5.2. 'Int32' means an integer number and 'Float' a floating point number. 'exposedField' denotes a data field the content of which can be changed by the con-s tent provider or broadcaster per audio scene.
The phaseGroup (specifies phase relationships in the node output, i . e. specifies whether or not there are important phase relationships between multiple audio channels) and the numChannel (number of channels in the node output) fields 1o are re-defined by the content provider due to the functional correlation with the channelConfig field: or parameters.
The channelConfig field and the below channel configuration association table can be defined using a set of pre-defined index values, thereby using values from the ISO/IEC 14496-15 3:2001 audio part standard, chapter 1.6.3.4. According to the invention, it is extended using some values of chapter 0.2.3.2 of the MPEG-2 audio standard ISO/IEC 13818-3:
indexNo. of audio syntactic elements,Channel to speaker mapping valuechannelslisted in order received 0 unspeci-unspecified channelConfiguration from child fled node is passed through 1 - Escape sequence The channelLocation, channelDi-rection and polarityPattern fields are valid 2 1 single channel elementcentre front speaker 3 2 channel_pair element left, right front speakers 4 3 single channel_element,centre front speaker, channel_pair element left, right front speakers 4 single channel element,centre front speaker, channel_pair element, left, right centre front speakers, single channel elementrear surround speakers 6 5 single channel element,centre front speaker, channel_pair element, left, right front speakers, channel_pair element left surround, right surround rear speakers 7 5+1 single channel element,centre front speaker, channel_pair element, left, right front speakers, channel_pair element, left surround, right surround rear Ife_element speakers, front low frequency ef-fects speaker 8 7+1 single channel element,centre front speaker, channel_pair element, left, right centre front speakers, channel_pair element, left, right outside front speakers, channel_pair element, left surround, right surround rear Ife element speakers, front low frequency ef-fects speaker 9 2/2 MPEG-2 L, R, LS, RS left, right front speakers, left surround, right surround rear speakers
14772-1:1998, subclause 5.2. 'Int32' means an integer number and 'Float' a floating point number. 'exposedField' denotes a data field the content of which can be changed by the con-s tent provider or broadcaster per audio scene.
The phaseGroup (specifies phase relationships in the node output, i . e. specifies whether or not there are important phase relationships between multiple audio channels) and the numChannel (number of channels in the node output) fields 1o are re-defined by the content provider due to the functional correlation with the channelConfig field: or parameters.
The channelConfig field and the below channel configuration association table can be defined using a set of pre-defined index values, thereby using values from the ISO/IEC 14496-15 3:2001 audio part standard, chapter 1.6.3.4. According to the invention, it is extended using some values of chapter 0.2.3.2 of the MPEG-2 audio standard ISO/IEC 13818-3:
indexNo. of audio syntactic elements,Channel to speaker mapping valuechannelslisted in order received 0 unspeci-unspecified channelConfiguration from child fled node is passed through 1 - Escape sequence The channelLocation, channelDi-rection and polarityPattern fields are valid 2 1 single channel elementcentre front speaker 3 2 channel_pair element left, right front speakers 4 3 single channel_element,centre front speaker, channel_pair element left, right front speakers 4 single channel element,centre front speaker, channel_pair element, left, right centre front speakers, single channel elementrear surround speakers 6 5 single channel element,centre front speaker, channel_pair element, left, right front speakers, channel_pair element left surround, right surround rear speakers 7 5+1 single channel element,centre front speaker, channel_pair element, left, right front speakers, channel_pair element, left surround, right surround rear Ife_element speakers, front low frequency ef-fects speaker 8 7+1 single channel element,centre front speaker, channel_pair element, left, right centre front speakers, channel_pair element, left, right outside front speakers, channel_pair element, left surround, right surround rear Ife element speakers, front low frequency ef-fects speaker 9 2/2 MPEG-2 L, R, LS, RS left, right front speakers, left surround, right surround rear speakers
10 2/1 MPEG-2 L, R, S left, right front speakers, rear surround speaker Table 1: Channel configuration association Advantageously, an escape value '1' is defined in this table having e.g. index '1' in the table. If this value occurs, s the desired channel configuration is not listed in the table and therefore the values in the channelLocation, channelDi-rection and polarityPattern fields are to be used for as-signing the desired channels and their properties. If the channelConfig index is an index defined in the table, the to channelLocation, channelDirection and polarityPattern fields are vectors of the length zero.
In the channelLocation and channelDirection fields a 3D-float vector array can be defined, whereby the first 3 float
In the channelLocation and channelDirection fields a 3D-float vector array can be defined, whereby the first 3 float
11 values (three-dimensional vector) are associated with the first channel, the next 3 float values are associated with the second channel, and so on.
The values are defined as x,y,z values (right handed coordi-nate system as used in ISO/IEC 14772-1 (VRML 97)). The chan-nelLocation values describe the direction and the absolute distance in meter (the absolute distance has been used be-cause simply the user can generate a normalised vector, as usually used in channel configuration). The channelDirection io is a unit vector with the same coordinate system. E.g. chan-nelLocation [0, 0, -1] relative to the listening sweet spot means centre speaker in one-meter distance. Three other ex-amples are given in the three lines of table 2:
channelLocation channelDirection Location X Y Z X Y Z
0 0 -1 0 0 1 center front speaker k*sin(30)0 k*-cos(60)-sin(30)0 cos(60)right front speaker k*-sin(45)k*sin(45)k*-cos(45)sin(45)-sin(45)cos(45)Ambisonic Cube (LFU) Left Front Up Table Z: Examples for channelLocation and channelDirection The polarityPattern is an integer vector where the values are restricted to the values given in table 3. This is use-ful for example in case of Dolby ProLogic sound where the 2o front channels have monopole pattern and the surround chan-nel have dipole characteristic.
The polarityPattern can have values according to table 2.
Value Characteristics 0 Monopole 1 Dipole 3 Cardioide 4 Headphone wanle 1: polarityYattern association
The values are defined as x,y,z values (right handed coordi-nate system as used in ISO/IEC 14772-1 (VRML 97)). The chan-nelLocation values describe the direction and the absolute distance in meter (the absolute distance has been used be-cause simply the user can generate a normalised vector, as usually used in channel configuration). The channelDirection io is a unit vector with the same coordinate system. E.g. chan-nelLocation [0, 0, -1] relative to the listening sweet spot means centre speaker in one-meter distance. Three other ex-amples are given in the three lines of table 2:
channelLocation channelDirection Location X Y Z X Y Z
0 0 -1 0 0 1 center front speaker k*sin(30)0 k*-cos(60)-sin(30)0 cos(60)right front speaker k*-sin(45)k*sin(45)k*-cos(45)sin(45)-sin(45)cos(45)Ambisonic Cube (LFU) Left Front Up Table Z: Examples for channelLocation and channelDirection The polarityPattern is an integer vector where the values are restricted to the values given in table 3. This is use-ful for example in case of Dolby ProLogic sound where the 2o front channels have monopole pattern and the surround chan-nel have dipole characteristic.
The polarityPattern can have values according to table 2.
Value Characteristics 0 Monopole 1 Dipole 3 Cardioide 4 Headphone wanle 1: polarityYattern association
12 In an alternative embodiment of the invention, the addi-tional AudioChannelConfig node 30 is not inserted. Instead, the functionality of this node is added to nodes of the type AudioMix 27, AudioSwitch 28 and AudioFX (not depicted).
In an further alternative embodiment of the invention, the above values of the phaseGroup fields are additionally de-fined for the corresponding existing nodes AudioMix, AudioSwitch and AudioFX in the first version ISO/IEC 14496 to of the MPEG-4 standard. This is a partial solution whereby the values for the phase groups are taken from above table 1 except the escape sequence. Higher values are reserved for private or future use. For example, channels having the pha-seGroup 2 are identified as left/right front speakers.
In an further alternative embodiment of the invention, the above values of the phaseGroup fields are additionally de-fined for the corresponding existing nodes AudioMix, AudioSwitch and AudioFX in the first version ISO/IEC 14496 to of the MPEG-4 standard. This is a partial solution whereby the values for the phase groups are taken from above table 1 except the escape sequence. Higher values are reserved for private or future use. For example, channels having the pha-seGroup 2 are identified as left/right front speakers.
Claims (4)
1. Method for processing two or more initially decoded (21, 22, 23) audio signals received or replayed from a bit-stream, that each have a different number of channels and/or different channel configurations, and that are combined by mixing (27) and/or switching (28) before be-ing presented (20) in a final channel configuration, wherein to each one of said initially decoded audio sig-nals a corresponding specific channel configuration in-formation item (ChannelConfig) is attached and the chan-nel configuration information items for said two or more initially decoded audio signals can demand channel con-figurations conflicting with each other, characterised in that said mixing (27) and/or switching (28) is controlled such that in case of non-matching number of channels and/or non-matching types of channel configurations the number of the channels to be output and/or the configura-tion type of the channels to be output following said mixing and/or said switching is determined by related specific mixing and/or switching information (27B) pro-vided from a content provider or broadcaster and that is embedded in said bitstream, and in that to the combined data stream to be presented a correspondingly updated channel configuration information item is attached (30).
2. Method according to claim 1, wherein said bitstream has MPEG-4 format.
3, Apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream, that each have a different number of channels and/or different channel configurations, and that are combined by mixing and/or switching before being presented in a final chan-nel configuration, wherein to each one of said initially decoded audio sig-nals a corresponding specific channel configuration in-formation item (ChannelConfig) is attached and the chan-nel configuration information items for said two or more initially decoded audio signals can demand channel con-figurations conflicting with each other, said apparatus including:
- at least two audio data decoders (21, 22, 23) that ini-tially decode audio data received or replayed from said bitstream;
- means (24-28) for processing the audio signals initially decoded by said audio data decoders, wherein at least two of said decoded audio signals each have a different num-ber of channels and/or a different channel configuration.
and wherein said processing includes combination by mix-ing (27) and/or switching (28);
- means (20) for presenting the combined audio signals in a final channel configuration, ' wherein in said processing means (24-28) said mixing (27) and/or switching (28) is controlled such that in case of non-matching number of channels and/or non-matching types of channel configurations the number of the channels to be output and/or the configuration type of the channels to be output following said mixing and/or said switching is determined by related specific mixing and/or switching information (278) provided from a content provider or broadcaster and that is embedded in said bitstream;
means (30) for attaching to the combined data stream fed to said presenting means (20) a correspondingly updated channel configuration information item.
- at least two audio data decoders (21, 22, 23) that ini-tially decode audio data received or replayed from said bitstream;
- means (24-28) for processing the audio signals initially decoded by said audio data decoders, wherein at least two of said decoded audio signals each have a different num-ber of channels and/or a different channel configuration.
and wherein said processing includes combination by mix-ing (27) and/or switching (28);
- means (20) for presenting the combined audio signals in a final channel configuration, ' wherein in said processing means (24-28) said mixing (27) and/or switching (28) is controlled such that in case of non-matching number of channels and/or non-matching types of channel configurations the number of the channels to be output and/or the configuration type of the channels to be output following said mixing and/or said switching is determined by related specific mixing and/or switching information (278) provided from a content provider or broadcaster and that is embedded in said bitstream;
means (30) for attaching to the combined data stream fed to said presenting means (20) a correspondingly updated channel configuration information item.
4. Apparatus according to claim 3, wherein said bitstream has MPEG-4 format.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP02026779A EP1427252A1 (en) | 2002-12-02 | 2002-12-02 | Method and apparatus for processing audio signals from a bitstream |
| EP02026779.5 | 2002-12-02 | ||
| PCT/EP2003/013172 WO2004052052A2 (en) | 2002-12-02 | 2003-11-24 | Method and apparatus for processing audio signals from a bitstream |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2508220A1 true CA2508220A1 (en) | 2004-06-17 |
| CA2508220C CA2508220C (en) | 2013-02-19 |
Family
ID=32309353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2508220A Expired - Fee Related CA2508220C (en) | 2002-12-02 | 2003-11-24 | Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream |
Country Status (9)
| Country | Link |
|---|---|
| US (1) | US8082050B2 (en) |
| EP (2) | EP1427252A1 (en) |
| JP (2) | JP5031988B2 (en) |
| KR (1) | KR101024749B1 (en) |
| CN (1) | CN100525513C (en) |
| AU (1) | AU2003288154B2 (en) |
| BR (2) | BRPI0316498B1 (en) |
| CA (1) | CA2508220C (en) |
| WO (1) | WO2004052052A2 (en) |
Families Citing this family (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE60311522T2 (en) * | 2002-12-02 | 2007-10-31 | Thomson Licensing | METHOD FOR DESCRIPTION OF THE COMPOSITION OF AN AUDIOSIGNAL |
| KR100745689B1 (en) | 2004-07-09 | 2007-08-03 | 한국전자통신연구원 | Apparatus and Method for separating audio objects from the combined audio stream |
| US8108219B2 (en) | 2005-07-11 | 2012-01-31 | Lg Electronics Inc. | Apparatus and method of encoding and decoding audio signal |
| JP2007157191A (en) * | 2005-11-30 | 2007-06-21 | Toshiba Corp | Device and method for mixing voices |
| TWI326448B (en) * | 2006-02-09 | 2010-06-21 | Lg Electronics Inc | Method for encoding and an audio signal and apparatus thereof and computer readable recording medium for method for decoding an audio signal |
| JP4193865B2 (en) * | 2006-04-27 | 2008-12-10 | ソニー株式会社 | Digital signal switching device and switching method thereof |
| CN101490744B (en) * | 2006-11-24 | 2013-07-17 | Lg电子株式会社 | Method and apparatus for encoding and decoding an audio signal |
| US20080201292A1 (en) * | 2007-02-20 | 2008-08-21 | Integrated Device Technology, Inc. | Method and apparatus for preserving control information embedded in digital data |
| CN101675472B (en) | 2007-03-09 | 2012-06-20 | Lg电子株式会社 | A method and an apparatus for processing an audio signal |
| KR20080082917A (en) | 2007-03-09 | 2008-09-12 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
| US20100249963A1 (en) * | 2007-06-25 | 2010-09-30 | Recollect Ltd. | recording system for salvaging information in retrospect |
| KR101572894B1 (en) | 2007-09-06 | 2015-11-30 | 엘지전자 주식회사 | A method and an apparatus of decoding an audio signal |
| US8615088B2 (en) | 2008-01-23 | 2013-12-24 | Lg Electronics Inc. | Method and an apparatus for processing an audio signal using preset matrix for controlling gain or panning |
| WO2009093867A2 (en) | 2008-01-23 | 2009-07-30 | Lg Electronics Inc. | A method and an apparatus for processing audio signal |
| KR101024924B1 (en) * | 2008-01-23 | 2011-03-31 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
| KR101461685B1 (en) * | 2008-03-31 | 2014-11-19 | 한국전자통신연구원 | Method and apparatus for generating side information bitstream of multi object audio signal |
| KR101596504B1 (en) * | 2008-04-23 | 2016-02-23 | 한국전자통신연구원 | / method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service |
| US8639368B2 (en) | 2008-07-15 | 2014-01-28 | Lg Electronics Inc. | Method and an apparatus for processing an audio signal |
| EP2146341B1 (en) * | 2008-07-15 | 2013-09-11 | LG Electronics Inc. | A method and an apparatus for processing an audio signal |
| TWI427619B (en) * | 2008-07-21 | 2014-02-21 | Realtek Semiconductor Corp | Audio mixer and method thereof |
| US20100057471A1 (en) * | 2008-08-26 | 2010-03-04 | Hongwei Kong | Method and system for processing audio signals via separate input and output processing paths |
| KR101600352B1 (en) * | 2008-10-30 | 2016-03-07 | 삼성전자주식회사 | / method and apparatus for encoding/decoding multichannel signal |
| CN102016982B (en) * | 2009-02-04 | 2014-08-27 | 松下电器产业株式会社 | Connection apparatus, remote communication system, and connection method |
| KR101040086B1 (en) * | 2009-05-20 | 2011-06-09 | 전자부품연구원 | Method and apparatus for generating audio and method and apparatus for reproducing audio |
| US9154596B2 (en) * | 2009-07-24 | 2015-10-06 | Broadcom Corporation | Method and system for audio system volume control |
| US8521316B2 (en) * | 2010-03-31 | 2013-08-27 | Apple Inc. | Coordinated group musical experience |
| US8965545B2 (en) * | 2010-09-30 | 2015-02-24 | Google Inc. | Progressive encoding of audio |
| US20120148075A1 (en) * | 2010-12-08 | 2012-06-14 | Creative Technology Ltd | Method for optimizing reproduction of audio signals from an apparatus for audio reproduction |
| CN102547140A (en) * | 2010-12-31 | 2012-07-04 | 新奥特（北京）视频技术有限公司 | Method for supporting multimode audio import |
| US8842842B2 (en) | 2011-02-01 | 2014-09-23 | Apple Inc. | Detection of audio channel configuration |
| CN103703511B (en) * | 2011-03-18 | 2017-08-22 | 弗劳恩霍夫应用研究促进协会 | It is positioned at the frame element in the frame for the bit stream for representing audio content |
| CN104364843B (en) | 2012-06-14 | 2017-03-29 | 杜比国际公司 | Solution code system, reconstructing method and equipment, coding system, method and apparatus and audio publishing system |
| TWI530941B (en) * | 2013-04-03 | 2016-04-21 | 杜比實驗室特許公司 | Methods and systems for interactive rendering of object based audio |
| EP2830045A1 (en) * | 2013-07-22 | 2015-01-28 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Concept for audio encoding and decoding for audio channels and audio objects |
| CN104053047B (en) * | 2014-06-24 | 2018-04-10 | 深圳市九洲电器有限公司 | A kind of audio output adjusting apparatus and method of adjustment |
| WO2016018787A1 (en) * | 2014-07-31 | 2016-02-04 | Dolby Laboratories Licensing Corporation | Audio processing systems and methods |
| WO2016035731A1 (en) * | 2014-09-04 | 2016-03-10 | ソニー株式会社 | Transmitting device, transmitting method, receiving device and receiving method |
| CN105635893B (en) * | 2014-10-31 | 2019-05-10 | Tcl通力电子（惠州）有限公司 | Terminal device and method for distributing sound channels thereof |
| CN205789102U (en) * | 2016-04-08 | 2016-12-07 | 王泰来 | High-fidelity is used to mix the high-fidelity dual-audio playing device putting device |
| ES2953832T3 (en) | 2017-01-10 | 2023-11-16 | Fraunhofer Ges Forschung | Audio decoder, audio encoder, method of providing a decoded audio signal, method of providing an encoded audio signal, audio stream, audio stream provider and computer program using a stream identifier |
| US10553224B2 (en) | 2017-10-03 | 2020-02-04 | Dolby Laboratories Licensing Corporation | Method and system for inter-channel coding |
| US20200388292A1 (en) * | 2019-06-10 | 2020-12-10 | Google Llc | Audio channel mixing |
Family Cites Families (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5594800A (en) * | 1991-02-15 | 1997-01-14 | Trifield Productions Limited | Sound reproduction system having a matrix converter |
| JPH07162384A (en) | 1993-12-06 | 1995-06-23 | Mitsubishi Electric Corp | Television receiver and output method for audio signal thereof |
| DE4409368A1 (en) * | 1994-03-18 | 1995-09-21 | Fraunhofer Ges Forschung | Method for encoding multiple audio signals |
| JPH0831096A (en) * | 1994-07-12 | 1996-02-02 | Matsushita Electric Ind Co Ltd | Audio data coding recorder and audio data decoding reproducing device |
| US5647008A (en) * | 1995-02-22 | 1997-07-08 | Aztech Systems Ltd. | Method and apparatus for digital mixing of audio signals in multimedia platforms |
| JP2766466B2 (en) * | 1995-08-02 | 1998-06-18 | 株式会社東芝 | Audio system, reproduction method, recording medium and recording method on recording medium |
| US6259957B1 (en) * | 1997-04-04 | 2001-07-10 | Cirrus Logic, Inc. | Circuits and methods for implementing audio Codecs and systems using the same |
| US6298025B1 (en) * | 1997-05-05 | 2001-10-02 | Warner Music Group Inc. | Recording and playback of multi-channel digital audio having different resolutions for different channels |
| US7333863B1 (en) * | 1997-05-05 | 2008-02-19 | Warner Music Group, Inc. | Recording and playback control system |
| BR9804955B1 (en) * | 1997-06-03 | 2009-12-01 | apparatus and process for reproducing a digital audio signal from a recording medium. | |
| US6141597A (en) * | 1997-09-08 | 2000-10-31 | Picturetel Corporation | Audio processor |
| US6654931B1 (en) * | 1998-01-27 | 2003-11-25 | At&T Corp. | Systems and methods for playing, browsing and interacting with MPEG-4 coded audio-visual objects |
| JPH11225390A (en) * | 1998-02-04 | 1999-08-17 | Matsushita Electric Ind Co Ltd | Reproduction method for multi-channel data |
| US6119091A (en) * | 1998-06-26 | 2000-09-12 | Lsi Logic Corporation | DVD audio decoder having a direct access PCM FIFO |
| JP3632891B2 (en) * | 1998-09-07 | 2005-03-23 | 日本ビクター株式会社 | Audio signal transmission method, audio disc, encoding device, and decoding device |
| JP2000148163A (en) * | 1998-11-05 | 2000-05-26 | Victor Co Of Japan Ltd | Disc encode device and disc regenerating device |
| EP1021044A1 (en) * | 1999-01-12 | 2000-07-19 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for encoding or decoding audio or video frame data |
| US6466833B1 (en) * | 1999-01-15 | 2002-10-15 | Oak Technology, Inc. | Method and apparatus for efficient memory use in digital audio applications |
| US6681077B1 (en) * | 1999-04-02 | 2004-01-20 | Matsushita Electric Industrial Co., Ltd. | Optical disc, recording device and reproducing device |
| US6629001B1 (en) * | 1999-09-15 | 2003-09-30 | Intel Corporation | Configurable controller for audio channels |
| US6931370B1 (en) * | 1999-11-02 | 2005-08-16 | Digital Theater Systems, Inc. | System and method for providing interactive audio in a multi-channel audio environment |
| JP3957251B2 (en) * | 2000-03-02 | 2007-08-15 | パイオニア株式会社 | Audio information reproducing system, audio information reproducing apparatus, and audio information reproducing method |
| US7266501B2 (en) * | 2000-03-02 | 2007-09-04 | Akiba Electronics Institute Llc | Method and apparatus for accommodating primary content audio and secondary content remaining audio capability in the digital audio production process |
| US6351733B1 (en) * | 2000-03-02 | 2002-02-26 | Hearing Enhancement Company, Llc | Method and apparatus for accommodating primary content audio and secondary content remaining audio capability in the digital audio production process |
| KR100359842B1 (en) * | 2000-03-08 | 2002-11-07 | 엘지전자 주식회사 | Method for expressing audio menu |
| EP1134724B1 (en) | 2000-03-17 | 2008-07-23 | Sony France S.A. | Real time audio spatialisation system with high level control |
| US20020016882A1 (en) * | 2000-04-24 | 2002-02-07 | Hiroshi Matsuuchi | Digital device, data input-output control method, and data input-output control system |
| US6799208B1 (en) * | 2000-05-02 | 2004-09-28 | Microsoft Corporation | Resource manager architecture |
| US7212872B1 (en) * | 2000-05-10 | 2007-05-01 | Dts, Inc. | Discrete multichannel audio with a backward compatible mix |
| US8495679B2 (en) * | 2000-06-30 | 2013-07-23 | Thomson Licensing | Method and apparatus for delivery of television programs and targeted de-coupled advertising |
| GB2366709A (en) * | 2000-06-30 | 2002-03-13 | Graeme Roy Smith | Modular software definable pre-amplifier |
| JP2002044543A (en) * | 2000-07-21 | 2002-02-08 | Alpine Electronics Inc | Digital broadcast receiver |
| US6757302B1 (en) * | 2000-09-14 | 2004-06-29 | Nvision, Inc. | Channel status management for multichannel audio distribution |
| US20020124097A1 (en) * | 2000-12-29 | 2002-09-05 | Isely Larson J. | Methods, systems and computer program products for zone based distribution of audio signals |
| JP4423790B2 (en) * | 2001-01-11 | 2010-03-03 | ソニー株式会社 | Demonstration system, demonstration method via network |
| JP2002232375A (en) | 2001-01-30 | 2002-08-16 | Sony Corp | Data transmitter, data receiver, method for transmitting data, method for receiving data and transmission system |
| US7689598B2 (en) * | 2001-02-15 | 2010-03-30 | International Business Machines Corporation | Method and system for file system synchronization between a central site and a plurality of remote sites |
| US7107110B2 (en) * | 2001-03-05 | 2006-09-12 | Microsoft Corporation | Audio buffers with audio effects |
| US6804565B2 (en) * | 2001-05-07 | 2004-10-12 | Harman International Industries, Incorporated | Data-driven software architecture for digital sound processing and equalization |
| US7216288B2 (en) * | 2001-06-27 | 2007-05-08 | International Business Machines Corporation | Dynamic scene description emulation for playback of audio/visual streams on a scene description based playback system |
| US7203692B2 (en) * | 2001-07-16 | 2007-04-10 | Sony Corporation | Transcoding between content data and description data |
| US20030021429A1 (en) * | 2001-07-30 | 2003-01-30 | Ratcliff David D. | On-the-fly configurable audio processing machine |
| DE10140149A1 (en) * | 2001-08-16 | 2003-02-27 | Philips Corp Intellectual Pty | Procedure for handling conflicts of use in digital networks |
| ES2203294B1 (en) * | 2001-09-28 | 2005-06-01 | Global Standards, S.L. | SYSTEM OF REMOTELY CONFIGURABLE RADIOPHONICS AUDIO RECEIVING AND LOYALING SYSTEMS AND DEVICES. |
| US20030078687A1 (en) * | 2001-10-15 | 2003-04-24 | Du Breuil Thomas Lemaigre | Method and system for automatically configuring an audio environment |
| US7058189B1 (en) * | 2001-12-14 | 2006-06-06 | Pixel Instruments Corp. | Audio monitoring and conversion apparatus and method |
| US20030177279A1 (en) * | 2002-02-08 | 2003-09-18 | Evans James C. | Creation of middleware adapters from paradigms |
| US20030156108A1 (en) * | 2002-02-20 | 2003-08-21 | Anthony Vetro | Consistent digital item adaptation |
| US7073193B2 (en) * | 2002-04-16 | 2006-07-04 | Microsoft Corporation | Media content descriptions |
| US7072726B2 (en) * | 2002-06-19 | 2006-07-04 | Microsoft Corporation | Converting M channels of digital audio data into N channels of digital audio data |
| US8060225B2 (en) * | 2002-07-31 | 2011-11-15 | Hewlett-Packard Development Company, L. P. | Digital audio device |
| US7533210B2 (en) * | 2002-10-24 | 2009-05-12 | Sun Microsystems, Inc. | Virtual communication interfaces for a micro-controller |
| US20040111677A1 (en) * | 2002-12-04 | 2004-06-10 | International Business Machines Corporation | Efficient means for creating MPEG-4 intermedia format from MPEG-4 textual representation |
-
2002
- 2002-12-02 EP EP02026779A patent/EP1427252A1/en not_active Withdrawn
-
2003
- 2003-11-24 KR KR1020057009899A patent/KR101024749B1/en active IP Right Grant
- 2003-11-24 CN CNB2003801030907A patent/CN100525513C/en not_active Expired - Fee Related
- 2003-11-24 JP JP2004556172A patent/JP5031988B2/en not_active Expired - Fee Related
- 2003-11-24 BR BRPI0316498-5A patent/BRPI0316498B1/en unknown
- 2003-11-24 CA CA2508220A patent/CA2508220C/en not_active Expired - Fee Related
- 2003-11-24 AU AU2003288154A patent/AU2003288154B2/en not_active Ceased
- 2003-11-24 EP EP03780037A patent/EP1568250B1/en not_active Expired - Fee Related
- 2003-11-24 BR BR0316498-5A patent/BR0316498A/en not_active IP Right Cessation
- 2003-11-24 WO PCT/EP2003/013172 patent/WO2004052052A2/en active Application Filing
- 2003-11-24 US US10/536,539 patent/US8082050B2/en not_active Expired - Fee Related
-
2011
- 2011-03-03 JP JP2011046044A patent/JP5346051B2/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| US8082050B2 (en) | 2011-12-20 |
| EP1568250B1 (en) | 2013-01-09 |
| AU2003288154A1 (en) | 2004-06-23 |
| CN1711800A (en) | 2005-12-21 |
| JP2006508592A (en) | 2006-03-09 |
| EP1568250A2 (en) | 2005-08-31 |
| JP2011150358A (en) | 2011-08-04 |
| US20060174267A1 (en) | 2006-08-03 |
| BRPI0316498B1 (en) | 2018-01-23 |
| JP5346051B2 (en) | 2013-11-20 |
| WO2004052052A3 (en) | 2004-08-12 |
| CN100525513C (en) | 2009-08-05 |
| EP1427252A1 (en) | 2004-06-09 |
| WO2004052052A2 (en) | 2004-06-17 |
| CA2508220C (en) | 2013-02-19 |
| JP5031988B2 (en) | 2012-09-26 |
| KR20050085262A (en) | 2005-08-29 |
| AU2003288154B2 (en) | 2008-08-07 |
| BR0316498A (en) | 2005-10-11 |
| KR101024749B1 (en) | 2011-03-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2508220C (en) | Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream | |
| RU2741738C1 (en) | System, method and permanent machine-readable data medium for generation, coding and presentation of adaptive audio signal data | |
| KR20210049771A (en) | Method and apparatus for playback of a higher-order ambisonics audio signal | |
| CN108134978B (en) | Method and system for interactive rendering of object-based audio | |
| CN1557111A (en) | Method and apparatus for multichannel logic matrix decoding | |
| US11176951B2 (en) | Processing of a monophonic signal in a 3D audio decoder, delivering a binaural content | |
| US5394472A (en) | Monaural to stereo sound translation process and apparatus | |
| Rumsey | Immersive audio: Objects, mixing, and rendering | |
| CA2117383A1 (en) | Loudspeaker system | |
| Gerzon et al. | Ambisonic surround-sound mixing for multitrack studios | |
| Plogsties et al. | Conveying spatial sound using MPEG-4 | |
| Mehta et al. | Recipes for creating and delivering next-generation broadcast audio | |
| Nind | Multimedia in cars: The use of Logic 7 surround processing as the solution to the challenge of providing surround sound in cars from all 2 channel and encoded 5.1 sources. | |
| Jenrick | Integrating multichannel sound into home video systems | |
| Gilbert et al. | Stereosurround-A Compatible Multichannel Encoding/Decoding Process for Audio and Audio/Video Applications | |
| Bleidt et al. | Meeting the Requirements of Next-Generation Broadcast Television Audio | |
| Hilson | Mixing with Dolby Pro Logic II Technology | |
| Lyman et al. | Digital audio delivery to the consumer | |
| Lyman | Program Presentation Using ATSC Audio Systems | |
| ZA200503594B (en) | Method for describing the composition of audio signals |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20201124 |