WO2005106872A1 - Method and system for synchronizing audio processing modules - Google Patents

Method and system for synchronizing audio processing modules Download PDF

Info

Publication number
WO2005106872A1
WO2005106872A1 PCT/US2005/012529 US2005012529W WO2005106872A1 WO 2005106872 A1 WO2005106872 A1 WO 2005106872A1 US 2005012529 W US2005012529 W US 2005012529W WO 2005106872 A1 WO2005106872 A1 WO 2005106872A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
audio processing
processing modules
buffer
audio data
Prior art date
Application number
PCT/US2005/012529
Other languages
French (fr)
Inventor
Stephen G. Holmes
Original Assignee
Nvidia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nvidia Corporation filed Critical Nvidia Corporation
Priority to CN2005800093838A priority Critical patent/CN1934646B/en
Publication of WO2005106872A1 publication Critical patent/WO2005106872A1/en

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10009Improvement or modification of read or write signals
    • G11B20/10037A/D conversion, D/A conversion, sampling, slicing and digital quantisation or adjusting parameters thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/10537Audio or video recording
    • G11B2020/10546Audio or video recording specifically adapted for audio data
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/10527Audio or video recording; Data buffering arrangements
    • G11B2020/1062Data buffering arrangements, e.g. recording or playback buffers

Definitions

  • the present writing relates to a method and a system for synchronizing audio processing modules .
  • Legacy computing devices were utilized to create documents, spreadsheets, and e-mails.
  • Such computing devi e provided monophomc sounds, which were utilized primarily to indicate occurrences of system events.
  • Computing devices are now also used to play games, surf the Internet, listen to music, watch movies and the like. Accordingly, conventional computing devices provide multi-channel audio capabilities.
  • FIG. 1 7 a block diagram of an audio portion of a computer system, in accordance with the conventional art, is shown.
  • the computer includes a processor 110, a memory 120, an audio system 130 and an output device (e.g.. speaker) 140,
  • the audio system 130 is communicatively coupled between thft processor 110, memory 120 and output device 140.
  • the processor 110 provides an operating system and one or more applications. One or more of the applications may cause the processor 110 to provide one or more sounds.
  • the processor 110 issues commands to the audio system 130 which contain the location in memory 120 (e.g., an address) of one or more wave tables to be played and parameters to be used to play the sounds.
  • the wave table consists of a duplicates of digital samples of a sound.
  • the parameters may include the frequency (eg., pitch) of the sound to be generated from the wave table- the envelope (e.g., at a , sustain, decay) describing the amplitude of the sound through time, and a tremolo to modulate the frequency.
  • the audio system 130 in response to commands from the processor 110, .etiieves one or more sounds from the wave tables stored in memory 120.
  • the audio system 130 processes the sounds according to the parameters, ' thereby gft ⁇ ftrating audio data.
  • the audio system 130 then converts the audio data to an analog output which may be played on a given output device (e.g., speaker) 140.
  • Embodiments of the present disclosure are directed toward an improved audio system capable of processing multiple sounds, from a plurality of applications, which can he output to any number of output devices, with reduced processor utilization, reduced generation of bus traffic and reduced latency.
  • the audio system includes a plurality of audio processing modules, a clock manager, a sample rate converter and a buffer,
  • the audio processing modules are communicatively coupled to the clock manager and the buffer.
  • the sample rate converter is communicatively coupled to the clock manager and the buffer.
  • the buffer provides for storing audio data generated and consumed by the audio processing modules.
  • the clock manager provides for determining the clock source of each audio processing module.
  • the clock manager also provides for configuring the audio processing modules and the ' sample rate converter as a function the clock source of each audio processing module.
  • The. sample; rate converter provides for synchronizing a flow rate of audio data generated by a first audio processing module and a flow rate of audio data consumed by a second audio processing module, when the clock source of the first arid ⁇ second audio processing modules are different.
  • a method for synchronizing audio processing modules of an audio system includes ' configuring a first one of an associated set of audio processing modules (e.g., an audio hardware accelerator) l ⁇ past, a first set of audio data through .-a buffer to a second one of the associated set of audio processing modules (e.g., an audio " hardware renderer), when the set of audio processing modules utilize a common cloc ' source. Therefore, when the two or more devices are found to have the same clock source (e.g., hardware clock), the software can then bypass the need to introduce rate control or sample rate converters between devices to prevent the underflow or overflow of data.
  • an associated set of audio processing modules e.g., an audio hardware accelerator
  • a second one of the associated set of audio processing modules e.g., an audio " hardware renderer
  • the, method includes configuring the first one of the associated set of audio processing modules to store the first set of audio data in a first buffer.
  • the sample rate converter is configured to receive the first set of audio data from the first buffer and to store a second set of audio data in a second buffer.
  • the sample rate converter is also configured to synchronize a flow rate of the first set of audio data into the first buffer with a flow rate of the second set of audio data out of the second buffer.
  • the second one of the associated set of audio processing modules is configured to receive the second set of audio data from the second buffer, when the set of audio processing modules do not utilize a common clock source.
  • a method for synchronizing audio processing modules includes operating the audio system in a first mode, when an associated set of audio processing modules share a common clock source.
  • the first mode includes storing audio " data generated by a first one of the associated set of audio processing modules in a shared buffer.
  • the first mode further includes receiving audio data consumed by a second one of the associated set of audio processing modules from the shared buffer.
  • the audio system is operated in a second mode, when the associated set of audio processing modules do not share a common clock source.
  • the second mode includes, storing audio data generated by the first one of the associated set of audio processing modules in an input buffer and receiving the audio data consumed by the second one of the associated set of audio processing modules from an output buffer.
  • the second mode further includes synchronizing the flow rate of audio data being stored m the input buffer with the flow rate of audio data being received from the oulpuL buffer.
  • a computing device implemented audio system includes a memory controller hub, a processor, a main memory and an audio system.
  • the processor, main memory and audio system are each communicatively coupled to the memory controller hub.
  • the audio system includes a clock manager, a plurality of audio processing modules, a sample rate converter and a buffer.
  • the plurality of audio processing modules are communicatively coupled to the clock manager and the buffer.
  • the sample rate converter is communicatively coupled to the clock manager and the buffer.
  • Embodiments of the present disclosure advantageously allow audio processing modules to act as wholly independent devices.
  • Embodiments of the present disclosure advantageously synchronize the audio processing modules when they do not share a common clock source.
  • the overhead of synchronizing the audio processing modules may be eliminated by embodiments of the present disclosure.
  • Figure 1 shows a block diagram of an audio portion of a computer system, in accordance with the prior art.
  • FIG. 2 shows a block diagram of an electronic audio system, in accordance with one embodiment of the present disclosure.
  • Figure 3 shows a block diagram of an audio system including one or more accelerators and Tenderers, in accordance wjth one embodiment of the present! disclosure.
  • Figure 4 shows a block diagram of an audio system including one or more local stages and a global stage, in accordance with one embodiment of the presentidisclosure.
  • Figure 5 shows a flow diagram of method of synchronizing audio processing modules, i accordance with one embodirnent of the present! disclosure.
  • FIG. 6 shows an exemplary computing platform for implementing embodiments of the present disclosure.
  • DETAILED DHSCKIPI ION [0011]
  • FIG. 2 a block diagram of an electronic audio system 200, in accordance with one embodiment of the present disclosure's shown.
  • the audio system 200 is coupled between one or more applications (e.g., music player, game, and/or the like) 210, 212, 214 and one or more output devices (e.g., speaker, PCI controller, USB controller, firewire controller and/or the like) 290, 92.
  • applications e.g., music player, game, and/or the like
  • output devices e.g., speaker, PCI controller, USB controller, firewire controller and/or the like
  • a particular application 210 generates one or more sounds.
  • the sounds are processed by the audio system 200 and output to an appropriate output device 290.
  • the audio system 2Q0 includes a plurality of audio processing modules 220, 225, 240, 45, a clock manager 260, a sample rate converter 270, and a buffer 2SO.
  • the audio processing modules 220, 225, 240, 245 may be communicatively coupled to the clock manager 260 and to the buffer 280.
  • the sample rate c ⁇ vcilci 270 uwy be communicatively coupled to the clock manager 260 and to the buffer 280.
  • a first audio processing module may be an accelerator module and a second audio processing module may be a Tenderer module, as described in detail below with respect to Figure 3.
  • a first audio processing module may be a local stage and a second audio processing module may be a global stage, as described in detail below with respect to Figure 4.
  • One or more audio processing modules may be associated with each other for processing sounds generated by a particular application 210, When associated audio processing modules 220, 245 are operating from different clock sources 230, 255 the rate of generation and consumption of audio data will differ. Even if two audio processing modules 220, 245 are operating from different clock sources that are operating at the same rate, there will be some drift (e.g., 48,1 KHz: and 47.9 KHz). When the audio processing modules 220, 245 are operating from the same clock source 230, the clock rates exactly •match (e.g., 48 Khz).
  • clock manager 260 configures the audio processing modules 220, 245 and the sample rate 270 converter as a function of the clock source 230, 250 of each of the audio processing modules 220, 245 " . If the associated audio processing modules 220, 245 share a common clock source 230, the audio processing modules 220, 245 ore configured by the clock manager 260 to store and retrieve audio data, respectively, in a ⁇ ar ⁇ ? ⁇ 1 buffer 282. Tf the associated audio
  • the first audio processing module 220 is configured by the clock manager 260 to store its output audio data in an input buffer 284.
  • the second audio processing module 245 is configured by the clock manager 260 to receive audio data from an output buffer 286.
  • the sample rate converter 270 is configured by the clock manager 260 to modify the audio data by inserting and or deleting extra samples in the audio data, thereby synchronize the flow rate of audio data stored in the input buffer 284 and the flow rate of audio data received from the output buffer 286.
  • the sample rate converter 270 may provide generation/consumption rate matching by monitoring an input pointer of a shared buffer and an output pointer of the shared buffer- The sample rate converter 270 may cause the first audio processing module 220 and/or the second audio processing module 245 to speed up or slow down depending upon the input and output pointer values. Thus, the output rate of the second audio processing module 245 is matched to the input rate of the first audio processing module 220, so that the two remain locked in synchronization.
  • a plurality of audio processing modules 220, 225 may generate audio data corresponding to sounds received by each audio processing module 220, 225.
  • a single audio processing module 245 may consume the audio data.
  • a single audio processing module 220 may generate audio data corresponding l ⁇ one oi inoie leceivcd sounds.
  • a plurality of audio ⁇ ioccssing modules 240, 245 may consume the audio data.
  • a first plurality of audio prncftqsing modules 220, 225 may generate audio data corresponding to one or more received sounds.
  • a second plurality of audio processing modules 240, 245 may consume the audio data.
  • FIG. 3 a block diagram of an audio system 300 including one or more accelerators 320, 325 and Tenderers 340, 345, in accordance with one embodiment of the present invention, is shown.
  • the audio system 300 may be coupled between one oi more applications 310, 315 and one or more output " devices 390.
  • a particular application 310 generates one or- more sounds.
  • the sounds are processed by the audio system 300 and output to an appropriate output device 390.
  • the audio system 300 may include a plurality of audio processing modules 320, 325, 340, 345, a clock manager 360, a sample rate converter 370 and a buffer 380.
  • One or more>o£ the' audio processing modules may be accelerator modules 320, 325.
  • One or more of the audio processing modules may be renderer modules 340, 345.
  • the associated accelerator an renderer modules 320, 340 may be communicatively coupled to the clock manager 360. and the buffer 380.
  • the sample rate converter 370 may be communicatively coupled to the clock manager 360 and the buffer 380.
  • the flow rate of audio data generated or consumed by the associated accelerator and renderer modules 320, 40, respectively, is a function of a clock driving the given module.
  • Each associated clock may be from a different clock source 330, 350, or one or more of the associated clocks may be from the same clock source 330. If the clock sources 330 are the same for a set of associated accelerator and renderer modules 320, 340, the rate of audio data generated and consumed will be equal. If the clock sources 330, 350 are different for a set of associated accelerator and renderer modules 320, 340, the rate of audio data generated and consumed will no- be equal. Even if two clocks sources 330, 350 are operating at the same frequency there will be some drift in the operating frfiqiiemcy.
  • the clock manager 360 may determine the clock source 330, 350 of each asso ia-ed accelerator and renderer module 320, 340.
  • each accelerator and renderer module 320, 340 registers a global unique identifier (GU ⁇ D) with the clock manager 360.
  • GUID global unique identifier
  • Each GUID identifies the clock source of the particular accelerator or renderer module.
  • the clock manager 360 then configures each associated accelerator and renderer module 320, 340 and the sample rate converter 370 based in part upon the clock source 330 of the associated acc eral ⁇ i module 320 and the clock source 350 of the associated renderer module 340.
  • the clock manager 360 configures the accelerator module 320 to operate in a first mode.
  • the accelerator module 320 ou ⁇ uts its audio data to a shared portion of the buffer 382.
  • the associated rendered module 340 is configured to receive its input audio data from the shared portion of the buffer 382.
  • the accelerator module 320 outputs audio data directly to the shared portion of the buifcr 382 from which the renderer module 340 consumes audio data.
  • the latency between the output of audio data by the accelerator module 320 and The input of rhe audio data by the renderer 340 module is approximately 2 s or less.
  • the shared portion of the buffer 382 may be approximately 1-lO B.
  • the clock manager 360 configures the modules 320, 340 and sample •rate converter 370 to operate in a second mode.
  • the associated accelerator module 320 is configured to output its audio data to an input portion of the buffer 384.
  • the associated rendered module 340 is configured to receive its input audio data from an output portion of the buffer 386
  • Thfi -.ample rate converter 370 is configured to match the flow rate into the input portion of the buffer 384 and out of the output portion of the buffer .386. Accordingly, the sample rare converter 370 retrieves the audio data from the input - portion of the buffer 384 and may introduce and/or eliminated extra data samples.
  • the output rate of the accelerator module 320 is matched to the input rate of the renderer module 340, so that the two rftmain locked in synchronization.
  • the latency between the output of audio data from an accelerator module 320 to the input by a renderer module 340 is typically approximately 15-20 ms.
  • the input portion and output portion of the buffer 384, 386 may be approximately 100-200 B each.
  • the audio system may be implemented in hardware, software, firmware, or a combination thexeof.
  • the accelerator module, the clock manager and sam le rate converter may be implemented in' software.
  • the renderer mhdulft may include a renderer driver, implemented in software, and renderer hardware (e.g., encoder/decoder (CODEC)).
  • the buffer may be implemented in system memory (e.g., dyna i c random access memory (DRAM)) .
  • the audio system 300 may also provide for processing input streams (e.g., recording).
  • the renderer module e:.g., CODEC
  • the renderer module 345 may receive an analog audio signal from an input device (e.g., microphone) 395.
  • the renderer m ule 345 may convert the analog audio signal into digital audio data, which is stored in the buffer 380.
  • the clock manager 360 configures the accelerator module 325, renderer module 345, sample rate converter 370 and buffer 380 as a function of the clock source 330, 350 of the renderer and accelerator modules 325, 345.
  • the sample- rate converter is inserted to synchronize the flow rate of data between the accelerator and renderer module 325, 345
  • the accelerator module 325 receives the audio data from the buffer 380 and processes the audio data according to a given application 315, The processed audio data is then typically stored in main memory and/or in a bulk storage device (e.g., hard drive) for future playback.
  • a bulk storage device e.g., hard drive
  • FIG. 4 a block diagram of an audio system including one or more local stages 423, 425 and a global stage 427, in accordance with one embodiment of the present disclosure,is s own.
  • the audio system includes an accelerator module 420, a clock manager 460, a sample rate r ⁇ n Arrer 470, a buffer 480 and a renderer (not shown).
  • the accelerator module 420 includes one or more local stages 423, 425 and a global stage 427.
  • the local stages 423, 425 and the global stage 427 are-each communicatively coupled to the clock manager 460 and the buffer 480.
  • the sample rate converter 470 is communicatively coupled to the clock manager 460 and the buffer 480.
  • the clock manager 460 configures the local stages 423, 425, global stage 427 and the sample rate converter 470 as a function of the clock source of each of the local stages 423, 425 and the global stage 427.
  • Each of thp local stage 423, 425 and the global stage 427 register a global unique identifier (GU ⁇ D) with the clock manager 460.
  • the GUID identifies the source of the clo ⁇ k of each local stage 423, 425 and the global stage 427.
  • one or more local stages 423, 2i> receive sounds from one or more applications and generate audio data ⁇ corresponding to the one or more sounds. If a particular local sta e 423 and the global stage 427 share a common clock source, the local stage 423 and the global stage 427 are configured by the clock manager 460 to store and retrieve audio data, respectively, in a shared portion of the buffer 482.
  • the clock manager 460 configures the local stage 423 to output its audio data to an input portion of the buffer 484.
  • the global stage 427 is configured to receive its input audio data from an output portion of the buffer 486.
  • the sample rate converter 470 is configured to receive the audio data from the input portion of the buffer 484 and introduce and/or eliminated extra data samples. The sample rate converter 470 then outputs the modified audio data to the output portion of the buffer 486 ⁇ Thus, synchronization is maintained between the local stage 423 and the global stage 427.
  • an application e.g., video game
  • a particular local stage 423 corresponding to the application mixes the plurality of sounds and outputs it to the buffer 480.
  • the sample rate converter 470 synchronizes the flow rate of audio data generated by the local stage 423 with the flow rate of audio data consumed by the global stage 427, when the stages do not have a common clock source. Otherwise, the local- stage 423 stores audio data in the shared portion of the buffer 482 and the global stage 427 consumes the audio data without the need for synchronization, when the stages 423, 427 have a common clock source.
  • the global stage may provide processing upon the audio data, such as reverb.
  • the audio data output by the global stage 427 may be stored in a buffer for consumption by one or more renderer modules.
  • the buffer 480 scores the audio data generated by each of the plurality local stages 423, 425 and consumed by the global stage 427.
  • the sample rate converter 470 synchronizes the flow rate of audio data generated by the local stages 423, 425 with the flow rate of audio data consumed by the global stage 427, when one or more stages do not have a common clock source. Otherwise, the local stages 423, 425 store audio data in the buffer 480 and the global stage 427 consumes the audio data without the need for synchronization, when the stages 423, 425, 427 have a common clock source.
  • Theieafie., global stage 427 mixes the audio data generated by each local stage 423, 425 together to generate audio data for output (e.g. r further processing by a renderer module).
  • the audio system may also provide for processing input streams (e.g., recording). It is also appreciated that the renderer • module may also include one or more local stages and a global stage.
  • each audio processing module e.g., accelerator, renderer, local stage, global stage
  • the registration process includes identification of the source clock for each audio processing module.
  • each of the audio processing modules register with the cluck manager by providing a global unique identifier (GUID) for instance.
  • GUID global unique identifier
  • the clock manager determines if the clock for an associated set of audio processing modules is from the same clock source.
  • the GUID of each accelerator and renderer module identifies the clock source thereof.
  • the GUID of each local and global stage identifies the source clock thereof.
  • the clock manager configures the associated audio processing modules to operate in a first mode, if ⁇ modules operate from the same clock source.
  • the associated accelerator module in configured to output its audio data to a shared portion of a buffer.
  • the associated renderer module is configured to retrieve the audio data from the shared portion of the buffer.
  • the local stage is configured to output its audio data to a shared portion of the buffer.
  • the global stage is configured to t retrieve the audio data from the shared portion of the buffer. , -
  • the clock manager of the present disclosure co ⁇ f ⁇ gures the associated audio processing modules an the. sample rate converter to operate in a second mode.
  • the audio generating audio processing mcfdule is configured to pass its audio data to a sample rate converter through- an input portion of the buffer, when the associated audio processing modules- do not utilize a common clock source.
  • the accelerator module stores audio data in an input portion of the buffer.
  • the local stage stores audio data in an input portion of the buffer, when the local and global 5> gc ⁇ > do not utilize a common clock source.
  • the sample rate converter is configured to synchronize the flow rates between the input and output portions of the buffer.
  • the sample rate converter retrieves audio data from the input buffer.
  • the sample rate converter monitors the rate of audio data production by the accelerator module and the rate of consumption by the renderer module and introduces and/or eliminates extra data sample to maintain synchronization.
  • the sample rate converter monitors the rate of audio data production by the local stage and the rate of consumption by the global stage and introduces and or eliminates extra data samples to maintain syncbroru7ation. After inrrnrlnction and/or elimination of extra data samples, the sample rate converter outputs the audio data to an output portion of the buffer.
  • the audio data consuming audio processing module is configured to receive the audio data from the sample rate converter through the output - portion of the buffer.
  • the associated renderer module receives the audio data from the output portion of the buffer, when the accelerato, and euderer module do not utilize a. onuuon clock source.
  • the global stage receives the audio data from the output portion of the buffer, when the local and global stages do not utilize a common clock source.
  • the exemplary computing device includes a processor (CPU) 610, a memory controller hub (e.g., north bridge) 615, a main memory 620, a graphics processor (GPU) 625 and an input output controller hub (e.g., south bridge) 630.
  • processor CPU
  • memory controller hub e.g., north bridge
  • main memory e.g., main memory
  • GPU graphics processor
  • input output controller hub e.g., south bridge
  • the processor 610, the graphics processor 625, the main memory 620, and the I/ hub controller hub 630 maybe communicatively coupled to the memory controller hub 615.
  • the graphics processor 625 may be i ple ⁇ ieiiLed m, _ ⁇ integral part of the- memory controller hub 615 (not shown).
  • the exemplary computing device may also include peripheral components, such as a display, a keyboard, a pointing device, mass data storage device(s), speakers), and the like, coupled to the input/output controller hub 630 by an ⁇ applicable bus 655-655 (PCI bus, USB, Firewire, Ethernet, ISA bus, etc).
  • the memory controller hub 615 provides for communicating information and instructions between the processor 610, the main memory 620, die graphic processor 625 and the i ⁇ pu output controller hub 630.
  • the input/output controller hub 630 provides for communicating information and instmctions between the memory controller hub 615 and the various input/output devices connected by the various busses 635-655
  • the main memory 620 provides for storage of the information and instructions.
  • the processor 610 processes information and instructions thereby providing an operating system and one or more applications.
  • the graphics processor processes information and insLru .i ⁇ rii thereby providing video data for display to a user,
  • the computing device further includes an audio system 660 in accordance with one or more of the above-described embodiments of the present disclosure.
  • the audio system 660 in one implementation, is an integral part of the input/output controller hub 630.
  • the audio system 660 includes one or more audio processing modules, a clock manager, a sample rate converter.
  • Each audio processing module may provide one or more functions such as mixing, multi-channel conversion (e.g., stereo, surround sound), three dimensional positional computation (e.g., hea icl-iied uansfer functions, elevation, direction, etc.) and various effects (e.g., chorus, reverb, obstruction, occlusion, eqtialiazation cross-talk cancellation, etc.).
  • the clock manager polls the audio processing modules to determine the source of each module's clock. Thereafter, one or more of the audio processing modules (e.g., accelerator, local stage) may generate audio data. hile one or more audio processing modules (e.g.., accelerator, local stage, renderer, global.stage) consume the audio data. For example., a first audio processing module generates audio' ata corresponding to ne or more received sounds. ⁇ second audio processing module consumes the audio data. If the first and sftcond audio processing modules share a common clock source, the clock manager configures the first audio processing module to output the generated audio data to a shared portion of the buffer.
  • the audio processing modules e.g., accelerator, local stage
  • the clock manger also configures the second audio processing module to consume the audio data from the shared portion of the buffer. If the first and second audio processing modules operate from different: clock sources, the clock manager configures the first audio p ocessing module to output the generated audio data to an input portion of the buffer.
  • the sample rate converter is configured by the clock manger to retrieve the audio data from the input portion of the buffer and to introduce or eliminate extra data samples to maintain synchronization. The sample rate converter then outputs the audio data to an output portion of the buffer.
  • the clock manager also configures the second audio processing module to consume the audio data from the output portion of the buffer, when the first and second audio processing modules operate from different clock sources.
  • the buffer of the audio system 660 may be implemented in main memory (e.g., shared memory access (S A)) 620.
  • the shared portion of the buffer may be- approximately 1-10 KB (e.g., 64 samples, where each sample is 24 bits), while the input and output portions may be approximately 100-500 KB each.
  • the buffer is described as comprising a shared portion, input portion and output portion, it is appreciated that the buffer may be implemented as a plurality of separate buffers or as a single buffer that is partitioned in accordance with the operating mode of the audio system 660.
  • the audio system 660 is described as an integral part of the input/Output controller hub 630. it is .appreciated that the audio system 660 may be coupled to any element that provides the audio system 660 a direct connection to main memory 620. The audio system 660 may also be implemented as an integral part of the memory controller hub. Implementation of the audio system 660 may also be distributed among one or more of the abuvc-iiieutio ⁇ elements of the computing device. Implementation of the audio system 660 may also be distributed among one or more of the above-mentioned elements of the computing device and implemented in information and instructions residing in mam memory 620 and executed by the processor 610, the memory controller hub 615 and or the input/output controller hub.
  • an accelerator module may be implemented in software (e.g., information and instructions), the clock manager and sample rate converter may be implemented as an integral part of the input/output controller hub 630, the buffer may be implemented in the main memory 620 and the Tenderer module may be implemented in an audio controller.
  • the memory controller hub 615, graphic processor 625; input output controller hub 630 and audio system 660 provide a distributed processing platform.
  • the audio system 660 advantageously increases computing device performance by off-loading audio effects processing and Tendering from the processor.
  • embodiments of the present disclosure advantageously allow audio processing modules to act as wholly independent devices.
  • Embodiments of the present disclosure advantageously synchronize the audio processing modules when they do not share a common clock spurce. When the audio processing modules share a common clock source, the overhead of synchronizing the audio processing modules may be eliminated by embodiments of the
  • some of the embodiments of the present disclosure provide an audio system having wholly independent audio processing modules.
  • the audio system includes a plurality of audio
  • the audio processing modules are communicatively coupled to the clock manager and the buffer.
  • the sample rate converter is communicatively coupled to the clock manager and the buffer.
  • the buffer provides for storing audio data generated and consumed by the audio processing modules.
  • the clock manager provides for determining the clock source of each audio processing module.
  • the clock manager also provides for configuring the audio processing modules and the sample rate converter as a function the clock source of each audio processing module.
  • the sample rate converter provides for synchronizing a flow rate of audio data generated by a first audio processing module and a flow rate of audio data consumed by a second audio processing module, when the clock source of the first aiid second audio processing modules are different

Abstract

An audio system having wholly independent audio processing modules. The audio system includes a plurality of audio processing modules, a clock manager, a sample rate converter and a buffer. The audio processing modules are communicatively coupled to the clock manager and the buffer. The sample rate converter is communicatively coupled to the clock manager and the buffer. The buffer provides for storing audio data generated and consumed by the audio processing modules. The clock manager provides for determining the clock source of each audio processing module. The clock manager also provides for configuing the audio processing modules and the sample rate converter as a function the clock source of each audio processing module. The sample rate converter provides for synchronizing a flow rate of audio data generated by a first audio processing module an a flow rate of audio data consumed by a second audio processing module, when the clock source of the first and second audio processing modules are different.

Description

METHOD AND SYSTEM FOR SYNCHRONIZING AUDIO PROCESSING MODULES
BACKGROUND [0001] The present writing relates to a method and a system for synchronizing audio processing modules . Legacy computing devices were utilized to create documents, spreadsheets, and e-mails. Such computing devi e provided monophomc sounds, which were utilized primarily to indicate occurrences of system events. Computing devices are now also used to play games, surf the Internet, listen to music, watch movies and the like. Accordingly, conventional computing devices provide multi-channel audio capabilities.
[0002] Referring to Figure 17 a block diagram of an audio portion of a computer system, in accordance with the conventional art, is shown. As depicted in Figure 1, the computer includes a processor 110, a memory 120, an audio system 130 and an output device (e.g.. speaker) 140, The audio system 130 is communicatively coupled between thft processor 110, memory 120 and output device 140.
[0003J The processor 110 provides an operating system and one or more applications. One or more of the applications may cause the processor 110 to provide one or more sounds. The processor 110 issues commands to the audio system 130 which contain the location in memory 120 (e.g., an address) of one or more wave tables to be played and parameters to be used to play the sounds. The wave table consists of a scries of digital samples of a sound, The parameters may include the frequency (eg., pitch) of the sound to be generated from the wave table- the envelope (e.g., at a , sustain, decay) describing the amplitude of the sound through time, and a tremolo to modulate the frequency. The audio system 130, in response to commands from the processor 110, .etiieves one or more sounds from the wave tables stored in memory 120. The audio system 130 processes the sounds according to the parameters, ' thereby gftπftrating audio data. The audio system 130 then converts the audio data to an analog output which may be played on a given output device (e.g., speaker) 140.
[0004] It is expected that computer users will continue to demarid improved audio systems for delivering high definition video, high definition audio, streaming video, streaming audio- multiplayer games, and/or other on-demand audio and video content. Accordingly, the audio system needs to provide ever increasing audio processing capabilities hile minimizing processor uliliz-nioii and bus traffic. Therefore, an improved audio systcm capable of processing multiple sounds, from a plurality of applications, which cah be output to any number of output devices, with reduced processor utilization, reduced generation of bus traffic and reduced latency, is needed.
SUMMARY [0005] Embodiments of the present disclosureare directed toward an improved audio system capable of processing multiple sounds, from a plurality of applications, which can he output to any number of output devices, with reduced processor utilization, reduced generation of bus traffic and reduced latency. In one embodiment, the audio system includes a plurality of audio processing modules, a clock manager, a sample rate converter and a buffer, The audio processing modules are communicatively coupled to the clock manager and the buffer. The sample rate converter is communicatively coupled to the clock manager and the buffer. The buffer provides for storing audio data generated and consumed by the audio processing modules. The clock manager provides for determining the clock source of each audio processing module. The clock manager also provides for configuring the audio processing modules and the' sample rate converter as a function the clock source of each audio processing module. The. sample; rate converter provides for synchronizing a flow rate of audio data generated by a first audio processing module and a flow rate of audio data consumed by a second audio processing module, when the clock source of the first arid ♦ second audio processing modules are different.
[0006] In another embodiment, a method for synchronizing audio processing modules of an audio system includes' configuring a first one of an associated set of audio processing modules (e.g., an audio hardware accelerator) lυ past, a first set of audio data through .-a buffer to a second one of the associated set of audio processing modules (e.g., an audio " hardware renderer), when the set of audio processing modules utilize a common cloc ' source. Therefore, when the two or more devices are found to have the same clock source (e.g., hardware clock), the software can then bypass the need to introduce rate control or sample rate converters between devices to prevent the underflow or overflow of data. When the set of audio processing modules do not utilize the common clock source., the, method includes configuring the first one of the associated set of audio processing modules to store the first set of audio data in a first buffer. The sample rate converter is configured to receive the first set of audio data from the first buffer and to store a second set of audio data in a second buffer. The sample rate converter is also configured to synchronize a flow rate of the first set of audio data into the first buffer with a flow rate of the second set of audio data out of the second buffer. The second one of the associated set of audio processing modules is configured to receive the second set of audio data from the second buffer, when the set of audio processing modules do not utilize a common clock source.
f 00071 In another embodiment, a method for synchronizing audio processing modules includes operating the audio system in a first mode, when an associated set of audio processing modules share a common clock source. The first mode includes storing audio "data generated by a first one of the associated set of audio processing modules in a shared buffer. The first mode further includes receiving audio data consumed by a second one of the associated set of audio processing modules from the shared buffer. The audio system is operated in a second mode, when the associated set of audio processing modules do not share a common clock source. The second mode includes, storing audio data generated by the first one of the associated set of audio processing modules in an input buffer and receiving the audio data consumed by the second one of the associated set of audio processing modules from an output buffer. The second mode further includes synchronizing the flow rate of audio data being stored m the input buffer with the flow rate of audio data being received from the oulpuL buffer.
[0008] In another embodiment, a computing device implemented audio system includes a memory controller hub, a processor, a main memory and an audio system. The processor, main memory and audio system are each communicatively coupled to the memory controller hub. The audio system includes a clock manager, a plurality of audio processing modules, a sample rate converter and a buffer. The plurality of audio processing modules are communicatively coupled to the clock manager and the buffer. The sample rate converter is communicatively coupled to the clock manager and the buffer.
[0009] Embodiments of the present disclosure advantageously allow audio processing modules to act as wholly independent devices. Embodiments of the present disclosure advantageously synchronize the audio processing modules when they do not share a common clock source. When the audio processing modules share a common clock source, the overhead of synchronizing the audio processing modules may be eliminated by embodiments of the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS 10010J The present disclosure is illustrated by way of example and not by way of limitation, in the figures of the accompanying drawings and in which like re.fp.re-.nce: numerals
refer to similar elements and in which:
Figure 1 shows a block diagram of an audio portion of a computer system, in accordance with the prior art.
Figure 2 shows a block diagram of an electronic audio system, in accordance with one embodiment of the present disclosure.
Figure 3 shows a block diagram of an audio system including one or more accelerators and Tenderers, in accordance wjth one embodiment of the present! disclosure.
Figure 4 shows a block diagram of an audio system including one or more local stages and a global stage, in accordance with one embodiment of the presentidisclosure.
Figure 5 shows a flow diagram of method of synchronizing audio processing modules, i accordance with one embodirnent of the present! disclosure.
Figure 6 shows an exemplary computing platform for implementing embodiments of the present disclosure. DETAILED DHSCKIPI ION [0011] Reference will now be made in detail to the embodiments of the 'disclosure, examples of which are illustrated in the accompanying drawings. While the disclosure will be
described in conjunction with these embodiments, it will be understood that they are not intended to limit thc isclosureto these embodiments. On the contrary, the disclosure s intended to cover alternatives, modifications and equivalents, which may be included within the scope of the disclosure as defined by the appended claims. Furthermore, in the following detailed description of the present disclosure, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it is understood that the present disclosuremay be practiced without these specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the present disclosure.
10012] Referring to Figure 2, a block diagram of an electronic audio system 200, in accordance with one embodiment of the present disclosure's shown. As depicted in Figure 2, the audio system 200 is coupled between one or more applications (e.g., music player, game, and/or the like) 210, 212, 214 and one or more output devices (e.g., speaker, PCI controller, USB controller, firewire controller and/or the like) 290, 92. Generally, a particular application 210 generates one or more sounds. The sounds are processed by the audio system 200 and output to an appropriate output device 290.
[0013] The audio system 2Q0 includes a plurality of audio processing modules 220, 225, 240, 45, a clock manager 260, a sample rate converter 270, and a buffer 2SO. The audio processing modules 220, 225, 240, 245 may be communicatively coupled to the clock manager 260 and to the buffer 280. The sample rate cυπvcilci 270 uwy be communicatively coupled to the clock manager 260 and to the buffer 280.
[0014] In one implementation, a first audio processing module may be an accelerator module and a second audio processing module may be a Tenderer module, as described in detail below with respect to Figure 3. In another implementation, a first audio processing module may be a local stage and a second audio processing module may be a global stage, as described in detail below with respect to Figure 4.
{0015] One or more audio processing modules (e.g., an accelerator module and a renderer module, or a local Stage and a global stage) 220, 245 may be associated with each other for processing sounds generated by a particular application 210, When associated audio processing modules 220, 245 are operating from different clock sources 230, 255 the rate of generation and consumption of audio data will differ. Even if two audio processing modules 220, 245 are operating from different clock sources that are operating at the same rate, there will be some drift (e.g., 48,1 KHz: and 47.9 KHz). When the audio processing modules 220, 245 are operating from the same clock source 230, the clock rates exactly •match (e.g., 48 Khz).
10016] In accordance with an embodiment of the present disclosureJhe .clock manager 260 configures the audio processing modules 220, 245 and the sample rate 270 converter as a function of the clock source 230, 250 of each of the audio processing modules 220, 245". If the associated audio processing modules 220, 245 share a common clock source 230, the audio processing modules 220, 245 ore configured by the clock manager 260 to store and retrieve audio data, respectively, in a ιar<?<1 buffer 282. Tf the associated audio
processing modules 220, 245 do not operate from a common clock source 230, 255?-the first audio processing module 220 is configured by the clock manager 260 to store its output audio data in an input buffer 284. The second audio processing module 245 is configured by the clock manager 260 to receive audio data from an output buffer 286. The sample rate converter 270 is configured by the clock manager 260 to modify the audio data by inserting and or deleting extra samples in the audio data, thereby synchronize the flow rate of audio data stored in the input buffer 284 and the flow rate of audio data received from the output buffer 286.
f0017] Alternatively, the sample rate converter 270 may provide generation/consumption rate matching by monitoring an input pointer of a shared buffer and an output pointer of the shared buffer- The sample rate converter 270 may cause the first audio processing module 220 and/or the second audio processing module 245 to speed up or slow down depending upon the input and output pointer values. Thus, the output rate of the second audio processing module 245 is matched to the input rate of the first audio processing module 220, so that the two remain locked in synchronization.
[0018] It is a preciated that, in another implementation, a plurality of audio processing modules 220, 225 may generate audio data corresponding to sounds received by each audio processing module 220, 225. A single audio processing module 245 may consume the audio data. In another implementation, a single audio processing module 220 may generate audio data corresponding lυ one oi inoie leceivcd sounds. A plurality of audio μioccssing modules 240, 245 may consume the audio data. In yet another implementation, a first plurality of audio prncftqsing modules 220, 225 may generate audio data corresponding to one or more received sounds. A second plurality of audio processing modules 240, 245 may consume the audio data.
[0019] Referring now to Figure 3, a block diagram of an audio system 300 including one or more accelerators 320, 325 and Tenderers 340, 345, in accordance with one embodiment of the present invention, is shown. As depicted in Figure 3, the audio system 300 may be coupled between one oi more applications 310, 315 and one or more output " devices 390. Generally, a particular application 310 generates one or- more sounds. The sounds are processed by the audio system 300 and output to an appropriate output device 390.
[0020] The audio system 300 may include a plurality of audio processing modules 320, 325, 340, 345, a clock manager 360, a sample rate converter 370 and a buffer 380. One or more>o£ the' audio processing modules may be accelerator modules 320, 325. One or more of the audio processing modules may be renderer modules 340, 345. A particular accelerator module 320 i_> typically associated with o particular renderer module 340- for processing sounds from a particular application 10. The associated accelerator an renderer modules 320, 340 may be communicatively coupled to the clock manager 360. and the buffer 380. The sample rate converter 370 may be communicatively coupled to the clock manager 360 and the buffer 380.
[0021] The flow rate of audio data generated or consumed by the associated accelerator and renderer modules 320, 40, respectively, is a function of a clock driving the given module. Each associated clock may be from a different clock source 330, 350, or one or more of the associated clocks may be from the same clock source 330. If the clock sources 330 are the same for a set of associated accelerator and renderer modules 320, 340, the rate of audio data generated and consumed will be equal. If the clock sources 330, 350 are different for a set of associated accelerator and renderer modules 320, 340, the rate of audio data generated and consumed will no- be equal. Even if two clocks sources 330, 350 are operating at the same frequency there will be some drift in the operating frfiqiiemcy. and therefore the rate of generation and consumption by the associated accelerator and renderer modules 320, 340 will vary. Only when the accelerator and renderer modules 320, 340 are operating from the same clock 330 source will the operating frequency match, and therefore the rate of generation and consumption between associated modules 320, 340 will also match.
IU02ZI Accordingly, the clock manager 360 may determine the clock source 330, 350 of each asso ia-ed accelerator and renderer module 320, 340. In one implementation, each accelerator and renderer module 320, 340 registers a global unique identifier (GUΪD) with the clock manager 360. Each GUID identifies the clock source of the particular accelerator or renderer module. The clock manager 360 then configures each associated accelerator and renderer module 320, 340 and the sample rate converter 370 based in part upon the clock source 330 of the associated acc eralυi module 320 and the clock source 350 of the associated renderer module 340.
- [0023] When associated accelerator and renderer modules 320, 340 are found to use the same clock source 330 (e.g., 48 KHz), the clock manager 360 configures the accelerator module 320 to operate in a first mode. In the first mode, the accelerator module 320 ouφuts its audio data to a shared portion of the buffer 382. The associated rendered module 340 is configured to receive its input audio data from the shared portion of the buffer 382. Thus, the accelerator module 320 outputs audio data directly to the shared portion of the buifcr 382 from which the renderer module 340 consumes audio data. In the first mode, the latency between the output of audio data by the accelerator module 320 and The input of rhe audio data by the renderer 340 module is approximately 2 s or less. In one implementation, the shared portion of the buffer 382 may be approximately 1-lO B.
[0024] When the associated accelerator and renderer modules 320, 340 use different clock sources 330, 350, the clock manager 360 configures the modules 320, 340 and sample •rate converter 370 to operate in a second mode. In the second mode, the associated accelerator module 320 is configured to output its audio data to an input portion of the buffer 384. The associated rendered module 340 is configured to receive its input audio data from an output portion of the buffer 386 Thfi -.ample rate converter 370 is configured to match the flow rate into the input portion of the buffer 384 and out of the output portion of the buffer .386. Accordingly, the sample rare converter 370 retrieves the audio data from the input - portion of the buffer 384 and may introduce and/or eliminated extra data samples. *lhe sample rate convener 370 then υuipuLs the modified audio data to the output portion of the buffer 386. Thus, the output rate of the accelerator module 320 is matched to the input rate of the renderer module 340, so that the two rftmain locked in synchronization. In the second mode, when sample rate conversion is utilized, the latency between the output of audio data from an accelerator module 320 to the input by a renderer module 340 is typically approximately 15-20 ms. In one implementation, the input portion and output portion of the buffer 384, 386 may be approximately 100-200 B each.
(0025] It is appreciated that the audio system may be implemented in hardware, software, firmware, or a combination thexeof. For example, the accelerator module, the clock manager and sam le rate converter may be implemented in' software. The renderer mhdulft may include a renderer driver, implemented in software, and renderer hardware (e.g., encoder/decoder (CODEC)). The buffer may be implemented in system memory (e.g., dyna i c random access memory (DRAM)) .
[0026] Although the operation of the audio system 300 has been described with , reference to audio output streams (e.g., playback), it is appreciated that the audio system 300 may also provide for processing input streams (e.g., recording). Fυi cΛauiple, the renderer module (e:.g., CODEC) 345 may receive an analog audio signal from an input device (e.g., microphone) 395. The renderer m ule 345 may convert the analog audio signal into digital audio data, which is stored in the buffer 380. The clock manager 360 configures the accelerator module 325, renderer module 345, sample rate converter 370 and buffer 380 as a function of the clock source 330, 350 of the renderer and accelerator modules 325, 345. If the renderer and accelerator module 325, 345 do not operate from a common clock source the sample- rate converter is inserted to synchronize the flow rate of data between the accelerator and renderer module 325, 345 The accelerator module 325 receives the audio data from the buffer 380 and processes the audio data according to a given application 315, The processed audio data is then typically stored in main memory and/or in a bulk storage device (e.g., hard drive) for future playback.
[0027] Referring now to Figure 4, a block diagram of an audio system including one or more local stages 423, 425 and a global stage 427, in accordance with one embodiment of the present disclosure,is s own. As depicted in Figure 4, the audio system includes an accelerator module 420, a clock manager 460, a sample rate rόn Arrer 470, a buffer 480 and a renderer (not shown). The accelerator module 420 includes one or more local stages 423, 425 and a global stage 427. The local stages 423, 425 and the global stage 427 are-each communicatively coupled to the clock manager 460 and the buffer 480. The sample rate converter 470 is communicatively coupled to the clock manager 460 and the buffer 480. The clock manager 460 configures the local stages 423, 425, global stage 427 and the sample rate converter 470 as a function of the clock source of each of the local stages 423, 425 and the global stage 427.
[0028] Each of thp local stage 423, 425 and the global stage 427 register a global unique identifier (GUϊD) with the clock manager 460. The GUID identifies the source of the cloάk of each local stage 423, 425 and the global stage 427. Thereafter, one or more local stages 423, 2i> receive sounds from one or more applications and generate audio data < corresponding to the one or more sounds. If a particular local sta e 423 and the global stage 427 share a common clock source, the local stage 423 and the global stage 427 are configured by the clock manager 460 to store and retrieve audio data, respectively, in a shared portion of the buffer 482. If a particular local stage 423 and the global stage 427 operate from different clock sources, the clock manager 460 configures the local stage 423 to output its audio data to an input portion of the buffer 484. The global stage 427 is configured to receive its input audio data from an output portion of the buffer 486. The sample rate converter 470 is configured to receive the audio data from the input portion of the buffer 484 and introduce and/or eliminated extra data samples. The sample rate converter 470 then outputs the modified audio data to the output portion of the buffer 486\ Thus, synchronization is maintained between the local stage 423 and the global stage 427.
[0029] For example, an application (e.g., video game) may be generating a plurality of sounds (a gun shot, a scream, a train, etc.). A particular local stage 423 corresponding to the application mixes the plurality of sounds and outputs it to the buffer 480. The sample rate converter 470 synchronizes the flow rate of audio data generated by the local stage 423 with the flow rate of audio data consumed by the global stage 427, when the stages do not have a common clock source. Otherwise, the local- stage 423 stores audio data in the shared portion of the buffer 482 and the global stage 427 consumes the audio data without the need for synchronization, when the stages 423, 427 have a common clock source. The global stage may provide processing upon the audio data, such as reverb. The audio data output by the global stage 427 may be stored in a buffer for consumption by one or more renderer modules.
[0030] In another example, the buffer 480 scores the audio data generated by each of the plurality local stages 423, 425 and consumed by the global stage 427. The sample rate converter 470 synchronizes the flow rate of audio data generated by the local stages 423, 425 with the flow rate of audio data consumed by the global stage 427, when one or more stages do not have a common clock source. Otherwise, the local stages 423, 425 store audio data in the buffer 480 and the global stage 427 consumes the audio data without the need for synchronization, when the stages 423, 425, 427 have a common clock source. Theieafie., global stage 427 mixes the audio data generated by each local stage 423, 425 together to generate audio data for output (e.g.r further processing by a renderer module).
[0031] Although the operation of the audio system has been described with reference to audio output streams (e.g., playback), it is appreciated that the audio system may also provide for processing input streams (e.g., recording). It is also appreciated that the renderer • module may also include one or more local stages and a global stage.
[0032] Referring now to Figure 5, a flow diagram of a computer implemented method of synchronizing audio processing modules, in accordance with one embodiment of the present disclosure, is shown. As depicted in Figure 5, the method begins with each audio processing module (e.g., accelerator, renderer, local stage, global stage) registering with a clock manager, at 510. The registration process includes identification of the source clock for each audio processing module. In one implementation, each of the audio processing modules register with the cluck manager by providing a global unique identifier (GUID) for instance.
[0033] At 520, the clock manager determines if the clock for an associated set of audio processing modules is from the same clock source. In one implementation, the GUID of each accelerator and renderer module identifies the clock source thereof. Similarly, the GUID of each local and global stage identifies the source clock thereof.
[0034] At 530, the clock manager configures the associated audio processing modules to operate in a first mode, if ή modules operate from the same clock source. In one implementation, the associated accelerator module in configured to output its audio data to a shared portion of a buffer. The associated renderer module is configured to retrieve the audio data from the shared portion of the buffer. Similarly, the local stage is configured to output its audio data to a shared portion of the buffer. The global stage is configured to t retrieve the audio data from the shared portion of the buffer. , -
• [0035] If the audio processing modules operate from different clock sources, the clock manager of the present disclosurecoπfϊgures the associated audio processing modules an the. sample rate converter to operate in a second mode. At 540, the audio generating audio processing mcfdule is configured to pass its audio data to a sample rate converter through- an input portion of the buffer, when the associated audio processing modules- do not utilize a common clock source. In one implementation, the accelerator module stores audio data in an input portion of the buffer. Similarly, the local stage stores audio data in an input portion of the buffer, when the local and global 5> gcϊ> do not utilize a common clock source.
[00361 At 550, the sample rate converter is configured to synchronize the flow rates between the input and output portions of the buffer. In one implementation, when the associated accelerator and renderer modules do not utilize a common clock source, the sample rate converter retrieves audio data from the input buffer. The sample rate converter monitors the rate of audio data production by the accelerator module and the rate of consumption by the renderer module and introduces and/or eliminates extra data sample to maintain synchronization. Similarly, the sample rate converter monitors the rate of audio data production by the local stage and the rate of consumption by the global stage and introduces and or eliminates extra data samples to maintain syncbroru7ation. After inrrnrlnction and/or elimination of extra data samples, the sample rate converter outputs the audio data to an output portion of the buffer.
[0037] At 560 of Figure 5, the audio data consuming audio processing module is configured to receive the audio data from the sample rate converter through the output - portion of the buffer. In one implementation, the associated renderer module receives the audio data from the output portion of the buffer, when the accelerato, and euderer module do not utilize a. onuuon clock source. Similarly, the global stage receives the audio data from the output portion of the buffer, when the local and global stages do not utilize a common clock source. [0038] Referring now to Figure 6, an exemplary computing platform for implementing embodiments of the present disclosureis shown. Although illustrated widi iefcieπce to a computing device, it is appreciated that embodiments of the present invention may be implemented in game consoles, porfabta gaming ςyςtemς, ersonal digital applicances, combination sei-top box/game consoles, smartphones or other mobile telephones, computer-based simulators, portable entertainment centers, or similar device that generates sound. As depicted in Figure 6, the exemplary computing device includes a processor (CPU) 610, a memory controller hub (e.g., north bridge) 615, a main memory 620, a graphics processor (GPU) 625 and an input output controller hub (e.g., south bridge) 630. The processor 610, the graphics processor 625, the main memory 620, and the I/ hub controller hub 630 maybe communicatively coupled to the memory controller hub 615. Alternatively/the graphics processor 625 may be i pleπieiiLed m, _ϊι integral part of the- memory controller hub 615 (not shown). The exemplary computing device may also include peripheral components, such as a display, a keyboard, a pointing device, mass data storage device(s), speakers), and the like, coupled to the input/output controller hub 630 by an ^applicable bus 655-655 (PCI bus, USB, Firewire, Ethernet, ISA bus, etc).
[0039] The memory controller hub 615 provides for communicating information and instructions between the processor 610, the main memory 620, die graphic processor 625 and the iπpu output controller hub 630. The input/output controller hub 630 provides for communicating information and instmctions between the memory controller hub 615 and the various input/output devices connected by the various busses 635-655 The main memory 620 provides for storage of the information and instructions. The processor 610 processes information and instructions thereby providing an operating system and one or more applications. Similarly, the graphics processor processes information and insLru .iυrii thereby providing video data for display to a user,
[0040] The computing device further includes an audio system 660 in accordance with one or more of the above-described embodiments of the present disclosure. The audio system 660, in one implementation, is an integral part of the input/output controller hub 630. The audio system 660 includes one or more audio processing modules, a clock manager, a sample rate converter. Each audio processing module may provide one or more functions such as mixing, multi-channel conversion (e.g., stereo, surround sound), three dimensional positional computation (e.g., hea icl-iied uansfer functions, elevation, direction, etc.) and various effects (e.g., chorus, reverb, obstruction, occlusion, eqtialiazation cross-talk cancellation, etc.).
[0041] The clock manager, of the audio system 660, polls the audio processing modules to determine the source of each module's clock. Thereafter, one or more of the audio processing modules (e.g., accelerator, local stage) may generate audio data. hile one or more audio processing modules (e.g.., accelerator, local stage, renderer, global.stage) consume the audio data. For example., a first audio processing module generates audio' ata corresponding to ne or more received sounds. Λ second audio processing module consumes the audio data. If the first and sftcond audio processing modules share a common clock source, the clock manager configures the first audio processing module to output the generated audio data to a shared portion of the buffer. The clock manger also configures the second audio processing module to consume the audio data from the shared portion of the buffer. If the first and second audio processing modules operate from different: clock sources, the clock manager configures the first audio p ocessing module to output the generated audio data to an input portion of the buffer. The sample rate converter is configured by the clock manger to retrieve the audio data from the input portion of the buffer and to introduce or eliminate extra data samples to maintain synchronization. The sample rate converter then outputs the audio data to an output portion of the buffer. The clock manager also configures the second audio processing module to consume the audio data from the output portion of the buffer, when the first and second audio processing modules operate from different clock sources.
[0042J. The buffer of the audio system 660 may be implemented in main memory (e.g., shared memory access (S A)) 620. The shared portion of the buffer may be- approximately 1-10 KB (e.g., 64 samples, where each sample is 24 bits), while the input and output portions may be approximately 100-500 KB each. Although the buffer is described as comprising a shared portion, input portion and output portion, it is appreciated that the buffer may be implemented as a plurality of separate buffers or as a single buffer that is partitioned in accordance with the operating mode of the audio system 660.
IQ043] Although the audio system 660 is described as an integral part of the input/Output controller hub 630. it is .appreciated that the audio system 660 may be coupled to any element that provides the audio system 660 a direct connection to main memory 620. The audio system 660 may also be implemented as an integral part of the memory controller hub. Implementation of the audio system 660 may also be distributed among one or more of the abuvc-iiieutioα elements of the computing device. Implementation of the audio system 660 may also be distributed among one or more of the above-mentioned elements of the computing device and implemented in information and instructions residing in mam memory 620 and executed by the processor 610, the memory controller hub 615 and or the input/output controller hub. For example, an accelerator module may be implemented in software (e.g., information and instructions), the clock manager and sample rate converter may be implemented as an integral part of the input/output controller hub 630, the buffer may be implemented in the main memory 620 and the Tenderer module may be implemented in an audio controller.
[0044] Accor ingly, the memory controller hub 615, graphic processor 625; input output controller hub 630 and audio system 660 provide a distributed processing platform. The audio system 660 advantageously increases computing device performance by off-loading audio effects processing and Tendering from the processor. Furthermore, embodiments of the present disclosure advantageously allow audio processing modules to act as wholly independent devices. Embodiments of the present disclosureadvantageously synchronize the audio processing modules when they do not share a common clock spurce. When the audio processing modules share a common clock source, the overhead of synchronizing the audio processing modules may be eliminated by embodiments of the
present disclosure. [0045] In summary, some of the embodiments of the present disclosure provide an audio system having wholly independent audio processing modules. The audio system includes a plurality of audio
processing modules, a clock manager, a sample rate converter and a buffer. The audio processing modules are communicatively coupled to the clock manager and the buffer. The sample rate converter is communicatively coupled to the clock manager and the buffer. The buffer provides for storing audio data generated and consumed by the audio processing modules. The clock manager provides for determining the clock source of each audio processing module. The clock manager also provides for configuring the audio processing modules and the sample rate converter as a function the clock source of each audio processing module. The sample rate converter provides for synchronizing a flow rate of audio data generated by a first audio processing module and a flow rate of audio data consumed by a second audio processing module, when the clock source of the first aiid second audio processing modules are different
[0046] The foregoing descriptions of specific embodiments of the present disclosure have been presented fυi pui poses of illustration and description. They arc not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the disclosure and its practical application, to thereby enable others skilled in the art to best utilize the disclosure and various embodiments with various modifications as are suited to the particular use • contemplated. It is intended that the scope of the invention be defined by the Claims appended hereto and their equivalents.

Claims

What is claimed is: 1. An electronic audio system comprising: a buffer communicatively conplftd to a first audio processing module and a second audio processing module, for storing audio data generated by said first audio processing module and consumed by said second audio processing module; a clock manager communicatively coupled to said first and second audio processing modules, for determining a first clock source of said first audio processing module, for determining a second clock source of said second audio processing module and for configuring said first and second audio processing modules and a sample rate converter as a function of said first clock source and said second clock source; and said sample rate converter communicati ely coupled to said buffer and said clock manager, for synchronizing a first flow rate of said audio data generated by said first audio proo.fts.ring module and a second flow rate of said audio data consumed by said second audio processing module when said first clock source is different from said second clock source.
2. The audio system according to Claim 1, wherein: said first audio processing module comprises an accelerator module; and said second audio processing module comprises a Tenderer module.
3. The audio system according to Claim 1, wherein: sήid first audio processing module comprises a local stage; and said second audio processing module comprises Λ glohal stage.
4- The audio system according to Claim I, wherein: 3aid first audio processing module comprises a first accelerator module; and said second audio processing module comprises a second accelerator module.
5. The audio system according to Claim 1, wherein: said first audio processing module comprises a first local stage; and said second audio processing module comprises a second local stage.
6. The audio system according to Claim 1, wherein: said first audio processing module is configured to store audio data in a shared portion of said buffer, when said first a d second audio processing modules share a common clock source; and said second audio processing module is configured to retrieve audio data from said shared portion of said buffer, when said first and second audio processing modules share said common clock source.
7. The audio system according to Claim 1, wherein: said first audio processing module is configured to store said audio data in an input poition of said buffer, when said first and second audio processing modules do not share a common clock source; said sample rate converter is configured to retrieve said audio data from said input buffer, to modify said audio data by insert or delete an extra sample and to store said modified audio data in an output portion of said buffer, when said first and second audio- processing modules do not share said common clock sυuice, and said second audio processing modulo is configured to retrieve said audio data from said output portion of said buffer, when sai firsf anrl se n audio processing modules do not share said common clock source.
8. The audio system according to Claim 1, wherein: said first audio processing module is configured to store audio data in a shared portion of said buffer, when said first and second audio processing modules do not share a common clock source; said second audio processing module is configured to retrieve audio data fϊom said shared portion of said buffer,, when said first and second audio processing modules do not share said common clock source; and • : said sample rate converter is configured to increase a rate of generation by said first audio processing module or decrease a rate of consumption by said second audio processing module, when said first and second audio processing modules do not share said common clock source.
9. The audio system according to Claim 1, wherein: said first clock source of said first audio processing module is determined from a first global unique identifier of said first audio processing module; and said second clock source of said second audio processing module is determined from a second global unique identifier of said second aurbo processing module.
10. A method for synchronizing audio processing modules comprising: registering a plurality of audio processing modules; determining if an associated set of audio processing modules utilize a common clock source; and configuring a first one of said associated set of audio processing modules to pass a first set of audio data through a first buffer to a second one of said associated set of audio processing modules, when said associated set of audio processing modules utilize said common clock source.
11. i 'he method according to Claim 10, further comprising: configuring said first one of said associated set of audio processing modules to store said first set of audio data in a sp. ond buffer, when said associated set of audio processing modules do not Utilize said common clock source; configuring said sample rate converter to receive said first set of audio data f om said second buffer, to store a second set of audio data in a third buffer and to synchronize a flow rate of said first set of audio data into said second buffer with a flow rate of said seconcUet of audio data out of said third buffer- when said associated set of audio processing modules do not utilize said common clock source; and configuring said second one of said associated set of audio processing modules to receive said second set of audio data from said third buffer, when said associated set of audio proc ssing modules do not utilize said common clock source.
12. The method according to Claim 11, wherein said first one of said associated set of audio processing modules generates said first set of audio data as a function of one or- more received sounds.
13. The method according to Claim 11, wherein said second one of said associated set of audio processing modules performs: rendering a playback signal as a function said first set of audio data, when said associated set of audio processing modules utilize said common clock source; and rendering said playback signal as a function of said second set of audio data, when said associated set of audio processing modules do not utilize said common clock source.
14. The method according to Claim 11, wherein said second one of said associated set of audio processing modules perform?- recording an input signal as a function of said first set of audio data, when said associated set of audio processing modules utilizes said common clock "source; and recording said input signal as a function of said second set of audio data, when said associated set of audio processing modules do not utilize said common clock source.
15. The method according to Claim 11, wherein said first one of said associated set of audio processing modules processes said first set of audio data.
16. The method according to Claim 11, wherein said second one of said associated " set of audio processing modules performs:
2g processing said first set of audio data, when said associated set of audio processing modules utilize said common clock source; and processing said second set of audio data, when said associated set of audio processing modules do not utilize said common clock sonrc?
17. A method for synchronizing audio processing modules comprising: operating in a first mode, when an associated set of audio processing modules share a common clock source, comprising; storing audio data generated by a first one of said associated set of audio processing modules in a shared buffer; and receiving audio data consumed by a second one of said associated set of audio processing modules from said shared buffer; and operating in α second mode, when said associated set of audio processing modules do not share" a common clock source, comprising: storing audio data generated by said first one of said associared set of audio processing modules in an input buffer; receiving audio data consumed by said second one of said associated set of audio processing modules from an output buffer; and synchronizing a first flow rate of audio data being stored in said input buffer with a second flow rate of audio data being received from said output buffer.
15. The method according to Claim 17, further comprising determining a clock source of each audio processing module.
1.9. The method according to Claim 1 S, wherein said determining a clock source of each audio μiocessLug module comprises: polling each audio processing module; and receiving an identifier of said clock source of each audio processing module.
20. The method according to any one of Claims 17-19, wherein said synchronizing comprises receiving said audio data from said input buffer; inserting or deleting an extra sample in said audio data to generate modified audio data; storing said modified audio data in said output buffer.
21. A computing device comprising: a memory controller hub: a processor communicatively coupled to said memory controller hub; a main memory communicatively coupled to said memory controller hub; and ah audio' system communicatively coupled to said memory controller hub comprising; a clock manager; a plurality' of audio processing modules communicatively coupled to said ' clock manager . a sample rate converter communicatively coupled to said clock source;- and a buffer communicatively coupled to said plurality of audio processing modules and said sample rate converter,
22. The computing device according lυ Claim 21, wheieiu said clock manager and said sample rate converter arc implemented by information and instructions) stored in said main memory and processed by said processor.
23. The computing device according to Claim 21 or Claim 22, wherein at least one of said
plurality of audio processing modules are an integral part of said memory controller hub.
24. The computing device according to any one of Claims 21-23, further comprising an input/ou controller hub communicatively coupled to said memory controller hub, wherein at least one of said plurality of audio processing modules are an integral part of said input/output controller hub.
25. The computing device according to any one of Claims 21-24, wherein said buffer is implemented in said main memory.
PCT/US2005/012529 2004-04-14 2005-04-12 Method and system for synchronizing audio processing modules WO2005106872A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2005800093838A CN1934646B (en) 2004-04-14 2005-04-12 Method and system for synchronizing audio processing modules

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/824,759 2004-04-14
US10/824,759 US7574274B2 (en) 2004-04-14 2004-04-14 Method and system for synchronizing audio processing modules

Publications (1)

Publication Number Publication Date
WO2005106872A1 true WO2005106872A1 (en) 2005-11-10

Family

ID=34965545

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/012529 WO2005106872A1 (en) 2004-04-14 2005-04-12 Method and system for synchronizing audio processing modules

Country Status (4)

Country Link
US (2) US7574274B2 (en)
CN (1) CN1934646B (en)
TW (1) TWI309011B (en)
WO (1) WO2005106872A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2506148A1 (en) * 2011-03-31 2012-10-03 Broadcom Corporation Method and system for processing audio signals in a central audio hub

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002165148A (en) * 2000-11-29 2002-06-07 Sony Corp Data processing apparatus and method, and record medium
JP3876855B2 (en) * 2003-07-10 2007-02-07 ヤマハ株式会社 Automix system
US8086752B2 (en) * 2006-11-22 2011-12-27 Sonos, Inc. Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US8290603B1 (en) 2004-06-05 2012-10-16 Sonos, Inc. User interfaces for controlling and manipulating groupings in a multi-zone media system
US9207905B2 (en) 2003-07-28 2015-12-08 Sonos, Inc. Method and apparatus for providing synchrony group status information
US8234395B2 (en) 2003-07-28 2012-07-31 Sonos, Inc. System and method for synchronizing operations among a plurality of independently clocked digital data processing devices
US8768494B1 (en) 2003-12-22 2014-07-01 Nvidia Corporation System and method for generating policy-based audio
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US9374607B2 (en) 2012-06-26 2016-06-21 Sonos, Inc. Media playback system with guest access
TWI238638B (en) * 2004-04-22 2005-08-21 Benq Corp Method and device for multimedia processing
US8868698B2 (en) 2004-06-05 2014-10-21 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US8326951B1 (en) 2004-06-05 2012-12-04 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US8515741B2 (en) * 2004-06-18 2013-08-20 Broadcom Corporation System (s), method (s) and apparatus for reducing on-chip memory requirements for audio decoding
US7519845B2 (en) * 2005-01-05 2009-04-14 Microsoft Corporation Software-based audio rendering
TW200627258A (en) * 2005-01-27 2006-08-01 Lite On Technology Corp Medium transfer-recording control method and the embedded system using the same
US7672742B2 (en) * 2005-02-16 2010-03-02 Adaptec, Inc. Method and system for reducing audio latency
EP1708395A3 (en) * 2005-03-31 2011-11-23 Yamaha Corporation Control apparatus for music system comprising a plurality of equipments connected together via network, and integrated software for controlling the music system
JP4184397B2 (en) * 2005-11-11 2008-11-19 シャープ株式会社 VIDEO / AUDIO PROCESSING SYSTEM AND ITS CONTROL METHOD, AUDIO PROCESSING SYSTEM, VIDEO / AUDIO PROCESSING SYSTEM CONTROL PROGRAM, AND RECORDING MEDIUM CONTAINING THE PROGRAM
US7813823B2 (en) * 2006-01-17 2010-10-12 Sigmatel, Inc. Computer audio system and method
US9420332B2 (en) * 2006-07-06 2016-08-16 Qualcomm Incorporated Clock compensation techniques for audio decoding
US8483853B1 (en) 2006-09-12 2013-07-09 Sonos, Inc. Controlling and manipulating groupings in a multi-zone media system
US8788080B1 (en) 2006-09-12 2014-07-22 Sonos, Inc. Multi-channel pairing in a media system
US9202509B2 (en) 2006-09-12 2015-12-01 Sonos, Inc. Controlling and grouping in a multi-zone media system
US7890472B2 (en) 2007-09-18 2011-02-15 Microsoft Corporation Parallel nested transactions in transactional memory
EP2253087B1 (en) * 2008-03-12 2013-08-21 Genelec OY Data transfer method and system for loudspeakers in a digital sound reproduction system
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US9729115B2 (en) 2012-04-27 2017-08-08 Sonos, Inc. Intelligently increasing the sound level of player
US8910191B2 (en) 2012-09-13 2014-12-09 Nvidia Corporation Encoder and decoder driver development techniques
US9008330B2 (en) 2012-09-28 2015-04-14 Sonos, Inc. Crossover frequency adjustments for audio speakers
US9510055B2 (en) 2013-01-23 2016-11-29 Sonos, Inc. System and method for a media experience social interface
US9338015B2 (en) * 2013-03-06 2016-05-10 National Chung-Shan Institute Of Science And Technology Real time power monitor and management system
US9035808B2 (en) * 2013-06-05 2015-05-19 Mstar Semiconductor, Inc. Communication system and sample rate converter thereof
TWI517592B (en) * 2013-06-05 2016-01-11 晨星半導體股份有限公司 Communication system and sample rate converter thereof
US9300647B2 (en) 2014-01-15 2016-03-29 Sonos, Inc. Software application and zones
US20150220498A1 (en) 2014-02-05 2015-08-06 Sonos, Inc. Remote Creation of a Playback Queue for a Future Event
US9226073B2 (en) 2014-02-06 2015-12-29 Sonos, Inc. Audio output balancing during synchronized playback
US9226087B2 (en) 2014-02-06 2015-12-29 Sonos, Inc. Audio output balancing during synchronized playback
US9679054B2 (en) 2014-03-05 2017-06-13 Sonos, Inc. Webpage media playback
US10587693B2 (en) 2014-04-01 2020-03-10 Sonos, Inc. Mirrored queues
US20150324552A1 (en) 2014-05-12 2015-11-12 Sonos, Inc. Share Restriction for Media Items
US20150356084A1 (en) 2014-06-05 2015-12-10 Sonos, Inc. Social Queue
US9874997B2 (en) 2014-08-08 2018-01-23 Sonos, Inc. Social playback queues
US10645130B2 (en) 2014-09-24 2020-05-05 Sonos, Inc. Playback updates
US9667679B2 (en) 2014-09-24 2017-05-30 Sonos, Inc. Indicating an association between a social-media account and a media playback system
US9860286B2 (en) 2014-09-24 2018-01-02 Sonos, Inc. Associating a captured image with a media item
WO2016049342A1 (en) 2014-09-24 2016-03-31 Sonos, Inc. Social media connection recommendations based on playback information
US9723038B2 (en) 2014-09-24 2017-08-01 Sonos, Inc. Social media connection recommendations based on playback information
US9959087B2 (en) 2014-09-24 2018-05-01 Sonos, Inc. Media item context from social media
US9690540B2 (en) 2014-09-24 2017-06-27 Sonos, Inc. Social media queue
TWI554089B (en) * 2014-09-29 2016-10-11 緯創資通股份有限公司 Audio and vedio sharing method and system
US10248376B2 (en) 2015-06-11 2019-04-02 Sonos, Inc. Multiple groupings in a playback system
US9886234B2 (en) 2016-01-28 2018-02-06 Sonos, Inc. Systems and methods of distributing audio to one or more playback devices
CN106126159B (en) * 2016-06-16 2018-01-23 广东欧珀移动通信有限公司 A kind of audio stream processing method and mobile terminal
US10353424B2 (en) 2016-07-01 2019-07-16 Imagination Technologies Limited Clock synchronisation
US10310897B2 (en) * 2016-09-30 2019-06-04 Intel Corporation Hardware accelerators and methods for offload operations
US10712997B2 (en) 2016-10-17 2020-07-14 Sonos, Inc. Room association based on name

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0869443A2 (en) * 1997-04-04 1998-10-07 Microsoft Corporation Method and computer program product for synchronizing the processing of multiple data streams and matching disparate processing rates using a standardized clock mechanism
US5875354A (en) * 1996-03-01 1999-02-23 Apple Computer, Inc. System for synchronization by modifying the rate of conversion by difference of rate between first clock and audio clock during a second time period
US6005901A (en) * 1997-02-27 1999-12-21 Advanced Micro Devices Arrangement for asynchronous decimation using a frequency ratio estimator and method thereof
US6226758B1 (en) * 1997-09-30 2001-05-01 Cirrus Logic, Inc. Sample rate conversion of non-audio AES data channels
US20020012324A1 (en) * 1998-06-22 2002-01-31 Roger D. Hayward Echo cancellation with dynamic latency adjustment

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3173022A (en) 1961-06-14 1965-03-09 North American Aviation Inc Overload protected switching circuit
JP3056866B2 (en) 1992-02-17 2000-06-26 アルパイン株式会社 Automatic volume control method
US5768628A (en) 1995-04-14 1998-06-16 Nvidia Corporation Method for providing high quality audio by storing wave tables in system memory and having a DMA controller on the sound card for transferring the wave tables
DE19522074A1 (en) 1995-06-17 1996-12-19 Bosch Gmbh Robert Fuel supply device for an internal combustion engine
US5918073A (en) * 1997-06-27 1999-06-29 Advanced Micro Devices, Inc. System and method for equalizing data buffer storage and fetch rates of peripheral devices
JP2001043062A (en) 1999-07-27 2001-02-16 Nec Corp Personal computer, volume control method thereof, and recording medium
US6260011B1 (en) 2000-03-20 2001-07-10 Microsoft Corporation Methods and apparatus for automatically synchronizing electronic audio files with electronic text files
US6646195B1 (en) 2000-04-12 2003-11-11 Microsoft Corporation Kernel-mode audio processing modules
US7599753B2 (en) 2000-09-23 2009-10-06 Microsoft Corporation Systems and methods for running priority-based application threads on a realtime component
SE0004838D0 (en) 2000-12-22 2000-12-22 Ericsson Telefon Ab L M Method and communication apparatus in a communication system
US7376475B2 (en) 2001-03-05 2008-05-20 Microsoft Corporation Audio buffer configuration
US7305097B2 (en) 2003-02-14 2007-12-04 Bose Corporation Controlling fading and surround signal level
US7272235B2 (en) 2003-06-26 2007-09-18 Microsoft Corporation Method and apparatus for audio normalization
US7216221B2 (en) 2003-09-30 2007-05-08 Microsoft Corporation Method and system for unified audio control on a personal computer

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5875354A (en) * 1996-03-01 1999-02-23 Apple Computer, Inc. System for synchronization by modifying the rate of conversion by difference of rate between first clock and audio clock during a second time period
US6005901A (en) * 1997-02-27 1999-12-21 Advanced Micro Devices Arrangement for asynchronous decimation using a frequency ratio estimator and method thereof
EP0869443A2 (en) * 1997-04-04 1998-10-07 Microsoft Corporation Method and computer program product for synchronizing the processing of multiple data streams and matching disparate processing rates using a standardized clock mechanism
US6226758B1 (en) * 1997-09-30 2001-05-01 Cirrus Logic, Inc. Sample rate conversion of non-audio AES data channels
US20020012324A1 (en) * 1998-06-22 2002-01-31 Roger D. Hayward Echo cancellation with dynamic latency adjustment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANALOG DEVICES, INC: "192 kHz Stereo Asynchronous Sample Rate Converter", AD1895-SPECIFICATIONS, September 2002 (2002-09-01), Norwood, MA, U.S.A, XP002340804 *
YONGE M: "A digital audio production system", BROADCASTING CONVENTION, 1995. IBC 95., INTERNATIONAL AMSTERDAM, NETHERLANDS, LONDON, UK,IEE, UK, 1995, pages 202 - 207, XP006528928, ISBN: 0-85296-644-X *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2506148A1 (en) * 2011-03-31 2012-10-03 Broadcom Corporation Method and system for processing audio signals in a central audio hub
KR101402869B1 (en) 2011-03-31 2014-06-03 브로드콤 코포레이션 Method and system for processing audio signals in a central audio hub

Also Published As

Publication number Publication date
US20080109574A1 (en) 2008-05-08
CN1934646A (en) 2007-03-21
US20050234571A1 (en) 2005-10-20
US7983772B2 (en) 2011-07-19
TW200604851A (en) 2006-02-01
CN1934646B (en) 2012-05-30
US7574274B2 (en) 2009-08-11
TWI309011B (en) 2009-04-21

Similar Documents

Publication Publication Date Title
US7574274B2 (en) Method and system for synchronizing audio processing modules
US6665409B1 (en) Methods for surround sound simulation and circuits and systems using the same
KR101116617B1 (en) Method and apparatus for transmitting and processing audio with I2S format
US8249730B2 (en) Systems and methods for shadowing an HDA codec
EP0853802B1 (en) Audio synthesizer
JP2020526789A (en) Last mile equalization
JP5160758B2 (en) Mobile device
US7434078B2 (en) Synchronization with hardware utilizing software clock slaving via a clock
CN110418183B (en) Audio and video synchronization method and device, electronic equipment and readable medium
US7395208B2 (en) Integrating external voices
US20220059071A1 (en) Sound modification of speech in audio signals over machine communication channels
US8224469B2 (en) Systems and methods for controlling audio volume in the processor of a high definition audio codec
US20110299690A1 (en) Method and apparatus for transmitting audio data
US7151970B1 (en) Multiple audio DACs with PC compatibility
US7884741B2 (en) For externally clocked digital audio input, determining a valid clock and muting audio during synchronization
US20060034581A1 (en) Media device featuring synchronized playback
US7470848B2 (en) Structure and method for playing MIDI messages and multi-media apparatus using the same
US9236054B2 (en) System and method for controlling audio data processing
KR101315994B1 (en) System and method for implementing audio file using virtual machine
US8219226B2 (en) Systems and methods for overriding hardwired responses in an HDA codec
KR20010005016A (en) Input buffer of MPEG audio layer3 decoder
JPH06180597A (en) Adpcm reproducing control device
KR19980040332U (en) Sound signal processor of personal computer system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 200580009383.8

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase