CA2258652A1 - Method and apparatus for providing sound in a spatial environment - Google Patents

Method and apparatus for providing sound in a spatial environment Download PDF

Info

Publication number
CA2258652A1
CA2258652A1 CA002258652A CA2258652A CA2258652A1 CA 2258652 A1 CA2258652 A1 CA 2258652A1 CA 002258652 A CA002258652 A CA 002258652A CA 2258652 A CA2258652 A CA 2258652A CA 2258652 A1 CA2258652 A1 CA 2258652A1
Authority
CA
Canada
Prior art keywords
sound
ox07ff
transducers
spatial
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002258652A
Other languages
French (fr)
Inventor
Daniel Bates
Glenn Arnold
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Extreme Audio Reality Inc
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/665,515 external-priority patent/US5850455A/en
Application filed by Individual filed Critical Individual
Publication of CA2258652A1 publication Critical patent/CA2258652A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/301Automatic calibration of stereophonic sound system, e.g. with test microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/20Disc-shaped record carriers
    • G11B2220/25Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537Optical discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/40Visual indication of stereophonic sound image

Abstract

A method and apparatus for providing sound in a spatial environment are provided. Control is provided over the perceived position of sound sources (10), including perceived positions behind the listener or listeners (20). The invention is effective for multiple simultaneous listeners distributed throughout the spatial environment. The invention provides techniques for real-time interaction with graphic images, computer game controls, or other computer-based events. The invention provides control over the relative amplitude of signals provided to each of plurality of spatially diverse transducers (16). By controlling the relative amplitudes of signals applied to each of the transducers (16), the present invention provides control over the perceived position of sound sources (10) in a spatial environment with respect to one or more listeners (20). Attenuation parameters may be stored in a table (38), indexed by the spatial region to which they apply, and used to adjust the relative amplitude of each of the transducers (16) used to produce a sound.

Description

CA 022~86~2 1998-12-17 METHOD AND APPARATUS FOR PROVIDING SOUND
IN A SPATIAL ENVIRONMENT

This is a continuation-in-part of Application No. 08/665,515, filed 5 June 18,1996.

BACKGROUND OF THE INVENTION

1. FIELD OF THE INVENTION
The present invention relates to a method and apparatus for providing and controlling sound in a spatial environment.
2. BACKGROUND ART
When hearing sounds, people can hear not only information about the sounds themselves, but also about the locations of the sound sources producing the sounds. Often, however, systems for producing or reproducing sound cannot accurately convey the same senses of direction and 20 position. Thus, a system is needed that can create the perception of sound sources being located in different places than the loudspeakers being used to provide the sound as well as the perception that the sound sources are moving with respect to the listener.

Humans derive much information about their environment from their sense of hearing. Even when one is deprived of other sensory inputs, one can obtain a good understanding of one's surroundings through hearing alone. One can sense direction, distance, amplitude, spectral content, and ., ~ _~ u . . . . .. .

CA 022~86~2 1998-12-17 WO 97/49262 PCT/US97tlO409 timing of sound sources. Such parameters are meaningful when they relate to an actual source sound that is physically located at a specific location.

However, it is often desirable to simulate sound sources and their 5 locations. One example involves reproduction of sound. A recording may be made of an orchestra playing music. Since different instruments are located at different locations within the orchestra, it is important to convey the same sense of position during playback in order to achieve faithful reproduction.

Another example involves synthesis of sound that is intended to convey the same parameters that are sensed from actual sound sources. An attempt may be made to create the sense that a bumble bee or a helicopter is flying by the listener. Ideally, it would be possible to convey the sense that sound is originating from one or more locations around a listener. Since 15 sound sources would be perceived to exist but would not require actual sound generating means to be at the same place the sound seems to be originating, such sound sources are referred to as apparent sound sources.

Initial attempts at synthesizing and reproducing sound were 20 monophonic. Since sound was generated from a single loudspeaker located at a single location, the sound was perceived as coming from that single location, not the potentially many locations of the original sound sources.
Thus, monophonic techniques lost all information relating to the position of the original sound sources.
To provide some sense of position, stereophonic reproduction was developed. For a stereophonic recording, two microphones were spaced CA 022~86~2 1998-12-17 horizontally and positioned in front of the original sound sources, for example, the instruments in an orchestra. Two separate recordings were made, one from each microphone. These two separate recordings were then played back over separate loudspeakers separated horizontally by some 5 distance. When adjusted properly, the perceived locations of the individual sound sources would lie along a line segment between the two loudspeakers.
As long as the locations of the original sound sources were along such a line segment, and assuming the two microphones had been positioned correctly, the positions of the perceived sound sources would roughly correspond to 10 the positions of the original sound sources. However, actual sound sources are rarely constrained to such specific configurations. Thus, stereophonic techniques cannot accurately convey the position information associated with most configurations of original sound sources.

Attempts were also made to reproduce sound using quadraphonic techniques. Quadraphonic techniques record sound signals received from four microphones. The four sound signals are denoted left front, right front, left rear, and right rear. As with stereophonic techniques, two separate channels are used for the left front and right front sound signals. The left 20 rear and right rear sound signals are modulated onto the left front and rightfront sound signals, respectively, and recorded on the same two channels used to record the left front and right front signals. By using only two recording channels, the quadraphonic techniques maintain backwards compatibility with stereophonic techniques. To reproduce sound, the two 25 channels are played back, and the left rear and right rear signals are demodulated. The resulting four sound signals are fed to four loudspeakers to attempt to convey meaningful position information. However, CA 022~86~2 1998-12-17 quadraphonic recording techniques do not provide interactive control of the position information that the techniques are attempting to convey. There is no provision for interactive control in conjunction with synthesized images or computer-based game controls. Moreover, the requirement for four 5 separate sound signals has traditionally hindered synthesis of sounds with controllable position information.

Another sound reproduction technique was developed to provide improved position perception without requiring more than the two (left and 10 right) channels of traditional stereophonic techniques. The technique involves the use of three loudspeakers. Two loudspeakers are positioned in front of a listener and reproduce the left and right sound signals as described in relation to stereophonic techniques. A third loudspeaker is positioned behind the listener. A sound signal that is obtained either by subtracting the 15 right sound signal from the left sound signal or by subtracting the left sound signal from the right sound signal is applied to the third loudspeaker. This sound signal that represents the difference between the left and right sound signals helps enhance position perception. As with quadraphonic techniques, this technique also does not provide interactive control of the 20 position information attempted to be conveyed. There is also no provision for interactive control in conjunction with synthesized images or computer-based game controls. Furthermore, additional circuitry is needed to generate the sound signal representing the difference of the left and right sound signals.
Another attempt at providing sound that creates the impression of surrounding the listener (i.e., surround sound) was made using the three CA 022~86~2 1998-12-17 WO 97/49262 PCT/US97tlO409 loudspeakers of the above technique in combination with one additional loudspeaker. The additional loudspeaker was a center loudspeaker between the left and right loudspeakers. The center loudspeaker helps reinforce the ~,c~Lion of sound coming from directly in front of a listener. Otherwise, 5 this technique suffers from the same disadvantages as the three loudspeaker technique. A variation on this technique split the left minus right difference signal into two loudspeakers positioned behind the listener. This arguably offered some improvement in position perception, but did not otherwise overcome the disadvantages of the previous technique. Another variation 10 on this technique used frequency dependent masking to convey information.
Frequency dependent masking alters the natural audio frequency spectrum and distorts the sound signals being reproduced.

Attempts have also been made to widen the perceived positioning of 15 stereophonic techniques. Some of these attempts have filtered the sound signals and introduced delays in the sound signals. Most of these techniques suffer from the disadvantage that they cannot create the perception that sound is emanating from a source behind the listener. Even those that can arguably cause some sensation that the sound is behind the listener cannot 20 overcome an ambiguity in perceived location for sounds intended to be perceived as originating directly in front of and directly behind the listener (i.e., at azimuth bearings of 0~ and 180~). Such techniques generally have the disadvantage of requiring the listener to be perfectly positioned with respect to the loudspeakers in order to achieve the desired perception. Some of these 25 techniques even require specific parameters of the anatomy of the listener's ears to be determined before attempting to provide accurate position perception. These techniques are listener dependent, do not support ~ . ~ . .... .

CA 022~86~2 1998-12-17 multiple simultaneous listeners, and must be reconfigured to accommodate different listeners.

Some audio processing equipment utilizes panning controls to set the 5 balance between sound levels generated by multiple loudspeakers. For instance, stereophonic systems often use a panning potentiometer commonly referred to as a balance control to control the relative levels of left and right loudspeakers. Some systems provide a panning potentiometer commonly referred to as a fader to control the relative levels of front and rear 10 loudspeakers. Some sound studio equipment combines these panning controls into a single control mechanism. Nevertheless, such controls do not allow individual control of perceived position information for multiple simultaneous sound sources. Furthermore, such controls do not provide dynamic interaction with graphic images or computer-based game controls.
15 Also, the relationship between gain and potentiometer position is generally fixed, preventing accurate dynamic control of perceived position, particularly for sound signals of widely varying amplitudes.

Thus, disadvantages abound with prior art techniques for attempting to control the perceived position of sound sources.

. . .

CA 022~86~2 1998-12-17 SUMMARY OF THE INVENTION

The present invention provides a method and apparatus for providing sound in a spatial environment. The present invention allows control over 5 the perceived position of sound sources, including perceived positions behind the listener or listeners. The present invention provides the desired effect for multiple simultaneous listeners distributed throughout the spatial environment. The present invention is independent of particular anatomical parameters of the listeners. The present invention provides 10 techniques for real-time interaction with graphic images, computer game controls, or other computer-based events.

The present invention controls signals representative of sounds from sound sources. The invention controls the relative amplitude of signals 15 provided to each of a plurality of transducers arranged in a distributed manner. Loudspeakers are a common type of transducer with which the present invention may be practiced. By making a particular loudspeaker louder relative to another loudspeaker for a given sound, the perception is created that an apparent sound source corresponding to sounds produced by 20 the loudspeakers is located closer to the louder loudspeaker. Similarly, making a particular loudspeaker relatively softer can make an apparent sound source seem to be farther from that particular loudspeaker. By carefully controlling the relative levels of signals applied to each of the loudspeakers, the present invention provides precise control over the 25 perceived position of sound sources in a spatial environment with respect to one or more listeners.

CA 022~86~2 1998-12-17 W O 97/49262 PCT~US97/10409 In one embodiment of the present invention, a spatial environment is defined to include a plurality of spatial regions. Attenuation parameters are values that specify the extent to which sound signals should be made louder or softer. For each region, attenuation parameters are determined that 5 provide adjustment of the amplitude of signals provided to each of a plurality of transducers so as to simulate the sounds that would be produced by a sound source located within that region. The attenuation parameters may be determined mathematically, empirically, or by any other suitable technique. When determining attenuation parameters mathematically, the 10 desired spatial environment may be modelled, the additive effects of multiple power levels or sound pressure levels may be calculated, the parameters for particular regions may be interpolated from parameters for other regions, or other mathematical techniques may be employed.
Empirical techniques may also be used. For example, a physical model of a 15 desired spatial environment may be constructed and measurements of acoustic parameters may be made. It is also possible to construct a mathematical framework that is then refined by incorporation of empirical data. Such an approach helps compensate for non-ideal phenomena that are difficult to model mathematically.
Once determined, the attenuation parameters may be stored in a table and indexed by the spatial region to which they apply. When it is desired to produce a sound having an apparent sound source within a particular spatial region, attenuation parameters that relate to that particular region may be 25 obtained from the table. The attenuation parameters may then be used to adjust the relative amplitude of each of the transducers used to produce the sound. The resulting sound is perceived by one or more listeners, who may .. . . .

be situated at various locations either internal to or external to the defined spatial environment, as being produced by a sound source located within the designated region.

CA 022~86~2 1998-12-17 WO 97/49262 PCT/US97/1040g BRIEF DESCRIPTION OF THE DRAWINGS

Figure 1 is a block diagram illustrating one embodiment of a system according to the present invention.

Figure 2 is a plan view diagram illustrating one example of an embodiment of the present invention for providing sound in a circular spatial environment.

Figure 3 is a plan view diagram illustrating one embodiment of the present invention having a circular spatial environment where the apparent position of sound sources can be controlled both angularly and radially.

Figure 4 is a three-dimensional diagram i}lustrating sound pressure 15 level with respect to perceived position in a spatial environment defined in the (x, z) plane for one embodiment of the present invention.

Figure 5 is a three-dimensional diagram illustrating sound pressure levels with respect to perceived position in a circular spatial environment for 20 one example of an acoustic effect produced by selecting attenuation parameters that result in a sound pressure level varying with radius.

Figure 6 is a three-dimensional diagram illustrating sound pressure levels with respect to perceived position for one embodiment of the present 25 invention.

. ~ . .

CA 022~86~2 1998-12-17 WO 97/49262 PCT/US9711fl409 Figure 7 is a three-dimensional diagram illustrating sound pressure level with respect to perceived position for one embodiment of the present invention .

Figure 8 is a plan view diagram illustrating an embodiment of the present invention allowing control of the perceived radial and angular positioning of a sound source.

Figure 9 is a three dimensional diagram illustrating an example of one embodiment of the present invention where sound pressure level varies over a rectilinear spatial environment.

Figure 10 is a diagram illustrating gain curves for one embodiment of the present invention.
Figure 11 is a perspective view diagram of one embodiment of the present invention.

Figure 12 is a plan view diagram illustrating one embodiment of the present invention having a rectilinear spatial environment.

Figure 13 is a plan view diagram of one embodiment of the present invention having a rectilinear spatial environment.

Figure 14 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional rectilinear spatial environment.

CA 022~86~2 1998-12-17 Figure 15 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional rectilinear spatial environment.

Figure 16 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional spatial environment.

Figure 17 is a perspective view diagram illustrating an embodiment of 10 the present invention having a three dimensional spherical spatial environment .

Figure 18 is a flow diagram illustrating one embodiment of a process according to the present invention.
Figure 19 is a flow diagram that is a continuation of the flow diagram illustrated in Figure 18.

Figure 20 is a flow diagram that is a continuation of the flow diagram 20 illustrated in Figures 18 and 19.

Figure 21 is a flow diagram that is a continuation of the flow diagram illustrated in Figures 18,19 and 20.

Figure 22 is a flow diagram illustrating one embodiment of a process according to the present invention.

CA 022~86~2 1998-12-17 Figure 23 is a flow diagram illustrating one embodiment of a process according to the present invention.

Figure 24 is a flow diagram illustrating one embodiment of a process 5 according to the present invention.

Figure 25 is a plan view diagram illustrating placement of transducers 16 relative to user 20 for one embodiment of the present invention.

Figure 26 is a perspective view diagram illustrating the placement of transducers 16 relative to user 20 for one embodiment of the present invention .

Figure 27 is a plan view diagram illustrating an embodiment of the 15 present invention.

Figure 28 is a plan diagram illustrating an example of a configuration of transducers 2801-2806 that may be used in conjunction with the present invention .

CA 022~86~2 1998-12-17 DETAILED DESCRIPTION OF THE INVENTION

A method and apparatus for providing sound in a spatial environment is described. In the following description, numerous specific 5 details are set forth in order to provide a more thorough understanding of the present invention. It will be apparent, however, to one skilled in the art, that the present invention may be practiced without these specific details. In other instances, well-known features have not been described in detail in order not to unnecessarily obscure the present invention.
While listeners typically perceive sounds qualitatively, sound can also be analyzed quantitatively. One quantitative parameter of sound is its sound pressure level. The sound pressure level affects how loud a sound is qualitatively perceived to be. The sound pressure level also can affect the 15 perceived direction and distance toward a sound source. Other parameters that are related to the sound pressure level are the sound power of a sound source and the sound intensity, which is a measure of acoustical energy flux through a defined area. Sound pressure level is often a convenient parameter since it can be easily measured and is a parameter to which ears are 20 sensitive.

Ears can detect very small periodic pressure variations that are inLel~leled as sound. Ears respond to changes in sound pressure ranging from the threshold of audibility, which varies from person to person, but 25 typically corresponds to a sound pressure amplitude of about 2x10-5 N/m2 (newtons/meter2) at a frequency of 1000 Hz, to sound pressure amplitude many orders of magnitude greater than that.

CA 022~86~2 1998-12-17 To accommodate the wide range of a pressure stimuli to which ears are sensitive, it is convenient to measure sound pressures on a logarithmic scale in units called decibels (dB). Sound pressure level in decibels is defined as:

Lp=20 log p/po.

Since this equation for sound pressure level provides a logarithmic expression for p relative to po, a standard reference value is assigned to po to10 provide an absolute reference for sound pressure level. Since a pressure amplitude of 2x10-5 n/m2 is the nominal threshold of audibility, it is commonly used as such a standard reference value for po. The sound pressure level po=2Xl0-5 n/m2 is assigned a sound pressure decibel level of O
dB. Expressed in other units, po=20 micropascals=2xlO-4 dynes/cm2=2x10-4 15 microbars. (For comparison, atmospheric pressure is 105 N/m2, or 106 microbars). Thus, extremely small variations in air pressure can be detected by the ear. Sound pressure levels may be measured by a sound level meter, comprising a microphone, an amplifier, and a meter calibrated in decibels.

Decibels also provide a convenient technique for logarithmically expressing other acoustic parameters such as sound power level and sound intensity level. Sound power level refers to the total sound power emitted by a source in all directions. Sound power is measured in watts (one watt equals one joule of energy per second or kilograms times meters2 over seconds3).
Audible sounds are produced with an extremely small amount of power.
Thus, sound power levels are expressed in decibels relative to a picowatt (10-12 watt). Sound power level (in decibels) is defined as:

CA 022S86~2 1998-12-17 LW=1O log W/Wo, where W is the sound power emitted by the source, and the reference power 5 Wo=10-12 watt.

The relationship between sound pressure level and sound power level depends on several factors, including the geometry of the source and the room. If the sound power level of a source is increased by 10 dB, the sound 10 pressure level also increases by 10 dB, provided everything else remains the same. If a source radiates sound equally in all directions and there are no reflecting surfaces nearby, the sound pressure level decreases by 6 dB each time the distance from the source doubles. Propagation in a free field is illustrated in the Table 1 below:

ISOTROPIC RADIATION OF SOUND ~ FREE SPACE
DISTANCE SIL or SPL
0 m OdB
1 m -lldB
2m -17dB
4m -23dB
8m -29dB
16m -35dB
32m -41dB
64m -47dB
128m -53dB
256m -59dB
512m -65dB
1024m -71dB

CA 022~86~2 1998-12-17 The decibel is also used to express sound intensity, which is the rate of energy flow across a unit area. The reference for measuring sound intensity level is Io=10-l2 watt/m2, and the sound intensity level is defined as:

Ll=10 log I/Io.

For a free progressive wave in air (e.g., a plane wave traveling down a tube or a spherical wave traveling outward from a source), sound pressure level and sound intensity level are equal (Lp _ Ll). This equality is not always10 accurate, however, because sound waves from many directions contribute to sound pressure at a point.

When a point source (or any source that radiates equally in all directions) radiates into free space, the intensity of the sound varies as 1/r2 15 (and the source pressure varies as 1 /r), where r is the distance from the source S. This may be understood as a given amount of sound power being distributed over the surface of an expanding sphere with area 4~r2.

I=W/47~r2, where W is the power of the source. An environment in which there are no reflections is called a free field. In a free field, the sound intensity level decreases by 6 dB each time the distance from the source is doubled. The sound intensity level (or sound pressure level) at a distance of one meter 25 from a source in a free field is 11 dB less than the sound power level of the source. This is easily shown as follows:

CA 022~86~2 1998-12-17 W W
4~r2 4~r(1) L, = 101Og lo-l2 = l0log lo-l2 -101og4~ = LW -1 l ~ Lp 5 Similarly it can be shown that a distance of two meters, Ll is 17 dB less than Lw.

It is also possible for a source to be resting on a hard, sound-reflecting surface and radiating hemispherical waves. Under those conditions, the 10 sound intensity level Ll and the sound pressure Lp at a distance of one meter are 8 dB less than the sound power level, once again diminishing by 6 dB
each time the distance is doubled. In actual practice, few sound sources radiate sound equally in all directions, and there are often reflecting surfaces nearby that destroy the symmetry of the spherical or hemispherical waves.

Decibels are also useful for expressing signals levels for sound to be produced or reproduced, for example using digital techniques. A digital-to-analog converter (DAC) may be used to convert a digital representation of a sound to an analog representation that may be converted to an acoustic form 20 by a transducer. A DAC takes as an input a digital value and produces as an output an analog electrical signal, for example a voltage or current, corresponding to the digital value. The relationship between the digital value and the analog electrical signal may vary from one type of DAC to another. For example, one type of DAC provides a full output with a 16-bit 25 input having a digital value of 65535 (all bits equal to one). One example of a DAC of this type reduces its analog output voltage by 6 dBV (decibels relative CA 022~86~2 1998-12-17 to one volt) each time the digital value at its input is reduced by half. This reduction in analog output voltage also provides a corresponding reduction in power output at transducers that are driven with a signal based on the analog output voltage of the DAC. These relationships are illustrated in 5 Table 2 below:

POWER
(16-Bit POWER POWER POWER VOLTAGE VOLTAGE
Linear) (%) (dB) (V) (dBV) 65535 100 1 0 1.0 0 FFFFh 57343 87.5 7/8 -.58 0.935 -1.16 DFFFh 49151 75 3/4 -1.25 0.866 -2.50 BFFFh 40959 62.5 5/8 -2.04 0.791 -4.08 9FFFh 36863 56.25 9/16 -2.50 0.750 -5.00 8FFFh 32768 50 1/2 -3.01 0.707 -6.02 8000h 24576 37.5 3/8 -4.26 0.612 -8.52 6000h 16384 25 1/4 -6.02 0.500 -12.04 4000h 12288 18.75 3/16 -7.27 0.433 -14.54 3000h 8192 12.5 1/8 -9.03 0.354 -18.06 2000h 4096 6.25 1/16 -12.04 0.250 -24.08 1000h 0000h Much of the development of systems for producing and reproducing sound has been directed toward providing accurate reproduction of spectral CA 022~86~2 1998-12-17 components of the sound. These efforts have culminated in the development of digital audio techniques that provide very accurate spectral reproduction and control of spectral components over a bandwidth determined by the sampling rate used. Unfortunately, this emphasis on 5 spectral accuracy has not been accompanied by corresponding developments in the ability to convey audio information useful for perceiving the position of sound sources in a spatial environment with respect to one or more listeners. Thus, during sound reproduction, accurate perception of the original positions of recorded sound sources by one or more listeners over a 10 broad spatial environment is difficult to achieve. During sound synthesis, accurate placement of synthetic sound sources in such an environment has also been difficult.

The present invention provides a method and apparatus for control of 15 perceived position of sound sources in a spatial environment with respect to one or more listeners. The present invention may be practiced with a plurality of spatial environments with either one spatial environment at a given time or with multiple simultaneous spatial environments. The present invention provides the ability to perceptually position multiple 20 simultaneous sound sources in the spatial environments. The present invention also allows perceptually diffuse sound sources to be produced concurrently with sound sources at perceptually discrete locations. The perceptual positioning of sound sources may be dynamically altered to produce the sensation of relative motion between the sound sources and one 25 or more listeners.

. ~, , CA 022~86~2 1998-12-17 The present invention uses a plurality of transducers at spatially diverse locations relative to one or more listeners. The present invention controls the relative amplitudes of signals used to drive the plurality of transducers. By accurately controlling the relative amplitudes, the present 5 invention allows accurate control of the perceived positions of sound sources within a spatial environment with respect to the listeners.

One embodiment of the present invention constructs tables containing attenuation parameters used to control the relative amplitudes of signals for 10 a number of discrete regions defined within a specified spatial environment.
Reference is made to the tables for each region within which a sound source is to be perceived as being located. The attenuation parameters are applied to the signals used to drive the transducers so as to effect control over the perceived positions of sound sources whose sounds are represented by the 15 signals.

Figure 1 is a block diagram illustrating one embodiment of a system according to the present invention. This embodiment comprises a controller 30, a host 12, a video display 34, a program 32, a driver 22, a data structure 26, 20 tables 38, one or more sound sources 10, couplers 14, mixing stage 131, transducers 16, spatial environment 18, and a user 20. Sound sources 10 may be any type of sound source, for example a pulse code modulated (PCM) sound file, a wavetable synthesizer or data, frequency modulation (FM) synthesizer or data. In one embodiment, a sound source may be controlled 25 using any suitable technique, for example, musical instrument digital interface (MIDI), common gateway interface (CGI) script, practical extraction and report language (PERL), hypertext markup language (HTML), compiled CA 022~86~2 1998-12-17 WO 97t49262 PCT/US97/10409 source code, executables, or any other suitable technique. Such control may be performed locally in relation to the sound source or may be performed remotely, for example over the internet or another network or communication medium. Sound sources 10 may be controlled by and used 5 in conjunction with host 12. Sound sources 10 provide digital sound data to couplers 14. Couplers 14 may be digital-to-analog converters (DACs), digital line drivers, or some other coupling devices. Couplers 14 provide an output used to drive transducers 16. Transducers 16 convert electrical energy of input signals to acoustic energy representative of the input signals.
Transducers 16 are illustrated as being in the vicinity of spatial environment 18. The actual positioning of transducers 16 may be varied.
Individual gain adjustment of the audio signals driving transducers 16 or changes in the attenuation parameters stored in tables 38 may be used to 15 adjust for changes in positioning of transducers 16. Spatial environment 18 is illustrated with user 20 at its center, although user 20 may be at a different location relative to spatial environment 18 or multiple users 20 may be at various locations. All users 20 perceive position of sound sources in relation to their locations relative to spatial environment 18. The size and 20 configuration of spatial environment 18 may be adjusted in an almost infinite number of ways by changing the spacing and placement of transducers 16 and the attenuation parameters stored in tables 38.

In one embodiment of the present invention, driver 22, which may be 25 implemented as software operating on host processor 12, as software operating on a separate processor, or as hardware, receives information from program 32 and controls the operation of sound source 10, couplers 14, CA 022~86~2 l998-l2-l7 W 097/49262 PCT~US97/10409 mixing stage 131, transducers 16, and other sound subsystem components so as to provide sound as desired. Driver 22 may be configured to accommodate different types of sound sources 10, couplers 14, mixing stages 131, transducers16, and other sound subsystem components.

Driver 22 controls the amplitude attenuation of the sound produced by each of transducers 16. Driver 22 may effect the attenuation control by subjecting signals representative of sound to attenuation anywhere along the path from program 32 to transducers 16. The attenuation parameters stored 10 in data structure 26 provide reference values by which such amplitude attenuation may be achieved. By applying the correct amplitude attenuation to the sound provided by each of transducers 16, the perceptual locations of each sound source 10 can be controlled within one or more spatial environments. Thus, user 20 is able to derive the sensation of being 15 surrounded by various sound sources located at one or more specific or diffuse locations within one or more spatial environments. With reference to the present invention, attenuation may refer to reduction in amplitude or to modification of amplitude that may include decrease, increase, or both.
Thus, by providing what is referred to as attenuation control, the present 20 invention provides the general ability to control the relative amplitudes of a plurality of signals used in coniunction with a plurality of spatially diverse transducers.

Program 32 or host processor 12 may provide an output signal to cause 25 driver 22 to instruct one or more of sound sources 10 to produce any desired sounds at a selected volume level and to cause driver 22 to create the perception that each sound is located at a specific or diffuse location relative CA 022~86~2 l998-l2-l7 W097/49262 PCTrUS97/10409 to spatial environment 18. Such sound sources 10 are, as an example, shown connected to four couplers 14 which translate signals representative of sounds to the four transducers 16. While four transducers 16 are illustrated, it will be appreciated that the present invention may be practiced with any 5 plural number of transducers 16. Tables 38 and couplers 14 may be selected to provide adequate capacity for the desired number of transducers.

In accordance with one embodiment of the invention, program 32 sends position information regarding the sounds to be produced to driver 22.
10 The position information may specify coordinates in any of many possible formats, for example, two-dimensional Cartesian, three-dimensional Cartesian, polar, cylindrical, spherical, or other well-known geometric coordinate systems. The position information may also specify a particular sector or region defined within the spatial environment. Reference is made 15 to data structure 26 to determine the attenuation parameters that correspond to the specified position information. In one example of a four transducer system, the attenuation parameters include individual attenuation values for each of the left and right, front and rear transducers 16 for dynamically positioning the perceived sound source with respect to the spatial 20 environment. Position information may be designated by program 32, and such position information may be modified by user 20 and controller 30, thereby allowing for interaction between user 20 and the perceived position of the sound sources.

User 20 may operate controller 30. Controller 30 provides an input to host 12. Controller 30 may be a device such as a joystick, a mouse, a gun, a headset, eyeglasses, or some other pointing device, position sensing device, CA 022~86~2 l998- l2- l7 W097/49262 PCT~US97/10409 direction sensing device, or control device configured to provide a position or direction signal to host processor 12 or to program 32, which may be operated by host processor 12. Host processor 12 may be a central processing unit (CPU), such as the CPU of a general purpose computer system or the 5 microcontroller of a special purpose computer system, such as a set top box orarcade game. Host 12 provides a video output signal to video display 34.
Program 32 may provide control of the video output signal provided to video display 34.

Program 32 represents information used in conjunction with host 12 to configure host 12 to perform the desired operations. Program 32 may be a game program, an application program, or information stored in a read only memory (ROM). When program 32 wishes to produce a sound in a spatial environment, program 32 passes information to driver 22. The information 15 passed from program 32 to driver 22 may include information relating to the sound to be produced and the location at which the sound is intended to be perceived. Driver 22 uses information stored in data structure 26. Data structure 26 comprises tables 38. Each of tables 38 provides attenuation parameters based on desired perceived position for a specific spatial 20 configuration. For example, for a table 38 that relates to a circular spatialconfiguration surrounding user 20 horizontally, such a table 38 contains attenuation information for each of transducers 16 to produce sound coming from a perceived position at a plurality of angles surrounding user 20.

A plurality of tables 38 may be provided. Some of tables 38 may be provided by default, allowing program 32 to utilize the default tables without having to specifically configure tables 38. However, program 32 may CA 022~86~2 1998- 12- 17 W097/49262 PCTrUS97/10409 specifically configure one or more of tables 38 to provide desired spatial configurations. Thus, program 32 may use data structure 26 without altering it or may customize data structure 26 as desired.

The invention allows dynamic selection of which of tables 38 iS to be used to produce a given sound. Thus, one of tables 38 may be used to produce a given sound at a first time, while another of tables 38 may be used to produce the sound at a later time. As an example, this feature of the invention may be used to alter the sound being produced if a user directs movement from one environment, such as a first room of a computer game, to another environment, such as a second room of a computer game. Since tables 38 may represent various simulated environments, for example a small room, a large room, an open field, a forest, a tunnel, or some other terrestrial or extraterrestrial environment, the invention affords great realism or even surrealism in the production of sounds.

When program 32 passes sound and position information to driver 22, driver 22 references data structure 26 containing tables 38 to determine the correct attenuation parameters corresponding to the position information received from program 32. Having derived the attenuation parameters from tables 38, driver 22 applies the appropriate attenuation to the sound information before sound is produced at transducers 16.

Driver 22 may process the sound information as received from program 32 to apply the correct attenuation. Driver 22 may use the sound information from program 32 to determine one or more sound sources 10 and may apply the appropriate attenuation at sound sources 10. Driver 22 CA 022~86~2 1998-12-17 WO 97149262 PCTtUS97/10409 may pass sound information from program 32 to sound sources 10, and sound sources 10 may pass digitized sound data to couplers 14. Alternatively, driver 22 may pass digitized sound data directly to couplers 14. Couplers 14 may be signal processing elements, for example digital to analog converters 5 (DACs). Driver 22 may control couplers 14 to provide the appropriate attenuation at couplers 14. Alternatively, driver 22 may control a mixing stage 131 coupled to the output of couplers 14 so as to provide appropriate attenuation at mixing stage 131.

Analog sound signals may be provided directly from couplers 14 to transducer 16, from mixing stage 131 to transducer 16, or from an additional gain stage following mixer 131 to transducer 16. Transducer 16 may be a plurality of loudspeakers positioned at diverse locations with respect to the spatial environment. In an embodiment with four transducers 16, 15 transducer 16 may be placed in a square configuration where each of transducers 16 is at a vertex of a square. Alternatively, transducer 16 may be oriented in any configuration providing adequate spatial diversity. For example, with four transducers 16, transducer 16 may be positioned at the vertices of a rectangle, a trapezoid, a rhombus, or some other polygonal 20 configuration. Such polygons need not be physically realized in any form, but may be merely imaginary shapes having vertices defined by the position of transducer 16.

The gain or efficiency of transducer 16 may be individually controlled 25 so as to alter or compensate for the physical positioning of transducer 16.
Such control over gain or efficiency of individual transducer 16 also allows adjustment of the position of the spatial environments defined according to CA 022~86~2 1998-12-17 data structure 26 relative to the physical locations of transducer 16. Thus, thepresent invention may be readily adapted to any desired listening environment regardless of specific constraints imposed on the physical positioning of transducer 16.

Figure 2 is a plan view diagram illustrating one example of an embodiment of the present invention for providing sound in a circular spatial environment. The circular spatial environment is preferably defined as a plurality of azimuth bearings surrounding user 20 in a horizontal plane.
10 Transducers 16 are preferably positioned in a square configuration or some other polygonal configuration surrounding user 20. Preferably, the center of the spatial environment being defined should be located approximately central to the polygon whose vertices are defined by the positions of transducer 16. When the invention is practiced with spatial environments 15 for which a center is not readily apparent, the geometric centroid of the spatial environment may be determined and will be understood to be a center or to be located within a central region. Alternatively, efficiency or gain adjustments may be made to transducer 16 so as to position the spatial environment as desired.
In one embodiment of a circular sound environment, 128 points are defined to be equally spaced on an imaginary circle surrounding user 20. In this example, point 64 is oriented directly in front of user 20, point 32 is located directly to the left of user 20, point 96 is located directly to the right of 25 user 20, and point 0 is located directly behind user 20. If a sound is desired to be perceived as coming diagonally from the left and behind the user, for example, at point 16, information is derived from table 38 corresponding to CA 022~86~2 1998-12-17 point 16 of the circular spatial environment to provide correct attenuation parameters for the sound produced as transducer 16. Likewise, at table 38 for the circular spatial environment illustrated in Figure 2 contains attenuation parameters for producing sounds with perceived positions from point 0 to 5 point 127 around the circular spatial environment surrounding user 20.

If the configuration of Figure 2 is practiced with four transducers 16, the transducers 16 are designated left front (LF), right front (RF), right rear (RR), and left rear (LR). Table 38 corresponding to this circular spatial 10 environment contains attenuation constants for each of the four transducers 16 (LF, RF, RR, LR). An example of a table 38 for a circular spatial environment is set forth in Table 3 below.

The first column of Table 3 specifies a decimal value for the 15 enumerated position in the circular spatial environment. The second column of Table 3 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left front transducer 16.
The third column of Table 3 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right front transducer 16.20 The fourth column of Table 3 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right rear transducer 16.
The fifth column of Table 3 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left rear transducer 16.
The hexadecimal values of the second through fifth columns of Table 3 are 25 based on a linear attenuation curve having a minimum attenuation corresponding to the hexadecimal value OxFFFF and a maximum attenuation corresponding to the hexadecimal value OxO000. An attenuation level of 6 CA 02258652 l998- l2- l7 dBV down relative to the minimum attenuation level corresponds to a hexadecimal value of Ox8000, and one of 12 dBV down corresponds to Ox4000.

CA 022~86~2 1998-12-17 Position LF RF RR LR
000 Ox07FF Ox07FF Ox9D01 OxA8D8 001 Ox07FF Ox07FF Ox987F OxB05C
002 Ox07FF Ox07FF Ox941D OxB831 003 Ox07FF Ox07FF Ox8FDA OxC05A
004 Ox07FF Ox07FF Ox8BB7 OxC8DA
005 Ox07FF Ox07FF Ox87B2 OxDlB4 006 Ox07FF Ox07FF Ox83CA OxDAEB
007 Ox07FF Ox07FF Ox07FF OxE482 008 Ox07FF Ox07FF Ox5A3F OxE7CA
009 Ox07FF Ox07FF Ox3FFF OxEFlD
010 Ox07FF Ox07FF Ox2DBF OxEE7B
011 Ox07FF Ox07FF Ox20CB OxFlE5 012 Ox07FF Ox07FF Ox173F OxF55A
013 Ox07FF Ox07FF OxOFFF OxF8DA
014 Ox07FF Ox07FF OxOABF OxFC67 015 Ox07FF Ox07FF Ox07FF OxFFFF
016 OxOABF Ox07FF Ox07FF OxFC67 017 OxOFFF Ox07FF Ox07FF OxF8DA
018 Ox173F Ox07FF Ox07FF OxF55A
019 Ox20CB Ox07FF Ox07FF OxFlE5 020 Ox2DBF Ox07FF Ox07FF OxEE7B
021 Ox3FFF Ox07FF Ox07FF OxEBlD
022 Ox583F Ox07FF Ox07FF OxE7CA
023 Ox07FF Ox07FF Ox07FF OxE482 024 Ox83CA Ox07FF Ox07FF OxDAEB
025 Ox87B2 Ox07FF Ox07FF OxDl B4 026 Ox8BB7 Ox07FF Ox07FF OxC8DA
027 Ox8FDA Ox07FF Ox07FF OxC05A
028 Ox941D Ox07FF Ox07FF OxB831 029 Ox987F Ox07FF Ox07FF OxB05C
030 Ox9D01 Ox07FF Ox07FF OxA8D8 031 OxAlA4 Ox07FF Ox07FF OxAlA4 032 OxA8D8 Ox07FF Ox07FF Ox9D01 033 OxB05C Ox07FF Ox07FF Ox987F
034 OxB831 Ox07FF Ox07FF Ox941D
035 OxC05A Ox07FF Ox07FF Ox8FDA
036 OxC8DA Ox07FF Ox07FF Ox8BB7 037 OxDlB4 Ox07FF Ox07FF Ox87B2 038 OxDAEB Ox07FF Ox07FF Ox83CA
039 OxE482 Ox07FF Ox07FF Ox07FF
040 OxE7CA Ox07FF Ox07FF Ox5A3F
041 OxEBlD Ox07FF Ox07FF Ox3FFF

CA 022~86~2 1998-12-17 042 OxEE7B Ox07FF Ox07FF Ox2DBF
043 OxFlE5 Ox07FF Ox07FF Ox20CB
044 OxF55A Ox07FF Ox07FF Ox173F
045 OxF8D A Ox07FF Ox07FF OxOFFF
046 OxFC67 Ox07FF Ox07FF OxOABF
047 OxFFFF Ox07FF Ox07FF Ox07FF
048 OxFC67 OxOABF Ox07FF Ox07FF
049 OxF8D A OxOFFF Ox07FF Ox07FF
050 OxF55A Ox173F Ox07FF Ox07FF
051 OxFlE5 Ox20CB Ox07FF Ox07FF
052 OxEE7B Ox2DBF Ox07FF Ox07FF
053 OxEBlD Ox3FFF Ox07FF Ox07FF
054 Ox37CA Ox5A3F Ox07FF Ox07FF
055 OxE482 Ox07FF Ox07FF Ox07FF
056 OxD AEB Ox83CA Ox07FF Ox07FF
057 OxDlB4 Ox87B2 Ox07FF Ox07FF
058 Oxc8DA Ox8BB7 Ox07FF Ox07FF
059 OxC05A Ox8FDA Ox07FF Ox07FF
060 OxB831 Ox941D Ox07FF Ox07FF
061 Ox505C Ox987F Ox07FF Ox07FF
062 OxA8D8 Ox9D01 Ox07FF Ox07FF
063 OxAlA4 OxAlA4 Ox07FF Ox07FF
064 Ox9D01 OxA8D8 Ox07FF Ox07FF
065 Ox987F OxB05C Ox07FF Ox07FF
066 Ox941D OxB831 Ox07FF Ox07FF
067 Ox8FD A OxC05A Ox07FF Ox07FF
068 Ox8BB7 OxC8DA Ox07FF Ox07FF
069 Ox87B2 OxDlB4 Ox07FF Ox07FF
070 Ox83C A OxD AEB Ox07FF Ox07FF
071 Ox07FF OxE482 Ox07FF Ox07FF
072 Ox5A3F OxE7CA Ox07FF Ox07FF
073 Ox3FFF OxEBlD Ox07FF Ox07FF
074 Ox2DBF OxEE7B Ox07FF Ox07FF
075 Ox20CB OxFlE5 Ox07FF Ox07FF
076 Ox173F OxF55A Ox07FF Ox07FF
077 OxOFFF OxF8DA Ox07FF Ox07FF
078 OxOABF OxFC67 Ox07FF Ox07FF
079 Ox07FF OxFFFF Ox07FF Ox07FF
080 Ox07FF OxFC67 OxOABF Ox07FF
081 Ox07FF OxF8D A Ox07FF Ox07FF
082 Ox07FF OxF55A Ox173F Ox07FF
083 Ox07FF OxFlE5 Ox20CB Ox07FF
084 Ox07FF OxEE7B Ox2DBF Ox07FF
085 Ox07FF OxEBlD Ox3FFF Ox07FF
086 Ox07FF OxE7CA Ox5A3F Ox07FF
087 Ox07FF OxE482 Ox07FF Ox07FF

CA 022~86~2 1998-12-17 W O 97/49262 PCTrUS97/10409 088 Ox07FF OxD AEB Ox83C A Ox07FF
089 Ox07FFOxDlB4 Ox87B2 Ox07FF
090 Ox07FFOxC8DA Ox8BB7 Ox07FF
091 Ox07FFOxC05A Ox8FD A Ox07FF
092 Ox07FFOxB831 Ox941D Ox07FF
093 Ox07FFOxB05C Ox987F Ox07FF
094 Ox07FFOxA8D8 Ox9DOl Ox07FF
095 Ox07FFOxAlA4 OxAlA4 Ox07FF
096 Ox07FFOx9DOl OxA8D8 Ox07FF
097 Ox07FFOx987F OxB05C Ox07FF
098 Ox07FFOx941D OxB831 Ox07FF
099 Ox07FFOx8FDA OxC05A Ox07FF
100 Ox07FFOx87B2 OxC8Da Ox07FF
101 Ox07FFOx87B2 OxDlB4 Ox07FF
102 Ox07FFOx83CA OxD AEB Ox07FF
103 Ox07FFOx7FFF OxE482 Ox07FF
104 Ox07FFOx5A3F OxE7CA Ox07FF
105 Ox07FFOx3FFF OxEBlD Ox07FF
106 Ox07FFOx2DBF OxEE7B Ox07FF
107 Ox07FFOx20CB OxFlE5 Ox07FF
108 Ox07FFOx173F OxF55A Ox07FF
109 Ox07FFOx07FF OxF8D A Ox07FF
110 Ox07FFOxOABF OxFC67 Ox07FF
111 Ox07FFOx07FF OxFFFF Ox07FF
112 Ox07FFOx07FF OxFC67 OxOABF
113 Ox07FFOx07FF OxF8DA Ox07FF
114 Ox07FFOx07FF OxF55A Ox173F
115 Ox07FF-Ox07FF OxFlE5 Ox20CB
116 Ox07FFOx07FF OxEE7B Ox2DBF
117 Ox07FFOx07FF OxEBlD Ox3FFF
118 Ox07FFOx07FF OxE7C A Ox5A3F
119 Ox07FFOx07FF OxE482 Ox7FFF
120 Ox07FFOx07FF OxDAEB Ox83C A
121 Ox07FFOx07FF OxDlB4 Ox87B2 122 Ox07FFOx07FF OxC8DA Ox8BB7 123 Ox07FFOx07FF OxC05A Ox8FD A
124 Ox07FFOx07FF OxB831 Ox941D
125 Ox07FFOx07FF OxB05C Ox987F
126 Ox07FFOx07FF OxA8D A Ox9DOl 127 Ox07FFOx07FF OxAlA4 OxAlA4 The correspondence between the desired attenuation levels for each defined region and the value used to program the sound subsystem (which appears in hexadecimal in the Table 3) may depend upon the type of sound SUtsS 111 IJTE SHEET (RULE 26) CA 022~86~2 1998-12-17 WO 97/49262 PCT/US97tlO409 subsystem used. To obtain the exemplary values provided in Table 3, which are suitable for a linear DAC, dBV values may be converted to linear values by dividing by -20 and raising 10 to the resulting value. This yields the antilogarithm, which cw,es~onds to a linear scale. The final value may be 5 expressed in hexadecimal (as in Table 3), decimal, or any other base or numerical convention.

As a general solution over a limited range for any DAC, a polynomial may be determined that will provide a curve fitting a plurality of data points 10 that correspond to known pairs of values expressing desired sound level and DAC values. For example, if x represents the sound attenuation level in dBV
and y represents the 16-bit value to be used to control the gain or attenuation of the DAC, and if known data points, expressed as (x, y), are (0, 65535), (6, 32768), (12, 16384), (24, 4096), (30, 2048), then a fourth-order polynomial can be 15 solved to provide a curve over the range 0-30 dBV. The polynomial is of the form ax4+bx3+cx2+dx+e=y. When solved using conventional techni~ues, for example linear algebra using Gaussian elimination, the variables are found to have the following values: a~0.10533, b--9.9542, c~380.17, d~-7406.6, and e=65535. Polynomials may be solved for other types of DACs, higher or lower 20 order polynomials may be used, and different numbers of data points may be used.

Figure 3 is a plan view diagram illustrating one embodiment of the present invention having a circular spatial environment where the apparent 25 position of sound sources can be controlled both angularly and radially. To provide control over the radial position of the perceived sound source, the embodiment illustrated in Figure 3 designates a plurality of rings 44. The CA 022~86~2 1998-12-17 WO 97t49262 PCTNS97/10409 innermost ring 44, which is referred to as ring 1, specifies a single point, known as point 0, or a small area approximately central to the spatial environment. The second of rings 44 known as ring 2, surrounds the ring known as ring 1. Likewise, a ring know as ring 3 surrounds ring 2 and a ring 5 known as ring 4 surrounds ring 3. Ring 5 surrounds ring 4 and ring 6 surrounds ring 5. Rings 44 are divided angularly into a plurality of sectors.
These sectors are in one example numbered from 0 to 124. Sector 0 includes all of ring 1. Ring 2 is divided into four sectors, sectors 1-4. Ring 3 is divided into 8 sectors, sectors 5-12. Ring 4 is divided into 16 sectors, sectors 13-28.
10 Ring 5 is divided into 32 sectors, sectors 29-60. Ring 6 is divided into 64 sectors, sector 61-124. Each sector is defined as all points having a radius between two fixed values and a azimuth position between two fixed angular values.

The table 38 corresponding to the spatial environment illustrated in Figure 3 contains attenuation parameters for each of the sectors defined as illustrated in Figure 3. If program 32 passes position information to driver 22 corresponding to the spatial environment illustrated in Figure 3, driver 22 uses the position information to determine the sector in which a sound source is desired to be perceived. When the appropriate sector is identified, the attenuation parameters from the corresponding table 38 are used to attenuate the sound signals provided to each of transducer 16 so as to produce the sensation that a sound source is located within the desired sector.

Various attenuation parameters may be used in conjunction with the spatial environment illustrated in Figure 3. For example, attenuation parameters may be selected so as to provide a constant total power from all CA 022~86~2 1998-12-17 transducers 16. By maintaining constant power independent of position, the relative amplitude of the sound remains the same regardless of position.
Such attenuation parameters are particularly useful if it is desired to maintain a specific amplitude level and to allow sounds to have a wide 5 dynamic range regardless of the desired placement of the sound sources. A
table 38 for such attenuation parameters for the spatial environment illustrated in Figure 3 is set forth in Table 4 below.

The first column of Table 4 specifies a decimal value for the 10 enumerated position in the spatial environment. The second column of Table 4 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left front transducer 16. The third column of Table 4 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right front transducer 16. The fourth 15 column of Table 4 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right rear transducer 16.
The fifth column of Table 4 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left rear transducer 16.
The hexadecimal values of the second through fifth columns of Table 4 are 20 based on a linear attenuation curve having a minimum attenuation colle~onding to the hexadecimal value OxFFFF and a maximum attenuation corresponding to the hexadecimal value OxO000. An attenuation level of 6 dBV down relative to the minimum attenuation level corresponds to a hexadecimal value of Ox8000, and one of 12 dBV down corresponds to Ox4000.

CA 022~86~2 1998-12-17 Position LF RF RR LR
000 Ox71E2 Ox71E2 Ox71E2 Ox71E2 001 Ox6B6F Ox5A3F Ox6B6F Ox87B2 002 Ox87B2 Ox6B6F Ox5A3F Ox6B6F
003 Ox6B6F Ox87B2 Ox6B6F Ox5A3F
004 Ox5A3F Ox6B6F Ox87B2 Ox6B6F
005 Ox5068 Ox5068 Ox87B2 Ox87B2 006 Ox71E2 Ox3FFF Ox71E2 Ox941D
007 Ox87B2 Ox5068 Ox5068 Ox87B2 008 Ox941D Ox71E2 Ox3FFF Ox71E2 009 Ox87B2 Ox87B2 Ox5068 Ox5068 010 Ox71E2 Ox941D Ox71E2 Ox3FFF
011 Ox5068 Ox87B2 Ox87B2 Ox5068 012 Ox3FFF Ox71E2 Ox941D Ox71E2 013 Ox331F Ox331F Ox941D Ox941D
014 Ox331F Ox331F Ox5FA2 OxC5FB
015 Ox331F Ox331F Ox331F OxDE13 016 Ox5FA2 Ox331F Ox331F OxC5FB
017 Ox941D Ox331F Ox331F Ox941D
018 OxC5FB Ox331F Ox331F Ox5FA2 019 OxDE13 Ox331F Ox331F Ox331F
020 OxC5FB Ox5FA2 Ox331F Ox331F
021 Ox941D Ox941D Ox331F Ox331F
022 Ox5FA2 OxC5FB Ox331F Ox331F
023 Ox331F OxDE13 Ox331F Ox331F
024 Ox331F OxC5FB Ox5FA2 Ox331F
025 Ox331F Ox941D Ox941D Ox331F
026 Ox331F Ox5FA2 OxC5FB Ox331F
027 Ox331F Ox331F OxDE13 Ox331F
028 Ox331F Ox331F OxC5FB Ox5FA2 029 OxlA22 OxlA22 OxA8D8 OxA8D8 030 OxlA22 OxlA22 Ox7F10 OxB987 031 OxlA22 OxlA22 Ox5FA2 OxCBC4 032 OxlA22 OxlA22 Ox31B8 OxDCCE
033 OxlA22 OxlA22 OxlA22 OxEF29 034 Ox31B8 OxlA22 OxlA22 OxDCCE
035 Ox5FA2 OxlA22 OxlA22 OxCBC4 036 Ox7F10 OxlA22 OxlA22 OxB987 037 OxA8D8 OxlA22 OxlA22 OxA8D8 038 OxB987 OxlA22 OxlA22 Ox7F10 039 OxCBC4 OxlA22 OxlA22 Ox5FA2 040 OxDCCE OxlA22 OxlA22 Ox31B8 041 OxEF29 OxlA22 OxlA22 OxlA22 CA 022~86~2 1998-12-17 042 OxDCCE Ox31B8 OxlA22 OxlA22 043 OxCBC4 Ox5FA2 OxlA22 OxlA22 044 OxB987 Ox7F10 OxlA22 OxlA22 045 OxA8D8 OxA8D8 OxlA22 OxlA22 046 Ox7F10 OxB987 OxlA22 OxlA22 047 Ox5FA2 OxCBC4 OxlA22 OxlA22 048 Ox31B8 OxDCCE OxlA22 OxlA22 049 OxlA22 OxEF29 OxlA22 OxlA22 050 OxlA22 OxDCCE Ox31B8 OxlA22 051 OxlA22 OxCBC4 Ox5FA2 OxlA22 052 OxlA22 OxB987 Ox7F10 OxlA22 053 OxlA22 OxA8D8 OxA8D8 OxlA22 054 OxlA22 Ox7F10 OxB987 OxlA22 055 OxlA22 Ox5FA2 OxCBC4 OxlA22 056 OxlA22 Ox31B8 OxDCCe OxlA22 057 OxlA22 OxlA22 OxEF29 OxlA22 058 OxlA22 OxlA22 OxDCCE Ox31B8 059 OxlA22 OxlA22 OxCBC4 Ox5FA2 060 OxlA22 OxlA22 OxB987 Ox7F10 061 Ox07FF Ox07FF OxAlA4 OxAlA4 062 Ox07FF Ox07FF Ox987F OxB05C
063 Ox07FF Ox07FF Ox8FDA OxC05A
064 Ox07FF Ox07FF Ox87B2 OxDlB4 065 Ox07FF Ox07FF Ox07FF OxE482 066 Ox07FF Ox07FF Ox3FFF OxEBlD
067 Ox07FF Ox07FF Ox20CB OxFlE5 068 Ox07FF Ox07FF Ox07FF OxF8DA
069 Ox07FF Ox07FF Ox07FF OxFFFF
070 OxOFFF Ox07FF Ox07FF OxF8DA
071 OxOFFF Ox07FF Ox07FF OxF8DA
072 Ox3FFF Ox07FF Ox07FF OxEBlD
073 Ox07FF Ox07FF Ox07FF OxE482 074 Ox87B2 Ox07FF Ox07FF OxDlB4 075 Ox8FDA Ox07FF Ox07FF OxC05A
076 Ox987F Ox07FF Ox07FF OxB05C
077 OxAlA4 Ox07FF Ox07FF OxAlA4 078 OxB05C Ox07FF Ox07FF Ox987F
079 OxC05A Ox07FF Ox07FF Ox8FDA
080 OxDlB4 Ox07FF Ox07FF Ox87B2 081 OxE482 Ox07FF Ox07FF Ox7FFF
082 OxEBlD Ox07FF Ox07FF Ox3FFF
083 OxFlE5 Ox07FF Ox07FF Ox20CB
084 OxF8Da Ox07FF Ox07FF OxOFFF
085 OxFFFF Ox07FF Ox07FF Ox07FF
086 OxF8Da OxOFFF Ox07FF Ox07FF
087 OxFlE5 Ox20CB Ox07FF Ox07FF

. ~.. . . ..

CA 022~86~2 1998-12-17 088 0xEBlD 0x3FFF 0x07FF 0x07FF
089 0xE482 0x7FFF 0x07FF 0x07FF
090 0xDlB4 0x77B2 0x07FF 0x07FF
091 0xC05A 0x8FDA 0x07FF 0x07FF
092 0xB05C 0x987F 0x07FF 0x07FF
093 0xAlA4 0xAlA4 0x07FF 0x07FF
094 0x987F 0xB05C 0x07FF 0x07FF
095 0x8FDA 0xC05A 0x07FF 0x07FF
096 0x87B2 0xDlB4 0x07FF 0x07FF
097 0x7FFF 0xE482 0x07FF 0x07FF
098 0x3FFF 0xEBlD 0x07FF 0x07FF
099 0x20CB 0xFlE5 0x07FF 0x07FF
100 0x0FFF 0xF8DA 0x07FF 0x07FF
101 0x07FF 0xFFFF 0x07FF 0x07FF
102 0x07FF 0xF8DA 0x0FFF 0x07FF
103 0x07FF 0xFlE5 0x20CB 0x07FF
104 0x07FF 0xEBlD 0x3FFF 0x07FF
105 0x07FF 0xE482 0x7FFF 0x07FF
106 0x07FF 0xDlB4 0x87B2 0x07FF
107 0x07FF 0xC05A 0x8FDA 0x07FF
108 0x07FF 0xB05C 0x987F 0x07FF
109 0x07FF 0xAlA4 0xAlA4 0x07FF
110 0x07FF 0x987F 0xB05C 0x07FF
111 0x07FF 0x8FDA 0xC05A 0x07FF
112 0x07FF 0x87B2 0xDlB4 0x07FF
113 0x07FF 0x07FF 0xE482 0x07FF
114 0x07FF 0x3FFF 0xEBlD 0x07FF
115 0x07FF 0x20CB 0xF185 0x07FF
116 0x07FF 0x07FF 0xFFFF 0x07FF
117 0x07FF 0x07FF 0xFFFF 0x07FF
118 0x07FF 0x07FF OxF8Da 0x0FFF
119 0x07FF 0x07FF 0xFlE5 0x20CB
120 0x07FF 0x07FF 0xEBlD 0x3FFF
121 0x07FF 0x07FF 0xE482 0x7FFF
122 0x07FF 0x07FF 0xDlB4 0x87B2 123 0x07FF 0x07FF 0xC05A 0x8FDA
124 0x07FF 0x07FF 0xB05C 0x987F

Other attenuation parameters may be used with the spatial 40 environment illustrated in Figure 3. For example, attenuation parameters may be configured so as to result in greater amplitude and corresponding sound pressure level for sounds perceived as being closer to user 20 and CA 022~86~2 1998-12-17 lesser in amplitude and corresponding sound pressure level for sounds - perceived as being farther from user 20. In such case, the sound pressure level decreases with increasing radius from the user 20. The relationship between radius and sound pressure level may be adjusted to provide the 5 desired psychoacoustic effects.

Figure 5 is a three-dimensional diagram illustrating sound pressure levels with respect to perceived position in a circular spatial environment for one example of an acoustic effect produced by selecting attenuation 10 parameters that result in a sound pressure level varying with radius. A
plane defined by the x and z axis represents a spatial environment, for example the circular spatial environment illustrated in Figure 3. If the circular spatial environment of Figure 3 is used, point 0 in ring 1 is represented by the intersection of the x axis and z axis. The y axis represents 15 the sound pressure level for each spatial position in the (x, z) plane. Thus,for the attenuation parameters represented by the 3 dimensional graph of Figure 5, sound sources have a higher sound pressure level when nearer to the y axis and a lower sound pressure level as there radius in the (x, z) plane increases. Table 5 below provides an example of attenuation parameters that 20 may be used to provide increased sound pressure level with decreased radius and decreased sound pressure level with increased radius.

The first column of Table 5 specifies a decimal value for the enumerated position in the spatial environment. The second column of 25 Table 5 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left front transducer 16. The third column of Table 5 specifies a hexA~lerinlal value representative of attenuation to be CA 022~86~2 1998-12-17 applied to the signal provided to a right front transducer 16. The fourth column of Table 5 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right rear transducer 16.
The fifth column of Table 5 specifies a hexadecimal value representative of 5 attenuation to be applied to the signal provided to a left rear transducer 16.The hexadecimal values of the second through fifth columns of Table 5 are based on a linear attenuation curve having a minimum attenuation corresponding to the hexadecimal value OxFFFF and a maximum attenuation corresponding to the hexadecimal value OxO000. An attenuation level of 6 10 dBV down relative to the minimum attenuation level corresponds to a hexadecimal value of Ox8000, and one of 12 dBV down corresponds to Ox4000.

CA 022~86~2 1998-12-17 Position LF RF RR LR
000 OxB58B OxB58B OxB58B OxB58B
001 OxB58B Ox8FDA OxB58B OxC05A
002 OxC05A OxB58B Ox8FDA OxB58B
003 OxB58B OxC05A OxB58B Ox8FDA
004 Ox8FDA OxB58B OxC05A OxB58B
005 Ox7FFF Ox7FFF OxB58B OxB58B
006 Ox8FDA Ox71E2 Ox8FDA OxCBC4 007 OxB58B Ox7FFF Ox7FFF OxB58B
008 OcCBC4 Ox8FDA Ox71E2 Ox8FDA
009 OxB58B OxB58B Ox7FFF Ox7FFF
010 Ox8FDA OxCBC4 Ox8FDA Ox71E2 011 Ox7FFF OxB58B OxB58B Ox7FFF
012 Ox71E2 Ox8FDA OxCBC4 Ox8FDA
013 Ox5068 Ox5068 OxB58B OxB58B
014 Ox5068 Ox5068 Ox71E2 OxDlB4 015 Ox5957 Ox5068 OxS068 OxE482 016 Ox71E2 Ox5068 Ox5068 OxDlB4 017 OxB58B Ox5068 Ox5068 OxB58B
018 OxDlB4 Ox5068 Ox5068 Ox71E2 019 OxE482 Ox5068 Ox5068 Ox5068 020 OxDlB4 Ox71E2 Ox5068 Ox5068 021 OxB58b OxB58B Ox5068 Ox5068 022 Ox71E2 OxDlB4 Ox5068 Ox5068 023 Ox5068 OxE482 Ox5068 Ox5068 024 Ox5068 OxDlB4 Ox71E2 Ox5068 025 Ox5068 OxB58B OxB58B Ox5068 026 Ox5068 Ox71E2 OxDlB4 Ox5068 027 Ox5068 Ox5068 OxE482 Ox5068 028 Ox5068 Ox5068 OxDlB4 Ox71E2 029 Ox2DBF Ox2DBF OxB58B OxB58B
030 Ox2DBF Ox2DBF Ox987F OxC5FB
031 Ox2BF Ox2DBF Ox7FFF OxD7CF
032 Ox2DBF Ox2DBF Ox4BEB OxE482 033 Ox2DBF Ox2DBF Ox2DBF OxFlE5 034 Ox4BEB Ox2DBF Ox2DBF OxE482 035 Ox7FFF Ox2DBF Ox2DBF OxD7CF
036 Ox987F Ox2DBF Ox2DBF OxC5FB
037 OxB58B Ox2DBF Ox2DBF OxB58B
038 OxC5FB Ox2DBF Ox2DBF Ox987F
039 OxD7CF Ox2DBF Ox2DBF Ox7FFF
040 OxE482 Ox2DBF Ox2DBF Ox4BEB
041 OxFlE5 Ox2DBF Ox2DBF Ox2DBF

CA 022~86~2 1998-12-17 042 OxE482 Ox4BEB Ox2DBF Ox2DBF
043 OxD7CF Ox7FFF Ox2DBF Ox2DBF
044 OxC5FB Ox987F Ox2DBF Ox2DBF
045 OxB58B OxB58B Ox2DBF Ox2DBF
046 Ox987F OxC5FB Ox2DBF Ox2DBF
047 Ox7FFF OxD7CF Ox2DBF Ox2DBF
048 Ox4BEB OxE482 Ox2DBF Ox2DBF
049 Ox2DBF OxFlE5 Ox2DBF Ox2DBF
050 Ox2DBF OxE482 Ox4BEB Ox2DBF
051 Ox2DBF OxD7CF Ox7FFF Ox2DBF
052 Ox2DBF OxC5FB Ox987F Ox2DBF
053 Ox2DBF OxB58B OxB58B Ox2DBF
054 Ox2DBF Ox987F OxC5FB Ox2DBF
055 Ox2DBF Ox7FFF OxD7CF Ox2DBF
056 Ox2DBF Ox4BEB OxE482 Ox2DBF
057 Ox2DBF Ox2DBF OxFlE5 Ox2DBF
058 Ox2DBF Ox2DBF OxE402 Ox4BEB
059 Ox2DBF Ox2DBF OxD7CF Ox7FFF
060 Ox2DBF Ox2DBF OxC5FB Ox987F
061 Ox07FF Ox07FF OxB58B OxB58B
062 Ox07FF Ox07FF OxA669 OxC05A
063 Ox07FF Ox07FF Ox987F OxCBC4 064 Ox07FF Ox07FF Ox8BB7 OxD7CF
065 Ox07FF Ox07FF Ox7FFF OxE482 066 Ox07FF Ox07FF Ox3FFF OxEB10 067 Ox07FF Ox07FF Ox20CB OxFlE5 068 Ox07FF Ox07FF OxOFFF OxF8DA
069 Ox07FF Ox07Ff Ox07Ff OxFFFF
070 OxOFFF Ox07FF Ox07FF OxF8DA
071 Ox20C8 Ox07FF Ox07FF OxFlE5 072 Ox3FFF Ox07FF Ox07FF OxE81D
073 Ox7FFF Ox07FF Ox07FF OxE482 074 Ox8BB7 Ox07FF Ox07FF OxD7CF
075 Ox987F Ox07FF Ox07FF OxCBC4 076 OxA669 Ox07FF Ox07FF OxC05A
077 OxB58B Ox07FF Ox07FF OxB58B
078 OxC05A Ox07FF Ox07FF OxA669 079 OxCBC4 Ox07FF Ox07FF Ox987F
080 OxD7Cf Ox07FF Ox07FF Ox8B57 081 OxE482 Ox07FF Ox07FF Ox07FFF
082 OxEBlD Ox07FF Ox07FF Ox3FFF
083 OxFlE5 Ox07FF Ox07FF Ox20CB
084 OxF8DA Ox07FF Ox07FF OxOFFF
085 OxOFFFF Ox07FF Ox07FF Ox07FF
086 OxF8DA OxOFFF Ox07FF Ox07FF
087 OxFlE5 Ox20CB Ox07FF Ox07FF

CA 022~86~2 1998-12-17 088 OxEBlD Ox3FFF Ox07FF Ox07FF
089 OxE482 Ox7FFF Ox07FF Ox07FF
090 OxD7CF Ox8BB7 Ox07FF Ox07FF
091 OxCBC4 Ox987F Ox07FF Ox07FF
092 OxC05A OxA669 Ox07FF Ox07FF
093 OxB58B OxB58B Ox07FF Ox07FF
094 OxA669 OxC05A Ox07FF Ox07FF
095 Ox987F OxCBC4 Ox07FF Ox07FF
096 Ox8BB7 OxD7CF Ox07FF Ox07FF
097 Ox7FFF OxE482 Ox07FF Ox07FF
098 Ox3FFF OxEBlD Ox07FF Ox07FF
099 Ox20CB OxFlE5 Ox07FF Ox07FF
100 OxOFFF OxF8DA Ox07FF Ox07Ff 101 Ox07FF OxFFF Ox07FF Ox07FF
102 Ox07FF OxF8DA OxOFFF Ox07FF
103 Ox07Ff OxFlE5 Ox20CB Ox07FF
104 Ox07FF OxEBlD Ox3FFF Ox07FF
105 Ox07FF OxE402 Ox7FFF Ox07FF
106 Ox07FF OxD7CF Ox8BB7 Ox07FF
107 Ox07FF OxCBC4 Ox987F Ox07FF
108 Ox07FF OxC05A OxA669 Ox07FF
109 Ox07FF OxB58B OxB58B Ox07FF
110 Ox07FF OxA669 OxC05A Ox07FF
111 Ox07FF Ox987F OxCBC4 Ox07FF
112 Ox07FF Ox8BB7 OxD7CF Ox07FF
113 Ox07FF Ox7FFF OxE482 Ox07FF
114 Ox07FF Ox3FFF OxEBlD Ox07FF
115 Ox07FF Ox20CB OxFlE5 Ox07FF
116 Ox07FF OxOFFF OxF8DA Ox07FF
117 Ox07FF Ox07FF OxFFFF Ox07FF
118 Ox07FF Ox07FF OxF8DA OxOFFF
119 Ox07FF Ox07FF OxFlB5 Ox20CB
120 Ox07FF Ox07FF OxEBlD Ox3FFF
121 Ox07FF Ox07FF OxE482 Ox7FFF
122 Ox07FF Ox07FF OxD7CF Ox98B7 123 Ox07FF Ox07FF OxCBC4 Ox987F
124 Ox07FF Ox07FF OxC05A OxA669 The relationship between radius and sound pressure level may be 40 varied. Figure 6 is a three-dimensional diagram illustrating sound pressure levels with respect to perceived position for one embodiment of the present invention. The embodiment of Figure 6 differs from that of Figure 5 in its CA 022~86~2 1998-12-17 relationship between radius and sound pressure level. Figure 6 iS
approximately conically shaped, while Figure 5 has more of a funnel shape.
Figure 6 also plots the sound pressure level along the y axis for each point on the (x, z) plane. The (x, z) plane represents the spatial environment, for 5 example, the circular spatial environment illustrated in Figure 3. Many other configurations are also possible according to the present invention. For example, attenuation parameters could be selected so as to result in a diagram similar to Figure 5 or Figure 6, but with a convex surface, for example an approximately hemispherical graph. Alternatively, the direction of the y axis 10 in any of these graphs could be reversed so as to result in a sound source that having a higher sound pressure level at a greater radius in a lower sound pressure level at a lesser radius. Thus, the present invention provides both a technique for simulating perceptions naturally associated with the positioning of a sound source as well as a technique for synthesizing unusual 15 sound effects that may have no natural analogy.

Figure 7 is a three-dimensional diagram illustrating sound pressure level with respect to perceived position for one embodiment of the present invention. Figure 7 illustrates a spatial environment distributed over a 20 portion of the (x, z) plane and attenuation parameters providing sound pressure levels plotted along the y axis. As can be seen from the graph, the maximum sound pressure level is found along the z axis, and the sound pressure level diminishes along the positive and negative directions of the x axis. The relationship between sound pressure level and the x component of 25 position may be adjusted by selecting attenuation parameters to provide the desired effects. A configuration such as that illustrated in Figure 7 is useful for simulating the acoustics of a hallway or tunnel, where sound is reflected CA 022~86~2 1998-12-17 and ducted along the axis of the hallway of tunnel, but attenuated off to the sides of the hallway or tunnel.

Figure 4 is a three-dimensional diagram illustrating sound pressure 5 level with respect to perceived position in a spatial environment defined in the (x, z) plane for one embodiment of the present invention. For example, the spatial environment defined in the (x, z) plane may be the circular spatial environment of Figure 3. The sound pressure level is plotted with respect to the y axis. As can be seen from the graph, the sound pressure level remains 10 constant over the defined spatial environment.

In the spatial environment illustrated in Figure 3, user 20 is preferably located at point 0 in ring 1 of the spatial environment. However, the present invention avoids disadvantages of prior art techniques by allowing user 20 to 15 deviate from point 0 and by allowing multiple users 20 to be present at various points within the spatial environment. Even with variation in the location of user 20 or with multiple users 20, the present invention provides the desired perception of sound positioning.

Figure 8 is a plan view diagram illustrating an embodiment of the present invention allowing control of the perceived radial and angular positioning of a sound source. If position information is limited to specific radial and angular locations, a table 38 may be constructed to provide attenuation parameters for those specific radial and angular locations. In Figure 8, the radial component is represented by p and the angular component is represented by ~.

CA 022~86~2 1998-12-17 Figure 9 is a three dimensional graph illustrating an example of one embodiment of the present invention where sound pressure level varies over a rectilinear spatial environment. The rectilinear spatial environment is illustrated as a portion of the (x, z) plane and sound pressure level is 5 illustrated along the y axis. As can be seen from the graph, the sound pressure level increases with proximity to the origin in the (x, z) plane and decreases with distance from the origin in the (x, z) plane. The attenuation parameters represented in Figure 9 result in the sound pressure level of a perceived sound source being naturally louder when the source is nearer to 10 user 20 and naturally quieter when the sound source is farther from user 20.

Figure 10 is a diagram illustrating gain curves for one embodiment of the present invention. Curve 1001 represents the power to be applied to the left back transducer 16. Curve 1002 represents the power to be applied to the 15 left front transducer 16. Curve 1003 represents the power to be applied to the right front transducer 16. Curve 1004 represents the power to be applied to the right back transducer 16. The direction at which the sound source is to be perceived is indicated in degrees with 0 degrees being directly in front of user20, a positive offset being to the right of user 20, and a negative offset being to 20 the left of user 20. Thus minus 180~ and plus 180~ both represent the angularposition directly behind user 20. As can be seen from curve 1001, if it is desired for a sound source to be perceived at minus 135~, a power level of 0 dB is applied to left back transducer 16. If it is desired to have the sound source perceived to be a minus 45~, a power level of zero decibels is applied to25 left front transducer 16. If it is desired for the sound source to be perceived at minus 90~ (directly to the left of the user 20), a power level of minus 3 dB is applied to each of left back transducer 16 and left front transducer 16. If the CA 022~86~2 1998-12-17 sound source is desired to appear at negative 67.5~, a power level of minus 1 dB is applied to left front transducer 16 and a power level of minus 6 dB is applied to left back transducer 16. As can be seen from the graph, curves 1001, 1002, 1003, and 1004 are identical but shifted 90~ to the right from the 5 previous curve, reflecting the preferred spacing transducer of 16 of 90~ with respect to each other.

Curves 1005, 1006, 1007, and 1008 represent the power levels to applied to transducers 16 to provide a perceived sound position allowing a circle 10 lying between the circle defined by power curves 1001, 1002, 1003, 1004 and the center of the spatial environment. To make a sound source appear in a angular position of minus 135~ along this smaller concentric circle, a power level of minus 1 dB is provided to the left back transducer 16 and a power level of minus 10 dB is provided to each of left front transducer 16 and right 15 back transducer 16. If a sound is to be perceived at a angular position of minus 90~ along this circle, a power level of minus 3 dB is provided to each of left back transducer 16 and left front transducer. Curves 1005, 1006, 1007, and 1008 are identical but shifted 90~ to the right of the previous curve to reflect the preferred 90~ spacing between transducer 16.
To make a sound appear to be centered within the spatial environment, a power level of minus 6 dB is applied to each of the left back, left front, right front and right back transducers 16.

Figure 11 is a perspective view diagram of one embodiment of the present invention. In this embodiment, transducers 16 are spatially distributed in three dimensions surrounding user 20. Although four CA 022~86~2 l998- l2- l7 W097/49262 PCTr~S97/10409 transducers 16 are illustrated as being located above a horizontal plane intersecting user 20 and four transducers 16 are illustrated as being located below a horizontal plane intersecting user 20, the present invention may also be practiced with other numbers of transducer 16 located in other three 5 dimensional spatial configurations. Transducer 16 may be located at the vertices of an imaginary cube or rectangular solid or some other spatially diverse three dimensional configuration with user 20 located within the spatial environment defined by the placement of transducer 16, preferably approximately central to such spatial environment.
Figure 12 iS a plan view diagram illustrating one embodiment of the present invention having a rectilinear spatial environment. The spatial environment of Figure 12 iS divided into nine regions. The nine regions are arranged in a three by three rectilinear pattern. Region 1200 iS centrally 15 located. Region 1204 is located in front of region 1200. Region 1208 iS located behind region 1200. Region 1202 is located to the left of region 1200. Region 1206 is located to the right of region 1200. Region 1203 is located in front of and to the left of region 1200. Region 1205 is located in front of and to the right of 1200. Region 1201 is located behind and to the left of region 1200.
20 Region 1207 iS located behind and to the right of region 1200. User 20 is preferably located in region 1200, although the present invention may also be practiced with user 20 in some other region or with multiple users 20 in various regions. Transducers 16 are illustrated as being located peripheral to regions 1203,1205,1201, and 1207. Transducer 16 may be located differently 25 with respect to the regions, for example peripheral to regions 1204,1202,1206 and 1208.

CA 022~86~2 1998-12-17 A table 38 is constructed according to the present invention with attenuation parameters corresponding to each of the regions illustrated in Figure 12. When it is desired to produce a sound intended to give the perception of being located in a particular region, the attenuation parameters 5 for that region are retrieved from the col.e~lJonding table 38 and used to program the attenuation of the sound subsystem. Thus, for example to make a sound seem to be located in region 1203, attenuation parameters from a corresponding table 38 are supplied to a sound subsystem that controls the attenuation of the sound signals before they are converted to an audible form 10 by transducers 16. To make a sound source appear to be located in region 1203, attenuation would be reduced for the sound produced by transducer 16 located approximate to region 1203, while attenuation would be increased for other transducers 16 located distinct to region 1203. Table 6 below provides an example of attenuation parameters for a table 38 that may be used in 15 conjunction with the spatial environment illustrated in Figure 12. Position 000 corresponds to region 1200, position 001 to region 1201, position 002 to region 1202, position 003 to region 1203, and so on through position 009, which corresponds to region 1209.

One embodiment based on Figure 12 may be used in configurations where region 1200 is designated as the origin, having the coordinates (0,0).
For example, region 1201 may comprise negative x and negative y coordinates (e.g., (-x,-y)). Region 1202 may comprise negative x and zero y coordinates (e.g., (-x,0)). Region 1203 may comprise negative x and positive y coordinates (e.g., (-x,+y)). Region 1204 may comprise zero x and positive y coordinates (e.g., (0,+y)). Region 1205 may comprise positive x and positive y coordinates (e.g., (+x,+y)). Region 1206 may comprise positive x and zero y coordinates CA 022~86~2 1998-12-17 (e.g., (+x,0)). Region 1207 may comprise positive x and negative y coordinates (e.g., (+x, -y)). Region 1208 may comprise zero x and negative y coordinates (e.g., (0,-y)).

For such an embodiment, an appropriate region may be determined simply using conditional tests. Conditional tests may be used to determine if the x and y coordinates are positive, zero, or negative. The results of these tests for both the x and y coordinates yield the appropriate region.

Such an embodiment may be used to provide compatibility with existing geometric conventions. Such compatibility may be referred to as "legacy support."

The first column of Table 6 specifies a decimal value for the enumerated position in the circular spatial environment. The second column of Table 6 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left front transducer 16.
The third column of Table 6 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right front transducer 16.The fourth column of Table 6 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a right rear transducer 16.
The fifth column of Table 6 specifies a hexadecimal value representative of attenuation to be applied to the signal provided to a left rear transducer 16.
The hexadecimal values of the second through fifth columns of Table 6 are based on a linear attenuation curve having a minimum attenuation corresponding to the hexadecimal value OxFFFF and a maximum attenuation corresponding to the hexadecimal value OxO000. An attenuation level of 6 CA 022~86~2 l998-l2-l7 dBV down relative to the minimum attenuation level corresponds to a hexadecimal value of Ox8000, and one of 12 dBV down corresponds to Ox4000.

Position LF RF RR LR
000 Ox71E2 Ox71E2 Ox71E2 Ox71E2 001 OxOOOO OxOOOO OxOOOO OxOOOO
002 OxAlA4 OxO000 OxO000 OxAlA4 003 OxFFFF OxO000 OxO000 OxO000 004 OxAlA4 OxAlA4 OxO000 OxO000 005 OxO000 OxFFFF OxO000 OxO000 006 OxO000 OxAlA4 OxAlA4 OxO000 007 OxO000 OxO000 OxFFFF OxO000 008 OxO000 OxO000 OxAlA4 OxAlA4 Figure 13 is a plan view diagram of one embodiment of the present invention having a rectilinear spatial environment. The spatial environment of Figure 13 comprises 25 regions arranged in a five by five rectilinear configuration. Region 1300is located central to the spatial environment. Region 1301is located behind and to the left of region 1300.
Region 1302is located to the left 1300. Region 1303 is located in front of and to the left of region 1300. Region 1304is located in front of region 1300.
Region 1305is located in front of and to the right of region 1304. Region 1306 is located to the right of region 1300. Region 1307is located to the right and behind region 1300. Region 1308is located behind region 1300.

Region 1309is located behind and to the left of region 1301. Region 30 1310is located to the left of region 1301. Region 1311is located to the left of region 1302. Region 1312is located to the left of region 1303. Region 1313is located in front of and to the left of region 1303. Region 1314is located in CA 022~86~2 l998- l2- l7 front of region 1303. ~egion 1315 is located is front of region 1304. Region 1316 iS located in front of region 1305. Region 1317 is located in front and to the right of region 1305. Region 1318 is located to the right of region 1305.
Region 1319 iS located to the right of region 1306. Region 1320 iS located to 5 the right of region 1307. Region 1321 iS located to the right and behind region 1307. Region 1322 is located behind region 1307. Region 1323 is located behind region 1308. Region 1324 is located behind region 1301.

User 20 iS preferably located in region 1300, although user 20 may be 10 located in another region or multiple users 20 may be located in various regions. Transducers 16 are illustrated as being located peripheral regions 1313,1317,1309, and 1321. The present invention may also be practiced with different numbers of transducers 16 and with transducers 16 located in different positions relative to regions 1300-1324.
Figure 14 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional rectilinear spatial environment. The spatial environment illustrated in Figure 14 comprises 27 three dimensional regions 1400-1426. The regions are arranged in a three by 20 three by three cubic configuration.

Region 1400 is centrally located. Region 1401 is located behind and to the left of region 1400. Region 1402 is located to the left of region 1400.
Region 1403 iS located in front of and to the left of region 1400. Region 1404 is 25 located in front of region 1400. Region 1405 is located in front and to the right of region 1400. Region 1406 is located to the right of region 1400. Region 1407 CA 022~86~2 1998-12-17 is located behind and to the right of region 1400. Region 1408 is located behind region 1400.

Region 1409 is located above region 1400. Region 1410 is located above 5 region 1401. Region 1411 is located above region 1402. Region 1412 is located above region 1403. Region 1413 is located above region 1404. Region 1414 is located above region 1405. Region 1415 is located above region 1406. Region 1416 is located above region 1407. Region 1417 is located above region 1408.

Region 1418 is located below region 1400. Region 1419 is located below region 1401. Region 1420 is located below region 1402. Region 1421 is located below region 1403. Region 1422 is located below region 1404. Region 1423 is located below region 1405. Region 1424 is located below region 1406. Region 1425 is located below region 1407. Region 1426 is located below region 1408.
User 20 is preferably located in region 1400, although user 20 may be located in another region or multiple users 20 may be located in various regions. Transducers 16 are preferably located peripheral regions 1410, 1412, 1414, 1416, 1419, 1421, 1423, and 1425. The present invention may be practiced 20 with other numbers of transducers 16 or with transducers located differently relative to regions 1400-1426.

Figure 15 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional rectilinear spatial 25 environment. The spatial environment of Figure 15 comprises 125 three dimensional regions. These regions are arranged in a five by five by five cubic configuration. User 20 is preferably located in the central region, CA 022~86~2 l998-l2-l7 W O 97/49262 PCTrUS97/10409 although user 20 may be located in another region or multiple users 20 may be located in various regions. Transducers 16 are illustrated as being located peripheral to the regions at the vertices of the five by five by five cubic configuration. The present invention may also be practiced with different numbers of transducers 16 and with transducers 16 located in different positions relative to the spatial environment.

A table 38 is constructed containing attenuation parameters for each of the 125 regions defined in Figure 15. For example, with 8 transducers 16, a 10 table 38 may be constructed having 125 rows and 8 columns. Each row corresponds to a particular region of the spatial environment, while each column provides an attenuation constant for each of the 8 transducers 16.
When spatial coordinates are provided to designate a location relative to user 20 at which a sound source is desired to be perceived, the region to which those spatial coordinates correspond is identified. The attenuation parameters corresponding to the appropriate region are determined from the corresponding table 38. The attenuation parameters are used to control the signal levels applied to each of transducers 16. By appropriately controlling the signal levels supplied to transducer 16, the perceived location of the 20 sound source may be accurately controlled within the spatial environment.
The present invention may be used to simultaneously control the apparent positioning of multiple sound sources in various regions throughout the spatial environment.

Figure 16 is a perspective view diagram illustrating one embodiment of the present invention having a three dimensional spatial environment.
The spatial environment is defined according to cylindrical coordinates.

CA 022~86~2 1998-12-17 These coordinates are designated by specifying a radial component p, and angular component ~, and a height component h. While the third component is referred to as a height coordinate, it may have any spatial orientation including but not limited to vertical. The spatial environment of 5 Figure 16 is divided into a plurality of regions wherein each region contains all points having a radial component between a minimum radially component for that region and a maximum radial component for that region, an angular component between a minimum angular component for that region and a maximum angular for that region, and a height component 10 between a minimum height component and a maximum height component for that region. Transducers 16 are illustrated as being located peripheral to regions having maximal radial and height components for the spatial environment and equally spaced angular components over the full range of possible angular components. Transducers 16 are also located with similar 15 spacing peripheral to similar locations having a minimal height component for the spatial environment. The invention may also be practiced with other numbers of transducers 16 and with transducer 16 located at different positions with respect to the spatial environment.

Moreover, a spatial environment may be defined based on a combination of a plurality of other spatial environments. For example, an embodiment such as that illustrated in Figure 5 may be combined with an embodiment such as one illustrated in Figure 3 or 4 either above or below it to yield another embodiment of a three dimensional spatial environment according to the present invention. Furthermore, an embodiment such as that illustrated in Figure 7 may be translated in the (x,z) plane to give a listener a sensation of moving from one type of spatial environment, for CA 022~86~2 1998-12-17 example one representative of a room, to another type of spatial environment, for example, one representative of a hallway or tunnel.

Figure 17 is a perspective view diagram illustrating an embodiment of 5 the present invention having a three dimensional spherical spatial environment. The spherical spatial environment is defined in terms of a radial component p, an angular azimuth component ~ and an angular elevation component ~. The spatial environment is divided into a plurality of regions where each region contains all points having a radial component 10 between a minimum radial component for that region and a maximum radial component for that region, an angular azimuth component between a minimum angular azimuth component for that region and a maximum angular azimuth component for that region, and an angular elevation component between a minimum angular elevation component for that 15 region and a maximum angular elevation component for that region.

User 20 is preferably located at the center of the spherical spatial environment, although user 20 may be located at some other point within the spherical spatial environment or multiple users 20 may be located at 20 various points within the spherical spatial environment. Transducer 16 are illustrated as being located at the vertices of an imaginary cube peripheral to the spherical spatial environment. However, transducers 16 may be located at other positions with respect to the spherical spatial environment and different numbers of transducer 16 may be employed.
As an example, the spherical spatial environment of Figure 17 may be practiced in conjunction with a virtual reality cage that allows user 20 to CA 022~86~2 l998- l2- l7 W097/49262 PCTrUS97/10409 undergo motion about a plurality of axes. User 20 experiences psychoacoustic effects in combination with motion and optional visual effects. These effects are combined to induce in user 20 the intended sensations.

Figure 18 iS a flow diagram illustrating one embodiment of a process according to the present invention. The process begins at step 1801. From step 1801, the process proceeds to step 1802. In step 1802, the process initializes the sound subsystem. All hardware components of the system use to produce sound are placed in a known state and prepared for the production of sound. From step 1802, the process continues to step 1803. In step 1803, the process determines the number of speakers to be used in the system. From step 1803, the process continues to step 1804. In step 1804, the process determines the number possible positions defined within the spatial environment. From step 1804, the process continues to step 1805. In step 1805, the process selects one or more spatial environments to be used with the system. The spatial environments may be selected from default spatial environments that may be preloaded or arbitrary spatial environments may be specifically defined. From step 1805, the process continues at step 1806. At step 1806, the process generates tables for the selected spatial environments.
Each table contains attenuation parameters for each transducer 16 for each region defined within the spatial environment. From step 1806, the process continues in reference to step A 1807. Reference step A 1807 is used to provide reference for other flow charts illustrated in other figures.

Figure 19 is a flow diagram that is a continuation of the flow diagram illustrated in Figure 18. The process continues from reference step A 1807 to step 1901. In step 1901, the process performs steps of a application program.

CA 022~86~2 1998-12-17 These steps may include the updating of position information associated with objects defined in the application program. For example, the application program may be a computer game program in which a player interacts with various objects at various locations relative to the player. As the game is 5 played, the relative locations of the various objects may be dynamically updated. If the objects are intended to be perceived as producing sounds the locations of the objects may be specified and updated so that the present invention may be able to cause the perception that the sounds are being produced at the corresponding locations.
From step 1901, the process continues to step 1902. In step 1902, the process prepares graphic images. The graphic images may be used to provide a graphic representation of the objects corresponding to the sound sources intended to be perceived at specific locations within the spatial environment.
15 From step 1902, the process continues to step 1903. In step 1903, tables are selected for the appropriate spatial environments to be used for producing sounds. From step 1903, the process continues to step 1904. In step 1904, the process identifies position information relating to sounds to be produced.
From step 1904, the process continues to step 1905. In step 1905, the process 20 obtains attenuation parameters from the tables selected in 1903. From step 1905, the process continues to step 1906. In step 1906 the process provides the attenuation parameters to the sound subsystem.

From step 1906, the process continues in step 1907. In step 1907, the 25 process plays the sounds using the sound subsystem. From step 1907, the process continues in step 1908. In step 1908, the process updates the graphic images. Frorn step 1908, the process continues to step 1909. In step 1909, the CA 022~86~2 1998-12-17 process identifies active sounds. Active sounds are sounds that have not been completely produced. From step 1909, the process continues in reference step B 1910. Reference step 1910 provides a reference in other flow charts for steps not illustrated in Figure 19.

Figure 20 is a flow diagram that is a continuation of the flow diagram illustrated in Figures 18 and 19. The process continues in reference step B
1910. From reference step B 1910, the process continues to decision block 2001. In decision block 2001, a decision is made as to whether or not a sound 10 is discrete. A sound is discrete if it is intended to be perceived as being localized in a particular region of the spatial environment. The present invention allows the particular region in which a sound is perceived as being localized to be changed over time. By changing the region in which a sound is perceived as being localized, a sensation of movement can be associated 15 with the sound. Not all sounds produced must be discrete. Other sounds may be produced so as to be perceived as ambient or generalized in origin. If a sound is not discrete, the process continues at decision block 2007. If the sound is discrete, the process continues at step 2002. In step 2002, the processupdates position information for the sounds being produced. The updated 20 position information may be based upon position information and updated by the application program or may be updated without reliance on the application program, for example by extrapolating a updated position from previous positions.

From step 2002, the process continues in step 2003. In step 2003, the process obtains attenuation parameters from a table 38 corresponding to the region of the spatial environment indicated by the position information.

CA 022~86~2 1998-12-17 From step 2003, the process continues in step 2004. In step 2004, the process provides attenuation parameters to the sound subsystem. If the sound system is currently playing a sound, the perceived position of the sound is dynamically updated based on the new attenuation parameters. From step 5 2004, the process continues to decision block 2005. In step 2005, a decision is made as to whether or not a sound is done playing. If the sound is done playing, the process continues from decision block 2005 to step 2006. In step 2006, the process removes the sound. From step 2006, the process continues at decision block 2007. If in decision block 2005, the sound is not done 10 playing, the process continues in decision block 2007.

In decision block 2007, a decision is made as to whether all active sounds have been updated. If all active sounds have not been updated, the process continues from decision block 2007 to step 2008. In step 2008, the 15 process selects the next active sound from step 2008, the process continues to decision block 2001. If in decision block 2007, all active sounds have been updated, the process continues to reference step D 2009. Reference step D 2009 provides a reference for steps in the process not shown on Figure 20.

Figure 21 is a flow diagram that is a continuation of the flow diagram illustrated in Figures 18, 19 and 20. The process continues in reference step D
2009. From reference step 2009, the process continues to decision block 2101.
In decision block 2101, a decision is made as to whether the application program is done. If the application program is not done, the process proceeds to reference block C 1911. From reference block C 1911, the process continues in step 1901 of Figure 19. If in decision block 2101, the application program isdone the process resets the sound subsystem in step 2102. In step 2102, the CA 022~86S2 l998-12-l7 W O97/49262 PCTrUS97/10409 process may reconfigure the sound system to be in the same state that is was in prior to step 1802 of Figure 18. Alternatively, the process may reconfigure the sound subsystem in any known state. From step 2102, the process continues to step 2103. The process ends in step 2103.

Figure 22iS a flow diagram illustrating one embodiment of a process according to the present invention. The process begins in step 2201 and continues to step 2202. In step 2202, the process identifies an azimuth coordinate. From step 2202, the process continues to step 2203. In step 2203, 10 the process identifies a radial component. From step 2203 the process continues in step 2204. In step 2204 the process locates a sector in which the azimuth radius identified in steps 2202 and 2203 occur. From step 2204, the process continues to step 2205. In step 2205 the process obtains attenuation parameters from table 38 for the appropriate sector indicated in step 2204.
From step 2205, the process continues to step 2206. In step 2206, the process provides attenuation parameters to a sound subsystem. From step 2206, the process continues to step 2207. In step 2207, the process plays a sound using the sound subsystem. From step 2207, the process continues to decision block 2208. In decision block 2208, a decision is made as to whether the sound is 20 done or not. If the sound is not done, the process continues from decision block 2208 to step 2202. If the sound is done, the process continues from decision block 2208 to step 2209. The process ends in step 2209.

Figure 23is a flow diagram illustrating one embodiment of a process according to the present invention. The process begins in step 2301. From step 2301, the process continues to step 2302. In step 2302, the process identifies Cartesian coordinates at which a sound is desired to be perceived.

CA 022~86~2 l998- l2- l7 W097/49262 PCTrUS97/10409 From step 2302, the process continues to step 2303. In step 2303, the process converts Cartesian coordinates to spherical coordinates. From step 2303, the process continues to step 2304. In step 2304, the process locates the sector in which the designated spherical coordinates occur. From step 2304, the process 5 continues to step 2305. In step 2305, the process obtains attenuation parameters for the indicated sector. ~rom step 2305, the process continues to step 2306. In step 2306, the process provides attenuation parameters to the sound subsystem. From step 2306, the process continues to step 2307. In step 2307, the process plays the sound using the sound subsystem. From step 2307, 10 the process continues to decision block 2308. In decision block 2308, a decision is made as to whether or not the sound is done. If the sound is not done, the process continues from decision block 2308 to step 2302. If the sound is done, the process continues from decision block 2308 to step 2309.
The process ends in step 2309.

Figure 24 is a flow diagram illustrating one embodiment of a process according to the present invention. The process begins in step 2401. From step 2401, the process continues to step 2402. In step 2402, the process identifies a sector in which a sound is desired to be perceived. From step 20 2402, the process continues to step 2403. In step 2403, the process obtains attenuation parameters for the indicated sector. From step 2403, the process continues to step 2404. In step 2404, the process provides attenuation parameters to the sound subsystem. From step 2404, the process continues to step 2405. In step 2405, the process plays the sound. From step 2405, the 25 process continues in decision block 2406. In decision block 2406, a decision is made as to whether the sound is done or not. If the sound is not done, the process continues from decision block 2406 to step 2402. If the sound is done, .

CA 022~86~2 l998- l2- l7 W097/49262 PCT~US97/10409 the process continues from decision block 2406 to step 2407. The process ends in step 2407.

Figure 25 iS a plan view diagram illustrating placement of transducers 5 16 relative to user 20 for one embodiment of the present invention. This example illustrates six transducers 16 located at an equal distance and separated by equal angular increments from each other with respect to user 20. Alternatively, various numbers of transducers 16 may be located at various distances from user 20 and at various angular increments with 10 respect to each other as viewed from the perspective of user 20.

Figure 26 is a perspective view diagram illustrating the placement of transducers 16 relative to user 20 for one embodiment of the present invention. In this embodiment, twelve transducers 16 are illustrated. Six of 15 transducers 16 may be oriented as illustrated in Figure 25, but with the plane in which these six transducers 16 lie being translated to a location above user 20. The other six of transducer 16 may also be configured as illustrated in Figure 25, but with the plane in which these six transducers 16 lie being translated to a location below user 20. Thus, an imaginary octahedron 20 having six sides, a top, and a bottom is formed with transducers 16 located at the vertices. User 20 is preferably located approximately central to the octahedron, although user 20 may be located elsewhere within the octahedron, outside the octahedron, or multiple users 20 may be located at various locations with respect to the octahedron. Moreover, transducer 16 25 may be oriented in a different three dimensional configuration providing adequate spatial diversity. Variations in the positioning of transducer 16 may CA 022~86~2 1998-12-17 be accommodated by modifying the attenuation parameters stored in tables 38.

Figure 27 is a plan view diagram illustrating an embodiment of the 5 present invention. The present invention may be practiced with spatial environments having varying spatial resolution over their area or volume.
For example, a planar circular spatial environment may be defined to have 128 regions, with 124 spatial regions spanning an arc of 180~ extending from directly left of user 20, across the front of user 20, to directly right of user 20.
10 A fewer number of regions may be defined along the arc of 180~ extending from directly left of user 20, behind user 20, to directly right of user 20.
Another region may be a central circular region centered about the center of the spatial region and encompassing a circular area of limited radius proximate to the center of the spatial region.
In Figure 27, region 2701 is a central circular region centered on the center of the circular spatial environment. Regions 2702 are a plurality of regions that span the 180~ arc in front of user 20. Region 2703 is a single region spanning a 60~ arc to the left and behind user 20. Region 2704 is a 20 single region spanning a 60~ arc directly behind user 20. Region 2705 is a single region spanning a 60~ arc to the right and behind user 20. Transducers 16 are positioned peripheral to the spatial environment.

Figure 28 is a plan diagram illustrating an example of a configuration 25 of transducers 2801-2806 that may be used in conjunction with the present invention. User 20 is preferably approximately centrally located with respect to walls 2807-2810 of a room. Transducer 2801 is preferably located in CA 022~86~2 1998-12-17 proximity to a left front corner of the room. Transducer 2801 is preferably directed toward user 20. Transducer 2802 is preferably located in a right front corner of the room. Transducer 2802 is preferably directed toward user 20.
Transducer 2803 is preferably located in a left rear corner of the room.
5 Transducer 2803 may be directed toward user 20. Alternatively, transducer 2803 may be directed toward wall 2809 or 2808 to provide indirect sound to user 20. Transducer 2804 is preferably located in a right rear corner of the room. Transducer 2804 may be directed toward user 20. Alternatively, transducer 2804 may be directed toward wall 2810 or 2808 to provide indirect 10 sound to user 20. Transducer 2805 and subwoofer 2806 are preferably located somewhere between transducers 2801 and 2802.

Such a configuration provides compatibility with sound processing techniques such as Dolby AC3, Prologic, and stereo PCM wave playback. For 15 example, when stereo signals are provided to transducers 2801 and 2802, sound signals produced according to the present invention may be applied to transducers 2803 and 2804. Alternatively, sound signals produced according to the present invention may be applied to transducers 2801-2804, but with the sound signals provided to transducers 2801 and 2802 being muted.
A center dialogue sound signal may be provided to transducer 2805 and a low frequency sound signal may be provided to subwoofer 2806.
Transducers 2801-2804 may be driven by sound signals produced according to the present invention, sound signals produced using a technique such as 25 Dolby AC3 or Prologic, or a combination thereof. Thus, the present invention provides compatibility with existing sound processing techniques.

CA 022~86~2 1998-12-17 The present invention may also be practiced with other types of spatial environments. For example, a spatial environment may be defined to be compatible with the Musical Instrument Digital Interface (MIDI) standard.
Information relating to such a spatial environment may be easily processed 5 by and communicated between MIDI apparatus. Spatial environments may be defined over arbitrary areas and volumes in a plurality of dimensions.
Spatial environments may be based on virtually any geometric shapes.
Spatial environments may have any number of spatial regions of any size that may be defined in any configuration with respect to the spatial 10 environment. Spatial regions may be equal in area or volume over the spatial environment or may differ in area or volume.

Spatial environments may be defined to correspond to any desired size. Spatial environments may also be scaled to accommodate a range of 15 sizes. For example, a rectilinear spatial environment may be scaled to provide the psychoacoustic effects of a small room or of 2 football field. Thus,the range of perceived distance between regions of the spatial environment may be controlled. The sense of distance can be psychoacoustically enhanced by introducing a delay in the process by which the sound is produced in 20 accordance with the distance from the perceived sound source to the user and the speed of sound desired to be simulated between the perceived sound source and user. The speed of sound can be selected according to realistic physical values, for example the speed of sound through air at room temperature, of other values that need not have any relation to actual 25 physical phenomena.

CA 022~86~2 1998-12-17 The present invention may be used to specify minimum and maximum levels for sounds being produced. For example, when a sound is specified to be produced, a minimum level may be given for that sound and a maximum level may be given for that sound. When adjustment of the level 5 of the sound is made according to adjustment parameters based on the location at which the sound is to be perceived, the adjusted level may be compared against the specified minimum and maximum levels for that sound. If the adjusted level is below the minimum level for that sound, the sound can be produced at the specified minimum level, the sound may be 10 muted, or the production of that sound may be avoided. If the adjusted level is above the specified maximum level, the sound may be produced at the specified maximum level. The minimum and maximum levels may be set either dependently or independently for the level of each of the transducers or for the level provided by the action of all of the transducers together. The 15 minimum and maximum levels may be specified in terms of sound pressure level, power, amplitude, sound intensity level, or any convenient acoustic or electrical parameter.

The present invention also allows an inner range and an outer range 20 between the user and the perceived location of a sound source. If a location is specified at which the sound source is to be perceived that is closer than the inner range, the sound may be produced according to the adjustment parameters corresponding to a location no closer than the inner range. If a location is specified at which the sound source is to be perceived that is 25 farther than the outer range, the sound may be produced according to parameters corresponding to a location no farther than the outer range, the sound may be muted, or production of the sound may be avoided.

.. . .

CA 022~86~2 1998-12-17 Different types of sound may be produced according to the present invention. For example, a data file containing PCM sound data (such as a file of the type commonly referred to as a .WAV file), another type of PCM sound 5 data source, an FM synthesis technique, a microphone, a MIDI-controlled wavetable synthesizer device, or some other sound signal source or sound data source may be used to supply the sound signal or sound data for the sound to be produced. Sound may also vary according to the perceived location they are intended to have. For example, sounds may be designated 10 as discrete, static, or ambient. A discrete sound is intended to be perceived as originating from a sound source located in a region of a spatial environment.
Different regions may be specified over time for the perceived sound source for a discrete sound. Thus, the perceived location of a perceived sound source for a discrete sound may be made to seem to move over time. When 15 a discrete sound is desired, a starting location for its perceived sound source may be initially specified. As the sound is being produced, the location of the perceived sound source may be dynamically updated. The updated location of the perceived sound source may be determined based on position information received from an application program or using any other 20 location updating technique. The location may be updated to correspond to changes of locations of visual objects in a graphic environment, for example while playing an interactive game.

A static sound is intended to be perceived as originating from a sound 25 source located in a region of a spatial environment that does not change overtime. The perceived location of a static sound source is not updated over time, thereby reducing the computational effort required to produce a static CA 022~86~2 l998- l2- l7 sound. Thus, a static sound source is perceived as remaining stationary over time. An ambient sound is intended to be perceived as originating from a diffuse sound source that may be internal or external to the defined spatial environment. Since the ambient sound is intended to be perceived as 5 originating from a diffuse sound source, particular position information need not be provided for ambient sounds. Ambient sounds may be produced by driving all transducers at equal levels or with signals that psychoacoustically diffuse the perceived sound source. Different combinations of these types of sound may be combined simultaneously to 10 provide the overall effect desired.

Since the present invention may be practiced with various spatial environments, transducer configurations, and user locations, the present invention also provides a technique for calibrating system performance. For 15 calibration, the user should preferably be located at the center of the spatial environment for which calibration is being performed. Alternatively, if the user is not expected to be at the center when using the invention, the user may be located at the location at which the user is expected to be during sound production according to the invention. A sound should be produced 20 with a perceived sound source located at a specified location, preferably thecenter or central region. The user is instructed to adjust the gain of circuits driving the individual transducers until the sound is perceived as originating from the specified location. Once the relative outputs of the transducers are adjusted, the absolute total output of the transducers may be 25 adjusted by adjusting the gain of circuits driving the transducers while maintaining the same relative relationships between the outputs of the transducers. Thus, the transducers may be calibrated relative to each other as CA 022~86~2 1998-12-17 well as to an absolute reference, for example a given decibel value of sound pressure level. When configuring the transducers and the circuits driving them, care should be taken to maintain proper phasing of the circuits and transducers.

The present invention may be practiced with transducers that are wired to the circuits driving them, or wireless transducers may be used. For example, wireless speakers using infrared, radio frequency (RF), or microwave links to the driving circuits may be used. The present invention 10 may also be practiced with a subwoofer channel for producing low frequency sounds. Since it is difficult to perceive direction and position of low frequency sound sources, the subwoofer channel may be usecl to drive one or more subwoofer transducers that may be separate from and independent of transducers used to produce sounds for which a specific direction or position 15 is intended to be perceived.

The present invention may be practiced as a system integrating sound, video display or other visual display, and user input. The invention may be used in conjunction with a computer, an arcade game, a set-top box, or with 20 other apparatus.

Thus, a method and apparatus for providing sound in a spatial environment has been provided.

CA 022~86~2 1998-12-17 Aypendix A

DISCRETE DYNAMIC POSITIONING OF AUDIO SIGNALS
IN A 360~ ENVIRONMENT

BACKGROUND OF l~IE INVEN'IION

1. FTFT n OF TH~ I~VF.l~TION

This invention relates to the digital control of audio environments 10 and, more particularly, to an environment which is of an increased reality toa listener, who is able to interact with the host, (such as a computer) at the same time, as a user thereof.

2. BACKGROUND ART

As will be appreciated, advances in audio technology in recent years 15 have proceeded in the direction of making the audio environment "real" to a listener. Thus, monophonic recording and playback evolved into stereophonic recording and playback. This in turn, led to developments in quadraphonic recordings and playback -- where the sound, instead of coming out from either left, or right speakers (or a combination of them), came from 20 4 speakers, replayed out of rear speakers, as well as from front speakers.
Enhanced stereo and surround sound developments followed, in the nature of Dolby, AC-3, and other systems, for example, to provide different approaches to immerse a listener in the sound environment.

~ SUBSllllllt ~ UI~ 26~

CA 022~86~2 1998-12-17 As these developments came along, computer produced audio programming followed suit in response to demands by users for higher quality sound. This made the job of the computer programmer designing video games and CD-ROMs more difficult, as the need for complex audio 5 production and imaging became necessAry. The task of the programmer was further complicated by the desire, and economic necessity to produce games, CD-ROMs, and virtual simulations that would operate on multiple computer platforms such as the Macintosh, IBM compatibles, Nintendo, and Sega.

Thus, a simplified manner of programming the placement and 10 movement of sound within a 360~ environment would be desirable, which would not require programmers to sit down and perform complex calculations to have the sound respond to the actions of the user in interacting with the visual aspect of the program. Also, even where there is no user interaction, a simplified manner of programming would be helpful 15 to one trying to develop these games, CD-ROMs, virtual simulations for an enhanced audio environment; and for performance by musicians, audio engineers, etc.

SU~ lllE SHEI (eULE 26) CA 022~86~2 1998-12-17 SUMl~IA~Y OF T~F. INVEN~ION

As will be seen from the following description, this invention generally relates to the discrete dynamic positioning of audio sources around 5 a user-listener sitting in the mi~lle of a 360~ environment -- which can be best described by assuming the user to be looking at a fixed point, and thus turning in a clockwise or counter-clockwise fashion a full circle (360 degrees),arriving again at the fixed point while being contained within the audio environment the duration of the entire turn. As will also be seen, the focus 10 of this invention is to enable the dynamic manipulation of sounds to be produced within that environment. As will be appreciated by those skilled in the art, this alteration can be effected through computer programming, as an example, or through user interaction in which events are prompted to the computer by the user, who instantaneously alters the listening environment.
15 In such manner, a realistic, interactive audio environment can be established.
As will become clear from the description below, the present invention operates in addressing several of the weaknesses as is associated with current audio system designs. First, the hardware limitations of those 20 designs are overcome in a manner by which amplitude attenuation is controlled from software that is customizable by the programmer, instead of being statically controlled by hardware or firmware. Secondly, the sound positioning of any voice can be rendered in a 360~ plane. Thirdly, it will be appreciated from the description that the data streams that deterrnine the 25 sound output can be modified, and added to by the actions of the user-listener without disrupting their translations. And, as will be seen, the invention SUBSIIIult SHE~ (RUIE 26) CA 022~86~2 1998-12-17 WO 97/49262 PCT/US97/lW09 creates a fluid and structured manner for addressing the need of placing sounds in a listening environment which does not exist in current audio system designs.
To accomplish this, it will be seen from the following description that 5 a software algorithm or driver, is u~ili7e-l, on a "host", such as a personal computer or a dedicated audio processor, positioned at a step prior to the sound generation, determining the playback pl~c~ment of the individual voices across the four or more sound outputs, which delivers the source in a known fashion to any or all transducers to which the outputs are connected.
10 In accordance with the invention, such software driver receives a sound placement value which it compares to a known table of values, and sends those values to the couplers for proper placement of the sound.
In an alternative system that incorporates static surround sound technologies (Dolby Pro Logic, AC-3...) the driver intercedes prior to the 15 decoding of the data stream, altering the data stream interpolator by decoding the data stream, altering the data stream as necessary to instigate new audio amplitude attenuation values, adding additional sound information, and encoding the altered data stream back to the format expected by the surround sound processor. If desired, the driver can re-code the altered data stream --20 for use on non-AC-3 systems -- to execute using the known number of couplers existing on the system in use.
Alternatively, and as will be appreciated, the driver can also send the translated data stream according to the preferred embodiment straight to the transducer when so configured, thereby permitting the existing data stream to 25 remain intact if so desired by the user, or to allow it to be altered by the software driver and "updated" to the new environment if so desired during user interaction with the system.

S~ lk SIEF (RUIE 26) CA 022s86~2 1998-12-17 W097/49262 PCT~US97/10409 In carrying out the teaching of the invention, a method is described which allows the computer programmer to merely specify a number identifying a location within a known pattern for positioning the sound desired in a specific embodiment employing four speakers, the center of 5 which is assumed to be the position of the user-listener. Once that number is set forth, a matrix established accordi~lg to the invention automatically placesthe sound in the field, by establishing amplitude attenuations of the sound reproduction by the speakers. The matrix contains a plurality of Tables, the first two being defaults used by the matrix if no other Table is defined by the 10 computer programmer.
In one embodiment of the matrix described (Table 1), 128 points are used to represent locations on a 360~ circle, where #0 is straight behind the user, and #64 is straight ahead. A data stream programmed for use with this driver would then present a source data stream to the driver containing a 15 message specifying a location (as an example "location #0"). The driver receives this message, looks in the matrix for the attenuation values of location #0, sets the attenuation values of the sound source to the values specified by the matrix, which is then produced at the proper outputs and volumes. Assuming a data stream issues multiple location numbers 20 sequentially, the attenuation levels dynamically change to match each of the new values presented to the driver by the data stream. If the second default Table (Table 2) is employed, the data stream represents not only locations on the circumference of the circle, but locations closer to, or further from the user. In this manner, the computer programmer need only specify the 25 location number according to the applicable table being utilized, and the driver and matrix take over themselves in establishing the needed amplitude attenuations to perceptually locate the sound in the 360~ field. The SU~IIIUIE SEEr (RUIE 26) CA 022~86~2 1998-12-17 programmer definable Table can be of any configuration to achieve the desired effect, such as being inside of a tunnel. Once a Table is loaded into the matrix, can be dynamically modified by the program, allowing the driver to access different table configurations at any given instance.
As will also be appreciated, where there is user interaction with the video game, CD-ROM, etc., the computer programmer simply can define the location by the matrix number, along with a variable, controlled by the user through a joystick, gun, mouse, head set, or other means in providing a new location for the sound to be positioned at. Such control merely changes the 10 location number specified to a different one, also present in the matrix, where the amplitude attenuations are established once again to control the sound sources passing through the couplers.
As will be appreciated, the method of dynamically locating these audio signals in the 360~ environment with either embodiment of the invention 15 operates independently of the type of computer being employed, so as to enable a programmer to more easily post a product to other computer platforms. in such manner, a "standard" can be set for each program for playback through different types of computers.
While the method and matrix of the invention will be understood in 20 using the Musical Instrument Digital Interface (MIDI) standard of controllingaudio in musical instruments, syr~thesi7.ers, and computer sound generation, in utilizing 1 byte words (128 values) to define the matrix and driver, other standards offering additional values may be used if developed in the future.

SU~ SEEr~RUIE28) CA 022~86~2 1998-12-17 WO 97/49262 PC'rNS97110409 Bl~T~F D~cRrpTIoN OF T~ DRAWINGS

These and other features of the invention will be more clearly understood from a con.~ eration of the following description, taken in 5 connection with the accompanying drawings, in which:
Figure 1 is a block diagram of an audio environment and system helpful in an understanding of the present invention;
Figure 2 is an example of one way to implement a matrix relating to a 360~ environment, and is considered a "default" matrix automatically loaded 10 by the driver when no other matrix is loaded; and Figure 3 is an example of another way to implement a matrix, relating to a 3-D environment contained in a 360~ sphere, and is considered a "default" matrix automatically loaded by the driver when no other matrix is loaded.

SUB~ lt SEE~ (RUIE 26) CA 022~86~2 1998-12-17 D~TAn F.~ D~Cl~TPrION OF TH~ DRAwr~

In Figure 1 one or more individual sound sources 10, defined as any sound embodied in a data stream, such as the voices on a synthesizer chip, a 5 pulse code modulation (PCM) file, etc. The sound source 10 is controlled by, and normally integral with, a host 12, and is connected via couplers 14 (such as D/A converters, digital line drivers, etc.) to a plurality of transducers 16,which translate the delivered source in a known fashion. The audio environment 18 is illustrated with a user 20 at its center, and is depicted with10 four transducers 16 situated one at each corner of the environment 18. Of course, any number of users can be included within the 360~ environment 18, with all aspects of heading and bearing being maintained as in real life, so that users standing in the center receive audio data representing that which would normally be presented to a user 20 standing in the center of the 15 environment 18. As will be appreciated, the audio environment 18 is limited only by the size and placement of the transducers 16, as supported by the system.
A software algc,rillu-l is utilized which includes proprietary knowledge of the sound sources 10 and proprietary knowledge of the number and types 20 of couplers 14, and a software driver 22, located on the host 12 which enables communication between the sound source 10 and the couplers 14. This algorithm functions by controlling the amplitude attenuations of each individual sound source 10 as it passes through the couplers 14, and the relationship of the amplitude sent through each coupler 14 by reference 25 values contained in a matrix 26 native to the algorithm. As will be seen from Figures 2 and 3, by changing the amplitude attenuations, the perceptual S~mUTE SEEr (~UIE 26) CA 022~86~2 1998-12-17 locations of each sound source 10 can be changed in the 360~ environment, such that the user 20 ends up being immersed in the audio environment.
In Figure 1, a configuration is shown, with a controller 30, employed by the user 20 sitting in the center of the enviromnent, holding onto a joystick, mouse, gun, or wearing a controlled headset, or otherwise connected to some control device to interact with a computer program 32 which typically sends an output signal to a video display screen 34 and which provides an output signal of a type to instruct the driver 22 to instruct the sound source 10 to produce any given sound at a selected volume level, and instruct the couplers 14 to place that sound at a given point in the 360~ environment 18.
Such sound source 10 is, as an example, shown connected to 4 couplers 14 which translate generated signals to the four transducers 16, in the audio environment under discussion. While only 4 transducers 16 are illustrated, it will be appreciated that the maximum number utilized is determined by the Matrix Tables 38 and the independently ~ccessihle couplers 14 of the system constructed.
As will be appreciated, the audio output signal from the computer program 32 is in the nature of an instruction to the Driver 22, which in turn controls both the sound sources 10, and the couplers 14 to play a particular sound at a certain volume and at a specified coordinate in the 360~
environment 18.
In accordance with the invention, the computer program 32 sends the specified coordinate number (as #32 for example) to the driver 22 where it is compared to a Table 38 in the matrix 26 which defines the various attenuation amplitudes for the individual left and right, front and rear transducers 16 in dynamically positioning the audio signal discretely in the 360~ environment 18 to which it is assigned. The matrix 26 then, is effective S~IIIUIE SIIEEI (RUIE 26) , ., .~. ., .. ~ .

CA 022~86~2 1998-12-17 to return the volume ratio to the Driver 22 where the amplitude attenuations for the couplers 14 are addressed. As will be appreciated, such coordinate number initially designed by the programmer at #32 can thus be varied by the controller 30, in changing the location as to where the sound is 5 to be positioned in the 360~ environment 18, to allow for user-listener 20 interaction.
With this understanding that the matrix 26 referenced by the driver 22 can thus be accessed dynamically by the user-listener 20, Figures 2 and 3 can be referred to in understanding the implementation and the discrete 10 positioning of the audio signal in perceptually immersing the user-listener 20 in the audio environment.
Figure 2 shows an audio environment 40 with the matrix 26 accessing a Table (#1) 38, containing the 128 values associated with the MIDI standard (#0-127). Each value or point thus represents an angle of offset from the first 15 point (0) equal to 360~ divided by 128, or 2.8125~, such that every 16 pointsequals a rotation of 45~ clockwise around a circle. With position 0 assumed to be straight behind the user 20, with position 64 assumed to be straight ahead of the user 20 (180~ offset from point 0), four transducers 16 are shown -- LeftFront (LF), Right Front (R~), Right Rear (RR), and Left Rear (LR). Thus, the 20 Table 38 contains an array for 128 points, each with four values (LF/RF/RR/LR). As understood, the four transducers 16 are positioned at 90~
intervals around the environment, such that LR = point 16, LF = point 48, RF
= point 80, and RR = point 112. As also indicated, point 0 is directly between LR & RR, point 32 is directly between LR & LF, point 64 is directly between I~F
25 & RF, and point 96 is directly between RF & RR.
Amplitude attenuations can be derived such that the point corresyonding to a specific transducer 16 (i.e., point 16 would equal SU~ lt SNEEr (BUIE 26~

CA 022~86~2 1998-12-17 transducer LR) has an array containing full-on for that transducer 16 -- and itsassociated coupler 14 -- and full-off for the other three (with full-on being defined as an attenuation of 0; full-off being defined as the maximum attenuation level from which sound output can not be registered from the 5 transducers). Points then directly in-between two transducers 16 (i.e., point 32 is directly between LR & LF) would have an array containing combinative values for the 2 transducers equaling the same db output from an individual transducer, while the other two transducers 16 are set to full-off. The points in-between the corner and mid-quadrant points can then be derived such that 10 as the point value moves from the pair of transducers toward one of the transducers in the pair, the value increases in the array for the transducer being approached until it reaches full-on, and the value decreases in the array for the transducer being moved away from, until it reaches full-off.
The Table (#1) 38 of Figure 2, will be appreciated to represent a 15 sequential matrix, in which the points are sequentially numbered such that incrementing (or decrementing) the point moves the sound around the circumference of the environment 18. Such environment is typical of stereo-field environments, except that the stereo field extends a full 360~. Distance will be seen to be irrelevant to location, and that the points locating the audio 20 signal are spatially positioned about the 360~ field, equidistant from the assumed central position of the user at 20. Since the driver 22 and matrix 26 recognize the 128 values, each incrementing or decrementing unit is effective to dynamically locate the audio signal 2.8125 degrees apart. In such manner, all that the computer programmer need do is specify an instruction that 25 translates to a matrix value at any of the 128 points in defining where the sound is to perceptually appear at. This simply can be done by having the matrix of Figure 2 as a "pie slice."

SU~ ult SEEr (~UIE 26) CA 022~86~2 1998-12-17 In establishing the instruction, regardless of what platform of host, computer, 12 is being lltili~ed, and independent of the content of the data stream or volume level selected for that sound source 10. Once the coordinate value is established, the amplitude attenuations for the couplers 5 14, automatically follow to activate the transducers 16 LF, RF, RR, and LR
accordingly positioning the audio signal. If the program designed, as an illustration, calls for the signal to perceptually appear at point #32 in the matrix of ~igure 2, but the user 20 actuates the controller 30 to interact with the program 32 in changing the video output 34 and the relevant audio 10 signal location, to a point #88, then the signal would perceptually appear atthat point, at the same volume, through different amplitude attenuations of the signals coupled to those same four transducers 16.
Similarly, the Table (#2) 38 of Figure 3 is useful in discretely and dynamically positioning the audio signal in the 360~ environment 18, but at 15 distances closer to, or further away from the user 20 according to the computer program 32, again by just specifying a coordinate which translates into a matrix value. The emulated 3-D environment of Figure 3 will be understood to consist of six concentric cirdes (RINGS 1-6), with the radius of each cycle being calculated based on a known maximum distance from the 20 user being the radius of an imaginary seventh ring, and the radius of each of the known six rings being derived from some subtraction of the known maximum distance such that the radii of the rings fits a cubic formula where Y = distance and X = ring. As shown, each RING 44 contains a different number of points, RING #1 having 1 point, RING #2 having 4 points, RING
25 #3 having 8 points, RING #4 having 16 points, RING #5 having 32 points, and RING #6 having 64 points. As will be appreciated, the starting point for each RING 44 is calculated in this manner such that the one point of l~ING 1 SU~ lt SEEr ~RULE 26) CA 022~86~2 1998-12-17 = #0, the four points of RING 2 = #1 #4, the eight points of RING 3 - #5~12, the sixteen points of RING 4 = #13~28, the 32 points of RING 5 = #29~60, and the sixty-four points of RING 6 = #61~124. As such, 125 points are present in this Table #2, as compared to the 128 points in Table (#1) in Figure 5 2.
To implement the matrix of Figure 3, only the x and z values need be considered, such that the 360~ field can be divided as follows: Quadrant #1 includes any point plotted with a negative x, and a negative z value, quadrant #2 is defined by any point plotted with a negative x value and a positive z 10 value, Quadrant #3 is defined by any point with a positive x value and a positive z value, and Quadrant #4 is defined by a point with a positive x value and a negative z value. Four transducers 16 are shown in this environment 18 -- Left Front (LF), Right Front (RF), Right Rear (RR), and Left Rear (LR). As indicated, each transducer is positioned at the center of a 15 quadrant (LR=1, LF=2, RF=3, RR-4). As will thus be seen, each coordinate in the matrix of Figure 3 contains an array of four values (LF/RF/RR/LR). The values assigned to each coordinate represent a progressive bleed based on the proximity of each RING 44 to the center user 20, such that RING 6 is calculated as previously described, and RING 1 has the same attenuation 20 level for each transducer 16.
In a manner analogous to that with Figure 2, the computer programmer provided with the "pie chart" of Figure 3, simply specifies that instruction coordinate in the program which would correspond to that one point in the field where the audio signal is to be perceptually positioned, a 25 given distance from the user 20, and along the 360~ field. By adjusting the controller 30, the user 20 can thereafter change that coordinate and simply ~UBSIllUlt SNEEI (RUIE 26) interact with the program 32-- regardless of the type and manufacture of the computer being employed as the host 12.

As thusly described, the software driver 22 and matrix 26 are 5 positioned prior to the placement of each individual sound source 10 in the environrnent, and when combined with a static sound data stream (PCM
Files, .Wavs), can act as an interpolator by altering the sound data stream as necessary to instigate the new audio amplitude attenuation values, adding in the additional sound information, prior to D/A conversion. In such 10 manner, the software driver is able to manipulate both static sound recordings, and computer generated information.

With the translation of surround sound recordings (Such as AC-3) on the other hand, the information is presented to the driver 22 in a combined 15 format, for translation. Here, the software algorithm "decompiles" the data stream into separate component streams (one for each target coupler), alters the data stream by adjusting amplitude parameters for each component stream, adds sound information to the app,opriate data streams, and "re-compiles" the data stream to be sent on to the surround sound processor.
20 The driver can also, if desired, re-code the modified data stream -- for use on non-AC-3 compliant type systems -- to execute using the known number of couplers 14 existing on the system in use.

As will be appreciated by those skilled in the art, four channel surround sound is developed according to the invention with a 25 simplification to the computer programmer that eliminates the need for SlllblllultSEEI (RUIE 2C) CA 022~86~2 1998-12-17 complex mathematical calculations for each of the channels employed.
Whether the positioning be just around the perimeter of the 360~
environment, or within it, closer to or further from the user, all that is required is the specification of the coordinate that corres~onds to the point on5 the Table utilized. It will also be seen that the driver and matrix arrangement can also be employed in other Table designs -- as by assigning a coordinate (0) to everything behind the user, and the remaining 127 coordinates to everything in front of the user -- as in two-channel stereo, where separation then becomes at increments of 180~ spread over the remaining 127 slices.
10 Increased sound perception thus can be had compared to the 2.8125~
separation available with the pre-set table shown in Figure 2.

While there have been described what are considered to be preferred embodiments of the present invention, it will be readily appreciated by those skilled in the art that modifications can be made without departing from the 15 scope of the teachings herein. Thus, whereas, the invention has been described in the context of employing a matrix of 128 values, it will be appreciated that if standards other than MIDI were employed, then the numbers of values can be established to conform with that standard.
Similarly, where more than 4 speakers were employed, other assignments of 20 signal amplitude attenuations would be necessitated, in order to control the outputs of each in defining that point where the perceptually appearing sound would be positioned. In either situation, a programmed instruction in the nature of 85 i x, for example, could establish, according to the matrix chart utilized, the programmer's definition as to where the sound is to 25 appear in the 360~ circular field, with the notation "x" being a variable set to change that location by the users controller 30 -- either by joystick, gun, SII~ UltSllEE~(RUIE26) , ._~........... . .

mouse or headset control in interacting with the computer program -- be it in video game, arcade, CD-ROM, or other "virtual realities" format. For at least such reasons, therefore, resort should be had to the claims appended hereto for a true understanding of the scope of the invention.

SU~TIlUTE SHE~ (RULE 26)

Claims (50)

1. A system for producing a sound in a spatial environment comprising:
four transducers for producing said sound;
a table containing parameters, said parameters for controlling the relative amplitudes of said transducers;
a gain control coupled to said transducers for adjusting the relative amplitudes of signals provided to said four transducers based on said parameters.
2. The system of claim 1 wherein said table is indexed according to a spatial region defined within said spatial environment.
3. The system of claim 2 wherein said parameters comprise adjustment values for said signals for each of said transducers.
4. The system of claim 3 wherein a total power of said signals provided to said transducers does not vary as a function of a location of said spatial region within said spatial environment.
5. The system of claim 3 wherein a total power of said signals provided to said transducers generally increases as a proximity of said spatial region to a central region of said spatial environment generally increases.
6. The system of claim 3 wherein a total power of said signals provided to said transducers generally decreases as a proximity of said spatial region to a central region of said spatial environment generally increases.
7. The system of claim 3 wherein said spatial region is selected from a plurality of defined spatial regions in response to an input signal responsive to a user action.
8. The system of claim 3 wherein a plurality of sounds are produced simultaneously using different of said parameters.
9. The system of claim 8 wherein a plurality of tables are used to produce said plurality of sounds.
10. A method for producing sound in a spatial environment comprising the steps of:
defining said spatial environment to include a plurality of spatial regions;
generating a table comprising adjustment parameters indexed to said plurality of spatial regions;
specifying a spatial region from among said plurality of spatial regions;
obtaining adjustment parameters corresponding to said spatial region from said table;
adjusting relative amplitudes of a plurality of signals representative of said sound according to said adjustment parameters;
applying said plurality of signals to a plurality of spatially diverse transducers.
11. The method of claim 10 further comprising steps of:
specifying a second spatial region from among said plurality of spatial regions;
obtaining second adjustment parameters corresponding to said second spatial region;
adjusting second relative amplitudes of a plurality of second signals representative of a second sound according to said second adjustment parameters;
applying said plurality of second signals to said plurality of spatially diverse transducers.
12. The method of claim 11 wherein said step of generating said table comprising said adjustment parameters indexed to said plurality of spatial regions comprises a step of:
generating a plurality of tables comprising adjustment parameters indexed to said plurality of spatial regions.
13. The method of claim 10 wherein said step of generating said table comprising said adjustment parameters indexed to said plurality of spatial regions comprises a step of:
providing said adjustment parameters for each of said plurality of spatially diverse transducers for each of said plurality of spatial regions.
14. The method of claim 13 wherein said step of specifying a spatial region from among said plurality of spatial regions comprises a step of:
receiving an input signal based on user actions.
15. A method for producing a sound in a spatial environment comprising steps of:
generating a signal representative of said sound;
adjusting an amplitude of said signal for each of a plurality of transducers according to a region within said spatial environment from which said sound is to be perceived as originating;
applying amplitude-adjusted signals to said plurality of transducers.
16. The method of claim 15 further comprising a step of:
providing a table comprising a plurality of adjustment parameters for use in said step of adjusting said amplitude.
17. The method of claim 16 wherein said step of providing a table comprises a step of:
indexing said table according to a plurality of regions within said spatial environment.
18. The method of claim 17 wherein said step of providing a table comprises a step of:
organizing said plurality of adjustment parameters so as to exhibit a known correspondence with said plurality of transducers.
19. The method of claim 18 further comprising a step of:
calculating said region based on a set of coordinates representative of a location within said region.
20. The method of claim 19 further comprising steps of:
generating a second signal representative of a second sound;
adjusting a second amplitude of said second signal for each of said plurality of transducers according to a second region within said spatial environment from which said second sound is to be perceived as originating.
21. The method of claim 15 wherein said step of adjusting said amplitude of said signal comprises a step of:
adjusting said amplitude of said signal based on an input signal received in response to a user action.
22. The method of claim 15 wherein said step of adjusting said amplitude of said signal comprises a step of:
adjusting said amplitude of said signal for each of said plurality of transducers such that a total power applied to said plurality of transducers is independent of said region within said spatial environment.
23. The method of claim 15 wherein said step of adjusting said amplitude of said signal comprises a step of:
adjusting said amplitude of said signal for each of said plurality of transducers such that a total power applied to said plurality of transducers is greater as a proximity of said region to a central region is closer.
24. The method of claim 15 wherein said step of adjusting said amplitude of said signal comprises a step of:
adjusting said amplitude of said signal for each of said plurality of transducers such that a total power applied to said plurality of transducers is lesser as a proximity of said region to a central region is closer.
25. An article of manufacture comprising:
a computer usable medium having computer readable program code embodied therein for causing a sound to be sensible as originating from a sound source located in a spatial region of a spatial environment, said computer readable program code in said article of manufacture comprising:
computer readable program code configured to cause said computer to generate a table comprising adjustment parameters indexed to a plurality of spatial regions in said spatial environment;
computer readable program code configured to cause said computer to obtain adjustment parameters corresponding to said spatial region from said table; and computer readable program code configured to cause said computer to adjust relative amplitudes of a plurality of signals representative of said sound according to said adjustment parameters.
26. Said article of manufacture according to claim 25 further comprising:
computer readable program code configured to cause said computer to apply said plurality of signals to a plurality of spatially diverse transducers.
27. Said article of manufacture according to claim 26 further comprising:
computer readable program code configured to cause said computer to specify a spatial region from among said plurality of spatial regions.
28. Said article of manufacture according to claim 26 further comprising:
computer readable program code configured to cause said computer to calculate a spatial region from among said plurality of spatial regions based on a set of coordinates representative of a location within said spatial region.
29. Said article of manufacture according to claim 26 further comprising:
computer readable program code configured to cause said computer to specify a spatial region from among said plurality of spatial regions based on an input signal received in response to a user action.
30. Said article of manufacture according to claim 26 further comprising:
computer readable program code configured to cause said computer to maintain a known correspondence between said adjustment parameters and said plurality of spatially diverse transducers.
31. Said article of manufacture according to claim 26 further comprising computer readable program code configured to cause said computer to obtain second adjustment parameters corresponding to a second spatial region from said table; and computer readable program code configured to cause said computer to adjust second relative amplitudes of a plurality of second signals representative of a second sound according to said second adjustment parameters
32. Said article of manufacture according to claim 26 further comprising:
computer readable program code configured to cause said computer to generate a second table comprising said second adjustment parameters indexed to a plurality of second spatial regions in said spatial environment.
33. A method for dynamically positioning audio signals in an environment comprising the steps of:
receiving audio coordinate values for the outputs of a given sound source;
providing a matrix of values defining individual spatial positions within said environment;
comparing said coordinate values with said matrix of values to provide attenuated amplitude levels for sound source outputs; and mixing signals from said sound source outputs through a coupler to four transducers to be reproduced thereat, wherein different attenuated amplitude levels apply to each of said four transducers.
34. The method of Claim 33, also including the step of:
locating a user-listener within said environment, with said transducers around said user-listener.
35. The method of Claim 34, wherein said step of providing a matrix of values provides a matrix of values to include a table of attenuation values for each of said sound source outputs.
36. The method of claim 34, wherein said step of receiving audio coordinate values receives audio coordinate values for a minimum of 4 outputs of a given sound source simultaneously, and at varying levels.
37. The method of claim 34, wherein said steps of receiving audio coordinate values, providing a matrix of values, comparing said coordinate values, and mixing signals art performed in a software program.
38. The method of claim 34, wherein said step of receiving audio coordinate values receives audio coordinate values as provided by a computer program.
39. The method of Claim 34, wherein said step of receiving audio coordinate values receives audio coordinate values as provided by a computer program in which each coordinate value can be continuously adjusted by said user-listener.
40. The method of claim 34, wherein said step of providing a matrix of values provides a matrix of values from 0 to N-1, where "0"
represents a location on a circle behind a listener of said reproduced audio output signals and where 1/2N represents a location on said circle in front of said listener.
41. A method for discretely and dynamically positioning audio signals in a 360° environment comprising the steps of:
First, receiving audio coordinate values for the outputs of a given sound source;
Second, providing a matrix of values defining individual spatial positions within said 360° environment, Third, comparing said coordinate values with said matrix of values to provide attenuated amplitude levels for sound source outputs; and Fourth, mixing signals from said sound source outputs through independently controllable couplers to a plurality of transducers to be reproduced thereat;
Fifth, locating a user listener within said 360° environment, at the center of said plurality of transducers, wherein said first step receives audio input signals as a data stream, where said third step separates said data stream into separate component streams, attenuates the amplitude parameters of each component stream, adds any additional sound information into the appropriate streams, and re-combines the amplitude attenuated component streams along with the added information, into a single data stream, and wherein said fourth step includes a sixth step of surround sound processing in coupling said output signals to said transducers.
42. A matrix of N values, which corresponds to levels of amplitude attenuation for coordinate values, in providing audio output signals to a coupler for signal processing to dynamically and individually spatially position sound sources about a field surrounding a user-listener, wherein said coordinate values are compared with said matrix of N values to provide said levels of amplitude attenuation, wherein four transducers are provided with individually processed audio output signals for reproducing sound thereat, wherein different attenuated amplitude levels apply to each of said four transducers.
43. The matrix of Claim 42 where N = 128.
44. The matrix of Claim 42 for spatially positioning said sound sources about said field equidistant from assumed position of said user-listener.
45. The matrix of Claim 42 for spatially positioning said sound sources about said field, and of preselected distance from said assumed position of said user-listener.
46. The matrix of Claim 42 wherein said matrix is incorporated in a software program.

100(a)
47. The method of Claim 34, wherein said step of receiving audio coordinate values receives audio input signals as a data stream, where said step of comparing said coordinate values separates said data stream into separate component streams, attenuates the amplitude parameters of each component stream, adds any additional sound information into the appropriate streams, and re-combines the amplitude attenuated component streams along with the added information, into a single data stream, and wherein said step of mixing signals includes a step of surround sound processing in coupling said output signals to said transducers.
48. The matrix of claim 42 wherein said field is a 360° field.
49. The matrix of claim 48 wherein said coupler comprises at least 4 couplers.
50. The matrix of claim 49 wherein said user-listener is located at a center of said field.
CA002258652A 1996-06-18 1997-06-18 Method and apparatus for providing sound in a spatial environment Abandoned CA2258652A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US665,515 1996-06-18
US08/665,515 US5850455A (en) 1996-06-18 1996-06-18 Discrete dynamic positioning of audio signals in a 360° environment
US08/851,103 US6154549A (en) 1996-06-18 1997-05-02 Method and apparatus for providing sound in a spatial environment
US851,103 1997-05-02

Publications (1)

Publication Number Publication Date
CA2258652A1 true CA2258652A1 (en) 1997-12-24

Family

ID=27099225

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002258652A Abandoned CA2258652A1 (en) 1996-06-18 1997-06-18 Method and apparatus for providing sound in a spatial environment

Country Status (5)

Country Link
US (1) US6154549A (en)
EP (1) EP0903057A4 (en)
AU (1) AU3489797A (en)
CA (1) CA2258652A1 (en)
WO (1) WO1997049262A1 (en)

Families Citing this family (79)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085387B1 (en) 1996-11-20 2006-08-01 Metcalf Randall B Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources
JPH11272156A (en) * 1998-03-25 1999-10-08 Sega Enterp Ltd Virtual three-dimensional sound image generating device and method and medium thereof
US6487296B1 (en) * 1998-09-30 2002-11-26 Steven W. Allen Wireless surround sound speaker system
JP3587088B2 (en) * 1999-06-15 2004-11-10 ヤマハ株式会社 Audio system, control method thereof, and recording medium
US7882426B1 (en) * 1999-08-09 2011-02-01 Cognex Corporation Conditional cell execution in electronic spreadsheets
US6239348B1 (en) 1999-09-10 2001-05-29 Randall B. Metcalf Sound system and method for creating a sound event based on a modeled sound field
US6977653B1 (en) * 2000-03-08 2005-12-20 Tektronix, Inc. Surround sound display
AUPQ942400A0 (en) * 2000-08-15 2000-09-07 Lake Technology Limited Cinema audio processing system
GB2374502B (en) * 2001-01-29 2004-12-29 Hewlett Packard Co Distinguishing real-world sounds from audio user interface sounds
GB2374506B (en) * 2001-01-29 2004-11-17 Hewlett Packard Co Audio user interface with cylindrical audio field organisation
GB2372923B (en) * 2001-01-29 2005-05-25 Hewlett Packard Co Audio user interface with selective audio field expansion
GB2374507B (en) * 2001-01-29 2004-12-29 Hewlett Packard Co Audio user interface with audio cursor
US20030227476A1 (en) * 2001-01-29 2003-12-11 Lawrence Wilcock Distinguishing real-world sounds from audio user interface sounds
US6829017B2 (en) 2001-02-01 2004-12-07 Avid Technology, Inc. Specifying a point of origin of a sound for audio effects using displayed visual information from a motion picture
US6804565B2 (en) 2001-05-07 2004-10-12 Harman International Industries, Incorporated Data-driven software architecture for digital sound processing and equalization
FR2836571B1 (en) * 2002-02-28 2004-07-09 Remy Henri Denis Bruno METHOD AND DEVICE FOR DRIVING AN ACOUSTIC FIELD RESTITUTION ASSEMBLY
CA2430403C (en) * 2002-06-07 2011-06-21 Hiroyuki Hashimoto Sound image control system
CA2499754A1 (en) 2002-09-30 2004-04-15 Electro Products, Inc. System and method for integral transference of acoustical events
US7676047B2 (en) * 2002-12-03 2010-03-09 Bose Corporation Electroacoustical transducing with low frequency augmenting devices
US8139797B2 (en) * 2002-12-03 2012-03-20 Bose Corporation Directional electroacoustical transducing
FR2850183B1 (en) * 2003-01-20 2005-06-24 Remy Henri Denis Bruno METHOD AND DEVICE FOR CONTROLLING A RESTITUTION ASSEMBLY FROM A MULTICHANNEL SIGNAL
US20050185806A1 (en) * 2003-02-14 2005-08-25 Salvador Eduardo T. Controlling fading and surround signal level
US7305097B2 (en) * 2003-02-14 2007-12-04 Bose Corporation Controlling fading and surround signal level
US7424117B2 (en) * 2003-08-25 2008-09-09 Magix Ag System and method for generating sound transitions in a surround environment
US7742832B1 (en) * 2004-01-09 2010-06-22 Neosonik Method and apparatus for wireless digital audio playback for player piano applications
DE602005026780D1 (en) * 2004-01-19 2011-04-21 Koninkl Philips Electronics Nv DEVICE COMPRISING A POINT AND SPACE GENERATOR FOR PROVIDING A STEREO IMMEDIATE IMPRESSION VIA A LARGE AREA
MX2007002632A (en) * 2004-09-03 2007-07-05 Parker Tsuhako Method and apparatus for producing a phantom three-dimensional sound space with recorded sound.
JP3827693B2 (en) * 2004-09-22 2006-09-27 株式会社コナミデジタルエンタテインメント GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM
WO2006050353A2 (en) * 2004-10-28 2006-05-11 Verax Technologies Inc. A system and method for generating sound events
US7774707B2 (en) * 2004-12-01 2010-08-10 Creative Technology Ltd Method and apparatus for enabling a user to amend an audio file
US7928311B2 (en) 2004-12-01 2011-04-19 Creative Technology Ltd System and method for forming and rendering 3D MIDI messages
US20060206221A1 (en) * 2005-02-22 2006-09-14 Metcalf Randall B System and method for formatting multimode sound content and metadata
US8180631B2 (en) * 2005-07-11 2012-05-15 Lg Electronics Inc. Apparatus and method of processing an audio signal, utilizing a unique offset associated with each coded-coefficient
US7688992B2 (en) * 2005-09-12 2010-03-30 Richard Aylward Seat electroacoustical transducing
US7698009B2 (en) * 2005-10-27 2010-04-13 Avid Technology, Inc. Control surface with a touchscreen for editing surround sound
WO2007141923A1 (en) * 2006-06-02 2007-12-13 Nec Corporation Gain control system, gain control method, and gain control program
US8515105B2 (en) * 2006-08-29 2013-08-20 The Regents Of The University Of California System and method for sound generation
US8930002B2 (en) * 2006-10-11 2015-01-06 Core Wireless Licensing S.A.R.L. Mobile communication terminal and method therefor
US20080252637A1 (en) * 2007-04-14 2008-10-16 Philipp Christian Berndt Virtual reality-based teleconferencing
US20080256452A1 (en) * 2007-04-14 2008-10-16 Philipp Christian Berndt Control of an object in a virtual representation by an audio-only device
US20080253547A1 (en) * 2007-04-14 2008-10-16 Philipp Christian Berndt Audio control for teleconferencing
JP4841495B2 (en) * 2007-04-16 2011-12-21 ソニー株式会社 Sound reproduction system and speaker device
US8724827B2 (en) * 2007-05-04 2014-05-13 Bose Corporation System and method for directionally radiating sound
US8325936B2 (en) * 2007-05-04 2012-12-04 Bose Corporation Directionally radiating sound in a vehicle
US8483413B2 (en) * 2007-05-04 2013-07-09 Bose Corporation System and method for directionally radiating sound
US9100748B2 (en) * 2007-05-04 2015-08-04 Bose Corporation System and method for directionally radiating sound
US20080273722A1 (en) * 2007-05-04 2008-11-06 Aylward J Richard Directionally radiating sound in a vehicle
AU2008207352A1 (en) * 2007-08-23 2009-03-12 Aristocrat Technologies Australia Pty Limited Gaming system, method of gaming and a sound controller
US8029363B2 (en) 2008-06-03 2011-10-04 Wms Gaming Inc. Wagering game machine with area sound panning
CN102209988B (en) * 2008-09-11 2014-01-08 弗劳恩霍夫应用研究促进协会 Apparatus, method and computer program for providing a set of spatial cues on the basis of a microphone signal and apparatus for providing a two-channel audio signal and a set of spatial cues
US8023660B2 (en) * 2008-09-11 2011-09-20 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Apparatus, method and computer program for providing a set of spatial cues on the basis of a microphone signal and apparatus for providing a two-channel audio signal and a set of spatial cues
US20100223552A1 (en) * 2009-03-02 2010-09-02 Metcalf Randall B Playback Device For Generating Sound Events
CN104822036B (en) 2010-03-23 2018-03-30 杜比实验室特许公司 The technology of audio is perceived for localization
US10158958B2 (en) 2010-03-23 2018-12-18 Dolby Laboratories Licensing Corporation Techniques for localized perceptual audio
US9857868B2 (en) 2011-03-19 2018-01-02 The Board Of Trustees Of The Leland Stanford Junior University Method and system for ergonomic touch-free interface
US8840466B2 (en) 2011-04-25 2014-09-23 Aquifi, Inc. Method and system to create three-dimensional mapping in a two-dimensional game
WO2013006325A1 (en) * 2011-07-01 2013-01-10 Dolby Laboratories Licensing Corporation Upmixing object based audio
US9408011B2 (en) 2011-12-19 2016-08-02 Qualcomm Incorporated Automated user/sensor location recognition to customize audio performance in a distributed multi-sensor environment
US8854433B1 (en) 2012-02-03 2014-10-07 Aquifi, Inc. Method and system enabling natural user interface gestures with an electronic system
US9111135B2 (en) 2012-06-25 2015-08-18 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera
US9098739B2 (en) 2012-06-25 2015-08-04 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching
US9532153B2 (en) * 2012-08-29 2016-12-27 Bang & Olufsen A/S Method and a system of providing information to a user
US8836768B1 (en) 2012-09-04 2014-09-16 Aquifi, Inc. Method and system enabling natural user interface gestures with user wearable glasses
US9154877B2 (en) * 2012-11-28 2015-10-06 Qualcomm Incorporated Collaborative sound system
US9098487B2 (en) 2012-11-29 2015-08-04 Hewlett-Packard Development Company, L.P. Categorization based on word distance
US9129155B2 (en) 2013-01-30 2015-09-08 Aquifi, Inc. Systems and methods for initializing motion tracking of human hands using template matching within bounded regions determined using a depth map
US9092665B2 (en) 2013-01-30 2015-07-28 Aquifi, Inc Systems and methods for initializing motion tracking of human hands
US10038957B2 (en) * 2013-03-19 2018-07-31 Nokia Technologies Oy Audio mixing based upon playing device location
US9298266B2 (en) 2013-04-02 2016-03-29 Aquifi, Inc. Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
TWI530941B (en) 2013-04-03 2016-04-21 杜比實驗室特許公司 Methods and systems for interactive rendering of object based audio
US9798388B1 (en) 2013-07-31 2017-10-24 Aquifi, Inc. Vibrotactile system to augment 3D input systems
US9507417B2 (en) 2014-01-07 2016-11-29 Aquifi, Inc. Systems and methods for implementing head tracking based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9619105B1 (en) 2014-01-30 2017-04-11 Aquifi, Inc. Systems and methods for gesture based interaction with viewpoint dependent user interfaces
CN104134226B (en) * 2014-03-12 2015-08-19 腾讯科技(深圳)有限公司 Speech simulation method, device and client device in a kind of virtual scene
US11900734B2 (en) 2014-06-02 2024-02-13 Accesso Technology Group Plc Queuing system
GB201409764D0 (en) 2014-06-02 2014-07-16 Accesso Technology Group Plc Queuing system
CN105989845B (en) 2015-02-25 2020-12-08 杜比实验室特许公司 Video content assisted audio object extraction
US11122384B2 (en) 2017-09-12 2021-09-14 The Regents Of The University Of California Devices and methods for binaural spatial processing and projection of audio signals
US20220387885A1 (en) * 2019-11-19 2022-12-08 Immersion Corporation Dynamic modification of multiple haptic effects

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4060696A (en) * 1975-06-20 1977-11-29 Victor Company Of Japan, Limited Binaural four-channel stereophony
US4121058A (en) * 1976-12-13 1978-10-17 E-Systems, Inc. Voice processor
DE3168990D1 (en) * 1980-03-19 1985-03-28 Matsushita Electric Ind Co Ltd Sound reproducing system having sonic image localization networks
US4532647A (en) * 1981-08-19 1985-07-30 John C. Bogue Automatic dimension control for a directional enhancement system
US4525855A (en) * 1981-08-27 1985-06-25 John C. Bogue Variable rate and variable limit dimension controls for a directional enhancement system
JPS59225700A (en) * 1983-06-06 1984-12-18 Fujitsu Ten Ltd Device for controlling sound field
JPS62122500A (en) * 1985-11-22 1987-06-03 Sony Corp Multi-channel stereo reproducing device
US5222059A (en) * 1988-01-06 1993-06-22 Lucasfilm Ltd. Surround-sound system with motion picture soundtrack timbre correction, surround sound channel timbre correction, defined loudspeaker directionality, and reduced comb-filter effects
US5043970A (en) * 1988-01-06 1991-08-27 Lucasarts Entertainment Company Sound system with source material and surround timbre response correction, specified front and surround loudspeaker directionality, and multi-loudspeaker surround
US5216718A (en) * 1990-04-26 1993-06-01 Sanyo Electric Co., Ltd. Method and apparatus for processing audio signals
US5386082A (en) * 1990-05-08 1995-01-31 Yamaha Corporation Method of detecting localization of acoustic image and acoustic image localizing system
GB2244629B (en) * 1990-05-30 1994-03-16 Sony Corp Three channel audio transmission and/or reproduction systems
US5339363A (en) * 1990-06-08 1994-08-16 Fosgate James W Apparatus for enhancing monophonic audio signals using phase shifters
NL9200391A (en) * 1992-03-03 1993-10-01 Nederland Ptt DEVICE FOR MAKING A CHANGE IN A FLOW OF TRANSMISSION CELLS.
JPH08502867A (en) * 1992-10-29 1996-03-26 ウィスコンシン アラムニ リサーチ ファンデーション Method and device for producing directional sound
US5406634A (en) * 1993-03-16 1995-04-11 Peak Audio, Inc. Intelligent speaker unit for speaker system network
US5371799A (en) * 1993-06-01 1994-12-06 Qsound Labs, Inc. Stereo headphone sound source localization system
ES2165370T3 (en) * 1993-06-22 2002-03-16 Thomson Brandt Gmbh METHOD FOR OBTAINING A MULTICHANNEL DECODING MATRIX.
DE69433258T2 (en) * 1993-07-30 2004-07-01 Victor Company of Japan, Ltd., Yokohama Surround sound signal processing device
US5487113A (en) * 1993-11-12 1996-01-23 Spheric Audio Laboratories, Inc. Method and apparatus for generating audiospatial effects
US5521981A (en) * 1994-01-06 1996-05-28 Gehring; Louis S. Sound positioner
CA2126903C (en) * 1994-06-28 1996-12-24 Stephen Hon Digital surround sound method and apparatus

Also Published As

Publication number Publication date
EP0903057A1 (en) 1999-03-24
US6154549A (en) 2000-11-28
EP0903057A4 (en) 2001-05-02
WO1997049262A1 (en) 1997-12-24
AU3489797A (en) 1998-01-07

Similar Documents

Publication Publication Date Title
US6154549A (en) Method and apparatus for providing sound in a spatial environment
US5850455A (en) Discrete dynamic positioning of audio signals in a 360° environment
JP6186436B2 (en) Reflective and direct rendering of up-mixed content to individually specifiable drivers
JP5985063B2 (en) Bidirectional interconnect for communication between the renderer and an array of individually specifiable drivers
EP3092824B1 (en) Calibration of virtual height speakers using programmable portable devices
EP0517848B1 (en) Sound mixing device
US9131305B2 (en) Configurable three-dimensional sound system
US9377941B2 (en) Audio speaker selection for optimization of sound origin
CA3123982C (en) Apparatus and method for reproducing a spatially extended sound source or apparatus and method for generating a bitstream from a spatially extended sound source
US6038330A (en) Virtual sound headset and method for simulating spatial sound
US8626321B2 (en) Processing audio input signals
WO2014077374A1 (en) Audio signal processing device, position information acquisition device, and audio signal processing system
KR20040004566A (en) Method and apparatus to create a sound field
WO1996033591A1 (en) An acoustical audio system for producing three dimensional sound image
US20060050908A1 (en) Personalized surround sound headphone system
KR20220156809A (en) Apparatus and method for reproducing a spatially extended sound source using anchoring information or apparatus and method for generating a description of a spatially extended sound source
Barrett et al. The ‘Virtualmonium’: an instrument for classical sound diffusion over a virtual loudspeaker orchestra
Steffens et al. Auditory orientation and distance estimation of sighted humans using virtual echolocation with artificial and self-generated sounds
JP2004088608A (en) Mixing device
EP1617702B1 (en) Portable electronic equipment with 3D audio rendering
TW202337236A (en) Apparatus, method and computer program for synthesizing a spatially extended sound source using elementary spatial sectors
TW202327379A (en) Apparatus, method or computer program for synthesizing a spatially extended sound source using modification data on a potentially modifying object
Arnold et al. Discrete dynamic positioning of audio signals in a 360 environment
Dausel et al. Wave Field Synthesis for Games using the Open฀ L interface

Legal Events

Date Code Title Description
EEER Examination request
FZDE Discontinued