Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

An artificial, three dimensional auditory display which artificially imparts localization cues to a multifrequency component electronic signal which corresponds to a sound source. The cues imparted are a front to back cue in the form of attenuation and boosting of certain frequency components of the signal, an elevational cue in the form of severe attenuation of a selected frequency component, i.e. variable notch filtering, an azimuth cue by means of splitting the signal into two signals and delaying one of them by a selected amount which is not greater than 0.67 milliseconds, an out of head localization cue by introducing delayed signals corresponding to early reflections of the original signal, an environment cue by introducing reverberations and a depth cue by selectively amplitude scaling the primary signal and the early reflection and reverberation signals.

InventorPeter H. Myers
Original AssigneeAmerican Natural Sound Company
Current U.S. Classification381/1; 381/17; 381/63; 381/74
International Classification: H04S 100

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US4060696Jun 17, 1976Nov 29, 1977Victor Company of Japan, LimitedBinaural four-channel stereophony
US4119798Sep 3, 1976Oct 10, 1978Victor Company of Japan, LimitedBinaural multi-channel stereophony
US4143244Dec 21, 1976Mar 6, 1979Victor Company of Japan, LimitedBinaural sound reproducing system
US4188504Apr 25, 1978Feb 12, 1980Victor Company of Japan, LimitedSignal processing circuit for binaural signals
US4251688Jan 15, 1979Feb 17, 1981Ana Maria FurnerAudio-digital processing system for demultiplexing stereophonic/quadriphonic input audio signals into 4-to-72 output audio signals

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US4933768Jul 19, 1989Jun 12, 1990Sanyo Electric Co., Ltd.Sound reproducer
US5027687Oct 5, 1989Jul 2, 1991Yamaha CorporationSound field control device
US5027689Aug 31, 1989Jul 2, 1991Yamaha CorporationMusical tone generating apparatus
US5046097Sep 2, 1988Sep 3, 1991QSound Ltd.Sound imaging process
US5095798Jan 8, 1990Mar 17, 1992Nintendo Co. Ltd.Electronic gaming device with pseudo-stereophonic sound generating capabilities
US5105462May 2, 1991Apr 14, 1992QSound Ltd.Sound imaging method and apparatus
US5161196Nov 21, 1990Nov 3, 1992Apparatus and method for reducing motion sickness
US5208860Oct 31, 1991May 4, 1993QSound Ltd.Sound imaging method and apparatus
US5212733Feb 28, 1990May 18, 1993Voyager Sound, Inc.Sound mixing device
US5261005Oct 8, 1991Nov 9, 1993Yamaha CorporationSound field control device
US5337363Nov 2, 1992Aug 9, 1994The 3DO CompanyMethod for generating three dimensional sound
US5369224Jun 18, 1993Nov 29, 1994Yamaha CorporationElectronic musical instrument producing pitch-dependent stereo sound
US5381482Feb 1, 1993Jan 10, 1995Matsushita Electric Industrial Co., Ltd.Sound field controller
US5384851Apr 11, 1994Jan 24, 1995Yamaha CorporationMethod and apparatus for controlling sound localization
US5386082Oct 30, 1992Jan 31, 1995Yamaha CorporationMethod of detecting localization of acoustic image and acoustic image localizing system
US5412732Jan 13, 1993May 2, 1995Pioneer Electronic CorporationStereo surround system
US5418856Nov 18, 1993May 23, 1995Kabushiki Kaisha Kawai Gakki SeisakushoStereo signal generator
US5436975Feb 2, 1994Jul 25, 1995QSound Ltd.Apparatus for cross fading out of the head sound locations
US5438623Oct 4, 1993Aug 1, 1995The United States of America as represented by the Administrator of National Aeronautics and Space AdministrationMulti-channel spatialization system for audio signals
US5440639Oct 13, 1993Aug 8, 1995Yamaha CorporationSound localization control apparatus
US5572235Nov 2, 1992Nov 5, 1996The 3DO CompanyMethod and apparatus for processing image data
US5585587Sep 7, 1994Dec 17, 1996Yamaha CorporationAcoustic image localization apparatus for distributing tone color groups throughout sound field
US5587936Oct 5, 1993Dec 24, 1996VPL Research, Inc.Method and apparatus for creating sounds in a virtual world by simulating sound in specific locations in space and generating sounds as touch feedback
US5596644Oct 27, 1994Jan 21, 1997Aureal Semiconductor Inc.Method and apparatus for efficient presentation of high-quality three-dimensional audio
US5596693Jul 31, 1995Jan 21, 1997The 3DO CompanyMethod for controlling a spryte rendering processor
US5647016Aug 7, 1995Jul 8, 1997Man-machine interface in aerospace craft that produces a localized sound in response to the direction of a target relative to the facial direction of a crew
US5682433Nov 2, 1995Oct 28, 1997Audio signal processor for simulating the notional sound source
US5752073Jul 11, 1995May 12, 1998CagEnt Technologies, Inc.Digital signal processor architecture
US5754660Sep 20, 1996May 19, 1998Nintendo Co., Ltd.Sound generator synchronized with image display
US5768393Nov 7, 1995Jun 16, 1998Yamaha CorporationThree-dimensional sound system
US5771294Oct 3, 1996Jun 23, 1998Yamaha CorporationAcoustic image localization apparatus for distributing tone color groups throughout sound field
US5796843Sep 8, 1995Aug 18, 1998Sony CorporationVideo signal and audio signal reproducing apparatus
US5802180Jan 17, 1997Sep 1, 1998Aureal Semiconductor Inc.Method and apparatus for efficient presentation of high-quality three-dimensional audio including ambient effects
US5812674Aug 20, 1996Sep 22, 1998France TelecomMethod to simulate the acoustical quality of a room and associated audio-digital processor
US5820462Jul 31, 1995Oct 13, 1998Nintendo Company Ltd.Manipulator for game machine
US5838389Sep 2, 1994Nov 17, 1998The 3DO CompanyApparatus and method for updating a CLUT during horizontal blanking
US5861846Feb 15, 1996Jan 19, 1999Aviation pilot collision alert
US5862229Oct 9, 1997Jan 19, 1999Nintendo Co., Ltd.Sound generator synchronized with image display
US5905464Sep 3, 1997May 18, 1999Rockwell-Collins FrancePersonal direction-finding apparatus
US5919092Sep 3, 1997Jul 6, 1999Nintendo Co., Ltd.Manipulator for game machine
US5943427Apr 21, 1995Aug 24, 1999Creative Technology Ltd.Method and apparatus for three dimensional audio spatialization
US5959597Sep 19, 1996Sep 28, 1999Sony CorporationImage/audio reproducing system
US6001015Sep 24, 1996Dec 14, 1999Nintendo Co., Ltd.Operation controlling device and video processing system used therewith
US6002351Jul 9, 1997Dec 14, 1999Nintendo Co., Ltd.
Hoshiden Corporation
Joystick device
US6021205Aug 20, 1996Feb 1, 2000Sony CorporationHeadphone device
US6022274Nov 22, 1995Feb 8, 2000Nintendo Co., Ltd.Video game system using memory module
US6026169May 23, 1996Feb 15, 2000Yamaha CorporationSound image localization device
US6038330Feb 20, 1998Mar 14, 2000Virtual sound headset and method for simulating spatial sound
US6042533Jul 24, 1998Mar 28, 2000Apparatus and method for relieving motion sickness
US6071191May 2, 1997Jun 6, 2000Nintendo Co., Ltd.Systems and methods for providing security in a video game system
US6078669Jul 14, 1997Jun 20, 2000EuPhonics, IncorporatedAudio spatial localization apparatus and methods
US6088461Sep 26, 1997Jul 11, 2000Crystal Semiconductor CorporationDynamic volume control system
US6091824Sep 26, 1997Jul 18, 2000Crystal Semiconductor CorporationReduced-memory early reflection and reverberation simulator and method
US6125115Feb 12, 1998Sep 26, 2000QSound Labs, Inc.Teleconferencing method and apparatus with three-dimensional sound positioning
US6178245Apr 12, 2000Jan 23, 2001National Semiconductor CorporationAudio signal generator to emulate three-dimensional audio signals
US6188769Nov 12, 1999Feb 13, 2001Creative Technology Ltd.Environmental reverberation processor
US6190257Aug 23, 1999Feb 20, 2001Nintendo Co., Ltd.Systems and method for providing security in a video game system
US6191772Jul 2, 1998Feb 20, 2001CagEnt Technologies, Inc.Resolution enhancement for video display using multi-line interpolation
US6243476Jun 18, 1997Jun 5, 2001Massachusetts Institute of TechnologyMethod and apparatus for producing binaural audio for a moving listener
US6330486Jul 16, 1997Dec 11, 2001Silicon Graphics, Inc.Acoustic perspective in a virtual three-dimensional environment
US6332840Jan 6, 1999Dec 25, 2001Ninetendo Co., Ltd.Operation controlling device and video processing system used therewith
US6383079Jul 19, 1999May 7, 2002Nintendo Co., Ltd.High performance/low cost video game system with multi-functional peripheral processing subsystem
US6394905Sep 12, 2000May 28, 2002Nintendo Co., Ltd.Systems and methods for providing security in a video game system
US6404442Mar 25, 1999Jun 11, 2002International Business Machines CorporationImage finding enablement with projected audio
US6418226Dec 10, 1997Jul 9, 2002Yamaha CorporationMethod of positioning sound image with distance adjustment
US6443913Mar 7, 2000Sep 3, 2002Apparatus and method for relieving motion sickness
US6445798Jan 21, 1998Sep 3, 2002Method of generating three-dimensional sound
US6469712Mar 25, 1999Oct 22, 2002International Business Machines CorporationProjected audio for computer displays
US6611603Aug 19, 1999Aug 26, 2003Harman International Industries, IncorporatedSteering of monaural sources of sound using head related transfer functions
US6692428Dec 10, 1999Feb 17, 2004Apparatus and method for relieving motion sickness
US6917686Feb 12, 2001Jul 12, 2005Creative Technology, Ltd.Environmental reverberation processor
US6956955Aug 6, 2001Oct 18, 2005The United States of America as represented by the Secretary of the Air ForceSpeech-based auditory distance display
US6978027Apr 11, 2000Dec 20, 2005Creative Technology Ltd.Reverberation processor for interactive audio applications
US7031474Oct 4, 1999Apr 18, 2006SRS Labs, Inc.Acoustic correction apparatus
US7099482Mar 8, 2002Aug 29, 2006Creative Technology LtdMethod and apparatus for the simulation of complex audio environments
US7174229Nov 13, 1998Feb 6, 2007Agere Systems Inc.Method and apparatus for processing interaural time delay in 3D digital audio
US7260231May 26, 1999Aug 21, 2007Multi-channel audio panel
US7277767Dec 11, 2000Oct 2, 2007SRS Labs, Inc.System and method for enhanced streaming audio
US7333622Apr 15, 2003Feb 19, 2008The Regents of the University of CaliforniaDynamic binaural sound capture and reproduction
US7391877Mar 30, 2007Jun 24, 2008United States of America as represented by the Secretary of the Air ForceSpatial processor for enhanced performance in multi-talker speech displays
US7467021Nov 19, 2004Dec 16, 2008SRS Labs, Inc.System and method for enhanced streaming audio
US7474754Sep 30, 2002Jan 6, 2009Koninklijke Philips Electronics N. V.Method for canceling unwanted loudspeaker signals
US7489788Jul 18, 2002Feb 10, 2009Personal Audio Pty LtdRecording a three dimensional auditory scene and reproducing it for the individual listener
US7522734Jan 12, 2004Apr 21, 2009The Board of Trustees of the Leland Stanford Junior UniversityDistributed acoustic reverberation for audio collaboration
US7561699Oct 26, 2004Jul 14, 2009Creative Technology LtdEnvironmental reverberation processor
US7602921Jul 17, 2002Oct 13, 2009Panasonic CorporationSound image localizer
US7676047Mar 7, 2003Mar 9, 2010Bose CorporationElectroacoustical transducing with low frequency augmenting devices
US7822496Oct 10, 2003Oct 26, 2010Sony CorporationAudio signal processing method and apparatus
US7907736Feb 8, 2006Mar 15, 2011SRS Labs, Inc.Acoustic correction apparatus
US7987281Oct 2, 2007Jul 26, 2011SRS Labs, Inc.System and method for enhanced streaming audio
US8027477Sep 13, 2006Sep 27, 2011SRS Labs, Inc.Systems and methods for audio processing
US8037414Sep 14, 2006Oct 11, 2011Avaya Inc.Audible computer user interface method and apparatus
US8041040May 31, 2007Oct 18, 2011Panasonic CorporationSound image control apparatus and sound image control method
US8046093Dec 8, 2008Oct 25, 2011SRS Labs, Inc.System and method for enhanced streaming audio
US8050434Dec 21, 2007Nov 1, 2011SRS Labs, Inc.Multi-channel audio enhancement system
US8139797Aug 18, 2003Mar 20, 2012Bose CorporationDirectional electroacoustical transducing
US8155323Dec 6, 2002Apr 10, 2012Dolby Laboratories Licensing CorporationMethod for improving spatial perception in virtual surround
US8200488Dec 10, 2003Jun 12, 2012Sony Deutschland GmbHMethod for processing speech using absolute loudness
US8238578Jan 8, 2010Aug 7, 2012Bose CorporationElectroacoustical transducing with low frequency augmenting devices
USRE38276Feb 11, 1997Oct 21, 2003Yamaha CorporationTone generating apparatus for sound imaging

Claims

1. A three dimensional auditory display apparatus for selectively giving the illusion of sound localization to a listener comprising

means or receiving at least one multifrequency component, electronic input signal which is representative of one or more sound signals,
front to back localization means for boosting the amplitudes of certain frequency components of the amplitudes of other frequency components of the input signal to selectively give the illusion that the sound source of the signal is positioned either ahead of or behind the listener and for thereby outputting the input signal with a front to back cue;
elevation localization means, including a variable notch filter, connected to the front to back localization means for selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener and to thereby output a signal to which a front to back cue and an elevational cue have been imparted; and
azimuth localization means connected to the elevation localization means for generating two output signals corresponding to the front to back and elevation cued signal output from the elevation localization means, with one of the two output signals being delayed with respect to the other by a selected period of time to shift the apparent location of the sound source to the left or the right of the listener, the azimuth localization means further including elevation adjustment means for decreasing the time delay with increases in the apparent elevation of the sound source with respect to the listener, the azimuth location means being connected in series with the front to back localization means and the elevation localization means.

2. A three dimensional auditory display apparatus as recited in claim 1 wherein the elevation adjustment means varies the time delay according to the function:

T.sub.delay =(4.566.multidot.10.sup.-6 .multidot.(arcsin(sin(Az).multidot.cos(E1))))+(2.616.multidot.10.sup.-4 .multidot.(sin(Az).multidot.cos(E1))))

where Az and E1 are the angles of azimuth and elevation, respectively, of the sound source with respect to the listener.

3. A three dimensional auditory display apparatus as recited in claim 1 further comprising out of head localization means for outputting multiple delayed output signals corresponding to the input signal, reverberation means for outputting reverberant signals corresponding to the input signal, and mixer means for combining and amplitude scaling the outputs of the out of head localization means, the reverberation means and the two output signals from the azimuth localization means to produce binaural signals.

4. A three dimensional auditory display apparatus as recited in claim 3 further comprising transducer means for converting the binaural signals into audible sounds.

5. A three dimensional auditory display apparatus as recited in claim 1 wherein the azimuth localization means selectively delays one of the two output signals relative to the other output signals between 0 and 0.67 milliseconds.

6. A three dimensional auditory display apparatus as recited in claim 3 wherein the reverberation means selectively outputs signals corresponding to the input signal but delayed in the range of between 0.1 and 15 seconds.

7. A three dimensional auditory display apparatus as recited in claim 3 further comprising at least one focus means supplied with at least one of the outputs of the out of head localization means or the reverberation means for selectively bandpass filtering the supplied output to limit the frequency components to 250 Hz, plus or minus 200 Hz to impart a cue of envelopment, to 1.5 KHz, plus or minus 500 Hz to impart a cue of source broadening, and to 4 KHz and above to impart a displaced image cue.

8. A three dimensional auditory display apparatus as recited in claim 3 wherein the out of head localization means further comprises means for introducing separate, selected interaural time delays for each of the multiple delayed output signals.

9. A three dimensional auditory display apparatus as recited in claim 3 wherein the input signal is representative of a direct sound signal.

10. A three dimensional auditory display apparatus for selectively giving illusion of sound localization to a listener comprising

means for receiving at least one multifrequency component, electronic input signal which is representative of one or more sound signals,
front to back localization means for selectively boosting biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz to introduce a front cue to the biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the electronic input signal while simultaneously boosting biasing bands those center frequencies are approximated at 1188 Hz and 10938 Hz to introduce a rear cue to the electronic input signal, the front to back localization means thereby outputting a front to back cued signal; and
elevation location means, including a variable notch filter, connected to the front to back localization means for selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener and to thereby output a signal to which a front to back cue and an elevational cue have been imparted.

11. A three dimensional auditory display apparatus as recited in claims 1 or 10 wherein the front to back location means comprises a finite impulse filter.

12. A three dimensional auditory display apparatus as recited in claims 1 or 10 wherein the elevation localization means attenuates a selected frequency component within a range of between 6 KHz and 12 KHz to impart an elevation cue in the range of between -45.degree. and +45.degree., respectively, relative to the listener's ear.

13. A three dimensional auditory display apparatus as recited in claims 1 to 10 further comprising a pair of front to back localization means and a pair of elevation localization means and further comprising a pair of microphones spaced apart by the approximate width of a human head, each of the microphones producing a separate electronic input signal which is supplied to a different one of the front to back localization means, whereby the outputs of the pair of elevation localization means constitute binaural signals.

14. A method of creating a three dimensional auditory display for selectively giving the illusion of sound localization to a listener comprising the following steps:

front to back localizing by receiving at least one multifrequency component, electronic input signal which is representative of at least one sound signal and boosting the amplitudes of certain frequency components of the input signal while simultaneously attenuating the amplitudes of other frequency components of the input signal to selectively produce a front to back cued signal giving the illusion to the listener that the sound source is either ahead of or behind the listener and
elevational localizing by selectively attenuating a selected frequency component of the front to back cued signal to produce a front to back and elevation cued signal giving the illusion that the sound source of the signal is at a particular elevation with respect to the listener; and
azimuth localizing by generating two output signals corresponding to the front to back and elevation cued signal, with one of the output signals being delayed with respect to the other by a selected period of time to shift the apparent sound source to the left or the right of the listener and decreasing the time delay with increases in the apparent elevation of the sound source with respect to the listener to impart an azimuth cue to the front to back and elevation cued signal.

15. A method of creating a three dimensional auditory display for selectively giving the illusion of sound localization to a listener comprising the following steps:

front to back localizing by receiving at least one multifrequency component, electronic input signal which is representative of at least one sound signal and selectively boosting biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the signal while simultaneously attenuating biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz and selectively attenuating biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the signal while simultaneously boosting biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz to selectively produce a front to back cued signal which imparts to the listener the illusion that the sound source of the signal is either ahead of or behind the listener; and
elevational localizing by selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener.

16. A method of creating a three dimensional auditory display as recited in claims 14 or 15 wherein the elevation localizing step comprises the step of attenuating a selected frequency component within a range of between 6 KHz and 12 KHz to impart an elevation cue in the range of between -45.degree. and +45.degree., respectively, relative to the listener's ear.

17. A method of creating a three dimensional auditory display as recited in claims 14 or 15 comprising the further steps of transducing sound waves received at a positions spaced apart by a distance approximately the width of a human head into separate electrical input signals and separately front to back localizing and elevation localizing each of the separate input signals.

18. A method of creating a three dimensional auditory display as recited in claims 14 or 15 wherein the input signal is representative of a direct sound.

19. A method of creating a three dimensional auditory display as recited in claim 16 comprising the further steps of:

out of head localizing by generating multiple delayed signals corresponding to the input signal;
imparting reverberation and depth control by generating reverberant signals corresponding to the input signal; and
binaural signal generation by combining and amplitude scaling the multiple delayed signals, the reverberant signals and the two output signals to produce binaural signals.

20. A method of creating a three dimensional auditory display as recited in claim 19 further comprising the step of converting the binaural signals into audible sounds.

21. A method of creating a three dimensional auditory display as recited in claim 19 wherein the step of imparting reverberation comprises the step of generating signals corresponding to the input signal but delayed in the range of between 0.1 and 15 seconds.

22. A method of creating a three dimensional auditory display as recited in claim 14 wherein in the azimuth localizing step the time delay is determined according to the function:

T.sub.delay =(4.566.multidot.10.sup.-6 .multidot.(arcsin(sin(Az).multidot.cos(E1))))+(2.616.multidot.10.sup.-4 .multidot.(sin(Az).multidot.cos (E1)))

where Az and E1 are the angles of azimuth and elevation, respectively.

23. A method of creating a three dimensional auditory display as recited in claim 14 wherein the azimuth localizing step comprises the step of selectively delaying one of the two output signals relative to the other output signal between 0 and 0.67 milliseconds.