An artificial, three dimensional auditory display which artificially imparts localization cues to a multifrequency component electronic signal which corresponds to a sound source. The cues imparted are a front to back cue in the form of attenuation and boosting of certain frequency components of the signal, an elevational cue in the form of severe attenuation of a selected frequency component, i.e. variable notch filtering, an azimuth cue by means of splitting the signal into two signals and delaying one of them by a selected amount which is not greater than 0.67 milliseconds, an out of head localization cue by introducing delayed signals corresponding to early reflections of the original signal, an environment cue by introducing reverberations and a depth cue by selectively amplitude scaling the primary signal and the early reflection and reverberation signals. |
Citations|
| US4060696 | Jun 17, 1976 | Nov 29, 1977 | Victor Company of Japan, Limited | Binaural four-channel stereophony | | US4119798 | Sep 3, 1976 | Oct 10, 1978 | Victor Company of Japan, Limited | Binaural multi-channel stereophony | | US4143244 | Dec 21, 1976 | Mar 6, 1979 | Victor Company of Japan, Limited | Binaural sound reproducing system | | US4188504 | Apr 25, 1978 | Feb 12, 1980 | Victor Company of Japan, Limited | Signal processing circuit for binaural signals | | US4251688 | Jan 15, 1979 | Feb 17, 1981 | Ana Maria Furner | Audio-digital processing system for demultiplexing stereophonic/quadriphonic input audio signals into 4-to-72 output audio signals |
Referenced by|
| US4933768 | Jul 19, 1989 | Jun 12, 1990 | Sanyo Electric Co., Ltd. | Sound reproducer | | US5027687 | Oct 5, 1989 | Jul 2, 1991 | Yamaha Corporation | Sound field control device | | US5027689 | Aug 31, 1989 | Jul 2, 1991 | Yamaha Corporation | Musical tone generating apparatus | | US5046097 | Sep 2, 1988 | Sep 3, 1991 | QSound Ltd. | Sound imaging process | | US5095798 | Jan 8, 1990 | Mar 17, 1992 | Nintendo Co. Ltd. | Electronic gaming device with pseudo-stereophonic sound generating capabilities | | US5105462 | May 2, 1991 | Apr 14, 1992 | QSound Ltd. | Sound imaging method and apparatus | | US5161196 | Nov 21, 1990 | Nov 3, 1992 | | Apparatus and method for reducing motion sickness | | US5208860 | Oct 31, 1991 | May 4, 1993 | QSound Ltd. | Sound imaging method and apparatus | | US5212733 | Feb 28, 1990 | May 18, 1993 | Voyager Sound, Inc. | Sound mixing device | | US5261005 | Oct 8, 1991 | Nov 9, 1993 | Yamaha Corporation | Sound field control device | | US5337363 | Nov 2, 1992 | Aug 9, 1994 | The 3DO Company | Method for generating three dimensional sound | | US5369224 | Jun 18, 1993 | Nov 29, 1994 | Yamaha Corporation | Electronic musical instrument producing pitch-dependent stereo sound | | US5381482 | Feb 1, 1993 | Jan 10, 1995 | Matsushita Electric Industrial Co., Ltd. | Sound field controller | | US5384851 | Apr 11, 1994 | Jan 24, 1995 | Yamaha Corporation | Method and apparatus for controlling sound localization | | US5386082 | Oct 30, 1992 | Jan 31, 1995 | Yamaha Corporation | Method of detecting localization of acoustic image and acoustic image localizing system | | US5412732 | Jan 13, 1993 | May 2, 1995 | Pioneer Electronic Corporation | Stereo surround system | | US5418856 | Nov 18, 1993 | May 23, 1995 | Kabushiki Kaisha Kawai Gakki Seisakusho | Stereo signal generator | | US5436975 | Feb 2, 1994 | Jul 25, 1995 | QSound Ltd. | Apparatus for cross fading out of the head sound locations | | US5438623 | Oct 4, 1993 | Aug 1, 1995 | The United States of America as represented by the Administrator of National Aeronautics and Space Administration | Multi-channel spatialization system for audio signals | | US5440639 | Oct 13, 1993 | Aug 8, 1995 | Yamaha Corporation | Sound localization control apparatus | | US5572235 | Nov 2, 1992 | Nov 5, 1996 | The 3DO Company | Method and apparatus for processing image data | | US5585587 | Sep 7, 1994 | Dec 17, 1996 | Yamaha Corporation | Acoustic image localization apparatus for distributing tone color groups throughout sound field | | US5587936 | Oct 5, 1993 | Dec 24, 1996 | VPL Research, Inc. | Method and apparatus for creating sounds in a virtual world by simulating sound in specific locations in space and generating sounds as touch feedback | | US5596644 | Oct 27, 1994 | Jan 21, 1997 | Aureal Semiconductor Inc. | Method and apparatus for efficient presentation of high-quality three-dimensional audio | | US5596693 | Jul 31, 1995 | Jan 21, 1997 | The 3DO Company | Method for controlling a spryte rendering processor | | US5647016 | Aug 7, 1995 | Jul 8, 1997 | | Man-machine interface in aerospace craft that produces a localized sound in response to the direction of a target relative to the facial direction of a crew | | US5682433 | Nov 2, 1995 | Oct 28, 1997 | | Audio signal processor for simulating the notional sound source | | US5752073 | Jul 11, 1995 | May 12, 1998 | CagEnt Technologies, Inc. | Digital signal processor architecture | | US5754660 | Sep 20, 1996 | May 19, 1998 | Nintendo Co., Ltd. | Sound generator synchronized with image display | | US5768393 | Nov 7, 1995 | Jun 16, 1998 | Yamaha Corporation | Three-dimensional sound system | | US5771294 | Oct 3, 1996 | Jun 23, 1998 | Yamaha Corporation | Acoustic image localization apparatus for distributing tone color groups throughout sound field | | US5796843 | Sep 8, 1995 | Aug 18, 1998 | Sony Corporation | Video signal and audio signal reproducing apparatus | | US5802180 | Jan 17, 1997 | Sep 1, 1998 | Aureal Semiconductor Inc. | Method and apparatus for efficient presentation of high-quality three-dimensional audio including ambient effects | | US5812674 | Aug 20, 1996 | Sep 22, 1998 | France Telecom | Method to simulate the acoustical quality of a room and associated audio-digital processor | | US5820462 | Jul 31, 1995 | Oct 13, 1998 | Nintendo Company Ltd. | Manipulator for game machine | | US5838389 | Sep 2, 1994 | Nov 17, 1998 | The 3DO Company | Apparatus and method for updating a CLUT during horizontal blanking | | US5861846 | Feb 15, 1996 | Jan 19, 1999 | | Aviation pilot collision alert | | US5862229 | Oct 9, 1997 | Jan 19, 1999 | Nintendo Co., Ltd. | Sound generator synchronized with image display | | US5905464 | Sep 3, 1997 | May 18, 1999 | Rockwell-Collins France | Personal direction-finding apparatus | | US5919092 | Sep 3, 1997 | Jul 6, 1999 | Nintendo Co., Ltd. | Manipulator for game machine | | US5943427 | Apr 21, 1995 | Aug 24, 1999 | Creative Technology Ltd. | Method and apparatus for three dimensional audio spatialization | | US5959597 | Sep 19, 1996 | Sep 28, 1999 | Sony Corporation | Image/audio reproducing system | | US6001015 | Sep 24, 1996 | Dec 14, 1999 | Nintendo Co., Ltd. | Operation controlling device and video processing system used therewith | | US6002351 | Jul 9, 1997 | Dec 14, 1999 | Nintendo Co., Ltd. Hoshiden Corporation | Joystick device | | US6021205 | Aug 20, 1996 | Feb 1, 2000 | Sony Corporation | Headphone device | | US6022274 | Nov 22, 1995 | Feb 8, 2000 | Nintendo Co., Ltd. | Video game system using memory module | | US6026169 | May 23, 1996 | Feb 15, 2000 | Yamaha Corporation | Sound image localization device | | US6038330 | Feb 20, 1998 | Mar 14, 2000 | | Virtual sound headset and method for simulating spatial sound | | US6042533 | Jul 24, 1998 | Mar 28, 2000 | | Apparatus and method for relieving motion sickness | | US6071191 | May 2, 1997 | Jun 6, 2000 | Nintendo Co., Ltd. | Systems and methods for providing security in a video game system | | US6078669 | Jul 14, 1997 | Jun 20, 2000 | EuPhonics, Incorporated | Audio spatial localization apparatus and methods | | US6088461 | Sep 26, 1997 | Jul 11, 2000 | Crystal Semiconductor Corporation | Dynamic volume control system | | US6091824 | Sep 26, 1997 | Jul 18, 2000 | Crystal Semiconductor Corporation | Reduced-memory early reflection and reverberation simulator and method | | US6125115 | Feb 12, 1998 | Sep 26, 2000 | QSound Labs, Inc. | Teleconferencing method and apparatus with three-dimensional sound positioning | | US6178245 | Apr 12, 2000 | Jan 23, 2001 | National Semiconductor Corporation | Audio signal generator to emulate three-dimensional audio signals | | US6188769 | Nov 12, 1999 | Feb 13, 2001 | Creative Technology Ltd. | Environmental reverberation processor | | US6190257 | Aug 23, 1999 | Feb 20, 2001 | Nintendo Co., Ltd. | Systems and method for providing security in a video game system | | US6191772 | Jul 2, 1998 | Feb 20, 2001 | CagEnt Technologies, Inc. | Resolution enhancement for video display using multi-line interpolation | | US6243476 | Jun 18, 1997 | Jun 5, 2001 | Massachusetts Institute of Technology | Method and apparatus for producing binaural audio for a moving listener | | US6330486 | Jul 16, 1997 | Dec 11, 2001 | Silicon Graphics, Inc. | Acoustic perspective in a virtual three-dimensional environment | | US6332840 | Jan 6, 1999 | Dec 25, 2001 | Ninetendo Co., Ltd. | Operation controlling device and video processing system used therewith | | US6383079 | Jul 19, 1999 | May 7, 2002 | Nintendo Co., Ltd. | High performance/low cost video game system with multi-functional peripheral processing subsystem | | US6394905 | Sep 12, 2000 | May 28, 2002 | Nintendo Co., Ltd. | Systems and methods for providing security in a video game system | | US6404442 | Mar 25, 1999 | Jun 11, 2002 | International Business Machines Corporation | Image finding enablement with projected audio | | US6418226 | Dec 10, 1997 | Jul 9, 2002 | Yamaha Corporation | Method of positioning sound image with distance adjustment | | US6443913 | Mar 7, 2000 | Sep 3, 2002 | | Apparatus and method for relieving motion sickness | | US6445798 | Jan 21, 1998 | Sep 3, 2002 | | Method of generating three-dimensional sound | | US6469712 | Mar 25, 1999 | Oct 22, 2002 | International Business Machines Corporation | Projected audio for computer displays | | US6611603 | Aug 19, 1999 | Aug 26, 2003 | Harman International Industries, Incorporated | Steering of monaural sources of sound using head related transfer functions | | US6692428 | Dec 10, 1999 | Feb 17, 2004 | | Apparatus and method for relieving motion sickness | | US6917686 | Feb 12, 2001 | Jul 12, 2005 | Creative Technology, Ltd. | Environmental reverberation processor | | US6956955 | Aug 6, 2001 | Oct 18, 2005 | The United States of America as represented by the Secretary of the Air Force | Speech-based auditory distance display | | US6978027 | Apr 11, 2000 | Dec 20, 2005 | Creative Technology Ltd. | Reverberation processor for interactive audio applications | | US7031474 | Oct 4, 1999 | Apr 18, 2006 | SRS Labs, Inc. | Acoustic correction apparatus | | US7099482 | Mar 8, 2002 | Aug 29, 2006 | Creative Technology Ltd | Method and apparatus for the simulation of complex audio environments | | US7174229 | Nov 13, 1998 | Feb 6, 2007 | Agere Systems Inc. | Method and apparatus for processing interaural time delay in 3D digital audio | | US7260231 | May 26, 1999 | Aug 21, 2007 | | Multi-channel audio panel | | US7277767 | Dec 11, 2000 | Oct 2, 2007 | SRS Labs, Inc. | System and method for enhanced streaming audio | | US7333622 | Apr 15, 2003 | Feb 19, 2008 | The Regents of the University of California | Dynamic binaural sound capture and reproduction | | US7391877 | Mar 30, 2007 | Jun 24, 2008 | United States of America as represented by the Secretary of the Air Force | Spatial processor for enhanced performance in multi-talker speech displays | | US7467021 | Nov 19, 2004 | Dec 16, 2008 | SRS Labs, Inc. | System and method for enhanced streaming audio | | US7474754 | Sep 30, 2002 | Jan 6, 2009 | Koninklijke Philips Electronics N. V. | Method for canceling unwanted loudspeaker signals | | US7489788 | Jul 18, 2002 | Feb 10, 2009 | Personal Audio Pty Ltd | Recording a three dimensional auditory scene and reproducing it for the individual listener | | US7522734 | Jan 12, 2004 | Apr 21, 2009 | The Board of Trustees of the Leland Stanford Junior University | Distributed acoustic reverberation for audio collaboration | | US7561699 | Oct 26, 2004 | Jul 14, 2009 | Creative Technology Ltd | Environmental reverberation processor | | US7602921 | Jul 17, 2002 | Oct 13, 2009 | Panasonic Corporation | Sound image localizer | | US7676047 | Mar 7, 2003 | Mar 9, 2010 | Bose Corporation | Electroacoustical transducing with low frequency augmenting devices | | US7822496 | Oct 10, 2003 | Oct 26, 2010 | Sony Corporation | Audio signal processing method and apparatus | | US7907736 | Feb 8, 2006 | Mar 15, 2011 | SRS Labs, Inc. | Acoustic correction apparatus | | US7987281 | Oct 2, 2007 | Jul 26, 2011 | SRS Labs, Inc. | System and method for enhanced streaming audio | | US8027477 | Sep 13, 2006 | Sep 27, 2011 | SRS Labs, Inc. | Systems and methods for audio processing | | US8037414 | Sep 14, 2006 | Oct 11, 2011 | Avaya Inc. | Audible computer user interface method and apparatus | | US8041040 | May 31, 2007 | Oct 18, 2011 | Panasonic Corporation | Sound image control apparatus and sound image control method | | US8046093 | Dec 8, 2008 | Oct 25, 2011 | SRS Labs, Inc. | System and method for enhanced streaming audio | | US8050434 | Dec 21, 2007 | Nov 1, 2011 | SRS Labs, Inc. | Multi-channel audio enhancement system | | US8139797 | Aug 18, 2003 | Mar 20, 2012 | Bose Corporation | Directional electroacoustical transducing | | US8155323 | Dec 6, 2002 | Apr 10, 2012 | Dolby Laboratories Licensing Corporation | Method for improving spatial perception in virtual surround | | US8200488 | Dec 10, 2003 | Jun 12, 2012 | Sony Deutschland GmbH | Method for processing speech using absolute loudness | | US8238578 | Jan 8, 2010 | Aug 7, 2012 | Bose Corporation | Electroacoustical transducing with low frequency augmenting devices | | USRE38276 | Feb 11, 1997 | Oct 21, 2003 | Yamaha Corporation | Tone generating apparatus for sound imaging |
Claims1. A three dimensional auditory display apparatus for selectively giving the illusion of sound localization to a listener comprising - means or receiving at least one multifrequency component, electronic input signal which is representative of one or more sound signals,
- front to back localization means for boosting the amplitudes of certain frequency components of the amplitudes of other frequency components of the input signal to selectively give the illusion that the sound source of the signal is positioned either ahead of or behind the listener and for thereby outputting the input signal with a front to back cue;
- elevation localization means, including a variable notch filter, connected to the front to back localization means for selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener and to thereby output a signal to which a front to back cue and an elevational cue have been imparted; and
- azimuth localization means connected to the elevation localization means for generating two output signals corresponding to the front to back and elevation cued signal output from the elevation localization means, with one of the two output signals being delayed with respect to the other by a selected period of time to shift the apparent location of the sound source to the left or the right of the listener, the azimuth localization means further including elevation adjustment means for decreasing the time delay with increases in the apparent elevation of the sound source with respect to the listener, the azimuth location means being connected in series with the front to back localization means and the elevation localization means.
2. A three dimensional auditory display apparatus as recited in claim 1 wherein the elevation adjustment means varies the time delay according to the function: - T.sub.delay =(4.566.multidot.10.sup.-6 .multidot.(arcsin(sin(Az).multidot.cos(E1))))+(2.616.multidot.10.sup.-4 .multidot.(sin(Az).multidot.cos(E1))))
- where Az and E1 are the angles of azimuth and elevation, respectively, of the sound source with respect to the listener.
3. A three dimensional auditory display apparatus as recited in claim 1 further comprising out of head localization means for outputting multiple delayed output signals corresponding to the input signal, reverberation means for outputting reverberant signals corresponding to the input signal, and mixer means for combining and amplitude scaling the outputs of the out of head localization means, the reverberation means and the two output signals from the azimuth localization means to produce binaural signals. 4. A three dimensional auditory display apparatus as recited in claim 3 further comprising transducer means for converting the binaural signals into audible sounds. 5. A three dimensional auditory display apparatus as recited in claim 1 wherein the azimuth localization means selectively delays one of the two output signals relative to the other output signals between 0 and 0.67 milliseconds. 6. A three dimensional auditory display apparatus as recited in claim 3 wherein the reverberation means selectively outputs signals corresponding to the input signal but delayed in the range of between 0.1 and 15 seconds. 7. A three dimensional auditory display apparatus as recited in claim 3 further comprising at least one focus means supplied with at least one of the outputs of the out of head localization means or the reverberation means for selectively bandpass filtering the supplied output to limit the frequency components to 250 Hz, plus or minus 200 Hz to impart a cue of envelopment, to 1.5 KHz, plus or minus 500 Hz to impart a cue of source broadening, and to 4 KHz and above to impart a displaced image cue. 8. A three dimensional auditory display apparatus as recited in claim 3 wherein the out of head localization means further comprises means for introducing separate, selected interaural time delays for each of the multiple delayed output signals. 9. A three dimensional auditory display apparatus as recited in claim 3 wherein the input signal is representative of a direct sound signal. 10. A three dimensional auditory display apparatus for selectively giving illusion of sound localization to a listener comprising - means for receiving at least one multifrequency component, electronic input signal which is representative of one or more sound signals,
- front to back localization means for selectively boosting biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz to introduce a front cue to the biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the electronic input signal while simultaneously boosting biasing bands those center frequencies are approximated at 1188 Hz and 10938 Hz to introduce a rear cue to the electronic input signal, the front to back localization means thereby outputting a front to back cued signal; and
- elevation location means, including a variable notch filter, connected to the front to back localization means for selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener and to thereby output a signal to which a front to back cue and an elevational cue have been imparted.
11. A three dimensional auditory display apparatus as recited in claims 1 or 10 wherein the front to back location means comprises a finite impulse filter. 12. A three dimensional auditory display apparatus as recited in claims 1 or 10 wherein the elevation localization means attenuates a selected frequency component within a range of between 6 KHz and 12 KHz to impart an elevation cue in the range of between -45.degree. and +45.degree., respectively, relative to the listener's ear. 13. A three dimensional auditory display apparatus as recited in claims 1 to 10 further comprising a pair of front to back localization means and a pair of elevation localization means and further comprising a pair of microphones spaced apart by the approximate width of a human head, each of the microphones producing a separate electronic input signal which is supplied to a different one of the front to back localization means, whereby the outputs of the pair of elevation localization means constitute binaural signals. 14. A method of creating a three dimensional auditory display for selectively giving the illusion of sound localization to a listener comprising the following steps: - front to back localizing by receiving at least one multifrequency component, electronic input signal which is representative of at least one sound signal and boosting the amplitudes of certain frequency components of the input signal while simultaneously attenuating the amplitudes of other frequency components of the input signal to selectively produce a front to back cued signal giving the illusion to the listener that the sound source is either ahead of or behind the listener and
- elevational localizing by selectively attenuating a selected frequency component of the front to back cued signal to produce a front to back and elevation cued signal giving the illusion that the sound source of the signal is at a particular elevation with respect to the listener; and
- azimuth localizing by generating two output signals corresponding to the front to back and elevation cued signal, with one of the output signals being delayed with respect to the other by a selected period of time to shift the apparent sound source to the left or the right of the listener and decreasing the time delay with increases in the apparent elevation of the sound source with respect to the listener to impart an azimuth cue to the front to back and elevation cued signal.
15. A method of creating a three dimensional auditory display for selectively giving the illusion of sound localization to a listener comprising the following steps: - front to back localizing by receiving at least one multifrequency component, electronic input signal which is representative of at least one sound signal and selectively boosting biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the signal while simultaneously attenuating biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz and selectively attenuating biasing bands whose center frequencies are approximated at 392 Hz and 3605 Hz of the signal while simultaneously boosting biasing bands whose center frequencies are approximated at 1188 Hz and 10938 Hz to selectively produce a front to back cued signal which imparts to the listener the illusion that the sound source of the signal is either ahead of or behind the listener; and
- elevational localizing by selectively attenuating a selected frequency component of the front to back cued signal to give the illusion that the sound source of the signal is at a particular elevation with respect to the listener.
16. A method of creating a three dimensional auditory display as recited in claims 14 or 15 wherein the elevation localizing step comprises the step of attenuating a selected frequency component within a range of between 6 KHz and 12 KHz to impart an elevation cue in the range of between -45.degree. and +45.degree., respectively, relative to the listener's ear. 17. A method of creating a three dimensional auditory display as recited in claims 14 or 15 comprising the further steps of transducing sound waves received at a positions spaced apart by a distance approximately the width of a human head into separate electrical input signals and separately front to back localizing and elevation localizing each of the separate input signals. 18. A method of creating a three dimensional auditory display as recited in claims 14 or 15 wherein the input signal is representative of a direct sound. 19. A method of creating a three dimensional auditory display as recited in claim 16 comprising the further steps of: - out of head localizing by generating multiple delayed signals corresponding to the input signal;
- imparting reverberation and depth control by generating reverberant signals corresponding to the input signal; and
- binaural signal generation by combining and amplitude scaling the multiple delayed signals, the reverberant signals and the two output signals to produce binaural signals.
20. A method of creating a three dimensional auditory display as recited in claim 19 further comprising the step of converting the binaural signals into audible sounds. 21. A method of creating a three dimensional auditory display as recited in claim 19 wherein the step of imparting reverberation comprises the step of generating signals corresponding to the input signal but delayed in the range of between 0.1 and 15 seconds. 22. A method of creating a three dimensional auditory display as recited in claim 14 wherein in the azimuth localizing step the time delay is determined according to the function: - T.sub.delay =(4.566.multidot.10.sup.-6 .multidot.(arcsin(sin(Az).multidot.cos(E1))))+(2.616.multidot.10.sup.-4 .multidot.(sin(Az).multidot.cos (E1)))
- where Az and E1 are the angles of azimuth and elevation, respectively.
23. A method of creating a three dimensional auditory display as recited in claim 14 wherein the azimuth localizing step comprises the step of selectively delaying one of the two output signals relative to the other output signal between 0 and 0.67 milliseconds. |