WO2004053838A2 - Method and apparatus for noise reduction - Google Patents

Method and apparatus for noise reduction Download PDF

Info

Publication number
WO2004053838A2
WO2004053838A2 PCT/US2003/038657 US0338657W WO2004053838A2 WO 2004053838 A2 WO2004053838 A2 WO 2004053838A2 US 0338657 W US0338657 W US 0338657W WO 2004053838 A2 WO2004053838 A2 WO 2004053838A2
Authority
WO
WIPO (PCT)
Prior art keywords
ofthe
processor
signal
filter
output signal
Prior art date
Application number
PCT/US2003/038657
Other languages
French (fr)
Other versions
WO2004053838A3 (en
Inventor
Kambiz C. Zangi
Steven Isabelle
Original Assignee
Liberato Technologies, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Liberato Technologies, Inc. filed Critical Liberato Technologies, Inc.
Priority to EP03796674A priority Critical patent/EP1576587A2/en
Priority to AU2003298914A priority patent/AU2003298914A1/en
Publication of WO2004053838A2 publication Critical patent/WO2004053838A2/en
Publication of WO2004053838A3 publication Critical patent/WO2004053838A3/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L2021/02082Noise filtering the noise being echo, reverberation of the speech
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02165Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming

Definitions

  • This invention relates generally to systems and methods for reducing noise in a communication, and more particularly to methods and systems for reducing the effect of acoustic noise in a hands-free telephone system.
  • a portable hand-held telephone can be arranged in an automobile or other vehicle so that a driver or other occupant ofthe vehicle can place and receive telephone calls from within the vehicle.
  • Some portable telephone systems allow the driver ofthe automobile to have a telephone conversation without holding the portable telephone. Such systems are generally referred to as "hands-free" systems.
  • the hands-free system receives acoustic signals from various undesirable noise sources, which tend to degrade the intelligibility of a telephone call.
  • the various noise sources can vary with time. For example, background wind, road, and mechanical noises in the interior of an automobile can change depending upon whether a window of an automobile is open or closed.
  • the various noise sources can be different in magnitude, spectral content, and direction for different types of automobiles, because different automobiles have different acoustic characteristics, including, but not limited to, different interior volumes, different surfaces, and different wind, road, and mechanical noise sources
  • an acoustic source such as a voice
  • a voice reflects around the interior ofthe automobile, becoming an acoustic source having multi-path acoustic propagation.
  • the direction from which the acoustic source emanates can appear to change in direction from time to time and can even appear to come from more than one direction at the same time.
  • a voice undergoing multi-path acoustic propagation is generally less intelligible than a voice having no multi-path acoustic propagation.
  • some conventional hands-free systems are configured to place the speaker in proximity to the ear ofthe driver and the microphone in proximity to the mouth ofthe driver. These hands-free systems reduce the effect of the multi-path acoustic propagation and the effect ofthe various noise sources by reducing the distance ofthe driver's mouth to the microphone and the distance ofthe speaker to the driver's ear. Therefore, the signal to noise ratios and corresponding intelligibility ofthe telephone call are improved.
  • such hands-free systems require the use of an apparatus worn on the head ofthe user.
  • a plurality of microphones can be used in combination with some classical processing techniques to improve communication intelligibility in some applications.
  • the plurality of microphones can be coupled to a time-delay beam former arrangement that provides an acoustic receive beam pointing toward the driver.
  • a time-delay beamformer provides desired acoustic receive beams only when associated with an acoustic source that generates planar sound waves.
  • only an acoustic source that is relatively far from the microphones generates acoustic energy that arrives at the microphones as a plane wave. Such is not the case for a hands-free system used in the interior of an automobile or in other relatively small areas.
  • multi-path acoustic propagation such as that described above in the interior of an automobile, can provide acoustic energy arriving at the microphones from more than one direction. Therefore, in the presence of a multi-path acoustic propagation, there is no single pointing direction for the receive acoustic beam.
  • the time-delay beamformer provides most signal to noise ratio improvement for noise that is incoherent between the microphones, for example, ambient noise in a room.
  • the dominant noise sources within an automobile are often directional and coherent.
  • the time-delay beamformer arrangement is not well suited to improve operation of a hands-free telephone system in an automobile.
  • Other conventional techniques for processing the microphone signals have similar deficiencies.
  • a hands-free system configured for operation in a relatively small enclosure such as an automobile. It would be further desirable to provide a hands-free system that provides a high degree of intelligibility in the presence ofthe variety of noise sources in an automobile. It would be still further desirable to provide a hands-free system that does not require the user to wear any portion ofthe system.
  • the present invention provides a noise reduction system having the ability to provide a communication having improved speech intelligibility.
  • the noise reduction system includes a first processor having one or more first processor filters configured to receive respective ones of one or more input signals from respective microphones.
  • the first processor is configured to provide an intermediate output signal.
  • the system also includes a second processor having a second processor filter configured to receive the intermediate output signal and provide a noise-reduced output signal.
  • the one or more first processor filters are dynamically adapted and the second processor filter is separately dynamically adapted.
  • the first processor filters are adapted in accordance with a noise power spectrum at the microphones and the second processor filter is adapted in accordance with a power spectrum ofthe intermediate output signal.
  • the first processor filters can be adapted at a different rate than the second processor filter, therefore a more accurate estimate ofthe power spectrum ofthe noise can be obtained, and this more accurate estimate ofthe power spectrum ofthe noise leads to a more accurate adaptation ofthe first processor filters.
  • the system provides a communication having a high degree of intelligibility. The system can be used to provide a hands-free system with which the user does not need to wear any part ofthe system.
  • a method for processing one or more input signals includes receiving the one or more input signals with a first filter portion, the first filter portion providing an intermediate output signal. The method also includes receiving the intermediate output signal with a second filter portion, the second filter portion providing an output signal. The method also includes dynamically adapting a response ofthe first filter portion and a response ofthe second filter portion.
  • the method provides a system that can dynamically adapt to varying signals and varying noises in a small enclosure, for example in the interior of an automobile.
  • FIG. 1 is a block diagram of an exemplary hands-free system in accordance with the present invention
  • FIG. 2 is a block diagram of a portion ofthe hands-free system of FIG. 1, including an exemplary signal processor;
  • FIG. 3 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 2 ;
  • FIG. 4 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 3;
  • FIG. 5 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 4;
  • FIG. 6 is a block diagram showing an alternate embodiment ofthe exemplary signal processor of FIG. 5;
  • FIG. 7 is a block diagram of an exemplary echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6;
  • FIG. 8 is a block diagram of an alternate echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6;
  • FIG. 9 is a block diagram of yet another alternate echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6;
  • FIG. 10 is a block diagram of a circuit for converting a signal from the time domain to the frequency domain which may be used in the exemplary signal processor of FIGS. 1-6; and
  • FIG. 11 is a block diagram of an alternate circuit for converting a signal from the time domain to the frequency domain, which may be used in the exemplary signal processor of FIGS. 1-6.
  • the notation x m [i] indicates a scalar-valued sample "i" of a particular channel "m” of a time-domain signal "x".
  • the notation x[i] indicates a scalar- valued sample "i” of one channel ofthe time-domain signal "x”. It is assumed that the signal x is band limited and sampled at a rate higher than the Nyquist rate. No distinction is made herein as to whether the sample x m [i] is an analog sample or a digital sample, as both are functionally equivalent.
  • a generic vector- valued time-domain signal, x [i], having M scalar- valued elements is denoted herein by:
  • an exemplary hands-free system 10 in accordance with the present invention includes one or more microphones 26a-26m coupled to a signal processor 30.
  • the signal processor 30 is coupled to a transmitter/receiver 32, which is coupled to an antenna 34.
  • the one or more microphones 26a-26M are inside of an enclosure 28, which, in one particular arrangement, can be the interior of an automobile.
  • the one or more microphones 26a-26M are configured to receive a local voice signal 14 generated by a person or other signal source 12 within the enclosure 28.
  • the local voice signal 14 propagates to each ofthe one or more microphones 26a-26M as one or more "desired signals" S ⁇ [i] to s m [M], each arriving at a respective microphone 26a-26M on respective paths 15a-15M from the person 12 to the one or more microphones 26a-26M.
  • the paths 15a-15M can have the same length or different lengths depending upon the position ofthe person 12 relative to each ofthe one or more microphones 26a-26M.
  • a loudspeaker 20, also within the enclosure 28, is coupled to the transmitter/receiver 32 for providing a remote voice signal 22 corresponding to a voice ofa remote person (not shown) at any distance from the hands-free system 10.
  • the remote person is in communication with the hands-free system by way of radio frequency signals (not shown) received by the antenna 34.
  • the communication can be a cellular telephone call provided over a cellular network (not shown) to the hands-free system 10.
  • the remote voice signal 22 corresponds to a remote-voice-producing signal q[i] provided to the loudspeaker 20 by the transmitter/receiver 32.
  • the remote voice signal 22 propagates to the one or more microphones 26a- 26M as one or more "remote voice signals" e ⁇ [i] to ⁇ M [i], each arriving at a respective microphone 26a-26M upon a respective path 23a-23M from the loudspeaker 20 to the one or more microphones 26a-26M.
  • the paths 23a-23M can have the same length or different lengths depending upon the position ofthe loudspeaker 20 relative to the one or more microphones 26a-26M.
  • One or more environmental noise sources generally denoted 16 which are undesirable, generate one or more environmental acoustic noise signals generally denoted 18, within the enclosure 28.
  • the environmental acoustic noise signals 18 propagate to the one or more microphones 26a-26M as one or more "environmental signals" v ⁇ [i] to v M [i], each arriving at a respective microphone 26a-26M upon a respective path 19a-19M from the environmental noise sources 16 to the one or more microphones 26a-26M.
  • the paths 19a-19M can have the same length or different lengths depending upon the position ofthe environmental noise sources 16 relative to the one or more microphones 26a-26M. Since there can be more than one
  • each such other noise source 16 can arrive at the microphones 26a-26M on different paths.
  • the other noise sources 16 are shown to be collocated for clarity in FIG. 1 , however, those of ordinary skill in the art will appreciate that in practice this typically will not be true.
  • the remote voice signal 22 and the environmental acoustic noise signal 18 comprise noise sources 24 that interfere with reception ofthe local voice signal 14 by the one or more microphones 26a-26M.
  • the environmental noise signal 18, the remote voice signal 22, and the local voice signal 14 can each vary independently of each other.
  • the local voice signal 14 can vary in a variety of ways, including but not limited to, a volume change when the person 12 starts and stops talking, a volume and phase change when the person 12 moves, and a volume, phase, and spectral content change when the person 12 is replaced by another person having a voice with different acoustic characteristics.
  • the remote voice signal 22 can vary in the same way as the local voice signal 14.
  • the environmental noise signal 18 can vary as the environmental noise sources 16 move, start, and stop. Not only can the local voice signal 14 vary, but also the desired signals 15 a-
  • the microphone 26a can vary irrespective of variations in the local voice signal 14.
  • the microphone 26a takes the microphone 26a as representative of all microphones 26a-26M, it should be appreciated that, while the microphone 26a receives the desired signal s ⁇ [i] corresponding to the local voice signal 14 on the path 15a, the microphone 26a also receives the local voice signal 14 on other paths (not shown). The other paths correspond to reflections ofthe local voice signal 14 from the inner surface 28a ofthe enclosure 28. Therefore, while the local voice signal 14 is shown to propagate from the person 12 to the microphone 26a on a single path 15a, the local voice signal 14 can also propagate from the person 12 to the microphone 26a on one or more other paths or reflection paths (not shown). The propagation, therefore, can be a multi-path propagation. In FIG. 1, only the direct propagation paths 15a-15M are shown.
  • the propagation paths 19a-19M and the propagation paths 23a-23M represent only direct propagation paths and the environmental noise signal 18 and the remote signal 22 both experience multi-path propagation in traversing from the environmental noise sources 16 and the loudspeaker 20 respectively, to the one or more microphones 26a-26M. Therefore, each ofthe local voice signal 14, the environmental noise signal 18, and the remote voice signal 22 arriving at the one or more microphones 26a-26M through multi-path propagation, are affected by the reflective characteristics and the shape, i.e., the acoustic characteristics, ofthe interior 28a ofthe enclosure 28.
  • the enclosure 28 is an interior of an automobile or other vehicle
  • the acoustic characteristics ofthe interior ofthe automobile vary from automobile to automobile, but they can also vary depending upon the contents ofthe automobile, and in particular they can also vary depending upon whether one or more windows are up or down.
  • the multi-path propagation has a more dominant effect on the acoustic signals received by the microphones 26a-26M when the enclosure 28 is small and when the interior ofthe enclosure 28 is acoustically reflective. Therefore, a small enclosure corresponding to the interior of an automobile having glass windows, known to be acoustically reflective, is expected to have substantial multi-path acoustic propagation.
  • equations can be used to describe aspects ofthe hands-free system of FIG. 1.
  • the notation s ⁇ [i] corresponds to one sample ofthe local voice signal 14 traveling along the path 15 a
  • the notation ei [i] corresponds to one sample ofthe echo signal 18 traveling along the path 23a
  • the notation v ⁇ [i] corresponds to one sample ofthe environmental noise signal 18 traveling along the path 23a.
  • the i th sample ofthe output ofthe m-th microphone is denoted r m [i].
  • s m [i] corresponds to the local voice signal 14
  • n m [i] corresponds to a combined noise signal described below.
  • the sampled signal s m [i] corresponds to a "desired signal portion" received by the m-th microphone.
  • the signal s m [i] has an equivalent representation s m [i] at the output ofthe m-th microphone within the signal r m [i]. Therefore, it will be understood that the local voice signal 14 corresponds to each ofthe signals S ⁇ [i] to S M [ ⁇ ], which signals have corresponding desired signal portions Sj[i] to S M [I] at the output of respective microphones.
  • n m [i] corresponds to a "noise signal portion" received by the m-th microphone (from the loudspeaker 20 and the environmental noise sources 16) as represented at the output ofthe m-th microphone within the signal r m [i]. Therefore, the output ofthe m-th microphone comprises desired contributions from the local voice signal 12, and undesired contributions from the noise 16, 20.
  • v m [i] is the environmental noise signal 18 received by the m-th microphone
  • e m [i] is the remote voice signal 22 received by the m-th microphone.
  • Both v m [i] and e m [i] have equivalent representations v m [i] and e m [i] at the output ofthe m-th microphone. Therefore, it will be understood that the remote voice signal 22 and the environmental noise signal 18 correspond to the signals e ⁇ [i] to e [i] and v ⁇ [i] to V M [ ⁇ ] respectively, which signals both contribute to corresponding "noise signal portions" ni [i] to n M [i] at the output of respective microphones.
  • the signal processor 30 receives the microphone output signals r m [i] from the one or more microphones 26a-26M and estimates the local voice signal 14 therefrom by estimating the desired signal portion s m [i] of one ofthe signals r m [i] provided at the output of one ofthe microphones.
  • the signal processor 30 receives the microphone output signals r m [i] and estimates the local voice signal 14 therefrom by estimating the desired signal portion s ⁇ [i] ofthe signal r ⁇ [i] provided at the output ofthe microphone 26a.
  • the desired signal portion from any microphone can be used.
  • the hands-free system 10 has no direct access to the local voice signal 14, or to the desired signal portions s m [i] within the signals r m [i] to which the local voice signal
  • the desired signal portions s m [i] only occur in combination with noise signals n m [i] within each ofthe signals r m [i] provided by each ofthe one or more microphones 26a-26M.
  • Each desired signal portion s m [i] provided by each microphone 26a-26M is related to the desired signal portion s ⁇ [i] provided by the first microphone through a linear convolution:
  • k m [i] are the transfer functions relating q[i] to e m [i].
  • the transfer functions k m [i] are strictly causal.
  • the above relationships have equivalent representations in the frequency domain. Lower case letters are used in the above equations to represent time domain signals. In contrast, upper case letters are used in the equations below to represent the same signals, but in the frequency domain.
  • vector notations are used to represent the values among the one or more microphones 26a-26M. Therefore, similar to the above time-domain representations given above, in the frequency-domain:
  • R( ⁇ ) is a frequency-domain representation of a group ofthe
  • time-sampled microphone output signals r m [i], S( ⁇ ) is a frequency-domain
  • N(_y) is a frequency-domain representation of a group ofthe time-sampled noise
  • G ( ⁇ ) is a frequency-domain representation of a group ofthe transfer functions g m [i]
  • S ⁇ ( ⁇ ) is a frequency-domain representation of a group of the time-sampled desired signal portion signals S ⁇ [i] provided by the first microphone 26a.
  • G ( ⁇ ) is a matrix of size M x 1 and S ⁇ (co) a scalar value is of size l x l.
  • N(-y)) is a frequency-domain representation of a group of the
  • time-sampled signals n m [i], K( ⁇ ) is a frequency-domain representation of a group of
  • K( ⁇ ) is a vector of size M x 1
  • Q( ⁇ ) is a scalar value of size l x l.
  • a mean-square error is a particular measurement that can be evaluated to characterize the performance ofthe hands-free system 10.
  • ⁇ [i] is an "estimate signal" corresponding to an estimate ofthe desired signal portion s ⁇ [i] ofthe signal r ⁇ [i] provided by the first microphone 26a.
  • the estimate signal ⁇ [i] is the desired output ofthe hands-free system 10, providing a high quality, noise reduced signal to a remote person.
  • the signal processor 30 provides processing that comprises minimizing the variance of ⁇ [i], where the variance of ⁇ [i] can be expressed as:
  • the signal processor 30 includes a data processor 52 and an adaptation processor 54 coupled to the data processor.
  • the microphones 26a-26M provide the signals r m [i] to the data processor 52 and to the adaptation processor 54.
  • the data processor 52 receives the signal r m [i] from the one or more microphones 26a-26M and, by processing described more fully below, provides an estimate signal s m [i] ofa desired signal portion s m [i] corresponding to one ofthe microphones 26a-26M, for example an estimate signal ⁇ [m] ofthe desired signal portion s ⁇ [i] ofthe signal r ⁇ [i] provided by the microphone 26a.
  • the desired signal portion s ⁇ [i] corresponds to the local voice signal 14 (FIG. 1) and in particular to the local voice signal S ⁇ [i] (FIG. 1) provided by the person 12 (FIG. 1) along the path 15a (FIG. 1).
  • the desired signal portion s m [i] provided by any ofthe one or more microphones 26a-26M can be used equivalently in place of s i [i] above, and therefore, the estimate becomes s m [i] .
  • the adaptation processor 54 dynamically adapts the processing provided by the data processor 52 by adjusting the response ofthe data processor 52.
  • the adaptation is described in more detail below.
  • the adaptation processor 54 thus dynamically adapts the processing performed by the data processor 52 to allow the data processor to provide an audio output as an estimate signal s ⁇ [i] having a relatively high quality, and a relatively high signal to noise ratio in the presence ofthe varying local voice signal 14 (FIG. 1), the varying remote voice signal 22 (FIG. 1), and the varying environmental noise signal 18 (FIG. 1).
  • the variation of these signals is described above in conjunction with FIG. 1. Referring now to FIG. 3, a portion 70 ofthe exemplary hands-free system 10 of
  • the signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor 52.
  • the microphones 26a-26M provide the signals r m [i] to the data processor 52 and to the adaptation processor 54.
  • the data processor 52 includes an array processor (AP) 72 coupled to a single channel noise reduction processor (SCNRP) 78.
  • the AP 72 includes one or more AP filters 74a-74M, each coupled to a respective one ofthe one or more microphones 26a- 26M.
  • the outputs ofthe one or more AP filters 74a-74M are coupled to a combiner circuit 76.
  • the combiner circuit 72 performs a simple sum ofthe outputs ofthe one or more AP filters 74a-74M.
  • the AP 72 has one or more inputs and a single scalar- valued output comprising a time series of values.
  • the SCNRP 78 includes a single input, single output SCNRP filter.
  • the input to the SCNRP filter 80 is an intermediate signal z[i] provided by the AP 72.
  • the output ofthe SCNRP filter provides the estimate signal ⁇ [i] ofthe desired signal portion S ⁇ [i] of z[i] corresponding to the first microphone 26a.
  • the estimate signal ⁇ [i], and alternate embodiments thereof, is described above in conjunction with FIG. 2.
  • the adaptation processor 54 dynamically adapts the response of each ofthe AP filters 74a-74M and the response ofthe SCNRP filter 80.
  • the adaptation is described in greater detail below.
  • the signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor 52.
  • the microphones 26a-26M provide the signals r m [i] to the data processor 52 and to the adaptation processor 54.
  • the data processor 52 includes the array processor (AP) 72 coupled to the single channel noise reduction processor (SCNRP) 78.
  • the AP 72 includes the one or more AP filters 74a-74M.
  • the outputs ofthe one or more AP filters 74a-74M are coupled to the combiner circuit 76.
  • the adaptation processor 54 includes a first adaptation processor 92 coupled to the AP 72, and to each AP filter 74a-74M therein.
  • the first adaptation processor 92 provides a dynamic adaptation ofthe one or more AP filters 74a- 74M.
  • the adaptation provided by the first adaptation processor 92 to any one ofthe one or more AP filters 74a-74M can be the same as or different from the adaptation provided to any other ofthe one or more AP filters 74a-74M.
  • the adaptation processor 54 also includes a second adaptation processor 94 coupled to the SCNRP 78 and to the SCNRP filter 80 therein.
  • the second adaptation processor 94 provides an adaptation ofthe SCNRP filter 80.
  • the first adaptation processor 92 dynamically adapts the response of each ofthe AP filters 74a-74M in response to noise signals.
  • the second adaptation processor 94 dynamically adapts the response ofthe SCNRP filter 80 in response to a combination of desired signals and noise signals. Because the signal processor 30 has both a first and a second adaptation processor 92, 94 respectively, each ofthe two adaptations can be different, for example, they can have different time constants. The adaptation is described in greater detail below.
  • a circuit portion 90 of an the exemplary hands-free system 10 of FIG. 1 includes the one or more microphones 26a-26M coupled to the signal processor 30.
  • the signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor.
  • the microphones 26a-26M provide the signals r m [i] to the data processor 52 and to the adaptation processor 54.
  • the variable 'k' in the notation below is used to denote that the various power spectra are computed upon a k-th frame of data.
  • the various power spectra are computed on a k+l-th frame of data, which may or may not overlap the k-th frame of data.
  • the variable 'k' is omitted from some ofthe following equations. However, it will be understood that the various power spectra described below are computed upon a particular data frame 'k'.
  • the adaptation processor 54 can be
  • the adaptation processor 54 includes the first adaptation processor 92 coupled to the AP 72, and to each AP filter 74a- 74M therein.
  • the first adaptation processor 92 includes a voice activity detector (VAD) 102.
  • VAD voice activity detector
  • the update processor 104 that computes a noise power spectrum P m ⁇ ;k) .
  • the two update processors 104, 106 provide the noise power spectrums P m ⁇ ;k) and
  • the adaptation processor 54 also includes the second adaptation processor 94 coupled to the SCNRP 78 and to the SCNRP filter 80 therein.
  • the second adaptation processor 94 includes an update processor 106 that computes a power spectrum
  • the power spectrum P 2Z ⁇ ;k) is a power spectrum ofthe entire intermediate signal z[i].
  • the update processor 106 provides the power spectrum
  • the one or more channels of time-domain input samples r ⁇ [i] to ⁇ M [1] provided to the AP 72 by the microphones 26a-26M can be considered equivalently to be a
  • the single channel time domain output samples z[i] provided by the AP 72 can be considered equivalently to be a frequency domain scalar-valued output Z( ⁇ ).
  • the AP 72 comprises an M-input
  • R ( ⁇ ) [R 1 ( ⁇ ) R 2 ( ⁇ ) ... R M ( ⁇ )] ⁇
  • T refers to the transpose of a vector
  • F (co) and R ( ⁇ ) are column vectors having vector elements corresponding to each microphone 26a-26M.
  • the asterisk symbol * corresponds to a complex conjugate.
  • the VAD 102 detects the presence or absence of a desired signal portion ofthe intermediate signal z[i].
  • the desired signal portion can be s ⁇ [i], corresponding to the voice signal provided by the first microphone 26a.
  • the VAD 102 can be constructed in a variety of ways to detect the presence or absence of a desired signal portion.
  • the VAD is shown to be coupled to the intermediate signal z[i], in other embodiments, the VAD can be coupled to one or more ofthe microphone signals ri [i] to r m [i], or to the output estimate signal ⁇ [i].
  • G (co) is the frequency domain vector notation for the transfer
  • the transfer function F ( o) provides a maximum
  • the desired signal portion S ⁇ [i] ofthe input signal r ⁇ [i], corresponding to the local voice signal 14 (FIG. 1), can vary rapidly with time.
  • using a slower time constant for adaptation of the AP filters results in a more accurate adaptation ofthe AP filters.
  • the AP filters are adapted based on estimates ofthe power spectrum ofthe noise, and using a slower time constant to estimate the power spectrum ofthe noise results in a more accurate estimate ofthe power spectrum ofthe noise; since, with a slower time constant, a longer measurement window can be used for estimating.
  • VAD 102 provides to the update processor 104 an indication of when the local voice signal 14 (FIG. 1) is absent, i.e. when the person 12 (FIG. 1) is not talking. Therefore,
  • the update processor 104 computes the power spectrum P -- (co) ofthe noise signal
  • the frequency domain representation Z(co) ofthe scalar-valued intermediate output signal z[i] can be expressed as sum of two terms: a term S ⁇ (co) due to the desired signal S ⁇ [i] provided by the first microphone 26a, and a term T(co) due to the noise t[i] provided by the one or more microphones 26a-26M. Therefore, it can be shown that:
  • the scalar-valued Z( ⁇ ) is further processed by the SCNRP filter 80.
  • the SCNRP filter 80 comprises a single-input, single-output linear filter with response: P ⁇ ) Furthermore,
  • P s ⁇ s ⁇ ( ⁇ ) is the power spectrum ofthe desired signal portion of the first microphone signal r ⁇ [i] within the intermediate output signal z[i]
  • P zz ( ⁇ ) is the power spectrum ofthe intermediate output signal z[i]
  • P tt ( ⁇ ) is the power spectrum ofthe noise signal portion ofthe intermediate output signal z[i]. Therefore, Q( ⁇ ) can be equivalently expressed as:
  • the transfer function Q( ⁇ ) ofthe SCNRP filter 80 can be expressed as a function of P s ⁇ s ⁇ ( ⁇ ) and P ⁇ (co) or equivalently as a function of P tt (co) and P zz (co) . Therefore, the second adaptation processor 94, in the embodiment shown, receives the signal z[i], or equivalently the frequency domain signal Z( ⁇ ), and the update processor 108 computes the power spectrum P z z(-a) corresponding thereto.
  • the second adaptation processor 94 can provide the SCNRP filter 80 with sufficient information to generate the desired transfer function Q(co) described by the above equations. While the second update processor updates the SCNRP filter 80 based upon
  • an alternate second update processor updates the SCNRP filter 80 based upon P s i s i( ⁇ ) and P zz (co).
  • the SCNRP filter 80 is essentially a single-input single-output Weiner filter.
  • the cascaded system of FIG. 5, consisting ofthe AP 72 followed by the SCNRP 78, is mathematically equivalent to an M-input/1 -output
  • Wiener filter for estimating S ⁇ (co) based on R (co), where the transfer function ofthe Wiener filter is described by the equation:
  • the hands-free system can also adapt the transfer function of the AP filters 74a- 74M.
  • G ( o) in addition to the dynamic adaptations to the AP filters 74 and the SCNRP filter 80. It is discussed above that g m [i] is the transfer function between the desired signal s ⁇ [i] and the other desired signals s m [i]:
  • the person 12 To collect samples ofthe desired signal portions s m [i] at the output ofthe microphones 26a-26M, the person 12 (FIG. 1) must be talking and the noise n [i] corresponding to the environmental noise signals v m [i] and the remote voice signals e m [i] must he much smaller than the desired signal s [i], i.e. the SNR at the output of each microphone 26a-26M must be high. This high SNR occurs whenever the talker is talking in a quiet environment.
  • the signal processor 30 can use P s i sm ( ⁇ )/P s isi( ⁇ ) as the final estimate of G m ( ⁇ ), where P s i s i( ⁇ ) is the power spectrum of S ⁇ [i] obtained using a Welch method.
  • the person 12 (FIG. 1) can explicitly initiate the
  • G (co) changes little over time for a particular user
  • G (co) can be estimated once at installation ofthe hands free system 10 (FIG. 1) into the automobile.
  • the hands-free system 10 can be used as a front- end to a speech recognition system that requires training.
  • speech recognition systems SRS
  • the noise reduction system can use the same training period for estimating G (co) since, the training ofthe SRS is done also in a quiet environment.
  • the signal processor 30 can determine when the SNR is high, and
  • the signal processor 30 can initiate the process for estimating G (co). For example, in one particular embodiment, to estimate the SNR at the output ofthe first microphone, the signal processor 30, during the time when the talker is silent (as determined by the VAD 102), measures the power ofthe noise at the output ofthe first microphone 26a. The signal processor 30, during the time when the talker is active (as determined by the VAD 102), measures the power ofthe speech plus noise signal. The signal processor 30 estimates the SNR at the output ofthe first microphone 26a as the ratio ofthe power of the speech plus noise signal to the noise power. The signal processor 30 compares the estimated SNR to a desired threshold, and if the computed SNR exceeds the threshold, the signal processor 30 identifies a quiet period and begins estimating elements of
  • each element of G (co) is estimated by the signal processor 30 as the ratio ofthe cross power spectra P s i sm ( ⁇ ) to the power spectrum P s ⁇ s ⁇ ( ⁇ )
  • the output ofthe hands-signal processor 30 is the estimate signal ⁇ [i], as desired.
  • the noise signal portions n m [i] and the desired signal portions s m [i] ofthe microphone signals r m [i] can vary at substantially different rates. Therefore, the structure ofthe signal processor 30, having the first and the second adaptation processors 92, 94 respectively, can provide different adaptation rates for the AP filters 74a-74M and for the SCNRP filter 80. As described above, having different adaptation rates results in a more accurate adaptation ofthe AP filters; therefore, this results in improved noise reduction.
  • the first adaptation processor 134 does not contain the VAD 102 (FIG. 5). Therefore, an update processor 130, must compute the noise power
  • desired signal portions s m [i] ofthe input signals r m [i] are present, i.e. while the person 12 (FIG. 1) is talking.
  • the estimate signal Si [i] is passed through subtraction processors 126a-126M, and the resulting signals are subtracted from the input signals r m [i] via subtraction circuits 122a-122M to provide subtracted signals 128a-128M to the update processor 130.
  • the subtraction processors 126a-126M comprise filters that operate upon the estimate signal ⁇ [i].
  • the subtracted signals 128a-128M are substantially noise signals, corresponding substantially to the noise signal portions n m [i] ofthe input signals r m [i]. Therefore, the update processor 130 can compute the noise power
  • the AP filters 74a-74M from the equations given above. While this embodiment 120 couples the subtraction processors 126a-126M to the estimate signal ⁇ [i] at the output ofthe SCNRP filter 80, in other embodiments, the subtraction processors can be coupled to other points ofthe system. For example, the subtraction filters can be coupled to the intermediate signal z[i].
  • the subtraction processors 126a-126M have the transfer functions G m ( ⁇ ), which, as described above, relate the desired signal portion ofthe first microphone
  • the data processor 162 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6.
  • the data processor 162 is but part of a signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6.
  • the data processor 162 includes an AP 156 and a SCNRP 160 that can correspond, for example to the AP 52 and the SCNRP 78 of FIG. 6.
  • the remote- voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to remote voice canceling processors 154a-154M.
  • the remote voice canceling processors 154a-154M comprise filters that operate upon the remote-voice-producing signal q[i].
  • the outputs ofthe remote voice canceling processors 154a-154M are subtracted via subtraction circuits 152a-152M from the signals r ⁇ [i] to r m [i] provided by the microphones 26a-26m.
  • noise attributed to the remote-voice-producing signal q[i] which forms a part ofthe signals r ⁇ [i] to r m [i] is subtracted from the signals r ⁇ [i] to r m [i] before the subsequent processing is performed by the AP 156 in conjunction with first and second adaptation processors (not shown).
  • the data processor 180 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6.
  • the data processor 180 is but part of a signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6.
  • the data processor 180 includes an AP 172 and a SCNRP 174 that can correspond, for example to the AP 52 and the SCNRP of FIG. 6.
  • the remote-voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to a remote voice canceling processor 178.
  • the remote voice canceling processor 178 comprises a filter that operates upon the remote-voice- producing signal q[i].
  • the output ofthe remote voice canceling processor 178 is subtracted via subtraction circuit 176 from the estimate signal ⁇ [i], therefore providing an improved estimate signal ⁇ [i]'. Therefore, noise attributed to the remote-voice- producing signal q[i] which forms a part ofthe signals r ⁇ [i] to r m [i] is subtracted from the final output ofthe data processor 180.
  • K m ( ⁇ ) is the transfer function ofthe acoustic channel with input q[i] and output e m [i]
  • F m ( ⁇ ) is the transfer function ofthe m-th filter ofthe AP 172
  • Q(co) is the transfer function of the SCNRP 174.
  • the data processor 200 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6.
  • the data processor 200 is but part of a signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6.
  • the data processor 200 includes an AP 192 and a SCNRP 198 that can correspond, for example to the AP 52 and the SCNRP of FIG. 6.
  • the remote- voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to remote voice canceling processor 194.
  • the remote voice canceling processor 194 comprises a filter that operates upon the remote-voice- producing signal q[i].
  • the output ofthe remote voice canceling processor 194 is subtracted via subtraction circuit 196 from the intermediate signal z[i], therefore providing an improved estimate signal z[i]'. Therefore, noise attributed to the remote- voice-producing signal q[i] which forms a part of the signals ri [i] to r m [i] is subtracted from the intermediate signal z[i].
  • K m ( ⁇ ) is the transfer function ofthe acoustic channel with input q[i] and output e m[ i]
  • F m ( ⁇ ) is the transfer function ofthe m-th AP filter within the AP 172 .
  • the serial to parallel converters store data samples from the signals r ⁇ [i]-r m [i] into data groups.
  • the serial to parallel converters 212a-212M provide the data groups to Nl -point discrete Fourier transform (DFT) processors 214a- 214M.
  • DFT discrete Fourier transform
  • the DFT processors 212a-212M are each coupled to a data processor 216 and an adaptation processor 218 which can be similar to the data processor 52 and adaptation processor 54 described above in conjunction with FIG. 6.
  • the DFT processors convert the time-domain samples r m [i] into frequency domain samples, which are provided to the data processor 216 and to the adaptation processor 218. Therefore, frequency domain samples are provided to both the data processor 216 and the adaptation processor 218. Filtering performed by AP filters (not shown) within the data processor 216 and power spectrum calculations provided by the adaptation processor 218 can be done in the frequency domain as is described above.
  • the serial to parallel converters store data samples from the signals r ⁇ [i] to r m [i] into data groups and provide the data groups to Nl -point discrete Fourier transform (DFT) processors 236a-236M.
  • DFT discrete Fourier transform
  • the serial to parallel converters 234a-234M provide the data groups to window processors 238a-238M and thereafter to N2 -point discrete Fourier transform (DFT) processors 238a-238M.
  • the DFT processors 236a-236M are each coupled to a data processor 242.
  • the DFT processors 240a-240M are each coupled to an adaptation processor 244.
  • the data processor 242 and the adaptation processor 244 can be the type of data processor 52 and adaptation processor 54 of FIG. 6.
  • the DFT processors convert the time-domain data groups into frequency domain samples, which are provided to the data processor 242 and to the adaptation processor 244. Therefore, frequency domain samples are provided to both the data processor 242 and the adaptation processor 244. Therefore, filtering provided by AP filters (not shown) in the data processor 242 and power spectrum calculations provided by the adaptation processor 244 can be done in the frequency domain as is described above.
  • the windowing processors 238a-238M provide the adaptation processor 244 with an improved ability to accurately determine the noise power spectrum and therefore to update the AP filters (not shown) within the data processor 242.
  • the use of windowing on signals that are used to provide an audio output in the data processor 216 results in distorted audio and a less intelligible output signal. Therefore, while is it desirable to provide the windowing processors 238a-238M for the signals to the adaptation processor 244, it is not desirable to provide windowing processors for the signals to the data processor 242.
  • DFT processors 236a-236M and the N2-point DFT processors 240a-240M can compute using a number of time domain data samples Nl different from a number of time domain data samples N2.

Abstract

An apparatus and method for noise reduction is described. The method and apparatus can be used in a hands-free communication system to provide a hands-free a communication system having improved intelligibility. The apparatus includes a first and a second processor, each separately dynamically adapted to changing signals and noise, to improve a signal to noise ratio.

Description

METHOD AND APPARATUS FOR NOISE REDUCTION
FIELD OF THE INVENTION This invention relates generally to systems and methods for reducing noise in a communication, and more particularly to methods and systems for reducing the effect of acoustic noise in a hands-free telephone system.
BACKGROUND OF THE INVENTION As is known in the art, a portable hand-held telephone can be arranged in an automobile or other vehicle so that a driver or other occupant ofthe vehicle can place and receive telephone calls from within the vehicle. Some portable telephone systems allow the driver ofthe automobile to have a telephone conversation without holding the portable telephone. Such systems are generally referred to as "hands-free" systems.
As is known, the hands-free system receives acoustic signals from various undesirable noise sources, which tend to degrade the intelligibility of a telephone call. The various noise sources can vary with time. For example, background wind, road, and mechanical noises in the interior of an automobile can change depending upon whether a window of an automobile is open or closed.
Furthermore, the various noise sources can be different in magnitude, spectral content, and direction for different types of automobiles, because different automobiles have different acoustic characteristics, including, but not limited to, different interior volumes, different surfaces, and different wind, road, and mechanical noise sources
It will be appreciated that an acoustic source such as a voice, for example, reflects around the interior ofthe automobile, becoming an acoustic source having multi-path acoustic propagation. In so reflecting, the direction from which the acoustic source emanates can appear to change in direction from time to time and can even appear to come from more than one direction at the same time. A voice undergoing multi-path acoustic propagation is generally less intelligible than a voice having no multi-path acoustic propagation. In order to reduce the effect of multi-path acoustic propagation as well as the effect ofthe various noise sources, some conventional hands-free systems are configured to place the speaker in proximity to the ear ofthe driver and the microphone in proximity to the mouth ofthe driver. These hands-free systems reduce the effect of the multi-path acoustic propagation and the effect ofthe various noise sources by reducing the distance ofthe driver's mouth to the microphone and the distance ofthe speaker to the driver's ear. Therefore, the signal to noise ratios and corresponding intelligibility ofthe telephone call are improved. However, such hands-free systems require the use of an apparatus worn on the head ofthe user.
Other hands-free systems place both the microphone and the speaker remotely from the driver, for example, on a dashboard ofthe automobile. This type of hands- free system has the advantage that it does not require an apparatus to be worn by the driver. However, such a hands-free system is fully susceptible to the effect ofthe multi-path acoustic propagation and also the effects ofthe various noise sources described above. This type of system, therefore, still has the problem of reduced intelligibility.
A plurality of microphones can be used in combination with some classical processing techniques to improve communication intelligibility in some applications. For example, the plurality of microphones can be coupled to a time-delay beam former arrangement that provides an acoustic receive beam pointing toward the driver. However, it will be recognized that a time-delay beamformer provides desired acoustic receive beams only when associated with an acoustic source that generates planar sound waves. In general, only an acoustic source that is relatively far from the microphones generates acoustic energy that arrives at the microphones as a plane wave. Such is not the case for a hands-free system used in the interior of an automobile or in other relatively small areas.
Furthermore, multi-path acoustic propagation, such as that described above in the interior of an automobile, can provide acoustic energy arriving at the microphones from more than one direction. Therefore, in the presence of a multi-path acoustic propagation, there is no single pointing direction for the receive acoustic beam. Also, the time-delay beamformer provides most signal to noise ratio improvement for noise that is incoherent between the microphones, for example, ambient noise in a room. In contrast, the dominant noise sources within an automobile are often directional and coherent. Therefore, due to the non-planar sound waves that propagate in the interior of the automobile, the multi-path acoustic propagation, and also due to coherency of noise received by more than one microphone, the time-delay beamformer arrangement is not well suited to improve operation of a hands-free telephone system in an automobile. Other conventional techniques for processing the microphone signals have similar deficiencies.
It would, therefore, be desirable to provide a hands-free system configured for operation in a relatively small enclosure such as an automobile. It would be further desirable to provide a hands-free system that provides a high degree of intelligibility in the presence ofthe variety of noise sources in an automobile. It would be still further desirable to provide a hands-free system that does not require the user to wear any portion ofthe system.
SUMMARY OF THE INVENTION The present invention provides a noise reduction system having the ability to provide a communication having improved speech intelligibility.
In accordance with the present invention, the noise reduction system includes a first processor having one or more first processor filters configured to receive respective ones of one or more input signals from respective microphones. The first processor is configured to provide an intermediate output signal. The system also includes a second processor having a second processor filter configured to receive the intermediate output signal and provide a noise-reduced output signal. In operation, the one or more first processor filters are dynamically adapted and the second processor filter is separately dynamically adapted. In one particular embodiment, the first processor filters are adapted in accordance with a noise power spectrum at the microphones and the second processor filter is adapted in accordance with a power spectrum ofthe intermediate output signal.
Inherent in the above formulation is the assumption that the power spectrum of the noise and the power spectrum ofthe intermediate signal stay relatively constant, long enough so that good estimates of these power spectra can be obtained, and these estimates are then used to adapt the first processor filters and the second processor filter. The longer the period of time each of these power spectrum stays constant, the longer the longer the period of time over which it can be measured. Hence, the better the quality ofthe resulting estimate. Naturally, a higher quality estimate ofthe power spectrum ofthe noise or a higher quality estimate ofthe power spectrum ofthe intermediate signal will lead to a better performance ofthe resulting noise reduction system. When the power spectrum ofthe noise changes at a significantly slower rate than the power spectrum ofthe intermediate signal, a slower time constant for estimating the power spectrum ofthe noise can be used, resulting in a more accurate estimate ofthe power spectrum ofthe noise. The more accurate estimate ofthe power spectrum ofthe noise can be used to adapt the first processor more accurately
With the above arrangement, because the noise power spectrum changes relatively slowly, the first processor filters can be adapted at a different rate than the second processor filter, therefore a more accurate estimate ofthe power spectrum ofthe noise can be obtained, and this more accurate estimate ofthe power spectrum ofthe noise leads to a more accurate adaptation ofthe first processor filters. The system provides a communication having a high degree of intelligibility. The system can be used to provide a hands-free system with which the user does not need to wear any part ofthe system.
In accordance with another aspect ofthe present invention, a method for processing one or more input signals includes receiving the one or more input signals with a first filter portion, the first filter portion providing an intermediate output signal. The method also includes receiving the intermediate output signal with a second filter portion, the second filter portion providing an output signal. The method also includes dynamically adapting a response ofthe first filter portion and a response ofthe second filter portion.
With this particular arrangement, the method provides a system that can dynamically adapt to varying signals and varying noises in a small enclosure, for example in the interior of an automobile.
BRIEF DESCRIPTION OF THE DRAWINGS The foregoing features ofthe invention, as well as the invention itself may be more fully understood from the following detailed description ofthe drawings, in which: FIG. 1 is a block diagram of an exemplary hands-free system in accordance with the present invention;
FIG. 2 is a block diagram of a portion ofthe hands-free system of FIG. 1, including an exemplary signal processor;
FIG. 3 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 2 ;
FIG. 4 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 3;
FIG. 5 is a block diagram showing greater detail ofthe exemplary signal processor of FIG. 4; FIG. 6 is a block diagram showing an alternate embodiment ofthe exemplary signal processor of FIG. 5;
FIG. 7 is a block diagram of an exemplary echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6; FIG. 8 is a block diagram of an alternate echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6;
FIG. 9 is a block diagram of yet another alternate echo canceling processor arrangement, which may be used in the exemplary signal processor of FIGS. 1-6; FIG. 10 is a block diagram ofa circuit for converting a signal from the time domain to the frequency domain which may be used in the exemplary signal processor of FIGS. 1-6; and
FIG. 11 is a block diagram of an alternate circuit for converting a signal from the time domain to the frequency domain, which may be used in the exemplary signal processor of FIGS. 1-6.
DETAILED DESCRIPTION OF THE INVENTION Before describing the noise reduction system in accordance with the present invention, some introductory concepts and terminology are explained. As used herein, the notation xm[i] indicates a scalar-valued sample "i" of a particular channel "m" of a time-domain signal "x". Similarly, the notation x[i] indicates a scalar- valued sample "i" of one channel ofthe time-domain signal "x". It is assumed that the signal x is band limited and sampled at a rate higher than the Nyquist rate. No distinction is made herein as to whether the sample xm[i] is an analog sample or a digital sample, as both are functionally equivalent.
As used herein, a Fourier transform, X( o), of x[i] at frequency ω (where 0 < ω <
2π) is described by the equation:
Figure imgf000008_0001
As used herein, an autocorrelation, Pχχ[t], of x[i] at lag t, is described by the equation:
Pxxt] = E{x [i] x* [i + t]}, where superscript "*" indicates a complex conjugate, and E{ } denotes expected value.
As used herein, a power spectrum, Pxx(-o), of x[i] at frequency ω (where 0 < ω < 2π) is described by the equation:
Figure imgf000009_0001
A generic vector- valued time-domain signal, x [i], having M scalar- valued elements is denoted herein by:
[i] = [xι[i] ... xM[i]]T where the superscript T denotes a transpose ofthe vector. Therefore the vector x [i] is a column vector.
The Fourier Transform of x [i] at frequency ω (where 0 < ω < 2π) is an M x
1 vector X (ω) whose m-th entry is the Fourier Transform of xm[i] at frequency ω.
The auto-correlation of 3c [i] at lag t is denoted herein by the M x M matrix pTx [t]
defined as:
^ [t] = E{ x[i]xH[i + t] }
where the superscript H represents an Hermetian.
The power spectrum ofthe vector- valued signal 3c [i] at frequency ω (where 0
< ω < 2π) is denoted herein by P (ω). The power spectrum P~ (ω) is an M x M
matrix whose (i, j) entry is the Fourier Transform ofthe (i, j) entry ofthe
autocorrelation function p~ [m] at frequency ω.
Referring now to FIG. 1, an exemplary hands-free system 10 in accordance with the present invention includes one or more microphones 26a-26m coupled to a signal processor 30. The signal processor 30 is coupled to a transmitter/receiver 32, which is coupled to an antenna 34. The one or more microphones 26a-26M are inside of an enclosure 28, which, in one particular arrangement, can be the interior of an automobile. The one or more microphones 26a-26M are configured to receive a local voice signal 14 generated by a person or other signal source 12 within the enclosure 28. The local voice signal 14 propagates to each ofthe one or more microphones 26a-26M as one or more "desired signals" Sι[i] to sm[M], each arriving at a respective microphone 26a-26M on respective paths 15a-15M from the person 12 to the one or more microphones 26a-26M. The paths 15a-15M can have the same length or different lengths depending upon the position ofthe person 12 relative to each ofthe one or more microphones 26a-26M.
A loudspeaker 20, also within the enclosure 28, is coupled to the transmitter/receiver 32 for providing a remote voice signal 22 corresponding to a voice ofa remote person (not shown) at any distance from the hands-free system 10. The remote person is in communication with the hands-free system by way of radio frequency signals (not shown) received by the antenna 34. For example, the communication can be a cellular telephone call provided over a cellular network (not shown) to the hands-free system 10. The remote voice signal 22 corresponds to a remote-voice-producing signal q[i] provided to the loudspeaker 20 by the transmitter/receiver 32.
The remote voice signal 22 propagates to the one or more microphones 26a- 26M as one or more "remote voice signals" eι[i] to βM[i], each arriving at a respective microphone 26a-26M upon a respective path 23a-23M from the loudspeaker 20 to the one or more microphones 26a-26M. The paths 23a-23M can have the same length or different lengths depending upon the position ofthe loudspeaker 20 relative to the one or more microphones 26a-26M.
One or more environmental noise sources generally denoted 16, which are undesirable, generate one or more environmental acoustic noise signals generally denoted 18, within the enclosure 28. The environmental acoustic noise signals 18 propagate to the one or more microphones 26a-26M as one or more "environmental signals" vι[i] to vM[i], each arriving at a respective microphone 26a-26M upon a respective path 19a-19M from the environmental noise sources 16 to the one or more microphones 26a-26M. The paths 19a-19M can have the same length or different lengths depending upon the position ofthe environmental noise sources 16 relative to the one or more microphones 26a-26M. Since there can be more than one
environmental noise source 16, the environmental noise signals Vι[i] to V [Ϊ] from
each such other noise source 16 can arrive at the microphones 26a-26M on different paths. The other noise sources 16 are shown to be collocated for clarity in FIG. 1 , however, those of ordinary skill in the art will appreciate that in practice this typically will not be true.
Together, the remote voice signal 22 and the environmental acoustic noise signal 18 comprise noise sources 24 that interfere with reception ofthe local voice signal 14 by the one or more microphones 26a-26M. It will be appreciated that the environmental noise signal 18, the remote voice signal 22, and the local voice signal 14 can each vary independently of each other. For example, the local voice signal 14 can vary in a variety of ways, including but not limited to, a volume change when the person 12 starts and stops talking, a volume and phase change when the person 12 moves, and a volume, phase, and spectral content change when the person 12 is replaced by another person having a voice with different acoustic characteristics. For another example, the remote voice signal 22 can vary in the same way as the local voice signal 14. For another example, the environmental noise signal 18 can vary as the environmental noise sources 16 move, start, and stop. Not only can the local voice signal 14 vary, but also the desired signals 15 a-
15M can vary irrespective of variations in the local voice signal 14. In this regard, taking the microphone 26a as representative of all microphones 26a-26M, it should be appreciated that, while the microphone 26a receives the desired signal sι[i] corresponding to the local voice signal 14 on the path 15a, the microphone 26a also receives the local voice signal 14 on other paths (not shown). The other paths correspond to reflections ofthe local voice signal 14 from the inner surface 28a ofthe enclosure 28. Therefore, while the local voice signal 14 is shown to propagate from the person 12 to the microphone 26a on a single path 15a, the local voice signal 14 can also propagate from the person 12 to the microphone 26a on one or more other paths or reflection paths (not shown). The propagation, therefore, can be a multi-path propagation. In FIG. 1, only the direct propagation paths 15a-15M are shown.
Similarly, the propagation paths 19a-19M and the propagation paths 23a-23M represent only direct propagation paths and the environmental noise signal 18 and the remote signal 22 both experience multi-path propagation in traversing from the environmental noise sources 16 and the loudspeaker 20 respectively, to the one or more microphones 26a-26M. Therefore, each ofthe local voice signal 14, the environmental noise signal 18, and the remote voice signal 22 arriving at the one or more microphones 26a-26M through multi-path propagation, are affected by the reflective characteristics and the shape, i.e., the acoustic characteristics, ofthe interior 28a ofthe enclosure 28. In one particular embodiment, where the enclosure 28 is an interior of an automobile or other vehicle, not only can the acoustic characteristics ofthe interior ofthe automobile vary from automobile to automobile, but they can also vary depending upon the contents ofthe automobile, and in particular they can also vary depending upon whether one or more windows are up or down.
The multi-path propagation has a more dominant effect on the acoustic signals received by the microphones 26a-26M when the enclosure 28 is small and when the interior ofthe enclosure 28 is acoustically reflective. Therefore, a small enclosure corresponding to the interior of an automobile having glass windows, known to be acoustically reflective, is expected to have substantial multi-path acoustic propagation.
As shown below, equations can be used to describe aspects ofthe hands-free system of FIG. 1.
In accordance with the general notation xm[i] described above, the notation sι[i] corresponds to one sample ofthe local voice signal 14 traveling along the path 15 a, the notation ei [i] corresponds to one sample ofthe echo signal 18 traveling along the path 23a, and the notation vι[i] corresponds to one sample ofthe environmental noise signal 18 traveling along the path 23a.
The ith sample ofthe output ofthe m-th microphone is denoted rm[i]. The ith sample ofthe output ofthe m-th microphone may be computed as: rm[i] = sm[i] + nm[i], m = l, ..., M
In the above equation, sm[i] corresponds to the local voice signal 14, and nm[i] corresponds to a combined noise signal described below.
The sampled signal sm[i] corresponds to a "desired signal portion" received by the m-th microphone. The signal sm[i] has an equivalent representation sm[i] at the output ofthe m-th microphone within the signal rm[i]. Therefore, it will be understood that the local voice signal 14 corresponds to each ofthe signals Sι[i] to SM[Ϊ], which signals have corresponding desired signal portions Sj[i] to SM[I] at the output of respective microphones. Similarly, nm[i] corresponds to a "noise signal portion" received by the m-th microphone (from the loudspeaker 20 and the environmental noise sources 16) as represented at the output ofthe m-th microphone within the signal rm[i]. Therefore, the output ofthe m-th microphone comprises desired contributions from the local voice signal 12, and undesired contributions from the noise 16, 20. As described above, the noise nm[i] at the output ofthe m-th microphone has contributions from both the environmental noise signal 18 and the remote voice signal 22 and can, therefore, be described by the following equation: nm[i] = vm[i] + em[i], m = l, ..., M
In the above equation, vm[i] is the environmental noise signal 18 received by the m-th microphone, and em[i] is the remote voice signal 22 received by the m-th microphone. Both vm[i] and em[i] have equivalent representations vm[i] and em[i] at the output ofthe m-th microphone. Therefore, it will be understood that the remote voice signal 22 and the environmental noise signal 18 correspond to the signals eι[i] to e [i] and vι[i] to VM[Ϊ] respectively, which signals both contribute to corresponding "noise signal portions" ni [i] to nM[i] at the output of respective microphones.
In operation, the signal processor 30 receives the microphone output signals rm[i] from the one or more microphones 26a-26M and estimates the local voice signal 14 therefrom by estimating the desired signal portion sm[i] of one ofthe signals rm[i] provided at the output of one ofthe microphones. In one particular embodiment, the signal processor 30 receives the microphone output signals rm[i] and estimates the local voice signal 14 therefrom by estimating the desired signal portion sι[i] ofthe signal rι[i] provided at the output ofthe microphone 26a. However, it will be understood that the desired signal portion from any microphone can be used. The hands-free system 10 has no direct access to the local voice signal 14, or to the desired signal portions sm[i] within the signals rm[i] to which the local voice signal
14 corresponds. Instead, the desired signal portions sm[i] only occur in combination with noise signals nm[i] within each ofthe signals rm[i] provided by each ofthe one or more microphones 26a-26M. Each desired signal portion sm[i] provided by each microphone 26a-26M is related to the desired signal portion sι[i] provided by the first microphone through a linear convolution:
Sm[i] = sι[i] * gm[i], i = l, ..., M where the gm[i] are the transfer functions relating Sι[i] provided by the first microphone 26a to sm[i] provided by the other microphones 26m. These transfer function are not necessarily causal. In one particular embodiment, the transfer functions gm[i] can be modeled as a simple time delays or time advances; however, these transfer functions can be any transfer function.
Similarly, each remote voice signal em[i] provided by each microphone 26a- 26M as part ofthe signals rm[i] is related to the remote voice-producing signal q[i] through a linear convolution: em[i] = q[i]* km[i], m= 1, ..., M
In the above equation, km[i] are the transfer functions relating q[i] to em[i]. The transfer functions km[i] are strictly causal. The above relationships have equivalent representations in the frequency domain. Lower case letters are used in the above equations to represent time domain signals. In contrast, upper case letters are used in the equations below to represent the same signals, but in the frequency domain. Furthermore, vector notations are used to represent the values among the one or more microphones 26a-26M. Therefore, similar to the above time-domain representations given above, in the frequency-domain:
R(ω)= S{ω)+ N{ω)
= G (ω)Sι(ω) + N (ω),
In the above equation, R(ω) is a frequency-domain representation of a group ofthe
time-sampled microphone output signals rm[i], S(ω) is a frequency-domain
representation of a group ofthe time-sampled desired signal portion signals sm[i],
N(_y) is a frequency-domain representation ofa group ofthe time-sampled noise
portion signals nm[i], G (ω) is a frequency-domain representation ofa group ofthe transfer functions gm[i], and Sι(ω) is a frequency-domain representation of a group of the time-sampled desired signal portion signals Sι[i] provided by the first microphone 26a.
G (ω) is a matrix of size M x 1 and Sι(co) a scalar value is of size l x l.
Similarly, in the frequency domain:
N(ω) = K{ω)Q(ω),
In the above equation, N(-y)) is a frequency-domain representation of a group of the
time-sampled signals nm[i], K(ω) is a frequency-domain representation ofa group of
the transfer functions km[i], and Q(ω) is a frequency-domain representation of a group ofthe time-sampled signals q[i]. K(ω) is a vector of size M x 1 , and Q(ω) is a scalar value of size l x l.
A mean-square error is a particular measurement that can be evaluated to characterize the performance ofthe hands-free system 10. The means square error can be represented as: μ[i] = sι(i) - §ι[i],
In the above equation. §ι[i] is an "estimate signal" corresponding to an estimate ofthe desired signal portion sι[i] ofthe signal rι[i] provided by the first microphone 26a. As described above, an estimate of any ofthe desired signal portions sm[i] could be used equivalently. In one particular embodiment, the estimate signal §ι[i] is the desired output ofthe hands-free system 10, providing a high quality, noise reduced signal to a remote person.
In one embodiment the signal processor 30 provides processing that comprises minimizing the variance of μ[i], where the variance of μ[i] can be expressed as:
Figure imgf000017_0001
or equivalently:
Var { s,[i]- §,[.]} = E{| s,[i]- s1[i] |2} The above equations are used in conjunction with figures below to more fully describe the processing provided by the signal processor 30.
Referring now to FIG. 2, a portion 50 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes the one or more microphones 26a-26M coupled to the signal processor 30. The signal processor 30 includes a data processor 52 and an adaptation processor 54 coupled to the data processor. The microphones 26a-26M provide the signals rm[i] to the data processor 52 and to the adaptation processor 54. In operation, the data processor 52 receives the signal rm[i] from the one or more microphones 26a-26M and, by processing described more fully below, provides an estimate signal sm[i] ofa desired signal portion sm[i] corresponding to one ofthe microphones 26a-26M, for example an estimate signal §ι[m] ofthe desired signal portion sι[i] ofthe signal rι[i] provided by the microphone 26a. It will be recognized that the desired signal portion sι[i], corresponds to the local voice signal 14 (FIG. 1) and in particular to the local voice signal Sι[i] (FIG. 1) provided by the person 12 (FIG. 1) along the path 15a (FIG. 1). However, in other embodiments, the desired signal portion sm[i] provided by any ofthe one or more microphones 26a-26M can be used equivalently in place of s i [i] above, and therefore, the estimate becomes sm[i] . While in operation, the adaptation processor 54 dynamically adapts the processing provided by the data processor 52 by adjusting the response ofthe data processor 52. The adaptation is described in more detail below. The adaptation processor 54 thus dynamically adapts the processing performed by the data processor 52 to allow the data processor to provide an audio output as an estimate signal sι[i] having a relatively high quality, and a relatively high signal to noise ratio in the presence ofthe varying local voice signal 14 (FIG. 1), the varying remote voice signal 22 (FIG. 1), and the varying environmental noise signal 18 (FIG. 1). The variation of these signals is described above in conjunction with FIG. 1. Referring now to FIG. 3, a portion 70 ofthe exemplary hands-free system 10 of
FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes the one or more microphones 26a-26M coupled to the signal processor 30. The signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor 52. The microphones 26a-26M provide the signals rm[i] to the data processor 52 and to the adaptation processor 54.
The data processor 52 includes an array processor (AP) 72 coupled to a single channel noise reduction processor (SCNRP) 78. The AP 72 includes one or more AP filters 74a-74M, each coupled to a respective one ofthe one or more microphones 26a- 26M. The outputs ofthe one or more AP filters 74a-74M are coupled to a combiner circuit 76. In one particular embodiment, the combiner circuit 72 performs a simple sum ofthe outputs ofthe one or more AP filters 74a-74M. In total, the AP 72 has one or more inputs and a single scalar- valued output comprising a time series of values.
The SCNRP 78 includes a single input, single output SCNRP filter. The input to the SCNRP filter 80 is an intermediate signal z[i] provided by the AP 72. The output ofthe SCNRP filter provides the estimate signal §ι[i] ofthe desired signal portion Sι[i] of z[i] corresponding to the first microphone 26a. The estimate signal §ι[i], and alternate embodiments thereof, is described above in conjunction with FIG. 2.
In operation, the adaptation processor 54 dynamically adapts the response of each ofthe AP filters 74a-74M and the response ofthe SCNRP filter 80. The adaptation is described in greater detail below.
Referring now to FIG. 4, a portion 90 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes the one or more microphones 26a-26M coupled to the signal processor 30. The signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor 52. The microphones 26a-26M provide the signals rm[i] to the data processor 52 and to the adaptation processor 54.
The data processor 52 includes the array processor (AP) 72 coupled to the single channel noise reduction processor (SCNRP) 78. The AP 72 includes the one or more AP filters 74a-74M. The outputs ofthe one or more AP filters 74a-74M are coupled to the combiner circuit 76.
The adaptation processor 54 includes a first adaptation processor 92 coupled to the AP 72, and to each AP filter 74a-74M therein. The first adaptation processor 92 provides a dynamic adaptation ofthe one or more AP filters 74a- 74M. However, it will be understood that the adaptation provided by the first adaptation processor 92 to any one ofthe one or more AP filters 74a-74M can be the same as or different from the adaptation provided to any other ofthe one or more AP filters 74a-74M.
The adaptation processor 54 also includes a second adaptation processor 94 coupled to the SCNRP 78 and to the SCNRP filter 80 therein. The second adaptation processor 94 provides an adaptation ofthe SCNRP filter 80.
In operation, the first adaptation processor 92 dynamically adapts the response of each ofthe AP filters 74a-74M in response to noise signals. The second adaptation processor 94 dynamically adapts the response ofthe SCNRP filter 80 in response to a combination of desired signals and noise signals. Because the signal processor 30 has both a first and a second adaptation processor 92, 94 respectively, each ofthe two adaptations can be different, for example, they can have different time constants. The adaptation is described in greater detail below.
Referring now to FIG. 5, a circuit portion 90 of an the exemplary hands-free system 10 of FIG. 1 , in which like elements of FIG. 1 are shown having like reference designations, includes the one or more microphones 26a-26M coupled to the signal processor 30. The signal processor 30 includes the data processor 52 and the adaptation processor 54 coupled to the data processor. The microphones 26a-26M provide the signals rm[i] to the data processor 52 and to the adaptation processor 54. The variable 'k' in the notation below is used to denote that the various power spectra are computed upon a k-th frame of data. At a subsequent computation, the various power spectra are computed on a k+l-th frame of data, which may or may not overlap the k-th frame of data. The variable 'k' is omitted from some ofthe following equations. However, it will be understood that the various power spectra described below are computed upon a particular data frame 'k'.
Notation given above describes the power spectrum notation Ps (ω) as an M x
M matrix whose (i, j) entry is the Fourier Transform ofthe (i, j) entry ofthe
autocorrelation function p^ [t] at frequency ω. The adaptation processor 54 can be
described with similar notations.
The adaptation processor 54 includes the first adaptation processor 92 coupled to the AP 72, and to each AP filter 74a- 74M therein. The first adaptation processor 92 includes a voice activity detector (VAD) 102. The VAD is coupled to an update
processor 104 that computes a noise power spectrum Pm{ω;k) . The update processor
104 is coupled to an update processor 106 that receives the power spectrum and
computes a noise power spectrum Pn{ω;k) therefrom. The power spectrum Plt{ω;k) is
a power spectrum ofthe noise portion ofthe intermediate signal z[i]. In combination,
the two update processors 104, 106 provide the noise power spectrums Pm{ω;k) and
P„{ω; k) in order to update the AP filters 74a-74M. The update ofthe AP filters 74a-
74M is described in more detail below.
The adaptation processor 54 also includes the second adaptation processor 94 coupled to the SCNRP 78 and to the SCNRP filter 80 therein. The second adaptation processor 94 includes an update processor 106 that computes a power spectrum
Pz2{ω;k) . The power spectrum P2Z{ω;k) is a power spectrum ofthe entire intermediate signal z[i]. The update processor 106 provides the power spectrum
Pzz{ω; k) in order to update the SCNRP filter 80. The update ofthe SCNRP filter 80 is
described in more detail below.
The one or more channels of time-domain input samples rι[i] to ΓM[1] provided to the AP 72 by the microphones 26a-26M can be considered equivalently to be a
frequency domain vector-valued input signal R (co). Similarly, the single channel time domain output samples z[i] provided by the AP 72 can be considered equivalently to be a frequency domain scalar-valued output Z(ω). The AP 72 comprises an M-input,
single-output linear filter having a response F (co) expressed in the frequency domain, where each element thereof corresponds to a response Fm(ω) of one ofthe AP filters
74a-74M. Therefore the output signal Z(ω) can be described by the following equation:
M
Z(co) = ∑Fm (ω)Rm(ω) m=\
= Fτ{ω)R{ω) ,
where
F (ω) = [F,(ω) F2(ω) ... FM(ω)]τ, and
R (ω) = [R1(ω) R2(ω) ... RM(ω)]τ As described above, the superscript T refers to the transpose of a vector,
therefore F (co) and R (ω) are column vectors having vector elements corresponding to each microphone 26a-26M. The asterisk symbol * corresponds to a complex conjugate. In operation ofthe signal processor 54, the VAD 102 detects the presence or absence ofa desired signal portion ofthe intermediate signal z[i]. The desired signal portion can be sι[i], corresponding to the voice signal provided by the first microphone 26a. One of ordinary skill in the art will understand that the VAD 102 can be constructed in a variety of ways to detect the presence or absence of a desired signal portion. While the VAD is shown to be coupled to the intermediate signal z[i], in other embodiments, the VAD can be coupled to one or more ofthe microphone signals ri [i] to rm[i], or to the output estimate signal §ι[i]. In operation ofthe first adaptation processor 92, the response ofthe filters 74a-
74m, F (co), is determined so that the output Z(ω) ofthe AP 72 is the maximum likelihood (ML) estimate of Sι(ω), where Sι(ω) is a frequency domain representation of the desired signal portion Sι[i] ofthe input signal rχ[i] provided by the first microphone 26a as described above. Therefore, it can be shown that the responses ofthe AP filters 74 can be described by vector elements in the equation:
F τ(ω) = — = G H(co)P :„i (co)
GH {ω)Pøn {ω)G{ω)
In the above equation, G (co) is the frequency domain vector notation for the transfer
function gm[i] between the microphones as described above, P _- (ω) corresponds to the
power spectrum ofthe noise. The transfer function F ( o) provides a maximum
likelihood estimate of S ι(ω) based upon an input of R (ω).
It will be understood that the m-th element ofthe vector F ( o) is the transfer
function ofthe m-th AP filter 74m. With the above vector transfer function, F (ω), the sum, Z(ω), ofthe outputs ofthe AP filters 74a-74M includes the desired signal portion Sι(co) associated with the first microphone, plus noise. Therefore, the desired signal portion Sι(ω) passes through the AP filters 74a-74M without distortion.
From the above equation, it can be seen that the response ofthe AP 72, F (ω), does not depend on the power spectrum Psisi(ω) ofthe desired signal portion sι[i].
Instead, it is only dependant upon P .- (ω), the power spectrum ofthe noise signal portions nm[i]. This is as expected, since the AP filters are adapted in response to power spectra computed during times when the VAD 102 indicates the absence ofthe local voice signal (14, FIG. 1).
The desired signal portion Sι[i] ofthe input signal rι[i], corresponding to the local voice signal 14 (FIG. 1), can vary rapidly with time. As seen from the above
equation, the response ofthe AP 72, F (ω), only depends upon the power spectrum
P^ (ω) ofthe noise signal portions nm[i] ofthe input signal rι[i], and also on the
frequency domain vector G (co), corresponding to the time domain transfer functions gm[i] between the microphones described above. Therefore the transfer functions
within the vector F (ω) are adapted based only in proportion to the noise, irrespective ofa local voice signal 14 (FIG. 1).
The transfer functions F (co), therefore, can be updated, i.e. have time constants, that vary more slowly than the desired signal portions corresponding to the local voice signal 14 (FIG. 1). As mentioned above, using a slower time constant for adaptation of the AP filters results in a more accurate adaptation ofthe AP filters. The AP filters are adapted based on estimates ofthe power spectrum ofthe noise, and using a slower time constant to estimate the power spectrum ofthe noise results in a more accurate estimate ofthe power spectrum ofthe noise; since, with a slower time constant, a longer measurement window can be used for estimating.
In order to compute the power spectrum P m (co), and the inverse thereof, the
VAD 102 provides to the update processor 104 an indication of when the local voice signal 14 (FIG. 1) is absent, i.e. when the person 12 (FIG. 1) is not talking. Therefore,
the update processor 104 computes the power spectrum P -- (co) ofthe noise signal
portions nm[i] ofthe input signal rm[i] during a time, and from time to time, when only the noise signal portions nm[i] are present. When the person 12 (FIG. 1) is silent, r [i] = [i] (since s [i] = 0), and on those frames of data, r [i] is used to update the inverse
-l power-spectrum ofthe noise P „n (ω; k), and therefore, to compute the transfer
functions ofthe AP filters 74a-74M. Therefore, the responses ofthe AP filters 74a-
74M, corresponding to the elements ofthe vector F (co), are computed at a time when no desired signal portions sm[i] are present.
As seen in the above equations, the transfer function F (ω) contains terms for the inverse ofthe power spectrum ofthe noise. It will be recognized by one of ordinary skill in art that there are a variety of mathematical methods to directly calculate the inverse of a power spectrum, without actually performing a mathematical vector inverse operation may be used. One such method uses a recursive least squares (RLS) algorithm to directly compute the inverse ofthe power spectrum, resulting in improved processing time. However, other methods can also be used to provide the inverse ofthe
power spectrum P jji (co).
The frequency domain representation Z(co) ofthe scalar-valued intermediate output signal z[i] can be expressed as sum of two terms: a term Sι(co) due to the desired signal Sι[i] provided by the first microphone 26a, and a term T(co) due to the noise t[i] provided by the one or more microphones 26a-26M. Therefore, it can be shown that:
Z(co) = Sι(ω) + T(ω) where T(co) has the following power spectrum:
tt(CB) " GH {ω)Pøi{ω)G{ω)
The scalar-valued Z(ω) is further processed by the SCNRP filter 80. The SCNRP filter 80 comprises a single-input, single-output linear filter with response: P ω) Furthermore,
PΩ(ω) =Psιsι(ω) - Ptt(co) or equivalently, Psisi(ω) = Pzz(ω) - P„ (ω) In the above equations, Psιsι(ω) is the power spectrum ofthe desired signal portion of the first microphone signal rι[i] within the intermediate output signal z[i], Pzz(ω) is the power spectrum ofthe intermediate output signal z[i], and Ptt(ω) is the power spectrum ofthe noise signal portion ofthe intermediate output signal z[i]. Therefore, Q(ω) can be equivalently expressed as:
(X^ i - W
P ω) Therefore, the transfer function Q(ω) ofthe SCNRP filter 80 can be expressed as a function of Psιsι(ω) and P (co) or equivalently as a function of Ptt(co) and Pzz(co) . Therefore, the second adaptation processor 94, in the embodiment shown, receives the signal z[i], or equivalently the frequency domain signal Z(ω), and the update processor 108 computes the power spectrum Pzz(-a) corresponding thereto. The
update processor 108 is also provided with the power spectrum Ptt(ω) computed by the update processor 106. Therefore, the second adaptation processor 94 can provide the SCNRP filter 80 with sufficient information to generate the desired transfer function Q(co) described by the above equations. While the second update processor updates the SCNRP filter 80 based upon
Ptt(co) and Pzz(co), in another embodiment, an alternate second update processor updates the SCNRP filter 80 based upon Psisi(ω) and Pzz (co). The above equations show these two alternatives to be equivalent. In one particular embodiment, the SCNRP filter 80 is essentially a single-input single-output Weiner filter. The cascaded system of FIG. 5, consisting ofthe AP 72 followed by the SCNRP 78, is mathematically equivalent to an M-input/1 -output
Wiener filter for estimating Sι(co) based on R (co), where the transfer function ofthe Wiener filter is described by the equation:
H(w) = E ( ω) x Q(co).
Referring again to the above equation for F (co), that describes the transfer function ofthe AP filters 74a- 74M, the hands-free system can also adapt the transfer
function G ( o) in addition to the dynamic adaptations to the AP filters 74 and the SCNRP filter 80. It is discussed above that gm[i] is the transfer function between the desired signal sι[i] and the other desired signals sm[i]:
sm[i] = gm[i] * sι[i] or equivalently
Sm(ω) = Gm(co) S,(ω) Given samples ofthe desired signal portions sm[i], a variety of techniques known to one of ordinary skill in the art can be used to estimate Gm(ω). One such technique is described below.
To collect samples ofthe desired signal portions sm[i] at the output ofthe microphones 26a-26M, the person 12 (FIG. 1) must be talking and the noise n [i] corresponding to the environmental noise signals vm[i] and the remote voice signals em[i] must he much smaller than the desired signal s [i], i.e. the SNR at the output of each microphone 26a-26M must be high. This high SNR occurs whenever the talker is talking in a quiet environment.
Whenever the SNR is determined to be high, the signal processor 30 can collect the desired signal Sι[i] (sι[i]= rι[i] for high SNR) from the output ofthe first microphone, and the signal processor 30 can collect sm[i] (sm[i]= rm[i] for high SNR) from the output ofthe m-th microphone. The signal processor 30 can then use these samples to estimate the cross power-spectrum between sι[i] and sm[i] (denoted herein as Psism(ω)). A well-known method for estimating Psism(ω) from samples of sι[i] and sm[i] is the Welch method of spectral estimation. Recall that Psism(ω) is the Fourier Transform of: yCsismW = E{sι[i]sm[i + t]};
therefore p sism( ) can be estimated.
Once Psism(ω) is estimated, the signal processor 30 can use Psism(ω)/Psisi(ω) as the final estimate of Gm(ω), where Psisi(ω) is the power spectrum of Sι[i] obtained using a Welch method.
In one particular embodiment, the person 12 (FIG. 1) can explicitly initiate the
estimation of G (ω) by commanding the system to start estimating G (co) at a particular time (e.g. by pushing a button and starting to talk). With this particular arrangement, the person 12 (FIG. 1) commands the system to start estimating G(co) only when they determine that the SNR is high (i.e. the noise is low). Generally, in the environment of
an automobile, for example, G (co) changes little over time for a particular user and for
a particular automobile. Therefore, G (co) can be estimated once at installation ofthe hands free system 10 (FIG. 1) into the automobile.
In some arrangements, the hands-free system 10 (FIG. 1) can be used as a front- end to a speech recognition system that requires training. Such speech recognition systems (SRS) require the user to train the SRS by uttering a few words/phrases in a quiet environment. The noise reduction system can use the same training period for estimating G (co) since, the training ofthe SRS is done also in a quiet environment.
Alternatively, the signal processor 30 can determine when the SNR is high, and
it can initiate the process for estimating G (co). For example, in one particular embodiment, to estimate the SNR at the output ofthe first microphone, the signal processor 30, during the time when the talker is silent (as determined by the VAD 102), measures the power ofthe noise at the output ofthe first microphone 26a. The signal processor 30, during the time when the talker is active (as determined by the VAD 102), measures the power ofthe speech plus noise signal. The signal processor 30 estimates the SNR at the output ofthe first microphone 26a as the ratio ofthe power of the speech plus noise signal to the noise power. The signal processor 30 compares the estimated SNR to a desired threshold, and if the computed SNR exceeds the threshold, the signal processor 30 identifies a quiet period and begins estimating elements of
G (ω).
In either arrangement, upon either identification of a quiet period by a user or
by the signal processor 30, each element of G (co) is estimated by the signal processor 30 as the ratio ofthe cross power spectra Psism(ω) to the power spectrum Psιsι(ω)
Therefore, having adapted the AP filters 74 with the transfer function F (co) above, the SCNRP filters with the transfer function Q(ω) above, and the transfer
functions G (co) with the techniques above, the output ofthe hands-signal processor 30 is the estimate signal §ι[i], as desired.
The noise signal portions nm[i] and the desired signal portions sm [i] ofthe microphone signals rm [i] can vary at substantially different rates. Therefore, the structure ofthe signal processor 30, having the first and the second adaptation processors 92, 94 respectively, can provide different adaptation rates for the AP filters 74a-74M and for the SCNRP filter 80. As described above, having different adaptation rates results in a more accurate adaptation ofthe AP filters; therefore, this results in improved noise reduction.
Referring now to FIG. 6, a circuit portion 120 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes a first adaptation processor 134. Unlike the first adaptation processor 92 of FIG. 5, the first adaptation processor 134 does not contain the VAD 102 (FIG. 5). Therefore, an update processor 130, must compute the noise power
spectrum P ~ (co) while both the noise portions nm[i] ofthe input signals rm[i] and the
desired signal portions sm[i] ofthe input signals rm[i] are present, i.e. while the person 12 (FIG. 1) is talking.
In this particular embodiment, in order to accomplish calculation of P m (co)
while the person 12 (FIG. 1) is talking, it would be desirable to subtract the desired signal portions sm[i] from the input signals rm[i] before receiving them with the first adaptation processor 134. However, the desired signal portions sm[i] are not explicitly known by the signal processor 30. Therefore, signals representing the desired signal portions sm[i] are instead subtracted from input signals rm[i].
A good estimate of a particular desired signal portion from the first microphone appears as the estimate signal Sι[i] at the output ofthe SCNRP filter 80. Therefore, in one embodiment, the estimate signal Si [i] is passed through subtraction processors 126a-126M, and the resulting signals are subtracted from the input signals rm[i] via subtraction circuits 122a-122M to provide subtracted signals 128a-128M to the update processor 130. The subtraction processors 126a-126M comprise filters that operate upon the estimate signal §ι[i]. The subtracted signals 128a-128M are substantially noise signals, corresponding substantially to the noise signal portions nm[i] ofthe input signals rm[i]. Therefore, the update processor 130 can compute the noise power
spectrum P m (co) and the inverse thereof used in computation ofthe responses F (co) of
the AP filters 74a-74M from the equations given above. While this embodiment 120 couples the subtraction processors 126a-126M to the estimate signal §ι[i] at the output ofthe SCNRP filter 80, in other embodiments, the subtraction processors can be coupled to other points ofthe system. For example, the subtraction filters can be coupled to the intermediate signal z[i].
The subtraction processors 126a-126M have the transfer functions Gm(ω), which, as described above, relate the desired signal portion ofthe first microphone
Sι(co) to the desired signal portion ofthe m-th microphone Sm(co), (i.e. Gm(co) = Sm(ω)/ S,(ω)).
Referring now to FIG. 7, a circuit portion 150 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes a data processor 162. The data processor 162 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6. However, it will be understood that the data processor 162 is but part ofa signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6. The data processor 162 includes an AP 156 and a SCNRP 160 that can correspond, for example to the AP 52 and the SCNRP 78 of FIG. 6. The remote- voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to remote voice canceling processors 154a-154M. The remote voice canceling processors 154a-154M comprise filters that operate upon the remote-voice-producing signal q[i]. The outputs ofthe remote voice canceling processors 154a-154M are subtracted via subtraction circuits 152a-152M from the signals rχ[i] to rm[i] provided by the microphones 26a-26m. Therefore, noise attributed to the remote-voice-producing signal q[i] which forms a part ofthe signals rι[i] to rm[i] is subtracted from the signals rι[i] to rm[i] before the subsequent processing is performed by the AP 156 in conjunction with first and second adaptation processors (not shown).
Therefore, in this particular embodiment :
r [i] = r [i] - [i] * q[i] In the above equation, k[i] is the impulse-response ofthe acoustic channel between q[i] and the intermediate signal z[i]. The transfer function ofthe m-th remote voice- canceling filter is Km(ω), where Km(co) is an estimate ofthe transfer function with input q[i] and output em[i], (i.e., Km(co) = E m(ω)/Q(ω)).
With this particular arrangement, the effect ofthe remote voice-producing signal q[i] on intelligibility ofthe estimate signal §ι[i] is reduced with the remote voice canceling processors 154a-154M.
Referring now to FIG. 8, a circuit portion 170 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes a data processor 180. The data processor 180 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6. However, it will be understood that the data processor 180 is but part of a signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6. The data processor 180 includes an AP 172 and a SCNRP 174 that can correspond, for example to the AP 52 and the SCNRP of FIG. 6. The remote-voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to a remote voice canceling processor 178. The remote voice canceling processor 178 comprises a filter that operates upon the remote-voice- producing signal q[i]. The output ofthe remote voice canceling processor 178 is subtracted via subtraction circuit 176 from the estimate signal §ι[i], therefore providing an improved estimate signal §ι[i]'. Therefore, noise attributed to the remote-voice- producing signal q[i] which forms a part ofthe signals rι[i] to rm[i] is subtracted from the final output ofthe data processor 180. The response ofthe signal channel between q[i] and the output ofthe SCNRP
174 is:
M
P (co) = ∑ Km(co)Fm(co)Q(co) m=\
In the above equation, Km(ω) is the transfer function ofthe acoustic channel with input q[i] and output em[i], Fm(ω) is the transfer function ofthe m-th filter ofthe AP 172, and Q(co) is the transfer function of the SCNRP 174.
With this particular arrangement, the effect ofthe remote- voice-producing signal q[i] on intelligibility ofthe improved estimate signal §ι[i]' is reduced with but one echo-canceling processor 178.
Referring now to FIG. 9, a circuit portion 190 ofthe exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes a data processor 200. The data processor 200 is shown without the first and second adaptation processors 134, 94 respectively of FIG. 6. However, it will be understood that the data processor 200 is but part of a signal processor, for example the signal processor 30 of FIG 6, which includes first and second adaptation processors, for example the first and second adaptation processors 134, 94 of FIG. 6.
The data processor 200 includes an AP 192 and a SCNRP 198 that can correspond, for example to the AP 52 and the SCNRP of FIG. 6. The remote- voice- producing signal q[i] that drives the loudspeaker 20 to produce the remote voice signal 22 (FIG. 1) is introduced to remote voice canceling processor 194. The remote voice canceling processor 194 comprises a filter that operates upon the remote-voice- producing signal q[i]. The output ofthe remote voice canceling processor 194 is subtracted via subtraction circuit 196 from the intermediate signal z[i], therefore providing an improved estimate signal z[i]'. Therefore, noise attributed to the remote- voice-producing signal q[i] which forms a part of the signals ri [i] to rm[i] is subtracted from the intermediate signal z[i].
The response ofthe signal channel between q[i] and the output ofthe AP 172 is:
M
E (co) = ∑ Km(co)Fm(ω) m=
In the above equation, Km(ω) is the transfer function ofthe acoustic channel with input q[i] and output em[i], and Fm(ω) is the transfer function ofthe m-th AP filter within the AP 172 .
With this particular arrangement, the effect ofthe remote-voice-producing
signal q[i] on intelligibility ofthe estimate signal s ι[i] is reduced with but one echo- canceling processor 194. Referring now to FIG. 10, a circuit portion 210 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes the microphones 26a-26M each coupled to a respective serial-to- parallel converter 212a-212M. The serial to parallel converters store data samples from the signals rι[i]-rm[i] into data groups. The serial to parallel converters 212a-212M provide the data groups to Nl -point discrete Fourier transform (DFT) processors 214a- 214M. The DFT processors 212a-212M are each coupled to a data processor 216 and an adaptation processor 218 which can be similar to the data processor 52 and adaptation processor 54 described above in conjunction with FIG. 6. In operation, the DFT processors convert the time-domain samples rm[i] into frequency domain samples, which are provided to the data processor 216 and to the adaptation processor 218. Therefore, frequency domain samples are provided to both the data processor 216 and the adaptation processor 218. Filtering performed by AP filters (not shown) within the data processor 216 and power spectrum calculations provided by the adaptation processor 218 can be done in the frequency domain as is described above.
Referring now to FIG. 11, a circuit portion 230 of an the exemplary hands-free system 10 of FIG. 1, in which like elements of FIG. 1 are shown having like reference designations, includes the microphones 26a-26M each coupled to respective serial-to- parallel converter 232a-232M and respective serial-to parallel converters 234a-234M. The serial to parallel converters store data samples from the signals rι[i] to rm[i] into data groups and provide the data groups to Nl -point discrete Fourier transform (DFT) processors 236a-236M. The serial to parallel converters 234a-234M provide the data groups to window processors 238a-238M and thereafter to N2 -point discrete Fourier transform (DFT) processors 238a-238M. The DFT processors 236a-236M are each coupled to a data processor 242. The DFT processors 240a-240M are each coupled to an adaptation processor 244. The data processor 242 and the adaptation processor 244 can be the type of data processor 52 and adaptation processor 54 of FIG. 6.
In operation, the DFT processors convert the time-domain data groups into frequency domain samples, which are provided to the data processor 242 and to the adaptation processor 244. Therefore, frequency domain samples are provided to both the data processor 242 and the adaptation processor 244. Therefore, filtering provided by AP filters (not shown) in the data processor 242 and power spectrum calculations provided by the adaptation processor 244 can be done in the frequency domain as is described above.
It is known in the art that the accuracy of estimating the noise power spectrum
-l P m (co) and the inverse thereof P %n (ω) c n be improved by applying a windowing
function, such as that provided by the windowing processors 238a-238M. Therefore, the windowing processors 238a-238M provide the adaptation processor 244 with an improved ability to accurately determine the noise power spectrum and therefore to update the AP filters (not shown) within the data processor 242. However, it is also known that the use of windowing on signals that are used to provide an audio output in the data processor 216 results in distorted audio and a less intelligible output signal. Therefore, while is it desirable to provide the windowing processors 238a-238M for the signals to the adaptation processor 244, it is not desirable to provide windowing processors for the signals to the data processor 242.
With the particular arrangement shown in the circuit portion 230, the Nl -point
DFT processors 236a-236M and the N2-point DFT processors 240a-240M can compute using a number of time domain data samples Nl different from a number of time domain data samples N2.
All references cited herein are hereby incorporated herein by reference in their entirety.
Having described preferred embodiments ofthe invention, it will now become apparent to one of ordinary skill in the art that other embodiments incorporating their concepts may be used. It is felt therefore that these embodiments should not be limited to disclosed embodiments, but rather should be limited only by the spirit and scope of the appended claims.
What is claimed is:

Claims

1. A system for processing one or more input signals, the system comprising: a first processor having one or more channels, each channel comprising a respective first processor filter, each channel configured to receive a respective one of the one or more input signals, wherein the first processor is configured to provide an intermediate output signal; a second processor comprising a second processor filter configured to receive the intermediate output signal and provide a noise-reduced output signal; a first adaptation processor coupled to the first processor; and a second adaptation processor coupled to the second processor.
2. The system of Claim 1 , wherein a noise signal portion of each respective one of the one or more input signals comprises a representation of acoustic noise, and a desired signal portion of each respective one ofthe one or more input signals comprises a representation of a voice.
3. The system of Claim 1, wherein the first adaptation processor adapts the first processor filter in each of the one or more channels in response to a variation of a power spectral density (PSD) of a noise signal portion of respective ones ofthe one or more input signals.
4. The system of Claim 3, wherein the first adaptation processor does not respond to variations ofthe power spectral density ofa desired signal portion of respective ones ofthe one or more input signals.
5. The system of Claim 3, wherein the first adaptation processor includes a power spectral density inversion processor that directly provides the inverse ofthe power spectral density (PSD) ofthe noise signal portion of respective ones ofthe one or more input signals.
6. The system of Claim 1 , wherein the second adaptation processor adapts the second processor filter in response to variations ofthe power spectral density (PSD) of a desired signal portion ofthe intermediate output signal.
7. The system of Claim 1, wherein the second adaptation processor adapts the second processor filter in response to variations ofthe power spectral density (PSD) of the intermediate output signal and to variations ofthe power spectral density (PSD) of a noise portion ofthe intermediate output signal.
8. The system of Claim 1 , wherein the first adaptation processor includes a voice activity detection (VAD) processor coupled to the intermediate output signal, the VAD processor having a VAD processor output for indicating when a desired signal portion ofthe intermediate output signal is absent.
9. The system of Claim 8, wherein the first adaptation processor adapts the first processor filter in each ofthe one or more channels in response to the VAD processor output.
10. The system of Claim 9, wherein the first adaptation processor adapts the first processor filter in each ofthe one or more channels in response to a noise portion of respective ones the one or more input signals, in response to the VAD processor output.
11. The system of Claim 1 , wherein the first adaptation processor includes a voice activity detection (VAD) processor coupled to at least one ofthe one or more input signals, the VAD processor having a VAD processor output for indicating when a desired signal portion of the at least one ofthe one or more input signals is absent.
12. The system of Claim 11, wherein the first adaptation processor adapts the first processor filter in each ofthe one or more channels in response to the VAD processor output.
13. The system of Claim 12, wherein the first adaptation processor adapts the first processor filter in each ofthe one or more channels in response to the noise portion of respective one ofthe one or more input signals, in response to the VAD processor output.
14. The system of Claim 1 , wherein the first adaptation processor includes a subtraction processor for subtracting a filtered version of an estimate ofa desired signal portion from each ofthe one or more input signals to provide one or more respective subtracted signals.
15. The system of Claim 14, wherein the first adaptation processor adapts the first processor filter in each of the one or more channels in response to a variation of a power spectral density (PSD) ofthe one or more subtracted signals.
16. The system of Claim 14, wherein the first adaptation processor includes a subtraction processor for subtracting a filtered version ofthe intermediate signal or a filtered version ofthe noise-reduced output signal from each ofthe one or more input signals to provide one or more respective subtracted signals.
17. The system of Claim 16, wherein the first adaptation processor adapts the first processor filter in each of the one or more channels in response to a variation of a power spectral density (PSD) ofthe one or more subtracted signals.
18. The system of Claim 1 , wherein the first adaptation processor adapts the first processor filters in each ofthe one or more channels so that the intermediate output is a maximum-likelihood estimate of a desired signal portion of the one or more input signals.
19. The system of Claim 1 , wherein the second processor filter comprises a single- input single-output Weiner filter.
20. The system of Claim 1, wherein the first adaptation processor adapts the first processor filters in each ofthe one or more channels so that the intermediate output is a maximum-likelihood estimate ofa desired signal portion ofthe one or more input signals, and the second processor filter comprises a single-input single-output Weiner filter.
21. The system of Claim 1 , wherein the first processor includes an un- windowed discrete Fourier transform (DFT) processor.
22. The system of Claim 1, wherein the first adaptation processor includes a windowed discrete Fourier transform (DFT) processor.
23. The system of Claim 1 , further including a remote voice canceling processor for subtracting a remote-voice-producing signal from each ofthe one or more input signals.
24. The system of Claim 1 , further including a remote voice canceling processor for subtracting a remote-voice-producing signal from the intermediate output signal.
25. The system of Claim 1 , further including a remote voice canceling processor for subtracting a remote-voice-producing signal from the noise-reduced output signal.
26. A system, comprising: a first filter portion configured to receive one or more input signals and to provide a single intermediate output signal; a second filter portion configured to receive the single intermediate output signal and to provide a single output signal; and a control circuit configured to receive at least a portion of each ofthe one or more input signals and at least a portion ofthe single intermediate output signal and to provide information to adapt filter characteristics ofthe first and second filter portions.
27. The system of Claim 26, wherein the control circuit comprises a first adaptation processor for providing first information to adapt the filter characteristics ofthe first filter portion and a second adaptation processor for providing second information to adapt the filter characteristics ofthe second filter portion.
28. The system of Claim 27, wherein the first information corresponds to a noise power spectral density ofthe one or more input signals and the second information corresponds to one or more of: a power spectral density of: a noise portion ofthe intermediate output signal, a power spectral density of a desired signal portion ofthe intermediate output signal, and a power spectral density ofthe intermediate output signal.
29. The system of Claim 26, further including an echo canceling processor coupled to receive the single output signal, for reducing an echo signal portion ofthe output signal by subtracting a remote-voice-producing signal from at least one of: the one or more input signals, the single intermediate output signal, and the single output signal.
30. A method for processing one or more input signals, comprising: receiving the one or more input signals with a first filter portion, the first filter portion providing an intermediate output signal; receiving the intermediate output signal with a second filter portion, the second filter portion providing an output signal; dynamically adapting a response ofthe first filter portion and a response ofthe second filter portion.
31. The method of Claim 30, wherein the dynamically adapting comprises adapting a response ofthe first filter portion in response to a noise portion ofthe one or more input signals and adapting a response ofthe second filter portion in response to a power spectral density of at least one of: a noise portion ofthe intermediate output signal, a desired signal portion ofthe intermediate output signal, and characteristics ofthe intermediate output signal.
32. The method of Claim 31 , wherein the receiving with a first filter portion comprises receiving with a maximum-likelihood filter having multiple inputs and a single output, and the receiving with a second filter portion comprises receiving with a single-input single-output Weiner filter.
33. The method of Claim 30, further including: reducing a remote voice signal portion ofthe output signal by subtracting a remote-voice-producing signal from at least one of: the one or more input signals, the intermediate output signal, and the output signal.
34. The method of Claim 30, further including: estimating a transfer function between respective ones ofthe one or more input signals in a training period during which a person determines that the one or more input signals have a high signal to noise ratio.
35. The method of Claim 30, further including: estimating a transfer function between respective ones ofthe one or more input signals in a training period during which a signal processor determines that the one or more input signals have a high signal to noise ratio.
36. The method of Claim 35, wherein the estimating the transfer function in the training period comprises estimating the transfer function in the training period corresponding to the training period associated with a voice recognition system.
PCT/US2003/038657 2002-12-10 2003-12-05 Method and apparatus for noise reduction WO2004053838A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP03796674A EP1576587A2 (en) 2002-12-10 2003-12-05 Method and apparatus for noise reduction
AU2003298914A AU2003298914A1 (en) 2002-12-10 2003-12-05 Method and apparatus for noise reduction

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/315,615 US7162420B2 (en) 2002-12-10 2002-12-10 System and method for noise reduction having first and second adaptive filters
US10/315,615 2002-12-10

Publications (2)

Publication Number Publication Date
WO2004053838A2 true WO2004053838A2 (en) 2004-06-24
WO2004053838A3 WO2004053838A3 (en) 2004-08-05

Family

ID=32468751

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/038657 WO2004053838A2 (en) 2002-12-10 2003-12-05 Method and apparatus for noise reduction

Country Status (4)

Country Link
US (1) US7162420B2 (en)
EP (1) EP1576587A2 (en)
AU (1) AU2003298914A1 (en)
WO (1) WO2004053838A2 (en)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4209247B2 (en) * 2003-05-02 2009-01-14 アルパイン株式会社 Speech recognition apparatus and method
WO2005024787A1 (en) * 2003-09-02 2005-03-17 Nec Corporation Signal processing method and apparatus
US20060031067A1 (en) * 2004-08-05 2006-02-09 Nissan Motor Co., Ltd. Sound input device
US7813923B2 (en) * 2005-10-14 2010-10-12 Microsoft Corporation Calibration based beamforming, non-linear adaptive filtering, and multi-sensor headset
CN1809105B (en) * 2006-01-13 2010-05-12 北京中星微电子有限公司 Dual-microphone speech enhancement method and system applicable to mini-type mobile communication devices
US8949120B1 (en) 2006-05-25 2015-02-03 Audience, Inc. Adaptive noise cancelation
US7876906B2 (en) 2006-05-30 2011-01-25 Sonitus Medical, Inc. Methods and apparatus for processing audio signals
US8291912B2 (en) * 2006-08-22 2012-10-23 Sonitus Medical, Inc. Systems for manufacturing oral-based hearing aid appliances
HUE043135T2 (en) * 2006-09-08 2019-07-29 Soundmed Llc Methods and apparatus for treating tinnitus
US8140325B2 (en) * 2007-01-04 2012-03-20 International Business Machines Corporation Systems and methods for intelligent control of microphones for speech recognition applications
US8270638B2 (en) * 2007-05-29 2012-09-18 Sonitus Medical, Inc. Systems and methods to provide communication, positioning and monitoring of user status
US20080304677A1 (en) * 2007-06-08 2008-12-11 Sonitus Medical Inc. System and method for noise cancellation with motion tracking capability
US8868417B2 (en) * 2007-06-15 2014-10-21 Alon Konchitsky Handset intelligibility enhancement system using adaptive filters and signal buffers
US20080312916A1 (en) * 2007-06-15 2008-12-18 Mr. Alon Konchitsky Receiver Intelligibility Enhancement System
US20090028352A1 (en) * 2007-07-24 2009-01-29 Petroff Michael L Signal process for the derivation of improved dtm dynamic tinnitus mitigation sound
US20120235632A9 (en) * 2007-08-20 2012-09-20 Sonitus Medical, Inc. Intra-oral charging systems and methods
US8433080B2 (en) * 2007-08-22 2013-04-30 Sonitus Medical, Inc. Bone conduction hearing device with open-ear microphone
US8224013B2 (en) 2007-08-27 2012-07-17 Sonitus Medical, Inc. Headset systems and methods
US7682303B2 (en) 2007-10-02 2010-03-23 Sonitus Medical, Inc. Methods and apparatus for transmitting vibrations
US20090105523A1 (en) * 2007-10-18 2009-04-23 Sonitus Medical, Inc. Systems and methods for compliance monitoring
US8795172B2 (en) * 2007-12-07 2014-08-05 Sonitus Medical, Inc. Systems and methods to provide two-way communications
US7974845B2 (en) 2008-02-15 2011-07-05 Sonitus Medical, Inc. Stuttering treatment methods and apparatus
US8270637B2 (en) * 2008-02-15 2012-09-18 Sonitus Medical, Inc. Headset systems and methods
US8023676B2 (en) 2008-03-03 2011-09-20 Sonitus Medical, Inc. Systems and methods to provide communication and monitoring of user status
US8150075B2 (en) 2008-03-04 2012-04-03 Sonitus Medical, Inc. Dental bone conduction hearing appliance
US20090226020A1 (en) 2008-03-04 2009-09-10 Sonitus Medical, Inc. Dental bone conduction hearing appliance
WO2009131755A1 (en) * 2008-04-24 2009-10-29 Sonitus Medical, Inc. Microphone placement for oral applications
US20090270673A1 (en) * 2008-04-25 2009-10-29 Sonitus Medical, Inc. Methods and systems for tinnitus treatment
EP2196988B1 (en) * 2008-12-12 2012-09-05 Nuance Communications, Inc. Determination of the coherence of audio signals
KR101251045B1 (en) * 2009-07-28 2013-04-04 한국전자통신연구원 Apparatus and method for audio signal discrimination
CA2776368C (en) 2009-10-02 2014-04-22 Sonitus Medical, Inc. Intraoral appliance for sound transmission via bone conduction
US7928392B1 (en) * 2009-10-07 2011-04-19 T-Ray Science Inc. Systems and methods for blind echo cancellation
US8718290B2 (en) 2010-01-26 2014-05-06 Audience, Inc. Adaptive noise reduction using level cues
US8660842B2 (en) * 2010-03-09 2014-02-25 Honda Motor Co., Ltd. Enhancing speech recognition using visual information
US8473287B2 (en) 2010-04-19 2013-06-25 Audience, Inc. Method for jointly optimizing noise reduction and voice quality in a mono or multi-microphone system
US9378754B1 (en) * 2010-04-28 2016-06-28 Knowles Electronics, Llc Adaptive spatial classifier for multi-microphone systems
US9280984B2 (en) * 2012-05-14 2016-03-08 Htc Corporation Noise cancellation method
GB2510331A (en) 2012-12-21 2014-08-06 Microsoft Corp Echo suppression in an audio signal
GB2512022A (en) * 2012-12-21 2014-09-24 Microsoft Corp Echo suppression
GB2509493A (en) 2012-12-21 2014-07-09 Microsoft Corp Suppressing Echo in a received audio signal by estimating the echo power in the received audio signal based on an FIR filter estimate
US9633670B2 (en) * 2013-03-13 2017-04-25 Kopin Corporation Dual stage noise reduction architecture for desired signal extraction
US9312826B2 (en) 2013-03-13 2016-04-12 Kopin Corporation Apparatuses and methods for acoustic channel auto-balancing during multi-channel signal extraction
US10306389B2 (en) 2013-03-13 2019-05-28 Kopin Corporation Head wearable acoustic system with noise canceling microphone geometry apparatuses and methods
TWI533289B (en) * 2013-10-04 2016-05-11 晨星半導體股份有限公司 Electronic device and calibrating system for suppressing noise and method thereof
CN107086043B (en) * 2014-03-12 2020-09-08 华为技术有限公司 Method and apparatus for detecting audio signal
US11631421B2 (en) 2015-10-18 2023-04-18 Solos Technology Limited Apparatuses and methods for enhanced speech recognition in variable environments
US11290814B1 (en) * 2020-12-15 2022-03-29 Valeo North America, Inc. Method, apparatus, and computer-readable storage medium for modulating an audio output of a microphone array

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3648171A (en) * 1970-05-04 1972-03-07 Bell Telephone Labor Inc Adaptive equalizer for digital data systems
US4403298A (en) * 1981-06-15 1983-09-06 Bell Telephone Laboratories, Incorporated Adaptive techniques for automatic frequency determination and measurement
US4947362A (en) * 1988-04-29 1990-08-07 Harris Semiconductor Patents, Inc. Digital filter employing parallel processing
CA2036078C (en) * 1990-02-21 1994-07-26 Fumio Amano Sub-band acoustic echo canceller
WO1992020170A1 (en) * 1991-04-30 1992-11-12 Kabushiki Kaisha Toshiba Voice communication device provided with echo canceler
JP3306600B2 (en) * 1992-08-05 2002-07-24 三菱電機株式会社 Automatic volume control
US5416799A (en) * 1992-08-10 1995-05-16 Stanford Telecommunications, Inc. Dynamically adaptive equalizer system and method
JP2924496B2 (en) * 1992-09-30 1999-07-26 松下電器産業株式会社 Noise control device
GB9222103D0 (en) * 1992-10-21 1992-12-02 Lotus Car Adaptive control system
SE501248C2 (en) * 1993-05-14 1994-12-19 Ericsson Telefon Ab L M Method and echo extinguisher for echo extinguishing with a number of cascade-coupled adaptive filters
EP0681730A4 (en) * 1993-11-30 1997-12-17 At & T Corp Transmitted noise reduction in communications systems.
JPH0830278A (en) * 1994-07-14 1996-02-02 Honda Motor Co Ltd Active vibration control device
US5815496A (en) * 1995-09-29 1998-09-29 Lucent Technologies Inc. Cascade echo canceler arrangement
US5999567A (en) * 1996-10-31 1999-12-07 Motorola, Inc. Method for recovering a source signal from a composite signal and apparatus therefor
US6496581B1 (en) * 1997-09-11 2002-12-17 Digisonix, Inc. Coupled acoustic echo cancellation system
US6950036B2 (en) * 2001-09-20 2005-09-27 Honeywell International Inc. Station identification for a local area augmentation system on a visual display
US7099822B2 (en) * 2002-12-10 2006-08-29 Liberato Technologies, Inc. System and method for noise reduction having first and second adaptive filters responsive to a stored vector

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
ASANO F ET AL: "SPEECH ENHANCEMENT USING ARRAY SIGNAL PROCESSING BASED ON THE COHERENT-SUBSPACE METHOD" IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS, COMMUNICATIONS AND COMPUTER SCIENCES, INSTITUTE OF ELECTRONICS INFORMATION AND COMM. ENG. TOKYO, JP, vol. E80-A, no. 11, 1 November 1997 (1997-11-01), pages 2276-2285, XP000768547 ISSN: 0916-8508 *
BITZER J: "]bersicht und Analyse mehrkanaliger Geräuschreduktionsverfahren zur Sprachkommunikation" UNIVERSIT[T BREMEN, ARBEITSBEREICH NACHRICHTENTECHNIK, [Online] 11 November 1999 (1999-11-11), XP002278588 Retrieved from the Internet: URL:http://www.ant.uni-bremen.de/research/ speech/Web111199.pdf> [retrieved on 2004-04-28] *
DAHL M ET AL: "Simultaneous echo cancellation and car noise suppression employing a microphone array" ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 1997. ICASSP-97., 1997 IEEE INTERNATIONAL CONFERENCE ON MUNICH, GERMANY 21-24 APRIL 1997, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 21 April 1997 (1997-04-21), pages 239-242, XP010226179 ISBN: 0-8186-7919-0 *
FISCHER S ET AL: "Broadband beamforming with adaptive postfiltering for speech acquisition in noisy environments" ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 1997. ICASSP-97., 1997 IEEE INTERNATIONAL CONFERENCE ON MUNICH, GERMANY 21-24 APRIL 1997, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, US, 21 April 1997 (1997-04-21), pages 359-362, XP010226209 ISBN: 0-8186-7919-0 *
KELLERMANN W ED - INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS: "STRATEGIES FOR COMBINING ACOUSTIC ECHO CANCELLATION AND ADAPTIVE BEAMFORMING MICROPHONE ARRAYS" 1997 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PLENARY, EXPERT SUMMARIES, SPECIAL, AUDIO, UNDERWATER ACOUSTICS, VLSI.MUNICH, APR. 21 - 24, 1997, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSIN, vol. VOL. 1, 21 April 1997 (1997-04-21), pages 219-222, XP000789157 ISBN: 0-8186-7920-4 *
MARRO C ET AL: "ANALYSIS OF NOISE REDUCTION AND DEREVERBERATION TECHNIQUES BASED ON MICROPHONE ARRAYS WITH POSTFILTERING" IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, IEEE INC. NEW YORK, US, vol. 6, no. 3, 1 May 1998 (1998-05-01), pages 240-259, XP000785354 ISSN: 1063-6676 *

Also Published As

Publication number Publication date
WO2004053838A3 (en) 2004-08-05
US20040111258A1 (en) 2004-06-10
AU2003298914A1 (en) 2004-06-30
US7162420B2 (en) 2007-01-09
EP1576587A2 (en) 2005-09-21

Similar Documents

Publication Publication Date Title
US7162420B2 (en) System and method for noise reduction having first and second adaptive filters
US7099822B2 (en) System and method for noise reduction having first and second adaptive filters responsive to a stored vector
KR100316116B1 (en) Noise reduction systems and devices, mobile radio stations
US6717991B1 (en) System and method for dual microphone signal noise reduction using spectral subtraction
US6549586B2 (en) System and method for dual microphone signal noise reduction using spectral subtraction
KR100851716B1 (en) Noise suppression based on bark band weiner filtering and modified doblinger noise estimate
US8831936B2 (en) Systems, methods, apparatus, and computer program products for speech signal processing using spectral contrast enhancement
US7206418B2 (en) Noise suppression for a wireless communication device
EP2026597B1 (en) Noise reduction by combined beamforming and post-filtering
US8565446B1 (en) Estimating direction of arrival from plural microphones
US20090012786A1 (en) Adaptive Noise Cancellation
US20040264610A1 (en) Interference cancelling method and system for multisensor antenna
JP6545419B2 (en) Acoustic signal processing device, acoustic signal processing method, and hands-free communication device
US20080312916A1 (en) Receiver Intelligibility Enhancement System
JP2003500936A (en) Improving near-end audio signals in echo suppression systems
US6954530B2 (en) Echo cancellation filter
JP3787088B2 (en) Acoustic echo cancellation method, apparatus, and acoustic echo cancellation program
JP3403549B2 (en) Echo canceller
Ezzaidi et al. A new algorithm for double talk detection and separation in the context of digital mobile radio telephone
Chen et al. Filtering techniques for noise reduction and speech enhancement
Herbordt et al. Computationally efficient frequency-domain combination of acoustic echo cancellation and robust adaptive beamforming.
Faneuff Spatial, spectral, and perceptual nonlinear noise reduction for hands-free microphones in a car
Gustafsson et al. Dual-Microphone Spectral Subtraction
Freudenberger et al. Spectral combining for microphone diversity systems
Gustafsson Speech enhancement for mobile communications

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003796674

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003796674

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP

WWW Wipo information: withdrawn in national office

Ref document number: 2003796674

Country of ref document: EP