|Publication number||US3681756 A|
|Publication date||Aug 1, 1972|
|Filing date||Apr 23, 1970|
|Priority date||Apr 23, 1970|
|Publication number||US 3681756 A, US 3681756A, US-A-3681756, US3681756 A, US3681756A|
|Inventors||Mahlon D Burkhard, Richard W Peters|
|Original Assignee||Industrial Research Prod Inc|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (7), Non-Patent Citations (1), Referenced by (46), Classifications (6)|
|External Links: USPTO, USPTO Assignment, Espacenet|
United States Patent Burkhard et al.
1451 Aug. 1,1972
 SYSTEM FOR FREQUENCY 3,594,509 7/1971 Shimamura ..179/ 15 AV MODIFICATION OF SPEECH AND 3,555,522 1/1971 Martin ..340/ 172.5 X OTHER AUDIO SIGNALS OTHER PUBLICATIONS  Inventors: Mame" Burkhard Hinsdale; Unscrambler lmproves Communications in Helium- 'ir Pears Algonqum both Oxygen Atmosphere, Westinghouse Engineer, Jan.
1969, V01. 29/No. l.  Assignee: Industrial Research Products Inc.,
Elk Grove Village, 111. Primary Examiner-Paul .l. l-lenon Assistant Examiner-Jan E. Rhoads  1970 Attorney-Kinzer, Dorn and Zickert  Appl. No.: 31,159
 ABSTRACT 52 us. (:1 ..34o/172.s, 179/1 SA A system for iy y p t frequencies of a speech 511 1m. 01 ..G06f 3/16, G101 1/08, 11031: 13/22 signal, or other audio signal, y a given multiplication 581 Field of Search ..34o/172.s, 347 AD; fa mp is ng an a gig a r n e i l79/l5 Ac 1555 1 SA 179/15 Av 1 SA 1555 vetting an audio signal to a digital signal having a bit rate f1 and means for temporarily storing that digital signal. The system further comprises apparatus for  References Cited reading out the stored digital signal, in groups of n digits, at a bit rate f2, with means for synchronizing UNITED STATES PATENTS the readout apparatus to connect the groups of n digits in sequence. A digital-analog converter uses the 3394222 2 glanalgan et a] i digital readout to develop a speech signal modified in l ope I frequency in accordance with the rate f1/f2 but having 3,571,515 3/1971 Buron ..179/1 SA same time span as the original speech Signal 3,584,158 6/1971 Jefferies ..179/1 SA 3,500,441 3/1970 Brolin ..179/l5 AV 12 Claims, 3 Drawing Figures FILTER f o ANALOG- Caaaa SIGNAL SOURCE 16 1a 1 F u 21 ADJUSTABLE c1. oc 1 f CLOCKHI) GATEK T; SRTEACCBISSFER T E L 1 12 22 14 FREQUENCY FIXED SHIFT REGISTER DIGITAL CLOCKGZ) al 5i? n STAGES 'fl/gggg F 3 i 2 /2 n FILTER 24x TRANSDUCER SYSTEM FOR FREQUENCY MODIFICATION OF SPEECH AND OTHER AUDIO SIGNALS BACKGROUND OF THE INVENTION audio signals with either an effective increase or decrease in frequency. One example is in the presentation of recorded material to blind persons. It is recognized that a person can assimilate spoken material at rates considerably higher than normal speaking rates. Consequently, if a recorded passage can be reproduced at a higher speed than the original recording, but maintained within the familiar portion of the frequency spectrum instead of being raised in pitch because of the accelerated reproduction, the high speed audio presentation of information can be greatly facilitated.
The use of helium instead of nitrogen atmospheres in high pressure diving has created a special and critical audio communication difficulty. The substitution of helium for nitrogen changes the resonant frequencies of the throat, mouth, and nose cavities used for speech, due to the fact that the velocity of sound in helium is greater than in nitrogen. The result is a multiplication of speech frequencies by a factor that may be as great as 2.8, depending upon the atmospheric pressure and concentration of helium. As a consequence, in order to maintain intelligible communications with a diver working under high pressures in a helium atmosphere, an effective frequency modification system is needed for the divers speech.
Another application for frequency multiplication processing of speech signals or other audio signals entails an inverted time situation, in which the speed of presentation of the audio signal is reduced and naturalness is restored by raising the frequency range of the reproduced signal. Thus, on poorly recorded audio messages, a substantial slowdown in reproduction, while maintaining the reproduction within the normal audio frequency range, may contribute substantially to effective and accurate interpretation. A related learning situation, for certain types of handicapped persons, can benefit from the same technique, reducing the rate of presentation but maintaining the reproduced sound in the natural portion of the frequency spectrum.
Similar systems can be useful to some persons having hearing losses; a frequency reduction can materially increase intelligibility. In the compression of information for storage, as in a talking book program, storage space can be reduced substantially by recording at normal speeds in a frequency increase mode with playback at a reduced speed.
A number of different audio signal processing systems have been proposed, directed to the several applications set forth above. In many of the suggested systems, the processing consists essentially of playback of the original audio signal, from a recording, at a different rate from the original recording rate. One example is a tape deck having multiple heads for scanning a moving magnetic tape at a rate such that the heads move relative to the tape. An example of a system of this kind is Fairbanks et al, U.S. Pat. No. 2,886,650.
Another and more complex approach has been described in Flanagan U.S. Pat. No. 3,394,228, which is specifically directed to the conversion of helium-atmosphere speech to more intelligible form. In the Flanagan apparatus, there is a breakdown of the helium-distorted speech into a plurality of formant patterns, followed by non-linear modulations of the various formants in accordance with various functions representative of the characteristics of the environment in which the speech is produced.
In another approach, described in a report entitled The Development of a Digital Helium Speech Processor No. 4007-F-2, Office of Naval Research, May 1968, the correction of helium-distorted speech signals is accomplished by an apparatus that treats voiced sounds differently from unvoiced sounds. For sounds in which the system cannot detect pitch in the speech waveform, the system decides that the signal is unvoiced" and does not require temporal modification. When the system does detect pitch in the input signal, it treats the signal as encompassing a voiced sound. The voiced portion of the signal is converted to digital form and stored alternately in two storage registers. The digital voiced sound signals are read out altemately from these registers, at a lower rate than the recording rate, and are then re-converted to analog form and are recombined with the unmodified unvoiced sounds.
SUMMARY OF THE INVENTION It is a principal object of the present invention, therefore, to provide a new and improved system for frequency modification of a speech signal or other audio signal, while retaining the same time of presentation as the input signal, which does not require splitting the speech signal on the basis of the pitch, formants, or any other functional characteristic.
A further object of the invention is to provide a new and improved system for frequency modification of a speech signal or other audio signal that affords optimum intelligibility and quality in its output while treating all parts of the speech signal the same.
A specific object of the invention is to provide a new and improved digital processing system for frequency modification of a speech signal or other audio signal that is simple and compact and can be used virtually anywhere, being suitable for carrying by an individual under virtually any circumstances.
Another object of the invention is to provide a new and improved frequency multiplication system for audio signals that is readily and effectively applicable to the various fields referred to above, and others, such as correction of helium-distorted speech, aid to the deaf, audio bandwidth compression, and special entertainment efiects.
A particular object of the invention is to provide a new and improved frequency-multiplication system for audio signals that is entirely non-mechanical in nature and requires little or no continuing maintenance.
A processing system for frequency modification of a speech signal or other audio signal, constructed in accordance with the invention, comprises analog-digital converter means for converting a complete speech signal to a digital data signal. Two temporary serial storage means, which may be connected in parallel or in series, are provided for recording the digital data signal at a primary bit rate fl; readout means are provided for reading out the recorded digital data signal, in groups of digits, and at a secondary bit rate f2 substantially different from 11 to develop an output signal. The
system includes synchronizing means for actuating the readout means at time intervals recurring at a frequency f3 that is very much lower than both fl and f2 and is preferably a subharmonic of f2. Output means, comprising a digital-analog converter, are provided for utilizing the digital data to develop a processed speech signal with a frequency modification of f1/f2 but within the same time span as the original speech or other audio signal.
BRIEF DESCRIPTION OF THE DRAWINGS DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 illustrates a processing system 10, constructed in accordance with the invention, for frequency modification of a speech signal in which the output signal has the same time span as the original signal. System comprises a first temporary serial storage means 11 for storing a digital data signal. The storage means 1 1 has a total capacity of n digits, where n is a positive integer which is at least 32 as a practical lower limit. The temporary serial storage means 11 may be constructed as a shift register of n stages; it would constitute a delay line or other storage device having a total capacity of n digits when supplied with a digital input signal of an appropriate frequency. System 10 further includes a second shift register or other temporary serial storage means 12 that also has a capacity of n digits and that is preferably essentially identical in construction to the first storage means 11.
System 10 comprises a first clock signal source 13 and a second clock signal source 14. The first clock signal source 13 is preferably an adjustable-frequency multivibrator or other oscillator, and is utilized to develop a first clock signal having a primary frequency fl that may be adjusted to meet the frequency multiplication and division requirements imposed upon the system. The second clock signal source 14 may be a fixed-frequency oscillator or similar device and develops a second clock signal having a frequency f2. In those instances in which a frequency downshift of an initial speech or other audio signal is required, frequency 12 should be substantially lower than frequency fl. This would be the situation for the correction of helium-distorted speech. In those instances in which a frequency upshift is required, the fixed frequency f2 is substantially higher than the adjustable clock frequency fl.
The system 10 of FIG. 1 further comprises an analogto-digital converter circuit 15 having two inputs, one for an audio signal and the other for a synchronizing clock signal. The audio signal input of the analogdigital converter 15 is coupled to a speech or other audio signal source 16. The signal source 16 may be a reproducing device, if the signals to be processed have previously been recorded. On the other hand, the signal source may be a live source, such as the communication line, amplifiers, and microphone of a telephone link to a diver. In either event, it may be assumed that source 16 includes appropriate spectrum shaping circuits to accommodate and compensate for general spectrum deficiencies in the initial signal due to microphone characteristics, etc. A low-pass filter 17 is preferably interposed between source 16 and converter 15 to minimize high-frequency overload noise in operation of the converter. The clock input of converter 15 is connected to the output of adjustable clock source 13, so that the output signal from converter 15 is a digital data signal having a bit rate fl.
There are several different forms of analog-to-digital converter that can be used for converter 15 in signal processing system 10. However, a particularly effective and useful circuit for this purpose is the type known as a delta modulator. A delta modulator is a single digit feedback encoding device, operated at a rather high sampling frequency (preferably 20 Khz or more), based upon comparison of an integrated output signal with the input signal. A one shows an input amplitude greater than the integrated output, a zero reflects the opposite situation. Construction and operation of a delta modulator are more fully described hereinafter in conjunction with FIG. 2. The output of converter 15, the digital data signal referred to above, is supplied to the data inputs of the two temporary storage means 11 and 12.
The clock signals fl and f2 from sources 13 and 14 are also supplied to the two inputs of a clock gate 18. Functionally, clock gate 18 is the equivalent of a double-pole double-throw switch having its output terminals connected together in pairs. In one operating condition, clock gate 18 applies clock signal fl to shift register 11 and applies clock signal 12 to shift register 12. In its other operating condition, clock gate 18 supplies signal fl to shift register 12 and signal f2 to shift register 1 1. It is thus seen that, at any given time, data is being stored in, advance through and read out of one of the shift registers at the bit rate fl while the same operations go forward in the other shift register at the different bit rate f2.
To control the operation of clock gate 18, the signal processing system 10 includes a frequency divider 19 having a division ratio of l/2n. The input to frequency divider 19 is taken from the fixed clock source 14 and constitutes clock signal f2. Consequently, it is seen that the output of frequency divider 19 is an actuating signal having a frequency 13 such that f3 =f2/2n. This signal is supplied to clock gate 18 to change the operating condition of the clock gate each time n data bits have been read out of either of the two temporary storage devices 11 at rate f2.
An output gate 21 is included in signal processing system 10. Functionally, output gate 21 is equivalent to a single-pole double-throw switch. It has two data signal inputs, each connected to the output stage of one of the two temporary storage means 11 and 12. Actuation of gate 21 is effected at the cyclic rate f2/2n by means of an actuating signal supplied to the gate from frequency divider 19. The output of gate 21 is thus alternately connected to storage means 11 and 12 respectively when data is being advanced through and read out of each one at bit rate f2. By this means a stream of data at bit rate 12 is gated to a digital-toanalog converter 22 that re-generates an analog audio signal from the digital input signal. Basically, converter 22 may constitute an integrator, integrating the digital data signal over short time intervals. The output of converter 22 may be supplied, through an appropriate filter or spectrum shaping circuit 23, to a transducer 24 or other utilization circuit. For example, transducer 24 may be a speaker, where a telephone system is involved, as in the correction of helium-distorted speech. On the other hand, transducer 24 may be a recorder in systems in which the frequency modification of the original signal from the source 16 is being effected to achieve particular recording characteristics.
The capacity n for the two shift registers 11 and 12 is preferably selected as a number that is an exponential power of two. By way of example, for each of the registers, the total number of stages n may be 1024, the tenth power of two; for greater accuracy and fidelity, the eleventh power of two (2048) may be selected. This capacity selection simplifies the construction of frequency divider l9; division by a factor of two is simple and is easy to control accurately. The output signal of frequency divider 19, at frequency f3, must be maintained within a relatively restricted range. It should be less than one hundred hertz in order to prevent the switching operations which occur at frequency 13 from interfering with intelligibility in the reproduced speech. Thus, measurements have shown that interruptions of speech with a relatively low duty cycle, such as a duty cycle of 50 percent, have reasonably high intelligibility as long as the interruption rate is substantially less than one hundred hertz and is greater than ten hertz. Apparently, physiological or psychological persistence, and signal redundancy, bridge the gaps. At interruption rates lower than hz, substantial amounts of the audio signal are lost to the listener, and intelligibility I decreases rapidly. At interruption rates above 100 hz, side band frequencies are produced in the speech band, causing substantial deterioration in intelligibility.
Another factor to be considered in connection with the audio system is the overall length, on a time basis, of the signal that is stored at any given time in either of the temporary storage means 11 and 12. The ability of a human being to determine the frequency or pitch of an acoustic signal is essentially constant and is good for signal durations of fifteen milliseconds or longer when the frequency is 1,000 hz or greater. Below 1000 hz the ability to determine pitch requires a signal duration that is inversely proportional to the period of the basic frequency of the audio signal. By limiting the output sampling time of the system to about fifteen milliseconds, good discrimination of voice components in the high frequency range, as is necessary for good articulation, is obtained. The storage capacity n, and the sampling frequency f3, which is j2/2n, together determine the fixed clock frequency f2; in the typical system under consideration, 12 is about 67 Khz when n is 1024. When the processing system 10 first starts in operation, it may be assumed that both of the temporary storage means 11 and 12 are empty. Furthermore, it may be assumed that clock gate 18 is initially conditioned, by the actuating signal from frequency divider 19, to apply the adjustable clock signal fl from source 13 to shift register 11 and to apply the fixed clock signal f2 from source 14 to shift register 12. Ac-
interval, in which the first segment or sample of the digital data signal is stored in shift register 11, there is no effective output signal from gate 18 to converter 19,
because there has been no information previously stored in either of the temporary storage registers.
After a sampling time interval ofj3/2, in this instance about 15 milliseconds, one-half cycle of the output from frequency divider 19, clock gate 18 is actuated by the actuating signal from frequency divider l9. Gate 18 now changes the shift signal inputs to storage means 11 and 12, supplying clock signal f1 to shift register 12 and supplying clock signal 12 to register 11.
The actuating signal from frequency divider 19 also actuates output gate 21 to connect the output stage of the first shift register 11 to the digital-analog converter 22. Shift register 11 has been filled with information during the first sampling time interval. Consequently, during the next sample interval, the data previously stored in shift register 11 is read out at the rate f2, through gate 21, to converter 22. Converter 22, which may be a relatively simple integrator, regenerates the speech or other audio signal with .a frequency change ratio of fl/f2 but with the same time span as the original speech signal. During this same time interval, the original speech signal from source 16 continues to be stored, in digital form, at the rate fl in the second temporary storage means 12.
Operation proceeds for a second sampling time interval of approximately 15 milliseconds, at which point the actuating signal from frequency divider 19 again actuates both of the gates 18 and 21, reverting to the original operating conditions with clock signal fl supplied to shift register 11 and clock signal 12 supplied to shift register 12. Output gate 21 now connects the output stage of shift register 12 to converter 22. During the succeeding sampling time interval of 15 milliseconds, therefore, the incoming signal from source 16 is recorded, in digital form, at rate fl in shift register 11. The information previously recorded in shift register 12 is read out to converter 22, at rate 12, and it utilized to reproduce the desired frequency-shifted audio signal.
If the ratio of frequency fl to frequency f2 is of the order of 2:1, it can be seen that information is recorded in the temporary storage means 11 and 12 at twice the rate that is is read out of those same storage means. In essence, this means that one-half of the digital data signal from converter 15 never reaches the digitalanalog converter 22. Nevertheless, in the case of helium-distored speech, there is a marked improvement in intelligibility in the output signal as reproduced by transducer 24, compared with previously known systems. Speech signals are often generated under noisy conditions, and hence include noise that interferes with the detection of voiced and unvoiced sounds. Because system 10 does not separate the speech signal into voiced and unvoiced segments, it does not encounter the noise problem and other difficulties prevalent in systems that split and then recombine the speech signals. In particular, avoiding any necessity for detection of voiced and unvoiced sounds permits use of system 10 for a variety of different audio signals, including completely non-vocal signals such as music. The system is highly adaptable to integrated circuit construction and can be incorporated in a single handportable device for battery or AC. power.
Speech processing system 10 can be used for a frequency upshift as well as for a frequency downshift. To this end, the operating frequency of the adjustable clock 13 may be established at some value substantially less than the frequency f2 of the fixed clock 14. With this change in relationships, it will be apparent that information is read out of shift registers 11 and 12 at a greater rate than employed for storing data in the registers. A series of blanks are incorporated in the output signal as supplied to transducer 24.
FIG. 2 illustrates an analog-digital converter circuit 15A that is a delta modulator and that constitutes the preferred form of circuit for use as the converter 15 in system 10. Converter 15A comprises a comparator amplifier 31 having an inverting input 32, a non-inverting input 33, and an output 34. The inverting input 32 is connected to a signal source (e.g., source 16 in FIG. 1) by a series resistor 35. The amplifier output 34 is connected to the D input of a type D sampling flip-flop circuit 36. The clock input C of flip-flop 36 is connected to the clock source 13 (FIG. 1).
Flip-flop circuit 3 6 has a main output Q and a complementary output Q. The output Q is the output terminal for converter 15A, and is connected to shift registers 11 and 12. Terminal Q is also connected to a dual integrator circuit comprising a series resistor 37, a shunt capacitor 38, a second series resistor 39, and a second shunt capacitor 41, a resistor 42 being connected in series with capacitor 41. The common terminal of resistor 39 and capacitor 41, in the second integrator stage, is connected back to the inverting input 32 of comparator amplifier 31 through a feedback resistor 43.
Converter 15A (FIG. 2) includes a second feedback loop for comparison amplifier 31. This secondary loop originates at the 6 output of flip-flop 36 and includes an integrator or low-pass filter comprising a series resistor 45 and a shunt capacitor 46. The loop is complete by a resistor 47 that connects the common terminal of resistor 45 and capacitor 46 back to the non-inverting input 33 of amplifier 31.
In operation, a positive-going signal supplied from source 16 to input 32 of amplifier and, in coincidence with a pulse of the f1 clock signal, produces a negativegoing pulse at the Q output of flip-flop 13. The pulse signal from terminal Q is averaged in the integrating circuit 40 and applied to terminal 32 as a negative feedback. If the positive-going input from source 16 exceeds the negative-going feedback at the time of the next fl pulse, another negative-going pulse is produced at the circuit output, and the integrated negative feedback signal increases in amplitude. When the negative feedback signal exceeds the input signal in amplitude, no additional pulses are developed at the Q output of flip-flop 36. Thus, whenever the input signal amplitude exceeds signal amplitude in negative feedback circuit 40, a series of pulses representative of one binary value are produced at terminal Q; when the reverse amplitude relation obtains, blank spaces representative of the other binary value occur in the Q terminal output.
The second feedback loop 50, connected from the 6 output of flip-flop 36 back to the non-inverting input 33 of comparator amplifier 31, provides a self-bias or self-generated reference for the comparator. This preferred circuit, in effect, gives a self-compensating threshold and more uniform white noise characteristic for delta modulator 15A, when idling, then in a conventional circuit using a fixed reference. In loop 50, the low-pass filter formed by resistor 45 and capacitor 46 maintains a DC. voltage on amplifier input 33 that bucks the DC. voltage of loop 40 as applied to input 32. Any D.C. component of the signal from source 16 or DC. offsets within amplifier 31 are effectively eliminated, avoiding the single-frequency warbling" that may be produced by a fixed-level delta modulator signal when re-converted to analog form. Moreover, the effect of low-level signals, just breaking the threshold of the modulator idling pattern, is more gradual and subjectively more tolerable.
FIG. 3 illustrates a processing system 60 for frequency modification of a speech signal that constitutes another embodiment of the present invention. In system 60, a signal source 61 is connected through an appropriate filter 70 to an analog-digital converter 62 which may constitute a delta modulator. The timing input to converter 62 comprises a clock signal at frequency fl derived from a first clock signal source 63. The output of converter 62 is supplied to the input stage of a shift register or other temporary serial storage means 64. Shift register 64 has a second or timing input taken from a clock gate 65. Clock gate 65 has two inputs; one is taken from clock source 63 and constitutes the recording clock signal fl. The other input to clock gate 65 is taken from a transfer clock signal source 66 and constitutes a transfer clock signal of frequency f4. The transfer clock frequency f4 is very much higher than the recording clock frequency fl and, in fact, should be more than 10 times fl.
The output of the temporary storage register 64 is connected to the input of a second essentially similar temporary storage means 67. The shift or other control circuits for the temporary storage means 67 are actuated by input signals from a second clock gate 68.
Clock gate 68 has two inputs; one is connected to the output of a readout clock source 69 that develops a readout clock signal of frequency f2 which is substantially different from frequency fl but is of the same order of magnitude. The other input to the clock gate 68 is taken from the transfer clock source 66 and constitutes the transfer clock signal f4 which is at least an order of magnitude higher in frequency than the readout clock signal 12.
The two clock gates and 68 are a part of a clock input gate means. The actuation means for the two clock gates comprises a gate actuation clock 71 that develops a gate actuation signal 76 of a quite low frequency f3 that also has a very low duty cycle. The output of the gate actuation clock 71 is supplied to both of the clock gates 65 and 68. The gate actuation signal 76 is also applied to an output gate 72 that couples the output stage of the second temporary storage means 67 to an analog-digital converter 73. The output of converter 73 is connected to a transducer 74 by a suitable output filter 75.
In considering the operation of signal processing system 60, FIG. 3, it may first be assumed that clock gate 65 is conditioned to supply the recording clock signal fl from clock source 63 to the first temporary storage means 64. This is the normal operating condition for system 60 for most of the time, and corresponds to the condition occurring during the long intervals 77 in the gate actuation signal 76. Under these conditions, a speech signal or other audio signal from source 61 is converted to digital form in converter 62 and is stored in the temporary storage means 64 at frequency fl.
The foregoing operational conditions are maintained for a time interval sufficient to fill, or nearly fill, the shift register 64. This time interval corresponds to the time 77 between pulses in the gate actuation signal 76. When one of the short pulses 78 occurs in the gate actuation signal, clock gate 65 is actuated to its alternate operating condition and supplies the high frequency transfer clock signal f4 to the temporary storage means 64 and 67. For a brief period of time, therefore, the previously recorded data is advanced at a very high speed through shift register 64 and is transferred to the second temporary storage register 67. At the end of each short pulse 78, the clock gate 65 reverts to its original operating condition and again supplies a recording clock signal fl to temporary storage means 64 to control the recording of further information in the storage means 64.
During the long time intervals 77 in the gate actuation control signal 76, clock gate 68 is conditioned to supply the readout clock signal f2 from source 69 to temporary storage means 67. As a consequence, any information that has been transferred from shift register 64 to register 67 is read out of register 67, at rate f2. When one of the short pulses 78 occurs in the gate actuation clock signal 76, however, gate 68 is actuated to its alternate condition and supplies the high frequency clock signal f4 to shift register 67 This enables the shift register 67 to receive data from shift register 64 in a rapid transfer operation and to clear previously recorded data when this is necessary. The gate actuation signal from clock 71 is also supplied to output gate 72 and closes the output gate during each of the brief transfer pulses 78. This is done to prevent highfrequency signals from being forwarded from shift register 67 to converter 73 during those time intervals in which data is being transferred from shift register 64 to shift register 67. In some instances the output gate 72 can be omitted.
The illustrated wave form for the gate actuation signal 76 is not essential; the same effect can be realized using signals of other wave forms and different duty cycles. However, the duty cycle for the gate means in system 60 must be quite high, in terms of time for record-readout operations compared to time for transfer operations.
For efiective operation, the ratio between frequencies fl and f2 should be kept within reasonable limits. For downshift operation, fl/f2 should be greater than one but preferably not greater than three. For an upshift in frequency, the ratio j2/fl should be at least unity and preferably smaller than three. The frequency f3 is preferably in the range of 10-100 hz as described above for the interruption of sampling frequency for the embodiment of FIG. 1. The transfer clock f4 should operate at an extremely high frequency in comparison to the other operating frequencies in the system. For example, in a frequency downshift operation with a desired ratio of two to one, the recording clock frequency fl may be established at khz with the readout clock frequency f2 being 50 khz. Under these circumstances, the operating frequency for the transfer clock f3, should be of the order of l to 10 megahertz or even higher.
The series construction for the shift registers that is used in system 60 entails a slight signal interruption compared to the parallel arrangement of system 10, but the overall effect on performance is not appreciable. As before, f3 may be made a subharmonic of f2, with the gate actuation clock 71 controlled by a frequency divider driven by signal 12.
1. A processing system for frequency modification of a speech or other original audio signal, which retains the time span of the original signal, comprising:
analog-digital converter means for converting an original audio signal to a digital data signal; two temporary serial storage means, each having a capacity of n digits, where n is a positive integer greater than or equal to 32; recording means for alternately recording said digital data signal in said two storage means at a primary bit rate f1;
readout means for reading out said digital data signal from said storage means, in groups of digits taken alternately from said two storage means, at a secondary bit rate f2 substantially different from fl to develop an output signal;
synchronizing means for actuating said recording means and said readout means at time intervals recurring at a frequency f3, where 13 is approxi mately equal toj2/2n in the range of 10 to 100 hz;
and output means, comprising a digital-analog converter,
for utilizing said output signal to develop a processed audio signal with a frequency modification of fl/j2 but having the same time span as the original audio signal. 2. A processing system for frequency modification of a speech or other original audio signal which retains the time span of the original signal, comprising:
first temporary serial storage means, having a capacity of n digits, where n is a positive integer greater than or equal to 32;
second temporary serial storage means also having a capacity of n digits;
a first clock signal source for developing a first clock signal of frequency 11;
a second clock signal source for developing a second clock signal of frequency f2, f2 being substantially different from frequency fl an analog-digital converter;
means for applying an original audio signal to said converter to develop a digital data signal;
means for supplying the digital data signal to the inputs of both of said temporary storage means;
clock gate means for applying said first and second clock signals to said temporary storage means, in alternation, to store said digital data signal therein at rate fl and to read out said digital data signal therefrom at rate f2;
output gate means for alternately coupling the outputs of said temporary stores to a single output circuit;
gate actuation means, comprising a frequency divider with a division ratio of approximately l/2n, having an input coupled to said second clock signal source and having an output coupled to both said gate means, for developing and supplying to both said gate means an actuating having a frequency f3, where 13 is approximately equal to j2/2n, so that said output circuit always receives said digital data read out at rate f2;
and a digital-analog converter, connected to the output gate means, for developing a regenerated speech signal with a frequency change ratio of fl/f2 but within the same time span as the original audio signal.
3. An audio signal processing system according to claim 2 in which said actuating signal frequency f3 is in the range of 10 to 100 hz.
4. An audio signal processing system according to claim 2 in which said a actuating signal frequency f3 is approximately 33 hz.
5. An audio signal processing system according to claim 4 in which the value of n is greater than 500.
6. An audio signal processing system according to claim 4 in which the value of n is a power of two.
7. An audio signal processing system according to claim 4 in which the value of n is a power of two exceeding 2 8. An audio signal processing system according to claim 2 in which said analog-digital converter is a delta modulator driven by the first clock signal fl.
9. A processing system for frequency modification of an audio-frequency analog signal which retains the same time span as the original signal, comprising:
a first temporary serial storage means, having a capacity of n digits, where n is a positive integer greater than or equal to 32;
a second temporary serial storage means, also having a capacity of n digits and having its input stage connected to the output stage of said first temporary storage means;
recording clock signal source for developing a recording clock signal of frequency fl; v
a readout clock signal source for developing a readout clock signal of frequency f2, 12 being substantially different from frequency f1;
transfer clock signal source for developing a transfer clock signal of frequency f4 such that f4 is very much greater than fl and f4 is very much greater than 12;
an analog to digital converter;
means for applying an original audio-frequency analog signal to said converter to develop a digital data signal;
means for supplying the digital data signal to the input of said first temporary storage means;
clock input gate means for alternately applying said 12 recordin and transfer clocl t gign ls to sai first tempor storage means, an o ternative y applying said readout and transfer clock signals to said second temporary storage means;
a digital-analog converter;
output gate means for coupling the output of said second temporary storage means to said digital analog converter; and
gate actuation means for developing a gate actuation signal of a frequency f3, where 13 is approximately equal to j2/2n and is lower than fl, and for applying said gate actuation signal to actuate both said gate means, applying said transfer clock signal to both said storage means and cutting off the input to said digital-analog converter periodically at frequency 13 to enable said digital-analog converter to develop a regenerated speech signal with a frequency change ratio of fl/f2 but within the same time span as the original audio signal.
10. A processing system for frequency modification of an audio signal, according to Claim 9, in which the time during which said transfer clock signal is applied to said storage means, in each cycle of said gate actuation signal, is much smaller than the time during which said recording and readout clock signals are supplied thereto.
1 l. A processing system system for frequency modification of an audio signal, according to Claim 9, in which f3 is in the range of 10-100 hz.
12. A processing system for frequency modification of a speech or other original audio signal, which retains the time span of the original signal, comprising:
analog-digital converter means for converting an original audio signal to a digital data signal; first temporary serial storage means, having a capacity of n digits, where n is a positive integer greater than or equal to 32;
recording means for recording said digital data signal in said first temporary serial storage means at a primary bit rate fl second temporary serial storage means also having a capacity of n digits, and, having an input connected to the output of said first temporary serial storage means;
transfer means for transferring said digital data signal from said first storage means to said second storage means, at a transfer rate f4 very much higher than rate fl readout means for reading out said digital data signal from said second storage means at a secondary bit rate 12 substantially different from fl and very much lower than f4, to develop an output signal;
synchronizing means for actuating said transfer means and for interrupting said recording means and said readout means, at time intervals recurring at a frequency f3, where f3 is approximately equal to f2/2n in the range of 10 to hz, said time intervals being very much smaller than H13; and
output means, comprising a digital-analog converter, for utilizing said output signal to develop a processed audio signal with a frequency modification of fl/j2 but having the same time span as the original audio signal.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3394228 *||Jun 3, 1965||Jul 23, 1968||Bell Telephone Labor Inc||Apparatus for spectral scaling of speech|
|US3431356 *||Jun 4, 1965||Mar 4, 1969||Integrated Electronic Corp||Apparatus and method for reconstructing speech|
|US3500441 *||Oct 12, 1967||Mar 10, 1970||Bell Telephone Labor Inc||Delta modulation with discrete companding|
|US3555522 *||Jan 3, 1968||Jan 12, 1971||Ametek Inc||Loading logic circuitry for deltic memory|
|US3571515 *||Jun 12, 1968||Mar 16, 1971||Ibm||Voice analysis and recovery system|
|US3584158 *||Dec 10, 1968||Jun 8, 1971||Westinghouse Electric Corp||Helium speech unscrambler|
|US3594509 *||Aug 5, 1969||Jul 20, 1971||Nippon Electric Co||Delta modulator apparatus|
|1||*||Unscrambler Improves Communications in Helium Oxygen Atmosphere, Westinghouse Engineer, Jan. 1969, Vol. 29/No. 1.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US3815100 *||Nov 7, 1972||Jun 4, 1974||Searle Medidata Inc||Self-clocking system utilizing guaranteed bit transition|
|US3838218 *||Mar 7, 1972||Sep 24, 1974||Cambridge Res & Dev Group||Bifrequency controlled analog shift register speech processor|
|US3846762 *||Aug 10, 1973||Nov 5, 1974||Westinghouse Electric Corp||Apparatus for optimal data storage|
|US3846827 *||Feb 12, 1973||Nov 5, 1974||Cambridge Res & Dev Group||Speech compressor-expander with signal sample zero reset|
|US3855424 *||Jan 30, 1973||Dec 17, 1974||Philips Corp||Information processor for changing tempo of playback from the recorded tempo|
|US3873778 *||Jun 6, 1973||Mar 25, 1975||Sony Corp||Signal processing system|
|US3883850 *||Jun 19, 1972||May 13, 1975||Threshold Tech||Programmable word recognition apparatus|
|US3936610 *||May 28, 1974||Feb 3, 1976||Cambridge Research And Development Group||Dual delay line storage sound signal processor|
|US3936805 *||Dec 26, 1973||Feb 3, 1976||International Business Machines Corporation||Dictation system for storing and retrieving audio information|
|US3950617 *||Sep 9, 1974||Apr 13, 1976||The United States Of America As Represented By The Secretary Of The Navy||Helium speech unscrambler with pitch synchronization|
|US4016540 *||Jan 22, 1973||Apr 5, 1977||Gilbert Peter Hyatt||Apparatus and method for providing interactive audio communication|
|US4051331 *||Mar 29, 1976||Sep 27, 1977||Brigham Young University||Speech coding hearing aid system utilizing formant frequency transformation|
|US4060848 *||Jan 22, 1973||Nov 29, 1977||Gilbert Peter Hyatt||Electronic calculator system having audio messages for operator interaction|
|US4123711 *||Jan 24, 1977||Oct 31, 1978||Canadian Patents And Development Limited||Synchronized compressor and expander voice processing system for radio telephone|
|US4177707 *||May 2, 1977||Dec 11, 1979||Boucher Gary R||Electronic music synthesizer|
|US4464784 *||Apr 30, 1981||Aug 7, 1984||Eventide Clockworks, Inc.||Pitch changer with glitch minimizer|
|US4811019 *||May 30, 1986||Mar 7, 1989||Shure Brothers Incorporated, Inc.||Delta modulation encoding/decoding circuitry|
|US4823380 *||Mar 27, 1987||Apr 18, 1989||Chaim Kohen||Voice changer|
|US4825364 *||Oct 1, 1973||Apr 25, 1989||Hyatt Gilbert P||Monolithic data processor with memory refresh|
|US4890326 *||Mar 3, 1988||Dec 26, 1989||Rubiyat Software, Inc.||Method for compressing data|
|US4896260 *||Apr 24, 1989||Jan 23, 1990||Hyatt Gilbert P||Data processor having integrated circuit memory refresh|
|US5594908 *||Jan 22, 1990||Jan 14, 1997||Hyatt; Gilbert P.||Computer system having a serial keyboard, a serial display, and a dynamic memory with memory refresh|
|US5615380 *||Apr 9, 1991||Mar 25, 1997||Hyatt; Gilbert P.||Integrated circuit computer system having a keyboard input and a sound output|
|US5717818 *||Sep 9, 1994||Feb 10, 1998||Hitachi, Ltd.||Audio signal storing apparatus having a function for converting speech speed|
|US5794201 *||Jun 5, 1995||Aug 11, 1998||Hitachi, Ltd.||Digital acoustic signal processing apparatus|
|US5940798 *||Feb 5, 1998||Aug 17, 1999||Scientific Learning Corporation||Feedback modification for reducing stuttering|
|US6098046 *||Jun 29, 1998||Aug 1, 2000||Pixel Instruments||Frequency converter system|
|US6226605||Aug 11, 1998||May 1, 2001||Hitachi, Ltd.||Digital voice processing apparatus providing frequency characteristic processing and/or time scale expansion|
|US6421636 *||May 30, 2000||Jul 16, 2002||Pixel Instruments||Frequency converter system|
|US6577739||Sep 16, 1998||Jun 10, 2003||University Of Iowa Research Foundation||Apparatus and methods for proportional audio compression and frequency shifting|
|US7072482||Sep 6, 2002||Jul 4, 2006||Sonion Nederland B.V.||Microphone with improved sound inlet port|
|US7764758 *||Jan 30, 2003||Jul 27, 2010||Lsi Corporation||Apparatus and/or method for variable data rate conversion|
|US8060361 *||Oct 30, 2007||Nov 15, 2011||Hon Hai Precision Industry Co., Ltd.||Communication device with a function of audio modulation and method for audio modulation|
|US8185929||May 27, 2005||May 22, 2012||Cooper J Carl||Program viewing apparatus and method|
|US8428427||Sep 14, 2005||Apr 23, 2013||J. Carl Cooper||Television program transmission, storage and recovery with audio and video synchronization|
|US8769601||Mar 5, 2010||Jul 1, 2014||J. Carl Cooper||Program viewing apparatus and method|
|US9286317 *||Dec 19, 2012||Mar 15, 2016||Panasonic Intellectual Property Management Co., Ltd.||Information processing equipment|
|US20040151267 *||Jan 30, 2003||Aug 5, 2004||Lsi Logic Corporation||Apparatus and/or method for variable data rate conversion|
|US20050039219 *||Oct 25, 2004||Feb 17, 2005||Pixel Instruments||Program viewing apparatus and method|
|US20050240962 *||May 27, 2005||Oct 27, 2005||Pixel Instruments Corp.||Program viewing apparatus and method|
|US20060015348 *||Sep 14, 2005||Jan 19, 2006||Pixel Instruments Corp.||Television program transmission, storage and recovery with audio and video synchronization|
|US20080103782 *||Oct 30, 2007||May 1, 2008||Hon Hai Precision Industry Co., Ltd.||Communication device with a function of audio modulation and method for audio modulation|
|US20100247065 *||Mar 5, 2010||Sep 30, 2010||Pixel Instruments Corporation||Program viewing apparatus and method|
|US20130166613 *||Dec 19, 2012||Jun 27, 2013||Panasonic Corporation||Information processing equipment|
|WO1996012270A1 *||Oct 12, 1995||Apr 25, 1996||Pixel Instruments||Time compression/expansion without pitch change|
|WO1999040572A1 *||Feb 4, 1999||Aug 12, 1999||Scientific Learning Corporation||Feedback modification for reducing stuttering|
|U.S. Classification||704/205, 704/211|
|Cooperative Classification||H05K999/99, G10L21/00|