CA2258908C - Speech rate conversion without extension of input data duration, using speech interval detection - Google Patents
Speech rate conversion without extension of input data duration, using speech interval detection Download PDFInfo
- Publication number
- CA2258908C CA2258908C CA002258908A CA2258908A CA2258908C CA 2258908 C CA2258908 C CA 2258908C CA 002258908 A CA002258908 A CA 002258908A CA 2258908 A CA2258908 A CA 2258908A CA 2258908 C CA2258908 C CA 2258908C
- Authority
- CA
- Canada
- Prior art keywords
- speech
- length
- data
- output data
- input data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/78—Detection of presence or absence of voice signals
- G10L2025/783—Detection of presence or absence of voice signals based on threshold decision
- G10L2025/786—Adaptive threshold
Abstract
When a delivered speed of a listening speech (speech speedy is slowed down, a connection order generator (8) always monitors a data length of input speech, an output data length calculated previously by a conversion function concerning a preset scaling factor, and a data length of actual output speech in predetermined processing unit, then decides connection order so as not to cause inconsistency among them. The speech data and the connection data are connected without omission of speech information by controlling a speech data connector (9). When power of an input signal data is calculated to discriminate a speech interval and a non-speech interval, a threshold value for power is decided according to a maximum value of the power and the difference between the maximum value and a minimum value.
Description
DESCRIPTION
SPEECH RATE CONVERSION WITHOUT EXTENSION OF
INPUT DATA DURATION, USING SPEECH INTERVAL DETECTION
Technical Field The present invention relates to a speech speed converting method and a device for embodying the same 1o which are able to achieve easiness of hearing expected in speech speed conversion without extension of playback time in various video devices, audio devices, medical devices, etc. such as a television set, a radio, a tape recorder, a video tape recorder, a video disk player, a hearing aid, etc.
The present invention also relates to a speech interval detecting method and a device for embodying the same which are able to discriminate between speech intervals and non-speech intervals of an input signal 2o in the event that the speech which is delivered together with noises or background sounds in a broadcast program, a recording tape, or a daily life is processed to change height of the voice or speech speed, the meaning of the speech is mechanically recognized, the speech is coded to transfer or record, or the like.
[Outline of the Invention]
The present invention relates to a speech speed converting method and a device for embodying the same which converts a speech speed in real time by processing 3o the speech made by the human being, and carries out a
SPEECH RATE CONVERSION WITHOUT EXTENSION OF
INPUT DATA DURATION, USING SPEECH INTERVAL DETECTION
Technical Field The present invention relates to a speech speed converting method and a device for embodying the same 1o which are able to achieve easiness of hearing expected in speech speed conversion without extension of playback time in various video devices, audio devices, medical devices, etc. such as a television set, a radio, a tape recorder, a video tape recorder, a video disk player, a hearing aid, etc.
The present invention also relates to a speech interval detecting method and a device for embodying the same which are able to discriminate between speech intervals and non-speech intervals of an input signal 2o in the event that the speech which is delivered together with noises or background sounds in a broadcast program, a recording tape, or a daily life is processed to change height of the voice or speech speed, the meaning of the speech is mechanically recognized, the speech is coded to transfer or record, or the like.
[Outline of the Invention]
The present invention relates to a speech speed converting method and a device for embodying the same which converts a speech speed in real time by processing 3o the speech made by the human being, and carries out a
-2-series of processes without omission of information, while monitoring always a data length of the input speech, an output data length calculated previously according to a conversion function, which is concerned with a previously given scaling factor, and a data length of the speech being output actually in constant process unit when a delivered speed (speech speed) of listening speech is made slow.
Furthermore,in thespeechspeed converting method to and the device for embodying the same, for example, the non-speech interval which has a length in excess of a variable threshold value being set according to a delay degree (conversion factor) expected in speech speed conversion can be reduced appropriately while aiming at minimizing the time difference between the image and the speech caused by extension of the speech in watching the television receiver, and maximum slowness impression which can be accomplished within a decided time range can be created automatically by changing adaptively a 2o conversion factor according to a degree of time difference between the input data length and the output data length, while keeping substantially a speaking time of the converted speech within a speaking time of an original speech.
Moreover, the present invention calculates the power of input signal data at a predetermined time interval in frame unit having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the 3o threshold value for the power which is changed according
Furthermore,in thespeechspeed converting method to and the device for embodying the same, for example, the non-speech interval which has a length in excess of a variable threshold value being set according to a delay degree (conversion factor) expected in speech speed conversion can be reduced appropriately while aiming at minimizing the time difference between the image and the speech caused by extension of the speech in watching the television receiver, and maximum slowness impression which can be accomplished within a decided time range can be created automatically by changing adaptively a 2o conversion factor according to a degree of time difference between the input data length and the output data length, while keeping substantially a speaking time of the converted speech within a speaking time of an original speech.
Moreover, the present invention calculates the power of input signal data at a predetermined time interval in frame unit having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the 3o threshold value for the power which is changed according
-3-to the maximum value and the difference between the maximum value and the minimum value , while holding the maximum value and the minimum value of the power within the past predetermined time period, so as to respond sequentially to change in respective powers of the input speech and the background sound. As a result, improvement in quality of processed sound, improvement in the speech recognition rate, increase in the coding efficiency, and improvement in quality of the decoded to speech can be achieved by detecting precisely the speech interval of the input signal in the case that changed in height of the voice or speech s;p2ed, mechanical recognition of the meaning of the speech, and coding of the speech to transfer or record, and the like are effected by processing the speech which is delivered together with noises or background sounds in a broadcast program, a recording tape, or a daily life.
In addition, the speech processing can be executed in real time while shortening a calculation time and 2o also reducing a cost , by employing only the power which can be derived relatively simply as a feature parameter.
Background Art In case the speech speed converting method is applied to the actual broadcast, there are some cases where delay from the original speech such as emergency news becomes an issue. Particularly, it is possible that this delay has a bad effect on the visual media in contrast with the effect expected in the speech speed 3o conversion.
a -4-Therefore, as approaches for achieving the speech speed converting effect (slowness impression) without delay from the original speech, there have been reported the method of suppressing extension i.n time by changing the speech speed from slowly to quickly as a function of a lapse time from a start point of one breath speech to an end point instead of uniformly slow conversion, and then reducing appropriately the non-speech interval between sentences (R. Ikezawa et al., "An Approach for to Absorbing Extension in Time Caused in Speech Speed Conversion", Spring Conference, Japanese Acoustic Society, 2-6-2, pp.331-332, 1992), the method of achieving this approach in real time (A. Imai et al., "Real Time Absorption Method for Extension in Time 15 Caused in Speech Speed Conversion", in International Conference, IEICE, D-694, pp 300, 1995), etc.
The former sets an appropriate function manually under that assumption that all speech styles have been known. The latter also sets a function defining a 2o factor manually, and fixes this function after the function has been set once.
In addition, only the constant .remaining time is set manually to reduce the non-speech interval. If a deal of "inconsistency" is integrated, the extended 25 speech being accumulated in a buffer is cleared manually.
Therefore, in the speech speed converting device in the prior art , there has been such a problem that , since various speaking styles (speech speed, "timing"
so in speech, etc.) are present in the broadcast speech _5~
according to the speaker and also appropriate parameters must be set manually respectively, the device has many operation point s, setting per se is difficult, and it is difficult for the common user to handle the device.
Besides, in the above speech speed converting device, the speech interval and the non-speech interval must be recognized separately. There are various systems as the speech interval detecting system in the 1o prior art.
As one of the speech interval detecting system in the prior art , such a system has been known that a noise level and a speech level are calculated based on the power of the speech signal , etc . , then a level threshold value is set based on the calculation result , then this level threshold value and the input signal are compared with each other, then the interval is decided as the speech interval if the level of the; input signal is higher than the level threshold valuE: and the interval 2o is decided as the non-speech interval if the level of the input signal is lower than the level threshold value.
As methods of setting the level threshold value employed in this system, there are first to third representative systems. Accordingtothe first system, a value which is obtained by adding a preselected constant to a noise level value of the input speech is employed as the level threshold valise. According to the second system which is an improved first system, 3o the level threshold value is set to a relatively large -6_ value when a value obtained by subtracting the noise level value from a maximum level value of the input speech signal is large, whereas the level threshold value is set to a relatively small value when the value obtained by subtracting the noise level value from a maximum level value of the input speech signal is small (for example, Patent Application Publication (KOKAI) Sho 58-130395, Patent Application Publication (KOKAI) Sho 61-272796, etc.).
1o According to the third system, in addition to these level threshold value setting methods., the input signal is monitored continuously, then the input signal is regarded as the noise level when the level of the input signal is steady over a constant timE: period, and then 15 a threshold value employed for the speech interval detection is set while updating the noise level sequentially (Proceeding in International Conference, IEICE, D-695, pp 301, 1995).
However, in the above speech interval detecting 2o system in the prior art, there have been problems described in the following.
To begin with, the first system has an advantage that it is simple, and can operate well when the average level of the speech is a middle level. However, the 25 first system is easy to detect the noise, etc. errously as speech when the average level of the speech is too large, and it is easy to detect the speech with omission of a part of the speech when the average level of the speech is too small.
_ -Then, the second system can overcome the problem arisen in the first system. However, there has been such a problem that o since the event that levels of the noises and the background sounds in the input signal are kept substantially constant is employed as a premise, the second system can follow the variation in level of the speech, but the precise speech interval detection cannot be assured when levels of the noises and the background sounds are changed at every moment.
to Then, since the variation in such noise level is considered into the third system, erroneous detection is not caused even when the noise level is changed sequentially.
However, not only the noise but also the background 15 sound such as music, imitation sound, etc. as sound effects are included in the broadcast program, etc., and commonly these levels are changed at every moment and at the same time the speech is always continued to deliver, so that the input signal level seldom becomes 2o steady over a gredetermined time period. In such case, there has been such a problem that , since the noise level cannot be set correctly even by the third system, it is difficult to detect precisely the speech interval.
The present invention has been made in view of the 25 above circumstances, and it is an object of the present invention to provide a speech speed converting method and a device for embodying the same which is capable of controlling adaptively the speech speed conversion factor and the non-speech interval according to set 3o conditions only by setting the conversion factor employed as the several-stage aims once by the user, and also achieving the expected effect for the speech speed conversion stably within the time range which is delivered actually.
In order to achieve the above object, there is provided a speech speed converting method comprising the steps of determining and sett~_ng in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data; applying the time lag at every moment to the function to determine the conversion factor at every moment; calculating a target length of the output data at every moment based on the determined conversion factor; modifying the calculated target length of the output data according to a length of actual output data; extending the input data according to the modified target length of the output data; deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold 2o value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
In the speech speed converting method set forth in the preceding paragraph, the function is such that the conversion factor decreases as the time lag increases.
Further, the calculated target length of the output data is modified according to a length of actual output data in such a manner that the calculated target length 3o is made equal to the length of the actual output data when the calculated target length is less than the Length of the actual output data, and otherwise the _9_ calculated target length is turned over as it is without being modified to the next step.
In another aspect of the speech speed converting method, after the step of calculating the target length of the output data, further comprising the step of making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is 1o without being modified to the next step.
In another aspect of the present invention, there is provided a speech speed converting device comprising: means for determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data; means for applying the time lag at every moment. to the function to determine the conversion factor at every moment;
means for calculating a target length of the output 2o data at every moment based on the determined conversion factor; means for modifying the calculated target length of the output data according to a length of actual output data; means for extending the input data according to the modified target length of the output data; means for deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted 3o input data as the output data. The function is such that the conversion factor decreases as the time lag increases.
- In the speech speed converting device described in the preceding paragraph, the modifying means modifies the calculated target length of the output data according to a length of actual output data in such a manner that the calculated target length is made equal to the length of the actual output data when the calculated target length is less than. the length of the actual output data, and otherwise the calculated target length is turned over as it is without being modified 1o to the next step.
The speech speed converting device further comprises means for making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is without being modified to the next step.
Brief Description of the Drawings FIG.1 is a block diagram showing a speech speed converting device according to an embodiment of the present invention;
FIG.2 is a block diagram showing a speech interval detecting device according to an embodiment of the present invention;
1o FIG.3 is a schematic view showing an example of an operation of the speech interval detecting device shown in FIG.2;
FIG.4 is a schematic view showing a method of generating connection data, which is employed to connect the same block repeatedly in a connection data generator shown in FIG. l;
FIG . 5 is a block diagram showing an example of a detailed configuration of an I/O data length monitor/comparator in a connection order generator 2o shown in FIG.l; and FIG.6 is a schematic view showing an example of connection order which is generated by the connection order generator shown in FIG.1.
Best Mode for Carrying out the Invention The present invention will be explained in detail with reference to the accompanying drawings hereinafter .
FIG.1 is a block diagram showing a speech speed 3o converting device according to an embodiment of the present invention.
The speech speed converting device shown in FIG.1 comprises a terminal 1, an- A/D converter 2 , an analysis processor 3 , a block data sglitter 4 , a block data memory 5, a connection data generator 6, a connection data memory 7 , a connection order generator 8 , a speech data connector 9 , a D/A converter 10 , and a terminal 11. When the speech-speed converted speech data are synthesized by applying an analyzing process to input speech data 1o from a speaker based on attributes of the speech data and then using a desired function according to the analyzed information, the speech speed converting device can eliminate omission of the speech information against change in scaling factor by executing these processes without inconsistency while comparing a data length (input data length) of input speech data, a target data length calculated by multiplying such data length by any scaling factor, and a data length ( output data length) of actual output speech data, and can 2o monitor time difference between the original speech being changed at every moment and the converted speech .
And, the speech speed converting device can eliminate adaptively the time difference from the original speech because of the speech speed conversion by changing the scaling factor adaptively, e.g., by increasing the speech speed conversion factor temporarily when the time difference is small and conversely decreasing the speech speed conversion factor temporarily when the time difference is large, and further changing a 3o remaining rate of the non-speech interval adaptively _ 13 _ based on the speech speed conversion factor, an amount of expansion, etc.
The A/D converter 2 executes an A/D conversion of the speech signal being input into the. terminal 1, a . g . , the speech signal being output from an analog speech output terminal of the video device , the audio device , etc. such as the microphone, the television set, the radio, and others, at a predetermined sampling rate ( a . g . , 32 kHz ) , and supplies the resultant speech data to to the analysis processor 3 and the block data splitter
In addition, the speech processing can be executed in real time while shortening a calculation time and 2o also reducing a cost , by employing only the power which can be derived relatively simply as a feature parameter.
Background Art In case the speech speed converting method is applied to the actual broadcast, there are some cases where delay from the original speech such as emergency news becomes an issue. Particularly, it is possible that this delay has a bad effect on the visual media in contrast with the effect expected in the speech speed 3o conversion.
a -4-Therefore, as approaches for achieving the speech speed converting effect (slowness impression) without delay from the original speech, there have been reported the method of suppressing extension i.n time by changing the speech speed from slowly to quickly as a function of a lapse time from a start point of one breath speech to an end point instead of uniformly slow conversion, and then reducing appropriately the non-speech interval between sentences (R. Ikezawa et al., "An Approach for to Absorbing Extension in Time Caused in Speech Speed Conversion", Spring Conference, Japanese Acoustic Society, 2-6-2, pp.331-332, 1992), the method of achieving this approach in real time (A. Imai et al., "Real Time Absorption Method for Extension in Time 15 Caused in Speech Speed Conversion", in International Conference, IEICE, D-694, pp 300, 1995), etc.
The former sets an appropriate function manually under that assumption that all speech styles have been known. The latter also sets a function defining a 2o factor manually, and fixes this function after the function has been set once.
In addition, only the constant .remaining time is set manually to reduce the non-speech interval. If a deal of "inconsistency" is integrated, the extended 25 speech being accumulated in a buffer is cleared manually.
Therefore, in the speech speed converting device in the prior art , there has been such a problem that , since various speaking styles (speech speed, "timing"
so in speech, etc.) are present in the broadcast speech _5~
according to the speaker and also appropriate parameters must be set manually respectively, the device has many operation point s, setting per se is difficult, and it is difficult for the common user to handle the device.
Besides, in the above speech speed converting device, the speech interval and the non-speech interval must be recognized separately. There are various systems as the speech interval detecting system in the 1o prior art.
As one of the speech interval detecting system in the prior art , such a system has been known that a noise level and a speech level are calculated based on the power of the speech signal , etc . , then a level threshold value is set based on the calculation result , then this level threshold value and the input signal are compared with each other, then the interval is decided as the speech interval if the level of the; input signal is higher than the level threshold valuE: and the interval 2o is decided as the non-speech interval if the level of the input signal is lower than the level threshold value.
As methods of setting the level threshold value employed in this system, there are first to third representative systems. Accordingtothe first system, a value which is obtained by adding a preselected constant to a noise level value of the input speech is employed as the level threshold valise. According to the second system which is an improved first system, 3o the level threshold value is set to a relatively large -6_ value when a value obtained by subtracting the noise level value from a maximum level value of the input speech signal is large, whereas the level threshold value is set to a relatively small value when the value obtained by subtracting the noise level value from a maximum level value of the input speech signal is small (for example, Patent Application Publication (KOKAI) Sho 58-130395, Patent Application Publication (KOKAI) Sho 61-272796, etc.).
1o According to the third system, in addition to these level threshold value setting methods., the input signal is monitored continuously, then the input signal is regarded as the noise level when the level of the input signal is steady over a constant timE: period, and then 15 a threshold value employed for the speech interval detection is set while updating the noise level sequentially (Proceeding in International Conference, IEICE, D-695, pp 301, 1995).
However, in the above speech interval detecting 2o system in the prior art, there have been problems described in the following.
To begin with, the first system has an advantage that it is simple, and can operate well when the average level of the speech is a middle level. However, the 25 first system is easy to detect the noise, etc. errously as speech when the average level of the speech is too large, and it is easy to detect the speech with omission of a part of the speech when the average level of the speech is too small.
_ -Then, the second system can overcome the problem arisen in the first system. However, there has been such a problem that o since the event that levels of the noises and the background sounds in the input signal are kept substantially constant is employed as a premise, the second system can follow the variation in level of the speech, but the precise speech interval detection cannot be assured when levels of the noises and the background sounds are changed at every moment.
to Then, since the variation in such noise level is considered into the third system, erroneous detection is not caused even when the noise level is changed sequentially.
However, not only the noise but also the background 15 sound such as music, imitation sound, etc. as sound effects are included in the broadcast program, etc., and commonly these levels are changed at every moment and at the same time the speech is always continued to deliver, so that the input signal level seldom becomes 2o steady over a gredetermined time period. In such case, there has been such a problem that , since the noise level cannot be set correctly even by the third system, it is difficult to detect precisely the speech interval.
The present invention has been made in view of the 25 above circumstances, and it is an object of the present invention to provide a speech speed converting method and a device for embodying the same which is capable of controlling adaptively the speech speed conversion factor and the non-speech interval according to set 3o conditions only by setting the conversion factor employed as the several-stage aims once by the user, and also achieving the expected effect for the speech speed conversion stably within the time range which is delivered actually.
In order to achieve the above object, there is provided a speech speed converting method comprising the steps of determining and sett~_ng in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data; applying the time lag at every moment to the function to determine the conversion factor at every moment; calculating a target length of the output data at every moment based on the determined conversion factor; modifying the calculated target length of the output data according to a length of actual output data; extending the input data according to the modified target length of the output data; deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold 2o value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
In the speech speed converting method set forth in the preceding paragraph, the function is such that the conversion factor decreases as the time lag increases.
Further, the calculated target length of the output data is modified according to a length of actual output data in such a manner that the calculated target length 3o is made equal to the length of the actual output data when the calculated target length is less than the Length of the actual output data, and otherwise the _9_ calculated target length is turned over as it is without being modified to the next step.
In another aspect of the speech speed converting method, after the step of calculating the target length of the output data, further comprising the step of making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is 1o without being modified to the next step.
In another aspect of the present invention, there is provided a speech speed converting device comprising: means for determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data; means for applying the time lag at every moment. to the function to determine the conversion factor at every moment;
means for calculating a target length of the output 2o data at every moment based on the determined conversion factor; means for modifying the calculated target length of the output data according to a length of actual output data; means for extending the input data according to the modified target length of the output data; means for deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted 3o input data as the output data. The function is such that the conversion factor decreases as the time lag increases.
- In the speech speed converting device described in the preceding paragraph, the modifying means modifies the calculated target length of the output data according to a length of actual output data in such a manner that the calculated target length is made equal to the length of the actual output data when the calculated target length is less than. the length of the actual output data, and otherwise the calculated target length is turned over as it is without being modified 1o to the next step.
The speech speed converting device further comprises means for making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is without being modified to the next step.
Brief Description of the Drawings FIG.1 is a block diagram showing a speech speed converting device according to an embodiment of the present invention;
FIG.2 is a block diagram showing a speech interval detecting device according to an embodiment of the present invention;
1o FIG.3 is a schematic view showing an example of an operation of the speech interval detecting device shown in FIG.2;
FIG.4 is a schematic view showing a method of generating connection data, which is employed to connect the same block repeatedly in a connection data generator shown in FIG. l;
FIG . 5 is a block diagram showing an example of a detailed configuration of an I/O data length monitor/comparator in a connection order generator 2o shown in FIG.l; and FIG.6 is a schematic view showing an example of connection order which is generated by the connection order generator shown in FIG.1.
Best Mode for Carrying out the Invention The present invention will be explained in detail with reference to the accompanying drawings hereinafter .
FIG.1 is a block diagram showing a speech speed 3o converting device according to an embodiment of the present invention.
The speech speed converting device shown in FIG.1 comprises a terminal 1, an- A/D converter 2 , an analysis processor 3 , a block data sglitter 4 , a block data memory 5, a connection data generator 6, a connection data memory 7 , a connection order generator 8 , a speech data connector 9 , a D/A converter 10 , and a terminal 11. When the speech-speed converted speech data are synthesized by applying an analyzing process to input speech data 1o from a speaker based on attributes of the speech data and then using a desired function according to the analyzed information, the speech speed converting device can eliminate omission of the speech information against change in scaling factor by executing these processes without inconsistency while comparing a data length (input data length) of input speech data, a target data length calculated by multiplying such data length by any scaling factor, and a data length ( output data length) of actual output speech data, and can 2o monitor time difference between the original speech being changed at every moment and the converted speech .
And, the speech speed converting device can eliminate adaptively the time difference from the original speech because of the speech speed conversion by changing the scaling factor adaptively, e.g., by increasing the speech speed conversion factor temporarily when the time difference is small and conversely decreasing the speech speed conversion factor temporarily when the time difference is large, and further changing a 3o remaining rate of the non-speech interval adaptively _ 13 _ based on the speech speed conversion factor, an amount of expansion, etc.
The A/D converter 2 executes an A/D conversion of the speech signal being input into the. terminal 1, a . g . , the speech signal being output from an analog speech output terminal of the video device , the audio device , etc. such as the microphone, the television set, the radio, and others, at a predetermined sampling rate ( a . g . , 32 kHz ) , and supplies the resultant speech data to to the analysis processor 3 and the block data splitter
4 neither too much nor too less while buffering such speech data into a :FIFO memory.
The analysis processor 3 extracts the speech intervals and the non-speech intervals by analyzing the speech data being output from the A/D converter 2 , then generates split information to detE:rmine respective time lengths necessary for the spls_t process of the speech data being executed in the block data splitter 4 based on these intervals , and then supplies such split 2o information to the block data splitter 4.
Now, embodiments of the speech interval detecting method and the device for embodying the same according to the present invention will be explained hereunder.
In the speech interval detecting method and the device for embodying the same according to the present invention, in view o.f the fact that level variation in the speech in the input signal is reflected on a maximum value of the power being input immediately before and level variation in the background sound is reflected on a minimum value of the power being :input immediately before if power of the input signal is employed as an index, a threshold value can be decided by such a process that a value obtained by subtracting a predetermined value from the maximum value of power being input immediately before is set to a basic threshold value and then correction is applied to increase the basic threshold value as a value obtained by subtracting the minimum value from the maximum value of power being input immediately before is decreas:ed (as an S/N is 1o reduced) , when noises are seldom present to determine a threshold value for speech/non-speech discrimination.
Then, the speech interval detecting method and the device for embodying the same calculates the power of the input speech data at a predetermined time interval in unit of frame having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the threshold value for the power which is changed according to the 2o maximum value and difference between the maximum value and the minimum value, while responding sequentially to change in respective powers of the: input speech and the background sound to hold the maximum value and the minimum value of the power in the p<~st predetermined time interval.
The explanation will be made concretely with reference to the drawings hereinafter.
FIG.2 is a block diagram showing the speech interval detecting device.
An speech interval detector 31 shown in FIG.2 comprises a power calculator 32 fo:r calculating the power of the digitized input s~'_gnal data at a predetermined time interval by a predetermined frame width, an instantaneous power maximum value latch 33 for holding the maximum value of the frame power within the past predetermined time period, an instantaneous power minimum value latch 34 for holding the minimum value of the frame power within the past predetermined 1o time period, a power threshold value. decision portion 35 for deciding a threshold value for power which is changed according to both the maxinnum value and the difference between the maximum value held in the instantaneous power maximum value latch 33 and the minimum value held in the instantaneous power minimum value latch 34, and a discriminator 36 for discriminating whether or not the speech belongs to the speech interval or the non-speech interval, by comparing the threshold value decided by the power 2o threshold value decision portion 35 with the power at the current frame.
The speech interval detector :.s1 calculates the power with respect to the input ~~ignal data at a predetermined time interval in frame unit having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the threshold value for power which is changed according to the maximum value and the difference between the maximum valuE: and the minimum 3o value, while responding sequentially to change in respective powers of the input speech and the background sound to hold the maximum value and the minimum value of the power within the past predetermined time period.
The power calculator 32 calculates a sum of squares or square mean value of the signal at a time interval of 5 ms over a frame width of 20 msec, for example, then sets the frame power at that time to "P" by representing this value logarithmically, i . a . , in decibel , and then supplies this frame power '°P" to the instantaneous power 1o maximum value latch 33, the instantaneous power minimum value latch 34, and the discriminator 36.
The instantaneous power maximum value latch 33 is designed to hold the maximum value of the frame power "P'° within the past predetermined time period (e. g., 6 seconds ) , and always supplies the .held value "P"pper°
to the power threshold value decision portion 35.
However, when the frame power "P" to satisfy "P>Pupper~~
is supplied from the power calculator 32 , the maximum value "Popper" is immediately updatec'l.
2o The instantaneous power minimum value latch 34 is designed to hold the minimum value of the frame power a~p.° within the past predetermined tame period (e. g., 4 seconds ) , and always supplies the held value "Plower'~
to the power threshold value decision portion 35.
However, when the frame power "P" to satisfy '°PCPlower~~
is supplied from the power calculator 32 , the minimum value "flower" is immediately updated .
The power threshold value decision portion 35 decides a threshold value °° Pthr'° of the power by executing calculations given in following equations, f or example , with the use of the maximum value '° Popper °°
held in the instantaneous power maximum value latch 33 and the minimum value ''Flower°° held in the instantaneous power minimum value latch 34, and then supplies the threshold value "Ptnr'° to the discriminator 36.
For Popper ' Plover ~ & ~ ( dB ~ .
Pthr - Popper " 35 ., . . ( 1 FOr Popper - Plover ~ 6 ~ ( dB ~ .
Pty = PoppEr - 3 5 + 3 5 X { 1 - ( Popper ' Flower ) / 6 d ~ . . . ( 2 ) In this case, it is desired that an upper limit of Ptnr should be set to Ptnr - Popper- 13 in order to prevent the malfunction of the device of the present invention when a level of the background sound becomes close to a level of the speech. Also, a constant 35 in above Eqs. corresponds to a basic threshold value when the above mentioned noises are seldom present.
The discriminator 36 compares the power '°P"
supplied from the power calculator 3c! every frame with 2o the threshold value "Ptnr" supplied from the power threshold value decision portion 35, then decides every frame that the frame belongs to the speech interval when ~~P~Pthr°° is satisfied and that the frame belongs to the non-speech interval when "PSPtnr°° is satisfied, and then 2s outputs a speech/non-speech discriminating signal based on these decision results.
Accordingly, as shown in FIG.3, under the situation that the value of the input signal data is _ 18 _ being changed , the maximum value "Pup~,er" and the minimum value "Plower~~ can be latched from the power "P°' being output from the power calculator 32 by the instantaneous power maximum value latch 33 and the instantaneous power minimum value latch 34 respectively, then the threshold value "Ptnr" is decided based on the maximum value "Pupper~°
and the minimum value "Plower" ~ and then it is decided based on this threshold value "Ptnr" whether or not the frames belong to the speech interval or the non-speech 1o interval respectively.
In this manner, in this embodiment, the power of the input signal data is calculated at a predetermined time interval in unit of frame having a predetermined time width and then, with responding sequentially to the change in the powers of the input speech and the background sound to keep the maximum value and the minimum value of the power within the Bast predetermined time period, the speech interval arid the non-speech interval are discriminated by using the threshold value 2o for power which changes according to the maximum value and the difference between the maxirnum value and the minimum value. Therefore, with regard to the speech which is delivered together with noises or background sounds in a broadcast program, a recording tape, or a daily life, the speech interval and the non-speech interval can be precisely discriminated frame by frame .
In this embodiment , since a level of the background sound is estimated based on the minimum value of the instantaneous power within the past predetermined time 3o period, the speech interval and the non-speech interval of the input signal can be discriminated even if the level of the background sound is varied at every moment in the broadcast program, etc . and simultaneously the speech is continued to deliver.
As a result, in the case that (a) height of the voice and speed of the speech in the input signal are changed by processing the speech, ( b ) the meaning of the speech in the input signal 1o is mechanically recognized, (c) the speech in the input s_egnal is coded to transfer or record, etc . , improvemE:nt in quality of processed sound, improvement in the speech recognition rate, increase in the coding efficiency, and improvement in quality of the decoded speech can be achieved.
Since only the power which can be derived relatively simply as a feature parameter is employed, a calculation time can be shortE:ned and also a 2o configuration of the overall device can be simplified to reduce a cost . In addition, speech processing can be executed in real time.
Next , in the speech speed converting method of the present invention, processes will be continued further as follows .
That is, the decision whether or not the speech is voiced sound with vibration of the vocal cords or voiceless sound without vibration of the vocal cords is applied to the interval in which the power exceeds 3o the predetermined threshold value Ptnr, i . a . , the speech interval. Not only the magnitude of the power but also zero crossing analysis , autocorrelat;ion analysis , etc .
can be applied to this decision.
When a time length of the block is decided to analyze the speech data, periodicity is detected by applying the predetermined autocorrelation analysis to the speech interval (voiced sound interval, voiceless sound interval ) and the non-speech interval , and then the block lengths are decided based on. this periodicity.
1o Then, pitch periods which are vibration periods of the vocal cords are detected from the voiced sound interval, and then the voiced sound interval is split such that respective pitch periods correspond to respective block lengths. At that time, since the pitch periods of the 15 voiced sound interval is distributed over the wide range of about 1. 25 ms to 28 . 0 ms , as precise pitch periods as possible are detected by executing the autocorrelation analysis using different window widths , or the like . The reason why the pitch period is used 2o as the block length of the voiced sound interval is to prevent change in height of the voice due to repetition in block unit. As with the voiceless sound interval and non-speech interval, the block length is detected by detecting the periodicity within 5 ms.
25 Then, the block data splitter 4 splits the speech data output from the A/D converter 2 in accordance with the block length decided by the analysis processor 3 , and then supplies the speech data which are obtained by this split process in unit of block and the block 30 length to the block data memory 5. The block data splitter 4 also supplies both end portions of the speech data obtained by the split process in unit of block;
i.e., a predetermined time length (e. g., 2 ms) after a start portion and a predetermined time length ( a . g . , 2 ms) before an end portion, to the connection data generator 6.
The block data memory 5 stores the speech data supplied in unit of block from the block data splitter 4 and the block length temporarily 'by virtue of ring 1o buffer. The block data memory 5, as the case may be, supplies the speech data being stored temporarily in unit of block to the speech data connector 9 and supplies the block lengths 'being stored temporarily to the connection order generator 8.
15 The connection data generator f applies windows to the speech data in the end portion. of the preceding block, the start portion of the concerned block, and the start portion of the succeeding block every block, as shown in FIG . 4 , then executes overlapping addition 20 of the end portion of the preceding lblock and the end portion of the concerned block and overlapping addition of the start portion of the concerned block and the start portion of the succeeding block, then generates connection data for every block by connecting them, and 25 then supplies the connection data to the connection data memory 7.
The connection data memory 7 stores the connection data of respective blocks supplied from the connection data generator 6 temporarily by virtue of ring buffer, 3o and then supplies the connection data being stored temporarily to the speech data connector 9 if necessary.
The connection order generator 8 generates the connection order of the speech data in unit of block and connection data in order to attain the desired speech speed which is set by a listener. In this case, the listener can set an extension factor in time for respective attributes (voiced sound interval, voiceless sound interval, and non-speech interval) by using a digital volume as an interface . This value is 1o stored in a writable memory. Also, this value can be provided by selecting one of the method (uniform extension mode ) in which such value is processed as a fixed extension factor and the method ( time extension absorption mode) in which a speech speed converting effect can be achieved within a limited time range by controlling respective speech attributes totally and . adaptively while aiming at such set factor, not to integrate the inconsistency for a predetermined time.
According to the connection order generator 8, 2o when the sgeech synthesis is performed actually by using the extension factor being set in the memory, the time difference between a delivered time of the original speech and an output time of the converted speech can be always monitored by grasping, in real time, time relationships among the input speech data length and the output speech data length at the same time and the speech data length to be synthesized, so that the time difference can be suppressed automai~ically within a constant length by feeding back this information. At 3o the same time, it can be checked whether or not inconsistency in time (e.g., request such that the output speech data .length must be set shorter than the input speech data length) is caused by using a scaling factor being changed into any value at any timing, and therefore omission of speech information in synthesis can be prevented.
Next, the process in the connection order generator 8 will be explained in detail hereunder . When the scaling factor of the speech is sE:t by any function, to the speech data length (= input data length) in processing unit specified by the block data splitter 4 is sequentially calculated based on respective block lengths supplied from the block data memory 5 , and then a length which is derived by multiplying the input data length by the scaling factor being set by the listener is set as a target data length. The speech data connector 9 connects the speech data. to coincide with this target data. length, and also feeds back the speech data length (=output data length), which is a length of the output speech data being output actually, sequentially to the connection order generator 8.
Then , as shown in FIG . 5 , a target length which is generated by an I/O data length monitor/comparator 20 provided in the connection order generator 8 is sent to the speech data connector 9 as connection order information. The I/O data length monitor/comparator 20 comprises an input data length monitor 21 for monitoring the input data length; an output target length calculator 22 for calculating a target length (target data length) of the output data generated by the sgeech speed factor conversion, which is effected based on the input data length obtained by the input data length. monitor 21 and the value given by the listener (or a function memory built in the device), for example, and also correcting this target data length automatically; a comparator 23 for comparing the target data length obtained by the output target length calculator 22 with the input data length obtained by the input data length monitor 21, and then setting the to target data length to coincide with the input data length if the target data length is shorter than the input data length, but outputting the target data length as it is if the target data length is longer than the .input data length; an output data length monitor 24 for receiving ready-connected information concerning the output data supplied from the speech. data connector 9 to monitor the output data length; and a comparator 25 for comparing the output data length obtained by the output data length monitor 24 with the target data length obtained by the comparator 23, and then setting the target data length to coincide wii=h the output data length if the target data length is shorter than the output data length, but outputting the target data length as it is if the target data length is longer than the output data length. Then, as described later, the I/O data length monitor/comparator 20 reads out values being set in the memory for every attribute of the speech at a predetermined time interval, then calculates the target data length in order to attain extension factors 3o for every read attribute, then generates the connection information, into which the scaling information of the speech are added, at every moment based on the target data length and the output data length obtained by the output data length monitor 24, and then connects the speech data and the connection data for every block, as shown in FIG.6.
First , the input data length and the target data length are compared sequentially with each other, and then the target data length-is corrected to coincide to with the input data length if it has been decided that the input data length is longer than the target data length, but change of the target data length is suspended if it has been. decided that the input data length is less than the target data length.
Then, the target data length and the actual output data length are compared sequentially with each other, and then the target data length is corrected to coincide with the output data length if it has been decided that the output data length is longer than the target data length, but change of the target data length is suspended if it has been decided that the output data length is less than the target data length.
Connection instructions indicating the extension information, connection information, etc. are 2~ generated to coincide with the target data lengths obtained by these comparing processes, and then supplied to the speech data connector 9.
Then, controlling conditions for the speech speed conversion factor in the connection order generator 8 so will be explained hereunder. For example, in case the speech speed conversion is desired in the limited time range such as the time frame in the broadcast , the input data length and the output data length are monitored sequentially so as to measure time difference between both data at a time interval being previously set arbitrarily, and then such a function for changing the scaling factor adaptively may be set that the speech speed conversion factor is increased temporarily if an amount of delay is small but the speech speed conversion 1o factor is decreased temporarily if an amount of delay is large.
For example, in this embodiment, assume that a start time of the first voiced sound appearing after a time when the non-speech interval of more than 200ms appears is set to "t=0" , and then a cosine function given by a following Eq.3 may be employed as a function which can provide a factor corresponding -to the start time of the voiced sounds appearing in the range of "O~t CT~~ .
2o f(t) - rs + 0.~(rs - re)(cos TCt/T + 1.0)...(3) Where t: 0 C t C T
rs: an external input value by the listener ( 1. O~rs~ 1 . 6 ) re: a value given as an initial value (e. g., re - 1.0) Then, the time difference between the input data length and the output data length is calculated at a certain constant time interval , a . g. , every one second, _ 27 and then the process is executed such that the initial value re is increased from "1.0" by "0.05" and conversely is decreased to about "0.95" according to the time difference at that time. However, in case the non-speech interval of more than 200 rns has not appeared yet at a point of time in excess of the time period T, a factor of 1.0, for example, is applied to the succeeding voiced sound interval. In this case, a new factor may be given by using a variable: such as the pitch, to the power, etc. as an index.
Further, a remaining rate of the non-speech interval may be changed adaptively in view of the speech speed conversion factor, the extension amount; etc.
This may be set arbitrarily as a function.
Then, a compression allowable limit (a R,ralue indicating how long at least interval must be saved without reduction ) of the non- speech interval is set to correspond to the external input value rs. This limit may be expressed by the above function, but it 2o may be set discretely, for example, as described in the following.
At rs = 1. this limit is reducible up to 300 ms 0 , At rs = 1. this limit is reducible up to 250 ms 1, At rs = 1. this limit is reducible up to 230 ms 2 , At rs = 1 this limit is reducible up to 200 ms . 3 , At rs 1 . this limit is reducible up to 200 ms = 4 , At rs 1. 5 this limit is reducible up to 150 ms = , At rs 1. 6 this limit is reducible up to 100 ms = , In addition, a reduction system of the non-speech interval can be implemented by shifting a pointer to any address on the ring buffer. In this embodiment, omission of the speech information can be prevented by shifting the pointer to the start portion of the voiced sound immediately after the concerned non-speech interval.
Furthermore, the speech data connector 9 reads the speech data from the block data memor;t 5 in unit of block in compliance with the connection order decided by the 1o connection order generator 8, then extends the speech data of the designated block, then connects the speech data and the connection data while reading out the connection data from the connection data memory 7 and suppressing the connection process not to cause excess and deficiency in capacity of the FIFO memory provided in the D/A converter 10 , and then generates the output speech data to supply them to the DJA converter 10.
The D/A converter 10 D/A-converts the output speech data at a predetermined sampling rate (e.g. , 32 2o kHz) while buffering the output speech data supplied from the speech data connector 9 by virtue of the FIFO
memory, then generates the output speech signal, and then outputs it from the terminal 13.
In this manner, in this embodiment, when the speech-speed converted speech data ar_e synthesized by applying an analyzing process to input speech data from a speaker based on attributes of the speech data and then using a desired function according to the analyzed information, the speech speed converting device can 3o eliminate omission of the speech information against change in extension/scaling factors since these processes can be executed without inconsistency while comparing the input data length, the target data length calculated by multiplying the input data length by any scaling factor, and the actual output speech data length.
And, the speech speed converting device can eliminate adaptively the time difference between the original speech and the converted speech because of the speech speed conversion by monitoring the time difference 1o which varies at every moment and changing the scaling factor adaptively, e.g. , by increasing the speech speed conversion factor temporarily when the time difference is small and conversely decreasing the speech speed conversion factor temporarily when the time difference 15 is large , and further changing a remaining rate of the non-speech interval adaptively based on the speech speed conversion factor, an amount of expansion, etc.
Therefore , the speech speed conversion factor and the non-speech interval can be controlled adaptively 2o according to set conditions only by setting the conversion factor employed as the several-stage aims once by the user, and thus an expected effect for the speech speed conversion can be achieved stably within the time range being delivered actually.
25 As a result, the most suitable speech speed converting effect for respective speakers can be provided automatically to the broadcast program in which the speakers are changed free~uently, etc. In addition, the present invention makes it possible for 3o the aged person and the visually or acoustically handicapped person, who are diff~_cult to listen the rapid talking, to listen the emergency news , which needs real time property, and the speech in the visual media such as the television stably and slowly without delay in time by an extremely simple operation.
Industrial Applicability As described above, according to the speech speed converting method and the device for embodying the same of the present invention, the speech speed conversion 1o factor and the non-speech interval can be controlled adaptively according to set conditions only by setting the conversion factor employed as the several-stage aims once by the user, and therefore the expected effect for the speech speed conversion can be achieved stably within the time range being delivered actually.
The analysis processor 3 extracts the speech intervals and the non-speech intervals by analyzing the speech data being output from the A/D converter 2 , then generates split information to detE:rmine respective time lengths necessary for the spls_t process of the speech data being executed in the block data splitter 4 based on these intervals , and then supplies such split 2o information to the block data splitter 4.
Now, embodiments of the speech interval detecting method and the device for embodying the same according to the present invention will be explained hereunder.
In the speech interval detecting method and the device for embodying the same according to the present invention, in view o.f the fact that level variation in the speech in the input signal is reflected on a maximum value of the power being input immediately before and level variation in the background sound is reflected on a minimum value of the power being :input immediately before if power of the input signal is employed as an index, a threshold value can be decided by such a process that a value obtained by subtracting a predetermined value from the maximum value of power being input immediately before is set to a basic threshold value and then correction is applied to increase the basic threshold value as a value obtained by subtracting the minimum value from the maximum value of power being input immediately before is decreas:ed (as an S/N is 1o reduced) , when noises are seldom present to determine a threshold value for speech/non-speech discrimination.
Then, the speech interval detecting method and the device for embodying the same calculates the power of the input speech data at a predetermined time interval in unit of frame having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the threshold value for the power which is changed according to the 2o maximum value and difference between the maximum value and the minimum value, while responding sequentially to change in respective powers of the: input speech and the background sound to hold the maximum value and the minimum value of the power in the p<~st predetermined time interval.
The explanation will be made concretely with reference to the drawings hereinafter.
FIG.2 is a block diagram showing the speech interval detecting device.
An speech interval detector 31 shown in FIG.2 comprises a power calculator 32 fo:r calculating the power of the digitized input s~'_gnal data at a predetermined time interval by a predetermined frame width, an instantaneous power maximum value latch 33 for holding the maximum value of the frame power within the past predetermined time period, an instantaneous power minimum value latch 34 for holding the minimum value of the frame power within the past predetermined 1o time period, a power threshold value. decision portion 35 for deciding a threshold value for power which is changed according to both the maxinnum value and the difference between the maximum value held in the instantaneous power maximum value latch 33 and the minimum value held in the instantaneous power minimum value latch 34, and a discriminator 36 for discriminating whether or not the speech belongs to the speech interval or the non-speech interval, by comparing the threshold value decided by the power 2o threshold value decision portion 35 with the power at the current frame.
The speech interval detector :.s1 calculates the power with respect to the input ~~ignal data at a predetermined time interval in frame unit having a predetermined time width, and then discriminates between the speech interval and the non-speech interval every frame by using the threshold value for power which is changed according to the maximum value and the difference between the maximum valuE: and the minimum 3o value, while responding sequentially to change in respective powers of the input speech and the background sound to hold the maximum value and the minimum value of the power within the past predetermined time period.
The power calculator 32 calculates a sum of squares or square mean value of the signal at a time interval of 5 ms over a frame width of 20 msec, for example, then sets the frame power at that time to "P" by representing this value logarithmically, i . a . , in decibel , and then supplies this frame power '°P" to the instantaneous power 1o maximum value latch 33, the instantaneous power minimum value latch 34, and the discriminator 36.
The instantaneous power maximum value latch 33 is designed to hold the maximum value of the frame power "P'° within the past predetermined time period (e. g., 6 seconds ) , and always supplies the .held value "P"pper°
to the power threshold value decision portion 35.
However, when the frame power "P" to satisfy "P>Pupper~~
is supplied from the power calculator 32 , the maximum value "Popper" is immediately updatec'l.
2o The instantaneous power minimum value latch 34 is designed to hold the minimum value of the frame power a~p.° within the past predetermined tame period (e. g., 4 seconds ) , and always supplies the held value "Plower'~
to the power threshold value decision portion 35.
However, when the frame power "P" to satisfy '°PCPlower~~
is supplied from the power calculator 32 , the minimum value "flower" is immediately updated .
The power threshold value decision portion 35 decides a threshold value °° Pthr'° of the power by executing calculations given in following equations, f or example , with the use of the maximum value '° Popper °°
held in the instantaneous power maximum value latch 33 and the minimum value ''Flower°° held in the instantaneous power minimum value latch 34, and then supplies the threshold value "Ptnr'° to the discriminator 36.
For Popper ' Plover ~ & ~ ( dB ~ .
Pthr - Popper " 35 ., . . ( 1 FOr Popper - Plover ~ 6 ~ ( dB ~ .
Pty = PoppEr - 3 5 + 3 5 X { 1 - ( Popper ' Flower ) / 6 d ~ . . . ( 2 ) In this case, it is desired that an upper limit of Ptnr should be set to Ptnr - Popper- 13 in order to prevent the malfunction of the device of the present invention when a level of the background sound becomes close to a level of the speech. Also, a constant 35 in above Eqs. corresponds to a basic threshold value when the above mentioned noises are seldom present.
The discriminator 36 compares the power '°P"
supplied from the power calculator 3c! every frame with 2o the threshold value "Ptnr" supplied from the power threshold value decision portion 35, then decides every frame that the frame belongs to the speech interval when ~~P~Pthr°° is satisfied and that the frame belongs to the non-speech interval when "PSPtnr°° is satisfied, and then 2s outputs a speech/non-speech discriminating signal based on these decision results.
Accordingly, as shown in FIG.3, under the situation that the value of the input signal data is _ 18 _ being changed , the maximum value "Pup~,er" and the minimum value "Plower~~ can be latched from the power "P°' being output from the power calculator 32 by the instantaneous power maximum value latch 33 and the instantaneous power minimum value latch 34 respectively, then the threshold value "Ptnr" is decided based on the maximum value "Pupper~°
and the minimum value "Plower" ~ and then it is decided based on this threshold value "Ptnr" whether or not the frames belong to the speech interval or the non-speech 1o interval respectively.
In this manner, in this embodiment, the power of the input signal data is calculated at a predetermined time interval in unit of frame having a predetermined time width and then, with responding sequentially to the change in the powers of the input speech and the background sound to keep the maximum value and the minimum value of the power within the Bast predetermined time period, the speech interval arid the non-speech interval are discriminated by using the threshold value 2o for power which changes according to the maximum value and the difference between the maxirnum value and the minimum value. Therefore, with regard to the speech which is delivered together with noises or background sounds in a broadcast program, a recording tape, or a daily life, the speech interval and the non-speech interval can be precisely discriminated frame by frame .
In this embodiment , since a level of the background sound is estimated based on the minimum value of the instantaneous power within the past predetermined time 3o period, the speech interval and the non-speech interval of the input signal can be discriminated even if the level of the background sound is varied at every moment in the broadcast program, etc . and simultaneously the speech is continued to deliver.
As a result, in the case that (a) height of the voice and speed of the speech in the input signal are changed by processing the speech, ( b ) the meaning of the speech in the input signal 1o is mechanically recognized, (c) the speech in the input s_egnal is coded to transfer or record, etc . , improvemE:nt in quality of processed sound, improvement in the speech recognition rate, increase in the coding efficiency, and improvement in quality of the decoded speech can be achieved.
Since only the power which can be derived relatively simply as a feature parameter is employed, a calculation time can be shortE:ned and also a 2o configuration of the overall device can be simplified to reduce a cost . In addition, speech processing can be executed in real time.
Next , in the speech speed converting method of the present invention, processes will be continued further as follows .
That is, the decision whether or not the speech is voiced sound with vibration of the vocal cords or voiceless sound without vibration of the vocal cords is applied to the interval in which the power exceeds 3o the predetermined threshold value Ptnr, i . a . , the speech interval. Not only the magnitude of the power but also zero crossing analysis , autocorrelat;ion analysis , etc .
can be applied to this decision.
When a time length of the block is decided to analyze the speech data, periodicity is detected by applying the predetermined autocorrelation analysis to the speech interval (voiced sound interval, voiceless sound interval ) and the non-speech interval , and then the block lengths are decided based on. this periodicity.
1o Then, pitch periods which are vibration periods of the vocal cords are detected from the voiced sound interval, and then the voiced sound interval is split such that respective pitch periods correspond to respective block lengths. At that time, since the pitch periods of the 15 voiced sound interval is distributed over the wide range of about 1. 25 ms to 28 . 0 ms , as precise pitch periods as possible are detected by executing the autocorrelation analysis using different window widths , or the like . The reason why the pitch period is used 2o as the block length of the voiced sound interval is to prevent change in height of the voice due to repetition in block unit. As with the voiceless sound interval and non-speech interval, the block length is detected by detecting the periodicity within 5 ms.
25 Then, the block data splitter 4 splits the speech data output from the A/D converter 2 in accordance with the block length decided by the analysis processor 3 , and then supplies the speech data which are obtained by this split process in unit of block and the block 30 length to the block data memory 5. The block data splitter 4 also supplies both end portions of the speech data obtained by the split process in unit of block;
i.e., a predetermined time length (e. g., 2 ms) after a start portion and a predetermined time length ( a . g . , 2 ms) before an end portion, to the connection data generator 6.
The block data memory 5 stores the speech data supplied in unit of block from the block data splitter 4 and the block length temporarily 'by virtue of ring 1o buffer. The block data memory 5, as the case may be, supplies the speech data being stored temporarily in unit of block to the speech data connector 9 and supplies the block lengths 'being stored temporarily to the connection order generator 8.
15 The connection data generator f applies windows to the speech data in the end portion. of the preceding block, the start portion of the concerned block, and the start portion of the succeeding block every block, as shown in FIG . 4 , then executes overlapping addition 20 of the end portion of the preceding lblock and the end portion of the concerned block and overlapping addition of the start portion of the concerned block and the start portion of the succeeding block, then generates connection data for every block by connecting them, and 25 then supplies the connection data to the connection data memory 7.
The connection data memory 7 stores the connection data of respective blocks supplied from the connection data generator 6 temporarily by virtue of ring buffer, 3o and then supplies the connection data being stored temporarily to the speech data connector 9 if necessary.
The connection order generator 8 generates the connection order of the speech data in unit of block and connection data in order to attain the desired speech speed which is set by a listener. In this case, the listener can set an extension factor in time for respective attributes (voiced sound interval, voiceless sound interval, and non-speech interval) by using a digital volume as an interface . This value is 1o stored in a writable memory. Also, this value can be provided by selecting one of the method (uniform extension mode ) in which such value is processed as a fixed extension factor and the method ( time extension absorption mode) in which a speech speed converting effect can be achieved within a limited time range by controlling respective speech attributes totally and . adaptively while aiming at such set factor, not to integrate the inconsistency for a predetermined time.
According to the connection order generator 8, 2o when the sgeech synthesis is performed actually by using the extension factor being set in the memory, the time difference between a delivered time of the original speech and an output time of the converted speech can be always monitored by grasping, in real time, time relationships among the input speech data length and the output speech data length at the same time and the speech data length to be synthesized, so that the time difference can be suppressed automai~ically within a constant length by feeding back this information. At 3o the same time, it can be checked whether or not inconsistency in time (e.g., request such that the output speech data .length must be set shorter than the input speech data length) is caused by using a scaling factor being changed into any value at any timing, and therefore omission of speech information in synthesis can be prevented.
Next, the process in the connection order generator 8 will be explained in detail hereunder . When the scaling factor of the speech is sE:t by any function, to the speech data length (= input data length) in processing unit specified by the block data splitter 4 is sequentially calculated based on respective block lengths supplied from the block data memory 5 , and then a length which is derived by multiplying the input data length by the scaling factor being set by the listener is set as a target data length. The speech data connector 9 connects the speech data. to coincide with this target data. length, and also feeds back the speech data length (=output data length), which is a length of the output speech data being output actually, sequentially to the connection order generator 8.
Then , as shown in FIG . 5 , a target length which is generated by an I/O data length monitor/comparator 20 provided in the connection order generator 8 is sent to the speech data connector 9 as connection order information. The I/O data length monitor/comparator 20 comprises an input data length monitor 21 for monitoring the input data length; an output target length calculator 22 for calculating a target length (target data length) of the output data generated by the sgeech speed factor conversion, which is effected based on the input data length obtained by the input data length. monitor 21 and the value given by the listener (or a function memory built in the device), for example, and also correcting this target data length automatically; a comparator 23 for comparing the target data length obtained by the output target length calculator 22 with the input data length obtained by the input data length monitor 21, and then setting the to target data length to coincide with the input data length if the target data length is shorter than the input data length, but outputting the target data length as it is if the target data length is longer than the .input data length; an output data length monitor 24 for receiving ready-connected information concerning the output data supplied from the speech. data connector 9 to monitor the output data length; and a comparator 25 for comparing the output data length obtained by the output data length monitor 24 with the target data length obtained by the comparator 23, and then setting the target data length to coincide wii=h the output data length if the target data length is shorter than the output data length, but outputting the target data length as it is if the target data length is longer than the output data length. Then, as described later, the I/O data length monitor/comparator 20 reads out values being set in the memory for every attribute of the speech at a predetermined time interval, then calculates the target data length in order to attain extension factors 3o for every read attribute, then generates the connection information, into which the scaling information of the speech are added, at every moment based on the target data length and the output data length obtained by the output data length monitor 24, and then connects the speech data and the connection data for every block, as shown in FIG.6.
First , the input data length and the target data length are compared sequentially with each other, and then the target data length-is corrected to coincide to with the input data length if it has been decided that the input data length is longer than the target data length, but change of the target data length is suspended if it has been. decided that the input data length is less than the target data length.
Then, the target data length and the actual output data length are compared sequentially with each other, and then the target data length is corrected to coincide with the output data length if it has been decided that the output data length is longer than the target data length, but change of the target data length is suspended if it has been decided that the output data length is less than the target data length.
Connection instructions indicating the extension information, connection information, etc. are 2~ generated to coincide with the target data lengths obtained by these comparing processes, and then supplied to the speech data connector 9.
Then, controlling conditions for the speech speed conversion factor in the connection order generator 8 so will be explained hereunder. For example, in case the speech speed conversion is desired in the limited time range such as the time frame in the broadcast , the input data length and the output data length are monitored sequentially so as to measure time difference between both data at a time interval being previously set arbitrarily, and then such a function for changing the scaling factor adaptively may be set that the speech speed conversion factor is increased temporarily if an amount of delay is small but the speech speed conversion 1o factor is decreased temporarily if an amount of delay is large.
For example, in this embodiment, assume that a start time of the first voiced sound appearing after a time when the non-speech interval of more than 200ms appears is set to "t=0" , and then a cosine function given by a following Eq.3 may be employed as a function which can provide a factor corresponding -to the start time of the voiced sounds appearing in the range of "O~t CT~~ .
2o f(t) - rs + 0.~(rs - re)(cos TCt/T + 1.0)...(3) Where t: 0 C t C T
rs: an external input value by the listener ( 1. O~rs~ 1 . 6 ) re: a value given as an initial value (e. g., re - 1.0) Then, the time difference between the input data length and the output data length is calculated at a certain constant time interval , a . g. , every one second, _ 27 and then the process is executed such that the initial value re is increased from "1.0" by "0.05" and conversely is decreased to about "0.95" according to the time difference at that time. However, in case the non-speech interval of more than 200 rns has not appeared yet at a point of time in excess of the time period T, a factor of 1.0, for example, is applied to the succeeding voiced sound interval. In this case, a new factor may be given by using a variable: such as the pitch, to the power, etc. as an index.
Further, a remaining rate of the non-speech interval may be changed adaptively in view of the speech speed conversion factor, the extension amount; etc.
This may be set arbitrarily as a function.
Then, a compression allowable limit (a R,ralue indicating how long at least interval must be saved without reduction ) of the non- speech interval is set to correspond to the external input value rs. This limit may be expressed by the above function, but it 2o may be set discretely, for example, as described in the following.
At rs = 1. this limit is reducible up to 300 ms 0 , At rs = 1. this limit is reducible up to 250 ms 1, At rs = 1. this limit is reducible up to 230 ms 2 , At rs = 1 this limit is reducible up to 200 ms . 3 , At rs 1 . this limit is reducible up to 200 ms = 4 , At rs 1. 5 this limit is reducible up to 150 ms = , At rs 1. 6 this limit is reducible up to 100 ms = , In addition, a reduction system of the non-speech interval can be implemented by shifting a pointer to any address on the ring buffer. In this embodiment, omission of the speech information can be prevented by shifting the pointer to the start portion of the voiced sound immediately after the concerned non-speech interval.
Furthermore, the speech data connector 9 reads the speech data from the block data memor;t 5 in unit of block in compliance with the connection order decided by the 1o connection order generator 8, then extends the speech data of the designated block, then connects the speech data and the connection data while reading out the connection data from the connection data memory 7 and suppressing the connection process not to cause excess and deficiency in capacity of the FIFO memory provided in the D/A converter 10 , and then generates the output speech data to supply them to the DJA converter 10.
The D/A converter 10 D/A-converts the output speech data at a predetermined sampling rate (e.g. , 32 2o kHz) while buffering the output speech data supplied from the speech data connector 9 by virtue of the FIFO
memory, then generates the output speech signal, and then outputs it from the terminal 13.
In this manner, in this embodiment, when the speech-speed converted speech data ar_e synthesized by applying an analyzing process to input speech data from a speaker based on attributes of the speech data and then using a desired function according to the analyzed information, the speech speed converting device can 3o eliminate omission of the speech information against change in extension/scaling factors since these processes can be executed without inconsistency while comparing the input data length, the target data length calculated by multiplying the input data length by any scaling factor, and the actual output speech data length.
And, the speech speed converting device can eliminate adaptively the time difference between the original speech and the converted speech because of the speech speed conversion by monitoring the time difference 1o which varies at every moment and changing the scaling factor adaptively, e.g. , by increasing the speech speed conversion factor temporarily when the time difference is small and conversely decreasing the speech speed conversion factor temporarily when the time difference 15 is large , and further changing a remaining rate of the non-speech interval adaptively based on the speech speed conversion factor, an amount of expansion, etc.
Therefore , the speech speed conversion factor and the non-speech interval can be controlled adaptively 2o according to set conditions only by setting the conversion factor employed as the several-stage aims once by the user, and thus an expected effect for the speech speed conversion can be achieved stably within the time range being delivered actually.
25 As a result, the most suitable speech speed converting effect for respective speakers can be provided automatically to the broadcast program in which the speakers are changed free~uently, etc. In addition, the present invention makes it possible for 3o the aged person and the visually or acoustically handicapped person, who are diff~_cult to listen the rapid talking, to listen the emergency news , which needs real time property, and the speech in the visual media such as the television stably and slowly without delay in time by an extremely simple operation.
Industrial Applicability As described above, according to the speech speed converting method and the device for embodying the same of the present invention, the speech speed conversion 1o factor and the non-speech interval can be controlled adaptively according to set conditions only by setting the conversion factor employed as the several-stage aims once by the user, and therefore the expected effect for the speech speed conversion can be achieved stably within the time range being delivered actually.
Claims (8)
1. A speech speed converting method comprising the steps of:
determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data;
applying the time lag at every moment to the function to determine the conversion factor at every moment;
calculating a target length of the output data at every moment based on the determined conversion factor;
modifying the calculated target length of the output data according to a length of actual output data;
extending the input data according to the modified target length of the output data;
deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data;
applying the time lag at every moment to the function to determine the conversion factor at every moment;
calculating a target length of the output data at every moment based on the determined conversion factor;
modifying the calculated target length of the output data according to a length of actual output data;
extending the input data according to the modified target length of the output data;
deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
2. A speech speed converting method set forth in claim 1, wherein the function is such that the conversion factor decreases as the time lag increases.
3. A speech speed converting method set forth in claim 1, wherein the calculated target length of the output data is modified according to a length of actual output data in such a manner that the calculated target length is made equal to the length of the actual output data when the calculated target length is less than the length of the actual output data, and otherwise the calculated target length is turned over as it is without being modified to the next step.
4. A speech speed converting method set forth in claim 1, wherein after the step of calculating the target length of the output data, further comprising the step of making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is without being modified to the next step.
5. A speech speed converting device comprising:
means for determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data;
means for applying the time lag at every moment to the function to determine the conversion factor at every moment;
means for calculating a target length of the output data at every moment based on the determined conversion factor;
means for modifying the calculated target length of the output data according to a length of actual output data;
means for extending the input data according to the modified target length of the output data;
means for deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
means for determining and setting in advance a conversion factor used for extending input data as a function that varies depending upon a time lag between the input data and output data;
means for applying the time lag at every moment to the function to determine the conversion factor at every moment;
means for calculating a target length of the output data at every moment based on the determined conversion factor;
means for modifying the calculated target length of the output data according to a length of actual output data;
means for extending the input data according to the modified target length of the output data;
means for deleting, when a length of a non-speech interval included in the extended input data exceeds a threshold value variously set depending upon a value of the conversion factor, the exceeding portion of the non-speech interval to output the partially deleted input data as the output data.
6. A speech speed converting device set forth in claim 5, wherein the function is such that the conversion factor decreases as the time lag increases.
7. A speech speed converting device set forth in claim 5, wherein the modifying means modifies the calculated target length of the output data according to a length of actual output data in such a manner that the calculated target length is made equal to the length of the actual output data when the calculated target length is less than the length of the actual output data, and otherwise the calculated target length is turned over as it is without being modified to the next step.
8. A speech speed converting method set forth in claim 1, further comprising means for making the calculated target length equal to a length of the input data when the calculated target length is less than the length of the input data, and otherwise turning over the calculated target length as it is without being modified to the next step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA002392849A CA2392849C (en) | 1997-04-30 | 1998-04-30 | Speech interval detecting method and device |
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP9/112961 | 1997-04-30 | ||
| JP11282297A JP3160228B2 (en) | 1997-04-30 | 1997-04-30 | Voice section detection method and apparatus |
| JP11296197A JP3220043B2 (en) | 1997-04-30 | 1997-04-30 | Speech rate conversion method and apparatus |
| JP9/112822 | 1997-04-30 | ||
| PCT/JP1998/001984 WO1998049673A1 (en) | 1997-04-30 | 1998-04-30 | Method and device for detecting voice sections, and speech velocity conversion method and device utilizing said method and device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002392849A Division CA2392849C (en) | 1997-04-30 | 1998-04-30 | Speech interval detecting method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2258908A1 CA2258908A1 (en) | 1998-11-05 |
| CA2258908C true CA2258908C (en) | 2002-12-10 |
Family
ID=26451896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002258908A Expired - Lifetime CA2258908C (en) | 1997-04-30 | 1998-04-30 | Speech rate conversion without extension of input data duration, using speech interval detection |
Country Status (7)
| Country | Link |
|---|---|
| US (2) | US6236970B1 (en) |
| EP (3) | EP0944036A4 (en) |
| KR (1) | KR100302370B1 (en) |
| CN (2) | CN1117343C (en) |
| CA (1) | CA2258908C (en) |
| NO (1) | NO317600B1 (en) |
| WO (1) | WO1998049673A1 (en) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19933541C2 (en) * | 1999-07-16 | 2002-06-27 | Infineon Technologies Ag | Method for a digital learning device for digital recording of an analog audio signal with automatic indexing |
| JP4438144B2 (en) * | 1999-11-11 | 2010-03-24 | ソニー株式会社 | Signal classification method and apparatus, descriptor generation method and apparatus, signal search method and apparatus |
| KR100806155B1 (en) * | 2000-08-09 | 2008-02-22 | 톰슨 라이센싱 | Method and system for enabling audio speed conversion |
| US20040090555A1 (en) * | 2000-08-10 | 2004-05-13 | Magdy Megeid | System and method for enabling audio speed conversion |
| KR100916959B1 (en) * | 2001-05-11 | 2009-09-14 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Estimating signal power in compressed audio |
| JP4265908B2 (en) * | 2002-12-12 | 2009-05-20 | アルパイン株式会社 | Speech recognition apparatus and speech recognition performance improving method |
| JP4114658B2 (en) * | 2004-04-13 | 2008-07-09 | ソニー株式会社 | Data transmitting apparatus and data receiving apparatus |
| FI20045146A0 (en) * | 2004-04-22 | 2004-04-22 | Nokia Corp | Detection of audio activity |
| WO2006008810A1 (en) | 2004-07-21 | 2006-01-26 | Fujitsu Limited | Speed converter, speed converting method and program |
| JP2006084754A (en) * | 2004-09-16 | 2006-03-30 | Oki Electric Ind Co Ltd | Voice recording and reproducing apparatus |
| US8364492B2 (en) * | 2006-07-13 | 2013-01-29 | Nec Corporation | Apparatus, method and program for giving warning in connection with inputting of unvoiced speech |
| ATE446572T1 (en) | 2006-08-22 | 2009-11-15 | Harman Becker Automotive Sys | METHOD AND SYSTEM FOR PROVIDING AN EXTENDED BANDWIDTH AUDIO SIGNAL |
| EP1939859A3 (en) | 2006-12-25 | 2013-04-24 | Yamaha Corporation | Sound signal processing apparatus and program |
| CN101636784B (en) | 2007-03-20 | 2011-12-28 | 富士通株式会社 | Speech recognition system, and speech recognition method |
| CN101472060B (en) * | 2007-12-27 | 2011-12-07 | 新奥特（北京）视频技术有限公司 | Method and device for estimating news program length |
| US20090209341A1 (en) * | 2008-02-14 | 2009-08-20 | Aruze Gaming America, Inc. | Gaming Apparatus Capable of Conversation with Player and Control Method Thereof |
| US8463412B2 (en) * | 2008-08-21 | 2013-06-11 | Motorola Mobility Llc | Method and apparatus to facilitate determining signal bounding frequencies |
| GB0919672D0 (en) * | 2009-11-10 | 2009-12-23 | Skype Ltd | Noise suppression |
| CN102376303B (en) * | 2010-08-13 | 2014-03-12 | 国基电子（上海）有限公司 | Sound recording device and method for processing and recording sound by utilizing same |
| JP5593244B2 (en) * | 2011-01-28 | 2014-09-17 | 日本放送協会 | Spoken speed conversion magnification determination device, spoken speed conversion device, program, and recording medium |
| CN103716470B (en) * | 2012-09-29 | 2016-12-07 | 华为技术有限公司 | The method and apparatus of Voice Quality Monitor |
| US9036844B1 (en) | 2013-11-10 | 2015-05-19 | Avraham Suhami | Hearing devices based on the plasticity of the brain |
| US9202469B1 (en) * | 2014-09-16 | 2015-12-01 | Citrix Systems, Inc. | Capturing noteworthy portions of audio recordings |
| CN107731243B (en) * | 2016-08-12 | 2020-08-07 | 电信科学技术研究院 | Voice real-time variable-speed playing method and device |
| US11386913B2 (en) * | 2017-08-01 | 2022-07-12 | Dolby Laboratories Licensing Corporation | Audio object classification based on location metadata |
| RU2761940C1 (en) | 2018-12-18 | 2021-12-14 | Общество С Ограниченной Ответственностью "Яндекс" | Methods and electronic apparatuses for identifying a statement of the user by a digital audio signal |
| CN111540342B (en) * | 2020-04-16 | 2022-07-19 | 浙江大华技术股份有限公司 | Energy threshold adjusting method, device, equipment and medium |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPS58130395A (en) | 1982-01-29 | 1983-08-03 | 株式会社東芝 | Vocal section detector |
| DE3370423D1 (en) * | 1983-06-07 | 1987-04-23 | Ibm | Process for activity detection in a voice transmission system |
| US4696040A (en) * | 1983-10-13 | 1987-09-22 | Texas Instruments Incorporated | Speech analysis/synthesis system with energy normalization and silence suppression |
| US4696039A (en) * | 1983-10-13 | 1987-09-22 | Texas Instruments Incorporated | Speech analysis/synthesis system with silence suppression |
| JPS61272796A (en) | 1985-05-28 | 1986-12-03 | 沖電気工業株式会社 | Voice section detection system |
| US4897832A (en) * | 1988-01-18 | 1990-01-30 | Oki Electric Industry Co., Ltd. | Digital speech interpolation system and speech detector |
| JPH02272837A (en) | 1989-04-14 | 1990-11-07 | Oki Electric Ind Co Ltd | Voice section detection system |
| US5305420A (en) * | 1991-09-25 | 1994-04-19 | Nippon Hoso Kyokai | Method and apparatus for hearing assistance with speech speed control function |
| JPH0698398A (en) | 1992-06-25 | 1994-04-08 | Hitachi Ltd | Non-voice section detecting/expanding device/method |
| JPH07129190A (en) * | 1993-09-10 | 1995-05-19 | Hitachi Ltd | Talk speed change method and device and electronic device |
| JPH06266380A (en) * | 1993-03-12 | 1994-09-22 | Toshiba Corp | Speech detecting circuit |
| US5848388A (en) * | 1993-03-25 | 1998-12-08 | British Telecommunications Plc | Speech recognition with sequence parsing, rejection and pause detection options |
| JP2835483B2 (en) | 1993-06-23 | 1998-12-14 | 松下電器産業株式会社 | Voice discrimination device and sound reproduction device |
| JPH0772896A (en) | 1993-09-01 | 1995-03-17 | Sanyo Electric Co Ltd | Device for compressing/expanding sound |
| US5611018A (en) * | 1993-09-18 | 1997-03-11 | Sanyo Electric Co., Ltd. | System for controlling voice speed of an input signal |
| JPH08254992A (en) | 1995-03-17 | 1996-10-01 | Fujitsu Ltd | Speech-speed transformation device |
| JPH08294199A (en) | 1995-04-20 | 1996-11-05 | Hitachi Ltd | Speech speed converter |
| GB2312360B (en) * | 1996-04-12 | 2001-01-24 | Olympus Optical Co | Voice signal coding apparatus |
-
1998
- 1998-04-30 EP EP98917743A patent/EP0944036A4/en not_active Ceased
- 1998-04-30 CA CA002258908A patent/CA2258908C/en not_active Expired - Lifetime
- 1998-04-30 US US09/202,867 patent/US6236970B1/en not_active Expired - Lifetime
- 1998-04-30 EP EP08005875A patent/EP1944753A3/en not_active Withdrawn
- 1998-04-30 CN CN98800566A patent/CN1117343C/en not_active Expired - Lifetime
- 1998-04-30 KR KR1019980710777A patent/KR100302370B1/en not_active IP Right Cessation
- 1998-04-30 EP EP04027925A patent/EP1517299A3/en not_active Withdrawn
- 1998-04-30 WO PCT/JP1998/001984 patent/WO1998049673A1/en not_active Application Discontinuation
- 1998-12-29 NO NO19986172A patent/NO317600B1/en not_active IP Right Cessation
-
2001
- 2001-02-12 US US09/781,634 patent/US6374213B2/en not_active Expired - Lifetime
-
2003
- 2003-03-06 CN CNB031192599A patent/CN1198263C/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| CN1117343C (en) | 2003-08-06 |
| EP1944753A2 (en) | 2008-07-16 |
| NO986172L (en) | 1999-02-19 |
| EP1517299A3 (en) | 2012-08-29 |
| CA2258908A1 (en) | 1998-11-05 |
| US20010010037A1 (en) | 2001-07-26 |
| KR20000022351A (en) | 2000-04-25 |
| EP0944036A4 (en) | 2000-02-23 |
| US6374213B2 (en) | 2002-04-16 |
| EP1517299A2 (en) | 2005-03-23 |
| EP1944753A3 (en) | 2012-08-15 |
| KR100302370B1 (en) | 2001-09-29 |
| CN1225737A (en) | 1999-08-11 |
| EP0944036A1 (en) | 1999-09-22 |
| CN1198263C (en) | 2005-04-20 |
| WO1998049673A1 (en) | 1998-11-05 |
| CN1441403A (en) | 2003-09-10 |
| US6236970B1 (en) | 2001-05-22 |
| NO986172D0 (en) | 1998-12-29 |
| NO317600B1 (en) | 2004-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2258908C (en) | Speech rate conversion without extension of input data duration, using speech interval detection | |
| EP0661689B1 (en) | Noise reducing method, noise reducing apparatus and telephone set | |
| KR100283421B1 (en) | Speech rate conversion method and apparatus | |
| JP4640461B2 (en) | Volume control device and program | |
| JP3875513B2 (en) | Method and apparatus for improving intelligibility of digitally compressed speech | |
| JP2002237785A (en) | Method for detecting sid frame by compensation of human audibility | |
| JP3255584B2 (en) | Sound detection device and method | |
| JP2008504783A (en) | Method and system for automatically adjusting the loudness of an audio signal | |
| EP1008140A1 (en) | Waveform-based periodicity detector | |
| US7058190B1 (en) | Acoustic signal enhancement system | |
| JPH0748695B2 (en) | Speech coding system | |
| JP2010021627A (en) | Device, method, and program for volume control | |
| CA2392849C (en) | Speech interval detecting method and device | |
| JP3413862B2 (en) | Voice section detection method | |
| JP3420831B2 (en) | Bone conduction voice noise elimination device | |
| JP2965788B2 (en) | Audio gain control device and audio recording / reproducing device | |
| JP3081469B2 (en) | Speech speed converter | |
| JP2905112B2 (en) | Environmental sound analyzer | |
| JPH06175693A (en) | Voice detection method | |
| CN112669872B (en) | Audio data gain method and device | |
| JP2546001B2 (en) | Automatic gain control device | |
| CN117953925A (en) | Audio and video non-silence segment detection method, device, equipment and storage medium | |
| JPH0242500A (en) | Digital recording and reproducing device | |
| JP2001282295A (en) | Encoder and encoding method | |
| JPH06140856A (en) | Voice signal processor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKEX | Expiry |
Effective date: 20180430 |