WO2004072767A2 - Audio reproduction apparatus, method, computer program - Google Patents

Audio reproduction apparatus, method, computer program Download PDF

Info

Publication number
WO2004072767A2
WO2004072767A2 PCT/IB2004/050059 IB2004050059W WO2004072767A2 WO 2004072767 A2 WO2004072767 A2 WO 2004072767A2 IB 2004050059 W IB2004050059 W IB 2004050059W WO 2004072767 A2 WO2004072767 A2 WO 2004072767A2
Authority
WO
WIPO (PCT)
Prior art keywords
tempo
audio
input
output
audio signal
Prior art date
Application number
PCT/IB2004/050059
Other languages
French (fr)
Other versions
WO2004072767A3 (en
Inventor
Martin F. Mckinney
Dirk J. Breebaart
Steven L. J. D. E. Van De Par
Ludovic A. J. Van Paepegem
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to JP2006502548A priority Critical patent/JP2006517679A/en
Priority to US10/545,185 priority patent/US7518054B2/en
Priority to CN2004800039576A priority patent/CN1748242B/en
Priority to EP04705874A priority patent/EP1595243A2/en
Publication of WO2004072767A2 publication Critical patent/WO2004072767A2/en
Publication of WO2004072767A3 publication Critical patent/WO2004072767A3/en

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/02Analogue recording or reproducing
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/003Repetitive work cycles; Sequence of movements
    • G09B19/0038Sports
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B69/00Training appliances or apparatus for special sports
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0686Timers, rhythm indicators or pacing apparatus using electric or electronic means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/40Rhythm
    • G10H1/42Rhythm comprising tone forming circuits
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • A63B2071/0625Emitting sound, noise or music
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/04Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A63B2230/06Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2230/00Measuring physiological parameters of the user
    • A63B2230/04Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations
    • A63B2230/06Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only
    • A63B2230/062Measuring physiological parameters of the user heartbeat characteristics, e.g. ECG, blood pressure modulations heartbeat rate only used as a control parameter for the apparatus
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/076Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction of timing, tempo; Beat detection
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/321Garment sensors, i.e. musical control means with trigger surfaces or joint angle sensors, worn as a garment by the player, e.g. bracelet, intelligent clothing
    • G10H2220/336Control shoe or boot, i.e. sensor-equipped lower part of lower limb, e.g. shoe, toe ring, sock, ankle bracelet or leg control attachment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/371Vital parameter control, i.e. musical instrument control based on body signals, e.g. brainwaves, pulsation, temperature, perspiration; biometric information
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/131Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising

Definitions

  • Audio reproduction apparatus method, computer program product
  • the invention relates to an audio reproduction apparatus suitable for use during sports training comprising: an input for inputting an input audio signal; an output for outputting an output audio signal; - a user behavior identification unit capable of providing a data output; and an audio conditioning unit for conditioning the output audio signal dependent on the data output from the user behavior identification unit.
  • the invention further relates to a method for delivering an output audio signal with an output tempo within a predefined deviation from a selected tempo comprising: - inputting an input audio signal; deriving a selected tempo on the basis of a data signal; and delivering based on the input audio signal an output audio signal, with an output tempo within a predefined deviation from the selected tempo.
  • the invention further relates to a computer program product comprising commands enabling a processor to execute the method.
  • the apparatus contains an embodiment of a user behavior identification unit being a gesture input and interpretation module.
  • the gesture input and interpretation module typically analyzes a trajectory of e.g. a mouse movement, the mouse being moved by a user.
  • the known apparatus also contains an audio conditioning unit, called a playback decision module, for selecting from a music database pieces of music with a particular emotional character corresponding to the gesture made. E.g. moving the mouse up and down in an excited way may result in the selection of a piece of music containing drum sounds.
  • One of the available emotional characters that can be used for selection mentioned in the cited document is a selected tempo of the pieces of music.
  • the known document describes another embodiment of the known apparatus which contains a musical instrument digital interface (MIDI) coder.
  • MIDI musical instrument digital interface
  • the user behavior identification unit is a tempo derivation unit for deriving the data output being a selected tempo, on the basis of a data signal
  • the audio conditioning unit comprises a tempo calculation unit arranged to calculate an input tempo of the input audio signal
  • the audio conditioning unit is arranged to deliver the output audio signal with an output tempo within a predefined deviation from the selected tempo, the output signal depending on the input tempo.
  • an excitedness of up and down movement of a mouse can be used for the derivation of an approximate indication of the selected tempo.
  • the selected tempo can be derived much more accurately on the basis of a data signal from e.g. a pace meter on a running shoe.
  • Such tempo measuring devices allow new applications, e.g. in sports. It is known that runners tend to run with a pace corresponding to the tempo of music playing, so an apparatus providing music of the correct tempo to the runner can facilitate his training.
  • the selected tempo is selected by a person doing sports or being engaged in a similar activity, such as a soldier on a march, according to his requirements.
  • the tempo calculation unit is comprised as a key feature of the apparatus according to the invention, to enable the apparatus to determine the input tempo of most types of input audio signal, e.g. real music from a radio or MP3 decoded audio, electronic music, or if required even speech.
  • An embodiment of the audio reproduction apparatus comprises selection means capable of selecting as the input audio signal a piece of audio from an audio source, and the audio conditioning unit is arranged to deliver the output audio signal based on the input audio signal if a condition is met, being: the absolute difference between the selected tempo and the input tempo is below the predefined deviation.
  • the selection means are arranged to search the audio source and select from it different pieces of audio or music as the input audio signal, until a piece of audio or music is found of roughly the selected tempo.
  • the conditioning unit is arranged to send the input audio signal to the output as the output audio signal.
  • the absolute difference condition on the output tempo can be formulated as an absolute difference condition on the input tempo.
  • An advantageous instance of the audio source is a memory containing MP3 encoded audio.
  • a typical memory which may be included in the audio reproduction apparatus, can store hundreds of pieces of music, so a nice training composition can be constructed from them for whichever training session.
  • Another variant of the selection means is arranged to search radio channels to find the correct music.
  • the audio conditioning unit further comprises an audio processing unit, arranged to derive, based upon the input audio signal, the output signal with an output tempo closer to the selected tempo than the input tempo.
  • the audio processing unit may be arranged to apply a tempo adjustment -realized in software or hardware- which offers the option of finetuning or in general adjusting an incorrect tempo of a selected input audio signal from the audio source. This is interesting in case there is not much music available in the audio source with substantially the selected tempo.
  • the audio- processing unit may also be arranged to compensate for tempo variations within a selected piece of music.
  • a simple algorithm for changing the tempo constructs the output audio signal by adding samples of the input signal to a substantially zero output signal, at time instances determined by the selected tempo, and applying an interpolation filter.
  • This algorithm results in a difference of pitch of the input and the output audio signal, which may for large tempo adjustments lead to a cartoon-like reproduction of singing voices, and off key music.
  • Pitch preserving tempo-changing algorithms can be applied in a high quality variant of the advanced variant, as described below for a different embodiment.
  • An alternative embodiment of the audio reproduction apparatus comprises an audio processing unit, arranged to construct, based on the input audio signal, the output audio signal with an output tempo closer to the selected tempo than the input tempo, and with an output pitch substantially equal to an input pitch of the input signal.
  • an audio processing unit it is not necessary to comprise selection means, since each input audio signal can be processed to obtain an output audio signal of roughly the selected tempo.
  • selection means may be present to select the input audio based on different criteria, e.g. by a user.
  • the audio conditioning unit comprises an audio processing unit, arranged to construct, based on the input audio signal, the output audio signal with an output tempo closer to the selected tempo than the input tempo, starting from a substantially zero value output audio signal, by adding input audio segments of consecutive samples of the input audio signal to the output audio signal, at output time instances determined by the ratio between the selected tempo and the input tempo, the input audio segments being selected on the basis of a predefined audio segment similarity criterion, and the samples in the segments being weighed by a predefined weighing function before being added to the output audio signal.
  • pitch corresponds to a short time scale variation of the audio signal, whereas tempo manifests itself on a longer time scale, e.g. a quarter of a second.
  • successive segments of the audio signal are relatively similar -e.g. for a particular audio signal they are similar in each 400 th of a second interval- , a fact of nature which a human ear exploits to determine the pitch.
  • the similar segments in the input audio signal are extracted. They are added to the output audio signal at the required temporal positions.
  • the input audio segments are placed in the output audio signal twice as far apart in time as in the input audio signal.
  • the gaps in between are filled by copying the input audio segments to the output audio signal again, or by adding calculated segments similar to the local input audio segments. Since the neighboring segments are similar, copying more or less of these similar segments to the output audio signal hardly changes the perceptual characteristics of the output audio signal as compared to the input audio signal, apart from the tempo or duration.
  • the weighing is included to make the output audio signal smoother, leading to a reduction in the amount of perceptible artifact.
  • the audio processing unit comprises a local tempo variation unit, arranged to apply between a first input audio segment and a first output audio segment, based on the first input audio segment, a first tempo adjustment with a first tempo change, and to apply between a second input audio segment and a second output audio segment, based on the second input audio segment, a second tempo adjustment with a second tempo change, whereby the first tempo change is different from the second tempo change.
  • the audio reproduction apparatus may further comprise a workout scheme specification unit, arranged to allow a specification of a series of consecutive selected tempos. This enables a user to specify an entire workout scheme, only as a set of tempos, so that the actual music played can still be varied according to his desire.
  • the specification may be done during the exercise or at home on a p.c. and downloaded to the apparatus. Other people than the user may also contribute to the specification.
  • the second object is realized in that the method is characterized in that an input tempo of the input audio signal is calculated, and the output signal is delivered in dependence of the input tempo.
  • Fig. 1 schematically shows the audio reproduction apparatus according to the invention
  • Fig. 2 schematically shows an embodiment of an audio-conditioning unit
  • Fig. 3 introduces the nomenclature used for characterizing the meter of a piece of music
  • Fig. 4a and 4b schematically shows an example embodiment of a tempo calculation unit
  • Fig. 5 schematically shows the signal processing of a particular pitch preserving tempo changing algorithm
  • Fig. 6a and 6b shows two example workout specifications; In these Figures elements drawn dashed are optional, depending on the desired embodiment.
  • Fig. 1 shows an audio reproduction apparatus 100 with an input 101 for inputting an input audio signal i, and an output 102 for outputting an output audio signal o, typically derived from the input audio signal.
  • the audio reproduction apparatus is intended for sports training or similar activity and comprises a tempo derivation unit 103 for deriving a selected tempo T on the basis of a data signal dl, d2, d3.
  • the audio reproduction apparatus 100 may e.g. be portable, connectable to a wearable sports measurement device or may be attached to a fitness apparatus. E.g. a runner may wear a sports shoe containing a pace meter 134, which measures the runner's pace i.e. how many steps are taken each second, e.g.
  • the acceleration sensor may transmit a number representing the pace as a first data signal dl to the tempo derivation unit.103.
  • the tempo derivation unit 103 may be arranged to perform the computation of the pace based on an incoming first data signal dl comprising the acceleration timeline.
  • the tempo derivation unit 103 may be arranged to calculate a selected tempo T based on the measured runner's pace, according to a selection strategy.
  • the selected tempo can be set equal to or within a predefined interval of the pace.
  • the runner can then listen to music of an output tempo substantially equal to his pace, which makes his running easier.
  • the pace can e.g.
  • an average pace can be determined as a baseline. If the runner then runs uphill for a short time, the selected tempo and hence the output tempo is not adjusted, so that the music motivates him to keep running at the same pace.
  • a desired training level can be set.
  • a heart rate meter 132 on a step machine in a fitness center may be transmitting the heart rate of a user exercising to the tempo derivation unit 103.
  • a desired heart rate is set on the step machine.
  • fast music is played.
  • the user can then fasten his step according to the output tempo of the music.
  • the desired heart rate may come in as a second data signal d2 together with the actual heart rate of a user at a time instance, or they may be two different data signals into the tempo derivation unit 103.
  • the user can also specify a selected tempo T by means of a user input 130 as a third data signal d3.
  • Other measurement devices characterizing sports activities may also be used, such as e.g. an oxymeter, a breathing analyser, or the onboard computer of a training apparatus which e.g. sends as a data signal the speed of a rolling carpet.
  • a workout scheme specification unit 180 may also be present, which is arranged to allow a user to specify a series of consecutive selected tempo's T according to his desire, formulating an exercise schedule for successive time intervals.
  • the user wants to start training with slow warm up music, then likes to continue with ten minutes strenuous exercise requiring music of a fast tempo, and ending with slow music for cool down and relaxation purposes.
  • synchronization means 182 are connected to the workout scheme specification unit 180, e.g. a wired or wireless connection to a master server or another similar audio reproduction apparatus, group training or training games in which a first user selects the selected tempo for a second user become possible.
  • the selection means may comprise a connection to an Internet server on which a personal trainer has stored a daily training profile.
  • an audio conditioning unit 104 is arranged to deliver based on the input audio signal i the output audio signal o, with an output tempo TO within a predefined deviation d from the selected tempo T.
  • the input audio signal i originates from an audio source of audio pieces, which may be e.g. a radio receiver, but advantageously may be a database of music pieces in the audio reproduction apparatus, such as a memory containing compressed audio files, or a CD reader.
  • a tempo calculation unit 106 is arranged to calculate an input tempo TI of the input audio signal i.
  • the audio conditioning unit 104 may be configured to transmit the input signal i as the output signal o to the output 102.
  • the tempo calculation unit 106 is arranged to send a control signal over a first control connection 154 to a switch 152. If the input audio signal is of roughly the desired selected tempo the switch 152 is closed and otherwise it is open.
  • the output 102 may be connected to a sound production means 122, such as a loudspeaker, or advantageously headphones.
  • An embodiment of the audio reproduction apparatus 100 comprises selection means 150 which is arranged to select individual pieces audio from the audio source 120.
  • the selection means 150 may e.g.
  • a memory 160 may be comprised, which contains a table of indices of audio pieces from the audio database and corresponding input tempo's TI, which table may typically be enlarged each time a piece of audio is loaded as an input signal and its tempo is calculated by the tempo calculation unit 106.
  • the advantage of such a table is that an audio piece of substantially the correct input tempo TI can immediately be selected, instead of having to go through and analyze all the audio pieces sequentially each time.
  • the audio source 120 may comprise a set of versions of the same song or audio piece with different tempos. This is interesting for a variant of the audio reproduction apparatus 100, which is only arranged to select input audio of substantially the desired tempo and is not arranged to change the tempo of a selected piece of audio.
  • a song may then be processed to obtain 10 versions of different tempo -e.g. on a p.c.-, which are then downloaded into the audio source 120 of e.g. a portable solid state MP3 or CD player.
  • a fallback audio setting unit 190 detecting the state of the switch 152 by means of detecting means 194, may furnish the output audio signal o, by temporarily supplying e.g. a default audio piece or the previous audio piece.
  • the fallback audio setting unit 190 may comprise an artificial audio generator 192 arranged to temporarily create an artificial output audio signal o, such as a sequence of audio segments containing a drum beat, or a sequence of electronic beeps.
  • Another embodiment may additionally or alternatively comprise an audio processing unit 108, arranged to construct the output audio signal o with an output tempo TO being roughly the selected tempo T, i.e. within the deviation d of the selected tempo T, on the basis of the input signal i.
  • an audio processing unit 108 arranged to construct the output audio signal o with an output tempo TO being roughly the selected tempo T, i.e. within the deviation d of the selected tempo T, on the basis of the input signal i.
  • the audio reproduction apparatus it may be realized as a hardware circuit or as a method running as software on a processor.
  • a first possible way to derive an output audio signal o similar to the input audio signal i but of changed tempo samples the input signal, places the samples in the output signal at a different intersample distance, and interpolates and/or filters.
  • a number of successive samples of the input audio signal is used to determine an output audio sample, e.g. by means of model prediction.
  • pitch-preserving tempo changing algorithms may also be employed by the audio -processing unit 108, such as the one described with the aid of Fig. 5.
  • the audio processing unit 108 may typically need the input tempo TI and the selected tempo T, or their ratio, which can be sent over a tempo connection 140 as a signal, coded number or any equivalent well known from prior art.
  • Tempo adjustment between the input audio signal and the output audio signal may occur without selection of an input audio signal with a particular tempo, hence e.g. with a fixed input audio signal, or in combination with input audio signal selection e.g.
  • the value of the predefined deviation d for selection may be larger than for tempo adjustment. In the first case it limits the number of songs that can be chosen from the audio database, whereas in the second case it is a tolerance on the tempo adjustment accuracy.
  • Fig. 2 schematically shows an embodiment of an audio -conditioning unit 104, in which the dashed components may or may not be present in different configurations.
  • An input tempo calculation part 200 is drawn explicitly, which is arranged to apply e.g. the algoritlim explained by means of Fig. 4 to obtain the input tempo TI.
  • a tempo comparator 202 is arranged to compare the calculated input tempo TI with the selected tempo T, and to send a "next audio piece" signal over the selection means 150 if their absolute difference is outside the predefined deviation d range, or by means of another tempo heuristic.
  • control signal of the first control connection 154 is also sent over the selection means 150 by the tempo comparator 202, but this may be implemented with a different connection.
  • the tempo comparator 202 may also be arranged to send the input tempo TI and the selected tempo T over the tempo connection 140 in case tempo adjustment by the audio processing unit is required as a result of a decision strategy evaluation of the tempo comparator 202.
  • the audio-processing unit 210 may also comprise a local tempo variation unit
  • the local tempo variation unit 210 is arranged to apply between a first input audio segment and a first output audio segment, based on the first input audio segment, a first tempo adjustment with a first tempo change, and to apply between a second input audio segment and a second output audio segment, based on the second input audio segment, a second tempo adjustment with a second tempo change, whereby the first tempo change is different from the second tempo change.
  • the adjustment can also be made by re-processing certain parts of the output audio signal after a global tempo adjustment. Especially for particular types of music, e.g. stretching single notes played on e.g.
  • the local tempo variation unit 210 may perform automatic analysis to detect whether particular instruments are present and in which time segments. It may also be arranged to check for tags indicating that there are notes played by particular instruments at particular times.
  • Fig. 3 introduces the nomenclature used for characterizing the meter of a piece of music.
  • the meter is the hierarchy of time instances of particular events that describes a particular piece of music.
  • An event is e.g. the playing of a note or the stressing of a note.
  • the lowest level 306 is called the tatum, and coincides with the playing of single notes. Note detection is starting point of atypical tempo calculator.
  • the second level 304 is the level of the beat or tactus.
  • the number of beats per minutes is a measure of tempo. It is identified by marking stress notes. Stress can be applied to a note e.g. by playing it louder or by a number of other variations such as pitch variations, temporal shifts, etc.
  • the highest level 302 shown is the measure or bar.
  • Fig. 4a schematically shows an example embodiment 400 of a tempo calculation part 200. It proves favorable for accurate tempo calculation to split an audio signal in multiple frequency bands by means of filters 402, 404, 406. These filters 402, 404, 406 are also designed to assure that the calculation occurs at the time scale of the tempo and not the time scale of the pitch.
  • the filtered signal is rectified by means of rectifiers 410, 412, 414 and the spatial difference signal is calculated by means of differentiators 420, 422, 424. Further rectifiers 430, 432, 434 are present so that only the increasing slope differences are retained. Correlators 440, 442, 444 are present to evaluate the periodicity of the rectifier difference pulses.
  • Fig. 4b schematically shows what the audio signal looks like in a third processing branch 484, namely a filtered signal 460 behind a third filter 406 and a rectified difference signal 470 behind a sixth rectifier 434.
  • Fig. 5 schematically shows the signal processing of a particular pitch preserving tempo changing algorithm, in a case in which the input tempo TI is twice the selected tempo T.
  • the fundamental idea is that audio consists of repetitive patterns, hence if similar patterns are inserted in between, a longer stretch of audio is obtained without significant alteration of the other perceptible characteristics of the audio, and in particular the pitch. Similarly, if a shorter duration audio signal is required, some of the numerous similar patterns can be dropped.
  • a first input segment 530 and a second input segment 532 are similar, as can be verified with a number of different similarity criteria.
  • the output audio signal o can be constructed digitally by first setting all required samples equal to zero.
  • the samples of the first input segment 530 at a first input time instance 510 are copied to a first output time instance 520 to obtain a first output audio segment 540.
  • the second input segment is drawn a little larger, symbolizing that the amplitude of an envelope of the input audio signal is slowly rising. Since for a tempo halving the amplitude variation of the output audio signal should be twice as slow, the second input segment 532 is copied to a third output time instance 524 to obtain a third output audio segment 544. There is no input data for a second output time instance 522.
  • a second output audio segment 542 is constructed based on a weighed combination of samples from e.g. the first and second input audio segment 530 resp. 532, e.g. by means of equation 1:
  • the output audio signal y(k) is synthesized at all discrete times k, by overlap, at a discrete number of synthesis time instances -enumerated by i and positioned a temporal distance D apart- of audio segments excised from the input audio signal x. It is further assumed in equation [6] that both the excised and synthesized audio segments are weighted by the same weighing function w.
  • X (iD) is the analysis time instance corresponding to a synthesis time instance iD, where excision of a audio segment from the input audio signal has to occur.
  • Fig. 6a shows an example of a temporal workout specification 600 which can be specified by a user and stored in memory in the workout scheme specification unit 180, if required together with additional data such as e.g. the name of the user, the date etc.
  • the workout scheme specification unit 180 is then arranged to send a tempo to the audio conditioning unit 104 at a corresponding time instance.
  • the temporal workout specification 600 comprises a consecutive set of specified time intervals, such as a first time interval 602 for warming up, and corresponding desired selected tempos, such as a first selected tempo 630.
  • the audio reproduction apparatus 100 may be in a mode which adapts itself to the user's performance on short time scales rather than to use a fixed temporal workout specification, a user may want to deviate at certain instances of time from the desired selected tempo for the particular time interval without the audio reproduction apparatus 100 updating the current selected tempo in the temporal workout specification 600.
  • the workout scheme specification unit 180 may be arranged to allow the specification of tolerances, such as tolerance 620.
  • the tolerances may be formulated e.g. as a lower and upper deviation from the desired selected tempo for the associated time interval and/or as a time interval during which the deviation of the current selected tempo T corresponding to e.g. the runner's pace may deviate from the desired selected tempo for the current time interval in the temporal workout specification 600 by an arbitrary amount. This is handy e.g. when the user has to discontinue running because of a red traffic light.
  • Fig. 6b shows an alternative workout specification 650, which may be advantageous in case the audio reproduction apparatus contains a display, a map of the neighborhood in memory, and localization means such as a global positioning system (GPS) unit.
  • the user can then e.g. draw intervals such as a first spatial interval 670 on a representation of a first street 660, and a second spatial interval 672 on a representation of a second street 662, and specify corresponding tempos.
  • the selected tempo is equal to a first value, etc.
  • the computer program product should be understood any physical realization of a collection of commands enabling a processor -generic or special purpose-, after a series of loading steps to get the commands into the processor, to execute any of the characteristic functions disclosed in the present invention.
  • the computer program product may be realized as data on a carrier such as e.g. a disk or tape, data present in a memory, data traveling over a network connection -wired or wireless- , or program code on paper.
  • the invention can be implemented by means of hardware or by means of software running on a computer, and previously stored on a data carrier or transmitted over a signal transmission system.

Abstract

The audio reproduction apparatus (100) for sports training purposes comprises a tempo derivation unit (103) for deriving a selected tempo (T) on the basis of a data signal (dl, d2, d3) e.g. from a sports measurement device such as a heart rate meter; and an audio conditioning unit (104) arranged to deliver based on the input audio signal the output audio signal, with a tempo within a predefined accepted deviation from the selected tempo (T), whereby the audio conditioning unit (104) comprises a tempo calculation unit (106) arranged to calculate an input tempo (TI) of the input audio signal, and the audio conditioning unit (104) is arranged to deliver the output signal in dependence of the input tempo (TI).

Description

Audio reproduction apparatus, method, computer program product
The invention relates to an audio reproduction apparatus suitable for use during sports training comprising: an input for inputting an input audio signal; an output for outputting an output audio signal; - a user behavior identification unit capable of providing a data output; and an audio conditioning unit for conditioning the output audio signal dependent on the data output from the user behavior identification unit.
The invention further relates to a method for delivering an output audio signal with an output tempo within a predefined deviation from a selected tempo comprising: - inputting an input audio signal; deriving a selected tempo on the basis of a data signal; and delivering based on the input audio signal an output audio signal, with an output tempo within a predefined deviation from the selected tempo.
The invention further relates to a computer program product comprising commands enabling a processor to execute the method.
A variant of such an apparatus is known from US2001/0035087-A. The apparatus contains an embodiment of a user behavior identification unit being a gesture input and interpretation module. In the known apparatus, the gesture input and interpretation module typically analyzes a trajectory of e.g. a mouse movement, the mouse being moved by a user. The known apparatus also contains an audio conditioning unit, called a playback decision module, for selecting from a music database pieces of music with a particular emotional character corresponding to the gesture made. E.g. moving the mouse up and down in an excited way may result in the selection of a piece of music containing drum sounds. One of the available emotional characters that can be used for selection mentioned in the cited document is a selected tempo of the pieces of music.
It is a disadvantage of the known apparatus that it is not flexible. Pieces of music have to be tagged in advance by a person, the tag describing the emotional character of the piece of music, which severely limits the number of available pieces of music which can be used with the known apparatus. If the gestures are used to compose a composition of music pieces, it will not sound very beautiful if there is only a limited set to choose from. Furthermore a tag typically specifies a tempo in a vague manner, such as: the tempo is "fast", "very fast", "slow" or "excited". An additional problem of the known apparatus is that each piece of music has a fixed tempo, as noted in its tag. Attempting to solve this problem, the known document describes another embodiment of the known apparatus which contains a musical instrument digital interface (MIDI) coder. A MIDI signal of a known tempo can be recoded to a new tempo. However the fact that this only applies to electronic music is again a flexibility limitation.
It is a first object of the invention to provide an apparatus of the kind mentioned in the opening paragraph which is relatively flexible as to the types of input audio signal, e.g. music, that can be used as input to deliver an output audio signal of substantially the selected tempo.
It is a second object to provide a method of the kind mentioned in the opening paragraph which is relatively flexible as to the types of input audio signal, e.g. music, that can be used as input to deliver an output audio signal of substantially the selected tempo. The first object is realized in that the user behavior identification unit is a tempo derivation unit for deriving the data output being a selected tempo, on the basis of a data signal; the audio conditioning unit comprises a tempo calculation unit arranged to calculate an input tempo of the input audio signal; and - the audio conditioning unit is arranged to deliver the output audio signal with an output tempo within a predefined deviation from the selected tempo, the output signal depending on the input tempo.
When analyzing user gestures, an excitedness of up and down movement of a mouse can be used for the derivation of an approximate indication of the selected tempo. However the selected tempo can be derived much more accurately on the basis of a data signal from e.g. a pace meter on a running shoe. Such tempo measuring devices allow new applications, e.g. in sports. It is known that runners tend to run with a pace corresponding to the tempo of music playing, so an apparatus providing music of the correct tempo to the runner can facilitate his training. In general, in the apparatus according to the invention, the selected tempo is selected by a person doing sports or being engaged in a similar activity, such as a soldier on a march, according to his requirements.
The tempo calculation unit is comprised as a key feature of the apparatus according to the invention, to enable the apparatus to determine the input tempo of most types of input audio signal, e.g. real music from a radio or MP3 decoded audio, electronic music, or if required even speech.
An embodiment of the audio reproduction apparatus according to the invention comprises selection means capable of selecting as the input audio signal a piece of audio from an audio source, and the audio conditioning unit is arranged to deliver the output audio signal based on the input audio signal if a condition is met, being: the absolute difference between the selected tempo and the input tempo is below the predefined deviation. The selection means are arranged to search the audio source and select from it different pieces of audio or music as the input audio signal, until a piece of audio or music is found of roughly the selected tempo. Once the condition is met, in a simple variant of the embodiment, the conditioning unit is arranged to send the input audio signal to the output as the output audio signal. Since in this case the output signal is the input signal, the absolute difference condition on the output tempo can be formulated as an absolute difference condition on the input tempo. An advantageous instance of the audio source is a memory containing MP3 encoded audio. Nowadays a typical memory, which may be included in the audio reproduction apparatus, can store hundreds of pieces of music, so a nice training composition can be constructed from them for whichever training session. Another variant of the selection means is arranged to search radio channels to find the correct music.
In an advanced variant of the embodiment, the audio conditioning unit further comprises an audio processing unit, arranged to derive, based upon the input audio signal, the output signal with an output tempo closer to the selected tempo than the input tempo. The audio processing unit may be arranged to apply a tempo adjustment -realized in software or hardware- which offers the option of finetuning or in general adjusting an incorrect tempo of a selected input audio signal from the audio source. This is interesting in case there is not much music available in the audio source with substantially the selected tempo. The audio- processing unit may also be arranged to compensate for tempo variations within a selected piece of music. A simple algorithm for changing the tempo constructs the output audio signal by adding samples of the input signal to a substantially zero output signal, at time instances determined by the selected tempo, and applying an interpolation filter. This algorithm results in a difference of pitch of the input and the output audio signal, which may for large tempo adjustments lead to a cartoon-like reproduction of singing voices, and off key music. Pitch preserving tempo-changing algorithms can be applied in a high quality variant of the advanced variant, as described below for a different embodiment.
An alternative embodiment of the audio reproduction apparatus according to the invention comprises an audio processing unit, arranged to construct, based on the input audio signal, the output audio signal with an output tempo closer to the selected tempo than the input tempo, and with an output pitch substantially equal to an input pitch of the input signal. By incorporating such an audio processing unit, it is not necessary to comprise selection means, since each input audio signal can be processed to obtain an output audio signal of roughly the selected tempo. Of course selection means may be present to select the input audio based on different criteria, e.g. by a user.
In a specific variant of the alternative embodiment, the audio conditioning unit comprises an audio processing unit, arranged to construct, based on the input audio signal, the output audio signal with an output tempo closer to the selected tempo than the input tempo, starting from a substantially zero value output audio signal, by adding input audio segments of consecutive samples of the input audio signal to the output audio signal, at output time instances determined by the ratio between the selected tempo and the input tempo, the input audio segments being selected on the basis of a predefined audio segment similarity criterion, and the samples in the segments being weighed by a predefined weighing function before being added to the output audio signal. The idea behind this algorithm is that pitch corresponds to a short time scale variation of the audio signal, whereas tempo manifests itself on a longer time scale, e.g. a quarter of a second. On the short time scale successive segments of the audio signal are relatively similar -e.g. for a particular audio signal they are similar in each 400th of a second interval- , a fact of nature which a human ear exploits to determine the pitch. By means of the predefined audio segment similarity criterion, the similar segments in the input audio signal are extracted. They are added to the output audio signal at the required temporal positions. E.g. if the output tempo is half as fast as the input tempo, the input audio segments are placed in the output audio signal twice as far apart in time as in the input audio signal. The gaps in between are filled by copying the input audio segments to the output audio signal again, or by adding calculated segments similar to the local input audio segments. Since the neighboring segments are similar, copying more or less of these similar segments to the output audio signal hardly changes the perceptual characteristics of the output audio signal as compared to the input audio signal, apart from the tempo or duration. The weighing is included to make the output audio signal smoother, leading to a reduction in the amount of perceptible artifact.
It is advantageous if the audio processing unit comprises a local tempo variation unit, arranged to apply between a first input audio segment and a first output audio segment, based on the first input audio segment, a first tempo adjustment with a first tempo change, and to apply between a second input audio segment and a second output audio segment, based on the second input audio segment, a second tempo adjustment with a second tempo change, whereby the first tempo change is different from the second tempo change.
E.g., by slowing the duration of some notes, e.g. played on a trumpet, more than the duration of notes in their the temporal environment, an additional suggestion of slowness can be simulated, which is advantageous for obtaining relaxing music.
The audio reproduction apparatus may further comprise a workout scheme specification unit, arranged to allow a specification of a series of consecutive selected tempos. This enables a user to specify an entire workout scheme, only as a set of tempos, so that the actual music played can still be varied according to his desire. The specification may be done during the exercise or at home on a p.c. and downloaded to the apparatus. Other people than the user may also contribute to the specification.
The second object is realized in that the method is characterized in that an input tempo of the input audio signal is calculated, and the output signal is delivered in dependence of the input tempo.
These and other aspects of the audio reproduction apparatus according to the invention will be apparent from and elucidated with reference to the implementations and embodiments described hereinafter, and with reference to the accompanying drawings, which serve merely as non-limiting illustrations.
In the drawings :
Fig. 1 schematically shows the audio reproduction apparatus according to the invention;
Fig. 2 schematically shows an embodiment of an audio-conditioning unit; Fig. 3 introduces the nomenclature used for characterizing the meter of a piece of music;
Fig. 4a and 4b schematically shows an example embodiment of a tempo calculation unit; Fig. 5 schematically shows the signal processing of a particular pitch preserving tempo changing algorithm; and
Fig. 6a and 6b shows two example workout specifications; In these Figures elements drawn dashed are optional, depending on the desired embodiment.
Fig. 1 shows an audio reproduction apparatus 100 with an input 101 for inputting an input audio signal i, and an output 102 for outputting an output audio signal o, typically derived from the input audio signal. The audio reproduction apparatus is intended for sports training or similar activity and comprises a tempo derivation unit 103 for deriving a selected tempo T on the basis of a data signal dl, d2, d3. The audio reproduction apparatus 100 may e.g. be portable, connectable to a wearable sports measurement device or may be attached to a fitness apparatus. E.g. a runner may wear a sports shoe containing a pace meter 134, which measures the runner's pace i.e. how many steps are taken each second, e.g. based on an acceleration sensor or a deformation sensor. E.g., based on an acceleration timeline the acceleration sensor may transmit a number representing the pace as a first data signal dl to the tempo derivation unit.103. Alternatively, the tempo derivation unit 103 may be arranged to perform the computation of the pace based on an incoming first data signal dl comprising the acceleration timeline. The tempo derivation unit 103 may be arranged to calculate a selected tempo T based on the measured runner's pace, according to a selection strategy. E.g. the selected tempo can be set equal to or within a predefined interval of the pace. The runner can then listen to music of an output tempo substantially equal to his pace, which makes his running easier. The pace can e.g. be measured at a number of time instances and an average pace can be determined as a baseline. If the runner then runs uphill for a short time, the selected tempo and hence the output tempo is not adjusted, so that the music motivates him to keep running at the same pace.
In an alternative tempo selection strategy, a desired training level can be set. E.g. a heart rate meter 132 on a step machine in a fitness center may be transmitting the heart rate of a user exercising to the tempo derivation unit 103. A desired heart rate is set on the step machine. As long as the actual heart rate of the user is below the desired heart rate, for a predefined interval of time to take into account adaptations in the heart rate of the user to increased exercise load conditions, fast music is played. The user can then fasten his step according to the output tempo of the music. The desired heart rate may come in as a second data signal d2 together with the actual heart rate of a user at a time instance, or they may be two different data signals into the tempo derivation unit 103. The user can also specify a selected tempo T by means of a user input 130 as a third data signal d3. Other measurement devices characterizing sports activities may also be used, such as e.g. an oxymeter, a breathing analyser, or the onboard computer of a training apparatus which e.g. sends as a data signal the speed of a rolling carpet.
A workout scheme specification unit 180 may also be present, which is arranged to allow a user to specify a series of consecutive selected tempo's T according to his desire, formulating an exercise schedule for successive time intervals. E.g. the user wants to start training with slow warm up music, then likes to continue with ten minutes strenuous exercise requiring music of a fast tempo, and ending with slow music for cool down and relaxation purposes. If synchronization means 182 are connected to the workout scheme specification unit 180, e.g. a wired or wireless connection to a master server or another similar audio reproduction apparatus, group training or training games in which a first user selects the selected tempo for a second user become possible. E.g. the selection means may comprise a connection to an Internet server on which a personal trainer has stored a daily training profile.
Given the selected tempo T, an audio conditioning unit 104 is arranged to deliver based on the input audio signal i the output audio signal o, with an output tempo TO within a predefined deviation d from the selected tempo T. The input audio signal i originates from an audio source of audio pieces, which may be e.g. a radio receiver, but advantageously may be a database of music pieces in the audio reproduction apparatus, such as a memory containing compressed audio files, or a CD reader. A tempo calculation unit 106 is arranged to calculate an input tempo TI of the input audio signal i. If a condition is met, being the absolute difference between the selected tempo T and the input tempo TI is below the predefined deviation d, the audio conditioning unit 104 may be configured to transmit the input signal i as the output signal o to the output 102. In a simple realization, the tempo calculation unit 106 is arranged to send a control signal over a first control connection 154 to a switch 152. If the input audio signal is of roughly the desired selected tempo the switch 152 is closed and otherwise it is open. The output 102 may be connected to a sound production means 122, such as a loudspeaker, or advantageously headphones.
If the absolute difference between the selected tempo T and the input tempo TI is above the predefined deviation d, the input audio signal does not conform to the user's likings as expressed in the selected tempo T, and some action has to be taken by the audio conditioning unit 104. Otherwise, in the simple realization the user hears no output audio as long as the condition is not met, since the switch 152 is open. The switch could be forced closed, but then music of the wrong output tempo is outputted. An embodiment of the audio reproduction apparatus 100 comprises selection means 150 which is arranged to select individual pieces audio from the audio source 120. The selection means 150 may e.g. be realized as a data connection or bus to the audio source 120, transmitting a "next song" commando or an index of a song, in case the input tempo TI is incorrect. The selection process continues until an audio piece of substantially the selected tempo is found. Instead of calculating the input tempo TI of a piece of audio on the fly, a memory 160 (see Fig. 2) may be comprised, which contains a table of indices of audio pieces from the audio database and corresponding input tempo's TI, which table may typically be enlarged each time a piece of audio is loaded as an input signal and its tempo is calculated by the tempo calculation unit 106. The advantage of such a table is that an audio piece of substantially the correct input tempo TI can immediately be selected, instead of having to go through and analyze all the audio pieces sequentially each time. The audio source 120 may comprise a set of versions of the same song or audio piece with different tempos. This is interesting for a variant of the audio reproduction apparatus 100, which is only arranged to select input audio of substantially the desired tempo and is not arranged to change the tempo of a selected piece of audio. A song may then be processed to obtain 10 versions of different tempo -e.g. on a p.c.-, which are then downloaded into the audio source 120 of e.g. a portable solid state MP3 or CD player.
While the selection means are searching for the correct song, and the condition is not met, a fallback audio setting unit 190 detecting the state of the switch 152 by means of detecting means 194, may furnish the output audio signal o, by temporarily supplying e.g. a default audio piece or the previous audio piece. The fallback audio setting unit 190 may comprise an artificial audio generator 192 arranged to temporarily create an artificial output audio signal o, such as a sequence of audio segments containing a drum beat, or a sequence of electronic beeps.
Another embodiment may additionally or alternatively comprise an audio processing unit 108, arranged to construct the output audio signal o with an output tempo TO being roughly the selected tempo T, i.e. within the deviation d of the selected tempo T, on the basis of the input signal i. Like all the functional components of the audio reproduction apparatus it may be realized as a hardware circuit or as a method running as software on a processor. A first possible way to derive an output audio signal o similar to the input audio signal i but of changed tempo, samples the input signal, places the samples in the output signal at a different intersample distance, and interpolates and/or filters. In a variant, a number of successive samples of the input audio signal is used to determine an output audio sample, e.g. by means of model prediction. Those algorithms in general introduce a perceptible change in pitch. Hence pitch-preserving tempo changing algorithms may also be employed by the audio -processing unit 108, such as the one described with the aid of Fig. 5. In order to realize the tempo adjustment, the audio processing unit 108 may typically need the input tempo TI and the selected tempo T, or their ratio, which can be sent over a tempo connection 140 as a signal, coded number or any equivalent well known from prior art. Tempo adjustment between the input audio signal and the output audio signal may occur without selection of an input audio signal with a particular tempo, hence e.g. with a fixed input audio signal, or in combination with input audio signal selection e.g. to correct for small deviations of the input tempo TI from the selected tempo T for the output audio signal o. Note that the value of the predefined deviation d for selection may be larger than for tempo adjustment. In the first case it limits the number of songs that can be chosen from the audio database, whereas in the second case it is a tolerance on the tempo adjustment accuracy.
Fig. 2 schematically shows an embodiment of an audio -conditioning unit 104, in which the dashed components may or may not be present in different configurations. An input tempo calculation part 200 is drawn explicitly, which is arranged to apply e.g. the algoritlim explained by means of Fig. 4 to obtain the input tempo TI. A tempo comparator 202 is arranged to compare the calculated input tempo TI with the selected tempo T, and to send a "next audio piece" signal over the selection means 150 if their absolute difference is outside the predefined deviation d range, or by means of another tempo heuristic. Note that in the drawn example of this embodiment the control signal of the first control connection 154 is also sent over the selection means 150 by the tempo comparator 202, but this may be implemented with a different connection. The tempo comparator 202 may also be arranged to send the input tempo TI and the selected tempo T over the tempo connection 140 in case tempo adjustment by the audio processing unit is required as a result of a decision strategy evaluation of the tempo comparator 202. The audio-processing unit 210 may also comprise a local tempo variation unit
210, arranged to apply an alternative tempo adjustment for selected local time segments of the output audio signal. In other words, the local tempo variation unit 210 is arranged to apply between a first input audio segment and a first output audio segment, based on the first input audio segment, a first tempo adjustment with a first tempo change, and to apply between a second input audio segment and a second output audio segment, based on the second input audio segment, a second tempo adjustment with a second tempo change, whereby the first tempo change is different from the second tempo change. The adjustment can also be made by re-processing certain parts of the output audio signal after a global tempo adjustment. Especially for particular types of music, e.g. stretching single notes played on e.g. a brass instrument in relation to the tempo of the rest of the song, can give the music an even slower impression. This can be interesting during the relaxation part after training. The local tempo variation unit 210 may perform automatic analysis to detect whether particular instruments are present and in which time segments. It may also be arranged to check for tags indicating that there are notes played by particular instruments at particular times.
Fig. 3 introduces the nomenclature used for characterizing the meter of a piece of music. The meter is the hierarchy of time instances of particular events that describes a particular piece of music. An event is e.g. the playing of a note or the stressing of a note. The lowest level 306 is called the tatum, and coincides with the playing of single notes. Note detection is starting point of atypical tempo calculator. The second level 304 is the level of the beat or tactus. The number of beats per minutes is a measure of tempo. It is identified by marking stress notes. Stress can be applied to a note e.g. by playing it louder or by a number of other variations such as pitch variations, temporal shifts, etc. The highest level 302 shown is the measure or bar.
Fig. 4a schematically shows an example embodiment 400 of a tempo calculation part 200. It proves favorable for accurate tempo calculation to split an audio signal in multiple frequency bands by means of filters 402, 404, 406. These filters 402, 404, 406 are also designed to assure that the calculation occurs at the time scale of the tempo and not the time scale of the pitch. The filtered signal is rectified by means of rectifiers 410, 412, 414 and the spatial difference signal is calculated by means of differentiators 420, 422, 424. Further rectifiers 430, 432, 434 are present so that only the increasing slope differences are retained. Correlators 440, 442, 444 are present to evaluate the periodicity of the rectifier difference pulses. Analysis logic combines these periodicities, leading to a most probable tatum prediction and looks for stress patterns in the tatum pattern, finally leading to the tempo. A particular variant using oscillators for analyzing the periodicity is described in "Eric D. Scheirer: Tempo and beat analysis of acoustic musical signals. Journal of the acoustic Society of America 103, no. 1, 1998, pp. 588-601.". Fig. 4b schematically shows what the audio signal looks like in a third processing branch 484, namely a filtered signal 460 behind a third filter 406 and a rectified difference signal 470 behind a sixth rectifier 434.
Fig. 5 schematically shows the signal processing of a particular pitch preserving tempo changing algorithm, in a case in which the input tempo TI is twice the selected tempo T. The fundamental idea is that audio consists of repetitive patterns, hence if similar patterns are inserted in between, a longer stretch of audio is obtained without significant alteration of the other perceptible characteristics of the audio, and in particular the pitch. Similarly, if a shorter duration audio signal is required, some of the numerous similar patterns can be dropped.
A first input segment 530 and a second input segment 532 are similar, as can be verified with a number of different similarity criteria. The output audio signal o can be constructed digitally by first setting all required samples equal to zero. The samples of the first input segment 530 at a first input time instance 510 are copied to a first output time instance 520 to obtain a first output audio segment 540. The second input segment is drawn a little larger, symbolizing that the amplitude of an envelope of the input audio signal is slowly rising. Since for a tempo halving the amplitude variation of the output audio signal should be twice as slow, the second input segment 532 is copied to a third output time instance 524 to obtain a third output audio segment 544. There is no input data for a second output time instance 522. But the output audio segment residing there should be similar to the first and the second output audio segment 540 resp. 544. Hence a second output audio segment 542 is constructed based on a weighed combination of samples from e.g. the first and second input audio segment 530 resp. 532, e.g. by means of equation 1:
Figure imgf000013_0001
In equation [1], the output audio signal y(k) is synthesized at all discrete times k, by overlap, at a discrete number of synthesis time instances -enumerated by i and positioned a temporal distance D apart- of audio segments excised from the input audio signal x. It is further assumed in equation [6] that both the excised and synthesized audio segments are weighted by the same weighing function w. X (iD) is the analysis time instance corresponding to a synthesis time instance iD, where excision of a audio segment from the input audio signal has to occur. However, when adding an excised audio segment to a part of the output audio signal already synthesized, one has to be careful that an excised audio segment from the input audio signal resembles closely an audio segment which is expected to follow the part of the output audio signal already synthesized. Therefore a small offset Δ, is introduced, which allows for excision of an audio segment at a slightly different discrete time than τ"1 (iD) .
Fig. 6a shows an example of a temporal workout specification 600 which can be specified by a user and stored in memory in the workout scheme specification unit 180, if required together with additional data such as e.g. the name of the user, the date etc. The workout scheme specification unit 180 is then arranged to send a tempo to the audio conditioning unit 104 at a corresponding time instance. The temporal workout specification 600 comprises a consecutive set of specified time intervals, such as a first time interval 602 for warming up, and corresponding desired selected tempos, such as a first selected tempo 630. If the audio reproduction apparatus 100 is in a mode which adapts itself to the user's performance on short time scales rather than to use a fixed temporal workout specification, a user may want to deviate at certain instances of time from the desired selected tempo for the particular time interval without the audio reproduction apparatus 100 updating the current selected tempo in the temporal workout specification 600. This is handy e.g. when he is running uphill for a short time. To achieve this, the workout scheme specification unit 180 may be arranged to allow the specification of tolerances, such as tolerance 620. The tolerances may be formulated e.g. as a lower and upper deviation from the desired selected tempo for the associated time interval and/or as a time interval during which the deviation of the current selected tempo T corresponding to e.g. the runner's pace may deviate from the desired selected tempo for the current time interval in the temporal workout specification 600 by an arbitrary amount. This is handy e.g. when the user has to discontinue running because of a red traffic light.
Fig. 6b shows an alternative workout specification 650, which may be advantageous in case the audio reproduction apparatus contains a display, a map of the neighborhood in memory, and localization means such as a global positioning system (GPS) unit. The user can then e.g. draw intervals such as a first spatial interval 670 on a representation of a first street 660, and a second spatial interval 672 on a representation of a second street 662, and specify corresponding tempos. As long as the user is running in the first street, the selected tempo is equal to a first value, etc.
Under computer program product should be understood any physical realization of a collection of commands enabling a processor -generic or special purpose-, after a series of loading steps to get the commands into the processor, to execute any of the characteristic functions disclosed in the present invention. In particular the computer program product may be realized as data on a carrier such as e.g. a disk or tape, data present in a memory, data traveling over a network connection -wired or wireless- , or program code on paper.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art are able to design alternatives, without departing from the scope of the claims. Apart from combinations of elements of the invention as combined in the claims, other combinations of the elements within the scope of the invention as perceived by one skilled in the art are covered by the invention. Any combination of elements can be realized in a single dedicated element. Any reference sign between parentheses in the claim is not intended for limiting the claim. The word
"comprising" does not exclude the presence of elements or aspects not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.
The invention can be implemented by means of hardware or by means of software running on a computer, and previously stored on a data carrier or transmitted over a signal transmission system.

Claims

CLAIMS:
1. An audio reproduction apparatus (100) suitable for use during sports training comprising: an input (101) for inputting an input audio signal (i); an output (102) for outputting an output audio signal (o); - a user behavior identification unit capable of providing a data output; and an audio conditioning unit (104) for conditioning the output audio signal (o) dependent on the data output from the user behavior identification unit, characterized in that: the user behavior identification unit is a tempo derivation unit (103) for deriving the data output being a selected tempo (T), on the basis of a data signal (dl, d2, d3); the audio conditioning unit (104) comprises a tempo calculation unit (106) arranged to calculate an input tempo (TI) of the input audio signal (i); and the audio conditioning unit (104) is arranged to deliver the output audio signal (o) with an output tempo (TO) within a predefined deviation (d) from the selected tempo (T), the output signal (o) depending on the input tempo (TI).
2. An audio reproduction apparatus (100) as claimed in claim 1, comprising selection means (150) capable of selecting as the input audio signal (i) a piece of audio from an audio source (120), and wherein the audio conditioning unit (104) is arranged to deliver the output audio signal (o) based on the input audio signal (i) if a condition is met, being: the absolute difference between the selected tempo (T) and the input tempo (TI) is below the predefined deviation (d).
3. An audio reproduction apparatus (100) as claimed in claim 2, wherein the audio conditioning unit (104) further comprises an audio processing unit (108), arranged to derive, based upon the input audio signal (i), the output signal (o) with an output tempo (TO) closer to the selected tempo (T) than the input tempo (TI).
4. An audio reproduction apparatus (100) as claimed in claim 1, wherein the audio conditioning unit (104) comprises an audio processing unit (108), arranged to construct, based on the input audio signal (i), the output audio signal (o) with an output tempo (TO) closer to the selected tempo (T) than the input tempo (TI), and with an output pitch substantially equal to an input pitch of the input signal (i).
5. An audio reproduction apparatus (100) as claimed in claim 4, wherein the audio processing unit (108) is arranged to construct the output audio signal (o) by starting from a substantially zero value output audio signal (o), adding input audio segments of consecutive samples of the input audio signal (i) to the output audio signal (o), at output time instances determined by the ratio between the selected tempo (T) and the input tempo (TI), the input audio segments being selected on the basis of a predefined audio segment similarity criterion, - and the samples in the segments being weighed by a predefined weighing function before being added to the output audio signal (o).
6. An audio reproduction apparatus (100) as claimed in claim 3 or 4, wherein the audio processing unit (108) comprises a local tempo variation unit (210), arranged to apply between a first input audio segment and a first output audio segment, based on the first input audio segment, a first tempo adjustment with a first tempo change, and to apply between a second input audio segment and a second output audio segment, based on the second input audio segment, a second tempo adjustment with a second tempo change, whereby the first tempo change is different from the second tempo change.
7. An audio reproduction apparatus (100) as claimed in claim 1, comprising a workout scheme specification unit (180), arranged to allow a specification of a series of consecutive selected tempos (T).
8. A method for delivering an output audio signal with an output tempo (TO) within a predefined deviation (d) from a selected tempo (T) comprising: inputting an input audio signal (i); deriving a selected tempo (T) on the basis of a data signal (dl, d2, d3); and delivering based on the input audio signal (i) an output audio signal (o), with an output tempo (TO) within a predefined deviation from the selected tempo (T), characterized in that an input tempo (TI) of the input audio signal (i) is calculated, and the output signal (o) is delivered in dependence of the input tempo (TI).
9. A computer program product comprising commands enabling a processor to execute the method of claim 8.
PCT/IB2004/050059 2003-02-12 2004-01-28 Audio reproduction apparatus, method, computer program WO2004072767A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2006502548A JP2006517679A (en) 2003-02-12 2004-01-28 Audio playback apparatus, method, and computer program
US10/545,185 US7518054B2 (en) 2003-02-12 2004-01-28 Audio reproduction apparatus, method, computer program
CN2004800039576A CN1748242B (en) 2003-02-12 2004-01-28 Audio reproduction apparatus, method, computer program
EP04705874A EP1595243A2 (en) 2003-02-12 2004-01-28 Audio reproduction apparatus, method, computer program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP03100307.2 2003-02-12
EP03100307 2003-02-12

Publications (2)

Publication Number Publication Date
WO2004072767A2 true WO2004072767A2 (en) 2004-08-26
WO2004072767A3 WO2004072767A3 (en) 2004-10-14

Family

ID=32865033

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2004/050059 WO2004072767A2 (en) 2003-02-12 2004-01-28 Audio reproduction apparatus, method, computer program

Country Status (6)

Country Link
US (1) US7518054B2 (en)
EP (1) EP1595243A2 (en)
JP (1) JP2006517679A (en)
KR (1) KR100981691B1 (en)
CN (1) CN1748242B (en)
WO (1) WO2004072767A2 (en)

Cited By (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1533784A2 (en) * 2003-11-20 2005-05-25 Sony Corporation Playback mode control device and method
WO2005082471A1 (en) * 2004-02-19 2005-09-09 Koninklijke Philips Electronics, N.V. Audio interval training device
WO2005082472A1 (en) * 2004-02-19 2005-09-09 Koninklijke Philips Electronics, N.V. Audio pacing device
EP1657721A2 (en) * 2004-11-16 2006-05-17 Sony Corporation Music content reproduction apparatus, method thereof and recording apparatus
WO2006085237A1 (en) 2005-02-14 2006-08-17 Koninklijke Philips Electronics N.V. Electronic device and method for selecting content items
WO2006085236A2 (en) * 2005-02-14 2006-08-17 Koninklijke Philips Electronics N.V. Electronic device and method for reproducing a human perceptual signal
WO2006085287A2 (en) * 2005-02-11 2006-08-17 Koninklijke Philips Electronics, N.V. Automatic personal play list generation based on dynamically changing criteria such as light intensity or vehicle speed and location
JP2006337505A (en) * 2005-05-31 2006-12-14 Sony Corp Musical player and processing control method
JP2007058048A (en) * 2005-08-26 2007-03-08 Sony Corp Information processing apparatus and information processing method, and program
WO2007042329A1 (en) 2005-10-13 2007-04-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Controlling reproduction of audio data
EP1796098A2 (en) 2005-12-06 2007-06-13 Sony Corporation Apparatus and method for reproducing audio signal
JP2007149218A (en) * 2005-11-28 2007-06-14 Sharp Corp Retrieving and reproducing apparatus
EP1804235A1 (en) * 2004-10-18 2007-07-04 Sony Corporation Content reproducing method and content reproducing device
EP1811496A2 (en) * 2006-01-20 2007-07-25 Yamaha Corporation Apparatus for controlling music reproduction and apparatus for reproducing music
EP1818841A2 (en) 2006-02-13 2007-08-15 Sony Corporation Method and device for content reproduction list generation
EP1845517A2 (en) * 2006-04-12 2007-10-17 Sony Corporation Retrieving and selecting content and content playback and search
EP1850318A2 (en) * 2006-04-25 2007-10-31 Nintendo Co., Ltd. Storage medium having music playing program stored therein and music playing apparatus thereof
EP1852154A1 (en) * 2005-02-03 2007-11-07 Sony Corporation Sound reproducing device, sound reproducing method, and sound reproducing program
EP1973113A1 (en) * 2006-01-13 2008-09-24 Sony Corporation Contents reproducing device, contents reproducing method, and program
WO2008129443A2 (en) * 2007-04-20 2008-10-30 Koninklijke Philips Electronics N.V. Audio playing system and method
WO2009003890A1 (en) * 2007-06-29 2009-01-08 Swirlnet A/S A method and an apparatus for providing information to a user
US7952013B2 (en) 2006-01-12 2011-05-31 Sony Corporation Contents reproducer and reproduction method for selecting content to be reproduced based on a moving tempo and tempo informaiton for the content
EP2336954A1 (en) * 2009-12-18 2011-06-22 ISW Industrie- Service und Warenhandelsgesellschaft mbH Training aid
CN1905004B (en) * 2005-07-27 2011-07-06 索尼株式会社 Audio-signal generation device
US8030564B2 (en) 2006-07-03 2011-10-04 Sony Corporation Method for selecting and recommending content, server, content playback apparatus, content recording apparatus, and recording medium storing computer program for selecting and recommending content
US8727947B2 (en) * 2007-02-16 2014-05-20 Nike, Inc. Real-time comparison of athletic information
WO2016005853A1 (en) * 2014-07-07 2016-01-14 Leila Benedicte Habiche Device for practising sport activities
EP3109595A1 (en) * 2004-12-17 2016-12-28 NIKE Innovate C.V. Multi-sensor monitoring of athletic performance where the playbackspeed of a media content depends upon gps data
US9662560B2 (en) 2006-09-07 2017-05-30 Nike, Inc. Athletic performance sensing and/or tracking systems and methods
US11955219B2 (en) 2022-05-04 2024-04-09 Nike, Inc. Athletic performance sensing and/or tracking systems and methods

Families Citing this family (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL130818A (en) * 1999-07-06 2005-07-25 Intercure Ltd Interventive-diagnostic device
EP1538970B1 (en) * 2002-08-09 2020-06-17 Intercure Ltd. Generalized metronome for modification of biorhythmic activity
US8672852B2 (en) 2002-12-13 2014-03-18 Intercure Ltd. Apparatus and method for beneficial modification of biorhythmic activity
US7236154B1 (en) 2002-12-24 2007-06-26 Apple Inc. Computer light adjustment
US7480512B2 (en) 2004-01-16 2009-01-20 Bones In Motion, Inc. Wireless device, program products and methods of using a wireless device to deliver services
US7805149B2 (en) * 2004-01-16 2010-09-28 Adidas Ag Location-aware fitness training device, methods, and program products that support real-time interactive communication and automated route generation
US7616097B1 (en) 2004-07-12 2009-11-10 Apple Inc. Handheld devices as visual indicators
US7894177B2 (en) 2005-12-29 2011-02-22 Apple Inc. Light activated hold switch
US7521623B2 (en) * 2004-11-24 2009-04-21 Apple Inc. Music synchronization arrangement
JP4650662B2 (en) * 2004-03-23 2011-03-16 ソニー株式会社 Signal processing apparatus, signal processing method, program, and recording medium
JP4581476B2 (en) * 2004-05-11 2010-11-17 ソニー株式会社 Information processing apparatus and method, and program
KR20070048201A (en) 2004-07-23 2007-05-08 인터큐어 엘티디 Apparatus and method for breathing pattern determination using a non-contact microphone
US20070189544A1 (en) * 2005-01-15 2007-08-16 Outland Research, Llc Ambient sound responsive media player
US7603414B2 (en) * 2005-09-09 2009-10-13 Outland Research, Llc System, method and computer program product for collaborative background music among portable communication devices
US7542816B2 (en) * 2005-01-27 2009-06-02 Outland Research, Llc System, method and computer program product for automatically selecting, suggesting and playing music media files
US20070156676A1 (en) * 2005-09-09 2007-07-05 Outland Research, Llc System, Method and Computer Program Product for Intelligent Groupwise Media Selection
US7562117B2 (en) * 2005-09-09 2009-07-14 Outland Research, Llc System, method and computer program product for collaborative broadcast media
US20070276870A1 (en) * 2005-01-27 2007-11-29 Outland Research, Llc Method and apparatus for intelligent media selection using age and/or gender
US20070213110A1 (en) * 2005-01-28 2007-09-13 Outland Research, Llc Jump and bob interface for handheld media player devices
US7567847B2 (en) * 2005-08-08 2009-07-28 International Business Machines Corporation Programmable audio system
JP2007075172A (en) * 2005-09-12 2007-03-29 Sony Corp Sound output control device, method and program
US8176101B2 (en) * 2006-02-07 2012-05-08 Google Inc. Collaborative rejection of media for physical establishments
US7825319B2 (en) * 2005-10-06 2010-11-02 Pacing Technologies Llc System and method for pacing repetitive motion activities
US20130228063A1 (en) * 2005-10-06 2013-09-05 William D. Turner System and method for pacing repetitive motion activities
US20110072955A1 (en) * 2005-10-06 2011-03-31 Turner William D System and method for pacing repetitive motion activities
US7586032B2 (en) * 2005-10-07 2009-09-08 Outland Research, Llc Shake responsive portable media player
US7683252B2 (en) * 2005-11-23 2010-03-23 Microsoft Corporation Algorithm for providing music to influence a user's exercise performance
US20070075127A1 (en) * 2005-12-21 2007-04-05 Outland Research, Llc Orientation-based power conservation for portable media devices
JP2007226935A (en) * 2006-01-24 2007-09-06 Sony Corp Audio reproducing device, audio reproducing method, and audio reproducing program
JP4672613B2 (en) * 2006-08-09 2011-04-20 株式会社河合楽器製作所 Tempo detection device and computer program for tempo detection
TW200820225A (en) * 2006-10-25 2008-05-01 Taiwan Chest Disease Ass Home-based exercise tranining method and system guided by automatically assessment and selecting music
JP4306754B2 (en) * 2007-03-27 2009-08-05 ヤマハ株式会社 Music data automatic generation device and music playback control device
US7956274B2 (en) * 2007-03-28 2011-06-07 Yamaha Corporation Performance apparatus and storage medium therefor
JP4311466B2 (en) * 2007-03-28 2009-08-12 ヤマハ株式会社 Performance apparatus and program for realizing the control method
US8330034B2 (en) * 2007-07-06 2012-12-11 Anthony LaBarbera Musical instrument with system and methods for actuating designated accompaniment sounds
US8702430B2 (en) * 2007-08-17 2014-04-22 Adidas International Marketing B.V. Sports electronic training system, and applications thereof
US8269093B2 (en) 2007-08-21 2012-09-18 Apple Inc. Method for creating a beat-synchronized media mix
US7766794B2 (en) * 2007-11-02 2010-08-03 Microsoft Corporation Mobile exercise enhancement with virtual competition
JP2009151107A (en) * 2007-12-20 2009-07-09 Yoshikazu Itami Sound producing device using physical information
US20100188405A1 (en) * 2009-01-28 2010-07-29 Apple Inc. Systems and methods for the graphical representation of the workout effectiveness of a playlist
DE102009015273A1 (en) 2009-04-01 2010-10-14 Albert-Ludwigs-Universität Freiburg Method and device for determining the endurance performance of a subject
US8033959B2 (en) 2009-05-18 2011-10-11 Adidas Ag Portable fitness monitoring systems, and applications thereof
US8200323B2 (en) 2009-05-18 2012-06-12 Adidas Ag Program products, methods, and systems for providing fitness monitoring services
US8105208B2 (en) 2009-05-18 2012-01-31 Adidas Ag Portable fitness monitoring systems with displays and applications thereof
US20110015765A1 (en) * 2009-07-15 2011-01-20 Apple Inc. Controlling an audio and visual experience based on an environment
US7952012B2 (en) * 2009-07-20 2011-05-31 Apple Inc. Adjusting a variable tempo of an audio file independent of a global tempo using a digital audio workstation
EP2389992A1 (en) * 2010-05-26 2011-11-30 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Training apparatus with musical feedback
US10039970B2 (en) 2010-07-14 2018-08-07 Adidas Ag Location-aware fitness monitoring methods, systems, and program products, and applications thereof
US8493822B2 (en) 2010-07-14 2013-07-23 Adidas Ag Methods, systems, and program products for controlling the playback of music
US9392941B2 (en) 2010-07-14 2016-07-19 Adidas Ag Fitness monitoring methods, systems, and program products, and applications thereof
FR2963689A1 (en) * 2010-08-04 2012-02-10 Michael Stephen Herve Digital music listening device for use at time of sporting practice i.e. race, has audio headset/ear-phones reproducing selected bit of music from music file database, and accelerometer capturing movement signal of runner
CN102064832B (en) * 2010-11-11 2013-09-18 广东欧珀移动通信有限公司 Implementation method for changing vibration effect with music
US8319087B2 (en) * 2011-03-30 2012-11-27 Google Inc. System and method for dynamic, feature-based playlist generation
US20120258433A1 (en) 2011-04-05 2012-10-11 Adidas Ag Fitness Monitoring Methods, Systems, And Program Products, And Applications Thereof
JP2013208266A (en) * 2012-03-30 2013-10-10 Sony Corp Pacemaker apparatus, operation method thereof, and program
US9183822B2 (en) * 2012-05-23 2015-11-10 Google Inc. Music selection and adaptation for exercising
CN103489451B (en) * 2012-06-13 2016-11-23 百度在线网络技术(北京)有限公司 The method of speech processing of mobile terminal and mobile terminal
DE102012210098A1 (en) * 2012-06-15 2013-12-19 Robert Bosch Gmbh Method for selecting music in smart phone used for motivating jogger during sport activity, involves detecting current state or movement state of person controlled by individual movement unit immediately
US20140338516A1 (en) * 2013-05-19 2014-11-20 Michael J. Andri State driven media playback rate augmentation and pitch maintenance
US9269341B1 (en) * 2013-06-30 2016-02-23 Second Wind Technologies, Inc. Method for processing music to match runners tempo
GB2518663A (en) * 2013-09-27 2015-04-01 Nokia Corp Audio analysis apparatus
CN103714824B (en) * 2013-12-12 2017-06-16 小米科技有限责任公司 A kind of audio-frequency processing method, device and terminal device
CN105989823B (en) * 2015-02-03 2020-02-18 中国移动通信集团四川有限公司 Automatic following and shooting accompaniment method and device
US10372757B2 (en) 2015-05-19 2019-08-06 Spotify Ab Search media content based upon tempo
US10055413B2 (en) 2015-05-19 2018-08-21 Spotify Ab Identifying media content
US9978426B2 (en) * 2015-05-19 2018-05-22 Spotify Ab Repetitive-motion activity enhancement based upon media content selection
US9563268B2 (en) 2015-05-19 2017-02-07 Spotify Ab Heart rate control based upon media content selection
CN105118517B (en) * 2015-06-29 2019-01-15 努比亚技术有限公司 A kind of device and method adjusting music rhythm
CN105761714B (en) * 2016-04-26 2019-08-20 南京丰生永康软件科技有限责任公司 A kind of system that heartbeat signal is converted into music
US10984035B2 (en) 2016-06-09 2021-04-20 Spotify Ab Identifying media content
US11113346B2 (en) 2016-06-09 2021-09-07 Spotify Ab Search media content based upon tempo
US9880805B1 (en) 2016-12-22 2018-01-30 Brian Howard Guralnick Workout music playback machine
US20180218204A1 (en) * 2017-01-31 2018-08-02 Stephen Phillip Kasmir Systems and methods for synchronizing timing between an individual leader and one or more people
US11040246B2 (en) 2018-02-06 2021-06-22 Adidas Ag Increasing accuracy in workout autodetection systems and methods
JP2020106753A (en) * 2018-12-28 2020-07-09 ローランド株式会社 Information processing device and video processing system
US11364419B2 (en) * 2019-02-21 2022-06-21 Scott B. Radow Exercise equipment with music synchronization
KR20220128131A (en) * 2021-03-12 2022-09-20 삼성전자주식회사 Electronic device and method for controlling the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998020482A1 (en) 1996-11-07 1998-05-14 Creative Technology Ltd. Time-domain time/pitch scaling of speech or audio signals, with transient handling
JP2001299980A (en) 2000-04-21 2001-10-30 Mitsubishi Electric Corp Motion support device

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5137501A (en) * 1987-07-08 1992-08-11 Mertesdorf Frank L Process and device for supporting fitness training by means of music
US5215468A (en) * 1991-03-11 1993-06-01 Lauffer Martha A Method and apparatus for introducing subliminal changes to audio stimuli
US5235761A (en) 1991-10-03 1993-08-17 Chang Che Yuan Multiple-purpose elastic shoe
US5267942A (en) * 1992-04-20 1993-12-07 Utah State University Foundation Method for influencing physiological processes through physiologically interactive stimuli
US5629491A (en) * 1995-03-29 1997-05-13 Yamaha Corporation Tempo control apparatus
JPH09325798A (en) * 1996-06-06 1997-12-16 Matsushita Electric Ind Co Ltd Voice recognizing device
JPH1063265A (en) * 1996-08-16 1998-03-06 Casio Comput Co Ltd Automatic playing device
JP3451900B2 (en) * 1997-09-22 2003-09-29 ヤマハ株式会社 Pitch / tempo conversion method and device
US6336891B1 (en) 1997-12-08 2002-01-08 Real Vision Corporation Interactive exercise pad system
JP3546755B2 (en) * 1999-05-06 2004-07-28 ヤマハ株式会社 Method and apparatus for companding time axis of rhythm sound source signal
JP3465628B2 (en) * 1999-05-06 2003-11-10 ヤマハ株式会社 Method and apparatus for time axis companding of audio signal
JP4300641B2 (en) * 1999-08-10 2009-07-22 ヤマハ株式会社 Time axis companding method and apparatus for multitrack sound source signal
US7183480B2 (en) 2000-01-11 2007-02-27 Yamaha Corporation Apparatus and method for detecting performer's motion to interactively control performance of music or the like
JP3654117B2 (en) * 2000-03-13 2005-06-02 ヤマハ株式会社 Expansion and contraction method of musical sound waveform signal in time axis direction
US20010035087A1 (en) 2000-04-18 2001-11-01 Morton Subotnick Interactive music playback system utilizing gestures
JP4581190B2 (en) * 2000-06-19 2010-11-17 ヤマハ株式会社 Music signal time axis companding method and apparatus
AU2001276865A1 (en) 2000-07-10 2002-01-21 Edward H. Hagey Portable electronic percussion instrument
JP3789326B2 (en) * 2000-07-31 2006-06-21 松下電器産業株式会社 Tempo extraction device, tempo extraction method, tempo extraction program, and recording medium
US7478047B2 (en) 2000-11-03 2009-01-13 Zoesis, Inc. Interactive character system
US7032178B1 (en) * 2001-03-30 2006-04-18 Gateway Inc. Tagging content for different activities
JP3947959B2 (en) * 2001-10-02 2007-07-25 カシオ計算機株式会社 Song data delivery apparatus and song data delivery method
JP4067372B2 (en) * 2002-09-27 2008-03-26 クラリオン株式会社 Exercise assistance device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998020482A1 (en) 1996-11-07 1998-05-14 Creative Technology Ltd. Time-domain time/pitch scaling of speech or audio signals, with transient handling
JP2001299980A (en) 2000-04-21 2001-10-30 Mitsubishi Electric Corp Motion support device

Cited By (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1533784A3 (en) * 2003-11-20 2005-09-28 Sony Corporation Playback mode control device and method
EP1533784A2 (en) * 2003-11-20 2005-05-25 Sony Corporation Playback mode control device and method
US7544880B2 (en) 2003-11-20 2009-06-09 Sony Corporation Playback mode control device and playback mode control method
US8376911B2 (en) 2004-02-19 2013-02-19 Koninklijke Philips Electronics N.V. Audio interval training device
WO2005082472A1 (en) * 2004-02-19 2005-09-09 Koninklijke Philips Electronics, N.V. Audio pacing device
US8808144B2 (en) 2004-02-19 2014-08-19 Koninklijke Philips N.V. Audio pacing device
US8608621B2 (en) 2004-02-19 2013-12-17 Koninklijke Philips N.V. Audio pacing device
WO2005082471A1 (en) * 2004-02-19 2005-09-09 Koninklijke Philips Electronics, N.V. Audio interval training device
KR101203492B1 (en) 2004-02-19 2012-11-21 코닌클리케 필립스 일렉트로닉스 엔.브이. Audio pacing device
CN101057273B (en) * 2004-10-18 2011-04-20 索尼株式会社 Content reproducing method and content reproducing device
EP1804235A4 (en) * 2004-10-18 2009-07-08 Sony Corp Content reproducing method and content reproducing device
US8358906B2 (en) 2004-10-18 2013-01-22 Sony Corporation Content playback method and content playback apparatus
USRE47948E1 (en) 2004-10-18 2020-04-14 Sony Corporation Content playback method and content playback apparatus
EP1804235A1 (en) * 2004-10-18 2007-07-04 Sony Corporation Content reproducing method and content reproducing device
EP1657721A2 (en) * 2004-11-16 2006-05-17 Sony Corporation Music content reproduction apparatus, method thereof and recording apparatus
US8017852B2 (en) 2004-11-16 2011-09-13 Sony Corporation Music content reproduction apparatus, method thereof and recording apparatus
EP1657721A3 (en) * 2004-11-16 2006-07-05 Sony Corporation Music content reproduction apparatus, method thereof and recording apparatus
EP1818935A1 (en) * 2004-11-16 2007-08-15 Sony Corporation Music content reproduction apparatus, method thereof and recording apparatus
US10668324B2 (en) 2004-12-17 2020-06-02 Nike, Inc. Multi-sensor monitoring of athletic performance
US9833660B2 (en) 2004-12-17 2017-12-05 Nike, Inc. Multi-sensor monitoring of athletic performance
US11071889B2 (en) 2004-12-17 2021-07-27 Nike, Inc. Multi-sensor monitoring of athletic performance
US11590392B2 (en) 2004-12-17 2023-02-28 Nike, Inc. Multi-sensor monitoring of athletic performance
EP3109595A1 (en) * 2004-12-17 2016-12-28 NIKE Innovate C.V. Multi-sensor monitoring of athletic performance where the playbackspeed of a media content depends upon gps data
US9937381B2 (en) 2004-12-17 2018-04-10 Nike, Inc. Multi-sensor monitoring of athletic performance
US10022589B2 (en) 2004-12-17 2018-07-17 Nike, Inc. Multi-sensor monitoring of athletic performance
US10328309B2 (en) 2004-12-17 2019-06-25 Nike, Inc. Multi-sensor monitoring of athletic performance
EP1852154A1 (en) * 2005-02-03 2007-11-07 Sony Corporation Sound reproducing device, sound reproducing method, and sound reproducing program
EP1852154A4 (en) * 2005-02-03 2014-07-09 Sony Corp Sound reproducing device, sound reproducing method, and sound reproducing program
WO2006085287A2 (en) * 2005-02-11 2006-08-17 Koninklijke Philips Electronics, N.V. Automatic personal play list generation based on dynamically changing criteria such as light intensity or vehicle speed and location
WO2006085287A3 (en) * 2005-02-11 2006-10-26 Koninkl Philips Electronics Nv Automatic personal play list generation based on dynamically changing criteria such as light intensity or vehicle speed and location
US20080254946A1 (en) * 2005-02-14 2008-10-16 Koninklijke Philips Electronics, N.V. Electronic Device and Method for Reproducing a Human Perceptual Signal
JP2008530678A (en) * 2005-02-14 2008-08-07 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Electronic device and method for selecting content items
US10741218B2 (en) 2005-02-14 2020-08-11 Koninklijke Philips N.V. Electronic device and method for reproducing a human perceptual signal
WO2006085237A1 (en) 2005-02-14 2006-08-17 Koninklijke Philips Electronics N.V. Electronic device and method for selecting content items
KR101370322B1 (en) * 2005-02-14 2014-03-05 코닌클리케 필립스 엔.브이. Electronic device and method for reproducing a human perceptual signal
WO2006085236A2 (en) * 2005-02-14 2006-08-17 Koninklijke Philips Electronics N.V. Electronic device and method for reproducing a human perceptual signal
US11465032B2 (en) 2005-02-14 2022-10-11 Koninklijke Philips N.V. Electronic device and method for reproducing a human perceptual signal
WO2006085236A3 (en) * 2005-02-14 2006-11-02 Koninkl Philips Electronics Nv Electronic device and method for reproducing a human perceptual signal
JP2008535532A (en) * 2005-02-14 2008-09-04 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Electronic device and method for reproducing human sensing signals
JP2006337505A (en) * 2005-05-31 2006-12-14 Sony Corp Musical player and processing control method
CN1905004B (en) * 2005-07-27 2011-07-06 索尼株式会社 Audio-signal generation device
JP2007058048A (en) * 2005-08-26 2007-03-08 Sony Corp Information processing apparatus and information processing method, and program
WO2007042329A1 (en) 2005-10-13 2007-04-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Controlling reproduction of audio data
JP2007149218A (en) * 2005-11-28 2007-06-14 Sharp Corp Retrieving and reproducing apparatus
EP1796098A3 (en) * 2005-12-06 2007-08-08 Sony Corporation Apparatus and method for reproducing audio signal
EP1796098A2 (en) 2005-12-06 2007-06-13 Sony Corporation Apparatus and method for reproducing audio signal
US7449627B2 (en) 2005-12-06 2008-11-11 Sony Corporation Apparatus and method for reproducing audio signal
US7952013B2 (en) 2006-01-12 2011-05-31 Sony Corporation Contents reproducer and reproduction method for selecting content to be reproduced based on a moving tempo and tempo informaiton for the content
EP1973113A4 (en) * 2006-01-13 2010-04-07 Sony Corp Contents reproducing device, contents reproducing method, and program
EP1973113A1 (en) * 2006-01-13 2008-09-24 Sony Corporation Contents reproducing device, contents reproducing method, and program
KR100868600B1 (en) * 2006-01-20 2008-11-13 야마하 가부시키가이샤 Apparatus for controlling music reproduction and apparatus for reproducing music
EP1811496A2 (en) * 2006-01-20 2007-07-25 Yamaha Corporation Apparatus for controlling music reproduction and apparatus for reproducing music
US7737353B2 (en) 2006-01-20 2010-06-15 Yamaha Corporation Apparatus for controlling music reproduction and apparatus for reproducing music
EP1811496A3 (en) * 2006-01-20 2008-01-23 Yamaha Corporation Apparatus for controlling music reproduction and apparatus for reproducing music
US7521624B2 (en) 2006-02-13 2009-04-21 Sony Corporation Content reproduction list generation device, content reproduction list generation method, and program-recorded recording medium
EP1818841A2 (en) 2006-02-13 2007-08-15 Sony Corporation Method and device for content reproduction list generation
JP2007242215A (en) * 2006-02-13 2007-09-20 Sony Corp Content reproduction list generation device, content reproduction list generation method, and program-recorded recording medium
EP1818841A3 (en) * 2006-02-13 2007-11-14 Sony Corporation Method and device for content reproduction list generation
EP1845517A3 (en) * 2006-04-12 2009-06-03 Sony Corporation Retrieving and selecting content and content playback and search
EP1845517A2 (en) * 2006-04-12 2007-10-17 Sony Corporation Retrieving and selecting content and content playback and search
EP1850318B1 (en) * 2006-04-25 2012-08-08 Nintendo Co., Ltd. Storage medium having music playing program stored therein and music playing apparatus thereof
EP1850318A2 (en) * 2006-04-25 2007-10-31 Nintendo Co., Ltd. Storage medium having music playing program stored therein and music playing apparatus thereof
US8030564B2 (en) 2006-07-03 2011-10-04 Sony Corporation Method for selecting and recommending content, server, content playback apparatus, content recording apparatus, and recording medium storing computer program for selecting and recommending content
EP2602007B1 (en) * 2006-09-07 2018-05-23 NIKE Innovate C.V. Athletic performance sensing and/or tracking system
US9662560B2 (en) 2006-09-07 2017-05-30 Nike, Inc. Athletic performance sensing and/or tracking systems and methods
US9403058B2 (en) 2007-02-16 2016-08-02 Nike, Inc. Real-time comparison of athletic information
US8727947B2 (en) * 2007-02-16 2014-05-20 Nike, Inc. Real-time comparison of athletic information
WO2008129443A3 (en) * 2007-04-20 2008-12-18 Koninkl Philips Electronics Nv Audio playing system and method
WO2008129443A2 (en) * 2007-04-20 2008-10-30 Koninklijke Philips Electronics N.V. Audio playing system and method
WO2009003890A1 (en) * 2007-06-29 2009-01-08 Swirlnet A/S A method and an apparatus for providing information to a user
EP2336954A1 (en) * 2009-12-18 2011-06-22 ISW Industrie- Service und Warenhandelsgesellschaft mbH Training aid
US10220289B2 (en) 2014-07-07 2019-03-05 Leila Benedicte Habiche Device for practicing sport activities
WO2016005853A1 (en) * 2014-07-07 2016-01-14 Leila Benedicte Habiche Device for practising sport activities
US11955219B2 (en) 2022-05-04 2024-04-09 Nike, Inc. Athletic performance sensing and/or tracking systems and methods

Also Published As

Publication number Publication date
CN1748242B (en) 2010-12-01
KR20050107425A (en) 2005-11-11
EP1595243A2 (en) 2005-11-16
US20070044641A1 (en) 2007-03-01
CN1748242A (en) 2006-03-15
US7518054B2 (en) 2009-04-14
JP2006517679A (en) 2006-07-27
WO2004072767A3 (en) 2004-10-14
KR100981691B1 (en) 2010-09-14

Similar Documents

Publication Publication Date Title
US7518054B2 (en) Audio reproduction apparatus, method, computer program
US7741554B2 (en) Apparatus and method for automatically creating music piece data
US9767777B1 (en) Music selection and adaptation for exercising
KR101370322B1 (en) Electronic device and method for reproducing a human perceptual signal
KR101333024B1 (en) Electronic device and method for selecting content items
US8269092B2 (en) Musical content reproducing device and musical content reproducing method
US7247786B2 (en) Song selection apparatus and method
US20130228063A1 (en) System and method for pacing repetitive motion activities
CN104460982A (en) Presenting audio based on biometrics parameters
CN104395953A (en) Evaluation of beats, chords and downbeats from a musical audio signal
US20090019994A1 (en) Method and system for determining a measure of tempo ambiguity for a music input signal
CN104978962A (en) Query by humming method and system
CN101002985A (en) Apparatus for controlling music reproduction and apparatus for reproducing music
CA2852762A1 (en) Method and system for modifying a media according to a physical performance of a user
JP5195137B2 (en) Exercise music creation device, exercise music creation method, and exercise music creation program
JP2007250053A (en) Contents reproducing device and contents reproducing method
Rubisch et al. A mobile music concept as support for achieving target heart rate in preventive and recreational endurance training
JP5181978B2 (en) Distribution apparatus, distribution method, and distribution program
JP5359811B2 (en) Mobile motion audio information generation device, mobile motion audio information distribution device, mobile motion audio information generation method, mobile motion audio information distribution method, mobile motion audio information generation program, and mobile motion audio information distribution program
JP2010079069A (en) Delivery device, delivery method, and program for delivery
CN115171729B (en) Audio quality determination method and device, electronic equipment and storage medium
JP2009237406A (en) Device for creating music for exercise, method for creating music for exercise and program for creating music for exercise
JP4108850B2 (en) Method for estimating standard calorie consumption by singing and karaoke apparatus
JP2009237408A (en) Device for creating music for exercise, method for creating music for exercise and program for creating music for exercise
JP2009237407A (en) Device for creating music for exercise, method for creating music for exercise and program for creating music for exercise

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004705874

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006502548

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 1858/CHENP/2005

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 20048039576

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 1020057014917

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 1020057014917

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2004705874

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007044641

Country of ref document: US

Ref document number: 10545185

Country of ref document: US

WWP Wipo information: published in national office

Ref document number: 10545185

Country of ref document: US