WO2010118233A2 - Cadence analysis of temporal gait patterns for seismic discrimination - Google Patents

Cadence analysis of temporal gait patterns for seismic discrimination Download PDF

Info

Publication number
WO2010118233A2
WO2010118233A2 PCT/US2010/030394 US2010030394W WO2010118233A2 WO 2010118233 A2 WO2010118233 A2 WO 2010118233A2 US 2010030394 W US2010030394 W US 2010030394W WO 2010118233 A2 WO2010118233 A2 WO 2010118233A2
Authority
WO
WIPO (PCT)
Prior art keywords
seismic data
data
temporal
gait
seismic
Prior art date
Application number
PCT/US2010/030394
Other languages
French (fr)
Other versions
WO2010118233A3 (en
Inventor
Theodore W. Berger
Alireza A. Dibazar
Hyung O. Park
Original Assignee
University Of Southern California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University Of Southern California filed Critical University Of Southern California
Publication of WO2010118233A2 publication Critical patent/WO2010118233A2/en
Publication of WO2010118233A3 publication Critical patent/WO2010118233A3/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V1/00Seismology; Seismic or acoustic prospecting or detecting
    • G01V1/28Processing seismic data, e.g. analysis, for interpretation, for correction
    • G01V1/30Analysis

Definitions

  • This disclosure relates to signal analysis of seismic signals.
  • the signal measured from a geophone typically has a 0.1 Hz ⁇ 100Hz frequency range, due to the resonant characteristics of the sensors.
  • the frequency response of the seismic sensor is in a relatively narrow frequency band, spectral analysis can be used for discriminating between seismic events caused by human footsteps or four-legged animals (quadrupeds) and/or vehicles. Due to the very similar walking mechanism of humans and animals, however, the generated rhythmic temporal seismic patterns of humans and animals are very similar. This renders the discrimination between a human's and an animal's footstep using frequency analysis as inadequate in many situations.
  • aspects of the present disclosure address limitations noted previously and are directed to techniques, including systems, methods, and apparatus, providing for the ability to recognize and classify acoustic signals, e.g., seismic signals, by processing data for determination of temporal gait patterns.
  • acoustic signals e.g., seismic signals
  • An aspect of the present disclosure is directed to methods of seismic analysis that can utilize a temporal gait pattern as a discriminating factor, e.g., to tell the difference between bipedal and quadruped footsteps.
  • An exemplary embodiment includes a method of seismic discrimination for detecting human footsteps.
  • the method can include, with a computer system, determining a gait period from a temporal window of seismic data.
  • the temporal window can be partitioned into k number of smaller sub-windows, each having a length equal to the gait period.
  • the signals can be averaged within the sub-windows.
  • a shift-invariant temporal gait pattern can be determined from the averaged signals of the sub-windows.
  • a number of weighting functions can be applied to the temporal gait pattern, producing a like number of features of the temporal gait pattern.
  • the features can be modeled with a statistical classifier.
  • the seismic data can be recognized (or, classified) as belonging to a particular class of data, e.g., biped or quadruped.
  • the features can be modeled with a statistical classifier using a Gaussian Mixture Model (GMM).
  • GMM Gaussian Mixture Model
  • Determining the gait period can include using the auto-correlation function.
  • Determining the shift-invariant temporal gait pattern can include circular- shifting the temporal gait pattern.
  • Applying a number of weighting functions to the temporal gait pattern can include applying twelve weighting functions.
  • the weighting functions can be triangular.
  • Using a Gaussian Mixture Model can include training a model parameter.
  • Training the model parameter can include using the Figueiredo-Jain algorithm.
  • seismic data can be recognized as belonging to a particular class of data.
  • the particular class of data can include seismic data corresponding to human footsteps.
  • the particular class of data can include seismic data corresponding to quadruped footsteps.
  • the particular class of data can include seismic data corresponding to one or more vehicles.
  • Such vehicles can be heavy track vehicles.
  • Gait frequency can be used for further recognition of seismic data.
  • the temporal window can be moved across the seismic data.
  • Moving the temporal window can include moving the temporal window across the seismic data with a desired degree of overlap.
  • the window can be three seconds wide and the overlap can be about two seconds.
  • the method can include enhancing signal-to-noise ratio of the seismic data by passing the data through a band-pass filter.
  • the method can include using a Hubert transform and low-pass filter to extract an envelope of a seismic signal.
  • the method can include applying a threshold to the auto-correlation function.
  • the threshold can be at a window corresponding to about 0.5 Hz to about 7 Hz.
  • Another aspect of the present disclosure is directed to systems providing seismic analysis utilizing a temporal gait pattern as a discriminating factor, e.g., to tell the difference between biped and quadruped footsteps.
  • An exemplary embodiment of a system for discrimination of seismic data can include a vibration sensor system configured and arranged to detect vibrations.
  • the system can also include a processor system configured and arranged to (i) receive data from the vibration sensor, (ii) recognize the seismic data as belonging to a particular class of seismic data, and (iii) produce an output signal corresponding to the recognized particular class of seismic data.
  • the processor system can further be configured and arranged to: (iii) determine a gait period from a temporal window of the seismic data, (iv) partition the temporal window into k number of smaller sub-windows, each having a length equal to the gait period, (v) average the signals within the sub-windows, (vi) determine a shift-invariant temporal gait pattern from the averaged signals of the sub-windows, (vii) apply a number of weighting functions to the temporal gait pattern and produce a like number of features of the temporal gait pattern, and (viii) model the features with a statistical classifier.
  • the system can further include a wireless transmitter for transmitting the output signal corresponding to the recognized class of seismic data.
  • the vibration sensor system can include one or more geophones, or other suitable vibration sensors.
  • the particular class of data can include seismic data corresponding to human footsteps.
  • the particular class of data can include seismic data corresponding to quadruped footsteps.
  • the particular class of data can include seismic data corresponding to or more vehicles.
  • the vehicles can be heavy track vehicles.
  • the processor system can further be configured and arranged to use gait frequency for recognition of seismic data.
  • FIG. 1 A depicts a box diagram of a method for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure
  • FIG. 1 B depicts a box diagram of a system for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure
  • FIG. 2 includes FIGS. 2A-2B, which depict plots of vectors for horse and human classes, in accordance with exemplary embodiments of the present disclosure
  • FIG. 3 depicts four plots showing seismic data from a horse's footsteps and their recognition, in accordance with exemplary embodiments of the present disclosure.
  • FIG. 4 depicts two plots illustrating temporal signals of human footsteps and their recognition by an embodiment of the present disclosure, in accordance with exemplary embodiments of the present disclosure.
  • aspects of the present disclosure are directed to seismic cadence analysis providing discrimination between human footsteps and other seismic/vibration signals.
  • FIG. 1 A depicts a box diagram of a method 100 for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure.
  • Method 100 can, of course, be implemented as suitable computer- readable instructions in a computer-readable medium (flash, RAM, ROM, etc.) and/or by corresponding signals, e.g., suitable for transmission over a communications network (LAN, WAN, Internet, wireless IR or RF, etc.).
  • General portions/steps of method 100 include extracting features from seismic/vibration data, determining a mean temporal gait pattern, and then use of a statistical classifier to model features of the data for classification/recognition of signals within the data.
  • data from seismic or acoustic/vibration sensors can be received or collected.
  • a sliding window can be applied with a desired amount of temporal overlap, e.g., two seconds, on the incoming signal, as described at 104.
  • the signal can then be passed through a band-pass filter to enhance the Signal to Noise Ratio (SNR), as described at 106, with corresponding representative signal waveforms shown at 108.
  • SNR Signal to Noise Ratio
  • Envelope detection can then take place to extract the envelope of the seismic signal(s), e.g., by application of a Hubert transform and low pass filtering (smoothing process), as described at 1 10.
  • Corresponding representative signal waveforms are shown at 1 12.
  • the signal can be utilized to extract the mean temporal pattern of the gait by averaging over each gait period. It can, therefore, be desirable to estimate the gait period within the temporal window and partition the signal (e.g., within the three seconds) based on gait period.
  • this can be achieved by estimating a gait period (or frequency) by using the auto-correlation function, e.g., as described at 1 14.
  • a corresponding representative signal waveform is shown at 1 16.
  • the auto-correlation signal can have a local maxima at the time of gait period. In general, finding the local maxima may be challenging, however, due to the resonant characteristics of the seismic sensors and the periodicity from walking mechanism, there is a detectable peak (arrow) in the auto-correlation function.
  • the gait period (which can provide cadence frequency) can later be employed as one the features for modeling purposes.
  • the temporal window can be equally divided into k number smaller windows each having gait period length.
  • the partitioned signals can then be averaged, as described at 1 18.
  • a corresponding representative signal waveform is shown at 120.
  • the averaged gait pattern from 1 18 can be circular-shifted so that the local maxima of the pattern is on the first sample, e.g., as described at 122.
  • a corresponding representative signal waveform is shown at 124.
  • the partitioning of the temporal window signal (e.g., three second signal) into k frames can have some remainder, which can be considered/accommodated in the circular shift of the next consecutive frame.
  • a number of suitable weighting functions e.g., twelve (12) triangular weighting functions, can be applied to the sub-windows, as described at 126.
  • a corresponding representative signal waveform is shown at 128.
  • the gait temporal pattern can be represented by a number of features, e.g., twelve (12) features.
  • the features can then be modeled by a suitable classifier, e.g., a Gaussian Mixture Model, which can employ training as a feature, as described at 130.
  • the gate period derived from the autocorrelation can be used as a feature for modeling, as described at 132.
  • System 150 can include a processor or processor system 152 that can function to perform one or more or all of the portions/steps of method 100 of FIG. 1 A.
  • process 152 can be a suitably programmed CPU performing operations according to computer-readable instructions as stored in memory (e.g., flash, ROM, RAM, etc.) or received from an outside source.
  • System 150 can also include a seismic/vibration sub-system or sensor 154.
  • Sensor 154 operates to receive seismic/sound data from the environment (local to the sensor) and relay corresponding signals to the processor 152.
  • Sensor 154 can be a suitable geophone, microphone, or the like.
  • An example of a suitable geophone is the SM-24XL geophone made commercially available by Ion Geophysical Corporation of 12300 Pare Crest Drive, Stafford, TX 77477.
  • System 150 can also include a communications system 156, e.g., a transceiver (two-way communication) or transmitter (one-way communication).
  • System components 152, 154, 156 can be configured together, e.g., within a single housing or on a shared platform 158, or can be located at different locations, e.g., connected by wire or wireless communications links 160.
  • system 150 can include a power source 162, e.g., battery or other power supply, that supplies one or more of the system components with suitable power.
  • a power source 162 e.g., battery or other power supply
  • Exemplary embodiments of system 150 can utilize a suitable solar power system, with photovoltaic cells, as a power source 162.
  • system 150 can function to receive seismic data from the environment by way of the sensor 154.
  • the processor 152 can classify, or recognize, signals within the sensed data as belonging to a particular class, e.g., having a bipedal or quadruped origin. The results of the classification can then be transmitted for use elsewhere, e.g., at a command center.
  • system 150 can be used to facilitate security of a location by being able to allow for discrimination between human footsteps and those of quadrupeds, e.g., horses, dogs.
  • Such seismic-based discrimination can provide for discrimination between signals produced by multiple people and/or multiple animals (or other sources of seismic/vibration signals).
  • Embodiments of system 150 can be implemented as an inexpensive, lightweight, and robust device for area monitoring, alone or in combination with other similar or different sensors.
  • embodiments of the present disclosure can employ suitable statistical classifiers to approximate the true probability density function for a multimodal random variable, e.g., as represented by collected seismic data.
  • Exemplary embodiments of the present disclosure can utilize the Gaussian Mixture Model (GMM) as a suitable classifier.
  • GMM Gaussian Mixture Model
  • a finite mixture model can be used to approximate the true probability density function.
  • a GMM is a good candidate as a classifier when there exists no prior knowledge of a probability density function. Therefore, estimating the distribution with a GMM not only can provide a chance to have a general model but also can help to understand the phenomena for a better use of the information of the distribution.
  • a non-singular multivariate normal distribution of a D dimensional random variable X ⁇ x can be defined as:
  • is the mean vector and ⁇ the covariance matrix of the normally distributed random variable X.
  • the GMM can be defined as a weighted sum of Gaussians function:
  • ⁇ c is the weight of c th mixture and ⁇ is defined as following
  • ⁇ a ⁇ , ⁇ ⁇ ,- - -,a c , ⁇ c , ⁇ c ⁇ (EQ. 3)
  • FJ Figueiredo-Jain
  • the objective function of the Figueiredo-Jain (FJ) algorithm utilizes the minimum message length criterion (i.e., the FJ algorithm minimizes the objective function) for finding optimum number of mixtures as defined in the EQ. 4 so that it can select best model directly from data rather than hierarchy of model-class:
  • N is the number of training points
  • V is the number of free parameters specifying a component
  • C nz is the number of components with nonzero weight in the mixture ( ⁇ c >0).
  • L(X. ⁇ ) is the log-likelihood of the training data given the distribution parameters ⁇ .
  • Exemplary embodiments of a system and method were implanted and tested.
  • the data recording included acquisition of seismic data of a horse ridden under different conditions.
  • a horse was chosen for quadruped class because the gait can be easily controlled by a rider and also data can be easily acquired with a rider's control.
  • the signal itself is clearer than that of a dog due to the high energy transferred from its weight. From a horse ranch of Yucca Valley, CA, a nine-year-old Hawaiian mustang was recorded using a geophone, a low-cost seismic sensor and developed hardware unit, at an arena and a hill in the early morning.
  • FIG. 2 includes FIGS. 2A-2B, which depict feature vectors for horse and human classes. Each plot represents an independent Gaussian mixture.
  • X-axis is the feature number (1 st ⁇ 12 th : cadence pattern, 13 th : gait frequency) and y-axis is normalized amplitude for the 1 st ⁇ 12 th features and frequency for the 13 th feature.
  • 6 Gaussian mixtures from a to f for the horse, 4 Gaussian mixtures from g to j for the human were built from the training data set.
  • the bright lines for the 1 st -12 th features and the circles for the 13 th feature are the mean value of each feature and the shading represents its distribution.
  • the preprocessing includes filtering at 10-100 Hz and applying a threshold to the auto-correlation function at a window corresponding to 0.5 Hz ⁇ 7 Hz gait frequency.
  • Features e.g., as described for method 100 of FIG. 1 A, were extracted from pre-processed data and GMMs were setup to model the features.
  • EQ. 4 As a result of EQ. 4 (above), six Gaussian mixtures for the horse, and four Gaussian mixtures for the human classes were formed during a training process. The mean value and the distribution of each mixture are presented in the FIG. 2, which includes FIGS. 2A-2B.
  • plots 2a to 2f present the statistics of horse's cadence pattern trained by mixtures.
  • the mixture shown in a is the most likely pattern in the data set for detecting horse and the others (2b to 2f) are presented in the order of their generating likelihood.
  • the mixture shown in plot 2a represents also "walk” which is a 4-beat gait.
  • the mixtures depicted in 2e and 2f are representatives of the other types of the "walk” gait (all of the "walk” gaits show four peaks on their temporal patterns).
  • the mixture e includes the pattern of slow canter which is slow 3-beat gait and in general the feature number 1 , 7, and 10 represent the peaks of 3 beats.
  • the mixture 2b represents the gallop which is the fastest 4 beat.
  • the peaks were not observed due to relatively higher variation of the location of the peaks in time and shorter duration of their time period.
  • the mixture 2c and 2d are built for trot which is a fast 2-beat gait. Similarity between two time domain peaks has doubled the gait frequency in the mixture 2d.
  • plots 2g to 2j show the mixtures of human cadence pattern.
  • the mixture in 2g is the most likely pattern for a human, which is built from a single person's footsteps including running and walking. Although human gait is 2- beat, most human footsteps have similarity between two 2-beats footsteps so that the gait frequency is measured doubled as in the mixture 2g.
  • the mixture 2h and 2i represents multiple the walk of multiple people. Randomness of the location of peaks in time made the feature space flat and the personal variance of the strength of footstep provides the difference between the 1 st feature and the other.
  • FIG. 3 depicts a collection 300 of four plots of seismic data from a horse's footsteps and their recognition by an embodiment of the present disclosure. From top to bottom, each plot represents the temporal signal from walk, canter, trot, and gallop, respectively.
  • the bottom axis (X-axis) is sample time in 1/100Os (milliseconds). The crosses on top of the signal meaning recognized as horse's footstep.
  • FIG. 4 depicts a collection 400 of two plots of seismic data from human footsteps and their recognition by an embodiment of the present disclosure.
  • the top plot represents the temporal signal from multiple people walking, and the bottom one from multiple people running.
  • the bottom axis (X-axis) is sample time in 10s.
  • the circles on top of the signal indicates that the implemented embodiment recognized the signal as a human footstep.
  • embodiments of the present disclosure can provide methods and/or system for cadence analysis of seismic data from vibration sensors.
  • the fundamental gait frequency and temporal pattern of gait can be used as features for a statistical classifier, for example, a GMM.
  • a GMM a statistical classifier
  • the temporal patterns of gait can be recognized as belonging to a particular class of seismic data.
  • seismic/vibrations sensors have been described herein as being or including geophones, other suitable sensors may be used within the scope of the present disclosure.
  • Other suitable sensors can include, but are not limited to, acoustic sensors, e.g., microphones.
  • the scope of the present disclosure is not limited by the type of underlying sensing technology, e.g., magnetic based, capacitive based as used in MEMS devices, etc.
  • cadence analysis can be used to detect other classes of security breaches, e.g., seismic signals generated by small unmanned, and heavy track vehicles)

Abstract

Systems, methods, and apparatus are described that provide for analysis of seismic data. Features of temporal gait patterns can be extracted from seismic/vibration data. A mean temporal gait pattern can be determined. A statistical classifier can be used to model features of the data. The model can be used to classify the data. As a result, discrimination of seismic sources can be performed. Systems for discrimination of seismic data are also described. A system can include a vibration sensor system configured and arranged to detect vibrations. A system can also include a processor system configured and arranged to receive data from the vibration sensor, recognize the seismic data as belonging to a particular class of seismic data, and produce an output signal corresponding to the recognized particular class of seismic data.

Description

CADENCE ANALYSIS OF TEMPORAL GAIT PATTERNS FOR SEISMIC
DISCRIMINATION
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application is based upon and claims priority to the following: U.S. Provisional Patent Application No. 61/167,822 entitled "CADENCE ANALYSIS OF TEMPORAL GAIT PATTERNS FOR SEISMIC DISCRIMINATION BETWEEN HUMAN AND QUADRUPED FOOTSTEPS," filed April 8, 2009, attorney docket 028080-0457 (USC 09-225); the entire content of which is incorporated herein by reference.
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH
[0002] This invention was made with Government support under Contract No. N00014-06-1 -01 17 and Contract No. SD121905 awarded by the Office of Naval Research (ONR). The Government has certain rights in the invention.
BACKGROUND
TECHN ICAL FIELD
[0003] This disclosure relates to signal analysis of seismic signals.
DESCRIPTION OF RELATED ART
[0004] With the growing interest on security problems, the development of technologies that can detect potential threats such as a human or vehicle approaching military assets has been stimulated. One area of interest is to utilize seismic waves propagating from the source i.e. a threat in order to recognize the threat. Seismic sensors are small enough that they can be easily hidden away so as to not be noticeable from an intruder's visual inspection. Moreover, the creation of artificial vibrations intended to cause confusion in the recognition process is very difficult.
[0005] Previous works in the domain of seismic detection of human vs. quadruped have relied on the fundamental gait frequency. Slow movement of quadrupeds can generate the same fundamental gait frequency as human footsteps therefore causing the recognizer to be confused when quadruped are ambling around the sensor.
[0006] The signal measured from a geophone typically has a 0.1 Hz~100Hz frequency range, due to the resonant characteristics of the sensors. Although the frequency response of the seismic sensor is in a relatively narrow frequency band, spectral analysis can be used for discriminating between seismic events caused by human footsteps or four-legged animals (quadrupeds) and/or vehicles. Due to the very similar walking mechanism of humans and animals, however, the generated rhythmic temporal seismic patterns of humans and animals are very similar. This renders the discrimination between a human's and an animal's footstep using frequency analysis as inadequate in many situations.
SUMMARY
[0007] Aspects of the present disclosure address limitations noted previously and are directed to techniques, including systems, methods, and apparatus, providing for the ability to recognize and classify acoustic signals, e.g., seismic signals, by processing data for determination of temporal gait patterns.
[0008] An aspect of the present disclosure is directed to methods of seismic analysis that can utilize a temporal gait pattern as a discriminating factor, e.g., to tell the difference between bipedal and quadruped footsteps.
[0009] An exemplary embodiment includes a method of seismic discrimination for detecting human footsteps. The method can include, with a computer system, determining a gait period from a temporal window of seismic data. With the computer system, the temporal window can be partitioned into k number of smaller sub-windows, each having a length equal to the gait period. With the computer system, the signals can be averaged within the sub-windows. With the computer system, a shift-invariant temporal gait pattern can be determined from the averaged signals of the sub-windows. With the computer system, a number of weighting functions can be applied to the temporal gait pattern, producing a like number of features of the temporal gait pattern. With the computer system, the features can be modeled with a statistical classifier. With the computer system, the seismic data can be recognized (or, classified) as belonging to a particular class of data, e.g., biped or quadruped.
[0010] The features can be modeled with a statistical classifier using a Gaussian Mixture Model (GMM).
[0011] Determining the gait period can include using the auto-correlation function.
[0012] Determining the shift-invariant temporal gait pattern can include circular- shifting the temporal gait pattern.
[0013] Applying a number of weighting functions to the temporal gait pattern can include applying twelve weighting functions.
[0014] The weighting functions can be triangular.
[0015] Using a Gaussian Mixture Model can include training a model parameter.
[0016] Training the model parameter can include using the Figueiredo-Jain algorithm.
[0017] With the computer system, additional (e.g., subsequent to the training) seismic data can be recognized as belonging to a particular class of data.
[0018] The particular class of data (from one or more classed) can include seismic data corresponding to human footsteps.
[0019] The particular class of data can include seismic data corresponding to quadruped footsteps.
[0020] The particular class of data can include seismic data corresponding to one or more vehicles.
[0021] Such vehicles can be heavy track vehicles.
[0022] Gait frequency can be used for further recognition of seismic data. [0023] The temporal window can be moved across the seismic data.
[0024] Moving the temporal window can include moving the temporal window across the seismic data with a desired degree of overlap.
[0025] The window can be three seconds wide and the overlap can be about two seconds.
[0026] The method can include enhancing signal-to-noise ratio of the seismic data by passing the data through a band-pass filter.
[0027] The method can include using a Hubert transform and low-pass filter to extract an envelope of a seismic signal.
[0028] The method can include applying a threshold to the auto-correlation function.
[0029] The threshold can be at a window corresponding to about 0.5 Hz to about 7 Hz.
[0030] Another aspect of the present disclosure is directed to systems providing seismic analysis utilizing a temporal gait pattern as a discriminating factor, e.g., to tell the difference between biped and quadruped footsteps.
[0031] An exemplary embodiment of a system for discrimination of seismic data can include a vibration sensor system configured and arranged to detect vibrations. The system can also include a processor system configured and arranged to (i) receive data from the vibration sensor, (ii) recognize the seismic data as belonging to a particular class of seismic data, and (iii) produce an output signal corresponding to the recognized particular class of seismic data.
[0032] The processor system can further be configured and arranged to: (iii) determine a gait period from a temporal window of the seismic data, (iv) partition the temporal window into k number of smaller sub-windows, each having a length equal to the gait period, (v) average the signals within the sub-windows, (vi) determine a shift-invariant temporal gait pattern from the averaged signals of the sub-windows, (vii) apply a number of weighting functions to the temporal gait pattern and produce a like number of features of the temporal gait pattern, and (viii) model the features with a statistical classifier.
[0033] The system can further include a wireless transmitter for transmitting the output signal corresponding to the recognized class of seismic data.
[0034] The vibration sensor system can include one or more geophones, or other suitable vibration sensors.
[0035] The particular class of data can include seismic data corresponding to human footsteps.
[0036] The particular class of data can include seismic data corresponding to quadruped footsteps.
[0037] The particular class of data can include seismic data corresponding to or more vehicles.
[0038] The vehicles can be heavy track vehicles.
[0039] The processor system can further be configured and arranged to use gait frequency for recognition of seismic data.
[0040] These, as well as other components, steps, features, benefits, and advantages, will now become clear from a review of the following detailed description of illustrative embodiments, the accompanying drawings, and the claims. Other embodiments can be practiced within the scope of the present disclosure.
BRIEF DESCRIPTION OF DRAWINGS
[0041] The drawings disclose illustrative embodiments of the present disclosure. They do not set forth all embodiments. Other embodiments may be used in addition or instead. Details that may be apparent or unnecessary may be omitted to save space or for more effective illustration. Conversely, some embodiments may be practiced without all of the details that are disclosed. When the same numeral appears in different drawings, it refers to the same or like components or steps.
[0042] Aspects of the disclosure may be more fully understood from the following description when read together with the accompanying drawings, which are to be regarded as illustrative in nature, and not as limiting. The drawings are not necessarily to scale, emphasis instead being placed on the principles of the disclosure. In the drawings:
[0043] FIG. 1 A depicts a box diagram of a method for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure;
[0044] FIG. 1 B depicts a box diagram of a system for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure;
[0045] FIG. 2 includes FIGS. 2A-2B, which depict plots of vectors for horse and human classes, in accordance with exemplary embodiments of the present disclosure;
[0046] FIG. 3 depicts four plots showing seismic data from a horse's footsteps and their recognition, in accordance with exemplary embodiments of the present disclosure; and
[0047] FIG. 4 depicts two plots illustrating temporal signals of human footsteps and their recognition by an embodiment of the present disclosure, in accordance with exemplary embodiments of the present disclosure.
[0048] While certain embodiments are depicted in the drawings, one skilled in the art will appreciate that the embodiments depicted are illustrative and that variations of those shown, as well as other embodiments described herein, may be envisioned and practiced within the scope of the present disclosure. DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS
[0049] Illustrative embodiments are now described. Other embodiments may be used in addition or instead. Details that may be apparent or unnecessary may be omitted to save space or for a more effective presentation. Conversely, some embodiments may be practiced without all of the details that are disclosed.
[0050] Aspects of the present disclosure are directed to seismic cadence analysis providing discrimination between human footsteps and other seismic/vibration signals.
[0051] FIG. 1 A depicts a box diagram of a method 100 for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure. Method 100 can, of course, be implemented as suitable computer- readable instructions in a computer-readable medium (flash, RAM, ROM, etc.) and/or by corresponding signals, e.g., suitable for transmission over a communications network (LAN, WAN, Internet, wireless IR or RF, etc.). General portions/steps of method 100 include extracting features from seismic/vibration data, determining a mean temporal gait pattern, and then use of a statistical classifier to model features of the data for classification/recognition of signals within the data.
[0052] For method 100, data from seismic or acoustic/vibration sensors, indicated by signal 102, can be received or collected. A sliding window can be applied with a desired amount of temporal overlap, e.g., two seconds, on the incoming signal, as described at 104. The signal can then be passed through a band-pass filter to enhance the Signal to Noise Ratio (SNR), as described at 106, with corresponding representative signal waveforms shown at 108. Envelope detection can then take place to extract the envelope of the seismic signal(s), e.g., by application of a Hubert transform and low pass filtering (smoothing process), as described at 1 10. Corresponding representative signal waveforms are shown at 1 12.
[0053] Next, the signal can be utilized to extract the mean temporal pattern of the gait by averaging over each gait period. It can, therefore, be desirable to estimate the gait period within the temporal window and partition the signal (e.g., within the three seconds) based on gait period.
[0054] For exemplary embodiments, this can be achieved by estimating a gait period (or frequency) by using the auto-correlation function, e.g., as described at 1 14. A corresponding representative signal waveform is shown at 1 16. Because of the periodicity in the signal(s), the auto-correlation signal can have a local maxima at the time of gait period. In general, finding the local maxima may be challenging, however, due to the resonant characteristics of the seismic sensors and the periodicity from walking mechanism, there is a detectable peak (arrow) in the auto-correlation function. The gait period (which can provide cadence frequency) can later be employed as one the features for modeling purposes.
[0055] Using the estimated gait period, the temporal window can be equally divided into k number smaller windows each having gait period length. The partitioned signals can then be averaged, as described at 1 18. A corresponding representative signal waveform is shown at 120.
[0056] In order to facilitate a shift-invariant temporal gait pattern representation, the averaged gait pattern from 1 18 can be circular-shifted so that the local maxima of the pattern is on the first sample, e.g., as described at 122. A corresponding representative signal waveform is shown at 124. The partitioning of the temporal window signal (e.g., three second signal) into k frames can have some remainder, which can be considered/accommodated in the circular shift of the next consecutive frame.
[0057] Lastly, a number of suitable weighting functions, e.g., twelve (12) triangular weighting functions, can be applied to the sub-windows, as described at 126. A corresponding representative signal waveform is shown at 128. As a result, the gait temporal pattern can be represented by a number of features, e.g., twelve (12) features. The features can then be modeled by a suitable classifier, e.g., a Gaussian Mixture Model, which can employ training as a feature, as described at 130. The gate period derived from the autocorrelation, can be used as a feature for modeling, as described at 132. [0058] FIG. 1 B depicts a box diagram of a system 150 for cadence analysis of temporal gait patterns, in accordance with exemplary embodiments of the present disclosure. System 150 can include a processor or processor system 152 that can function to perform one or more or all of the portions/steps of method 100 of FIG. 1 A. For example, process 152 can be a suitably programmed CPU performing operations according to computer-readable instructions as stored in memory (e.g., flash, ROM, RAM, etc.) or received from an outside source. System 150 can also include a seismic/vibration sub-system or sensor 154.. Sensor 154 operates to receive seismic/sound data from the environment (local to the sensor) and relay corresponding signals to the processor 152. Sensor 154 can be a suitable geophone, microphone, or the like. An example of a suitable geophone is the SM-24XL geophone made commercially available by Ion Geophysical Corporation of 12300 Pare Crest Drive, Stafford, TX 77477. System 150 can also include a communications system 156, e.g., a transceiver (two-way communication) or transmitter (one-way communication). System components 152, 154, 156, can be configured together, e.g., within a single housing or on a shared platform 158, or can be located at different locations, e.g., connected by wire or wireless communications links 160. As shown, system 150 can include a power source 162, e.g., battery or other power supply, that supplies one or more of the system components with suitable power. Exemplary embodiments of system 150 can utilize a suitable solar power system, with photovoltaic cells, as a power source 162.
[0059] In operation, system 150 can function to receive seismic data from the environment by way of the sensor 154. The processor 152 can classify, or recognize, signals within the sensed data as belonging to a particular class, e.g., having a bipedal or quadruped origin. The results of the classification can then be transmitted for use elsewhere, e.g., at a command center. In such a way, system 150 can be used to facilitate security of a location by being able to allow for discrimination between human footsteps and those of quadrupeds, e.g., horses, dogs. Such seismic-based discrimination can provide for discrimination between signals produced by multiple people and/or multiple animals (or other sources of seismic/vibration signals). [0060] Embodiments of system 150 can be implemented as an inexpensive, lightweight, and robust device for area monitoring, alone or in combination with other similar or different sensors.
[0061] As described previously for method 100, embodiments of the present disclosure can employ suitable statistical classifiers to approximate the true probability density function for a multimodal random variable, e.g., as represented by collected seismic data.
[0062] Exemplary embodiments of the present disclosure can utilize the Gaussian Mixture Model (GMM) as a suitable classifier. For a multimodal random variable, the values of which are generated by one of several independent sources, a finite mixture model can be used to approximate the true probability density function. Moreover, a GMM is a good candidate as a classifier when there exists no prior knowledge of a probability density function. Therefore, estimating the distribution with a GMM not only can provide a chance to have a general model but also can help to understand the phenomena for a better use of the information of the distribution.
[0063] A non-singular multivariate normal distribution of a D dimensional random variable X<→ x can be defined as:
1
X ~ N{x : μ∑) = x : μ,Σ =
(2π)D/2 Σ W exp -kx-fif ∑^x-M) (EQ. 1 )
where μ is the mean vector and Σ the covariance matrix of the normally distributed random variable X.
[0064] The GMM can be defined as a weighted sum of Gaussians function:
p{x : θ) = ∑acN{x;μcc) (EQ. 2)
where σc is the weight of cth mixture and θ is defined as following,
θ = {aλλ,- - -,acc,∑c} (EQ. 3) [0065] To estimate, or train, the model parameter θ, a suitable algorithm can be used. In exemplary embodiments, the Figueiredo-Jain (FJ) algorithm can be used, which automatically chooses the optimum number of mixtures during the training. The objective function of the Figueiredo-Jain (FJ) algorithm utilizes the minimum message length criterion (i.e., the FJ algorithm minimizes the objective function) for finding optimum number of mixtures as defined in the EQ. 4 so that it can select best model directly from data rather than hierarchy of model-class:
Λ(Θ,X)4 CΛV + l) -InL[X, θ) (EQ. 4)
Figure imgf000013_0001
where N is the number of training points, V is the number of free parameters specifying a component, and Cnz is the number of components with nonzero weight in the mixture (σc>0). The last term In L(X.Θ) is the log-likelihood of the training data given the distribution parameters θ.
Exemplary Embodiments - Experiment and Results:
[0066] Exemplary embodiments of a system and method were implanted and tested. The data recording included acquisition of seismic data of a horse ridden under different conditions. A horse was chosen for quadruped class because the gait can be easily controlled by a rider and also data can be easily acquired with a rider's control. In addition, the signal itself is clearer than that of a dog due to the high energy transferred from its weight. From a horse ranch of Yucca Valley, CA, a nine-year-old Hawaiian mustang was recorded using a geophone, a low-cost seismic sensor and developed hardware unit, at an arena and a hill in the early morning.
[0067] First, recordings were made as the horse walked and ran around the arena with different gaits for 20 minutes keeping a distance of maximum 100 feet from the sensor, e.g., in order of speed: a walk, a 4-beat gait; a trot, a 2-beat gait; and, a canter, a 3-beat gait. The recorded data also included a different type of walk, called a collective walk or working walk and the transition gait between each gait, which is not one of the previously-described natural gaits. The canter gaits appeared only in short periods mixed with the walking gait and mostly slow canter which was slower than trot. Second, at the hill, the data of gallop, which is the fastest 4-beat gait, and the other natural gaits were recorded for another 20 minutes of walking and running around the hill. The distance from the sensor was from 20 feet to 200 feet.
[0068] FIG. 2 includes FIGS. 2A-2B, which depict feature vectors for horse and human classes. Each plot represents an independent Gaussian mixture. X-axis is the feature number (1 st ~ 12th: cadence pattern, 13th: gait frequency) and y-axis is normalized amplitude for the 1 st ~ 12th features and frequency for the 13th feature. 6 Gaussian mixtures from a to f for the horse, 4 Gaussian mixtures from g to j for the human were built from the training data set. The bright lines for the 1 st -12th features and the circles for the 13th feature are the mean value of each feature and the shading represents its distribution.
[0069] For human footsteps, the data of a single person running and people - group of five - walking in a group were collected at a sandy terrain near the Joshua Tree national park, CA again using the geophone sensor. Each of four different people ran along a straight path of 200 feet and data was recorded for over five roundtrips with speed varying from the fast running speed possible down to fast walking. For the data of people walking in a group, five people walked naturally along the same path in a group for five roundtrips. Then, the same five individuals were recorded walking at the same rate of speed and in sequence, keeping six feet from person to person, for another five roundtrips. Also, they were recorded walking randomly around the sensor for three minutes. The sensor was located five feet away from the middle of the path.
[0070] After preprocessing of the data, only human and quadruped's footsteps were detected from the input signal and the other classes were rejected. The rejected data includes background i.e. no event, any event with no gait frequency in the specified frequency band, and transition in speed and gait pattern. The preprocessing includes filtering at 10-100 Hz and applying a threshold to the auto-correlation function at a window corresponding to 0.5 Hz~7 Hz gait frequency. Features, e.g., as described for method 100 of FIG. 1 A, were extracted from pre-processed data and GMMs were setup to model the features. [0071] As a result of EQ. 4 (above), six Gaussian mixtures for the horse, and four Gaussian mixtures for the human classes were formed during a training process. The mean value and the distribution of each mixture are presented in the FIG. 2, which includes FIGS. 2A-2B.
[0072] In FIG. 2A, plots 2a to 2f present the statistics of horse's cadence pattern trained by mixtures. The mixture shown in a is the most likely pattern in the data set for detecting horse and the others (2b to 2f) are presented in the order of their generating likelihood. The mixture shown in plot 2a represents also "walk" which is a 4-beat gait. The mixtures depicted in 2e and 2f are representatives of the other types of the "walk" gait (all of the "walk" gaits show four peaks on their temporal patterns). The mixture e includes the pattern of slow canter which is slow 3-beat gait and in general the feature number 1 , 7, and 10 represent the peaks of 3 beats. The mixture 2b represents the gallop which is the fastest 4 beat. In Gallop, the peaks were not observed due to relatively higher variation of the location of the peaks in time and shorter duration of their time period. The mixture 2c and 2d are built for trot which is a fast 2-beat gait. Similarity between two time domain peaks has doubled the gait frequency in the mixture 2d.
[0073] In FIG. 2B, plots 2g to 2j show the mixtures of human cadence pattern. The mixture in 2g is the most likely pattern for a human, which is built from a single person's footsteps including running and walking. Although human gait is 2- beat, most human footsteps have similarity between two 2-beats footsteps so that the gait frequency is measured doubled as in the mixture 2g. The mixture 2h and 2i represents multiple the walk of multiple people. Randomness of the location of peaks in time made the feature space flat and the personal variance of the strength of footstep provides the difference between the 1 st feature and the other.
[0074] To evaluate the performance of the trained recognizers, a self-validation test was performed on the data used for training. During the test, the average of posteriori probabilities of each class on ten consecutive window frames was calculated (an assumption was made that there is/were no abrupt changes within the class). Average posteriori can be used to enhance the low-SNR observations results and reduce false positives.
[0075] Sample test signals and their results are plotted in the FIGS. 3 and 4, described below. The classification results of the experiments are summarized in Table I.
[0076] FIG. 3 depicts a collection 300 of four plots of seismic data from a horse's footsteps and their recognition by an embodiment of the present disclosure. From top to bottom, each plot represents the temporal signal from walk, canter, trot, and gallop, respectively. The bottom axis (X-axis) is sample time in 1/100Os (milliseconds). The crosses on top of the signal meaning recognized as horse's footstep.
[0077] FIG. 4 depicts a collection 400 of two plots of seismic data from human footsteps and their recognition by an embodiment of the present disclosure. The top plot represents the temporal signal from multiple people walking, and the bottom one from multiple people running. The bottom axis (X-axis) is sample time in 10s. The circles on top of the signal indicates that the implemented embodiment recognized the signal as a human footstep.
[0078] For the data set of each class, the number of frames with wrong recognition was counted and its percentage is presented in Table 1 . Testing was also conducted separately to ascertain whether discrimination could be discerned between multiple people (e.g., five persons) walking, running, and the footsteps of a horse. The implemented system/method was also tested with additional human walking data (data of a single person walking as recorded a year ago at the same location), which was not utilized for the initial training of the system.
TABLE I. FALSE RECOGNITION RATE FOR HUMAN AND HORSE
Figure imgf000017_0001
[0079] As indicated in Table 1 , a higher false recognition rate on seismic signals of a human running arises from the similarity to the trot gait of the horse. At the specific gait frequency, a human's cadence pattern and a horse's are very similar as can be seen in FIGS. 3 and 4, also in the plots 2.d and 2.g. For the embodiment shown, overall performance was over 95% correct recognition, as shown in the Table 1 . Although not shown, a dog's gait was also recognized as quadruped without any additional training suggesting that the model trained with horse can be an appropriate representative for quadruped.
[0080] Accordingly, embodiments of the present disclosure can provide methods and/or system for cadence analysis of seismic data from vibration sensors. The fundamental gait frequency and temporal pattern of gait can be used as features for a statistical classifier, for example, a GMM. As a result, the temporal patterns of gait can be recognized as belonging to a particular class of seismic data.
[0081] The components, steps, features, benefits and advantages that have been discussed are merely illustrative. None of them, nor the discussions relating to them, are intended to limit the scope of protection in any way. Numerous other embodiments are also contemplated. These include embodiments that have fewer, additional, and/or different components, steps, features, benefits and advantages. These also include embodiments in which the components and/or steps are arranged and/or ordered differently. [0082] For example, while statistical classifiers, or expectation maximizers, have been described herein as Gaussian Mixture Models, others may be used within the scope of the present disclosure. Suitable alternative statistical classifiers can include, but are not limited to, linear classifiers, quadratic classifiers, k-nearest neighbor, Decision trees, random forests, neural networks, Bayesian networks, and/or Hidden Markov models.
[0083] For further example, while seismic/vibrations sensors have been described herein as being or including geophones, other suitable sensors may be used within the scope of the present disclosure. Other suitable sensors can include, but are not limited to, acoustic sensors, e.g., microphones. In addition, the scope of the present disclosure is not limited by the type of underlying sensing technology, e.g., magnetic based, capacitive based as used in MEMS devices, etc.
[0084] Moreover, cadence analysis according to the present disclosure can be used to detect other classes of security breaches, e.g., seismic signals generated by small unmanned, and heavy track vehicles)
[0085] Unless otherwise stated, all measurements, values, ratings, positions, magnitudes, sizes, and other specifications that are set forth in this specification, including in the claims that follow, are approximate, not exact. They are intended to have a reasonable range that is consistent with the functions to which they relate and with what is customary in the art to which they pertain.
[0086] All articles, patents, patent applications, and other publications which have been cited in this disclosure are hereby incorporated herein by reference.
[0087] The phrase "means for" when used in a claim is intended to and should be interpreted to embrace the corresponding structures and materials that have been described and their equivalents. Similarly, the phrase "step for" when used in a claim is intended to and should be interpreted to embrace the corresponding acts that have been described and their equivalents. The absence of these phrases in a claim mean that the claim is not intended to and should not be interpreted to be limited to any of the corresponding structures, materials, or acts or to their equivalents.
[0088] Nothing that has been stated or illustrated is intended or should be interpreted to cause a dedication of any component, step, feature, benefit, advantage, or equivalent to the public, regardless of whether it is recited in the claims.
[0089] The scope of protection is limited solely by the claims that now follow. That scope is intended and should be interpreted to be as broad as is consistent with the ordinary meaning of the language that is used in the claims when interpreted in light of this specification and the prosecution history that follows and to encompass all structural and functional equivalents.

Claims

CLAIMSWhat is claimed is:
1 . A method of seismic discrimination for detecting human footsteps, the method comprising:
with a computer system, determining a gait period from a temporal window of seismic data;
with the computer system, partitioning the temporal window into k number of smaller sub-windows, each having a length equal to the gait period;
with the computer system, averaging the signals within the sub-windows;
with the computer system, determining a shift-invariant temporal gait pattern from the averaged signals of the sub-windows;
with the computer system, applying a number of weighting functions to the temporal gait pattern and producing a like number of features of the temporal gait pattern;
with the computer system, modeling the features with a statistical classifier; and
with the computer system, recognizing the seismic data as belonging to a particular class of data.
2. The method of claim 1 , wherein modeling the features with a statistical classifier comprises using a Gaussian Mixture Model (GMM).
3. The method of claim 1 , wherein determining the gait period comprises using the auto-correlation function.
4. The method of claim 1 , wherein determining the shift-invariant temporal gait pattern comprises circular-shifting the temporal gait pattern.
5. The method of claim 1 , wherein applying a number of weighting functions to the temporal gait pattern comprises applying twelve weighting functions.
6. The method of claim 5, wherein the weighting functions are triangular.
7. The method of claim 2, wherein using a Gaussian Mixture Model comprises training a model parameter.
8. The method of claim 7, wherein training the model parameter comprises using the Figueiredo-Jain algorithm.
9. The method of claim 8, further comprising, with the computer system, recognizing additional seismic data as belonging to a particular class of data.
10. The method of claim 1 , wherein the particular class of data comprises seismic data corresponding to human footsteps.
1 1 . The method of claim 1 , wherein the particular class of data comprises seismic data corresponding to quadruped footsteps.
12. The method of claim 1 , wherein the particular class of data comprises seismic data corresponding to vehicles.
13. The method of claim 12, wherein the vehicles comprise heavy track vehicles.
14. The method of claim 1 , further comprising using gait frequency for recognition of seismic data.
15. The method of claim 1 , further comprising moving the temporal window across the seismic data.
16. The method of claim 15, wherein moving the temporal window includes moving the temporal window across the seismic data with a desired degree of overlap.
17. The method of claim 16, wherein the window is three seconds wide and the overlap is about two seconds.
18. The method of claim 1 , further comprising enhancing signal-to-noise ratio of the seismic data by passing the data through a band-pass filter.
19. The method of claim 1 , further comprising using a Hubert transform and low-pass filter to extract an envelope of a seismic signal.
20. The method of claim 3, further comprising applying a threshold to the autocorrelation function.
21 . The method of claim 20, wherein the threshold is at a window corresponding to about 0.5 Hz to about 7 Hz.
22. A system for discrimination of seismic data, the system comprising:
a vibration sensor system configured and arranged to detect vibrations;
a processor system configured and arranged to (i) receive data from the vibration sensor, (ii) recognize the seismic data as belonging to a particular class of seismic data, and (iii) produce an output signal corresponding to the recognized particular class of seismic data.
23. The system of claim 22, wherein the processor system is further configured and arranged to: (iii) determine a gait period from a temporal window of the seismic data, (iv) partition the temporal window into k number of smaller sub- windows, each having a length equal to the gait period, (v) average the signals within the sub-windows, (vi) determine a shift-invariant temporal gait pattern from the averaged signals of the sub-windows, (vii) apply a number of weighting functions to the temporal gait pattern and produce a like number of features of the temporal gait pattern, and (viii) model the features with a statistical classifier.
24. The system of claim 22, further comprising a wireless transmitter from transmitting the output signal corresponding to the recognized class of seismic data.
25. The system of claim 22, wherein the vibration sensor system comprises one or more geophones.
26. The system of claim 22, wherein the particular class of data comprises seismic data corresponding to human footsteps.
27. The system of claim 22, wherein the particular class of data comprises seismic data corresponding to quadruped footsteps.
28. The system of claim 22, wherein the particular class of data comprises seismic data corresponding to vehicles.
29. The system of claim 22, wherein the vehicles comprise heavy track vehicles.
30. The system of claim 22, wherein the processor system is further configured and arranged to use gait frequency for recognition of seismic data.
PCT/US2010/030394 2009-04-08 2010-04-08 Cadence analysis of temporal gait patterns for seismic discrimination WO2010118233A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16782209P 2009-04-08 2009-04-08
US61/167,822 2009-04-08

Publications (2)

Publication Number Publication Date
WO2010118233A2 true WO2010118233A2 (en) 2010-10-14
WO2010118233A3 WO2010118233A3 (en) 2011-01-13

Family

ID=42934285

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/030394 WO2010118233A2 (en) 2009-04-08 2010-04-08 Cadence analysis of temporal gait patterns for seismic discrimination

Country Status (2)

Country Link
US (1) US20100260011A1 (en)
WO (1) WO2010118233A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8077036B2 (en) 2007-10-03 2011-12-13 University Of Southern California Systems and methods for security breach detection
US8111174B2 (en) 2007-10-03 2012-02-07 University Of Southern California Acoustic signature recognition of running vehicles using spectro-temporal dynamic neural network
US8615476B2 (en) 2009-04-15 2013-12-24 University Of Southern California Protecting military perimeters from approaching human and vehicle using biologically realistic neural network

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110172954A1 (en) * 2009-04-20 2011-07-14 University Of Southern California Fence intrusion detection
US8460001B1 (en) * 2011-04-14 2013-06-11 Thomas C. Chuang Athletic performance monitoring with overstride detection
US11016111B1 (en) 2012-01-31 2021-05-25 Thomas Chu-Shan Chuang Stride monitoring
DE102012007436A1 (en) * 2012-04-13 2013-10-17 FBN - Leibniz-Institut für Nutztierbiologie Method and device for the acoustic determination of the gait of a hoofed animal, in particular livestock
CN103268500B (en) * 2013-05-29 2016-04-06 山东大学 A kind of gait recognition method walking states change to robustness
WO2016130571A1 (en) * 2015-02-09 2016-08-18 Carnegie Mellon University Indoor identification of individuals through footstep induced structural vibration
CN109998551B (en) * 2019-04-11 2020-09-11 北京航空航天大学 Gait phase analysis method for sectional type local peak detection

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4110730A (en) * 1976-04-28 1978-08-29 The United States Of America As Represented By The Secretary Of The Army Rate sensitive system for a seismic sensing range containment apparatus
US20080106403A1 (en) * 2006-11-07 2008-05-08 Harris Corporation Systems and methods for dynamic situational signal processing for target detection and classfication
US20080234983A1 (en) * 2007-03-22 2008-09-25 Commtest Instruments Limited Method and system for vibration signal processing

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3699509A (en) * 1969-10-21 1972-10-17 Us Army Seismic system for real-time reporting
CH676519A5 (en) * 1988-06-28 1991-01-31 Cerberus Ag
US5083304A (en) * 1990-09-28 1992-01-21 Motorola, Inc. Automatic gain control apparatus and method
US5477324A (en) * 1994-08-26 1995-12-19 Georgia Tech Research Corporation Method and apparatus for detecting surface wave vector dynamics using three beams of coherent light
US5774846A (en) * 1994-12-19 1998-06-30 Matsushita Electric Industrial Co., Ltd. Speech coding apparatus, linear prediction coefficient analyzing apparatus and noise reducing apparatus
US6135965A (en) * 1996-12-02 2000-10-24 Board Of Regents, The University Of Texas System Spectroscopic detection of cervical pre-cancer using radial basis function networks
US6014447A (en) * 1997-03-20 2000-01-11 Raytheon Company Passive vehicle classification using low frequency electro-magnetic emanations
EP0988585A4 (en) * 1997-06-11 2007-12-26 Univ Southern California Dynamic synapse for signal processing in neural networks
US5973998A (en) * 1997-08-01 1999-10-26 Trilon Technology, Llc. Automatic real-time gunshot locator and display system
US20070120668A1 (en) * 2000-03-10 2007-05-31 Radio Systems Corporation Security System Using Piezoelectric Sensors
US6798715B2 (en) * 2000-07-08 2004-09-28 Neptune Technologies, Inc. Biomimetic sonar system and method
US6944590B2 (en) * 2002-04-05 2005-09-13 Microsoft Corporation Method of iterative noise estimation in a recursive framework
US6914854B1 (en) * 2002-10-29 2005-07-05 The United States Of America As Represented By The Secretary Of The Army Method for detecting extended range motion and counting moving objects using an acoustics microphone array
US7420878B2 (en) * 2005-01-20 2008-09-02 Fred Holmes System and method for precision acoustic event detection
WO2006110630A2 (en) * 2005-04-07 2006-10-19 Safety Dynamics, Inc. Real time acoustic event location and classification system with camera display
US7558156B2 (en) * 2006-01-06 2009-07-07 Agilent Technologies, Inc. Acoustic location and enhancement
CA2650234C (en) * 2006-04-25 2016-08-02 The University Of Mississippi Methods for detecting humans
WO2009036096A1 (en) * 2007-09-10 2009-03-19 Safety Dynamics, Inc. Remote activity detection or intrusion monitoring system
US8164484B2 (en) * 2007-10-03 2012-04-24 University Of Southern California Detection and classification of running vehicles based on acoustic signatures
US8077036B2 (en) * 2007-10-03 2011-12-13 University Of Southern California Systems and methods for security breach detection
US8615476B2 (en) * 2009-04-15 2013-12-24 University Of Southern California Protecting military perimeters from approaching human and vehicle using biologically realistic neural network

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4110730A (en) * 1976-04-28 1978-08-29 The United States Of America As Represented By The Secretary Of The Army Rate sensitive system for a seismic sensing range containment apparatus
US20080106403A1 (en) * 2006-11-07 2008-05-08 Harris Corporation Systems and methods for dynamic situational signal processing for target detection and classfication
US20080234983A1 (en) * 2007-03-22 2008-09-25 Commtest Instruments Limited Method and system for vibration signal processing

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8077036B2 (en) 2007-10-03 2011-12-13 University Of Southern California Systems and methods for security breach detection
US8111174B2 (en) 2007-10-03 2012-02-07 University Of Southern California Acoustic signature recognition of running vehicles using spectro-temporal dynamic neural network
US8164484B2 (en) 2007-10-03 2012-04-24 University Of Southern California Detection and classification of running vehicles based on acoustic signatures
US8615476B2 (en) 2009-04-15 2013-12-24 University Of Southern California Protecting military perimeters from approaching human and vehicle using biologically realistic neural network

Also Published As

Publication number Publication date
US20100260011A1 (en) 2010-10-14
WO2010118233A3 (en) 2011-01-13

Similar Documents

Publication Publication Date Title
US20100260011A1 (en) Cadence analysis of temporal gait patterns for seismic discrimination
US8164484B2 (en) Detection and classification of running vehicles based on acoustic signatures
Yang et al. UAV detection system with multiple acoustic nodes using machine learning models
Bittle et al. A review of current marine mammal detection and classification algorithms for use in automated passive acoustic monitoring
Damarla et al. Detection of people and animals using non-imaging sensors
CN102045120A (en) Vibration signal identification method for optical fiber perimeter system
US8077036B2 (en) Systems and methods for security breach detection
Park et al. Cadence analysis of temporal gait patterns for seismic discrimination between human and quadruped footsteps
US8615476B2 (en) Protecting military perimeters from approaching human and vehicle using biologically realistic neural network
Mukhopadhyay et al. Detection of an intruder and prediction of his state of motion by using seismic sensor
Heck et al. Automatic detection of snow avalanches in continuous seismic data using hidden Markov models
Bin et al. Moving target recognition with seismic sensing: A review
Küçükbay et al. Use of acoustic and vibration sensor data to detect objects in surveillance wireless sensor networks
Xu et al. Seismic target recognition based on parallel recurrent neural network for unattended ground sensor systems
Mehmood et al. Discrimination of bipeds from quadrupeds using seismic footstep signatures
Mohebbi-Kalkhoran et al. Classifying humpback whale calls to song and non-song vocalizations using bag of words descriptor on acoustic data
Anghelescu et al. Human footstep detection using seismic sensors
Schumer Analysis of human footsteps utilizing multi-axial seismic fusion
Narayanaswami et al. Sensor fusion and feature-based human/animal classification for unattended ground sensors
Ma et al. An optic-fiber fence intrusion recognition system using mixture Gaussian hidden Markov models
Andrei et al. Considerations on developing a chainsaw intrusion detection and localization system for preventing unauthorized logging
Litvak et al. Detection of falls at home using floor vibrations and sound
Dibazar et al. Intelligent recognition of acoustic and vibration threats for security breach detection, close proximity danger identification, and perimeter protection
Zuba et al. UPAL: Underwater passive aquatic listener
Damarla Seismic and ultrasonic data analysis for characterizing people and animals

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10762438

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10762438

Country of ref document: EP

Kind code of ref document: A2