US20010004726A1 - Method and system for enhancing the accuracy of measurements of a physical quantity - Google Patents
Method and system for enhancing the accuracy of measurements of a physical quantity Download PDFInfo
- Publication number
- US20010004726A1 US20010004726A1 US09/776,189 US77618901A US2001004726A1 US 20010004726 A1 US20010004726 A1 US 20010004726A1 US 77618901 A US77618901 A US 77618901A US 2001004726 A1 US2001004726 A1 US 2001004726A1
- Authority
- US
- United States
- Prior art keywords
- residual
- value
- residuals
- determining
- measurements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
- G01S7/523—Details of pulse systems
- G01S7/526—Receivers
- G01S7/53—Means for transforming coordinates or for evaluating data, e.g. using computers
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
- G01S15/88—Sonar systems specially adapted for specific applications
- G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
- G01S7/52004—Means for monitoring or calibrating
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Testing Or Calibration Of Command Recording Devices (AREA)
Abstract
A method for determining measurements of a surface includes determining a trend for a plurality of measurements and determining, for each of at least one of the plurality of measurements, an associated residual between the trend and the measurement and determining, for each of at least one of the associated residuals, an interpolated value for the residual. The method also includes comparing, for each of the at least one associated residuals, the residual to the interpolated value of the residual to determine whether a measurement associated with the residual is anomalous. In response to determining that a measurement associated with the residual is anomalous, the anomalous measurement is discarded. The remaining measurements then represent the surface of interest. The system includes a processor for executing a program of the method. Further, the system includes memory, an input device, and an output device.
Description
- This invention relates generally to enhancing the accuracy of measurements of a physical quantity and more particularly to a method and system for enhancing the accuracy of measurements of a physical quantity.
- Modeling of a physical object often requires the taking of measurements. The measurement taking process on occasion introduces an error associated with each measured value. If the measurement taking process is conducted in an appropriate fashion, the errors should be normally distributed about a mean of zero. However, at times, the measurement taking or measurement recordation process is flawed, resulting in flawed or anomalous data. In such a case the use of such data to represent the measured object would be incorrect and would provide imprecise results. Therefore, it is desirable to determine whether a measurement is anomalous before using the measurement to represent a physical quantity.
- Although anomaly detection has utility in numerous applications and for numerous types of measurements, one example of the usefulness of anomaly detection will be described with reference to bathymetric data. Oceanographers and ocean explorers make use of charts of the ocean floors. Such charts are produced by taking depth measurements of the ocean floor. One example of a procedure for taking a depth measurement of the ocean floor involves projecting, from an ocean vessel, sound waves to the bottom of the ocean floor and measuring the time required for a reflected wave to return to the vessel. Such a procedure is subject to a variety of sources of error that create anomalous measurements. For example, a large ocean animal, such as a whale, may reflect a portion of the sound wave back to the vessel, creating an anomalous reading. In addition, measurements may be improperly recorded in meters where feet is the appropriate unit of measure, or feet where meters are the appropriate unit of measure. Such sources of errors lead to anomalous measurements that should be discarded prior to utilizing the data to represent a physical quantity.
- Accordingly, a need has arisen for an improved method and system for enhancing the accuracy of measurements of a physical quantity. The present invention provides a system and method for enhancing the accuracy of measurements representing a physical quantity.
- According to one embodiment of the invention, a method for enhancing the accuracy of measurements representing a physical quantity includes determining a trend for a plurality of measurements. For each of at least one of the plurality of measurements an associated residual between the trend and the measurement is determined, and, for at least one of the associated residuals, there is determined an interpolated value for the residual. The method also includes comparing, for each of the at least one associated residuals, the residual to the interpolated value of the residual to determine whether a measurement associated with the residual is anomalous. In response to determining that a measurement associated with the residual is anomalous, the anomalous measurement is discarded. The remaining non-anomalous measurements then represent the physical quantity.
- According to another embodiment of the invention, a system for enhancing the accuracy of measurements of a physical quantity includes a storage medium, a processor coupled to the storage medium, and a computer program stored in the storage medium. The processor executes the computer program to determine a trend for a plurality of measurements. The processor executing the computer program generates a determination, for each of at least one of the plurality of measurements, an associated residual between the trend and the measurement, and also determines, for each of at least one of the associated residuals, an interpolated value for the residual. The processor running the computer program also compares, for each of the at least one associated residuals, the interpolated value to the residual to determine whether a measurement associated with the residual is anomalous. In response to determining whether a measurement is anomalous, execution of the computer program generates an indication that the measurement is anomalous so that it may be discarded. The non-anomalous measurements are then output from the system.
- Embodiments of the invention provide numerous technical advantages. For example, in one embodiment of the invention, a method for enhancing the accuracy of measurements allows determination of whether a measurement is anomalous and whether it may be discarded. Discarding anomalous measurements creates a more accurate representation of the measured object than if the anomalous measurements were included. In one embodiment of the invention a Kriging process is utilized to perform an interpolation used in determining if a measurement is anomalous. The use of the Kriging process is particularly advantageous because Kriging automatically provides an error for an interpolated value, which is utilized in the present invention and which is not readily available with other interpolation methods without additional processing.
- Other technical advantages are readily apparent to one skilled in the art from the following figures, descriptions, and claims.
- For a more complete understanding of the present invention and the advantages thereof, reference is now made to the following descriptions taken in connection with the accompanying drawings in which:
- FIG. 1 is an isometric drawing illustrating a representation of the floor of an ocean;
- FIG. 2 is a schematic drawing illustrating the measurement of the depth of a portion of the ocean floor;
- FIG. 3 is a graph illustrating the plurality of measured values of the depth of the ocean floor at different longitudes as well as the actual depth of the ocean floor at those longitudes;
- FIG. 4 is a graph illustrating a normal distribution of residuals centered about a mean of zero;
- FIG. 5A is a flowchart illustrating a method for determining whether a measured value is anomalous;
- FIG. 5B is a graphical illustration of the method illustrated in FIG. 5A for determining whether a measured value is anomalous;
- FIG. 5C is a plot of a variogram used according to the method of FIG. 5A in determining whether a measurement is anomalous; and
- FIG. 6 is a block diagram of an anomalous measurement detection system.
- The present invention and advantages thereof are best understood by referring to FIGS. 1 through 6 of the drawings, like numerals being used for like and corresponding parts of the various drawings.
- Although the invention is useful to determine anomalies in measurements in a variety of contexts, an example application for the invention is the determination of whether depth measurements of the ocean floor are anomalous. Depth measurements of the ocean floors are often referred to as bathymetric data. The following description of the invention is in the context of determining anomalies in depth measurements of the oceans; however, the invention also finds utility with any suitable type of measurements including, but not limited to, measurement of temperature, pressure, volume, weight, mass, length, area, velocity, acceleration, luminosity, energy, power, electrical charge, and magnetism.
- FIG. 1 is an isometric drawing illustrating a
representation 10 of anocean floor 16.Representation 10 provides a model ofocean floor 16, which is similar to models used by oceanographers or other persons interested in the shape and depth ofocean floor 16. The depth ofocean floor 16 is illustrated at a variety oflocations 12 ofocean floor 16.Locations 12 are specified by alongitude 26 and alatitude 28. Such a model is developed through measurements of the ocean floor taken according to one method as described in conjunction with FIG. 2. According to the invention, such measurements are analyzed in order to exclude anomalous measurements for use in generatingrepresentation 10. Exclusion of anomalous measurements generates a more accurate representation of a physical quantity. - FIG. 2 is a schematic drawing illustrating the measurement of a
depth 14 ofocean floor 16 at alocation 12. As illustrated, avessel 20 takes depth measurements by transmittingsound waves 22 to theocean floor 16. By measuring the time forsound waves 22 to reflect back tovessel 20, an indication ofdepth 14 ofocean floor 16 is obtained. Alocation 12 at whichdepth 14 is measured is specified bylongitude 26 andlatitude 28. These depth measurements are subject to errors in the measurement taking process and should be examined for anomalous measurements to produce the bestpossible representation 10 of theocean floor 16. For example, alarge ocean animal 24, such as a whale, may alter the reflection time ofsound waves 22 to return tovessel 20 and therefore produce a measurement that is not accurately indicative ofdepth 14. Such a measurement would be anomalous. Another example of the production of an anomalous measurement is the recordation ofdepth 14 in feet if the appropriate unit of measure is meters. - FIG. 3 is a graph illustrating a plurality of measured
values 30 ofdepth 14 ofocean floor 16 atdifferent longitudes 26 as well as theactual depth 32 of the ocean floor at thoselongitudes 26. A dottedline 56 represents a calculated trend of measureddepths 30. Calculation oftrend line 56 of measureddepth 30 is described in greater detail in conjunction with FIGS. 5A through 5C. Although in the example illustrated in FIG. 2 measureddepths 30 are taken at a givenlongitude 26 andlatitude 28, for simplicity of description FIG. 3 illustrates varying depths as a function oflongitude 26 for aconstant latitude 28. As illustrated, most measureddepths 30 lie close to trend line and are located on either side of the trend line. Also illustrated in FIG. 3 is one of a plurality ofresiduals 38. Each residual 38 indicates a difference between a measureddepth 30 andtrend line 56. - An
outlier measurement 34 is illustrated as lying significantly below the trend line and has an associated outlier residual 39. An outlier measurement is a measurement that differs significantly from a trend of the measured values, such astrend line 56. An outlier measurement may be anomalous or non-anomalous. An anomalous outlier measurement is an outlier measurement that is determined not to be representative of the actual physical quantity. A non-anomalous outlier measurement is an outlier measurement that, although differing from a determined trend of measured values, is nevertheless determined to be representative of the actual quantity measured. Determination that a measurement is anoutlier measurement 34 is performed according to the teachings of the invention as described with reference to FIGS. 5A through 5C. - In FIG. 4 there is shown a graph illustrating a normal distribution of
residuals 38 centered about a mean of zero. As illustrated, a normal bell-shapeddistribution curve 36 represents an expected distribution of errors for measurements taken, for example, according to the method illustrated in FIG. 2. A normal bell-shapeddistribution curve 36 is centered about a mean of zero, thereby indicating that the number of data values 30 exceeding trend line is approximately equal to the number of measuredvalues 30 less thantrend 56. Outlier residual 39 is illustrated on the far left hand side of thedistribution curve 36. Such a residual value may lie on the far end of the curve because it is anomalous, and indicate that the measurement was improperly taken. Alternatively, the residual 39 may be at the far end of the curve because it is consistent with thenormal distribution curve 36, but nevertheless is an extreme residual value. - If outlier residual39 occurred because of an anomalous measurement, it would be desirable to discard
outlier measurement 34 associated with outlier residual 39 to avoid using an anomalous measurement in producingrepresentation 10 ofocean floor 16. If, however, outlier residual 39 was obtained correctly and merely corresponds to an extreme value onnormal distribution curve 36,outlier measurement 34 should be retained in producingrepresentation 10 ofocean floor 16. Determination of whetheroutlier measurement 34 is anomalous is made in accordance with the present invention as described with reference to FIGS. 5A through 5C. - FIG. 5A is a flowchart illustrating a method for determining whether a measured value is anomalous, and FIG. 5B is a graphical illustration of the method of FIG. 5A for determining whether a measured value is anomalous. A method for determining whether an outlier is an anomalous measurement, such as
outlier measurement 34, is described in conjunction with FIGS. 5A and 5B. For simplicity of description, the method is described in the context of bathymetric data obtained as illustrated in FIG. 2; however, as described above, the method may be used for a variety of types of measurements for various physical quantities. - The method begins at
step 40 illustrated in FIG. 5A. At a step 42 asource data set 142 illustrated in FIG. 5B, is received.Source data set 142 includes a plurality of measuredvalues 30 ofdepth 14 at associatedlongitudes 26 andlatitudes 28. At astep 44 clear outliers, such asoutlier measurement 34, are temporarily removed from the processed data to produce a clear outlier asdata set 146 and adata set 148 that does not include clear outliers as illustrated in FIG. 5B. - A clear outlier is illustrated in FIG. 5B as producing clear
outlier data set 146 and thedata set 148 to facilitate description of the present invention; however, such illustration does not imply that a separate device or program is necessarily utilized for performingstep 44. Additional representations in FIG. 5B, such as, aresidual calculator 158, anoutlier detector 164, avariogram calculator 174, and anoutlier classifier 180 are similarly illustrated to facilitate description, and their functions are similarly not necessarily performed by independent devices or programs. - One example of a procedure for temporarily removing clear outliers is described below. A standard moving window technique in which measured
values 30 are binned at, for example, 20 times the measured Real World Nyquist of data measurements is used. Binning refers to the generation of a regular array of map cells overlying the source data set and is used to compute statistics of data points lying in a small geographical area. A Real World Nyquist is the frequency beyond which no further information may be gleaned from the data. A mean and a standard variation for measuredvalues 30 is calculated for each bin.Measured values 30 that exceed a predetermined multiple of the standard deviation of measuredvalues 30 are temporarily removed as clear outliers. It has been determined that temporarily excluding errors that exceed five times the standard deviation is particularly advantageous; however, other suitable multiples of the standard deviation may be utilized to remove clear outliers.Step 44 of temporarily removing clear outliers is performed to avoid undue influence on asubsequent step 50 for computing a trend of measured values 30. - After clear outliers have been temporarily removed, the trend of
data set 148 is determined atstep 50. A preliminary step in computing the trend ofdata set 148 is togrid data set 148 atstep 52.Gridding data set 148 produces a grid of data points that have values representing the depths at each grid point. These values at each grid point are based upon data withindata set 148. An example technique for griddingdata set 148 is the use of the Triangular Irregular Network algorithm. The Triangular Irregular Network algorithm is described in Macedonio, G. and Pareschi, M. T., 1991, An Algorithm for the Triangulation of Arbitrarily Distributed Points: Applications to Volume Estimate and Terrain Fitting, Computers and Geosciences, v. 17, no. 17, p. 859-874. - After
data set 148 has been gridded, the gridded data is filtered atstep 54 to maintain only the low frequency components of the gridded data. The low frequency components of the gridded data represent the trend of the gridded data.Step 54 of filtering the gridded data is illustrated in FIG. 5B as being performed by a lowpass filter function 154. In one embodiment of the invention, the filtering atstep 54 utilizes a simple Gaussian expression with a half-width given by: - 10*Σd;
-
- where Σd is the horizontal resolution of the input data computed by a spectral analysis. This corresponds to maintaining wavelengths of the data greater than 10 times the Real World Nyquist of the data.
-
Step 54 of filtering the gridded data produces a low pass component ortrend 156 illustrated in FIG. 5B. Low pass component ortrend 156 represents the trend ofdata set 148. An example illustration of a low pass component is provided in one dimension for a constant latitude astrend 56 in FIG. 3. Based on the computed low pass component ortrend 156 ofdata set 148, the difference betweentrend 156 and each data point of source data set 142 is calculated atstep 58. This difference between each data point and the calculated trend is referred to as a residual.Step 58 of computing residuals is illustrated in FIG. 5B as being performed by aresidual calculator 158. As shown, theresidual calculator 158 receives data values from both clearoutlier data set 146 anddata set 148. Thus clear outliers indata set 146 are temporarily removed to predicttrend 156 ofsource data 142, but are later used aftertrend 156 is determined. - As described above, the
data set 148 is gridded before the low pass component ortrend 156 is calculated, and as a result the low pass component ortrend 156 must also be gridded. Therefore, some interpolation is necessary to determine a measurement at a random location on the gridded surface of low pass component ortrend 156 to provide an associated residual. This may be accomplished according to a variety of techniques including simple bilinear interpolation. Residuals are calculated by subtracting the data values both in clearoutlier data set 146 anddata set 148, or in other words the data values from source data set 142, from the gridded low pass component ortrend 156. A set ofresiduals 160 illustrated in FIG. 5B is produced bystep 58 that computes residuals for all data withinsource data set 142. - After generating
residuals 160 atstep 58, the mean and standard deviation of each residual of the set ofresiduals 160 is calculated at astep 62. At astep 64 each of the residuals are compared to the standard deviation calculated atstep 62. If a residual exceeds a particular multiple of the standard deviation of residuals, the residual is identified as an outlier, and the residual may be anomalous or non-anomalous. If a residual is less than a particular multiple of the standard deviation of the residuals, the residual is identified as a non-outlier. In one embodiment of the invention, a multiple of 2.5 has been determined to provide particularly advantageous results.Steps residuals 160, comparing residuals to the standard deviation ofresiduals 160, and selecting outliers is illustrated in FIG. 5B as performed by anoutlier detector 164. The results of these steps produce a set ofoutlier residuals 166 and a set ofnon-outlier residuals 168. -
Non-outlier residuals 168 do not differ from the mean of all of theresiduals 160 to an extent great enough to constitute anomalous data. Outlier,residuals 166 differ from the mean ofresiduals 160 to an extent great enough to be anomalous.Step 64 of comparingresiduals 160 to the standard deviation ofresiduals 160 and selecting outliers is performed to increase processing speed of anomalous data detection. Alternatively, step 64 is omitted and the determination of whether a residual is associated with an anomalous measurement is performed on each residual of the set ofresiduals 160 rather thanonly residuals 166 that constitute outliers. The remainder of the method illustrated in FIGS. 5A and 5B is directed to determining whetheroutlier residuals 166 are anomalous or non-anomalous. - One method for differentiating between residuals that are anomalous and residuals that are not anomalous is cross validation. Cross validation differentiates between residuals that are supported by neighboring depth measurements and those that are not. Residuals supported by their neighbors, despite being abnormally high, are much more likely to be valid data points than isolated outliers. Cross validation begins at
step 70. A first step in cross validation occurs at astep 72 in whichresiduals 160 are gridded. Griddingresiduals 160 is performed in the same manner as described above with reference togridding data set 148. At astep 74, variograms are calculated for griddedresiduals 160. Variograms are used to determine which neighboring measurements should be used in determining whether a residual is supported by its neighbors and facilitates interpolation of a data value based on neighboring data values. Variograms are described in greater detail in conjunction with FIG. 5C.Steps gridding residuals 160 and computing a variogram forresiduals 160 are illustrated in FIG. 5B for simplicity of description as being performed by avariogram calculator 174.Variograms 176, illustrated in FIG. 5B, are produced bystep 74. - Based on the computed
variogram 176 for each outlier residual, an interpolated value is calculated atstep 76 for each of theoutlier residuals 166 based upon the value of neighboring residuals to determine whether an outlier residual is anomalous or non-anomalous. For this calculation, the value calculated for an outlier residual atstep 58 is not included. Thus an outlier residual in the set ofoutlier residuals 166 is not included in the determination of an interpolated value for that outlier residual. In addition to determining an interpolated value for an outlier residual, an error associated with the interpolated value is determined. One example ofstep 76 of determining an interpolated residual value and error is described in greater detail in conjunction with FIG. 5C. - At a
step 78, the interpolated value for an outlier residual is compared to the measured value of the same outlier residual to determine if they are statistically inconsistent. If the measured value of an outlier residual differs from the interpolated value of an outlier to too great a degree an outlier residual is classified as anomalous. If however, an outlier residual in the set ofoutlier residuals 166 differs from the interpolated value of an outlier residual by less than an acceptable amount, the outlier residual is classified as non-anomalous. In one embodiment, the determination of whether the interpolated value for an outlier residual differs from the measured value of an outlier residual is made according to the formula - |D−I|>{square root}{square root over (δI2+δD2)}
- where
- I=interpolated value for a residual
- D=measured value for a residual
- δI=calculated error for I
- δD=calculated error for D.
- The calculated error for the measured value of residuals (δD) is determined based on the error in the measurement of the associated depth. If the left-hand-side of the above equation exceeds the right-hand-side, the associated residual is classified as anomalous. This classification is performed at
step 80.Steps outlier classifier 180. The results ofstep 80 are adata set 182 of non-anomalous outliers and adata set 184 of anomalous outliers. Data sets 182 and 184 are generated at astep 86. At astep 88 data in source data set 142 associated with residuals in anomalousoutlier data set 184 are discarded. In addition, data in source data set 142 associated with residuals innon-anomalous data set 182 are combined with data in source data set 142 associated with residuals innon-outlier data set 168 for use in modeling the measured object. The method concludes atstep 90. - FIG. 5C is a plot of the
variogram 176 used according to the method of FIG. 5A in determining whether a measurement is anomalous.Variogram 176 identifies the extent an outlier residual 178 is correlated with data values proximate the outlier residual 178. Neighboring data values are correlated with outlier residual 178 if they lie within the range of the variogram centered at the residual under consideration. Therefore, only data values withinvariogram 176 are utilized to calculate an interpolated value for outlier residual 178. The interpolation process determines an interpolated value for outlier residual 178 based on the residual values ofneighbor residuals 202 withinvariogram 176 using a weighted average. The weighting is based, in part, on the extent to which data values withinvariogram 176 are correlated with outlier residual 178. This correlation varies roughly with the distance between a neighboring residual 202 and outlier residual 178. In addition, the weighting is dependent upon the uncertainty of the residual values of neighboringresiduals 202 withinvariogram 176. - An exemplary process of implementing such interpolation and calculation of a variogram is referred to in the art as multi-variate Kriging and is described inIntroduction to Disjunctive Kriging and Nonlinear Geostatistics, by J. Rivoirand, 1994, Clarendon Press, Oxford University Press, which is incorporated by reference herein. Although an interpolated value for outlier residual 178 and an associated error may be obtained according to other interpolation methods, the use of Kriging is particularly advantageous.
- In the described example of selecting whether an outlier residual is anomalous or non-anomalous, the measured values of
depth 14 were obtained onocean surface 16 forvarious longitudes 26 andlatitudes 28. Thus, interpolation utilized neighbors lying roughly in a surface specified by two dimensions. However, other applications for the invention utilize interpolation in a single dimension and in more than two dimensions. - Thus, the method described in conjunction with FIGS. 5A through 5C determines whether a measurement is anomalous or non-anomalous and allows discarding of anomalous measurements in order to provide a more accurate representation of the measured object. In one embodiment of the invention, Kriging is used to perform an interpolation and error calculation. Kriging is particularly useful for these functions because Kriging automatically provides an error with the interpolated value, alleviating the need to perform additional calculations that would be required if an interpolation method was used that did not automatically provide an error calculation. An example of that utilizes the above method is described below in conjunction with FIG. 6.
- FIG. 6 is a block diagram of anomalous measurement detection system100 for determining whether a measured value is anomalous. Anomalous measurement detection system 100 includes a
processor 202, aninput device 202, anoutput device 206, amemory system 108, and adisk drive 110. The present embodiment includes computer software stored inmemory system 108 or ondisk drive 110 and is executed byprocessor 202.Disk drive 110 includes a variety of types of storage media such as, for example, floppy disk drives, hard drives, CD ROM disk drives, or magnetic tape drives. Data is received from a user of anomalous measurement detection system 100 using a keyboard or other type ofinput device 204. Data is provided to a user of anomalous data detection system 100 throughoutput device 206, which may include a display, printer, or any other suitable type of output device. - Anomalous measurement detection system100 includes an
anomaly detection program 112. In FIG. 6, theanomaly detection program 112 is illustrated as stored inmemory system 108, and will be executed byprocessor 202.Anomaly detection program 112 is alternatively stored ondisk drive 110. Theprocessor 202 when executing theanomaly detection program 112 receivessource data set 142 and determines which data values within thesource data set 142 are anomalous and which are non-anomalous according to the method described in conjunction with FIGS. 5A through 5C. The system provides an outlier representing the data values that are anomalous and the data values that are non-anomalous. The anomalous measurement data detection system 100 discards anomalous data to enhance the accuracy of measurements representing a physical quantity. - Although the present invention and its advantages have been described in detail, it should be understood the various changes, substitutions, and alterations can be made therein without departing from the spirit and scope of the present invention as defined by the appended claims.
Claims (16)
1. A method for enhancing the accuracy processing measurements of a physical quantity comprising the steps of:
determining a trend for a plurality of measurements;
determining, for each of at least one of the plurality of measurements, an associated residual between the trend and the measurement;
determining, for each of at least one of the associated residuals, an interpolated value for the residual;
comparing, for each of the at least one associated residuals, the associated residual to the interpolated value of the residual to identify an anomalous associated measurement;
in response to identification of an anomalous measurement, discarding the anomalous measurement; and
generating an output of all measurements of the physical quantity not discarded as anomalous.
2. The method of , wherein the step of determining, for each of the at least one associated residuals, an interpolated value for the residual and an error value associated with the interpolated value comprises the process of Kriging.
claim 1
3. The method of , wherein the step of comparing, for each of the at least one associated residuals, the associated residual to the interpolated value of the residual comprises determining whether the magnitude of the difference between the associated residual and the interpolated value of the residual exceeds a first value.
claim 1
4. The method of , and further comprising the steps of:
claim 1
determining, for each of the at least one of the plurality of measurements, a residual error associated with the residual;
determining, for each of the at lest one of the associated residuals, an interpolated value error associated with the interpolated value; and
wherein the step of comparing, for each of the at least one associated residuals, the associated residual to the interpolated value of the residual comprises determining whether the magnitude of the difference between the associated residual and the interpolated value of the residual exceeds {square root}{square root over (δI2+δD2)}, where “δI” is the interpolated value error and “δD” is the residual error.
5. The method of , wherein the step of determining a trend for a plurality of measurement further comprising associating each of the plurality of measurements with points on a grid.
claim 1
6. The method of , wherein the step of determining an interpolated value and an error value by Kriging comprise determining an interpolated value and an error value by multi-variate Kriging.
claim 2
7. A method for enhancing the accuracy of depth measurements of a portion of an ocean floor comprising the steps of:
determining a trend for a plurality of depth measurements;
determining, for each of the plurality of depth measurements, an associated residual between the trend and the measurement;
determining when the magnitude of the residual exceeds a particular value;
determining, for each of the residuals that exceeds the particular value, an interpolated value for the residual;
comparing, for each of the residuals that exceeds the particular value, the residual to the interpolated value of the residual to identify an anomalous associated depth measurement;
in response to identification of an anomalous associated depth measurement, discarding the anomalous depth measurement; and
generating an output of all depth measurement of the physical quantity not discarded as anomalous.
8. The method of , wherein the step of determining, for each of the residuals that exceeds the particular value, an interpolated value for the residual and an error value associated with the interpolated value comprises the process of Kriging.
claim 7
9. The method of , wherein the steps of determining, for each of the residuals that exceeds the particular value, an interpolated value for the residual comprises the process of multi-variate Kriging.
claim 8
10. The method of , wherein the step of comparing, for each of the residuals that exceeds the particular value, the residual to the interpolated value of the residual includes the step of determining whether the difference between the associated residual and the interpolated value of the residual exceeds a first value.
claim 7
11. The method of , and further comprising steps of:
claim 10
determining for each of the residuals that exceeds a particular value, an error value associated with the determined interpolated value for the residual;
determining, for each of the plurality of depth measurements, a residual error associated with the residual; and
wherein the step of comparing, for each of the residuals that exceeds the particular value, the residual to the interpolated value of the residual includes the step of determining whether the difference between the residual and the interpolated value of the residual exceeds {square root}{square root over (δI2+δD2)}, where “δI” is the interpolated value error and “δD” is the residual error.
12. The method of , wherein determining, for each of the plurality of depth measurements, whether the magnitude of the residual exceeds a particular value includes the step of determining whether the magnitude of the residual exceeds 2.5 times a standard deviation of all residuals of all plurality of measurements.
claim 7
13. A system for outputting anomalous measurements of an object of interest, comprising:
a storage medium;
a processor coupled to the storage medium;
a computer program stored in the storage medium, the computer program executed on the processor to:
determine a trend for a plurality of measurements;
determine, for each of at least one of the plurality of measurements, an associated residual between the trend and the measurement;
determine, for each of at least one of the associated residuals, an interpolated value for the residual;
compare, for each of the at least one associated residuals, the error value to the residual to determine whether a measurement associated with the residual is anomalous;
in response to an identification of an anomalous measurement, discarding anomalous measurements; and
output means for generating all measurements of the object of interest not discarded as anomalous.
14. The system of , wherein the computer program when executed on the processor determines an interpolated value for the residual by the process of Kriging.
claim 13
15. The system of , wherein the computer program when executed on the processor program determines, for each of the at least one associated residuals, whether the magnitude of the difference between the residual and the interpolated value of the residual exceeds a first value.
claim 13
16. The system of , wherein the computer program when operated on the processor:
claim 13
determining, for each of the at least one of the plurality of measurements, a residual error associated with a residual;
determining for each of the at least one of the associated residuals an interpolated value error associated with the interpolated value; and
determines, for each of the at least one associated residuals, whether the magnitude of the difference between the residual and the interpolated value of the residual exceeds {square root}{square root over (δI2+δD2)}, where “δI” is the interpolated value error and “δD” is the residual error.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/776,189 US6351717B2 (en) | 1998-10-13 | 2001-02-01 | Method and system for enhancing the accuracy of measurements of a physical quantity |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/170,849 US6185512B1 (en) | 1998-10-13 | 1998-10-13 | Method and system for enhancing the accuracy of measurements of a physical quantity |
US09/776,189 US6351717B2 (en) | 1998-10-13 | 2001-02-01 | Method and system for enhancing the accuracy of measurements of a physical quantity |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/170,849 Continuation US6185512B1 (en) | 1998-10-13 | 1998-10-13 | Method and system for enhancing the accuracy of measurements of a physical quantity |
Publications (2)
Publication Number | Publication Date |
---|---|
US20010004726A1 true US20010004726A1 (en) | 2001-06-21 |
US6351717B2 US6351717B2 (en) | 2002-02-26 |
Family
ID=22621520
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/170,849 Expired - Lifetime US6185512B1 (en) | 1998-10-13 | 1998-10-13 | Method and system for enhancing the accuracy of measurements of a physical quantity |
US09/776,189 Expired - Fee Related US6351717B2 (en) | 1998-10-13 | 2001-02-01 | Method and system for enhancing the accuracy of measurements of a physical quantity |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/170,849 Expired - Lifetime US6185512B1 (en) | 1998-10-13 | 1998-10-13 | Method and system for enhancing the accuracy of measurements of a physical quantity |
Country Status (1)
Country | Link |
---|---|
US (2) | US6185512B1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030028350A1 (en) * | 2001-06-21 | 2003-02-06 | Seem John E. | Method of intelligent data analysis to detect abnormal use of utilities in buildings |
US20050068315A1 (en) * | 2003-09-29 | 2005-03-31 | Autodesk, Inc. | Surface construction audit trail and manipulation |
US20050078110A1 (en) * | 2003-09-29 | 2005-04-14 | Autodesk, Inc. | Interactive triangulated irregular network (TIN) surfaces design |
US20050091016A1 (en) * | 2003-09-29 | 2005-04-28 | Autodesk, Inc. | Surface smoothing techniques |
US20090024371A1 (en) * | 2007-07-19 | 2009-01-22 | Xu Di | Method for predicting micro-topographic distribution of terrain |
US20130116939A1 (en) * | 2011-11-03 | 2013-05-09 | International Business Machines Corporation | Behavior change detection |
WO2013074157A1 (en) * | 2011-11-15 | 2013-05-23 | Chevron U.S.A. Inc. | Method of using spatially independent subsets of data to calculate vertical trend curve uncertainty of spatially correlated reservoir data |
Families Citing this family (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6721694B1 (en) | 1998-10-13 | 2004-04-13 | Raytheon Company | Method and system for representing the depths of the floors of the oceans |
US6185512B1 (en) * | 1998-10-13 | 2001-02-06 | Raytheon Company | Method and system for enhancing the accuracy of measurements of a physical quantity |
US8266025B1 (en) * | 1999-08-09 | 2012-09-11 | Citibank, N.A. | System and method for assuring the integrity of data used to evaluate financial risk or exposure |
US6842753B2 (en) * | 2001-01-12 | 2005-01-11 | Microsoft Corporation | Sampling for aggregation queries |
US7367020B2 (en) * | 2001-07-27 | 2008-04-29 | Raytheon Company | Executable radio software system and method |
US6812926B1 (en) * | 2002-02-26 | 2004-11-02 | Microsoft Corporation | Displaying data containing outlying data items |
FR2836572B1 (en) * | 2002-02-27 | 2004-06-04 | Earth Resource Man Services Er | METHOD FOR DETERMINING A SPATIAL QUALITY INDEX OF REGIONALIZED DATA |
US6972678B2 (en) * | 2002-08-01 | 2005-12-06 | The United States Of America As Represented By The Secretary Of The Navy | Wireless-based system and method for hull-based sensing |
US6823297B2 (en) * | 2003-03-06 | 2004-11-23 | Chevron U.S.A. Inc. | Multi-scale finite-volume method for use in subsurface flow simulation |
US20060030430A1 (en) * | 2004-06-22 | 2006-02-09 | Accu-Sport International, Inc. | Method, apparatus and computer program product for automatically analyzing human performance |
US7151643B2 (en) * | 2005-04-22 | 2006-12-19 | Kabushiki Kaisha Toshiba | Apparatus and method for protecting a disk drive in a hardcopy device |
US7466628B2 (en) * | 2006-08-15 | 2008-12-16 | Coda Octopus Group, Inc. | Method of constructing mathematical representations of objects from reflected sonar signals |
US20080140345A1 (en) * | 2006-12-07 | 2008-06-12 | International Business Machines Corporation | Statistical summarization of event data |
EP2297658A2 (en) * | 2008-05-16 | 2011-03-23 | Chevron U.S.A. Incorporated | Multi-scale method for multi-phase flow in porous media |
CN101587187B (en) * | 2008-05-23 | 2012-05-30 | 中国科学院声学研究所 | Method for correcting deviation of depth measuring sonar system |
EP2310972A2 (en) * | 2008-07-03 | 2011-04-20 | Chevron U.S.A. Inc. | Multi-scale finite volume method for reservoir simulation |
US8301429B2 (en) * | 2008-10-09 | 2012-10-30 | Chevron U.S.A. Inc. | Iterative multi-scale method for flow in porous media |
US8469401B2 (en) | 2009-02-23 | 2013-06-25 | Amsafe, Inc. | Seat harness pretensioner |
CN101533103B (en) * | 2009-04-13 | 2012-03-21 | 中国石油天然气集团公司 | Method for constructing well-constrained transverse variable H-V curve in the construction of seismic wave velocity field |
EA201270601A1 (en) * | 2009-10-28 | 2012-11-30 | Шеврон Ю.Эс.Эй. Инк. | MULTI-SCALE METHOD OF FINAL VOLUMES FOR MODELING COLLECTORS |
US9230308B2 (en) * | 2011-06-30 | 2016-01-05 | Weyerhaeuser Nr Company | Method and apparatus for removing artifacts from aerial images |
US9022483B2 (en) | 2012-06-07 | 2015-05-05 | Shield Restraint Systems, Inc. | Seatbelt buckle tongue assembly |
US9119445B2 (en) | 2013-02-19 | 2015-09-01 | Amsafe, Inc. | Buckle assemblies with lift latches and associated methods and systems |
US9277788B2 (en) | 2013-02-19 | 2016-03-08 | Amsafe, Inc. | Dual release buckle assemblies and associated systems and methods |
WO2016100566A1 (en) | 2014-12-16 | 2016-06-23 | Shield Restraint Systems, Inc. | Web adjusters for use with restraint systems and associated methods of use and manufacture |
US10604259B2 (en) | 2016-01-20 | 2020-03-31 | Amsafe, Inc. | Occupant restraint systems having extending restraints, and associated systems and methods |
US9814282B2 (en) | 2016-02-02 | 2017-11-14 | Shield Restraint Systems, Inc. | Harsh environment buckle assemblies and associated systems and methods |
AU2018219223A1 (en) | 2017-02-07 | 2019-08-29 | Shield Restraint Systems, Inc. | Web adjuster |
US10121225B1 (en) | 2018-01-04 | 2018-11-06 | Finger Food Studios, Inc. | Dynamic scaling of visualization data while maintaining desired object characteristics |
GB2580621A (en) * | 2019-01-17 | 2020-07-29 | Bae Systems Plc | Echo sounder callibration |
CN109946702A (en) * | 2019-04-04 | 2019-06-28 | 广州丰谱信息技术有限公司 | The ultrasonic undersea detection imaging system of machine ship one |
Family Cites Families (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3906352A (en) | 1973-03-16 | 1975-09-16 | Del Norte Technology | Method of making a three-dimensional seismic profile of ocean floor |
US4562540A (en) | 1982-11-12 | 1985-12-31 | Schlumberger Technology Corporation | Diffraction tomography system and methods |
US5247436A (en) | 1987-08-14 | 1993-09-21 | Micro-Tek, Inc. | System for interpolating surface potential values for use in calculating current density |
US4964103A (en) | 1989-07-13 | 1990-10-16 | Conoco Inc. | Three dimensional before stack depth migration of two dimensional or three dimensional seismic data |
US4995011A (en) | 1989-09-20 | 1991-02-19 | Woods Hole Oceanographic Institute | Acoustic mapping system using tomographic reconstruction |
US5126978A (en) | 1991-04-23 | 1992-06-30 | The United States Of America As Represented By The Secretary Of The Navy | Undersea data collection, analysis, and display system |
US5200931A (en) | 1991-06-18 | 1993-04-06 | Alliant Techsystems Inc. | Volumetric and terrain imaging sonar |
US5404296A (en) | 1991-09-25 | 1995-04-04 | Tinking Machines Corporation | Massively parallel computer arrangement for analyzing seismic data pursuant to pre-stack depth migration methodology |
US5318475A (en) | 1992-06-19 | 1994-06-07 | Case Corporation | Apparatus for measuring mass flow of grain in a harvesting machine |
US5383114A (en) | 1992-10-05 | 1995-01-17 | Western Atlas International, Inc. | Method for displaying a volume of seismic data |
US5321613A (en) | 1992-11-12 | 1994-06-14 | Coleman Research Corporation | Data fusion workstation |
US5416750A (en) | 1994-03-25 | 1995-05-16 | Western Atlas International, Inc. | Bayesian sequential indicator simulation of lithology from seismic data |
US5504678A (en) | 1994-06-03 | 1996-04-02 | Exxon Production Research Company | Method for seismic data processing using depth slice decomposition |
US5657223A (en) | 1994-06-03 | 1997-08-12 | Exxon Production Research Company | Method for seismic data processing using depth slice decomposition |
US5539704A (en) | 1995-06-23 | 1996-07-23 | Western Atlas International, Inc. | Bayesian sequential Gaussian simulation of lithology with non-linear data |
US5729451A (en) | 1995-12-01 | 1998-03-17 | Coleman Research Corporation | Apparatus and method for fusing diverse data |
US5838634A (en) | 1996-04-04 | 1998-11-17 | Exxon Production Research Company | Method of generating 3-D geologic models incorporating geologic and geophysical constraints |
US5884229A (en) | 1996-06-10 | 1999-03-16 | Exxon Production Research Company | Method for measuring lateral continuity at a specified subsurface location from seismic data |
US5995882A (en) * | 1997-02-12 | 1999-11-30 | Patterson; Mark R. | Modular autonomous underwater vehicle system |
US5978646A (en) | 1997-07-10 | 1999-11-02 | The United States Of America As Represented By The Secretary Of The Navy | Method and apparatus for simulating a lofargram in a multipath sonar system |
US6002914A (en) | 1997-07-10 | 1999-12-14 | The United States Of America As Represented By The Secretary Of The Navy | Method and apparatus for simulating reverberation in a multipath sonar system |
US5983067A (en) | 1997-07-10 | 1999-11-09 | The United States Of America As Represented By The Secretary Of The Navy | Method and apparatus for simulating cross-correlation coefficients in a multipath sonar system |
US5995906A (en) | 1997-10-03 | 1999-11-30 | Western Atlas International, Inc. | Method for reconciling data at seismic and well-log scales in 3-D earth modeling |
US6185512B1 (en) * | 1998-10-13 | 2001-02-06 | Raytheon Company | Method and system for enhancing the accuracy of measurements of a physical quantity |
-
1998
- 1998-10-13 US US09/170,849 patent/US6185512B1/en not_active Expired - Lifetime
-
2001
- 2001-02-01 US US09/776,189 patent/US6351717B2/en not_active Expired - Fee Related
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030028350A1 (en) * | 2001-06-21 | 2003-02-06 | Seem John E. | Method of intelligent data analysis to detect abnormal use of utilities in buildings |
US6816811B2 (en) * | 2001-06-21 | 2004-11-09 | Johnson Controls Technology Company | Method of intelligent data analysis to detect abnormal use of utilities in buildings |
US7523396B2 (en) | 2003-09-29 | 2009-04-21 | Autodesk, Inc. | Surface construction audit trail and manipulation |
US20050078110A1 (en) * | 2003-09-29 | 2005-04-14 | Autodesk, Inc. | Interactive triangulated irregular network (TIN) surfaces design |
US20050091016A1 (en) * | 2003-09-29 | 2005-04-28 | Autodesk, Inc. | Surface smoothing techniques |
US20050068315A1 (en) * | 2003-09-29 | 2005-03-31 | Autodesk, Inc. | Surface construction audit trail and manipulation |
US7561990B2 (en) | 2003-09-29 | 2009-07-14 | Autodesk, Inc. | Interactive triangulated irregular network (TIN) surfaces design |
US20090024371A1 (en) * | 2007-07-19 | 2009-01-22 | Xu Di | Method for predicting micro-topographic distribution of terrain |
US8065124B2 (en) * | 2007-07-19 | 2011-11-22 | China Institute Of Water Resources And Hydropower Research | Method for predicting micro-topographic distribution of terrain |
US20130116939A1 (en) * | 2011-11-03 | 2013-05-09 | International Business Machines Corporation | Behavior change detection |
US9171339B2 (en) * | 2011-11-03 | 2015-10-27 | International Business Machines Corporation | Behavior change detection |
WO2013074157A1 (en) * | 2011-11-15 | 2013-05-23 | Chevron U.S.A. Inc. | Method of using spatially independent subsets of data to calculate vertical trend curve uncertainty of spatially correlated reservoir data |
US9146903B2 (en) | 2011-11-15 | 2015-09-29 | Chevron U.S.A. Inc. | Method of using spatially independent subsets of data to calculate vertical trend curve uncertainty of spatially correlated reservoir data |
Also Published As
Publication number | Publication date |
---|---|
US6351717B2 (en) | 2002-02-26 |
US6185512B1 (en) | 2001-02-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6185512B1 (en) | Method and system for enhancing the accuracy of measurements of a physical quantity | |
CN113759425B (en) | Method and system for evaluating filling characteristics of deep paleo-karst reservoir stratum by well-seismic combination | |
US6721694B1 (en) | Method and system for representing the depths of the floors of the oceans | |
CN113759424B (en) | Karst reservoir filling analysis method and system based on spectral decomposition and machine learning | |
Chapman et al. | Benchmarking geoacoustic inversion methods for range-dependent waveguides | |
Leroy | Detecting climate signals: Some Bayesian aspects | |
CN112883564B (en) | Water body temperature prediction method and prediction system based on random forest | |
Buongiorno Nardelli et al. | Towards high resolution mapping of 3-D mesoscale dynamics from observations | |
Khan et al. | The thermo‐chemical and physical structure beneath the North American continent from Bayesian inversion of surface‐wave phase velocities | |
US8639442B2 (en) | Identifying invalid seismic data | |
EP3273274A1 (en) | Device and method for estimating pre-stack wavelet model from seismic gathers | |
Riedel et al. | Uncertainty estimation for amplitude variation with offset (AVO) inversion | |
EP4182733A1 (en) | Systems and methods for detecting seismic discontinuties using singular vector variances | |
CN114781576B (en) | Sound velocity profile estimation method and device based on random forest algorithm | |
EP0354813A2 (en) | Seismic data processing | |
Eaton et al. | Determining microseismic event locations by semblance-weighted stacking | |
CN107491588B (en) | Inversion method and system of temperature and pressure profile | |
CN113552624B (en) | Porosity prediction method and device | |
Lyzenga | Unconstrained inversion of waveheight spectra from SAR images | |
Smith et al. | Using topographic slope distributions to infer seafloor patterns | |
US20210011186A1 (en) | Onshore separated wave-field imaging | |
US20090052279A1 (en) | Method and system for determining azimuth parameters for seismic data processing | |
CN114114421A (en) | Deep learning-based guided self-learning seismic data denoising method and device | |
Lapinski et al. | Bayesian geoacoustic inversion for the inversion techniques 2001 workshop | |
Clarke et al. | Processing and interpretation of 95 kHz backscatter data from shallow-water multibeam sonars |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20140226 |