Sign in

Method and apparatus for tracking a hand-held writing instrument with ...

 David G. Stork et al
One embodiment of the writing instrument described herein comprises a pen-like device containing three accelerometers and three gyroscopes. Data from these sensors are processed via an Euler transform. Prior to using the writing instrument, the user holds the writing instrument in multiple...
Inventors: David G. Stork, Michael Angelo, Gregory J. Wolff
Assignees: Ricoh Company, Ltd.
Primary Examiner: Paul A. Bell

U.S. Classification
345/179; 178/190.1

International Classification
G09G 500; G06K 1118

View patent at USPTO

Citations

Patent NumberTitleIssue date
3906444(unknown)Sep 1975
3915015(unknown)Oct 1975
RE29765Strain gauge transducer systemSep 19, 1978
4241409Hand held pen-size calculatorDec 23, 1980
4345239Apparatus for determining pen accelerationAug 17, 1982
4468694Apparatus and method for remote displaying and sensing of information using shadow parallaxAug 28, 1984
4513437Data input pen for Signature VerificationApr 23, 1985
4545018Calibration of automated laser machining apparatusOct 1, 1985
4561105Complex pattern recognition method and systemDec 24, 1985
4646073Input-output coordinate transforming method and apparatus for input-integrated displayFeb 24, 1987
4731857Recognition system for run-on handwritten charactersMar 15, 1988
4737773Graphical display apparatus having a coordinate correction circuitApr 12, 1988
4751741Pen-type character recognition apparatusJun 14, 1988
4787051Inertial mouse systemNov 22, 1988
48067073-Dimensional digitizer penFeb 21, 1989
4856077Method of signature verification and device for carrying out the methodAug 8, 1989
4883926Stylus switchNov 28, 1989
4988981Computer data entry and manipulation apparatus and methodJan 29, 1991
5022086Handwriting apparatus for information collection based on force and positionJun 4, 1991
5025314Apparatus allowing remote interactive use of a plurality of writing surfacesJun 18, 1991
5027115Pen-type computer input deviceJun 25, 1991
5159321Pen-type computer input deviceOct 27, 1992
5164585Stylus/digitizer combination with elongate reflectors and linear CCDNov 17, 1992
5181181Computer apparatus input device for three-dimensional informationJan 19, 1993
5215397Writing device for storing handwritingJun 1, 1993
5226091Method and apparatus for capturing information in drawing or writingJul 6, 1993
5227622Wireless input system for computer using pen position detectionJul 13, 1993
5239292Computer graphics system electronically simulating painting on canvasAug 24, 1993
5247137Autonomous computer input device and marking instrumentSep 21, 1993
5294792Writing tip position sensing and processing apparatusMar 15, 1994
5296871Three-dimensional mouse with tactile feedbackMar 22, 1994
5371516Pen-type computer input deviceDec 6, 1994
5396265Three-dimensional tactile computer input deviceMar 7, 1995
5408382Terminal and docking mechanism with open channel members and guide rollersApr 18, 1995
5414227Stylus tilt detection apparatus for communication with a remote digitizing displayMay 9, 1995
5434371Hand-held electronic writing toolJul 18, 1995
5436792Pivotable docking station for use with notepad computer systemsJul 25, 1995
5440326Gyroscopic pointerAug 8, 1995
5444192Interactive data entry apparatusAug 22, 1995
D362663Docking station for a pen computerSep 26, 1995
5471226Coordinate input apparatus and calibration method for the sameNov 28, 1995
5477012Optical position determinationDec 19, 1995
5506605Three-dimensional mouse with tactile feedbackApr 9, 1996
5512892Hand held control deviceApr 30, 1996
5517579Handwritting input apparatus for handwritting recognition using more than one sensing techniqueMay 14, 1996
5526018Stretching scales for computer documents or drawingsJun 11, 1996
5548092Apparatus and method of imaging written informationAug 20, 1996
5570109Schedule and to-do list for a pen-based computer systemOct 29, 1996
5583323Calibration of graphic data-acquisition tracking systemDec 10, 1996
5587558Coordinate detecting apparatus having acceleration detectorsDec 24, 1996
5587560Portable handwritten data capture device and method of usingDec 24, 1996
5657054Determination of pen location on display apparatus using piezoelectric point elementsAug 12, 1997
5751276Method for calibrating touch panel displaysMay 12, 1998
5777898Method and apparatus for aligning a digitizing panel with a display device Jul 7, 1998
5902968Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movementMay 11, 1999
5953683Sourceless orientation sensorSep 14, 1999

Claims

What is claimed is:

1. A method comprising:

obtaining sensor readings for each of a plurality of predefined positions of a writing instrument
generating a mapping of sensor outputs to writing instrument positions based, at least in part, on the sensor readings at the plurality of predefined positions with respect to a writing surface; and
generating a mapping of possible sensor outputs to possible writing instrument positions comprises determining a polynomial approximation of future writing instrument positions corresponding to future sensor outputs based on sensor outputs at the predetermined positions, wherein the polynomial approximation includes the sensor outputs for each predefined position.

2. The method of claim 1 further comprising changing the mapping of possible sensor outputs to possible writing instrument positions to compensate for an angle of a writing surface.

3. The method of claim 1 further comprising changing the mapping of possible sensor outputs to possible writing instrument positions based on measurable deviations of a mapped position to a known position.

4. The method of claim 3, wherein changing the mapping of possible sensor outputs to possible writing instrument positions is based on pattern recognition.

5. The method of claim 1, where in the sensors comprise a first accelerometer, a second accelerometer and a third accelerometer, wherein the outputs of the accelerometers are voltages in proportion to the force measured by the respective accelerometer.

6. The method of claim 1, wherein the sensors comprise a first gyroscope, a second gyroscope, and a third gyroscope, wherein the outputs of the gyroscopes are voltages in proportion to angular velocities measured by the respective gyroscopes.

7. A method comprising:

obtaining sensor readings for each of a plurality of predefined positions of a writing instrument with respect to a writing surface; and
generating a mapping of sensor outputs to writing instrument positions based, at least in part, on the sensor readings at the plurality of predefined positions and the elected sensor readings at the plurality of predefined positions with respect to the writing surface, wherein generating a mapping of possible sensor outputs to possible writing instrument positions comprises:
mapping a first voltage output by a first sensor when the writing instrument is in a first predetermined position with respect to the writing surface; and
mapping a second voltage output by a second sensor when the writing instrument is in a second predetermined position with respect to the writing surface; and
mapping sensor output voltages between the first voltage and the second voltage to positions of the writing instrument between the first predetermined position and the second predetermined position.

8. The method of claim 7, further comprising:

mapping a third voltage output by a third sensor when the writing instrument is in a third predetermined position with respect to the writing surface; and
mapping sensor output voltages between the second voltage and the third voltage to positions of the writing instrument between the second predetermined position and the third predetermined position.

9. The method of claim 8, wherein the third predetermined position is at a second right angle to the second predetermined position and at a third right angle to the first predetermined position.

10. The method of claim 8 wherein the third predetermined position a third accelerometer is substantially perpendicular to gravity.

11. The method of claim 7, wherein the first predetermined position is at a first right angle to the second predetermined position.

12. The method of claim 7 wherein the first predetermined position a first accelerometer is substantially perpendicular to gravity.

13. The method of claim 12 wherein the second predetermined position a second accelerometer is substantially perpendicular to gravity.

14. A system comprising:

a plurality of accelerometers that generate output voltages in response to accelerations in a corresponding direction; and
a calibration circuit to map the accelerometer output voltages to position data based on accelerometer output voltages when the writing instrument is in a plurality predetermined positions and to generate a mapping of possible sensor outputs to possible writing instrument positions comprises determining a polynomial approximation of future writing instrument positions corresponding to future sensor outputs based on sensor outputs at the predetermined positions, wherein the polynomial approximation includes the sensor outputs for each predefined position.

15. The system of claim 14, wherein the plurality of accelerometers comprise:

a first accelerometer that outputs a first voltage when the writing instrument is in a first predetermined position and a second voltage when the writing instrument is in a second predetermined position; and
a second accelerometer that outputs a third voltage when the writing instrument is in the first predetermined position and a fourth voltage when the writing instrument is in the second predetermined position;
wherein the calibration circuit maps the first voltage and the third voltage to the first predetermined position and maps the second voltage and the fourth voltage to the second predetermined position, further wherein the calibration circuit maps voltages between the first voltage and second voltage and voltages between the third voltage and the fourth voltage to positions of the writing instrument between the first predetermined position and the second predetermined position.

16. The system of claim 15 wherein the first predetermined position is at a first right angle with respect to the second predetermined position.

17. The system of claim 15 further comprising:

a third accelerometer that outputs a fifth voltage when the writing instrument is in the first predetermined position and a sixth voltage when the writing instrument is in the second predetermined position, and wherein the calibration circuit maps the fifth voltage to the first predetermined position and the sixth voltage to the second predetermined position, and further wherein the calibration circuit maps voltages between the fifth voltage and the sixth voltage to positions between the first predetermined position and the second predetermined position.