Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

A method and apparatus for recognizing a gesture input on a display screen of a computer system. A method of recognizing an ellipse gesture comprises the steps of receiving a stroke input by a user onto a computer screen, smoothing the stroke by reducing the number of points that represent the stroke, determining whether the smoothed stroke includes at least a predetermined minimum number of points, and, if so, calculating angles between adjacent segments of the smoothed stroke and calculating derivatives of the angles. It is determined if the stroke substantially represents an ellipse by utilizing the angles and the derivatives of the angles. The method preferably includes selecting an ink object on the screen if the ink object is substantially overlapped by the smoothed stroke. A different method of implementing fuzzy recognition includes smoothing the stroke, normalizing the smoothed stroke, determining whether the normalized stroke matches one of a plurality of gesture prototype...

InventorArnaud P. J. Gourdol
Original AssigneeApple Computer, Inc.
Current U.S. Classification382/187; 345/179; 382/173; 715/863
International Classification: G06K 900

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US4365235Dec 31, 1980Dec 21, 1982International Business Machines CorporationChinese/Kanji on-line recognition system
US4680804Mar 28, 1985Jul 14, 1987Hitachi, Ltd.Method for designating a recognition mode in a hand-written character/graphic recognizer
US4739317Mar 30, 1984Apr 19, 1988International Business Machines CorporationDraw graphics capabilities
US4812832Jul 15, 1987Mar 14, 1989Brother Kogyo Kabushiki KaishaInput control device
US4821030Dec 19, 1986Apr 11, 1989Tektronix, Inc.Touchscreen feedback system
US4992630Jul 11, 1989Feb 12, 1991Summagraphics CorporationDigitizer tablet with user customization of stylus proximity and pressure
US5034989Jan 17, 1989Jul 23, 1991On-line handwritten character recognition apparatus with non-ambiguity algorithm
US5038382Oct 13, 1989Aug 6, 1991International Business Machines CorporationMulti-scale recognizer for hand drawn strokes
US5063600May 14, 1990Nov 5, 1991Hybrid information management system for handwriting and text
US5121442Oct 2, 1991Jun 9, 1992Sharp Kabushiki KaishaFigure input system
US5157737May 14, 1990Oct 20, 1992Grid Systems CorporationHandwritten keyboardless entry computer system
US5218645Mar 29, 1991Jun 8, 1993Cell Analysis Systems, Inc.Method and apparatus for separating cell objects for analysis
US5220649Apr 29, 1991Jun 15, 1993Script/binary-encoded-character processing method and system with moving space insertion mode

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US5796866Dec 8, 1994Aug 18, 1998Matsushita Electric Industrial Co., Ltd.Apparatus and method for editing handwritten stroke
US5861886Jun 26, 1996Jan 19, 1999Xerox CorporationMethod and apparatus for grouping graphic objects on a computer based system having a graphical user interface
US6144764Jan 20, 1998Nov 7, 2000Mitsui High-tec, Inc.Method and apparatus for on-line handwritten input character recognition and recording medium for executing the method
US6249606Feb 19, 1998Jun 19, 2001Mindmaker, Inc.Method and system for gesture category recognition and training using a feature vector
US6438523May 18, 1999Aug 20, 2002Processing handwritten and hand-drawn input and speech input
US6459442Dec 1, 1999Oct 1, 2002Xerox CorporationSystem for applying application behaviors to freeform data
US6476834May 28, 1999Nov 5, 2002International Business Machines CorporationDynamic creation of selectable items on surfaces
US6647145Jul 23, 1999Nov 11, 2003Co-Operwrite LimitedMeans for inputting characters or commands into a computer
US6883145Jun 12, 2001Apr 19, 2005Arrow logic system for creating and operating control systems
US7017124Jan 18, 2002Mar 21, 2006Method for controlling electronic devices using digital recall tool
US7254787Aug 5, 2003Aug 7, 2007Method for formatting text by hand drawn inputs
US7339580Dec 17, 2004Mar 4, 2008Apple Inc.Method and apparatus for integrating manual input
US7487461May 4, 2005Feb 3, 2009International Business Machines CorporationSystem and method for issuing commands based on pen motions on a graphical keyboard
US7511702May 9, 2006Mar 31, 2009Apple Inc.Force and location sensitive display
US7515135Jun 15, 2004Apr 7, 2009Research In Motion LimitedVirtual keypad for touchscreen display
US7538760Mar 30, 2006May 26, 2009Apple Inc.Force imaging input device and system
US7567238Nov 21, 2001Jul 28, 2009NEC CorporationMethod for supporting medical treatment system and medical treatment support system
US7580829Feb 11, 2005Aug 25, 2009Tegic Communications, Inc.Apparatus and method for reordering of multiple language databases for text disambiguation
US7610194Jul 16, 2003Oct 27, 2009Tegic Communications, Inc.Dynamic database reordering system
US7614008Sep 16, 2005Nov 3, 2009Apple Inc.Operation of a computer with touch screen interface
US7619618Jul 3, 2006Nov 17, 2009Apple Inc.Identifying contacts on a touch surface
US7653883Sep 30, 2005Jan 26, 2010Apple Inc.Proximity detector in handheld device
US7656393Jun 23, 2006Feb 2, 2010Apple Inc.Electronic device having display and surrounding touch sensitive bezel for user interface and control
US7656394Jul 3, 2006Feb 2, 2010Apple Inc.User interface gestures
US7663607May 6, 2004Feb 16, 2010Apple Inc.Multipoint touchscreen
US7705830Feb 10, 2006Apr 27, 2010Apple Inc.System and method for packing multitouch gestures onto a hand
US7750891Jun 28, 2004Jul 6, 2010Tegic Communications, Inc.Selective input system based on tracking of motion parameters of an input device
US7764274Jul 3, 2006Jul 27, 2010Apple Inc.Capacitive sensing arrangement
US7765486Sep 15, 2004Jul 27, 2010NBOR CorporationArrow logic system for creating and operating control systems
US7778818Sep 21, 2007Aug 17, 2010Tegic Communications, Inc.Directional input system with automatic correction
US7782307Nov 14, 2006Aug 24, 2010Apple Inc.Maintaining activity after contact liftoff or touchdown
US7812828Feb 22, 2007Oct 12, 2010Apple Inc.Ellipse fitting for multi-touch surfaces
US7821503May 11, 2009Oct 26, 2010Tegic Communications, Inc.Touch screen and graphical user interface
US7844914Sep 16, 2005Nov 30, 2010Apple Inc.Activating virtual keys of a touch-screen virtual keyboard
US7880730Sep 11, 2007Feb 1, 2011Tegic Communications, Inc.Keyboard system with automatic correction
US7920131Aug 28, 2009Apr 5, 2011Apple Inc.Keystroke tactility arrangement on a smooth touch surface
US7925088Feb 23, 2005Apr 12, 2011Hewlett-Packard Development Company, L.P.System, method and apparatus for automatic segmentation and analysis of ink stream
US7929765May 12, 2010Apr 19, 2011Fujitsu LimitedVideo text processing apparatus
US7932897Aug 15, 2005Apr 26, 2011Apple Inc.Method of increasing the spatial resolution of touch sensitive devices
US7978181Apr 25, 2006Jul 12, 2011Apple Inc.Keystroke tactility arrangement on a smooth touch surface
US8115745Dec 19, 2008Feb 14, 2012Tactile Displays, LLCApparatus and method for interactive display with tactile feedback
US8125463Nov 7, 2008Feb 28, 2012Apple Inc.Multipoint touchscreen
US8130203May 31, 2007Mar 6, 2012Apple Inc.Multi-touch input discrimination
US8147248Mar 21, 2005Apr 3, 2012Microsoft CorporationGesture training
US8159501Jul 12, 2008Apr 17, 2012International Business Machines CorporationSystem and method for smooth pointing of objects during a presentation
US8201087Jan 31, 2008Jun 12, 2012Tegic Communications, Inc.Spell-check for a keyboard system with automatic correction
US8217908Jun 19, 2008Jul 10, 2012Tactile Displays, LLCApparatus and method for interactive display with tactile feedback
US8225203Nov 4, 2010Jul 17, 2012Nuance Communications, Inc.Spell-check for a keyboard system with automatic correction
US8237681Jul 2, 2010Aug 7, 2012Tegic Communications, Inc.Selective input system and process based on tracking of motion parameters of an input object
US8237682Oct 22, 2010Aug 7, 2012Tegic Communications, Inc.System and process for selectable input with a touch screen
US8238662Jul 17, 2007Aug 7, 2012SMART Technologies ULCMethod for manipulating regions of a digital image
US8239784Jan 18, 2005Aug 7, 2012Apple Inc.Mode-based graphical user interfaces for touch sensitive input devices
US8243041Jan 18, 2012Aug 14, 2012Apple Inc.Multi-touch input discrimination
USRE40153May 27, 2005Mar 18, 2008Apple Inc.Multi-touch system and method for emulating modifier keys via fingertip chords
USRE40993Jan 13, 2006Nov 24, 2009Apple Inc.System and method for recognizing touch typing under limited tactile feedback conditions
USRE42738Oct 8, 1998Sep 27, 2011Apple Inc.Portable computers

Claims

1. A method for recognizing a gesture input on a display screen for a computer system, the method comprising the steps of:

(a) receiving a stroke input by a user onto a computer screen, the stroke being represented as a string of points;
(b) smoothing said stroke by reducing the number of points that represent the stroke such that the points of the smoothed stroke are located at least a threshold distance apart from one another, said smoothing step including the substeps of:
(i) calculating a position for a new point that is positioned between two adjacent points in the stroke that are separated by less than the threshold distance; and
(ii) replacing the two adjacent points that are separated by less than the threshold distance with the new point; and
(iii) repeating steps (i) and (ii) until all of the remaining points in the stroke are separated by at least the threshold distance;
(c) determining whether said smoothed stroke includes at least a predetermined minimum number of points;
(d) calculating angles between adjacent segments of said smoothed stroke and calculating derivatives of said angles; and
(e) determining whether said stroke substantially represents an ellipse, the ellipse determining step utilizing said angles and said derivatives of said angles and including the substeps of:
(i) determining whether said stroke substantially curves in one direction, wherein said stroke is not considered to substantially represent an ellipse when said stroke does not curve in one direction;
(ii) determining whether a point on said stroke that is within a predetermined portion including an end point of said stroke is within a predetermined distance of an opposite end point of said stroke, wherein said stroke is not considered to substantially represent an ellipse when said point is not within said predetermined distance of said opposite end point; and
(iii) summing said derivatives of said angles and checking whether said sum is within a predetermined range of values, wherein said stroke is not considered to substantially represent an ellipse when said sum is outside said range of values;
wherein steps (d) and (e) are only executed when said smoothed stroke includes at least said predetermined minimum number of points.

2. A method as recited in claim 1 further comprising the steps of:

determining whether an object displayed on a computer screen is substantially overlapped by said smoothed stroke; and
selecting said object when said object is overlapped by said smoothed stroke and said smoothed stroke substantially represents an ellipse.