Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Inventors: Wayne Westerman, John G. Elias
Original Assignee: Apple Inc.
Primary Examiner: Amare Mengistu
Secondary Examiner: Koosha Sharifi
Attorney: Morrison & Foerster LLP
Current U.S. Classification: 345/173; 178/18.01; 178/18.03; 345/174; 345/175

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US3333160Feb 24, 1964Jul 25, 1967PROXIMITY RESPONSIVE SYSTEM
US3541541Jun 21, 1967Nov 17, 1970POSITION POT
US3662105May 21, 19701972ELECTRICAL SENSOR OF PLANE COORDINATES
US3798370Apr 17, 19721974SZ-CONDUCTIVE SHEET
US4237421Oct 19, 1978Dec 2, 1980General Electric CompanySingle-electrode capacitance touchpad sensor systems
US4246452Jan 5, 1979Jan 20, 1981Mattel, Inc.Switch apparatus
US4266144May 14, 1979May 5, 1981Emhart Industries, Inc.Detection means for multiple capacitive sensing devices
US4290061Aug 23, 1979Sep 15, 1981General Electric CompanyElectrically integrated touch input and output display system
US4291303Aug 23, 1979Sep 22, 1981General Electric CompanyTouch pad and display tube circuitry
US4550221Oct 7, 1983Oct 29, 1985Touch sensitive control device
US4561002Aug 30, 1982Dec 24, 1985General Electric CompanyCapacitive touch switch arrangement
US4672364Jun 18, 1984Jun 9, 1987Carroll Touch IncTouch input device having power profiling
US4672558Sep 25, 1984Jun 9, 1987Aquila Technologies Group, Inc.Touch-sensitive data input device
US4692809Nov 20, 1984Sep 8, 1987Hughes Aircraft CompanyIntegrated touch paint system for displays
US4695827Nov 20, 1984Sep 22, 1987Hughes Aircraft CompanyElectromagnetic energy interference seal for light beam touch panels
US4733222Apr 18, 1986Mar 22, 1988Integrated Touch Arrays, Inc.Capacitance-variation-sensitive touch sensing array system
US4734685Jul 18, 1984Mar 29, 1988Canon Kabushiki KaishaPosition control apparatus
US4746770Feb 17, 1987May 24, 1988Sensor Frame IncorporatedMethod and apparatus for isolating and manipulating graphic objects on computer video monitor
US4771276Apr 15, 1985Sep 13, 1988International Business Machines CorporationElectromagnetic touch sensor input system in a cathode ray tube display device
US4788384Dec 17, 1987Nov 29, 1988Centre National de la Recherche ScientifiqueDevice for two-dimensional localization of events that generate current on a resistive surface
US4806846Jul 6, 1987Feb 21, 1989High accuracy direct reading capacitance-to-voltage converter
US4898555Mar 23, 1989Feb 6, 1990Bell & Howell Publication Systems CompanyDisplay screen bezel and assembly method
US4968877Sep 14, 1988Nov 6, 1990Sensor Frame CorporationVideoHarp
US5003519May 25, 1989Mar 26, 1991ETA S.A. Fabriques d'EbauchesAlarm arrangement for a timepiece
US5017030Jul 7, 1986May 21, 1991Ergonomically designed keyboard
US5178477Jun 6, 1991Jan 12, 1993Ergonomic keyboard input device
US5189403Feb 1, 1991Feb 23, 1993Home Row, Inc.Integrated keyboard and pointing device system with automatic mode change
US5194862Jun 7, 1991Mar 16, 1993U.S. Philips CorporationTouch sensor array systems and display systems incorporating such
US5224861Sep 17, 1990Jul 6, 1993Hughes Aircraft CompanyTraining device onboard instruction station
US5241308Jul 23, 1992Aug 31, 1993Paragon Systems, Inc.Force sensitive touch panel
US5252951Oct 21, 1991Oct 12, 1993International Business Machines CorporationGraphical user interface with gesture recognition in a multiapplication environment
US5270711Apr 30, 1990Dec 14, 1993U.S. Philips CorporationTouch sensor array systems and display systems incorporating such
US5281966Jan 31, 1992Jan 25, 1994Method of encoding alphabetic characters for a chord keyboard
US5305017Jul 13, 1992Apr 19, 1994Methods and apparatus for data input
US5327161Oct 21, 1991Jul 5, 1994Microtouch Systems, Inc.System and method for emulating a mouse input device with a touchpad input device
US5345543Nov 16, 1992Sep 6, 1994Apple Computer, Inc.Method for manipulating objects on a computer display
US5369228Nov 25, 1992Nov 29, 1994Signagraphics CorporationData input device with a pressure-sensitive input surface
US5376948Apr 22, 1994Dec 27, 1994Visage, Inc.Method of and apparatus for touch-input computer and related display employing touch force location external to the display
US5379057Jul 28, 1993Jan 3, 1995Microslate, Inc.Portable computer with touch screen and computer system employing same
US5398310Apr 13, 1992Mar 14, 1995Apple Computer, IncorporatedPointing gesture based computer note pad paging and scrolling interface
US5442742Oct 14, 1993Aug 15, 1995Apple Computer, Inc.Method and apparatus for the manipulation of text on a computer display screen
US5463388Jan 29, 1993Oct 31, 1995AT&T IPM Corp.Computer mouse or keyboard input device utilizing capacitive sensors
US5463696Jul 5, 1994Oct 31, 1995Apple Computer, Inc.Recognition system and method for user inputs to a computer system
US5471578Dec 30, 1993Nov 28, 1995Xerox CorporationApparatus and method for altering enclosure selections in a gesture based input system
US5479528Jul 22, 1994Dec 26, 1995AT&T Corp.Intelligent work surfaces
US5483261Oct 26, 1993Jan 9, 1996ITU Research, Inc.Graphical input controller and method with rear screen image detection
US5488204Oct 17, 1994Jan 30, 1996Synaptics, IncorporatedPaintbrush stylus for capacitive touch sensor pad
US5495077Jun 2, 1994Feb 27, 1996Synaptics, Inc.Object position and proximity detector
US5513309May 8, 1995Apr 30, 1996Apple Computer, Inc.Graphic editor user interface for a pointer-based computer system
US5523775Jun 8, 1994Jun 4, 1996Apple Computer, Inc.Method for selecting objects on a computer display
US5530455Aug 10, 1994Jun 25, 1996Mouse Systems CorporationRoller mouse for implementing scrolling in windows applications
US5543590Sep 2, 1994Aug 6, 1996Synaptics, IncorporatedObject position detector with edge motion feature
US5543591Oct 7, 1994Aug 6, 1996Synaptics, IncorporatedObject position detector with edge motion feature and gesture recognition
US5548667Sep 7, 1994Aug 20, 1996Sony CorporationImage processing system and method thereof in which three dimensional shape is reproduced from two dimensional image data
US5563632Apr 30, 1993Oct 8, 1996Microtouch Systems, Inc.Method of and apparatus for the elimination of the effects of internal interference in force measurement systems, including touch - input computer and related displays employing touch force location measurement techniques
US5563996Sep 24, 1993Oct 8, 1996Apple Computer, Inc.Computer note pad including gesture based note division tools and method
US5565658Dec 7, 1994Oct 15, 1996Cirque CorporationCapacitance-based proximity with interference rejection apparatus and methods
US5579036Apr 28, 1994Nov 26, 1996AT&T Global Information Solutions CompanyTouch screen device and shielding bracket therefor
US5581276Sep 8, 1993Dec 3, 1996Kabushiki Kaisha Toshiba3D human interface apparatus using motion recognition based on dynamic image processing
US5581484Jun 27, 1994Dec 3, 1996Finger mounted computer input device
US5581681Jun 7, 1995Dec 3, 1996Apple Computer, Inc.Pointing gesture based computer note pad paging and scrolling interface
US5583946Sep 30, 1993Dec 10, 1996Apple Computer, Inc.Method and apparatus for recognizing gestures on a computer system
US5589856Dec 30, 1994Dec 31, 1996International Business Machines CorporationSystem & method for dynamically labeled touch sensitive buttons in a digitizing display
US5590219Mar 16, 1995Dec 31, 1996Apple Computer, Inc.Method and apparatus for recognizing gestures on a computer system
US5592566Jun 1, 1995Jan 7, 1997Apple Computer, IncorporatedMethod and apparatus for computerized recognition
US5594469Feb 21, 1995Jan 14, 1997Mitsubishi Electric Information Technology Center America Inc.Hand gesture machine control system
US5594810Jun 5, 1995Jan 14, 1997Apple Computer, Inc.Method and apparatus for recognizing gestures on a computer system
US5596694Apr 8, 1996Jan 21, 1997Apple Computer, Inc.Method and apparatus for indicating a change in status of an object and its disposition using animation
US5612719Apr 15, 1994Mar 18, 1997Apple Computer, Inc.Gesture sensitive buttons for graphical user interfaces
US5625715Oct 21, 1993Apr 29, 1997U.S. Philips CorporationMethod and apparatus for encoding pictures including a moving object
US5631805Sep 27, 1995May 20, 1997Dynapro Systems, Inc.Touch screen enclosure having an insertable graphic sheet
US5633955May 31, 1995May 27, 1997Apple Computer, Inc.Method of connecting shapes on a display of a computer system
US5634102Aug 7, 1995May 27, 1997Apple Computer, Inc.Methods and apparatus for a selectable backdrop
US5636101Sep 27, 1995Jun 3, 1997Dynapro Systems, Inc.Touch screen enclosure system having touch screen pan and hinged rear enclosure section for ease of serviceability
US5642108Dec 29, 1994Jun 24, 1997Infogrip, Inc.Chordic keyboard system for generating a signal in response to a chord that is assigned using a correlation based on a composite chord-difficulty index
US5644657Jun 1, 1995Jul 1, 1997Apple Computer, Inc.Method for locating and displaying information in a pointer-based computer system
US5666113Sep 5, 1995Sep 9, 1997MicroTouch Systems, Inc.System for using a touchpad input device for cursor control and keyboard emulation
US5666502Aug 7, 1995Sep 9, 1997Apple Computer, Inc.Graphical user interface using historical lists with field classes
US5666552Jun 1, 1995Sep 9, 1997Apple Computer, Inc.Method and apparatus for the manipulation of text on a computer display screen
US5675361Aug 23, 1995Oct 7, 1997Computer keyboard pointing device
US5675362Oct 4, 1994Oct 7, 1997Microslate, Inc.Portable computer with touch screen and computing system employing same
US5677710May 10, 1993Oct 14, 1997Apple Computer, Inc.Recognition keypad
US5689253Apr 9, 1993Nov 18, 1997Kinesis CorporationErgonomic keyboard apparatus
US5710844May 27, 1992Jan 20, 1998Apple ComputerMethod for searching and displaying results in a pen-based computer system
US5729249Aug 1, 1995Mar 17, 1998ITU Research, Inc.Touch sensitive input control device
US5729250May 8, 1995Mar 17, 1998International Business Machines CorporationFront cover assembly for a touch sensitive device
US5730165Dec 26, 1995Mar 24, 1998Time domain capacitive field detector
US5736976Feb 13, 1995Apr 7, 1998Computer data entry apparatus with hand motion sensing and monitoring
US5741990Jun 25, 1997Apr 21, 1998Notepool, Ltd.Method of and means for producing musical note relationships
US5745116Sep 9, 1996Apr 28, 1998Motorola, Inc.Intuitive gesture-based graphical user interface
US5745716Aug 7, 1995Apr 28, 1998Apple Computer, Inc.Method and apparatus for tab access and tab cycling in a pen-based computer system
US5746818Aug 29, 1996May 5, 1998Seiko Epson CorporationPigment ink composition capable of forming image having no significant bleeding or feathering
US5748184May 28, 1996May 5, 1998International Business Machines CorporationVirtual pointing device for touchscreens
US5748269Nov 21, 1996May 5, 1998Westinghouse Air Brake CompanyEnvironmentally-sealed, convectively-cooled active matrix liquid crystal display (LCD)
US5764222May 28, 1996Jun 9, 1998International Business Machines CorporationVirtual pointing device for touchscreens
US5767457Nov 13, 1995Jun 16, 1998Cirque CorporationApparatus and method for audible feedback from input device
US5767842Apr 21, 1995Jun 16, 1998International Business Machines CorporationMethod and device for optical input of commands or data
US5790104Jun 25, 1996Aug 4, 1998International Business Machines CorporationMultiple, moveable, customizable virtual pointing devices
US5790107Jun 7, 1995Aug 4, 1998Logitech, Inc.Touch sensing method and apparatus
US5802516May 30, 1995Sep 1, 1998Apple Computer, Inc.Method of controlling an electronic book for a computer system
US5808567May 17, 1993Sep 15, 1998DSI Datotech Systems, Inc.Apparatus and method of communicating using three digits of a hand
US5809267Mar 18, 1996Sep 15, 1998Xerox CorporationApparatus and method for executing multiple-concatenated command gestures in a gesture based input system
US5821690Apr 22, 1996Oct 13, 1998Cambridge Display Technology LimitedElectroluminescent devices having a light-emitting layer
US5821930May 30, 1996Oct 13, 1998U S West, Inc.Method and system for generating a working window in a computer system
US5823782Jul 9, 1997Oct 20, 1998Tinkers & ChanceCharacter recognition educational system
US5825351Nov 15, 1995Oct 20, 1998Apple Computer, Inc.Method and apparatus for noise filtering for an input device
US5825352Feb 28, 1996Oct 20, 1998Logitech, Inc.Multiple fingers contact sensing method for emulating mouse buttons and mouse operations on a touch sensor pad
US5835079Jun 13, 1996Nov 10, 1998International Business Machines CorporationVirtual pointing device for touchscreens
US5837947Feb 9, 1996Nov 17, 1998Symbios, Inc.Method and apparatus for reducing noise in an electrostatic digitizing table
US5854625Nov 6, 1996Dec 29, 1998Synaptics, IncorporatedForce sensing touchpad
US5856824Jun 25, 1996Jan 5, 1999International Business Machines Corp.Reshapable pointing device for touchscreens
US5877748Nov 20, 1995Mar 2, 1999Computer control input interface system
US5880411Mar 28, 1996Mar 9, 1999Synaptics, IncorporatedObject position detector with edge motion feature and gesture recognition
US5883619Nov 12, 1996Mar 16, 1999Primax Electronics Ltd.Computer mouse for scrolling a view of an image
US5886697Mar 7, 1997Mar 23, 1999Sun Microsystems, Inc.Method and apparatus for improved graphical user interface having anthropomorphic characters
US5896126Aug 29, 1996Apr 20, 1999International Business Machines CorporationSelection device for touchscreen systems
US5898434Aug 22, 1994Apr 27, 1999Apple Computer, Inc.User interface system having programmable user interface elements
US5917476Sep 24, 1996Jun 29, 1999Cursor feedback text input method
US5920309Jan 4, 1996Jul 6, 1999Logitech, Inc.Touch sensing method and apparatus
US5923319Nov 7, 1997Jul 13, 1999International Business Machines CorporationFront cover assembly for touch sensitive device
US5933134Jun 25, 1996Aug 3, 1999International Business Machines CorporationTouch screen virtual pointing device which goes into a translucent hibernation state when not in use
US5943043Dec 5, 1996Aug 24, 1999International Business Machines CorporationTouch panel "double-touch" input method and detection apparatus
US5943044May 15, 1997Aug 24, 1999Interlink ElectronicsForce sensing semiconductive touchpad
US5982302Mar 7, 1994Nov 9, 1999Touch-sensitive keyboard/mouse
US5995106Aug 19, 1997Nov 30, 1999Sun Microsystems, Inc.Graphical user interface for displaying and navigating in a directed graph structure
US6002389Sep 23, 1997Dec 14, 1999Logitech, Inc.Touch and pressure sensing method and apparatus
US6002808Jul 26, 1996Dec 14, 1999Mitsubishi Electric Information Technology Center America, Inc.Hand gesture control system
US6020881Feb 18, 1997Feb 1, 2000Sun MicrosystemsGraphical user interface with method and apparatus for interfacing to remote devices
US6031524Jun 18, 1997Feb 29, 2000Intermec IP Corp.Hand-held portable data terminal having removably interchangeable, washable, user-replaceable components with liquid-impervious seal
US6037882Sep 30, 1997Mar 14, 2000Method and apparatus for inputting data to an electronic system
US6050825May 8, 1998Apr 18, 2000Opaque, one-size-fits-all computer keyboard cover which covers only the three or four alpha-numeric rows
US6052339Jun 1, 1998Apr 18, 2000Asulab S.A.Watch with touch reading and setting of time functions
US6061177Dec 19, 1996May 9, 2000Integrated computer display and graphical input apparatus and method
US6072494Oct 15, 1997Jun 6, 2000Electric Planet, Inc.Method and apparatus for real-time gesture recognition
US6084576Mar 4, 1998Jul 4, 2000User friendly keyboard
US6097371Mar 12, 1996Aug 1, 2000Microsoft CorporationSystem and method of adjusting display characteristics of a displayable data file using an ergonomic computer input device
US6107997Jun 27, 1996Aug 22, 2000Touch-sensitive keyboard/mouse and computing device using the same
US6128003Dec 22, 1997Oct 3, 2000Hitachi, Ltd.Hand gesture recognition system and method
US6131299Jul 1, 1998Oct 17, 2000Faro Technologies, Inc.Display device for a coordinate measurement machine
US6135958Aug 6, 1998Oct 24, 2000Acuson CorporationUltrasound imaging system with touch-pad pointing device
US6144380Feb 19, 1997Nov 7, 2000Apple Computer Inc.Method of entering and using handwriting to identify locations within an electronic book
US6147680Jun 3, 1997Nov 14, 2000KOA T&T CorporationTouchpad with interleaved traces
US6154209Apr 26, 1999Nov 28, 2000Sun Microsystems, Inc.Graphical user interface with method and apparatus for interfacing to remote devices
US6160551Mar 20, 1995Dec 12, 2000Sun Microsystems, Inc.Graphical user interface for displaying and manipulating objects
US6188391Jul 9, 1998Feb 13, 2001Synaptics, Inc.Two-layer capacitive touchpad and method of making same
US6198515Mar 16, 1998Mar 6, 2001Apparatus and method for controlled sealing between bezel and CRT
US6208329Aug 13, 1996Mar 27, 2001LSI Logic CorporationSupplemental mouse button emulation system, method and apparatus for a coordinate based data input device
US6222465Dec 9, 1998Apr 24, 2001Lucent Technologies Inc.Gesture-based computer interface
US6239790Aug 17, 1999May 29, 2001Interlink ElectronicsForce sensing semiconductive touchpad
US6243071Nov 3, 1993Jun 5, 2001Apple Computer, Inc.Tool set for navigating through an electronic book
US6246862Feb 3, 1999Jun 12, 2001Motorola, Inc.Sensor controlled user interface for portable communication device
US6249606Feb 19, 1998Jun 19, 2001Mindmaker, Inc.Method and system for gesture category recognition and training using a feature vector
US6255604May 29, 1996Jul 3, 2001Canon Kabushiki KaishaCoordinate detecting device for outputting coordinate data when two points are simultaneously depressed, method therefor and computer control device
US6278443Apr 30, 1998Aug 21, 2001International Business Machines CorporationTouch screen with random finger placement and rolling on screen to control the movement of information on-screen
US6288707Jan 25, 1999Sep 11, 2001Capacitive position sensor
US6289326Jun 4, 1997Sep 11, 2001Portable interactive kiosk
US6292178Oct 19, 1998Sep 18, 2001Allergan Sales, Inc.Screen navigation control apparatus for ophthalmic surgical instruments
US6323846Jan 25, 1999Nov 27, 2001University of DelawareMethod and apparatus for integrating manual input
US6323849Jan 22, 1999Nov 27, 2001Motorola, Inc.Display module with reduced power consumption
US6344861Jul 28, 2000Feb 5, 2002Sun Microsystems, Inc.Graphical user interface for displaying and manipulating objects
US6347290Jun 24, 1998Feb 12, 2002Compaq Information Technologies Group, L.P.Apparatus and method for detecting and executing positional and gesture commands corresponding to movement of handheld computing device
US6377009Sep 7, 2000Apr 23, 2002Capacitive closure obstruction sensor
US6380931May 18, 2001Apr 30, 2002Synaptics IncorporatedObject position detector with edge motion feature and gesture recognition
US6411287Sep 8, 1999Jun 25, 2002Elo TouchSystems, Inc.Stress seal for acoustic wave touchscreens
US6414671Mar 24, 1998Jul 2, 2002Synaptics IncorporatedObject position detector with edge motion feature and gesture recognition
US6421234Oct 10, 2000Jul 16, 2002Juniper Systems, Inc.Handheld electronics device having ergonomic features
US6452514Jan 26, 2000Sep 17, 2002Capacitive sensor and array
US6457355Aug 24, 2000Oct 1, 2002Level sensing
US6466036Sep 7, 1999Oct 15, 2002Charge transfer capacitance measurement circuit
US6515669Oct 6, 1999Feb 4, 2003Olympus Optical Co., Ltd.Operation input device applied to three-dimensional input device
US6525749Oct 25, 1996Feb 25, 2003Xerox CorporationApparatus and method for supporting the implicit structure of freeform lists, outlines, text, tables and diagrams in a gesture-based input system and editing system
US6535200Aug 27, 2001Mar 18, 2003Capacitive position sensor
US6543684Mar 28, 2000Apr 8, 2003NCR CorporationTransaction terminal with privacy shield for touch-screen pin entry
US6543947Mar 14, 2001Apr 8, 2003Keyboard having keys arranged in a pan configuration
US6570557Feb 10, 2001May 27, 2003Finger Works, Inc.Multi-touch system and method for emulating modifier keys via fingertip chords
US6593916Nov 3, 2000Jul 15, 2003Touchscreen having multiple parallel connections to each electrode in a series resistor chain on the periphery of the touch area
US6610936Aug 12, 1997Aug 26, 2003Synaptics, Inc.Object position detector with edge motion feature and gesture recognition
US6624833Apr 17, 2000Sep 23, 2003Lucent Technologies Inc.Gesture-based input interface system with shadow detection
US6639577May 28, 1998Oct 28, 2003Gemstar-TV Guide International, Inc.Portable information display device with ergonomic bezel
US6650319Mar 5, 1999Nov 18, 2003Elo Touchsystems, Inc.Touch screen based topological mapping with resistance framing design
US6658994Mar 31, 2003Dec 9, 2003Chromalox, Inc.Modular assembly for a holding cabinet controller
US6670894Feb 1, 2002Dec 30, 2003System and method for keyboard independent touch typing
US6677932Jan 28, 2001Jan 13, 2004Finger Works, Inc.System and method for recognizing touch typing under limited tactile feedback conditions
US6677934Jul 30, 1999Jan 13, 2004L-3 CommunicationsInfrared touch panel with improved sunlight rejection
US6724366Apr 3, 2001Apr 20, 2004Thumb actuated x-y input device
US6757002Nov 4, 1999Jun 29, 2004Hewlett-Packard Development Company, L.P.Track pad pointing device with areas of specialized function
US6803906Jul 5, 2000Oct 12, 2004Smart Technologies, Inc.Passive touch system and method of detecting user input
US6842672Feb 24, 2004Jan 11, 2005Garmin International, Inc.Cockpit instrument panel systems and methods with redundant flight data display
US6856259Feb 6, 2004Feb 15, 2005Elo Touchsystems, Inc.Touch sensor system to detect multiple touch events
US6888536Jul 31, 2001May 3, 2005The University of DelawareMethod and apparatus for integrating manual input
US6900795Feb 27, 2002May 31, 2005Unitary molded lens filter for touch screen interface
US6927761Mar 29, 2002Aug 9, 20053M Innovative Properties CompanyMoisture deflector for capacitive NFI touch screens for use with bezels of conductive material
US6942571Oct 16, 2000Sep 13, 2005Bally Gaming, Inc.Gaming device with directional and speed control of mechanical reels using touch screen
US6965375Apr 27, 2001Nov 15, 2005Palm, Inc.Compact integrated touch panel display for a handheld device
US6972401Jan 30, 2003Dec 6, 2005Smart Technologies Inc.Illuminated bezel and touch system incorporating the same
US6977666Sep 3, 1999Dec 20, 2005Innovative Solutions and Support Inc.Flat panel display using dual CPU's for an aircraft cockpit
US6985801Nov 12, 2004Jan 10, 2006Garmin International, Inc.Cockpit instrument panel systems and methods with redundant flight data display
US6992659May 22, 2001Jan 31, 2006palmOne, Inc.High transparency integrated enclosure touch screen assembly for a portable hand held device
US7031228Sep 2, 2003Apr 18, 2006Asulab S.A.Timepiece with touch-type reading and control of time data
US7084859Feb 22, 2001Aug 1, 2006Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US7129416Feb 5, 2004Oct 31, 2006Apple Computer, Inc.Hybrid ground grid for printed circuit board
US7240289Jan 23, 2002Jul 3, 2007Sun Microsystems, Inc.Graphical user interface for displaying and navigating in a directed graph structure
US7339580Dec 17, 2004Mar 4, 2008Apple Inc.Method and apparatus for integrating manual input
USRE40153May 27, 2005Mar 18, 2008Apple Inc.Multi-touch system and method for emulating modifier keys via fingertip chords
US20020118848Feb 27, 2001Device using analog controls to mix compressed digital audio data
US20020140668Apr 3, 2001Thumb actuated x-y input device
US20030006974Jul 3, 2001Methods and systems for increasing the input efficiency of personal digital assistants and other handheld stylus-engagable computing devices
US20030076301Sep 26, 2002Apple Computer, Inc.Method and apparatus for accelerated scrolling
US20030076303Feb 7, 2002Apple Computers, Inc.Mouse having a rotary dial
US20030076306Jul 1, 2002Touch pad handheld device
US20030095095Nov 20, 2001Nokia CorporationForm factor for portable device
US20030095096Sep 26, 2002Apple Computer, Inc.Method and apparatus for use of rotational user inputs
US20030098858Oct 15, 2002N-trig Ltd.Dual function input device and method
US20030132950Jun 28, 2002Detecting, classifying, and interpreting input events based on stimuli in multiple sensory domains
US20030164820Jun 22, 2002Acoustic condition sensor employing a plurality of mutually non-orthogonal waves
US20030206202May 1, 2003Information processing apparatus
US20030234768May 14, 2003Input method and input device
US20040146688Dec 22, 2003Carrier which is aesthetically irreversibly convertible from planar blank to closed package for coded card and methods for manufacture and use of the same
US20040263484Jun 25, 2003Multifunctional UI input device for moblie terminals
US20050012723Jul 14, 2004MOVE MOBILE SYSTEMS, INC.System and method for a portable multimedia client
US20050052425Aug 18, 2003Movable touch pad with added functionality
US20050104867Dec 17, 2004University of DelawareMethod and apparatus for integrating manual input
US20050110768Nov 25, 2003Touch pad for handheld device
US20060022955Aug 26, 2004Visual expander
US20060022956Dec 17, 2004Touch-sensitive electronic apparatus for media applications, and methods therefor
US20060026521Jul 30, 2004Gestures for touch sensitive input devices
US20060026535Jan 18, 2005Mode-based graphical user interfaces for touch sensitive input devices
US20060026536Jan 31, 2005Gestures for touch sensitive input devices
US20060032680Aug 15, 2005Fingerworks, Inc.Method of increasing the spatial resolution of touch sensitive devices
US20060033724Sep 16, 2005Virtual input device placement on a touch screen user interface
US20060053387Sep 16, 2005Operation of a computer with touch screen interface
US20060066582Sep 24, 2004Apple Computer, Inc.Raw data track pad device and system
US20060085757Sep 16, 2005Activating virtual keys of a touch-screen virtual keyboard
US20060097991May 6, 2004Multipoint touchscreen
US20060197753Mar 3, 2006Multi-functional hand-held device
US20060232567Jul 3, 2006FINGERWORKS, INC.CAPACITIVE SENSING ARRANGEMENT
US20060238517Jun 23, 2006APPLE COMPUTER, INC.Electronic Device Having Display and Surrounding Touch Sensitive Bezel for User Interface and Control
US20060238518Jul 3, 2006FINGERWORKS, INC.TOUCH SURFACE
US20060238519Jul 3, 2006FINGERWORKS, INC.USER INTERFACE GESTURES
US20060238520Jul 3, 2006FINGERWORKS, INC.USER INTERFACE GESTURES
US20060238521Jul 3, 2006FINGERWORKS, INC.IDENTIFYING CONTACTS ON A TOUCH SURFACE
US20060238522Jul 3, 2006FINGERWORKS, INC.IDENTIFYING CONTACTS ON A TOUCH SURFACE
US20070070050Nov 14, 2006FINGERWORKS, INC.MULTI-TOUCH CONTACT MOTION EXTRACTION
US20070070051Nov 14, 2006FINGERWORKS, INC.MULTI-TOUCH CONTACT MOTION EXTRACTION
US20070070052Nov 14, 2006FINGERWORKS, INC.MULTI-TOUCH CONTACT MOTION EXTRACTION
US20070078919Nov 14, 2006FINGERWORKS, INC.MULTI-TOUCH HAND POSITION OFFSET COMPUTATION
US20070081726Nov 14, 2006FINGERWORKS, INC.MULTI-TOUCH CONTACT TRACKING ALGORITHM
US20070229464Mar 30, 2006Apple Computer, Inc.Force Imaging Input Device and System
US20070236466May 9, 2006Apple Computer, Inc.Force and Location Sensitive Display
US20070247429Apr 25, 2006APPLE COMPUTER, INC.KEYSTROKE TACTILITY ARRANGEMENT ON A SMOOTH TOUCH SURFACE
US20070257890May 2, 2006APPLE COMPUTER, INC.MULTIPOINT TOUCH SURFACE CONTROLLER
US20070268273Jul 30, 2007Apple Inc.SENSOR ARRANGEMENT FOR USE WITH A TOUCH SENSOR THAT IDENTIFIES HAND PARTS
US20070268274Jul 30, 2007Apple Inc.TOUCH SENSING WITH MOBILE SENSORS
US20070268275Jul 30, 2007Apple Inc.TOUCH SENSING WITH A COMPLIANT CONDUCTOR
US20080041639Jul 30, 2007Apple Inc.CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20080042986Jul 30, 2007Apple Inc.TOUCH SENSING ARCHITECTURE
US20080042987Jul 30, 2007Apple Inc.TOUCH SENSING THROUGH HAND DISSECTION
US20080042988Jul 30, 2007Apple Inc.WRITING USING A TOUCH SENSOR
US20080042989Jul 30, 2007Apple Inc.TYPING WITH A TOUCH SENSOR
US20080128182Jul 30, 2007Apple Inc.SENSOR ARRANGEMENT FOR USE WITH A TOUCH SENSOR
US20090021489Jun 13, 2008IDENTIFYING CONTACTS ON A TOUCH SURFACE
US20090160816Dec 22, 2008MULTI-TOUCH CONTACT MOTION EXTRACTION
US20090244031Apr 10, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20090244032Jun 5, 2009Contact Tracking and Identification Module for Touch Sensing
US20090244033Jun 5, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20090249236Jun 5, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20090251435Apr 10, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20090251438Apr 10, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING
US20090251439Apr 10, 2009CONTACT TRACKING AND IDENTIFICATION MODULE FOR TOUCH SENSING

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US8206047Jun 24, 2011Jun 26, 2012TouchFire, Inc.Keyboard overlay for optimal touch typing on a proximity-based touch screen

Claims

1. A method of processing input from a touch-sensitive surface, the method comprising:

receiving at least one proximity image representing a scan of a plurality of electrodes of the touch-sensitive surface;

segmenting each proximity image into one or more pixel groups that indicate significant proximity, each pixel group representing proximity of a distinguishable hand part or other touch object on or near the touch-sensitive surface; and

mathematically fitting an ellipse to at least one of the pixel groups.

2. The method of claim 1 further comprising transmitting one or more ellipse parameters as a control signal to an electronic or electromechanical device.

3. The method of claim 2 wherein the one or more ellipse parameters is selected from the group consisting of position, shape, size, orientation, eccentricity, major radius, minor radius, and any combination thereof.

4. The method of claim 3 wherein the one or more ellipse parameters are used to distinguish a pixel group associated with a fingertip from a pixel group associated with a thumb.

5. The method of claim 1 wherein fitting an ellipse to a group of pixels comprises computing one or more eigenvalues and one or more eigenvectors of a covariance matrix associated with the pixel group.

6. The method of claim 1 further comprising: tracking a path of at least one of the one or more pixel groups through a time-sequenced series of proximity images;

fitting an ellipse to the at least one of the one or more pixel groups in each of the time-sequenced series of proximity images; and

tracking a change in one or more ellipse parameters through the time-sequenced series of proximity images.

7. The method of claim 6 further comprising transmitting the change in the one or more ellipse parameters as a control signal to an electronic or electromechanical device.

8. The method of claim 7 wherein the change in the one or more ellipse parameters is selected from the group consisting of position, shape, size, orientation, eccentricity, major radius, minor radius, and any combination thereof.

9. The method of claim 6 wherein fitting an ellipse to the one pixel group comprises computing one or more eigenvalues and one or more eigenvectors of a covariance matrix associated with the pixel group.

10. A touch-sensing device comprising:

a substrate;

a plurality of touch-sensing electrodes arranged on the substrate;

electronic scanning hardware adapted to read the plurality of touch-sensing electrodes;

a calibration module operatively coupled to the electronic scanning hardware and adapted to construct a proximity image having a plurality of pixels corresponding to the touch-sensing electrodes; and
a contact tracking and identification module adapted to:
segment the proximity image into one or more pixel groups, each pixel group representing proximity of a distinguishable hand part or other touch object on or near the touch-sensitive surface;
and
mathematically fit an ellipse to at least one of the one or more pixel groups.

11. The touch-sensing device of claim 10 further comprising a host communication interface adapted to transmit one or more ellipse parameters as a control signal to an electronic or electromechanical device.

12. The touch-sensing device of claim 11 wherein the touch-sensing device is integral with the electronic or electromechanical device.

13. The touch-sensing device of claim 11 wherein the one or more ellipse parameters comprise one or more parameters selected from the group consisting of position, shape, size, orientation, eccentricity, major radius, minor radius, and any combination thereof.

14. The method of claim 13 wherein the one or more ellipse parameters are used to distinguish a pixel group associated with a fingertip from a pixel group associated with a thumb.

15. The touch-sensing device of claim 10 wherein the contact tracking and identification module is adapted to compute one or more eigenvalues and one or more eigenvectors to fit the ellipse.

16. The touch-sensing device of claim 10 wherein the contact tracking and identification module is further adapted to:

track a path of one or more pixel groups through a plurality of time-sequenced proximity images;

fit an ellipse to at least one of the one or more pixel groups in a first proximity image of the plurality of time-sequenced proximity images; and

track a change in one or more ellipse parameters associated with the fitted ellipse through two or more of the time-sequenced proximity images.

17. The touch-sensing device of claim 16 further comprising a host communication interface adapted to transmit the change in at least one of the one or more ellipse parameters as a control signal to an electronic or electromechanical device.

18. The touch-sensing device of claim 17 wherein the touch-sensing device is integral with the electronic or electromechanical device.

19. The touch-sensing device of claim 17 wherein the change in one or more ellipse parameters used as a control input to an electronic or electromechanical device comprises one or more parameters selected from the group consisting of position, shape, size, orientation, eccentricity, major radius, minor radius, and any combination thereof.

20. The touch-sensing device of claim 16 wherein the contact tracking and identification module is adapted to compute one or more eigenvalues and one or more eigenvectors to fit the ellipse.

21. The touch-sensing device of any one of claims 10-12 and 16-18 wherein the touch-sensing device is fabricated on or integrated with a display device.

22. The touch-sensing device of claim 21, wherein the display device comprises a liquid crystal display (LCD) or a light-emitting polymer display (LPD).

23. A computer-readable medium having embodied thereon instructions executable by a machine to perform a method according to any of claims 1-9.

24. A touch-sensing device comprising:

means for producing a proximity image representing a scan of a plurality of electrodes of a touch-sensitive surface, the proximity image having a plurality of pixels corresponding to the touch-sensing electrodes; and

means for segmenting the proximity image into one or more pixel groups, each pixel group representing a touch object on or near the touch-sensitive surface; and

means for fitting an ellipse to at least one of the pixel groups.

25. The touch-sensing device of claim 24 wherein the touch object comprises at least a portion of a hand.

26. The touch-sensing device of claim 24 wherein the touch object comprises at least a portion of one or more fingers.

27. The touch-sensing device of claim 24 wherein the touch object comprises at least a portion of a body part.

28. The touch-sensing device of claim 27 wherein the body part comprises one or more of a hand, a finger, an ear, or a cheek.

29. The touch-sensing device of claim 24 further comprising means for transmitting one or more ellipse parameters as a control signal to an electronic or electromechanical device.

30. The touch-sensing device of claim 27 wherein the touch-sensing device is integral with the electronic or electromechanical device.

31. The touch-sensing device of claim 24 further comprising:

means for tracking a path of one or more pixel groups through a plurality of time-sequenced proximity images;

means for fitting an ellipse to at least one of the pixel groups in a plurality successive proximity images; and

means for tracking a change in one or more ellipse parameters through a plurality of time-sequenced proximity images.

32. The touch-sensing device of claim 29 further comprising means for transmitting the change in the one or more ellipse parameters as a control signal to an electronic or electromechanical device.

33. The touch-sensing device of claim 32 wherein the touch-sensing device is integral with the electronic or electromechanical device.

34. The touch-sensing device of any one of claims 24 and 29-33 wherein the touch-sensing device is fabricated on or integrated with a display device.

35. The touch-sensing device of claim 34, wherein the display device comprises a liquid crystal display (LCD) or a light-emitting polymer display (LPD).

Drawings