Search Images Maps Play YouTube News Gmail Drive More »
Advanced Patent Search | Web History | Sign in

Patents

A computer system includes a computer processor, an operating system operative in connection with the computer processor, and a display responsive to the operating system. The system also has a pointing device that includes a position sensor and a tactile actuator. A pointing device driver is responsive to the position sensor, and the tactile actuator is responsive to the pointing device driver. A general-purpose application is responsive to the pointing device driver and to the operating system and in communication with the display, and the pointing device driver is also responsive to the general purpose application. The system further includes a profile that maps region changes associated with material displayed on the screen to tactile signals to be sent to the tactile actuator.

InventorsKristofer E. Elbing, Jonathan T. Foote
Current U.S. Classification345/158; 715/863
International Classification: G09G 500

View patent at USPTO
Search USPTO Assignment Database

Citations

Cited PatentFiling dateIssue dateOriginal AssigneeTitle
US3919691May 26, 19711975TACTILE MAN-MACHINE COMMUNICATION SYSTEM
US4104603Feb 16, 1977Aug 1, 1978HEI, Inc.Tactile feel device
US4185283Jan 9, 1978Jan 22, 1980Multiple character word indication system employing sequential sensible indicia
US4334280Jun 9, 1980Jun 8, 1982Texas Instruments IncorporatedSystem and method for providing an audible sound and a tactile feedback in an electronic data processing system
US4557182Jun 7, 1984Dec 10, 1985Expansion chamber devices
US4664339Oct 11, 1984May 12, 1987The Boeing CompanyMissile appendage deployment mechanism
US4687444Mar 31, 1986Aug 18, 1987The United States of America as represented by the Administrator of the National Aeronautics & Space AdministrationBraille reading system
US4868549May 18, 1987Sep 19, 1989International Business Machines CorporationFeedback mouse
US4885565Jun 1, 1988Dec 5, 1989General Motors CorporationTouchscreen CRT with tactile feedback
US4905001Oct 8, 1987Feb 27, 1990Hand-held finger movement actuated communication devices and systems employing such devices
US5091865Jun 24, 1991Feb 25, 1992Canon Kabushiki KaishaPattern reading apparatus having variable reading period
US5186629Aug 22, 1991Feb 16, 1993International Business Machines CorporationVirtual graphics display capable of presenting icons and windows to the blind computer user and method
US5223828Aug 19, 1991Jun 29, 1993International Business Machines CorporationMethod and system for enabling a blind computer user to handle message boxes in a graphical user interface
US5287102Dec 20, 1991Feb 15, 1994International Business Machines CorporationMethod and system for enabling a blind computer user to locate icons in a graphical user interface
US5296871Jul 27, 1992Mar 22, 1994Three-dimensional mouse with tactile feedback
US5351677Apr 15, 1992Oct 4, 1994Olympus Optical Co., Ltd.Medical system having object information reproduction means for palpation
US5461399Dec 23, 1993Oct 24, 1995International Business MachinesMethod and system for enabling visually impaired computer users to graphically select displayed objects
US5751843Feb 8, 1996May 12, 1998Siemens AktiengesellschaftMethod for detecting the spatial position and rotational position of suitably marked objects in digital image sequences
US5796406Jun 1, 1995Aug 18, 1998Sharp Kabushiki KaishaGesture-based input information processing apparatus
US5861886Jun 26, 1996Jan 19, 1999Xerox CorporationMethod and apparatus for grouping graphic objects on a computer based system having a graphical user interface
US5867146Jan 10, 1997Feb 2, 1999LG Electronics Inc.Three dimensional wireless pointing device
US5870080Mar 14, 1996Feb 9, 1999Gateway 2000, Inc.Electro-magnetic transceiver combined with a pointing device
US5874942Nov 20, 1995Feb 23, 1999VIR Systems Pty. Ltd.Sensor data processing
US5880714Jan 15, 1997Mar 9, 1999Immersion CorporationThree-dimensional cursor control interface with force feedback

Referenced by

Citing PatentFiling dateIssue dateOriginal AssigneeTitle
US6392675Feb 24, 1999May 21, 2002International Business Machines CorporationVariable speed cursor movement
US6422942Jan 11, 2000Jul 23, 2002Virtual game board and tracking device therefor
US6636161Jul 10, 2001Oct 21, 2003Immersion CorporationIsometric haptic feedback interface
US6683598Sep 1, 1999Jan 27, 2004Microsoft CorporationMouse optical sampling scheme
US6686901Jan 26, 2001Feb 3, 2004Immersion CorporationEnhancing inertial tactile feedback in computer interface devices having increased mass
US6686911Oct 2, 2000Feb 3, 2004Immersion CorporationControl knob with control modes and force feedback
US6693626May 12, 2000Feb 17, 2004Immersion CorporationHaptic feedback using a keyboard device
US6703550Oct 10, 2001Mar 9, 2004Immersion CorporationSound data output and manipulation using haptic feedback
US6707443Feb 18, 2000Mar 16, 2004Immersion CorporationHaptic trackball device
US6715045Jan 29, 2002Mar 30, 2004Immersion CorporationHost cache for haptic feedback effects
US6717573Jan 12, 2001Apr 6, 2004Immersion CorporationLow-cost haptic mouse implementations
US6750877Jan 16, 2002Jun 15, 2004Immersion CorporationControlling haptic feedback for enhancing navigation in a graphical environment
US6762745May 5, 2000Jul 13, 2004Immersion CorporationActuator control providing linear and continuous force output
US6816148Sep 18, 2001Nov 9, 2004Immersion CorporationEnhanced cursor control using interface devices
US6833846Oct 23, 2002Dec 21, 2004Immersion CorporationControl methods for the reduction of limit cycle oscillations for haptic devices with displacement quantization
US6904823Apr 3, 2002Jun 14, 2005Immersion CorporationHaptic shifting devices
US6906697Aug 10, 2001Jun 14, 2005Immersion CorporationHaptic sensations for tactile feedback interface devices
US6928386Mar 18, 2003Aug 9, 2005Immersion CorporationHigh-resolution optical encoder with phased-array photodetectors
US6956558Oct 2, 2000Oct 18, 2005Immersion CorporationRotary force feedback wheels for remote control devices
US6982696Jun 30, 2000Jan 3, 2006Immersion CorporationMoving magnet actuator for providing haptic feedback
US6999066Jun 24, 2002Feb 14, 2006Xerox CorporationSystem for audible feedback for touch screen displays
US7038667Aug 11, 2000May 2, 2006Immersion CorporationMechanisms for control knobs and other interface devices
US7056123Jul 15, 2002Jun 6, 2006Immersion CorporationInterface apparatus with cable-driven force feedback and grounded actuators
US7061466May 4, 2000Jun 13, 2006Immersion CorporationForce feedback device including single-phase, fixed-coil actuators
US7084854Sep 27, 2001Aug 1, 2006Immersion CorporationActuator for providing tactile sensations and device for directional tactile sensations
US7091948Sep 4, 2001Aug 15, 2006Immersion CorporationDesign of force sensations for haptic feedback computer interfaces
US7102541Oct 20, 2003Sep 5, 2006Immersion CorporationIsotonic-isometric haptic feedback interface
US7104152Dec 29, 2004Sep 12, 2006Immersion CorporationHaptic shifting devices
US7106305Dec 16, 2003Sep 12, 2006Immersion CorporationHaptic feedback using a keyboard device
US7106313Dec 11, 2000Sep 12, 2006Immersion CorporationForce feedback interface device with force functionality button
US7112737Jul 15, 2004Sep 26, 2006Immersion CorporationSystem and method for providing a haptic effect to a musical instrument
US7116317Apr 23, 2004Oct 3, 2006Immersion CorporationSystems and methods for user interfaces designed for rotary input devices
US7136045Mar 1, 2001Nov 14, 2006Immersion CorporationTactile mouse
US7148875Aug 6, 2002Dec 12, 2006Immersion CorporationHaptic feedback for touchpads and other touch controls
US7154470Jul 29, 2002Dec 26, 2006Immersion CorporationEnvelope modulator for haptic feedback devices
US7159008Jun 30, 2000Jan 2, 2007Immersion CorporationChat interface with haptic feedback functionality
US7168042Oct 9, 2001Jan 23, 2007Immersion CorporationForce effects for object types in a graphical user interface
US7176898Sep 13, 2002Feb 13, 2007Xerox CorporationRemovable control panel for multi-function equipment
US7191191Apr 12, 2002Mar 13, 2007Immersion CorporationHaptic authoring
US7193607Mar 17, 2003Mar 20, 2007Immersion CorporationFlexure mechanism for interface device
US7198137Jul 29, 2004Apr 3, 2007Immersion CorporationSystems and methods for providing haptic feedback with position sensing
US7198137Jul 29, 2004Apr 3, 2007Immersion CorporationSystems and methods for providing haptic feedback with position sensing
US7202851May 4, 2001Apr 10, 2007Immersion Medical Inc.Haptic interface for palpation simulation
US7208671Feb 20, 2004Apr 24, 2007Immersion CorporationSound data output and manipulation using haptic feedback
US7209028Mar 14, 2005Apr 24, 2007Immersion CorporationPosition sensor with resistive element
US7218310Jul 17, 2001May 15, 2007Immersion CorporationProviding enhanced haptic feedback effects
US7245202Sep 10, 2004Jul 17, 2007Immersion CorporationSystems and methods for networked haptic devices
US7253803Jan 5, 2001Aug 7, 2007Immersion CorporationForce feedback interface device with sensor
US7265750Mar 5, 2002Sep 4, 2007Immersion CorporationHaptic feedback stylus and other devices
US7283120Jan 16, 2004Oct 16, 2007Immersion CorporationMethod and apparatus for providing haptic feedback having a position-based component and a predetermined time-based component
US7283123Apr 12, 2002Oct 16, 2007Immersion CorporationTextures and other spatial sensations for a relative haptic interface device
US7299321Nov 14, 2003Nov 20, 2007Memory and force output management for a force feedback system
US7307619Apr 19, 2006Dec 11, 2007Immersion Medical, Inc.Haptic interface for palpation simulation
US7307619Apr 19, 2006Dec 11, 2007Immersion Medical, Inc.Haptic interface for palpation simulation
US7327348Aug 14, 2003Feb 5, 2008Immersion CorporationHaptic feedback effects for control knobs and other interface devices
US7336260Nov 1, 2002Feb 26, 2008Immersion CorporationMethod and apparatus for providing tactile sensations
US7337400Apr 16, 2001Feb 26, 2008Tactile user interface with application-specific tactile behavior
US7345672Feb 27, 2004Mar 18, 2008Immersion CorporationForce feedback system and actuator power management
US7386415Jul 12, 2005Jun 10, 2008Immersion CorporationSystem and method for increasing sensor resolution using interpolation
US7404716Dec 12, 2005Jul 29, 2008Immersion CorporationInterface apparatus with cable-driven force feedback and four grounded actuators
US7405729Jul 20, 2006Jul 29, 2008Immersion CorporationSystems and methods for user interfaces designed for rotary input devices
US7423631Apr 5, 2004Sep 9, 2008Immersion CorporationLow-cost haptic mouse implementations
US7432910Feb 23, 2004Oct 7, 2008Immersion CorporationHaptic interface device and actuator assembly providing linear haptic sensations
US7447604Nov 23, 2004Nov 4, 2008Immersion CorporationMethod and apparatus for compensating for position slip in interface devices
US7450110Aug 17, 2004Nov 11, 2008Immersion CorporationHaptic input devices
US7453039Aug 18, 2006Nov 18, 2008Immersion CorporationSystem and method for providing haptic feedback to a musical instrument
US7472047Mar 17, 2004Dec 30, 2008Immersion CorporationSystem and method for constraining a graphical hand from penetrating simulated graphical objects
US7477237Jun 3, 2004Jan 13, 2009Immersion CorporationSystems and methods for providing a haptic manipulandum
US7502011Jun 25, 2002Mar 10, 2009Immersion CorporationHybrid control of haptic feedback for host computer and interface device
US7522152May 27, 2004Apr 21, 2009Immersion CorporationProducts and processes for providing haptic feedback in resistive interface devices
US7535454May 21, 2003May 19, 2009Immersion CorporationMethod and apparatus for providing haptic feedback
US7548232Aug 17, 2004Jun 16, 2009Immersion CorporationHaptic interface for laptop computers and other portable devices
US7561141Feb 23, 2004Jul 14, 2009Immersion CorporationHaptic feedback device with button forces
US7564444Oct 17, 2005Jul 21, 2009Immersion CorporationSystem and method of applying force feedback to a manipulandum wheel utilized with a graphical user interface
US7567232Oct 23, 2002Jul 28, 2009Immersion CorporationMethod of using tactile feedback to deliver silent status information to a user of an electronic device
US7567243Jun 1, 2004Jul 28, 2009Immersion CorporationSystem and method for low power haptic feedback
US7623114Oct 9, 2001Nov 24, 2009Immersion CorporationHaptic feedback sensations based on audio output from computer devices
US7639232Nov 30, 2005Dec 29, 2009Immersion CorporationSystems and methods for controlling a resonant device for generating vibrotactile haptic effects
US7667687Jul 22, 2004Feb 23, 2010Immersion CorporationResistive and hybrid control schemes for haptic feedback interface devices
US7676356Oct 31, 2005Mar 9, 2010Immersion CorporationSystem, method and data structure for simulated interaction with graphical objects
US7696978Sep 28, 2004Apr 13, 2010Immersion CorporationEnhanced cursor control using interface devices
US7701438Jun 20, 2006Apr 20, 2010Immersion CorporationDesign of force sensations for haptic feedback computer interfaces
US7710399Mar 15, 2004May 4, 2010Immersion CorporationHaptic trackball device
US7728820Jul 10, 2003Jun 1, 2010Immersion CorporationHaptic feedback for touchpads and other touch controls
US7742036Jun 23, 2004Jun 22, 2010Immersion CorporationSystem and method for controlling haptic devices having multiple operational modes
US7764268Sep 24, 2004Jul 27, 2010Immersion CorporationSystems and methods for providing a haptic device
US7769417Dec 8, 2002Aug 3, 2010Immersion CorporationMethod and apparatus for providing haptic feedback to off-activating area
US7791588Dec 2, 2004Sep 7, 2010Immersion CorporationSystem and method for mapping instructions associated with haptic feedback
US7808488Mar 29, 2007Oct 5, 2010Immersion CorporationMethod and apparatus for providing tactile sensations
US7821493Apr 16, 2007Oct 26, 2010Immersion CorporationProviding enhanced haptic feedback effects
US7877243Jul 15, 2002Jan 25, 2011Immersion CorporationPivotable computer interface
US7889174Nov 8, 2006Feb 15, 2011Immersion CorporationTactile feedback interface device including display screen
US7916121Feb 3, 2009Mar 29, 2011Immersion CorporationHybrid control of haptic feedback for host computer and interface device
US7944435Sep 21, 2006May 17, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US7978183Nov 15, 2007Jul 12, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US7978186Sep 22, 2005Jul 12, 2011Immersion CorporationMechanisms for control knobs and other interface devices
US7982711Dec 17, 2004Jul 19, 2011Immersion CorporationHaptic profiling system and method
US7982720Nov 15, 2007Jul 19, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US7986303Sep 25, 2007Jul 26, 2011Immersion CorporationTextures and other spatial sensations for a relative haptic interface device
US8002089Sep 10, 2004Aug 23, 2011Immersion CorporationSystems and methods for providing a haptic device
US8004492Oct 22, 2010Aug 23, 2011Immersion CorporationInterface for controlling a graphical image
US8007282Jul 25, 2008Aug 30, 2011Immersion CorporationMedical simulation interface apparatus and method
US8013847Aug 24, 2004Sep 6, 2011Immersion CorporationMagnetic actuator for providing haptic feedback
US8018434Jul 26, 2010Sep 13, 2011Immersion CorporationSystems and methods for providing a haptic device
US8020095Jun 28, 2007Sep 13, 2011Immersion CorporationForce feedback system including multi-tasking graphical host environment
US8031181Oct 30, 2007Oct 4, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US8049734Nov 15, 2007Nov 1, 2011Immersion CorporationHaptic feedback for touchpads and other touch control
US8059088Sep 13, 2005Nov 15, 2011Immersion CorporationMethods and systems for providing haptic messaging to handheld communication devices
US8059104Oct 30, 2007Nov 15, 2011Immersion CorporationHaptic interface for touch screen embodiments
US8059105Jan 14, 2008Nov 15, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US8063892Oct 30, 2007Nov 22, 2011Immersion CorporationHaptic interface for touch screen embodiments
US8063893Nov 15, 2007Nov 22, 2011Immersion CorporationHaptic feedback for touchpads and other touch controls
US8073501May 25, 2007Dec 6, 2011Immersion CorporationMethod and apparatus for providing haptic feedback to non-input locations
US8103472Aug 14, 2008Jan 24, 2012Immersion CorporationMethod and apparatus for compensating for position slip in interface devices
US8125453Oct 20, 2003Feb 28, 2012Immersion CorporationSystem and method for providing rotational haptic feedback
US8154512Apr 20, 2009Apr 10, 2012Immersion CoporationProducts and processes for providing haptic feedback in resistive interface devices
US8159461Sep 30, 2010Apr 17, 2012Immersion CorporationMethod and apparatus for providing tactile sensations
US8164573Nov 26, 2003Apr 24, 2012Immersion CorporationSystems and methods for adaptive interpretation of input from a touch-sensitive input device
US8188981Oct 30, 2007May 29, 2012Immersion CorporationHaptic interface for touch screen embodiments
US8212772Oct 6, 2008Jul 3, 2012Immersion CorporationHaptic interface device and actuator assembly providing linear haptic sensations
US8217892May 6, 2008Jul 10, 2012Dell Products L.P.Tactile feedback input device
US8232969Oct 11, 2005Jul 31, 2012Immersion CorporationHaptic feedback for button and scrolling action simulation in touch input devices
USRE39906Jun 21, 2001Nov 6, 2007Immersion CorporationGyro-stabilized platforms for force-feedback applications
USRE40808Jun 18, 2004Jun 30, 2009Immersion CorporationLow-cost haptic mouse implementations
USRE42183Sep 8, 1999Mar 1, 2011Immersion CorporationInterface control

Claims

1. A computer system, comprising:

a computer processor,
an operating system operative in connection with the computer processor,
a display responsive to the operating system,
a pointing device including:
a position sensor having an output line, and
a tactile actuator having an input line,
a pointing device driver responsive to the output line of the position sensor and wherein the input line of the tactile actuator is responsive to the pointing device driver,
a general-purpose application responsive to the pointing device driver and to the operating system and in communication with the display, and wherein the pointing device driver is responsive to the general purpose application, and
a profile that maps region changes associated with material displayed on the screen to tactile signals to be sent to the tactile actuator.

2. The computer system of claim 1 wherein the system is operative to detect movement from one group of regions to another and change profiles based on the detected movement.

3. The computer system of claim 2 wherein the system is further operative to send a boundary actuation command to the tactile actuator upon detecting the movement from one group of regions to another.

4. The computer system of claim 2 wherein the groups of regions correspond to different display windows.

5. The computer system of claim 1 wherein the system is operative to automatically determine a range of region attributes and normalize the intensity of the tactile signals based on this determination.

6. The computer system of claim 1 wherein the system is operative to detect a guard band surrounding transitions between regions in the map.

7. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and provide tactile signals to the tactile actuator in anticipation of changes in the regions when the speed exceeds a certain value.

8. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and simplify tactile signals to the tactile actuator when the speed meets certain criteria.

9. The computer system of claim 1 wherein the system is operative to detect a speed of motion from the position sensor and eliminate tactile signals to the tactile actuator when the speed meets certain criteria.

10. The computer system of claim 1 wherein the profile includes a storage element that specifies whether heuristics are to be applied to determine a relationship between region changes and tactile signals.

11. The computer system of claim 1 wherein the system is operative to change display attributes of a cursor displayed on the screen when the position sensor indicates a change in position.

12. The computer system of claim 1 wherein the pointing device further includes a tactility control and wherein the system is operative to send different tactile signals to the actuator in response to user actuation of the tactility control.

13. The computer system of claim 1 further including a housing and wherein the tactile actuator is a pressure-wave generating tactile actuator mounted inside a portion of the pointing device housing.

14. The computer system of claim 13 wherein the pointing device is a mouse, wherein the housing is a housing of the mouse, and wherein the transducer is mounted inside the housing of the mouse.

15. The computer system of claim 13 wherein the system is operative to send finite duration pulses to the actuator that are no longer than ten cycles long for an individual change in regions.

16. The computer system of claim 1 wherein the position sensor is in a mouse and wherein the actuator is in a mouse pad.

17. The computer system of claim 1 wherein the actuator and the position sensor are in a touch pad.

18. The computer system of claim 1 wherein the profile maps regions that match display regions displayed on the display.

19. The computer system of claim 18 wherein the profile maps regions that correspond to absolute display intensity of the display regions.

20. The computer system of claim 18 wherein the profile maps regions that are arranged in a regularly spaced Cartesian grid.

21. The computer system of claim 18 wherein the profile maps at least some of the regions to correspond to cells each containing a single alphanumeric character.

22. The computer of claim 18 wherein the system is operative to translate a difference in a property value of two of the regions into an intensity of a tactile signal.

23. The computer system of claim 1 wherein the system further includes an audio device and is operative to provide an audio signal to the audio device, and wherein information transmitted by the audio signal corresponds to information transmitted by the tactile signal.

24. A method of operating a computer, comprising:

maintaining a map of a plurality of regions corresponding to regions displayed on a display screen,
responding to signals from a pointing device to define a cursor position relative to the regions expressed in the map,
displaying a cursor in a first of the regions displayed on the display screen,
detecting a signal from a pointing device that indicates user actuation of the pointing device corresponding to a movement of the cursor from a first of the regions expressed in the map to a second of the regions expressed in the map,
sending an actuation command request signal to an actuator in the pointing device in response to the detection of user actuation in the step of detecting, and
generating a tactile signal in the pointing device in response to the actuation command.

25. The method of claim 24 wherein the steps of detecting, sending, and generating cooperate to provide actuation request signals substantially only during displacement of the pointing device, delayed by processing overhead.

26. A computer memory for use with a computer system with a tactile user interface and a window-based operating system, comprising:

a boundary descriptor stored in the memory and operative to instruct the system whether a boundary between portions of a display layout within a first of a plurality of different general-purpose application windows is to be associated with tactile attributes to be presented to the user,
a heuristic flag stored in the memory and operative to instruct the system whether to use heuristics to determine how to associate the display layout within the first window with tactile attributes, and
at least one further mapping element stored in the memory and which defines a predefined relationship between the display layout within the first window and tactile attributes.

27. The computer memory of claim 26 wherein the further mapping element is a preferred element, and further including an additional further mapping element stored in the memory, the additional further element being a default element.