Search Images Maps Play YouTube News Gmail Drive More »
Sign in
Screen reader users: click this link for accessible mode. Accessible mode has the same essential features but works better with your reader.

Patents

  1. Advanced Patent Search
Publication numberUS20030117378 A1
Publication typeApplication
Application numberUS 10/317,504
Publication dateJun 26, 2003
Filing dateDec 12, 2002
Priority dateDec 21, 2001
Also published asUS20120200519
Publication number10317504, 317504, US 2003/0117378 A1, US 2003/117378 A1, US 20030117378 A1, US 20030117378A1, US 2003117378 A1, US 2003117378A1, US-A1-20030117378, US-A1-2003117378, US2003/0117378A1, US2003/117378A1, US20030117378 A1, US20030117378A1, US2003117378 A1, US2003117378A1
InventorsFernando Incertis Carro
Original AssigneeInternational Business Machines Corporation
Export CitationBiBTeX, EndNote, RefMan
External Links: USPTO, USPTO Assignment, Espacenet
Device and system for retrieving and displaying handwritten annotations
US 20030117378 A1
Abstract
An apparatus for capturing and displaying handwritten annotations, for use with a computer system, comprises a transparent digitizing tablet adapted to cooperate with a stylus in order to capture handwritten annotations. It also comprises a transparent electro-luminescent display adapted to display captured handwritten annotations, the transparent digitizing tablet being superposed on the transparent electro-luminescent display.
Images(10)
Previous page
Next page
Claims(5)
I claim:
1. Apparatus for capturing and displaying handwritten annotations, for use with a computer system, the apparatus comprising:
a substantially transparent digitizing tablet responsive to a stylus for capturing handwritten annotations; and
a substantially transparent electro-luminescent display for displaying handwritten annotations captured by the digitizing tablet;
wherein the digitizing tablet is superposed on the electro-luminescent display.
2. The apparatus of claim 1, wherein the electro-luminescent display is a transparent organic light-emitting device.
3. A system for capturing and displaying electronic handwritten annotations, comprising:
a substantially transparent digitizing tablet responsive to a stylus for capturing handwritten annotations and a substantially transparent electro-luminescent display for displaying and highlighting handwritten annotations captured by the digitizing tablet, wherein the digitizing tablet is superposed on the electro-luminescent display;
a computer system;
means for digitizing annotations made by the stylus on the digitizing tablet and sending the digitized annotations to the computer system; and
means for transmitting digitized annotations from the computer system to the electro-luminescent display.
4. The system of claim 3, wherein the computer system includes means for storing digitized annotations received from the digitizing table.
5. The system of claim 4, wherein a digitized annotation is stored in the computer system in association with a reference to a physical document.
Description
    FIELD OF THE INVENTION
  • [0001]
    The present invention generally relates to computer interfaces used to input information relating to a physical document. More particularly, the invention relates to a device for capturing and displaying handwritten annotations and a computer system using such a device.
  • BACKGROUND
  • [0002]
    For most people, handwriting on a physical medium is the most natural manner of recording information. Thus, digitizing tablets are commonly used as input devices for computer systems allowing the entry of handwritten information into a computer. Moreover, in the prior art, several techniques have been described using a transparent digitizing tablet superposed on a display device, such as an LCD screen. Such a device allows an electronic form to be displayed by the LCD screen, through the digitizing tablet, and the strokes or annotations produced by a pencil-like stylus on the digitizing tablet to be displayed on the underlying display device. An example of these techniques is described in U.S. Pat. No. 6,212,297, by Sklarew, entitled “Handwritten keyboardless entry computer system”. Such a device is not adapted to be used with a physical document but only with an electronic document.
  • [0003]
    Other types of interfaces make it possible to write with real ink over a physical document, in paper form for example, superposed on a digitizing tablet. This latter is enabled to digitize and capture information handwritten on physical documents. However, such a method degrades the integrity of original physical documents since the document is marked with real ink annotations.
  • SUMMARY
  • [0004]
    A main object of the present invention is to overcome the above-mentioned drawbacks and to propose a new apparatus and system adapted to associate additional information with physical documents while keeping intact the integrity of the physical documents.
  • [0005]
    In a first aspect, the present invention relates to an apparatus for capturing and displaying handwritten annotations, for use with a computer system, comprising a transparent digitizing tablet adapted to cooperate with a stylus in order to capture handwritten annotations. The apparatus comprises a transparent electro-luminescent display adapted to display captured handwritten annotations, said transparent digitizing tablet being superposed on said transparent electro-luminescent display.
  • [0006]
    Thanks to the transparent electro-luminescent display and the transparent digitizing tablet superposed thereon, handwritten annotations can be marked and displayed on a physical document without physically marking the document. Thus, a user can make annotations over a physical document using “electronic ink” so that what is being “written” by the user on the physical document (on the digitizing tablet) can appear to the user electronically illuminated by the transparent electro-luminiscent display, on the same physical document.
  • [0007]
    Such an apparatus enables the user to draw, sketch, annotate, construct, outline, enhance, erase, associate and display information directly over physical documents while keeping intact the integrity of said physical documents.
  • [0008]
    In a second aspect of the invention, a system for capturing and displaying electronic handwritten annotations comprises:
  • [0009]
    an apparatus as described above;
  • [0010]
    a computer system;
  • [0011]
    a stylus adapted to cooperate with a transparent digitizing tablet of said apparatus;
  • [0012]
    said transparent digitizing tablet comprising means for digitizing annotations made by said stylus and means for sending digitized annotations to the computer system;
  • [0013]
    said computer system comprising means for transmitting digitized annotations to the transparent electro-luminescent display of said apparatus; and
  • [0014]
    said transparent electro-luminescent display comprising means for highlighting said digitized annotations.
  • [0015]
    As mentioned above, such a system makes it possible to “write” over physical documents without physically marking said documents.
  • [0016]
    According to a preferred embodiment of the invention, the computer system comprises means for storing digitized annotations sent by the transparent digitizing tablet. The handwritten annotations are stored in order to be retrieved and displayed in the future by the same or another user. Moreover, a user can handwrite several pages over a single form without physically marking it, and store said handwritten annotations in a computer system for later use.
  • [0017]
    This information can be selectively displayed over the same form. According to a third aspect of the invention, a method for capturing and displaying handwritten annotations, using a system as described above comprises the following steps:
  • [0018]
    digitizing annotations made by the stylus on the transparent digitizing tablet;
  • [0019]
    sending digitized annotations to the computer system;
  • [0020]
    transmitting digitized annotations to the transparent electro-luminescent display; and
  • [0021]
    highlighting said digitized annotations.
  • [0022]
    According to a fourth aspect of the invention, a method for retrieving and displaying electronic handwritten annotations on a physical document, using a system as described above comprises the following steps:
  • [0023]
    identifying a physical document;
  • [0024]
    identifying digitized annotations stored in an annotation table associated with the identified document; and
  • [0025]
    sending for display the digitized annotations to the transparent electro-luminescent display.
  • [0026]
    The invention also includes a computer program comprising computer readable instructions for carrying out the method for capturing and displaying handwritten annotations and/or the method for retrieving and displaying handwritten information according to the invention.
  • [0027]
    The method for capturing and displaying handwritten information, the method for retrieving and displaying handwritten information and the computer program present the same advantages and the same characteristics as the apparatus and system which perform them.
  • [0028]
    Other features and advantages of the invention will also emerge from the following description.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0029]
    In the accompanying drawings, given by way of non-limiting example:
  • [0030]
    [0030]FIG. 1 is a schematic view of an apparatus for capturing and displaying handwritten annotations according to a first aspect of the invention;
  • [0031]
    [0031]FIG. 2 is a block diagram illustrating a system for capturing and displaying handwritten information according to a second aspect of the invention;
  • [0032]
    [0032]FIG. 3 illustrates an algorithm for a method of capturing and displaying handwritten information according to a third aspect of the invention;
  • [0033]
    FIGS. 4 to 6 illustrate the method for capturing and displaying handwritten annotations on a physical document;
  • [0034]
    [0034]FIG. 7 illustrates an algorithm for a method of retrieving and displaying handwritten information according to a fourth aspect of the invention; and
  • [0035]
    [0035]FIGS. 8 and 9 illustrate a method for retrieving and displaying handwritten information on a physical document;
  • DETAILED DESCRIPTION
  • [0036]
    Referring first to FIG. 1, a description will now be given of an apparatus for capturing and displaying handwritten annotations in accordance with the invention.
  • [0037]
    This apparatus 10 comprises a transparent digitizing tablet 11 adapted to cooperate with a stylus 12 in order to capture handwritten annotations. Such a transparent digitizing tablet 11 is commonly used to generate signals that are proportional to the coordinates of each point pressed by the stylus 12. Digitizing tablet 11 and stylus 12 can be considered as electronic equivalents of pencil and paper used for writing, drawing, tracing or sketching.
  • [0038]
    In a preferred embodiment of the invention, the digitizing tablet may be built from a substrate having a matrix formed by a plurality of first and second lines used to determine the position of the stylus 12 when the latter is applied to the tablet. The first lines correspond to a plurality of scanning lines and the second lines correspond to a plurality of data lines. These first and second lines are made from a transparent conductive material, for example from indium tin oxide (ITO). The application of the stylus to the tablet creates an electric signal, the succession of electric signals corresponding to a drawing on the tablet. An example of transparent digitizing tablets it would be possible to use for implementing the present invention is produced by Wacom Technology Co. and sold under the name Wacom, PL Series, LCD pen tablet system. Such a tablet is used with a pen-like stylus. An example of a stylus it would be possible to use, in combination with the digitizing tablet, is Wacom's wireless, pressure sensitive UltraPen sold by Wacom Technology Co.
  • [0039]
    According to the invention, the apparatus further comprises a transparent electro-luminescent display 13 adapted to display captured handwritten annotations. This display 13 is of the type of a transparent organic bright light-emitting device. In a preferred embodiment of the present invention, the display 13 comprises a substrate having an array or a mesh formed by a plurality of first and second lines. The first lines correspond to transparent scanning lines and the second lines correspond to transparent data lines. These first and second lines cross one other and an electro-luminescent element is located at each intersection of the scanning and data lines. Such a light-emitting display, with a passive matrix, may be made of an array of Transparent Organic Light Emitting Devices (TOLED's) which are commonly used to create vision area displays on windshields, cockpits, and so forth. TOLED are today manufactured with standard silicon semiconductors. An example of light emitting foil technology it would be possible to use here is that used for the TOLED's manufactured by UNIVERSAL DISPLAY CO.
  • [0040]
    In its basic form, a TOLED is a monolithic, solid-state device consisting in a series of molecules of small size forming organic thin films sandwiched between two transparent, conductive layers. When a voltage is applied across the device, it emits light. This light emission is based upon a luminescence phenomenon wherein electrons and holes are injected and migrate from the contacts toward the organic junction under the applied electric field. When these carriers meet, they form excitons (electron-hole pairs) that recombine radiatively to emit light. As a result, TOLED's are bright and can be directed to emit from either or both surfaces of the sheet. This is possible because, in addition to the transparent contacts, the organic materials are also transparent over their own emission spectrum and throughout most of the visible spectrum. Moreover, TOLED displays can be nearly as clear as glass, since they can be up to 85% transparent when not energized.
  • [0041]
    As shown on FIG. 1, the transparent digitizing tablet 11 is superposed on the transparent electro-luminescent display 13. Thus, the apparatus comprises two superposed, functionally independent transparent foils. This apparatus consists in a portable transparent electro-luminescent digitizing tablet 10 which can be superposed on any kind of physical document 5.
  • [0042]
    A shown in FIG. 1, the electro-luminescent display 13 is adapted to emit light at the point 1001 that is pressed by the stylus (see the arrow 1002). Since the digitizing tablet superposed thereon is transparent, the light emitted by the display is transmitted through the tablet in order to appear on the top of the apparatus 10. Moreover, since this display is transparent, it is also adapted to transmit light (see the arrow 1003) from the physical document 5 through both the display 13 and the tablet 11, so that the surface of the physical document 5 is visible on unmarked areas. Consequently, such an apparatus is perfectly adapted to write annotations in “electronic ink” and to display these annotations over the document 5, without physically marking the document.
  • [0043]
    As shown in FIG. 2, this apparatus 10 is used with a computer system 20. The computer system 20 can be a personal computer, an Internet enabled cell phone, a Personal Digital Assistant, an onboard computer, a network computer, an Internet appliance or a wireless IP enabled device. The apparatus 10 can communicate with the computer system 20 over an infrared link, a serial wired connection or any other communication means. The apparatus 10, the stylus 12 and the computer system 20 thus constitute a system for capturing and displaying electronic handwritten annotations.
  • [0044]
    The apparatus 10 comprises means 14 for digitizing annotations made by the stylus 12 and means 15 for sending digitized annotations to the computer system 20. In practice, a pulse driving circuit 16 alternately transmits driving pulses to the X- and Y-axis directions of the digitizing tablet 11 for sensing the current position of the stylus 12. The pulse driving circuit 16 is controlled by the microcontroller 15. The position of the stylus 12 is detected by capacitive coupling sensed in the digitizing tablet 11, that is the stylus 12 senses a position signal in a potential distribution on the digitizing tablet 11 using capacitive coupling, and provides the position to the digitizing means 14 which is referred to as a position sensing circuit 14.
  • [0045]
    The position sensing circuit 14 receives the current X- and Y-axis coordinate data of the stylus 12 and converts the coordinate data into digitized position data. The micro-controller 15 transfers data of the position detected from the position sensing circuit 14 to the computer system 20. Thus, the micro-controller 15 is used for sending digitized annotations to the computer system 20.
  • [0046]
    Upon reception of position data from the position sensing circuit 14, the micro-controller 15 analyses the position data to calculate the current position of the stylus and updates the computer system 20. This latter comprises means 21 for transmitting digitized annotations to the transparent electro-luminescent display 13 of the apparatus 10. Thus the data of the position of the stylus 12 is directly transmitted by the computer system 20 to an electro-luminescent display driving circuit 17 controlled by the computer system 20. The electro-luminescent display driving circuit provides X-, and Y-axis coordinate driving signals to the electro-luminescent display 13 so that this latter can display the pixel on which is positioned the stylus through the transparent tablet 11.
  • [0047]
    The computer system 20 also comprises means 22, 23, 24 for storing digitized annotations sent by the transparent digitizing tablet 11. As described in detail in the following description, in reference to the method performed by the system, the storing means 22, 23, 24 are adapted to store digitized annotations associated with a reference to a physical document which is used in relation with the apparatus 20.
  • [0048]
    As illustrated on FIG. 4, the apparatus 10, connected to the computer system 20 is used to create annotations relating to a physical document 5. Here, this document to be annotated is a book of several pages, entitled “Early British Kingdoms”. Any kind of document can be used, and for example, geographic maps, technical plans, commercial catalogs or even any other type of hard-copy, engraved, written or printed surfaces. The physical document 5 could also be a blank paper sheet or a printed form to be filled in. The material of the physical documents can be paper, plastic, wood or any other material.
  • [0049]
    As shown on the embodiment of FIG. 3, the method comprises first a step 30 of selecting a physical document and assigning an identification number to it. Here, the identification number is a reference, such as Doc: 170301, which can be written on the document, for example on the first page of the book. A document's annotation table is then created in a creating step 31. As shown on FIG. 5, the annotation table is created on the computer system 20. It comprises the reference number of the document and possibly, other relevant information related to the document such as the title, author, ISBN (International Standard Book Number), date, and so forth.
  • [0050]
    In a selecting step 32, a page of the document, here the page 115, is selected and entered in the annotation table. This step corresponds to open a new page entry on the annotation table. An aligning step 33 is then performed wherein the apparatus 10 comprising digitizing tablet 11 and electro-luminescent display 13 in a stack superposed over the selected page of the document. This location of the apparatus is clearly shown in FIG. 5. Since the apparatus comprises superposed sheets that are both transparent, the page of the document underneath the apparatus can be read through the apparatus 10. Preferably, the apparatus 10 is aligned with the borders of the page by some conventional means, for example by adjusting the upper left corner of the page with the upper left corner of the apparatus 10.
  • [0051]
    A writing step 34 is then performed by using the stylus 12 as shown in FIG. 6, in order to create annotations relating to the document. Any type of annotations (marks, texts, drawing, underlines, and so forth) can be handwritten by the stylus 12 on the digitizing tablet 11 of the apparatus 10. These annotations made by a user can be directly related to the content of the page seen through the apparatus 10 by virtue of its transparency.
  • [0052]
    A digitizing step 35 is adapted to digitize annotations made by the stylus 12 on the transparent digitizing tablet 11. In practice, as illustrated in FIG. 6, the digitizing tablet 11 takes samples, digitizes the sequence Xi, Yi of coordinates of each point pressed by the stylus 12 on the tablet 11 and sends this sequence to the computer system 20. The succession of sequences of coordinates thus constitute a digitizing annotation sent to the computer system 20 during a sending step 36. Under control of the same computer system 20, the sequence of coordinates Xi, Yi are transmitted, i.e. sent back, to the apparatus 10, and more precisely, to the transparent electro-luminescent display 10. This transmitting step 37 is adapted to transmit digitized annotations in order to further highlight the digitized annotations during a displaying step 38.
  • [0053]
    In practice, each of the point coordinates Xi, Yi received by the elctro-luminescent display is decoded and the corresponding row and column drivers of the matrix of passive electro-luminescent elements become active. When active, the element (or pixel) located at the intersection of the selected row and column emits light. Obviously, only the electro-luminescent elements corresponding to the stylus strokes sensed by the digitizing tablet 11 must be continuously scanned and refreshed by the computer system 20. Unmarked areas of the apparatus 10 remain transparent, while only the areas marked by the stylus 12 are highlighted in order to display annotations made by the user directly over the selected page of the document, without physically marking this page. Thus, the method described above permits the entering and displaying of annotations simultaneously.
  • [0054]
    According to the preferred embodiment described here, the method further comprises a step 39 of storing, in the annotation table stored in the computer system, digitized annotations sent by the apparatus 10.
  • [0055]
    [0055]FIG. 6 shows how the sequence Xi, Yi of point coordinates, corresponding to stylus strokes is stored on the computer system 20, as a “Page Annotation File” (.PAF). that encodes the graphic information of the annotations made by the user. Once created, this .PAF file is referenced in the document's annotation table, associated with the selected document's page.
  • [0056]
    In this embodiment, the name of the file to be referenced is composed of the document's reference (here 170301) followed by the page number (here 115).
  • [0057]
    As an example, the annotation table associated with a document after annotating different pages (for example pages 3, 12, 57, 115, . . . , 213) would be as follows:
    DOG: 170301 Title: “Early British Kingdoms” Author: David Gnash Ford of Infield, Berkshire, UK
    Date: Jan. 28, 2000 ISBN: 84-344-0856-2
    Pg.: 3 File: 170301-003.PAF
    Pg: 12 File: 170301-012.PAF
    Pg: 57 File: 170301-057.PAF
    Pg: 115 File: 170301-115.PAF
    Pg: . . . File: 170301- . . .
    Pg: 213 File: 170301 -213.PAF
  • [0058]
    A method for retrieving and displaying electronic handwritten annotations on a physical document 5 is now described with reference to FIGS. 7 to 9. This retrieving method can be performed by the same user as the one who has made the annotations over the document or by another user from a computer system memorizing the annotation table associated with the document.
  • [0059]
    Firstly, the method of retrieving and displaying annotations comprises a step for identifying a physical document. In practice, a first selecting step 70 is adapted to select a physical document by entering a reference number of this document. The user can enter, by means of any interface (keyboard, mouse, etc.) the reference number, here Doc: 170301. As shown in FIG. 8, the apparatus 10 comprises here an array 18 of buttons, preferably touch sensitive, printed on a dedicated touch pad area of the apparatus, directly on the digitizing tablet 11. The user enters the reference of the physical document via a button marked “Doc” and number buttons. When this reference entered in the apparatus is transmitted via the microcontroller 15 to the computer system 20, this latter retrieves the annotation table associated with the selected document.
  • [0060]
    Next, a second selecting step 71 is performed to identify a page of the physical document 5, for example the page 115 of the book under consideration. The entering of the number of the page can be made as described above, via the button area 18. The number of the page is transferred from the apparatus 10 to the computer system 20 via the micro-controller 15 and in a retrieving step 72 the computer system identifies the page annotation file (e.g. 170301-115.PAF) of the selected page within the annotation table associated with the selected document. During the selecting step 70 and 71 and the retrieving step 72, the apparatus 10 can be disposed in any way vis--vis the physical document.
  • [0061]
    An aligning step 73 is then performed for aligning the apparatus 10 over the selected document page. This step is shown in FIG. 9. The upper left corner of the apparatus 10 can be adjusted in a conventional manner with the upper left corner of the page. Thanks to the transparency of the apparatus 10, the user can see the content of the selected document page through the apparatus 10.
  • [0062]
    Next, a step 74 of identifying digitized annotations stored in the page annotation file is performed. In fact, in the page annotation file, all the annotations made previously over the page of the document are encoded as graphic information. Next, during a sending step 75, the computer system 10 sends the retrieved annotations to the apparatus 10 for displaying the annotations via the transparent electro-luminescent display 13.
  • [0063]
    Consequently, the annotations that have been made by the user or by another user, are displayed by the apparatus 10 directly over the physical document, without marking it. Thus, if two remotely located users share copies of the same document, annotations made by any one user over his copy can be transmitted via a communication network, by sending the annotation table relating to the document, to the other user. This latter can then see the same annotations over his document, through an analogous system shown in FIG. 2. If the physical document is a form to be filled in, this form can be filled in for different persons without physically marking the form. Moreover, it may be noted that, when the physical document is simply a blank sheet of paper, the methods and the system according to the invention can be applied to create a handwritten document or drawing which is memorized in a page annotation file to be displayed again by the user or another user.
  • [0064]
    The above-described methods can be performed by microprocessors incorporated respectively in the apparatus 10 and the computer system 20.
  • [0065]
    The computer system 20 comprises also a Read Only Memory storing a computer program comprising computer readable instructions for carrying out the method for capturing and displaying handwritten annotations and for retrieving and displaying handwritten annotations.
  • [0066]
    The computer system 20 comprises a Random Access Memory adapted to store the modified parameters when the program is run, such as the Page Annotation Files associated with each selected physical document.
  • [0067]
    The computer program could also be stored on a hard disk of the computer system 20 or in a movable storage means such as a diskette or a CD-ROM which can be read by a reader incorporated in the computer system 20.
  • [0068]
    Persons skilled in the art will recognize that many variations of the teachings of this invention can be practiced that still fall within the claims of the invention which follow.
Patent Citations
Cited PatentFiling datePublication dateApplicantTitle
US3760360 *Nov 1, 1971Sep 18, 1973E Systems IncMatrix switch
US4190831 *May 8, 1978Feb 26, 1980The Singer CompanyLight pen detection system for CRT image display
US4263592 *Nov 6, 1979Apr 21, 1981Pentel Kabushiki KaishaInput pen assembly
US4274081 *Aug 7, 1979Jun 16, 1981Hitachi, Ltd.Data input apparatus
US4277783 *Jul 2, 1979Jul 7, 1981Bell Telephone Laboratories, IncorporatedLight pen tracking method and apparatus
US4289333 *Jun 28, 1979Sep 15, 1981Think, Inc.Method for locating features on a map
US4348660 *Sep 9, 1980Sep 7, 1982Sheldon Industries Inc.Automatically relegendable keyboard
US4367465 *Apr 4, 1980Jan 4, 1983Hewlett-Packard CompanyGraphics light pen and method for raster scan CRT
US4377810 *Dec 4, 1980Mar 22, 1983Data General CorporationLight pen detection circuit and method
US4454417 *Feb 5, 1982Jun 12, 1984George A. MayHigh resolution light pen for use with graphic displays
US4504913 *Jun 7, 1982Mar 12, 1985Nippondenso Co., Ltd.Electronic navigator for automotive vehicles
US4523188 *Oct 25, 1982Jun 11, 1985The United States Of America As Represented By The Secretary Of The ArmyAutomated map and display alignment
US4532395 *Sep 20, 1983Jul 30, 1985Timex CorporationElectroluminescent flexible touch switch panel
US4550310 *Oct 28, 1982Oct 29, 1985Fujitsu LimitedTouch sensing device
US4565947 *Mar 12, 1984Jan 21, 1986International Business Machines CorporationColor cathode ray tube for use with a light pen
US4680430 *Feb 27, 1985Jul 14, 1987Fujitsu LimitedCoordinate detecting apparatus
US4723836 *Oct 10, 1984Feb 9, 1988Sharp Kabushiki KaishaHandwritten character input device
US4752773 *Nov 1, 1985Jun 21, 1988Hitachi, Ltd.Image display apparatus capable of selective and partial erasure of information
US4782328 *Oct 2, 1986Nov 1, 1988Product Development Services, IncorporatedAmbient-light-responsive touch screen data input method and system
US4849911 *Sep 25, 1986Jul 18, 1989Modern Body And Engineering Corp.Method for imputting data to a computer aided design system
US4853498 *Jun 13, 1988Aug 1, 1989Tektronix, Inc.Position measurement apparatus for capacitive touch panel system
US4855725 *Dec 28, 1988Aug 8, 1989Fernandez Emilio AMicroprocessor based simulated book
US4868912 *Jul 28, 1988Sep 19, 1989Digital ElectronicsInfrared touch panel
US4952918 *May 9, 1988Aug 28, 1990Toshiba Kikai Kabushiki KaishaDisplay and input apparatus
US4973960 *Feb 24, 1989Nov 27, 1990Amoco CorporationData entry method and apparatus
US5063600 *May 14, 1990Nov 5, 1991Norwood Donald DHybrid information management system for handwriting and text
US5070467 *Jun 11, 1990Dec 3, 1991Kabushiki Kaisha ToshibaMethod and apparatus for combination information display and input operations
US5149919 *Nov 26, 1991Sep 22, 1992International Business Machines CorporationStylus sensing system
US5202828 *May 15, 1991Apr 13, 1993Apple Computer, Inc.User interface system having programmable user interface elements
US5231698 *Mar 20, 1991Jul 27, 1993Forcier Mitchell DScript/binary-encoded-character processing method and system
US5239152 *Oct 30, 1990Aug 24, 1993Donnelly CorporationTouch sensor panel with hidden graphic mode
US5243149 *Apr 10, 1992Sep 7, 1993International Business Machines Corp.Method and apparatus for improving the paper interface to computing systems
US5250929 *Jul 29, 1991Oct 5, 1993Conference Communications, Inc.Interactive overlay-driven computer display system
US5283557 *Jul 5, 1991Feb 1, 1994Ncr CorporationMethod for converting high resolution data into lower resolution data
US5311302 *Jul 2, 1992May 10, 1994Hughes Aircraft CompanyEntertainment and data management system for passenger vehicle including individual seat interactive video terminals
US5315129 *May 1, 1991May 24, 1994University Of Southern CaliforniaOrganic optoelectronic devices and methods
US5315667 *Oct 31, 1991May 24, 1994International Business Machines CorporationOn-line handwriting recognition using a prototype confusability dialog
US5353016 *Jan 16, 1992Oct 4, 1994Sony CorporationRemote commander
US5448263 *Oct 21, 1991Sep 5, 1995Smart Technologies Inc.Interactive display system
US5495581 *Oct 15, 1993Feb 27, 1996Tsai; IrvingMethod and apparatus for linking a document with associated reference information using pattern matching
US5555555 *Jan 19, 1994Sep 10, 1996Aisin Seiki Kabushiki KaishaApparatus which detects lines approximating an image by repeatedly narrowing an area of the image to be analyzed and increasing the resolution in the analyzed area
US5624265 *Jul 1, 1994Apr 29, 1997Tv Interactive Data CorporationPrinted publication remote contol for accessing interactive media
US5640193 *Aug 15, 1994Jun 17, 1997Lucent Technologies Inc.Multimedia service access by reading marks on an object
US5654529 *May 3, 1995Aug 5, 1997Hewlett-Packard CompanyStylus-input computing system with erasure
US5668576 *Apr 28, 1994Sep 16, 1997Nissha Printing Co., Ltd.Transparent touch panel with contractible resin layer used to maintain visibility
US5692073 *Jul 30, 1996Nov 25, 1997Xerox CorporationFormless forms and paper web using a reference-based mark extraction technique
US5703436 *Mar 6, 1996Dec 30, 1997The Trustees Of Princeton UniversityTransparent contacts for organic devices
US5706030 *Jun 2, 1995Jan 6, 1998Brother Kogyo Kabushiki KaishaCompact data input device having transparent touch panel
US5757026 *Apr 15, 1996May 26, 1998The Trustees Of Princeton UniversityMulticolor organic light emitting devices
US5757139 *Feb 3, 1997May 26, 1998The Trustees Of Princeton UniversityDriving circuit for stacked organic light emitting devices
US5811833 *Dec 23, 1996Sep 22, 1998University Of So. CaElectron transporting and light emitting layers based on organic free radicals
US5818425 *Apr 3, 1996Oct 6, 1998Xerox CorporationMapping drawings generated on small mobile pen based electronic devices onto large displays
US5834893 *Dec 23, 1996Nov 10, 1998The Trustees Of Princeton UniversityHigh efficiency organic light emitting devices with light directing structures
US5844363 *Jan 23, 1997Dec 1, 1998The Trustees Of Princeton Univ.Vacuum deposited, non-polymeric flexible organic light emitting devices
US5850214 *Sep 17, 1996Dec 15, 1998Ameranth Technology Systems, Inc.Information manangement system with electronic clipboard
US5861219 *Apr 15, 1997Jan 19, 1999The Trustees Of Princeton UniversityOrganic light emitting devices containing a metal complex of 5-hydroxy-quinoxaline as a host material
US5870767 *Nov 22, 1996Feb 9, 1999International Business Machines CorporationMethod and system for rendering hyper-link information in a printable medium from a graphical user interface
US5897648 *Dec 20, 1996Apr 27, 1999Numonics CorporationApparatus and method for editing electronic documents
US5903729 *Jul 10, 1997May 11, 1999Motorola, Inc.Method, system, and article of manufacture for navigating to a resource in an electronic network
US5905251 *Jul 11, 1997May 18, 1999Metrologic Instruments, Inc.Hand-held portable WWW access terminal with visual display panel and GUI-based WWW browser program integrated with bar code symbol reader in a hand-supportable housing
US5915285 *Jan 21, 1993Jun 22, 1999Optical Coating Laboratory, Inc.Transparent strain sensitive devices and method
US5917280 *Feb 3, 1997Jun 29, 1999The Trustees Of Princeton UniversityStacked organic light emitting devices
US5923388 *Jun 30, 1998Jul 13, 1999Fujistu LimitedTouch panel
US5929834 *Apr 18, 1996Jul 27, 1999Brinks Hofer Gilson & LioneLiquid crystal display device with tablet
US5932895 *May 20, 1997Aug 3, 1999The Trustees Of Princeton UniversitySaturated full color stacked organic light emitting devices
US5953587 *Nov 24, 1997Sep 14, 1999The Trustees Of Princeton UniversityMethod for deposition and patterning of organic thin film
US5957697 *Nov 25, 1998Sep 28, 1999Ithaca Media CorporationPrinted book augmented with an electronic virtual book and associated electronic data
US5965981 *Jan 28, 1998Oct 12, 1999Nippondenso Co., LtdTransparent thin-film EL display apparatus
US5986401 *Mar 20, 1997Nov 16, 1999The Trustee Of Princeton UniversityHigh contrast transparent organic light emitting device display
US5995084 *Jan 17, 1997Nov 30, 1999Tritech Microelectronics, Ltd.Touchpad pen-input and mouse controller
US5998803 *May 29, 1997Dec 7, 1999The Trustees Of Princeton UniversityOrganic light emitting device containing a hole injection enhancement layer
US6005252 *Sep 25, 1997Dec 21, 1999The Trustees Of Princeton UniversityMethod and apparatus for measuring film spectral properties
US6013538 *Nov 24, 1997Jan 11, 2000The Trustees Of Princeton UniversityMethod of fabricating and patterning OLEDs
US6013982 *Dec 23, 1996Jan 11, 2000The Trustees Of Princeton UniversityMulticolor display devices
US6067080 *Feb 21, 1997May 23, 2000Electronics For ImagingRetrofittable apparatus for converting a substantially planar surface into an electronic data capture device
US6115008 *Feb 12, 1998Sep 5, 2000Lear Automotive Dearborn, Inc.Transparent EL display
US6212297 *Jun 7, 1995Apr 3, 2001Samsung Electronics Co., Ltd.Handwritten keyboardless entry computer system
US6279014 *Sep 15, 1997Aug 21, 2001Xerox CorporationMethod and system for organizing documents based upon annotations in context
US6304898 *Oct 11, 2000Oct 16, 2001Datahouse, Inc.Method and system for creating and sending graphical email
US6396598 *Aug 26, 1998May 28, 2002Sharp Kabushiki KaishaMethod and apparatus for electronic memo processing for integrally managing document including paper document and electronic memo added to the document
US6424094 *May 15, 2001Jul 23, 2002Eastman Kodak CompanyOrganic electroluminescent display with integrated resistive touch screen
US6738049 *May 1, 2001May 18, 2004Aquila Technologies Group, Inc.Image based touchscreen device
US6771283 *Apr 25, 2001Aug 3, 2004International Business Machines CorporationMethod and system for accessing interactive multimedia information or services by touching highlighted items on physical documents
US6798907 *Jan 24, 2001Sep 28, 2004Advanced Digital Systems, Inc.System, computer software product and method for transmitting and processing handwritten data
US6814642 *Jul 23, 2001Nov 9, 2004Eastman Kodak CompanyTouch screen display and method of manufacture
US6963334 *Apr 12, 2000Nov 8, 2005Mediaone Group, Inc.Smart collaborative whiteboard integrated with telephone or IP network
US6976220 *Jun 30, 2000Dec 13, 2005Silverbrook Research Pty LtdMethod and system for conferencing
US6980202 *Dec 12, 2002Dec 27, 2005International Business Machines CorporationMethod and system for creating and accessing hyperlinks from annotations relating to a physical document
US7003308 *Dec 10, 2004Feb 21, 2006At&T Corp.Method and system for handwritten electronic messaging
US7027038 *Aug 6, 2001Apr 11, 2006International Business Machines CorporationSystem and method for locating on a physical document items referenced in another physical document
US7050835 *Dec 12, 2001May 23, 2006Universal Display CorporationIntelligent multi-media display communication system
US7116316 *Mar 7, 2002Oct 3, 2006Intel CorporationAudible and visual effects as a result of adaptive tablet scanning
US20020047870 *Jun 26, 2001Apr 25, 2002International Business Machines CorporationSystem and method for locating on a physical document items referenced in an electronic document
US20020057836 *Feb 28, 2001May 16, 2002Lui Charlton E.Implicit page breaks for digitally represented handwriting
US20020078088 *Dec 19, 2000Jun 20, 2002Xerox CorporationMethod and apparatus for collaborative annotation of a document
US20020152216 *Sep 27, 2001Oct 17, 2002Nicolas BouthorsMethod and system for optimizing consultations of groups of data by a plurality of clients
US20030001899 *Jun 29, 2001Jan 2, 2003Nokia CorporationSemi-transparent handwriting recognition UI
US20030103238 *Nov 30, 2001Jun 5, 2003Xerox CorporationSystem for processing electronic documents using physical documents
USRE34476 *May 28, 1992Dec 14, 1993Norwood Donald DHybrid information management system for handwriting and text
Referenced by
Citing PatentFiling datePublication dateApplicantTitle
US7136054Jan 6, 2004Nov 14, 2006Microsoft CorporationCamera-pen-tip mapping and calibration
US7263224Jan 16, 2004Aug 28, 2007Microsoft CorporationStrokes localization by m-array decoding and fast image matching
US7310779Apr 6, 2004Dec 18, 2007International Business Machines CorporationMethod for creating and selecting active regions on physical documents
US7581171Jan 6, 2004Aug 25, 2009Microsoft CorporationPositionally encoded document image analysis and labeling
US7684618Mar 22, 2006Mar 23, 2010Microsoft CorporationPassive embedded interaction coding
US7729539May 31, 2005Jun 1, 2010Microsoft CorporationFast error-correcting of embedded interaction codes
US7817816Aug 17, 2005Oct 19, 2010Microsoft CorporationEmbedded interaction code enabled surface type identification
US7826074Feb 25, 2005Nov 2, 2010Microsoft CorporationFast embedded interaction code printing with custom postscript commands
US7920753Jun 12, 2008Apr 5, 2011Microsoft CorporationPreprocessing for information pattern analysis
US7966352 *Jan 26, 2004Jun 21, 2011Microsoft CorporationContext harvesting from selected content
US8083149Nov 5, 2009Dec 27, 2011Hand Held Products, Inc.Annotation of optical images on a mobile device
US8156153Jul 25, 2008Apr 10, 2012Microsoft CorporationGlobal metadata embedding and decoding
US8196041Aug 21, 2007Jun 5, 2012International Business Machines CorporationMethod and system for processing information relating to active regions of a page of physical document
US8297979May 27, 2005Oct 30, 2012Mattel, Inc.Electronic learning device with a graphic user interface for interactive writing
US9165478 *Apr 15, 2004Oct 20, 2015International Business Machines CorporationSystem and method to enable blind people to have access to information printed on a physical document
US20040257346 *Jun 20, 2003Dec 23, 2004Microsoft CorporationContent selection and handling
US20040262051 *Apr 6, 2004Dec 30, 2004International Business Machines CorporationProgram product, system and method for creating and selecting active regions on physical documents
US20050022108 *Apr 15, 2004Jan 27, 2005International Business Machines CorporationSystem and method to enable blind people to have access to information printed on a physical document
US20050146518 *Jan 6, 2004Jul 7, 2005Microsoft CorporationCamera-pen-tip mapping and calibration
US20050149865 *Jan 6, 2004Jul 7, 2005Microsoft CorporationPositionally encoded document image analysis and labeling
US20050165839 *Jan 26, 2004Jul 28, 2005Vikram MadanContext harvesting from selected content
US20050201621 *Jan 16, 2004Sep 15, 2005Microsoft CorporationStrokes localization by m-array decoding and fast image matching
US20070118795 *Nov 21, 2006May 24, 2007Peter NoyesA Method of Processing Annotations Using an Editable Multi-Dimensional Catalog
US20080017422 *Aug 21, 2007Jan 24, 2008Carro Fernando IMethod and system for processing information relating to active regions of a page of physical document
US20090013247 *May 13, 2004Jan 8, 2009Fernando Incertis CarroSystem and method for composing an electronic document from physical documents
US20110101103 *Nov 5, 2009May 5, 2011Hand Held Products, Inc.Annotation of optical images on a mobile device
Classifications
U.S. Classification345/173
International ClassificationG06F3/0488
Cooperative ClassificationG06F3/04883
European ClassificationG06F3/0488G
Legal Events
DateCodeEventDescription
Dec 12, 2002ASAssignment
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARRO, FERNANDO INCERTIS;REEL/FRAME:013579/0147
Effective date: 20021202