US20080128502A1 - Method for producing indicators and processing apparatus and system utilizing the indicators - Google Patents

Method for producing indicators and processing apparatus and system utilizing the indicators Download PDF

Info

Publication number
US20080128502A1
US20080128502A1 US12/003,349 US334907A US2008128502A1 US 20080128502 A1 US20080128502 A1 US 20080128502A1 US 334907 A US334907 A US 334907A US 2008128502 A1 US2008128502 A1 US 2008128502A1
Authority
US
United States
Prior art keywords
graphical
information
indicator
state
electronic book
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US12/003,349
Other versions
US7726570B2 (en
Inventor
Yao-Hung Tsai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sonix Technology Co Ltd
Original Assignee
Sonix Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=21688204&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20080128502(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Sonix Technology Co Ltd filed Critical Sonix Technology Co Ltd
Priority to US12/003,349 priority Critical patent/US7726570B2/en
Assigned to SONIX TECHNOLOGY CO., LTD. reassignment SONIX TECHNOLOGY CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TSAI, YAO-HUNG
Publication of US20080128502A1 publication Critical patent/US20080128502A1/en
Priority to US12/591,420 priority patent/US8002198B2/en
Application granted granted Critical
Publication of US7726570B2 publication Critical patent/US7726570B2/en
Adjusted expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1439Methods for optical code recognition including a method step for retrieval of the optical code
    • G06K7/1447Methods for optical code recognition including a method step for retrieval of the optical code extracting optical codes from image or text carrying said optical code
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • G06F3/0317Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • G06F3/0317Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G06F3/0321Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G06K19/06037Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking multi-dimensional coding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G06K19/06046Constructional details
    • G06K19/06178Constructional details the marking having a feature size being smaller than can be seen by the unaided human eye
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/12Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using a selected wavelength, e.g. to sense red marks and ignore blue marks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1408Methods for optical code recognition the method being specifically adapted for the type of code
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1408Methods for optical code recognition the method being specifically adapted for the type of code
    • G06K7/14172D bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
    • G06K7/1404Methods for optical code recognition
    • G06K7/1439Methods for optical code recognition including a method step for retrieval of the optical code
    • G06K7/1456Methods for optical code recognition including a method step for retrieval of the optical code determining the orientation of the optical code with respect to the reader and correcting therefore
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K2019/06215Aspects not covered by other subgroups
    • G06K2019/06234Aspects not covered by other subgroups miniature-code
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K2019/06215Aspects not covered by other subgroups
    • G06K2019/06262Aspects not covered by other subgroups with target- or other orientation-indicating feature
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection

Definitions

  • the present invention relates to a method for producing indicators and processing apparatus and system utilizing the indicators, and more particularly, to a method, an apparatus and a system for providing additional information from the indicators affixed onto the surface of an object.
  • the digital information can be displayed in multiple dimensions, while the information printed in book or attached to the object still are displayed in two dimensions.
  • multiple dimensions information can be recorded on the book or the object, people can acquire additional information through the electronic apparatus.
  • One aspect of the present invention is to provide a method for producing graphical indicators.
  • Some visually negligible graphical indicators are affixed on the surface of an object.
  • the graphical indicators co-exist with main information, such as a text or picture, on the surface of object, and do not interfere with the perception of human eyes to the main information.
  • a user retrieves the graphical indicators through an electronic system that does not couple with the object and acquires additional information from the graphical indicators.
  • the apparatus or the system includes an optical-reading device, a processing device, and an output device.
  • the optical-reading device captures an image including the graphical indicators from the surface of object, the processing device, responsive to the graphical indicators, acquires the corresponding additional information by processing and/or transforming the graphical indicators, and the output device outputs the additional information.
  • FIG. 1(A) is a schematic diagram illustrating the graphical indicators on the surface of object in accordance with the present invention
  • FIG. 1(B) is an enlarged diagram illustrating one of the graphical indicators in FIG. 1(A) ;
  • FIG. 1(C) is a schematic diagram illustrating the combination of the graphical micro-units in FIG. 1(B) converting into the bit array;
  • FIG. 1(D) is a schematic diagram illustrating the two-dimensional matrix form in accordance with the present invention.
  • FIG. 1(E) is an enlarged diagram illustrating the index zones and the graphical indicators in accordance with the present invention
  • FIG. 1(F) illustrates the image corresponding to the matrix form of the graphical indicators converted into a bit matrix form in accordance with the present invention
  • FIGS. 2(A)-2(C) are the diagrams illustrating various embodiments in accordance with the present invention.
  • FIG. 2(D) is the diagram illustrating other embodiment for the arrangement of the graphical indicators in accordance with the present invention.
  • FIG. 2(E) is the diagram illustrating the different graphical indicators arranged in a index zone in accordance with the present invention.
  • FIG. 3 is a schematic diagram illustrating an electronic system in accordance with the present invention.
  • FIG. 4 is a schematic flowchart illustrating the operation of the electronic system in accordance with the present invention.
  • FIG. 5 is an embodiment of the processing system in accordance with the present invention.
  • FIG. 6 is a schematic diagram illustrating the electronic apparatus in accordance with the present invention.
  • FIG. 7 is a schematic flow chart illustrating the operation of the electronic apparatus in accordance with the present invention.
  • FIG. 8 is a schematic diagram illustrating one practical application in accordance with the present invention.
  • FIG. 9 is a schematic diagram illustrating the additional information used for controlling a response device in accordance with the present invention.
  • FIG. 10 is a schematic diagram illustrating the application of the present invention to information appliances
  • FIG. 11 is a schematic diagram illustrating the additional information used to control other devices.
  • FIG. 12(A) is a graph illustrating the conventional bar code in the prior art.
  • FIG. 12(B) is a graph illustrating use of indicators of the present invention.
  • the present invention provides a method for producing graphical indicators and interactive systems for utilizing the graphical indicators.
  • Some visually negligible graphical indicators are affixed on the surface of an object.
  • the graphical indicators co-exist with a main information, such as a text or picture, on the surface of object, and do not interfere with the perception of human eyes to the main information.
  • a user retrieves the graphical indicators through an electronic system and acquires additional information from the graphical indicators.
  • the user can utilize the graphical indicators without a complicated platform providing coordinate system.
  • the typical book or the surface of object can carry more information through the graphical indicators.
  • one aspect of the graphical indicators is that the graphical indicators are so visually negligible that do not interfere with the main information on the surface of object.
  • Another aspect of the graphical indicators is that the graphical indicators are not interfered by the other information on the surface when the electronic system reads the graphical indicators.
  • each graphical indicator includes multiple graphical micro-units arranged in a layout. Shown in FIG. 1(A) , which has scale of 2.5:1, the combination 100 of the graphical micro-units in a background to “APPLE” is the matrix consisting of graphical micro-units. The micro-units can be reduced further such that the combination 100 of the graphical micro-units is visually negligible or is viewed as a background material by human eyes.
  • the shape of the graphical micro-units may be regular or irregular shape, such as a round spot.
  • the graphical micro-unit must be so tiny that only a microscope apparatus can detect it.
  • the combination 100 of the graphical micro-units consists of multiple graphical indicators arranged in sequence.
  • Each graphical indicator includes multiple state zones for selectively respectively storing the graphical micro-units, wherein each of the state zones displays a state from at least two candidate states.
  • FIG. 1(B) is an enlarged diagram illustrating one of the graphical indicators in FIG. 1(A) .
  • the graphical indicator 11 includes 36 units of state zones 113 in the form of 6 by 6 matrix.
  • Each state zone 113 selectively includes one graphical micro-unit or does not include the graphical micro-unit to represent the first or second state.
  • bit matrix form 114 shown in FIG. 1(C) is resulted.
  • the bit matrix form 114 stores a variety of information as expected or desired. In other word, the user can store desired information based on the combination of different values of the state zones.
  • the multiple graphical indicators, as well as the graphical micro-units are arranged in two-dimension matrix forms. Such arrangements of the graphical indicators and the graphical micro-units look homogenous to human eyes.
  • the present invention provides a method for retrieving the individual graphical indicator from the matrix form of the graphical indicators.
  • the graphical indicator 11 includes a header information 111 and a content information 112 arranged in a layout that corresponds to different indicator information.
  • all header information 111 are identical among different graphical indicators 11 .
  • more than one set of header information may be employed as long as each header information within each graphical indicator is capable of distinguishing the corresponding graphical indicator from adjacent graphical indicators and indicating the orientation of the corresponding graphical indicator to the optical device.
  • different value of content information 112 represents different indicator information.
  • one graphical indicator 11 is read through capturing one header information 111 , and the graphical indicator 11 does not interfere with each adjacent graphical indicator 11 .
  • the header information 111 in one graphical indicator 11 may be different from that of other graphical indicator 11 as long as the system can use the header information to retrieve the corresponding content information.
  • FIG. 1(D) which has scale of 120:1, is a schematic diagram illustrating the two-dimensional matrix form in accordance with the present invention.
  • the user first searches the header information 111 and further retrieves the graphical indicator 11 and the corresponding content information 112 .
  • the image corresponding to the matrix form of the graphical indicators is rotated and converted into bit matrix form, shown in FIG. 1(F) during the process.
  • each zone corresponds to an index value.
  • the graphical indicator corresponding to identical indicator information is repeatedly arranged in each index zone.
  • the graphical indicator corresponding to different indicator information is repeatedly arranged in different index zones.
  • the system maker of the invention records the corresponding relationship of the indicator information to the index zone in an electronic apparatus. When the electronic apparatus captures an image from a index zone, it can acquire the index value of the zone using the corresponding relationship.
  • FIG. 1(E) which has scale of 20:1 is an enlarged diagram illustrating the index zones and the graphical indicators in accordance with the present invention.
  • the graphical indicators 11 corresponding to same indicator information are arranged in the index zone 12 .
  • the graphical indicators corresponding to different indicator information are respectively arranged in the other index zones.
  • FIGS. 2(A)-2(C) are the diagrams illustrating other embodiments for the graphical indicators in accordance with the present invention. Shown in FIGS. 2(A)-2(C) , a vertical segment represents the first state, and a horizontal segment represents the second state.
  • FIG. 2(D) is the diagram illustrating other embodiment for the arrangement of the graphical indicators in accordance with the present invention. Different from the matrix arrangement in FIGS. 1(A)-1(F) , a cellular arrangement is set forth in FIG. 2(D) .
  • different graphical indicators may also be arranged in one index zone as shown in FIG. 2(E) .
  • the letters “A”, “B”, “C”, and “D” respectively represent four different graphical indicators corresponding to four different indicator information. These four different graphical indicators are repeatedly arranged in sequence within one index zone, shown in FIG. 2(E) .
  • each graphical indicator must be tiny and human eyes can not differentiate one graphical indicator from others.
  • each square centimeter of the selected zone includes more than 3000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
  • each square centimeter of the selected zone includes more than 6000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
  • the following provides the methods for capturing the graphical indicators by an electronic system without interference with main information on the surface of object.
  • a desired color is obtained by combining primitive color inks: cyan (C), magenta (M), yellow (Y), and black (K).
  • C cyan
  • M magenta
  • Y yellow
  • K black
  • hue and saturation are obtained by adjusting combination of C, Y, and M
  • brightness is obtained by adjusting K.
  • infrared ray has high transmittance for most of C, M, Y primitive color inks, but has low transmittance for most of K color inks.
  • C, M, Y color inks hardly absorb the infrared ray, but black color ink substantially absorbs the infrared ray. Therefore, infrared ray transmits through most of C, M, Y color inks and displays high brightness after reflecting from a light-coloured object surface under C, M, Y color inks.
  • the surface that is printed in black color ink displays low brightness because of the absorption of the infrared ray by most of black color ink.
  • a detector receives an image corresponding to graphical indicators printed in most of black color ink, the image does not interfere with main information printed in most of C, M, Y color inks.
  • the main information needs to be printed in black
  • one type of black color in the specification we called it Near_K, which hardly absorbs infrared ray, is used to print the main information.
  • Mixing C, M, Y colors under predetermined ratio makes Near_K that displays visual black, such as dark indigo or dark brown.
  • the ratio for mixing C, M, Y colors to obtain Near_K color is well known to the people skilled in the art. Since Near_K is made by C, M, Y color inks, Near_K is transmittable by infrared ray. And, to cooperate with this arrangement, the graphical indicators are printed using K (black) color.
  • the black color is used for an example and, however, it is not a limitation.
  • Other inks that can substantially absorb the infrared ray can be used to print graphical indicators. This approach has advantage of low cost.
  • any type of oil ink no matter what color it shows, that could substantially absorb infrared ray, are suitable for the print of graphical indicator and are intended scope of protection of present application.
  • Any types of oil ink, that are transmittable by infrared and are close to black visually, i.e. some oil ink of edibility-class without carbon element, can also be used as Near-K color.
  • Near-K color may act as role of black color of four primitive colors (C,M,Y,K) while printing the main information over the surface.
  • Another method is to directly use visual light. Since there are many graphical indicators that are not overlapped with the main information, as long as the detector detects single graphical indicator, the indicator information can be obtained.
  • the additional information is encoded into the indicator information by method of compressed encoding.
  • the electronic system retrieves the indicator information, it acquires the additional information by decoding the indicator information.
  • the processing device of the invention responsive to the graphical indicators, acquires the corresponding additional information by processing (decoding) the graphical indicators.
  • mapping unit stored in the electronic system.
  • the embodiments of the mapping unit include a database or a lookup table, etc.
  • Actual implementations for the mapping unit include a hard disk, a floppy disk, a compact disk, a read-only memory, or a memory card.
  • the electronic system acquires the additional information corresponding to the indicator information through the mapping unit.
  • the processing device responsive to the graphical indicators, acquires the corresponding additional information by transforming the graphical indicators.
  • the processing device responsive to the graphical indicators, acquires the corresponding additional information by processing and/or transforming the graphical indicators.
  • FIG. 3 is a schematic diagram illustrating an electronic system 31 in accordance with the present invention.
  • the electronic system 31 includes an optical device 311 , i.e. an image acquiring device, a processing device 312 , i.e. an image-processing circuit, and an output device 313 , i.e. an output circuit.
  • the processing device 312 is wired or wireless coupled to the optical device 311 .
  • the processing device 312 is wired or wireless coupled to the output device 313 .
  • FIG. 4 is a schematic flowchart illustrating the operation of the electronic system in accordance with the present invention.
  • the optical device 311 captures an image from the surface of object (step 41 ) that includes the graphical indicator.
  • the processing device 312 retrieves the graphical indicator from the image (step 42 ) and acquires the additional information corresponding to the graphical indicator (step 43 ).
  • the output device 313 receives the additional information from the processing device 312 and outputs the additional information (step 44 ).
  • FIG. 5 is an embodiment of the processing system in accordance with the present invention.
  • the main information is printed on the surface of an object 51 .
  • the main information in the embodiment includes multiple icons 511 and corresponding illustrations 513 .
  • Such main information is generally used in a typical language-learning book or children-teaching book.
  • the object is made of plastic, paper, or any printable carriers.
  • the surface of object 51 includes multiple index zones on which respective icons 511 and illustrations 513 are affixed.
  • the index zone corresponding to the icon 511 is printed with multiple identical graphical indicators 512 .
  • the graphical indicator 512 is visible. But in actual practice, the graphical indicator 512 may be so tiny as to be non-visible to human naked eyes.
  • the icon 511 is directly captured by human eyes 52 .
  • the electronic system 31 is used to acquire the additional information corresponding to the graphical indicator 512 .
  • the optical device 311 captures the image including the graphical indicator 512 and transfers the image to the processing device 312 . Then the processing device 312 retrieves the graphical indicator 512 from the image and acquires the additional information corresponding to the graphical indicator 512 .
  • the additional information includes audio information, such as pronunciations of horse in English or other visual information, such as illustration of horse. Then the output device 313 outputs the audio information with a speaker 3131 and the visual information with a display panel 3132 .
  • other types of information sensible by human being such as olfactory or tactual information, can also be outputted.
  • FIG. 6 is a schematic diagram illustrating details of the electronic apparatus in accordance with the present invention.
  • the electronic apparatus includes an optical-reading device 61 , an image-processing circuit 62 , and an output circuit 63 .
  • the optical-reading device 61 includes one or more sensor units 611 and one or more active light source 612 .
  • the exemplary sensor unit 611 includes sensor micro-units, such as charge couple devices (CCD) or CMOS sensor units.
  • the image-processing circuit 62 includes a digital signal processor 621 (DSP) and a read-only memory card (ROM card) 622 .
  • the read-only memory card (ROM card) 622 functions as a mapping unit.
  • FIG. 6 and FIG. 7 together illustrate the operation of embodiment.
  • FIG. 7 is a schematic flow chart illustrating the operation of the electronic apparatus in FIG. 6 .
  • the active light source 612 of the optical-reading device 61 irradiates active light beam 613 onto the surface of object 64 (step 71 ).
  • the surface of object 64 absorbs the portion of the active light beam 613 and reflects or scatters the light.
  • the sensor unit 611 captures the scattered light 614 through subsequent lens 615 and an optic filter 616 to form an image (step 72 ) and converts the image into electronic information (step 73 ).
  • the sensor unit 611 transfers the electronic information to the image-processing circuit 62 for image processing purpose.
  • the image-processing circuit 62 extracts the combination of the graphical micro-units from the electronic information (step 74 ).
  • the exemplary combination of the graphical micro-units is denoted as 100 in FIGS. 1(A) to 1(E) .
  • the image-processing circuit 62 converts the combination of the graphical micro-units into the numeral codes (step 75 ). For example, the combination of the graphical micro-units in FIG. 1(B) converts into the bit array shown in FIG. 1(C) .
  • the image-processing circuit 62 retrieves the indicator information according to the numeral codes (step 76 ) and further acquires the additional information corresponding to the indicator information (step 77 ).
  • the ROM card 622 stores the mapping relationship of the indicator information and the additional information.
  • the digital signal processor 621 executes the image process above-mentioned.
  • the output circuit 63 outputs the additional information (step 78 ).
  • the additional information is audio information.
  • the output circuit 63 includes a speaker that outputs the audio information corresponding to the zone on the surface of object irradiated by the active light source 612 .
  • the read-only memory card (ROM card) 622 per se includes a built-in digital signal processor.
  • the mapping unit i.e. read-only memory card (ROM card) 622 , retrieves additional information corresponding to the indicator information responsive to the command from digital signal processor 621 .
  • FIG. 8 is a schematic diagram illustrating one practical application in accordance with the present invention.
  • the optical device includes an input pen 81 .
  • the processing device is embedded in a general-purpose computer 82 and is programmable.
  • the output device includes a monitor 831 and a speaker 832 .
  • the book 80 has the graphical indicators of the present invention at predetermined locations, and a disc 821 is accompanied with the book 80 .
  • the optical device of the input pen 81 captures the image of the selected zone and transfers it to the general-purpose computer 82 run by the program in the disc 821 .
  • the general-purpose computer 82 processes the image and acquires the additional information under control of the disc 821 , and retrieves the additional information.
  • the additional information includes the explanation of the graphical indicators retrieved and the audio information.
  • the monitor 831 coupled to the general-purpose computer 82 outputs an illustration 834 , as well as the speaker 832 outputs the audio information.
  • the additional information may also include commands for controlling other interactive devices.
  • FIG. 9 is a schematic diagram illustrating the additional information used for controlling a responsive device in accordance with the present invention.
  • the surface of object 90 includes multiple index zones, and each index zone has one main information 9011 , such as alphanumeric information on a conventional key cap. Furthermore, one desired graphical indicator 9012 is affixed to the same index zone.
  • the optical device of an electronic system 91 captures the image including the graphical indicator 9012 .
  • the processing device of the electronic system 91 retrieves the graphical indicator 9012 from the image and acquires the additional information corresponding to the graphical indicator 9012 .
  • the additional information is a command corresponding to the main information 9011 .
  • the electronic system 91 transfers the command to a response device 92 .
  • the response device 92 may be an audio device capable of generating sound of corresponding piano key. Under the same concept while altering the patterns, the object 90 may easily become a computer keyboard or calculator keyboard.
  • the response device 92 may include mobile phone, personal digital assistant, notebook, and other electronic devices.
  • FIG. 10 is a schematic diagram illustrating the application of the present invention to information appliances.
  • An interactive television 101 is equipped with a set top box 1011 for receiving user-interactive commands.
  • a brochure 103 provided by cable TV program supplier is designed to include the graphical indicator of the invention.
  • the input device retrieves the graphical indicator from the image of the program 104 and acquires the additional information corresponding to the graphical indicator.
  • the additional information is a command to the set top box 1011 .
  • the output device in the remote selector 102 is an infrared emitter for transferring the command to the set top box 1011 .
  • the present invention provides an input solution for the interactive television 101 .
  • FIG. 11 is a schematic diagram illustrating the additional information used to control other devices.
  • a response device 1001 includes puppets 10011 , 10012 , 10013 , word-line display panel 10014 , and display panel 10015 .
  • a script book 10018 is provided to include the graphical indicators corresponding to the contents. The user selects the specific content with the electronic device 10016 . For example, if the user would like to have a sunny day displayed in the display panel 10015 , he or she captures the corresponding graphical indicator on the script book 10018 using the electronic device 10016 . The electronic device 10016 retrieves the graphical indicator and acquires the corresponding additional information.
  • the additional information is the command 10017 transmitted for controlling the response device 1001 .
  • the electronic device 10016 transfers the command 10017 to the response device 1001 through wireless or infrared transmission.
  • the response device 1001 displays the sunny day on the display panel 10015 in response to the command 10017 .
  • the electronic device 10016 retrieves the graphical indicators corresponding to the dialogue 10019 and then acquires a command of additional information.
  • the electronic device 10016 transfers the command to the response device 1001 and the puppet 10012 .
  • the response device 1001 displays the dialogue 10019 on the word-line display panel 10014 , and the puppet 10012 speaks dialogue when making the action.
  • FIG. 12(A) is a graph illustrating the conventional bar code 10001 in the prior art.
  • FIG. 12(B) is a graph illustrating use of indicators 10002 , 10003 of the present invention.
  • the information implicitly stored in the conventional bar code 10001 is now stored in the graphical indicator 10002 provided by the invention, and the information of an editor or a writer is stored in the graphical indicator 10003 provided by the invention.
  • the graphical indicators 10002 , 10003 do not interfere with other main information on the surface 10000 .
  • This invention may be implemented into a coordinate positioning system as index value mentioned above is a coordinate value when a coordinate system is predefined over the surface.
  • the coordinate positioning system allows a user to make positioning action over a surface of an object while the surface including a main information.
  • the coordinate positioning system includes a coordinate system and a device.
  • the coordinate system implemented over the surface, includes multiple coordinate zones.
  • Each coordinate zone includes at least a visually negligible graphical indicator
  • the graphical indicator includes multiple graphical micro-units co-existing with the main information over the surface without interference with the main information.
  • the multiple graphical micro-units are arranged in a layout in the graphical indicator, the layout corresponds to an indicator information indicating a coordinate value of each coordinate zone.
  • the device is used for capturing the layout from the graphical indicator, retrieving the coordinate value responsive to the layout, and providing a response in response to the coordinate value.

Abstract

The present invention discloses a method for producing graphical indicators and interactive systems for utilizing the graphical indicators. On the surface of an object, visually negligible graphical indicators are provided. The graphical indicators and main information, i.e. text or pictures, co-exist on the surface of object. The graphical indicators do not interfere with the main information when the perception of human eyes are concerned. With the graphical indicators, further information other than the main information on the surface of object are carried. In addition to the main information on the surface of object, one is able to obtain additional information through an auxiliary electronic device or trigger an interactive operation.

Description

    CROSS REFERENCE FOR RELATED APPLICATIONS
  • This application is a Divisional of U.S. application Ser. No. 10/189,244 filed on Jul. 2, 2002. Priority is claimed on U.S. application Ser. No. 10/189,244 filed on Jul. 2, 2002, which claims the priority date of R.O.C. Patent Application No. 091100350 filed on Jan. 11, 2002, all of which is incorporated by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to a method for producing indicators and processing apparatus and system utilizing the indicators, and more particularly, to a method, an apparatus and a system for providing additional information from the indicators affixed onto the surface of an object.
  • 2. Description of the Prior Art
  • Dating back to ancient time, people start delivering information by recording information on surfaces of various objects. For example, since the birth of paper, people acquire the information through characters and drawings affixed on papers. Furthermore, in recent years, with distinctive colors, characters, or pictures attached to different locations on surface of an object, people try to disclose the information with regard to each different position of the object.
  • When people observe the surface of object, they generally capture the information visually. However, the amount or types of the information carried by the surface of object are generally limited under the restrictions of the area size, beautification of the surface.
  • Nowadays, due to the advance of electronic technology, the visual information has been retrieved from its original carrier and stored as the digital information in an electronic apparatus. And people read them directly from the electronic apparatus. However, it is difficult for the digital information to totally replace the information printed in books or information attached to the surface of object.
  • On the other hand, through hyper link approach of computer technology, the digital information can be displayed in multiple dimensions, while the information printed in book or attached to the object still are displayed in two dimensions. Thus, if multiple dimensions information can be recorded on the book or the object, people can acquire additional information through the electronic apparatus.
  • SUMMARY OF THE INVENTION
  • One aspect of the present invention is to provide a method for producing graphical indicators. Some visually negligible graphical indicators are affixed on the surface of an object. The graphical indicators co-exist with main information, such as a text or picture, on the surface of object, and do not interfere with the perception of human eyes to the main information. A user retrieves the graphical indicators through an electronic system that does not couple with the object and acquires additional information from the graphical indicators.
  • Another aspect of the present invention provides an apparatus and a system utilizing the graphical indicators. The apparatus or the system includes an optical-reading device, a processing device, and an output device. The optical-reading device captures an image including the graphical indicators from the surface of object, the processing device, responsive to the graphical indicators, acquires the corresponding additional information by processing and/or transforming the graphical indicators, and the output device outputs the additional information.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1(A) is a schematic diagram illustrating the graphical indicators on the surface of object in accordance with the present invention;
  • FIG. 1(B) is an enlarged diagram illustrating one of the graphical indicators in FIG. 1(A);
  • FIG. 1(C) is a schematic diagram illustrating the combination of the graphical micro-units in FIG. 1(B) converting into the bit array;
  • FIG. 1(D) is a schematic diagram illustrating the two-dimensional matrix form in accordance with the present invention;
  • FIG. 1(E) is an enlarged diagram illustrating the index zones and the graphical indicators in accordance with the present invention;
  • FIG. 1(F) illustrates the image corresponding to the matrix form of the graphical indicators converted into a bit matrix form in accordance with the present invention;
  • FIGS. 2(A)-2(C) are the diagrams illustrating various embodiments in accordance with the present invention;
  • FIG. 2(D) is the diagram illustrating other embodiment for the arrangement of the graphical indicators in accordance with the present invention;
  • FIG. 2(E) is the diagram illustrating the different graphical indicators arranged in a index zone in accordance with the present invention;
  • FIG. 3 is a schematic diagram illustrating an electronic system in accordance with the present invention;
  • FIG. 4 is a schematic flowchart illustrating the operation of the electronic system in accordance with the present invention;
  • FIG. 5 is an embodiment of the processing system in accordance with the present invention;
  • FIG. 6 is a schematic diagram illustrating the electronic apparatus in accordance with the present invention;
  • FIG. 7 is a schematic flow chart illustrating the operation of the electronic apparatus in accordance with the present invention;
  • FIG. 8 is a schematic diagram illustrating one practical application in accordance with the present invention;
  • FIG. 9 is a schematic diagram illustrating the additional information used for controlling a response device in accordance with the present invention;
  • FIG. 10 is a schematic diagram illustrating the application of the present invention to information appliances;
  • FIG. 11 is a schematic diagram illustrating the additional information used to control other devices;
  • FIG. 12(A) is a graph illustrating the conventional bar code in the prior art; and
  • FIG. 12(B) is a graph illustrating use of indicators of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • The present invention provides a method for producing graphical indicators and interactive systems for utilizing the graphical indicators. Some visually negligible graphical indicators are affixed on the surface of an object. The graphical indicators co-exist with a main information, such as a text or picture, on the surface of object, and do not interfere with the perception of human eyes to the main information. A user retrieves the graphical indicators through an electronic system and acquires additional information from the graphical indicators. The user can utilize the graphical indicators without a complicated platform providing coordinate system. Furthermore, the typical book or the surface of object can carry more information through the graphical indicators.
  • Exemplary Design for the Graphical Indicators
  • In the present invention, one aspect of the graphical indicators is that the graphical indicators are so visually negligible that do not interfere with the main information on the surface of object. Another aspect of the graphical indicators is that the graphical indicators are not interfered by the other information on the surface when the electronic system reads the graphical indicators.
  • For the visually negligible feature of graphical indicator, each graphical indicator includes multiple graphical micro-units arranged in a layout. Shown in FIG. 1(A), which has scale of 2.5:1, the combination 100 of the graphical micro-units in a background to “APPLE” is the matrix consisting of graphical micro-units. The micro-units can be reduced further such that the combination 100 of the graphical micro-units is visually negligible or is viewed as a background material by human eyes.
  • In practical application, the shape of the graphical micro-units may be regular or irregular shape, such as a round spot. For best result, the graphical micro-unit must be so tiny that only a microscope apparatus can detect it.
  • When the graphical micro-units are tiny and arranged loosely in the layout, the user easily neglects the combination 100 of graphical micro-units and pays attention to main information, like the word “APPLE” depicted in FIG. 1(A). Next, we explain how to use the graphical indicator to carry information.
  • The combination 100 of the graphical micro-units consists of multiple graphical indicators arranged in sequence. Each graphical indicator includes multiple state zones for selectively respectively storing the graphical micro-units, wherein each of the state zones displays a state from at least two candidate states.
  • For example, shown in FIG. 1(B) is an enlarged diagram illustrating one of the graphical indicators in FIG. 1(A). The graphical indicator 11 includes 36 units of state zones 113 in the form of 6 by 6 matrix. Each state zone 113 selectively includes one graphical micro-unit or does not include the graphical micro-unit to represent the first or second state.
  • When the micro-units in state zone 113 of the first state are assigned value of one and those of the second state are assigned value of zero, a bit matrix form 114 shown in FIG. 1(C) is resulted. Thus, the bit matrix form 114 stores a variety of information as expected or desired. In other word, the user can store desired information based on the combination of different values of the state zones.
  • Furthermore, the multiple graphical indicators, as well as the graphical micro-units, are arranged in two-dimension matrix forms. Such arrangements of the graphical indicators and the graphical micro-units look homogenous to human eyes. Next, the present invention provides a method for retrieving the individual graphical indicator from the matrix form of the graphical indicators.
  • Shown in FIG. 1(B), which has scale of 100:1, the graphical indicator 11 includes a header information 111 and a content information 112 arranged in a layout that corresponds to different indicator information. In one embodiment, all header information 111 are identical among different graphical indicators 11. However, for a more comprehensive design, more than one set of header information may be employed as long as each header information within each graphical indicator is capable of distinguishing the corresponding graphical indicator from adjacent graphical indicators and indicating the orientation of the corresponding graphical indicator to the optical device. On the other hand, different value of content information 112 represents different indicator information. Thus, one graphical indicator 11 is read through capturing one header information 111, and the graphical indicator 11 does not interfere with each adjacent graphical indicator 11. However, in another embodiment, the header information 111 in one graphical indicator 11 may be different from that of other graphical indicator 11 as long as the system can use the header information to retrieve the corresponding content information.
  • FIG. 1(D), which has scale of 120:1, is a schematic diagram illustrating the two-dimensional matrix form in accordance with the present invention. The user first searches the header information 111 and further retrieves the graphical indicator 11 and the corresponding content information 112.
  • Furthermore, in order to rapidly retrieve the indicator information, the image corresponding to the matrix form of the graphical indicators is rotated and converted into bit matrix form, shown in FIG. 1(F) during the process.
  • Furthermore, we divide the surface of object into multiple index zones. Each zone corresponds to an index value. The graphical indicator corresponding to identical indicator information is repeatedly arranged in each index zone. The graphical indicator corresponding to different indicator information is repeatedly arranged in different index zones. The system maker of the invention records the corresponding relationship of the indicator information to the index zone in an electronic apparatus. When the electronic apparatus captures an image from a index zone, it can acquire the index value of the zone using the corresponding relationship.
  • For example, FIG. 1(E), which has scale of 20:1, is an enlarged diagram illustrating the index zones and the graphical indicators in accordance with the present invention. The graphical indicators 11 corresponding to same indicator information are arranged in the index zone 12. The graphical indicators corresponding to different indicator information are respectively arranged in the other index zones.
  • Other embodiment for the graphical indicators is possible. For example, FIGS. 2(A)-2(C) are the diagrams illustrating other embodiments for the graphical indicators in accordance with the present invention. Shown in FIGS. 2(A)-2(C), a vertical segment represents the first state, and a horizontal segment represents the second state.
  • Furthermore, FIG. 2(D) is the diagram illustrating other embodiment for the arrangement of the graphical indicators in accordance with the present invention. Different from the matrix arrangement in FIGS. 1(A)-1(F), a cellular arrangement is set forth in FIG. 2(D).
  • Alternately, different graphical indicators may also be arranged in one index zone as shown in FIG. 2(E). The letters “A”, “B”, “C”, and “D” respectively represent four different graphical indicators corresponding to four different indicator information. These four different graphical indicators are repeatedly arranged in sequence within one index zone, shown in FIG. 2(E).
  • There are requirements for the graphical indicators being negligible to human eyes. First, each graphical indicator must be tiny and human eyes can not differentiate one graphical indicator from others. Second, according to the size of the graphical micro-unit, the pitch between micro-unit, and the desired visual effect, one should reduce the number of the graphical micro-units used. In this way, the graphical indicators have little influence on the brightness of the surface of object. Furthermore, number of graphical micro-units of each graphical indicator is substantially equal to each other, and therefore the graphical indicators look more homogenous to human eyes and become invisible to human eyes.
  • In a first embodiment, each square centimeter of the selected zone includes more than 3000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
  • In a second embodiment, each square centimeter of the selected zone includes more than 6000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
  • The following provides the methods for capturing the graphical indicators by an electronic system without interference with main information on the surface of object.
  • First, a method utilizing infrared ray and oil ink is illustrated below.
  • While printing the information on conventional media, a desired color is obtained by combining primitive color inks: cyan (C), magenta (M), yellow (Y), and black (K). Generally, hue and saturation are obtained by adjusting combination of C, Y, and M, and brightness is obtained by adjusting K.
  • It is noted that infrared ray has high transmittance for most of C, M, Y primitive color inks, but has low transmittance for most of K color inks. In other words, C, M, Y color inks hardly absorb the infrared ray, but black color ink substantially absorbs the infrared ray. Therefore, infrared ray transmits through most of C, M, Y color inks and displays high brightness after reflecting from a light-coloured object surface under C, M, Y color inks. On the contrary, the surface that is printed in black color ink displays low brightness because of the absorption of the infrared ray by most of black color ink. Thus, when a detector receives an image corresponding to graphical indicators printed in most of black color ink, the image does not interfere with main information printed in most of C, M, Y color inks.
  • On the other hand, when the main information needs to be printed in black, one type of black color, in the specification we called it Near_K, which hardly absorbs infrared ray, is used to print the main information. Mixing C, M, Y colors under predetermined ratio makes Near_K that displays visual black, such as dark indigo or dark brown. The ratio for mixing C, M, Y colors to obtain Near_K color is well known to the people skilled in the art. Since Near_K is made by C, M, Y color inks, Near_K is transmittable by infrared ray. And, to cooperate with this arrangement, the graphical indicators are printed using K (black) color.
  • In the above description, the black color is used for an example and, however, it is not a limitation. Other inks that can substantially absorb the infrared ray can be used to print graphical indicators. This approach has advantage of low cost. It is to be noted that any type of oil ink, no matter what color it shows, that could substantially absorb infrared ray, are suitable for the print of graphical indicator and are intended scope of protection of present application. Any types of oil ink, that are transmittable by infrared and are close to black visually, i.e. some oil ink of edibility-class without carbon element, can also be used as Near-K color. Near-K color may act as role of black color of four primitive colors (C,M,Y,K) while printing the main information over the surface.
  • On the other end, it is known that most oil inks absorb ultra-violent or blue light. That is, they do not produce light in visible spectrum when irradiated by ultra-violent or blue light. However, special type ink, such as fluorescent ink, produces visual image under the irradiation of ultra-violet or blue light. Thus, under this approach, the graphical indicators are printed in fluorescent ink, and the main information is printed in a typical oil ink. To cope with the arrangement, ultra-violent or blue light is used to irradiate the surface of object while reading the image. Afterwards, the non-interference image can be obtained by implementing an optical filter for filtering out unwanted spectrum portion.
  • Another method is to directly use visual light. Since there are many graphical indicators that are not overlapped with the main information, as long as the detector detects single graphical indicator, the indicator information can be obtained.
  • There are more than one approaches to generate (prepare) the indicator information. For example, the additional information is encoded into the indicator information by method of compressed encoding. When the electronic system retrieves the indicator information, it acquires the additional information by decoding the indicator information. When this approach is adopted, the processing device of the invention, responsive to the graphical indicators, acquires the corresponding additional information by processing (decoding) the graphical indicators.
  • Another way to obtain the additional information from the indicator information is using a mapping unit stored in the electronic system. The embodiments of the mapping unit include a database or a lookup table, etc. Actual implementations for the mapping unit include a hard disk, a floppy disk, a compact disk, a read-only memory, or a memory card. The electronic system acquires the additional information corresponding to the indicator information through the mapping unit. When this approach is adopted, the processing device, responsive to the graphical indicators, acquires the corresponding additional information by transforming the graphical indicators. Furthermore, for a more complicated design, the processing device, responsive to the graphical indicators, acquires the corresponding additional information by processing and/or transforming the graphical indicators.
  • Exemplary Electronic System Utilizing the Graphical Indicators
  • FIG. 3 is a schematic diagram illustrating an electronic system 31 in accordance with the present invention. The electronic system 31 includes an optical device 311, i.e. an image acquiring device, a processing device 312, i.e. an image-processing circuit, and an output device 313, i.e. an output circuit. The processing device 312 is wired or wireless coupled to the optical device 311. Similarly, the processing device 312 is wired or wireless coupled to the output device 313.
  • FIG. 4 is a schematic flowchart illustrating the operation of the electronic system in accordance with the present invention. The optical device 311 captures an image from the surface of object (step 41) that includes the graphical indicator. Next, the processing device 312 retrieves the graphical indicator from the image (step 42) and acquires the additional information corresponding to the graphical indicator (step 43). The output device 313 receives the additional information from the processing device 312 and outputs the additional information (step 44).
  • FIG. 5 is an embodiment of the processing system in accordance with the present invention. The main information is printed on the surface of an object 51. The main information in the embodiment includes multiple icons 511 and corresponding illustrations 513. Such main information is generally used in a typical language-learning book or children-teaching book. The object is made of plastic, paper, or any printable carriers.
  • In addition, the surface of object 51 includes multiple index zones on which respective icons 511 and illustrations 513 are affixed. In particular, the index zone corresponding to the icon 511 is printed with multiple identical graphical indicators 512. To illustrate clearly, the graphical indicator 512 is visible. But in actual practice, the graphical indicator 512 may be so tiny as to be non-visible to human naked eyes.
  • In this embodiment, the icon 511 is directly captured by human eyes 52. In addition, the electronic system 31 is used to acquire the additional information corresponding to the graphical indicator 512.
  • As the electronic system 31 is directed to a zone to that the graphical indicator 512 is affixed, the optical device 311 captures the image including the graphical indicator 512 and transfers the image to the processing device 312. Then the processing device 312 retrieves the graphical indicator 512 from the image and acquires the additional information corresponding to the graphical indicator 512. In the embodiment, the additional information includes audio information, such as pronunciations of horse in English or other visual information, such as illustration of horse. Then the output device 313 outputs the audio information with a speaker 3131 and the visual information with a display panel 3132. In addition, other types of information sensible by human being, such as olfactory or tactual information, can also be outputted.
  • FIG. 6 is a schematic diagram illustrating details of the electronic apparatus in accordance with the present invention. In the embodiment, the electronic apparatus includes an optical-reading device 61, an image-processing circuit 62, and an output circuit 63. The optical-reading device 61 includes one or more sensor units 611 and one or more active light source 612. The exemplary sensor unit 611 includes sensor micro-units, such as charge couple devices (CCD) or CMOS sensor units. In the embodiment, the image-processing circuit 62 includes a digital signal processor 621 (DSP) and a read-only memory card (ROM card) 622. The read-only memory card (ROM card) 622 functions as a mapping unit.
  • FIG. 6 and FIG. 7 together illustrate the operation of embodiment. FIG. 7 is a schematic flow chart illustrating the operation of the electronic apparatus in FIG. 6. The active light source 612 of the optical-reading device 61 irradiates active light beam 613 onto the surface of object 64 (step 71). The surface of object 64 absorbs the portion of the active light beam 613 and reflects or scatters the light. The sensor unit 611 captures the scattered light 614 through subsequent lens 615 and an optic filter 616 to form an image (step 72) and converts the image into electronic information (step 73).
  • The sensor unit 611 transfers the electronic information to the image-processing circuit 62 for image processing purpose. The image-processing circuit 62 extracts the combination of the graphical micro-units from the electronic information (step 74). The exemplary combination of the graphical micro-units is denoted as 100 in FIGS. 1(A) to 1(E). Next, the image-processing circuit 62 converts the combination of the graphical micro-units into the numeral codes (step 75). For example, the combination of the graphical micro-units in FIG. 1(B) converts into the bit array shown in FIG. 1(C). Then the image-processing circuit 62 retrieves the indicator information according to the numeral codes (step 76) and further acquires the additional information corresponding to the indicator information (step 77). In the embodiment, the ROM card 622 stores the mapping relationship of the indicator information and the additional information. The digital signal processor 621 executes the image process above-mentioned.
  • Next, the output circuit 63 outputs the additional information (step 78). In the embodiment, the additional information is audio information. The output circuit 63 includes a speaker that outputs the audio information corresponding to the zone on the surface of object irradiated by the active light source 612.
  • Alternatively, the read-only memory card (ROM card) 622 per se includes a built-in digital signal processor. Under this arrangement, the mapping unit, i.e. read-only memory card (ROM card) 622, retrieves additional information corresponding to the indicator information responsive to the command from digital signal processor 621.
  • FIG. 8 is a schematic diagram illustrating one practical application in accordance with the present invention. In the embodiment, the optical device includes an input pen 81. The processing device is embedded in a general-purpose computer 82 and is programmable. The output device includes a monitor 831 and a speaker 832. The book 80 has the graphical indicators of the present invention at predetermined locations, and a disc 821 is accompanied with the book 80. When the user directs the input pen 81 to the selected zone of the book 80, such as zone at which “BOOK” is printed, the optical device of the input pen 81 captures the image of the selected zone and transfers it to the general-purpose computer 82 run by the program in the disc 821. The general-purpose computer 82 processes the image and acquires the additional information under control of the disc 821, and retrieves the additional information. The additional information includes the explanation of the graphical indicators retrieved and the audio information. Next, the monitor 831 coupled to the general-purpose computer 82 outputs an illustration 834, as well as the speaker 832 outputs the audio information.
  • Furthermore, the additional information may also include commands for controlling other interactive devices.
  • Application for Input of Information
  • FIG. 9 is a schematic diagram illustrating the additional information used for controlling a responsive device in accordance with the present invention. The surface of object 90 includes multiple index zones, and each index zone has one main information 9011, such as alphanumeric information on a conventional key cap. Furthermore, one desired graphical indicator 9012 is affixed to the same index zone.
  • The optical device of an electronic system 91 captures the image including the graphical indicator 9012. The processing device of the electronic system 91 retrieves the graphical indicator 9012 from the image and acquires the additional information corresponding to the graphical indicator 9012. The additional information is a command corresponding to the main information 9011. The electronic system 91 transfers the command to a response device 92. For instance, the response device 92 may be an audio device capable of generating sound of corresponding piano key. Under the same concept while altering the patterns, the object 90 may easily become a computer keyboard or calculator keyboard. The response device 92 may include mobile phone, personal digital assistant, notebook, and other electronic devices.
  • FIG. 10 is a schematic diagram illustrating the application of the present invention to information appliances. An interactive television 101 is equipped with a set top box 1011 for receiving user-interactive commands. A brochure 103 provided by cable TV program supplier is designed to include the graphical indicator of the invention. When the user selects one program 104 with an input device within the remote selector 102, the input device retrieves the graphical indicator from the image of the program 104 and acquires the additional information corresponding to the graphical indicator. In the embodiment, the additional information is a command to the set top box 1011. The output device in the remote selector 102 is an infrared emitter for transferring the command to the set top box 1011. Thus, the present invention provides an input solution for the interactive television 101.
  • Application for Control Function
  • Besides visual, olfactory or vibrating effects, the additional information includes controlling commands. FIG. 11 is a schematic diagram illustrating the additional information used to control other devices. As indicated, a response device 1001 includes puppets 10011, 10012, 10013, word-line display panel 10014, and display panel 10015. A script book 10018 is provided to include the graphical indicators corresponding to the contents. The user selects the specific content with the electronic device 10016. For example, if the user would like to have a sunny day displayed in the display panel 10015, he or she captures the corresponding graphical indicator on the script book 10018 using the electronic device 10016. The electronic device 10016 retrieves the graphical indicator and acquires the corresponding additional information. The additional information is the command 10017 transmitted for controlling the response device 1001. The electronic device 10016 transfers the command 10017 to the response device 1001 through wireless or infrared transmission. The response device 1001 displays the sunny day on the display panel 10015 in response to the command 10017.
  • As the electronic device 10016 is denoted to a dialogue 10019, the electronic device 10016 retrieves the graphical indicators corresponding to the dialogue 10019 and then acquires a command of additional information. The electronic device 10016 transfers the command to the response device 1001 and the puppet 10012. The response device 1001 displays the dialogue 10019 on the word-line display panel 10014, and the puppet 10012 speaks dialogue when making the action.
  • Substitute for Bar Code
  • The feature of the present invention is different from conventional bar code. FIG. 12(A) is a graph illustrating the conventional bar code 10001 in the prior art. FIG. 12(B) is a graph illustrating use of indicators 10002, 10003 of the present invention. In one embodiment, the information implicitly stored in the conventional bar code 10001 is now stored in the graphical indicator 10002 provided by the invention, and the information of an editor or a writer is stored in the graphical indicator 10003 provided by the invention. The graphical indicators 10002, 10003 do not interfere with other main information on the surface 10000.
  • Application for Coordinate Positioning System
  • This invention may be implemented into a coordinate positioning system as index value mentioned above is a coordinate value when a coordinate system is predefined over the surface. Under this application, the coordinate positioning system allows a user to make positioning action over a surface of an object while the surface including a main information. The coordinate positioning system includes a coordinate system and a device.
  • The coordinate system, implemented over the surface, includes multiple coordinate zones. Each coordinate zone includes at least a visually negligible graphical indicator, and the graphical indicator includes multiple graphical micro-units co-existing with the main information over the surface without interference with the main information. The multiple graphical micro-units are arranged in a layout in the graphical indicator, the layout corresponds to an indicator information indicating a coordinate value of each coordinate zone.
  • The device is used for capturing the layout from the graphical indicator, retrieving the coordinate value responsive to the layout, and providing a response in response to the coordinate value.
  • Those skilled in the art will readily observe that numerous modifications and alterations of the device may be made while retaining the teaching of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Claims (17)

1. An electronic book system comprising:
an optical device for capturing an image from a selected zone on a surface of a page of a book by a user, wherein the image includes a graphical indicator that is visually negligible and is affixed on the surface of the page of the book;
a processing circuitry coupled to the optical device for receiving the image, the processing circuitry retrieving the graphical indicator from the image and acquiring an additional information corresponding to the graphical indicator by processing and/or transforming the graphical indicators;
a speech circuitry retrieving the additional information and acquiring an audio information corresponding to the additional information by processing and/or transforming the additional information; and
a speaker coupled to the speech circuitry for outputting a sound corresponding to the audio information.
2. The electronic book system of claim 1, wherein the graphical indicator comprises a plurality of graphical micro-units arranged in a layout, the layout corresponds to an indicator information, the processing circuitry analyses the layout of the graphical micro-units to retrieve the indicator information and further to acquire the additional information from the indicator information by processing and/or transforming the graphical indicators.
3. The electronic book system of claim 2, wherein each graphical indicator occupies very small amount of area, and each graphical micro-unit occupies very small amount of area, and number of graphic micro-units of each graphical indicator is substantially equal to each other.
4. The electronic book system of claim 2, wherein the surface of the page of the book comprises a main information that overlaps and co-exists with the graphical micro-units on the surface of the page of the book, wherein the graphical micro-units are negligible when the user observes the main information.
5. The electronic book system of claim 4, wherein the graphical indicator comprises a plurality of state zones for selectively respectively storing the graphical micro-units, wherein each of the state zones displays a state from at least two candidate states.
6. The electronic book system of claim 5, wherein the candidate states comprise a first state and a second state, as in the first state, the state zone includes one graphical micro-unit, and as in the second state, the state zone does not include the graphical micro-unit.
7. The electronic book system of claim 6, wherein each square centimeter of the selected zone includes more than 3000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
8. The electronic book system of claim 6, wherein each square centimeter of the selected zone includes more than 6000 state zones of which less than seventy percent are in the first state, and percentage of area occupied by the graphical micro-unit in the state zone is less than 80.
9. The electronic book system of claim 6, wherein the state zones are arranged in a two-dimensional matrix form and the graphical indicator comprises a header information and a content information, each header information within each graphical indicator is capable of distinguishing the corresponding graphical indicator from adjacent graphical indicators and indicating the orientation of the corresponding graphical indicator to the optical device.
10. The electronic book system of claim 4, wherein each graphical micro-unit is printed in an ink that substantially absorbs infrared ray, and the main information is printed in an ink that hardly absorbs infrared ray, and the optical device emits infrared ray onto the surface of the page of the book and then receives a response image from the surface of the page of the book as the image.
11. The electronic book system of claim 10, wherein the ink is a black oil ink, while the main information is printed in a Near-K ink that hardly absorb infrared ray.
12. The electronic book system of claim 4, wherein each graphical micro-unit is printed in a fluorescent ink, and the main information is printed in a typical oil ink, the optical device emitting ultraviolet ray or blue ray onto the surface of the page of the book and then receiving a response image from the surface of the page of the book as the image.
13. The electronic book system of claim 4, wherein the surface of the page of the book comprises multiple index zones, each index zone corresponds to one index value, and multiple identical graphical indicators are arranged in each index zone.
14. The electronic book system of claim 1 further comprising a mapping unit indicating mapping relationship of the indicator information and the additional information, the processing circuitry being coupled to the mapping unit to retrieve one additional information corresponding to the indicator information.
15. The electronic book system of claim 1, wherein the graphical indicator is recorded in a vehicle that is affixed onto the surface of the page of the book.
16. The electronic book system of claim 1 further comprising a mapping unit indicating mapping relationship of the indicator information and the additional information, the mapping unit retrieves one additional information corresponding to the indicator information.
17. The electronic book system of claim 4, wherein each graphical micro-unit is printed in the Black (K) primitive color ink, and the main information is printed in the Cyan (C), Magenta (M), Yellow (Y) primitive color ink, or a combination thereof.
US12/003,349 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators Expired - Fee Related US7726570B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/003,349 US7726570B2 (en) 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,420 US8002198B2 (en) 2002-01-11 2009-11-19 Method for producing indicators and processing apparatus and system utilizing the indicators

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
TW091100350A TWI235926B (en) 2002-01-11 2002-01-11 A method for producing indicators and processing system, coordinate positioning system and electronic book system utilizing the indicators
TW91100350A 2002-01-11
TW091100350 2002-01-11
US10/189,244 US7328845B2 (en) 2002-01-11 2002-07-02 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/003,349 US7726570B2 (en) 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/189,244 Division US7328845B2 (en) 2002-01-11 2002-07-02 Method for producing indicators and processing apparatus and system utilizing the indicators

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/591,420 Continuation US8002198B2 (en) 2002-01-11 2009-11-19 Method for producing indicators and processing apparatus and system utilizing the indicators

Publications (2)

Publication Number Publication Date
US20080128502A1 true US20080128502A1 (en) 2008-06-05
US7726570B2 US7726570B2 (en) 2010-06-01

Family

ID=21688204

Family Applications (7)

Application Number Title Priority Date Filing Date
US10/189,244 Active 2025-07-21 US7328845B2 (en) 2002-01-11 2002-07-02 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/003,336 Expired - Fee Related US7669774B2 (en) 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/003,349 Expired - Fee Related US7726570B2 (en) 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,420 Expired - Fee Related US8002198B2 (en) 2002-01-11 2009-11-19 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,479 Expired - Lifetime US8851391B2 (en) 2002-01-11 2009-11-20 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,480 Expired - Fee Related US8006913B2 (en) 2002-01-11 2009-11-20 Method for producing indicators and processing apparatus and system utilizing the indicators
US14/507,736 Expired - Fee Related US9846797B2 (en) 2002-01-11 2014-10-06 Method for producing indicators and processing apparatus and system utilizing the indicators

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US10/189,244 Active 2025-07-21 US7328845B2 (en) 2002-01-11 2002-07-02 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/003,336 Expired - Fee Related US7669774B2 (en) 2002-01-11 2007-12-21 Method for producing indicators and processing apparatus and system utilizing the indicators

Family Applications After (4)

Application Number Title Priority Date Filing Date
US12/591,420 Expired - Fee Related US8002198B2 (en) 2002-01-11 2009-11-19 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,479 Expired - Lifetime US8851391B2 (en) 2002-01-11 2009-11-20 Method for producing indicators and processing apparatus and system utilizing the indicators
US12/591,480 Expired - Fee Related US8006913B2 (en) 2002-01-11 2009-11-20 Method for producing indicators and processing apparatus and system utilizing the indicators
US14/507,736 Expired - Fee Related US9846797B2 (en) 2002-01-11 2014-10-06 Method for producing indicators and processing apparatus and system utilizing the indicators

Country Status (6)

Country Link
US (7) US7328845B2 (en)
JP (1) JP2004166177A (en)
DE (1) DE10255926C5 (en)
FR (1) FR2834806B1 (en)
GB (2) GB2396042B (en)
TW (1) TWI235926B (en)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7916124B1 (en) 2001-06-20 2011-03-29 Leapfrog Enterprises, Inc. Interactive apparatus using print media
TWI235926B (en) * 2002-01-11 2005-07-11 Sonix Technology Co Ltd A method for producing indicators and processing system, coordinate positioning system and electronic book system utilizing the indicators
CN102930311B (en) 2002-09-26 2016-04-27 吉田健治 Signal conditioning package medium being formed the method for dot pattern, uses the data inputting method of dot pattern, use the information I/O method of dot pattern, use the message input device of dot pattern, use dot pattern
US7133031B2 (en) 2002-10-31 2006-11-07 Microsoft Corporation Optical system design for a universal computing device
GB0321164D0 (en) * 2003-09-10 2003-10-08 Hewlett Packard Development Co Methods,apparatus and software for printing location pattern
US7853193B2 (en) 2004-03-17 2010-12-14 Leapfrog Enterprises, Inc. Method and device for audibly instructing a user to interact with a function
US8316068B2 (en) * 2004-06-04 2012-11-20 Telefonaktiebolaget Lm Ericsson (Publ) Memory compression
CN101068606B (en) * 2004-12-03 2010-08-25 世嘉股份有限公司 Gaming machine
JP5110682B2 (en) * 2004-12-07 2012-12-26 株式会社ワオ・コーポレーション Information processing system, information output device, and program
KR100628463B1 (en) * 2004-12-13 2006-09-26 핑거시스템 주식회사 System and Method of Detecting Absolute Coordinates
CA2606135C (en) 2005-04-28 2015-06-30 Kenji Yoshida Information input/output method using dot pattern
JP3771252B1 (en) 2005-07-01 2006-04-26 健治 吉田 Dot pattern
GB2428324B (en) * 2005-07-11 2011-03-23 Ryknield Executor Company Ltd Apparatus and methods relating to voting systems
US7922099B1 (en) * 2005-07-29 2011-04-12 Leapfrog Enterprises, Inc. System and method for associating content with an image bearing surface
US7936339B2 (en) 2005-11-01 2011-05-03 Leapfrog Enterprises, Inc. Method and system for invoking computer functionality by interaction with dynamically generated interface regions of a writing surface
JP5036166B2 (en) * 2005-11-14 2012-09-26 アノト アクティエボラーク Handwriting input system, electronic pen device and position coordinate encoding medium applied to the same
JP4289350B2 (en) 2005-12-26 2009-07-01 富士ゼロックス株式会社 Image processing apparatus and image processing method
US8599143B1 (en) 2006-02-06 2013-12-03 Leapfrog Enterprises, Inc. Switch configuration for detecting writing pressure in a writing device
US8086051B2 (en) 2006-03-06 2011-12-27 Pixart Imaging Inc. Method of decoding fetched scene on encoded dotmap and electronic device thereof
TW200734933A (en) 2006-03-06 2007-09-16 Pixart Imaging Inc Dot-matrix pattern design and decoding method and the device thereof
TWI370413B (en) * 2006-04-14 2012-08-11 Sonix Technology Co Ltd Graphical indicator
WO2007145317A1 (en) * 2006-06-16 2007-12-21 Pioneer Corporation Two-dimensional code pattern, two-dimensional code pattern display device, and its reading device
CN101098454B (en) * 2006-06-28 2010-08-18 北京爱国者妙笔数码科技有限责任公司 Implementing controlled program request system using the reading video coding
US8261967B1 (en) 2006-07-19 2012-09-11 Leapfrog Enterprises, Inc. Techniques for interactively coupling electronic content with printed media
FR2904452B1 (en) * 2006-07-28 2009-02-27 Alphacode Sarl METHOD OF ENCODING INFORMATION USING MIXED CHARACTERS
KR100841285B1 (en) * 2006-09-18 2008-06-25 주식회사 펜래버레토리 Product having Absolute Positioning Code Pattern on a surface thereof and Method for generating Absolute Positioning Code Pattern
KR100860940B1 (en) * 2007-01-22 2008-09-29 광주과학기술원 Method of providing contents using a color marker and system for performing the same
TWI391871B (en) * 2007-02-09 2013-04-01 Sonix Technology Co Ltd Picture processing device and method and graphic/text edit method
EP1959374A1 (en) * 2007-02-19 2008-08-20 Cronto Limited Multi-dimensional bar code, apparatus and method for reading the same and method for generating the same
TWI385536B (en) * 2007-03-26 2013-02-11 Sonix Technology Co Ltd Method, system and computer-readable media for authoring talking book
CN101101631B (en) * 2007-07-02 2014-06-18 天津市阿波罗信息技术有限公司 Multimedia printing system realization method for multi-resolution printer
TWI349884B (en) * 2007-11-14 2011-10-01 Pixart Imaging Inc Data encryption method implemented on a pattern displaying medium with at least two types of ink
DE102008017168A1 (en) 2008-04-02 2009-10-08 Crossmedia Solution Gmbh & Co. Kg Method for storing and reading data
CN102124429B (en) 2008-06-20 2015-06-24 美泰有限公司 Capacitive touchpad and toy incorporating the same
CN101615259B (en) * 2008-08-01 2013-04-03 凌通科技股份有限公司 Method for coding two-dimensional optical identification code, identification system and printed product thereof
JP2011053854A (en) * 2009-09-01 2011-03-17 Hong-Teng Lv Coding method of two-dimensional optical recognition code and print product using the method
TWI395202B (en) * 2009-11-24 2013-05-01 Kuo Ping Yang Method and computer program product of putting identification codes in a document
EP2580713B1 (en) * 2010-06-11 2016-04-06 Rnib Coded information systems
GB2496772A (en) * 2010-06-25 2013-05-22 Polyvision Corp Activation objects for interactive systems
US10220646B2 (en) 2010-07-06 2019-03-05 Sparkup Ltd. Method and system for book reading enhancement
US8864018B2 (en) 2011-08-11 2014-10-21 Smart Pj's Llc Providing access to a collection via a plurality of discrete machine-recognizable codes
JP5688516B2 (en) * 2012-01-21 2015-03-25 松翰科技股▲ふん▼有限公司 Data input / output method using dot code
FR3000567B1 (en) * 2012-12-31 2015-09-04 Commissariat Energie Atomique SAMPLE TRACKING DEVICE, AND OBSERVATION SYSTEM COMPRISING SUCH A TRACKING DEVICE
TWI492167B (en) * 2014-06-05 2015-07-11 Sonix Technology Co Ltd Graphical indicator
CN109359657B (en) 2015-10-19 2022-11-25 松翰科技股份有限公司 Index structure
CN108664835A (en) * 2017-04-02 2018-10-16 田雪松 A kind of recognition methods of coding pattern validity and identification device
TWI718026B (en) * 2020-03-13 2021-02-01 松翰科技股份有限公司 Graphical indicator

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4627819A (en) * 1985-01-23 1986-12-09 Price/Stern/Sloan Publishers, Inc. Teaching or amusement apparatus
US4869532A (en) * 1986-10-07 1989-09-26 Dainichiseika Color & Chemicals Mfg. Co., Ltd. Prints and production method thereof
US5329108A (en) * 1991-11-22 1994-07-12 Cherloc Map with indexes for a geographical information system and system for applying same
US5416312A (en) * 1992-11-20 1995-05-16 Cherloc Document bearing an image or a text and provided with an indexing frame, and associated document analysis system
US5473536A (en) * 1994-04-04 1995-12-05 Spacelabs Medical, Inc. Method and system for customizing the display of patient physiological parameters on a medical monitor
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination
US5866895A (en) * 1994-12-16 1999-02-02 Olympus Optical Co., Ltd. Information recording medium and information reproduction system
US5945656A (en) * 1997-05-27 1999-08-31 Lemelson; Jerome H. Apparatus and method for stand-alone scanning and audio generation from printed material
US5959285A (en) * 1996-10-16 1999-09-28 Symbol Technologies, Inc. Two-dimensional bar code symbology using gray code encodation scheme
US6229964B1 (en) * 1998-02-26 2001-05-08 Eastman Kodak Company Image with sound playback apparatus
US20020020750A1 (en) * 1998-04-01 2002-02-21 Xerox Corporation Marking medium area with encoded identifier for producing action through network
US6412695B1 (en) * 2000-04-07 2002-07-02 Motorola, Inc. Optical code and delineator apparatus and method
US6441921B1 (en) * 1997-10-28 2002-08-27 Eastman Kodak Company System and method for imprinting and reading a sound message on a greeting card
US6460766B1 (en) * 1996-10-28 2002-10-08 Francis Olschafskie Graphic symbols and method and system for identification of same
US6473762B1 (en) * 1997-03-25 2002-10-29 Mci Communications Corporation System and method to automatic equipment placement at remote sites
US6556690B1 (en) * 1999-06-17 2003-04-29 Eastman Kodak Company Articles bearing invisible encodements on curved surfaces
US20040032505A1 (en) * 2000-10-20 2004-02-19 Kia Silverbrook Device that reads data encoded as dots
US7017806B2 (en) * 2003-10-22 2006-03-28 Peterson Stanley K Method of selecting and storing airline ticket data

Family Cites Families (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2612994A (en) 1949-10-20 1952-10-07 Norman J Woodland Classifying apparatus and method
GB736132A (en) 1953-02-26 1955-08-31 Sandri Skematic S P A Improvements in graphical indicators
JPS5295121A (en) 1976-02-06 1977-08-10 Hitachi Ltd Code plate
US4549867A (en) 1982-05-25 1985-10-29 Texas Instruments Incorporated Electronic learning aid with random number modes
US4505682A (en) 1982-05-25 1985-03-19 Texas Instruments Incorporated Learning aid with match and compare mode of operation
US4457719A (en) 1982-05-25 1984-07-03 Texas Instruments Incorporated Electronic learning aid for providing sequencing and spelling exercises
US4604065A (en) 1982-10-25 1986-08-05 Price/Stern/Sloan Publishers, Inc. Teaching or amusement apparatus
US4602152A (en) 1983-05-24 1986-07-22 Texas Instruments Incorporated Bar code information source and method for decoding same
US4924078A (en) * 1987-11-25 1990-05-08 Sant Anselmo Carl Identification symbol, system and method
US4889365A (en) 1988-04-11 1989-12-26 The Label Printers Counterfeit resistant label and method of making the same
US4939354A (en) 1988-05-05 1990-07-03 Datacode International, Inc. Dynamically variable machine readable binary code and method for reading and producing thereof
US4891011A (en) 1988-07-13 1990-01-02 Cook Graham D System for assisting the learning of a subject
US5042079A (en) 1988-08-12 1991-08-20 Casio Computer Co., Ltd. Method of recording/reproducing data of mesh pattern, and apparatus therefor
US5591957A (en) 1988-08-12 1997-01-07 Casio Computer Co., Ltd. Apparatus for reading mesh pattern image data having bars along upper and lower sides of mesh pattern and a boundary line between horizontally adjacent dark and light area of mesh pattern
US5051736A (en) 1989-06-28 1991-09-24 International Business Machines Corporation Optical stylus and passive digitizing tablet data input system
US5234798A (en) 1991-10-04 1993-08-10 Dittler Brothers, Incorporated Thermal reactive structures
US5369261A (en) 1992-02-12 1994-11-29 Shamir; Harry Multi-color information encoding system
JPH0660261A (en) 1992-08-04 1994-03-04 Fuji Electric Co Ltd Cooling/heating controller for automatic vending machine
EP1298579A1 (en) 1992-09-28 2003-04-02 Olympus Optical Co., Ltd. Information recording medium, information reproducing device and information reproducing method
CA2123456C (en) 1993-05-24 1998-09-15 William Berson Document authentication system utilizing a transparent label
US5449895A (en) 1993-12-22 1995-09-12 Xerox Corporation Explicit synchronization for self-clocking glyph codes
US5905250A (en) 1993-12-27 1999-05-18 Olympus Optical Co., Ltd. Audio information recording/reproducing system
US5591956A (en) 1995-05-15 1997-01-07 Welch Allyn, Inc. Two dimensional data encoding structure and symbology for use with optical readers
US5729731A (en) 1994-03-18 1998-03-17 Hitachi, Ltd. Method of retrieving in a database through image information
JP3962102B2 (en) 1995-07-21 2007-08-22 大日本印刷株式会社 Infrared absorbing pattern forming ink and printed matter having infrared absorbing pattern layer
US20030040957A1 (en) 1995-07-27 2003-02-27 Willam Y. Conwell Advertising employing watermarking
JPH0981711A (en) 1995-09-20 1997-03-28 Olympus Optical Co Ltd Information recording medium, information reproduction system, and information recording the system
US5717197A (en) 1995-12-21 1998-02-10 Xerox Corporation Tiled embedded data block-types for generic embedded data block systems
US5686705A (en) 1996-02-15 1997-11-11 Explore Technologies, Inc. Surface position location system and method
US5877458A (en) 1996-02-15 1999-03-02 Kke/Explore Acquisition Corp. Surface position location system and method
US6098882A (en) * 1996-03-01 2000-08-08 Cobblestone Software, Inc. Variable formatting of digital data into a pattern
DE19625767A1 (en) 1996-06-27 1998-01-08 Mm Lesestift Manager Memory Reader for the optical acquisition and storage of visually marked and projected alphanumeric characters, graphics and photographic images
JPH10163558A (en) 1996-11-29 1998-06-19 Dainippon Screen Mfg Co Ltd Semiconductor laser driver
US5937110A (en) 1996-12-20 1999-08-10 Xerox Corporation Parallel propagating embedded binary sequences for characterizing objects in N-dimensional address space
JPH10251570A (en) 1997-03-11 1998-09-22 Dainippon Printing Co Ltd Fluorescent luminous ink and fluorescent image formed product
EP0907139A3 (en) 1997-09-16 2000-02-23 Eastman Kodak Company Method and apparatus for reading invisibly encoded sound data on an object
JPH11112787A (en) 1997-10-03 1999-04-23 Canon Inc Device for processing image, its method and storage medium
US6094279A (en) 1997-10-28 2000-07-25 Eastman Kodak Company System and process for non-perceptibly integrating sound data into a printed image
DE69835133T8 (en) 1997-12-03 2007-05-16 Kabushiki Kaisha Toshiba, Kawasaki Image information processing method and method for preventing counterfeiting of certificates and the like
US6102505A (en) 1997-12-18 2000-08-15 Eastman Kodak Company Recording audio and electronic images
JP3600018B2 (en) 1998-06-30 2004-12-08 三洋電機株式会社 Data embedding device and data generating device
US6325420B1 (en) 1998-08-17 2001-12-04 Inspectron Corporation Method for embedding non-intrusive encoded data in printed matter and system for reading same
US6560741B1 (en) 1999-02-24 2003-05-06 Datastrip (Iom) Limited Two-dimensional printed code for storing biometric information and integrated off-line apparatus for reading same
US7055739B1 (en) * 1999-05-25 2006-06-06 Silverbrook Research Pty Ltd Identity-coded surface with reference points
SE516522C2 (en) 1999-05-28 2002-01-22 Anoto Ab Position determining product for digitization of drawings or handwritten information, obtains displacement between symbol strings along symbol rows when symbol strings are repeated on symbol rows
AU5263500A (en) 1999-05-28 2000-12-18 Anoto Ab Recording of information
US6502756B1 (en) 1999-05-28 2003-01-07 Anoto Ab Recording of information
MXPA01012338A (en) 1999-05-28 2004-07-30 Anato Ab Calendar.
US6995859B1 (en) * 1999-09-17 2006-02-07 Silverbrook Research Pty Ltd Method and system for instruction of a computer
SE517445C2 (en) 1999-10-01 2002-06-04 Anoto Ab Position determination on a surface provided with a position coding pattern
JP2001096889A (en) 1999-10-01 2001-04-10 Hitachi Maxell Ltd Printed product and printed product reader
JP2001153780A (en) 1999-11-24 2001-06-08 Maruyasu Industries Co Ltd Characteristic-value detecting apparatus for liquid using surface acoustic wave device
US6244764B1 (en) 2000-01-21 2001-06-12 Robotic Vision Systems, Inc. Method for data matrix print quality verification
SE0000949L (en) 2000-03-21 2001-09-22 Anoto Ab location information
US6586688B2 (en) 2000-04-05 2003-07-01 Anoto Ab Information-related devices and methods
JP3837999B2 (en) 2000-06-05 2006-10-25 富士ゼロックス株式会社 Image generation method and image generation apparatus
JP3762953B2 (en) 2000-06-16 2006-04-05 独立行政法人 国立印刷局 Printed matter and method for creating printed matter
US6714683B1 (en) 2000-08-24 2004-03-30 Digimarc Corporation Wavelet based feature modulation watermarks and related applications
US6823084B2 (en) 2000-09-22 2004-11-23 Sri International Method and apparatus for portably recognizing text in an image sequence of scene imagery
US6429924B1 (en) 2000-11-30 2002-08-06 Eastman Kodak Company Photofinishing method
US6637658B2 (en) 2001-01-22 2003-10-28 Welch Allyn, Inc. Optical reader having partial frame operating mode
US6559690B2 (en) 2001-03-15 2003-05-06 Micron Technology, Inc. Programmable dual drive strength output buffer with a shared boot circuit
TWI235926B (en) * 2002-01-11 2005-07-11 Sonix Technology Co Ltd A method for producing indicators and processing system, coordinate positioning system and electronic book system utilizing the indicators
TWI249141B (en) 2004-07-12 2006-02-11 Sunplus Technology Co Ltd Document having index data and system for reading document having index data
TWI336866B (en) 2008-07-11 2011-02-01 Generalplus Technology Inc Method for coding two dimensional optical identification with the same gray level and printing product thereof

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4627819A (en) * 1985-01-23 1986-12-09 Price/Stern/Sloan Publishers, Inc. Teaching or amusement apparatus
US4869532A (en) * 1986-10-07 1989-09-26 Dainichiseika Color & Chemicals Mfg. Co., Ltd. Prints and production method thereof
US5329108A (en) * 1991-11-22 1994-07-12 Cherloc Map with indexes for a geographical information system and system for applying same
US5852434A (en) * 1992-04-03 1998-12-22 Sekendur; Oral F. Absolute optical position determination
US5416312A (en) * 1992-11-20 1995-05-16 Cherloc Document bearing an image or a text and provided with an indexing frame, and associated document analysis system
US5473536A (en) * 1994-04-04 1995-12-05 Spacelabs Medical, Inc. Method and system for customizing the display of patient physiological parameters on a medical monitor
US5866895A (en) * 1994-12-16 1999-02-02 Olympus Optical Co., Ltd. Information recording medium and information reproduction system
US5959285A (en) * 1996-10-16 1999-09-28 Symbol Technologies, Inc. Two-dimensional bar code symbology using gray code encodation scheme
US6460766B1 (en) * 1996-10-28 2002-10-08 Francis Olschafskie Graphic symbols and method and system for identification of same
US6473762B1 (en) * 1997-03-25 2002-10-29 Mci Communications Corporation System and method to automatic equipment placement at remote sites
US5945656A (en) * 1997-05-27 1999-08-31 Lemelson; Jerome H. Apparatus and method for stand-alone scanning and audio generation from printed material
US6441921B1 (en) * 1997-10-28 2002-08-27 Eastman Kodak Company System and method for imprinting and reading a sound message on a greeting card
US6229964B1 (en) * 1998-02-26 2001-05-08 Eastman Kodak Company Image with sound playback apparatus
US20020020750A1 (en) * 1998-04-01 2002-02-21 Xerox Corporation Marking medium area with encoded identifier for producing action through network
US6556690B1 (en) * 1999-06-17 2003-04-29 Eastman Kodak Company Articles bearing invisible encodements on curved surfaces
US6412695B1 (en) * 2000-04-07 2002-07-02 Motorola, Inc. Optical code and delineator apparatus and method
US20040032505A1 (en) * 2000-10-20 2004-02-19 Kia Silverbrook Device that reads data encoded as dots
US7017806B2 (en) * 2003-10-22 2006-03-28 Peterson Stanley K Method of selecting and storing airline ticket data

Also Published As

Publication number Publication date
FR2834806B1 (en) 2008-03-28
US20030133164A1 (en) 2003-07-17
US20100072282A1 (en) 2010-03-25
GB0402333D0 (en) 2004-03-10
GB2396042A (en) 2004-06-09
DE10255926B4 (en) 2006-08-03
US7726570B2 (en) 2010-06-01
DE10255926A1 (en) 2003-07-31
US8002198B2 (en) 2011-08-23
US20100072281A1 (en) 2010-03-25
US20080128520A1 (en) 2008-06-05
DE10255926C5 (en) 2018-02-01
US7328845B2 (en) 2008-02-12
US20150083799A1 (en) 2015-03-26
GB2384094A (en) 2003-07-16
TWI235926B (en) 2005-07-11
US20100076766A1 (en) 2010-03-25
US9846797B2 (en) 2017-12-19
US7669774B2 (en) 2010-03-02
GB2384094B (en) 2004-09-22
JP2004166177A (en) 2004-06-10
US8006913B2 (en) 2011-08-30
FR2834806A1 (en) 2003-07-18
US8851391B2 (en) 2014-10-07
GB0227653D0 (en) 2003-01-08
GB2396042B (en) 2004-12-22

Similar Documents

Publication Publication Date Title
US9846797B2 (en) Method for producing indicators and processing apparatus and system utilizing the indicators
EP1269404B1 (en) Method and system for storing a coding pattern
JP4707395B2 (en) Information code containing redundant information
KR20100083862A (en) Printing method of information processing device and printing control system of icon image
KR20040047819A (en) Information reproduction method, information inputting and outputting method, information reproduction apparatus, portable information inputting and outputting apparatus and electronic toy using dot pattern
JP2009163354A (en) Medium for information recording, information reading apparatus, and information inputting system
CA2243581C (en) Apparatus and method of assisting visually impaired persons to generate graphical data in a computer
KR20060054119A (en) Digital code recorded media, apparatus for remote-controlling electronic devices and apparatus for recognizing and executing digital code
CN101079112B (en) Printing medium multimedia system multimedia production part implementation method
US6887080B2 (en) Multi-purpose visual-language system based on braille
WO2007123297A1 (en) Multimedia digital cood printing apparatus and printing method
CN102369503B (en) Information reading/output device
CN1469294B (en) Printing user interface system and its application
KR100708275B1 (en) Robot System with Manu Selection Card Having Printed Manu Code and Figure
KR200368146Y1 (en) Coding video electronic book structure
JP6358109B2 (en) Information code display device
KR100923445B1 (en) Providing Method of Digital Contents, System of the Same, and Reproducing Apparatus of Digital Contents
JP2006236134A (en) Two-dimensional code and two-dimensional code display medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONIX TECHNOLOGY CO., LTD., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TSAI, YAO-HUNG;REEL/FRAME:020334/0508

Effective date: 20020613

Owner name: SONIX TECHNOLOGY CO., LTD.,TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:TSAI, YAO-HUNG;REEL/FRAME:020334/0508

Effective date: 20020613

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2552)

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220601