CA2015740A1 - Hierarchical constrained automatic learning network for character recognition - Google Patents

Hierarchical constrained automatic learning network for character recognition

Info

Publication number
CA2015740A1
CA2015740A1 CA2015740A CA2015740A CA2015740A1 CA 2015740 A1 CA2015740 A1 CA 2015740A1 CA 2015740 A CA2015740 A CA 2015740A CA 2015740 A CA2015740 A CA 2015740A CA 2015740 A1 CA2015740 A1 CA 2015740A1
Authority
CA
Canada
Prior art keywords
feature
constrained
map
layer
maps
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA2015740A
Other languages
French (fr)
Other versions
CA2015740C (en
Inventor
John S. Denker
Richard E. Howard
Lawrence D. Jackel
Yann Lecun
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NCR Voyix Corp
Original Assignee
American Telephone and Telegraph Co Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by American Telephone and Telegraph Co Inc filed Critical American Telephone and Telegraph Co Inc
Publication of CA2015740A1 publication Critical patent/CA2015740A1/en
Application granted granted Critical
Publication of CA2015740C publication Critical patent/CA2015740C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/18Extraction of features or characteristics of the image
    • G06V30/1801Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections
    • G06V30/18019Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections by matching or filtering
    • G06V30/18038Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters
    • G06V30/18048Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters with interaction between the responses of different filters, e.g. cortical complex cells
    • G06V30/18057Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Abstract

Highly accurate, reliable optical character recognition is afforded by a layered network having several layers of constrained feature detection wherein each layer of constrained feature detection includes a plurality of constrained feature maps and a corresponding plurality of feature reduction maps. Each feature reduction map is connected to only one constrained feature map in the same layer for undersampling that constrained feature map. Units in each constrained feature map of the first constrained feature detection layer respond as a function of a corresponding kernel and of different portions of the pixel image of the character captured in a receptive field associated with the unit. Units in each feature map of the second constrained feature detection layer respond as a function of a corresponding kernel and of different portions of an individual feature reduction map or a combination of several feature reduction maps in the first constrained feature detection layer as captured in a receptive field of the unit. The feature reduction maps of the second constrained feature detection layer are fully connected to each unit in the final character classification layer.
Kernels are automatically learned by constrained back propagation during network initialization or training.
CA002015740A 1989-11-30 1990-04-30 Hierarchical constrained automatic learning network for character recognition Expired - Fee Related CA2015740C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US444,455 1989-11-30
US07/444,455 US5067164A (en) 1989-11-30 1989-11-30 Hierarchical constrained automatic learning neural network for character recognition

Publications (2)

Publication Number Publication Date
CA2015740A1 true CA2015740A1 (en) 1991-05-31
CA2015740C CA2015740C (en) 1996-01-16

Family

ID=23764959

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002015740A Expired - Fee Related CA2015740C (en) 1989-11-30 1990-04-30 Hierarchical constrained automatic learning network for character recognition

Country Status (3)

Country Link
US (1) US5067164A (en)
JP (1) JPH0650539B2 (en)
CA (1) CA2015740C (en)

Families Citing this family (99)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588091A (en) * 1989-05-17 1996-12-24 Environmental Research Institute Of Michigan Dynamically stable associative learning neural network system
US5361328A (en) * 1989-09-28 1994-11-01 Ezel, Inc. Data processing system using a neural network
JPH07104952B2 (en) * 1989-12-28 1995-11-13 シャープ株式会社 Pattern matching device
US5271090A (en) * 1990-03-21 1993-12-14 At&T Bell Laboratories Operational speed improvement for neural network
JPH03288285A (en) * 1990-04-04 1991-12-18 Takayama:Kk Learning method for data processor
KR910020571A (en) * 1990-05-21 1991-12-20 다카도리 수나오 Data processing device
JP2760145B2 (en) * 1990-09-26 1998-05-28 三菱電機株式会社 Knowledge information processing device
US5263107A (en) * 1991-01-31 1993-11-16 Sharp Kabushiki Kaisha Receptive field neural network with shift-invariant pattern recognition
JPH04315272A (en) * 1991-04-12 1992-11-06 Eastman Kodak Japan Kk Graphic recognizing device
DE69223447T2 (en) * 1991-05-24 1998-06-04 Koninkl Philips Electronics Nv Learning method for neural network and classification system for applying this method
US5293456A (en) * 1991-06-28 1994-03-08 E. I. Du Pont De Nemours And Company Object recognition system employing a sparse comparison neural network
US5179596A (en) * 1991-07-05 1993-01-12 Booz, Allen & Hamilton, Inc. Analog pattern categorization system having dual weighted connectivity between nodes
US5493688A (en) * 1991-07-05 1996-02-20 Booz, Allen & Hamilton, Inc. Pattern categoritzation system having self-organizing analog fields
DE4138740A1 (en) 1991-11-26 1993-05-27 Schloemann Siemag Ag METHOD AND DEVICE FOR CONTINUOUSLY casting slabs or blocks
US6418424B1 (en) 1991-12-23 2002-07-09 Steven M. Hoffberg Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US6400996B1 (en) 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US8352400B2 (en) 1991-12-23 2013-01-08 Hoffberg Steven M Adaptive pattern recognition based controller apparatus and method and human-factored interface therefore
US6850252B1 (en) 1999-10-05 2005-02-01 Steven M. Hoffberg Intelligent electronic appliance system and method
US10361802B1 (en) 1999-02-01 2019-07-23 Blanding Hovenweep, Llc Adaptive pattern recognition based control system and method
US5903454A (en) 1991-12-23 1999-05-11 Hoffberg; Linda Irene Human-factored interface corporating adaptive pattern recognition based controller apparatus
JP2809954B2 (en) * 1992-03-25 1998-10-15 三菱電機株式会社 Apparatus and method for image sensing and processing
EP0566015A3 (en) * 1992-04-14 1994-07-06 Eastman Kodak Co Neural network optical character recognition system and method for classifying characters in amoving web
US5481621A (en) * 1992-05-28 1996-01-02 Matsushita Electric Industrial Co., Ltd. Device and method for recognizing an image based on a feature indicating a relative positional relationship between patterns
DE69329218T2 (en) * 1992-06-19 2001-04-05 United Parcel Service Inc Method and device for input classification with a neural network
US5438629A (en) * 1992-06-19 1995-08-01 United Parcel Service Of America, Inc. Method and apparatus for input classification using non-spherical neurons
JP2723118B2 (en) * 1992-08-31 1998-03-09 インターナショナル・ビジネス・マシーンズ・コーポレイション Neural network and optical character recognition device for use in recognizing two-dimensional objects
US5377302A (en) * 1992-09-01 1994-12-27 Monowave Corporation L.P. System for recognizing speech
US5319722A (en) * 1992-10-01 1994-06-07 Sony Electronics, Inc. Neural network for character recognition of rotated characters
US5742702A (en) * 1992-10-01 1998-04-21 Sony Corporation Neural network for character recognition and verification
US5625708A (en) * 1992-10-13 1997-04-29 Lucent Technologies, Inc. Method and apparatus for symbol recognition using multidimensional preprocessing
US5337372A (en) * 1992-10-13 1994-08-09 At&T Bell Laboratories Method and apparatus for symbol recognition using multidimensional preprocessing at multiple resolutions
US5647022A (en) * 1992-10-13 1997-07-08 Lucent Technologies Inc. Method and apparatus for symbol recognition using multidimensional preprocessing and symbol sorting
JPH06203005A (en) * 1992-10-27 1994-07-22 Eastman Kodak Co High speed partitioned neural network and building-up method thereof
EP0602717B1 (en) * 1992-12-16 1997-10-01 Laboratoires D'electronique Philips S.A.S. Neural device and construction method
US5479574A (en) * 1993-04-01 1995-12-26 Nestor, Inc. Method and apparatus for adaptive classification
US5649068A (en) * 1993-07-27 1997-07-15 Lucent Technologies Inc. Pattern recognition system using support vectors
JPH0744514A (en) * 1993-07-27 1995-02-14 Matsushita Electric Ind Co Ltd Learning data contracting method for neural network
GB2282906B (en) 1993-10-13 1996-11-06 Dataquill Ltd Data enty systems
US5473730A (en) * 1993-11-09 1995-12-05 At&T Ipm Corp. High efficiency learning network
US5774586A (en) * 1994-05-04 1998-06-30 Ncr Corporation Method and apparatus for standardization of inputs to word recognition systems
US5572628A (en) * 1994-09-16 1996-11-05 Lucent Technologies Inc. Training system for neural networks
US5802204A (en) * 1995-06-07 1998-09-01 Microchip Technology Incorporated Handwritten character translator using fuzzy logic
US7966078B2 (en) 1999-02-01 2011-06-21 Steven Hoffberg Network media appliance system and method
US7007239B1 (en) 2000-09-21 2006-02-28 Palm, Inc. Method and apparatus for accessing a contacts database and telephone services
US20060121938A1 (en) 1999-08-12 2006-06-08 Hawkins Jeffrey C Integrated handheld computing and telephony device
US8064886B2 (en) 1999-08-12 2011-11-22 Hewlett-Packard Development Company, L.P. Control mechanisms for mobile devices
US7503016B2 (en) 1999-08-12 2009-03-10 Palm, Inc. Configuration mechanism for organization of addressing elements
US7216177B1 (en) 2000-06-16 2007-05-08 Palm, Inc. Apparatus and method for supplying electronic content to network appliances
US8332553B2 (en) 2000-09-21 2012-12-11 Hewlett-Packard Development Company, L.P. Method and apparatus for accessing a contacts database and telephone services
EP1262907B1 (en) * 2001-05-28 2007-10-03 Honda Research Institute Europe GmbH Pattern recognition with hierarchical networks
US7395089B1 (en) 2001-06-11 2008-07-01 Palm, Inc Integrated personal digital assistant device
US6950988B1 (en) 2001-06-11 2005-09-27 Handspring, Inc. Multi-context iterative directory filter
US6975304B1 (en) 2001-06-11 2005-12-13 Handspring, Inc. Interface for processing of an alternate symbol in a computer device
US6957397B1 (en) 2001-06-11 2005-10-18 Palm, Inc. Navigating through a menu of a handheld computer using a keyboard
US7356361B1 (en) 2001-06-11 2008-04-08 Palm, Inc. Hand-held device
US6976226B1 (en) 2001-07-06 2005-12-13 Palm, Inc. Translating tabular data formatted for one display device to a format for display on other display devices
US7692667B2 (en) 2001-08-17 2010-04-06 Palm, Inc. Handheld computer having moveable segments that are interactive with an integrated display
US7231208B2 (en) 2001-10-17 2007-06-12 Palm, Inc. User interface-technique for managing an active call
US7192235B2 (en) 2001-11-01 2007-03-20 Palm, Inc. Temporary messaging address system and method
US7665043B2 (en) 2001-12-28 2010-02-16 Palm, Inc. Menu navigation and operation feature for a handheld computer
US7474298B2 (en) 2002-05-31 2009-01-06 Palm, Inc. Mobile device having an adjustable length to selectively expose a surface component
KR100560017B1 (en) * 2002-11-09 2006-03-15 유경진 A dental cleaner for one time and manufacturing method the same
US8374974B2 (en) * 2003-01-06 2013-02-12 Halliburton Energy Services, Inc. Neural network training data selection using memory reduced cluster analysis for field model development
US7231229B1 (en) 2003-03-16 2007-06-12 Palm, Inc. Communication device interface
US7164088B1 (en) 2003-03-16 2007-01-16 Palm, Inc. Method and apparatus to improve tactile feel for keyboards and button assemblies
US7835504B1 (en) 2003-03-16 2010-11-16 Palm, Inc. Telephone number parsing and linking
WO2004084121A1 (en) * 2003-03-17 2004-09-30 Fujitsu Limited Car identifying method and device
US7295852B1 (en) 2003-05-01 2007-11-13 Palm, Inc. Automated telephone conferencing method and system
US7865180B2 (en) 2003-06-23 2011-01-04 Palm, Inc. Automated telephone conferencing method and system
US7287015B2 (en) * 2004-09-30 2007-10-23 International Business Machines Corporation Methods and apparatus for transmitting signals through network elements for classification
WO2007095107A2 (en) * 2006-02-10 2007-08-23 Numenta, Inc. Architecture of a hierarchical temporal memory based system
US8065244B2 (en) * 2007-03-14 2011-11-22 Halliburton Energy Services, Inc. Neural-network based surrogate model construction methods and applications thereof
US20080254811A1 (en) * 2007-04-11 2008-10-16 Palm, Inc. System and method for monitoring locations of mobile devices
US9031583B2 (en) 2007-04-11 2015-05-12 Qualcomm Incorporated Notification on mobile device based on location of other mobile device
US9140552B2 (en) 2008-07-02 2015-09-22 Qualcomm Incorporated User defined names for displaying monitored location
TW200907134A (en) * 2007-08-09 2009-02-16 Zheng Chuan Tian Ribbon roller set transmission device of ribbon loom
US8126519B2 (en) 2007-08-31 2012-02-28 Hewlett-Packard Development Company, L.P. Housing for mobile computing device having construction to slide and pivot into multiple positions
US8233948B2 (en) 2007-12-11 2012-07-31 Hewlett-Packard Development Company, L.P. Slider assembly for a housing of a mobile computing device
US8150482B2 (en) 2008-01-08 2012-04-03 Hewlett-Packard Development Company, L.P. Mobile computing device with moveable housing segments
US8611661B2 (en) * 2007-12-26 2013-12-17 Intel Corporation OCR multi-resolution method and apparatus
US8200298B2 (en) 2008-01-08 2012-06-12 Hewlett-Packard Development Company, L.P. Keypad housing configuration for a mobile computing device
AU2009279644B2 (en) * 2008-08-06 2012-08-23 Halliburton Energy Services, Inc. Systems and methods employing cooperative optimization-based dimensionality reduction
US9514388B2 (en) * 2008-08-12 2016-12-06 Halliburton Energy Services, Inc. Systems and methods employing cooperative optimization-based dimensionality reduction
US8218904B2 (en) * 2008-08-27 2012-07-10 Lockheed Martin Corporation Method and system for circular to horizontal transposition of an image
JP2011107648A (en) * 2009-11-20 2011-06-02 Fujifilm Corp Lens unit
KR101938033B1 (en) 2012-09-05 2019-01-11 엘리먼트, 인크. Biometric authentication in connection with camera-equipped devices
US9189067B2 (en) 2013-01-12 2015-11-17 Neal Joseph Edelstein Media distribution system
US9913135B2 (en) 2014-05-13 2018-03-06 Element, Inc. System and method for electronic key provisioning and access management in connection with mobile devices
US9501740B2 (en) 2014-06-03 2016-11-22 Saudi Arabian Oil Company Predicting well markers from artificial neural-network-predicted lithostratigraphic facies
JP6415607B2 (en) 2014-06-03 2018-10-31 エレメント,インク. Exit and authentication related to mobile devices
US10192148B1 (en) * 2017-08-22 2019-01-29 Gyrfalcon Technology Inc. Machine learning of written Latin-alphabet based languages via super-character
SG11202002399SA (en) 2017-09-18 2020-04-29 Element Inc Methods, systems, and media for detecting spoofing in mobile authentication
BR112021018149B1 (en) 2019-03-12 2023-12-26 Element Inc COMPUTER-IMPLEMENTED METHOD FOR DETECTING BIOMETRIC IDENTITY RECOGNITION FORGERY USING THE CAMERA OF A MOBILE DEVICE, COMPUTER-IMPLEMENTED SYSTEM, AND NON-TRAINER COMPUTER-READABLE STORAGE MEDIUM
US11173510B2 (en) * 2019-03-22 2021-11-16 Twenty Twenty Therapeutics Llc Imaging device for identifying a liquid within a dispenser
US11281911B2 (en) 2019-04-27 2022-03-22 Gyrfalcon Technology Inc. 2-D graphical symbols for representing semantic meaning of a video clip
US10713830B1 (en) 2019-05-13 2020-07-14 Gyrfalcon Technology Inc. Artificial intelligence based image caption creation systems and methods thereof
US11526723B2 (en) 2019-07-09 2022-12-13 Gyrfalcon Technology Inc. Apparatus and methods of obtaining multi-scale feature vector using CNN based integrated circuits
US11507248B2 (en) 2019-12-16 2022-11-22 Element Inc. Methods, systems, and media for anti-spoofing using eye-tracking
US11774553B2 (en) * 2020-06-18 2023-10-03 Infineon Technologies Ag Parametric CNN for radar processing

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4774677A (en) * 1981-08-06 1988-09-27 Buckley Bruce S Self-organizing circuits
US4760604A (en) * 1985-02-15 1988-07-26 Nestor, Inc. Parallel, multi-unit, adaptive, nonlinear pattern class separator and identifier
US4897811A (en) * 1988-01-19 1990-01-30 Nestor, Inc. N-dimensional coulomb neural network which provides for cumulative learning of internal representations

Also Published As

Publication number Publication date
JPH0650539B2 (en) 1994-06-29
CA2015740C (en) 1996-01-16
US5067164A (en) 1991-11-19
JPH0334082A (en) 1991-02-14

Similar Documents

Publication Publication Date Title
CA2015740A1 (en) Hierarchical constrained automatic learning network for character recognition
CA2032126A1 (en) Hierarchical constrained automatic learning network for character recognition
Allen A naïve realist theory of colour
Finks et al. Reinterpreting visual patterns in mental imagery
Feldman The generality problem for reliabilism
Block The photographic fallacy in the debate about mental imagery
Bornstein The Influence of Visual Perception on Culture 1
Payne On the construction, deconstruction and reconstruction of experience in ‘critical’outdoor education
CN108764164A (en) A kind of method for detecting human face and system based on deformable convolutional network
CA2027440A1 (en) Paper-like computer output display and scanning system therefor
CN107346629A (en) A kind of intelligent blind reading method and intelligent blind reader system
CA2179566A1 (en) Information carrier with diffraction structures
Pinz A computer vision system for the recognition of trees in aerial photographs
Stokes Thinking and perceiving
McGilvray Constant colors in the head
Reynolds Knowing how to believe with justification
MacEachren et al. The role of brightness differences in figure-ground: is darker figure?
Wolfe Guided search 2.0: The upgrade
Gilman A new perspective on pictorial representation
Pollnac Illusion susceptibility and adaptation to the marine environment: Is the carpentered world hypothesis seaworthy?
Gilman Pictures in cognition
EP0032438A3 (en) Image storage and display
Hinton Use of tactile pictures to communicate the work of visual artists to blind people
Burge Marr's theory of vision
CA2090449A1 (en) Image processing apparatus

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed