WO2008067326A3 - Group-based temporal pooling - Google Patents

Group-based temporal pooling Download PDF

Info

Publication number
WO2008067326A3
WO2008067326A3 PCT/US2007/085661 US2007085661W WO2008067326A3 WO 2008067326 A3 WO2008067326 A3 WO 2008067326A3 US 2007085661 W US2007085661 W US 2007085661W WO 2008067326 A3 WO2008067326 A3 WO 2008067326A3
Authority
WO
WIPO (PCT)
Prior art keywords
sensed input
groups
htm node
node
htm
Prior art date
Application number
PCT/US2007/085661
Other languages
French (fr)
Other versions
WO2008067326A2 (en
Inventor
Jeffrey C Hawkins
Robert G Jaros
Dileep George
Original Assignee
Numenta Inc
Jeffrey C Hawkins
Robert G Jaros
Dileep George
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Numenta Inc, Jeffrey C Hawkins, Robert G Jaros, Dileep George filed Critical Numenta Inc
Priority to EP07854798A priority Critical patent/EP2087437A4/en
Publication of WO2008067326A2 publication Critical patent/WO2008067326A2/en
Publication of WO2008067326A3 publication Critical patent/WO2008067326A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs

Abstract

An HTM node learns a plurality of groups of sensed input patterns over time based on the frequency of temporal adjacency of the input patterns. An HTM node receives a new sensed input, the HTM node assigns probabilities as to the likelihood that the new sensed input matches each of the plurality of learned groups. The HTM node then combines this probability distribution (may be normalized) with previous state information to assign probabilities as to the likelihood that the new sensed input is part of each of the learned groups of the HTM node. Then, as described above, the distribution over the set of groups learned by the HTM node is passed to a higher level node. This process is repeated at higher level nodes to infer a cause of the newly sensed input.
PCT/US2007/085661 2006-11-28 2007-11-27 Group-based temporal pooling WO2008067326A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP07854798A EP2087437A4 (en) 2006-11-28 2007-11-27 Group-based temporal pooling

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US86748306P 2006-11-28 2006-11-28
US60/867,483 2006-11-28

Publications (2)

Publication Number Publication Date
WO2008067326A2 WO2008067326A2 (en) 2008-06-05
WO2008067326A3 true WO2008067326A3 (en) 2008-07-24

Family

ID=39468651

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/085661 WO2008067326A2 (en) 2006-11-28 2007-11-27 Group-based temporal pooling

Country Status (3)

Country Link
US (1) US7937342B2 (en)
EP (1) EP2087437A4 (en)
WO (1) WO2008067326A2 (en)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060184462A1 (en) 2004-12-10 2006-08-17 Hawkins Jeffrey C Methods, architecture, and apparatus for implementing machine intelligence and hierarchical memory systems
US7739208B2 (en) 2005-06-06 2010-06-15 Numenta, Inc. Trainable hierarchical memory system and method
US20070192267A1 (en) 2006-02-10 2007-08-16 Numenta, Inc. Architecture of a hierarchical temporal memory based system
US8732098B2 (en) 2006-02-10 2014-05-20 Numenta, Inc. Hierarchical temporal memory (HTM) system deployed as web service
US7941389B2 (en) 2006-02-10 2011-05-10 Numenta, Inc. Hierarchical temporal memory based system including nodes with input or output variables of disparate properties
US7937342B2 (en) 2006-11-28 2011-05-03 Numenta, Inc. Method and apparatus for detecting spatial patterns
US7941392B2 (en) 2007-02-28 2011-05-10 Numenta, Inc. Scheduling system and method in a hierarchical temporal memory based system
US8112367B2 (en) 2007-02-28 2012-02-07 Numenta, Inc. Episodic memory with a hierarchical temporal memory based system
US8037010B2 (en) 2007-02-28 2011-10-11 Numenta, Inc. Spatio-temporal learning algorithms in hierarchical temporal networks
EP2162853A1 (en) * 2007-06-29 2010-03-17 Numenta, Inc. Hierarchical temporal memory system with enhanced inference capability
US8175984B2 (en) 2007-12-05 2012-05-08 Numenta, Inc. Action based learning
US8175985B2 (en) * 2008-03-19 2012-05-08 Numenta, Inc. Plugin infrastructure for hierarchical temporal memory (HTM) system
US7983998B2 (en) 2008-03-21 2011-07-19 Numenta, Inc. Feedback in group based hierarchical temporal memory system
US8407166B2 (en) * 2008-06-12 2013-03-26 Numenta, Inc. Hierarchical temporal memory system with higher-order temporal pooling capability
WO2009152459A1 (en) * 2008-06-12 2009-12-17 Numenta, Inc. Hierarchical temporal memory system with higher-order temporal pooling capability
US8195582B2 (en) * 2009-01-16 2012-06-05 Numenta, Inc. Supervision based grouping of patterns in hierarchical temporal memory (HTM)
US8392351B2 (en) * 2009-04-24 2013-03-05 Palo Alto Research Center Incorporated System and computer-implemented method for generating temporal footprints to identify tasks
US9189745B2 (en) 2010-03-15 2015-11-17 Numenta, Inc. Temporal memory using sparse distributed representation
US11651277B2 (en) 2010-03-15 2023-05-16 Numenta, Inc. Sparse distributed representation for networked processing in predictive system
US8346804B2 (en) * 2010-11-03 2013-01-01 General Electric Company Systems, methods, and apparatus for computer-assisted full medical code scheme to code scheme mapping
US8504570B2 (en) * 2011-08-25 2013-08-06 Numenta, Inc. Automated search for detecting patterns and sequences in data using a spatial and temporal memory system
US8645291B2 (en) 2011-08-25 2014-02-04 Numenta, Inc. Encoding of data for processing in a spatial and temporal memory system
US8825565B2 (en) 2011-08-25 2014-09-02 Numenta, Inc. Assessing performance in a spatial and temporal memory system
ES2611177T3 (en) 2012-03-15 2017-05-05 Cortical.Io Gmbh Procedures, devices and products for semantic text processing
US9336774B1 (en) 2012-04-20 2016-05-10 Google Inc. Pattern recognizing engine
US9159021B2 (en) 2012-10-23 2015-10-13 Numenta, Inc. Performing multistep prediction using spatial and temporal memory system
EP2919647B1 (en) 2012-11-13 2021-01-06 Elminda Ltd. Neurophysiological data analysis using spatiotemporal parcellation
US9904889B2 (en) 2012-12-05 2018-02-27 Applied Brain Research Inc. Methods and systems for artificial cognition
EP3068295A4 (en) 2013-11-13 2017-07-19 Elminda Ltd. Method and system for managing pain
US10318878B2 (en) 2014-03-19 2019-06-11 Numenta, Inc. Temporal processing scheme and sensorimotor information processing
US10417554B2 (en) 2014-05-22 2019-09-17 Lee J. Scheffler Methods and systems for neural and cognitive processing
US10394851B2 (en) 2014-08-07 2019-08-27 Cortical.Io Ag Methods and systems for mapping data items to sparse distributed representations
US10885089B2 (en) 2015-08-21 2021-01-05 Cortical.Io Ag Methods and systems for identifying a level of similarity between a filtering criterion and a data item within a set of streamed documents
US10572221B2 (en) 2016-10-20 2020-02-25 Cortical.Io Ag Methods and systems for identifying a level of similarity between a plurality of data representations
US11100396B2 (en) 2017-08-24 2021-08-24 International Business Machines Corporation Self-adjusting threshold for synaptic activity in neural networks
US11556343B2 (en) 2017-09-22 2023-01-17 International Business Machines Corporation Computational method for temporal pooling and correlation
US11354320B2 (en) * 2018-10-11 2022-06-07 International Business Machines Corporation Determining causes of events in data
US11681922B2 (en) 2019-11-26 2023-06-20 Numenta, Inc. Performing inference and training using sparse neural network
US11734332B2 (en) 2020-11-19 2023-08-22 Cortical.Io Ag Methods and systems for reuse of data item fingerprints in generation of semantic maps

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060235320A1 (en) * 2004-05-12 2006-10-19 Zoll Medical Corporation ECG rhythm advisory method
US20060248026A1 (en) * 2005-04-05 2006-11-02 Kazumi Aoyama Method and apparatus for learning data, method and apparatus for generating data, and computer program
US20060248073A1 (en) * 2005-04-28 2006-11-02 Rosie Jones Temporal search results
US20060259163A1 (en) * 2000-03-10 2006-11-16 Smiths Detection Inc. Temporary expanding integrated monitoring network

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4766534A (en) * 1986-10-16 1988-08-23 American Telephone And Telegraph Company, At&T Bell Laboratories Parallel processing network and method
US4845744A (en) * 1986-10-16 1989-07-04 American Telephone And Telegraph Company, At&T Bell Laboratories Method of overlaying virtual tree networks onto a message passing parallel processing network
US5255348A (en) * 1991-06-14 1993-10-19 Nenov Valeriy I Neural network for learning, recognition and recall of pattern sequences
US7481453B2 (en) * 1991-07-09 2009-01-27 Automotive Technologies International, Inc. Inflator system
US6400996B1 (en) * 1999-02-01 2002-06-04 Steven M. Hoffberg Adaptive pattern recognition based control system and method
US7251637B1 (en) * 1993-09-20 2007-07-31 Fair Isaac Corporation Context vector generation and retrieval
US7786864B1 (en) * 2000-09-08 2010-08-31 Automotive Technologies International, Inc. Vehicular RFID and sensor assemblies
US5712953A (en) * 1995-06-28 1998-01-27 Electronic Data Systems Corporation System and method for classification of audio or audio/video signals based on musical content
US6195622B1 (en) * 1998-01-15 2001-02-27 Microsoft Corporation Methods and apparatus for building attribute transition probability models for use in pre-fetching resources
EP0965943A3 (en) 1998-06-04 2001-11-28 Matsushita Electric Industrial Co., Ltd. Optical character reading method and system for a document with ruled lines and their application
US6567814B1 (en) * 1998-08-26 2003-05-20 Thinkanalytics Ltd Method and apparatus for knowledge discovery in databases
US6122014A (en) * 1998-09-17 2000-09-19 Motorola, Inc. Modified chroma keyed technique for simple shape coding for digital video
US6751343B1 (en) * 1999-09-20 2004-06-15 Ut-Battelle, Llc Method for indexing and retrieving manufacturing-specific digital imagery based on image content
US6468069B2 (en) * 1999-10-25 2002-10-22 Jerome H. Lemelson Automatically optimized combustion control
US6625585B1 (en) * 2000-02-18 2003-09-23 Bioreason, Inc. Method and system for artificial intelligence directed lead discovery though multi-domain agglomerative clustering
US6714941B1 (en) * 2000-07-19 2004-03-30 University Of Southern California Learning data prototypes for information extraction
US6574537B2 (en) * 2001-02-05 2003-06-03 The Boeing Company Diagnostic system and method
US6947378B2 (en) * 2001-02-28 2005-09-20 Mitsubishi Electric Research Labs, Inc. Dynamic network resource allocation using multimedia content features and traffic features
US7962482B2 (en) * 2001-05-16 2011-06-14 Pandora Media, Inc. Methods and systems for utilizing contextual feedback to generate and modify playlists
US7797062B2 (en) * 2001-08-10 2010-09-14 Rockwell Automation Technologies, Inc. System and method for dynamic multi-objective optimization of machine selection, integration and utilization
US7233781B2 (en) 2001-10-10 2007-06-19 Ochoa Optics Llc System and method for emergency notification content delivery
US7203635B2 (en) * 2002-06-27 2007-04-10 Microsoft Corporation Layered models for context awareness
US20040148520A1 (en) * 2003-01-29 2004-07-29 Rajesh Talpade Mitigating denial of service attacks
JP3987013B2 (en) * 2003-09-01 2007-10-03 本田技研工業株式会社 Vehicle periphery monitoring device
US7565451B2 (en) 2004-01-23 2009-07-21 Microsoft Corporation Adaptive dispatch of received messages to code using inter-positioned message modification
US20050190990A1 (en) * 2004-01-27 2005-09-01 Burt Peter J. Method and apparatus for combining a plurality of images
US7788109B2 (en) * 2004-04-03 2010-08-31 Altusys Corp. Method and apparatus for context-sensitive event correlation with external control in situation-based management
US20060184462A1 (en) 2004-12-10 2006-08-17 Hawkins Jeffrey C Methods, architecture, and apparatus for implementing machine intelligence and hierarchical memory systems
US7809722B2 (en) * 2005-05-09 2010-10-05 Like.Com System and method for enabling search and retrieval from image files based on recognized information
US7739208B2 (en) * 2005-06-06 2010-06-15 Numenta, Inc. Trainable hierarchical memory system and method
US20070192267A1 (en) * 2006-02-10 2007-08-16 Numenta, Inc. Architecture of a hierarchical temporal memory based system
US7937342B2 (en) 2006-11-28 2011-05-03 Numenta, Inc. Method and apparatus for detecting spatial patterns
EP2162853A1 (en) 2007-06-29 2010-03-17 Numenta, Inc. Hierarchical temporal memory system with enhanced inference capability

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060259163A1 (en) * 2000-03-10 2006-11-16 Smiths Detection Inc. Temporary expanding integrated monitoring network
US20060235320A1 (en) * 2004-05-12 2006-10-19 Zoll Medical Corporation ECG rhythm advisory method
US20060248026A1 (en) * 2005-04-05 2006-11-02 Kazumi Aoyama Method and apparatus for learning data, method and apparatus for generating data, and computer program
US20060248073A1 (en) * 2005-04-28 2006-11-02 Rosie Jones Temporal search results

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2087437A4 *

Also Published As

Publication number Publication date
EP2087437A2 (en) 2009-08-12
WO2008067326A2 (en) 2008-06-05
US7937342B2 (en) 2011-05-03
EP2087437A4 (en) 2010-10-27
US20080140593A1 (en) 2008-06-12

Similar Documents

Publication Publication Date Title
WO2008067326A3 (en) Group-based temporal pooling
GB201313670D0 (en) System and method to efficently identify bad components in a multi-node system utilizing multiple node topologies
MX369047B (en) Systems and methods for mapping and routing based on clustering.
EP3575980A3 (en) Intelligent data quality
CN105807618B (en) Control method and first central control equipment
WO2010038149A3 (en) Distributed master election
GB201113886D0 (en) Network capacity management system and method
WO2014124024A3 (en) Interference measurements and management in directional mesh networks
WO2004096979A3 (en) Methods and systems for annotating biomolecular sequences
MX2010007394A (en) Isolation of content by processes in an application.
DE602004005242D1 (en) CENTRALIZED CONFIGURATION OF LINK-SCOPE TYPE-MANAGED OBJECTS IN NETWORKS BASED ON THE INTERNET PROTOCOL (IP)
Yuan et al. Interplay between structure and dynamics in adaptive complex networks: Emergence and amplification of modularity by adaptive dynamics
IN2011CH02818A (en)
CN101867519B (en) Dynamic area routing method and system for ad hoc network
PT2204076E (en) Method for configuring an illumination bus system
WO2015013540A8 (en) System and method for greedy-based autonomous resource block assignment scheme for cellular networks with self-organizing relaying terminals
WO2016008538A8 (en) Assigning multiple radio network temporary identifiers to a user device
MX2022005832A (en) Method and apparatus for configuring alarm rule of iot device, device, and storage medium.
CN102857991A (en) Networking method of multilayer WSN (wireless sensor network) with dynamic cluster head algorithm
BR112018072934A2 (en) method and system for achieving self-adaptive clustering in a sensory network
CN103929289B (en) For determining the method and device of the ECCE search spaces of the EPDCCH of cross-carrier scheduling
BRPI0909482A2 (en) routing and interrupt information update on a communication network
ATE497663T1 (en) METHOD FOR MULTI-HOP DATA TRANSMISSION IN AN AD-HOC NETWORK WITH HIDDEN NODES
Hatime et al. OCTOPUS: An on-demand communication topology updating strategy for mobile sensor networks
DK1860830T3 (en) Procedure for installing a hierarchical network

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07854798

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 1852/KOLNP/2009

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2007854798

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE