CA2304646A1 - Online database mining - Google Patents

Online database mining Download PDF

Info

Publication number
CA2304646A1
CA2304646A1 CA002304646A CA2304646A CA2304646A1 CA 2304646 A1 CA2304646 A1 CA 2304646A1 CA 002304646 A CA002304646 A CA 002304646A CA 2304646 A CA2304646 A CA 2304646A CA 2304646 A1 CA2304646 A1 CA 2304646A1
Authority
CA
Canada
Prior art keywords
stage
online
rules
preprocessing
order
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002304646A
Other languages
French (fr)
Other versions
CA2304646C (en
Inventor
Charu Chandra Aggarwal
Philip Shi-Lung Yu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2304646A1 publication Critical patent/CA2304646A1/en
Application granted granted Critical
Publication of CA2304646C publication Critical patent/CA2304646C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2246—Trees, e.g. B+trees
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2465—Query processing support for facilitating data mining operations in structured databases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/31—Indexing; Data structures therefor; Storage structures
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/953—Organization of data
    • Y10S707/954—Relational
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/953—Organization of data
    • Y10S707/956—Hierarchical
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/964—Database arrangement
    • Y10S707/966—Distributed
    • Y10S707/967—Peer-to-peer
    • Y10S707/968—Partitioning
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99932—Access augmentation or optimizing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99933—Query processing, i.e. searching
    • Y10S707/99936—Pattern matching access

Abstract

A computer method is provided of online mining of quantitative association rules which has two stages, a preprocessing stage followed by an online rule generation stage. The required computational effort is reduced by the preprocessing stage, defined by preprocessing data to organize the relationships between antecedent attributes to create a hierarchically arranged multidimensional indexing structure. The resulting structure facilitates the performance of the second stage, online processing, which involves the generation of quantitative association rules. The second stage, online rule generation, utilizes the multidimensional index structure created by the preprocessing stage by first finding the areas in the data which correspond to the rules and then uses a merging step to create a merged tree in order to carefully combine interesting regions in order to give a hierarchical representation of the rule set. The merged tree is then used in order to actually generate the rules.
CA002304646A 1997-11-04 1998-09-29 Online database mining Expired - Lifetime CA2304646C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US08/964,064 1997-11-04
US08/964,064 US6092064A (en) 1997-11-04 1997-11-04 On-line mining of quantitative association rules
PCT/GB1998/002928 WO1999023577A1 (en) 1997-11-04 1998-09-29 Online database mining

Publications (2)

Publication Number Publication Date
CA2304646A1 true CA2304646A1 (en) 1999-05-14
CA2304646C CA2304646C (en) 2003-10-28

Family

ID=25508083

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002304646A Expired - Lifetime CA2304646C (en) 1997-11-04 1998-09-29 Online database mining

Country Status (15)

Country Link
US (1) US6092064A (en)
EP (1) EP1034489B1 (en)
JP (1) JP3575602B2 (en)
KR (1) KR100382296B1 (en)
CN (1) CN1138222C (en)
AU (1) AU750629B2 (en)
CA (1) CA2304646C (en)
CZ (1) CZ294171B6 (en)
DE (1) DE69809964T2 (en)
ES (1) ES2184322T3 (en)
HK (1) HK1033987A1 (en)
HU (1) HUP0100161A3 (en)
PL (1) PL340380A1 (en)
TW (1) TW505868B (en)
WO (1) WO1999023577A1 (en)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5684985A (en) 1994-12-15 1997-11-04 Ufil Unified Data Technologies Ltd. Method and apparatus utilizing bond identifiers executed upon accessing of an endo-dynamic information node (EDIN)
JPH11328186A (en) * 1997-11-11 1999-11-30 Mitsubishi Electric Corp Method and device for generating correlation rule
IL122850A0 (en) * 1998-01-05 1999-03-12 Wizsoft Pattern recognition using generalized association rules
US6185549B1 (en) * 1998-04-29 2001-02-06 Lucent Technologies Inc. Method for mining association rules in data
US6311179B1 (en) * 1998-10-30 2001-10-30 International Business Machines Corporation System and method of generating associations
US6278998B1 (en) * 1999-02-16 2001-08-21 Lucent Technologies, Inc. Data mining using cyclic association rules
CA2368123A1 (en) * 1999-04-09 2000-10-19 Berkeley*I E O R Process for determining object level profitability
US6405200B1 (en) 1999-04-23 2002-06-11 Microsoft Corporation Generating a model for raw variables from a model for cooked variables
US6542878B1 (en) 1999-04-23 2003-04-01 Microsoft Corporation Determining whether a variable is numeric or non-numeric
US6529895B2 (en) 1999-04-23 2003-03-04 Microsoft Corporation Determining a distribution of a numeric variable
US6321225B1 (en) * 1999-04-23 2001-11-20 Microsoft Corporation Abstracting cooked variables from raw variables
KR100344530B1 (en) * 1999-12-20 2002-07-24 한국과학기술원 A Subsequence matching method using duality in constructing windows in time-series databases
US6865582B2 (en) * 2000-01-03 2005-03-08 Bechtel Bwxt Idaho, Llc Systems and methods for knowledge discovery in spatial data
US7007020B1 (en) * 2000-03-10 2006-02-28 Hewlett-Packard Development Company, L.P. Distributed OLAP-based association rule generation method and system
KR20020018777A (en) * 2000-09-04 2002-03-09 박대희 An incremental updating data mining method for pattern classification
US7539677B1 (en) 2000-10-09 2009-05-26 Battelle Memorial Institute Sequential pattern data mining and visualization
US6711577B1 (en) 2000-10-09 2004-03-23 Battelle Memorial Institute Data mining and visualization techniques
US20020072941A1 (en) * 2000-12-07 2002-06-13 Ibm Corporation Method and apparatus for processing electronic records for physical transactions
US6757678B2 (en) 2001-04-12 2004-06-29 International Business Machines Corporation Generalized method and system of merging and pruning of data trees
JP4571404B2 (en) * 2001-07-26 2010-10-27 インターナショナル・ビジネス・マシーンズ・コーポレーション Data processing method, data processing system, and program
KR20030032096A (en) * 2001-10-10 2003-04-26 이창환 A method of data mining and a computer-readable medium
KR100500329B1 (en) * 2001-10-18 2005-07-11 주식회사 핸디소프트 System and Method for Workflow Mining
US6714940B2 (en) 2001-11-15 2004-03-30 International Business Machines Corporation Systems, methods, and computer program products to rank and explain dimensions associated with exceptions in multidimensional data
KR100497212B1 (en) * 2002-03-02 2005-06-23 (주)비엘시스템스 Apparatus and method for rule generation in ensemble machines
US7152056B2 (en) * 2002-04-19 2006-12-19 Dow Jones Reuters Business Interactive, Llc Apparatus and method for generating data useful in indexing and searching
KR20050011745A (en) * 2002-04-19 2005-01-29 컴퓨터 어소시에이츠 싱크, 인코포레이티드 System and method for providing inferencing services
US6920459B2 (en) * 2002-05-07 2005-07-19 Zycus Infotech Pvt Ltd. System and method for context based searching of electronic catalog database, aided with graphical feedback to the user
US6993534B2 (en) * 2002-05-08 2006-01-31 International Business Machines Corporation Data store for knowledge-based data mining system
US7010526B2 (en) 2002-05-08 2006-03-07 International Business Machines Corporation Knowledge-based data mining system
US8214391B2 (en) * 2002-05-08 2012-07-03 International Business Machines Corporation Knowledge-based data mining system
US6947929B2 (en) * 2002-05-10 2005-09-20 International Business Machines Corporation Systems, methods and computer program products to determine useful relationships and dimensions of a database
US7447687B2 (en) 2002-05-10 2008-11-04 International Business Machines Corporation Methods to browse database query information
US7716167B2 (en) * 2002-12-18 2010-05-11 International Business Machines Corporation System and method for automatically building an OLAP model in a relational database
US7953694B2 (en) * 2003-01-13 2011-05-31 International Business Machines Corporation Method, system, and program for specifying multidimensional calculations for a relational OLAP engine
US7895191B2 (en) 2003-04-09 2011-02-22 International Business Machines Corporation Improving performance of database queries
US20040260680A1 (en) * 2003-06-19 2004-12-23 International Business Machines Corporation Personalized indexing and searching for information in a distributed data processing system
US7289983B2 (en) * 2003-06-19 2007-10-30 International Business Machines Corporation Personalized indexing and searching for information in a distributed data processing system
US7426520B2 (en) 2003-09-10 2008-09-16 Exeros, Inc. Method and apparatus for semantic discovery and mapping between data sources
US7958132B2 (en) * 2004-02-10 2011-06-07 Microsoft Corporation Voting based scheme for electronic document node reuse
US7707143B2 (en) * 2004-06-14 2010-04-27 International Business Machines Corporation Systems, methods, and computer program products that automatically discover metadata objects and generate multidimensional models
US20050283494A1 (en) * 2004-06-22 2005-12-22 International Business Machines Corporation Visualizing and manipulating multidimensional OLAP models graphically
US7480663B2 (en) * 2004-06-22 2009-01-20 International Business Machines Corporation Model based optimization with focus regions
US8924343B2 (en) 2005-03-23 2014-12-30 International Business Machines Coporation Method and system for using confidence factors in forming a system
KR100812378B1 (en) * 2005-11-28 2008-03-11 이원석 estDec+ method for finding frequent itemsets over data streams using compressed-Prefix trees
US20070250476A1 (en) * 2006-04-21 2007-10-25 Lockheed Martin Corporation Approximate nearest neighbor search in metric space
KR100799665B1 (en) * 2007-04-10 2008-01-30 삼육대학교산학협력단 Method and system for predicting the desire for the atged welfare
US8401987B2 (en) * 2007-07-17 2013-03-19 International Business Machines Corporation Managing validation models and rules to apply to data sets
JP5228461B2 (en) * 2007-12-05 2013-07-03 富士通株式会社 Pattern extraction apparatus, pattern extraction program, and pattern extraction method
US9720971B2 (en) * 2008-06-30 2017-08-01 International Business Machines Corporation Discovering transformations applied to a source table to generate a target table
US20100030719A1 (en) * 2008-07-10 2010-02-04 Covey Todd M Methods and apparatus related to bioinformatics data analysis
US8185531B2 (en) * 2008-07-24 2012-05-22 Nahava Inc. Method and apparatus for partitioning high-dimension vectors for use in a massive index tree
US8290955B2 (en) * 2008-09-18 2012-10-16 International Business Machines Corporation Classification of data in a hierarchical data structure
US20110035444A1 (en) * 2009-08-06 2011-02-10 Timedright Inc. Relationship security in online social and professional networks and communities
CN101996102B (en) * 2009-08-31 2013-07-17 中国移动通信集团公司 Method and system for mining data association rule
CN102117302B (en) * 2009-12-31 2013-01-23 南京理工大学 Data origin tracking method on sensor data stream complex query results
US8930303B2 (en) 2012-03-30 2015-01-06 International Business Machines Corporation Discovering pivot type relationships between database objects
JP6020031B2 (en) 2012-10-19 2016-11-02 富士通株式会社 Extraction program, extraction apparatus, and extraction method
JP6003561B2 (en) 2012-11-15 2016-10-05 富士通株式会社 Extraction program, extraction apparatus, and extraction method
JP5962471B2 (en) 2012-11-30 2016-08-03 富士通株式会社 Extraction program, extraction apparatus, and extraction method
JP6102594B2 (en) * 2013-07-16 2017-03-29 富士通株式会社 Data output method and data output program
JP6136685B2 (en) * 2013-07-16 2017-05-31 富士通株式会社 Data extraction method and data extraction program
US9672495B2 (en) * 2014-12-23 2017-06-06 Sap Se Enhancing frequent itemset mining
US10671607B2 (en) * 2016-09-23 2020-06-02 Futurewei Technologies, Inc. Pipeline dependent tree query optimizer and scheduler
WO2018217190A1 (en) * 2017-05-23 2018-11-29 Hitachi, Ltd. System and method to reduce network traffic and load of host servers
CN107703383A (en) * 2017-09-21 2018-02-16 国网上海市电力公司 A kind of method for building up of information acquisition system fault diagnosis knowledge base
CN112183823B (en) * 2020-09-08 2023-12-05 国网江苏省电力有限公司营销服务中心 Rule tree-based type selection method and system for electric energy metering device

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5664171A (en) * 1994-04-14 1997-09-02 International Business Machines Corporation System and method for query optimization using quantile values of a large unordered data set
US5819266A (en) * 1995-03-03 1998-10-06 International Business Machines Corporation System and method for mining sequential patterns in a large database
US5737550A (en) * 1995-03-28 1998-04-07 Advanced Micro Devices, Inc. Cache memory to processor bus interface and method thereof
US5794209A (en) * 1995-03-31 1998-08-11 International Business Machines Corporation System and method for quickly mining association rules in databases
US5615341A (en) * 1995-05-08 1997-03-25 International Business Machines Corporation System and method for mining generalized association rules in databases
JP2963033B2 (en) * 1995-09-29 1999-10-12 株式会社野村総合研究所 Sample classification support device
JPH09114669A (en) * 1995-10-16 1997-05-02 Hitachi Ltd Rule generation method
US5724573A (en) * 1995-12-22 1998-03-03 International Business Machines Corporation Method and system for mining quantitative association rules in large relational tables
JPH09251467A (en) * 1996-03-15 1997-09-22 Mitsubishi Electric Corp Data mining system and method
JP3952518B2 (en) * 1996-03-29 2007-08-01 株式会社日立製作所 Multidimensional data processing method
GB9611403D0 (en) * 1996-05-31 1996-08-07 Northern Telecom Ltd Network data analysis method

Also Published As

Publication number Publication date
US6092064A (en) 2000-07-18
EP1034489A1 (en) 2000-09-13
AU750629B2 (en) 2002-07-25
HUP0100161A2 (en) 2001-05-28
CZ20001630A3 (en) 2001-05-16
ES2184322T3 (en) 2003-04-01
PL340380A1 (en) 2001-01-29
CN1138222C (en) 2004-02-11
CN1278345A (en) 2000-12-27
CZ294171B6 (en) 2004-10-13
JP2001522095A (en) 2001-11-13
CA2304646C (en) 2003-10-28
HK1033987A1 (en) 2001-10-05
AU9272698A (en) 1999-05-24
DE69809964T2 (en) 2003-08-28
WO1999023577A1 (en) 1999-05-14
EP1034489B1 (en) 2002-12-04
DE69809964D1 (en) 2003-01-16
TW505868B (en) 2002-10-11
HUP0100161A3 (en) 2004-03-01
KR100382296B1 (en) 2003-05-09
KR20010031687A (en) 2001-04-16
JP3575602B2 (en) 2004-10-13

Similar Documents

Publication Publication Date Title
CA2304646A1 (en) Online database mining
US5978794A (en) Method and system for performing spatial similarity joins on high-dimensional points
Zadeh Fuzzy languages and their relation to human and machine intelligence
Lin Data mining and machine oriented modeling: A granular computing approach
US6070133A (en) Information retrieval system utilizing wavelet transform
Berzal et al. TBAR: An efficient method for association rule mining in relational databases
WO2004036456A3 (en) Method and system for online analytical processing (olap)
Theodoridis et al. Range queries involving spatial relations: A performance analysis
Lee et al. Access methods of image database
Iiritano et al. Managing the knowledge contained in electronic documents: a clustering method for text mining
Theodoridis et al. Supporting direction relations in spatial database systems
Trieschnigg et al. TNO Hierarchical topic detection report at TDT 2004
Métais et al. Using linguistic knowledge in view integration: Toward a third generation of tools
JPH1196177A (en) Method for generating term dictionary, and storage medium recording term dictionary generation program
Chen et al. On the shoulders of giants
Bentayeb et al. Efficient integration of data mining techniques in database management systems
Sumita et al. Document structure extraction for interactive document retrieval systems
Salton A note about information science research
Fonseca A bipartite graph co-clustering approach to ontology mapping
TAMRAKAR An Analysis of Fuzzy set of Query Processing for Fuzzification
Brabec et al. The VASCO R-tree JAVAtm applet
Kailing et al. Extending metric index structures for efficient range query processing
Cakmakov et al. A multimedia cognitive-based system model
Johnson et al. Using SAS/PC for higher order factoring
Iivari Relationships, aggregations and complex objects

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20181001

MKEX Expiry

Effective date: 20181001