WO1999024925A2 - Method and system for generating corporate information - Google Patents

Method and system for generating corporate information Download PDF

Info

Publication number
WO1999024925A2
WO1999024925A2 PCT/EP1998/007210 EP9807210W WO9924925A2 WO 1999024925 A2 WO1999024925 A2 WO 1999024925A2 EP 9807210 W EP9807210 W EP 9807210W WO 9924925 A2 WO9924925 A2 WO 9924925A2
Authority
WO
WIPO (PCT)
Prior art keywords
database
target
merge
source
data
Prior art date
Application number
PCT/EP1998/007210
Other languages
French (fr)
Other versions
WO1999024925A3 (en
Inventor
Harrold Kikkers
Original Assignee
Koninklijke Kpn N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Kpn N.V. filed Critical Koninklijke Kpn N.V.
Priority to EP98961180A priority Critical patent/EP1046118A2/en
Priority to AU16691/99A priority patent/AU1669199A/en
Priority to US09/530,154 priority patent/US6678691B1/en
Priority to CA002308853A priority patent/CA2308853A1/en
Publication of WO1999024925A2 publication Critical patent/WO1999024925A2/en
Publication of WO1999024925A3 publication Critical patent/WO1999024925A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99943Generating database or data structure, e.g. via user interface

Definitions

  • the invention is related to a method and system for generating corporate information, such as customer information etc.
  • a large organisation usually has many automation systems which contain information on partly the same objects, for example customers.
  • there is a user group within the organisation which requires customer information originating from various systems and which is displayed as originating from one source .
  • These users in other words, require an integrated customer image.
  • Each object has a meaningless key, which, once assigned to an object, always retains the same value; herewith, each object always has an unequivocal identification throughout time , which is important for the following reasons : * the keys are independent of implementation details in the legacy systems ;
  • Each table in the target database has its counterpart in a so-called merge database, from which it can be derived.
  • a complete and unequivocal image of an object is stored.
  • the merge database all information on said object which is present in the source data is placed before that same object.
  • the individual sources can each provide a fragmentary and mutually conflicting image of the object.
  • the core of the transformer is the merge database.
  • the merge database has a generic structure through which the above-mentioned requirements of the target model can be met. According to the present invention, the merge database has the following structure elements:
  • - GROUPING determining the target-object-id of the object to which the record belongs ;
  • the following table indicates which structure elements are read and changed by one of the basic operations.
  • the basic operation " calculating" is diverse in nature and is not unequivocally representable in the table .
  • the following practical example demonstrates how, in a target database, a customer image is built up with regard to failures and complaints. Said customer image is built up from the source database of the failures system and the source database of the complaints system. The practical example makes clear how the structure elements and the basic operations of the merge database can be deployed.
  • Fig. 1 shows the overall set-up of the transformation process.
  • Fig. 2 shows the structure of the customer image based on the failures database and the complaints database.
  • Fig. 3 shows the content of the source database.
  • Fig. 4 shows the merge database, after the basic operation PROJECTION.
  • Fig. 5 shows the merge database, after the basic operation GROUPING .
  • Fig. 6 shows the merge database, after the basic operation RELATING .
  • Fig. 7 shows the content of the target database.
  • the projection maps the source database (Fig. 3) on the merge database (Fig. 4). For records which are no longer current, the structure element status is set to "non-current" . It is evident from the example that :
  • - - a field can cover several structure elements.
  • the grouping indicates to which object the information of the record belongs; grouping takes place by filling in the structure element (a meaningless object key) TARGET-OBJECT-ID (Fig. 5). Records receive the same TARGET-OBJECT-ID if the grouping criteria for the records are equal.
  • the grouping criterion is always that the grouping attributes must contain equal values. A part of a grouping criterion can also be that certain grouping attributes must contain a constant value.
  • the grouping also takes records with the status 'non- current' into consideration.
  • the basic operation "calculating" is not carried out.
  • An example for a calculation could be that the name, address and place of residence data of a customer are cosmeticised, after which the cosmeticised value is used as grouping attribute. This can prevent a customer whose name, address and place of residence data are spelt slightly different in two legacy systems , from being presented in the target database as two customers .
  • the requirements which were set can satisfied: - meaningless key for each object of the target model; the key value is retained in the course of time; - simple derivability of objects from the target model: the target-object- id in the merge database points to the object with the same key in the target database, and the source identification of a record in the merge database points to one record in a legacy system.
  • the derivability is thus laid down in the data, and an analysis of the transformation process therefore does not need to take place.
  • the system according to the invention has a number of characteristics of a data warehouse .
  • a data warehouse system collects legacy data, merges the data of the legacy systems and makes the data available.
  • the system according to the invention is controlled on the basis of the design of the corporate model. The transformations are therefore much more extensive.
  • data warehouses are used only for OLAP purposes .
  • the system according to the invention is used for OLAP purposes as well as for filing purposes. This places greater demands on the quality and refreshment time of the data. Matters such as persistence of object keys and derivability of objects are not necessary for a data warehouse.

Abstract

System for the transformation of a number of source databases having n legacy data models to a target database having one target model, for the purpose of providing corporate information, such as customer information with integrated customer images. Use is made of a merge database, having an intermediate data structure with which the source database is coupled to the target database. The merge database has a number of structure elements on which four basic operations are performed, namely PROJECTING: filling the table of the merge database from the source database, GROUPING: determining the target-object-id of the object to which the record belongs, RELATING: determining the target-object-id of a related datum within the merge database, and CALCULATING: evaluation of an attribute of one table of the merge database. In this regard, the structure elements are read and changed by one of said basic operations according to a given processing matrix.

Description

Method and system for generating corporate information.
A. BACKGOUND OF THE INVENTION
The invention is related to a method and system for generating corporate information, such as customer information etc.
A large organisation usually has many automation systems which contain information on partly the same objects, for example customers. In this regard there is a user group within the organisation which requires customer information originating from various systems and which is displayed as originating from one source . These users , in other words, require an integrated customer image.
It is obvious that the data model behind this integrated customer image should be based on the corporate data model. This data model, after all, offers an unequivocal frame of concepts which can be assumed to be known throughout the company. The data model on which this corporate data model is based is further designated as the target model .
The following requirements can be set regarding the target model :
- Each object has a meaningless key, which, once assigned to an object, always retains the same value; herewith, each object always has an unequivocal identification throughout time , which is important for the following reasons : * the keys are independent of implementation details in the legacy systems ;
* it is possible to store information on an object and to save this information;
* trends for an object or for a group of objects can be followed; - Simple derivability of records from the legacy data to objects in the target model and vice versa; this is important for the following reasons :
* the transformation of legacy data into target data is testable; * quality monitoring is possible;
* condition for possible implementation of update functions , in which commands which are given in terms of the corporate model are translated into a sequence of actions at the level of the legacy systems . The target model shall have to fed from the legacy systems. A possible technical solution for filling the target model is one in which the legacy systems are directly "pricked into" by means of RPC (Remote Procedure Calls). Problems in this regard are : relationships on legacy systems are often difficult to establish due to incompatible codings etc.; the load on the legacy systems can be considerable since retrieving data may require intensive processing; the legacy systems need to be adapted;
OLAP (Online Analytical Processing) on the target model is not possible.
B. SUMMARY OF THE INVENTION
In the solution according to the invention, use is made of dumps of the legacy systems. In this regard, the global structure of the process which takes care of the transformation of n legacy data models to a target model is represented by the following table, which, per data set, indicates the content of said data set and the processes acting on said data.
Figure imgf000005_0001
Each table in the target database has its counterpart in a so- called merge database, from which it can be derived. In the target database, a complete and unequivocal image of an object is stored. In the merge database, all information on said object which is present in the source data is placed before that same object. The individual sources can each provide a fragmentary and mutually conflicting image of the object. The core of the transformer is the merge database.
The merge database has a generic structure through which the above-mentioned requirements of the target model can be met. According to the present invention, the merge database has the following structure elements:
Figure imgf000006_0001
Four basic operations are defined on the above structure: - PROJECTION: filling of the table of the merge database from the source database ;
- GROUPING: determining the target-object-id of the object to which the record belongs ;
- RELATING: determining the target-object-id of a related datum within the merge database ;
- CALCULATING: evaluation of the attribute of a table of the merge database .
The following table indicates which structure elements are read and changed by one of the basic operations. The basic operation " calculating" is diverse in nature and is not unequivocally representable in the table .
Figure imgf000007_0001
Note: The basic operation RELATING reads from two tables and changes one table .
C. EXAMPLE OF EMBODIMENT
The following practical example demonstrates how, in a target database, a customer image is built up with regard to failures and complaints. Said customer image is built up from the source database of the failures system and the source database of the complaints system. The practical example makes clear how the structure elements and the basic operations of the merge database can be deployed.
Fig. 1 shows the overall set-up of the transformation process.
Fig. 2 shows the structure of the customer image based on the failures database and the complaints database.
Fig. 3 shows the content of the source database.
Fig. 4 shows the merge database, after the basic operation PROJECTION.
Fig. 5 shows the merge database, after the basic operation GROUPING .
Fig. 6 shows the merge database, after the basic operation RELATING .
Fig. 7, finally, shows the content of the target database. The projection maps the source database (Fig. 3) on the merge database (Fig. 4). For records which are no longer current, the structure element status is set to "non-current" . It is evident from the example that :
- not every structure element needs to occur in every table ; - a structure element can be implemented in several fields;
- a field can cover several structure elements.
The grouping indicates to which object the information of the record belongs; grouping takes place by filling in the structure element (a meaningless object key) TARGET-OBJECT-ID (Fig. 5). Records receive the same TARGET-OBJECT-ID if the grouping criteria for the records are equal. In the example, the grouping criterion is always that the grouping attributes must contain equal values. A part of a grouping criterion can also be that certain grouping attributes must contain a constant value. Besides records having the status ' current X the grouping also takes records with the status 'non- current' into consideration. Hereby objects which undergo a change and objects which, after a time of absence (status 'non-current' ) , return again (status 'current'), retain the same value for the structure element target-object-id. The relating (Fig. 6) is a similar process as the grouping: in a grouping, a table is related to itself and in a relating operation two tables are taken into consideration. Relating operations always take only records having the status 'current' into consideration.
In the example, the basic operation "calculating" is not carried out. An example for a calculation could be that the name, address and place of residence data of a customer are cosmeticised, after which the cosmeticised value is used as grouping attribute. This can prevent a customer whose name, address and place of residence data are spelt slightly different in two legacy systems , from being presented in the target database as two customers .
With this structure, the requirements which were set can satisfied: - meaningless key for each object of the target model; the key value is retained in the course of time; - simple derivability of objects from the target model: the target-object- id in the merge database points to the object with the same key in the target database, and the source identification of a record in the merge database points to one record in a legacy system. The derivability is thus laid down in the data, and an analysis of the transformation process therefore does not need to take place.
It is observed that the system according to the invention has a number of characteristics of a data warehouse . A data warehouse system, however, collects legacy data, merges the data of the legacy systems and makes the data available. The system according to the invention is controlled on the basis of the design of the corporate model. The transformations are therefore much more extensive. Further, data warehouses are used only for OLAP purposes . The system according to the invention is used for OLAP purposes as well as for filing purposes. This places greater demands on the quality and refreshment time of the data. Matters such as persistence of object keys and derivability of objects are not necessary for a data warehouse.

Claims

D . CLAIMS
1. System for the transformation of a number of source databases having n legacy data models to a target database having one target model, for the purpose of providing corporate information, such as customer information with integrated customer images, characterised by the following databases and processes executed thereupon:
Figure imgf000010_0001
where the merge database has a generic structure with the following structure elements :
Figure imgf000011_0001
on which structure four basic operations are defined:
- PROJECTION: filling of the table of the merge database from the source database ;
- GROUPING: determining the target-object-id of the object to which the record belongs ; - RELATING: determining the target-ob ec -id of a related datum within the merge database ;
- CALCULATING: evaluation of the attribute of a table of the merge database , where the structure elements are read and changed by one of the said basic operations according to the table:
Figure imgf000012_0001
PCT/EP1998/007210 1997-11-06 1998-11-06 Method and system for generating corporate information WO1999024925A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP98961180A EP1046118A2 (en) 1997-11-06 1998-11-06 Method and system for generating corporate information
AU16691/99A AU1669199A (en) 1997-11-06 1998-11-06 Method and system for generating corporate information
US09/530,154 US6678691B1 (en) 1997-11-06 1998-11-06 Method and system for generating corporate information
CA002308853A CA2308853A1 (en) 1997-11-06 1998-11-06 Method and system for generating corporate information

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL1007462 1997-11-06
NL1007462A NL1007462C1 (en) 1997-11-06 1997-11-06 Method and system for the generation of business information.

Publications (2)

Publication Number Publication Date
WO1999024925A2 true WO1999024925A2 (en) 1999-05-20
WO1999024925A3 WO1999024925A3 (en) 1999-07-22

Family

ID=19765965

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP1998/007210 WO1999024925A2 (en) 1997-11-06 1998-11-06 Method and system for generating corporate information

Country Status (7)

Country Link
US (1) US6678691B1 (en)
EP (1) EP1046118A2 (en)
AU (1) AU1669199A (en)
CA (1) CA2308853A1 (en)
HU (1) HUP0004097A3 (en)
NL (1) NL1007462C1 (en)
WO (1) WO1999024925A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1014288C2 (en) * 2000-02-04 2001-08-07 It Consultancy Group B V Computerized system for selecting and buying number of objects via electronic network, e.g. Internet, is flexible and easy to program
EP1515245A3 (en) * 2003-09-15 2006-06-07 Sap Ag Merging of datasets into a database
WO2006119652A1 (en) * 2005-05-13 2006-11-16 Abb Research Ltd Generating a unique representation of physical assets

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6134560A (en) * 1997-12-16 2000-10-17 Kliebhan; Daniel F. Method and apparatus for merging telephone switching office databases
US6829668B2 (en) * 2000-12-28 2004-12-07 Intel Corporation System for finding data related to an example datum on two electronic devices
US7885996B2 (en) * 2001-09-29 2011-02-08 Siebel Systems, Inc. Method, apparatus, and system for implementing notifications in a framework to support web-based applications
US8359335B2 (en) 2001-09-29 2013-01-22 Siebel Systems, Inc. Computing system and method to implicitly commit unsaved data for a world wide web application
US7203948B2 (en) * 2001-09-29 2007-04-10 Siebel Systems, Inc. Method, apparatus, and system for implementing caching of view custom options in a framework to support web-based applications
US7146617B2 (en) 2001-09-29 2006-12-05 Siebel Systems, Inc. Method, apparatus, and system for implementing view caching in a framework to support web-based applications
US6907451B1 (en) * 2001-09-29 2005-06-14 Siebel Systems, Inc. Method, apparatus, and system for immediate posting of changes in a client server environment
US7461119B2 (en) * 2001-09-29 2008-12-02 Siebel Systems, Inc. Method, apparatus, and system for managing status of requests in a client server environment
US7870492B2 (en) 2001-10-02 2011-01-11 Siebel Systems, Inc. Method, apparatus, and system for managing commands in a client server environment
US7458061B2 (en) * 2002-06-14 2008-11-25 Sun Microsystems, Inc. Protecting object identity in a language with built-in synchronization objects
WO2004077216A2 (en) * 2003-01-30 2004-09-10 Vaman Technologies (R & D) Limited System and method for heterogeneous data migration in real-time
US7206784B2 (en) * 2003-05-28 2007-04-17 Oracle International Corporation Method and apparatus for performing multiple merge operations using source data that is modified in between the merge operations
US7225411B1 (en) * 2003-06-30 2007-05-29 Tibco Software Inc. Efficient transformation of information between a source schema and a target schema
US7302447B2 (en) * 2005-01-14 2007-11-27 International Business Machines Corporation Virtual columns
US20060106889A1 (en) * 2004-11-12 2006-05-18 Mannby Claes-Fredrik U Method, system, and program for managing revisions to a file
US7730027B2 (en) * 2004-12-16 2010-06-01 Sap Ag Graphical transformation of data
US8090658B2 (en) * 2006-06-23 2012-01-03 International Business Machines Corporation System and method of member unique names
US8190610B2 (en) * 2006-10-05 2012-05-29 Yahoo! Inc. MapReduce for distributed database processing
US7523123B2 (en) * 2006-11-16 2009-04-21 Yahoo! Inc. Map-reduce with merge to process multiple relational datasets
US9984173B2 (en) * 2014-02-24 2018-05-29 International Business Machines Corporation Automated value analysis in legacy data
US10896194B2 (en) * 2017-12-21 2021-01-19 International Business Machines Corporation Generating a combined database with data extracted from multiple systems
US11120016B2 (en) 2017-12-21 2021-09-14 International Business Machines Corporation Automated generation of a query statement based on user selections received through a user interface

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5794228A (en) * 1993-04-16 1998-08-11 Sybase, Inc. Database system with buffer manager providing per page native data compression and decompression
US5692107A (en) * 1994-03-15 1997-11-25 Lockheed Missiles & Space Company, Inc. Method for generating predictive models in a computer system
US5832475A (en) * 1996-03-29 1998-11-03 International Business Machines Corporation Database system and method employing data cube operator for group-by operations
US5765028A (en) * 1996-05-07 1998-06-09 Ncr Corporation Method and apparatus for providing neural intelligence to a mail query agent in an online analytical processing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1014288C2 (en) * 2000-02-04 2001-08-07 It Consultancy Group B V Computerized system for selecting and buying number of objects via electronic network, e.g. Internet, is flexible and easy to program
EP1515245A3 (en) * 2003-09-15 2006-06-07 Sap Ag Merging of datasets into a database
US7283994B2 (en) 2003-09-15 2007-10-16 Sap Ag Merging of products into a database
WO2006119652A1 (en) * 2005-05-13 2006-11-16 Abb Research Ltd Generating a unique representation of physical assets
US8032563B2 (en) 2005-05-13 2011-10-04 Abb Research Ltd Generating a unique representation of physical assets

Also Published As

Publication number Publication date
HUP0004097A2 (en) 2001-02-28
EP1046118A2 (en) 2000-10-25
CA2308853A1 (en) 1999-05-20
AU1669199A (en) 1999-05-31
US6678691B1 (en) 2004-01-13
WO1999024925A3 (en) 1999-07-22
HUP0004097A3 (en) 2002-05-28
NL1007462C1 (en) 1997-11-28

Similar Documents

Publication Publication Date Title
US6678691B1 (en) Method and system for generating corporate information
US5721911A (en) Mechanism for metadata for an information catalog system
Langran Issues of implementing a spatiotemporal system
US6732120B1 (en) System and method for processing and display of geographical data
US20050091206A1 (en) Method and system for handling data available in multidimensional databases using a spreadsheet
US5619694A (en) Case database storage/retrieval system
JP4571746B2 (en) System and method for selectively defining access to application functions
US7668888B2 (en) Converting object structures for search engines
CN110032604A (en) Data storage device, transfer device and data bank access method
US6301581B1 (en) Method and system for managing access to a plurality of data objects
US7325010B1 (en) Information modeling method and database searching method using the information modeling method
GB2334601A (en) Database data model extension
WO2003050720A2 (en) Database system having heterogeneous object types
US5557788A (en) Relational access system for network type data bases which uses a unique declarative statement
US5602985A (en) Data presenting device
Bagg et al. Modelling historical change in southern Corsica: temporal GIS development using an extensible database system
US6976242B2 (en) Organizational information processing and operational system designing method
JPH01102656A (en) Estimation processing system for system performance
US20080320407A1 (en) Method for Processing Data
US20020087637A1 (en) Component information database system and search method thereof
JPH03219366A (en) Screen retrieving system for hierarchical structure data
JPH06214850A (en) File retrieving device
JP2777273B2 (en) Document creation and management system
Halustchak Proposed spatial data handling extensions to SQL
Aisbett et al. Consistency in visual information systems

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: A3

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH GM HR HU ID IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW SD SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1998961180

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: PV2000-1220

Country of ref document: CZ

ENP Entry into the national phase

Ref document number: 2308853

Country of ref document: CA

Ref country code: CA

Ref document number: 2308853

Kind code of ref document: A

Format of ref document f/p: F

NENP Non-entry into the national phase

Ref country code: KR

WWE Wipo information: entry into national phase

Ref document number: 09530154

Country of ref document: US

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: PV2000-1220

Country of ref document: CZ

WWP Wipo information: published in national office

Ref document number: 1998961180

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: PV2000-1220

Country of ref document: CZ

WWW Wipo information: withdrawn in national office

Ref document number: 1998961180

Country of ref document: EP