WO2003094056A3 - Database replication system - Google Patents

Database replication system Download PDF

Info

Publication number
WO2003094056A3
WO2003094056A3 PCT/US2003/014032 US0314032W WO03094056A3 WO 2003094056 A3 WO2003094056 A3 WO 2003094056A3 US 0314032 W US0314032 W US 0314032W WO 03094056 A3 WO03094056 A3 WO 03094056A3
Authority
WO
WIPO (PCT)
Prior art keywords
database
data
processes
source
server
Prior art date
Application number
PCT/US2003/014032
Other languages
French (fr)
Other versions
WO2003094056A2 (en
Inventor
Leroy D Earl
Sergey Igorevich Oderov
Original Assignee
Lakeview Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lakeview Technology Inc filed Critical Lakeview Technology Inc
Priority to AU2003232061A priority Critical patent/AU2003232061A1/en
Priority to EP03747671A priority patent/EP1499973A2/en
Publication of WO2003094056A2 publication Critical patent/WO2003094056A2/en
Publication of WO2003094056A3 publication Critical patent/WO2003094056A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/275—Synchronous replication

Abstract

A method for online, real-time, continuous replication of a database includes a process for initially copying a database from one or more source servers to a destination server, processes for scanning database transaction log files and database data files to identify when data has changed, processes for replicating changed data from the source server to the destination server, and processes to ensure that the source and destination databases are continually synchronized. The inventive method is self-healing and can recover and resume without loss of data even if the replication process is slowed, interrupted, or halted.
PCT/US2003/014032 2002-05-02 2003-05-02 Database replication system WO2003094056A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2003232061A AU2003232061A1 (en) 2002-05-02 2003-05-02 Database replication system
EP03747671A EP1499973A2 (en) 2002-05-02 2003-05-02 Database replication system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US38005302P 2002-05-02 2002-05-02
US60/380,053 2002-05-02
US10/426,467 2003-04-30
US10/426,467 US20030208511A1 (en) 2002-05-02 2003-04-30 Database replication system

Publications (2)

Publication Number Publication Date
WO2003094056A2 WO2003094056A2 (en) 2003-11-13
WO2003094056A3 true WO2003094056A3 (en) 2004-09-30

Family

ID=29273172

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2003/014032 WO2003094056A2 (en) 2002-05-02 2003-05-02 Database replication system

Country Status (4)

Country Link
US (1) US20030208511A1 (en)
EP (1) EP1499973A2 (en)
AU (1) AU2003232061A1 (en)
WO (1) WO2003094056A2 (en)

Families Citing this family (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6976093B2 (en) * 1998-05-29 2005-12-13 Yahoo! Inc. Web server content replication
KR100970122B1 (en) * 2001-11-01 2010-07-13 베리사인 인코포레이티드 High speed non-concurrency controlled database
US20030145021A1 (en) * 2002-01-31 2003-07-31 Jarmo Parkkinen Method and arrangement for serially aligning database transactions
US7370064B2 (en) * 2002-08-06 2008-05-06 Yousefi Zadeh Homayoun Database remote replication for back-end tier of multi-tier computer systems
GB2391649B (en) * 2002-08-09 2004-10-13 Gordano Ltd E-mail systems
JP2004171249A (en) * 2002-11-20 2004-06-17 Hitachi Ltd Backup execution decision method for database
US7370025B1 (en) * 2002-12-17 2008-05-06 Symantec Operating Corporation System and method for providing access to replicated data
US7337195B2 (en) * 2002-12-31 2008-02-26 International Business Machines Corporation Method and device for establishing synchronized recovery log points
US7467168B2 (en) * 2003-06-18 2008-12-16 International Business Machines Corporation Method for mirroring data at storage locations
US7257592B2 (en) * 2003-06-26 2007-08-14 International Business Machines Corporation Replicating the blob data from the source field to the target field based on the source coded character set identifier and the target coded character set identifier, wherein the replicating further comprises converting the blob data from the source coded character set identifier to the target coded character set identifier
US8095511B2 (en) * 2003-06-30 2012-01-10 Microsoft Corporation Database data recovery system and method
US7200620B2 (en) * 2003-09-29 2007-04-03 International Business Machines Corporation High availability data replication of smart large objects
US7269607B2 (en) * 2003-09-29 2007-09-11 International Business Machines Coproartion Method and information technology infrastructure for establishing a log point for automatic recovery of federated databases to a prior point in time
US7831550B1 (en) * 2003-09-30 2010-11-09 Symantec Operating Corporation Propagating results of a volume-changing operation to replicated nodes
US7197661B1 (en) * 2003-12-05 2007-03-27 F5 Networks, Inc. System and method for dynamic mirroring of a network connection
US20050138306A1 (en) * 2003-12-19 2005-06-23 Panchbudhe Ankur P. Performance of operations on selected data in a storage area
JP2005235058A (en) 2004-02-23 2005-09-02 Hitachi Ltd Snapshot acquisition method, snapshot acquisition device, and computer program provided with snapshot acquisition function
US7490083B2 (en) 2004-02-27 2009-02-10 International Business Machines Corporation Parallel apply processing in data replication with preservation of transaction integrity and source ordering of dependent updates
US8688634B2 (en) * 2004-02-27 2014-04-01 International Business Machines Corporation Asynchronous peer-to-peer data replication
US20050278458A1 (en) * 2004-06-09 2005-12-15 Microsoft Corporation Analysis services database synchronization
US20050278385A1 (en) * 2004-06-10 2005-12-15 Hewlett-Packard Development Company, L.P. Systems and methods for staggered data replication and recovery
JP4484618B2 (en) 2004-07-30 2010-06-16 株式会社日立製作所 Disaster recovery system, program, and data replication method
US7299376B2 (en) 2004-08-25 2007-11-20 International Business Machines Corporation Apparatus, system, and method for verifying backup data
US20060059209A1 (en) * 2004-09-14 2006-03-16 Lashley Scott D Crash recovery by logging extra data
JP2006127028A (en) * 2004-10-27 2006-05-18 Hitachi Ltd Memory system and storage controller
US7475387B2 (en) 2005-01-04 2009-01-06 International Business Machines Corporation Problem determination using system run-time behavior analysis
US8037056B2 (en) 2005-02-18 2011-10-11 International Business Machines Corporation Online repair of a replicated table
US7376675B2 (en) * 2005-02-18 2008-05-20 International Business Machines Corporation Simulating multi-user activity while maintaining original linear request order for asynchronous transactional events
US8214353B2 (en) * 2005-02-18 2012-07-03 International Business Machines Corporation Support for schema evolution in a multi-node peer-to-peer replication environment
US9286346B2 (en) * 2005-02-18 2016-03-15 International Business Machines Corporation Replication-only triggers
US7827141B2 (en) * 2005-03-10 2010-11-02 Oracle International Corporation Dynamically sizing buffers to optimal size in network layers when supporting data transfers related to database applications
US7487386B2 (en) * 2005-03-30 2009-02-03 International Business Machines Corporation Method for increasing file system availability via block replication
US8112655B2 (en) 2005-04-21 2012-02-07 Violin Memory, Inc. Mesosynchronous data bus apparatus and method of data transmission
US9384818B2 (en) 2005-04-21 2016-07-05 Violin Memory Memory power management
US9582449B2 (en) 2005-04-21 2017-02-28 Violin Memory, Inc. Interconnection system
US8200887B2 (en) * 2007-03-29 2012-06-12 Violin Memory, Inc. Memory management system and method
US8452929B2 (en) 2005-04-21 2013-05-28 Violin Memory Inc. Method and system for storage of data in non-volatile media
KR101331569B1 (en) 2005-04-21 2013-11-21 바이올린 메모리 인코포레이티드 Interconnection System
US9286198B2 (en) 2005-04-21 2016-03-15 Violin Memory Method and system for storage of data in non-volatile media
US20070027935A1 (en) * 2005-07-28 2007-02-01 Haselton William R Backing up source files in their native file formats to a target storage
CA2933790C (en) * 2005-10-28 2019-04-30 Oracle International Corporation Apparatus and method for creating a real time database replica
US7526516B1 (en) * 2006-05-26 2009-04-28 Kaspersky Lab, Zao System and method for file integrity monitoring using timestamps
JP5124989B2 (en) * 2006-05-26 2013-01-23 日本電気株式会社 Storage system and data protection method and program
US20080059469A1 (en) * 2006-08-31 2008-03-06 International Business Machines Corporation Replication Token Based Synchronization
US8028186B2 (en) 2006-10-23 2011-09-27 Violin Memory, Inc. Skew management in an interconnection system
US7882061B1 (en) * 2006-12-21 2011-02-01 Emc Corporation Multi-thread replication across a network
US7685386B2 (en) 2007-01-24 2010-03-23 International Business Machines Corporation Data storage resynchronization using application features
US8768890B2 (en) * 2007-03-14 2014-07-01 Microsoft Corporation Delaying database writes for database consistency
US11010076B2 (en) 2007-03-29 2021-05-18 Violin Systems Llc Memory system with multiple striping of raid groups and method for performing the same
US9632870B2 (en) 2007-03-29 2017-04-25 Violin Memory, Inc. Memory system with multiple striping of raid groups and method for performing the same
US7788360B2 (en) * 2007-09-10 2010-08-31 Routesync, Llc Configurable distributed information sharing system
US9032032B2 (en) * 2008-06-26 2015-05-12 Microsoft Technology Licensing, Llc Data replication feedback for transport input/output
US8332365B2 (en) * 2009-03-31 2012-12-11 Amazon Technologies, Inc. Cloning and recovery of data volumes
US20100325351A1 (en) * 2009-06-12 2010-12-23 Bennett Jon C R Memory system having persistent garbage collection
EP2290562A1 (en) * 2009-08-24 2011-03-02 Amadeus S.A.S. Segmented main-memory stored relational database table system with improved collaborative scan algorithm
EP2521980A1 (en) * 2010-01-05 2012-11-14 Siemens Product Lifecycle Management Software Inc. Traversal-free rapid data transfer
JP5357068B2 (en) * 2010-01-20 2013-12-04 インターナショナル・ビジネス・マシーンズ・コーポレーション Information processing apparatus, information processing system, data archive method, and data deletion method
US8311986B2 (en) * 2010-09-16 2012-11-13 Mimosa Systems, Inc. Determining database record content changes
US8341134B2 (en) 2010-12-10 2012-12-25 International Business Machines Corporation Asynchronous deletion of a range of messages processed by a parallel database replication apply process
US8892514B2 (en) * 2011-11-15 2014-11-18 Sybase, Inc. Multi-path replication in databases
CN103136070B (en) * 2011-11-30 2015-08-05 阿里巴巴集团控股有限公司 A kind of method and apparatus of data disaster tolerance process
US9652495B2 (en) 2012-03-13 2017-05-16 Siemens Product Lifecycle Management Software Inc. Traversal-free updates in large data structures
US9122740B2 (en) 2012-03-13 2015-09-01 Siemens Product Lifecycle Management Software Inc. Bulk traversal of large data structures
US9317508B2 (en) * 2012-09-07 2016-04-19 Red Hat, Inc. Pro-active self-healing in a distributed file system
US8874508B1 (en) * 2012-10-02 2014-10-28 Symantec Corporation Systems and methods for enabling database disaster recovery using replicated volumes
US9201906B2 (en) 2012-12-21 2015-12-01 Commvault Systems, Inc. Systems and methods to perform data backup in data storage systems
US8935207B2 (en) 2013-02-14 2015-01-13 Sap Se Inspecting replicated data
US9304815B1 (en) 2013-06-13 2016-04-05 Amazon Technologies, Inc. Dynamic replica failure detection and healing
US9110847B2 (en) 2013-06-24 2015-08-18 Sap Se N to M host system copy
US9811542B1 (en) 2013-06-30 2017-11-07 Veritas Technologies Llc Method for performing targeted backup
US9923762B1 (en) * 2013-08-13 2018-03-20 Ca, Inc. Upgrading an engine when a scenario is running
US10176240B2 (en) * 2013-09-12 2019-01-08 VoltDB, Inc. Methods and systems for real-time transactional database transformation
US10198493B2 (en) 2013-10-18 2019-02-05 Sybase, Inc. Routing replicated data based on the content of the data
US9836516B2 (en) 2013-10-18 2017-12-05 Sap Se Parallel scanners for log based replication
US9836515B1 (en) * 2013-12-31 2017-12-05 Veritas Technologies Llc Systems and methods for adding active volumes to existing replication configurations
CN103678718A (en) * 2013-12-31 2014-03-26 金蝶软件（中国）有限公司 Database synchronization method and system
US9727625B2 (en) 2014-01-16 2017-08-08 International Business Machines Corporation Parallel transaction messages for database replication
US9558078B2 (en) 2014-10-28 2017-01-31 Microsoft Technology Licensing, Llc Point in time database restore from storage snapshots
US9990224B2 (en) 2015-02-23 2018-06-05 International Business Machines Corporation Relaxing transaction serializability with statement-based data replication
CN105843707B (en) * 2016-03-28 2019-05-14 上海上讯信息技术股份有限公司 Database quick recovery method and equipment
CN106126658B (en) * 2016-06-28 2019-03-19 电子科技大学 A kind of database auditing point construction method based on virtual memory snapshot
US10769134B2 (en) 2016-10-28 2020-09-08 Microsoft Technology Licensing, Llc Resumable and online schema transformations
US10355869B2 (en) 2017-01-12 2019-07-16 International Business Machines Corporation Private blockchain transaction management and termination
US11256572B2 (en) * 2017-01-23 2022-02-22 Honeywell International Inc. Systems and methods for processing data in security systems using parallelism, stateless queries, data slicing, or asynchronous pull mechanisms
CN110678855B (en) * 2017-05-31 2023-06-16 三菱电机株式会社 Data copying device and computer readable storage medium
US11120047B1 (en) 2018-08-22 2021-09-14 Gravic, Inc. Method and apparatus for continuously comparing two databases which are actively being kept synchronized
WO2020082073A1 (en) * 2018-10-19 2020-04-23 Arris Enterprises Llc Distributed state recovery in a system having dynamic reconfiguration of participating nodes
US11163792B2 (en) 2019-05-29 2021-11-02 International Business Machines Corporation Work assignment in parallelized database synchronization
CN110188018B (en) * 2019-05-29 2023-06-09 广州伟宏智能科技有限公司 Data synchronous copying software operation and maintenance monitoring system
CN111008123B (en) * 2019-10-23 2023-10-24 贝壳技术有限公司 Database testing method and device, storage medium and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0724223A1 (en) * 1995-01-24 1996-07-31 Tandem Computers Incorporated Remote duplicate database facility with database replication support for online line DDL operations
US5740433A (en) * 1995-01-24 1998-04-14 Tandem Computers, Inc. Remote duplicate database facility with improved throughput and fault tolerance
US5845295A (en) * 1996-08-27 1998-12-01 Unisys Corporation System for providing instantaneous access to a snapshot Op data stored on a storage medium for offline analysis
US5852715A (en) * 1996-03-19 1998-12-22 Emc Corporation System for currently updating database by one host and reading the database by different host for the purpose of implementing decision support functions
US5937414A (en) * 1997-02-28 1999-08-10 Oracle Corporation Method and apparatus for providing database system replication in a mixed propagation environment
US6032158A (en) * 1997-05-02 2000-02-29 Informatica Corporation Apparatus and method for capturing and propagating changes from an operational database to data marts

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5819020A (en) * 1995-10-16 1998-10-06 Network Specialists, Inc. Real time backup system
US6487644B1 (en) * 1996-11-22 2002-11-26 Veritas Operating Corporation System and method for multiplexed data back-up to a storage tape and restore operations using client identification tags
US6018745A (en) * 1997-12-23 2000-01-25 Ericsson Inc. Coupled file access
US6578041B1 (en) * 2000-06-30 2003-06-10 Microsoft Corporation High speed on-line backup when using logical log operations
US6877016B1 (en) * 2001-09-13 2005-04-05 Unisys Corporation Method of capturing a physically consistent mirrored snapshot of an online database

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0724223A1 (en) * 1995-01-24 1996-07-31 Tandem Computers Incorporated Remote duplicate database facility with database replication support for online line DDL operations
US5740433A (en) * 1995-01-24 1998-04-14 Tandem Computers, Inc. Remote duplicate database facility with improved throughput and fault tolerance
US5852715A (en) * 1996-03-19 1998-12-22 Emc Corporation System for currently updating database by one host and reading the database by different host for the purpose of implementing decision support functions
US5845295A (en) * 1996-08-27 1998-12-01 Unisys Corporation System for providing instantaneous access to a snapshot Op data stored on a storage medium for offline analysis
US5937414A (en) * 1997-02-28 1999-08-10 Oracle Corporation Method and apparatus for providing database system replication in a mixed propagation environment
US6032158A (en) * 1997-05-02 2000-02-29 Informatica Corporation Apparatus and method for capturing and propagating changes from an operational database to data marts

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Replicating and Restoring Microsoft SQL Databases with VERITAS Storage Replicator 2.1", 4 March 2002, VERITAS, XP002290508 *
BRATSBERG S E ET AL: "PROVIDING A HIGHLY AVAILABLE DATABASE BY REPLICATION AND ONLINE SELF-REPAIR", INTELLIGENT SYSTEMS ENGINEERING, INSTITUTION OF ELECTRICAL ENGINEERS., STEVENAGE, GB, vol. 4, no. 3, September 1996 (1996-09-01), pages 131 - 139, XP001120321, ISSN: 0963-9640 *
JIM GRAY REUTER A: "Transaction processing: concepts and techniques", TRANSACTION PROCESSING: CONCEPTS AND TECHNIQUES, XX, XX, 1993, pages 493 - 525, XP002947548 *
LINDSAY B ET AL: "A snapshot differential refresh algorithm", SIGMOD RECORD, SIGMOD, NEW YORK, NY, US, vol. 15, no. 2, 28 May 1986 (1986-05-28), pages 53 - 60, XP002134864, ISSN: 0163-5808 *
LYON J: "Design considerations in replicated database systems for disaster protection", INTELLECTUAL LEVERAGE. SAN FRANCISCO, FEB. 29 - MAR. 4, 1988, COMPUTER SOCIETY INTERNATIONAL CONFERENCE. (COMPCON), WASHINGTON, IEEE COMP. SOC. PRESS, US, vol. CONF. 33, 29 February 1988 (1988-02-29), pages 428 - 430, XP010011545, ISBN: 0-8186-0828-5 *
S. BOBROWSKI ET AL.: "The Oracle8 Replication Manual, Part No. A58245-01, Chapters 1-2", December 1997, ORACLE, USA, XP002290509 *

Also Published As

Publication number Publication date
AU2003232061A1 (en) 2003-11-17
US20030208511A1 (en) 2003-11-06
WO2003094056A2 (en) 2003-11-13
EP1499973A2 (en) 2005-01-26
AU2003232061A8 (en) 2003-11-17

Similar Documents

Publication Publication Date Title
WO2003094056A3 (en) Database replication system
WO2006073847A3 (en) Systems and methods for dynamic data backup
WO2003096227A3 (en) Method and apparatus for change data capture in a database system
WO2000029998A3 (en) Optimization of change log handling
WO2005111788A3 (en) Moving real-time data events across devices in a network
WO2005111870A3 (en) Method and system for real-time event journaling to provide enterprise data services
WO2005015431A3 (en) System and method of relational database configuration mirroring
US20040199552A1 (en) Transactionally consistent change tracking for databases
WO1998009447A3 (en) Apparatus and method for tracking world wide web browser requests across distinct domains
CA2227432A1 (en) Transaction synchronization in a disconnectable computer and network
JP2005507122A5 (en)
CA2396261A1 (en) Method and system for fault tolerant media streaming over the internet
HK1065388A1 (en) Selective data replication system and method
WO2008124517A8 (en) Method and apparatus for media duplication
ATE443890T1 (en) METHOD FOR IMPROVING DUPLICATE SERVER PERFORMANCE AND DUPLICATE SERVER SYSTEM
ATE382904T1 (en) APPARATUS, SYSTEM AND METHOD FOR REINITIALIZING A SERIALIZATION OF FILE SYSTEMS
WO2006006875A3 (en) Method and system for correlating content with linear media
WO2007016040A3 (en) System and method for retrieving information from a supervisory control manufacturing /production database
WO2008058230A3 (en) Fast primary cluster recovery
AU2003221937A1 (en) System, method and apparatus for data processing and storage to provide continuous operations independent of device failure or disaster
WO2001084371A3 (en) System of and method for transparent management of data objects in containers across distributed heterogenous resources
HK1060414A1 (en) Network-based information management
WO2002075539A3 (en) Client-server model for synchronization of files
WO2005101186A3 (en) System, method and computer program product for extracting metadata faster than real-time
GB0112016D0 (en) Method system and program products for serialising replicated transactions of a distributed computing environment

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SK SL TJ TM TN TR TT TZ UA UG UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003747671

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003747671

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP

WWW Wipo information: withdrawn in national office

Ref document number: 2003747671

Country of ref document: EP

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)