CA2482891A1 - Enhancements to data integrity verification mechanism - Google Patents

Enhancements to data integrity verification mechanism Download PDF

Info

Publication number
CA2482891A1
CA2482891A1 CA002482891A CA2482891A CA2482891A1 CA 2482891 A1 CA2482891 A1 CA 2482891A1 CA 002482891 A CA002482891 A CA 002482891A CA 2482891 A CA2482891 A CA 2482891A CA 2482891 A1 CA2482891 A1 CA 2482891A1
Authority
CA
Canada
Prior art keywords
data
block
enhancements
data integrity
integrity verification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002482891A
Other languages
French (fr)
Other versions
CA2482891C (en
Inventor
Juan Loaiza
Wei Hu
Jingling Lee
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of CA2482891A1 publication Critical patent/CA2482891A1/en
Application granted granted Critical
Publication of CA2482891C publication Critical patent/CA2482891C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1004Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's to protect a block of data words, e.g. CRC or checksum
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0727Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a storage system, e.g. in a DASD or network based storage system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0751Error or fault detection not based on redundancy
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10Indexing scheme relating to G06F11/10
    • G06F2211/1002Indexing scheme relating to G06F11/1076
    • G06F2211/1007Addressing errors, i.e. silent errors in RAID, e.g. sector slipping and addressing errors
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • G11B20/18Error detection or correction; Testing, e.g. of drop-outs

Abstract

A method and apparatus is provided for maintaining data integrity. According to the method, a physical checksum calculation is performed on a block of data. After performing the physical checksum calculation, a logical check is performed on the data contained with the block of data. If the block of data passes the logical check, then the block of data may be written to nonvolatile memory. Thereafter, when the block of data is read from nonvolatile memory a physical checksum verification procedure is performed on the block of data to determine whether the block of data was corrupted after performing the logical check on the data contained with the block of data.
CA002482891A 2002-04-25 2003-03-21 Enhancements to data integrity verification mechanism Expired - Lifetime CA2482891C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/133,002 2002-04-25
US10/133,002 US7020835B2 (en) 2000-10-19 2002-04-25 Enhancements to data integrity verification mechanism
PCT/US2003/009063 WO2003091880A2 (en) 2002-04-25 2003-03-21 Enhancements to data integrity verification mechanism

Publications (2)

Publication Number Publication Date
CA2482891A1 true CA2482891A1 (en) 2003-11-06
CA2482891C CA2482891C (en) 2009-07-07

Family

ID=29268767

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002482891A Expired - Lifetime CA2482891C (en) 2002-04-25 2003-03-21 Enhancements to data integrity verification mechanism

Country Status (7)

Country Link
US (2) US7020835B2 (en)
EP (1) EP1497728A2 (en)
JP (1) JP2005524144A (en)
CN (1) CN1332311C (en)
AU (1) AU2003218378B2 (en)
CA (1) CA2482891C (en)
WO (1) WO2003091880A2 (en)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6928607B2 (en) * 2000-10-19 2005-08-09 Oracle International Corporation Data integrity verification mechanism
US20020188656A1 (en) * 2001-05-15 2002-12-12 Charles Patton Combining specialized, spatially distinguished, point to point communications with other wireless networking communications to provide networking configuration in classroom-like settings
JP4080227B2 (en) * 2002-03-28 2008-04-23 株式会社日立製作所 Data verification method and disk array device
US7302603B2 (en) * 2003-11-20 2007-11-27 International Business Machines Corporation Host-initiated data reconstruction for improved RAID read operations
US7353432B1 (en) * 2003-11-25 2008-04-01 Sun Microsystems, Inc. Maintaining high data integrity
FI20031856A0 (en) 2003-12-18 2003-12-18 Nokia Corp Procedure for ensuring the integrity of data registration
US7152138B2 (en) * 2004-01-30 2006-12-19 Hewlett-Packard Development Company, L.P. System on a chip having a non-volatile imperfect memory
US7082447B2 (en) * 2004-06-16 2006-07-25 Hitachi, Ltd. Method and apparatus for archive data validation in an archive system
US7526686B2 (en) * 2004-08-04 2009-04-28 International Business Machines Corporation Apparatus, system, and method for active data verification in a storage system
US20060155916A1 (en) * 2005-01-11 2006-07-13 Gilbert Carl L Writing uncorrupted data to electronic memory
US7627614B2 (en) * 2005-03-03 2009-12-01 Oracle International Corporation Lost write detection and repair
US7539908B2 (en) * 2005-05-17 2009-05-26 Pantech & Curitel Communications, Inc. Apparatus having function of checking error in copying or moving file and method thereof
US7454668B1 (en) * 2005-09-23 2008-11-18 Emc Corporation Techniques for data signature and protection against lost writes
US7716166B2 (en) * 2007-01-07 2010-05-11 Apple Inc. Method and apparatus for simplifying the decoding of data
JP4362134B2 (en) * 2007-02-09 2009-11-11 富士通株式会社 Data access method, channel adapter, data access control device, and data access program
JP2008225558A (en) * 2007-03-08 2008-09-25 Fujitsu Ltd Data-relay integrated circuit, data relay device, and data relay method
US8176405B2 (en) * 2007-09-24 2012-05-08 International Business Machines Corporation Data integrity validation in a computing environment
US20090240717A1 (en) * 2008-03-20 2009-09-24 Hitachi, Ltd. Method and apparatus for verifying archived data integrity in integrated storage systems
US9104662B2 (en) * 2008-08-08 2015-08-11 Oracle International Corporation Method and system for implementing parallel transformations of records
JP2010055210A (en) * 2008-08-26 2010-03-11 Hitachi Ltd Storage system and data guarantee method
US8468417B2 (en) * 2009-02-18 2013-06-18 Micron Technology, Inc. Data integrity in memory controllers and methods
CN101990208B (en) * 2009-07-31 2013-05-15 中国移动通信集团公司 Automatic data checking method, system and equipment
US8095656B2 (en) * 2009-11-16 2012-01-10 International Business Machines Corportion Geo-positionally based data access security
US8335951B2 (en) 2010-05-06 2012-12-18 Utc Fire & Security Americas Corporation, Inc. Methods and system for verifying memory device integrity
US8370689B2 (en) * 2010-05-06 2013-02-05 Utc Fire & Security Americas Corporation, Inc. Methods and system for verifying memory device integrity
US8589761B2 (en) * 2011-05-31 2013-11-19 Micron Technology, Inc. Apparatus and methods for providing data integrity
CN103825649A (en) * 2012-11-16 2014-05-28 华为技术有限公司 Optical module information restoration method and apparatus
CN104035833A (en) * 2013-03-07 2014-09-10 联发科技股份有限公司 Method And System For Verifying Machine Readable Code Integrity
US10152500B2 (en) 2013-03-14 2018-12-11 Oracle International Corporation Read mostly instances
JP6136834B2 (en) * 2013-10-07 2017-05-31 富士通株式会社 Storage control device, control program, and control method
US9767178B2 (en) 2013-10-30 2017-09-19 Oracle International Corporation Multi-instance redo apply
US9892153B2 (en) 2014-12-19 2018-02-13 Oracle International Corporation Detecting lost writes
US10449811B2 (en) 2015-06-15 2019-10-22 Infineon Technologies Ag Tire monitoring system and method
US9767318B1 (en) * 2015-08-28 2017-09-19 Frank Dropps Secure controller systems and associated methods thereof
US11657037B2 (en) 2015-10-23 2023-05-23 Oracle International Corporation Query execution against an in-memory standby database
US10747752B2 (en) 2015-10-23 2020-08-18 Oracle International Corporation Space management for transactional consistency of in-memory objects on a standby database
US10105189B2 (en) * 2015-11-10 2018-10-23 Mako Surgical Corp. Techniques for correcting an error in a nonvolatile memory of an embedded component for an end effector in a robotic surgical system
US10733045B2 (en) * 2016-07-14 2020-08-04 Microsoft Technology Licensing, Llc Online repair of metadata for structured data including file systems
US10698771B2 (en) 2016-09-15 2020-06-30 Oracle International Corporation Zero-data-loss with asynchronous redo shipping to a standby database
CN106648969B (en) * 2016-10-26 2020-09-18 苏州浪潮智能科技有限公司 Method and system for inspecting damaged data in disk
US10891291B2 (en) 2016-10-31 2021-01-12 Oracle International Corporation Facilitating operations on pluggable databases using separate logical timestamp services
US11475006B2 (en) 2016-12-02 2022-10-18 Oracle International Corporation Query and change propagation scheduling for heterogeneous database systems
US10691722B2 (en) 2017-05-31 2020-06-23 Oracle International Corporation Consistent query execution for big data analytics in a hybrid database
US10521617B2 (en) * 2017-08-14 2019-12-31 Western Digital Technologies, Inc. Non-volatile memory device with secure read
DE102017124313B4 (en) * 2017-10-18 2021-03-18 Infineon Technologies Ag MEMORY ARRANGEMENT AND METHOD FOR VERIFYING MEMORY ACCESS
JP6824929B2 (en) * 2018-06-07 2021-02-03 株式会社日立製作所 Memory control system and memory control method
US10951236B2 (en) * 2018-10-30 2021-03-16 Microsoft Technology Licensing, Llc Hierarchical data integrity verification of erasure coded data in a distributed computing system
US11068351B2 (en) * 2018-11-19 2021-07-20 International Business Machines Corporation Data consistency when switching from primary to backup data storage
US10891184B2 (en) * 2019-05-22 2021-01-12 Macronix International Co., Ltd. Configurable data integrity mode, and memory device including same
CN112749039A (en) * 2019-10-31 2021-05-04 伊姆西Ip控股有限责任公司 Method, apparatus and program product for data writing and data recovery
FR3103073B1 (en) * 2019-11-12 2021-12-03 Thales Sa MULTIMEDIA SERVER INTENDED TO BE ON BOARD AN AIRCRAFT, ELECTRONIC ENTERTAINMENT SYSTEM INCLUDING SUCH SERVER, SOFTWARE CONFIGURATION PROCESS FOR SUCH SERVER AND ASSOCIATED COMPUTER PROGRAM
CN111078662B (en) * 2019-11-22 2023-01-06 苏州浪潮智能科技有限公司 Block chain data storage method and device
CN111522686B (en) * 2020-03-27 2023-11-10 北京经纬恒润科技股份有限公司 Nonvolatile data reading and writing method and device

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5146571A (en) 1988-03-28 1992-09-08 Emc Corporation Remapping defects in a storage system through the use of a tree structure
US5233618A (en) 1990-03-02 1993-08-03 Micro Technology, Inc. Data correcting applicable to redundant arrays of independent disks
US5182752A (en) 1990-06-29 1993-01-26 Digital Equipment Corporation Method and apparatus for transferring data between a data bus and a data storage device
US5289478A (en) 1991-03-11 1994-02-22 Fujitsu Limited Method and means for verification of write data
JP2855019B2 (en) 1992-02-10 1999-02-10 富士通株式会社 External storage device data guarantee method and external storage device
US5696775A (en) 1994-09-23 1997-12-09 Cirrus Logic, Inc. Method and apparatus for detecting the transfer of a wrong sector
US5805799A (en) 1995-12-01 1998-09-08 Quantum Corporation Data integrity and cross-check code with logical block address
US5893930A (en) * 1996-07-12 1999-04-13 International Business Machines Corporation Predictive translation of a data address utilizing sets of associative entries stored consecutively in a translation lookaside buffer
FR2754926B1 (en) 1996-10-23 1998-11-20 Schlumberger Ind Sa METHOD FOR MANAGING DATA INTEGRITY FAULTS IN A REWRITE MEMORY
US6094708A (en) * 1997-05-06 2000-07-25 Cisco Technology, Inc. Secondary cache write-through blocking mechanism
US6237124B1 (en) * 1998-03-16 2001-05-22 Actel Corporation Methods for errors checking the configuration SRAM and user assignable SRAM data in a field programmable gate array
US6009542A (en) 1998-03-31 1999-12-28 Quantum Corporation Method for preventing transfer of data to corrupt addresses
US6098190A (en) 1998-08-04 2000-08-01 Hewlett-Packard Co. Method and apparatus for use of a host address to validate accessed data
US6446234B1 (en) 1999-03-16 2002-09-03 International Business Machines Corporation Method and apparatus for updating cyclic redundancy check information for data storage
US6438724B1 (en) 1999-03-16 2002-08-20 International Business Machines Corporation Method and apparatus for deterministically altering cyclic redundancy check information for data storage
US6928607B2 (en) 2000-10-19 2005-08-09 Oracle International Corporation Data integrity verification mechanism
US7627614B2 (en) * 2005-03-03 2009-12-01 Oracle International Corporation Lost write detection and repair

Also Published As

Publication number Publication date
JP2005524144A (en) 2005-08-11
US20030140288A1 (en) 2003-07-24
AU2003218378B2 (en) 2007-06-07
US7246281B2 (en) 2007-07-17
WO2003091880A2 (en) 2003-11-06
CN1332311C (en) 2007-08-15
CA2482891C (en) 2009-07-07
EP1497728A2 (en) 2005-01-19
US20060242513A1 (en) 2006-10-26
CN1650267A (en) 2005-08-03
AU2003218378A1 (en) 2003-11-10
WO2003091880A3 (en) 2004-04-08
US7020835B2 (en) 2006-03-28

Similar Documents

Publication Publication Date Title
CA2482891A1 (en) Enhancements to data integrity verification mechanism
CA2424988A1 (en) Data integrity verification mechanism
ATE306099T1 (en) METHOD FOR DETECTING MALICIAL COMPUTER CODE
WO2006007264A3 (en) Simultaneous external read operation during internal programming in a flash memory device
WO2003010671A1 (en) Non-volatile memory and non-volatile memory data rewriting method
WO2002014997A3 (en) Apparatus and method for writing and reading data to and from a virtual volume of redundant storage devices
EP1256881A3 (en) Method and apparatus for write protecting a gaming storage medium
WO2006052321A3 (en) System and method of reading non-volatile computer memory
WO2004059894A3 (en) Method and device for compressed-domain packet loss concealment
EP1416386A3 (en) Method and apparatus for effectively enabling an out of sequence write process within a non-volatile memory system
WO2003094004A3 (en) Method and system to retrieve information from a storage device
WO2004059651A3 (en) Nonvolatile memory unit with specific cache
EP2031492A4 (en) Data storage device and data storage method
AU2003272756A1 (en) An apparatus and method for facilitating memory data access with generic read/write patterns
EP1522927A3 (en) File storage apparatus capable of restoring file management information
AU2003292553A1 (en) Data file storage device, data file storage program and data file storage method
TW200707189A (en) Memory block erasing in a flash memory device
AU2003277571A1 (en) Information processing device and method, program storage medium, recording medium, and program
WO2007078645A3 (en) Method and apparatus for cloning filesystems across computing systems
WO2007054252A3 (en) Reconfigurable system with corruption detection and recovery
EP0381885A3 (en) Method for identifying bad data
SG123577A1 (en) Servo information write method, servo control method, data storage device, and program
WO2004061585A3 (en) Method and apparatus for patching code and data residing on a memory
WO2003001380A3 (en) Method and apparatus for preservation of failure state in a read destructive memory
TW200700987A (en) Method and apparatus for performing multi-programmable function with one-time programmable memories

Legal Events

Date Code Title Description
EEER Examination request
MKEX Expiry

Effective date: 20230321