WO2009070235A3 - Parallel reed-solomon raid (rs-raid) architecture, device, and method - Google Patents

Parallel reed-solomon raid (rs-raid) architecture, device, and method Download PDF

Info

Publication number
WO2009070235A3
WO2009070235A3 PCT/US2008/012944 US2008012944W WO2009070235A3 WO 2009070235 A3 WO2009070235 A3 WO 2009070235A3 US 2008012944 W US2008012944 W US 2008012944W WO 2009070235 A3 WO2009070235 A3 WO 2009070235A3
Authority
WO
WIPO (PCT)
Prior art keywords
raid
data storage
architecture
parallel
solomon
Prior art date
Application number
PCT/US2008/012944
Other languages
French (fr)
Other versions
WO2009070235A2 (en
Inventor
Arvind Pruthi
Original Assignee
Marvell World Trade Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Marvell World Trade Ltd. filed Critical Marvell World Trade Ltd.
Priority to JP2010534958A priority Critical patent/JP5298393B2/en
Priority to EP08854634.6A priority patent/EP2212796B1/en
Priority to EP13000066.4A priority patent/EP2605140B1/en
Publication of WO2009070235A2 publication Critical patent/WO2009070235A2/en
Publication of WO2009070235A3 publication Critical patent/WO2009070235A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1028—Distributed, i.e. distributed RAID systems with parity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1054—Parity-fast hardware, i.e. dedicated fast hardware for RAID systems with parity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2211/00—Indexing scheme relating to details of data-processing equipment not covered by groups G06F3/00 - G06F13/00
    • G06F2211/10—Indexing scheme relating to G06F11/10
    • G06F2211/1002—Indexing scheme relating to G06F11/1076
    • G06F2211/1057—Parity-multiple bits-RAID6, i.e. RAID 6 implementations

Abstract

The parallel RS-RAID data storage architecture can aggregate that data and checksums within each cluster into intermediate or partial sums that are transferred or distributed to other clusters. The use of intermediate data symbols, intermediate checksum symbols, cluster configuration information on the assignment of data storage devices to clusters and the operational status of data storage devices, and the like, can reduce the computational burden and latency for the error correction calculations while increasing the scalability and throughput of the parallel RS- RAID distributed data storage architecture.
PCT/US2008/012944 2007-11-21 2008-11-20 Parallel reed-solomon raid (rs-raid) architecture, device, and method WO2009070235A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2010534958A JP5298393B2 (en) 2007-11-21 2008-11-20 Parallel Reed-Solomon RAID (RS-RAID) architecture, device, and method
EP08854634.6A EP2212796B1 (en) 2007-11-21 2008-11-20 Parallel reed-solomon raid (rs-raid) architecture, device, and method
EP13000066.4A EP2605140B1 (en) 2007-11-21 2008-11-20 Parallel Reed-Solomon RAID (RS-RAID) Architecture, Device, and Method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US98967007P 2007-11-21 2007-11-21
US60/989,670 2007-11-21

Publications (2)

Publication Number Publication Date
WO2009070235A2 WO2009070235A2 (en) 2009-06-04
WO2009070235A3 true WO2009070235A3 (en) 2010-03-25

Family

ID=40643226

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/012944 WO2009070235A2 (en) 2007-11-21 2008-11-20 Parallel reed-solomon raid (rs-raid) architecture, device, and method

Country Status (5)

Country Link
US (3) US8219887B2 (en)
EP (2) EP2605140B1 (en)
JP (1) JP5298393B2 (en)
KR (1) KR101543369B1 (en)
WO (1) WO2009070235A2 (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8259836B2 (en) * 2006-12-04 2012-09-04 Samsung Electronics Co., Ltd. Method and system for generating candidate beamforming coefficients for transmission of data over a wireless medium
US8265177B2 (en) * 2006-12-04 2012-09-11 Samsung Electronics Co., Ltd. System and method for wireless communication of uncompressed high definition video data using beambook-constructed beamforming signals
US8040856B2 (en) * 2006-12-04 2011-10-18 Samsung Electronics Co., Ltd. System and method for wireless communication of uncompressed high definition video data using a beamforming acquisition protocol
US20080130778A1 (en) * 2006-12-04 2008-06-05 Samsung Electronics Co., Ltd. System and method for wireless communication of uncompressed high definition video data using a transfer matrix for beamforming estimation
US20090046798A1 (en) * 2007-08-13 2009-02-19 Samsung Electronics Co., Ltd. System and method for acquiring a training matrix for a breamforming acquisition protocol using a butson matrix
US9311184B2 (en) * 2010-02-27 2016-04-12 Cleversafe, Inc. Storing raid data as encoded data slices in a dispersed storage network
US9135115B2 (en) * 2010-02-27 2015-09-15 Cleversafe, Inc. Storing data in multiple formats including a dispersed storage format
US9009569B2 (en) * 2010-10-18 2015-04-14 Xyratex Technology Limited Detection and correction of silent data corruption
US8667326B2 (en) 2011-05-23 2014-03-04 International Business Machines Corporation Dual hard disk drive system and method for dropped write detection and recovery
US8914706B2 (en) 2011-12-30 2014-12-16 Streamscale, Inc. Using parity data for concurrent data authentication, correction, compression, and encryption
US8683296B2 (en) 2011-12-30 2014-03-25 Streamscale, Inc. Accelerated erasure coding system and method
WO2014002178A1 (en) * 2012-06-26 2014-01-03 東芝三菱電機産業システム株式会社 Data collection device and data collection program
KR101447419B1 (en) * 2012-06-26 2014-10-06 도시바 미쓰비시덴키 산교시스템 가부시키가이샤 Data collection system and data collection system program recording medium recorded
US9047220B2 (en) * 2012-07-23 2015-06-02 Hitachi, Ltd. Storage system and data management method
US10651975B2 (en) 2012-08-02 2020-05-12 Pure Storage, Inc. Forwarding data amongst cooperative DSTN processing units of a massive data ingestion system
US9258177B2 (en) 2012-08-02 2016-02-09 International Business Machines Corporation Storing a data stream in a set of storage devices
US9613656B2 (en) 2012-09-04 2017-04-04 Seagate Technology Llc Scalable storage protection
RU2502124C1 (en) * 2012-09-12 2013-12-20 Общество с ограниченной ответственностью "РЭЙДИКС" Method of recovering records in storage device and system for realising said method
WO2014140676A1 (en) * 2013-03-15 2014-09-18 Emc Corporation Load balancing on disks in raid based on linear block codes
US9459957B2 (en) 2013-06-25 2016-10-04 Mellanox Technologies Ltd. Offloading node CPU in distributed redundant storage systems
US9594634B2 (en) * 2014-06-02 2017-03-14 Intel Corporation Techniques to efficiently compute erasure codes having positive and negative coefficient exponents to permit data recovery from more than two failed storage units
CN104156283B (en) * 2014-08-27 2017-08-25 华为技术有限公司 Data reconstruction method, device and storage system
US9710320B2 (en) 2015-03-23 2017-07-18 Microsoft Technology Licensing, Llc Data processing validation
US10705909B2 (en) * 2015-06-25 2020-07-07 International Business Machines Corporation File level defined de-clustered redundant array of independent storage devices solution
KR102549605B1 (en) * 2016-03-04 2023-06-30 삼성전자주식회사 Recovering method of raid storage device
EP3849089A1 (en) 2020-01-09 2021-07-14 Microsoft Technology Licensing, LLC Encoding for data recovery in storage systems
RU2758943C1 (en) * 2020-12-07 2021-11-03 федеральное государственное казенное военное образовательное учреждение высшего образования "Краснодарское высшее военное орденов Жукова и Октябрьской Революции Краснознаменное училище имени генерала армии С.М. Штеменко" Министерства обороны Российской Федерации Method for distributed data storage with proven integrity

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0297507A2 (en) * 1987-07-02 1989-01-04 International Business Machines Corporation Memory unit backup using checksum
US20070245173A1 (en) * 2006-03-21 2007-10-18 International Business Machines Corporation Enclosure-based raid parity assist

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889934A (en) * 1997-02-24 1999-03-30 Data General Corporation Data validation system for a group of data storage disks
US6952797B1 (en) * 2000-10-25 2005-10-04 Andy Kahn Block-appended checksums
US6742081B2 (en) * 2001-04-30 2004-05-25 Sun Microsystems, Inc. Data storage array employing block checksums and dynamic striping
JP2003131818A (en) * 2001-10-25 2003-05-09 Hitachi Ltd Configuration of raid among clusters in cluster configuring storage
US6751136B2 (en) * 2002-06-17 2004-06-15 Lsi Logic Corporation Drive failure recovery via capacity reconfiguration
US7219289B2 (en) * 2005-03-15 2007-05-15 Tandberg Data Corporation Multiply redundant raid system and XOR-efficient method and apparatus for implementing the same
US8370715B2 (en) * 2007-04-12 2013-02-05 International Business Machines Corporation Error checking addressable blocks in storage

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0297507A2 (en) * 1987-07-02 1989-01-04 International Business Machines Corporation Memory unit backup using checksum
US20070245173A1 (en) * 2006-03-21 2007-10-18 International Business Machines Corporation Enclosure-based raid parity assist

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PLANK J S: "A TUTORIAL ON REED-SOLOMON CODING FOR FAULT-TOLERANCE IN RAID-LIKE SYSTEMS", SOFTWARE PRACTICE & EXPERIENCE, WILEY & SONS, BOGNOR REGIS, GB, vol. 27, no. 9, 1 September 1997 (1997-09-01), pages 995 - 1012, XP000695944, ISSN: 0038-0644 *

Also Published As

Publication number Publication date
KR20100095525A (en) 2010-08-31
EP2212796A2 (en) 2010-08-04
WO2009070235A2 (en) 2009-06-04
EP2605140A1 (en) 2013-06-19
EP2605140B1 (en) 2020-08-26
US8645798B2 (en) 2014-02-04
US20120266049A1 (en) 2012-10-18
US20090132851A1 (en) 2009-05-21
JP5298393B2 (en) 2013-09-25
EP2212796B1 (en) 2019-02-27
US20130138881A1 (en) 2013-05-30
US8219887B2 (en) 2012-07-10
KR101543369B1 (en) 2015-08-11
JP2011504269A (en) 2011-02-03
US8359524B2 (en) 2013-01-22

Similar Documents

Publication Publication Date Title
WO2009070235A3 (en) Parallel reed-solomon raid (rs-raid) architecture, device, and method
DE602005007355D1 (en) R ERROR TOLERANT RAID GROUP
WO2010005661A3 (en) Efficient in-band reliability with separate cyclic redundancy code frames
TW200644446A (en) Convolution-encoded data storage on a redundant array of independent devices
EP1808020A4 (en) System for providing in-flight entertainment with data redundancy
EP1883865A4 (en) Symmetric multiprocessor fault tolerant computer system
TWI350108B (en) Redundant data encoding methods and device
WO2011159806A3 (en) Apparatus, system, and method for providing error correction
EP3682342A4 (en) Shared blockchain data storage based on error correction coding in trusted execution environments
DE502005004657D1 (en) REDUNDANT DATA SYSTEM
WO2009112332A3 (en) Selecting a deduplication protocol for a data storage library
EP2300913A4 (en) Methods and systems for developing, debugging, and executing data integration applications
WO2013075125A3 (en) Systems, methods, and devices for multi-tiered error correction
GB2490400B (en) Read-other protocol for maintaining parity coherency in a write-back distributed redundancy data storage system
EP1866774A4 (en) Method for storing data with reduced redundancy using data clusters
EP1881439A4 (en) Data backup system
EP1877901A4 (en) Fault tolerant computer system
WO2009074979A3 (en) Chien-search system employing a clock-gating scheme to save power for error correction decoder and other applications
EP1751660A4 (en) Scalable, software based quorum architecture
WO2009032898A3 (en) Compact input device
WO2007141534A3 (en) Document automation systems
EP2115562A4 (en) High performance raid-6 system architecture with pattern matching
JP2007272895A5 (en)
WO2010107176A3 (en) Apparatus and method for managing a dram buffer
GB2449348B (en) Improving latency by offsetting cyclic redundancy code lanes from data lanes

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08854634

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 20107010285

Country of ref document: KR

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2010534958

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2008854634

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE