Highly reliable data layout schemes for very large scale storage systems

Dongjian Luo; Haifeng Zhong; Wei Wu

doi:10.1117/12.845964

23 October 2009 Highly reliable data layout schemes for very large scale storage systems

Dongjian Luo, Haifeng Zhong, Wei Wu

Proceedings Volume 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies; 75170T (2009) https://doi.org/10.1117/12.845964
Event: Photonics and Optoelectronics Meetings 2009, 2009, Wuhan, China

Abstract

In this paper, we investigate data layout schemes and their impact on system reliability in a petabyte scale storage system built from thousands of Object-Based Storage Devices. We delve in two underlying data layout schemes: RAID 5 and RAID 5 mirroring. To accelerate data reconstruction, Fast Mirroring Copy is employed where the reconstructed objects are stored on different OBSDs throughout the system. In order to improve the system reliability, SMART Reliability Mechanism (SRM) is introduced for enhancing the reliability in very large-scale storage system. Analysis results show that they can be used to assure the reliability of data storage and efficiently utilize the disk resource while exert minimum impact on the whole systems performance.

Citation Download Citation

Dongjian Luo, Haifeng Zhong, and Wei Wu "Highly reliable data layout schemes for very large scale storage systems", Proc. SPIE 7517, Photonics and Optoelectronics Meetings (POEM) 2009: Optical Storage and New Storage Technologies, 75170T (23 October 2009); https://doi.org/10.1117/12.845964

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available