Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Liquid Cloud Storage

Liquid Cloud Storage A liquid system provides durable object storage based on spreading redundantly generated data across a network of hundreds to thousands of potentially unreliable storage nodes. A liquid system uses a combination of a large code, lazy repair, and flow storage organization. We show that a liquid system can be operated to enable flexible and essentially optimal combinations of storage durability, storage overhead, repair bandwidth usage, and access performance. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Storage (TOS) Association for Computing Machinery

Liquid Cloud Storage

Download PDF
49 pages

Loading next page...
 
/lp/association-for-computing-machinery/liquid-cloud-storage-yxayCEIDuy
Publisher
Association for Computing Machinery
Copyright
Copyright © 2019 ACM
ISSN
1553-3077
eISSN
1553-3093
DOI
10.1145/3281276
Publisher site
See Article on Publisher Site

Abstract

A liquid system provides durable object storage based on spreading redundantly generated data across a network of hundreds to thousands of potentially unreliable storage nodes. A liquid system uses a combination of a large code, lazy repair, and flow storage organization. We show that a liquid system can be operated to enable flexible and essentially optimal combinations of storage durability, storage overhead, repair bandwidth usage, and access performance.

Journal

ACM Transactions on Storage (TOS) – Association for Computing Machinery

Published: Feb 18, 2019

Keywords: Distributed information systems

References

  • Hard Drive Data and Stats
    Backblaze,
  • Hypertext Transfer Protocol Version 2 (HTTP/2), RFC 7540
    Belshe, M.; Peon, R.; (Eds, M. Thomson
  • Total recall: System support for automated availability management
    Bhagwan, R.; Tati, K.; Cheng, Y.-C.; Savage, S.; Voelker, G. M.
  • An XOR-based erasure-resilient coding scheme
    Bloemer, J.; Kalfane, M.; Karpinski, M.; Karp, R.; Luby, M.; Zuckerman, D.
  • Windows azure storage: A highly available cloud storage service with strong consistency
    Calder, B.; Wang, J.; Ogus, A.; Nilakantan, N.; Skjolsvold, A.; McKelvie, S.; Xu, Y.; Srivastav, S.; Wu, J.; Simitci, H.; Haridas, J.; Uddaraju, C.; Khatri, H.; Edwards, A.; Bedekar, V.; Mainali, S.; Abbasi, R.; Agarwal, A.; Haq, M. Fahim ul; Haq, M. Ikram ul; Bhardwaj, D.; Dayanand, S.; Adusumilli, A.; McNett, M.; Sankaran, S.; Manivannan, K.; Rigas, L.
  • Understanding TCP incast and its implications for big data workloads
    Chen, Y.; Griffith, R.; Zats, D.; Joseph, A. D.; Katz, R.
  • Giza: Erasure coding objects across global data centers
    Chen, Y. L.; Mu, S.; Li, J.; Huang, C.; Li, J.; Ogus, A.; Phillips, D.
  • Copysets: Reducing the frequency of data loss in cloud storage
    Cidon, A.; Rumble, S. M.; Stutsman, R.; Katti, S.; Ousterhout, J.; Rosenblum, M.
  • Dropbox's Exabyte Storage System
    Cowling, J.
  • Online Wiki Bibliography for Distributed Storage Papers
    Dimakis, A.
  • Network coding for distributed storage systems
    Dimakis, A.; Godfrey, P.; Wu, Y.; Wainwright, M.; Ramchandran, K.
  • Network coding for distributed storage systems
    Dimakis, A.; Godfrey, P.; Wu, Y.; Wainwright, M.; Ramchandran, K.
  • A scalable, high-performance distributed file system
    Weil, Sage A.; Brandt, Scott A.; Miller, Ethan L.; Long, Darrell D. E.; Maltzahn, Carlos
  • Availability in globally distributed storage systems
    Ford, D.; Labelle, F.; Popovici, F.; Stokely, M.; Truong, V.; Barroso, L.; Grimes, C.; Quinlan, S.
  • Snappy: A fast Compressor/Decompressor
    Google,
  • On the locality of codeword symbols
    Gopalan, P.; Huang, C.; Simitci, H.; Yekhanin, S.
  • Erasure coding in windows azure storage
    Huang, C.; Simitci, H.; Xu, Y.; Ogus, A.; Calder, B.; Gopalan, P.; Li, J.; Yekhanin, S.
  • Coding for fast content download
    Joshi, G.; Liu, Y.; Soljanin, E.
  • Reed-Solomon Forward Error Correction (FEC) Schemes, RFC 5510
    Lacan, J.; Roca, V.; Peltotalo, J.; Peltotalo, S.
  • Repair pipelining for erasure-coded storage
    Li, R.; Li, X.; Lee, P. P. C.; Huang, Q.
  • Capacity bounds for distributed storage
    Luby, M.
  • RaptorQ Forward Error Correction Scheme for Object Delivery, RFC 6330
    Luby, M.; Shokrollahi, A.; Watson, M.; Stockhammer, T.; Minder, L.
  • Facebook’s warm BLOB storage system
    Muralidhar, S.; Lloyd, W.; Roy, S.; Hill, C.; Lin, E.; Liu, W.; Pan, S.; Shankar, S.; Sivakumar, V.; Tang, L.; Kumar, S.
  • Having your cake and eating it too: Jointly optimal erasure codes for I/O, storage, and network-bandwidth
    Rashmi, K. V.; Nakkiran, P.; Wang, J.; Shah, N. B.; Ramchandran, K.
  • A “Hitchhiker’s” guide to fast and efficient data reconstruction in erasure-coded data centers
    Rashmi, K. V.; Shah, N. B.; Gu, D.; Kuang, H.; Borthakur, D.; Ramchandran, K.
  • A Remote Direct Memory Access Protocol Specification, RFC 5040
    Recio, R.; Metzler, B.; Culley, P.; Hilland, J.; Garcia, D.
  • Effective erasure codes for reliable computer communication protocols
    Rizzo, L.
  • High availability in DHTs: Erasure coding vs
    Rodrigues, R.; Liskov, B.
  • SM863a Specification Sheet
    Samsung,
  • XORing elephants: Novel erasure codes for big data
    Sathiamoorty, M.; Asteris, M.; Papailiopoulos, D.; Dimakis, A.; Vadali, R.; Chen, S.; Borthakur, D.
  • Raptor codes
    Shokrollahi, A.; Luby, M.
  • Lazy means smart: Reducing repair bandwidth costs in erasure-coded distributed storage
    Silberstein, M.; Ganesh, L.; Wang, Y.; Alvisi, M. Dahlin L.
  • Proactive replication for data durability
    Sit, E.; Haeberlen, A.; Dabek, F.; Chun, B.; Weatherspoon, H.; Morris, R.; Kaashoek, M.; Kubiatowicz, J.
  • Erasure coding vs
    Weatherspoon, H.; Kubiatowicz, J.