BlobSeer: Towards efficient data storage management for large-scale, distributed systems - TEL - Thèses en ligne
Theses Year : 2010

BlobSeer: Towards efficient data storage management for large-scale, distributed systems

Bogdan Nicolae
  • Function : Author
  • PersonId : 867353

Abstract

With data volumes increasing at a high rate and the emergence of highly scalable infrastructures (cloud computing, petascale computing), distributed management of data becomes a crucial issue that faces many challenges. This thesis brings several contributions in order to address such challenges. First, it proposes a set of principles for designing highly scalable distributed storage systems that are optimized for heavy data access concurrency. In particular, it highlights the potentially large benefits of using versioning in this context. Second, based on these principles, it introduces a series of distributed data and metadata management algorithms that enable a high throughput under concurrency. Third, it shows how to efficiently implement these algorithms in practice, dealing with key issues such as high-performance parallel transfers, efficient maintainance of distributed data structures, fault tolerance, etc. These results are used to build BlobSeer, an experimental prototype that is used to demonstrate both the theoretical benefits of the approach in synthetic benchmarks, as well as the practical benefits in real-life, applicative scenarios: as a storage backend for MapReduce applications, as a storage backend for deployment and snapshotting of virtual machine images in clouds, as a quality-of-service enabled data storage service for cloud applications. Extensive experimentations on the Grid'5000 testbed show that BlobSeer remains scalable and sustains a high throughput even under heavy access concurrency, outperforming by a large margin several state-of-art approaches.
Fichier principal
Vignette du fichier
thesis.pdf (2.67 Mo) Télécharger le fichier
Loading...

Dates and versions

tel-00552271 , version 1 (05-01-2011)

Identifiers

  • HAL Id : tel-00552271 , version 1

Cite

Bogdan Nicolae. BlobSeer: Towards efficient data storage management for large-scale, distributed systems. Computer Science [cs]. Université Rennes 1, 2010. English. ⟨NNT : ⟩. ⟨tel-00552271⟩
1448 View
1704 Download

Share

More