Optimizing Distributed In-memory Storage Systems: Fault-tolerance, Performance, Energy Efficiency

Yacine Taleb 1
1 KerData - Scalable Storage for Clouds and Beyond
Inria Rennes – Bretagne Atlantique , IRISA_D1 - SYSTÈMES LARGE ÉCHELLE
Abstract : Emerging technologies such as connected devices and social networking applications are shaping the way we live, work, and interact with each other. These technologies generate increasingly high volumes of data. Dealing with large volumes of data has been an important focus in the last decade, however, today the challenge has shifted from data volume to velocity: How to store, process, and extract value from data generated With the growing capacity of DRAM, service providers largely rely on DRAM- based storage systemsto serve their workloads. Because DRAM is volatile, usually, distributed in- memory storage systems rely on expensive durability mechanisms to persist data. This creates trade-offs between performance, durability and efficiency in in-memory storage systems We first study these trade-offs by means of experimental study. We extract the main factors that impact performance and efficiency in in-memory storage systems. Then, we design and implement a new RDMA-based replication mechanism that greatly improves replication efficiency in in-memory storage systems. Finally, we leverage our techniques and apply them to stream storage systems. We design and implement high- performance replication mechanisms for stream storage, while guaranteeing linearizability and durability.
Complete list of metadatas

https://hal.inria.fr/tel-01891897
Contributor : Yacine Taleb <>
Submitted on : Wednesday, October 10, 2018 - 10:32:56 AM
Last modification on : Monday, January 7, 2019 - 3:51:22 PM
Long-term archiving on : Friday, January 11, 2019 - 12:50:13 PM

File

Thesis_Yacine_Final.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-01891897, version 1

Citation

Yacine Taleb. Optimizing Distributed In-memory Storage Systems: Fault-tolerance, Performance, Energy Efficiency. Computer Science [cs]. ENS Rennes, 2018. English. ⟨tel-01891897v1⟩

Share

Metrics

Record views

117

Files downloads

86