Skip to Main content Skip to Navigation
Journal articles

A novel real-time scheduling algorithm and performance analysis of a MapReduce-based cloud

Abstract : MapReduce, a popular programming model for processing data-intensive tasks, has achieved great success in a wide range of applications such as search indexing, social network mining, collaborative recommendation, and spam detection. However, the ability of MapReduce is limited in two respects by its default schedulers. First, it does not support concurrent services sharing a cloud datacenter and second, it fails to guarantee response time for deadline-constrained services. This paper proposes the Paused Rate Monotonic (PRM) algorithm for scheduling hard real-time tasks on a MapReduce-based cloud. The scheduling performance is analyzed theoretically. We prove a bound on cluster utilization, which can be used as a sufficient condition to test whether a given task set can be scheduled. Both the theoretical analysis and experimental evaluation show that the PRM algorithm outperforms traditional real-time ones by improving the probability that a real-time task set can be scheduled on a MapReduce-based cloud.
Complete list of metadatas

https://hal-centralesupelec.archives-ouvertes.fr/hal-01708803
Contributor : Frédéric Magoulès <>
Submitted on : Wednesday, February 14, 2018 - 10:08:30 AM
Last modification on : Wednesday, April 8, 2020 - 4:06:46 PM

Identifiers

Collections

Citation

Fei Teng, Frédéric Magoulès, Lei Yu, Tianrui Li. A novel real-time scheduling algorithm and performance analysis of a MapReduce-based cloud. Journal of Supercomputing, Springer Verlag, 2014, 69 (2), pp.739 - 765. ⟨10.1007/s11227-014-1115-z⟩. ⟨hal-01708803⟩

Share

Metrics

Record views

205