Impact of Asynchronism on GPU Accelerated Parallel Iterative Computations

Sylvain Contassot-Vivier (1) , Thomas Jost (1) , Stéphane Vialle (1, 2, 3)

1 ALGORILLE - Algorithms for the Grid
2 SUPELEC-Campus Metz
3 Georgia Tech Lorraine [Metz]

We study the impact of asynchronism on parallel iterative algorithms in the particular context of local clusters of workstations including GPUs. The application test is a classical PDE problem of advection-diffusion-reaction in 3D. We propose an asynchronous version of a previously developed PDE solver using GPUs for the inner computations. The algorithm is tested with two kinds of clusters, a homogeneous one and a heterogeneous one (with different CPUs and GPUs).

Domains: Computer Science [cs]; Distributed, Parallel, and Cluster Computing [cs.DC]

Sylvain Contassot-Vivier, Thomas Jost, Stéphane Vialle. Impact of Asynchronism on GPU Accelerated Parallel Iterative Computations. PARA 2010 - 10th International Conference on Applied Parallel and Scientific Computing, Jun 2010, Reykjavík, Iceland. pp.43-53, ⟨10.1007/978-3-642-28151-8_5⟩. ⟨hal-00685153⟩