H. Akaike, On a successive transformation of probability distribution and its application to the analysis of the optimum gradient method, Annals of the Institute of Statistical Mathematics, vol.11, issue.1, pp.1-16, 1959.

J. Barzilai and J. M. Borwein, Two-point step size gradient methods, IMA Journal of Numerical Analysis, vol.8, issue.1, pp.141-148, 1988.

A. L. Cauchy, Méthode générale pour la résolution des systèmes d'équations simultanées, Comp. Rend. Sci. Paris, vol.25, issue.1, pp.536-538, 1847.

Y. Dai, Alternate step gradient method, Optimization, vol.52, issue.4-5, pp.395-415, 2003.

Y. Dai and Y. Yuan, Alternate minimization gradient method, IMA Journal of Numerical Analysis, vol.23, issue.3, pp.377-393, 2003.

Y. Dai and Y. Yuan, Analysis of monotone gradient methods, Journal of Industrial and Management Optimization, vol.1, issue.2, pp.181-192, 2005.

T. A. Davis and Y. Hu, The University of Florida sparse matrix collection, ACM Transactions on Mathematical Software, vol.38, issue.1, 2011.

R. De-asmundis, D. Di-serafino, F. Riccio, and G. Toraldo, On spectral properties of steepest descent methods, IMA Journal of Numerical Analysis, vol.33, issue.4, pp.1416-1435, 2013.

R. Fletcher, On the Barzilai-Borwein method, Optimization and Control with Applications, pp.235-256, 2005.

A. Friedlander, J. M. Martínez, B. Molina, and M. Raydan, Gradient method with retards and generalizations, SIAM Journal on Numerical Analysis, vol.36, issue.1, pp.275-289, 1999.

M. R. Hestenes and E. Stiefel, Methods of conjugate gradients for solving linear systems, Journal of Research of the National Bureau of Standards, vol.49, issue.6, pp.409-436, 1952.

F. Magoulès and A. Ahamed, Alinea: An advanced linear algebra library for massively parallel computations on graphics processing units, The International Journal of High Performance Computing Applications, vol.29, issue.3, pp.284-310, 2015.

F. Magoulès and G. Gbikpi-benissan, JACK: an asynchronous communication kernel library for iterative algorithms, The Journal of Supercomputing, vol.73, issue.8, pp.3468-3487, 2017.

F. Magoulès and G. Gbikpi-benissan, Distributed convergence detection based on global residual error under asynchronous iterations, IEEE Transactions on Parallel and Distributed Systems, vol.29, issue.4, pp.819-829, 2018.

F. Magoulès and G. Gbikpi-benissan, JACK2: An MPI-based communication library with non-blocking synchronization for asynchronous iterations, Advances in Engineering Software, vol.119, pp.116-133, 2018.

F. Magoulès, G. Gbikpi-benissan, and Q. Zou, Asynchronous iterations of Parareal algorithm for option pricing models, Mathematics, vol.6, issue.4, pp.1-18, 2018.

F. Magoulès, D. B. Szyld, and C. Venet, Numerische Mathematik, vol.137, issue.1, pp.199-227, 2017.

F. Magoulès and C. Venet, Asynchronous iterative sub-structuring methods. Mathematics and Computers in Simulation, vol.145, pp.34-49, 2018.

M. Raydan, On the Barzilai and Borwein choice of steplength for the gradient method, IMA Journal of Numerical Analysis, vol.13, issue.3, pp.321-326, 1993.

Y. Yuan, A new stepsize for the steepest descent method, Journal of Computational Mathematics, vol.24, issue.2, pp.149-156, 2006.

B. Zhou, L. Gao, and Y. Dai, Gradient methods with adaptive step-sizes. Computational Optimization and Applications, vol.35, pp.69-86, 2006.