J. Chung, K. Lee, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran, Ubershuffle: Communication-efficient data shuffling for sgd via coding theory, NIPS 2017, ML Systems Workshop

M. Gurbuzbalaban, A. Ozdaglar, and P. Parrilo, Why random reshuffling beats stochastic gradient descent, 2015.

K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, and K. Ramchandran, Speeding up distributed machine learning using codes, IEEE Trans. Inf. Theory, vol.64, issue.3, 2018.

F. A. Tobagi and V. B. Hunt, Performance analysis of carrier sense multiple access with collision detection, Computer Networks, vol.4, pp.245-259, 1980.

. Ansi/, Token ring access method and physical layer specifications, IEEE Standard, vol.802, 1985.

M. A. Attia and R. Tandon, Information theoretic limits of data shuffling for distributed learning, IEEE Global Commun. Conf. (GLOBECOM), 2016.

, On the worst-case communication overhead for distributed data shuffling, 54th Annual Allerton Conf. on Commun., Control, and Computing, 2016.

M. A. Maddah-ali and U. Niesen, Fundamental limits of caching, IEEE Trans. Infor. Theory, vol.60, issue.5, pp.2856-2867, 2014.

K. Wan, D. Tuninetti, and P. Piantanida, On the optimality of uncoded cache placement, IEEE Infor. Theory Workshop, 2016.

Q. Yu, M. A. Maddah-ali, and S. Avestimehr, The exact rate-memory tradeoff for caching with uncoded prefetching, IEEE Trans. Infor. Theory, vol.64, pp.1281-1296, 2018.

M. A. Attia and R. Tandon, Near optimal coded data shuffling for distributed learning, vol.65, pp.7325-7349, 2019.

A. Elmahdy and S. Mohajer, On the fundamental limits of coded data shuffling for distributed learning systems, IEEE Int. Symp. Inf, 2018.

M. Ji, G. Caire, and A. Molisch, Fundamental limits of caching in wireless d2d networks, IEEE Trans. Inf. Theory, vol.62, issue.1, pp.849-869, 2016.

S. Li, M. A. Maddah-ali, Q. Yu, and A. S. Avestimehr, A fundamental tradeoff between computation and communication in distributed computing, IEEE Trans. Inf. Theory, vol.64, issue.1, pp.109-128, 2018.

Y. H. Ezzeldin, M. Karmoose, and C. Fragouli, Communication vs distributed computation: An alternative trade-off curve, IEEE Inf. Theory Workshop (ITW), 2017.

N. Woolsey, R. Chen, and M. Ji, A new combinatorial design of coded distributed computing, IEEE Int. Symp. Inf. Theory, 2018.

K. Konstantinos and A. Ramamoorthy, Leveraging coding techniques for speeding up distributed computing, 2018.

S. R. Srinivasavaradhan, L. Song, and C. Fragouli, Distributed computing trade-offs with random connectivity, IEEE Int. Symp. Inf. Theory, 2018.

S. Prakash, A. Reisizadeh, R. Pedarsani, and S. Avestimehr, Coded computing for distributed graph analytics, IEEE Int. Symp. Inf. Theory, 2018.

B. Guler, A. S. Avestimehr, and A. Ortega, A topology-aware coding framework for distributed graph processing, IEEE International Conference on Acoustics, Speech and Signal Processing, 2019.

L. Songze, Q. Yu, M. A. Maddah-ali, and A. S. Avestimehr, A scalable framework for wireless distributed computing, IEEE/ACM Transactions on Networking, vol.25, issue.5, pp.2643-2654, 2017.

Q. Yan, S. Yang, and M. Wigger, Storage, computation, and communication: A fundamental tradeoff in distributed computing, 2018.

N. Woolsey, R. Chen, and M. Ji, Cascaded coded distributed computing on heterogeneous networks, 2019.

, Coded distributed computing with heterogeneous function assignments, 2019.

P. Sadeghi, F. Arbabjolfaei, and Y. Kim, Distributed index coding, IEEE Inf. Theory Workshop, 2016.

Y. Liu, P. Sadeghi, F. Arbabjolfaei, and Y. Kim, Capacity theorems for distributed index coding, 2018.

Y. Birk and T. Kol, Informed source coding on demand (iscod) over broadcast channels, Proc. IEEE Conf. Comput. Commun, pp.1257-1264, 1998.

A. Porter and M. Wootters, Embedded index coding, 2019.

C. Thapa, L. Ong, S. J. Johnson, and M. Li, Structural characteristics of two-sender index coding, 2019.

A. E. Gamal and Y. Kim, Network Information Theory, 2011.

K. Wan, He is currently a post-doctoral researcher with the Communications and Information Theory Chair (CommIT) at Technische Universität Berlin, S '15 -M '18) received the M.Sc. and Ph.D. degrees in Communications from Université Paris Sud-CentraleSupélec, 2014.

, Tuninetti is a recipient of a best paper award at the European Wireless Conference in 2002, of an NSF CAREER award in 2007, and named University of Illinois Scholar in 2015. Dr. Tuninetti was the editor-in-chief of the IEEE Information Theory Society Newsletter from, which she joined in 2005. Dr. Tuninetti got her Ph.D. in Electrical Engineering in 2002 from ENST/Télécom ParisTech, 2002.

. Dr, Tuninetti's research interests are in the ultimate performance limits of wireless interference networks (with special emphasis on cognition and user cooperation), coexistence between radar and communication systems, multirelay networks, content-type coding, cache-aided systems and distributed private coded computing

M. Ji, He is now an Assistant Professor of Electrical and Computer Engineering Department and an Adjunct Assistant Professor of School of Computing at the University of Utah. He received the IEEE Communications Society Leonard G. Abraham Prize for the best IEEE, IEEE ICC 2015 conference, the best student paper award in IEEE European Wireless 2010 Conference and USC Annenberg Fellowship from, pp.2015-2016, 2006.

G. Caire, D. from Politecnico di Torino in 1994. He has been a post-doctoral research fellow with the, S '92 -M '94 -SM '03 -F '05) was born in Torino in 1965. He received the B.Sc. in Electrical Engineering from Politecnico di Torino in 1990, the M.Sc. in Electrical Engineering from Princeton University in 1992, and the Ph, 1994.
URL : https://hal.archives-ouvertes.fr/hal-00738137

G. Leonard, Abraham Prize for best IEEE JSAC paper in 2019, the Okawa Research Award in 2006, the Alexander von Humboldt Professorship in 2014, the Vodafone Innovation Prize in 2015, and an ERC Advanced Grant, 2018.

, He was President of the IEEE Information Theory Society in 2011. His main research interests are in the field of communications theory, information theory, 2004.

P. Piantanida, SM '16) received both B.Sc. in Electrical Engineering and the M.Sc (with honors) from the University of Buenos Aires (Argentina) in 2003, and the Ph.D. from Université Paris-Sud, 2007.

, at CentraleSupélec together with CNRS (UMR 8506) and Université Paris-Sud, as an Associate Professor of Network Information Theory. He is currently associated with Montreal Institute for Learning Algorithms (Mila) at Université de Montréal, Quebec, Canada. He is an IEEE Senior Member and serves as Associate Editor for IEEE Transactions on Information Forensics and Security. He served as General Co-Chair of the 2019 IEEE International Symposium on Information Theory (ISIT), Since October 2007 he has joined the Laboratoire des Signaux et Systèmes (L2S)