A. Mart?n, A. Ashish, B. Paul, B. Eugene, C. Zhifeng et al., Tensorflow : Large-scale machine learning on heterogeneous distributed systems, 2016.

A. Ala, G. Vincent, and J. Xiaoran, A study of retrieval algorithms of sparse messages in networks of neural cliques " . In : arXiv preprint arXiv, pp.1308-4506, 2013.

H. David, . Ackley, E. Geoffrey, . Hinton, J. Terrence et al., A learning algorithm for Boltzmann machines, Cognitive science 9, pp.147-169, 1985.

B. Kamary, A. Claude, B. Vincent, G. Xiaoran, and J. , Storing sparse messages in networks of neural cliques, IEEE Transactions on neural networks and learning systems 25, pp.980-989, 2014.
URL : https://hal.archives-ouvertes.fr/hal-00994216

A. Shun-ichi, Learning patterns and pattern sequences by self-organizing nets of threshold elements, IEEE Transactions on, vol.10011, pp.1197-1206, 1972.

J. Daniel, . Amit, G. Hanoch, and S. Haim, Spin-glass models of neural networks, Physical Review A, vol.32, issue.2, p.1007, 1985.

J. Daniel, . Amit, G. Hanoch, and S. Haim, Storing infinite numbers of patterns in a spin-glass model of neural networks ", In : Physical Review Letters, vol.5514, p.1530, 1985.

A. James and . Anderson, A memory storage model utilizing spatial correlation functions, pp.113-119, 1968.

A. James, . Anderson, W. Jack, . Silverstein, A. Stephen et al., Distinctive features, categorical perception, and probability learning : Some applications of a neural model, In : Psychological Review, vol.845, p.413, 1977.

A. Nicolas, B. Le, S. Sébastien, and L. , Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks, 2016.

D. Alan and . Baddeley, Human memory : Theory and practice, 1997.

B. Frédéric, L. Pascal, P. Razvan, B. James, G. Ian et al., Theano : new features and speed improvements, 2012.

B. Yoshua, P. Simard, and F. Paolo, Learning long-term dependencies with gradient descent is difficult, IEEE transactions on neural networks 5, pp.157-166, 1994.

B. James, B. Olivier, B. Frédéric, L. Pascal, P. Razvan et al., Theano : A CPU and GPU math compiler in Python, Proc. 9th Python in Science Conf, pp.1-7, 2010.

B. Claude and G. Alain, Turbo codes, In : Encyclopedia of Telecommunications, 2003.

B. Ella and M. Heikki, Random projection in dimensionality reduction : applications to image and text data, Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, pp.245-250, 2001.

M. Christopher and . Bishop, Pattern recognition, Machine Learning, vol.128, pp.1-58, 2006.

B. Thomas, E. Mike, and . Davies, Iterative hard thresholding for compressed sensing, Applied and Computational Harmonic Analysis, vol.273, pp.265-274, 2009.

B. Bartosz, G. Vincent, F. Seguin, and H. Frédéric, Huffman coding for storing non-uniformly distributed messages in networks of neural cliques, AAAI 2014 : the 28th Conference on Artificial Intelligence. T. 1. 2014, pp.262-268

B. Bartosz, G. Vincent, F. Seguin, and H. Frédéric, Twin Neurons for Efficient Real-World Data Distribution in Networks of Neural Cliques : Applications in Power Management in Electronic Circuits, IEEE transactions on neural networks and learning systems 27, pp.375-387, 2016.

B. Léon, Large-scale machine learning with stochastic gradient descent, Proceedings of COMPSTAT'2010, pp.177-186, 2010.

B. Léon, Online learning and stochastic approximations, On-line learning in neural networks, p.142, 1998.

J. Buhmann, R. Divko, and K. Schulten, Associative memory with high information content, Physical Review A, vol.34, issue.5, p.2689, 1989.
DOI : 10.1103/PhysRevA.34.2571

J. Emmanuel and . Candes, The restricted isometry property and its implications for compressed sensing, Comptes Rendus Mathematique, vol.3469, issue.10, pp.589-592, 2008.

J. Emmanuel, . Candès, and R. Justin, Sparsity and incoherence in compressive sampling, p.969, 2007.

J. Emmanuel, . Candès, B. Michael, and . Wakin, An introduction to compressive sampling, IEEE signal processing magazine 25, pp.21-30, 2008.

J. Emmanuel and . Candès, Compressive sampling, Proceedings of the international congress of mathematicians. T. 3. Madrid, pp.1433-1452, 2006.

C. Natalia and D. Yang, Spike timing-dependent plasticity : a Hebbian learning rule, Annu. Rev. Neurosci, vol.31, pp.25-46, 2008.

C. Adam, H. Brody, W. Tao, W. David, C. Bryan et al., Deep learning with COTS HPC systems, International Conference on Machine Learning, pp.1337-1345, 2013.

C. Ronan, B. Samy, and M. Johnny, Torch : a modular machine learning software library, Rapp. tech. Idiap, 2002.

T. Jerome, . Connor, M. Douglas, E. Les, and . Atlas, Recurrent neural networks and robust time series prediction, IEEE transactions on neural networks 5, pp.240-254, 1994.

K. William, . Coulter, J. Christopher, . Hillar, I. Guy et al., Adaptive compressed sensing?a new class of self-organizing coding models for neuroscience, 2010 IEEE International Conference on. IEEE, pp.5494-5497, 2010.

C. Matthieu, H. Itay, S. Daniel, E. Ran, and B. Yoshua, Binarized neural networks : Training deep neural networks with weights and activations constrained to+ 1 or-1, 2016.

E. George, . Dahl, N. Tara, . Sainath, E. Geoffrey et al., Improving deep neural networks for LVCSR using rectified linear units and dropout, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.8609-8613, 2013.

D. Robin, C. Philippe, C. Laura, G. Vincent, J. Warren et al., Restricted clustered neural network for storing real data, Proceedings of the 25th edition on Great Lakes Symposium on VLSI. ACM. 2015, pp.205-210

D. Manolis and G. Christophe, text Detection with Convolutional Neural Networks, pp.290-294, 2008.

D. David and G. Cottrell, n?linear dimensionality reduction, In : Adv. Neural Inform. Process. Sys, vol.5, pp.580-587, 1993.

D. Jeffrey, A. Lisa, . Hendricks, G. Sergio, R. Marcus et al., Long-term recurrent convolutional networks for visual recognition and description, Proceedings of the IEEE conference on computer vision and pattern recognition, pp.2625-2634, 2015.

L. David and . Donoho, Compressed sensing In : Information Theory, IEEE Transactions on, vol.524, pp.1289-1306, 2006.

L. David, . Donoho, and E. Michael, Optimally sparse representation in general (nonorthogonal ) dictionaries via l1 minimization, Proceedings of the National Academy of Sciences, pp.2197-2202, 2003.

F. Jianfeng, S. Mariya, and T. Brunello, On the critical capacity of the Hopfield model, In : Communications in Mathematical Physics, vol.2161, pp.139-177, 2001.

F. Asja and I. Christian, An introduction to restricted Boltzmann machines, Iberoamerican Congress on Pattern Recognition, pp.14-36, 2012.

F. Roger, Practical methods of optimization, 2013.

F. Peter, P. Malcom, and . Young, Sparse coding in the primate cortex, pp.1064-1068, 1995.

D. Gabor, Associative Holographic Memories, IBM Journal of Research and Development, vol.13, issue.2, pp.156-159, 1969.
DOI : 10.1147/rd.132.0156

G. Robert, Low-density parity-check codes, IRE Transactions on information theory, vol.81, pp.21-28, 1962.

G. Christophe and D. Manolis, Convolutional face finder : A neural architecture for fast and robust face detection, IEEE Transactions on pattern analysis and machine intelligence, vol.2611, pp.1408-1423, 2004.

G. Elizabeth, The space of interactions in neural network models, Journal of physics A : Mathematical and general, vol.211, p.257, 1988.

E. Sedgh, G. Dominique, P. Vincent, and G. , Automatic face recognition using SIFT and networks of tagged neural cliques, Proceedings of Cognitive. 2015, pp.57-61

G. Alex, M. Abdel-rahman, and H. Geoffrey, Speech recognition with deep recurrent neural networks, 2013 IEEE international conference on acoustics , speech and signal processing, pp.6645-6649, 2013.

G. Vincent and B. Claude, Nearly-optimal associative memories based on distributed constant weight codes, Information Theory and Applications Workshop (ITA), 2012. IEEE. 2012, pp.269-273

G. Vincent and B. Claude, Sparse neural networks with large learning diversity, IEEE Transactions on Neural Networks, vol.227, pp.1087-1096, 2011.

G. Vincent, H. Judith, L. Matthias, and V. Franck, A Comparative Study of Sparse Associative Memories, 2015.

H. Raia, S. Pierre, B. Jan, E. Ayse, S. Marco et al., Learning long-range vision for autonomous off-road driving, Journal of Field Robotics, vol.262, pp.120-144, 2009.

W. Richard and . Hamming, Error detecting and error correcting codes, Bell System technical journal 29, pp.147-160, 1950.

H. Kaiming, Z. Xiangyu, R. Shaoqing, and S. Jian, Delving deep into rectifiers : Surpassing human-level performance on imagenet classification, Proceedings of the IEEE International Conference on Computer Vision, pp.1026-1034, 2015.

D. Olding and H. , The organization of behavior : A neuropsychological theory, 2005.

H. Christopher, T. Ngoc, and K. Kilian, Robust exponential binary pattern storage in Little-Hopfield networks, 2012.

E. Geoffrey and . Hinton, Training products of experts by minimizing contrastive divergence, pp.1771-1800, 2002.

E. Geoffrey, . Hinton, O. Simon, and T. Yee-whye, A fast learning algorithm for deep belief nets, Neural computation, vol.187, pp.1527-1554, 2006.

H. Sepp and S. Jürgen, Long short-term memory, Neural computation 9, pp.1735-1780, 1997.

J. John and . Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proceedings of the national academy of sciences 79, pp.2554-2558, 1982.

J. John and . Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons, Proceedings of the national academy of sciences 81, pp.3088-3092, 1984.

J. John, . Hopfield, W. David, and . Tank, Neural " computation of decisions in optimization problems, Biological cybernetics, vol.523, pp.141-152, 1985.

H. Mark, 1.1 Computing's energy problem (and what we can do about it) . In : 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC), IEEE, pp.10-14, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01129522

O. Patrik and . Hoyer, Non-negative matrix factorization with sparseness constraints, The Journal of Machine Learning Research, vol.5, pp.1457-1469, 2004.

O. Patrik, . Hoyer, and H. Aapo, A multi-layer sparse coding network learns contour coding from natural images, pp.1593-1605, 2002.

H. Romain, C. Nicolas, and L. Sébastien, A new penalisation term for image retrieval in clique neural networks, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, 2016.

H. Niall and R. Scott, Comparing measures of sparsity, In : Information Theory IEEE Transactions on, vol.5510, pp.4723-4741, 2009.

A. Mark and . Iwen, Compressed sensing with sparse binary matrices : Instance optimal error guarantees in near-optimal time, Journal of Complexity, vol.301, pp.1-15, 2014.

J. Laurent, N. Jason, . Laska, T. Petros, . Boufounos et al., Robust 1-bit compressive sensing via binary stable embeddings of sparse vectors, IEEE Transactions on, vol.594, pp.2082-2102, 2013.

J. Hooman, G. Vincent, O. Naoya, J. Warren, and . Gross, A low-power content-addressable memory based on clustered-sparse networks, Application-Specific Systems, Architectures and Processors (ASAP), 2013 IEEE 24th International Conference on. IEEE. 2013, pp.305-308

J. Hooman, G. Vincent, O. Naoya, J. Warren, and . Gross, Algorithm and architecture for a low-power content-addressable memory based on sparse clustered networks, Very Large Scale Integration (VLSI) Systems, IEEE Transactions on 23, pp.642-653, 2015.

J. Hooman, O. Naoya, G. Vincent, H. Takahiro, J. Warren et al., Algorithm and architecture for a multiple-field context-driven search engine using fully-parallel clustered associative memories, Signal Processing Systems (SiPS), pp.1-6, 2014.

J. Hooman, O. Naoya, G. Vincent, J. Warren, and . Gross, Architecture and implementation of an associative memory using sparse clustered networks, Circuits and Systems (ISCAS), 2012 IEEE International Symposium on. IEEE. 2012, pp.2901-2904

J. Yangqing, S. Evan, D. Jeff, K. Sergey, L. Jonathan et al., Caffe : Convolutional architecture for fast feature embedding, Proceedings of the 22nd ACM international conference on Multimedia, pp.675-678, 2014.

J. Xiaoran, G. Vincent, and B. Claude, Learning long sequences in binary neural networks, International Conference on Advanced Cognitive Technologies and Applications, pp.165-170, 2012.

B. William, . Johnson, and L. Joram, Extensions of Lipschitz mappings into a Hilbert space, Contemporary mathematics 26, pp.189-206, 1984.

A. Jordan, On discriminative vs. generative classifiers : A comparison of logistic regression and naive bayes, Advances in neural information processing systems, p.841, 2002.

M. Kahana, M. Howard, S. Polyn, and H. Roediger, Learning and memory : a comprehensive reference, 2008.

K. Pentti, Sparse distributed memory, 1988.

M. Peter, K. Leon, and O. Chua, Neural networks for nonlinear programming, Circuits and Systems, pp.554-562, 1988.

K. Andreas, Optimal synaptic learning in non-linear associative memory, The 2010 International Joint Conference on. IEEE, pp.1-7, 2010.

K. Teuvo, Correlation matrix memories, IEEE Transactions on, vol.1004, pp.353-359, 1972.

K. Teuvo, Self-organization and associative memory, 2012.

K. Bart, Adaptive bidirectional associative memories, In : Applied optics, vol.2623, pp.4947-4960, 1987.

K. Bart, Bidirectional associative memories, Systems, Man and Cybernetics IEEE Transactions on, vol.181, pp.49-60, 1988.

K. Kenneth, F. Joseph, . Murray, D. Bhaskar, . Rao et al., Dictionary learning algorithms for sparse representation, Neural computation 15, pp.349-396, 2003.

K. Alex, S. Ilya, E. Geoffrey, and . Hinton, Imagenet classification with deep convolutional neural networks " . In : Advances in neural information processing systems, pp.1097-1105, 2012.

L. Stephen, E. Sedgh, G. Vincent, G. Dominique, and P. , Using Tags to Improve Diversity of Sparse Associative Memories, Proceedings of Cognitive, 2015.

L. Yann and B. Yoshua, Convolutional networks for images, speech, and time series " . In : The handbook of brain theory and neural networks 3361, 1995.

L. Yann, B. Yoshua, and H. Geoffrey, Deep learning, Nature, vol.5217553, pp.436-444, 2015.

L. Yann, B. Léon, B. Yoshua, and H. Patrick, Gradient-based learning applied to document recognition, Proceedings of the IEEE, pp.2278-2324, 1998.

H. David, J. Willshaw, and O. Buneman, Theories of associative recall, In : Quarterly reviews of biophysics, vol.3, pp.2-223, 1970.

L. Weizhi, L. Weiyu, K. Kidiyo, and R. Joseph, Near-optimal binary compressed sensing matrix, 2013.

M. Matteo, H. Wang, T. Yamamoto, M. Neeley, C. Radoslaw et al., Implementing the quantum von Neumann architecture with superconducting circuits, In : Science, vol.334, pp.6052-61, 2011.

M. Arya, A. Singh, and R. , Associative Memory via a Sparse Recovery Model, Advances in Neural Information Processing Systems, pp.2683-2691, 2015.

S. Warren, . Mcculloch, and P. Walter, A logical calculus of the ideas immanent in nervous activity " . In : The bulletin of mathematical biophysics 5, pp.115-133, 1943.

J. Robert, . Mceliece, C. Edward, . Posner, R. Eugene et al., The capacity of the Hopfield associative memory, IEEE Transactions on, vol.334, pp.461-482, 1987.

C. Dean and . Mumme, Storage capacity of the linear associator : beginnings of a theory of computational memory, Rapp. tech. DTIC Document, 1988.

N. Vinod, E. Geoffrey, and . Hinton, Rectified linear units improve restricted boltzmann machines, Proceedings of the 27th International Conference on Machine Learning (ICML-10, pp.807-814, 2010.

N. Kaoru, Associatron-a model of associative memory, In : Systems, Man and Cybernetics IEEE Transactions on, vol.3, pp.380-388, 1972.

N. Iku and K. Makoto, Complex associative memory, Neural Networks 9, pp.253-261, 1996.

N. Andrew, Sparse autoencoder, CS294A Lecture notes, pp.1-19, 2011.

A. Bruno and . Olshausen, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature, vol.3816583, pp.607-609, 1996.

G. Palm, Memory capacities of local rules for synaptic modification, Concepts in Neuroscience, pp.97-128, 1991.

G. Palm, On the Asymptotic Information Storage Capacity of Neural Networks, pp.271-280, 1989.
DOI : 10.1007/978-3-642-83740-1_29

P. Günther, Neural associative memories and sparse coding, Neural Networks, vol.37, pp.165-171, 2013.

P. Günther, On associative memory, In : Biological cybernetics, vol.361, pp.19-31, 1980.

A. Seymour and . Papert, The summer vision project, 1966.

R. Frank, The perceptron : a probabilistic model for information storage and organization in the brain, In : Psychological review, vol.656, p.386, 1958.

E. David, . Rumelhart, E. Geoffrey, . Hinton, J. Ronald et al., Learning representations by back-propagating errors, Cognitive modeling 5, p.1, 1988.

S. Ruslan, E. Geoffrey, and . Hinton, Deep Boltzmann Machines, In : AISTATS. T, vol.1, p.3, 2009.

S. Jürgen, Deep learning in neural networks : An overview, Neural networks, vol.61, pp.85-117, 2015.

S. Pierre, K. Koray, C. Soumith, and L. Yann, Pedestrian detection with unsupervised multi-stage feature learning, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3626-3633, 2013.

S. Thomas, O. Aude, and P. Tomaso, A feedforward architecture accounts for rapid categorization, Proceedings of the National Academy of Sciences, pp.6424-6429, 2007.

S. Thomas, K. Minjoon, C. Charles, K. Ulf, K. Gabriel et al., A theory of object recognition : computations and circuits in the feedforward path of the ventral stream in primate visual cortex, 2005.

C. Elwood and S. , A mathematical theory of communication, In : ACM SIGMOBILE Mobile Computing and Communications Review, vol.51, pp.3-55, 2001.

S. David, H. Aja, C. J. Maddison, G. Arthur, S. Laurent et al., Mastering the game of Go with deep neural networks and tree search, Nature, vol.529, pp.7587-484, 2016.

T. Friedrich, . Sommer, and P. Günther, Improved bidirectional retrieval of sparse patterns stored by Hebbian learning, Neural Networks, vol.122, pp.281-297, 1999.

F. Sommer and P. Dayan, Bayesian retrieval in associative memories with storage errors, IEEE Transactions on Neural Networks, vol.9, issue.4, pp.705-713, 1998.
DOI : 10.1109/72.701183

S. Nitish, E. Geoffrey, . Hinton, K. Alex, S. Ilya et al., Dropout : a simple way to prevent neural networks from overfitting, In : Journal of Machine Learning Research, vol.151, pp.1929-1958, 2014.

S. Karl, Die lernmatrix, In : Biological Cybernetics, vol.11, pp.36-45, 1961.

S. Yi, W. Xiaogang, and T. Xiaoou, Deep convolutional network cascade for facial point detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3476-3483, 2013.

S. Ilya, V. Oriol, V. Quoc, and . Le, Sequence to sequence learning with neural networks " . In : Advances in neural information processing systems, pp.3104-3112, 2014.

T. Yaniv, Y. Ming, R. Marc-'aurelio, and W. Lior, Deepface : Closing the gap to human-level performance in face verification, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.1701-1708, 2014.

T. Yaakov, L. David, and . Donoho, Extensions of compressed sensing, In : Signal processing, vol.863, pp.549-571, 2006.

V. Régis, C. Monrocq, L. Yann, and . Cun, Original approach for the localisation of objects in images, IEE Proceedings-Vision, Image and Signal Processing 141, pp.245-250, 1994.

V. Vladimir, The nature of statistical learning theory Springer science & business media, 2013.

S. Santosh and . Vempala, The random projection method. T. 65, 2005.

V. Pascal, L. Hugo, B. Yoshua, and M. Pierre-antoine, Extracting and composing robust features with denoising autoencoders, Proceedings of the 25th international conference on Machine learning, pp.1096-1103, 2008.

V. Pascal, L. Hugo, L. Isabelle, B. Yoshua, and M. Pierre-antoine, Stacked denoising autoencoders : Learning useful representations in a deep network with a local denoising criterion, Journal of Machine Learning Research, vol.11, pp.3371-3408, 2010.

V. Oriol, T. Alexander, B. Samy, and E. Dumitru, Show and tell : A neural image caption generator, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.3156-3164, 2015.

V. John, . Neumann, and K. Ray, The computer and the brain, 2012.

W. Nicholas and C. Charles, The effects of distinctiveness on memory and metamemory for face?name associations, pp.73-88, 2012.

J. Paul and . Werbos, Backpropagation through time : what it does and how to do it, Proceedings of the IEEE 78, pp.1550-1560, 1990.

W. David, Models of distributed associative memory. The University of Edinburgh, 1971.

W. David and D. Peter, Optimal plasticity from matrix memories : What goes up must come down, Neural Computation, vol.2, issue.1, pp.85-93, 1990.

J. David, . Willshaw, B. Peter, H. Christopher, and L. , Non-holographic associative memory, In : Nature, 1969.

G. Wilson and G. Pawley, On the stability of the Travelling Salesman Problem algorithm of Hopfield and Tank, Biological Cybernetics, vol.220, issue.1, pp.63-70, 1988.
DOI : 10.1007/BF00363956

H. Nono, W. Cyrille, C. Philippe, and C. , Improving Storage of Patterns in Binary Cluster-Based Neural Networks : Clone-based Model and Architecture, Internationnal workshop on Neural Coding, co-located with DATE Conference 2015, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01101583

Z. Bolei, L. Agata, X. Jianxiong, T. Antonio, and O. Aude, Learning deep features for scene recognition using places database Advances in neural information processing systems, pp.487-495, 2014.