Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks - CentraleSupélec Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks

Résumé

Modelling time series is quite a difficult task. The last recent years, reservoir computing approaches have been proven very efficient for such problems. Indeed, thanks to recurrence in the connections between neurons, this approach is a powerful tool to catch and model time dependencies between samples. Yet, the prediction quality often depends on the trade-off between the number of neurons in the reservoir and the amount of training data. Supposedly, the larger the number of neurons, the richer the reservoir of dynamics. However, the risk of overfitting problem appears. Conversely, the lower the number of neurons is, the lower the risk of overfitting problem is but also the poorer the reservoir of dynamics is. We consider here the combination of an echo state network with a projection method to benefit from the advantages of the reservoir computing approach without needing to pay attention to overfitting problems due to a lack of training data.
Fichier principal
Vignette du fichier
rp_esn.pdf (590.93 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00869814 , version 1 (06-11-2017)

Identifiants

Citer

Lucie Daubigney, Matthieu Geist, Olivier Pietquin. Random Projections: a Remedy for Overfitting Issues in Time Series Prediction with Echo State Networks. ICASSP 2013, May 2013, Vancouver, Canada. pp.3253-3257, ⟨10.1109/ICASSP.2013.6638259⟩. ⟨hal-00869814⟩
378 Consultations
241 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More