Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system - CentraleSupélec Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

Résumé

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task.
Fichier principal
Vignette du fichier
IS_2011_LDMGSCMGOPSY.pdf (91.66 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00652194 , version 1 (15-12-2011)

Identifiants

  • HAL Id : hal-00652194 , version 1

Citer

Lucie Daubigney, Milica Gašić, Senthilkumar Chandramohan, Matthieu Geist, Olivier Pietquin, et al.. Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system. Interspeech 2011, Aug 2011, Florence, Italy. pp.1301-1304. ⟨hal-00652194⟩
181 Consultations
184 Téléchargements

Partager

Gmail Facebook X LinkedIn More