Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system - Archive ouverte HAL Access content directly
Conference Papers Year : 2011

Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system

Abstract

The optimization of dialogue policies using reinforcement learning (RL) is now an accepted part of the state of the art in spoken dialogue systems (SDS). Yet, it is still the case that the commonly used training algorithms for SDS require a large number of dialogues and hence most systems still rely on artificial data generated by a user simulator. Optimization is therefore performed off-line before releasing the system to real users. Gaussian Processes (GP) for RL have recently been applied to dialogue systems. One advantage of GP is that they compute an explicit measure of uncertainty in the value function estimates computed during learning. In this paper, a class of novel learning strategies is described which use uncertainty to control exploration on-line. Comparisons between several exploration schemes show that significant improvements to learning speed can be obtained and that rapid and safe online optimisation is possible, even on a complex task.
Fichier principal
Vignette du fichier
IS_2011_LDMGSCMGOPSY.pdf (91.66 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00652194 , version 1 (15-12-2011)

Identifiers

  • HAL Id : hal-00652194 , version 1

Cite

Lucie Daubigney, Milica Gašić, Senthilkumar Chandramohan, Matthieu Geist, Olivier Pietquin, et al.. Uncertainty management for on-line optimisation of a POMDP-based large-scale spoken dialogue system. Interspeech 2011, Aug 2011, Florence, Italy. pp.1301-1304. ⟨hal-00652194⟩
176 View
159 Download

Share

Gmail Facebook Twitter LinkedIn More