Parameter selection in Gaussian process interpolation: an empirical study of selection criteria - Archive ouverte HAL Access content directly
Preprints, Working Papers, ... Year :

Parameter selection in Gaussian process interpolation: an empirical study of selection criteria

Abstract

This article revisits the fundamental problem of parameter selection for Gaussian process interpolation. By choosing the mean and the covariance functions of a Gaussian process within parametric families, the user obtains a family of Bayesian procedures to perform predictions about the unknown function, and must choose a member of the family that will hopefully provide good predictive performances. We base our study on the general concept of scoring rules, which provides an effective framework for building leave-one-out selection and validation criteria, and a notion of extended likelihood criteria based on an idea proposed by Fasshauer and co-authors in 2009, which makes it possible to recover standard selection criteria such as, for instance, the generalized cross-validation criterion. Under this setting, we empirically show on several test problems of the literature that the choice of an appropriate family of models is often more important than the choice of a particular selection criterion (e.g., the likelihood versus a leave-one-out selection criterion). Moreover, our numerical results show that the regularity parameter of a Matérn covariance can be selected effectively by most selection criteria.
Fichier principal
Vignette du fichier
spetit-gpparam-paper.pdf (594.96 Ko) Télécharger le fichier
spetit-gpparam-suppmat-HALv3.pdf (1.23 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03285513 , version 1 (13-07-2021)
hal-03285513 , version 2 (25-03-2022)
hal-03285513 , version 3 (10-11-2022)

Licence

Attribution - NonCommercial - NoDerivatives - CC BY 4.0

Identifiers

Cite

Sébastien Petit, Julien Bect, Paul Feliot, Emmanuel Vazquez. Parameter selection in Gaussian process interpolation: an empirical study of selection criteria. 2022. ⟨hal-03285513v3⟩
213 View
222 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More