Detecting covariate shift with Black Box predictors - Archive ouverte HAL Access content directly
Conference Papers Year :

Detecting covariate shift with Black Box predictors

(1) , (1) , (1) , (1)
1

Abstract

Many Machine Learning algorithms aiming at classifying signals/images X among a number of discrete labels Y involve training instances, from which the predictor P Y |X is extracted according to the data distribution P X|Y. This predictor is later used to predict the appropriate label for other instances of X that are hence assumed to be drawn from the same distribution. This is a fundamental requirement for many real-world applications, therefore it is of great importance to monitor the reliability of the classification provided by the algorithm based on the learned distributions, when the test set statistics differ from the training set ones. This paper makes a step in that direction by proposing a Black Box Shift Detector of the data evolution (covariate shift). 'Black Box' here means that it does not require any knowledge of the predictor's architecture. Experiments demonstrate accurate detection on different high-dimensional datasets of natural images.
Fichier principal
Vignette du fichier
Data_Detection-5.pdf (3.19 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02172275 , version 1 (25-04-2020)
hal-02172275 , version 2 (19-01-2022)

Identifiers

Cite

Florence Alberge, Clément Feutry, Pierre Duhamel, Pablo Piantanida. Detecting covariate shift with Black Box predictors. International Conference on Telecommunications (ICT 2019), Apr 2019, Hanoi, Vietnam. ⟨10.1109/ICT.2019.8798827⟩. ⟨hal-02172275v2⟩
94 View
183 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More