Global optimization based on noisy evaluations: an empirical study of two statistical approaches

Emmanuel Vazquez (1, 2) , Julien Villemonteix (1, 3, 2) , Maryan Sidorkiewicz (3) , Eric Walter (2)

1 SUPELEC-Campus Gif
2 L2S - Laboratoire des signaux et systèmes
3 Technocentre Renault [Guyancourt]

The optimization of the output of complex computer codes has often to be achieved with a small budget of evaluations. Algorithms dedicated to such problems have been developed and compared, such as the Expected Improvement algorithm (EI) or the Informational Approach to Global Optimization (IAGO). However, the influence of noisy evaluation results on the outcome of these comparisons has often been neglected, despite its frequent appearance in industrial problems. In this paper, empirical convergence rates for EI and IAGO are compared when an additive noise corrupts the result of an evaluation. IAGO appears more efficient than EI and various modifications of EI designed to deal with noisy evaluations.

Keywords: noisy evaluations; computer simulations; Global optimization; kriging; Gaussian process; noisy evaluations.

Domains: Mathematics [math]; Optimization and Control [math.OC]; Mathematics [math]; Statistics [math.ST]; Statistics [stat]; Statistics Theory [stat.TH]

Emmanuel Vazquez, Julien Villemonteix, Maryan Sidorkiewicz, Eric Walter. Global optimization based on noisy evaluations: an empirical study of two statistical approaches. Journal of Physics: Conference Series, 2008, 135 (1), pp.012100. ⟨10.1088/1742-6596/135/1/012100⟩. ⟨hal-00278188v2⟩