Bayesian inference for algorithm ranking analysis
Fecha
2018-08-30Autor
Calvo, B.
Ceberio, J.
Lozano, J.A.
Metadatos
Mostrar el registro completo del ítemResumen
The statistical assessment of the empirical comparison of algorithms is an essential step in heuristic optimization. Classically, researchers have relied on the use of statistical tests. However, recently, concerns about their use have arisen and, in many fields, other (Bayesian) alternatives are being considered. For a proper analysis, different aspects should be considered. In this work we focus on the question: what is the probability of a given algorithm being the best? To tackle this question, we propose a Bayesian analysis based on the Plackett-Luce model over rankings that allows several algorithms to be considered at the same time