Home > Research > Publications & Outputs > GIBBON: General-purpose Information-Based Bayes...

Electronic data

  • 21-0120

    Final published version, 2.15 MB, PDF document

    Available under license: CC BY

Links

View graph of relations

GIBBON: General-purpose Information-Based Bayesian Optimisation

Research output: Contribution to journalJournal articlepeer-review

Published
<mark>Journal publication date</mark>8/10/2021
<mark>Journal</mark>Journal of Machine Learning Research
Issue number235
Volume22
Number of pages49
Pages (from-to)1-49
Publication StatusPublished
<mark>Original language</mark>English

Abstract

This paper describes a general-purpose extension of max-value entropy search, a popular approach for Bayesian Optimisation (BO). A novel approximation is proposed for the information gain -- an information-theoretic quantity central to solving a range of BO problems, including noisy, multi-fidelity and batch optimisations across both continuous and highly-structured discrete spaces. Previously, these problems have been tackled separately within information-theoretic BO, each requiring a different sophisticated approximation scheme, except for batch BO, for which no computationally-lightweight information-theoretic approach has previously been proposed. GIBBON (General-purpose Information-Based Bayesian OptimisatioN) provides a single principled framework suitable for all the above, out-performing existing approaches whilst incurring substantially lower computational overheads. In addition, GIBBON does not require the problem's search space to be Euclidean and so is the first high-performance yet computationally light-weight acquisition function that supports batch BO over general highly structured input spaces like molecular search and gene design. Moreover, our principled derivation of GIBBON yields a natural interpretation of a popular batch BO heuristic based on determinantal point processes. Finally, we analyse GIBBON across a suite of synthetic benchmark tasks, a molecular search loop, and as part of a challenging batch multi-fidelity framework for problems with controllable experimental noise.