Home > Research > Publications & Outputs > Learning Rate Free Sampling in Constrained Domains

Electronic data

Links

View graph of relations

Learning Rate Free Sampling in Constrained Domains

Research output: Contribution to Journal/MagazineConference articlepeer-review

Published
<mark>Journal publication date</mark>12/12/2023
<mark>Journal</mark>Advances in Neural Information Processing Systems
Volume36
Publication StatusPublished
<mark>Original language</mark>English
Event37th Conference on Neural Information Processing Systems, NeurIPS 2023 - New Orleans, United States
Duration: 10/12/202316/12/2023

Conference

Conference37th Conference on Neural Information Processing Systems, NeurIPS 2023
Country/TerritoryUnited States
CityNew Orleans
Period10/12/2316/12/23

Abstract

We introduce a suite of new particle-based algorithms for sampling in constrained domains which are entirely learning rate free. Our approach leverages coin betting ideas from convex optimisation, and the viewpoint of constrained sampling as a mirrored optimisation problem on the space of probability measures. Based on this viewpoint, we also introduce a unifying framework for several existing constrained sampling algorithms, including mirrored Langevin dynamics and mirrored Stein variational gradient descent. We demonstrate the performance of our algorithms on a range of numerical examples, including sampling from targets on the simplex, sampling with fairness constraints, and constrained sampling problems in post-selection inference. Our results indicate that our algorithms achieve competitive performance with existing constrained sampling methods, without the need to tune any hyperparameters.

Bibliographic note

Publisher Copyright: © 2023 Neural information processing systems foundation. All rights reserved.