Final published version, 603 KB, PDF document
Final published version
Other version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - On the efficiency of pseudo-marginal random walk Metropolis algorithms
AU - Sherlock, Christopher
AU - Thiery, Alex
AU - Roberts, Gareth
AU - Rosenthal, Jeffrey
PY - 2015/1
Y1 - 2015/1
N2 - We examine the behaviour of the pseudo-marginal random walk Metropolis algorithm, where evaluations of the target density for the accept/reject probability are estimated rather than computed precisely. Under relatively general conditions on the target distribution, we obtain limiting formulae for the acceptance rate and for the expected squared jump distance, as the dimension of the target approaches infinity, under the assumption that the noise in the estimate of the log-target is additive and is independent of the position. For targets with independent and identically distributed components, we also obtain a limiting diffusion for the first component. We then consider the overall efficiency of the algorithm, in terms of both speed of mixing and computational time. Assuming the additive noise is Gaussian and is inversely proportional to the number of unbiased estimates that are used, we prove that the algorithm is optimally efficient when the variance of the noise is approximately 3.3 and the acceptance rate is approximately 7.0%. We also find that the optimal scaling is insensitive to the noise and that the optimal variance of the noise is insensitive to the scaling. The theory is illustrated with a simulation study using the particle random walk Metropolis.
AB - We examine the behaviour of the pseudo-marginal random walk Metropolis algorithm, where evaluations of the target density for the accept/reject probability are estimated rather than computed precisely. Under relatively general conditions on the target distribution, we obtain limiting formulae for the acceptance rate and for the expected squared jump distance, as the dimension of the target approaches infinity, under the assumption that the noise in the estimate of the log-target is additive and is independent of the position. For targets with independent and identically distributed components, we also obtain a limiting diffusion for the first component. We then consider the overall efficiency of the algorithm, in terms of both speed of mixing and computational time. Assuming the additive noise is Gaussian and is inversely proportional to the number of unbiased estimates that are used, we prove that the algorithm is optimally efficient when the variance of the noise is approximately 3.3 and the acceptance rate is approximately 7.0%. We also find that the optimal scaling is insensitive to the noise and that the optimal variance of the noise is insensitive to the scaling. The theory is illustrated with a simulation study using the particle random walk Metropolis.
KW - Markov chain Monte Carlo
KW - MCMC
KW - pseudo-marginal random walk Metropolis
KW - optimal scaling
KW - diffusion limit
KW - particle methods
U2 - 10.1214/14-AOS1278
DO - 10.1214/14-AOS1278
M3 - Journal article
VL - 43
SP - 238
EP - 275
JO - Annals of Statistics
JF - Annals of Statistics
SN - 0090-5364
IS - 1
ER -