Matthew J. Heiner, Samuel B. Johnson, Joshua R. Christensen, David B. Dahl
{"title":"定量切片采样","authors":"Matthew J. Heiner, Samuel B. Johnson, Joshua R. Christensen, David B. Dahl","doi":"arxiv-2407.12608","DOIUrl":null,"url":null,"abstract":"We propose and demonstrate an alternate, effective approach to simple slice\nsampling. Using the probability integral transform, we first generalize Neal's\nshrinkage algorithm, standardizing the procedure to an automatic and universal\nstarting point: the unit interval. This enables the introduction of approximate\n(pseudo-) targets through importance reweighting, a technique that has\npopularized elliptical slice sampling. Reasonably accurate pseudo-targets can\nboost sampler efficiency by requiring fewer rejections and by reducing target\nskewness. This strategy is effective when a natural, possibly crude,\napproximation to the target exists. Alternatively, obtaining a marginal\npseudo-target from initial samples provides an intuitive and automatic tuning\nprocedure. We consider two metrics for evaluating the quality of approximation;\neach can be used as a criterion to find an optimal pseudo-target or as an\ninterpretable diagnostic. We examine performance of the proposed sampler\nrelative to other popular, easily implemented MCMC samplers on standard targets\nin isolation, and as steps within a Gibbs sampler in a Bayesian modeling\ncontext. We extend the transformation method to multivariate slice samplers and\ndemonstrate with a constrained state-space model for which a readily available\nforward-backward algorithm provides the target approximation.","PeriodicalId":501215,"journal":{"name":"arXiv - STAT - Computation","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quantile Slice Sampling\",\"authors\":\"Matthew J. Heiner, Samuel B. Johnson, Joshua R. Christensen, David B. Dahl\",\"doi\":\"arxiv-2407.12608\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We propose and demonstrate an alternate, effective approach to simple slice\\nsampling. Using the probability integral transform, we first generalize Neal's\\nshrinkage algorithm, standardizing the procedure to an automatic and universal\\nstarting point: the unit interval. This enables the introduction of approximate\\n(pseudo-) targets through importance reweighting, a technique that has\\npopularized elliptical slice sampling. Reasonably accurate pseudo-targets can\\nboost sampler efficiency by requiring fewer rejections and by reducing target\\nskewness. This strategy is effective when a natural, possibly crude,\\napproximation to the target exists. Alternatively, obtaining a marginal\\npseudo-target from initial samples provides an intuitive and automatic tuning\\nprocedure. We consider two metrics for evaluating the quality of approximation;\\neach can be used as a criterion to find an optimal pseudo-target or as an\\ninterpretable diagnostic. We examine performance of the proposed sampler\\nrelative to other popular, easily implemented MCMC samplers on standard targets\\nin isolation, and as steps within a Gibbs sampler in a Bayesian modeling\\ncontext. We extend the transformation method to multivariate slice samplers and\\ndemonstrate with a constrained state-space model for which a readily available\\nforward-backward algorithm provides the target approximation.\",\"PeriodicalId\":501215,\"journal\":{\"name\":\"arXiv - STAT - Computation\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.12608\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.12608","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
We propose and demonstrate an alternate, effective approach to simple slice
sampling. Using the probability integral transform, we first generalize Neal's
shrinkage algorithm, standardizing the procedure to an automatic and universal
starting point: the unit interval. This enables the introduction of approximate
(pseudo-) targets through importance reweighting, a technique that has
popularized elliptical slice sampling. Reasonably accurate pseudo-targets can
boost sampler efficiency by requiring fewer rejections and by reducing target
skewness. This strategy is effective when a natural, possibly crude,
approximation to the target exists. Alternatively, obtaining a marginal
pseudo-target from initial samples provides an intuitive and automatic tuning
procedure. We consider two metrics for evaluating the quality of approximation;
each can be used as a criterion to find an optimal pseudo-target or as an
interpretable diagnostic. We examine performance of the proposed sampler
relative to other popular, easily implemented MCMC samplers on standard targets
in isolation, and as steps within a Gibbs sampler in a Bayesian modeling
context. We extend the transformation method to multivariate slice samplers and
demonstrate with a constrained state-space model for which a readily available
forward-backward algorithm provides the target approximation.