RuiKang OuYang, Bo Qiang, José Miguel Hernández-Lobato
{"title":"BEnDEM:基于引导去噪能量匹配的波尔兹曼采样器","authors":"RuiKang OuYang, Bo Qiang, José Miguel Hernández-Lobato","doi":"arxiv-2409.09787","DOIUrl":null,"url":null,"abstract":"Developing an efficient sampler capable of generating independent and\nidentically distributed (IID) samples from a Boltzmann distribution is a\ncrucial challenge in scientific research, e.g. molecular dynamics. In this\nwork, we intend to learn neural samplers given energy functions instead of data\nsampled from the Boltzmann distribution. By learning the energies of the noised\ndata, we propose a diffusion-based sampler, ENERGY-BASED DENOISING ENERGY\nMATCHING, which theoretically has lower variance and more complexity compared\nto related works. Furthermore, a novel bootstrapping technique is applied to\nEnDEM to balance between bias and variance. We evaluate EnDEM and BEnDEM on a\n2-dimensional 40 Gaussian Mixture Model (GMM) and a 4-particle double-welling\npotential (DW-4). The experimental results demonstrate that BEnDEM can achieve\nstate-of-the-art performance while being more robust.","PeriodicalId":501340,"journal":{"name":"arXiv - STAT - Machine Learning","volume":"47 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"BEnDEM:A Boltzmann Sampler Based on Bootstrapped Denoising Energy Matching\",\"authors\":\"RuiKang OuYang, Bo Qiang, José Miguel Hernández-Lobato\",\"doi\":\"arxiv-2409.09787\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Developing an efficient sampler capable of generating independent and\\nidentically distributed (IID) samples from a Boltzmann distribution is a\\ncrucial challenge in scientific research, e.g. molecular dynamics. In this\\nwork, we intend to learn neural samplers given energy functions instead of data\\nsampled from the Boltzmann distribution. By learning the energies of the noised\\ndata, we propose a diffusion-based sampler, ENERGY-BASED DENOISING ENERGY\\nMATCHING, which theoretically has lower variance and more complexity compared\\nto related works. Furthermore, a novel bootstrapping technique is applied to\\nEnDEM to balance between bias and variance. We evaluate EnDEM and BEnDEM on a\\n2-dimensional 40 Gaussian Mixture Model (GMM) and a 4-particle double-welling\\npotential (DW-4). The experimental results demonstrate that BEnDEM can achieve\\nstate-of-the-art performance while being more robust.\",\"PeriodicalId\":501340,\"journal\":{\"name\":\"arXiv - STAT - Machine Learning\",\"volume\":\"47 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Machine Learning\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09787\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Machine Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09787","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
BEnDEM:A Boltzmann Sampler Based on Bootstrapped Denoising Energy Matching
Developing an efficient sampler capable of generating independent and
identically distributed (IID) samples from a Boltzmann distribution is a
crucial challenge in scientific research, e.g. molecular dynamics. In this
work, we intend to learn neural samplers given energy functions instead of data
sampled from the Boltzmann distribution. By learning the energies of the noised
data, we propose a diffusion-based sampler, ENERGY-BASED DENOISING ENERGY
MATCHING, which theoretically has lower variance and more complexity compared
to related works. Furthermore, a novel bootstrapping technique is applied to
EnDEM to balance between bias and variance. We evaluate EnDEM and BEnDEM on a
2-dimensional 40 Gaussian Mixture Model (GMM) and a 4-particle double-welling
potential (DW-4). The experimental results demonstrate that BEnDEM can achieve
state-of-the-art performance while being more robust.