{"title":"多变量高斯源与加性噪声互信息的次模性","authors":"George Crowley, Inaki Esnaola","doi":"arxiv-2409.03541","DOIUrl":null,"url":null,"abstract":"Sensor placement approaches in networks often involve using\ninformation-theoretic measures such as entropy and mutual information. We prove\nthat mutual information abides by submodularity and is non-decreasing when\nconsidering the mutual information between the states of the network and a\nsubset of $k$ nodes subjected to additive white Gaussian noise. We prove this\nunder the assumption that the states follow a non-degenerate multivariate\nGaussian distribution.","PeriodicalId":501082,"journal":{"name":"arXiv - MATH - Information Theory","volume":"297 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Submodularity of Mutual Information for Multivariate Gaussian Sources with Additive Noise\",\"authors\":\"George Crowley, Inaki Esnaola\",\"doi\":\"arxiv-2409.03541\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Sensor placement approaches in networks often involve using\\ninformation-theoretic measures such as entropy and mutual information. We prove\\nthat mutual information abides by submodularity and is non-decreasing when\\nconsidering the mutual information between the states of the network and a\\nsubset of $k$ nodes subjected to additive white Gaussian noise. We prove this\\nunder the assumption that the states follow a non-degenerate multivariate\\nGaussian distribution.\",\"PeriodicalId\":501082,\"journal\":{\"name\":\"arXiv - MATH - Information Theory\",\"volume\":\"297 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - MATH - Information Theory\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.03541\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - MATH - Information Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.03541","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Submodularity of Mutual Information for Multivariate Gaussian Sources with Additive Noise
Sensor placement approaches in networks often involve using
information-theoretic measures such as entropy and mutual information. We prove
that mutual information abides by submodularity and is non-decreasing when
considering the mutual information between the states of the network and a
subset of $k$ nodes subjected to additive white Gaussian noise. We prove this
under the assumption that the states follow a non-degenerate multivariate
Gaussian distribution.