Jiyang Wang, Wanfeng Liang, Lijie Li, Yue Wu, Xiaoyan Ma
{"title":"用于高维微生物组数据的新型鲁棒协方差矩阵估算法","authors":"Jiyang Wang, Wanfeng Liang, Lijie Li, Yue Wu, Xiaoyan Ma","doi":"10.1111/anzs.12415","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Microbiome data typically lie in a high-dimensional simplex. One of the key questions in metagenomic analysis is to exploit the covariance structure for this kind of data. In this paper, a framework called approximate-estimate-threshold (AET) is developed for the robust basis covariance estimation for high-dimensional microbiome data. To be specific, we first construct a proxy matrix <span></span><math>\n <semantics>\n <mrow>\n <mi>Γ</mi>\n </mrow>\n <annotation>$$ \\boldsymbol{\\Gamma} $$</annotation>\n </semantics></math>, which is almost indistinguishable from the real basis covariance matrix <span></span><math>\n <semantics>\n <mrow>\n <mi>∑</mi>\n </mrow>\n <annotation>$$ \\boldsymbol{\\Sigma} $$</annotation>\n </semantics></math>. Then, any estimator <span></span><math>\n <semantics>\n <mrow>\n <mover>\n <mrow>\n <mi>Γ</mi>\n </mrow>\n <mo>^</mo>\n </mover>\n </mrow>\n <annotation>$$ \\hat{\\boldsymbol{\\Gamma}} $$</annotation>\n </semantics></math> satisfying some conditions can be used to estimate <span></span><math>\n <semantics>\n <mrow>\n <mi>Γ</mi>\n </mrow>\n <annotation>$$ \\boldsymbol{\\Gamma} $$</annotation>\n </semantics></math>. Finally, we impose a thresholding step on <span></span><math>\n <semantics>\n <mrow>\n <mover>\n <mrow>\n <mi>Γ</mi>\n </mrow>\n <mo>^</mo>\n </mover>\n </mrow>\n <annotation>$$ \\hat{\\boldsymbol{\\Gamma}} $$</annotation>\n </semantics></math> to obtain the final estimator <span></span><math>\n <semantics>\n <mrow>\n <mover>\n <mrow>\n <mi>∑</mi>\n </mrow>\n <mo>^</mo>\n </mover>\n </mrow>\n <annotation>$$ \\hat{\\boldsymbol{\\Sigma}} $$</annotation>\n </semantics></math>. In particular, this paper applies a Huber-type estimator <span></span><math>\n <semantics>\n <mrow>\n <mover>\n <mrow>\n <mi>Γ</mi>\n </mrow>\n <mo>^</mo>\n </mover>\n </mrow>\n <annotation>$$ \\hat{\\boldsymbol{\\Gamma}} $$</annotation>\n </semantics></math>, and achieves robustness by only requiring the boundedness of 2+<span></span><math>\n <semantics>\n <mrow>\n <mi>ϵ</mi>\n </mrow>\n <annotation>$$ \\epsilon $$</annotation>\n </semantics></math> moments for some <span></span><math>\n <semantics>\n <mrow>\n <mi>ϵ</mi>\n <mo>∈</mo>\n <mo>(</mo>\n <mn>0</mn>\n <mo>,</mo>\n <mn>2</mn>\n <mo>]</mo>\n </mrow>\n <annotation>$$ \\epsilon \\in \\left(0,2\\right] $$</annotation>\n </semantics></math>. We derive the convergence rate of <span></span><math>\n <semantics>\n <mrow>\n <mover>\n <mrow>\n <mi>∑</mi>\n </mrow>\n <mo>^</mo>\n </mover>\n </mrow>\n <annotation>$$ \\hat{\\boldsymbol{\\Sigma}} $$</annotation>\n </semantics></math> under the spectral norm, and provide theoretical guarantees on support recovery. Extensive simulations and a real example are used to illustrate the empirical performance of our method.</p>\n </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":"66 2","pages":"281-295"},"PeriodicalIF":0.8000,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A new robust covariance matrix estimation for high-dimensional microbiome data\",\"authors\":\"Jiyang Wang, Wanfeng Liang, Lijie Li, Yue Wu, Xiaoyan Ma\",\"doi\":\"10.1111/anzs.12415\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>Microbiome data typically lie in a high-dimensional simplex. One of the key questions in metagenomic analysis is to exploit the covariance structure for this kind of data. In this paper, a framework called approximate-estimate-threshold (AET) is developed for the robust basis covariance estimation for high-dimensional microbiome data. To be specific, we first construct a proxy matrix <span></span><math>\\n <semantics>\\n <mrow>\\n <mi>Γ</mi>\\n </mrow>\\n <annotation>$$ \\\\boldsymbol{\\\\Gamma} $$</annotation>\\n </semantics></math>, which is almost indistinguishable from the real basis covariance matrix <span></span><math>\\n <semantics>\\n <mrow>\\n <mi>∑</mi>\\n </mrow>\\n <annotation>$$ \\\\boldsymbol{\\\\Sigma} $$</annotation>\\n </semantics></math>. Then, any estimator <span></span><math>\\n <semantics>\\n <mrow>\\n <mover>\\n <mrow>\\n <mi>Γ</mi>\\n </mrow>\\n <mo>^</mo>\\n </mover>\\n </mrow>\\n <annotation>$$ \\\\hat{\\\\boldsymbol{\\\\Gamma}} $$</annotation>\\n </semantics></math> satisfying some conditions can be used to estimate <span></span><math>\\n <semantics>\\n <mrow>\\n <mi>Γ</mi>\\n </mrow>\\n <annotation>$$ \\\\boldsymbol{\\\\Gamma} $$</annotation>\\n </semantics></math>. Finally, we impose a thresholding step on <span></span><math>\\n <semantics>\\n <mrow>\\n <mover>\\n <mrow>\\n <mi>Γ</mi>\\n </mrow>\\n <mo>^</mo>\\n </mover>\\n </mrow>\\n <annotation>$$ \\\\hat{\\\\boldsymbol{\\\\Gamma}} $$</annotation>\\n </semantics></math> to obtain the final estimator <span></span><math>\\n <semantics>\\n <mrow>\\n <mover>\\n <mrow>\\n <mi>∑</mi>\\n </mrow>\\n <mo>^</mo>\\n </mover>\\n </mrow>\\n <annotation>$$ \\\\hat{\\\\boldsymbol{\\\\Sigma}} $$</annotation>\\n </semantics></math>. In particular, this paper applies a Huber-type estimator <span></span><math>\\n <semantics>\\n <mrow>\\n <mover>\\n <mrow>\\n <mi>Γ</mi>\\n </mrow>\\n <mo>^</mo>\\n </mover>\\n </mrow>\\n <annotation>$$ \\\\hat{\\\\boldsymbol{\\\\Gamma}} $$</annotation>\\n </semantics></math>, and achieves robustness by only requiring the boundedness of 2+<span></span><math>\\n <semantics>\\n <mrow>\\n <mi>ϵ</mi>\\n </mrow>\\n <annotation>$$ \\\\epsilon $$</annotation>\\n </semantics></math> moments for some <span></span><math>\\n <semantics>\\n <mrow>\\n <mi>ϵ</mi>\\n <mo>∈</mo>\\n <mo>(</mo>\\n <mn>0</mn>\\n <mo>,</mo>\\n <mn>2</mn>\\n <mo>]</mo>\\n </mrow>\\n <annotation>$$ \\\\epsilon \\\\in \\\\left(0,2\\\\right] $$</annotation>\\n </semantics></math>. We derive the convergence rate of <span></span><math>\\n <semantics>\\n <mrow>\\n <mover>\\n <mrow>\\n <mi>∑</mi>\\n </mrow>\\n <mo>^</mo>\\n </mover>\\n </mrow>\\n <annotation>$$ \\\\hat{\\\\boldsymbol{\\\\Sigma}} $$</annotation>\\n </semantics></math> under the spectral norm, and provide theoretical guarantees on support recovery. Extensive simulations and a real example are used to illustrate the empirical performance of our method.</p>\\n </div>\",\"PeriodicalId\":55428,\"journal\":{\"name\":\"Australian & New Zealand Journal of Statistics\",\"volume\":\"66 2\",\"pages\":\"281-295\"},\"PeriodicalIF\":0.8000,\"publicationDate\":\"2024-05-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Australian & New Zealand Journal of Statistics\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/anzs.12415\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"STATISTICS & PROBABILITY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Australian & New Zealand Journal of Statistics","FirstCategoryId":"100","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/anzs.12415","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
A new robust covariance matrix estimation for high-dimensional microbiome data
Microbiome data typically lie in a high-dimensional simplex. One of the key questions in metagenomic analysis is to exploit the covariance structure for this kind of data. In this paper, a framework called approximate-estimate-threshold (AET) is developed for the robust basis covariance estimation for high-dimensional microbiome data. To be specific, we first construct a proxy matrix , which is almost indistinguishable from the real basis covariance matrix . Then, any estimator satisfying some conditions can be used to estimate . Finally, we impose a thresholding step on to obtain the final estimator . In particular, this paper applies a Huber-type estimator , and achieves robustness by only requiring the boundedness of 2+ moments for some . We derive the convergence rate of under the spectral norm, and provide theoretical guarantees on support recovery. Extensive simulations and a real example are used to illustrate the empirical performance of our method.
期刊介绍:
The Australian & New Zealand Journal of Statistics is an international journal managed jointly by the Statistical Society of Australia and the New Zealand Statistical Association. Its purpose is to report significant and novel contributions in statistics, ranging across articles on statistical theory, methodology, applications and computing. The journal has a particular focus on statistical techniques that can be readily applied to real-world problems, and on application papers with an Australasian emphasis. Outstanding articles submitted to the journal may be selected as Discussion Papers, to be read at a meeting of either the Statistical Society of Australia or the New Zealand Statistical Association.
The main body of the journal is divided into three sections.
The Theory and Methods Section publishes papers containing original contributions to the theory and methodology of statistics, econometrics and probability, and seeks papers motivated by a real problem and which demonstrate the proposed theory or methodology in that situation. There is a strong preference for papers motivated by, and illustrated with, real data.
The Applications Section publishes papers demonstrating applications of statistical techniques to problems faced by users of statistics in the sciences, government and industry. A particular focus is the application of newly developed statistical methodology to real data and the demonstration of better use of established statistical methodology in an area of application. It seeks to aid teachers of statistics by placing statistical methods in context.
The Statistical Computing Section publishes papers containing new algorithms, code snippets, or software descriptions (for open source software only) which enhance the field through the application of computing. Preference is given to papers featuring publically available code and/or data, and to those motivated by statistical methods for practical problems.