Shuvayan Banerjee, Radhendushka Srivastava, James Saunderson, Ajit Rajwade
{"title":"小组成员规格错误下的稳健非适应性小组测试","authors":"Shuvayan Banerjee, Radhendushka Srivastava, James Saunderson, Ajit Rajwade","doi":"arxiv-2409.05345","DOIUrl":null,"url":null,"abstract":"Given $p$ samples, each of which may or may not be defective, group testing\n(GT) aims to determine their defect status by performing tests on $n < p$\n`groups', where a group is formed by mixing a subset of the $p$ samples.\nAssuming that the number of defective samples is very small compared to $p$, GT\nalgorithms have provided excellent recovery of the status of all $p$ samples\nwith even a small number of groups. Most existing methods, however, assume that\nthe group memberships are accurately specified. This assumption may not always\nbe true in all applications, due to various resource constraints. Such errors\ncould occur, eg, when a technician, preparing the groups in a laboratory,\nunknowingly mixes together an incorrect subset of samples as compared to what\nwas specified. We develop a new GT method, the Debiased Robust Lasso Test\nMethod (DRLT), that handles such group membership specification errors. The\nproposed DRLT method is based on an approach to debias, or reduce the inherent\nbias in, estimates produced by Lasso, a popular and effective sparse regression\ntechnique. We also provide theoretical upper bounds on the reconstruction error\nproduced by our estimator. Our approach is then combined with two carefully\ndesigned hypothesis tests respectively for (i) the identification of defective\nsamples in the presence of errors in group membership specifications, and (ii)\nthe identification of groups with erroneous membership specifications. The DRLT\napproach extends the literature on bias mitigation of statistical estimators\nsuch as the LASSO, to handle the important case when some of the measurements\ncontain outliers, due to factors such as group membership specification errors.\nWe present numerical results which show that our approach outperforms several\nbaselines and robust regression techniques for identification of defective\nsamples as well as erroneously specified groups.","PeriodicalId":501340,"journal":{"name":"arXiv - STAT - Machine Learning","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust Non-adaptive Group Testing under Errors in Group Membership Specifications\",\"authors\":\"Shuvayan Banerjee, Radhendushka Srivastava, James Saunderson, Ajit Rajwade\",\"doi\":\"arxiv-2409.05345\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Given $p$ samples, each of which may or may not be defective, group testing\\n(GT) aims to determine their defect status by performing tests on $n < p$\\n`groups', where a group is formed by mixing a subset of the $p$ samples.\\nAssuming that the number of defective samples is very small compared to $p$, GT\\nalgorithms have provided excellent recovery of the status of all $p$ samples\\nwith even a small number of groups. Most existing methods, however, assume that\\nthe group memberships are accurately specified. This assumption may not always\\nbe true in all applications, due to various resource constraints. Such errors\\ncould occur, eg, when a technician, preparing the groups in a laboratory,\\nunknowingly mixes together an incorrect subset of samples as compared to what\\nwas specified. We develop a new GT method, the Debiased Robust Lasso Test\\nMethod (DRLT), that handles such group membership specification errors. The\\nproposed DRLT method is based on an approach to debias, or reduce the inherent\\nbias in, estimates produced by Lasso, a popular and effective sparse regression\\ntechnique. We also provide theoretical upper bounds on the reconstruction error\\nproduced by our estimator. Our approach is then combined with two carefully\\ndesigned hypothesis tests respectively for (i) the identification of defective\\nsamples in the presence of errors in group membership specifications, and (ii)\\nthe identification of groups with erroneous membership specifications. The DRLT\\napproach extends the literature on bias mitigation of statistical estimators\\nsuch as the LASSO, to handle the important case when some of the measurements\\ncontain outliers, due to factors such as group membership specification errors.\\nWe present numerical results which show that our approach outperforms several\\nbaselines and robust regression techniques for identification of defective\\nsamples as well as erroneously specified groups.\",\"PeriodicalId\":501340,\"journal\":{\"name\":\"arXiv - STAT - Machine Learning\",\"volume\":\"1 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Machine Learning\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.05345\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Machine Learning","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.05345","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Robust Non-adaptive Group Testing under Errors in Group Membership Specifications
Given $p$ samples, each of which may or may not be defective, group testing
(GT) aims to determine their defect status by performing tests on $n < p$
`groups', where a group is formed by mixing a subset of the $p$ samples.
Assuming that the number of defective samples is very small compared to $p$, GT
algorithms have provided excellent recovery of the status of all $p$ samples
with even a small number of groups. Most existing methods, however, assume that
the group memberships are accurately specified. This assumption may not always
be true in all applications, due to various resource constraints. Such errors
could occur, eg, when a technician, preparing the groups in a laboratory,
unknowingly mixes together an incorrect subset of samples as compared to what
was specified. We develop a new GT method, the Debiased Robust Lasso Test
Method (DRLT), that handles such group membership specification errors. The
proposed DRLT method is based on an approach to debias, or reduce the inherent
bias in, estimates produced by Lasso, a popular and effective sparse regression
technique. We also provide theoretical upper bounds on the reconstruction error
produced by our estimator. Our approach is then combined with two carefully
designed hypothesis tests respectively for (i) the identification of defective
samples in the presence of errors in group membership specifications, and (ii)
the identification of groups with erroneous membership specifications. The DRLT
approach extends the literature on bias mitigation of statistical estimators
such as the LASSO, to handle the important case when some of the measurements
contain outliers, due to factors such as group membership specification errors.
We present numerical results which show that our approach outperforms several
baselines and robust regression techniques for identification of defective
samples as well as erroneously specified groups.