Harendra Guturu, Andrew Nichols, Lee S. Cantrell, Seth Just, János Kis, Theodore Platt, Iman Mohtashemi, Jian Wang, Serafim Batzoglou
{"title":"大型蛋白质组学群组的云端可扩展分析","authors":"Harendra Guturu, Andrew Nichols, Lee S. Cantrell, Seth Just, János Kis, Theodore Platt, Iman Mohtashemi, Jian Wang, Serafim Batzoglou","doi":"10.1101/2024.09.05.611509","DOIUrl":null,"url":null,"abstract":"Rapid advances in depth and throughput of untargeted mass-spectrometry-based proteomic technologies are enabling large-scale cohort proteomic and proteogenomic analyses. As such studies scale, the data infrastructure and search engines required to process data must also scale. This challenge is amplified in search engines that rely on library-free match between runs (MBR) search, which enable enhanced depth-per-sample and data completeness. However, to-date, no MBR-based search could scale to process cohorts of thousands or more individuals. Here, we present a strategy to deploy search engines in a distributed cloud environment without source code modification, thereby enhancing resource scalability and throughput. Additionally, we present an algorithm, Scalable MBR, that replicates the MBR procedure of the popular DIA-NN software for scalability to thousands of samples. We demonstrate that Scalable MBR can search thousands of MS raw files in a few hours compared to days required for the original DIA-NN MBR procedure and demonstrate that the results are almost indistinguishable to those of DIA-NN native MBR. The method has been tested to scale to over 15,000 injections and is available for use in the Proteograph(TM) Analysis Suite.","PeriodicalId":501307,"journal":{"name":"bioRxiv - Bioinformatics","volume":"35 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cloud-enabled Scalable Analysis of Large Proteomics Cohorts\",\"authors\":\"Harendra Guturu, Andrew Nichols, Lee S. Cantrell, Seth Just, János Kis, Theodore Platt, Iman Mohtashemi, Jian Wang, Serafim Batzoglou\",\"doi\":\"10.1101/2024.09.05.611509\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Rapid advances in depth and throughput of untargeted mass-spectrometry-based proteomic technologies are enabling large-scale cohort proteomic and proteogenomic analyses. As such studies scale, the data infrastructure and search engines required to process data must also scale. This challenge is amplified in search engines that rely on library-free match between runs (MBR) search, which enable enhanced depth-per-sample and data completeness. However, to-date, no MBR-based search could scale to process cohorts of thousands or more individuals. Here, we present a strategy to deploy search engines in a distributed cloud environment without source code modification, thereby enhancing resource scalability and throughput. Additionally, we present an algorithm, Scalable MBR, that replicates the MBR procedure of the popular DIA-NN software for scalability to thousands of samples. We demonstrate that Scalable MBR can search thousands of MS raw files in a few hours compared to days required for the original DIA-NN MBR procedure and demonstrate that the results are almost indistinguishable to those of DIA-NN native MBR. The method has been tested to scale to over 15,000 injections and is available for use in the Proteograph(TM) Analysis Suite.\",\"PeriodicalId\":501307,\"journal\":{\"name\":\"bioRxiv - Bioinformatics\",\"volume\":\"35 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"bioRxiv - Bioinformatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2024.09.05.611509\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"bioRxiv - Bioinformatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.09.05.611509","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Cloud-enabled Scalable Analysis of Large Proteomics Cohorts
Rapid advances in depth and throughput of untargeted mass-spectrometry-based proteomic technologies are enabling large-scale cohort proteomic and proteogenomic analyses. As such studies scale, the data infrastructure and search engines required to process data must also scale. This challenge is amplified in search engines that rely on library-free match between runs (MBR) search, which enable enhanced depth-per-sample and data completeness. However, to-date, no MBR-based search could scale to process cohorts of thousands or more individuals. Here, we present a strategy to deploy search engines in a distributed cloud environment without source code modification, thereby enhancing resource scalability and throughput. Additionally, we present an algorithm, Scalable MBR, that replicates the MBR procedure of the popular DIA-NN software for scalability to thousands of samples. We demonstrate that Scalable MBR can search thousands of MS raw files in a few hours compared to days required for the original DIA-NN MBR procedure and demonstrate that the results are almost indistinguishable to those of DIA-NN native MBR. The method has been tested to scale to over 15,000 injections and is available for use in the Proteograph(TM) Analysis Suite.