Mengtian Shi, Chiyuan Huang, Renhui Chen, David Da Yong Chen, Binjun Yan
{"title":"A New Evaluation Metric for Quantitative Accuracy of LC-MS/MS-Based Proteomics with Data-Independent Acquisition.","authors":"Mengtian Shi, Chiyuan Huang, Renhui Chen, David Da Yong Chen, Binjun Yan","doi":"10.1021/acs.jproteome.4c00088","DOIUrl":null,"url":null,"abstract":"<p><p>Data-independent acquisition (DIA) has improved the identification and quantitation coverage of peptides and proteins in liquid chromatography-tandem mass spectrometry-based proteomics. However, different DIA data-processing tools can produce very different identification and quantitation results for the same data set. Currently, benchmarking studies of DIA tools are predominantly focused on comparing the identification results, while the quantitative accuracy of DIA measurements is acknowledged to be important but insufficiently investigated, and the absence of suitable metrics for comparing quantitative accuracy is one of the reasons. A new metric is proposed for the evaluation of quantitative accuracy to avoid the influence of differences in false discovery rate control stringency. The part of the quantitation results with high reliability was acquired from each DIA tool first, and the quantitative accuracy was evaluated by comparing quantification error rates at the same number of accurate ratios. From the results of four benchmark data sets, the proposed metric was shown to be more sensitive to discriminating the quantitative performance of DIA tools. Moreover, the DIA tools with advantages in quantitative accuracy were consistently revealed by this metric. The proposed metric can also help researchers in optimizing algorithms of the same DIA tool and sample preprocessing methods to enhance quantitative accuracy.</p>","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.1021/acs.jproteome.4c00088","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/8/28 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Data-independent acquisition (DIA) has improved the identification and quantitation coverage of peptides and proteins in liquid chromatography-tandem mass spectrometry-based proteomics. However, different DIA data-processing tools can produce very different identification and quantitation results for the same data set. Currently, benchmarking studies of DIA tools are predominantly focused on comparing the identification results, while the quantitative accuracy of DIA measurements is acknowledged to be important but insufficiently investigated, and the absence of suitable metrics for comparing quantitative accuracy is one of the reasons. A new metric is proposed for the evaluation of quantitative accuracy to avoid the influence of differences in false discovery rate control stringency. The part of the quantitation results with high reliability was acquired from each DIA tool first, and the quantitative accuracy was evaluated by comparing quantification error rates at the same number of accurate ratios. From the results of four benchmark data sets, the proposed metric was shown to be more sensitive to discriminating the quantitative performance of DIA tools. Moreover, the DIA tools with advantages in quantitative accuracy were consistently revealed by this metric. The proposed metric can also help researchers in optimizing algorithms of the same DIA tool and sample preprocessing methods to enhance quantitative accuracy.
数据独立采集(DIA)提高了基于液相色谱-串联质谱的蛋白质组学中肽段和蛋白质的鉴定和定量覆盖率。然而,不同的 DIA 数据处理工具会对同一数据集产生截然不同的鉴定和定量结果。目前,DIA 工具的基准研究主要集中在鉴定结果的比较上,而 DIA 测量的定量准确性虽然被认为很重要,但却没有得到充分的研究,原因之一就是缺乏比较定量准确性的合适指标。本文提出了一种新的定量准确度评估指标,以避免误发现率控制严格程度差异的影响。首先从每个 DIA 工具中获取可靠性高的那部分定量结果,然后通过比较相同准确比率数量下的定量错误率来评估定量准确性。从四个基准数据集的结果来看,所提出的指标在区分 DIA 工具的定量性能方面更为灵敏。此外,该指标还能持续显示在定量准确性方面具有优势的 DIA 工具。该指标还有助于研究人员优化同一 DIA 工具的算法和样本预处理方法,以提高定量准确性。