{"title":"Estimating Protein Complex Model Accuracy Using Graph Transformers and Pairwise Similarity Graphs.","authors":"Jian Liu, Pawan Neupane, Jianlin Cheng","doi":"10.1101/2025.02.04.636562","DOIUrl":null,"url":null,"abstract":"<p><strong>Motivation: </strong>Estimation of protein complex structure accuracy is an essential step in protein complex structure prediction and is also important for users to select good structural models for various applications, such as protein function analysis and drug design. Despite the success of structure prediction methods such as AlphaFold2 and AlphaFold3, predicting the quality of predicted complex structures (structural models) and selecting top ones from large model pools remains challenging.</p><p><strong>Results: </strong>We present GATE, a novel method that uses graph transformers on pairwise model similarity graphs to predict the quality (accuracy) of complex structural models. By integrating single-model and multi-model quality features, GATE captures both the characteristics of individual models and the geometric similarity between them to make robust predictions. On the dataset of the 15th Critical Assessment of Protein Structure Prediction (CASP15), GATE achieved the highest Pearson's correlation (0.748) and the lowest ranking loss (0.1191) compared to existing methods. In the blind CASP16 experiment, GATE was ranked 4th according to the overall sum of z-scores of multiple metrics based on both TM-score and Oligo-GDTTS scores. In terms of per-target average metrics based on TM-score, GATE achieved a Pearson's correlation of 0.7076 (1st place among all methods), a Spearman's correlation of 0.4514 (3rd place), a ranking loss of 0.1221 (3rd place), and an Area Under the Curve (AUC) score of 0.6680 (3rd place), highlighting its strong, balanced ability of estimating complex model accuracy and selecting good models.</p><p><strong>Availability: </strong>The source code of GATE is freely available at https://github.com/BioinfoMachineLearning/GATE.</p>","PeriodicalId":519960,"journal":{"name":"bioRxiv : the preprint server for biology","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11838578/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"bioRxiv : the preprint server for biology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2025.02.04.636562","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Motivation: Estimation of protein complex structure accuracy is an essential step in protein complex structure prediction and is also important for users to select good structural models for various applications, such as protein function analysis and drug design. Despite the success of structure prediction methods such as AlphaFold2 and AlphaFold3, predicting the quality of predicted complex structures (structural models) and selecting top ones from large model pools remains challenging.
Results: We present GATE, a novel method that uses graph transformers on pairwise model similarity graphs to predict the quality (accuracy) of complex structural models. By integrating single-model and multi-model quality features, GATE captures both the characteristics of individual models and the geometric similarity between them to make robust predictions. On the dataset of the 15th Critical Assessment of Protein Structure Prediction (CASP15), GATE achieved the highest Pearson's correlation (0.748) and the lowest ranking loss (0.1191) compared to existing methods. In the blind CASP16 experiment, GATE was ranked 4th according to the overall sum of z-scores of multiple metrics based on both TM-score and Oligo-GDTTS scores. In terms of per-target average metrics based on TM-score, GATE achieved a Pearson's correlation of 0.7076 (1st place among all methods), a Spearman's correlation of 0.4514 (3rd place), a ranking loss of 0.1221 (3rd place), and an Area Under the Curve (AUC) score of 0.6680 (3rd place), highlighting its strong, balanced ability of estimating complex model accuracy and selecting good models.
Availability: The source code of GATE is freely available at https://github.com/BioinfoMachineLearning/GATE.
动机:蛋白质复合体结构精度的估计是蛋白质复合体结构预测的重要步骤,对于用户在蛋白质功能分析和药物设计等各种应用中选择良好的结构模型也很重要。尽管AlphaFold2和AlphaFold3等结构预测方法取得了成功,但预测预测的复杂结构(结构模型)的质量并从大型模型池中选择最佳模型仍然具有挑战性。结果:我们提出了GATE,这是一种利用两两模型相似图上的图变换来预测复杂结构模型质量(精度)的新方法。通过整合单模型和多模型的质量特征,GATE既能捕获单个模型的特征,又能捕获它们之间的几何相似性,从而做出稳健的预测。在第15次蛋白质结构预测关键评估(CASP15)数据集上,与现有方法相比,GATE获得了最高的Pearson’s相关性(0.748)和最低的排序损失(0.1191)。在盲法CASP16实验中,GATE在TM-score和Oligo-GDTTS评分的基础上,根据多个指标的z得分总和排名第4。在基于TM-score的每目标平均指标方面,GATE的Pearson相关系数为0.7076(所有方法中排名第一),Spearman相关系数为0.4514(排名第三),排名损失为0.1221(排名第三),曲线下面积(Area Under the Curve, AUC)得分为0.6680(排名第三),突出了GATE在估计复杂模型精度和选择良好模型方面具有较强的平衡能力。可用性:GATE的源代码可以在https://github.com/BioinfoMachineLearning/GATE上免费获得。