Felix J Dorfner, Janis L Vahldiek, Leonhard Donle, Andrei Zhukov, Lina Xu, Hartmut Häntze, Marcus R Makowski, Hugo J W L Aerts, Fabian Proft, Valeria Rios Rodriguez, Judith Rademacher, Mikhail Protopopov, Hildrun Haibel, Kay-Geert Hermann, Torsten Diekhoff, Lisa C Adams, Murat Torgutalp, Denis Poddubnyy, Keno K Bressem
{"title":"以解剖为中心的深度学习提高了骶髂炎放射学检测的通用性和进展预测。","authors":"Felix J Dorfner, Janis L Vahldiek, Leonhard Donle, Andrei Zhukov, Lina Xu, Hartmut Häntze, Marcus R Makowski, Hugo J W L Aerts, Fabian Proft, Valeria Rios Rodriguez, Judith Rademacher, Mikhail Protopopov, Hildrun Haibel, Kay-Geert Hermann, Torsten Diekhoff, Lisa C Adams, Murat Torgutalp, Denis Poddubnyy, Keno K Bressem","doi":"10.1136/rmdopen-2024-004628","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To examine whether incorporating anatomy-centred deep learning can improve generalisability and enable prediction of disease progression.</p><p><strong>Methods: </strong>This retrospective multicentre study included conventional pelvic radiographs of four different patient cohorts focusing on axial spondyloarthritis collected at university and community hospitals. The first cohort, which consisted of 1483 radiographs, was split into training (n=1261) and validation (n=222) sets. The other cohorts comprising 436, 340 and 163 patients, respectively, were used as independent test datasets. For the second cohort, follow-up data of 311 patients was used to examine progression prediction capabilities. Two neural networks were trained, one on images cropped to the bounding box of the sacroiliac joints (anatomy-centred) and the other one on full radiographs. The performance of the models was compared using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity and specificity.</p><p><strong>Results: </strong>On the three test datasets, the standard model achieved AUC scores of 0.853, 0.817, 0.947, with an accuracy of 0.770, 0.724, 0.850. Whereas the anatomy-centred model achieved AUC scores of 0.899, 0.846, 0.957, with an accuracy of 0.821, 0.744, 0.906, respectively. The patients who were identified as high risk by the anatomy-centred model had an OR of 2.16 (95% CI 1.19, 3.86) for having progression of radiographic sacroiliitis within 2 years.</p><p><strong>Conclusion: </strong>Anatomy-centred deep learning can improve the generalisability of models in detecting radiographic sacroiliitis. The model is published as fully open source alongside this study.</p>","PeriodicalId":21396,"journal":{"name":"RMD Open","volume":"10 4","pages":""},"PeriodicalIF":5.1000,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751840/pdf/","citationCount":"0","resultStr":"{\"title\":\"Anatomy-centred deep learning improves generalisability and progression prediction in radiographic sacroiliitis detection.\",\"authors\":\"Felix J Dorfner, Janis L Vahldiek, Leonhard Donle, Andrei Zhukov, Lina Xu, Hartmut Häntze, Marcus R Makowski, Hugo J W L Aerts, Fabian Proft, Valeria Rios Rodriguez, Judith Rademacher, Mikhail Protopopov, Hildrun Haibel, Kay-Geert Hermann, Torsten Diekhoff, Lisa C Adams, Murat Torgutalp, Denis Poddubnyy, Keno K Bressem\",\"doi\":\"10.1136/rmdopen-2024-004628\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>To examine whether incorporating anatomy-centred deep learning can improve generalisability and enable prediction of disease progression.</p><p><strong>Methods: </strong>This retrospective multicentre study included conventional pelvic radiographs of four different patient cohorts focusing on axial spondyloarthritis collected at university and community hospitals. The first cohort, which consisted of 1483 radiographs, was split into training (n=1261) and validation (n=222) sets. The other cohorts comprising 436, 340 and 163 patients, respectively, were used as independent test datasets. For the second cohort, follow-up data of 311 patients was used to examine progression prediction capabilities. Two neural networks were trained, one on images cropped to the bounding box of the sacroiliac joints (anatomy-centred) and the other one on full radiographs. The performance of the models was compared using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity and specificity.</p><p><strong>Results: </strong>On the three test datasets, the standard model achieved AUC scores of 0.853, 0.817, 0.947, with an accuracy of 0.770, 0.724, 0.850. Whereas the anatomy-centred model achieved AUC scores of 0.899, 0.846, 0.957, with an accuracy of 0.821, 0.744, 0.906, respectively. The patients who were identified as high risk by the anatomy-centred model had an OR of 2.16 (95% CI 1.19, 3.86) for having progression of radiographic sacroiliitis within 2 years.</p><p><strong>Conclusion: </strong>Anatomy-centred deep learning can improve the generalisability of models in detecting radiographic sacroiliitis. The model is published as fully open source alongside this study.</p>\",\"PeriodicalId\":21396,\"journal\":{\"name\":\"RMD Open\",\"volume\":\"10 4\",\"pages\":\"\"},\"PeriodicalIF\":5.1000,\"publicationDate\":\"2024-12-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11751840/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"RMD Open\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1136/rmdopen-2024-004628\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"RHEUMATOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"RMD Open","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/rmdopen-2024-004628","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RHEUMATOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的:研究结合以解剖为中心的深度学习是否可以提高通用性并能够预测疾病进展。方法:这项回顾性多中心研究包括在大学和社区医院收集的四个不同的轴型脊柱炎患者队列的常规骨盆x线片。第一个队列包括1483张x线片,分为训练组(n=1261)和验证组(n=222)。其他队列分别包括436、340和163名患者,作为独立的测试数据集。对于第二队列,311例患者的随访数据用于检查进展预测能力。两个神经网络被训练,一个在裁剪到骶髂关节边界框的图像上(以解剖学为中心),另一个在完整的x光片上。采用受试者工作特征曲线下面积(AUC)、准确度、灵敏度和特异性对模型的性能进行比较。结果:在三个测试数据集上,标准模型的AUC得分分别为0.853、0.817、0.947,准确率分别为0.770、0.724、0.850。而以解剖为中心的模型AUC得分分别为0.899、0.846、0.957,准确率分别为0.821、0.744、0.906。通过以解剖为中心的模型确定为高风险的患者在2年内发生影像学骶髂炎进展的OR为2.16 (95% CI 1.19, 3.86)。结论:以解剖为中心的深度学习可提高骶髂炎影像学检测模型的通用性。该模型与本研究一起作为完全开源发布。
Anatomy-centred deep learning improves generalisability and progression prediction in radiographic sacroiliitis detection.
Purpose: To examine whether incorporating anatomy-centred deep learning can improve generalisability and enable prediction of disease progression.
Methods: This retrospective multicentre study included conventional pelvic radiographs of four different patient cohorts focusing on axial spondyloarthritis collected at university and community hospitals. The first cohort, which consisted of 1483 radiographs, was split into training (n=1261) and validation (n=222) sets. The other cohorts comprising 436, 340 and 163 patients, respectively, were used as independent test datasets. For the second cohort, follow-up data of 311 patients was used to examine progression prediction capabilities. Two neural networks were trained, one on images cropped to the bounding box of the sacroiliac joints (anatomy-centred) and the other one on full radiographs. The performance of the models was compared using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity and specificity.
Results: On the three test datasets, the standard model achieved AUC scores of 0.853, 0.817, 0.947, with an accuracy of 0.770, 0.724, 0.850. Whereas the anatomy-centred model achieved AUC scores of 0.899, 0.846, 0.957, with an accuracy of 0.821, 0.744, 0.906, respectively. The patients who were identified as high risk by the anatomy-centred model had an OR of 2.16 (95% CI 1.19, 3.86) for having progression of radiographic sacroiliitis within 2 years.
Conclusion: Anatomy-centred deep learning can improve the generalisability of models in detecting radiographic sacroiliitis. The model is published as fully open source alongside this study.
期刊介绍:
RMD Open publishes high quality peer-reviewed original research covering the full spectrum of musculoskeletal disorders, rheumatism and connective tissue diseases, including osteoporosis, spine and rehabilitation. Clinical and epidemiological research, basic and translational medicine, interesting clinical cases, and smaller studies that add to the literature are all considered.