Yuntong Ma, Ian Pan, Stanley Y Kim, Ged G Wieschhoff, Katherine P Andriole, Jacob C Mandell
{"title":"Deep learning discrimination of rheumatoid arthritis from osteoarthritis on hand radiography.","authors":"Yuntong Ma, Ian Pan, Stanley Y Kim, Ged G Wieschhoff, Katherine P Andriole, Jacob C Mandell","doi":"10.1007/s00256-023-04408-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To develop a deep learning model to distinguish rheumatoid arthritis (RA) from osteoarthritis (OA) using hand radiographs and to evaluate the effects of changing pretraining and training parameters on model performance.</p><p><strong>Materials and methods: </strong>A convolutional neural network was retrospectively trained on 9714 hand radiograph exams from 8387 patients obtained from 2017 to 2021 at seven hospitals within an integrated healthcare network. Performance was assessed using an independent test set of 250 exams from 146 patients. Binary discriminatory capacity (no arthritis versus arthritis; RA versus not RA) and three-way classification (no arthritis versus OA versus RA) were evaluated. The effects of additional pretraining using musculoskeletal radiographs, using all views as opposed to only the posteroanterior view, and varying image resolution on model performance were also investigated. Area under the receiver operating characteristic curve (AUC) and Cohen's kappa coefficient were used to evaluate diagnostic performance.</p><p><strong>Results: </strong>For no arthritis versus arthritis, the model achieved an AUC of 0.975 (95% CI: 0.957, 0.989). For RA versus not RA, the model achieved an AUC of 0.955 (95% CI: 0.919, 0.983). For three-way classification, the model achieved a kappa of 0.806 (95% CI: 0.742, 0.866) and accuracy of 87.2% (95% CI: 83.2%, 91.2%) on the test set. Increasing image resolution increased performance up to 1024 × 1024 pixels. Additional pretraining on musculoskeletal radiographs and using all views did not significantly affect performance.</p><p><strong>Conclusion: </strong>A deep learning model can be used to distinguish no arthritis, OA, and RA on hand radiographs with high performance.</p>","PeriodicalId":21783,"journal":{"name":"Skeletal Radiology","volume":" ","pages":"377-383"},"PeriodicalIF":1.9000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Skeletal Radiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00256-023-04408-2","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/8/2 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: To develop a deep learning model to distinguish rheumatoid arthritis (RA) from osteoarthritis (OA) using hand radiographs and to evaluate the effects of changing pretraining and training parameters on model performance.
Materials and methods: A convolutional neural network was retrospectively trained on 9714 hand radiograph exams from 8387 patients obtained from 2017 to 2021 at seven hospitals within an integrated healthcare network. Performance was assessed using an independent test set of 250 exams from 146 patients. Binary discriminatory capacity (no arthritis versus arthritis; RA versus not RA) and three-way classification (no arthritis versus OA versus RA) were evaluated. The effects of additional pretraining using musculoskeletal radiographs, using all views as opposed to only the posteroanterior view, and varying image resolution on model performance were also investigated. Area under the receiver operating characteristic curve (AUC) and Cohen's kappa coefficient were used to evaluate diagnostic performance.
Results: For no arthritis versus arthritis, the model achieved an AUC of 0.975 (95% CI: 0.957, 0.989). For RA versus not RA, the model achieved an AUC of 0.955 (95% CI: 0.919, 0.983). For three-way classification, the model achieved a kappa of 0.806 (95% CI: 0.742, 0.866) and accuracy of 87.2% (95% CI: 83.2%, 91.2%) on the test set. Increasing image resolution increased performance up to 1024 × 1024 pixels. Additional pretraining on musculoskeletal radiographs and using all views did not significantly affect performance.
Conclusion: A deep learning model can be used to distinguish no arthritis, OA, and RA on hand radiographs with high performance.
期刊介绍:
Skeletal Radiology provides a forum for the dissemination of current knowledge and information dealing with disorders of the musculoskeletal system including the spine. While emphasizing the radiological aspects of the many varied skeletal abnormalities, the journal also adopts an interdisciplinary approach, reflecting the membership of the International Skeletal Society. Thus, the anatomical, pathological, physiological, clinical, metabolic and epidemiological aspects of the many entities affecting the skeleton receive appropriate consideration.
This is the Journal of the International Skeletal Society and the Official Journal of the Society of Skeletal Radiology and the Australasian Musculoskelelal Imaging Group.