Victory Fabian Edem, Esin Nkereuwem, Schadrac C Agbla, Sheila A Owusu, Abdou K Sillah, Binta Saidy, Musa B Jallow, Audrey G Forson, Uzochukwu Egere, Beate Kampmann, Toyin Togun
{"title":"Accuracy of CAD4TB (Computer-Aided Detection for Tuberculosis) on paediatric chest radiographs.","authors":"Victory Fabian Edem, Esin Nkereuwem, Schadrac C Agbla, Sheila A Owusu, Abdou K Sillah, Binta Saidy, Musa B Jallow, Audrey G Forson, Uzochukwu Egere, Beate Kampmann, Toyin Togun","doi":"10.1183/13993003.00811-2024","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Computer-aided detection (CAD) systems hold promise for improving tuberculosis (TB) detection on digital chest radiographs. However, data on their performance in exclusively paediatric populations are scarce.</p><p><strong>Methods: </strong>We conducted a retrospective diagnostic accuracy study evaluating the performance of CAD4TBv7 (Computer-Aided Detection for Tuberculosis version 7) using digital chest radiographs from well-characterised cohorts of Gambian children aged <15 years with presumed pulmonary TB. The children were consecutively recruited between 2012 and 2022. We measured CAD4TBv7 performance against a microbiological reference standard (MRS) of confirmed TB, and also performed Bayesian latent class analysis (LCA) to address the inherent limitations of the MRS in children. Diagnostic performance was assessed using the area under the receiver operating characteristic curve (AUROC) and point estimates of sensitivity and specificity.</p><p><strong>Results: </strong>A total of 724 children were included in the analysis, with confirmed TB in 58 (8%), unconfirmed TB in 145 (20%) and unlikely TB in 521 (72%). Using the MRS, CAD4TBv7 showed an AUROC of 0.70 (95% CI 0.60-0.79), and demonstrated sensitivity and specificity of 19.0% (95% CI 11-31%) and 99.0% (95% CI 98.0-100.0%), respectively. Applying Bayesian LCA with the assumption of conditional independence between tests, sensitivity and specificity estimates for CAD4TBv7 were 42.7% (95% CrI 29.2-57.5%) and 97.9% (95% CrI 96.6-98.8%), respectively. When allowing for conditional dependence between culture and Xpert assay, CAD4TBv7 demonstrated a sensitivity of 50.3% (95% CrI 32.9-70.0%) and specificity of 98.0% (95% CrI 96.7-98.9%).</p><p><strong>Conclusion: </strong>Although CAD4TBv7 demonstrated high specificity, its suboptimal sensitivity underscores the crucial need for optimisation of CAD4TBv7 for detecting TB in children.</p>","PeriodicalId":12265,"journal":{"name":"European Respiratory Journal","volume":" ","pages":""},"PeriodicalIF":16.6000,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11540982/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"European Respiratory Journal","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1183/13993003.00811-2024","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/11/1 0:00:00","PubModel":"Print","JCR":"Q1","JCRName":"RESPIRATORY SYSTEM","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Computer-aided detection (CAD) systems hold promise for improving tuberculosis (TB) detection on digital chest radiographs. However, data on their performance in exclusively paediatric populations are scarce.
Methods: We conducted a retrospective diagnostic accuracy study evaluating the performance of CAD4TBv7 (Computer-Aided Detection for Tuberculosis version 7) using digital chest radiographs from well-characterised cohorts of Gambian children aged <15 years with presumed pulmonary TB. The children were consecutively recruited between 2012 and 2022. We measured CAD4TBv7 performance against a microbiological reference standard (MRS) of confirmed TB, and also performed Bayesian latent class analysis (LCA) to address the inherent limitations of the MRS in children. Diagnostic performance was assessed using the area under the receiver operating characteristic curve (AUROC) and point estimates of sensitivity and specificity.
Results: A total of 724 children were included in the analysis, with confirmed TB in 58 (8%), unconfirmed TB in 145 (20%) and unlikely TB in 521 (72%). Using the MRS, CAD4TBv7 showed an AUROC of 0.70 (95% CI 0.60-0.79), and demonstrated sensitivity and specificity of 19.0% (95% CI 11-31%) and 99.0% (95% CI 98.0-100.0%), respectively. Applying Bayesian LCA with the assumption of conditional independence between tests, sensitivity and specificity estimates for CAD4TBv7 were 42.7% (95% CrI 29.2-57.5%) and 97.9% (95% CrI 96.6-98.8%), respectively. When allowing for conditional dependence between culture and Xpert assay, CAD4TBv7 demonstrated a sensitivity of 50.3% (95% CrI 32.9-70.0%) and specificity of 98.0% (95% CrI 96.7-98.9%).
Conclusion: Although CAD4TBv7 demonstrated high specificity, its suboptimal sensitivity underscores the crucial need for optimisation of CAD4TBv7 for detecting TB in children.
期刊介绍:
The European Respiratory Journal (ERJ) is the flagship journal of the European Respiratory Society. It has a current impact factor of 24.9. The journal covers various aspects of adult and paediatric respiratory medicine, including cell biology, epidemiology, immunology, oncology, pathophysiology, imaging, occupational medicine, intensive care, sleep medicine, and thoracic surgery. In addition to original research material, the ERJ publishes editorial commentaries, reviews, short research letters, and correspondence to the editor. The articles are published continuously and collected into 12 monthly issues in two volumes per year.