Marlina Tanty Ramli Hamid, Nazimah Ab Mumin, Shamsiah Abdul Hamid, Kartini Rahmat
{"title":"Application of Artificial Intelligence (AI) System in Opportunistic Screening and Diagnostic Population in a Middle-income Nation.","authors":"Marlina Tanty Ramli Hamid, Nazimah Ab Mumin, Shamsiah Abdul Hamid, Kartini Rahmat","doi":"10.2174/0115734056280191231207052903","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study evaluates the effectiveness of artificial intelligence (AI) in mammography in a diverse population from a middle-income nation and compares it to traditional methods.</p><p><strong>Methods: </strong>A retrospective study was conducted on 543 mammograms of 467 Malays, 48 Chinese, and 28 Indians in a middle-income nation. Three breast radiologists interpreted the examinations independently in two reading sessions (with and without AI support). Breast density and BI-RADS categories were assessed, comparing the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) results.</p><p><strong>Results: </strong>Of 543 mammograms, 69.2% had lesions detected. Biopsies were performed on 25%(n=136), with 66(48.5%) benign and 70(51.5%) malignant. Substantial agreement in density assessment between the radiologist and AI software (κ =0.606, p < 0.001) and the BI-RADS category with and without AI (κ =0.74, p < 0.001). The performance of the AI software was comparable to the traditional methods. The sensitivity, specificity, PPV, and NPV or radiologists alone, radiologist + AI, and AI alone were 81.9%,90.4%,56.0%, and 97.1%; 81.0%, 93.1%,55.5%, and 97.0%; and 90.0%,76.5%,36.2%, and 98.1%, respectively. AI software enhances the accuracy of lesion diagnosis and reduces unnecessary biopsies, particularly for BI-RADS 4 lesions. The AI software results for synthetic were almost similar to the original 2D mammography, with AUC of 0.925 and 0.871, respectively.</p><p><strong>Conclusion: </strong>AI software may assist in the accurate diagnosis of breast lesions, enhancing the efficiency of breast lesion diagnosis in a mixed population of opportunistic screening and diagnostic patients.</p><p><strong>Key messages: </strong>• The use of artificial intelligence (AI) in mammography for population-based breast cancer screening has been validated in high-income nations, with reported improved diagnostic performance. Our study evaluated the usage of an AI tool in an opportunistic screening setting in a multi-ethnic and middle-income nation. • The application of AI in mammography enhances diagnostic accuracy, potentially leading to reduced unnecessary biopsies. • AI integration into the workflow did not disrupt the performance of trained breast radiologists, as there is a substantial inter-reader agreement for BI-RADS category assessment and breast density.</p>","PeriodicalId":54215,"journal":{"name":"Current Medical Imaging Reviews","volume":" ","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2024-02-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Current Medical Imaging Reviews","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2174/0115734056280191231207052903","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: This study evaluates the effectiveness of artificial intelligence (AI) in mammography in a diverse population from a middle-income nation and compares it to traditional methods.
Methods: A retrospective study was conducted on 543 mammograms of 467 Malays, 48 Chinese, and 28 Indians in a middle-income nation. Three breast radiologists interpreted the examinations independently in two reading sessions (with and without AI support). Breast density and BI-RADS categories were assessed, comparing the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) results.
Results: Of 543 mammograms, 69.2% had lesions detected. Biopsies were performed on 25%(n=136), with 66(48.5%) benign and 70(51.5%) malignant. Substantial agreement in density assessment between the radiologist and AI software (κ =0.606, p < 0.001) and the BI-RADS category with and without AI (κ =0.74, p < 0.001). The performance of the AI software was comparable to the traditional methods. The sensitivity, specificity, PPV, and NPV or radiologists alone, radiologist + AI, and AI alone were 81.9%,90.4%,56.0%, and 97.1%; 81.0%, 93.1%,55.5%, and 97.0%; and 90.0%,76.5%,36.2%, and 98.1%, respectively. AI software enhances the accuracy of lesion diagnosis and reduces unnecessary biopsies, particularly for BI-RADS 4 lesions. The AI software results for synthetic were almost similar to the original 2D mammography, with AUC of 0.925 and 0.871, respectively.
Conclusion: AI software may assist in the accurate diagnosis of breast lesions, enhancing the efficiency of breast lesion diagnosis in a mixed population of opportunistic screening and diagnostic patients.
Key messages: • The use of artificial intelligence (AI) in mammography for population-based breast cancer screening has been validated in high-income nations, with reported improved diagnostic performance. Our study evaluated the usage of an AI tool in an opportunistic screening setting in a multi-ethnic and middle-income nation. • The application of AI in mammography enhances diagnostic accuracy, potentially leading to reduced unnecessary biopsies. • AI integration into the workflow did not disrupt the performance of trained breast radiologists, as there is a substantial inter-reader agreement for BI-RADS category assessment and breast density.
期刊介绍:
Current Medical Imaging Reviews publishes frontier review articles, original research articles, drug clinical trial studies and guest edited thematic issues on all the latest advances on medical imaging dedicated to clinical research. All relevant areas are covered by the journal, including advances in the diagnosis, instrumentation and therapeutic applications related to all modern medical imaging techniques.
The journal is essential reading for all clinicians and researchers involved in medical imaging and diagnosis.