Alyssa T Watanabe, Valerie Dib, Junhao Wang, Richard Mantey, William Daughton, Chi Yung Chim, Gregory Eckel, Caroline Moss, Vinay Goel, Nitesh Nerlekar
{"title":"Artificial Intelligence-based Software for Breast Arterial Calcification Detection on Mammograms.","authors":"Alyssa T Watanabe, Valerie Dib, Junhao Wang, Richard Mantey, William Daughton, Chi Yung Chim, Gregory Eckel, Caroline Moss, Vinay Goel, Nitesh Nerlekar","doi":"10.1093/jbi/wbae064","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>The performance of a commercially available artificial intelligence (AI)-based software that detects breast arterial calcifications (BACs) on mammograms is presented.</p><p><strong>Methods: </strong>This retrospective study was exempt from IRB approval and adhered to the HIPAA regulations. Breast arterial calcification detection using AI was assessed in 253 patients who underwent 314 digital mammography (DM) examinations and 143 patients who underwent 277 digital breast tomosynthesis (DBT) examinations between October 2004 and September 2022. Artificial intelligence performance for binary BAC detection was compared with ground truth (GT) determined by the majority consensus of breast imaging radiologists. Area under the receiver operating curve (AUC), sensitivity, specificity, positive predictive value and negative predictive value (NPV), accuracy, and BAC prevalence rates of the AI algorithm were compared.</p><p><strong>Results: </strong>The case-level AUCs of AI were 0.96 (0.93-0.98) for DM and 0.95 (0.92-0.98) for DBT. Sensitivity, specificity, and accuracy were 87% (79%-93%), 92% (88%-96%), and 91% (87%-94%) for DM and 88% (80%-94%), 90% (84%-94%), and 89% (85%-92%) for DBT. Positive predictive value and NPV were 82% (72%-89%) and 95% (92%-97%) for DM and 84% (76%-90%) and 92% (88%-96%) for DBT, respectively. Results are 95% confidence intervals. Breast arterial calcification prevalence was similar for both AI and GT assessments.</p><p><strong>Conclusion: </strong>Breast AI software for detection of BAC presence on mammograms showed promising performance for both DM and DBT examinations. Artificial intelligence has potential to aid radiologists in detection and reporting of BAC on mammograms, which is a known cardiovascular risk marker specific to women.</p>","PeriodicalId":43134,"journal":{"name":"Journal of Breast Imaging","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Breast Imaging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jbi/wbae064","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: The performance of a commercially available artificial intelligence (AI)-based software that detects breast arterial calcifications (BACs) on mammograms is presented.
Methods: This retrospective study was exempt from IRB approval and adhered to the HIPAA regulations. Breast arterial calcification detection using AI was assessed in 253 patients who underwent 314 digital mammography (DM) examinations and 143 patients who underwent 277 digital breast tomosynthesis (DBT) examinations between October 2004 and September 2022. Artificial intelligence performance for binary BAC detection was compared with ground truth (GT) determined by the majority consensus of breast imaging radiologists. Area under the receiver operating curve (AUC), sensitivity, specificity, positive predictive value and negative predictive value (NPV), accuracy, and BAC prevalence rates of the AI algorithm were compared.
Results: The case-level AUCs of AI were 0.96 (0.93-0.98) for DM and 0.95 (0.92-0.98) for DBT. Sensitivity, specificity, and accuracy were 87% (79%-93%), 92% (88%-96%), and 91% (87%-94%) for DM and 88% (80%-94%), 90% (84%-94%), and 89% (85%-92%) for DBT. Positive predictive value and NPV were 82% (72%-89%) and 95% (92%-97%) for DM and 84% (76%-90%) and 92% (88%-96%) for DBT, respectively. Results are 95% confidence intervals. Breast arterial calcification prevalence was similar for both AI and GT assessments.
Conclusion: Breast AI software for detection of BAC presence on mammograms showed promising performance for both DM and DBT examinations. Artificial intelligence has potential to aid radiologists in detection and reporting of BAC on mammograms, which is a known cardiovascular risk marker specific to women.