Zan Klanecek, Yao-Kuan Wang, Tobias Wagner, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Katja Jarm, Mateja Krajc, Miloš Vrhovec, Hilde Bosmans, Robert Jeraj
{"title":"Impact of pectoral muscle removal on deep-learning-based breast cancer risk prediction.","authors":"Zan Klanecek, Yao-Kuan Wang, Tobias Wagner, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Katja Jarm, Mateja Krajc, Miloš Vrhovec, Hilde Bosmans, Robert Jeraj","doi":"10.1088/1361-6560/adb367","DOIUrl":null,"url":null,"abstract":"<p><p><i>Objective.</i>State-of-the-art breast cancer risk (BCR) prediction models have been originally trained on mammograms with pectoral muscle (PM) included. This study investigated whether excluding PM during training/fine-tuning improves the model's BCR discrimination performance, calibration, and robustness.<i>Approach.</i>First, the Original deep learning model (MIRAI), trained on the US (Massachusetts General Hospital) data, was validated, and the relative contribution of PM to BCR predictions was evaluated using saliency maps. Additionally, 23 792 mammograms from the Slovenian screening program were collected and two datasets were created, with and without screening positive exams. The original MIRAI was then fine-tuned on the training/fine-tuning set of Slovenian mammograms with and without PM, creating Fine-tuned MIRAI models. In total, four models (Original MIRAI with PM, Original MIRAI without PM, Fine-tuned MIRAI with PM, Fine-tuned MIRAI without PM) were compared on a test set in terms of discrimination performance for 1-5 Year BCR (evaluating area under the curve), calibration performance (measured with expected calibration error-ECE) and robustness to incremental PM removals/additions, and to incremental breast tissue removals.<i>Results.</i>The relative contribution of PM to the BCR prediction on the Original MIRAI model was low (∼5%); however, there were significant outliers where the relative contribution was more than 50%. The removal of PM did not impact the 1-5 Year BCR discrimination performance of the Original MIRAI (with screening positive exams: 0.77-0.91, without screening positive exams: 0.64-0.67). Fine-tuned MIRAI on mammograms with PM removed achieved significantly higher 1-5 Year BCR discrimination performance (with screening positive exams: 0.82-0.93, without screening positive exams: 0.71-0.79). After recalibration, all models had similar ECE (with screening positive exams: 0.04-0.05, without screening positive exams: 0.02-0.03).<i>Significance.</i>Improved BCR discrimination performance can be achieved when the model is trained/fine-tuned on mammograms with PM removed.</p>","PeriodicalId":20185,"journal":{"name":"Physics in medicine and biology","volume":" ","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics in medicine and biology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1088/1361-6560/adb367","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective.State-of-the-art breast cancer risk (BCR) prediction models have been originally trained on mammograms with pectoral muscle (PM) included. This study investigated whether excluding PM during training/fine-tuning improves the model's BCR discrimination performance, calibration, and robustness.Approach.First, the Original deep learning model (MIRAI), trained on the US (Massachusetts General Hospital) data, was validated, and the relative contribution of PM to BCR predictions was evaluated using saliency maps. Additionally, 23 792 mammograms from the Slovenian screening program were collected and two datasets were created, with and without screening positive exams. The original MIRAI was then fine-tuned on the training/fine-tuning set of Slovenian mammograms with and without PM, creating Fine-tuned MIRAI models. In total, four models (Original MIRAI with PM, Original MIRAI without PM, Fine-tuned MIRAI with PM, Fine-tuned MIRAI without PM) were compared on a test set in terms of discrimination performance for 1-5 Year BCR (evaluating area under the curve), calibration performance (measured with expected calibration error-ECE) and robustness to incremental PM removals/additions, and to incremental breast tissue removals.Results.The relative contribution of PM to the BCR prediction on the Original MIRAI model was low (∼5%); however, there were significant outliers where the relative contribution was more than 50%. The removal of PM did not impact the 1-5 Year BCR discrimination performance of the Original MIRAI (with screening positive exams: 0.77-0.91, without screening positive exams: 0.64-0.67). Fine-tuned MIRAI on mammograms with PM removed achieved significantly higher 1-5 Year BCR discrimination performance (with screening positive exams: 0.82-0.93, without screening positive exams: 0.71-0.79). After recalibration, all models had similar ECE (with screening positive exams: 0.04-0.05, without screening positive exams: 0.02-0.03).Significance.Improved BCR discrimination performance can be achieved when the model is trained/fine-tuned on mammograms with PM removed.
期刊介绍:
The development and application of theoretical, computational and experimental physics to medicine, physiology and biology. Topics covered are: therapy physics (including ionizing and non-ionizing radiation); biomedical imaging (e.g. x-ray, magnetic resonance, ultrasound, optical and nuclear imaging); image-guided interventions; image reconstruction and analysis (including kinetic modelling); artificial intelligence in biomedical physics and analysis; nanoparticles in imaging and therapy; radiobiology; radiation protection and patient dose monitoring; radiation dosimetry