Ahmed El Kaffas, Krishna Chaitanya Bhatraju, Jenny M Vo-Phamhi, Thodsawit Tiyarattanachai, Neha Antil, Lindsey M Negrete, Aya Kamaya, Luyao Shen
{"title":"开发用于从临床标准超声波对肝脏脂肪变性进行分类的深度学习模型","authors":"Ahmed El Kaffas, Krishna Chaitanya Bhatraju, Jenny M Vo-Phamhi, Thodsawit Tiyarattanachai, Neha Antil, Lindsey M Negrete, Aya Kamaya, Luyao Shen","doi":"10.1016/j.ultrasmedbio.2024.09.020","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Early detection and monitoring of hepatic steatosis can help establish appropriate preventative measures against progression to more advanced disease. We aimed to develop a deep learning (DL) program for classification of hepatic steatosis from standard-of-care grayscale ultrasound (US) images.</p><p><strong>Methods: </strong>In this single-center retrospective study, we utilized grayscale US images from January 1, 2010, to October 23, 2022, labeled with magnetic resonance imaging (MRI) proton density fat fraction (MRI-PDFF) to develop a DL multi-instance program for differentiating normal (S0) from steatotic liver (S1/2/3) and normal/mild steatosis (S0/1) from moderate/severe steatosis (S2/3). Diagnostic performances were assessed with area under the receiver operating characteristic curves (AUC), sensitivity, specificity and balanced accuracy with 95% confidence interval (CI).</p><p><strong>Results: </strong>A total of 403 patients with 403 US exams were included: 171 (42%) were normal (S0: MRI-PDFF <5%), 154 (38%) had mild steatosis (S1: MRI-PDFF 5-17.4%), 29 (7%) had moderate steatosis (S2: MRI-PDFF >17.4%-22.1%) and 49 (12%) had severe steatosis (S3: MRI-PDFF >22.1%). The dataset was split to include 322 patients in train/validation and 81 patients in a holdout test set (kept blind). The S0 versus S1/2/3 model achieved 81.3% (95% CI 72.1-90.5) AUC, 81.1% (70.6-91.6) sensitivity, 71.4% (54.7-88.2) specificity and 76.3% (66.4-86.2) balanced accuracy. The S0/1 versus S2/3 model achieved 95.9% (89-100) AUC, 87.5% (71.3-100) sensitivity, 96.9% (92.7-100) specificity and 92.2% (83.8-100) balanced accuracy. A multi-class model achieved a sensitivity of 71.4% (54.7-88.2) for S0, 67.6% (52.5-82.7) for S1 and 87.5% (71.3-100) for S2/3; specificity for the same model was 81.1% (70.6-91.6) for S0, 77.3% (64.9-89.7) for S1 and 96.9% (92.7-100) for S2/3.</p><p><strong>Conclusion: </strong>Our DL program offered high sensitivity and accuracy in detecting and categorizing hepatic steatosis from standard-of-care ultrasound.</p>","PeriodicalId":49399,"journal":{"name":"Ultrasound in Medicine and Biology","volume":null,"pages":null},"PeriodicalIF":2.4000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of a Deep Learning Model for Classification of Hepatic Steatosis from Clinical Standard Ultrasound.\",\"authors\":\"Ahmed El Kaffas, Krishna Chaitanya Bhatraju, Jenny M Vo-Phamhi, Thodsawit Tiyarattanachai, Neha Antil, Lindsey M Negrete, Aya Kamaya, Luyao Shen\",\"doi\":\"10.1016/j.ultrasmedbio.2024.09.020\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>Early detection and monitoring of hepatic steatosis can help establish appropriate preventative measures against progression to more advanced disease. We aimed to develop a deep learning (DL) program for classification of hepatic steatosis from standard-of-care grayscale ultrasound (US) images.</p><p><strong>Methods: </strong>In this single-center retrospective study, we utilized grayscale US images from January 1, 2010, to October 23, 2022, labeled with magnetic resonance imaging (MRI) proton density fat fraction (MRI-PDFF) to develop a DL multi-instance program for differentiating normal (S0) from steatotic liver (S1/2/3) and normal/mild steatosis (S0/1) from moderate/severe steatosis (S2/3). Diagnostic performances were assessed with area under the receiver operating characteristic curves (AUC), sensitivity, specificity and balanced accuracy with 95% confidence interval (CI).</p><p><strong>Results: </strong>A total of 403 patients with 403 US exams were included: 171 (42%) were normal (S0: MRI-PDFF <5%), 154 (38%) had mild steatosis (S1: MRI-PDFF 5-17.4%), 29 (7%) had moderate steatosis (S2: MRI-PDFF >17.4%-22.1%) and 49 (12%) had severe steatosis (S3: MRI-PDFF >22.1%). The dataset was split to include 322 patients in train/validation and 81 patients in a holdout test set (kept blind). The S0 versus S1/2/3 model achieved 81.3% (95% CI 72.1-90.5) AUC, 81.1% (70.6-91.6) sensitivity, 71.4% (54.7-88.2) specificity and 76.3% (66.4-86.2) balanced accuracy. The S0/1 versus S2/3 model achieved 95.9% (89-100) AUC, 87.5% (71.3-100) sensitivity, 96.9% (92.7-100) specificity and 92.2% (83.8-100) balanced accuracy. A multi-class model achieved a sensitivity of 71.4% (54.7-88.2) for S0, 67.6% (52.5-82.7) for S1 and 87.5% (71.3-100) for S2/3; specificity for the same model was 81.1% (70.6-91.6) for S0, 77.3% (64.9-89.7) for S1 and 96.9% (92.7-100) for S2/3.</p><p><strong>Conclusion: </strong>Our DL program offered high sensitivity and accuracy in detecting and categorizing hepatic steatosis from standard-of-care ultrasound.</p>\",\"PeriodicalId\":49399,\"journal\":{\"name\":\"Ultrasound in Medicine and Biology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ultrasound in Medicine and Biology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.ultrasmedbio.2024.09.020\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ACOUSTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ultrasound in Medicine and Biology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.ultrasmedbio.2024.09.020","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ACOUSTICS","Score":null,"Total":0}
Development of a Deep Learning Model for Classification of Hepatic Steatosis from Clinical Standard Ultrasound.
Objective: Early detection and monitoring of hepatic steatosis can help establish appropriate preventative measures against progression to more advanced disease. We aimed to develop a deep learning (DL) program for classification of hepatic steatosis from standard-of-care grayscale ultrasound (US) images.
Methods: In this single-center retrospective study, we utilized grayscale US images from January 1, 2010, to October 23, 2022, labeled with magnetic resonance imaging (MRI) proton density fat fraction (MRI-PDFF) to develop a DL multi-instance program for differentiating normal (S0) from steatotic liver (S1/2/3) and normal/mild steatosis (S0/1) from moderate/severe steatosis (S2/3). Diagnostic performances were assessed with area under the receiver operating characteristic curves (AUC), sensitivity, specificity and balanced accuracy with 95% confidence interval (CI).
Results: A total of 403 patients with 403 US exams were included: 171 (42%) were normal (S0: MRI-PDFF <5%), 154 (38%) had mild steatosis (S1: MRI-PDFF 5-17.4%), 29 (7%) had moderate steatosis (S2: MRI-PDFF >17.4%-22.1%) and 49 (12%) had severe steatosis (S3: MRI-PDFF >22.1%). The dataset was split to include 322 patients in train/validation and 81 patients in a holdout test set (kept blind). The S0 versus S1/2/3 model achieved 81.3% (95% CI 72.1-90.5) AUC, 81.1% (70.6-91.6) sensitivity, 71.4% (54.7-88.2) specificity and 76.3% (66.4-86.2) balanced accuracy. The S0/1 versus S2/3 model achieved 95.9% (89-100) AUC, 87.5% (71.3-100) sensitivity, 96.9% (92.7-100) specificity and 92.2% (83.8-100) balanced accuracy. A multi-class model achieved a sensitivity of 71.4% (54.7-88.2) for S0, 67.6% (52.5-82.7) for S1 and 87.5% (71.3-100) for S2/3; specificity for the same model was 81.1% (70.6-91.6) for S0, 77.3% (64.9-89.7) for S1 and 96.9% (92.7-100) for S2/3.
Conclusion: Our DL program offered high sensitivity and accuracy in detecting and categorizing hepatic steatosis from standard-of-care ultrasound.
期刊介绍：
Ultrasound in Medicine and Biology is the official journal of the World Federation for Ultrasound in Medicine and Biology. The journal publishes original contributions that demonstrate a novel application of an existing ultrasound technology in clinical diagnostic, interventional and therapeutic applications, new and improved clinical techniques, the physics, engineering and technology of ultrasound in medicine and biology, and the interactions between ultrasound and biological systems, including bioeffects. Papers that simply utilize standard diagnostic ultrasound as a measuring tool will be considered out of scope. Extended critical reviews of subjects of contemporary interest in the field are also published, in addition to occasional editorial articles, clinical and technical notes, book reviews, letters to the editor and a calendar of forthcoming meetings. It is the aim of the journal fully to meet the information and publication requirements of the clinicians, scientists, engineers and other professionals who constitute the biomedical ultrasonic community.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
