Automatic Quantification of COVID-19 Pulmonary Edema by Self-supervised Contrastive Learning.

Zhaohui Liang, Zhiyun Xue, Sivaramakrishnan Rajaraman, Yang Feng, Sameer Antani
{"title":"Automatic Quantification of COVID-19 Pulmonary Edema by Self-supervised Contrastive Learning.","authors":"Zhaohui Liang, Zhiyun Xue, Sivaramakrishnan Rajaraman, Yang Feng, Sameer Antani","doi":"10.1007/978-3-031-44917-8_12","DOIUrl":null,"url":null,"abstract":"<p><p>We proposed a self-supervised machine learning method to automatically rate the severity of pulmonary edema in the frontal chest X-ray radiographs (CXR) which could be potentially related to COVID-19 viral pneumonia. For this we use the modified radiographic assessment of lung edema (mRALE) scoring system. The new model was first optimized with the simple Siamese network (SimSiam) architecture where a ResNet-50 pretrained by ImageNet database was used as the backbone. The encoder projected a 2048-dimension embedding as representation features to a downstream fully connected deep neural network for mRALE score prediction. A 5-fold cross-validation with 2,599 frontal CXRs was used to examine the new model's performance with comparison to a non-pretrained SimSiam encoder and a ResNet-50 trained from scratch. The mean absolute error (MAE) of the new model is 5.05 (95%CI 5.03-5.08), the mean squared error (MSE) is 66.67 (95%CI 66.29-67.06), and the Spearman's correlation coefficient (Spearman ρ) to the expert-annotated scores is 0.77 (95%CI 0.75-0.79). All the performance metrics of the new model are superior to the two comparators (P<0.01), and the scores of MSE and Spearman ρ of the two comparators have no statistical difference (P>0.05). The model also achieved a prediction probability concordance of 0.811 and a quadratic weighted kappa of 0.739 with the medical expert annotations in external validation. We conclude that the self-supervised contrastive learning method is an effective strategy for mRALE automated scoring. It provides a new approach to improve machine learning performance and minimize the expert knowledge involvement in quantitative medical image pattern learning.</p>","PeriodicalId":517398,"journal":{"name":"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...","volume":"14307 ","pages":"128-137"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10896252/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-44917-8_12","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/8 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

We proposed a self-supervised machine learning method to automatically rate the severity of pulmonary edema in the frontal chest X-ray radiographs (CXR) which could be potentially related to COVID-19 viral pneumonia. For this we use the modified radiographic assessment of lung edema (mRALE) scoring system. The new model was first optimized with the simple Siamese network (SimSiam) architecture where a ResNet-50 pretrained by ImageNet database was used as the backbone. The encoder projected a 2048-dimension embedding as representation features to a downstream fully connected deep neural network for mRALE score prediction. A 5-fold cross-validation with 2,599 frontal CXRs was used to examine the new model's performance with comparison to a non-pretrained SimSiam encoder and a ResNet-50 trained from scratch. The mean absolute error (MAE) of the new model is 5.05 (95%CI 5.03-5.08), the mean squared error (MSE) is 66.67 (95%CI 66.29-67.06), and the Spearman's correlation coefficient (Spearman ρ) to the expert-annotated scores is 0.77 (95%CI 0.75-0.79). All the performance metrics of the new model are superior to the two comparators (P<0.01), and the scores of MSE and Spearman ρ of the two comparators have no statistical difference (P>0.05). The model also achieved a prediction probability concordance of 0.811 and a quadratic weighted kappa of 0.739 with the medical expert annotations in external validation. We conclude that the self-supervised contrastive learning method is an effective strategy for mRALE automated scoring. It provides a new approach to improve machine learning performance and minimize the expert knowledge involvement in quantitative medical image pattern learning.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过自监督对比学习自动量化 COVID-19 肺水肿
我们提出了一种自我监督的机器学习方法,用于自动评定可能与 COVID-19 病毒性肺炎有关的正面胸部 X 光片(CXR)中肺水肿的严重程度。为此,我们使用了改良肺水肿放射学评估(mRALE)评分系统。新模型首先使用简单的连体网络(SimSiam)架构进行优化,以 ImageNet 数据库预训练的 ResNet-50 为骨干。编码器将 2048 维嵌入作为表示特征投射到下游的全连接深度神经网络,用于 mRALE 分数预测。使用 2,599 张正面 CXR 进行了 5 倍交叉验证,以检验新模型与未经预训练的 SimSiam 编码器和从头开始训练的 ResNet-50 相比的性能。新模型的平均绝对误差 (MAE) 为 5.05(95%CI 5.03-5.08),平均平方误差 (MSE) 为 66.67(95%CI 66.29-67.06),与专家注释分数的斯皮尔曼相关系数 (Spearman ρ) 为 0.77(95%CI 0.75-0.79)。新模型的所有性能指标均优于两个比较模型(P0.05)。在外部验证中,该模型与医学专家注释的预测概率一致性为 0.811,二次加权卡帕值为 0.739。我们的结论是,自监督对比学习法是 mRALE 自动评分的有效策略。它提供了一种新方法来提高机器学习性能,并最大限度地减少定量医学图像模式学习中专家知识的参与。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Automatic Quantification of COVID-19 Pulmonary Edema by Self-supervised Contrastive Learning. Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1