远程皮肤病学中的深度去模糊技术:深度学习模型恢复模糊图像分类的准确性。

IF 2.8 3区 医学 Q2 HEALTH CARE SCIENCES & SERVICES Telemedicine and e-Health Pub Date : 2024-09-01 Epub Date: 2024-06-27 DOI:10.1089/tmj.2023.0703
Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee
{"title":"远程皮肤病学中的深度去模糊技术:深度学习模型恢复模糊图像分类的准确性。","authors":"Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee","doi":"10.1089/tmj.2023.0703","DOIUrl":null,"url":null,"abstract":"<p><p><b>Background:</b> Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. <b>Methods:</b> We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. <b>Main Outcomes and Measures:</b> Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. <b>Results:</b> The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. <b>Conclusions:</b> Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.</p>","PeriodicalId":54434,"journal":{"name":"Telemedicine and e-Health","volume":" ","pages":"2477-2482"},"PeriodicalIF":2.8000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification.\",\"authors\":\"Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee\",\"doi\":\"10.1089/tmj.2023.0703\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Background:</b> Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. <b>Methods:</b> We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. <b>Main Outcomes and Measures:</b> Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. <b>Results:</b> The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. <b>Conclusions:</b> Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.</p>\",\"PeriodicalId\":54434,\"journal\":{\"name\":\"Telemedicine and e-Health\",\"volume\":\" \",\"pages\":\"2477-2482\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Telemedicine and e-Health\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1089/tmj.2023.0703\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/27 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Telemedicine and e-Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1089/tmj.2023.0703","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/27 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

摘要

背景:远程皮肤病学和咨询中的模糊图像增加了深度学习模型和医生的诊断难度。我们旨在确定深度学习模型去除模糊图像后诊断准确性的恢复程度。研究方法我们使用了公共皮肤图像数据集中的 19191 张皮肤图像(其中包括 23 种皮肤病类别)、公共模糊皮肤图像数据集中的 54 张皮肤图像以及一家医疗中心的 53 张模糊皮肤科会诊照片,以比较训练有素的诊断深度学习模型的诊断准确性以及模糊图像和去模糊图像之间的主观清晰度。我们评估了五种不同的去模糊模型,包括运动模糊模型、高斯模糊模型、虚化模糊模型、混合轻微模糊模型和混合强烈模糊模型。主要结果和衡量标准:诊断准确性以模型预测皮肤病类别的灵敏度和准确度来衡量。清晰度评分由委员会认证的皮肤科医生按 4 分制进行,4 分表示图像清晰度最高。结果显示诊断模型对轻微模糊和严重模糊图像的灵敏度分别下降了 0.15 和 0.22,去模糊模型对每组图像的灵敏度分别恢复了 0.14 和 0.17。去模糊后,皮肤科医生感知的清晰度评分从 1.87 提高到 2.51。激活图显示,诊断模型的焦点受到了模糊的影响,但去模糊后得到了恢复。结论深度学习模型可以恢复诊断模型对模糊图像的诊断准确性,并提高皮肤科医生感知到的图像清晰度。该模型可纳入远程皮肤病学,帮助诊断模糊图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification.

Background: Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. Methods: We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. Main Outcomes and Measures: Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. Results: The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. Conclusions: Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Telemedicine and e-Health
Telemedicine and e-Health 医学-卫生保健
CiteScore
8.80
自引率
6.40%
发文量
270
审稿时长
2.3 months
期刊介绍: Telemedicine and e-Health is the leading peer-reviewed journal for cutting-edge telemedicine applications for achieving optimal patient care and outcomes. It places special emphasis on the impact of telemedicine on the quality, cost effectiveness, and access to healthcare. Telemedicine applications play an increasingly important role in health care. They offer indispensable tools for home healthcare, remote patient monitoring, and disease management, not only for rural health and battlefield care, but also for nursing home, assisted living facilities, and maritime and aviation settings. Telemedicine and e-Health offers timely coverage of the advances in technology that offer practitioners, medical centers, and hospitals new and innovative options for managing patient care, electronic records, and medical billing.
期刊最新文献
Quality of Life Among Patients with Heart Failure with Reduced Ejection Fraction Receiving Telemedicine Care in Vietnam. The Association Between Telehealth Use During Buprenorphine Treatment for Opioid Use Disorder and Clinical Outcomes: A Retrospective Cohort Study. Acceptability of Forensic Sexual Assault Telehealth Consultation. Taking a Step Back or a Step Forward. Tele-Critical Care, Severity of Illness, and 30-Day Mortality Risk: A Retrospective, Cohort Analysis.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1