Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee
{"title":"远程皮肤病学中的深度去模糊技术:深度学习模型恢复模糊图像分类的准确性。","authors":"Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee","doi":"10.1089/tmj.2023.0703","DOIUrl":null,"url":null,"abstract":"<p><p><b>Background:</b> Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. <b>Methods:</b> We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. <b>Main Outcomes and Measures:</b> Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. <b>Results:</b> The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. <b>Conclusions:</b> Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.</p>","PeriodicalId":54434,"journal":{"name":"Telemedicine and e-Health","volume":" ","pages":"2477-2482"},"PeriodicalIF":2.8000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification.\",\"authors\":\"Hsu-Hang Yeh, Benny Wei-Yun Hsu, Sheng-Yuan Chou, Ting-Jung Hsu, Vincent S Tseng, Chih-Hung Lee\",\"doi\":\"10.1089/tmj.2023.0703\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Background:</b> Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. <b>Methods:</b> We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. <b>Main Outcomes and Measures:</b> Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. <b>Results:</b> The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. <b>Conclusions:</b> Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.</p>\",\"PeriodicalId\":54434,\"journal\":{\"name\":\"Telemedicine and e-Health\",\"volume\":\" \",\"pages\":\"2477-2482\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Telemedicine and e-Health\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1089/tmj.2023.0703\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/27 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Telemedicine and e-Health","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1089/tmj.2023.0703","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/27 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
Deep Deblurring in Teledermatology: Deep Learning Models Restore the Accuracy of Blurry Images' Classification.
Background: Blurry images in teledermatology and consultation increased the diagnostic difficulty for both deep learning models and physicians. We aim to determine the extent of restoration in diagnostic accuracy after blurry images are deblurred by deep learning models. Methods: We used 19,191 skin images from a public skin image dataset that includes 23 skin disease categories, 54 skin images from a public dataset of blurry skin images, and 53 blurry dermatology consultation photos in a medical center to compare the diagnosis accuracy of trained diagnostic deep learning models and subjective sharpness between blurry and deblurred images. We evaluated five different deblurring models, including models for motion blur, Gaussian blur, Bokeh blur, mixed slight blur, and mixed strong blur. Main Outcomes and Measures: Diagnostic accuracy was measured as sensitivity and precision of correct model prediction of the skin disease category. Sharpness rating was performed by board-certified dermatologists on a 4-point scale, with 4 being the highest image clarity. Results: The sensitivity of diagnostic models dropped 0.15 and 0.22 on slightly and strongly blurred images, respectively, and deblurring models restored 0.14 and 0.17 for each group. The sharpness ratings perceived by dermatologists improved from 1.87 to 2.51 after deblurring. Activation maps showed the focus of diagnostic models was compromised by the blurriness but was restored after deblurring. Conclusions: Deep learning models can restore the diagnostic accuracy of diagnostic models for blurry images and increase image sharpness perceived by dermatologists. The model can be incorporated into teledermatology to help the diagnosis of blurry images.
期刊介绍:
Telemedicine and e-Health is the leading peer-reviewed journal for cutting-edge telemedicine applications for achieving optimal patient care and outcomes. It places special emphasis on the impact of telemedicine on the quality, cost effectiveness, and access to healthcare. Telemedicine applications play an increasingly important role in health care. They offer indispensable tools for home healthcare, remote patient monitoring, and disease management, not only for rural health and battlefield care, but also for nursing home, assisted living facilities, and maritime and aviation settings.
Telemedicine and e-Health offers timely coverage of the advances in technology that offer practitioners, medical centers, and hospitals new and innovative options for managing patient care, electronic records, and medical billing.