Shiva Shankar Marri, Warood Albadri, Mohammed Salman Hyder, Ajit B Janagond, Arun C Inamadar
{"title":"人工智能应用程序(Aysa)在皮肤病诊断中的功效:横断面分析","authors":"Shiva Shankar Marri, Warood Albadri, Mohammed Salman Hyder, Ajit B Janagond, Arun C Inamadar","doi":"10.2196/48811","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Dermatology is an ideal specialty for artificial intelligence (AI)-driven image recognition to improve diagnostic accuracy and patient care. Lack of dermatologists in many parts of the world and the high frequency of cutaneous disorders and malignancies highlight the increasing need for AI-aided diagnosis. Although AI-based applications for the identification of dermatological conditions are widely available, research assessing their reliability and accuracy is lacking.</p><p><strong>Objective: </strong>The aim of this study was to analyze the efficacy of the Aysa AI app as a preliminary diagnostic tool for various dermatological conditions in a semiurban town in India.</p><p><strong>Methods: </strong>This observational cross-sectional study included patients over the age of 2 years who visited the dermatology clinic. Images of lesions from individuals with various skin disorders were uploaded to the app after obtaining informed consent. The app was used to make a patient profile, identify lesion morphology, plot the location on a human model, and answer questions regarding duration and symptoms. The app presented eight differential diagnoses, which were compared with the clinical diagnosis. The model's performance was evaluated using sensitivity, specificity, accuracy, positive predictive value, negative predictive value, and F<sub>1</sub>-score. Comparison of categorical variables was performed with the χ<sup>2</sup> test and statistical significance was considered at P<.05.</p><p><strong>Results: </strong>A total of 700 patients were part of the study. A wide variety of skin conditions were grouped into 12 categories. The AI model had a mean top-1 sensitivity of 71% (95% CI 61.5%-74.3%), top-3 sensitivity of 86.1% (95% CI 83.4%-88.6%), and all-8 sensitivity of 95.1% (95% CI 93.3%-96.6%). The top-1 sensitivities for diagnosis of skin infestations, disorders of keratinization, other inflammatory conditions, and bacterial infections were 85.7%, 85.7%, 82.7%, and 81.8%, respectively. In the case of photodermatoses and malignant tumors, the top-1 sensitivities were 33.3% and 10%, respectively. Each category had a strong correlation between the clinical diagnosis and the probable diagnoses (P<.001).</p><p><strong>Conclusions: </strong>The Aysa app showed promising results in identifying most dermatoses.</p>","PeriodicalId":73553,"journal":{"name":"JMIR dermatology","volume":"7 ","pages":"e48811"},"PeriodicalIF":0.0000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11252620/pdf/","citationCount":"0","resultStr":"{\"title\":\"Efficacy of an Artificial Intelligence App (Aysa) in Dermatological Diagnosis: Cross-Sectional Analysis.\",\"authors\":\"Shiva Shankar Marri, Warood Albadri, Mohammed Salman Hyder, Ajit B Janagond, Arun C Inamadar\",\"doi\":\"10.2196/48811\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Dermatology is an ideal specialty for artificial intelligence (AI)-driven image recognition to improve diagnostic accuracy and patient care. Lack of dermatologists in many parts of the world and the high frequency of cutaneous disorders and malignancies highlight the increasing need for AI-aided diagnosis. Although AI-based applications for the identification of dermatological conditions are widely available, research assessing their reliability and accuracy is lacking.</p><p><strong>Objective: </strong>The aim of this study was to analyze the efficacy of the Aysa AI app as a preliminary diagnostic tool for various dermatological conditions in a semiurban town in India.</p><p><strong>Methods: </strong>This observational cross-sectional study included patients over the age of 2 years who visited the dermatology clinic. Images of lesions from individuals with various skin disorders were uploaded to the app after obtaining informed consent. The app was used to make a patient profile, identify lesion morphology, plot the location on a human model, and answer questions regarding duration and symptoms. The app presented eight differential diagnoses, which were compared with the clinical diagnosis. The model's performance was evaluated using sensitivity, specificity, accuracy, positive predictive value, negative predictive value, and F<sub>1</sub>-score. Comparison of categorical variables was performed with the χ<sup>2</sup> test and statistical significance was considered at P<.05.</p><p><strong>Results: </strong>A total of 700 patients were part of the study. A wide variety of skin conditions were grouped into 12 categories. The AI model had a mean top-1 sensitivity of 71% (95% CI 61.5%-74.3%), top-3 sensitivity of 86.1% (95% CI 83.4%-88.6%), and all-8 sensitivity of 95.1% (95% CI 93.3%-96.6%). The top-1 sensitivities for diagnosis of skin infestations, disorders of keratinization, other inflammatory conditions, and bacterial infections were 85.7%, 85.7%, 82.7%, and 81.8%, respectively. In the case of photodermatoses and malignant tumors, the top-1 sensitivities were 33.3% and 10%, respectively. Each category had a strong correlation between the clinical diagnosis and the probable diagnoses (P<.001).</p><p><strong>Conclusions: </strong>The Aysa app showed promising results in identifying most dermatoses.</p>\",\"PeriodicalId\":73553,\"journal\":{\"name\":\"JMIR dermatology\",\"volume\":\"7 \",\"pages\":\"e48811\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11252620/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR dermatology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2196/48811\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Medicine\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR dermatology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/48811","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
摘要
背景:皮肤病学是人工智能(AI)驱动的图像识别的理想专业,可提高诊断准确性和改善患者护理。世界上许多地方缺乏皮肤科医生,而皮肤疾病和恶性肿瘤的发病率又很高,因此对人工智能辅助诊断的需求与日俱增。虽然基于人工智能的皮肤病识别应用程序已广泛应用,但对其可靠性和准确性的评估研究却十分缺乏:本研究旨在分析 Aysa AI 应用程序作为初步诊断工具对印度半城市地区各种皮肤病的疗效:这项观察性横断面研究包括到皮肤科诊所就诊的 2 岁以上患者。在获得知情同意后,患有各种皮肤病的患者的皮损图像被上传到应用程序中。该应用程序用于建立患者档案、识别皮损形态、在人体模型上绘制位置图,以及回答有关病程和症状的问题。该应用程序提供了八种鉴别诊断,并与临床诊断进行了比较。使用灵敏度、特异性、准确性、阳性预测值、阴性预测值和 F1 分数对模型的性能进行了评估。分类变量的比较采用χ2检验,统计显著性以PResults为标准:共有 700 名患者参与了研究。各种皮肤状况被分为 12 类。人工智能模型的前 1 位灵敏度平均为 71%(95% CI 61.5%-74.3%),前 3 位灵敏度平均为 86.1%(95% CI 83.4%-88.6%),所有 8 位灵敏度平均为 95.1%(95% CI 93.3%-96.6%)。诊断皮肤感染、角化障碍、其他炎症和细菌感染的灵敏度前 1 位分别为 85.7%、85.7%、82.7% 和 81.8%。对于光化性皮肤病和恶性肿瘤,前 1 位的灵敏度分别为 33.3% 和 10%。每个类别的临床诊断和可能诊断(PConclusions)之间都有很强的相关性:Aysa 应用程序在识别大多数皮肤病方面显示出良好的效果。
Efficacy of an Artificial Intelligence App (Aysa) in Dermatological Diagnosis: Cross-Sectional Analysis.
Background: Dermatology is an ideal specialty for artificial intelligence (AI)-driven image recognition to improve diagnostic accuracy and patient care. Lack of dermatologists in many parts of the world and the high frequency of cutaneous disorders and malignancies highlight the increasing need for AI-aided diagnosis. Although AI-based applications for the identification of dermatological conditions are widely available, research assessing their reliability and accuracy is lacking.
Objective: The aim of this study was to analyze the efficacy of the Aysa AI app as a preliminary diagnostic tool for various dermatological conditions in a semiurban town in India.
Methods: This observational cross-sectional study included patients over the age of 2 years who visited the dermatology clinic. Images of lesions from individuals with various skin disorders were uploaded to the app after obtaining informed consent. The app was used to make a patient profile, identify lesion morphology, plot the location on a human model, and answer questions regarding duration and symptoms. The app presented eight differential diagnoses, which were compared with the clinical diagnosis. The model's performance was evaluated using sensitivity, specificity, accuracy, positive predictive value, negative predictive value, and F1-score. Comparison of categorical variables was performed with the χ2 test and statistical significance was considered at P<.05.
Results: A total of 700 patients were part of the study. A wide variety of skin conditions were grouped into 12 categories. The AI model had a mean top-1 sensitivity of 71% (95% CI 61.5%-74.3%), top-3 sensitivity of 86.1% (95% CI 83.4%-88.6%), and all-8 sensitivity of 95.1% (95% CI 93.3%-96.6%). The top-1 sensitivities for diagnosis of skin infestations, disorders of keratinization, other inflammatory conditions, and bacterial infections were 85.7%, 85.7%, 82.7%, and 81.8%, respectively. In the case of photodermatoses and malignant tumors, the top-1 sensitivities were 33.3% and 10%, respectively. Each category had a strong correlation between the clinical diagnosis and the probable diagnoses (P<.001).
Conclusions: The Aysa app showed promising results in identifying most dermatoses.