Validation and three years of clinical experience in using an artificial intelligence algorithm as a second read system for prostate cancer diagnosis—real-world experience
Juan Carlos Santa-Rosario, Erik A. Gustafson, Dario E. Sanabria Bellassai, Phillip E. Gustafson, Mariano de Socarraz
{"title":"Validation and three years of clinical experience in using an artificial intelligence algorithm as a second read system for prostate cancer diagnosis—real-world experience","authors":"Juan Carlos Santa-Rosario, Erik A. Gustafson, Dario E. Sanabria Bellassai, Phillip E. Gustafson, Mariano de Socarraz","doi":"10.1016/j.jpi.2024.100378","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Prostate cancer ranks as the most frequently diagnosed cancer in men in the USA, with significant mortality rates. Early detection is pivotal for optimal patient outcomes, providing increased treatment options and potentially less invasive interventions. There remain significant challenges in prostate cancer histopathology, including the potential for missed diagnoses due to pathologist variability and subjective interpretations.</p></div><div><h3>Methods</h3><p>To address these challenges, this study investigates the ability of artificial intelligence (AI) to enhance diagnostic accuracy. The Galen™ Prostate AI algorithm was validated on a cohort of Puerto Rican men to demonstrate its efficacy in cancer detection and Gleason grading. Subsequently, the AI algorithm was integrated into routine clinical practice during a 3-year period at a CLIA certified precision pathology laboratory.</p></div><div><h3>Results</h3><p>The Galen™ Prostate AI algorithm showed a 96.7% (95% CI 95.6–97.8) specificity and a 96.6% (95% CI 93.3–98.8) sensitivity for prostate cancer detection and 82.1% specificity (95% CI 73.9–88.5) and 81.1% sensitivity (95% CI 73.7–87.2) for distinction of Gleason Grade Group 1 from Grade Group 2+. The subsequent AI integration into routine clinical use examined prostate cancer diagnoses on >122,000 slides and 9200 cases over 3 years and had an overall AI Impact ™ factor of 1.8%.</p></div><div><h3>Conclusions</h3><p>The potential of AI to be a powerful, reliable, and effective diagnostic tool for pathologists is highlighted, while the AI Impact™ in a real-world setting demonstrates the ability of AI to standardize prostate cancer diagnosis at a high level of performance across pathologists.</p></div>","PeriodicalId":37769,"journal":{"name":"Journal of Pathology Informatics","volume":"15 ","pages":"Article 100378"},"PeriodicalIF":0.0000,"publicationDate":"2024-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2153353924000178/pdfft?md5=9c3ac8cee3a0de7c2dbd11239bf2bccb&pid=1-s2.0-S2153353924000178-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Pathology Informatics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2153353924000178","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Prostate cancer ranks as the most frequently diagnosed cancer in men in the USA, with significant mortality rates. Early detection is pivotal for optimal patient outcomes, providing increased treatment options and potentially less invasive interventions. There remain significant challenges in prostate cancer histopathology, including the potential for missed diagnoses due to pathologist variability and subjective interpretations.
Methods
To address these challenges, this study investigates the ability of artificial intelligence (AI) to enhance diagnostic accuracy. The Galen™ Prostate AI algorithm was validated on a cohort of Puerto Rican men to demonstrate its efficacy in cancer detection and Gleason grading. Subsequently, the AI algorithm was integrated into routine clinical practice during a 3-year period at a CLIA certified precision pathology laboratory.
Results
The Galen™ Prostate AI algorithm showed a 96.7% (95% CI 95.6–97.8) specificity and a 96.6% (95% CI 93.3–98.8) sensitivity for prostate cancer detection and 82.1% specificity (95% CI 73.9–88.5) and 81.1% sensitivity (95% CI 73.7–87.2) for distinction of Gleason Grade Group 1 from Grade Group 2+. The subsequent AI integration into routine clinical use examined prostate cancer diagnoses on >122,000 slides and 9200 cases over 3 years and had an overall AI Impact ™ factor of 1.8%.
Conclusions
The potential of AI to be a powerful, reliable, and effective diagnostic tool for pathologists is highlighted, while the AI Impact™ in a real-world setting demonstrates the ability of AI to standardize prostate cancer diagnosis at a high level of performance across pathologists.
背景在美国,前列腺癌是最常见的男性癌症,死亡率很高。早期检测是获得最佳治疗效果的关键,它提供了更多的治疗选择,并可能减少侵入性干预。前列腺癌组织病理学仍面临重大挑战,包括由于病理学家的变异和主观解释可能导致漏诊。Galen™ 前列腺人工智能算法在一组波多黎各男性中进行了验证,以证明其在癌症检测和格里森分级方面的功效。结果 Galen™ 前列腺 AI 算法在前列腺癌检测方面的特异性为 96.7%(95% CI 95.6-97.8),灵敏度为 96.6%(95% CI 93.3-98.8);在区分格里森 1 级和 2+ 级方面,特异性为 82.1%(95% CI 73.9-88.5),灵敏度为 81.1%(95% CI 73.7-87.2)。结论人工智能作为病理学家强大、可靠和有效的诊断工具的潜力得到了强调,而在真实世界环境中的人工智能影响(AI Impact™)表明,人工智能有能力使病理学家的前列腺癌诊断达到高水平的标准化。
期刊介绍:
The Journal of Pathology Informatics (JPI) is an open access peer-reviewed journal dedicated to the advancement of pathology informatics. This is the official journal of the Association for Pathology Informatics (API). The journal aims to publish broadly about pathology informatics and freely disseminate all articles worldwide. This journal is of interest to pathologists, informaticians, academics, researchers, health IT specialists, information officers, IT staff, vendors, and anyone with an interest in informatics. We encourage submissions from anyone with an interest in the field of pathology informatics. We publish all types of papers related to pathology informatics including original research articles, technical notes, reviews, viewpoints, commentaries, editorials, symposia, meeting abstracts, book reviews, and correspondence to the editors. All submissions are subject to rigorous peer review by the well-regarded editorial board and by expert referees in appropriate specialties.