Farhan Akram, Daniël P de Bruyn, Quincy C C van den Bosch, Teodora E Trandafir, Thierry P P van den Bosch, Rob M Verdijk, Annelies de Klein, Emine Kiliç, Andrew P Stubbs, Erwin Brosens, Jan H von der Thüsen
{"title":"利用常规血红素-伊红染色组织切片,通过深度学习预测葡萄膜黑色素瘤的分子亚类。","authors":"Farhan Akram, Daniël P de Bruyn, Quincy C C van den Bosch, Teodora E Trandafir, Thierry P P van den Bosch, Rob M Verdijk, Annelies de Klein, Emine Kiliç, Andrew P Stubbs, Erwin Brosens, Jan H von der Thüsen","doi":"10.1111/his.15271","DOIUrl":null,"url":null,"abstract":"<p><strong>Aims: </strong>Uveal melanoma has a high propensity to metastasize. Prognosis is associated with specific driver mutations and copy number variations, and these can only be obtained after genetic testing. In this study we evaluated the efficacy of patient outcome prediction using deep learning on haematoxylin and eosin (HE)-stained primary uveal melanoma slides in comparison to molecular testing.</p><p><strong>Methods: </strong>In this retrospective study of patients with uveal melanoma, 113 patients from the Erasmus Medical Centre who underwent enucleation had tumour tissue analysed for molecular classification between 1993 and 2020. Routine HE-stained slides were scanned to obtain whole-slide images (WSI). After annotation of regions of interest, tiles of 1024 × 1024 pixels were extracted at a magnification of 40×. An ablation study to select the best-performing deep-learning model was carried out using three state-of-the-art deep-learning models (EfficientNet, Vision Transformer, and Swin Transformer).</p><p><strong>Results: </strong>Deep-learning models were subjected to a training cohort (n = 40), followed by a validation cohort (n = 20), and finally underwent a test cohort (n = 48). A k-fold cross-validation (k = 3) of validation and test cohorts (n = 113 of three classes: BAP1, SF3B1, EIF1AX) demonstrated Swin Transformer as the best-performing deep-learning model to predict molecular subclasses based on HE stains. The model achieved an accuracy of 0.83 ± 0.09 on the validation cohort and 0.75 ± 0.04 on the test cohort. Within the subclasses, this model correctly predicted 70% BAP1-mutated, 61% SF3B1-mutated and 80% EIF1AX-mutated UM in the test set.</p><p><strong>Conclusions: </strong>This study showcases the potential of the deep-learning methodology for predicting molecular subclasses in a multiclass manner using HE-stained WSI. This development holds promise for advanced prognostication of UM patients without the need of molecular or immunohistochemical testing. Additionally, this study suggests there are distinct histopathological features per subclass; mainly utilizing epithelioid cellular morphology for BAP1-classification, but an unknown feature distinguishes EIF1AX and SF3B1.</p>","PeriodicalId":13219,"journal":{"name":"Histopathology","volume":null,"pages":null},"PeriodicalIF":3.9000,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Prediction of molecular subclasses of uveal melanoma by deep learning using routine haematoxylin-eosin-stained tissue slides.\",\"authors\":\"Farhan Akram, Daniël P de Bruyn, Quincy C C van den Bosch, Teodora E Trandafir, Thierry P P van den Bosch, Rob M Verdijk, Annelies de Klein, Emine Kiliç, Andrew P Stubbs, Erwin Brosens, Jan H von der Thüsen\",\"doi\":\"10.1111/his.15271\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Aims: </strong>Uveal melanoma has a high propensity to metastasize. Prognosis is associated with specific driver mutations and copy number variations, and these can only be obtained after genetic testing. In this study we evaluated the efficacy of patient outcome prediction using deep learning on haematoxylin and eosin (HE)-stained primary uveal melanoma slides in comparison to molecular testing.</p><p><strong>Methods: </strong>In this retrospective study of patients with uveal melanoma, 113 patients from the Erasmus Medical Centre who underwent enucleation had tumour tissue analysed for molecular classification between 1993 and 2020. Routine HE-stained slides were scanned to obtain whole-slide images (WSI). After annotation of regions of interest, tiles of 1024 × 1024 pixels were extracted at a magnification of 40×. An ablation study to select the best-performing deep-learning model was carried out using three state-of-the-art deep-learning models (EfficientNet, Vision Transformer, and Swin Transformer).</p><p><strong>Results: </strong>Deep-learning models were subjected to a training cohort (n = 40), followed by a validation cohort (n = 20), and finally underwent a test cohort (n = 48). A k-fold cross-validation (k = 3) of validation and test cohorts (n = 113 of three classes: BAP1, SF3B1, EIF1AX) demonstrated Swin Transformer as the best-performing deep-learning model to predict molecular subclasses based on HE stains. The model achieved an accuracy of 0.83 ± 0.09 on the validation cohort and 0.75 ± 0.04 on the test cohort. Within the subclasses, this model correctly predicted 70% BAP1-mutated, 61% SF3B1-mutated and 80% EIF1AX-mutated UM in the test set.</p><p><strong>Conclusions: </strong>This study showcases the potential of the deep-learning methodology for predicting molecular subclasses in a multiclass manner using HE-stained WSI. This development holds promise for advanced prognostication of UM patients without the need of molecular or immunohistochemical testing. Additionally, this study suggests there are distinct histopathological features per subclass; mainly utilizing epithelioid cellular morphology for BAP1-classification, but an unknown feature distinguishes EIF1AX and SF3B1.</p>\",\"PeriodicalId\":13219,\"journal\":{\"name\":\"Histopathology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.9000,\"publicationDate\":\"2024-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Histopathology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/his.15271\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/7/1 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"CELL BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Histopathology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/his.15271","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/7/1 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"CELL BIOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
目的:葡萄膜黑色素瘤具有高度转移倾向。预后与特定的驱动基因突变和拷贝数变异有关,而这些只能通过基因检测获得。在这项研究中,我们评估了利用深度学习对血红素和伊红(HE)染色的原发性葡萄膜黑色素瘤切片进行患者预后预测的效果,并与分子检测进行了比较:在这项针对葡萄膜黑色素瘤患者的回顾性研究中,伊拉斯谟医学中心(Erasmus Medical Centre)在1993年至2020年期间对113名接受去核手术的患者的肿瘤组织进行了分子分类分析。对常规 HE 染色切片进行扫描,以获得全切片图像(WSI)。在对感兴趣区进行标注后,以 40 倍的放大率提取 1024 × 1024 像素的瓦片。使用三种最先进的深度学习模型(EfficientNet、Vision Transformer 和 Swin Transformer)进行了消融研究,以选择性能最佳的深度学习模型:对深度学习模型进行了训练队列(n = 40),然后是验证队列(n = 20),最后是测试队列(n = 48)。对验证队列和测试队列(n = 113,分为三类:BAP1、SF3B1、EIF1AX)进行的 k 倍交叉验证(k = 3)表明,Swin Transformer 是基于 HE 染色预测分子亚类的表现最佳的深度学习模型。该模型在验证组群中的准确率为 0.83 ± 0.09,在测试组群中的准确率为 0.75 ± 0.04。在亚类中,该模型正确预测了测试集中 70% 的 BAP1 突变、61% 的 SF3B1 突变和 80% 的 EIF1AX 突变 UM:本研究展示了深度学习方法在使用 HE 染色的 WSI 以多类方式预测分子亚类方面的潜力。这一研究成果有望在无需分子或免疫组化检测的情况下,为 UM 患者的晚期预后做出预测。此外,这项研究还表明,每个亚类都有不同的组织病理学特征;主要是利用上皮样细胞形态进行 BAP1 分类,但有一个未知特征可区分 EIF1AX 和 SF3B1。
Prediction of molecular subclasses of uveal melanoma by deep learning using routine haematoxylin-eosin-stained tissue slides.
Aims: Uveal melanoma has a high propensity to metastasize. Prognosis is associated with specific driver mutations and copy number variations, and these can only be obtained after genetic testing. In this study we evaluated the efficacy of patient outcome prediction using deep learning on haematoxylin and eosin (HE)-stained primary uveal melanoma slides in comparison to molecular testing.
Methods: In this retrospective study of patients with uveal melanoma, 113 patients from the Erasmus Medical Centre who underwent enucleation had tumour tissue analysed for molecular classification between 1993 and 2020. Routine HE-stained slides were scanned to obtain whole-slide images (WSI). After annotation of regions of interest, tiles of 1024 × 1024 pixels were extracted at a magnification of 40×. An ablation study to select the best-performing deep-learning model was carried out using three state-of-the-art deep-learning models (EfficientNet, Vision Transformer, and Swin Transformer).
Results: Deep-learning models were subjected to a training cohort (n = 40), followed by a validation cohort (n = 20), and finally underwent a test cohort (n = 48). A k-fold cross-validation (k = 3) of validation and test cohorts (n = 113 of three classes: BAP1, SF3B1, EIF1AX) demonstrated Swin Transformer as the best-performing deep-learning model to predict molecular subclasses based on HE stains. The model achieved an accuracy of 0.83 ± 0.09 on the validation cohort and 0.75 ± 0.04 on the test cohort. Within the subclasses, this model correctly predicted 70% BAP1-mutated, 61% SF3B1-mutated and 80% EIF1AX-mutated UM in the test set.
Conclusions: This study showcases the potential of the deep-learning methodology for predicting molecular subclasses in a multiclass manner using HE-stained WSI. This development holds promise for advanced prognostication of UM patients without the need of molecular or immunohistochemical testing. Additionally, this study suggests there are distinct histopathological features per subclass; mainly utilizing epithelioid cellular morphology for BAP1-classification, but an unknown feature distinguishes EIF1AX and SF3B1.
期刊介绍:
Histopathology is an international journal intended to be of practical value to surgical and diagnostic histopathologists, and to investigators of human disease who employ histopathological methods. Our primary purpose is to publish advances in pathology, in particular those applicable to clinical practice and contributing to the better understanding of human disease.