Manman Fei , Xin Zhang , Dongdong Chen , Zhiyun Song , Qian Wang , Lichi Zhang
{"title":"Whole slide cervical cancer classification via graph attention networks and contrastive learning","authors":"Manman Fei , Xin Zhang , Dongdong Chen , Zhiyun Song , Qian Wang , Lichi Zhang","doi":"10.1016/j.neucom.2024.128787","DOIUrl":null,"url":null,"abstract":"<div><div>Cervical cancer is one of the most common cancers among women, which seriously threatens women’s health. Early screening can reduce the incidence rate and mortality. Thinprep cytologic test (TCT) is one of the important means of cytological screening, which has high sensitivity and specificity, and has been widely used in the early screening of cervical cancer. The automatic diagnosis of whole slide images (WSIs) by computers can effectively improve the efficiency and accuracy of doctors’ diagnoses. However, current methods ignore the intrinsic relationships between cervical cells in WSIs and neglect contextual information from the surrounding suspicious areas, and therefore limit their robustness and generalizability. In this paper, we propose a novel two-stage method to implement the automatic diagnosis of WSIs, which constructs Graph Attention Networks (GAT) based on local and global fields respectively to capture their contextual information in a hierarchical manner. In the first stage, we extract representative patches from each WSI through suspicious cell detection, and then employ a Local GAT to classify cervical cells by capturing correlations between suspicious cells in image tiles. This classification process provides the confidence and feature vectors for each suspicious cell. In the second stage, we perform WSI classification using a Global GAT model. We construct graphs corresponding to top-<span><math><msub><mrow><mi>K</mi></mrow><mrow><mi>g</mi></mrow></msub></math></span> and bottom-<span><math><msub><mrow><mi>K</mi></mrow><mrow><mi>g</mi></mrow></msub></math></span> cells for each WSI based on results from Local GAT, and introduce a supervised contrastive learning strategy to enhance the discriminative power of the extracted features. Experimental results demonstrate that our proposed method outperforms conventional approaches and effectively showcases the benefits of supervised contrastive learning. Our source code and example data are available at https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"613 ","pages":"Article 128787"},"PeriodicalIF":5.5000,"publicationDate":"2024-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224015583","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Cervical cancer is one of the most common cancers among women, which seriously threatens women’s health. Early screening can reduce the incidence rate and mortality. Thinprep cytologic test (TCT) is one of the important means of cytological screening, which has high sensitivity and specificity, and has been widely used in the early screening of cervical cancer. The automatic diagnosis of whole slide images (WSIs) by computers can effectively improve the efficiency and accuracy of doctors’ diagnoses. However, current methods ignore the intrinsic relationships between cervical cells in WSIs and neglect contextual information from the surrounding suspicious areas, and therefore limit their robustness and generalizability. In this paper, we propose a novel two-stage method to implement the automatic diagnosis of WSIs, which constructs Graph Attention Networks (GAT) based on local and global fields respectively to capture their contextual information in a hierarchical manner. In the first stage, we extract representative patches from each WSI through suspicious cell detection, and then employ a Local GAT to classify cervical cells by capturing correlations between suspicious cells in image tiles. This classification process provides the confidence and feature vectors for each suspicious cell. In the second stage, we perform WSI classification using a Global GAT model. We construct graphs corresponding to top- and bottom- cells for each WSI based on results from Local GAT, and introduce a supervised contrastive learning strategy to enhance the discriminative power of the extracted features. Experimental results demonstrate that our proposed method outperforms conventional approaches and effectively showcases the benefits of supervised contrastive learning. Our source code and example data are available at https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification.
宫颈癌是妇女最常见的癌症之一,严重威胁着妇女的健康。早期筛查可以降低发病率和死亡率。薄片细胞学检查(Thinprep cytologic test,TCT)是细胞学筛查的重要手段之一,具有较高的灵敏度和特异性,已广泛应用于宫颈癌的早期筛查。利用计算机对全切片图像(WSI)进行自动诊断,可以有效提高医生诊断的效率和准确性。然而,目前的方法忽视了 WSIs 中宫颈细胞之间的内在关系,也忽略了周围可疑区域的上下文信息,因此限制了其鲁棒性和普适性。在本文中,我们提出了一种分两个阶段实现 WSI 自动识别的新方法,该方法分别基于局部场和全局场构建图注意网络 (GAT),以分层方式捕捉其上下文信息。在第一阶段,我们通过可疑细胞检测从每个 WSI 中提取具有代表性的斑块,然后采用局部 GAT,通过捕捉图像瓦片中可疑细胞之间的相关性来对宫颈细胞进行分类。这一分类过程可为每个可疑细胞提供置信度和特征向量。在第二阶段,我们使用全局 GAT 模型进行 WSI 分类。我们根据局部 GAT 的结果,为每个 WSI 构建对应于上 Kg 和下 Kg 单元的图,并引入监督对比学习策略,以增强所提取特征的判别能力。实验结果表明,我们提出的方法优于传统方法,并有效地展示了监督对比学习的优势。我们的源代码和示例数据可在 https://github.com/feimanman/Whole-Slide-Cervical-Cancer-Classification 上获取。
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.