Hongming Xu;Qi Xu;Fengyu Cong;Jeonghyun Kang;Chu Han;Zaiyi Liu;Anant Madabhushi;Cheng Lu
{"title":"用于计算组织病理学的视觉转换器","authors":"Hongming Xu;Qi Xu;Fengyu Cong;Jeonghyun Kang;Chu Han;Zaiyi Liu;Anant Madabhushi;Cheng Lu","doi":"10.1109/RBME.2023.3297604","DOIUrl":null,"url":null,"abstract":"Computational histopathology is focused on the automatic analysis of rich phenotypic information contained in gigabyte whole slide images, aiming at providing cancer patients with more accurate diagnosis, prognosis, and treatment recommendations. Nowadays deep learning is the mainstream methodological choice in computational histopathology. Transformer, as the latest technological advance in deep learning, learns feature representations and global dependencies based on self-attention mechanisms, which is increasingly gaining prevalence in this field. This article presents a comprehensive review of state-of-the-art vision transformers that have been explored in histopathological image analysis for classification, segmentation, and survival risk regression applications. We first overview preliminary concepts and components built into vision transformers. Various recent applications including whole slide image classification, histological tissue component segmentation, and survival outcome prediction with tailored transformer architectures are then discussed. We finally discuss key challenges revolving around the use of vision transformers and envisioned future perspectives. We hope that this review could provide an elaborate guideline for readers to explore vision transformers in computational histopathology, such that more advanced techniques assisting in the precise diagnosis and treatment of cancer patients could be developed.","PeriodicalId":39235,"journal":{"name":"IEEE Reviews in Biomedical Engineering","volume":"17 ","pages":"63-79"},"PeriodicalIF":17.2000,"publicationDate":"2023-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vision Transformers for Computational Histopathology\",\"authors\":\"Hongming Xu;Qi Xu;Fengyu Cong;Jeonghyun Kang;Chu Han;Zaiyi Liu;Anant Madabhushi;Cheng Lu\",\"doi\":\"10.1109/RBME.2023.3297604\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Computational histopathology is focused on the automatic analysis of rich phenotypic information contained in gigabyte whole slide images, aiming at providing cancer patients with more accurate diagnosis, prognosis, and treatment recommendations. Nowadays deep learning is the mainstream methodological choice in computational histopathology. Transformer, as the latest technological advance in deep learning, learns feature representations and global dependencies based on self-attention mechanisms, which is increasingly gaining prevalence in this field. This article presents a comprehensive review of state-of-the-art vision transformers that have been explored in histopathological image analysis for classification, segmentation, and survival risk regression applications. We first overview preliminary concepts and components built into vision transformers. Various recent applications including whole slide image classification, histological tissue component segmentation, and survival outcome prediction with tailored transformer architectures are then discussed. We finally discuss key challenges revolving around the use of vision transformers and envisioned future perspectives. We hope that this review could provide an elaborate guideline for readers to explore vision transformers in computational histopathology, such that more advanced techniques assisting in the precise diagnosis and treatment of cancer patients could be developed.\",\"PeriodicalId\":39235,\"journal\":{\"name\":\"IEEE Reviews in Biomedical Engineering\",\"volume\":\"17 \",\"pages\":\"63-79\"},\"PeriodicalIF\":17.2000,\"publicationDate\":\"2023-07-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Reviews in Biomedical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10190115/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, BIOMEDICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Reviews in Biomedical Engineering","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10190115/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
Vision Transformers for Computational Histopathology
Computational histopathology is focused on the automatic analysis of rich phenotypic information contained in gigabyte whole slide images, aiming at providing cancer patients with more accurate diagnosis, prognosis, and treatment recommendations. Nowadays deep learning is the mainstream methodological choice in computational histopathology. Transformer, as the latest technological advance in deep learning, learns feature representations and global dependencies based on self-attention mechanisms, which is increasingly gaining prevalence in this field. This article presents a comprehensive review of state-of-the-art vision transformers that have been explored in histopathological image analysis for classification, segmentation, and survival risk regression applications. We first overview preliminary concepts and components built into vision transformers. Various recent applications including whole slide image classification, histological tissue component segmentation, and survival outcome prediction with tailored transformer architectures are then discussed. We finally discuss key challenges revolving around the use of vision transformers and envisioned future perspectives. We hope that this review could provide an elaborate guideline for readers to explore vision transformers in computational histopathology, such that more advanced techniques assisting in the precise diagnosis and treatment of cancer patients could be developed.
期刊介绍:
IEEE Reviews in Biomedical Engineering (RBME) serves as a platform to review the state-of-the-art and trends in the interdisciplinary field of biomedical engineering, which encompasses engineering, life sciences, and medicine. The journal aims to consolidate research and reviews for members of all IEEE societies interested in biomedical engineering. Recognizing the demand for comprehensive reviews among authors of various IEEE journals, RBME addresses this need by receiving, reviewing, and publishing scholarly works under one umbrella. It covers a broad spectrum, from historical to modern developments in biomedical engineering and the integration of technologies from various IEEE societies into the life sciences and medicine.