Vision transformer architecture and applications in digital health: a tutorial and survey.

4区 计算机科学 Q1 Arts and Humanities Visual Computing for Industry, Biomedicine, and Art Pub Date : 2023-07-10 DOI:10.1186/s42492-023-00140-9
Khalid Al-Hammuri, Fayez Gebali, Awos Kanan, Ilamparithi Thirumarai Chelvan
{"title":"Vision transformer architecture and applications in digital health: a tutorial and survey.","authors":"Khalid Al-Hammuri, Fayez Gebali, Awos Kanan, Ilamparithi Thirumarai Chelvan","doi":"10.1186/s42492-023-00140-9","DOIUrl":null,"url":null,"abstract":"<p><p>The vision transformer (ViT) is a state-of-the-art architecture for image recognition tasks that plays an important role in digital health applications. Medical images account for 90% of the data in digital medicine applications. This article discusses the core foundations of the ViT architecture and its digital health applications. These applications include image segmentation, classification, detection, prediction, reconstruction, synthesis, and telehealth such as report generation and security. This article also presents a roadmap for implementing the ViT in digital health systems and discusses its limitations and challenges.</p>","PeriodicalId":52384,"journal":{"name":"Visual Computing for Industry, Biomedicine, and Art","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10333157/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Visual Computing for Industry, Biomedicine, and Art","FirstCategoryId":"1093","ListUrlMain":"https://doi.org/10.1186/s42492-023-00140-9","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Arts and Humanities","Score":null,"Total":0}
引用次数: 0

Abstract

The vision transformer (ViT) is a state-of-the-art architecture for image recognition tasks that plays an important role in digital health applications. Medical images account for 90% of the data in digital medicine applications. This article discusses the core foundations of the ViT architecture and its digital health applications. These applications include image segmentation, classification, detection, prediction, reconstruction, synthesis, and telehealth such as report generation and security. This article also presents a roadmap for implementing the ViT in digital health systems and discusses its limitations and challenges.

Abstract Image

Abstract Image

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
数字健康领域的视觉转换器架构与应用:教程与调查。
视觉转换器(ViT)是一种用于图像识别任务的先进架构,在数字医疗应用中发挥着重要作用。医疗图像占数字医疗应用数据的 90%。本文将讨论 ViT 架构的核心基础及其数字医疗应用。这些应用包括图像分割、分类、检测、预测、重建、合成以及远程医疗(如报告生成和安全)。本文还介绍了在数字医疗系统中实施 ViT 的路线图,并讨论了其局限性和挑战。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Visual Computing for Industry, Biomedicine, and Art
Visual Computing for Industry, Biomedicine, and Art Arts and Humanities-Visual Arts and Performing Arts
CiteScore
5.60
自引率
0.00%
发文量
28
审稿时长
5 weeks
期刊最新文献
Discrimination between leucine-rich glioma-inactivated 1 antibody encephalitis and gamma-aminobutyric acid B receptor antibody encephalitis based on ResNet18. Hyperparameter optimization for cardiovascular disease data-driven prognostic system. Survey of methods and principles in three-dimensional reconstruction from two-dimensional medical images. Vision transformer architecture and applications in digital health: a tutorial and survey. DB-DCAFN: dual-branch deformable cross-attention fusion network for bacterial segmentation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1