Multi-resolution visual Mamba with multi-directional selective mechanism for retinal disease detection.

IF 4.6 2区 生物学 Q2 CELL BIOLOGY Frontiers in Cell and Developmental Biology Pub Date : 2024-10-11 eCollection Date: 2024-01-01 DOI:10.3389/fcell.2024.1484880
Qiankun Zuo, Zhengkun Shi, Bo Liu, Na Ping, Jiangtao Wang, Xi Cheng, Kexin Zhang, Jia Guo, Yixian Wu, Jin Hong
{"title":"Multi-resolution visual Mamba with multi-directional selective mechanism for retinal disease detection.","authors":"Qiankun Zuo, Zhengkun Shi, Bo Liu, Na Ping, Jiangtao Wang, Xi Cheng, Kexin Zhang, Jia Guo, Yixian Wu, Jin Hong","doi":"10.3389/fcell.2024.1484880","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Retinal diseases significantly impact patients' quality of life and increase social medical costs. Optical coherence tomography (OCT) offers high-resolution imaging for precise detection and monitoring of these conditions. While deep learning techniques have been employed to extract features from OCT images for classification, convolutional neural networks (CNNs) often fail to capture global context due to their focus on local receptive fields. Transformer-based methods, on the other hand, suffer from quadratic complexity when handling long-range dependencies.</p><p><strong>Methods: </strong>To overcome these limitations, we introduce the Multi-Resolution Visual Mamba (MRVM) model, which addresses long-range dependencies with linear computational complexity for OCT image classification. The MRVM model initially employs convolution to extract local features and subsequently utilizes the retinal Mamba to capture global dependencies. By integrating multi-scale global features, the MRVM enhances classification accuracy and overall performance. Additionally, the multi-directional selection mechanism (MSM) within the retinal Mamba improves feature extraction by concentrating on various directions, thereby better capturing complex, orientation-specific retinal patterns.</p><p><strong>Results: </strong>Experimental results demonstrate that the MRVM model excels in differentiating retinal images with various lesions, achieving superior detection accuracy compared to traditional methods, with overall accuracies of 98.98\\% and 96.21\\% on two public datasets, respectively.</p><p><strong>Discussion: </strong>This approach offers a novel perspective for accurately identifying retinal diseases and could contribute to the development of more robust artificial intelligence algorithms and recognition systems for medical image-assisted diagnosis.</p>","PeriodicalId":12448,"journal":{"name":"Frontiers in Cell and Developmental Biology","volume":"12 ","pages":"1484880"},"PeriodicalIF":4.6000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11512455/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Cell and Developmental Biology","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.3389/fcell.2024.1484880","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"CELL BIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Introduction: Retinal diseases significantly impact patients' quality of life and increase social medical costs. Optical coherence tomography (OCT) offers high-resolution imaging for precise detection and monitoring of these conditions. While deep learning techniques have been employed to extract features from OCT images for classification, convolutional neural networks (CNNs) often fail to capture global context due to their focus on local receptive fields. Transformer-based methods, on the other hand, suffer from quadratic complexity when handling long-range dependencies.

Methods: To overcome these limitations, we introduce the Multi-Resolution Visual Mamba (MRVM) model, which addresses long-range dependencies with linear computational complexity for OCT image classification. The MRVM model initially employs convolution to extract local features and subsequently utilizes the retinal Mamba to capture global dependencies. By integrating multi-scale global features, the MRVM enhances classification accuracy and overall performance. Additionally, the multi-directional selection mechanism (MSM) within the retinal Mamba improves feature extraction by concentrating on various directions, thereby better capturing complex, orientation-specific retinal patterns.

Results: Experimental results demonstrate that the MRVM model excels in differentiating retinal images with various lesions, achieving superior detection accuracy compared to traditional methods, with overall accuracies of 98.98\% and 96.21\% on two public datasets, respectively.

Discussion: This approach offers a novel perspective for accurately identifying retinal diseases and could contribute to the development of more robust artificial intelligence algorithms and recognition systems for medical image-assisted diagnosis.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
具有多方向选择机制的多分辨率视觉曼巴,用于视网膜疾病检测。
导言:视网膜疾病严重影响患者的生活质量,并增加社会医疗成本。光学相干断层扫描(OCT)可提供高分辨率成像,用于精确检测和监测这些疾病。虽然深度学习技术已被用于从 OCT 图像中提取特征进行分类,但卷积神经网络(CNN)由于侧重于局部感受野,往往无法捕捉全局背景。另一方面,基于变换器的方法在处理长程依赖关系时,会受到二次复杂性的影响:为了克服这些局限性,我们引入了多分辨率视觉曼巴(MRVM)模型,该模型以线性计算复杂度解决了 OCT 图像分类中的长程依赖性问题。MRVM 模型最初采用卷积法提取局部特征,随后利用视网膜 Mamba 捕捉全局相关性。通过整合多尺度全局特征,MRVM 提高了分类精度和整体性能。此外,视网膜 Mamba 中的多方向选择机制(MSM)通过集中于不同方向来改进特征提取,从而更好地捕捉复杂、特定方向的视网膜模式:实验结果表明,MRVM 模型在区分各种病变的视网膜图像方面表现出色,与传统方法相比,检测准确率更高,在两个公共数据集上的总体准确率分别为 98.98% 和 96.21%:该方法为准确识别视网膜疾病提供了一个新的视角,有助于为医学影像辅助诊断开发更强大的人工智能算法和识别系统。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Frontiers in Cell and Developmental Biology
Frontiers in Cell and Developmental Biology Biochemistry, Genetics and Molecular Biology-Cell Biology
CiteScore
9.70
自引率
3.60%
发文量
2531
审稿时长
12 weeks
期刊介绍: Frontiers in Cell and Developmental Biology is a broad-scope, interdisciplinary open-access journal, focusing on the fundamental processes of life, led by Prof Amanda Fisher and supported by a geographically diverse, high-quality editorial board. The journal welcomes submissions on a wide spectrum of cell and developmental biology, covering intracellular and extracellular dynamics, with sections focusing on signaling, adhesion, migration, cell death and survival and membrane trafficking. Additionally, the journal offers sections dedicated to the cutting edge of fundamental and translational research in molecular medicine and stem cell biology. With a collaborative, rigorous and transparent peer-review, the journal produces the highest scientific quality in both fundamental and applied research, and advanced article level metrics measure the real-time impact and influence of each publication.
期刊最新文献
Comparison of two UPS regulators: the 26S proteasome LID and the COP9 signalosome. Contribution of the paternal histone epigenome to the preimplantation embryo. Corrigendum: Integrated analysis of single-cell and bulk RNA sequencing data reveals a cellular senescence-related signature in hepatocellular carcinoma. Editorial: Glial crosstalk in neurological disorders. Insights into the pathogenesis of gestational and hepatic diseases: the impact of ferroptosis.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1