使用基于门控递归单元的多任务时态神经网络在超声定位显微镜中高效追踪微泡轨迹

Yuting Zhang, Wenjun Zhou, Lijie Huang, Yongjie Shao, Anguo Luo, Jianwen Luo, Bo Peng
{"title":"使用基于门控递归单元的多任务时态神经网络在超声定位显微镜中高效追踪微泡轨迹","authors":"Yuting Zhang, Wenjun Zhou, Lijie Huang, Yongjie Shao, Anguo Luo, Jianwen Luo, Bo Peng","doi":"10.1109/TUFFC.2024.3424955","DOIUrl":null,"url":null,"abstract":"<p><p>Ultrasound Localization Microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical trade-off between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps like pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the Gated Recurrent Unit (GRU)-based Multitasking Temporal Neural Network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. Additionally, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer substitutions to systematically evaluate the performance of various temporal neural networks, including Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. Additionally, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. Model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.</p>","PeriodicalId":13322,"journal":{"name":"IEEE transactions on ultrasonics, ferroelectrics, and frequency control","volume":"PP ","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Efficient Microbubble Trajectory Tracking in Ultrasound Localization Microscopy Using a Gated Recurrent Unit-Based Multitasking Temporal Neural Network.\",\"authors\":\"Yuting Zhang, Wenjun Zhou, Lijie Huang, Yongjie Shao, Anguo Luo, Jianwen Luo, Bo Peng\",\"doi\":\"10.1109/TUFFC.2024.3424955\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Ultrasound Localization Microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical trade-off between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps like pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the Gated Recurrent Unit (GRU)-based Multitasking Temporal Neural Network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. Additionally, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer substitutions to systematically evaluate the performance of various temporal neural networks, including Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. Additionally, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. Model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.</p>\",\"PeriodicalId\":13322,\"journal\":{\"name\":\"IEEE transactions on ultrasonics, ferroelectrics, and frequency control\",\"volume\":\"PP \",\"pages\":\"\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-07-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on ultrasonics, ferroelectrics, and frequency control\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1109/TUFFC.2024.3424955\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ACOUSTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on ultrasonics, ferroelectrics, and frequency control","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1109/TUFFC.2024.3424955","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0

摘要

超声定位显微镜(ULM)是一种新兴的医学成像技术,它有效地解决了传统超声成像固有的分辨率和穿透力之间的传统权衡问题,为无创观察微血管系统开辟了新途径。然而,传统的微泡跟踪方法遇到了各种实际挑战。这些方法通常需要多个处理阶段,包括成对相关和轨迹优化等复杂步骤,导致实时应用不可行。此外,现有的基于深度学习的跟踪技术忽视了微泡运动的时间性,导致对其动态行为的建模效果不佳。为了解决这些局限性,本研究引入了一种名为基于门控递归单元(GRU)的多任务时态神经网络(GRU-MT)的新方法。GRU-MT 可同时处理微气泡轨迹跟踪和轨迹优化任务。此外,我们还增强了 Piepenbrock 等人最初提出的非线性运动模型,以更好地概括微气泡的非线性运动特性,从而提高轨迹跟踪精度。在本研究中,我们进行了一系列涉及网络层替换的实验,系统地评估了各种时空神经网络(包括递归神经网络、长短期记忆、GRU、变压器及其双向对应网络)在微气泡轨迹跟踪任务中的性能。同时,该方法还与传统的微气泡跟踪技术进行了定性和定量比较。实验结果表明,GRU-MT 在模拟和活体数据集上都表现出卓越的非线性建模能力和鲁棒性。此外,它还能在更短的时间间隔内减少轨迹跟踪误差,突出了它在高效微泡轨迹跟踪方面的潜力。模型代码开源于 https://github.com/zyt-Lib/GRU-MT。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Efficient Microbubble Trajectory Tracking in Ultrasound Localization Microscopy Using a Gated Recurrent Unit-Based Multitasking Temporal Neural Network.

Ultrasound Localization Microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical trade-off between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps like pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the Gated Recurrent Unit (GRU)-based Multitasking Temporal Neural Network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. Additionally, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer substitutions to systematically evaluate the performance of various temporal neural networks, including Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. Additionally, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. Model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.70
自引率
16.70%
发文量
583
审稿时长
4.5 months
期刊介绍: IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control includes the theory, technology, materials, and applications relating to: (1) the generation, transmission, and detection of ultrasonic waves and related phenomena; (2) medical ultrasound, including hyperthermia, bioeffects, tissue characterization and imaging; (3) ferroelectric, piezoelectric, and piezomagnetic materials, including crystals, polycrystalline solids, films, polymers, and composites; (4) frequency control, timing and time distribution, including crystal oscillators and other means of classical frequency control, and atomic, molecular and laser frequency control standards. Areas of interest range from fundamental studies to the design and/or applications of devices and systems.
期刊最新文献
TinyProbe: A Wearable 32-channel Multi-Modal Wireless Ultrasound Probe. LSMD: Long-Short Memory-Based Detection Network for Carotid Artery Detection in B-mode Ultrasound Video Streams. A Phantom-Free Approach for Estimating the Backscatter Coefficient of Aggregated Red Blood Cells applied to COVID-19 Patients. High-frequency wearable ultrasound array belt for small animal echocardiography. Deep Power-aware Tunable Weighting for Ultrasound Microvascular Imaging.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1