首页 > 最新文献

IEEE Journal of Translational Engineering in Health and Medicine-Jtehm最新文献

英文 中文
Single Camera-Based Gait Analysis Using Pose Estimation for Ankle-Foot Orthosis Stiffness Adjustment on Individuals With Stroke 基于姿态估计的单摄像头步态分析用于中风患者踝足矫形器刚度调整
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-07-02 DOI: 10.1109/JTEHM.2025.3585442
Masataka Yamamoto;Koji Shimatani;Daisuke Matsuura;Yusuke Murakami;Naoya Oeda;Hiroshi Takemura
Introduction: Stroke is one of the most common causes of impaired gait. The use of an ankle-foot orthosis (AFO) is one of the recommended methods to improve gait function in stroke patients. Although the stiffness of the AFO is adjusted for each stroke patient, the effect of stiffness adjustment remains unclear due to the difficulty in measuring the gait parameters in a clinical setting. Objective: This study aimed to investigate the effect of adjusting the AFO stiffness based on the gait ability of stroke patients using a markerless gait analysis method. Methods: A total of 32 individuals with stroke were directed to walk under five conditions: no-AFO and AFO with four different levels of spring stiffness. These springs were used to resist the plantarflexion movements. Moreover, the best gait speed improvement condition (best condition) was determined from the five gait conditions for each participant and was compared with the other conditions, assuming a clinical setting. Spatiotemporal gait parameters such as the gait speed, cadence, step length, stance phase, and swing phase were measured from body keypoints in RGB images. Results and Conclusion: The experimental results showed that the gait speed, cadence, step length on both sides, and stance time on both sides were significantly improved in the best condition compared with the other conditions. This study demonstrated the usefulness of the markerless gait analysis method using a single RGB camera and the effectiveness of AFO stiffness adjustment based on the gait ability of the users.
中风是步态受损最常见的原因之一。使用踝足矫形器(AFO)是改善脑卒中患者步态功能的推荐方法之一。虽然每个中风患者都调整了AFO的刚度,但由于在临床环境中难以测量步态参数,因此调整刚度的效果尚不清楚。目的:采用无标记步态分析方法,探讨基于脑卒中患者步态能力调整AFO刚度的效果。方法:对32例脑卒中患者进行5种不同条件下的步行训练,分别为无足部矫直和足部矫直,并伴有4种不同程度的弹簧刚度。这些弹簧被用来抵抗跖屈运动。此外,从每个参与者的五种步态条件中确定最佳步态速度改善条件(最佳条件),并与其他条件进行比较,假设临床设置。从RGB图像的身体关键点测量步态速度、步频、步长、站立相位和摆动相位等时空步态参数。结果与结论:实验结果表明,与其他条件相比,最佳条件下的步态速度、步频、两侧步长、两侧站立时间均有显著改善。本研究证明了使用单个RGB相机的无标记步态分析方法的有效性,以及基于用户步态能力调整AFO刚度的有效性。
{"title":"Single Camera-Based Gait Analysis Using Pose Estimation for Ankle-Foot Orthosis Stiffness Adjustment on Individuals With Stroke","authors":"Masataka Yamamoto;Koji Shimatani;Daisuke Matsuura;Yusuke Murakami;Naoya Oeda;Hiroshi Takemura","doi":"10.1109/JTEHM.2025.3585442","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3585442","url":null,"abstract":"Introduction: Stroke is one of the most common causes of impaired gait. The use of an ankle-foot orthosis (AFO) is one of the recommended methods to improve gait function in stroke patients. Although the stiffness of the AFO is adjusted for each stroke patient, the effect of stiffness adjustment remains unclear due to the difficulty in measuring the gait parameters in a clinical setting. Objective: This study aimed to investigate the effect of adjusting the AFO stiffness based on the gait ability of stroke patients using a markerless gait analysis method. Methods: A total of 32 individuals with stroke were directed to walk under five conditions: no-AFO and AFO with four different levels of spring stiffness. These springs were used to resist the plantarflexion movements. Moreover, the best gait speed improvement condition (best condition) was determined from the five gait conditions for each participant and was compared with the other conditions, assuming a clinical setting. Spatiotemporal gait parameters such as the gait speed, cadence, step length, stance phase, and swing phase were measured from body keypoints in RGB images. Results and Conclusion: The experimental results showed that the gait speed, cadence, step length on both sides, and stance time on both sides were significantly improved in the best condition compared with the other conditions. This study demonstrated the usefulness of the markerless gait analysis method using a single RGB camera and the effectiveness of AFO stiffness adjustment based on the gait ability of the users.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"333-340"},"PeriodicalIF":3.7,"publicationDate":"2025-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11063274","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144704943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effective Tumor Annotation for Automated Diagnosis of Liver Cancer 肝癌自动诊断的有效肿瘤标注
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-06-05 DOI: 10.1109/JTEHM.2025.3576827
Yi-Hsuan Chuang;Ja-Hwung Su;Tzu-Chieh Lin;Hue-Xin Cheng;Pin-Hao Shen;Jin-Ping Ou;Ding-Hong Han;Yi-Wen Liao;Yeong-Chyi Lee;Yu-Fan Cheng;Tzung-Pei Hong;Katherine Shu-Min Li;Yi Lu;Chih-Chi Wang
In recent years, visual cancer information retrieval using Artificial Intelligence has been shown to be effective in diagnosis and treatment. Especially for a modern liver-cancer diagnosis system, the automated tumor annotation plays a crucial role. So-called tumor annotation refers to tagging the tumor in Biomedical images by computer vision technologies such as Deep Learning. After annotation, the tumor information such as tumor location, tumor size and tumor characteristics can be output into a clinical report. To this end, this paper proposes an effective approach that includes tumor segmentation, tumor location, tumor measuring, and tumor recognition to achieve high-quality tumor annotation, thereby assisting radiologists in efficiently making accurate diagnosis reports. For tumor segmentation, a Multi-Residual Attention Unet is proposed to alleviate problems of vanishing gradient and information diversity. For tumor location, an effective Multi-SeResUnet is proposed to partition the liver into 8 couinaud segments. Based on the partitioned segments, the tumor is located accurately. For tumor recognition, an effective multi-labeling classifier is used to recognize the tumor characteristics by the visual tumor features. For tumor measuring, a regression model is proposed to measure the tumor size. To reveal the effectiveness of individual methods, each method was evaluated on real datasets. The experimental results reveal that the proposed methods are more promising than the state-of-the-art methods in tumor segmentation, tumor measuring, tumor localization and tumor recognition. Specifically, the average tumor size error and the annotation accuracy are 0.432 cm and 91.6%, respectively, which suggest potential for reducing radiologists’ workload. In summary, this paper proposes an effective tumor annotation for an automated diagnosis support system. Clinical and Translational Impact Statement—The proposed methods have been evaluated and shown to significantly improve the efficiency and accuracy of liver tumor annotation, reducing the time required for radiologists to complete reports on tumor segmentation, liver partition, tumor measuring and tumor recognition. By integrating into existing clinical decision support systems, it has the potential to reduce diagnostic errors and treatment delays, thereby improving patient outcomes and clinical workflow.
近年来,利用人工智能进行视觉肿瘤信息检索在诊断和治疗方面已被证明是有效的。特别是在现代肝癌诊断系统中,肿瘤的自动标注起着至关重要的作用。所谓肿瘤标注,是指利用深度学习等计算机视觉技术对生物医学图像中的肿瘤进行标注。经过标注后,肿瘤位置、肿瘤大小、肿瘤特征等肿瘤信息可以输出到临床报告中。为此,本文提出了一种包括肿瘤分割、肿瘤定位、肿瘤测量、肿瘤识别在内的实现高质量肿瘤标注的有效方法,从而帮助放射科医师高效准确地做出诊断报告。针对肿瘤分割中存在的梯度消失和信息多样性问题,提出了一种多残差关注网络。对于肿瘤的定位,提出了一种有效的Multi-SeResUnet将肝脏划分为8个不同的节段。根据分割的节段,准确定位肿瘤。在肿瘤识别方面,采用有效的多标记分类器,根据肿瘤的视觉特征对肿瘤特征进行识别。对于肿瘤的测量,提出了一个回归模型来测量肿瘤的大小。为了揭示单个方法的有效性,每种方法都在真实数据集上进行了评估。实验结果表明,该方法在肿瘤分割、肿瘤测量、肿瘤定位和肿瘤识别等方面具有较好的应用前景。具体而言,平均肿瘤大小误差和标注准确率分别为0.432 cm和91.6%,这表明有可能减少放射科医生的工作量。综上所述,本文为自动诊断支持系统提出了一种有效的肿瘤标注方法。临床和转化影响声明-所提出的方法已被评估并显示显着提高了肝脏肿瘤注释的效率和准确性,减少了放射科医生完成肿瘤分割、肝脏划分、肿瘤测量和肿瘤识别报告所需的时间。通过整合到现有的临床决策支持系统中,它有可能减少诊断错误和治疗延误,从而改善患者的治疗结果和临床工作流程。
{"title":"Effective Tumor Annotation for Automated Diagnosis of Liver Cancer","authors":"Yi-Hsuan Chuang;Ja-Hwung Su;Tzu-Chieh Lin;Hue-Xin Cheng;Pin-Hao Shen;Jin-Ping Ou;Ding-Hong Han;Yi-Wen Liao;Yeong-Chyi Lee;Yu-Fan Cheng;Tzung-Pei Hong;Katherine Shu-Min Li;Yi Lu;Chih-Chi Wang","doi":"10.1109/JTEHM.2025.3576827","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3576827","url":null,"abstract":"In recent years, visual cancer information retrieval using Artificial Intelligence has been shown to be effective in diagnosis and treatment. Especially for a modern liver-cancer diagnosis system, the automated tumor annotation plays a crucial role. So-called tumor annotation refers to tagging the tumor in Biomedical images by computer vision technologies such as Deep Learning. After annotation, the tumor information such as tumor location, tumor size and tumor characteristics can be output into a clinical report. To this end, this paper proposes an effective approach that includes tumor segmentation, tumor location, tumor measuring, and tumor recognition to achieve high-quality tumor annotation, thereby assisting radiologists in efficiently making accurate diagnosis reports. For tumor segmentation, a Multi-Residual Attention Unet is proposed to alleviate problems of vanishing gradient and information diversity. For tumor location, an effective Multi-SeResUnet is proposed to partition the liver into 8 couinaud segments. Based on the partitioned segments, the tumor is located accurately. For tumor recognition, an effective multi-labeling classifier is used to recognize the tumor characteristics by the visual tumor features. For tumor measuring, a regression model is proposed to measure the tumor size. To reveal the effectiveness of individual methods, each method was evaluated on real datasets. The experimental results reveal that the proposed methods are more promising than the state-of-the-art methods in tumor segmentation, tumor measuring, tumor localization and tumor recognition. Specifically, the average tumor size error and the annotation accuracy are 0.432 cm and 91.6%, respectively, which suggest potential for reducing radiologists’ workload. In summary, this paper proposes an effective tumor annotation for an automated diagnosis support system. Clinical and Translational Impact Statement—The proposed methods have been evaluated and shown to significantly improve the efficiency and accuracy of liver tumor annotation, reducing the time required for radiologists to complete reports on tumor segmentation, liver partition, tumor measuring and tumor recognition. By integrating into existing clinical decision support systems, it has the potential to reduce diagnostic errors and treatment delays, thereby improving patient outcomes and clinical workflow.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"251-260"},"PeriodicalIF":3.7,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11025471","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144281292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Dataset 在有限数据集上使用混合专家改进法语临床笔记分类的变压器性能
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-06-04 DOI: 10.1109/JTEHM.2025.3576570
Thanh-Dung Le;Philippe Jouvet;Rita Noumeir
Transformer-based models have shown outstanding results in natural language processing but face challenges in applications like classifying small-scale clinical texts, especially with constrained computational resources. This study presents a customized Mixture of Expert (MoE) Transformer models for classifying small-scale French clinical texts at CHU Sainte-Justine Hospital. The MoE-Transformer addresses the dual challenges of effective training with limited data and low-resource computation suitable for in-house hospital use. Despite the success of biomedical pre-trained models such as CamemBERT-bio, DrBERT, and AliBERT, their high computational demands make them impractical for many clinical settings. Our MoE-Transformer model not only outperforms DistillBERT, CamemBERT, FlauBERT, and Transformer models on the same dataset but also achieves impressive results: an accuracy of 87%, precision of 87%, recall of 85%, and F1-score of 86%. While the MoE-Transformer does not surpass the performance of biomedical pre-trained BERT models, it can be trained at least 190 times faster, offering a viable alternative for settings with limited data and computational resources. Although the MoE-Transformer addresses challenges of generalization gaps and sharp minima, demonstrating some limitations for efficient and accurate clinical text classification, this model still represents a significant advancement in the field. It is particularly valuable for classifying small French clinical narratives within the privacy and constraints of hospital-based computational resources. Clinical and Translational Impact Statement—This study highlights the potential of customized MoE-Transformers in enhancing clinical text classification, particularly for small-scale datasets like French clinical narratives. The MoE-Transformer's ability to outperform several pre-trained BERT models marks a stride in applying NLP techniques to clinical data and integrating into a Clinical Decision Support System in a Pediatric Intensive Care Unit. The study underscores the importance of model selection and customization in achieving optimal performance for specific clinical applications, especially with limited data availability and within the constraints of hospital-based computational resources
基于变压器的模型在自然语言处理方面取得了突出的成果,但在分类小规模临床文本等应用方面面临挑战,特别是在计算资源有限的情况下。本研究提出了一个定制的混合专家(MoE)变压器模型,用于在CHU圣贾斯汀医院对小规模法语临床文本进行分类。MoE-Transformer解决了使用有限数据进行有效培训和适合医院内部使用的低资源计算的双重挑战。尽管CamemBERT-bio、DrBERT和AliBERT等生物医学预训练模型取得了成功,但它们的高计算要求使它们在许多临床环境中不切实际。我们的MoE-Transformer模型不仅在相同的数据集上优于DistillBERT、CamemBERT、FlauBERT和Transformer模型,而且还取得了令人印象深刻的结果:准确率为87%,精密度为87%,召回率为85%,f1分数为86%。虽然MoE-Transformer的性能没有超过生物医学预训练BERT模型,但它的训练速度至少快190倍,为数据和计算资源有限的设置提供了可行的替代方案。尽管MoE-Transformer解决了泛化差距和锐最小值的挑战,展示了有效和准确的临床文本分类的一些限制,但该模型仍然代表了该领域的重大进步。它对于在基于医院的计算资源的隐私和限制范围内对小型法国临床叙述进行分类特别有价值。临床和翻译影响声明:本研究强调了定制的moe - transformer在增强临床文本分类方面的潜力,特别是对于像法国临床叙述这样的小规模数据集。MoE-Transformer的性能优于几个预训练的BERT模型,标志着在将NLP技术应用于临床数据并集成到儿科重症监护病房的临床决策支持系统方面迈出了一大步。该研究强调了模型选择和定制对于实现特定临床应用的最佳性能的重要性,特别是在数据可用性有限和基于医院的计算资源受限的情况下
{"title":"Improving Transformer Performance for French Clinical Notes Classification Using Mixture of Experts on a Limited Dataset","authors":"Thanh-Dung Le;Philippe Jouvet;Rita Noumeir","doi":"10.1109/JTEHM.2025.3576570","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3576570","url":null,"abstract":"Transformer-based models have shown outstanding results in natural language processing but face challenges in applications like classifying small-scale clinical texts, especially with constrained computational resources. This study presents a customized Mixture of Expert (MoE) Transformer models for classifying small-scale French clinical texts at CHU Sainte-Justine Hospital. The MoE-Transformer addresses the dual challenges of effective training with limited data and low-resource computation suitable for in-house hospital use. Despite the success of biomedical pre-trained models such as CamemBERT-bio, DrBERT, and AliBERT, their high computational demands make them impractical for many clinical settings. Our MoE-Transformer model not only outperforms DistillBERT, CamemBERT, FlauBERT, and Transformer models on the same dataset but also achieves impressive results: an accuracy of 87%, precision of 87%, recall of 85%, and F1-score of 86%. While the MoE-Transformer does not surpass the performance of biomedical pre-trained BERT models, it can be trained at least 190 times faster, offering a viable alternative for settings with limited data and computational resources. Although the MoE-Transformer addresses challenges of generalization gaps and sharp minima, demonstrating some limitations for efficient and accurate clinical text classification, this model still represents a significant advancement in the field. It is particularly valuable for classifying small French clinical narratives within the privacy and constraints of hospital-based computational resources. Clinical and Translational Impact Statement—This study highlights the potential of customized MoE-Transformers in enhancing clinical text classification, particularly for small-scale datasets like French clinical narratives. The MoE-Transformer's ability to outperform several pre-trained BERT models marks a stride in applying NLP techniques to clinical data and integrating into a Clinical Decision Support System in a Pediatric Intensive Care Unit. The study underscores the importance of model selection and customization in achieving optimal performance for specific clinical applications, especially with limited data availability and within the constraints of hospital-based computational resources","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"261-274"},"PeriodicalIF":3.7,"publicationDate":"2025-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11023574","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144299303","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Foundation Model-Based Framework for Multimodal Retinal Age Prediction 一种新的基于基础模型的多模态视网膜年龄预测框架
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-06-04 DOI: 10.1109/JTEHM.2025.3576596
Christopher Nielsen;Matthias Wilms;Nils D. Forkert
The retinal age gap (RAG; the difference between the retina’s biological and chronological age) has recently gained increased attention as a potential image-based, non-invasive, and accessible biomarker for a broad spectrum of ocular and non-ocular diseases. Traditionally, machine learning predictions of biological retinal age utilize convolutional neural network (CNN) architectures and data from color fundus photography (CFP). Despite being previously unexplored, the multimodal fusion of two-dimensional CFP with three-dimensional optical coherence tomography (OCT) data has significant potential to enhance retinal age prediction accuracy and the diagnostic utility of the RAG biomarker. Therefore, this work presents a novel foundation model-based framework for multimodal retinal age prediction. Technology or Method: Feature representations from CFP and OCT images were extracted using RETFound, a powerful foundation model for retinal image analysis. These representations were then combined using an innovative fusion strategy to train a lightweight linear regression head model for predicting retinal age. Training and evaluation of the developed multimodal retinal age prediction model was achieved using retinal images from over 80,000 participants in the UK Biobank. Results: The developed multimodal model sets a new benchmark in retinal age prediction (mean absolute error of 2.75 years), outperforming traditional CNN and single-modality approaches. Additionally, multimodal RAG values demonstrated superior performance in classifying patients with diabetes mellitus type 1, multiple sclerosis, and chronic kidney disease, highlighting the clinical relevance of the proposed multimodal approach for non-ocular disease detection. Conclusions: This work demonstrates that multimodal fusion of CFP and OCT significantly improves retinal age prediction and subsequent RAG-based analyses. By leveraging foundation models and multimodal retinal imaging, the proposed approach enhances disease classification accuracy and demonstrates the potential of integrating the RAG into clinical workflows as a scalable, non-invasive screening tool. Significance: The findings underscore the potential of multimodal retinal imaging to transform RAG into a clinically relevant and highly accessible biomarker for disease detection.
视网膜年龄差距(RAG;视网膜的生物年龄和实足年龄之间的差异最近作为一种潜在的基于图像的、非侵入性的、可获得的生物标志物,广泛用于眼部和非眼部疾病,得到了越来越多的关注。传统上,生物视网膜年龄的机器学习预测利用卷积神经网络(CNN)架构和彩色眼底摄影(CFP)数据。尽管以前未被探索过,但二维CFP与三维光学相干断层扫描(OCT)数据的多模态融合具有显著的潜力,可以提高视网膜年龄预测的准确性和RAG生物标志物的诊断效用。因此,这项工作提出了一种新的基于基础模型的多模态视网膜年龄预测框架。技术或方法:使用RETFound(视网膜图像分析的强大基础模型)提取CFP和OCT图像的特征表示。然后使用一种创新的融合策略将这些表示组合起来,以训练用于预测视网膜年龄的轻量级线性回归头部模型。利用来自英国生物银行80,000多名参与者的视网膜图像,对开发的多模态视网膜年龄预测模型进行了训练和评估。结果:所建立的多模态模型为视网膜年龄预测设定了新的基准(平均绝对误差为2.75年),优于传统的CNN和单模态方法。此外,多模态RAG值在对1型糖尿病、多发性硬化症和慢性肾病患者进行分类方面表现出优异的性能,突出了所提出的多模态方法在非眼部疾病检测中的临床意义。结论:本研究表明,CFP和OCT的多模态融合显著改善了视网膜年龄预测和随后基于rag的分析。通过利用基础模型和多模态视网膜成像,所提出的方法提高了疾病分类的准确性,并展示了将RAG作为可扩展的非侵入性筛查工具整合到临床工作流程中的潜力。意义:研究结果强调了多模态视网膜成像将RAG转化为临床相关且高度可及的疾病检测生物标志物的潜力。
{"title":"A Novel Foundation Model-Based Framework for Multimodal Retinal Age Prediction","authors":"Christopher Nielsen;Matthias Wilms;Nils D. Forkert","doi":"10.1109/JTEHM.2025.3576596","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3576596","url":null,"abstract":"The retinal age gap (RAG; the difference between the retina’s biological and chronological age) has recently gained increased attention as a potential image-based, non-invasive, and accessible biomarker for a broad spectrum of ocular and non-ocular diseases. Traditionally, machine learning predictions of biological retinal age utilize convolutional neural network (CNN) architectures and data from color fundus photography (CFP). Despite being previously unexplored, the multimodal fusion of two-dimensional CFP with three-dimensional optical coherence tomography (OCT) data has significant potential to enhance retinal age prediction accuracy and the diagnostic utility of the RAG biomarker. Therefore, this work presents a novel foundation model-based framework for multimodal retinal age prediction. Technology or Method: Feature representations from CFP and OCT images were extracted using RETFound, a powerful foundation model for retinal image analysis. These representations were then combined using an innovative fusion strategy to train a lightweight linear regression head model for predicting retinal age. Training and evaluation of the developed multimodal retinal age prediction model was achieved using retinal images from over 80,000 participants in the UK Biobank. Results: The developed multimodal model sets a new benchmark in retinal age prediction (mean absolute error of 2.75 years), outperforming traditional CNN and single-modality approaches. Additionally, multimodal RAG values demonstrated superior performance in classifying patients with diabetes mellitus type 1, multiple sclerosis, and chronic kidney disease, highlighting the clinical relevance of the proposed multimodal approach for non-ocular disease detection. Conclusions: This work demonstrates that multimodal fusion of CFP and OCT significantly improves retinal age prediction and subsequent RAG-based analyses. By leveraging foundation models and multimodal retinal imaging, the proposed approach enhances disease classification accuracy and demonstrates the potential of integrating the RAG into clinical workflows as a scalable, non-invasive screening tool. Significance: The findings underscore the potential of multimodal retinal imaging to transform RAG into a clinically relevant and highly accessible biomarker for disease detection.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"299-309"},"PeriodicalIF":3.7,"publicationDate":"2025-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11023594","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144524371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Practical Sensor-to-Segment Calibration Method for Upper Limb Inertial Motion Capture in a Clinical Setting 一种实用的上肢惯性运动捕捉传感器-节段校准方法
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-30 DOI: 10.1109/JTEHM.2025.3565986
Mhairi Mcinnes;Dimitra Blana;Andrew Starkey;Edward K. Chadwick
Inertial sensors have the potential to be a useful clinical tool because they can facilitate human motion capture outside the research setting. A major barrier to the widespread application of inertial motion capture is the lack of accepted calibration methods for ensuring accuracy, in particular the lack of a common convention for calculating the rotational offset of the sensors, known as sensor-to-segment calibration. The purpose of this study was to develop and test a sensor-to-segment calibration method for upper limb motion capture which is practical for clinical applications.We developed a calibration method which depends mainly on the estimation of joint axes from arbitrary elbow motion, and partially on the design of custom attachment mounts to achieve physical alignment. With twenty healthy participants, we used OpenSim’s inertial sensor workflow to calculate joint kinematics, and evaluated the accuracy of the method through comparison with optical motion capture.We found the new calibration method resulted in upper limb kinematics with a median RMS error of 5–8°, and a median correlation coefficient of 0.977–0.987, which was significantly more accurate than a static pose calibration (p-value < 0.001).This work has demonstrated a method of calibration which is practical for clinical applications because it is quick to perform and does not depend on the subject’s ability to perform specific movements, or on the operator’s ability to carefully place sensors.Clinical Impact: The calibration method proposed in this work is a realistic option for the translation of inertial sensor technology into everyday clinical use.
惯性传感器有潜力成为一种有用的临床工具,因为它们可以促进研究环境之外的人体运动捕捉。惯性运动捕捉广泛应用的一个主要障碍是缺乏公认的校准方法来确保精度,特别是缺乏计算传感器旋转偏移量的通用约定,称为传感器到段校准。本研究的目的是开发和测试一种用于上肢运动捕捉的传感器到节段校准方法,该方法可用于临床应用。我们开发了一种校准方法,该方法主要依赖于从任意肘关节运动中估计关节轴,部分依赖于定制附件安装的设计来实现物理校准。在20名健康参与者中,我们使用OpenSim的惯性传感器工作流程来计算关节运动学,并通过与光学运动捕捉的比较来评估该方法的准确性。结果表明,该方法的上肢运动学标定的中位数均方根误差为5 ~ 8°,中位数相关系数为0.977 ~ 0.987,显著优于静态位姿标定(p值< 0.001)。这项工作证明了一种适用于临床应用的校准方法,因为它可以快速执行,并且不依赖于受试者执行特定动作的能力,也不依赖于操作员仔细放置传感器的能力。临床影响:这项工作中提出的校准方法是将惯性传感器技术转化为日常临床使用的现实选择。
{"title":"A Practical Sensor-to-Segment Calibration Method for Upper Limb Inertial Motion Capture in a Clinical Setting","authors":"Mhairi Mcinnes;Dimitra Blana;Andrew Starkey;Edward K. Chadwick","doi":"10.1109/JTEHM.2025.3565986","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3565986","url":null,"abstract":"Inertial sensors have the potential to be a useful clinical tool because they can facilitate human motion capture outside the research setting. A major barrier to the widespread application of inertial motion capture is the lack of accepted calibration methods for ensuring accuracy, in particular the lack of a common convention for calculating the rotational offset of the sensors, known as sensor-to-segment calibration. The purpose of this study was to develop and test a sensor-to-segment calibration method for upper limb motion capture which is practical for clinical applications.We developed a calibration method which depends mainly on the estimation of joint axes from arbitrary elbow motion, and partially on the design of custom attachment mounts to achieve physical alignment. With twenty healthy participants, we used OpenSim’s inertial sensor workflow to calculate joint kinematics, and evaluated the accuracy of the method through comparison with optical motion capture.We found the new calibration method resulted in upper limb kinematics with a median RMS error of 5–8°, and a median correlation coefficient of 0.977–0.987, which was significantly more accurate than a static pose calibration (p-value < 0.001).This work has demonstrated a method of calibration which is practical for clinical applications because it is quick to perform and does not depend on the subject’s ability to perform specific movements, or on the operator’s ability to carefully place sensors.Clinical Impact: The calibration method proposed in this work is a realistic option for the translation of inertial sensor technology into everyday clinical use.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"216-226"},"PeriodicalIF":3.7,"publicationDate":"2025-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10981591","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143943979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On-Demand Cueing Sensitive to Step Variability: Understanding Its Impact on Gait of Individuals With Parkinson’s Disease 对步长变异性敏感的按需提示:了解其对帕金森病患者步态的影响
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-24 DOI: 10.1109/JTEHM.2025.3563381
Priya Pallavi;Ankita Raghuvanshi;Suhagiya Dharmik Kumar;Niravkumar Patel;Manasi Kanetkar;Rahul Chhatlani;Manish Rana;Sagar Betai;Roopa Rajan;Uttama Lahiri
Parkinson’s disease (PD) is characterized by gait disturbances with freezing of gait (FoG) being one of the most disabling symptoms. The FoG episode is often preceded by an increase in variability in Step Time. As the disease progresses, such gait impairment may become resistant to pharmacotherapy. Use of external cues is an alternative. Existing solutions deliver external cues in a continuous manner that might cause habituation effects, thereby emphasizing the need for on-demand cueing. Manual on-demand cueing upon freezing has been shown to be powerful in bringing an individual out of a freezing state. This can be achieved if one’s proneness to freeze before entering into freezing state can be sensed, and in-turn triggering an external cue on-demand. Motivated by this, we have developed a wearable device ( $mathrm{SmartWalk}_{mathrm {VC}}$ ) that can sense such proneness based on variability in Step Time to offer a visual cue on-demand. We conducted a study involving 20 age-matched healthy individuals and those with PD who walked overground while wearing SmartWalkVC operated in three modes with regard to offering visual cue, namely (a) On-demand cueing, (b) Continuous cueing and (c) No cueing. The results of our study showed that with on-demand cueing, those with PD had minimum variability of Step Time among all the three modes unlike healthy individuals whose gait remained majorly unaffected by different cueing modes. Also, walking speed increased along with a reduction in FoG episodes for those with PD in the on-demand cueing mode compared with the other two modes.Clinical and Translational Impact Statement: Wearable SmartWalkVC quantifies one’s Step Time variability to offer visual cue on-demand, reducing one’s Freezing of Gait that can have clinical significance and be translated to impact one’s social presence.
帕金森病(PD)的特点是步态障碍,步态冻结(FoG)是最致残的症状之一。在FoG发作之前,通常会出现步长变异性的增加。随着病情的发展,这种步态障碍可能对药物治疗产生抗药性。使用外部线索也是一种选择。现有的解决方案以连续的方式传递外部线索,这可能会导致习惯效应,从而强调了对随需应变的线索的需求。在冷冻时手动按需提示已被证明在使个体脱离冷冻状态方面是强大的。这可以实现,如果一个人在进入冻结状态之前的冻结倾向可以被感知,并反过来按需触发外部提示。受此启发,我们开发了一种可穿戴设备($mathrm{smartwwalk}_{mathrm {VC}}$),它可以根据步长时间的变化来感知这种倾向,并根据需要提供视觉提示。我们进行了一项研究,涉及20名年龄匹配的健康个体和PD患者,他们戴着SmartWalkVC在地面上行走,并在三种模式下提供视觉提示,即(a)按需提示,(b)连续提示和(c)无提示。我们的研究结果表明,在按需提示下,PD患者在所有三种模式下的步长变化最小,而健康个体的步态则基本不受不同提示模式的影响。此外,与其他两种模式相比,PD患者在按需提示模式下的步行速度随着FoG发作的减少而增加。临床和转化影响声明:可穿戴式SmartWalkVC量化一个人的步速变化,根据需要提供视觉提示,减少一个人的步态冻结,这可以具有临床意义,并转化为影响一个人的社交存在。
{"title":"On-Demand Cueing Sensitive to Step Variability: Understanding Its Impact on Gait of Individuals With Parkinson’s Disease","authors":"Priya Pallavi;Ankita Raghuvanshi;Suhagiya Dharmik Kumar;Niravkumar Patel;Manasi Kanetkar;Rahul Chhatlani;Manish Rana;Sagar Betai;Roopa Rajan;Uttama Lahiri","doi":"10.1109/JTEHM.2025.3563381","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3563381","url":null,"abstract":"Parkinson’s disease (PD) is characterized by gait disturbances with freezing of gait (FoG) being one of the most disabling symptoms. The FoG episode is often preceded by an increase in variability in Step Time. As the disease progresses, such gait impairment may become resistant to pharmacotherapy. Use of external cues is an alternative. Existing solutions deliver external cues in a continuous manner that might cause habituation effects, thereby emphasizing the need for on-demand cueing. Manual on-demand cueing upon freezing has been shown to be powerful in bringing an individual out of a freezing state. This can be achieved if one’s proneness to freeze before entering into freezing state can be sensed, and in-turn triggering an external cue on-demand. Motivated by this, we have developed a wearable device (<inline-formula> <tex-math>$mathrm{SmartWalk}_{mathrm {VC}}$ </tex-math></inline-formula>) that can sense such proneness based on variability in Step Time to offer a visual cue on-demand. We conducted a study involving 20 age-matched healthy individuals and those with PD who walked overground while wearing SmartWalkVC operated in three modes with regard to offering visual cue, namely (a) On-demand cueing, (b) Continuous cueing and (c) No cueing. The results of our study showed that with on-demand cueing, those with PD had minimum variability of Step Time among all the three modes unlike healthy individuals whose gait remained majorly unaffected by different cueing modes. Also, walking speed increased along with a reduction in FoG episodes for those with PD in the on-demand cueing mode compared with the other two modes.Clinical and Translational Impact Statement: Wearable SmartWalkVC quantifies one’s Step Time variability to offer visual cue on-demand, reducing one’s Freezing of Gait that can have clinical significance and be translated to impact one’s social presence.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"183-192"},"PeriodicalIF":3.7,"publicationDate":"2025-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10976342","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143896394","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Validation of a Wearable System for Enhanced Monitoring of Lower Limb Lymphedema 可穿戴下肢淋巴水肿监测系统的设计与验证
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-24 DOI: 10.1109/JTEHM.2025.3563985
Sara Bernasconi;Giovanni Maria Oriolo;Giovanni Farina;Andrea Aliverti;Antonella Lomauro
Lymphedema, characterized by limb swelling, is typically treated with Complex Decongestive Therapy (CDT), which includes physical exercise. This study seeks to design and validate a wearable device aimed at enhancing CDT by monitoring patient adherence to prescribed exercises and tracking changes in the range of motion of the affected limbs. A wearable device, constituted by two boards with 2 IMUs, connected by a flexible flat cable, was designed and developed for placement across targeted joints. It communicates wirelessly with PCs, where raw data from IMUs are collected. Through the application of the Madgwick filter, orientation of the units is obtained and finally joints angles are computed. The device was validated through bench testing using an orthopedic goniometer and field testing with an optoelectronic system. The in vivo validation involved 18 volunteers, including 10 healthy individuals and 8 individuals with lymphedema, who performed flexion-extension movements and walked on a treadmill (at speeds of 3 km/h and 5 km/h). Bench testing demonstrated strong correlation and agreement (r2=0.999, mean percentage error = -0.51°, standard deviation = 2.00°). Once worn by the participants, the device enabled the measurement of joint angles during flexion-extension exercises (r2=0.852, mean percentage error = 1.44°, standard deviation = 11.7°) and the extraction of step counting, step time and toe off during walk at different speeds. The developed wearable device exhibited robust performance in both bench and field testing. This device, designed specifically for lymphedema patients, offers valuable insights into limb function and exercise adherence, potentially improving personalized treatment strategies.
以肢体肿胀为特征的淋巴水肿,通常采用包括体育锻炼在内的综合减充血疗法(CDT)治疗。本研究旨在设计和验证一种可穿戴设备,旨在通过监测患者对规定运动的依从性和跟踪受影响肢体运动范围的变化来增强CDT。设计和开发了一种可穿戴设备,由两个带有2个imu的电路板组成,通过柔性扁平电缆连接,可放置在目标关节上。它与电脑进行无线通信,电脑收集imu的原始数据。通过Madgwick滤波器的应用,得到了单元的方位,最后计算出了关节角度。该装置通过骨科角计的台架测试和光电系统的现场测试进行了验证。体内验证涉及18名志愿者,包括10名健康个体和8名淋巴水肿患者,他们进行屈伸运动并在跑步机上行走(速度分别为3公里/小时和5公里/小时)。台架检验显示相关性强,一致性好(r2=0.999,平均百分比误差= -0.51°,标准差= 2.00°)。参与者佩戴后,该设备可以测量屈伸运动时的关节角度(r2=0.852,平均百分比误差= 1.44°,标准差= 11.7°),并提取不同速度下行走时的步数、步数和脚趾脱落。所开发的可穿戴设备在台架和现场测试中均表现出稳健的性能。该装置专为淋巴水肿患者设计,为肢体功能和运动依从性提供了有价值的见解,有可能改善个性化治疗策略。
{"title":"Design and Validation of a Wearable System for Enhanced Monitoring of Lower Limb Lymphedema","authors":"Sara Bernasconi;Giovanni Maria Oriolo;Giovanni Farina;Andrea Aliverti;Antonella Lomauro","doi":"10.1109/JTEHM.2025.3563985","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3563985","url":null,"abstract":"Lymphedema, characterized by limb swelling, is typically treated with Complex Decongestive Therapy (CDT), which includes physical exercise. This study seeks to design and validate a wearable device aimed at enhancing CDT by monitoring patient adherence to prescribed exercises and tracking changes in the range of motion of the affected limbs. A wearable device, constituted by two boards with 2 IMUs, connected by a flexible flat cable, was designed and developed for placement across targeted joints. It communicates wirelessly with PCs, where raw data from IMUs are collected. Through the application of the Madgwick filter, orientation of the units is obtained and finally joints angles are computed. The device was validated through bench testing using an orthopedic goniometer and field testing with an optoelectronic system. The in vivo validation involved 18 volunteers, including 10 healthy individuals and 8 individuals with lymphedema, who performed flexion-extension movements and walked on a treadmill (at speeds of 3 km/h and 5 km/h). Bench testing demonstrated strong correlation and agreement (r<sup>2</sup>=0.999, mean percentage error = -0.51°, standard deviation = 2.00°). Once worn by the participants, the device enabled the measurement of joint angles during flexion-extension exercises (r<sup>2</sup>=0.852, mean percentage error = 1.44°, standard deviation = 11.7°) and the extraction of step counting, step time and toe off during walk at different speeds. The developed wearable device exhibited robust performance in both bench and field testing. This device, designed specifically for lymphedema patients, offers valuable insights into limb function and exercise adherence, potentially improving personalized treatment strategies.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"193-201"},"PeriodicalIF":3.7,"publicationDate":"2025-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10975766","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143925066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Survival Prediction of Esophageal Cancer Using 3D CT Imaging: A Context-Aware Approach With Non-Local Feature Aggregation and Graph-Based Spatial Interaction 使用三维CT成像预测食管癌的生存:一种具有非局部特征聚集和基于图的空间交互的上下文感知方法
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-21 DOI: 10.1109/JTEHM.2025.3562724
Fuce Guo;Chen Huang;Shengmei Lin;Yongmei Dai;Qianshun Chen;Shu Zhang;Xunyu XU
Accurate prediction of survival rates in esophageal cancer (EC) is crucial for guiding personalized treatment decisions. Deep learning-based survival models have gained increasing attention due to their powerful ability to capture complex embeddings in medical data. However, the primary limitation of current frameworks for predicting survival lies in their lack of attention to the contextual interactions between tumor and lymph node regions, which are vital for survival predictions. In the current study, we aimed to develop an effective EC survival risk prediction using only 3D computed tomography (CT) images.The proposed model consists of two essential components: 1) non-local feature aggregation module(NFAM) that integrates visual features from tumor and lymph nodes at both local and global scales, 2) graph-based spatial interaction module(GSIM) that explores the latent contextual interactions between tumors and lymph nodes.The experimental results demonstrate that our model achieves superior performance compared to state-of-the-art survival prediction methods, emphasizing its robust predictive capability. Moreover, we found that retaining lymph nodes with major axis $geq 8$ mm yields the best predictive results (C-index: 0.725), offering valuable guidance on choosing prognostic factors for esophageal cancer.For EC survival prediction using solely 3D CT images, integrating lymph node information with tumor information helps to improve the predictive performance of deep learning models.Clinical impact: The American Joint Committee on Cancer (TNM) classification serves as the primary framework for risk stratification, prognostic evaluation, and therapeutic decision-making in oncology. Nevertheless, this prognostic tool has demonstrated limited predictive accuracy in assessing long-term survival for esophageal carcinoma patients undergoing multimodal therapeutic regimens. Notably, even among those categorized within identical staging parameters, significant outcome heterogeneity persists, with survival trajectories diverging substantially across clinically matched populations. Our model serves as a complementary tool to the TNM staging system. By stratifying patients into distinct risk categories, this approach enables accurate prognosis assessment and provides critical guidance for postoperative adjuvant therapy decisions (such as whether to administer adjuvant radiotherapy or chemotherapy), thereby facilitating personalized treatment recommendations.
准确预测食管癌(EC)的生存率对于指导个性化治疗决策至关重要。基于深度学习的生存模型因其捕获医疗数据中复杂嵌入的强大能力而受到越来越多的关注。然而,目前预测生存的框架的主要局限性在于缺乏对肿瘤和淋巴结区域之间环境相互作用的关注,而这对生存预测至关重要。在当前的研究中,我们旨在仅使用3D计算机断层扫描(CT)图像开发有效的EC生存风险预测。该模型由两个基本组件组成:1)非局部特征聚合模块(NFAM),该模块集成了肿瘤和淋巴结在局部和全局尺度上的视觉特征;2)基于图的空间交互模块(GSIM),该模块探索肿瘤和淋巴结之间潜在的上下文相互作用。实验结果表明,与现有的生存预测方法相比,我们的模型取得了更好的性能,强调了其鲁棒性。此外,我们发现保留长轴$geq 8$ mm淋巴结的预测结果最好(c指数:0.725),为食管癌预后因素的选择提供了有价值的指导。对于仅使用3D CT图像进行EC生存预测,将淋巴结信息与肿瘤信息相结合有助于提高深度学习模型的预测性能。临床影响:美国癌症联合委员会(TNM)分类是肿瘤风险分层、预后评估和治疗决策的主要框架。然而,这种预后工具在评估食管癌患者接受多模式治疗方案的长期生存时显示出有限的预测准确性。值得注意的是,即使在相同分期参数分类的患者中,显著的结果异质性仍然存在,生存轨迹在临床匹配人群中存在显著差异。我们的模型作为TNM分期系统的补充工具。通过将患者分为不同的风险类别,该方法可以准确评估预后,并为术后辅助治疗决策(如是否进行辅助放疗或化疗)提供重要指导,从而促进个性化治疗建议。
{"title":"Survival Prediction of Esophageal Cancer Using 3D CT Imaging: A Context-Aware Approach With Non-Local Feature Aggregation and Graph-Based Spatial Interaction","authors":"Fuce Guo;Chen Huang;Shengmei Lin;Yongmei Dai;Qianshun Chen;Shu Zhang;Xunyu XU","doi":"10.1109/JTEHM.2025.3562724","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3562724","url":null,"abstract":"Accurate prediction of survival rates in esophageal cancer (EC) is crucial for guiding personalized treatment decisions. Deep learning-based survival models have gained increasing attention due to their powerful ability to capture complex embeddings in medical data. However, the primary limitation of current frameworks for predicting survival lies in their lack of attention to the contextual interactions between tumor and lymph node regions, which are vital for survival predictions. In the current study, we aimed to develop an effective EC survival risk prediction using only 3D computed tomography (CT) images.The proposed model consists of two essential components: 1) non-local feature aggregation module(NFAM) that integrates visual features from tumor and lymph nodes at both local and global scales, 2) graph-based spatial interaction module(GSIM) that explores the latent contextual interactions between tumors and lymph nodes.The experimental results demonstrate that our model achieves superior performance compared to state-of-the-art survival prediction methods, emphasizing its robust predictive capability. Moreover, we found that retaining lymph nodes with major axis <inline-formula> <tex-math>$geq 8$ </tex-math></inline-formula>mm yields the best predictive results (C-index: 0.725), offering valuable guidance on choosing prognostic factors for esophageal cancer.For EC survival prediction using solely 3D CT images, integrating lymph node information with tumor information helps to improve the predictive performance of deep learning models.Clinical impact: The American Joint Committee on Cancer (TNM) classification serves as the primary framework for risk stratification, prognostic evaluation, and therapeutic decision-making in oncology. Nevertheless, this prognostic tool has demonstrated limited predictive accuracy in assessing long-term survival for esophageal carcinoma patients undergoing multimodal therapeutic regimens. Notably, even among those categorized within identical staging parameters, significant outcome heterogeneity persists, with survival trajectories diverging substantially across clinically matched populations. Our model serves as a complementary tool to the TNM staging system. By stratifying patients into distinct risk categories, this approach enables accurate prognosis assessment and provides critical guidance for postoperative adjuvant therapy decisions (such as whether to administer adjuvant radiotherapy or chemotherapy), thereby facilitating personalized treatment recommendations.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"202-213"},"PeriodicalIF":3.7,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10971407","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143913401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning-Based Automatic Diagnosis System for Developmental Dysplasia of the Hip 基于深度学习的髋关节发育不良自动诊断系统
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-15 DOI: 10.1109/JTEHM.2025.3560877
Yang Li;Leo Yan Li-Han;Hua Tian
The clinical diagnosis of developmental dysplasia of the hip (DDH) typically involves manually measuring key radiological angles—Center-Edge (CE), Tönnis, and Sharp angles—from pelvic radiographs, a process that is time-consuming and susceptible to variability. This study aims to develop an automated system that integrates these measurements to enhance the accuracy and consistency of DDH diagnosis. We developed an end-to-end deep learning model for keypoint detection that accurately identifies eight anatomical keypoints from pelvic radiographs, enabling the automated calculation of CE, Tönnis, and Sharp angles. To support the diagnostic decision, we introduced a novel data-driven scoring system that combines the information from all three angles into a comprehensive and explainable diagnostic output. The system demonstrated superior consistency in angle measurements compared to a cohort of eight moderately experienced orthopedists. The intraclass correlation coefficients for the CE, Tönnis, and Sharp angles were 0.957 (95% CI: 0.952–0.962), 0.942 (95% CI: 0.937–0.947), and 0.966 (95% CI: 0.964–0.968), respectively. The system achieved a diagnostic F1 score of 0.863 (95% CI: 0.851–0.876), significantly outperforming the orthopedist group (0.777, 95% CI: 0.737–0.817, $p = 0.005$ ), as well as using clinical diagnostic criteria for each angle individually ( $plt 0.001$ ). The proposed system provides reliable and consistent automated measurements of radiological angles and an explainable diagnostic output for DDH, outperforming moderately experienced clinicians.Clinical impact: This AI-powered solution reduces the variability and potential errors of manual measurements, offering clinicians a more consistent and interpretable tool for DDH diagnosis.
髋关节发育不良(DDH)的临床诊断通常涉及人工测量骨盆x线片的关键放射角度-中心边缘(CE), Tönnis和锐角,这一过程既耗时又容易变化。本研究旨在开发一个集成这些测量的自动化系统,以提高DDH诊断的准确性和一致性。我们开发了一个端到端的深度学习模型,用于关键点检测,该模型可以准确地从骨盆x线片中识别8个解剖关键点,从而实现CE、Tönnis和Sharp角的自动计算。为了支持诊断决策,我们引入了一种新颖的数据驱动评分系统,该系统将所有三个角度的信息结合到一个全面且可解释的诊断输出中。与8位中等经验的骨科医生相比,该系统在角度测量方面表现出优越的一致性。CE、Tönnis和Sharp角的类内相关系数分别为0.957 (95% CI: 0.952-0.962)、0.942 (95% CI: 0.937-0.947)和0.966 (95% CI: 0.964-0.968)。该系统的诊断F1评分为0.863 (95% CI: 0.851-0.876),显著优于骨科组(0.777,95% CI: 0.737-0.817, p = 0.005),并且单独使用每个角度的临床诊断标准(plt 0.001)。该系统为DDH提供可靠和一致的放射角度自动测量和可解释的诊断输出,优于中等经验的临床医生。临床影响:这种人工智能解决方案减少了人工测量的可变性和潜在错误,为临床医生提供了更加一致和可解释的DDH诊断工具。
{"title":"Deep Learning-Based Automatic Diagnosis System for Developmental Dysplasia of the Hip","authors":"Yang Li;Leo Yan Li-Han;Hua Tian","doi":"10.1109/JTEHM.2025.3560877","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3560877","url":null,"abstract":"The clinical diagnosis of developmental dysplasia of the hip (DDH) typically involves manually measuring key radiological angles—Center-Edge (CE), Tönnis, and Sharp angles—from pelvic radiographs, a process that is time-consuming and susceptible to variability. This study aims to develop an automated system that integrates these measurements to enhance the accuracy and consistency of DDH diagnosis. We developed an end-to-end deep learning model for keypoint detection that accurately identifies eight anatomical keypoints from pelvic radiographs, enabling the automated calculation of CE, Tönnis, and Sharp angles. To support the diagnostic decision, we introduced a novel data-driven scoring system that combines the information from all three angles into a comprehensive and explainable diagnostic output. The system demonstrated superior consistency in angle measurements compared to a cohort of eight moderately experienced orthopedists. The intraclass correlation coefficients for the CE, Tönnis, and Sharp angles were 0.957 (95% CI: 0.952–0.962), 0.942 (95% CI: 0.937–0.947), and 0.966 (95% CI: 0.964–0.968), respectively. The system achieved a diagnostic F1 score of 0.863 (95% CI: 0.851–0.876), significantly outperforming the orthopedist group (0.777, 95% CI: 0.737–0.817, <inline-formula> <tex-math>$p = 0.005$ </tex-math></inline-formula>), as well as using clinical diagnostic criteria for each angle individually (<inline-formula> <tex-math>$plt 0.001$ </tex-math></inline-formula>). The proposed system provides reliable and consistent automated measurements of radiological angles and an explainable diagnostic output for DDH, outperforming moderately experienced clinicians.Clinical impact: This AI-powered solution reduces the variability and potential errors of manual measurements, offering clinicians a more consistent and interpretable tool for DDH diagnosis.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"174-182"},"PeriodicalIF":3.7,"publicationDate":"2025-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10965781","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143896492","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Design of a Portable Birdcage via Meander Line Antenna (MLA) to Lower Beta Amyloid (Aβ) in Alzheimer’s Disease 通过弯曲线天线(MLA)降低阿尔茨海默病β淀粉样蛋白(Aβ)的新型便携式鸟笼设计
IF 3.7 3区 医学 Q2 ENGINEERING, BIOMEDICAL Pub Date : 2025-04-10 DOI: 10.1109/JTEHM.2025.3559693
Felipe Perez;Jorge Morisaki;Haitham Kanakri;Maher Rizkalla;Ahmed Abdalla
Late Onset Alzheimer’s Disease (LOAD) is the most common cause of dementia, characterized by the deposition of plaques primarily of neurotoxic amyloid- $beta $ ( $Abeta $ ) peptide and tau protein. Our objective is to develop a noninvasive therapy to decrease the toxic A $beta $ levels, using repeated electromagnetic field stimulation (REMFS) in the brain of Alzheimer’s disease patients. We previously examined the effects of REMFS on $Abeta $ levels in primary human brain (PHB) cultures at different frequencies, powers, and specific absorption rates (SAR). PHB cultures at day in vitro (DIV7) treated with 64 MHz with a SAR of 0.6 W/Kg, one hour daily for 14 days (DIV 21) had significantly reduced (p =0.001) levels of secreted $Abeta $ -42 and $Abeta $ -40 peptide without evidence of toxicity. The EMF frequency and power, and SAR levels used in our work is utilized in MRI’s, thus suggesting REMFS can be further developed in clinical settings to lower ( $Abeta $ ) levels and improve the memory in AD patients. These findings and numerous studies in rodent AD models prompted us to design a portable RF device, appropriate for human use, that will deliver a homogeneous RF power deposition with a SAR value of 0.4-0.9 W/kg to all human brain memory areas, lower ( $Abeta $ ) levels, and potentially improve memory in human AD patients.The research took place at the Indiana University School of Medicine (IUSM) and Purdue University Indianapolis. The first phase was done in PHB cultures at the IUSM. Through this phase, we found that a 64 MHz frequency and an RF power deposition with a SAR of 0.4-0.6 W/kg reduced the (A $beta $ ) levels potentially impacting Alzheimer’s disease. The second phase of the project was conducted at Purdue University, we used ANSYS HFSS (High Frequency Simulation System) to design the devices that produced an appropriate penetration depth, polarization, and power deposition with a SAR of 0.4-0.9 W/kg to all memory brain areas of several numerical models. In Phase II-B will validate the device in a physical phantom. Phase III will require the FDA approval and application in clinical trials.The research parameters were translated into a designed product that fits comfortably in human head and fed from an external RF source that generates an RF power deposition with a SAR of 0.4-0.9 W/kg to a realistic numerical brain. The engineering design is flexible by varying the leg capacitors of the Meander Line Antenna (MLA) devices. Thermal outcomes of the resu
最近,我们的工程团队设计了一种鸟笼天线,可以在真实的数值人脑中产生具有与我们生物实验相同SAR值的均匀射频功率沉积。在这里,工程研究已经扩展到研究便携式柔性鸟笼天线的设计,该天线将能够调整以适应身体患者的特征,如几何形状,头部大小和组织尺寸。这种新设备有望改善SAR的均匀性,并可能减少治疗期间患者大脑中未治疗区域的可能性。此外,我们确定这些暴露的最高温升小于0.5°C,这是监管机构的安全水平。本研究考虑一种便携式设备系统,将达到研究参数和患者满意度的可靠性和舒适性。
{"title":"A Novel Design of a Portable Birdcage via Meander Line Antenna (MLA) to Lower Beta Amyloid (Aβ) in Alzheimer’s Disease","authors":"Felipe Perez;Jorge Morisaki;Haitham Kanakri;Maher Rizkalla;Ahmed Abdalla","doi":"10.1109/JTEHM.2025.3559693","DOIUrl":"https://doi.org/10.1109/JTEHM.2025.3559693","url":null,"abstract":"Late Onset Alzheimer’s Disease (LOAD) is the most common cause of dementia, characterized by the deposition of plaques primarily of neurotoxic amyloid-<inline-formula> <tex-math>$beta $ </tex-math></inline-formula> (<inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula>) peptide and tau protein. Our objective is to develop a noninvasive therapy to decrease the toxic A<inline-formula> <tex-math>$beta $ </tex-math></inline-formula> levels, using repeated electromagnetic field stimulation (REMFS) in the brain of Alzheimer’s disease patients. We previously examined the effects of REMFS on <inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula> levels in primary human brain (PHB) cultures at different frequencies, powers, and specific absorption rates (SAR). PHB cultures at day in vitro (DIV7) treated with 64 MHz with a SAR of 0.6 W/Kg, one hour daily for 14 days (DIV 21) had significantly reduced (p =0.001) levels of secreted <inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula>-42 and <inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula>-40 peptide without evidence of toxicity. The EMF frequency and power, and SAR levels used in our work is utilized in MRI’s, thus suggesting REMFS can be further developed in clinical settings to lower (<inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula>) levels and improve the memory in AD patients. These findings and numerous studies in rodent AD models prompted us to design a portable RF device, appropriate for human use, that will deliver a homogeneous RF power deposition with a SAR value of 0.4-0.9 W/kg to all human brain memory areas, lower (<inline-formula> <tex-math>$Abeta $ </tex-math></inline-formula>) levels, and potentially improve memory in human AD patients.The research took place at the Indiana University School of Medicine (IUSM) and Purdue University Indianapolis. The first phase was done in PHB cultures at the IUSM. Through this phase, we found that a 64 MHz frequency and an RF power deposition with a SAR of 0.4-0.6 W/kg reduced the (A<inline-formula> <tex-math>$beta $ </tex-math></inline-formula>) levels potentially impacting Alzheimer’s disease. The second phase of the project was conducted at Purdue University, we used ANSYS HFSS (High Frequency Simulation System) to design the devices that produced an appropriate penetration depth, polarization, and power deposition with a SAR of 0.4-0.9 W/kg to all memory brain areas of several numerical models. In Phase II-B will validate the device in a physical phantom. Phase III will require the FDA approval and application in clinical trials.The research parameters were translated into a designed product that fits comfortably in human head and fed from an external RF source that generates an RF power deposition with a SAR of 0.4-0.9 W/kg to a realistic numerical brain. The engineering design is flexible by varying the leg capacitors of the Meander Line Antenna (MLA) devices. Thermal outcomes of the resu","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"13 ","pages":"158-173"},"PeriodicalIF":3.7,"publicationDate":"2025-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10962220","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143883508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Journal of Translational Engineering in Health and Medicine-Jtehm
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1