Pub Date : 2024-10-01DOI: 10.1109/JTEHM.2024.3471468
Qiuyang Lin;Haocun Wang;Dwaipayan Biswas;Zheyi Li;Erika Lutin;Chris van Hoof;Mingyi Chen;Nick van Helleputte
Advancements in integrated circuit (IC) technology have accelerated the miniaturization of body-worn sensors and systems, enabling long-term health monitoring. Wearable electrocardiogram (ECG), finger photoplethysmogram (PPG), and wrist-worn PPG have shown great success and significantly improved life quality. Chest-based PPG has the potential to extract multiple vital signs but requires ultra-high dynamic range (DR) IC to read out the small PPG signal among large respiration and artifacts inherent in daily life. This paper presents a dedicated high DR system for wearable chest PPG applications with a small form factor. The whole measurement system is integrated on a 20 cm2 PCB board. We have formulated a comprehensive evaluation protocol to validate the system with on-body chest PPG measurement in the workspace environment. First, chest PPG data was obtained from 6 adults and compared to data from a standard ECG patch. This system showed an average absolute deviation (AD) of 0.41 beats per minute, achieving > 99.53% heart rate (HR) accuracy. Second, chest PPG was recorded and compared to conventional PPG finger clip and PPG wristband, also showing > 98.6% HR matching and an absolute deviation in the standard deviation of NN intervals (SDNN) of < 12.8 ms for HRV monitoring within the protocol. Moreover, it successfully derives other vital parameters such as respiration rate and blood oxygen level (SpO2), showing the advancement among all these three reference modalities. This system can pave the way for new application areas, such as chest patches, to monitor chronic heart and respiratory diseases.
{"title":"A Novel Chest-Based PPG Measurement System","authors":"Qiuyang Lin;Haocun Wang;Dwaipayan Biswas;Zheyi Li;Erika Lutin;Chris van Hoof;Mingyi Chen;Nick van Helleputte","doi":"10.1109/JTEHM.2024.3471468","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3471468","url":null,"abstract":"Advancements in integrated circuit (IC) technology have accelerated the miniaturization of body-worn sensors and systems, enabling long-term health monitoring. Wearable electrocardiogram (ECG), finger photoplethysmogram (PPG), and wrist-worn PPG have shown great success and significantly improved life quality. Chest-based PPG has the potential to extract multiple vital signs but requires ultra-high dynamic range (DR) IC to read out the small PPG signal among large respiration and artifacts inherent in daily life. This paper presents a dedicated high DR system for wearable chest PPG applications with a small form factor. The whole measurement system is integrated on a 20 cm2 PCB board. We have formulated a comprehensive evaluation protocol to validate the system with on-body chest PPG measurement in the workspace environment. First, chest PPG data was obtained from 6 adults and compared to data from a standard ECG patch. This system showed an average absolute deviation (AD) of 0.41 beats per minute, achieving > 99.53% heart rate (HR) accuracy. Second, chest PPG was recorded and compared to conventional PPG finger clip and PPG wristband, also showing > 98.6% HR matching and an absolute deviation in the standard deviation of NN intervals (SDNN) of < 12.8 ms for HRV monitoring within the protocol. Moreover, it successfully derives other vital parameters such as respiration rate and blood oxygen level (SpO2), showing the advancement among all these three reference modalities. This system can pave the way for new application areas, such as chest patches, to monitor chronic heart and respiratory diseases.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"675-683"},"PeriodicalIF":3.7,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10701507","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142524193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-19DOI: 10.1109/JTEHM.2024.3463720
Jiwon Chung;Sunghun Kim;Ji Hye Won;Hyunjin Park
Neuroimaging genetics represents a multivariate approach aimed at elucidating the intricate relationships between high-dimensional genetic variations and neuroimaging data. Predominantly, existing methodologies revolve around Sparse Canonical Correlation Analysis (SCCA), a framework we expand to 1) encompass multiple imaging modalities and 2) promote the simultaneous identification of structurally linked features across imaging modalities. The structurally linked brain regions were assessed using diffusion tensor imaging, which quantifies the presence of neuronal fibers, thereby grounding our approach in biologically well-founded prior knowledge within the SCCA model. In our proposed structurally linked SCCA framework, we leverage T1-weighted MRI and functional MRI (fMRI) time series data to delineate both the structural and functional characteristics of the brain. Genetic variations, specifically single nucleotide polymorphisms (SNPs), are also incorporated as a genetic modality. Validation of our methodology was conducted using a simulated dataset and large-scale normative data from the Human Connectome Project (HCP). Our approach demonstrated superior performance compared to existing methods on simulated data and revealed interpretable gene-imaging associations in the real dataset. Thus, our methodology lays the groundwork for elucidating the genetic underpinnings of brain structure and function, thereby providing novel insights into the field of neuroscience. Our code is available at https://github.com/mungegg .
{"title":"Integrating Multimodal Neuroimaging and Genetics: A Structurally-Linked Sparse Canonical Correlation Analysis Approach","authors":"Jiwon Chung;Sunghun Kim;Ji Hye Won;Hyunjin Park","doi":"10.1109/JTEHM.2024.3463720","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3463720","url":null,"abstract":"Neuroimaging genetics represents a multivariate approach aimed at elucidating the intricate relationships between high-dimensional genetic variations and neuroimaging data. Predominantly, existing methodologies revolve around Sparse Canonical Correlation Analysis (SCCA), a framework we expand to 1) encompass multiple imaging modalities and 2) promote the simultaneous identification of structurally linked features across imaging modalities. The structurally linked brain regions were assessed using diffusion tensor imaging, which quantifies the presence of neuronal fibers, thereby grounding our approach in biologically well-founded prior knowledge within the SCCA model. In our proposed structurally linked SCCA framework, we leverage T1-weighted MRI and functional MRI (fMRI) time series data to delineate both the structural and functional characteristics of the brain. Genetic variations, specifically single nucleotide polymorphisms (SNPs), are also incorporated as a genetic modality. Validation of our methodology was conducted using a simulated dataset and large-scale normative data from the Human Connectome Project (HCP). Our approach demonstrated superior performance compared to existing methods on simulated data and revealed interpretable gene-imaging associations in the real dataset. Thus, our methodology lays the groundwork for elucidating the genetic underpinnings of brain structure and function, thereby providing novel insights into the field of neuroscience. Our code is available at \u0000<uri>https://github.com/mungegg</uri>\u0000.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"659-667"},"PeriodicalIF":3.7,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10684222","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142434622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-10DOI: 10.1109/JTEHM.2024.3457593
Jun Wang;Zeyang Dai;Xiao Liu
Nocturnal enuresis is a bothersome condition that affects many children and their caregivers. Post-voiding systems is of little value in training a child into a correct voiding routing while existing pre-voiding systems suffer from several practical limitations, such as cumbersome hardware, assuming individual bladder shapes being universal, and being sensitive to sensor placement error. Methods: A low-voltage ultrasound system with machine learning has been developed in estimating bladder filling status. A custom-made flexible 1D transducer array has been excited by low-voltage coded pulses with a pulse compression technique for an enhanced signal-to-noise ratio. In order to minimize the negative influence of possible transducer misplacement, a multiple-position training strategy using machine learning has been adopted in this work. Three popular classification methods, KNN, SVM and sparse coding, have been utilized to classify the acquired different volumes ranging from 100 ml to 300 ml into two categories: low volume and high volume. The low-volume category requires no further action while the high-volume category triggers an alarm to alert the child and caregiver. Results: When the sensor placement is ideal, i.e., the position of the practical sensor placement is on spot with the trained position, the precision and recall of the classification using sparse coding are $0.957~pm ~0.02$ and $0.958~pm ~0.02$ , respectively. Even if the transducer array is misplaced by up to 4.5 mm away from the ideal location, the proposed system is able to maintain high classification accuracy (precision $ge 0.75$ and recall $ge 0.75$ ). Category: Early/Pre-Clinical Research Clinical and Translational Impact: The proposed ultrasound sensor system for nocturnal enuresis is of significant clinical and translational value as it addresses two major issues that limit the wide adoption of similar devices. Firstly, it offers enhanced safety as the entire system has been implemented in the lowvoltage domain. Secondly, the system features ample tolerance to sensor misplacement while maintaining high classification accuracy. These features combined provide a much more user-friendly environment for children and their caregivers than existing devices.
{"title":"A Pre-Voiding Alarm System Using Wearable Ultrasound and Machine Learning Algorithms for Children With Nocturnal Enuresis","authors":"Jun Wang;Zeyang Dai;Xiao Liu","doi":"10.1109/JTEHM.2024.3457593","DOIUrl":"10.1109/JTEHM.2024.3457593","url":null,"abstract":"Nocturnal enuresis is a bothersome condition that affects many children and their caregivers. Post-voiding systems is of little value in training a child into a correct voiding routing while existing pre-voiding systems suffer from several practical limitations, such as cumbersome hardware, assuming individual bladder shapes being universal, and being sensitive to sensor placement error. Methods: A low-voltage ultrasound system with machine learning has been developed in estimating bladder filling status. A custom-made flexible 1D transducer array has been excited by low-voltage coded pulses with a pulse compression technique for an enhanced signal-to-noise ratio. In order to minimize the negative influence of possible transducer misplacement, a multiple-position training strategy using machine learning has been adopted in this work. Three popular classification methods, KNN, SVM and sparse coding, have been utilized to classify the acquired different volumes ranging from 100 ml to 300 ml into two categories: low volume and high volume. The low-volume category requires no further action while the high-volume category triggers an alarm to alert the child and caregiver. Results: When the sensor placement is ideal, i.e., the position of the practical sensor placement is on spot with the trained position, the precision and recall of the classification using sparse coding are \u0000<inline-formula> <tex-math>$0.957~pm ~0.02$ </tex-math></inline-formula>\u0000 and \u0000<inline-formula> <tex-math>$0.958~pm ~0.02$ </tex-math></inline-formula>\u0000, respectively. Even if the transducer array is misplaced by up to 4.5 mm away from the ideal location, the proposed system is able to maintain high classification accuracy (precision \u0000<inline-formula> <tex-math>$ge 0.75$ </tex-math></inline-formula>\u0000 and recall \u0000<inline-formula> <tex-math>$ge 0.75$ </tex-math></inline-formula>\u0000). Category: Early/Pre-Clinical Research Clinical and Translational Impact: The proposed ultrasound sensor system for nocturnal enuresis is of significant clinical and translational value as it addresses two major issues that limit the wide adoption of similar devices. Firstly, it offers enhanced safety as the entire system has been implemented in the lowvoltage domain. Secondly, the system features ample tolerance to sensor misplacement while maintaining high classification accuracy. These features combined provide a much more user-friendly environment for children and their caregivers than existing devices.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"643-658"},"PeriodicalIF":3.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10671589","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142181839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-10DOI: 10.1109/JTEHM.2024.3455941
George Oliveira Barros;José Nathan Andrade Muller da Silva;Henrique Machado de Sousa Proença;Stanley Almeida Araújo;David Campos Wanderley;Luciano Rebouças de Oliveira;Washington Luis Conrado Dos-Santos;Angelo Amancio Duarte;Flavio de Barros Vidal
Podocyte degenerative changes are common in various kidney diseases, and their accurate identification is crucial for pathologists to diagnose and treat such conditions. However, this can be a difficult task, and previous attempts to automate the identification of podocytes have not been entirely successful. To address this issue, this study proposes a novel approach that combines pathologists’ expertise with an automated classifier to enhance the identification of podocytopathies. The study involved building a new dataset of renal glomeruli images, some with and others without podocyte degenerative changes, and developing a convolutional neural network (CNN) based classifier. The results showed that our automated classifier achieved an impressive 90.9% f-score. When the pathologists used as an auxiliary tool to classify a second set of images, the medical group’s average performance increased significantly, from $91.4pm 12.5$ % to $96.1pm 2.9$ % of f-score. Fleiss’ kappa agreement among the pathologists also increased from 0.59 to 0.83. Conclusion: These findings suggest that automating this task can bring benefits for pathologists to correctly identify images of glomeruli with podocyte degeneration, leading to improved individual accuracy while raising agreement in diagnosing podocytopathies. This approach could have significant implications for the diagnosis and treatment of kidney diseases. Clinical impact: The approach presented in this study has the potential to enhance the accuracy of medical diagnoses for detecting podocyte abnormalities in glomeruli, which serve as biomarkers for various glomerular diseases.
{"title":"Enhancing Podocyte Degenerative Changes Identification With Pathologist Collaboration: Implications for Improved Diagnosis in Kidney Diseases","authors":"George Oliveira Barros;José Nathan Andrade Muller da Silva;Henrique Machado de Sousa Proença;Stanley Almeida Araújo;David Campos Wanderley;Luciano Rebouças de Oliveira;Washington Luis Conrado Dos-Santos;Angelo Amancio Duarte;Flavio de Barros Vidal","doi":"10.1109/JTEHM.2024.3455941","DOIUrl":"10.1109/JTEHM.2024.3455941","url":null,"abstract":"Podocyte degenerative changes are common in various kidney diseases, and their accurate identification is crucial for pathologists to diagnose and treat such conditions. However, this can be a difficult task, and previous attempts to automate the identification of podocytes have not been entirely successful. To address this issue, this study proposes a novel approach that combines pathologists’ expertise with an automated classifier to enhance the identification of podocytopathies. The study involved building a new dataset of renal glomeruli images, some with and others without podocyte degenerative changes, and developing a convolutional neural network (CNN) based classifier. The results showed that our automated classifier achieved an impressive 90.9% f-score. When the pathologists used as an auxiliary tool to classify a second set of images, the medical group’s average performance increased significantly, from \u0000<inline-formula> <tex-math>$91.4pm 12.5$ </tex-math></inline-formula>\u0000% to \u0000<inline-formula> <tex-math>$96.1pm 2.9$ </tex-math></inline-formula>\u0000% of f-score. Fleiss’ kappa agreement among the pathologists also increased from 0.59 to 0.83. Conclusion: These findings suggest that automating this task can bring benefits for pathologists to correctly identify images of glomeruli with podocyte degeneration, leading to improved individual accuracy while raising agreement in diagnosing podocytopathies. This approach could have significant implications for the diagnosis and treatment of kidney diseases. Clinical impact: The approach presented in this study has the potential to enhance the accuracy of medical diagnoses for detecting podocyte abnormalities in glomeruli, which serve as biomarkers for various glomerular diseases.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"635-642"},"PeriodicalIF":3.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10675352","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142181840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-03DOI: 10.1109/JTEHM.2024.3454077
Zhichuan Tang;Zhixuan Cui;Hang Wang;Pengcheng Liu;Xuan Xu;Keshuai Yang
Rehabilitation devices, such as traditional rigid exoskeletons or exosuits, have been widely used to rehabilitate upper limb function post-stroke. In this paper, we have developed an exosuit with four degrees of freedom to enable users to involve more joints in the rehabilitation process. Additionally, a hybrid electroencephalogram-based (EEG-based) control approach has been developed to promote active user engagement and provide more control commands.The hybrid EEG-based control approach includes steady-state visual evoked potential (SSVEP) paradigm and motor imagery (MI) paradigm. Firstly, the rehabilitation movement was selected by SSVEP paradigm, and the multivariate variational mode decomposition (MVMD) and canonical correlation analysis (CCA) method was used for SSVEP EEG recognition; then, the motion intention was obtained by MI paradigm, and the convolutional neural network (CNN) and long short-term memory network (LSTM) were used to build a CNN-LSTM model for MI EEG recognition; finally, the recognition results were translated into control commands of Bowden cables to achieve multi-degree-of-freedom rehabilitation.Experimental results show that the average classification accuracy of the CNN-LSTM model reaches to 90.07% ± 2.23%, and the overall accuracy of the hybrid EEG-based control approach reaches to 85.26% ± 1.95%. The twelve subjects involved in the usability assessment demonstrated an average system usability scale (SUS) score of 81.25 ± 5.82. Additionally, four participants who underwent a 35-day rehabilitation training demonstrated an average 10.33% increase in range of motion (ROM) across 4 joints, along with a 11.35% increase in the average electromyography (EMG) amplitude of the primary muscle involved.The exosuit demonstrates good accuracy in control, exhibits favorable usability, and shows certain efficacy in multi-joint rehabilitation. Our study has taken into account the neuroplastic principles, aiming to achieve active user engagement while introducing additional degrees of freedom, offering novel ideas and methods for potential brain-computer interface (BCI)-based rehabilitation strategies and hardware development.Clinical impact: Our study presents an exosuit with four degrees of freedom for stroke rehabilitation, enabling multi-joint movement and improved motor recovery. The hybrid EEG-based control approach enhances active user engagement, offering a promising strategy for more effective and user-driven rehabilitation, potentially improving clinical outcomes.Clinical and Translational Impact Statement: By developing an exosuit and a hybrid EEG-based control approach, this study enhances stroke rehabilitation through better user engagement and multi-joint capabilities. These innovations consider neuroplasticity principles, integrating rehabilitation theory with rehabilitation device.
{"title":"A 4-DOF Exosuit Using a Hybrid EEG-Based Control Approach for Upper-Limb Rehabilitation","authors":"Zhichuan Tang;Zhixuan Cui;Hang Wang;Pengcheng Liu;Xuan Xu;Keshuai Yang","doi":"10.1109/JTEHM.2024.3454077","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3454077","url":null,"abstract":"Rehabilitation devices, such as traditional rigid exoskeletons or exosuits, have been widely used to rehabilitate upper limb function post-stroke. In this paper, we have developed an exosuit with four degrees of freedom to enable users to involve more joints in the rehabilitation process. Additionally, a hybrid electroencephalogram-based (EEG-based) control approach has been developed to promote active user engagement and provide more control commands.The hybrid EEG-based control approach includes steady-state visual evoked potential (SSVEP) paradigm and motor imagery (MI) paradigm. Firstly, the rehabilitation movement was selected by SSVEP paradigm, and the multivariate variational mode decomposition (MVMD) and canonical correlation analysis (CCA) method was used for SSVEP EEG recognition; then, the motion intention was obtained by MI paradigm, and the convolutional neural network (CNN) and long short-term memory network (LSTM) were used to build a CNN-LSTM model for MI EEG recognition; finally, the recognition results were translated into control commands of Bowden cables to achieve multi-degree-of-freedom rehabilitation.Experimental results show that the average classification accuracy of the CNN-LSTM model reaches to 90.07% ± 2.23%, and the overall accuracy of the hybrid EEG-based control approach reaches to 85.26% ± 1.95%. The twelve subjects involved in the usability assessment demonstrated an average system usability scale (SUS) score of 81.25 ± 5.82. Additionally, four participants who underwent a 35-day rehabilitation training demonstrated an average 10.33% increase in range of motion (ROM) across 4 joints, along with a 11.35% increase in the average electromyography (EMG) amplitude of the primary muscle involved.The exosuit demonstrates good accuracy in control, exhibits favorable usability, and shows certain efficacy in multi-joint rehabilitation. Our study has taken into account the neuroplastic principles, aiming to achieve active user engagement while introducing additional degrees of freedom, offering novel ideas and methods for potential brain-computer interface (BCI)-based rehabilitation strategies and hardware development.Clinical impact: Our study presents an exosuit with four degrees of freedom for stroke rehabilitation, enabling multi-joint movement and improved motor recovery. The hybrid EEG-based control approach enhances active user engagement, offering a promising strategy for more effective and user-driven rehabilitation, potentially improving clinical outcomes.Clinical and Translational Impact Statement: By developing an exosuit and a hybrid EEG-based control approach, this study enhances stroke rehabilitation through better user engagement and multi-joint capabilities. These innovations consider neuroplasticity principles, integrating rehabilitation theory with rehabilitation device.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"622-634"},"PeriodicalIF":3.7,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663725","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-23DOI: 10.1109/JTEHM.2024.3448457
Chayut Bunterngchit;Jiaxing Wang;Zeng-Guang Hou
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.
{"title":"Simultaneous EEG-fNIRS Data Classification Through Selective Channel Representation and Spectrogram Imaging","authors":"Chayut Bunterngchit;Jiaxing Wang;Zeng-Guang Hou","doi":"10.1109/JTEHM.2024.3448457","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3448457","url":null,"abstract":"The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"600-612"},"PeriodicalIF":3.7,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10643872","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective: Optimized deep brain stimulation (DBS) is fast becoming a therapy of choice for the treatment of Parkinson’s disease (PD). However, the post-operative optimization (aimed at maximizing patient clinical benefits and minimizing adverse effects) of all possible DBS parameter settings using the standard-of-care clinical protocol requires numerous clinical visits, which substantially increases the time to optimization per patient (TPP), patient cost burden and limit the number of patients who can undergo DBS treatment. The TPP is further elongated in electrodes with stimulation directionality or in diseases with latency in clinical feedback. In this work, we proposed a deep learning and fMRI-based pipeline for DBS optimization that can potentially reduce the TPP from ~1 year to a few hours during a single clinical visit.Methods and procedures: We developed an unsupervised autoencoder (AE)-based model to extract meaningful features from 122 previously acquired blood oxygenated level dependent (BOLD) fMRI datasets from 39 a priori clinically optimized PD patients undergoing DBS therapy. The extracted features are then fed into multilayer perceptron (MLP)-based parameter classification and prediction models for rapid DBS parameter optimization.Results: The AE-extracted features of optimal and non-optimal DBS were disentangled. The AE-MLP classification model yielded accuracy, precision, recall, F1 score, and combined AUC of 0.96 ± 0.04, 0.95 ± 0.07, 0.92 ± 0.07, 0.93 ± 0.06, and 0.98 respectively. Accuracies of 0.79 ± 0.04, 0.85 ± 0.04, 0.82 ± 0.05, 0.83 ± 0.05, and 0.70 ± 0.07 were obtained in the prediction of voltage, frequency, and x-y-z contact locations, respectively.Conclusion: The proposed AE-MLP models yielded promising results for fMRI-based DBS parameter classification and prediction, potentially facilitating rapid semi-automated DBS parameter optimization. Clinical and Translational Impact Statement—A deep learning-based pipeline for semi-automated DBS parameter optimization is presented, with the potential to significantly decrease the optimization duration per patient and patients' financial burden while increasing patient throughput.
{"title":"Deep Learning and fMRI-Based Pipeline for Optimization of Deep Brain Stimulation During Parkinson’s Disease Treatment: Toward Rapid Semi-Automated Stimulation Optimization","authors":"Jianwei Qiu;Afis Ajala;John Karigiannis;Jürgen Germann;Brendan Santyr;Aaron Loh;Luca Marinelli;Thomas Foo;Radhika Madhavan;Desmond Yeo;Alexandre Boutet;Andres Lozano","doi":"10.1109/JTEHM.2024.3448392","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3448392","url":null,"abstract":"Objective: Optimized deep brain stimulation (DBS) is fast becoming a therapy of choice for the treatment of Parkinson’s disease (PD). However, the post-operative optimization (aimed at maximizing patient clinical benefits and minimizing adverse effects) of all possible DBS parameter settings using the standard-of-care clinical protocol requires numerous clinical visits, which substantially increases the time to optimization per patient (TPP), patient cost burden and limit the number of patients who can undergo DBS treatment. The TPP is further elongated in electrodes with stimulation directionality or in diseases with latency in clinical feedback. In this work, we proposed a deep learning and fMRI-based pipeline for DBS optimization that can potentially reduce the TPP from ~1 year to a few hours during a single clinical visit.Methods and procedures: We developed an unsupervised autoencoder (AE)-based model to extract meaningful features from 122 previously acquired blood oxygenated level dependent (BOLD) fMRI datasets from 39 a priori clinically optimized PD patients undergoing DBS therapy. The extracted features are then fed into multilayer perceptron (MLP)-based parameter classification and prediction models for rapid DBS parameter optimization.Results: The AE-extracted features of optimal and non-optimal DBS were disentangled. The AE-MLP classification model yielded accuracy, precision, recall, F1 score, and combined AUC of 0.96 ± 0.04, 0.95 ± 0.07, 0.92 ± 0.07, 0.93 ± 0.06, and 0.98 respectively. Accuracies of 0.79 ± 0.04, 0.85 ± 0.04, 0.82 ± 0.05, 0.83 ± 0.05, and 0.70 ± 0.07 were obtained in the prediction of voltage, frequency, and x-y-z contact locations, respectively.Conclusion: The proposed AE-MLP models yielded promising results for fMRI-based DBS parameter classification and prediction, potentially facilitating rapid semi-automated DBS parameter optimization. Clinical and Translational Impact Statement—A deep learning-based pipeline for semi-automated DBS parameter optimization is presented, with the potential to significantly decrease the optimization duration per patient and patients' financial burden while increasing patient throughput.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"589-599"},"PeriodicalIF":3.7,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10643605","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-20DOI: 10.1109/JTEHM.2024.3446511
Rafael Morales Mayoral;Ameer Helmi;Samuel W. Logan;Naomi T. Fitter
Children worldwide are becoming increasingly inactive, leading to significant wellness challenges. Initial findings from our research team indicate that robots could potentially provide a more effective approach (compared to other age-appropriate toys) for encouraging physical activity in children. However, the basis of this past work relied on either interactions with groups of children (making it challenging to isolate specific factors that influenced activity levels) or a preliminary version of results of the present study (which centered on just a single more exploratory method for assessing child movement). This paper delves into more controlled interactions involving a single robot and a child participant, while also considering observations over an extended period to mitigate the influence of novelty on the study outcomes. We discuss the outcomes of a two-month-long deployment, during which $N=8$ participants engaged with our custom robot, GoBot, in weekly sessions. During each session, the children experienced three different conditions: a teleoperated robot mode, a semi-autonomous robot mode, and a control condition in which the robot was present but inactive. Compared to our past related work, the results expanded our findings by confirming with greater clout (based on multiple data streams, including one more robust measure compared to the past related work) that children tended to be more physically active when the robot was active, and interestingly, there were no significant differences between the teleoperated and semi-autonomous modes in terms of our study measures. These insights can inform future applications of assistive robots in child motor interventions, including the guiding of appropriate levels of autonomy for these systems. This study demonstrates that incorporating robotic systems into play environments can boost physical activity in young children, indicating potential implementation in settings crafted to enhance children’s physical movement.
{"title":"GoBot Go! Using a Custom Assistive Robot to Promote Physical Activity in Children","authors":"Rafael Morales Mayoral;Ameer Helmi;Samuel W. Logan;Naomi T. Fitter","doi":"10.1109/JTEHM.2024.3446511","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3446511","url":null,"abstract":"Children worldwide are becoming increasingly inactive, leading to significant wellness challenges. Initial findings from our research team indicate that robots could potentially provide a more effective approach (compared to other age-appropriate toys) for encouraging physical activity in children. However, the basis of this past work relied on either interactions with groups of children (making it challenging to isolate specific factors that influenced activity levels) or a preliminary version of results of the present study (which centered on just a single more exploratory method for assessing child movement). This paper delves into more controlled interactions involving a single robot and a child participant, while also considering observations over an extended period to mitigate the influence of novelty on the study outcomes. We discuss the outcomes of a two-month-long deployment, during which \u0000<inline-formula> <tex-math>$N=8$ </tex-math></inline-formula>\u0000 participants engaged with our custom robot, GoBot, in weekly sessions. During each session, the children experienced three different conditions: a teleoperated robot mode, a semi-autonomous robot mode, and a control condition in which the robot was present but inactive. Compared to our past related work, the results expanded our findings by confirming with greater clout (based on multiple data streams, including one more robust measure compared to the past related work) that children tended to be more physically active when the robot was active, and interestingly, there were no significant differences between the teleoperated and semi-autonomous modes in terms of our study measures. These insights can inform future applications of assistive robots in child motor interventions, including the guiding of appropriate levels of autonomy for these systems. This study demonstrates that incorporating robotic systems into play environments can boost physical activity in young children, indicating potential implementation in settings crafted to enhance children’s physical movement.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"613-621"},"PeriodicalIF":3.7,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10640114","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142143707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-29DOI: 10.1109/JTEHM.2024.3435334
Nikolas Hesse;Sandra Baumgartner;Anja Gut;Hubertus J. A. Van Hedel
Objective: Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. Methods: Twenty-three typically developing children and healthy young adults (5-29 years, 110–189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson’s correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. Results: Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. Conclusion: Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. Clinical Impact: The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.
{"title":"Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults","authors":"Nikolas Hesse;Sandra Baumgartner;Anja Gut;Hubertus J. A. Van Hedel","doi":"10.1109/JTEHM.2024.3435334","DOIUrl":"10.1109/JTEHM.2024.3435334","url":null,"abstract":"Objective: Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. Methods: Twenty-three typically developing children and healthy young adults (5-29 years, 110–189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson’s correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. Results: Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. Conclusion: Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. Clinical Impact: The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"580-588"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10614255","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141873112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective: Attention-deficit/hyperactivity disorder (ADHD) is a childhood-onset neurodevelopmental disorder with a prevalence ranging from 6.1 to 9.4%. The main symptoms of ADHD are inattention, hyperactivity, impulsivity, and even destructive behaviors that may have a long-term negative influence on learning performance or social relationships. Early diagnosis and treatment provide the best chance of reducing and managing symptoms. Currently, ADHD diagnosis relies on behavioral observations and ratings by clinicians and parents. Medical diagnosis of ADHD was reported to be delayed because of a global shortage of well-trained clinicians, the heterogeneous nature of ADHD, and combined comorbidities. Therefore, alternative ways to increase the efficiency of early diagnosis are needed. Previous studies used behavioral and neurophysiological data to assess patients with ADHD, yielding an accuracy range from 56.6% to 92%. Several factors were shown to affect the detection rate, including methods and tasks used and the number of electroencephalogram (EEG) channels. Given that children with ADHD have difficulty sustaining attention, in this study, we tested whether data from multiple tasks with different difficulties and prolonged experiment times can probe the levels of brain resources engaged during task performance and increase ADHD detection. Specifically, we proposed a Deep Neural Network-based (DNN) fusion model of multiple tasks to enhance the detection of ADHD. Methods & Results: Forty-nine children with ADHD and thirty-two typically developing children were recruited. Analytic results show that the fusion of multi-task neurophysiological data can increase the separation rate to 89%, whereas a single data type can only achieve a best accuracy of 81%. Moreover, the use of multiple tasks helps distinguish between children with ADHD and typically developing children. Our results suggest that different neurophysiological models from multiple tasks can provide essential information to assist in ADHD screening. In conclusion, the proposed model offers a more efficient, and accurate alternative for early clinical diagnosis and management of ADHD. The application of artificial intelligence and multimodal neurophysiological data in clinical settings sets a precedent for digital health, paving the way for future advancements in the field.
{"title":"Fusion of Multi-Task Neurophysiological Data to Enhance the Detection of Attention- Deficit/Hyperactivity Disorder","authors":"Kai-Feng Zhang;Shih-Ching Yeh;Eric Hsiao-Kuang Wu;Xiu Xu;Ho-Jung Tsai;Chun-Chuan Chen","doi":"10.1109/JTEHM.2024.3435553","DOIUrl":"10.1109/JTEHM.2024.3435553","url":null,"abstract":"Objective: Attention-deficit/hyperactivity disorder (ADHD) is a childhood-onset neurodevelopmental disorder with a prevalence ranging from 6.1 to 9.4%. The main symptoms of ADHD are inattention, hyperactivity, impulsivity, and even destructive behaviors that may have a long-term negative influence on learning performance or social relationships. Early diagnosis and treatment provide the best chance of reducing and managing symptoms. Currently, ADHD diagnosis relies on behavioral observations and ratings by clinicians and parents. Medical diagnosis of ADHD was reported to be delayed because of a global shortage of well-trained clinicians, the heterogeneous nature of ADHD, and combined comorbidities. Therefore, alternative ways to increase the efficiency of early diagnosis are needed. Previous studies used behavioral and neurophysiological data to assess patients with ADHD, yielding an accuracy range from 56.6% to 92%. Several factors were shown to affect the detection rate, including methods and tasks used and the number of electroencephalogram (EEG) channels. Given that children with ADHD have difficulty sustaining attention, in this study, we tested whether data from multiple tasks with different difficulties and prolonged experiment times can probe the levels of brain resources engaged during task performance and increase ADHD detection. Specifically, we proposed a Deep Neural Network-based (DNN) fusion model of multiple tasks to enhance the detection of ADHD. Methods & Results: Forty-nine children with ADHD and thirty-two typically developing children were recruited. Analytic results show that the fusion of multi-task neurophysiological data can increase the separation rate to 89%, whereas a single data type can only achieve a best accuracy of 81%. Moreover, the use of multiple tasks helps distinguish between children with ADHD and typically developing children. Our results suggest that different neurophysiological models from multiple tasks can provide essential information to assist in ADHD screening. In conclusion, the proposed model offers a more efficient, and accurate alternative for early clinical diagnosis and management of ADHD. The application of artificial intelligence and multimodal neurophysiological data in clinical settings sets a precedent for digital health, paving the way for future advancements in the field.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"668-674"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10614196","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141872990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：