Pub Date : 2024-09-10DOI: 10.1109/JTEHM.2024.3457593
Jun Wang;Zeyang Dai;Xiao Liu
Nocturnal enuresis is a bothersome condition that affects many children and their caregivers. Post-voiding systems is of little value in training a child into a correct voiding routing while existing pre-voiding systems suffer from several practical limitations, such as cumbersome hardware, assuming individual bladder shapes being universal, and being sensitive to sensor placement error. Methods: A low-voltage ultrasound system with machine learning has been developed in estimating bladder filling status. A custom-made flexible 1D transducer array has been excited by low-voltage coded pulses with a pulse compression technique for an enhanced signal-to-noise ratio. In order to minimize the negative influence of possible transducer misplacement, a multiple-position training strategy using machine learning has been adopted in this work. Three popular classification methods, KNN, SVM and sparse coding, have been utilized to classify the acquired different volumes ranging from 100 ml to 300 ml into two categories: low volume and high volume. The low-volume category requires no further action while the high-volume category triggers an alarm to alert the child and caregiver. Results: When the sensor placement is ideal, i.e., the position of the practical sensor placement is on spot with the trained position, the precision and recall of the classification using sparse coding are $0.957~pm ~0.02$ and $0.958~pm ~0.02$ , respectively. Even if the transducer array is misplaced by up to 4.5 mm away from the ideal location, the proposed system is able to maintain high classification accuracy (precision $ge 0.75$ and recall $ge 0.75$ ). Category: Early/Pre-Clinical Research Clinical and Translational Impact: The proposed ultrasound sensor system for nocturnal enuresis is of significant clinical and translational value as it addresses two major issues that limit the wide adoption of similar devices. Firstly, it offers enhanced safety as the entire system has been implemented in the lowvoltage domain. Secondly, the system features ample tolerance to sensor misplacement while maintaining high classification accuracy. These features combined provide a much more user-friendly environment for children and their caregivers than existing devices.
{"title":"A Pre-Voiding Alarm System Using Wearable Ultrasound and Machine Learning Algorithms for Children With Nocturnal Enuresis","authors":"Jun Wang;Zeyang Dai;Xiao Liu","doi":"10.1109/JTEHM.2024.3457593","DOIUrl":"10.1109/JTEHM.2024.3457593","url":null,"abstract":"Nocturnal enuresis is a bothersome condition that affects many children and their caregivers. Post-voiding systems is of little value in training a child into a correct voiding routing while existing pre-voiding systems suffer from several practical limitations, such as cumbersome hardware, assuming individual bladder shapes being universal, and being sensitive to sensor placement error. Methods: A low-voltage ultrasound system with machine learning has been developed in estimating bladder filling status. A custom-made flexible 1D transducer array has been excited by low-voltage coded pulses with a pulse compression technique for an enhanced signal-to-noise ratio. In order to minimize the negative influence of possible transducer misplacement, a multiple-position training strategy using machine learning has been adopted in this work. Three popular classification methods, KNN, SVM and sparse coding, have been utilized to classify the acquired different volumes ranging from 100 ml to 300 ml into two categories: low volume and high volume. The low-volume category requires no further action while the high-volume category triggers an alarm to alert the child and caregiver. Results: When the sensor placement is ideal, i.e., the position of the practical sensor placement is on spot with the trained position, the precision and recall of the classification using sparse coding are \u0000<inline-formula> <tex-math>$0.957~pm ~0.02$ </tex-math></inline-formula>\u0000 and \u0000<inline-formula> <tex-math>$0.958~pm ~0.02$ </tex-math></inline-formula>\u0000, respectively. Even if the transducer array is misplaced by up to 4.5 mm away from the ideal location, the proposed system is able to maintain high classification accuracy (precision \u0000<inline-formula> <tex-math>$ge 0.75$ </tex-math></inline-formula>\u0000 and recall \u0000<inline-formula> <tex-math>$ge 0.75$ </tex-math></inline-formula>\u0000). Category: Early/Pre-Clinical Research Clinical and Translational Impact: The proposed ultrasound sensor system for nocturnal enuresis is of significant clinical and translational value as it addresses two major issues that limit the wide adoption of similar devices. Firstly, it offers enhanced safety as the entire system has been implemented in the lowvoltage domain. Secondly, the system features ample tolerance to sensor misplacement while maintaining high classification accuracy. These features combined provide a much more user-friendly environment for children and their caregivers than existing devices.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"643-658"},"PeriodicalIF":3.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10671589","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142181839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-10DOI: 10.1109/JTEHM.2024.3455941
George Oliveira Barros;José Nathan Andrade Muller da Silva;Henrique Machado de Sousa Proença;Stanley Almeida Araújo;David Campos Wanderley;Luciano Rebouças de Oliveira;Washington Luis Conrado Dos-Santos;Angelo Amancio Duarte;Flavio de Barros Vidal
Podocyte degenerative changes are common in various kidney diseases, and their accurate identification is crucial for pathologists to diagnose and treat such conditions. However, this can be a difficult task, and previous attempts to automate the identification of podocytes have not been entirely successful. To address this issue, this study proposes a novel approach that combines pathologists’ expertise with an automated classifier to enhance the identification of podocytopathies. The study involved building a new dataset of renal glomeruli images, some with and others without podocyte degenerative changes, and developing a convolutional neural network (CNN) based classifier. The results showed that our automated classifier achieved an impressive 90.9% f-score. When the pathologists used as an auxiliary tool to classify a second set of images, the medical group’s average performance increased significantly, from $91.4pm 12.5$ % to $96.1pm 2.9$ % of f-score. Fleiss’ kappa agreement among the pathologists also increased from 0.59 to 0.83. Conclusion: These findings suggest that automating this task can bring benefits for pathologists to correctly identify images of glomeruli with podocyte degeneration, leading to improved individual accuracy while raising agreement in diagnosing podocytopathies. This approach could have significant implications for the diagnosis and treatment of kidney diseases. Clinical impact: The approach presented in this study has the potential to enhance the accuracy of medical diagnoses for detecting podocyte abnormalities in glomeruli, which serve as biomarkers for various glomerular diseases.
{"title":"Enhancing Podocyte Degenerative Changes Identification With Pathologist Collaboration: Implications for Improved Diagnosis in Kidney Diseases","authors":"George Oliveira Barros;José Nathan Andrade Muller da Silva;Henrique Machado de Sousa Proença;Stanley Almeida Araújo;David Campos Wanderley;Luciano Rebouças de Oliveira;Washington Luis Conrado Dos-Santos;Angelo Amancio Duarte;Flavio de Barros Vidal","doi":"10.1109/JTEHM.2024.3455941","DOIUrl":"10.1109/JTEHM.2024.3455941","url":null,"abstract":"Podocyte degenerative changes are common in various kidney diseases, and their accurate identification is crucial for pathologists to diagnose and treat such conditions. However, this can be a difficult task, and previous attempts to automate the identification of podocytes have not been entirely successful. To address this issue, this study proposes a novel approach that combines pathologists’ expertise with an automated classifier to enhance the identification of podocytopathies. The study involved building a new dataset of renal glomeruli images, some with and others without podocyte degenerative changes, and developing a convolutional neural network (CNN) based classifier. The results showed that our automated classifier achieved an impressive 90.9% f-score. When the pathologists used as an auxiliary tool to classify a second set of images, the medical group’s average performance increased significantly, from \u0000<inline-formula> <tex-math>$91.4pm 12.5$ </tex-math></inline-formula>\u0000% to \u0000<inline-formula> <tex-math>$96.1pm 2.9$ </tex-math></inline-formula>\u0000% of f-score. Fleiss’ kappa agreement among the pathologists also increased from 0.59 to 0.83. Conclusion: These findings suggest that automating this task can bring benefits for pathologists to correctly identify images of glomeruli with podocyte degeneration, leading to improved individual accuracy while raising agreement in diagnosing podocytopathies. This approach could have significant implications for the diagnosis and treatment of kidney diseases. Clinical impact: The approach presented in this study has the potential to enhance the accuracy of medical diagnoses for detecting podocyte abnormalities in glomeruli, which serve as biomarkers for various glomerular diseases.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"635-642"},"PeriodicalIF":3.7,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10675352","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142181840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-03DOI: 10.1109/JTEHM.2024.3454077
Zhichuan Tang;Zhixuan Cui;Hang Wang;Pengcheng Liu;Xuan Xu;Keshuai Yang
Rehabilitation devices, such as traditional rigid exoskeletons or exosuits, have been widely used to rehabilitate upper limb function post-stroke. In this paper, we have developed an exosuit with four degrees of freedom to enable users to involve more joints in the rehabilitation process. Additionally, a hybrid electroencephalogram-based (EEG-based) control approach has been developed to promote active user engagement and provide more control commands.The hybrid EEG-based control approach includes steady-state visual evoked potential (SSVEP) paradigm and motor imagery (MI) paradigm. Firstly, the rehabilitation movement was selected by SSVEP paradigm, and the multivariate variational mode decomposition (MVMD) and canonical correlation analysis (CCA) method was used for SSVEP EEG recognition; then, the motion intention was obtained by MI paradigm, and the convolutional neural network (CNN) and long short-term memory network (LSTM) were used to build a CNN-LSTM model for MI EEG recognition; finally, the recognition results were translated into control commands of Bowden cables to achieve multi-degree-of-freedom rehabilitation.Experimental results show that the average classification accuracy of the CNN-LSTM model reaches to 90.07% ± 2.23%, and the overall accuracy of the hybrid EEG-based control approach reaches to 85.26% ± 1.95%. The twelve subjects involved in the usability assessment demonstrated an average system usability scale (SUS) score of 81.25 ± 5.82. Additionally, four participants who underwent a 35-day rehabilitation training demonstrated an average 10.33% increase in range of motion (ROM) across 4 joints, along with a 11.35% increase in the average electromyography (EMG) amplitude of the primary muscle involved.The exosuit demonstrates good accuracy in control, exhibits favorable usability, and shows certain efficacy in multi-joint rehabilitation. Our study has taken into account the neuroplastic principles, aiming to achieve active user engagement while introducing additional degrees of freedom, offering novel ideas and methods for potential brain-computer interface (BCI)-based rehabilitation strategies and hardware development.Clinical impact: Our study presents an exosuit with four degrees of freedom for stroke rehabilitation, enabling multi-joint movement and improved motor recovery. The hybrid EEG-based control approach enhances active user engagement, offering a promising strategy for more effective and user-driven rehabilitation, potentially improving clinical outcomes.Clinical and Translational Impact Statement: By developing an exosuit and a hybrid EEG-based control approach, this study enhances stroke rehabilitation through better user engagement and multi-joint capabilities. These innovations consider neuroplasticity principles, integrating rehabilitation theory with rehabilitation device.
{"title":"A 4-DOF Exosuit Using a Hybrid EEG-Based Control Approach for Upper-Limb Rehabilitation","authors":"Zhichuan Tang;Zhixuan Cui;Hang Wang;Pengcheng Liu;Xuan Xu;Keshuai Yang","doi":"10.1109/JTEHM.2024.3454077","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3454077","url":null,"abstract":"Rehabilitation devices, such as traditional rigid exoskeletons or exosuits, have been widely used to rehabilitate upper limb function post-stroke. In this paper, we have developed an exosuit with four degrees of freedom to enable users to involve more joints in the rehabilitation process. Additionally, a hybrid electroencephalogram-based (EEG-based) control approach has been developed to promote active user engagement and provide more control commands.The hybrid EEG-based control approach includes steady-state visual evoked potential (SSVEP) paradigm and motor imagery (MI) paradigm. Firstly, the rehabilitation movement was selected by SSVEP paradigm, and the multivariate variational mode decomposition (MVMD) and canonical correlation analysis (CCA) method was used for SSVEP EEG recognition; then, the motion intention was obtained by MI paradigm, and the convolutional neural network (CNN) and long short-term memory network (LSTM) were used to build a CNN-LSTM model for MI EEG recognition; finally, the recognition results were translated into control commands of Bowden cables to achieve multi-degree-of-freedom rehabilitation.Experimental results show that the average classification accuracy of the CNN-LSTM model reaches to 90.07% ± 2.23%, and the overall accuracy of the hybrid EEG-based control approach reaches to 85.26% ± 1.95%. The twelve subjects involved in the usability assessment demonstrated an average system usability scale (SUS) score of 81.25 ± 5.82. Additionally, four participants who underwent a 35-day rehabilitation training demonstrated an average 10.33% increase in range of motion (ROM) across 4 joints, along with a 11.35% increase in the average electromyography (EMG) amplitude of the primary muscle involved.The exosuit demonstrates good accuracy in control, exhibits favorable usability, and shows certain efficacy in multi-joint rehabilitation. Our study has taken into account the neuroplastic principles, aiming to achieve active user engagement while introducing additional degrees of freedom, offering novel ideas and methods for potential brain-computer interface (BCI)-based rehabilitation strategies and hardware development.Clinical impact: Our study presents an exosuit with four degrees of freedom for stroke rehabilitation, enabling multi-joint movement and improved motor recovery. The hybrid EEG-based control approach enhances active user engagement, offering a promising strategy for more effective and user-driven rehabilitation, potentially improving clinical outcomes.Clinical and Translational Impact Statement: By developing an exosuit and a hybrid EEG-based control approach, this study enhances stroke rehabilitation through better user engagement and multi-joint capabilities. These innovations consider neuroplasticity principles, integrating rehabilitation theory with rehabilitation device.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"622-634"},"PeriodicalIF":3.7,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10663725","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142169698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-23DOI: 10.1109/JTEHM.2024.3448457
Chayut Bunterngchit;Jiaxing Wang;Zeng-Guang Hou
The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.
{"title":"Simultaneous EEG-fNIRS Data Classification Through Selective Channel Representation and Spectrogram Imaging","authors":"Chayut Bunterngchit;Jiaxing Wang;Zeng-Guang Hou","doi":"10.1109/JTEHM.2024.3448457","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3448457","url":null,"abstract":"The integration of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) can facilitate the advancement of brain-computer interfaces (BCIs). However, existing research in this domain has grappled with the challenge of the efficient selection of features, resulting in the underutilization of the temporal richness of EEG and the spatial specificity of fNIRS data.To effectively address this challenge, this study proposed a deep learning architecture called the multimodal DenseNet fusion (MDNF) model that was trained on two-dimensional (2D) EEG data images, leveraging advanced feature extraction techniques. The model transformed EEG data into 2D images using a short-time Fourier transform, applied transfer learning to extract discriminative features, and consequently integrated them with fNIRS-derived spectral entropy features. This approach aimed to bridge existing gaps in EEG-fNIRS-based BCI research by enhancing classification accuracy and versatility across various cognitive and motor imagery tasks.Experimental results on two public datasets demonstrated the superiority of our model over existing state-of-the-art methods.Thus, the high accuracy and precise feature utilization of the MDNF model demonstrates the potential in clinical applications for neurodiagnostics and rehabilitation, thereby paving the method for patient-specific therapeutic strategies.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"600-612"},"PeriodicalIF":3.7,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10643872","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective: Optimized deep brain stimulation (DBS) is fast becoming a therapy of choice for the treatment of Parkinson’s disease (PD). However, the post-operative optimization (aimed at maximizing patient clinical benefits and minimizing adverse effects) of all possible DBS parameter settings using the standard-of-care clinical protocol requires numerous clinical visits, which substantially increases the time to optimization per patient (TPP), patient cost burden and limit the number of patients who can undergo DBS treatment. The TPP is further elongated in electrodes with stimulation directionality or in diseases with latency in clinical feedback. In this work, we proposed a deep learning and fMRI-based pipeline for DBS optimization that can potentially reduce the TPP from ~1 year to a few hours during a single clinical visit.Methods and procedures: We developed an unsupervised autoencoder (AE)-based model to extract meaningful features from 122 previously acquired blood oxygenated level dependent (BOLD) fMRI datasets from 39 a priori clinically optimized PD patients undergoing DBS therapy. The extracted features are then fed into multilayer perceptron (MLP)-based parameter classification and prediction models for rapid DBS parameter optimization.Results: The AE-extracted features of optimal and non-optimal DBS were disentangled. The AE-MLP classification model yielded accuracy, precision, recall, F1 score, and combined AUC of 0.96 ± 0.04, 0.95 ± 0.07, 0.92 ± 0.07, 0.93 ± 0.06, and 0.98 respectively. Accuracies of 0.79 ± 0.04, 0.85 ± 0.04, 0.82 ± 0.05, 0.83 ± 0.05, and 0.70 ± 0.07 were obtained in the prediction of voltage, frequency, and x-y-z contact locations, respectively.Conclusion: The proposed AE-MLP models yielded promising results for fMRI-based DBS parameter classification and prediction, potentially facilitating rapid semi-automated DBS parameter optimization. Clinical and Translational Impact Statement—A deep learning-based pipeline for semi-automated DBS parameter optimization is presented, with the potential to significantly decrease the optimization duration per patient and patients' financial burden while increasing patient throughput.
{"title":"Deep Learning and fMRI-Based Pipeline for Optimization of Deep Brain Stimulation During Parkinson’s Disease Treatment: Toward Rapid Semi-Automated Stimulation Optimization","authors":"Jianwei Qiu;Afis Ajala;John Karigiannis;Jürgen Germann;Brendan Santyr;Aaron Loh;Luca Marinelli;Thomas Foo;Radhika Madhavan;Desmond Yeo;Alexandre Boutet;Andres Lozano","doi":"10.1109/JTEHM.2024.3448392","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3448392","url":null,"abstract":"Objective: Optimized deep brain stimulation (DBS) is fast becoming a therapy of choice for the treatment of Parkinson’s disease (PD). However, the post-operative optimization (aimed at maximizing patient clinical benefits and minimizing adverse effects) of all possible DBS parameter settings using the standard-of-care clinical protocol requires numerous clinical visits, which substantially increases the time to optimization per patient (TPP), patient cost burden and limit the number of patients who can undergo DBS treatment. The TPP is further elongated in electrodes with stimulation directionality or in diseases with latency in clinical feedback. In this work, we proposed a deep learning and fMRI-based pipeline for DBS optimization that can potentially reduce the TPP from ~1 year to a few hours during a single clinical visit.Methods and procedures: We developed an unsupervised autoencoder (AE)-based model to extract meaningful features from 122 previously acquired blood oxygenated level dependent (BOLD) fMRI datasets from 39 a priori clinically optimized PD patients undergoing DBS therapy. The extracted features are then fed into multilayer perceptron (MLP)-based parameter classification and prediction models for rapid DBS parameter optimization.Results: The AE-extracted features of optimal and non-optimal DBS were disentangled. The AE-MLP classification model yielded accuracy, precision, recall, F1 score, and combined AUC of 0.96 ± 0.04, 0.95 ± 0.07, 0.92 ± 0.07, 0.93 ± 0.06, and 0.98 respectively. Accuracies of 0.79 ± 0.04, 0.85 ± 0.04, 0.82 ± 0.05, 0.83 ± 0.05, and 0.70 ± 0.07 were obtained in the prediction of voltage, frequency, and x-y-z contact locations, respectively.Conclusion: The proposed AE-MLP models yielded promising results for fMRI-based DBS parameter classification and prediction, potentially facilitating rapid semi-automated DBS parameter optimization. Clinical and Translational Impact Statement—A deep learning-based pipeline for semi-automated DBS parameter optimization is presented, with the potential to significantly decrease the optimization duration per patient and patients' financial burden while increasing patient throughput.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"589-599"},"PeriodicalIF":3.7,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10643605","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123042","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-20DOI: 10.1109/JTEHM.2024.3446511
Rafael Morales Mayoral;Ameer Helmi;Samuel W. Logan;Naomi T. Fitter
Children worldwide are becoming increasingly inactive, leading to significant wellness challenges. Initial findings from our research team indicate that robots could potentially provide a more effective approach (compared to other age-appropriate toys) for encouraging physical activity in children. However, the basis of this past work relied on either interactions with groups of children (making it challenging to isolate specific factors that influenced activity levels) or a preliminary version of results of the present study (which centered on just a single more exploratory method for assessing child movement). This paper delves into more controlled interactions involving a single robot and a child participant, while also considering observations over an extended period to mitigate the influence of novelty on the study outcomes. We discuss the outcomes of a two-month-long deployment, during which $N=8$ participants engaged with our custom robot, GoBot, in weekly sessions. During each session, the children experienced three different conditions: a teleoperated robot mode, a semi-autonomous robot mode, and a control condition in which the robot was present but inactive. Compared to our past related work, the results expanded our findings by confirming with greater clout (based on multiple data streams, including one more robust measure compared to the past related work) that children tended to be more physically active when the robot was active, and interestingly, there were no significant differences between the teleoperated and semi-autonomous modes in terms of our study measures. These insights can inform future applications of assistive robots in child motor interventions, including the guiding of appropriate levels of autonomy for these systems. This study demonstrates that incorporating robotic systems into play environments can boost physical activity in young children, indicating potential implementation in settings crafted to enhance children’s physical movement.
{"title":"GoBot Go! Using a Custom Assistive Robot to Promote Physical Activity in Children","authors":"Rafael Morales Mayoral;Ameer Helmi;Samuel W. Logan;Naomi T. Fitter","doi":"10.1109/JTEHM.2024.3446511","DOIUrl":"https://doi.org/10.1109/JTEHM.2024.3446511","url":null,"abstract":"Children worldwide are becoming increasingly inactive, leading to significant wellness challenges. Initial findings from our research team indicate that robots could potentially provide a more effective approach (compared to other age-appropriate toys) for encouraging physical activity in children. However, the basis of this past work relied on either interactions with groups of children (making it challenging to isolate specific factors that influenced activity levels) or a preliminary version of results of the present study (which centered on just a single more exploratory method for assessing child movement). This paper delves into more controlled interactions involving a single robot and a child participant, while also considering observations over an extended period to mitigate the influence of novelty on the study outcomes. We discuss the outcomes of a two-month-long deployment, during which \u0000<inline-formula> <tex-math>$N=8$ </tex-math></inline-formula>\u0000 participants engaged with our custom robot, GoBot, in weekly sessions. During each session, the children experienced three different conditions: a teleoperated robot mode, a semi-autonomous robot mode, and a control condition in which the robot was present but inactive. Compared to our past related work, the results expanded our findings by confirming with greater clout (based on multiple data streams, including one more robust measure compared to the past related work) that children tended to be more physically active when the robot was active, and interestingly, there were no significant differences between the teleoperated and semi-autonomous modes in terms of our study measures. These insights can inform future applications of assistive robots in child motor interventions, including the guiding of appropriate levels of autonomy for these systems. This study demonstrates that incorporating robotic systems into play environments can boost physical activity in young children, indicating potential implementation in settings crafted to enhance children’s physical movement.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"613-621"},"PeriodicalIF":3.7,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10640114","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142143707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-29DOI: 10.1109/JTEHM.2024.3435334
Nikolas Hesse;Sandra Baumgartner;Anja Gut;Hubertus J. A. Van Hedel
Objective: Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. Methods: Twenty-three typically developing children and healthy young adults (5-29 years, 110–189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson’s correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. Results: Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. Conclusion: Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. Clinical Impact: The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.
{"title":"Concurrent Validity of Motion Parameters Measured With an RGB-D Camera-Based Markerless 3D Motion Tracking Method in Children and Young Adults","authors":"Nikolas Hesse;Sandra Baumgartner;Anja Gut;Hubertus J. A. Van Hedel","doi":"10.1109/JTEHM.2024.3435334","DOIUrl":"10.1109/JTEHM.2024.3435334","url":null,"abstract":"Objective: Low-cost, portable RGB-D cameras with integrated motion tracking functionality enable easy-to-use 3D motion analysis without requiring expensive facilities and specialized personnel. However, the accuracy of existing systems is insufficient for most clinical applications, particularly when applied to children. In previous work, we developed an RGB-D camera-based motion tracking method and showed that it accurately captures body joint positions of children and young adults in 3D. In this study, the validity and accuracy of clinically relevant motion parameters that were computed from kinematics of our motion tracking method are evaluated in children and young adults. Methods: Twenty-three typically developing children and healthy young adults (5-29 years, 110–189 cm) performed five movement tasks while being recorded simultaneously with a marker-based Vicon system and an Azure Kinect RGB-D camera. Motion parameters were computed from the extracted kinematics of both methods: time series measurements, i.e., measurements over time, peak measurements, i.e., measurements at a single time instant, and movement smoothness. The agreement of these parameter values was evaluated using Pearson’s correlation coefficients r for time series data, and mean absolute error (MAE) and Bland-Altman plots with limits of agreement for peak measurements and smoothness. Results: Time series measurements showed strong to excellent correlations (r-values between 0.8 and 1.0), MAE for angles ranged from 1.5 to 5 degrees and for smoothness parameters (SPARC) from 0.02-0.09, while MAE for distance-related parameters ranged from 9 to 15 mm. Conclusion: Extracted motion parameters are valid and accurate for various movement tasks in children and young adults, demonstrating the suitability of our tracking method for clinical motion analysis. Clinical Impact: The low-cost portable hardware in combination with our tracking method enables motion analysis outside of specialized facilities while providing measurements that are close to those of the clinical gold-standard.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"580-588"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10614255","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141873112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective: Attention-deficit/hyperactivity disorder (ADHD) is a childhood-onset neurodevelopmental disorder with a prevalence ranging from 6.1 to 9.4%. The main symptoms of ADHD are inattention, hyperactivity, impulsivity, and even destructive behaviors that may have a long-term negative influence on learning performance or social relationships. Early diagnosis and treatment provide the best chance of reducing and managing symptoms. Currently, ADHD diagnosis relies on behavioral observations and ratings by clinicians and parents. Medical diagnosis of ADHD was reported to be delayed because of a global shortage of well-trained clinicians, the heterogeneous nature of ADHD, and combined comorbidities. Therefore, alternative ways to increase the efficiency of early diagnosis are needed. Previous studies used behavioral and neurophysiological data to assess patients with ADHD, yielding an accuracy range from 56.6% to 92%. Several factors were shown to affect the detection rate, including methods and tasks used and the number of electroencephalogram (EEG) channels. Given that children with ADHD have difficulty sustaining attention, in this study, we tested whether data from multiple tasks with different difficulties and prolonged experiment times can probe the levels of brain resources engaged during task performance and increase ADHD detection. Specifically, we proposed a Deep Neural Network-based (DNN) fusion model of multiple tasks to enhance the detection of ADHD. Methods & Results: Forty-nine children with ADHD and thirty-two typically developing children were recruited. Analytic results show that the fusion of multi-task neurophysiological data can increase the separation rate to 89%, whereas a single data type can only achieve a best accuracy of 81%. Moreover, the use of multiple tasks helps distinguish between children with ADHD and typically developing children. Our results suggest that different neurophysiological models from multiple tasks can provide essential information to assist in ADHD screening. In conclusion, the proposed model offers a more efficient, and accurate alternative for early clinical diagnosis and management of ADHD. The application of artificial intelligence and multimodal neurophysiological data in clinical settings sets a precedent for digital health, paving the way for future advancements in the field.
{"title":"Fusion of Multi-Task Neurophysiological Data to Enhance the Detection of Attention- Deficit/Hyperactivity Disorder","authors":"Kai-Feng Zhang;Shih-Ching Yeh;Eric Hsiao-Kuang Wu;Xiu Xu;Ho-Jung Tsai;Chun-Chuan Chen","doi":"10.1109/JTEHM.2024.3435553","DOIUrl":"10.1109/JTEHM.2024.3435553","url":null,"abstract":"Objective: Attention-deficit/hyperactivity disorder (ADHD) is a childhood-onset neurodevelopmental disorder with a prevalence ranging from 6.1 to 9.4%. The main symptoms of ADHD are inattention, hyperactivity, impulsivity, and even destructive behaviors that may have a long-term negative influence on learning performance or social relationships. Early diagnosis and treatment provide the best chance of reducing and managing symptoms. Currently, ADHD diagnosis relies on behavioral observations and ratings by clinicians and parents. Medical diagnosis of ADHD was reported to be delayed because of a global shortage of well-trained clinicians, the heterogeneous nature of ADHD, and combined comorbidities. Therefore, alternative ways to increase the efficiency of early diagnosis are needed. Previous studies used behavioral and neurophysiological data to assess patients with ADHD, yielding an accuracy range from 56.6% to 92%. Several factors were shown to affect the detection rate, including methods and tasks used and the number of electroencephalogram (EEG) channels. Given that children with ADHD have difficulty sustaining attention, in this study, we tested whether data from multiple tasks with different difficulties and prolonged experiment times can probe the levels of brain resources engaged during task performance and increase ADHD detection. Specifically, we proposed a Deep Neural Network-based (DNN) fusion model of multiple tasks to enhance the detection of ADHD. Methods & Results: Forty-nine children with ADHD and thirty-two typically developing children were recruited. Analytic results show that the fusion of multi-task neurophysiological data can increase the separation rate to 89%, whereas a single data type can only achieve a best accuracy of 81%. Moreover, the use of multiple tasks helps distinguish between children with ADHD and typically developing children. Our results suggest that different neurophysiological models from multiple tasks can provide essential information to assist in ADHD screening. In conclusion, the proposed model offers a more efficient, and accurate alternative for early clinical diagnosis and management of ADHD. The application of artificial intelligence and multimodal neurophysiological data in clinical settings sets a precedent for digital health, paving the way for future advancements in the field.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"668-674"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10614196","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141872990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-29DOI: 10.1109/JTEHM.2024.3433448
Dong Hyun Choi;Yoon Ha Joo;Ki Hong Kim;Jeong Ho Park;Hyunjin Joo;Hyoun-Joong Kong;Hyunju Lee;Kyoung Jun Song;Sungwan Kim
The objective of this study was to develop a sound recognition-based cardiopulmonary resuscitation (CPR) training system that is accessible, cost-effective, easy-to-maintain and provides accurate CPR feedback. Beep-CPR, a novel device with accordion squeakers that emit high-pitched sounds during compression, was developed. The sounds emitted by Beep-CPR were recorded using a smartphone, segmented into 2-second audio fragments, and then transformed into spectrograms. A total of 6,065 spectrograms were generated from approximately 40 minutes of audio data, which were then randomly split into training, validation, and test datasets. Each spectrogram was matched with the depth, rate, and release velocity of the compression measured at the same time interval by the ZOLL X Series monitor/defibrillator. Deep learning models utilizing spectrograms as input were trained using transfer learning based on EfficientNet to predict the depth (Depth model), rate (Rate model), and release velocity (Recoil model) of compressions. Results: The mean absolute error (MAE) for the Depth model was 0.30 cm (95% confidence interval [CI]: 0.27–0.33). The MAE of the Rate model was 3.6/min (95% CI: 3.2–3.9). For the Recoil model, the MAE was 2.3 cm/s (95% CI: 2.1–2.5). External validation of the models demonstrated acceptable performance across multiple conditions, including the utilization of a newly-manufactured device, a fatigued device, and evaluation in an environment with altered spatial dimensions. We have developed a novel sound recognition-based CPR training system, that accurately measures compression quality during training. Significance: Beep-CPR is a cost-effective and easy-to-maintain solution that can improve the efficacy of CPR training by facilitating decentralized at-home training with performance feedback.
本研究的目的是开发一种基于声音识别的心肺复苏（CPR）培训系统，该系统方便使用、经济实惠、易于维护并能提供准确的心肺复苏反馈。Beep-CPR 是一种新型装置，带有风琴式尖叫器，在按压过程中会发出高亢的声音。Beep-CPR 发出的声音由智能手机录制，分割成 2 秒钟的音频片段，然后转换成频谱图。从大约 40 分钟的音频数据中共生成了 6,065 张频谱图，然后随机分成训练数据集、验证数据集和测试数据集。每张频谱图都与 ZOLL X 系列监护仪/除颤器在相同时间间隔内测量到的压缩深度、速率和释放速度相匹配。以频谱图为输入的深度学习模型通过基于 EfficientNet 的迁移学习进行训练，以预测按压的深度（深度模型）、速率（速率模型）和释放速度（反冲模型）。结果：深度模型的平均绝对误差（MAE）为 0.30 厘米（95% 置信区间 [CI]：0.27-0.33）。速率模型的 MAE 为 3.6/分钟（95% 置信区间：3.2-3.9）。后坐力模型的 MAE 为 2.3 厘米/秒（95% CI：2.1-2.5）。模型的外部验证表明，在多种条件下，包括使用新制造的设备、疲劳设备以及在空间尺寸改变的环境中进行评估，其性能都是可以接受的。我们开发了一种新型的基于声音识别的心肺复苏训练系统，可在训练过程中准确测量按压质量。意义重大：Beep-CPR 是一种成本效益高且易于维护的解决方案，可通过提供性能反馈来促进分散的家庭培训，从而提高心肺复苏术培训的效果。
{"title":"A Development of a Sound Recognition-Based Cardiopulmonary Resuscitation Training System","authors":"Dong Hyun Choi;Yoon Ha Joo;Ki Hong Kim;Jeong Ho Park;Hyunjin Joo;Hyoun-Joong Kong;Hyunju Lee;Kyoung Jun Song;Sungwan Kim","doi":"10.1109/JTEHM.2024.3433448","DOIUrl":"10.1109/JTEHM.2024.3433448","url":null,"abstract":"The objective of this study was to develop a sound recognition-based cardiopulmonary resuscitation (CPR) training system that is accessible, cost-effective, easy-to-maintain and provides accurate CPR feedback. Beep-CPR, a novel device with accordion squeakers that emit high-pitched sounds during compression, was developed. The sounds emitted by Beep-CPR were recorded using a smartphone, segmented into 2-second audio fragments, and then transformed into spectrograms. A total of 6,065 spectrograms were generated from approximately 40 minutes of audio data, which were then randomly split into training, validation, and test datasets. Each spectrogram was matched with the depth, rate, and release velocity of the compression measured at the same time interval by the ZOLL X Series monitor/defibrillator. Deep learning models utilizing spectrograms as input were trained using transfer learning based on EfficientNet to predict the depth (Depth model), rate (Rate model), and release velocity (Recoil model) of compressions. Results: The mean absolute error (MAE) for the Depth model was 0.30 cm (95% confidence interval [CI]: 0.27–0.33). The MAE of the Rate model was 3.6/min (95% CI: 3.2–3.9). For the Recoil model, the MAE was 2.3 cm/s (95% CI: 2.1–2.5). External validation of the models demonstrated acceptable performance across multiple conditions, including the utilization of a newly-manufactured device, a fatigued device, and evaluation in an environment with altered spatial dimensions. We have developed a novel sound recognition-based CPR training system, that accurately measures compression quality during training. Significance: Beep-CPR is a cost-effective and easy-to-maintain solution that can improve the efficacy of CPR training by facilitating decentralized at-home training with performance feedback.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"550-557"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613881","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141868985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-29DOI: 10.1109/JTEHM.2024.3434460
Lei Guan;Xiaodong Yang;Nan Zhao;Malik Muhammad Arslan;Muneeb Ullah;Qurat Ul Ain;Abbas Ali Shah;Akram Alomainy;Qammer H. Abbasi
Vital signs are important indicators to evaluate the health status of patients. Channel state information (CSI) can sense the displacement of the chest wall caused by cardiorespiratory activity in a non-contact manner. Due to the influence of clutter, DC components, and respiratory harmonics, it is difficult to detect reliable heartbeat signals. To address this problem, this paper proposes a robust and novel method for simultaneously extracting breath and heartbeat signals using software defined radios (SDR). Specifically, we model and analyze the signal and propose singular value decomposition (SVD)-based clutter suppression method to enhance the vital sign signals. The DC is estimated and compensated by the circle fitting method. Then, the heartbeat signal and respiratory signal are obtained by the modified variational modal decomposition (VMD). The experimental results demonstrate that the proposed method can accurately separate the respiratory signal and the heartbeat signal from the filtered signal. The Bland-Altman analysis shows that the proposed system is in good agreement with the medical sensors. In addition, the proposed system can accurately measure the heart rate variability (HRV) within 0.5m. In summary, our system can be used as a preferred contactless alternative to traditional contact medical sensors, which can provide advanced patient-centered healthcare solutions.
{"title":"Non-Contact Measurement of Cardiopulmonary Activity Using Software Defined Radios","authors":"Lei Guan;Xiaodong Yang;Nan Zhao;Malik Muhammad Arslan;Muneeb Ullah;Qurat Ul Ain;Abbas Ali Shah;Akram Alomainy;Qammer H. Abbasi","doi":"10.1109/JTEHM.2024.3434460","DOIUrl":"10.1109/JTEHM.2024.3434460","url":null,"abstract":"Vital signs are important indicators to evaluate the health status of patients. Channel state information (CSI) can sense the displacement of the chest wall caused by cardiorespiratory activity in a non-contact manner. Due to the influence of clutter, DC components, and respiratory harmonics, it is difficult to detect reliable heartbeat signals. To address this problem, this paper proposes a robust and novel method for simultaneously extracting breath and heartbeat signals using software defined radios (SDR). Specifically, we model and analyze the signal and propose singular value decomposition (SVD)-based clutter suppression method to enhance the vital sign signals. The DC is estimated and compensated by the circle fitting method. Then, the heartbeat signal and respiratory signal are obtained by the modified variational modal decomposition (VMD). The experimental results demonstrate that the proposed method can accurately separate the respiratory signal and the heartbeat signal from the filtered signal. The Bland-Altman analysis shows that the proposed system is in good agreement with the medical sensors. In addition, the proposed system can accurately measure the heart rate variability (HRV) within 0.5m. In summary, our system can be used as a preferred contactless alternative to traditional contact medical sensors, which can provide advanced patient-centered healthcare solutions.","PeriodicalId":54255,"journal":{"name":"IEEE Journal of Translational Engineering in Health and Medicine-Jtehm","volume":"12 ","pages":"558-568"},"PeriodicalIF":3.7,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10613608","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141873113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：