Pub Date : 2023-07-13DOI: 10.1088/1741-2552/ace47c
Kai Yang, Shuang Wu, Di Zhou, Lin Gan, Gaoyan Zhang
Objective.Many recent studies investigating the processing of continuous natural speech have employed electroencephalography (EEG) due to its high temporal resolution. However, most of these studies explored the response mechanism limited to the electrode space. In this study, we intend to explore the underlying neural processing in the source space, particularly the dynamic functional interactions among different regions during neural entrainment to speech.Approach.We collected 128-channel EEG data while 22 participants listened to story speech and time-reversed speech using a naturalistic paradigm. We compared three different strategies to determine the best method to estimate the neural tracking responses from the sensor space to the brain source space. After that, we used dynamic graph theory to investigate the source connectivity dynamics among regions that were involved in speech tracking.Main result.By comparing the correlations between the predicted neural response and the original common neural response under the two experimental conditions, we found that estimating the common neural response of participants in the electrode space followed by source localization of neural responses achieved the best performance. Analysis of the distribution of brain sources entrained to story speech envelopes showed that not only auditory regions but also frontoparietal cognitive regions were recruited, indicating a hierarchical processing mechanism of speech. Further analysis of inter-region interactions based on dynamic graph theory found that neural entrainment to speech operates across multiple brain regions along the hierarchical structure, among which the bilateral insula, temporal lobe, and inferior frontal gyrus are key brain regions that control information transmission. All of these information flows result in dynamic fluctuations in functional connection strength and network topology over time, reflecting both bottom-up and top-down processing while orchestrating computations toward understanding.Significance.Our findings have important implications for understanding the neural mechanisms of the brain during processing natural speech stimuli.
{"title":"Study on neural entrainment to continuous speech using dynamic source connectivity analysis.","authors":"Kai Yang, Shuang Wu, Di Zhou, Lin Gan, Gaoyan Zhang","doi":"10.1088/1741-2552/ace47c","DOIUrl":"https://doi.org/10.1088/1741-2552/ace47c","url":null,"abstract":"<p><p><i>Objective.</i>Many recent studies investigating the processing of continuous natural speech have employed electroencephalography (EEG) due to its high temporal resolution. However, most of these studies explored the response mechanism limited to the electrode space. In this study, we intend to explore the underlying neural processing in the source space, particularly the dynamic functional interactions among different regions during neural entrainment to speech.<i>Approach.</i>We collected 128-channel EEG data while 22 participants listened to story speech and time-reversed speech using a naturalistic paradigm. We compared three different strategies to determine the best method to estimate the neural tracking responses from the sensor space to the brain source space. After that, we used dynamic graph theory to investigate the source connectivity dynamics among regions that were involved in speech tracking.<i>Main result.</i>By comparing the correlations between the predicted neural response and the original common neural response under the two experimental conditions, we found that estimating the common neural response of participants in the electrode space followed by source localization of neural responses achieved the best performance. Analysis of the distribution of brain sources entrained to story speech envelopes showed that not only auditory regions but also frontoparietal cognitive regions were recruited, indicating a hierarchical processing mechanism of speech. Further analysis of inter-region interactions based on dynamic graph theory found that neural entrainment to speech operates across multiple brain regions along the hierarchical structure, among which the bilateral insula, temporal lobe, and inferior frontal gyrus are key brain regions that control information transmission. All of these information flows result in dynamic fluctuations in functional connection strength and network topology over time, reflecting both bottom-up and top-down processing while orchestrating computations toward understanding.<i>Significance.</i>Our findings have important implications for understanding the neural mechanisms of the brain during processing natural speech stimuli.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9803662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-12DOI: 10.1088/1741-2552/ace380
Yang Deng, Qingyu Sun, Ce Wang, Yijun Wang, S Kevin Zhou
Objective.The steady-state visual evoked potential (SSVEP)-based brain-computer interface has received extensive attention in research due to its simple system, less training data, and high information transfer rate. There are currently two prominent methods dominating the classification of SSVEP signals. One is the knowledge-based task-related component analysis (TRCA) method, whose core idea is to find the spatial filters by maximizing the inter-trial covariance. The other is the deep learning-based approach, which directly learns a classification model from data. However, how to integrate the two methods to achieve better performance has not been studied before.Approach.In this study, we develop a novel algorithm named TRCA-Net (TRCA-Net) to enhance SSVEP signal classification, which enjoys the advantages of both the knowledge-based method and the deep model. Specifically, the proposed TRCA-Net first performs TRCA to obtain spatial filters, which extract task-related components of data. Then the TRCA-filtered features from different filters are rearranged as new multi-channel signals for a deep convolutional neural network (CNN) for classification. Introducing the TRCA filters to a deep learning-based approach improves the signal-to-noise ratio of input data, hence benefiting the deep learning model.Main results.We evaluate the performance of TRCA-Net using two publicly available large-scale benchmark datasets, and the results demonstrate the effectiveness of TRCA-Net. Additionally, offline and online experiments separately testing ten and five subjects further validate the robustness of TRCA-Net. Further, we conduct ablation studies on different CNN backbones and demonstrate that our approach can be transplanted into other CNN models to boost their performance.Significance.The proposed approach is believed to have a promising potential for SSVEP classification and promote its practical applications in communication and control. The code is available athttps://github.com/Sungden/TRCA-Net.
{"title":"TRCA-Net: using TRCA filters to boost the SSVEP classification with convolutional neural network.","authors":"Yang Deng, Qingyu Sun, Ce Wang, Yijun Wang, S Kevin Zhou","doi":"10.1088/1741-2552/ace380","DOIUrl":"https://doi.org/10.1088/1741-2552/ace380","url":null,"abstract":"<p><p><i>Objective.</i>The steady-state visual evoked potential (SSVEP)-based brain-computer interface has received extensive attention in research due to its simple system, less training data, and high information transfer rate. There are currently two prominent methods dominating the classification of SSVEP signals. One is the knowledge-based task-related component analysis (TRCA) method, whose core idea is to find the spatial filters by maximizing the inter-trial covariance. The other is the deep learning-based approach, which directly learns a classification model from data. However, how to integrate the two methods to achieve better performance has not been studied before.<i>Approach.</i>In this study, we develop a novel algorithm named TRCA-Net (TRCA-Net) to enhance SSVEP signal classification, which enjoys the advantages of both the knowledge-based method and the deep model. Specifically, the proposed TRCA-Net first performs TRCA to obtain spatial filters, which extract task-related components of data. Then the TRCA-filtered features from different filters are rearranged as new multi-channel signals for a deep convolutional neural network (CNN) for classification. Introducing the TRCA filters to a deep learning-based approach improves the signal-to-noise ratio of input data, hence benefiting the deep learning model.<i>Main results.</i>We evaluate the performance of TRCA-Net using two publicly available large-scale benchmark datasets, and the results demonstrate the effectiveness of TRCA-Net. Additionally, offline and online experiments separately testing ten and five subjects further validate the robustness of TRCA-Net. Further, we conduct ablation studies on different CNN backbones and demonstrate that our approach can be transplanted into other CNN models to boost their performance.<i>Significance.</i>The proposed approach is believed to have a promising potential for SSVEP classification and promote its practical applications in communication and control. The code is available athttps://github.com/Sungden/TRCA-Net.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9791683","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective. Brain source reconstruction through electroencephalogram is a challenging issue in brain research with possible applications in cognitive science as well as brain damage and dysfunction recognition. Its goal is to estimate the location of each source in the brain along with the signal being produced.Approach. In this paper, by assuming a small number of band limited sources, we propose a novel method for the problem by using successive multivariate variational mode decomposition (SMVMD). Our new method can be considered as a blind source estimation method, which means that it is capable of extracting the source signal without the knowledge of the location of the source or its lead field vector. In addition, the source location can be determined through comparing the mixing vector found in SMVMD and the lead filed vectors of the entire brain.Main results. The simulations verify that our method leads to performance improvement in comparison to the well-known localization and source signal estimation techniques such as MUltiple SIgnal Calssification (MUSIC), recursively applied and projected MUSIC, dipole fitting method, MV beamformer, and standardized low-resolution brain electromagnetic tomography.Significance. The proposed method enjoys low computational complexity. Moreover, our investigations on some experimental epileptic data confirm its superiority over the MUSIC method in the aspect of localization accuracy.
{"title":"A novel brain source reconstruction using a multivariate mode decomposition.","authors":"Hanieh Sotudeh, Sayed Mahmoud Sakhaei, Javad Kazemitabar","doi":"10.1088/1741-2552/acdffe","DOIUrl":"https://doi.org/10.1088/1741-2552/acdffe","url":null,"abstract":"<p><p><i>Objective</i>. Brain source reconstruction through electroencephalogram is a challenging issue in brain research with possible applications in cognitive science as well as brain damage and dysfunction recognition. Its goal is to estimate the location of each source in the brain along with the signal being produced.<i>Approach</i>. In this paper, by assuming a small number of band limited sources, we propose a novel method for the problem by using successive multivariate variational mode decomposition (SMVMD). Our new method can be considered as a blind source estimation method, which means that it is capable of extracting the source signal without the knowledge of the location of the source or its lead field vector. In addition, the source location can be determined through comparing the mixing vector found in SMVMD and the lead filed vectors of the entire brain.<i>Main results</i>. The simulations verify that our method leads to performance improvement in comparison to the well-known localization and source signal estimation techniques such as MUltiple SIgnal Calssification (MUSIC), recursively applied and projected MUSIC, dipole fitting method, MV beamformer, and standardized low-resolution brain electromagnetic tomography.<i>Significance</i>. The proposed method enjoys low computational complexity. Moreover, our investigations on some experimental epileptic data confirm its superiority over the MUSIC method in the aspect of localization accuracy.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10156964","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-07DOI: 10.1088/1741-2552/ace218
Antoine Ghestem, Marco N Pompili, Matthias Dipper-Wawra, Pascale Quilichini, Christophe Bernard, Maëva Ferraris
Neuropixels probes have become a crucial tool for high-density electrophysiological recordings. Although most research involving these probes is in acute preparations, some scientific inquiries require long-term recordings in freely moving animals. Recent reports have presented prosthesis designs for chronic recordings, but some of them do not allow for probe recovery, which is desirable given their cost. Others appear to be fragile, as these articles describe numerous broken implants.Objective.This fragility presents a challenge for recordings in rats, particularly in epilepsy models where strong mechanical stress impinges upon the prosthesis. To overcome these limitations, we sought to develop a new prosthesis for long-term electrophysiological recordings in healthy and epileptic rats.Approach.We present a new prosthesis specifically designed to protect the probes from strong shocks and enable the safe retrieval of probes after experiments.Main results.This prosthesis was successfully used to record from healthy and epileptic rats for up to three weeks almost continuously. Overall, 10 out of 11 probes could be successfully retrieved with a retrieval and reuse success rate of 91%.Significance.Our design and protocol significantly improved previously described probe recycling performances and prove usage on epileptic rats.
{"title":"Long-term near-continuous recording with Neuropixels probes in healthy and epileptic rats.","authors":"Antoine Ghestem, Marco N Pompili, Matthias Dipper-Wawra, Pascale Quilichini, Christophe Bernard, Maëva Ferraris","doi":"10.1088/1741-2552/ace218","DOIUrl":"https://doi.org/10.1088/1741-2552/ace218","url":null,"abstract":"<p><p>Neuropixels probes have become a crucial tool for high-density electrophysiological recordings. Although most research involving these probes is in acute preparations, some scientific inquiries require long-term recordings in freely moving animals. Recent reports have presented prosthesis designs for chronic recordings, but some of them do not allow for probe recovery, which is desirable given their cost. Others appear to be fragile, as these articles describe numerous broken implants.<i>Objective.</i>This fragility presents a challenge for recordings in rats, particularly in epilepsy models where strong mechanical stress impinges upon the prosthesis. To overcome these limitations, we sought to develop a new prosthesis for long-term electrophysiological recordings in healthy and epileptic rats.<i>Approach.</i>We present a new prosthesis specifically designed to protect the probes from strong shocks and enable the safe retrieval of probes after experiments.<i>Main results.</i>This prosthesis was successfully used to record from healthy and epileptic rats for up to three weeks almost continuously. Overall, 10 out of 11 probes could be successfully retrieved with a retrieval and reuse success rate of 91%.<i>Significance.</i>Our design and protocol significantly improved previously described probe recycling performances and prove usage on epileptic rats.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10158437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-06DOI: 10.1088/1741-2552/ace219
Simone Romeni, Elena Losanno, Elisabeth Koert, Luca Pierantoni, Ignacio Delgado-Martinez, Xavier Navarro, Silvestro Micera
Objective.Peripheral nerve interfaces have the potential to restore sensory, motor, and visceral functions. In particular, intraneural interfaces allow targeting deep neural structures with high selectivity, even if their performance strongly depends upon the implantation procedure and the subject's anatomy. Currently, few alternatives exist for the determination of the target subject structural and functional anatomy, and statistical characterizations from cadaveric samples are limited because of their high cost. We propose an optimization workflow that can guide both the pre-surgical planning and the determination of maximally selective multisite stimulation protocols for implants consisting of several intraneural electrodes, and we characterize its performance in silico. We show that the availability of structural and functional information leads to very high performances and allows taking informed decisions on neuroprosthetic design.Approach.We employ hybrid models (HMs) of neuromodulation in conjunction with a machine learning-based surrogate model to determine fiber activation under electrical stimulation, and two steps of optimization through particle swarm optimization to optimize in silico implant geometry, implantation and stimulation protocols using morphological data from the human median nerve at a reduced computational cost.Main results.Our method allows establishing the optimal geometry of multi-electrode transverse intra-fascicular multichannel electrode implants, the optimal number of electrodes to implant, their optimal insertion, and a set of multipolar stimulation protocols that lead in silico to selective activation of all the muscles innervated by the human median nerve.Significance.We show how to use effectively HMs for optimizing personalized neuroprostheses for motor function restoration. We provide in-silico evidences about the potential of multipolar stimulation to increase greatly selectivity. We also show that the knowledge of structural and functional anatomies of the target subject leads to very high selectivity and motivate the development of methods for theirin vivocharacterization.
{"title":"Combining biophysical models and machine learning to optimize implant geometry and stimulation protocol for intraneural electrodes.","authors":"Simone Romeni, Elena Losanno, Elisabeth Koert, Luca Pierantoni, Ignacio Delgado-Martinez, Xavier Navarro, Silvestro Micera","doi":"10.1088/1741-2552/ace219","DOIUrl":"https://doi.org/10.1088/1741-2552/ace219","url":null,"abstract":"<p><p><i>Objective.</i>Peripheral nerve interfaces have the potential to restore sensory, motor, and visceral functions. In particular, intraneural interfaces allow targeting deep neural structures with high selectivity, even if their performance strongly depends upon the implantation procedure and the subject's anatomy. Currently, few alternatives exist for the determination of the target subject structural and functional anatomy, and statistical characterizations from cadaveric samples are limited because of their high cost. We propose an optimization workflow that can guide both the pre-surgical planning and the determination of maximally selective multisite stimulation protocols for implants consisting of several intraneural electrodes, and we characterize its performance in silico. We show that the availability of structural and functional information leads to very high performances and allows taking informed decisions on neuroprosthetic design.<i>Approach.</i>We employ hybrid models (HMs) of neuromodulation in conjunction with a machine learning-based surrogate model to determine fiber activation under electrical stimulation, and two steps of optimization through particle swarm optimization to optimize in silico implant geometry, implantation and stimulation protocols using morphological data from the human median nerve at a reduced computational cost.<i>Main results.</i>Our method allows establishing the optimal geometry of multi-electrode transverse intra-fascicular multichannel electrode implants, the optimal number of electrodes to implant, their optimal insertion, and a set of multipolar stimulation protocols that lead in silico to selective activation of all the muscles innervated by the human median nerve.<i>Significance.</i>We show how to use effectively HMs for optimizing personalized neuroprostheses for motor function restoration. We provide in-silico evidences about the potential of multipolar stimulation to increase greatly selectivity. We also show that the knowledge of structural and functional anatomies of the target subject leads to very high selectivity and motivate the development of methods for their<i>in vivo</i>characterization.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9856290","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective.The evaluation of animals' motion behavior has played a vital role in neuromuscular biomedical research and clinical diagnostics, which reflects the changes caused by neuromodulation or neurodamage. Currently, the existing animal pose estimation methods are unreliable, unpractical, and inaccurate.Approach.Data augmentation (random scaling, random standard deviation Gaussian blur, random contrast, and random uniform color quantization) is adopted to augment image dataset. For the key points recognition, we present a novel efficient convolutional deep learning framework (PMotion), which combines modified ConvNext using multi-kernel feature fusion and self-defined stacked Hourglass block with SiLU activation function.Main results.PMotion is useful to predict the key points of dynamics of unmarked animal body joints in real time with high spatial precision. Gait quantification (step length, step height, and joint angle) was performed for the study of lateral lower limb movements with rats on a treadmill.Significance.The performance accuracy of PMotion on rat joint dataset was improved by 1.98, 1.46, and 0.55 pixels compared with deepposekit, deeplabcut, and stacked hourglass, respectively. This approach also may be applied for neurobehavioral studies of freely moving animals' behavior in challenging environments (e.g.Drosophila melanogasterand openfield-Pranav) with a high accuracy.
{"title":"PMotion: an advanced markerless pose estimation approach based on novel deep learning framework used to reveal neurobehavior.","authors":"Xiaodong Lv, Haijie Liu, Luyao Chen, Chuankai Dai, Penghu Wei, Junwei Hao, Guoguang Zhao","doi":"10.1088/1741-2552/acd603","DOIUrl":"https://doi.org/10.1088/1741-2552/acd603","url":null,"abstract":"<p><p><i>Objective.</i>The evaluation of animals' motion behavior has played a vital role in neuromuscular biomedical research and clinical diagnostics, which reflects the changes caused by neuromodulation or neurodamage. Currently, the existing animal pose estimation methods are unreliable, unpractical, and inaccurate.<i>Approach.</i>Data augmentation (random scaling, random standard deviation Gaussian blur, random contrast, and random uniform color quantization) is adopted to augment image dataset. For the key points recognition, we present a novel efficient convolutional deep learning framework (PMotion), which combines modified ConvNext using multi-kernel feature fusion and self-defined stacked Hourglass block with SiLU activation function.<i>Main results.</i>PMotion is useful to predict the key points of dynamics of unmarked animal body joints in real time with high spatial precision. Gait quantification (step length, step height, and joint angle) was performed for the study of lateral lower limb movements with rats on a treadmill.<i>Significance.</i>The performance accuracy of PMotion on rat joint dataset was improved by 1.98, 1.46, and 0.55 pixels compared with deepposekit, deeplabcut, and stacked hourglass, respectively. This approach also may be applied for neurobehavioral studies of freely moving animals' behavior in challenging environments (e.g.<i>Drosophila melanogaster</i>and openfield-Pranav) with a high accuracy.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9794025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-30DOI: 10.1088/1741-2552/ace07e
Xing Chen, Feng Wang, Roxana Kooijmans, Peter Christiaan Klink, Christian Boehler, Maria Asplund, Pieter Roelf Roelfsema
Objective. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.Approach.We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.Main results. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrOxcoating and higher impedances for electrodes with broken tips.Significance. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.
{"title":"Chronic stability of a neuroprosthesis comprising multiple adjacent Utah arrays in monkeys.","authors":"Xing Chen, Feng Wang, Roxana Kooijmans, Peter Christiaan Klink, Christian Boehler, Maria Asplund, Pieter Roelf Roelfsema","doi":"10.1088/1741-2552/ace07e","DOIUrl":"10.1088/1741-2552/ace07e","url":null,"abstract":"<p><p><i>Objective</i>. Electrical stimulation of visual cortex via a neuroprosthesis induces the perception of dots of light ('phosphenes'), potentially allowing recognition of simple shapes even after decades of blindness. However, restoration of functional vision requires large numbers of electrodes, and chronic, clinical implantation of intracortical electrodes in the visual cortex has only been achieved using devices of up to 96 channels. We evaluated the efficacy and stability of a 1024-channel neuroprosthesis system in non-human primates (NHPs) over more than 3 years to assess its suitability for long-term vision restoration.<i>Approach.</i>We implanted 16 microelectrode arrays (Utah arrays) consisting of 8 × 8 electrodes with iridium oxide tips in the primary visual cortex (V1) and visual area 4 (V4) of two sighted macaques. We monitored the animals' health and measured electrode impedances and neuronal signal quality by calculating signal-to-noise ratios of visually driven neuronal activity, peak-to-peak voltages of the waveforms of action potentials, and the number of channels with high-amplitude signals. We delivered cortical microstimulation and determined the minimum current that could be perceived, monitoring the number of channels that successfully yielded phosphenes. We also examined the influence of the implant on a visual task after 2-3 years of implantation and determined the integrity of the brain tissue with a histological analysis 3-3.5 years post-implantation.<i>Main results</i>. The monkeys remained healthy throughout the implantation period and the device retained its mechanical integrity and electrical conductivity. However, we observed decreasing signal quality with time, declining numbers of phosphene-evoking electrodes, decreases in electrode impedances, and impaired performance on a visual task at visual field locations corresponding to implanted cortical regions. Current thresholds increased with time in one of the two animals. The histological analysis revealed encapsulation of arrays and cortical degeneration. Scanning electron microscopy on one array revealed degradation of IrO<i>x</i>coating and higher impedances for electrodes with broken tips.<i>Significance</i>. Long-term implantation of a high-channel-count device in NHP visual cortex was accompanied by deformation of cortical tissue and decreased stimulation efficacy and signal quality over time. We conclude that improvements in device biocompatibility and/or refinement of implantation techniques are needed before future clinical use is feasible.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9728594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-29DOI: 10.1088/1741-2552/ace07d
Guixun Xu, Wenhui Guo, Yanjiang Wang
Objective and Significance:This paper proposes an LSTM-enhanced multi-view dynamic emotion graph representation model, which not only integrates the relationship between electrode channels into electroencephalogram (EEG) signal processing to extract multi-dimensional spatial topology information but also retains abundant temporal information of EEG signals.Approach:Specifically, the proposed model mainly includes two branches: a dynamic learning of multiple graph representation information branch and a branch that could learn the time-series information with memory function. First, the preprocessed EEG signals are input into these two branches, and through the former branch, multiple graph representations suitable for EEG signals can be found dynamically, so that the graph feature representations under multiple views are mined. Through the latter branch, it can be determined which information needs to be remembered and which to be forgotten, so as to obtain effective sequence information. Then the features of the two branches are fused via the mean fusion operator to obtain richer and more discriminative EEG spatiotemporal features to improve the performance of signal recognition.Main results:Finally, extensive subject-independent experiments are conducted on SEED, SEED-IV, and Database for Emotion Analysis using Physiological Signals datasets to evaluate model performance. Results reveal the proposed method could better recognize EEG emotional signals compared to other state-of-the-art methods.
目的与意义:提出了一种基于lstm的多视角动态情绪图表示模型,该模型不仅将电极通道之间的关系整合到脑电图信号处理中,提取了脑电图信号的多维空间拓扑信息,而且保留了脑电图信号丰富的时间信息。具体而言,该模型主要包括两个分支:动态学习多图表示信息分支和具有记忆功能的时间序列信息学习分支。首先,将预处理后的脑电信号输入到这两个分支中,通过前一个分支动态地找到适合于脑电信号的多个图表示,从而挖掘出多个视图下的图特征表示。通过后一个分支,可以确定哪些信息需要被记住,哪些信息需要被遗忘,从而获得有效的序列信息。然后通过均值融合算子对两个分支的特征进行融合,得到更丰富、更具判别性的脑电信号时空特征,提高信号识别的性能。最后,利用生理信号数据集对SEED、SEED- iv和Database for Emotion Analysis进行了广泛的受试者独立实验,以评估模型的性能。结果表明,与现有方法相比,该方法能更好地识别EEG情绪信号。
{"title":"LSTM-enhanced multi-view dynamical emotion graph representation for EEG signal recognition.","authors":"Guixun Xu, Wenhui Guo, Yanjiang Wang","doi":"10.1088/1741-2552/ace07d","DOIUrl":"https://doi.org/10.1088/1741-2552/ace07d","url":null,"abstract":"<p><p><i>Objective and Significance:</i>This paper proposes an LSTM-enhanced multi-view dynamic emotion graph representation model, which not only integrates the relationship between electrode channels into electroencephalogram (EEG) signal processing to extract multi-dimensional spatial topology information but also retains abundant temporal information of EEG signals.<i>Approach:</i>Specifically, the proposed model mainly includes two branches: a dynamic learning of multiple graph representation information branch and a branch that could learn the time-series information with memory function. First, the preprocessed EEG signals are input into these two branches, and through the former branch, multiple graph representations suitable for EEG signals can be found dynamically, so that the graph feature representations under multiple views are mined. Through the latter branch, it can be determined which information needs to be remembered and which to be forgotten, so as to obtain effective sequence information. Then the features of the two branches are fused via the mean fusion operator to obtain richer and more discriminative EEG spatiotemporal features to improve the performance of signal recognition.<i>Main results:</i>Finally, extensive subject-independent experiments are conducted on SEED, SEED-IV, and Database for Emotion Analysis using Physiological Signals datasets to evaluate model performance. Results reveal the proposed method could better recognize EEG emotional signals compared to other state-of-the-art methods.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-06-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9790922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-22DOI: 10.1088/1741-2552/acdea9
Canwen Wu, Jiaru He, Yiyue Zhu, Junwei Wu, Yan Chen, Maodan Yuan, Zhongwen Cheng, Lvming Zeng, Xuanrong Ji
Objective.Monoamine dysfunction has been implicated as a pathophysiological basis of several mental disorders, including anxiety and depression. Transcranial ultrasound stimulation (TUS) is a noninvasive nerve stimulation technic showing great potential in treating depression/anxiety disorders. This study aims to investigate whether TUS can ameliorate depression with anxiety in mice by regulating brain monoamine levels.Approach.Mice received repeated subcutaneous injections of corticosterone (CORT, 20 mg kg-1) for 3 weeks to produce depression- and anxiety-like behaviors. Ultrasound stimulated the dorsal lateral nucleus (DRN) for 30 min daily for 3 weeks without interruption of CORT injection. Behavioral phenotypes of depression and anxiety were estimated by sucrose preference test (SPT), tail suspension test (TST), and elevated plus-maze test (EPM). Liquid chromatography-mass spectrometry (LC-MS) was used to quantify brain levels of serotonin (5-HT), norepinephrine (NE), and dopamine (DA). Western blotting was performed to detect brain-derived neurotrophic factor (BDNF) levels in hippocampal.Main results.TUS of DRN significantly ameliorated the depression-like behaviors in SPT (p= 0.0004) and TST (p= 0.0003) as well as anxiety-like behaviors in EPM (open arm entry frequencies,p< 0.05). Moreover, TUS increased c-Fos-positive cell expression (p= 0.0127) and induced no tissue damage. LC-MS results showed TUS of DRN resulted in a non-significant increase in the 5-HT levels and a significant decrease in the NE levels, but did not affect the levels of DA and BDNF.Significance.These results suggest TUS of DRN has safely and effectively ameliorated CORT-induced depression- and anxiety-like behaviors, possibly by restoring brain levels of 5-HT and NE. TUS may be a safe and effective technique for remedying depression and anxiety comorbidity.
{"title":"Ultrasound neuromodulation ameliorates chronic corticosterone-induced depression- and anxiety-like behaviors in mice.","authors":"Canwen Wu, Jiaru He, Yiyue Zhu, Junwei Wu, Yan Chen, Maodan Yuan, Zhongwen Cheng, Lvming Zeng, Xuanrong Ji","doi":"10.1088/1741-2552/acdea9","DOIUrl":"https://doi.org/10.1088/1741-2552/acdea9","url":null,"abstract":"<p><p><i>Objective.</i>Monoamine dysfunction has been implicated as a pathophysiological basis of several mental disorders, including anxiety and depression. Transcranial ultrasound stimulation (TUS) is a noninvasive nerve stimulation technic showing great potential in treating depression/anxiety disorders. This study aims to investigate whether TUS can ameliorate depression with anxiety in mice by regulating brain monoamine levels.<i>Approach.</i>Mice received repeated subcutaneous injections of corticosterone (CORT, 20 mg kg<sup>-1</sup>) for 3 weeks to produce depression- and anxiety-like behaviors. Ultrasound stimulated the dorsal lateral nucleus (DRN) for 30 min daily for 3 weeks without interruption of CORT injection. Behavioral phenotypes of depression and anxiety were estimated by sucrose preference test (SPT), tail suspension test (TST), and elevated plus-maze test (EPM). Liquid chromatography-mass spectrometry (LC-MS) was used to quantify brain levels of serotonin (5-HT), norepinephrine (NE), and dopamine (DA). Western blotting was performed to detect brain-derived neurotrophic factor (BDNF) levels in hippocampal.<i>Main results.</i>TUS of DRN significantly ameliorated the depression-like behaviors in SPT (<i>p</i>= 0.0004) and TST (<i>p</i>= 0.0003) as well as anxiety-like behaviors in EPM (open arm entry frequencies,<i>p</i>< 0.05). Moreover, TUS increased c-Fos-positive cell expression (<i>p</i>= 0.0127) and induced no tissue damage. LC-MS results showed TUS of DRN resulted in a non-significant increase in the 5-HT levels and a significant decrease in the NE levels, but did not affect the levels of DA and BDNF.<i>Significance.</i>These results suggest TUS of DRN has safely and effectively ameliorated CORT-induced depression- and anxiety-like behaviors, possibly by restoring brain levels of 5-HT and NE. TUS may be a safe and effective technique for remedying depression and anxiety comorbidity.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10035328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-06-22DOI: 10.1088/1741-2552/acdd9d
Moritz Doering, Jochen Kieninger, Julian Kübler, Ulrich Hofmann, Stefan J Rupitsch, Gerald Urban, Andreas Weltin
Objective.Current-controlled neurostimulation is increasingly used in the clinical treatment of neurological disorders and widely applied in neural prostheses such as cochlear implants. Despite its importance, time-dependent potential traces of electrodes during microsecond-scale current pulses, especially with respect to a reference electrode (RE), are not precisely understood. However, this knowledge is critical to predict contributions of chemical reactions at the electrodes, and ultimately electrode stability, biocompatibility, and stimulation safety and efficacy.Approach.We assessed the electrochemistry of neurostimulation protocolsin vitrowith Pt microelectrodes from millisecond (classical electroanalysis) to microsecond (neurostimulation) timescales. We developed a dual-channel instrumentation amplifier to include a RE in neurostimulation setups. Uniquely, we combined potential measurements with potentiostatic prepolarization to control and investigate the surface status, which is not possible in typical stimulation setups.Main results.We thoroughly validated the instrumentation and highlighted the importance of monitoring individual electrochemical electrode potentials in different configurations of neurostimulation. We investigated electrode processes such as oxide formation and oxygen reduction by chronopotentiometry, bridging the gap between milli- and microsecond timescales. Our results demonstrate how much impact on potential traces the electrode's initial surface state and electrochemical surface processes have, even on a microsecond scale.Significance.Our unique use of preconditioning in combination with stimulation reveals that interpreting potential traces with respect to electrode processes is misleading without rigorous control of the electrode's surface state. Especiallyin vivo, where the microenvironment is unknown, simply measuring the voltage between two electrodes cannot accurately reflect the electrode's state and processes. Potential boundaries determine charge transfer, corrosion, and alterations of the electrode/tissue interface such as pH and oxygenation, particularly in long-termin vivouse. Our findings are relevant for all use-cases of constant-current stimulation, strongly advocating for electrochemicalin situinvestigations in many applications like the development of new electrode materials and stimulation methods.
{"title":"Advanced electrochemical potential monitoring for improved understanding of electrical neurostimulation protocols.","authors":"Moritz Doering, Jochen Kieninger, Julian Kübler, Ulrich Hofmann, Stefan J Rupitsch, Gerald Urban, Andreas Weltin","doi":"10.1088/1741-2552/acdd9d","DOIUrl":"https://doi.org/10.1088/1741-2552/acdd9d","url":null,"abstract":"<p><p><i>Objective.</i>Current-controlled neurostimulation is increasingly used in the clinical treatment of neurological disorders and widely applied in neural prostheses such as cochlear implants. Despite its importance, time-dependent potential traces of electrodes during microsecond-scale current pulses, especially with respect to a reference electrode (RE), are not precisely understood. However, this knowledge is critical to predict contributions of chemical reactions at the electrodes, and ultimately electrode stability, biocompatibility, and stimulation safety and efficacy.<i>Approach.</i>We assessed the electrochemistry of neurostimulation protocols<i>in vitro</i>with Pt microelectrodes from millisecond (classical electroanalysis) to microsecond (neurostimulation) timescales. We developed a dual-channel instrumentation amplifier to include a RE in neurostimulation setups. Uniquely, we combined potential measurements with potentiostatic prepolarization to control and investigate the surface status, which is not possible in typical stimulation setups.<i>Main results.</i>We thoroughly validated the instrumentation and highlighted the importance of monitoring individual electrochemical electrode potentials in different configurations of neurostimulation. We investigated electrode processes such as oxide formation and oxygen reduction by chronopotentiometry, bridging the gap between milli- and microsecond timescales. Our results demonstrate how much impact on potential traces the electrode's initial surface state and electrochemical surface processes have, even on a microsecond scale.<i>Significance.</i>Our unique use of preconditioning in combination with stimulation reveals that interpreting potential traces with respect to electrode processes is misleading without rigorous control of the electrode's surface state. Especially<i>in vivo</i>, where the microenvironment is unknown, simply measuring the voltage between two electrodes cannot accurately reflect the electrode's state and processes. Potential boundaries determine charge transfer, corrosion, and alterations of the electrode/tissue interface such as pH and oxygenation, particularly in long-term<i>in vivo</i>use. Our findings are relevant for all use-cases of constant-current stimulation, strongly advocating for electrochemical<i>in situ</i>investigations in many applications like the development of new electrode materials and stimulation methods.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9676652","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}