Objective. The study of brain networks has become an influential tool for investigating post-stroke brain function. However, studies on the dynamics of cortical networks associated with muscle activity are limited. This is crucial for elucidating the altered coordination patterns in the post-stroke motor control system.Approach. In this study, we introduced the time-delayed maximal information spectral coefficient (TDMISC) method to assess the local frequency band characteristics (alpha, beta, and gamma bands) of functional corticomuscular coupling (FCMC) and cortico-cortical network parameters. We validated the effectiveness of TDMISC using a unidirectionally coupled Hénon maps model and a neural mass model.Main result. A grip task with 25% of maximum voluntary contraction was designed, and simulation results demonstrated that TDMISC accurately characterizes signals' local frequency band and directional properties. In the gamma band, the affected side showed significantly strong FCMC in the ascending direction. However, in the beta band, the affected side exhibited significantly weak FCMC in all directions. For the cortico-cortical network parameters, the affected side showed a lower clustering coefficient than the unaffected side in all frequency bands. Additionally, the affected side exhibited a longer shortest path length than the unaffected side in all frequency bands. In all frequency bands, the unaffected motor cortex in the stroke group exerted inhibitory effects on the affected motor cortex, the parietal associative areas, and the somatosensory cortices.Significance. These results provide meaningful insights into neural mechanisms underlying motor dysfunction.
{"title":"Analysis of corticomuscular-cortical functional network based on time-delayed maximal information spectral coefficient.","authors":"Jianpeng Tang, Xugang Xi, Ting Wang, Junhong Wang, Lihua Li, Zhong Lü","doi":"10.1088/1741-2552/acf7f7","DOIUrl":"10.1088/1741-2552/acf7f7","url":null,"abstract":"<p><p><i>Objective</i>. The study of brain networks has become an influential tool for investigating post-stroke brain function. However, studies on the dynamics of cortical networks associated with muscle activity are limited. This is crucial for elucidating the altered coordination patterns in the post-stroke motor control system.<i>Approach</i>. In this study, we introduced the time-delayed maximal information spectral coefficient (TDMISC) method to assess the local frequency band characteristics (alpha, beta, and gamma bands) of functional corticomuscular coupling (FCMC) and cortico-cortical network parameters. We validated the effectiveness of TDMISC using a unidirectionally coupled Hénon maps model and a neural mass model.<i>Main result</i>. A grip task with 25% of maximum voluntary contraction was designed, and simulation results demonstrated that TDMISC accurately characterizes signals' local frequency band and directional properties. In the gamma band, the affected side showed significantly strong FCMC in the ascending direction. However, in the beta band, the affected side exhibited significantly weak FCMC in all directions. For the cortico-cortical network parameters, the affected side showed a lower clustering coefficient than the unaffected side in all frequency bands. Additionally, the affected side exhibited a longer shortest path length than the unaffected side in all frequency bands. In all frequency bands, the unaffected motor cortex in the stroke group exerted inhibitory effects on the affected motor cortex, the parietal associative areas, and the somatosensory cortices.<i>Significance</i>. These results provide meaningful insights into neural mechanisms underlying motor dysfunction.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10185539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-22DOI: 10.1088/1741-2552/ace932
Mohammad Reza Rezaei, Haseul Jeoung, Ayda Ghahramani, Uptal Saha, Venkat Bhat, Milos R Popovic, Ali Yousefi, Robert E W Chen, Milad Lankarany
Objective. The subthalamic nucleus (STN) of the basal ganglia interacts with the medial prefrontal cortex (mPFC) and shapes a control loop, specifically when the brain receives contradictory information from either different sensory systems or conflicting information from sensory inputs and prior knowledge that developed in the brain. Experimental studies demonstrated that significant increases in theta activities (2-8 Hz) in both the STN and mPFC as well as increased phase synchronization between mPFC and STN are prominent features of conflict processing. While these neural features reflect the importance of STN-mPFC circuitry in conflict processing, a low-dimensional representation of the mPFC-STN interaction referred to as a cognitive state, that links neural activities generated by these sub-regions to behavioral signals (e.g. the response time), remains to be identified.Approach. Here, we propose a new model, namely, the heterogeneous input discriminative-generative decoder (HI-DGD) model, to infer a cognitive state underlying decision-making based on neural activities (STN and mPFC) and behavioral signals (individuals' response time) recorded in ten Parkinson's disease (PD) patients while they performed a Stroop task. PD patients may have conflict processing which is quantitatively (may be qualitative in some) different from healthy populations.Main results. Using extensive synthetic and experimental data, we showed that the HI-DGD model can diffuse information from neural and behavioral data simultaneously and estimate cognitive states underlying conflict and non-conflict trials significantly better than traditional methods. Additionally, the HI-DGD model identified which neural features made significant contributions to conflict and non-conflict choices. Interestingly, the estimated features match well with those reported in experimental studies.Significance. Finally, we highlight the capability of the HI-DGD model in estimating a cognitive state from a single trial of observation, which makes it appropriate to be utilized in closed-loop neuromodulation systems.
{"title":"Inferring cognitive state underlying conflict choices in verbal Stroop task using heterogeneous input discriminative-generative decoder model.","authors":"Mohammad Reza Rezaei, Haseul Jeoung, Ayda Ghahramani, Uptal Saha, Venkat Bhat, Milos R Popovic, Ali Yousefi, Robert E W Chen, Milad Lankarany","doi":"10.1088/1741-2552/ace932","DOIUrl":"10.1088/1741-2552/ace932","url":null,"abstract":"<p><p><i>Objective</i>. The subthalamic nucleus (STN) of the basal ganglia interacts with the medial prefrontal cortex (mPFC) and shapes a control loop, specifically when the brain receives contradictory information from either different sensory systems or conflicting information from sensory inputs and prior knowledge that developed in the brain. Experimental studies demonstrated that significant increases in theta activities (2-8 Hz) in both the STN and mPFC as well as increased phase synchronization between mPFC and STN are prominent features of conflict processing. While these neural features reflect the importance of STN-mPFC circuitry in conflict processing, a low-dimensional representation of the mPFC-STN interaction referred to as a cognitive state, that links neural activities generated by these sub-regions to behavioral signals (e.g. the response time), remains to be identified.<i>Approach</i>. Here, we propose a new model, namely, the heterogeneous input discriminative-generative decoder (HI-DGD) model, to infer a cognitive state underlying decision-making based on neural activities (STN and mPFC) and behavioral signals (individuals' response time) recorded in ten Parkinson's disease (PD) patients while they performed a Stroop task. PD patients may have conflict processing which is quantitatively (may be qualitative in some) different from healthy populations.<i>Main results</i>. Using extensive synthetic and experimental data, we showed that the HI-DGD model can diffuse information from neural and behavioral data simultaneously and estimate cognitive states underlying conflict and non-conflict trials significantly better than traditional methods. Additionally, the HI-DGD model identified which neural features made significant contributions to conflict and non-conflict choices. Interestingly, the estimated features match well with those reported in experimental studies.<i>Significance</i>. Finally, we highlight the capability of the HI-DGD model in estimating a cognitive state from a single trial of observation, which makes it appropriate to be utilized in closed-loop neuromodulation systems.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10222160","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-22DOI: 10.1088/1741-2552/acf68b
Jeffrey Lim, Po T Wang, Luke Bashford, Spencer Kellis, Susan J Shaw, Hui Gong, Michelle Armacost, Payam Heydari, An H Do, Richard A Andersen, Charles Y Liu, Zoran Nenadic
Objective.Invasive brain-computer interfaces (BCIs) have shown promise in restoring motor function to those paralyzed by neurological injuries. These systems also have the ability to restore sensation via cortical electrostimulation. Cortical stimulation produces strong artifacts that can obscure neural signals or saturate recording amplifiers. While front-end hardware techniques can alleviate this problem, residual artifacts generally persist and must be suppressed by back-end methods.Approach.We have developed a technique based on pre-whitening and null projection (PWNP) and tested its ability to suppress stimulation artifacts in electroencephalogram (EEG), electrocorticogram (ECoG) and microelectrode array (MEA) signals from five human subjects.Main results.In EEG signals contaminated by narrow-band stimulation artifacts, the PWNP method achieved average artifact suppression between 32 and 34 dB, as measured by an increase in signal-to-interference ratio. In ECoG and MEA signals contaminated by broadband stimulation artifacts, our method suppressed artifacts by 78%-80% and 85%, respectively, as measured by a reduction in interference index. When compared to independent component analysis, which is considered the state-of-the-art technique for artifact suppression, our method achieved superior results, while being significantly easier to implement.Significance.PWNP can potentially act as an efficient method of artifact suppression to enable simultaneous stimulation and recording in bi-directional BCIs to biomimetically restore motor function.
{"title":"Suppression of cortical electrostimulation artifacts using pre-whitening and null projection.","authors":"Jeffrey Lim, Po T Wang, Luke Bashford, Spencer Kellis, Susan J Shaw, Hui Gong, Michelle Armacost, Payam Heydari, An H Do, Richard A Andersen, Charles Y Liu, Zoran Nenadic","doi":"10.1088/1741-2552/acf68b","DOIUrl":"10.1088/1741-2552/acf68b","url":null,"abstract":"<p><p><i>Objective.</i>Invasive brain-computer interfaces (BCIs) have shown promise in restoring motor function to those paralyzed by neurological injuries. These systems also have the ability to restore sensation via cortical electrostimulation. Cortical stimulation produces strong artifacts that can obscure neural signals or saturate recording amplifiers. While front-end hardware techniques can alleviate this problem, residual artifacts generally persist and must be suppressed by back-end methods.<i>Approach.</i>We have developed a technique based on pre-whitening and null projection (PWNP) and tested its ability to suppress stimulation artifacts in electroencephalogram (EEG), electrocorticogram (ECoG) and microelectrode array (MEA) signals from five human subjects.<i>Main results.</i>In EEG signals contaminated by narrow-band stimulation artifacts, the PWNP method achieved average artifact suppression between 32 and 34 dB, as measured by an increase in signal-to-interference ratio. In ECoG and MEA signals contaminated by broadband stimulation artifacts, our method suppressed artifacts by 78%-80% and 85%, respectively, as measured by a reduction in interference index. When compared to independent component analysis, which is considered the state-of-the-art technique for artifact suppression, our method achieved superior results, while being significantly easier to implement.<i>Significance.</i>PWNP can potentially act as an efficient method of artifact suppression to enable simultaneous stimulation and recording in bi-directional BCIs to biomimetically restore motor function.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10156316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective.Brain-computer interfaces (BCIs) enable a direct communication of the brain with the external world, using one's neural activity, measured by electroencephalography (EEG) signals. In recent years, convolutional neural networks (CNNs) have been widely used to perform automatic feature extraction and classification in various EEG-based tasks. However, their undeniable benefits are counterbalanced by the lack of interpretability properties as well as the inability to perform sufficiently when only limited amount of training data is available.Approach.In this work, we introduce a novel, lightweight, fully-learnable neural network architecture that relies on Gabor filters to delocalize EEG signal information into scattering decomposition paths along frequency and slow-varying temporal modulations.Main results.We utilize our network in two distinct modeling settings, for building either a generic (training across subjects) or a personalized (training within a subject) classifier.Significance.In both cases, using two different publicly available datasets and one in-house collected dataset, we demonstrate high performance for our model with considerably less number of trainable parameters as well as shorter training time compared to other state-of-the-art deep architectures. Moreover, our network demonstrates enhanced interpretability properties emerging at the level of the temporal filtering operation and enables us to train efficient personalized BCI models with limited amount of training data.
{"title":"BrainWave-Scattering Net: a lightweight network for EEG-based motor imagery recognition.","authors":"Konstantinos Barmpas, Yannis Panagakis, Dimitrios A Adamos, Nikolaos Laskaris, Stefanos Zafeiriou","doi":"10.1088/1741-2552/acf78a","DOIUrl":"10.1088/1741-2552/acf78a","url":null,"abstract":"<p><p><i>Objective.</i>Brain-computer interfaces (BCIs) enable a direct communication of the brain with the external world, using one's neural activity, measured by electroencephalography (EEG) signals. In recent years, convolutional neural networks (CNNs) have been widely used to perform automatic feature extraction and classification in various EEG-based tasks. However, their undeniable benefits are counterbalanced by the lack of interpretability properties as well as the inability to perform sufficiently when only limited amount of training data is available.<i>Approach.</i>In this work, we introduce a novel, lightweight, fully-learnable neural network architecture that relies on Gabor filters to delocalize EEG signal information into scattering decomposition paths along frequency and slow-varying temporal modulations.<i>Main results.</i>We utilize our network in two distinct modeling settings, for building either a generic (training across subjects) or a personalized (training within a subject) classifier.<i>Significance.</i>In both cases, using two different publicly available datasets and one in-house collected dataset, we demonstrate high performance for our model with considerably less number of trainable parameters as well as shorter training time compared to other state-of-the-art deep architectures. Moreover, our network demonstrates enhanced interpretability properties emerging at the level of the temporal filtering operation and enables us to train efficient personalized BCI models with limited amount of training data.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10184559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-21DOI: 10.1088/1741-2552/acf7f5
Yuchao He, Xin Wang, Zijian Yang, Lingbin Xue, Yuming Chen, Junyu Ji, Feng Wan, Subhas Chandra Mukhopadhyay, Lina Men, Chi Fai Michael Tong, Guanglin Li, Shixiong Chen
Objective. Attention-deficit/hyperactivity disorder (ADHD) is the most common neurodevelopmental disorder in adolescents that can seriously impair a person's attention function, cognitive processes, and learning ability. Currently, clinicians primarily diagnose patients based on the subjective assessments of the Diagnostic and Statistical Manual of Mental Disorders-5, which can lead to delayed diagnosis of ADHD and even misdiagnosis due to low diagnostic efficiency and lack of well-trained diagnostic experts. Deep learning of electroencephalogram (EEG) signals recorded from ADHD patients could provide an objective and accurate method to assist physicians in clinical diagnosis.Approach. This paper proposes the EEG-Transformer deep learning model, which is based on the attention mechanism in the traditional Transformer model, and can perform feature extraction and signal classification processing for the characteristics of EEG signals. A comprehensive comparison was made between the proposed transformer model and three existing convolutional neural network models.Main results. The results showed that the proposed EEG-Transformer model achieved an average accuracy of 95.85% and an average AUC value of 0.9926 with the fastest convergence speed, outperforming the other three models. The function and relationship of each module of the model are studied by ablation experiments. The model with optimal performance was identified by the optimization experiment.Significance. The EEG-Transformer model proposed in this paper can be used as an auxiliary tool for clinical diagnosis of ADHD, and at the same time provides a basic model for transferable learning in the field of EEG signal classification.
{"title":"Classification of attention deficit/hyperactivity disorder based on EEG signals using a EEG-Transformer model<sup>∗</sup>.","authors":"Yuchao He, Xin Wang, Zijian Yang, Lingbin Xue, Yuming Chen, Junyu Ji, Feng Wan, Subhas Chandra Mukhopadhyay, Lina Men, Chi Fai Michael Tong, Guanglin Li, Shixiong Chen","doi":"10.1088/1741-2552/acf7f5","DOIUrl":"10.1088/1741-2552/acf7f5","url":null,"abstract":"<p><p><i>Objective</i>. Attention-deficit/hyperactivity disorder (ADHD) is the most common neurodevelopmental disorder in adolescents that can seriously impair a person's attention function, cognitive processes, and learning ability. Currently, clinicians primarily diagnose patients based on the subjective assessments of the Diagnostic and Statistical Manual of Mental Disorders-5, which can lead to delayed diagnosis of ADHD and even misdiagnosis due to low diagnostic efficiency and lack of well-trained diagnostic experts. Deep learning of electroencephalogram (EEG) signals recorded from ADHD patients could provide an objective and accurate method to assist physicians in clinical diagnosis.<i>Approach</i>. This paper proposes the EEG-Transformer deep learning model, which is based on the attention mechanism in the traditional Transformer model, and can perform feature extraction and signal classification processing for the characteristics of EEG signals. A comprehensive comparison was made between the proposed transformer model and three existing convolutional neural network models.<i>Main results</i>. The results showed that the proposed EEG-Transformer model achieved an average accuracy of 95.85% and an average AUC value of 0.9926 with the fastest convergence speed, outperforming the other three models. The function and relationship of each module of the model are studied by ablation experiments. The model with optimal performance was identified by the optimization experiment.<i>Significance</i>. The EEG-Transformer model proposed in this paper can be used as an auxiliary tool for clinical diagnosis of ADHD, and at the same time provides a basic model for transferable learning in the field of EEG signal classification.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10178275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-20DOI: 10.1088/1741-2552/ace8be
Julia Berezutskaya, Zachary V Freudenburg, Mariska J Vansteensel, Erik J Aarnoutse, Nick F Ramsey, Marcel A J van Gerven
Objective.Development of brain-computer interface (BCI) technology is key for enabling communication in individuals who have lost the faculty of speech due to severe motor paralysis. A BCI control strategy that is gaining attention employs speech decoding from neural data. Recent studies have shown that a combination of direct neural recordings and advanced computational models can provide promising results. Understanding which decoding strategies deliver best and directly applicable results is crucial for advancing the field.Approach.In this paper, we optimized and validated a decoding approach based on speech reconstruction directly from high-density electrocorticography recordings from sensorimotor cortex during a speech production task.Main results.We show that (1) dedicated machine learning optimization of reconstruction models is key for achieving the best reconstruction performance; (2) individual word decoding in reconstructed speech achieves 92%-100% accuracy (chance level is 8%); (3) direct reconstruction from sensorimotor brain activity produces intelligible speech.Significance.These results underline the need for model optimization in achieving best speech decoding results and highlight the potential that reconstruction-based speech decoding from sensorimotor cortex can offer for development of next-generation BCI technology for communication.
{"title":"Direct speech reconstruction from sensorimotor brain activity with optimized deep learning models.","authors":"Julia Berezutskaya, Zachary V Freudenburg, Mariska J Vansteensel, Erik J Aarnoutse, Nick F Ramsey, Marcel A J van Gerven","doi":"10.1088/1741-2552/ace8be","DOIUrl":"10.1088/1741-2552/ace8be","url":null,"abstract":"<p><p><i>Objective.</i>Development of brain-computer interface (BCI) technology is key for enabling communication in individuals who have lost the faculty of speech due to severe motor paralysis. A BCI control strategy that is gaining attention employs speech decoding from neural data. Recent studies have shown that a combination of direct neural recordings and advanced computational models can provide promising results. Understanding which decoding strategies deliver best and directly applicable results is crucial for advancing the field.<i>Approach.</i>In this paper, we optimized and validated a decoding approach based on speech reconstruction directly from high-density electrocorticography recordings from sensorimotor cortex during a speech production task.<i>Main results.</i>We show that (1) dedicated machine learning optimization of reconstruction models is key for achieving the best reconstruction performance; (2) individual word decoding in reconstructed speech achieves 92%-100% accuracy (chance level is 8%); (3) direct reconstruction from sensorimotor brain activity produces intelligible speech.<i>Significance.</i>These results underline the need for model optimization in achieving best speech decoding results and highlight the potential that reconstruction-based speech decoding from sensorimotor cortex can offer for development of next-generation BCI technology for communication.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10510111/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9837388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-19DOI: 10.1088/1741-2552/acec14
Nitin Sadras, Omid G Sani, Parima Ahmadipour, Maryam M Shanechi
Objective.When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI.Approach.We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap.Main results.We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost of errors are high.Significance.Our results show feasibility of non-invasive EEG-based BCIs to improve human decision making.
{"title":"Post-stimulus encoding of decision confidence in EEG: toward a brain-computer interface for decision making.","authors":"Nitin Sadras, Omid G Sani, Parima Ahmadipour, Maryam M Shanechi","doi":"10.1088/1741-2552/acec14","DOIUrl":"10.1088/1741-2552/acec14","url":null,"abstract":"<p><p><i>Objective.</i>When making decisions, humans can evaluate how likely they are to be correct. If this subjective confidence could be reliably decoded from brain activity, it would be possible to build a brain-computer interface (BCI) that improves decision performance by automatically providing more information to the user if needed based on their confidence. But this possibility depends on whether confidence can be decoded right after stimulus presentation and before the response so that a corrective action can be taken in time. Although prior work has shown that decision confidence is represented in brain signals, it is unclear if the representation is stimulus-locked or response-locked, and whether stimulus-locked pre-response decoding is sufficiently accurate for enabling such a BCI.<i>Approach.</i>We investigate the neural correlates of confidence by collecting high-density electroencephalography (EEG) during a perceptual decision task with realistic stimuli. Importantly, we design our task to include a post-stimulus gap that prevents the confounding of stimulus-locked activity by response-locked activity and vice versa, and then compare with a task without this gap.<i>Main results.</i>We perform event-related potential and source-localization analyses. Our analyses suggest that the neural correlates of confidence are stimulus-locked, and that an absence of a post-stimulus gap could cause these correlates to incorrectly appear as response-locked. By preventing response-locked activity from confounding stimulus-locked activity, we then show that confidence can be reliably decoded from single-trial stimulus-locked pre-response EEG alone. We also identify a high-performance classification algorithm by comparing a battery of algorithms. Lastly, we design a simulated BCI framework to show that the EEG classification is accurate enough to build a BCI and that the decoded confidence could be used to improve decision making performance particularly when the task difficulty and cost of errors are high.<i>Significance.</i>Our results show feasibility of non-invasive EEG-based BCIs to improve human decision making.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10354737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-19DOI: 10.1088/1741-2552/acf78b
Giulia Parodi, Martina Brofiga, Vito Paolo Pastore, Michela Chiappalone, Sergio Martinoia
Objective.The purpose of this study is to investigate whether and how the balance between excitation and inhibition ('E/I balance') influences the spontaneous development of human-derived neuronal networksin vitro. To achieve that goal, we performed a long-term (98 d) characterization of both homogeneous (only excitatory or inhibitory neurons) and heterogeneous (mixed neuronal types) cultures with controlled E/I ratios (i.e. E:I 0:100, 25:75, 50:50, 75:25, 100:0) by recording their electrophysiological activity using micro-electrode arrays.Approach.Excitatory and inhibitory neurons were derived from human induced pluripotent stem cells (hiPSCs). We realized five different configurations by systematically varying the glutamatergic and GABAergic percentages.Main results.We successfully built both homogeneous and heterogeneous neuronal cultures from hiPSCs finely controlling the E/I ratios; we were able to maintain them for up to 3 months. Homogeneity differentially impacted purely inhibitory (no bursts) and purely excitatory (few bursts) networks, deviating from the typical traits of heterogeneous cultures (burst dominated). Increased inhibition in heterogeneous cultures strongly affected the duration and organization of bursting and network bursting activity. Spike-based functional connectivity and image-based deep learning analysis further confirmed all the above.Significance.Healthy neuronal activity is controlled by a well-defined E/I balance whose alteration could lead to the onset of neurodevelopmental disorders like schizophrenia or epilepsy. Most of the commonly usedin vitromodels are animal-derived or too simplified and thus far from thein vivohuman condition. In this work, by performing a long-term study of hiPSCs-derived neuronal networks obtained from healthy human subjects, we demonstrated the feasibility of a robustin vitromodel which can be further exploited for investigating pathological conditions where the E/I balance is impaired.
{"title":"Deepening the role of excitation/inhibition balance in human iPSCs-derived neuronal networks coupled to MEAs during long-term development.","authors":"Giulia Parodi, Martina Brofiga, Vito Paolo Pastore, Michela Chiappalone, Sergio Martinoia","doi":"10.1088/1741-2552/acf78b","DOIUrl":"10.1088/1741-2552/acf78b","url":null,"abstract":"<p><p><i>Objective.</i>The purpose of this study is to investigate whether and how the balance between excitation and inhibition ('E/I balance') influences the spontaneous development of human-derived neuronal networks<i>in vitro</i>. To achieve that goal, we performed a long-term (98 d) characterization of both homogeneous (only excitatory or inhibitory neurons) and heterogeneous (mixed neuronal types) cultures with controlled E/I ratios (i.e. E:I 0:100, 25:75, 50:50, 75:25, 100:0) by recording their electrophysiological activity using micro-electrode arrays.<i>Approach.</i>Excitatory and inhibitory neurons were derived from human induced pluripotent stem cells (hiPSCs). We realized five different configurations by systematically varying the glutamatergic and GABAergic percentages.<i>Main results.</i>We successfully built both homogeneous and heterogeneous neuronal cultures from hiPSCs finely controlling the E/I ratios; we were able to maintain them for up to 3 months. Homogeneity differentially impacted purely inhibitory (no bursts) and purely excitatory (few bursts) networks, deviating from the typical traits of heterogeneous cultures (burst dominated). Increased inhibition in heterogeneous cultures strongly affected the duration and organization of bursting and network bursting activity. Spike-based functional connectivity and image-based deep learning analysis further confirmed all the above.<i>Significance.</i>Healthy neuronal activity is controlled by a well-defined E/I balance whose alteration could lead to the onset of neurodevelopmental disorders like schizophrenia or epilepsy. Most of the commonly used<i>in vitro</i>models are animal-derived or too simplified and thus far from the<i>in vivo</i>human condition. In this work, by performing a long-term study of hiPSCs-derived neuronal networks obtained from healthy human subjects, we demonstrated the feasibility of a robust<i>in vitro</i>model which can be further exploited for investigating pathological conditions where the E/I balance is impaired.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10652884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-18DOI: 10.1088/1741-2552/acf5a4
Alessio P Buccino, Olivier Winter, David Bryant, David Feng, Karel Svoboda, Joshua H Siegle
Objective.With the rapid adoption of high-density electrode arrays for recording neural activity, electrophysiology data volumes within labs and across the field are growing at unprecedented rates. For example, a one-hour recording with a 384-channel Neuropixels probe generates over 80 GB of raw data. These large data volumes carry a high cost, especially if researchers plan to store and analyze their data in the cloud. Thus, there is a pressing need for strategies that can reduce the data footprint of each experiment.Approach.Here, we establish a set of benchmarks for comparing the performance of various compression algorithms on experimental and simulated recordings from Neuropixels 1.0 (NP1) and 2.0 (NP2) probes.Main results.For lossless compression, audio codecs (FLACandWavPack) achieve compression ratios (CRs) 6% higher for NP1 and 10% higher for NP2 than the best general-purpose codecs, at the expense of decompression speed. For lossy compression, theWavPackalgorithm in 'hybrid mode' increases the CR from 3.59 to 7.08 for NP1 and from 2.27 to 7.04 for NP2 (compressed file size of ∼14% for both types of probes), without adverse effects on spike sorting accuracy or spike waveforms.Significance.Along with the tools we have developed to make compression easier to deploy, these results should encourage all electrophysiologists to apply compression as part of their standard analysis workflows.
{"title":"Compression strategies for large-scale electrophysiology data.","authors":"Alessio P Buccino, Olivier Winter, David Bryant, David Feng, Karel Svoboda, Joshua H Siegle","doi":"10.1088/1741-2552/acf5a4","DOIUrl":"10.1088/1741-2552/acf5a4","url":null,"abstract":"<p><p><i>Objective.</i>With the rapid adoption of high-density electrode arrays for recording neural activity, electrophysiology data volumes within labs and across the field are growing at unprecedented rates. For example, a one-hour recording with a 384-channel Neuropixels probe generates over 80 GB of raw data. These large data volumes carry a high cost, especially if researchers plan to store and analyze their data in the cloud. Thus, there is a pressing need for strategies that can reduce the data footprint of each experiment.<i>Approach.</i>Here, we establish a set of benchmarks for comparing the performance of various compression algorithms on experimental and simulated recordings from Neuropixels 1.0 (NP1) and 2.0 (NP2) probes.<i>Main results.</i>For lossless compression, audio codecs (FLACandWavPack) achieve compression ratios (CRs) 6% higher for NP1 and 10% higher for NP2 than the best general-purpose codecs, at the expense of decompression speed. For lossy compression, theWavPackalgorithm in 'hybrid mode' increases the CR from 3.59 to 7.08 for NP1 and from 2.27 to 7.04 for NP2 (compressed file size of ∼14% for both types of probes), without adverse effects on spike sorting accuracy or spike waveforms.<i>Significance.</i>Along with the tools we have developed to make compression easier to deploy, these results should encourage all electrophysiologists to apply compression as part of their standard analysis workflows.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10296885","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-18DOI: 10.1088/1741-2552/acf7f3
Ilia Semenkov, Nikita Fedosov, Ilya Makarov, Alexei Ossadtchi
Objective.Neurofeedback and brain-computer interfacing technology open the exciting opportunity for establishing interactive closed-loop real-time communication with the human brain. This requires interpreting brain's rhythmic activity and generating timely feedback to the brain. Lower delay between neuronal events and the appropriate feedback increases the efficacy of such interaction. Novel more efficient approaches capable of tracking brain rhythm's phase and envelope are needed for scenarios that entail instantaneous interaction with the brain circuits.Approach.Isolating narrow-band signals incurs fundamental delays. To some extent they can be compensated using forecasting models. Given the high quality of modern time series forecasting neural networks we explored their utility for low-latency extraction of brain rhythm parameters. We tested five neural networks with conceptually distinct architectures in forecasting synthetic EEG rhythms. The strongest architecture was then trained to simultaneously filter and forecast EEG data. We compared it against the state-of-the-art techniques using synthetic and real data from 25 subjects.Main results.The temporal convolutional network (TCN) remained the strongest forecasting model that achieved in the majority of testing scenarios>90% rhythm's envelope correlation with<10 ms effective delay and<20∘circular standard deviation of phase estimates. It also remained stable enough to noise level perturbations. Trained to filter and predict the TCN outperformed the cFIR, the Kalman filter based state-space estimation technique and remained on par with the larger Conv-TasNet architecture.Significance.Here we have for the first time demonstrated the utility of the neural network approach for low-latency narrow-band filtering of brain activity signals. Our proposed approach coupled with efficient implementation enhances the effectiveness of brain-state dependent paradigms across various applications. Moreover, our framework for forecasting EEG signals holds promise for investigating the predictability of brain activity, providing valuable insights into the fundamental questions surrounding the functional organization and hierarchical information processing properties of the brain.
{"title":"Real-time low latency estimation of brain rhythms with deep neural networks.","authors":"Ilia Semenkov, Nikita Fedosov, Ilya Makarov, Alexei Ossadtchi","doi":"10.1088/1741-2552/acf7f3","DOIUrl":"10.1088/1741-2552/acf7f3","url":null,"abstract":"<p><p><i>Objective.</i>Neurofeedback and brain-computer interfacing technology open the exciting opportunity for establishing interactive closed-loop real-time communication with the human brain. This requires interpreting brain's rhythmic activity and generating timely feedback to the brain. Lower delay between neuronal events and the appropriate feedback increases the efficacy of such interaction. Novel more efficient approaches capable of tracking brain rhythm's phase and envelope are needed for scenarios that entail instantaneous interaction with the brain circuits.<i>Approach.</i>Isolating narrow-band signals incurs fundamental delays. To some extent they can be compensated using forecasting models. Given the high quality of modern time series forecasting neural networks we explored their utility for low-latency extraction of brain rhythm parameters. We tested five neural networks with conceptually distinct architectures in forecasting synthetic EEG rhythms. The strongest architecture was then trained to simultaneously filter and forecast EEG data. We compared it against the state-of-the-art techniques using synthetic and real data from 25 subjects.<i>Main results.</i>The temporal convolutional network (TCN) remained the strongest forecasting model that achieved in the majority of testing scenarios>90% rhythm's envelope correlation with<10 ms effective delay and<20∘circular standard deviation of phase estimates. It also remained stable enough to noise level perturbations. Trained to filter and predict the TCN outperformed the cFIR, the Kalman filter based state-space estimation technique and remained on par with the larger Conv-TasNet architecture.<i>Significance.</i>Here we have for the first time demonstrated the utility of the neural network approach for low-latency narrow-band filtering of brain activity signals. Our proposed approach coupled with efficient implementation enhances the effectiveness of brain-state dependent paradigms across various applications. Moreover, our framework for forecasting EEG signals holds promise for investigating the predictability of brain activity, providing valuable insights into the fundamental questions surrounding the functional organization and hierarchical information processing properties of the brain.</p>","PeriodicalId":16753,"journal":{"name":"Journal of neural engineering","volume":null,"pages":null},"PeriodicalIF":4.0,"publicationDate":"2023-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10669898","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}