The reproducibility crisis highlights several unresolved issues in science, including the need to develop measures that gauge both the consistency and convergence of data sets. While existing meta-analytic methods quantify the consistency of evidence, they do not quantify its convergence: the extent to which different types of empirical methods have provided evidence to support a hypothesis. To address this gap in meta-analysis, we and colleagues developed a summary metric—the cumulative evidence index (CEI)—which uses Bayesian statistics to quantify the degree of both consistency and convergence of evidence regarding causal hypotheses between two phenomena. Here, we outline the CEI's underlying model, which quantifies the extent to which studies of four types—positive intervention, negative intervention, positive non-intervention and negative non-intervention—lend credence to any of three types of causal relations: excitatory, inhibitory or no-connection. Along with p-values and other measures, the CEI can provide a more holistic perspective on a set of evidence by quantitatively expressing epistemic principles that scientists regularly employ qualitatively. The CEI can thus address the reproducibility crisis by formally demonstrating how convergent evidence across multiple study types can yield progress toward scientific consensus, even when an individual type of study fails to yield reproducible results.
可重复性危机凸显了科学中几个尚未解决的问题,包括需要制定衡量数据集一致性和趋同性的标准。现有的荟萃分析方法可以量化证据的一致性,但不能量化证据的趋同性:即不同类型的实证方法在多大程度上提供了支持假设的证据。为了弥补荟萃分析中的这一不足,我们和同事开发了一种总结性指标--累积证据指数(CEI)--它使用贝叶斯统计法来量化有关两个现象之间因果假设的证据的一致性和趋同性程度。在此,我们概述了 CEI 的基本模型,该模型量化了积极干预、消极干预、积极非干预和消极非干预四种类型的研究在多大程度上证明了三种类型的因果关系中的任何一种:兴奋、抑制或无联系。CEI 与 P 值和其他测量方法一样,可以通过定量表达科学家经常定性使用的认识论原则,为一组证据提供更全面的视角。因此,CEI 可以解决可重复性危机,正式展示多种研究类型的趋同证据如何在科学共识方面取得进展,即使个别类型的研究未能产生可重复性结果。
{"title":"Quantifying convergence and consistency","authors":"Nicholas J. Matiasz, Justin Wood, Alcino J. Silva","doi":"10.1111/ejn.16561","DOIUrl":"10.1111/ejn.16561","url":null,"abstract":"<p>The reproducibility crisis highlights several unresolved issues in science, including the need to develop measures that gauge both the consistency and convergence of data sets. While existing meta-analytic methods quantify the <i>consistency</i> of evidence, they do not quantify its <i>convergence</i>: the extent to which different types of empirical methods have provided evidence to support a hypothesis. To address this gap in meta-analysis, we and colleagues developed a summary metric—the <i>cumulative evidence index</i> (CEI)—which uses Bayesian statistics to quantify the degree of both consistency and convergence of evidence regarding causal hypotheses between two phenomena. Here, we outline the CEI's underlying model, which quantifies the extent to which studies of four types—<i>positive intervention</i>, <i>negative intervention</i>, <i>positive non-intervention</i> and <i>negative non-intervention</i>—lend credence to any of three types of causal relations: <i>excitatory</i>, <i>inhibitory</i> or <i>no-connection</i>. Along with <i>p</i>-values and other measures, the CEI can provide a more holistic perspective on a set of evidence by quantitatively expressing epistemic principles that scientists regularly employ qualitatively. The CEI can thus address the reproducibility crisis by formally demonstrating how convergent evidence across multiple study types can yield progress toward scientific consensus, even when an individual type of study fails to yield reproducible results.</p>","PeriodicalId":11993,"journal":{"name":"European Journal of Neuroscience","volume":"60 10","pages":"6391-6394"},"PeriodicalIF":2.7,"publicationDate":"2024-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ejn.16561","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elina S. Kangas, Xueqiao Li, Elisa Vuoriainen, Sari Lindeman, Piia Astikainen
Depression is a heterogeneous syndrome that impacts an individual's emotional, social, cognitive and bodily functioning. Depression is associated with biases in emotional processing, but alterations in basic sensory processing have received less attention in depression research. Here, we measured event-related potentials (ERPs) in response to changes in the intensity of auditory stimuli and the location of somatosensory stimuli in participants with depression and in non-depressed control participants. We tested whether auditory mismatch negativity, P3a or N1 intensity dependence response or somatosensory mismatch response, P3a, P50 or N80 can dissociate depressed participants and non-depressed controls, and we also analysed the effects of depression medication and age in this sample. N1 intensity dependence response was increased in unmedicated depressed participants relative to non-depressed controls. When age was controlled for in the analysis, the effect of depression was only at a trend level. N1 intensity dependence response correlated with depression severity at the whole sample level. We did not observe any depression-related alterations in auditory mismatch negativity or P3a or somatosensory ERPs. Our results may reflect an association between the N1 intensity dependence response and altered neurotransmitter activity in depression, but this should be confirmed in future studies.
{"title":"Intensity dependence of auditory evoked potentials distinguish participants with unmedicated depression from non-depressed controls","authors":"Elina S. Kangas, Xueqiao Li, Elisa Vuoriainen, Sari Lindeman, Piia Astikainen","doi":"10.1111/ejn.16569","DOIUrl":"10.1111/ejn.16569","url":null,"abstract":"<p>Depression is a heterogeneous syndrome that impacts an individual's emotional, social, cognitive and bodily functioning. Depression is associated with biases in emotional processing, but alterations in basic sensory processing have received less attention in depression research. Here, we measured event-related potentials (ERPs) in response to changes in the intensity of auditory stimuli and the location of somatosensory stimuli in participants with depression and in non-depressed control participants. We tested whether auditory mismatch negativity, P3a or N1 intensity dependence response or somatosensory mismatch response, P3a, P50 or N80 can dissociate depressed participants and non-depressed controls, and we also analysed the effects of depression medication and age in this sample. N1 intensity dependence response was increased in unmedicated depressed participants relative to non-depressed controls. When age was controlled for in the analysis, the effect of depression was only at a trend level. N1 intensity dependence response correlated with depression severity at the whole sample level. We did not observe any depression-related alterations in auditory mismatch negativity or P3a or somatosensory ERPs. Our results may reflect an association between the N1 intensity dependence response and altered neurotransmitter activity in depression, but this should be confirmed in future studies.</p>","PeriodicalId":11993,"journal":{"name":"European Journal of Neuroscience","volume":"60 10","pages":"6440-6469"},"PeriodicalIF":2.7,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ejn.16569","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461096","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Flash sequences appear as steady emission of light if the frequency is above the flicker-fusion threshold. One can display flicker-fused letters against a background, and using the Talbot-Plateau law, vary the average luminance of the letters to control degree of match to background luminance. We have previously reported that the visual system can identify letters that have an average luminance that equals background luminance, which can be described as an anomalous contrast discrimination. The present work confirms the earlier report, and provides additional evidence that the phenomenon is not based on a shift in luminance balance. We discuss the possible role of ON and OFF retinal channels in registering the anomalous contrast.
{"title":"Anomalous recognition of flicker-fused letters","authors":"Ernest Greene, Jack Morrison, Wei Wang","doi":"10.1111/ejn.16564","DOIUrl":"10.1111/ejn.16564","url":null,"abstract":"<p>Flash sequences appear as steady emission of light if the frequency is above the flicker-fusion threshold. One can display flicker-fused letters against a background, and using the Talbot-Plateau law, vary the average luminance of the letters to control degree of match to background luminance. We have previously reported that the visual system can identify letters that have an average luminance that equals background luminance, which can be described as an anomalous contrast discrimination. The present work confirms the earlier report, and provides additional evidence that the phenomenon is not based on a shift in luminance balance. We discuss the possible role of ON and OFF retinal channels in registering the anomalous contrast.</p>","PeriodicalId":11993,"journal":{"name":"European Journal of Neuroscience","volume":"60 10","pages":"6429-6439"},"PeriodicalIF":2.7,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ejn.16564","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Despite predictions that neuroscientific discoveries would revolutionize psychiatry, decades of research have not yet led to clinically significant advances in psychiatric care. For this reason, an increasing number of researchers are recognizing the limitations of a purely biomedical approach in psychiatric research. These researchers call for reevaluating the conceptualization of mental disorders and argue for a non-reductionist approach to mental health. The aim of this paper is to discuss philosophical assumptions that underly neuroscientific research in psychiatry and offer practical tools to researchers for overcoming potential conceptual problems that are derived from those assumptions. Specifically, we will discuss: the analogy problem, questioning whether mental health problems are equivalent to brain disorders, the normativity problem, addressing the value-laden nature of psychiatric categories and the priority problem, which describes the level of analysis (e.g., biological, psychological, social, etc.) that should be prioritized when studying psychiatric conditions. In addition, we will explore potential strategies to mitigate practical problems that might arise due to these implicit assumptions. Overall, the aim of this paper is to suggest philosophical tools of practical use for neuroscientists, demonstrating the benefits of a closer collaboration between neuroscience and philosophy.
{"title":"Let's fail better: Using philosophical tools to improve neuroscientific research in psychiatry","authors":"Inés Abalo-Rodríguez, Chrysanthi Blithikioti","doi":"10.1111/ejn.16552","DOIUrl":"10.1111/ejn.16552","url":null,"abstract":"<p>Despite predictions that neuroscientific discoveries would revolutionize psychiatry, decades of research have not yet led to clinically significant advances in psychiatric care. For this reason, an increasing number of researchers are recognizing the limitations of a purely biomedical approach in psychiatric research. These researchers call for reevaluating the conceptualization of mental disorders and argue for a non-reductionist approach to mental health. The aim of this paper is to discuss philosophical assumptions that underly neuroscientific research in psychiatry and offer practical tools to researchers for overcoming potential conceptual problems that are derived from those assumptions. Specifically, we will discuss: the analogy problem, questioning whether mental health problems are equivalent to brain disorders, the normativity problem, addressing the value-laden nature of psychiatric categories and the priority problem, which describes the level of analysis (e.g., biological, psychological, social, etc.) that should be prioritized when studying psychiatric conditions. In addition, we will explore potential strategies to mitigate practical problems that might arise due to these implicit assumptions. Overall, the aim of this paper is to suggest philosophical tools of practical use for neuroscientists, demonstrating the benefits of a closer collaboration between neuroscience and philosophy.</p>","PeriodicalId":11993,"journal":{"name":"European Journal of Neuroscience","volume":"60 10","pages":"6375-6390"},"PeriodicalIF":2.7,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hugues Lamothe, Carine Karachi, Katia Lehongre, Anne Buot, David Grabli, Stephane Thobois, Eric Burguière, Caroline Giordana, Jean-Luc Houeto, Luc Mallet, Marie Vidailhet, Marie-Laure Welter
Gilles de la Tourette syndrome (GTS) and dystonia (DYS) are both hyperkinetic movement disorders effectively treated by deep brain stimulation (DBS) of the internal part of the globus pallidus (GPi). In this study, we compared single-neuron activity in the GPi between 18 GTS patients (with an average of 41 cells per patient) and 17 DYS patients (with an average of 54 cells per patient), all of whom underwent bilateral pallidal stimulation surgery, under general anesthesia or while awake at rest. We found no significant differences in GPi neuronal activity characteristics between patients operated on under general anesthesia versus those who were awake, irrespective of their diagnosis (GTS or DYS). We found higher firing rates, firing rate in bursts, pause duration and interspike interval coefficient of variation in GTS patients compared to DYS patients. On the opposite, we found higher number of pauses and bursts frequency in DYS patients. Lastly, we found a higher proportion of GPi oscillatory activities in DYS compared to GTS patients, with predominant activity within the low-frequency band (theta/alpha) in both patient groups. These findings underscore the complex relationship between the different neuronal discharge characteristic such as oscillatory or bursting activity within the GPi in shaping the clinical phenotypes of hyperkinetic disorders. Further research is warranted to deepen our understanding of how neuronal patterns are transmitted within deep brain structures and to develop strategies aimed at normalizing these pathological activities, by refining DBS techniques to enhance treatment efficacy and individual outcomes.
{"title":"Pallidal neuronal activity in Gilles de la Tourette syndrome and dystonic patients: A comparative study","authors":"Hugues Lamothe, Carine Karachi, Katia Lehongre, Anne Buot, David Grabli, Stephane Thobois, Eric Burguière, Caroline Giordana, Jean-Luc Houeto, Luc Mallet, Marie Vidailhet, Marie-Laure Welter","doi":"10.1111/ejn.16567","DOIUrl":"10.1111/ejn.16567","url":null,"abstract":"<p>Gilles de la Tourette syndrome (GTS) and dystonia (DYS) are both hyperkinetic movement disorders effectively treated by deep brain stimulation (DBS) of the internal part of the globus pallidus (GPi). In this study, we compared single-neuron activity in the GPi between 18 GTS patients (with an average of 41 cells per patient) and 17 DYS patients (with an average of 54 cells per patient), all of whom underwent bilateral pallidal stimulation surgery, under general anesthesia or while awake at rest. We found no significant differences in GPi neuronal activity characteristics between patients operated on under general anesthesia versus those who were awake, irrespective of their diagnosis (GTS or DYS). We found higher firing rates, firing rate in bursts, pause duration and interspike interval coefficient of variation in GTS patients compared to DYS patients. On the opposite, we found higher number of pauses and bursts frequency in DYS patients. Lastly, we found a higher proportion of GPi oscillatory activities in DYS compared to GTS patients, with predominant activity within the low-frequency band (theta/alpha) in both patient groups. These findings underscore the complex relationship between the different neuronal discharge characteristic such as oscillatory or bursting activity within the GPi in shaping the clinical phenotypes of hyperkinetic disorders. Further research is warranted to deepen our understanding of how neuronal patterns are transmitted within deep brain structures and to develop strategies aimed at normalizing these pathological activities, by refining DBS techniques to enhance treatment efficacy and individual outcomes.</p>","PeriodicalId":11993,"journal":{"name":"European Journal of Neuroscience","volume":"60 9","pages":"6185-6194"},"PeriodicalIF":2.7,"publicationDate":"2024-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/ejn.16567","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142461124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}