Pub Date : 2024-09-11eCollection Date: 2024-01-01DOI: 10.5334/cpsy.117
Nitay Alon, Lion Schulz, Vaughan Bell, Michael Moutoussis, Peter Dayan, Joseph M Barnby
Humans need to be on their toes when interacting with competitive others to avoid being taken advantage of. Too much caution out of context can, however, be detrimental and produce false beliefs of intended harm. Here, we offer a formal account of this phenomenon through the lens of Theory of Mind. We simulate agents of different depths of mentalizing within a simple game theoretic paradigm and show how, if aligned well, deep recursive mentalization gives rise to both successful deception as well as reasonable skepticism. However, we also show that if a self is mentalizing too deeply - hyper-mentalizing - false beliefs arise that a partner is trying to trick them maliciously, resulting in a material loss to the self. Importantly, we show that this is only true when hypermentalizing agents believe observed actions are generated intentionally. This theory offers a potential cognitive mechanism for suspiciousness, paranoia, and conspiratorial ideation. Rather than a deficit in Theory of Mind, paranoia may arise from the application of overly strategic thinking to ingenuous behaviour.
Author summary: Interacting competitively requires vigilance to avoid deception. However, excessive caution can have adverse effects, stemming from false beliefs of intentional harm. So far there is no formal cognitive account of what may cause this suspiciousness. Here we present an examination of this phenomenon through the lens of Theory of Mind - the cognitive ability to consider the beliefs, intentions, and desires of others. By simulating interacting computer agents we illustrate how well-aligned agents can give rise to successful deception and justified skepticism. Crucially, we also reveal that overly cautious agents develop false beliefs that an ingenuous partner is attempting malicious trickery, leading to tangible losses. As well as formally defining a plausible mechanism for suspiciousness, paranoia, and conspiratorial thinking, our theory indicates that rather than a deficit in Theory of Mind, paranoia may involve an over-application of strategy to genuine behaviour.
{"title":"(Mal)adaptive Mentalizing in the Cognitive Hierarchy, and Its Link to Paranoia.","authors":"Nitay Alon, Lion Schulz, Vaughan Bell, Michael Moutoussis, Peter Dayan, Joseph M Barnby","doi":"10.5334/cpsy.117","DOIUrl":"https://doi.org/10.5334/cpsy.117","url":null,"abstract":"<p><p>Humans need to be on their toes when interacting with competitive others to avoid being taken advantage of. Too much caution out of context can, however, be detrimental and produce false beliefs of intended harm. Here, we offer a formal account of this phenomenon through the lens of Theory of Mind. We simulate agents of different depths of mentalizing within a simple game theoretic paradigm and show how, if aligned well, deep recursive mentalization gives rise to both successful deception as well as reasonable skepticism. However, we also show that if a self is mentalizing too deeply - hyper-mentalizing - false beliefs arise that a partner is trying to trick them maliciously, resulting in a material loss to the self. Importantly, we show that this is only true when hypermentalizing agents believe observed actions are generated intentionally. This theory offers a potential cognitive mechanism for suspiciousness, paranoia, and conspiratorial ideation. Rather than a deficit in Theory of Mind, paranoia may arise from the application of overly strategic thinking to ingenuous behaviour.</p><p><strong>Author summary: </strong>Interacting competitively requires vigilance to avoid deception. However, excessive caution can have adverse effects, stemming from false beliefs of intentional harm. So far there is no formal cognitive account of what may cause this suspiciousness. Here we present an examination of this phenomenon through the lens of Theory of Mind - the cognitive ability to consider the beliefs, intentions, and desires of others. By simulating interacting computer agents we illustrate how well-aligned agents can give rise to successful deception and justified skepticism. Crucially, we also reveal that overly cautious agents develop false beliefs that an ingenuous partner is attempting malicious trickery, leading to tangible losses. As well as formally defining a plausible mechanism for suspiciousness, paranoia, and conspiratorial thinking, our theory indicates that rather than a deficit in Theory of Mind, paranoia may involve an over-application of strategy to genuine behaviour.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11396085/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142302416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-21eCollection Date: 2024-01-01DOI: 10.5334/cpsy.114
Wanjun Lin, Raymond J Dolan
In value-based decision-making there is wide behavioural variability in how individuals respond to uncertainty. Maladaptive responses to uncertainty have been linked to a vulnerability to mental illness, for example, between risk aversion and affective disorders. Here, we examine individual differences in risk sensitivity when subjects confront options drawn from different value distributions, where these embody the same or different means and variances. In simulations, we show that a model that learns a distribution using Bayes' rule and reads out different parts of the distribution under the influence of a risk-sensitive parameter (Conditional Value at Risk, CVaR) predicts how likely an agent is to prefer a broader over a narrow distribution (pro-variance bias/risk-seeking) under the same overall means. Using empirical data, we show that CVaR estimates correlate with participants' pro-variance biases better than a range of alternative parameters derived from other models. Importantly, across two independent samples, CVaR estimates and participants' pro-variance bias negatively correlated with trait rumination, a common trait in depression and anxiety. We conclude that a Bayesian-CVaR model captures individual differences in sensitivity to variance in value distributions and task-independent trait dispositions linked to affective disorders.
{"title":"Decision-Making, Pro-variance Biases and Mood-Related Traits.","authors":"Wanjun Lin, Raymond J Dolan","doi":"10.5334/cpsy.114","DOIUrl":"10.5334/cpsy.114","url":null,"abstract":"<p><p>In value-based decision-making there is wide behavioural variability in how individuals respond to uncertainty. Maladaptive responses to uncertainty have been linked to a vulnerability to mental illness, for example, between risk aversion and affective disorders. Here, we examine individual differences in risk sensitivity when subjects confront options drawn from different value distributions, where these embody the same or different means and variances. In simulations, we show that a model that learns a distribution using Bayes' rule and reads out different parts of the distribution under the influence of a risk-sensitive parameter (Conditional Value at Risk, CVaR) predicts how likely an agent is to prefer a broader over a narrow distribution (pro-variance bias/risk-seeking) under the same overall means. Using empirical data, we show that CVaR estimates correlate with participants' pro-variance biases better than a range of alternative parameters derived from other models. Importantly, across two independent samples, CVaR estimates and participants' pro-variance bias negatively correlated with trait rumination, a common trait in depression and anxiety. We conclude that a Bayesian-CVaR model captures individual differences in sensitivity to variance in value distributions and task-independent trait dispositions linked to affective disorders.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11342847/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142057480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-26eCollection Date: 2024-01-01DOI: 10.5334/cpsy.112
Sam Paskewitz, Inti A Brazil, Ilker Yildirim, Sonia Ruiz, Arielle Baskin-Sommers
Decades of research document an association between neurocognitive dysfunction and externalizing behaviors, including rule-breaking, aggression, and impulsivity. However, there has been very little work that examines how multiple neurocognitive functions co-occur within individuals and which combinations of neurocognitive functions are most relevant for externalizing behaviors. Moreover, Latent Profile Analysis (LPA), a widely used method for grouping individuals in person-centered analysis, often struggles to balance the tradeoff between good model fit (splitting participants into many latent profiles) and model interpretability (using only a few, highly distinct latent profiles). To address these problems, we implemented a non-parametric Bayesian form of LPA based on the Dirichlet process mixture model (DPM-LPA) and used it to study the relationship between neurocognitive functioning and externalizing behaviors in adolescents participating in the Adolescent Brain Cognitive Development Study. First, we found that DPM-LPA outperformed conventional LPA, revealing more distinct profiles and classifying participants with higher certainty. Second, latent profiles extracted from DPM-LPA were differentially related to externalizing behaviors: profiles with deficits in working memory, inhibition, and/or language abilities were robustly related to different expressions of externalizing. Together, these findings represent a step towards addressing the challenge of finding novel ways to use neurocognitive data to better describe the individual. By precisely identifying and specifying the variation in neurocognitive and behavioral patterns this work offers an innovative empirical foundation for the development of assessments and interventions that address these costly behaviors.
{"title":"Enhancing Within-Person Estimation of Neurocognition and the Prediction of Externalizing Behaviors in Adolescents.","authors":"Sam Paskewitz, Inti A Brazil, Ilker Yildirim, Sonia Ruiz, Arielle Baskin-Sommers","doi":"10.5334/cpsy.112","DOIUrl":"10.5334/cpsy.112","url":null,"abstract":"<p><p>Decades of research document an association between neurocognitive dysfunction and externalizing behaviors, including rule-breaking, aggression, and impulsivity. However, there has been very little work that examines how multiple neurocognitive functions co-occur within individuals and which combinations of neurocognitive functions are most relevant for externalizing behaviors. Moreover, Latent Profile Analysis (LPA), a widely used method for grouping individuals in person-centered analysis, often struggles to balance the tradeoff between good model fit (splitting participants into many latent profiles) and model interpretability (using only a few, highly distinct latent profiles). To address these problems, we implemented a non-parametric Bayesian form of LPA based on the Dirichlet process mixture model (DPM-LPA) and used it to study the relationship between neurocognitive functioning and externalizing behaviors in adolescents participating in the Adolescent Brain Cognitive Development Study. First, we found that DPM-LPA outperformed conventional LPA, revealing more distinct profiles and classifying participants with higher certainty. Second, latent profiles extracted from DPM-LPA were differentially related to externalizing behaviors: profiles with deficits in working memory, inhibition, and/or language abilities were robustly related to different expressions of externalizing. Together, these findings represent a step towards addressing the challenge of finding novel ways to use neurocognitive data to better describe the individual. By precisely identifying and specifying the variation in neurocognitive and behavioral patterns this work offers an innovative empirical foundation for the development of assessments and interventions that address these costly behaviors.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11276473/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141790191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-26eCollection Date: 2024-01-01DOI: 10.5334/cpsy.109
Alkistis Saramandi, Laura Crucianelli, Athanasios Koukoutsakis, Veronica Nisticò, Liza Mavromara, Diana Goeta, Giovanni Boido, Fragiskos Gonidakis, Benedetta Demartini, Sara Bertelli, Orsola Gambini, Paul M Jenkinson, Aikaterini Fotopoulou
Patients with anorexia nervosa (AN) typically hold altered beliefs about their body that they struggle to update, including global, prospective beliefs about their ability to know and regulate their body and particularly their interoceptive states. While clinical questionnaire studies have provided ample evidence on the role of such beliefs in the onset, maintenance, and treatment of AN, psychophysical studies have typically focused on perceptual and 'local' beliefs. Across two experiments, we examined how women at the acute AN (N = 86) and post-acute AN state (N = 87), compared to matched healthy controls (N = 180) formed and updated their self-efficacy beliefs retrospectively (Experiment 1) and prospectively (Experiment 2) about their heartbeat counting abilities in an adapted heartbeat counting task. As preregistered, while AN patients did not differ from controls in interoceptive accuracy per se, they hold and maintain 'pessimistic' interoceptive, metacognitive self-efficacy beliefs after performance. Modelling using a simplified computational Bayesian learning framework showed that neither local evidence from performance, nor retrospective beliefs following that performance (that themselves were suboptimally updated) seem to be sufficient to counter and update pessimistic, self-efficacy beliefs in AN. AN patients showed lower learning rates than controls, revealing a tendency to base their posterior beliefs more on prior beliefs rather than prediction errors in both retrospective and prospective belief updating. Further explorations showed that while these differences in both explicit beliefs, and the latent mechanisms of belief updating, were not explained by general cognitive flexibility differences, they were explained by negative mood comorbidity, even after the acute stage of illness.
{"title":"Updating Prospective Self-Efficacy Beliefs About Cardiac Interoception in Anorexia Nervosa: An Experimental and Computational Study.","authors":"Alkistis Saramandi, Laura Crucianelli, Athanasios Koukoutsakis, Veronica Nisticò, Liza Mavromara, Diana Goeta, Giovanni Boido, Fragiskos Gonidakis, Benedetta Demartini, Sara Bertelli, Orsola Gambini, Paul M Jenkinson, Aikaterini Fotopoulou","doi":"10.5334/cpsy.109","DOIUrl":"10.5334/cpsy.109","url":null,"abstract":"<p><p>Patients with anorexia nervosa (AN) typically hold altered beliefs about their body that they struggle to update, including global, prospective beliefs about their ability to know and regulate their body and particularly their interoceptive states. While clinical questionnaire studies have provided ample evidence on the role of such beliefs in the onset, maintenance, and treatment of AN, psychophysical studies have typically focused on perceptual and 'local' beliefs. Across two experiments, we examined how women at the acute AN (N = 86) and post-acute AN state (N = 87), compared to matched healthy controls (N = 180) formed and updated their self-efficacy beliefs retrospectively (Experiment 1) and prospectively (Experiment 2) about their heartbeat counting abilities in an adapted heartbeat counting task. As preregistered, while AN patients did not differ from controls in interoceptive accuracy <i>per se</i>, they hold and maintain 'pessimistic' interoceptive, metacognitive self-efficacy beliefs after performance. Modelling using a simplified computational Bayesian learning framework showed that neither local evidence from performance, nor retrospective beliefs following that performance (that themselves were suboptimally updated) seem to be sufficient to counter and update pessimistic, self-efficacy beliefs in AN. AN patients showed lower learning rates than controls, revealing a tendency to base their posterior beliefs more on prior beliefs rather than prediction errors in both retrospective and prospective belief updating. Further explorations showed that while these differences in both explicit beliefs, and the latent mechanisms of belief updating, were not explained by general cognitive flexibility differences, they were explained by negative mood comorbidity, even after the acute stage of illness.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11212784/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141473201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-20eCollection Date: 2024-01-01DOI: 10.5334/cpsy.105
Dan Holley, Erica A Varga, Erie D Boorman, Andrew S Fox
Alfred Hitchcock, film director and "Master of Suspense," observed that terror is not driven by a negative event, but "only in the anticipation of it." This observation is not restricted to the movies: Anxiety builds when we anticipate uncertain negative events, and heightened reactivity during uncertain threat anticipation is a transdiagnostic marker of anxiety (Grupe & Nitschke, 2013; Holley & Fox, 2022; Hur et al., 2020; Krain et al., 2008; Simmons et al., 2008; Yassa et al., 2012). Here, we manipulate the temporal dynamics of an uncertain threat to demonstrate how the evolving expectation of threat can lead people to forgo rewards and experience fear/anxiety. Specifically, we show that increased "hazard rate," which can build during periods of uncertainty, promotes a tendency to avoid threatening contexts while increasing fear/anxiety. These results provide insight into why the anticipation of temporally uncertain threats elicits fear/anxiety, and reframe the underlying causes of related psychopathology.
电影导演、"悬疑大师 "阿尔弗雷德-希区柯克(Alfred Hitchcock)认为,恐怖并非由负面事件驱动,而是 "仅在对负面事件的预期中"。这一观察结果并不局限于电影:当我们预测到不确定的负面事件时,焦虑就会产生,而在不确定的威胁预测过程中反应性的增强是焦虑的跨诊断标志(Grupe & Nitschke, 2013; Holley & Fox, 2022; Hur et al., 2020; Krain et al., 2008; Simmons et al., 2008; Yassa et al., 2012)。在这里,我们操纵了不确定威胁的时间动态,以证明不断变化的威胁预期如何导致人们放弃奖励并体验恐惧/焦虑。具体来说,我们表明,在不确定时期增加的 "危险率 "会在增加恐惧/焦虑的同时促进人们回避威胁环境的倾向。这些结果让我们了解了为什么对时间上不确定的威胁的预期会引起恐惧/焦虑,并重塑了相关精神病理学的根本原因。
{"title":"Temporal Dynamics of Uncertainty Cause Anxiety and Avoidance.","authors":"Dan Holley, Erica A Varga, Erie D Boorman, Andrew S Fox","doi":"10.5334/cpsy.105","DOIUrl":"10.5334/cpsy.105","url":null,"abstract":"<p><p>Alfred Hitchcock, film director and \"Master of Suspense,\" observed that terror is not driven by a negative event, but \"only in the anticipation of it.\" This observation is not restricted to the movies: Anxiety builds when we anticipate uncertain negative events, and heightened reactivity during uncertain threat anticipation is a transdiagnostic marker of anxiety (Grupe & Nitschke, 2013; Holley & Fox, 2022; Hur et al., 2020; Krain et al., 2008; Simmons et al., 2008; Yassa et al., 2012). Here, we manipulate the temporal dynamics of an uncertain threat to demonstrate how the evolving expectation of threat can lead people to forgo rewards and experience fear/anxiety. Specifically, we show that increased \"hazard rate,\" which can build during periods of uncertainty, promotes a tendency to avoid threatening contexts while increasing fear/anxiety. These results provide insight into <i>why</i> the anticipation of temporally uncertain threats elicits fear/anxiety, and reframe the underlying causes of related psychopathology.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11192096/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141444072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-09eCollection Date: 2024-01-01DOI: 10.5334/cpsy.102
Isabel K Lütkenherm, Shannon M Locke, Oliver J Robinson
In patients with mood disorders, negative affective biases - systematically prioritising and interpreting information negatively - are common. A translational cognitive task testing this bias has shown that depressed patients have a reduced preference for a high reward under ambiguous decision-making conditions. The precise mechanisms underscoring this bias are, however, not yet understood. We therefore developed a set of measures to probe the underlying source of the behavioural bias by testing its relationship to a participant's reward sensitivity, value sensitivity and reward learning rate. One-hundred-forty-eight participants completed three online behavioural tasks: the original ambiguous-cue decision-making task probing negative affective bias, a probabilistic reward learning task probing reward sensitivity and reward learning rate, and a gambling task probing value sensitivity. We modelled the learning task through a dynamic signal detection theory model and the gambling task through an expectation-maximisation prospect theory model. Reward sensitivity from the probabilistic reward task (β = 0.131, p = 0.024) and setting noise from the probabilistic reward task (β = -0.187, p = 0.028) both predicted the affective bias score in a logistic regression. Increased negative affective bias, at least on this specific task, may therefore be driven in part by a combination of reduced sensitivity to rewards and more variable responses.
{"title":"Reward Sensitivity and Noise Contribute to Negative Affective Bias: A Learning Signal Detection Theory Approach in Decision-Making.","authors":"Isabel K Lütkenherm, Shannon M Locke, Oliver J Robinson","doi":"10.5334/cpsy.102","DOIUrl":"10.5334/cpsy.102","url":null,"abstract":"<p><p>In patients with mood disorders, negative affective biases - systematically prioritising and interpreting information negatively - are common. A translational cognitive task testing this bias has shown that depressed patients have a reduced preference for a high reward under ambiguous decision-making conditions. The precise mechanisms underscoring this bias are, however, not yet understood. We therefore developed a set of measures to probe the underlying source of the behavioural bias by testing its relationship to a participant's reward sensitivity, value sensitivity and reward learning rate. One-hundred-forty-eight participants completed three online behavioural tasks: the original ambiguous-cue decision-making task probing negative affective bias, a probabilistic reward learning task probing reward sensitivity and reward learning rate, and a gambling task probing value sensitivity. We modelled the learning task through a dynamic signal detection theory model and the gambling task through an expectation-maximisation prospect theory model. Reward sensitivity from the probabilistic reward task (<i>β</i> = 0.131, p = 0.024) and setting noise from the probabilistic reward task (<i>β</i> = -0.187, p = 0.028) both predicted the affective bias score in a logistic regression. Increased negative affective bias, at least on this specific task, may therefore be driven in part by a combination of reduced sensitivity to rewards and more variable responses.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11104415/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141077445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-03eCollection Date: 2024-01-01DOI: 10.5334/cpsy.108
Daniel G Dillon, Emily L Belleau, Julianne Origlio, Madison McKee, Aava Jahan, Ashley Meyer, Min Kang Souther, Devon Brunner, Manuel Kuhn, Yuen Siang Ang, Cristina Cusin, Maurizio Fava, Diego A Pizzagalli
The Probabilistic Reward Task (PRT) is widely used to investigate the impact of Major Depressive Disorder (MDD) on reinforcement learning (RL), and recent studies have used it to provide insight into decision-making mechanisms affected by MDD. The current project used PRT data from unmedicated, treatment-seeking adults with MDD to extend these efforts by: (1) providing a more detailed analysis of standard PRT metrics-response bias and discriminability-to better understand how the task is performed; (2) analyzing the data with two computational models and providing psychometric analyses of both; and (3) determining whether response bias, discriminability, or model parameters predicted responses to treatment with placebo or the atypical antidepressant bupropion. Analysis of standard metrics replicated recent work by demonstrating a dependency between response bias and response time (RT), and by showing that reward totals in the PRT are governed by discriminability. Behavior was well-captured by the Hierarchical Drift Diffusion Model (HDDM), which models decision-making processes; the HDDM showed excellent internal consistency and acceptable retest reliability. A separate "belief" model reproduced the evolution of response bias over time better than the HDDM, but its psychometric properties were weaker. Finally, the predictive utility of the PRT was limited by small samples; nevertheless, depressed adults who responded to bupropion showed larger pre-treatment starting point biases in the HDDM than non-responders, indicating greater sensitivity to the PRT's asymmetric reinforcement contingencies. Together, these findings enhance our understanding of reward and decision-making mechanisms that are implicated in MDD and probed by the PRT.
{"title":"Using Drift Diffusion and RL Models to Disentangle Effects of Depression On Decision-Making vs. Learning in the Probabilistic Reward Task.","authors":"Daniel G Dillon, Emily L Belleau, Julianne Origlio, Madison McKee, Aava Jahan, Ashley Meyer, Min Kang Souther, Devon Brunner, Manuel Kuhn, Yuen Siang Ang, Cristina Cusin, Maurizio Fava, Diego A Pizzagalli","doi":"10.5334/cpsy.108","DOIUrl":"10.5334/cpsy.108","url":null,"abstract":"<p><p>The Probabilistic Reward Task (PRT) is widely used to investigate the impact of Major Depressive Disorder (MDD) on reinforcement learning (RL), and recent studies have used it to provide insight into decision-making mechanisms affected by MDD. The current project used PRT data from unmedicated, treatment-seeking adults with MDD to extend these efforts by: (1) providing a more detailed analysis of standard PRT metrics-response bias and discriminability-to better understand how the task is performed; (2) analyzing the data with two computational models and providing psychometric analyses of both; and (3) determining whether response bias, discriminability, or model parameters predicted responses to treatment with placebo or the atypical antidepressant bupropion. Analysis of standard metrics replicated recent work by demonstrating a dependency between response bias and response time (RT), and by showing that reward totals in the PRT are governed by discriminability. Behavior was well-captured by the Hierarchical Drift Diffusion Model (HDDM), which models decision-making processes; the HDDM showed excellent internal consistency and acceptable retest reliability. A separate \"belief\" model reproduced the evolution of response bias over time better than the HDDM, but its psychometric properties were weaker. Finally, the predictive utility of the PRT was limited by small samples; nevertheless, depressed adults who responded to bupropion showed larger pre-treatment starting point biases in the HDDM than non-responders, indicating greater sensitivity to the PRT's asymmetric reinforcement contingencies. Together, these findings enhance our understanding of reward and decision-making mechanisms that are implicated in MDD and probed by the PRT.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11104335/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141074541","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-20eCollection Date: 2024-01-01DOI: 10.5334/cpsy.104
Antonius Wiehler, Jan Peters
Gambling disorder is associated with deficits in reward-based learning, but the underlying computational mechanisms are still poorly understood. Here, we examined this issue using a stationary reinforcement learning task in combination with computational modeling and functional resonance imaging (fMRI) in individuals that regular participate in gambling (n = 23, seven fulfilled one to three DSM 5 criteria for gambling disorder, sixteen fulfilled four or more) and matched controls (n = 23). As predicted, the gambling group exhibited substantially reduced accuracy, whereas overall response times (RTs) were not reliably different between groups. We then used comprehensive modeling using reinforcement learning drift diffusion models (RLDDMs) in combination with hierarchical Bayesian parameter estimation to shed light on the computational underpinnings of this performance deficit. In both groups, an RLDDM in which both non-decision time and decision threshold (boundary separation) changed over the course of the experiment accounted for the data best. The model showed good parameter and model recovery, and posterior predictive checks revealed that, in both groups, the model accurately reproduced the evolution of accuracies and RTs over time. Modeling revealed that, compared to controls, the learning impairment in the gambling group was linked to a more rapid reduction in decision thresholds over time, and a reduced impact of value-differences on the drift rate. The gambling group also showed shorter non-decision times. FMRI analyses replicated effects of prediction error coding in the ventral striatum and value coding in the ventro-medial prefrontal cortex, but there was no credible evidence for group differences in these effects. Taken together, our findings show that reinforcement learning impairments in disordered gambling are linked to both maladaptive decision threshold adjustments and a reduced consideration of option values in the choice process.
{"title":"Decomposition of Reinforcement Learning Deficits in Disordered Gambling via Drift Diffusion Modeling and Functional Magnetic Resonance Imaging.","authors":"Antonius Wiehler, Jan Peters","doi":"10.5334/cpsy.104","DOIUrl":"10.5334/cpsy.104","url":null,"abstract":"<p><p>Gambling disorder is associated with deficits in reward-based learning, but the underlying computational mechanisms are still poorly understood. Here, we examined this issue using a stationary reinforcement learning task in combination with computational modeling and functional resonance imaging (fMRI) in individuals that regular participate in gambling (n = 23, seven fulfilled one to three DSM 5 criteria for gambling disorder, sixteen fulfilled four or more) and matched controls (n = 23). As predicted, the gambling group exhibited substantially reduced accuracy, whereas overall response times (RTs) were not reliably different between groups. We then used comprehensive modeling using reinforcement learning drift diffusion models (RLDDMs) in combination with hierarchical Bayesian parameter estimation to shed light on the computational underpinnings of this performance deficit. In both groups, an RLDDM in which both non-decision time and decision threshold (boundary separation) changed over the course of the experiment accounted for the data best. The model showed good parameter and model recovery, and posterior predictive checks revealed that, in both groups, the model accurately reproduced the evolution of accuracies and RTs over time. Modeling revealed that, compared to controls, the learning impairment in the gambling group was linked to a more rapid reduction in decision thresholds over time, and a reduced impact of value-differences on the drift rate. The gambling group also showed shorter non-decision times. FMRI analyses replicated effects of prediction error coding in the ventral striatum and value coding in the ventro-medial prefrontal cortex, but there was no credible evidence for group differences in these effects. Taken together, our findings show that reinforcement learning impairments in disordered gambling are linked to both maladaptive decision threshold adjustments and a reduced consideration of option values in the choice process.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11104325/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141077439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-02-07eCollection Date: 2024-01-01DOI: 10.5334/cpsy.95
Daniel J Hauke, Michelle Wobmann, Christina Andreou, Amatya J Mackintosh, Renate de Bock, Povilas Karvelis, Rick A Adams, Philipp Sterzer, Stefan Borgwardt, Volker Roth, Andreea O Diaconescu
Paranoid delusions or unfounded beliefs that others intend to deliberately cause harm are a frequent and burdensome symptom in early psychosis, but their emergence and consolidation still remains opaque. Recent theories suggest that overly precise prediction errors lead to an unstable model of the world providing a breeding ground for delusions. Here, we employ a Bayesian approach to test for such an unstable model of the world and investigate the computational mechanisms underlying emerging paranoia. We modelled behaviour of 18 first-episode psychosis patients (FEP), 19 individuals at clinical high risk for psychosis (CHR-P), and 19 healthy controls (HC) during an advice-taking task designed to probe learning about others' changing intentions. We formulated competing hypotheses comparing the standard Hierarchical Gaussian Filter (HGF), a Bayesian belief updating scheme, with a mean-reverting HGF to model an altered perception of volatility. There was a significant group-by-volatility interaction on advice-taking suggesting that CHR-P and FEP displayed reduced adaptability to environmental volatility. Model comparison favored the standard HGF in HC, but the mean-reverting HGF in CHR-P and FEP in line with perceiving increased volatility, although model attributions in CHR-P were heterogeneous. We observed correlations between perceiving increased volatility and positive symptoms generally as well as with frequency of paranoid delusions specifically. Our results suggest that FEP are characterised by a different computational mechanism - perceiving the environment as increasingly volatile - in line with Bayesian accounts of psychosis. This approach may prove useful to investigate heterogeneity in CHR-P and identify vulnerability for transition to psychosis.
{"title":"Altered Perception of Environmental Volatility During Social Learning in Emerging Psychosis.","authors":"Daniel J Hauke, Michelle Wobmann, Christina Andreou, Amatya J Mackintosh, Renate de Bock, Povilas Karvelis, Rick A Adams, Philipp Sterzer, Stefan Borgwardt, Volker Roth, Andreea O Diaconescu","doi":"10.5334/cpsy.95","DOIUrl":"10.5334/cpsy.95","url":null,"abstract":"<p><p>Paranoid delusions or unfounded beliefs that others intend to deliberately cause harm are a frequent and burdensome symptom in early psychosis, but their emergence and consolidation still remains opaque. Recent theories suggest that overly precise prediction errors lead to an unstable model of the world providing a breeding ground for delusions. Here, we employ a Bayesian approach to test for such an unstable model of the world and investigate the computational mechanisms underlying emerging paranoia. We modelled behaviour of 18 first-episode psychosis patients (FEP), 19 individuals at clinical high risk for psychosis (CHR-P), and 19 healthy controls (HC) during an advice-taking task designed to probe learning about others' changing intentions. We formulated competing hypotheses comparing the standard Hierarchical Gaussian Filter (HGF), a Bayesian belief updating scheme, with a mean-reverting HGF to model an altered perception of volatility. There was a significant group-by-volatility interaction on advice-taking suggesting that CHR-P and FEP displayed reduced adaptability to environmental volatility. Model comparison favored the standard HGF in HC, but the mean-reverting HGF in CHR-P and FEP in line with perceiving increased volatility, although model attributions in CHR-P were heterogeneous. We observed correlations between perceiving increased volatility and positive symptoms generally as well as with frequency of paranoid delusions specifically. Our results suggest that FEP are characterised by a different computational mechanism - perceiving the environment as increasingly volatile - in line with Bayesian accounts of psychosis. This approach may prove useful to investigate heterogeneity in CHR-P and identify vulnerability for transition to psychosis.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11104374/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141077433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-08-28eCollection Date: 2023-01-01DOI: 10.5334/cpsy.94
Jingwen Jin, Peter Zeidman, Karl J Friston, Roman Kotov
Introduction: Illness course plays a crucial role in delineating psychiatric disorders. However, existing nosologies consider only its most basic features (e.g., symptom sequence, duration). We developed a Dynamic Causal Model (DCM) that characterizes course patterns more fully using dense timeseries data. This foundational study introduces the new modeling approach and evaluates its validity using empirical and simulated data.
Methods: A three-level DCM was constructed to model how latent dynamics produce symptoms of depression, mania, and psychosis. This model was fit to symptom scores of nine patients collected prospectively over four years, following first hospitalization. Simulated subjects based on these empirical data were used to evaluate model parameters at the subject-level. At the group-level, we tested the accuracy with which the DCM can estimate the latent course patterns using Parametric Empirical Bayes (PEB) and leave-one-out cross-validation.
Results: Analyses of empirical data showed that DCM accurately captured symptom trajectories for all nine subjects. Simulation results showed that parameters could be estimated accurately (correlations between generative and estimated parameters >= 0.76). Moreover, the model could distinguish different latent course patterns, with PEB correctly assigning simulated patients for eight of nine course patterns. When testing any pair of two specific course patterns using leave-one-out cross-validation, 30 out of 36 pairs showed a moderate or high out-of-samples correlation between the true group-membership and the estimated group-membership values.
Conclusion: DCM has been widely used in neuroscience to infer latent neuronal processes from neuroimaging data. Our findings highlight the potential of adopting this methodology for modeling symptom trajectories to explicate nosologic entities, temporal patterns that define them, and facilitate personalized treatment.
{"title":"Inferring Trajectories of Psychotic Disorders Using Dynamic Causal Modeling.","authors":"Jingwen Jin, Peter Zeidman, Karl J Friston, Roman Kotov","doi":"10.5334/cpsy.94","DOIUrl":"10.5334/cpsy.94","url":null,"abstract":"<p><strong>Introduction: </strong>Illness course plays a crucial role in delineating psychiatric disorders. However, existing nosologies consider only its most basic features (e.g., symptom sequence, duration). We developed a Dynamic Causal Model (DCM) that characterizes course patterns more fully using dense timeseries data. This foundational study introduces the new modeling approach and evaluates its validity using empirical and simulated data.</p><p><strong>Methods: </strong>A three-level DCM was constructed to model how latent dynamics produce symptoms of depression, mania, and psychosis. This model was fit to symptom scores of nine patients collected prospectively over four years, following first hospitalization. Simulated subjects based on these empirical data were used to evaluate model parameters at the subject-level. At the group-level, we tested the accuracy with which the DCM can estimate the latent course patterns using Parametric Empirical Bayes (PEB) and leave-one-out cross-validation.</p><p><strong>Results: </strong>Analyses of empirical data showed that DCM accurately captured symptom trajectories for all nine subjects. Simulation results showed that parameters could be estimated accurately (correlations between generative and estimated parameters >= 0.76). Moreover, the model could distinguish different latent course patterns, with PEB correctly assigning simulated patients for eight of nine course patterns. When testing any pair of two specific course patterns using leave-one-out cross-validation, 30 out of 36 pairs showed a moderate or high out-of-samples correlation between the true group-membership and the estimated group-membership values.</p><p><strong>Conclusion: </strong>DCM has been widely used in neuroscience to infer latent neuronal processes from neuroimaging data. Our findings highlight the potential of adopting this methodology for modeling symptom trajectories to explicate nosologic entities, temporal patterns that define them, and facilitate personalized treatment.</p>","PeriodicalId":72664,"journal":{"name":"Computational psychiatry (Cambridge, Mass.)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11104383/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46793796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}