Registered reports are an important initiative to improve the methodological rigor and transparency of scientific studies. One possible benefit of registered reports is that they may increase public acceptance of controversial research findings. We test this question by providing participants in a large US-based sample (n = 1,500) with descriptions of the key features of registered reports and the standard peer-review process, and then eliciting credibility judgments for various scientific results. We do not find evidence that participants view findings from registered reports as more credible than findings conducted under a standard (non-registered) report. This was true for both plausible and implausible study findings. Our results help clarify public attitudes and beliefs about scientific findings in light of recent methodological developments.
{"title":"Do Registered Reports Make Scientific Findings More Believable to the Public?","authors":"Elaine Costa, Y. Inbar, David Tannenbaum","doi":"10.1525/collabra.32607","DOIUrl":"https://doi.org/10.1525/collabra.32607","url":null,"abstract":"Registered reports are an important initiative to improve the methodological rigor and transparency of scientific studies. One possible benefit of registered reports is that they may increase public acceptance of controversial research findings. We test this question by providing participants in a large US-based sample (n = 1,500) with descriptions of the key features of registered reports and the standard peer-review process, and then eliciting credibility judgments for various scientific results. We do not find evidence that participants view findings from registered reports as more credible than findings conducted under a standard (non-registered) report. This was true for both plausible and implausible study findings. Our results help clarify public attitudes and beliefs about scientific findings in light of recent methodological developments.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66876897","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Olivier Desmedt, M. Van Den Houte, M. Walentynowicz, Sarah Dekeyser, O. Luminet, O. Corneille
The Heartbeat Counting Task (HCT) was designed and is intended to measure the objective ability to detect cardiac signals (also called cardiac interoceptive accuracy). Because interoceptive accuracy is thought to play a key role in biological (e.g., body mass index) and psychological (e.g., trait anxiety) risk factors and indicators of mental health, HCT scores should be associated with these outcomes. In order to examine this question, we performed a meta-analysis on these associations among adult participants. The final data set comprised 133 studies with 11,524 participants. We focused here on the seven most studied outcomes (i.e., outcomes that were studied in at least ten published studies). HCT performance was not significantly associated with trait anxiety, depression, and alexithymia. It was weakly and negatively associated with age after correction for publication bias, sex (male > female), heart rate, and body mass index. In addition, the quality assessment indicates that only a few studies reported sample size justification (6%), pre-registration (0.8%), and data in free access (6.8%). Theoretically expected associations between HCT performance and psychological indicators of mental health were not meta-analytically found. We discuss the implications of these findings for practice and theory.
{"title":"How Does Heartbeat Counting Task Performance Relate to Theoretically-Relevant Mental Health Outcomes? A Meta-Analysis","authors":"Olivier Desmedt, M. Van Den Houte, M. Walentynowicz, Sarah Dekeyser, O. Luminet, O. Corneille","doi":"10.1525/collabra.33271","DOIUrl":"https://doi.org/10.1525/collabra.33271","url":null,"abstract":"The Heartbeat Counting Task (HCT) was designed and is intended to measure the objective ability to detect cardiac signals (also called cardiac interoceptive accuracy). Because interoceptive accuracy is thought to play a key role in biological (e.g., body mass index) and psychological (e.g., trait anxiety) risk factors and indicators of mental health, HCT scores should be associated with these outcomes. In order to examine this question, we performed a meta-analysis on these associations among adult participants. The final data set comprised 133 studies with 11,524 participants. We focused here on the seven most studied outcomes (i.e., outcomes that were studied in at least ten published studies). HCT performance was not significantly associated with trait anxiety, depression, and alexithymia. It was weakly and negatively associated with age after correction for publication bias, sex (male > female), heart rate, and body mass index. In addition, the quality assessment indicates that only a few studies reported sample size justification (6%), pre-registration (0.8%), and data in free access (6.8%). Theoretically expected associations between HCT performance and psychological indicators of mental health were not meta-analytically found. We discuss the implications of these findings for practice and theory.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66877040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Amelia S. Dev, D. Moore, Sheri L. Johnson, Karin T. Garrett
The theory of depressive realism holds that depressed individuals are less prone to optimistic bias, and are thus more realistic, in assessing their control or performance. Since the theory was proposed 40 years ago, many innovations have been validated for testing cognitive accuracy, including improved measures of bias in perceived control and performance. We incorporate several of those innovations in a well-powered, pre-registered study designed to identify depressive realism. Amazon MTurk workers (N = 246) and undergraduate students (N = 134) completed a classic contingency task, an overconfidence task, and measures of mental health constructs, including depression and anxiety. We measured perceived control throughout the contingency task, allowing us to compare control estimates at the trial-level to estimates assessed at task conclusion. We found no evidence that depressive symptoms relate to illusory control or to overconfidence. Our results suggest that despite its popular acceptance, depressive realism is not replicable.
{"title":"Sadder ≠ Wiser: Depressive Realism Is Not Robust to Replication","authors":"Amelia S. Dev, D. Moore, Sheri L. Johnson, Karin T. Garrett","doi":"10.1525/collabra.38529","DOIUrl":"https://doi.org/10.1525/collabra.38529","url":null,"abstract":"The theory of depressive realism holds that depressed individuals are less prone to optimistic bias, and are thus more realistic, in assessing their control or performance. Since the theory was proposed 40 years ago, many innovations have been validated for testing cognitive accuracy, including improved measures of bias in perceived control and performance. We incorporate several of those innovations in a well-powered, pre-registered study designed to identify depressive realism. Amazon MTurk workers (N = 246) and undergraduate students (N = 134) completed a classic contingency task, an overconfidence task, and measures of mental health constructs, including depression and anxiety. We measured perceived control throughout the contingency task, allowing us to compare control estimates at the trial-level to estimates assessed at task conclusion. We found no evidence that depressive symptoms relate to illusory control or to overconfidence. Our results suggest that despite its popular acceptance, depressive realism is not replicable.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66878985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sarah Schneider, T. Lösch, Danielle I. Schneider, A. Schütz
During adolescence, what is more important for educational achievement, well-being, and the formation of positive social relationships: being competent, having positive thoughts about oneself, or a complex relationship between the two? There has been a long-standing debate in psychology on the effects of accurate and biased self-perceptions, and sophisticated ways of modeling the effects of self-perception, competence, and their interplay have recently been suggested. But recent research has focused on adults and has not taken reference effects into account. The present preregistered study used a large German sample of students (N = 6,086 students in 559 classes) in Grade 5 (mean age = 10.55 years, SD = 0.64) with data from the National Educational Panel Study (NEPS). We tested the effects of academic self-concept and competence in math and reading on outcomes pertaining to achievement, well-being, and social relationships up to 4 years later and identified the best fitting hypotheses through a model fit comparison. In contrast to previous studies, we took the frame of reference for students’ self-concept into account by controlling for class-level effects of self-concept and competence in a multilevel analysis. Results showed that educational achievement was best explained by the complex interplay of self-concept and competence, where competence was the stronger predictor. By contrast, self-concept was a stronger predictor of well-being than competence was. For social relationships, results were less clear and differed by the specific outcome variables that were used. Overall, in the school context, self-concept and competence per se seem to be more predictive of future outcomes than their fit or misfit.
{"title":"How Self-Concept, Competence, and Their Fit or Misfit Predict Educational Achievement, Well-Being, and Social Relationships in the School Context","authors":"Sarah Schneider, T. Lösch, Danielle I. Schneider, A. Schütz","doi":"10.1525/collabra.37154","DOIUrl":"https://doi.org/10.1525/collabra.37154","url":null,"abstract":"During adolescence, what is more important for educational achievement, well-being, and the formation of positive social relationships: being competent, having positive thoughts about oneself, or a complex relationship between the two? There has been a long-standing debate in psychology on the effects of accurate and biased self-perceptions, and sophisticated ways of modeling the effects of self-perception, competence, and their interplay have recently been suggested. But recent research has focused on adults and has not taken reference effects into account. The present preregistered study used a large German sample of students (N = 6,086 students in 559 classes) in Grade 5 (mean age = 10.55 years, SD = 0.64) with data from the National Educational Panel Study (NEPS). We tested the effects of academic self-concept and competence in math and reading on outcomes pertaining to achievement, well-being, and social relationships up to 4 years later and identified the best fitting hypotheses through a model fit comparison. In contrast to previous studies, we took the frame of reference for students’ self-concept into account by controlling for class-level effects of self-concept and competence in a multilevel analysis. Results showed that educational achievement was best explained by the complex interplay of self-concept and competence, where competence was the stronger predictor. By contrast, self-concept was a stronger predictor of well-being than competence was. For social relationships, results were less clear and differed by the specific outcome variables that were used. Overall, in the school context, self-concept and competence per se seem to be more predictive of future outcomes than their fit or misfit.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66879021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Do individual differences in attention to one’s own emotion relate to the way individuals interpret emotion in other people? For example, although the accuracy has been debated, people’s facial expressions are often perceived as providing information about their emotional state. Previous research on individual differences in attention to emotion has mostly looked at how individuals categorize the emotions they believe other people to have or to the extent to which individuals have dysregulated attention to emotional information. However, less is known about other facets of emotional interpretation such as perceptions of emotional intensity and genuineness. One hypothesis, suggested by previous literature on categorization, is that higher attention to one’s own emotion may result in greater differentiation of the cues perceived to relate to emotional intensity and genuineness. On the other hand, previous research on dysregulated attention to emotion suggests a second possibility: higher attention to emotion might instead result in heightened weighting of facial expressions which tend to be perceived to indicate emotional intensity and genuineness. Across two studies, participants rated their perception of emotional intensity in facial expressions and their perception of genuineness in Duchenne and non-Duchenne smiles. Contrary to both hypotheses, attention to emotion did not significantly relate to perceived emotional intensity or genuineness (Study 1). Furthermore, whereas an exploratory test suggested a significant relation between attention to emotion and the average perceived intensity of different emotion categories (Study 1), the relation was not significant in a conceptual replication study (Study 2). The current research highlights the possibility that future research may benefit from explorations of an expanded range of biased perceptions of facial expressions in relation to individual differences in attention to emotion.
{"title":"Does Attention to One’s Own Emotion Relate to the Emotional Interpretation of Other People’s Faces?","authors":"S. Munin, Jennifer S. Beer","doi":"10.1525/collabra.34565","DOIUrl":"https://doi.org/10.1525/collabra.34565","url":null,"abstract":"Do individual differences in attention to one’s own emotion relate to the way individuals interpret emotion in other people? For example, although the accuracy has been debated, people’s facial expressions are often perceived as providing information about their emotional state. Previous research on individual differences in attention to emotion has mostly looked at how individuals categorize the emotions they believe other people to have or to the extent to which individuals have dysregulated attention to emotional information. However, less is known about other facets of emotional interpretation such as perceptions of emotional intensity and genuineness. One hypothesis, suggested by previous literature on categorization, is that higher attention to one’s own emotion may result in greater differentiation of the cues perceived to relate to emotional intensity and genuineness. On the other hand, previous research on dysregulated attention to emotion suggests a second possibility: higher attention to emotion might instead result in heightened weighting of facial expressions which tend to be perceived to indicate emotional intensity and genuineness. Across two studies, participants rated their perception of emotional intensity in facial expressions and their perception of genuineness in Duchenne and non-Duchenne smiles. Contrary to both hypotheses, attention to emotion did not significantly relate to perceived emotional intensity or genuineness (Study 1). Furthermore, whereas an exploratory test suggested a significant relation between attention to emotion and the average perceived intensity of different emotion categories (Study 1), the relation was not significant in a conceptual replication study (Study 2). The current research highlights the possibility that future research may benefit from explorations of an expanded range of biased perceptions of facial expressions in relation to individual differences in attention to emotion.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66877959","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Antonio Iudici, Chiara Verzelloni, D. Bonato, Jessica Neri, E. Faccio
The current literature on the geriatric population highlights that relocation into a healthcare facility is a crucial event in the existence of many older people and their families. Guilt, difficulties, concern and restlessness may characterise this transition and even accelerate the ageing process in some. However, the manner in which the decision to relocate is made and communicated has not been well investigated. The following study aims to explore how older residents experience the transition into a care home as well as how they experience their relationship with it and its clinicians, and what processes may determine their own sense of autonomy. The researchers used a qualitative method and conducted semi-structured interviews. Critical discourse analysis (CDA) was chosen as the tool for data analysis. Results showed that relocation into care homes is described as a passive and influenced choice. Further, the facility is described as a place that provides essential services to older people but also as a place where it is possible to maintain personalised relationships. Finally, the study discusses the implications of older people’s mental representations not only on their lives but also on how their relatives, clinicians and society perceive them. This also extends to the implications on how services are organised and implemented.
{"title":"Relocation Into Italian Residential Care Homes: A Qualitative Analysis of Decision and Choice: Psychological Implications and Consideration on Health","authors":"Antonio Iudici, Chiara Verzelloni, D. Bonato, Jessica Neri, E. Faccio","doi":"10.1525/collabra.31755","DOIUrl":"https://doi.org/10.1525/collabra.31755","url":null,"abstract":"The current literature on the geriatric population highlights that relocation into a healthcare facility is a crucial event in the existence of many older people and their families. Guilt, difficulties, concern and restlessness may characterise this transition and even accelerate the ageing process in some. However, the manner in which the decision to relocate is made and communicated has not been well investigated. The following study aims to explore how older residents experience the transition into a care home as well as how they experience their relationship with it and its clinicians, and what processes may determine their own sense of autonomy. The researchers used a qualitative method and conducted semi-structured interviews. Critical discourse analysis (CDA) was chosen as the tool for data analysis. Results showed that relocation into care homes is described as a passive and influenced choice. Further, the facility is described as a place that provides essential services to older people but also as a place where it is possible to maintain personalised relationships. Finally, the study discusses the implications of older people’s mental representations not only on their lives but also on how their relatives, clinicians and society perceive them. This also extends to the implications on how services are organised and implemented.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66876275","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Moffatt et al. (2020) reported the results of an experiment (N = 26 in the final sample) comparing the facial electromyographic correlates of mental rumination and distraction, following an experimentally induced stressor. Based on the absence of significant difference (and BFs between 3.6 and 4.3) in the perioral muscular activity between the rumination and distraction conditions, Moffatt et al. (2020) concluded that self-reported inner experience was unrelated to peripheral muscular activity as assessed using surface electromyography. In this short commentary, we show that there is limited evidence for the main conclusion put forward by Moffatt et al. (2020), and we suggest ways forward, both from a theoretical and a methodological perspective. Complete source code, reproducible analyses, and figures are available at https://osf.io/ba3gk/.
Moffatt等人(2020)报告了一项实验的结果(最终样本中N = 26),比较了实验诱导的应激源后精神反刍和分心的面部肌电图相关性。Moffatt et al.(2020)基于反刍和分心条件下口周肌肉活动没有显著差异(BFs在3.6和4.3之间),得出结论,使用表面肌电图评估,自我报告的内心体验与周围肌肉活动无关。在这篇简短的评论中,我们表明Moffatt等人(2020)提出的主要结论证据有限,我们从理论和方法论的角度提出了前进的方向。完整的源代码,可复制的分析和图表可在https://osf.io/ba3gk/。
{"title":"Re-analysing the Data From Moffatt et al. (2020): What Can We Learn From an Under-powered Absence of Difference?","authors":"Ladislas Nalborczyk","doi":"10.1525/collabra.33059","DOIUrl":"https://doi.org/10.1525/collabra.33059","url":null,"abstract":"Moffatt et al. (2020) reported the results of an experiment (N = 26 in the final sample) comparing the facial electromyographic correlates of mental rumination and distraction, following an experimentally induced stressor. Based on the absence of significant difference (and BFs between 3.6 and 4.3) in the perioral muscular activity between the rumination and distraction conditions, Moffatt et al. (2020) concluded that self-reported inner experience was unrelated to peripheral muscular activity as assessed using surface electromyography. In this short commentary, we show that there is limited evidence for the main conclusion put forward by Moffatt et al. (2020), and we suggest ways forward, both from a theoretical and a methodological perspective. Complete source code, reproducible analyses, and figures are available at https://osf.io/ba3gk/.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66876850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this pre-registered study on a representative Polish sample (n = 1751), we aimed to test two potential critical issues with the Ascent of Humans scale. First, we tested whether the scores may be influenced by peripheral and previously undiscussed properties of the measurement: position of the slider-scale dot and the pattern of groups’ display. Second, we tested whether participation in Ascent of Humans measurement may influence the attitudes towards out-groups, making participants more prejudiced. All our predictions were conclusively disconfirmed. Additionally, we explored the distribution of Ascent of Humans, discovering large inflation of scores indicating the absence of dehumanisation. We discuss implications of our findings for improving theoretical grounds of dehumanisation and its measurement.
在这项针对波兰代表性样本(n = 1751)的预注册研究中,我们旨在测试人类上升量表的两个潜在关键问题。首先,我们测试了分数是否会受到外围和先前未讨论的测量属性的影响:滑块刻度点的位置和组的显示模式。其次,我们测试了参与人类的上升测量是否会影响对外群体的态度,使参与者更有偏见。我们所有的预测都被彻底否定了。此外,我们还探索了《Ascent of Humans》的分布,发现分数的大幅膨胀表明游戏中没有去人性化。我们讨论了我们的研究结果对改善非人化及其测量的理论基础的影响。
{"title":"Ascent of Humans: Investigating Methodological and Ethical Concerns About the Measurement","authors":"Kamil Izydorczak, T. Grzyb, D. Doliński","doi":"10.1525/collabra.33297","DOIUrl":"https://doi.org/10.1525/collabra.33297","url":null,"abstract":"In this pre-registered study on a representative Polish sample (n = 1751), we aimed to test two potential critical issues with the Ascent of Humans scale. First, we tested whether the scores may be influenced by peripheral and previously undiscussed properties of the measurement: position of the slider-scale dot and the pattern of groups’ display. Second, we tested whether participation in Ascent of Humans measurement may influence the attitudes towards out-groups, making participants more prejudiced. All our predictions were conclusively disconfirmed. Additionally, we explored the distribution of Ascent of Humans, discovering large inflation of scores indicating the absence of dehumanisation. We discuss implications of our findings for improving theoretical grounds of dehumanisation and its measurement.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66877230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The replication crisis has shown that research in psychology and other fields including biology is not as robust as previously thought. In response, methods have been introduced to address the problem and increase reproducibility, including two methods that are the focus here: (1) preregistration of study hypotheses and methods, and (2) analysis of whether p-hacking may have occurred through patterns of p-values. Each is easy to find, even in short summaries of research, but do consumers of research recognize these indicators as evidence of trustworthiness? In the current study, we examined how professionals (n = 111), researchers (n = 74) and undergraduate students (n = 78) judged the trustworthiness of short descriptions of research in their field, which varied in terms of whether there was a reference to a preregistration or evidence of potential p-hacking. Overall, participants trusted studies less when they were not preregistered. Researchers and professionals, but not students were sensitive to evidence of p-hacking. We suggest that education about questionable research practices like p-hacking and hypothesizing after the results are known needs to be improved.
{"title":"The Effect of Preregistration and P-Value Patterns on Trust in Psychology and Biology Research","authors":"Clare Conry-Murray, Annie McConnon, M. Bower","doi":"10.1525/collabra.36306","DOIUrl":"https://doi.org/10.1525/collabra.36306","url":null,"abstract":"The replication crisis has shown that research in psychology and other fields including biology is not as robust as previously thought. In response, methods have been introduced to address the problem and increase reproducibility, including two methods that are the focus here: (1) preregistration of study hypotheses and methods, and (2) analysis of whether p-hacking may have occurred through patterns of p-values. Each is easy to find, even in short summaries of research, but do consumers of research recognize these indicators as evidence of trustworthiness? In the current study, we examined how professionals (n = 111), researchers (n = 74) and undergraduate students (n = 78) judged the trustworthiness of short descriptions of research in their field, which varied in terms of whether there was a reference to a preregistration or evidence of potential p-hacking. Overall, participants trusted studies less when they were not preregistered. Researchers and professionals, but not students were sensitive to evidence of p-hacking. We suggest that education about questionable research practices like p-hacking and hypothesizing after the results are known needs to be improved.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66878330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Caroline Zygar-Hoffmann, Lara Cristoforo, L. Wolf, Felix D. Schönbrodt
Relationship closeness is considered an important psychological variable for studying couple relationships, and is often postulated as cause for important relationship outcomes. The current study evaluates four micro-interventions for their suitability to experimentally elicit feelings of closeness towards one’s partner. Using participants’ smartphones, and a combination of experience sampling, event sampling, and ecological momentary interventions, individuals reported for a week on their experiences of closeness before and after completing daily either a neutral task or a task meant to enhance relationship closeness. The closeness tasks included showing physical affection, sharing a childhood memory, looking each other in the eyes for five minutes, and discussing shared life achievements. Results of intention-to-treat analyses on a within-person level showed that closeness increased from pre- to post-measurement on average more strongly on days of any of the four examined closeness conditions than on days of the neutral control conditions. Interindividual variability of this effect was observed, emphasizing the relevance of using within-person designs to evaluate such interventions. Exploratory analyses showed that effect sizes declined across time within the day. This study provides instruments for research on causal effects of closeness in everyday relationship life, and an evidence basis for smartphone-delivered interventions in practitioner settings.
{"title":"Eliciting Short-Term Closeness in Couple Relationships With Ecological Momentary Interventions","authors":"Caroline Zygar-Hoffmann, Lara Cristoforo, L. Wolf, Felix D. Schönbrodt","doi":"10.1525/collabra.38599","DOIUrl":"https://doi.org/10.1525/collabra.38599","url":null,"abstract":"Relationship closeness is considered an important psychological variable for studying couple relationships, and is often postulated as cause for important relationship outcomes. The current study evaluates four micro-interventions for their suitability to experimentally elicit feelings of closeness towards one’s partner. Using participants’ smartphones, and a combination of experience sampling, event sampling, and ecological momentary interventions, individuals reported for a week on their experiences of closeness before and after completing daily either a neutral task or a task meant to enhance relationship closeness. The closeness tasks included showing physical affection, sharing a childhood memory, looking each other in the eyes for five minutes, and discussing shared life achievements. Results of intention-to-treat analyses on a within-person level showed that closeness increased from pre- to post-measurement on average more strongly on days of any of the four examined closeness conditions than on days of the neutral control conditions. Interindividual variability of this effect was observed, emphasizing the relevance of using within-person designs to evaluate such interventions. Exploratory analyses showed that effect sizes declined across time within the day. This study provides instruments for research on causal effects of closeness in everyday relationship life, and an evidence basis for smartphone-delivered interventions in practitioner settings.","PeriodicalId":45791,"journal":{"name":"Collabra-Psychology","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"66878552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}