Pub Date : 2024-11-12DOI: 10.1007/s11292-024-09648-3
Liliana Ribeiro, Inês Sousa Guedes, Carla Sofia Cardoso
Objective
This study aims to explore susceptibility to phishing emails by analysing the visual patterns of individuals.
Method
A quasi-experimental study was developed, using 28 emails (13 phishing; 13 legitimate; 2 control) which were subdivided into two groups (G1; G2) and presented to the participants who looked at a set of 15 emails. The sample consisted of 70 participants.
Results
Phishing emails showed significantly higher average fixation times and total fixations in the sender’s area compared to legitimate emails. However, no significant correlations were found between fixation time, total number of fixations in various areas of the email, and the accuracy of email identification (both general and phishing).
Conclusion
This pioneering study within the Portuguese context lays the foundation for future research on analysing and accurately detecting different types of emails, including differentiating between them. It also supports the development of targeted training to improve the recognition of various emails cues.
{"title":"Eyes on phishing emails: an eye-tracking study","authors":"Liliana Ribeiro, Inês Sousa Guedes, Carla Sofia Cardoso","doi":"10.1007/s11292-024-09648-3","DOIUrl":"https://doi.org/10.1007/s11292-024-09648-3","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objective</h3><p>This study aims to explore susceptibility to phishing emails by analysing the visual patterns of individuals.</p><h3 data-test=\"abstract-sub-heading\">Method</h3><p>A quasi-experimental study was developed, using 28 emails (13 phishing; 13 legitimate; 2 control) which were subdivided into two groups (G1; G2) and presented to the participants who looked at a set of 15 emails. The sample consisted of 70 participants.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>Phishing emails showed significantly higher average fixation times and total fixations in the sender’s area compared to legitimate emails. However, no significant correlations were found between fixation time, total number of fixations in various areas of the email, and the accuracy of email identification (both general and phishing).</p><h3 data-test=\"abstract-sub-heading\">Conclusion</h3><p>This pioneering study within the Portuguese context lays the foundation for future research on analysing and accurately detecting different types of emails, including differentiating between them<i>. </i>It also supports the development of targeted training to improve the recognition of various emails cues<i>.</i></p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"19 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142599295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-09DOI: 10.1007/s11292-024-09646-5
Christopher M. Campbell, Ryan M. Labrecque, Alicia d. McKay
Objectives
This systematic review examined the reporting practices of propensity score modeling (PSM) in criminology and criminal justice studies.
Methods
There were 229 articles (with 527 individual sets of PSM analyses) published between 2000 and 2022 in the top 19 ranked criminology and criminal justice journals that were identified for study inclusion. These articles were systematically coded to assess the presence of key PSM reporting elements, including covariates, estimation methods, balancing strategy, matching type, sample size, balance assessment, sensitivity analysis, and post-PSM analyses.
Results
The use of PSM has increased dramatically over the last two decades. Study findings suggest that while there are many areas where the discipline has improved reporting over the last 22 years, there are still others that are sorely lacking. Our review reveals that only 28.9% of studies reported the propensity score technique used, 21.8% did not report pre- or post-PSM sample information, and 26.6% of all studies examined either did not report a balance assessment or reported using only one assessment which were largely null hypothesis significance testing.
Conclusions
Our findings provide a baseline assessment of PSM reporting and provide some guidance for conducting, reviewing, and publishing PSM research in criminology and criminal justice journals.
{"title":"Higher expectations: a systematic review of reporting the science of propensity score modeling in criminal justice studies","authors":"Christopher M. Campbell, Ryan M. Labrecque, Alicia d. McKay","doi":"10.1007/s11292-024-09646-5","DOIUrl":"https://doi.org/10.1007/s11292-024-09646-5","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objectives</h3><p>This systematic review examined the reporting practices of propensity score modeling (PSM) in criminology and criminal justice studies.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>There were 229 articles (with 527 individual sets of PSM analyses) published between 2000 and 2022 in the top 19 ranked criminology and criminal justice journals that were identified for study inclusion. These articles were systematically coded to assess the presence of key PSM reporting elements, including covariates, estimation methods, balancing strategy, matching type, sample size, balance assessment, sensitivity analysis, and post-PSM analyses.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>The use of PSM has increased dramatically over the last two decades. Study findings suggest that while there are many areas where the discipline has improved reporting over the last 22 years, there are still others that are sorely lacking. Our review reveals that only 28.9% of studies reported the propensity score technique used, 21.8% did not report pre- or post-PSM sample information, and 26.6% of all studies examined either did not report a balance assessment or reported using only one assessment which were largely null hypothesis significance testing.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Our findings provide a baseline assessment of PSM reporting and provide some guidance for conducting, reviewing, and publishing PSM research in criminology and criminal justice journals.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"26 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142598024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-06DOI: 10.1007/s11292-024-09647-4
Gordon Abner, Yi Wang, Eloy Oliveira
Objective
The objective of this study is to conduct the first peer-reviewed meta-analysis of the predictors of job satisfaction among law enforcement. We draw upon self-determination theory (SDT) to guide our selection of six antecedents to include in our analysis.
Methods
We utilize Schmidt and Hunter’s (2015) meta-analytic methods of correcting correlations individually for artifacts. We also employ meta-analytic sub-group comparison methods as part of a moderator analysis.
Results
The results in order from the smallest to the largest effect size are cynicism towards the public ρ = -.34, job autonomy ρ = .41, supervisor support ρ = .43, co-worker support ρ = .53, opportunities for professional development ρ = .58, and training ρ = .59. Regarding the subgroup analyses, the effect sizes for supervisor support were significantly weaker in individualistic countries than in collectivistic countries, and the effect size for autonomy was significantly stronger in individualistic countries than in collectivistic countries.
Conclusions
Our findings support the utility of SDT in explaining job satisfaction among law enforcement. While SDT has broad applications, the relative impact of each dimension of SDT on job satisfaction varies meaningfully across cultures.
{"title":"Unpacking job satisfaction among law enforcement through self-determination theory: a meta-analytic approach","authors":"Gordon Abner, Yi Wang, Eloy Oliveira","doi":"10.1007/s11292-024-09647-4","DOIUrl":"https://doi.org/10.1007/s11292-024-09647-4","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objective</h3><p>The objective of this study is to conduct the first peer-reviewed meta-analysis of the predictors of job satisfaction among law enforcement. We draw upon self-determination theory (SDT) to guide our selection of six antecedents to include in our analysis.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>We utilize Schmidt and Hunter’s (2015) meta-analytic methods of correcting correlations individually for artifacts. We also employ meta-analytic sub-group comparison methods as part of a moderator analysis.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>The results in order from the smallest to the largest effect size are cynicism towards the public ρ = -.34, job autonomy ρ = .41, supervisor support ρ = .43, co-worker support ρ = .53, opportunities for professional development ρ = .58, and training ρ = .59. Regarding the subgroup analyses, the effect sizes for supervisor support were significantly weaker in individualistic countries than in collectivistic countries, and the effect size for autonomy was significantly stronger in individualistic countries than in collectivistic countries.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Our findings support the utility of SDT in explaining job satisfaction among law enforcement. While SDT has broad applications, the relative impact of each dimension of SDT on job satisfaction varies meaningfully across cultures.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"16 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142588692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-01DOI: 10.1007/s11292-024-09643-8
Lee R. J. Hughes, Jacob G. Sorbello, Kurt Piron, Corey Allen, Timothy Piatkowski, Grant J. Devilly
Background
We sought to determine whether various ion scanner devices could provide a practical alternative in field-based research, where affordable and accessible drug screening is needed for comprehensive and ongoing investigation.
Methods
In Study 1, off-site sample analysis proved inconclusive, rendering Protocols A and B impractical for ongoing drug screening. Conversely, Study 2’s on-site, real-time analysis (Protocol C) emerged as a more effective method. The Itemizer3, particularly in Protocol C, excelled in discerning drug users. Comparing admitted drug use rates in both studies, the mere presence of an objective measure, confirmational or not, likely facilitated more truthful participant responses, highlighting the efficacy of real-time, on-site drug screening using IMS/ITMS technologies.
Findings
All samples analyzed off-site in Study 1 were found to be inconclusive. As such, Protocols A and B were not feasible for on-going drug screening and monitoring. Conversely, the results of Study 2 Protocol C demonstrated that harvesting samples directly off participants on-site and analyzing these in-real time to be a more efficacious method. Our findings in Protocol C also show that the Itemizer3 was better at identifying those who did not use drugs from those who did. Looking at the incidence rates of admitted drug use in Studies 1 and 2, we find that simply having an objective measure present (irrespective of whether it is confirmational or not) likely resulted in us obtaining more truthful responses from participants about their use of drugs.
Conclusions
Our results underscore IMS/ITMS practicality for on-site NED drug screening.
背景我们试图确定各种离子扫描仪是否能为现场研究提供一种实用的替代方法,因为现场研究需要经济实惠、方便使用的药物筛查来进行全面和持续的调查。方法在研究 1 中,非现场样本分析被证明是不确定的,因此方案 A 和 B 对于持续的药物筛查是不切实际的。相反,研究 2 的现场实时分析(方案 C)则是一种更有效的方法。Itemizer3,尤其是在 C 方案中,在识别吸毒者方面表现出色。比较这两项研究中被承认的吸毒率,无论是否确证,只要有客观的测量方法,就有可能促进被试做出更真实的回答,这凸显了使用 IMS/ITMS 技术进行实时现场毒品筛查的功效。因此,方案 A 和 B 不适合用于持续的药物筛查和监测。相反,研究 2 方案 C 的结果表明,直接从参与者身上采集现场样本并进行实时分析是一种更有效的方法。我们在 C 方案中的研究结果还表明,Itemizer3 能更好地从吸毒者中识别出未吸毒者。从研究 1 和研究 2 中承认的吸毒发生率来看,我们发现,只要有一个客观的测量方法(无论其是否具有确认性),我们就能从参与者那里获得更真实的吸毒情况。
{"title":"Examining the use of drug screening technologies in night-time entertainment districts","authors":"Lee R. J. Hughes, Jacob G. Sorbello, Kurt Piron, Corey Allen, Timothy Piatkowski, Grant J. Devilly","doi":"10.1007/s11292-024-09643-8","DOIUrl":"https://doi.org/10.1007/s11292-024-09643-8","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Background</h3><p>We sought to determine whether various ion scanner devices could provide a practical alternative in field-based research, where affordable and accessible drug screening is needed for comprehensive and ongoing investigation.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>In Study 1, off-site sample analysis proved inconclusive, rendering Protocols A and B impractical for ongoing drug screening. Conversely, Study 2’s on-site, real-time analysis (Protocol C) emerged as a more effective method. The Itemizer3, particularly in Protocol C, excelled in discerning drug users. Comparing admitted drug use rates in both studies, the mere presence of an objective measure, confirmational or not, likely facilitated more truthful participant responses, highlighting the efficacy of real-time, on-site drug screening using IMS/ITMS technologies.</p><h3 data-test=\"abstract-sub-heading\">Findings</h3><p>All samples analyzed off-site in Study 1 were found to be inconclusive. As such, Protocols A and B were not feasible for on-going drug screening and monitoring. Conversely, the results of Study 2 Protocol C demonstrated that harvesting samples directly off participants on-site and analyzing these in-real time to be a more efficacious method. Our findings in Protocol C also show that the Itemizer3 was better at identifying those who did not use drugs from those who did. Looking at the incidence rates of admitted drug use in Studies 1 and 2, we find that simply having an objective measure present (irrespective of whether it is confirmational or not) likely resulted in us obtaining more truthful responses from participants about their use of drugs.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Our results underscore IMS/ITMS practicality for on-site NED drug screening.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"10 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142562056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-18DOI: 10.1007/s11292-024-09645-6
Jean-Louis van Gelder, Timothy C. Barnum, Shaina Herman, Peter Wozniak
Objective
This Research Note describes the MAXLab Aggression and Bystander Intervention Scenario Set (MAXLab_ABISS) and provides empirical examples of its applicability. We describe the scenarios, elaborate on the production process, provide technical specifications, and explain how materials can be obtained.
Method
This modular stimulus set, which is currently available in the English, German and Dutch language, includes 360° videos for studying decision-making in interpersonal violence. It offers researchers a complimentary method to collect data on emotions, perceptions, and reactions to violent situations using immersive technology.
Results
Analysis from two samples (n = 101 and n = 55) show the immersive scenarios of the stimulus set are effective at evoking targeted emotional experiences at the moment of a crime decision.
Conclusion
MAXLab_ABISS is a safe and effective tool for studying decision making in real-life, emotion-laden criminogenic settings. We offer insights for how researchers can further use the materials to study decision making related to crime and violence.
{"title":"The MAXLab aggression and bystander intervention scenario set (MAXLab_ABISS): A modular scenario set for studying decision making in situations of interpersonal violence in virtual reality","authors":"Jean-Louis van Gelder, Timothy C. Barnum, Shaina Herman, Peter Wozniak","doi":"10.1007/s11292-024-09645-6","DOIUrl":"https://doi.org/10.1007/s11292-024-09645-6","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objective</h3><p>This Research Note describes the MAXLab Aggression and Bystander Intervention Scenario Set (MAXLab_ABISS) and provides empirical examples of its applicability. We describe the scenarios, elaborate on the production process, provide technical specifications, and explain how materials can be obtained.</p><h3 data-test=\"abstract-sub-heading\">Method</h3><p>This modular stimulus set, which is currently available in the English, German and Dutch language, includes 360° videos for studying decision-making in interpersonal violence. It offers researchers a complimentary method to collect data on emotions, perceptions, and reactions to violent situations using immersive technology.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>Analysis from two samples (n = 101 and n = 55) show the immersive scenarios of the stimulus set are effective at evoking targeted emotional experiences at the moment of a crime decision.</p><h3 data-test=\"abstract-sub-heading\">Conclusion</h3><p>MAXLab_ABISS is a safe and effective tool for studying decision making in real-life, emotion-laden criminogenic settings. We offer insights for how researchers can further use the materials to study decision making related to crime and violence.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"98 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142448200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-02DOI: 10.1007/s11292-024-09644-7
Ian T. Adams, Matt Barter, Kyle McLean, Hunter M. Boehme, Irick A. Geary
Objectives
This study examines the potential of artificial intelligence (AI) to reduce the time police officers spend writing reports, a task that consumes a significant portion of their workday.
Methods
In a pre-registered randomized controlled trial, we test this claim within the patrol division of a medium-sized police department (n = 85) at the individual report level (n = 755). Analyses utilize mixed-effects regression accounting for the nested structure of report-writing.
Results
AI assistance did not significantly affect the duration of writing police reports. Alternative specifications beyond those specified in the pre-registration, including a difference-in-differences approach observing report duration over a full year (n = 6084), confirm the null findings are robust.
Conclusions
Our findings contradict marketing expectations for the effect of this technology, suggesting no time savings in report-writing can be expected when using AI-assisted report-writing. Several other potential effects remain possible and untested.
{"title":"No man’s hand: artificial intelligence does not improve police report writing speed","authors":"Ian T. Adams, Matt Barter, Kyle McLean, Hunter M. Boehme, Irick A. Geary","doi":"10.1007/s11292-024-09644-7","DOIUrl":"https://doi.org/10.1007/s11292-024-09644-7","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objectives</h3><p>This study examines the potential of artificial intelligence (AI) to reduce the time police officers spend writing reports, a task that consumes a significant portion of their workday.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>In a pre-registered randomized controlled trial, we test this claim within the patrol division of a medium-sized police department (<i>n</i> = 85) at the individual report level (<i>n</i> = 755). Analyses utilize mixed-effects regression accounting for the nested structure of report-writing.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>AI assistance did not significantly affect the duration of writing police reports. Alternative specifications beyond those specified in the pre-registration, including a difference-in-differences approach observing report duration over a full year (<i>n</i> = 6084), confirm the null findings are robust.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Our findings contradict marketing expectations for the effect of this technology, suggesting no time savings in report-writing can be expected when using AI-assisted report-writing. Several other potential effects remain possible and untested.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"12 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142384901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-16DOI: 10.1007/s11292-024-09639-4
Bitna Kim, Matthew A. Bills, Meghan Royle
Objectives
This study aims to identify effective strategies for disseminating scholarly evidence to corrections practitioners within the framework of translational criminology.
Methods
In this experimental study, corrections practitioners were randomly assigned to receive weekly executive summaries, full-text articles, or corrections news for five months. Data were collected through a pre-survey, a 2-month midpoint survey, and a post-survey to evaluate engagement and knowledge uptake.
Results
Participants receiving executive summaries showed the highest engagement but did not demonstrate enhanced comprehension compared to those receiving corrections news, who exhibited higher comprehension. Those accessing full-text articles reported the least comprehension and lower engagement, despite finding the information highly useful.
Conclusions
Given the mixed effectiveness of executive summaries and full-text articles, future research should develop tailored dissemination strategies to better meet the needs of corrections practitioners. The study highlights the critical roles of partnerships and pracademics in translating complex research for practical application.
{"title":"Knowledge dissemination in translational criminology: a case study in corrections","authors":"Bitna Kim, Matthew A. Bills, Meghan Royle","doi":"10.1007/s11292-024-09639-4","DOIUrl":"https://doi.org/10.1007/s11292-024-09639-4","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objectives</h3><p>This study aims to identify effective strategies for disseminating scholarly evidence to corrections practitioners within the framework of translational criminology.</p><h3 data-test=\"abstract-sub-heading\">Methods</h3><p>In this experimental study, corrections practitioners were randomly assigned to receive weekly executive summaries, full-text articles, or corrections news for five months. Data were collected through a pre-survey, a 2-month midpoint survey, and a post-survey to evaluate engagement and knowledge uptake.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>Participants receiving executive summaries showed the highest engagement but did not demonstrate enhanced comprehension compared to those receiving corrections news, who exhibited higher comprehension. Those accessing full-text articles reported the least comprehension and lower engagement, despite finding the information highly useful.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Given the mixed effectiveness of executive summaries and full-text articles, future research should develop tailored dissemination strategies to better meet the needs of corrections practitioners. The study highlights the critical roles of partnerships and pracademics in translating complex research for practical application.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"23 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142235326","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-16DOI: 10.1007/s11292-024-09641-w
Tammy Wong, Muhammad A. Rishi
The purpose of this response essay is to commend the authors of the article, “Evaluating the effectiveness of a fatigue training intervention for the Seattle Police Department” for calling attention to the issue of fatigue and addressing its negative impact on health and safety. We highlight the demanding role of police officers and how fatigue can have significant consequences. We also discuss how the American Academy of Sleep Medicine (AASM) is committed to calling attention to the importance of sufficient sleep, and review how effectively the online training course tackled the issue. The positive results from the online training program align well with the AASM’s priority of addressing and improving sleep health. The AASM finds the published trial to be groundbreaking work and agree that its cost-effective, low-burden strategy for combating fatigue can be a potential model for significantly improving sleep, mental health, and safe driving in police officers.
{"title":"A Commentary on James et al.: One promising model for fatigue mitigation and prevention","authors":"Tammy Wong, Muhammad A. Rishi","doi":"10.1007/s11292-024-09641-w","DOIUrl":"https://doi.org/10.1007/s11292-024-09641-w","url":null,"abstract":"<p>The purpose of this response essay is to commend the authors of the article, “Evaluating the effectiveness of a fatigue training intervention for the Seattle Police Department” for calling attention to the issue of fatigue and addressing its negative impact on health and safety. We highlight the demanding role of police officers and how fatigue can have significant consequences. We also discuss how the American Academy of Sleep Medicine (AASM) is committed to calling attention to the importance of sufficient sleep, and review how effectively the online training course tackled the issue. The positive results from the online training program align well with the AASM’s priority of addressing and improving sleep health. The AASM finds the published trial to be groundbreaking work and agree that its cost-effective, low-burden strategy for combating fatigue can be a potential model for significantly improving sleep, mental health, and safe driving in police officers.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"9 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142235324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-12DOI: 10.1007/s11292-024-09636-7
Brandon del Pozo, Steven Belenko, Faye S. Taxman, Robin S. Engel, Jerry Ratcliffe, Ian Adams, Alex R. Piquero
In “Cause, Effect, and the Structure of the Social World” (2023), Megan Stevenson makes a claim that randomized controlled trials (RCTs) have not had a significant effect in criminal justice settings. She then draws the conclusion that the gold standard for research designs, RCTs, are inherently incapable of doing so, demonstrating that the social world they intervene on is too complex, but also too resilient, to respond to the types of interventions that are evaluable by RCT. She calls the insistence that RCTs can work an “engineer’s” view of the world, which she discards as a myth. The argument then conflates RCTs with other methods of generating and sustaining change in organizations and systems, and closes suggesting RCTs should be discarded for less rigorous but more sweeping means of social reform. This article proceeds as follows: It characterizes Stevenson’s argument, which she asserts is empirical, as a de facto meta-analysis of criminal justice RCTs executed as a heuristic and presented in a narrative format. It argues that if a formal meta-analysis would be rendered invalid by violating established protocols, then a heuristic analysis that commits the same errors would be invalid as well. The analysis then presents the prohibitions on pooling studies with heterogeneous designs, interventions, outcomes, and metrics for the purpose of meta-analysis. It demonstrates that Stevenson pools a wide range of heterogenous studies, rendering her empirical meta-analytic claims problematic. It is true that many criminal justice RCTs have produced null or lackluster results—which also constitute an important outcome—and attempts to replicate significant findings have often been unsuccessful. This is not unique to criminal justice: psychology was recently in crisis when it was determined few of its most prominent studies could be replicated. However, less rigorous methods of reform do not solve this problem. Instead, more comprehensive research designs such as hybrid implementation/effectiveness trials can reveal aspects of our social world that impact external validity and generalizability. Findings from these studies can help illuminate the conditions that impact outcomes and sustainably modify highly resilient human behaviors. These methods arise from techniques in medicine and public health, which Stevenson brackets off as fundamentally different from criminal justice. This type of thinking may be the actual myth that prevents progress.
{"title":"Then a miracle occurs: cause, effect, and the heterogeneity of criminal justice research","authors":"Brandon del Pozo, Steven Belenko, Faye S. Taxman, Robin S. Engel, Jerry Ratcliffe, Ian Adams, Alex R. Piquero","doi":"10.1007/s11292-024-09636-7","DOIUrl":"https://doi.org/10.1007/s11292-024-09636-7","url":null,"abstract":"<p>In “Cause, Effect, and the Structure of the Social World” (2023), Megan Stevenson makes a claim that randomized controlled trials (RCTs) have not had a significant effect in criminal justice settings. She then draws the conclusion that the gold standard for research designs, RCTs, are inherently incapable of doing so, demonstrating that the social world they intervene on is too complex, but also too resilient, to respond to the types of interventions that are evaluable by RCT. She calls the insistence that RCTs can work an “engineer’s” view of the world, which she discards as a myth. The argument then conflates RCTs with other methods of generating and sustaining change in organizations and systems, and closes suggesting RCTs should be discarded for less rigorous but more sweeping means of social reform. This article proceeds as follows: It characterizes Stevenson’s argument, which she asserts is empirical, as a de facto meta-analysis of criminal justice RCTs executed as a heuristic and presented in a narrative format. It argues that if a formal meta-analysis would be rendered invalid by violating established protocols, then a heuristic analysis that commits the same errors would be invalid as well. The analysis then presents the prohibitions on pooling studies with heterogeneous designs, interventions, outcomes, and metrics for the purpose of meta-analysis. It demonstrates that Stevenson pools a wide range of heterogenous studies, rendering her empirical meta-analytic claims problematic. It is true that many criminal justice RCTs have produced null or lackluster results—which also constitute an important outcome—and attempts to replicate significant findings have often been unsuccessful. This is not unique to criminal justice: psychology was recently in crisis when it was determined few of its most prominent studies could be replicated. However, less rigorous methods of reform do not solve this problem. Instead, more comprehensive research designs such as hybrid implementation/effectiveness trials can reveal aspects of our social world that impact external validity and generalizability. Findings from these studies can help illuminate the conditions that impact outcomes and sustainably modify highly resilient human behaviors. These methods arise from techniques in medicine and public health, which Stevenson brackets off as fundamentally different from criminal justice. This type of thinking may be the actual myth that prevents progress.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"104 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142171319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-12DOI: 10.1007/s11292-024-09640-x
Rachel Leigh Greenspan, Logan Baggett, Brian B. Boutwell
Objective
Calls for more transparent and replicable scientific practices have been increasing across scientific disciplines over the last decade, often referred to as the open science movement. Open science practices are arguably particularly important in fields like criminology and criminal justice where empirical findings aim to inform public policy and legal practice. Despite favorable views of these practices by criminal justice scholars, limited research has explored how often researchers actually use these open science practices.
Method
The current study measures the reported use of pre-registration, open access, open materials, open data, and open code in leading criminology and criminal justice journals from 2018 to 2022.
Results
Our results reveal limited use of open science practices, particularly pre-registration and open code.
Conclusions
Given these findings, we call for both journals and authors to consider adopting these practices to move toward a more transparent and replicable field.
{"title":"Open science practices in criminology and criminal justice journals","authors":"Rachel Leigh Greenspan, Logan Baggett, Brian B. Boutwell","doi":"10.1007/s11292-024-09640-x","DOIUrl":"https://doi.org/10.1007/s11292-024-09640-x","url":null,"abstract":"<h3 data-test=\"abstract-sub-heading\">Objective</h3><p>Calls for more transparent and replicable scientific practices have been increasing across scientific disciplines over the last decade, often referred to as the open science movement. Open science practices are arguably particularly important in fields like criminology and criminal justice where empirical findings aim to inform public policy and legal practice. Despite favorable views of these practices by criminal justice scholars, limited research has explored how often researchers actually use these open science practices.</p><h3 data-test=\"abstract-sub-heading\">Method</h3><p>The current study measures the reported use of pre-registration, open access, open materials, open data, and open code in leading criminology and criminal justice journals from 2018 to 2022.</p><h3 data-test=\"abstract-sub-heading\">Results</h3><p>Our results reveal limited use of open science practices, particularly pre-registration and open code.</p><h3 data-test=\"abstract-sub-heading\">Conclusions</h3><p>Given these findings, we call for both journals and authors to consider adopting these practices to move toward a more transparent and replicable field.</p>","PeriodicalId":47684,"journal":{"name":"Journal of Experimental Criminology","volume":"41 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142171318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}