Patterns and Pitfalls of Short-cuts Used in Environmental Management Rapid Reviews

Abstract

Environmental managers and policy-makers need reliable evidence to make effective decisions. Systematic reviews are one way to provide this information but are time-consuming and may not meet the needs of decision-makers when faced with rapidly changing management requirements or transient policy-windows. Rapid reviews are one type of knowledge synthesis that follow simplified or truncated methods compared to systematic reviews. Rapid reviews on environmentally-relevant topics are growing in prevalence, but it is unclear if rapid reviews use similar short-cuts or follow available guidelines. In this methodological review, we assess 26 rapid reviews published between 2002 and 2023. Numerous rapid review short-cuts and approaches were identified, with few consistencies among studies. Short-cuts were present in all stages of the review process, with some of the most common short-cuts including not developing an a priori review protocol, not including stakeholder involvement, or not conducting critical appraisal of study validity. Poor quality in reporting of methods was observed. Fewer than half of assessed rapid reviews reported using available guidelines when developing their methods. Future rapid reviews should aim for improved reporting and adherence to published guidelines to help increase the useability and evidence-user confidence. This will also enable readers to understand where short-cuts were made and their potential consequences for the conclusions of the review.