Pub Date : 2024-07-17DOI: 10.1186/s41077-024-00300-8
Cristina Diaz-Navarro, Bridie Jones, Gethin Pugh, Michael Moneypenny, Marc Lazarovici, David J Grant
Simulation educators are often requested to provide multidisciplinary and/or interprofessional simulation training in response to critical incidents. Current perspectives on patient safety focus on learning from failure, success and everyday variation. An international collaboration has led to the development of an accessible and practical framework to guide the implementation of appropriate simulation-based responses to clinical events, integrating quality improvement, simulation and patient safety methodologies to design appropriate and impactful responses. In this article, we describe a novel five-step approach to planning simulation-based interventions after any events that might prompt simulation-based learning in healthcare environments. This approach guides teams to identify pertinent events in healthcare, involve relevant stakeholders, agree on appropriate change interventions, elicit how simulation can contribute to them and share the learning without aggravating the second victim phenomenon. The framework is underpinned by Deming's System of Profound Knowledge, the Model for Improvement and translational simulation. It aligns with contemporary socio-technical models in healthcare, by emphasising the role of clinical teams in designing adaptation and change for improvement, as well as encouraging collaborations to enhance patient safety in healthcare. For teams to achieve this adaptive capacity that realises organisational goals of continuous learning and improvement requires the breaking down of historical silos through the creation of an infrastructure that formalises relationships between service delivery, safety management, quality improvement and education. This creates opportunities to learn by design, rather than chance, whilst striving to close gaps between work as imagined and work as done.
{"title":"Improving quality through simulation; developing guidance to design simulation interventions following key events in healthcare.","authors":"Cristina Diaz-Navarro, Bridie Jones, Gethin Pugh, Michael Moneypenny, Marc Lazarovici, David J Grant","doi":"10.1186/s41077-024-00300-8","DOIUrl":"10.1186/s41077-024-00300-8","url":null,"abstract":"<p><p>Simulation educators are often requested to provide multidisciplinary and/or interprofessional simulation training in response to critical incidents. Current perspectives on patient safety focus on learning from failure, success and everyday variation. An international collaboration has led to the development of an accessible and practical framework to guide the implementation of appropriate simulation-based responses to clinical events, integrating quality improvement, simulation and patient safety methodologies to design appropriate and impactful responses. In this article, we describe a novel five-step approach to planning simulation-based interventions after any events that might prompt simulation-based learning in healthcare environments. This approach guides teams to identify pertinent events in healthcare, involve relevant stakeholders, agree on appropriate change interventions, elicit how simulation can contribute to them and share the learning without aggravating the second victim phenomenon. The framework is underpinned by Deming's System of Profound Knowledge, the Model for Improvement and translational simulation. It aligns with contemporary socio-technical models in healthcare, by emphasising the role of clinical teams in designing adaptation and change for improvement, as well as encouraging collaborations to enhance patient safety in healthcare. For teams to achieve this adaptive capacity that realises organisational goals of continuous learning and improvement requires the breaking down of historical silos through the creation of an infrastructure that formalises relationships between service delivery, safety management, quality improvement and education. This creates opportunities to learn by design, rather than chance, whilst striving to close gaps between work as imagined and work as done.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11253482/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141629364","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-03DOI: 10.1186/s41077-024-00295-2
Kelli Krase, Julie A Broski, Stephen Tarver, Shariska P Harrington, Amy Wolverton, Mae Winchester, German Berbel, Melody K Zakarian, Taylor Zabel, Hannah Warren, Matthew C Lineberry
Background: During a critical event in the labor and delivery operating room, it is crucial for team members responding to the situation to be aware of the designated leaders. Visual and verbal cues have been utilized to designate leadership in various healthcare settings; however, previous research has indicated mixed results using visual cues for role designation.
Methods: The purpose of this study was to explore the use of the red surgical hat as a visual cue of leadership during obstetric emergency simulation training. We used a mixed-methods design to analyze simulation-based education video and debriefing transcripts.
Results: There was a statistically significant difference in the proportion of participants who declared leadership vs. those who donned the red hat. Participants were more likely to visually declare leadership utilizing a red surgical bouffant hat than to verbally declare leadership. Most participants indicated that observing the red hat to detect leadership in the operating room was more effective than when leaders used a verbal declaration to inform others who was leading.
Conclusions: Our findings suggest that utilizing a visual cue of leadership with the red surgical bouffant hat improves participant perceptions of communication of the surgical team during an obstetrical critical event in a simulation environment.
{"title":"The red hat - designating leadership using visual and verbal cues: a mixed-methods study.","authors":"Kelli Krase, Julie A Broski, Stephen Tarver, Shariska P Harrington, Amy Wolverton, Mae Winchester, German Berbel, Melody K Zakarian, Taylor Zabel, Hannah Warren, Matthew C Lineberry","doi":"10.1186/s41077-024-00295-2","DOIUrl":"10.1186/s41077-024-00295-2","url":null,"abstract":"<p><strong>Background: </strong>During a critical event in the labor and delivery operating room, it is crucial for team members responding to the situation to be aware of the designated leaders. Visual and verbal cues have been utilized to designate leadership in various healthcare settings; however, previous research has indicated mixed results using visual cues for role designation.</p><p><strong>Methods: </strong>The purpose of this study was to explore the use of the red surgical hat as a visual cue of leadership during obstetric emergency simulation training. We used a mixed-methods design to analyze simulation-based education video and debriefing transcripts.</p><p><strong>Results: </strong>There was a statistically significant difference in the proportion of participants who declared leadership vs. those who donned the red hat. Participants were more likely to visually declare leadership utilizing a red surgical bouffant hat than to verbally declare leadership. Most participants indicated that observing the red hat to detect leadership in the operating room was more effective than when leaders used a verbal declaration to inform others who was leading.</p><p><strong>Conclusions: </strong>Our findings suggest that utilizing a visual cue of leadership with the red surgical bouffant hat improves participant perceptions of communication of the surgical team during an obstetrical critical event in a simulation environment.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11221081/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141499792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-02DOI: 10.1186/s41077-024-00302-6
Peter Dieckmann, Birgitte Bruun, Sofie Mundt, Ragnhild Holgaard, Doris Østergaard
In this article, we present a generic model for social and cognitive skills that can be used in work and (simulation-based) education in healthcare. We combined existing non-technical skills tools into a tool that we call SCOPE. SCOPE is a model that comprises the three social categories of "teamwork", "leading", and "task management" as well as the two cognitive categories of "situation awareness" and "decision making". Each category comprises between three and six elements. We formulated guiding questions for each category in an attempt to emphasize its core meaning. We developed a dynamic graphical representation of the categories that emphasize the constant changes in the relative importance of the categories over the course of a clinical or educational situation. Anecdotal evidence supports the value of the model for aligning language around social and cognitive skills across specialties and professions.
{"title":"Social and Cognitive Skills (SCOPE)-a generic model for multi-professional work and education in healthcare.","authors":"Peter Dieckmann, Birgitte Bruun, Sofie Mundt, Ragnhild Holgaard, Doris Østergaard","doi":"10.1186/s41077-024-00302-6","DOIUrl":"10.1186/s41077-024-00302-6","url":null,"abstract":"<p><p>In this article, we present a generic model for social and cognitive skills that can be used in work and (simulation-based) education in healthcare. We combined existing non-technical skills tools into a tool that we call SCOPE. SCOPE is a model that comprises the three social categories of \"teamwork\", \"leading\", and \"task management\" as well as the two cognitive categories of \"situation awareness\" and \"decision making\". Each category comprises between three and six elements. We formulated guiding questions for each category in an attempt to emphasize its core meaning. We developed a dynamic graphical representation of the categories that emphasize the constant changes in the relative importance of the categories over the course of a clinical or educational situation. Anecdotal evidence supports the value of the model for aligning language around social and cognitive skills across specialties and professions.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11218223/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141494497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-26DOI: 10.1186/s41077-024-00299-y
Joanne Kerins, Katherine Ralston, Suzanne Anderson Stirling, Nicholas Simpson, Victoria Ruth Tallentire
Background: Evaluating the impact of simulation-based education (SBE) has prioritised demonstrating a causal link to improved patient outcomes. Recent calls herald a move away from looking for causation to understanding 'what else happened'. Inspired by Shorrock's varieties of human work from patient safety literature, this study draws on the concept of work-as-done versus work-as-imagined. Applying this to SBE recognises that some training impacts will be unexpected, and the realities of training will never be quite as imagined. This study takes a critical realist stance to explore the experience and consequences, intended and unintended, of the internal medicine training (IMT) simulation programme in Scotland, to better understand 'training-as-done'.
Methods: Critical realism accepts that there is a reality to uncover but acknowledges that our knowledge of reality is inevitably our construction and cannot be truly objective. The IMT simulation programme involves three courses over a 3-year period: a 3-day boot camp, a skills day and a 2-day registrar-ready course. Following ethical approval, interviews were conducted with trainees who had completed all courses, as well as faculty and stakeholders both immersed in and distant from course delivery. Interviews were audio-recorded, transcribed verbatim and analysed using critical realist analysis, influenced by Shorrock's proxies for work-as-done.
Results: Between July and December 2023, 24 interviews were conducted with ten trainees, eight faculty members and six stakeholders. Data described proxies for training-as-done within three broad categories: design, experience and impact. Proxies for training design included training-as-prescribed, training-as-desired and training-as-prioritised which compete to produce training-as-standardised. Experience included training-as-anticipated with pre-simulation anxiety and training-as-unintended with the valued opportunity for social comparison as well as a sense of identity and social cohesion. The impact reached beyond the individual trainee with faculty development and inspiration for other training ventures.
Conclusion: Our findings highlight unintended consequences of SBE such as social comparison and feeling 'valued as a trainee, valued as a person'. It sheds light on the fear of simulation, reinforcing the importance of psychological safety. A critical realist approach illuminated the 'bigger picture', revealing insights and underlying mechanisms that allow this study to present a new framework for conceptualising training evaluation.
{"title":"Training as imagined? A critical realist analysis of Scotland's internal medicine simulation programme.","authors":"Joanne Kerins, Katherine Ralston, Suzanne Anderson Stirling, Nicholas Simpson, Victoria Ruth Tallentire","doi":"10.1186/s41077-024-00299-y","DOIUrl":"10.1186/s41077-024-00299-y","url":null,"abstract":"<p><strong>Background: </strong>Evaluating the impact of simulation-based education (SBE) has prioritised demonstrating a causal link to improved patient outcomes. Recent calls herald a move away from looking for causation to understanding 'what else happened'. Inspired by Shorrock's varieties of human work from patient safety literature, this study draws on the concept of work-as-done versus work-as-imagined. Applying this to SBE recognises that some training impacts will be unexpected, and the realities of training will never be quite as imagined. This study takes a critical realist stance to explore the experience and consequences, intended and unintended, of the internal medicine training (IMT) simulation programme in Scotland, to better understand 'training-as-done'.</p><p><strong>Methods: </strong>Critical realism accepts that there is a reality to uncover but acknowledges that our knowledge of reality is inevitably our construction and cannot be truly objective. The IMT simulation programme involves three courses over a 3-year period: a 3-day boot camp, a skills day and a 2-day registrar-ready course. Following ethical approval, interviews were conducted with trainees who had completed all courses, as well as faculty and stakeholders both immersed in and distant from course delivery. Interviews were audio-recorded, transcribed verbatim and analysed using critical realist analysis, influenced by Shorrock's proxies for work-as-done.</p><p><strong>Results: </strong>Between July and December 2023, 24 interviews were conducted with ten trainees, eight faculty members and six stakeholders. Data described proxies for training-as-done within three broad categories: design, experience and impact. Proxies for training design included training-as-prescribed, training-as-desired and training-as-prioritised which compete to produce training-as-standardised. Experience included training-as-anticipated with pre-simulation anxiety and training-as-unintended with the valued opportunity for social comparison as well as a sense of identity and social cohesion. The impact reached beyond the individual trainee with faculty development and inspiration for other training ventures.</p><p><strong>Conclusion: </strong>Our findings highlight unintended consequences of SBE such as social comparison and feeling 'valued as a trainee, valued as a person'. It sheds light on the fear of simulation, reinforcing the importance of psychological safety. A critical realist approach illuminated the 'bigger picture', revealing insights and underlying mechanisms that allow this study to present a new framework for conceptualising training evaluation.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11210083/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141461153","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-26DOI: 10.1186/s41077-024-00298-z
Tarek Hazwani, Heba Hamam, Angela Caswell, Azza Madkhaly, Saif Al Saif, Zahra Al Hassan, Reem Al Sweilem, Asma Arabi
Background: Recognizing and identifying latent safety threats (LSTs) before patient care commences is crucial, aiding leaders in ensuring hospital readiness and extending its impact beyond patient safety alone. This study evaluated the effectiveness of a combination of Simulation-based Clinical Systems Testing (SbCST) with Healthcare Failure Mode and Effect Analysis (HFMEA) with regard to mitigating LSTs within a newly constructed hospital.
Methods: Three phases of the combined SbCST and HFMEA approach were implemented across all hospital settings. The scenarios tested system functionalities, team responses, and resource availability. The threats thus identified were categorized into system-related issues, human issues, and resource issues, after which they were prioritized and addressed using mitigation strategies. Reassessment confirmed the effectiveness of these strategies before hospital commissioning.
Results: More than 76% of the LSTs were mitigated through the combined approach. System-related issues, such as nonfunctional communication devices and faulty elevators, were addressed by leadership. Human issues such as miscommunication and nonadherence to hospital policy led to improvements in interprofessional communication and teamwork. Resource issues, including missing equipment and risks of oxygen explosion, were addressed through procurement, maintenance, and staff training for equipment preparation.
Conclusion: The SbCST and HFMEA were highly effective with regard to proactively identifying and mitigating LSTs across all aspects of hospital preparedness. This systematic and comprehensive approach offers a valuable tool for enhancing patient safety in new healthcare facilities, thereby potentially setting a new standard for proactive hazard identification and risk management in the context of healthcare construction and commissioning.
{"title":"Proactive patient safety: enhancing hospital readiness through simulation-based clinical systems testing and healthcare failure mode and effect analysis.","authors":"Tarek Hazwani, Heba Hamam, Angela Caswell, Azza Madkhaly, Saif Al Saif, Zahra Al Hassan, Reem Al Sweilem, Asma Arabi","doi":"10.1186/s41077-024-00298-z","DOIUrl":"10.1186/s41077-024-00298-z","url":null,"abstract":"<p><strong>Background: </strong>Recognizing and identifying latent safety threats (LSTs) before patient care commences is crucial, aiding leaders in ensuring hospital readiness and extending its impact beyond patient safety alone. This study evaluated the effectiveness of a combination of Simulation-based Clinical Systems Testing (SbCST) with Healthcare Failure Mode and Effect Analysis (HFMEA) with regard to mitigating LSTs within a newly constructed hospital.</p><p><strong>Methods: </strong>Three phases of the combined SbCST and HFMEA approach were implemented across all hospital settings. The scenarios tested system functionalities, team responses, and resource availability. The threats thus identified were categorized into system-related issues, human issues, and resource issues, after which they were prioritized and addressed using mitigation strategies. Reassessment confirmed the effectiveness of these strategies before hospital commissioning.</p><p><strong>Results: </strong>More than 76% of the LSTs were mitigated through the combined approach. System-related issues, such as nonfunctional communication devices and faulty elevators, were addressed by leadership. Human issues such as miscommunication and nonadherence to hospital policy led to improvements in interprofessional communication and teamwork. Resource issues, including missing equipment and risks of oxygen explosion, were addressed through procurement, maintenance, and staff training for equipment preparation.</p><p><strong>Conclusion: </strong>The SbCST and HFMEA were highly effective with regard to proactively identifying and mitigating LSTs across all aspects of hospital preparedness. This systematic and comprehensive approach offers a valuable tool for enhancing patient safety in new healthcare facilities, thereby potentially setting a new standard for proactive hazard identification and risk management in the context of healthcare construction and commissioning.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11202391/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141452304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-24DOI: 10.1186/s41077-024-00301-7
Sethapong Lertsakulbunlue, Anupong Kantiwong
Introduction: Peer assessment can enhance understanding of the simulation-based learning (SBL) process and promote feedback, though research on its rubrics remains limited. This study assesses the validity and reliability of a peer assessment rubric and determines the appropriate number of items and raters needed for a reliable assessment in the advanced cardiac life support (ACLS) context.
Methods: Ninety-five third-year medical students participated in the ACLS course and were assessed by two teachers (190 ratings) and three peers (285 ratings). Students rotated roles and were assessed once as a team leader on a ten-item rubric in three domains: electrocardiogram and ACLS skills, management and mechanisms, and affective domains. Messick's validity framework guided the collection of validity evidence.
Results: Five sources of validity evidence were collected: (1) content: expert reviews and alpha, beta, and pilot tests for iterative content validation; (2) response process: achieved acceptable peer interrater reliability (intraclass correlation = 0.78, p = 0.001) and a Cronbach's alpha of 0.83; (3) internal structure: demonstrated reliability through generalizability theory, where one peer rater with ten items achieved sufficient reliability (Phi-coefficient = 0.76), and two raters enhanced reliability (Phi-coefficient = 0.85); construct validity was supported by confirmatory factor analysis. (4) Relations to other variables: Peer and teacher ratings were similar. However, peers rated higher in scenario management; further generalizability theory analysis indicated comparable reliability with the same number of teachers. (5) Consequences: Over 80% of students positively perceived peer assessment on a 5-point Likert scale survey.
Conclusion: This study confirms the validity and reliability of ACLS SBL rubrics while utilizing peers as raters. Rubrics can exhibit clear performance criteria, ensure uniform grading, provide targeted feedback, and promote peer assessment skills.
{"title":"Development of peer assessment rubrics in simulation-based learning for advanced cardiac life support skills among medical students.","authors":"Sethapong Lertsakulbunlue, Anupong Kantiwong","doi":"10.1186/s41077-024-00301-7","DOIUrl":"10.1186/s41077-024-00301-7","url":null,"abstract":"<p><strong>Introduction: </strong>Peer assessment can enhance understanding of the simulation-based learning (SBL) process and promote feedback, though research on its rubrics remains limited. This study assesses the validity and reliability of a peer assessment rubric and determines the appropriate number of items and raters needed for a reliable assessment in the advanced cardiac life support (ACLS) context.</p><p><strong>Methods: </strong>Ninety-five third-year medical students participated in the ACLS course and were assessed by two teachers (190 ratings) and three peers (285 ratings). Students rotated roles and were assessed once as a team leader on a ten-item rubric in three domains: electrocardiogram and ACLS skills, management and mechanisms, and affective domains. Messick's validity framework guided the collection of validity evidence.</p><p><strong>Results: </strong>Five sources of validity evidence were collected: (1) content: expert reviews and alpha, beta, and pilot tests for iterative content validation; (2) response process: achieved acceptable peer interrater reliability (intraclass correlation = 0.78, p = 0.001) and a Cronbach's alpha of 0.83; (3) internal structure: demonstrated reliability through generalizability theory, where one peer rater with ten items achieved sufficient reliability (Phi-coefficient = 0.76), and two raters enhanced reliability (Phi-coefficient = 0.85); construct validity was supported by confirmatory factor analysis. (4) Relations to other variables: Peer and teacher ratings were similar. However, peers rated higher in scenario management; further generalizability theory analysis indicated comparable reliability with the same number of teachers. (5) Consequences: Over 80% of students positively perceived peer assessment on a 5-point Likert scale survey.</p><p><strong>Conclusion: </strong>This study confirms the validity and reliability of ACLS SBL rubrics while utilizing peers as raters. Rubrics can exhibit clear performance criteria, ensure uniform grading, provide targeted feedback, and promote peer assessment skills.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":2.8,"publicationDate":"2024-06-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11194909/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141447675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-17DOI: 10.1186/s41077-024-00287-2
{"title":"Meeting Abstracts for the Society for Simulation in Europe 2024.","authors":"","doi":"10.1186/s41077-024-00287-2","DOIUrl":"10.1186/s41077-024-00287-2","url":null,"abstract":"","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11181568/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141332558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-11DOI: 10.1186/s41077-024-00297-0
Adam F Roche, Daragh Moneley, Tim Lawler, Emily Boyle, Greg Gosi, Adrian O'Callaghan, Caitriona Cahir, Dara O'Keeffe, Claire M Condron
Background: There is an increasing need to increase simulation-based learning opportunities for vascular surgery residents in endovascular skills training. This study aims to explore the effectiveness of remote expert instructional feedback of endovascular simulation-based education, as a means of increasing training opportunities in this area for vascular surgery residents.
Methods: A mixed-methods study design was adopted. Twelve vascular surgery residents from Ireland were tasked with completing two endovascular renal artery procedures: one with in-person expert feedback and the other with remote instruction. Participants ranged in experience levels from second year to final year of residency. Following the training activities, interviews and a questionnaire were employed to gather information on the usefulness of remote feedback.
Results: There was no significant difference reported by participants using a post-event validated questionnaire between remote and in-person feedback. During the interviews, participants expressed mixed feelings about the presence of the educator while practicing, but they eventually saw no limiting factors to their practice when the trainer provided remote feedback. When receiving performance feedback remotely, clear communication and a shared knowledge of the task development are critical to success.
Conclusions: We believe these findings can inform the design and development of remote learning and assessment of endovascular skills training and ultimately provide increased opportunities for more skills practice for vascular surgical residents.
{"title":"Remote feedback in endovascular simulation training: a mixed-methods study.","authors":"Adam F Roche, Daragh Moneley, Tim Lawler, Emily Boyle, Greg Gosi, Adrian O'Callaghan, Caitriona Cahir, Dara O'Keeffe, Claire M Condron","doi":"10.1186/s41077-024-00297-0","DOIUrl":"10.1186/s41077-024-00297-0","url":null,"abstract":"<p><strong>Background: </strong>There is an increasing need to increase simulation-based learning opportunities for vascular surgery residents in endovascular skills training. This study aims to explore the effectiveness of remote expert instructional feedback of endovascular simulation-based education, as a means of increasing training opportunities in this area for vascular surgery residents.</p><p><strong>Methods: </strong>A mixed-methods study design was adopted. Twelve vascular surgery residents from Ireland were tasked with completing two endovascular renal artery procedures: one with in-person expert feedback and the other with remote instruction. Participants ranged in experience levels from second year to final year of residency. Following the training activities, interviews and a questionnaire were employed to gather information on the usefulness of remote feedback.</p><p><strong>Results: </strong>There was no significant difference reported by participants using a post-event validated questionnaire between remote and in-person feedback. During the interviews, participants expressed mixed feelings about the presence of the educator while practicing, but they eventually saw no limiting factors to their practice when the trainer provided remote feedback. When receiving performance feedback remotely, clear communication and a shared knowledge of the task development are critical to success.</p><p><strong>Conclusions: </strong>We believe these findings can inform the design and development of remote learning and assessment of endovascular skills training and ultimately provide increased opportunities for more skills practice for vascular surgical residents.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11165733/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141307452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-04DOI: 10.1186/s41077-024-00296-1
Susan Wiltrakis, Ruth Hwu, Sherita Holmes, Srikant Iyer, Nandranie Goodwin, Claire Mathai, Scott Gillespie, Kiran B Hebbar, Nora Colman
Background: Cognitive load impacts performance of debriefers and learners during simulations, but limited data exists examining debriefer cognitive load. The aim of this study is to compare the cognitive load of the debriefers during simulation-based team training (SbTT) with Rapid Cycle Deliberate Practice (RCDP) debriefing and Traditional Reflective Debriefing (TRD). We hypothesize that cognitive load will be reduced during RCDP compared to TRD.
Methods: This study was part of a large-scale, interdisciplinary team training program at Children's Healthcare of Atlanta Egleston Pediatric Emergency Department, with 164 learners (physicians, nurses, medical technicians, paramedics, and respiratory therapists (RTs)). Eight debriefers (main facilitators and discipline-specific coaches) led 28 workshops, which were quasi-randomized to either RCDP or TRD. Each session began with a baseline medical resuscitation scenario and cognitive load measurement using the NASA Task Load Index (TLX), and the NASA TLX was repeated immediately following either TRD or RCDP debriefing. Raw scores of the NASA TLX before and after intervention were compared. ANOVA tests were used to compare differences in NASA TLX scores before and after intervention between the RCDP and TRD groups.
Results: For all debriefers, mean NASA TLX scores for physical demands and frustration significantly decreased (- 0.8, p = 0.004 and - 1.3, p = 0.002) in TRD and mean perceived performance success significantly increased (+ 2.4, p < 0.001). For RCDP, perceived performance success increased post-debriefing (+ 3.6, p < 0.001), time demands decreased (- 1.0, p = 0.04), and frustration decreased (- 2.0, p < 0.001). Comparing TRD directly to RCDP, perceived performance success was greater in RCDP than TRD (3.6 vs. 2.4, p = 0.04). Main facilitators had lower effort and mental demand in RCDP and greater perceived success (p < 0.001).
Conclusion: RCDP had greater perceived success than TRD for debriefers. Main facilitators also report reduced effort and baseline mental demand in RCDP. For less experienced debriefers, newer simulation programs, or large team training sessions such as our study, RCDP may be a less mentally demanding debriefing methodology for facilitators.
{"title":"Debriefer cognitive load during Traditional Reflective Debriefing vs. Rapid Cycle Deliberate Practice interdisciplinary team training.","authors":"Susan Wiltrakis, Ruth Hwu, Sherita Holmes, Srikant Iyer, Nandranie Goodwin, Claire Mathai, Scott Gillespie, Kiran B Hebbar, Nora Colman","doi":"10.1186/s41077-024-00296-1","DOIUrl":"10.1186/s41077-024-00296-1","url":null,"abstract":"<p><strong>Background: </strong>Cognitive load impacts performance of debriefers and learners during simulations, but limited data exists examining debriefer cognitive load. The aim of this study is to compare the cognitive load of the debriefers during simulation-based team training (SbTT) with Rapid Cycle Deliberate Practice (RCDP) debriefing and Traditional Reflective Debriefing (TRD). We hypothesize that cognitive load will be reduced during RCDP compared to TRD.</p><p><strong>Methods: </strong>This study was part of a large-scale, interdisciplinary team training program at Children's Healthcare of Atlanta Egleston Pediatric Emergency Department, with 164 learners (physicians, nurses, medical technicians, paramedics, and respiratory therapists (RTs)). Eight debriefers (main facilitators and discipline-specific coaches) led 28 workshops, which were quasi-randomized to either RCDP or TRD. Each session began with a baseline medical resuscitation scenario and cognitive load measurement using the NASA Task Load Index (TLX), and the NASA TLX was repeated immediately following either TRD or RCDP debriefing. Raw scores of the NASA TLX before and after intervention were compared. ANOVA tests were used to compare differences in NASA TLX scores before and after intervention between the RCDP and TRD groups.</p><p><strong>Results: </strong>For all debriefers, mean NASA TLX scores for physical demands and frustration significantly decreased (- 0.8, p = 0.004 and - 1.3, p = 0.002) in TRD and mean perceived performance success significantly increased (+ 2.4, p < 0.001). For RCDP, perceived performance success increased post-debriefing (+ 3.6, p < 0.001), time demands decreased (- 1.0, p = 0.04), and frustration decreased (- 2.0, p < 0.001). Comparing TRD directly to RCDP, perceived performance success was greater in RCDP than TRD (3.6 vs. 2.4, p = 0.04). Main facilitators had lower effort and mental demand in RCDP and greater perceived success (p < 0.001).</p><p><strong>Conclusion: </strong>RCDP had greater perceived success than TRD for debriefers. Main facilitators also report reduced effort and baseline mental demand in RCDP. For less experienced debriefers, newer simulation programs, or large team training sessions such as our study, RCDP may be a less mentally demanding debriefing methodology for facilitators.</p>","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11149316/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141248675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-21DOI: 10.1186/s41077-024-00288-1
Cristina Diaz-Navarro, Robert Armstrong, Matthew Charnetski, Kirsty J Freeman, Sabrina Koh, Gabriel Reedy, Jayne Smitten, Pier Luigi Ingrassia, Francisco Maio Matos, Barry Issenberg
Simulation plays a pivotal role in addressing universal healthcare challenges, reducing education inequities, and improving mortality, morbidity and patient experiences. It enhances healthcare processes and systems, contributing significantly to the development of a safety culture within organizations. It has proven to be cost-effective and successful in enhancing team performance, fostering workforce resilience and improving patient outcomes.Through an international collaborative effort, an iterative consultation process was conducted with 50 societies operating across 67 countries within six continents. This process revealed common healthcare challenges and simulation practices worldwide. The intended audience for this statement includes policymakers, healthcare organization leaders, health education institutions, and simulation practitioners. It aims to establish a consensus on the key priorities for the broad adoption of exemplary simulation practice that benefits patients and healthcare workforces globally.Key recommendations Advocating for the benefits that simulation provides to patients, staff and organizations is crucial, as well as promoting its adoption and integration into daily learning and practice throughout the healthcare spectrum. Low-cost, high-impact simulation methods should be leveraged to expand global accessibility and integrate into system improvement processes as well as undergraduate and postgraduate curricula. Support at institutional and governmental level is essential, necessitating a unified and concerted approach in terms of political, strategic and financial commitment.It is imperative that simulation is used appropriately, employing evidence-based quality assurance approaches that adhere to recognized standards of best practice. These standards include faculty development, evaluation, accrediting, credentialing, and certification.We must endeavor to provide equitable and sustainable access to high-quality, contextually relevant simulation-based learning opportunities, firmly upholding the principles of equity, diversity and inclusion. This should be complemented with a renewed emphasis on research and scholarship in this field.Call for action We urge policymakers and leaders to formally acknowledge and embrace the benefits of simulation in healthcare practice and education. This includes a commitment to sustained support and a mandate for the application of simulation within education, training, and clinical environments.We advocate for healthcare systems and education institutions to commit themselves to the goal of high-quality healthcare and improved patient outcomes. This commitment should encompass the promotion and resource support of simulation-based learning opportunities for individuals and interprofessional teams throughout all stages and levels of a caregiver's career, in alignment with best practice standards.We call upon simulation practitioners to champion healthcare simulation as an indispensa
{"title":"Global consensus statement on simulation-based practice in healthcare.","authors":"Cristina Diaz-Navarro, Robert Armstrong, Matthew Charnetski, Kirsty J Freeman, Sabrina Koh, Gabriel Reedy, Jayne Smitten, Pier Luigi Ingrassia, Francisco Maio Matos, Barry Issenberg","doi":"10.1186/s41077-024-00288-1","DOIUrl":"10.1186/s41077-024-00288-1","url":null,"abstract":"<p><p>Simulation plays a pivotal role in addressing universal healthcare challenges, reducing education inequities, and improving mortality, morbidity and patient experiences. It enhances healthcare processes and systems, contributing significantly to the development of a safety culture within organizations. It has proven to be cost-effective and successful in enhancing team performance, fostering workforce resilience and improving patient outcomes.Through an international collaborative effort, an iterative consultation process was conducted with 50 societies operating across 67 countries within six continents. This process revealed common healthcare challenges and simulation practices worldwide. The intended audience for this statement includes policymakers, healthcare organization leaders, health education institutions, and simulation practitioners. It aims to establish a consensus on the key priorities for the broad adoption of exemplary simulation practice that benefits patients and healthcare workforces globally.Key recommendations Advocating for the benefits that simulation provides to patients, staff and organizations is crucial, as well as promoting its adoption and integration into daily learning and practice throughout the healthcare spectrum. Low-cost, high-impact simulation methods should be leveraged to expand global accessibility and integrate into system improvement processes as well as undergraduate and postgraduate curricula. Support at institutional and governmental level is essential, necessitating a unified and concerted approach in terms of political, strategic and financial commitment.It is imperative that simulation is used appropriately, employing evidence-based quality assurance approaches that adhere to recognized standards of best practice. These standards include faculty development, evaluation, accrediting, credentialing, and certification.We must endeavor to provide equitable and sustainable access to high-quality, contextually relevant simulation-based learning opportunities, firmly upholding the principles of equity, diversity and inclusion. This should be complemented with a renewed emphasis on research and scholarship in this field.Call for action We urge policymakers and leaders to formally acknowledge and embrace the benefits of simulation in healthcare practice and education. This includes a commitment to sustained support and a mandate for the application of simulation within education, training, and clinical environments.We advocate for healthcare systems and education institutions to commit themselves to the goal of high-quality healthcare and improved patient outcomes. This commitment should encompass the promotion and resource support of simulation-based learning opportunities for individuals and interprofessional teams throughout all stages and levels of a caregiver's career, in alignment with best practice standards.We call upon simulation practitioners to champion healthcare simulation as an indispensa","PeriodicalId":72108,"journal":{"name":"Advances in simulation (London, England)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11106913/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141072444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}