Arthroscopic Shoulder Simulation Studies Reveal Improvements in Performance Metrics Without Proven Transferability to the Operating Room: A Systematic Review.
Madeleine Grace DeClercq, Mitchell T Pfennig, James Gannon, Olamide Oshikoya, Bradley Perry, Kevin F Dunne, J Michael Wiater
{"title":"Arthroscopic Shoulder Simulation Studies Reveal Improvements in Performance Metrics Without Proven Transferability to the Operating Room: A Systematic Review.","authors":"Madeleine Grace DeClercq, Mitchell T Pfennig, James Gannon, Olamide Oshikoya, Bradley Perry, Kevin F Dunne, J Michael Wiater","doi":"10.1016/j.arthro.2024.08.020","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To evaluate the use of shoulder arthroscopic simulation in orthopaedic surgery trainees.</p><p><strong>Methods: </strong>A literature search was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, using PubMed, Medline (Ovid), and EMBASE library databases. Inclusion criteria were experimental studies reporting pre- and post-test results of shoulder arthroscopic simulation in orthopaedic trainees (studies reporting results of comparison between groups not within the groups were excluded). Participant demographics, type of simulator training, simulator tasks assessed, and performance outcome measures were systematically reviewed. Each performance outcome measure was graphically represented in a Forest plot with point estimates of the incidence of performance outcomes with corresponding 95% confidence intervals and I<sup>2</sup>.</p><p><strong>Results: </strong>Fifteen studies met inclusion criteria with a total of 353 participants. The most common procedures simulated were diagnostic shoulder arthroscopy (n = 9 [60%]), arthroscopic Bankart repairs (n = 3 [20%]), and rotator cuff repairs (n = 2 [13%]). Simulations primarily used virtual reality (60%) and benchtop models (40%). The primary outcomes measured were time to task completion and Arthroscopic Surgical Skill Evaluation Tool scores. Time to task completion improved significantly with training (range 13-439 seconds pretest to 8-253.29 seconds post-test), with substantial heterogeneity across studies (I<sup>2</sup> = 87%). ASSET scores improved in 60% of the studies (ranging from 14-20.9 pretest to 17.9-28.5 post-test), with low heterogeneity (I<sup>2</sup> = 20%). In addition, both camera and probe distances decreased after simulation use, whereas the 14-point anatomic checklist showed no pre- to post-test differences.</p><p><strong>Conclusions: </strong>Arthroscopic simulation training benefits technical skills in shoulder arthroscopy, but the quality, assessment, and validity of these protocols vary. The translation of simulation training into the operating room has yet to be conclusively demonstrated.</p><p><strong>Level of evidence: </strong>Level IV, systematic review of Level I-IV studies.</p>","PeriodicalId":55459,"journal":{"name":"Arthroscopy-The Journal of Arthroscopic and Related Surgery","volume":null,"pages":null},"PeriodicalIF":4.4000,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Arthroscopy-The Journal of Arthroscopic and Related Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.arthro.2024.08.020","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: To evaluate the use of shoulder arthroscopic simulation in orthopaedic surgery trainees.
Methods: A literature search was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, using PubMed, Medline (Ovid), and EMBASE library databases. Inclusion criteria were experimental studies reporting pre- and post-test results of shoulder arthroscopic simulation in orthopaedic trainees (studies reporting results of comparison between groups not within the groups were excluded). Participant demographics, type of simulator training, simulator tasks assessed, and performance outcome measures were systematically reviewed. Each performance outcome measure was graphically represented in a Forest plot with point estimates of the incidence of performance outcomes with corresponding 95% confidence intervals and I2.
Results: Fifteen studies met inclusion criteria with a total of 353 participants. The most common procedures simulated were diagnostic shoulder arthroscopy (n = 9 [60%]), arthroscopic Bankart repairs (n = 3 [20%]), and rotator cuff repairs (n = 2 [13%]). Simulations primarily used virtual reality (60%) and benchtop models (40%). The primary outcomes measured were time to task completion and Arthroscopic Surgical Skill Evaluation Tool scores. Time to task completion improved significantly with training (range 13-439 seconds pretest to 8-253.29 seconds post-test), with substantial heterogeneity across studies (I2 = 87%). ASSET scores improved in 60% of the studies (ranging from 14-20.9 pretest to 17.9-28.5 post-test), with low heterogeneity (I2 = 20%). In addition, both camera and probe distances decreased after simulation use, whereas the 14-point anatomic checklist showed no pre- to post-test differences.
Conclusions: Arthroscopic simulation training benefits technical skills in shoulder arthroscopy, but the quality, assessment, and validity of these protocols vary. The translation of simulation training into the operating room has yet to be conclusively demonstrated.
Level of evidence: Level IV, systematic review of Level I-IV studies.
期刊介绍:
Nowhere is minimally invasive surgery explained better than in Arthroscopy, the leading peer-reviewed journal in the field. Every issue enables you to put into perspective the usefulness of the various emerging arthroscopic techniques. The advantages and disadvantages of these methods -- along with their applications in various situations -- are discussed in relation to their efficiency, efficacy and cost benefit. As a special incentive, paid subscribers also receive access to the journal expanded website.