Standardizing surgical training with objective performance indicators: a prospective cohort study.

Abstract

Background: Multiple surgical virtual reality (VR) simulators are currently available; however, there is lack of comparison between performance after practice on these simulators compared to bench top models. Utilizing the Intuitive Data recorder (IDR) and Objective performance indicators (OPI), we aim to objectively assess robotic surgical skills using a dry lab model. We hypothesize that practicing surgical skills will improve OPIs and that those who practice on the dry lab model will have a greater improvement in their OPIs compared to those who practice with Fundamentals of Robotic Surgery (FRS) SimNow VR.

Methods: The IDR was used to record kinematics as each participant went through five basic surgery tasks on a dry lab benchtop model to record baseline performance. Participants were then randomized to practice on the dry lab model or the corresponding SimNow Virtual reality (VR) tasks. The participants repeated the tasks again on the benchtop model. Statistical analysis was performed using paired samples t tests, independent samples t tests, and ANOVA tests.

Results: Twenty-seven surgeons participated in our study ranging from interns to attendings. Randomization to VR vs benchtop practice resulted in 11 and 13 participants in each group. For the rollercoaster, backhand suturing, railroad, and knot tying tasks, a significant improvement in kinematic profiles was observed. Bimanual dexterity, angular motion, and smoothness metrics improved most consistently across the tasks after practice. Kinematic profiles between those practicing on VR versus benchtop had no significant differences.

Conclusions: This study shows that OPIs can be used to benchmark surgical trainees. VR appears to be non-inferior to dry lab model for practice for trainees. We identified patterns in OPI improvement that can be tailored to specific skills depending on the trainees needs. Our study is the first step in developing a standardized training and assessment tool to assess competency in robotic surgery training.