Surgical Skill Evaluation From Robot-Assisted Surgery Recordings

A. Soleymani, A. A. S. Asl, Mojtaba Yeganejou, Scott Dick, M. Tavakoli, Xingyu Li
{"title":"Surgical Skill Evaluation From Robot-Assisted Surgery Recordings","authors":"A. Soleymani, A. A. S. Asl, Mojtaba Yeganejou, Scott Dick, M. Tavakoli, Xingyu Li","doi":"10.1109/ismr48346.2021.9661527","DOIUrl":null,"url":null,"abstract":"Quality and safety are critical elements in the performance of surgeries. Therefore, surgical trainees need to obtain the required degrees of expertise before operating on patients. Conventionally, a trainee’s performance is evaluated by qualitative methods that are time-consuming and prone to bias. Using autonomous and quantitative surgical skill assessment improves the consistency, repeatability, and reliability of the evaluation. To this end, this paper proposes a video-based deep learning framework for surgical skill assessment. By incorporating prior knowledge on surgeon’s activity in the system design, we decompose the complex task of spatio-temporal representation learning from video recordings into two independent, relatively-simple learning processes, which greatly reduces the model size. We evaluate the proposed framework using the publicly available JIGSAWS robotic surgery dataset and demonstrate its capability to learn the underlying features of surgical maneuvers and the dynamic interplay between sequences of actions effectively. The skill level classification accuracy of 97.27% on the public dataset demonstrates the superiority of the proposed model over prior video-based skill assessment methods. The code of this paper will be available on Github at link: ${\\color{blue}{\\text{sourceCode}}}$.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 International Symposium on Medical Robotics (ISMR)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ismr48346.2021.9661527","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8

Abstract

Quality and safety are critical elements in the performance of surgeries. Therefore, surgical trainees need to obtain the required degrees of expertise before operating on patients. Conventionally, a trainee’s performance is evaluated by qualitative methods that are time-consuming and prone to bias. Using autonomous and quantitative surgical skill assessment improves the consistency, repeatability, and reliability of the evaluation. To this end, this paper proposes a video-based deep learning framework for surgical skill assessment. By incorporating prior knowledge on surgeon’s activity in the system design, we decompose the complex task of spatio-temporal representation learning from video recordings into two independent, relatively-simple learning processes, which greatly reduces the model size. We evaluate the proposed framework using the publicly available JIGSAWS robotic surgery dataset and demonstrate its capability to learn the underlying features of surgical maneuvers and the dynamic interplay between sequences of actions effectively. The skill level classification accuracy of 97.27% on the public dataset demonstrates the superiority of the proposed model over prior video-based skill assessment methods. The code of this paper will be available on Github at link: ${\color{blue}{\text{sourceCode}}}$.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
从机器人辅助手术记录中评估手术技能
质量和安全是外科手术的关键因素。因此,外科受训者在对患者进行手术前需要获得所需的专业程度。传统上,培训生的表现是通过定性的方法来评估的,这种方法既耗时又容易产生偏见。使用自主和定量的手术技能评估提高了评估的一致性、可重复性和可靠性。为此,本文提出了一种基于视频的外科技能评估深度学习框架。通过在系统设计中引入关于外科医生活动的先验知识,我们将复杂的视频记录时空表征学习任务分解为两个独立的、相对简单的学习过程,从而大大减小了模型的尺寸。我们使用公开可用的JIGSAWS机器人手术数据集评估了所提出的框架,并证明了它能够有效地学习手术操作的潜在特征和动作序列之间的动态相互作用。在公共数据集上的技能水平分类准确率为97.27%,表明了该模型相对于先前基于视频的技能评估方法的优越性。本文的代码将在Github上提供:${\color{blue}{\text{sourceCode}}}$。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
MOPS: A Modular and Open Platform for Surgical Robotics Research Lymph Node Detection Using Robot Assisted Electrical Impedance Scanning and an Artificial Neural Network Image-Guided Optimization of Robotic Catheters for Patient-Specific Endovascular Intervention Surgical Skill Evaluation From Robot-Assisted Surgery Recordings Learning Soft-Tissue Simulation from Models and Observation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1