Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot

IF 2.9 Q2 ROBOTICS Robotics Pub Date : 2024-01-01 DOI:10.3390/robotics13010010
Reenu Arikkat Paul, Luay Jawad, Abhishek Shankar, Maitreyee Majumdar, Troy Herrick-Thomason, Abhilash Pandya
{"title":"Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot","authors":"Reenu Arikkat Paul, Luay Jawad, Abhishek Shankar, Maitreyee Majumdar, Troy Herrick-Thomason, Abhilash Pandya","doi":"10.3390/robotics13010010","DOIUrl":null,"url":null,"abstract":"Robotic surgery involves significant task switching between tool control and camera control, which can be a source of distraction and error. This study evaluated the performance of a voice-enabled autonomous camera control system compared to a human-operated camera for the da Vinci surgical robot. Twenty subjects performed a series of tasks that required them to instruct the camera to move to specific locations to complete the tasks. The subjects performed the tasks (1) using an automated camera system that could be tailored based on keywords; and (2) directing a human camera operator using voice commands. The data were analyzed using task completion measures and the NASA Task Load Index (TLX) human performance metrics. The human-operated camera control method was able to outperform an automated algorithm in terms of task completion (6.96 vs. 7.71 correct insertions; p-value = 0.044). However, subjective feedback suggests that a voice-enabled autonomous camera control system is comparable to a human-operated camera control system. Based on the subjects’ feedback, thirteen out of the twenty subjects preferred the voice-enabled autonomous camera control system including the surgeon. This study is a step towards a more natural language interface for surgical robotics as these systems become better partners during surgery.","PeriodicalId":37568,"journal":{"name":"Robotics","volume":"20 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/robotics13010010","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Robotic surgery involves significant task switching between tool control and camera control, which can be a source of distraction and error. This study evaluated the performance of a voice-enabled autonomous camera control system compared to a human-operated camera for the da Vinci surgical robot. Twenty subjects performed a series of tasks that required them to instruct the camera to move to specific locations to complete the tasks. The subjects performed the tasks (1) using an automated camera system that could be tailored based on keywords; and (2) directing a human camera operator using voice commands. The data were analyzed using task completion measures and the NASA Task Load Index (TLX) human performance metrics. The human-operated camera control method was able to outperform an automated algorithm in terms of task completion (6.96 vs. 7.71 correct insertions; p-value = 0.044). However, subjective feedback suggests that a voice-enabled autonomous camera control system is comparable to a human-operated camera control system. Based on the subjects’ feedback, thirteen out of the twenty subjects preferred the voice-enabled autonomous camera control system including the surgeon. This study is a step towards a more natural language interface for surgical robotics as these systems become better partners during surgery.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
评估达芬奇手术机器人的语音自主相机控制系统
机器人手术需要在工具控制和摄像头控制之间进行大量任务切换,这可能会分散注意力并造成错误。这项研究评估了达芬奇手术机器人的语音自主相机控制系统与人工操作相机的性能比较。20 名受试者完成了一系列任务,要求他们指示摄像头移动到特定位置以完成任务。受试者完成了以下任务:(1) 使用可根据关键字定制的自动照相机系统;(2) 使用语音命令指挥人类照相机操作员。数据分析采用了任务完成度测量和美国宇航局任务负荷指数(TLX)人类性能指标。就任务完成情况而言,人工操作的相机控制方法优于自动算法(6.96 对 7.71;p 值 = 0.044)。不过,主观反馈表明,语音自主照相机控制系统与人工操作的照相机控制系统不相上下。根据受试者的反馈,20 名受试者中有 13 名更喜欢包括外科医生在内的语音自主照相机控制系统。随着这些系统在手术过程中成为更好的合作伙伴,这项研究为手术机器人向更自然的语言界面迈进迈出了一步。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Robotics
Robotics Mathematics-Control and Optimization
CiteScore
6.70
自引率
8.10%
发文量
114
审稿时长
11 weeks
期刊介绍: Robotics publishes original papers, technical reports, case studies, review papers and tutorials in all the aspects of robotics. Special Issues devoted to important topics in advanced robotics will be published from time to time. It particularly welcomes those emerging methodologies and techniques which bridge theoretical studies and applications and have significant potential for real-world applications. It provides a forum for information exchange between professionals, academicians and engineers who are working in the area of robotics, helping them to disseminate research findings and to learn from each other’s work. Suitable topics include, but are not limited to: -intelligent robotics, mechatronics, and biomimetics -novel and biologically-inspired robotics -modelling, identification and control of robotic systems -biomedical, rehabilitation and surgical robotics -exoskeletons, prosthetics and artificial organs -AI, neural networks and fuzzy logic in robotics -multimodality human-machine interaction -wireless sensor networks for robot navigation -multi-sensor data fusion and SLAM
期刊最新文献
Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot NU-Biped-4.5: A Lightweight and Low-Prototyping-Cost Full-Size Bipedal Robot Probability-Based Strategy for a Football Multi-Agent Autonomous Robot System An Enhanced Multi-Sensor Simultaneous Localization and Mapping (SLAM) Framework with Coarse-to-Fine Loop Closure Detection Based on a Tightly Coupled Error State Iterative Kalman Filter Playing Checkers with an Intelligent and Collaborative Robotic System
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1