Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality

J. Noël, M. Moschovas, E. Patel, T. Rogers, J. Marquinez, B. Rocco, A. Mottrie, V. Patel
{"title":"Step-by-step optimisation of robotic-assisted radical prostatectomy using augmented reality","authors":"J. Noël, M. Moschovas, E. Patel, T. Rogers, J. Marquinez, B. Rocco, A. Mottrie, V. Patel","doi":"10.1590/S1677-5538.IBJU.2022.99.10","DOIUrl":null,"url":null,"abstract":"ABSTRACT Introduction: Surgical training will be complemented by digitalisation, as the COVID 19 pandemic continues (1). Proximie is an augmented reality (AR) platform that can display up to 4 native camera views, with live or semi live telementoring. It can optimise ergonomics of the surgeon at the console (2), and robotic instrument orientation. We describe the utilisation of Proximie as a step-by-step guide in a robotic assisted radical prostatectomy (RARP). Surgical Technique: Author V. P. performed a transperitoneal multiport da Vinci Xi RARP with the Proximie platform: a laptop computer, multiple HD webcams, microphones and speakers. Using an HDMI cable to the Intuitive Surgical tower, output display from the console and an additional laparoscopic tower is shown. Each webcam was mounted to the side armrests of the console, directed at the surgeon's hands. An independent ‘drop in’ laparoscope via an additional 5mm left upper quadrant port was utilised. Observers can visualise the AR platform's recordings on a laptop and/or smartphone. A PTZ (pan-tilt-zoom) camera can capture the operating room, bedside assistant, ports and patient position. Our video demonstrates three of four camera views for posture, forearm, wrist, hand, and finger orientation, relative to the translated robotic steps. A pincer grasp of the endowrist manipulator during anastomosis allows optimal robotic wrist rotation. The second laparoscopic camera view demonstrated intracorporeal angles of robotic arm and bedside assistant's instrument position for critical steps such as nerve sparing and anastomosis (3). The console time was 100 minutes, no intraoperative complications, or delay in image transmission occurred with utilising the platform. Considerations: An AR platform can create deeper learning for RARP in real time or recorded sessions. Two-way verbal and visual communication with ability to annotate on screen, allows long distance mentoring. The platform's utility can be accessed in anywhere, to project surgeons beyond their immediate environment. This allows for democratisation of access to high volume institutions and their evolution of techniques (4), to assist patients globally. Potential developments are artificial intelligence (AI) networks analysing repository of such recorded data, to identify intraoperative hand motion and robotic instrument tracking. AR is a pertinent building block to enhance robotic training, skill dissemination, precision medicine (5) and surgery overall.","PeriodicalId":13674,"journal":{"name":"International Brazilian Journal of Urology : official journal of the Brazilian Society of Urology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Brazilian Journal of Urology : official journal of the Brazilian Society of Urology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1590/S1677-5538.IBJU.2022.99.10","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

ABSTRACT Introduction: Surgical training will be complemented by digitalisation, as the COVID 19 pandemic continues (1). Proximie is an augmented reality (AR) platform that can display up to 4 native camera views, with live or semi live telementoring. It can optimise ergonomics of the surgeon at the console (2), and robotic instrument orientation. We describe the utilisation of Proximie as a step-by-step guide in a robotic assisted radical prostatectomy (RARP). Surgical Technique: Author V. P. performed a transperitoneal multiport da Vinci Xi RARP with the Proximie platform: a laptop computer, multiple HD webcams, microphones and speakers. Using an HDMI cable to the Intuitive Surgical tower, output display from the console and an additional laparoscopic tower is shown. Each webcam was mounted to the side armrests of the console, directed at the surgeon's hands. An independent ‘drop in’ laparoscope via an additional 5mm left upper quadrant port was utilised. Observers can visualise the AR platform's recordings on a laptop and/or smartphone. A PTZ (pan-tilt-zoom) camera can capture the operating room, bedside assistant, ports and patient position. Our video demonstrates three of four camera views for posture, forearm, wrist, hand, and finger orientation, relative to the translated robotic steps. A pincer grasp of the endowrist manipulator during anastomosis allows optimal robotic wrist rotation. The second laparoscopic camera view demonstrated intracorporeal angles of robotic arm and bedside assistant's instrument position for critical steps such as nerve sparing and anastomosis (3). The console time was 100 minutes, no intraoperative complications, or delay in image transmission occurred with utilising the platform. Considerations: An AR platform can create deeper learning for RARP in real time or recorded sessions. Two-way verbal and visual communication with ability to annotate on screen, allows long distance mentoring. The platform's utility can be accessed in anywhere, to project surgeons beyond their immediate environment. This allows for democratisation of access to high volume institutions and their evolution of techniques (4), to assist patients globally. Potential developments are artificial intelligence (AI) networks analysing repository of such recorded data, to identify intraoperative hand motion and robotic instrument tracking. AR is a pertinent building block to enhance robotic training, skill dissemination, precision medicine (5) and surgery overall.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用增强现实逐步优化机器人辅助根治性前列腺切除术
导语:随着COVID - 19大流行的持续,外科培训将辅以数字化(1)。Proximie是一个增强现实(AR)平台,可以显示多达4个本地摄像头视图,支持实时或半实时远程监控。它可以优化外科医生在控制台的人体工程学(2),以及机器人仪器的定位。我们描述了在机器人辅助根治性前列腺切除术(RARP)中使用Proximie作为一步一步的指南。使用HDMI电缆连接Intuitive Surgical塔,显示控制台的输出显示和额外的腹腔镜塔。每个网络摄像头都安装在控制台的侧扶手上,对准外科医生的手。通过左侧上象限额外5mm的端口使用独立的“插入”腹腔镜。观察者可以在笔记本电脑和/或智能手机上可视化AR平台的记录。PTZ (pan-tilt-zoom)摄像机可以捕捉手术室、床边助手、端口和病人的位置。我们的视频展示了相对于翻译机器人步骤的姿势、前臂、手腕、手和手指方向的四个摄像机视图中的三个。钳式腕内机械手在吻合过程中可以实现最佳的机械手腕旋转。第二次腹腔镜相机视图显示机器人手臂的体腔角度和床边助手的器械位置,用于神经保留和吻合等关键步骤(3)。控制台时间为100分钟,使用该平台未发生术中并发症或图像传输延迟。注意事项:AR平台可以在实时或录制会话中为RARP创建更深入的学习。双向口头和视觉交流,能够在屏幕上注释,允许远程指导。该平台的实用功能可以在任何地方访问,以预测外科医生的直接环境。这允许进入高容量机构的民主化及其技术的发展(4),以帮助全球患者。潜在的发展是人工智能(AI)网络分析这些记录数据的存储库,以识别术中手部运动和机器人仪器跟踪。增强现实是增强机器人训练、技能传播、精准医疗(5)和外科手术的相关组成部分。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Advocating hormonal treatment to prevent adult infertility in patients diagnosed with congenital undescended testes REPLY TO THE AUTHORS: Re: One-day voiding diary in the evaluation of Lower Urinary Tract Symptoms in children Vesical imaging reporting and data system (VI-RADS) in bladder cancer diagnosis in review in this number of International Brazilian Journal of Urology The evolution of stress urinary incontinence treatment techniques of the last three decades Impact of artificial urinary sphincter erosion in the reimplantation of the device
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1