首页 > 最新文献

2023 International Symposium on Medical Robotics (ISMR)最新文献

英文 中文
cHand: Open Source Hand Posture Visualization in CHAI3D cHand: CHAI3D中的开源手部姿势可视化
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130196
Edoardo Battaglia, A. M. Fey
Visualization of hand movement is an important part of many medical training, VR and haptic experiences, which researchers typically address by developing application specific hand visualization tools. While some existing simulators allow for hand kinematic visualization using a generic hand model, they are usual targeted for robotic grasp planning rather than designed specifically for rendering in applications that include haptic experiences. To fill this gap, in this paper we present cHand, an extension of the haptics software library CHAI3D, that enables hand kinematic visualization of an arbitrary hand model. A representation of the hand can be achieved with elementary geometric shapes that are provided by CHAI3D, or with custom geometries loaded from STL files. We release cHand as an open source contribution to keep with the open source nature of CHAI3D, and present a tutorial on its use in this manuscript.
手部运动的可视化是许多医疗培训、VR和触觉体验的重要组成部分,研究人员通常通过开发特定应用的手部可视化工具来解决这一问题。虽然一些现有的模拟器允许使用通用的手部模型进行手部运动可视化,但它们通常是针对机器人抓取规划而不是专门为包括触觉体验在内的应用程序的渲染而设计的。为了填补这一空白,在本文中,我们提出了cHand,这是触觉软件库CHAI3D的扩展,可以实现任意手部模型的手部运动学可视化。手的表示可以用CHAI3D提供的基本几何形状来实现,或者用从STL文件加载的自定义几何形状来实现。我们将cHand作为开源贡献发布,以保持CHAI3D的开源性质,并在此手稿中提供有关其使用的教程。
{"title":"cHand: Open Source Hand Posture Visualization in CHAI3D","authors":"Edoardo Battaglia, A. M. Fey","doi":"10.1109/ISMR57123.2023.10130196","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130196","url":null,"abstract":"Visualization of hand movement is an important part of many medical training, VR and haptic experiences, which researchers typically address by developing application specific hand visualization tools. While some existing simulators allow for hand kinematic visualization using a generic hand model, they are usual targeted for robotic grasp planning rather than designed specifically for rendering in applications that include haptic experiences. To fill this gap, in this paper we present cHand, an extension of the haptics software library CHAI3D, that enables hand kinematic visualization of an arbitrary hand model. A representation of the hand can be achieved with elementary geometric shapes that are provided by CHAI3D, or with custom geometries loaded from STL files. We release cHand as an open source contribution to keep with the open source nature of CHAI3D, and present a tutorial on its use in this manuscript.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115304504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Using a Force-Controlled Robot for Probing-Based Registration and Automated Bone Drilling in Pedicle Screw Placement Procedures 在椎弓根螺钉置入过程中使用力控制机器人进行基于探针的配准和自动骨钻孔
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130247
Saman Vafadar, Elie Saghbiny, Antoine Harlé, G. Morel
Pedicle screw placement is a crucial phase in various spine surgical procedures. In the recent years, robotic solutions have been proposed to assist it. They require intra-operative registration based on CT or fluoroscopic imaging, raising risks for patients and surgeons. In this study, we investigated registration methods that remove the need for intraoperative imaging. They involve a robot holding a mechanical probe whose tip contacts the bone at sparse locations. This involves either surgeon's manual guidance, or automatic force-control based probing. Further, once the anatomy is registered, we automate the entire process, including the pedicle preparation and drilling, with the same force controlled robot. Ten drillings were performed in five lumbar vertebrae of a porcine sample using a custom-designed instrument mounted on the robot's end-effector. Preoprative and postoperative scans were performed to evaluate the registrations and drillings quantitatively. The mean difference between the planned and postop-measured drilling orientations was $2.2^{circ} ({text{Max}}. 4.4^{circ})$. The mean distance between the planned entry points and the postop-measured drilling paths was $2.2 mm (text{Max}. 4.1 mm)$. These results open perspectives for X-ray free robotic operations and pedicle screw placement automation.
椎弓根螺钉放置是各种脊柱外科手术的关键阶段。近年来,已经提出了机器人解决方案来辅助它。它们需要基于CT或透视成像的术中登记,这增加了患者和外科医生的风险。在本研究中,我们研究了不需要术中成像的配准方法。他们需要一个机器人拿着一个机械探针,探针的尖端接触骨头的稀疏位置。这包括外科医生的手动指导,或自动力控制为基础的探测。此外,一旦解剖注册,我们自动化整个过程,包括椎弓根准备和钻孔,用相同的力控制机器人。使用安装在机器人末端执行器上的定制设计的仪器在猪样本的五个腰椎上进行了10次钻孔。术前和术后扫描定量评估配位和钻孔。计划和停止后测量的钻井方向之间的平均差异为$2.2^{circ} ({text{Max}})。美元 4.4 ^{保监会})。计划进入点与停止后测量的钻井路径之间的平均距离为220毫米。 4.1 mm)$。这些结果为无x射线机器人手术和椎弓根螺钉放置自动化开辟了前景。
{"title":"Using a Force-Controlled Robot for Probing-Based Registration and Automated Bone Drilling in Pedicle Screw Placement Procedures","authors":"Saman Vafadar, Elie Saghbiny, Antoine Harlé, G. Morel","doi":"10.1109/ISMR57123.2023.10130247","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130247","url":null,"abstract":"Pedicle screw placement is a crucial phase in various spine surgical procedures. In the recent years, robotic solutions have been proposed to assist it. They require intra-operative registration based on CT or fluoroscopic imaging, raising risks for patients and surgeons. In this study, we investigated registration methods that remove the need for intraoperative imaging. They involve a robot holding a mechanical probe whose tip contacts the bone at sparse locations. This involves either surgeon's manual guidance, or automatic force-control based probing. Further, once the anatomy is registered, we automate the entire process, including the pedicle preparation and drilling, with the same force controlled robot. Ten drillings were performed in five lumbar vertebrae of a porcine sample using a custom-designed instrument mounted on the robot's end-effector. Preoprative and postoperative scans were performed to evaluate the registrations and drillings quantitatively. The mean difference between the planned and postop-measured drilling orientations was $2.2^{circ} ({text{Max}}. 4.4^{circ})$. The mean distance between the planned entry points and the postop-measured drilling paths was $2.2 mm (text{Max}. 4.1 mm)$. These results open perspectives for X-ray free robotic operations and pedicle screw placement automation.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"82 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122399441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Trimodal Framework for Robot-Assisted Vascular Shunt Insertion When a Supervising Surgeon is Local, Remote, or Unavailable 当监督外科医生在本地、远程或不可用时,机器人辅助血管分流插入的三模式框架
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130195
K. Dharmarajan, Will Panitch, Baiyu Shi, Huang Huang, Lawrence Yunliang Chen, Thomas Low, Danyal Fer, Ken Goldberg
Vascular shunt insertion is a common surgical procedure requiring a surgeon-and-surgical-assistant team performed to temporarily restore blood flow to damaged tissues. Robotic assistance for this procedure is challenging due to precision and control uncertainty. The role of the robot in this task depends on the availability of a human surgeon. We propose a trimodal framework for vascular shunt insertion assisted by a dVRK robotic surgical assistant. We consider three scenarios: (1) a surgeon is available locally; (2) a remote surgeon is available via teleoperation; (3) no surgeon is available. In each scenario, the robot operates in a different mode either by teleoperation or automation. For mode (1), a learned visual servoing policy is proposed for vessel grasping. Physical experiments demonstrate a success rate of 70%-100% for mode (1), 100% for mode (2), and 80%-95% for mode (3).
血管分流插入是一种常见的外科手术,需要一个外科医生和外科助理团队来暂时恢复血液流向受损组织。由于精度和控制的不确定性,机器人辅助这一过程具有挑战性。机器人在这项任务中的作用取决于人类外科医生的可用性。我们提出了一个由dVRK机器人手术助手辅助的血管分流插入的三模框架。我们考虑三种情况:(1)当地有外科医生;(2)可通过远程手术获得远程外科医生;(3)没有外科医生可用。在每种情况下,机器人都以不同的模式操作,要么是远程操作,要么是自动操作。对于模式(1),提出了一种学习的视觉伺服策略用于船舶抓取。物理实验表明,模式(1)的成功率为70% ~ 100%,模式(2)为100%,模式(3)为80% ~ 95%。
{"title":"A Trimodal Framework for Robot-Assisted Vascular Shunt Insertion When a Supervising Surgeon is Local, Remote, or Unavailable","authors":"K. Dharmarajan, Will Panitch, Baiyu Shi, Huang Huang, Lawrence Yunliang Chen, Thomas Low, Danyal Fer, Ken Goldberg","doi":"10.1109/ISMR57123.2023.10130195","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130195","url":null,"abstract":"Vascular shunt insertion is a common surgical procedure requiring a surgeon-and-surgical-assistant team performed to temporarily restore blood flow to damaged tissues. Robotic assistance for this procedure is challenging due to precision and control uncertainty. The role of the robot in this task depends on the availability of a human surgeon. We propose a trimodal framework for vascular shunt insertion assisted by a dVRK robotic surgical assistant. We consider three scenarios: (1) a surgeon is available locally; (2) a remote surgeon is available via teleoperation; (3) no surgeon is available. In each scenario, the robot operates in a different mode either by teleoperation or automation. For mode (1), a learned visual servoing policy is proposed for vessel grasping. Physical experiments demonstrate a success rate of 70%-100% for mode (1), 100% for mode (2), and 80%-95% for mode (3).","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129439931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling Tendon-actuated Concentric Tube Robots 肌腱驱动同心管机器人建模
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130176
Yash Chitalia, A. Donder, P. Dupont
Mechanics-based models have been developed to describe the shape of tendon-actuated continuum robots. Models have also been developed to describe the shape of concentric tube robots, i.e., nested combinations of precurved superelastic tubes. While an important class of continuum robots used in endoscopic and intracardiac medical applications combines these two designs, existing models do not cover this combination. Tendon-actuated models are limited to a single tube while concentric tube models do not include tendon-produced forces and moments. This paper derives a mechanics-based model for this hybrid design and assesses it using numerical and physical experiments involving a pair of tendon-actuated tubes. It is demonstrated that, similar to concentric tube robots, relative twisting between the tendon-actuated tubes is an important factor in determining overall robot shape.
基于力学的模型已经发展到描述肌腱驱动连续体机器人的形状。模型也被开发来描述同心管机器人的形状,即预弯曲超弹性管的嵌套组合。虽然在内窥镜和心脏内医疗应用中使用的一类重要的连续体机器人结合了这两种设计,但现有的模型并未涵盖这种组合。肌腱驱动模型仅限于单个管,而同心管模型不包括肌腱产生的力和力矩。本文为这种混合设计导出了一个基于力学的模型,并使用涉及一对肌腱驱动管的数值和物理实验对其进行了评估。研究表明,与同心管机器人类似,肌腱驱动管之间的相对扭转是决定机器人整体形状的重要因素。
{"title":"Modeling Tendon-actuated Concentric Tube Robots","authors":"Yash Chitalia, A. Donder, P. Dupont","doi":"10.1109/ISMR57123.2023.10130176","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130176","url":null,"abstract":"Mechanics-based models have been developed to describe the shape of tendon-actuated continuum robots. Models have also been developed to describe the shape of concentric tube robots, i.e., nested combinations of precurved superelastic tubes. While an important class of continuum robots used in endoscopic and intracardiac medical applications combines these two designs, existing models do not cover this combination. Tendon-actuated models are limited to a single tube while concentric tube models do not include tendon-produced forces and moments. This paper derives a mechanics-based model for this hybrid design and assesses it using numerical and physical experiments involving a pair of tendon-actuated tubes. It is demonstrated that, similar to concentric tube robots, relative twisting between the tendon-actuated tubes is an important factor in determining overall robot shape.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127931749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
An Evaluation Platform for Catheter Ablation Navigation 导管消融导航评价平台
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130271
Florian Heemeyer, C. Chautems, Q. Boehler, J. Merino, Bradley J. Nelson
Cardiac arrhythmia refers to a condition of an abnormal or irregular heartbeat, which usually results in disturbed blood flow. This can lead to a reduced cardiac output and an increased risk for blood clot formation, which can cause life-threatening heart failure or stroke. Radio-frequency catheter ablation is becoming the treatment of choice for most cardiac arrhythmias. To recover the normal heartbeat, the abnormal excitation sites inside the heart are first identified and then isolated or destroyed by applying radio-frequency energy through the use of an ablation catheter. The design and precise navigation of these ablation catheters is currently a topic of considerable interest. However, the lack of a standardized evaluation setup for catheter ablation makes it challenging to properly compare different systems. In this paper, we present an evaluation platform to tackle this problem. The setup consists of a 3D printed anatomical model, a tracking system for the catheter and a dedicated graphical user interface. The performance of a catheter ablation system can then be assessed based on various performance metrics, such as the procedure duration, contact stability or the ablation angle. Finally, we conduct a proof-of-concept study to demonstrate the usefulness of the proposed setup.
心律失常是指一种异常或不规则的心跳状态,通常会导致血流紊乱。这可能导致心排血量减少和血栓形成的风险增加,从而导致危及生命的心力衰竭或中风。射频导管消融正在成为大多数心律失常的治疗选择。为了恢复正常的心跳,首先确定心脏内部的异常兴奋部位,然后通过使用消融导管施加射频能量来隔离或破坏。这些消融导管的设计和精确导航目前是一个相当感兴趣的话题。然而,缺乏导管消融的标准化评估设置使得正确比较不同系统具有挑战性。在本文中,我们提出了一个评估平台来解决这个问题。该装置由3D打印解剖模型、导管跟踪系统和专用图形用户界面组成。导管消融系统的性能可以根据各种性能指标进行评估,如手术持续时间、接触稳定性或消融角度。最后,我们进行了概念验证研究,以证明所提出设置的有用性。
{"title":"An Evaluation Platform for Catheter Ablation Navigation","authors":"Florian Heemeyer, C. Chautems, Q. Boehler, J. Merino, Bradley J. Nelson","doi":"10.1109/ISMR57123.2023.10130271","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130271","url":null,"abstract":"Cardiac arrhythmia refers to a condition of an abnormal or irregular heartbeat, which usually results in disturbed blood flow. This can lead to a reduced cardiac output and an increased risk for blood clot formation, which can cause life-threatening heart failure or stroke. Radio-frequency catheter ablation is becoming the treatment of choice for most cardiac arrhythmias. To recover the normal heartbeat, the abnormal excitation sites inside the heart are first identified and then isolated or destroyed by applying radio-frequency energy through the use of an ablation catheter. The design and precise navigation of these ablation catheters is currently a topic of considerable interest. However, the lack of a standardized evaluation setup for catheter ablation makes it challenging to properly compare different systems. In this paper, we present an evaluation platform to tackle this problem. The setup consists of a 3D printed anatomical model, a tracking system for the catheter and a dedicated graphical user interface. The performance of a catheter ablation system can then be assessed based on various performance metrics, such as the procedure duration, contact stability or the ablation angle. Finally, we conduct a proof-of-concept study to demonstrate the usefulness of the proposed setup.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132362139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Markerless Suture Needle Tracking From A Robotic Endoscope Based On Deep Learning 基于深度学习的机器人内窥镜无标记缝合针跟踪
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130199
Yiwei Jiang, Haoying Zhou, G. Fischer
Advancements in robot-assisted surgery have been rapidly growing since two decades ago. More recently, the automation of robotic surgical tasks has become the focus of research. In this area, the detection and tracking of a surgical tool are crucial for an autonomous system to plan and perform a procedure. For example, knowing the position and posture of a needle is a prerequisite for an automatic suturing system to grasp it and perform suturing tasks. In this paper, we proposed a novel method, based on Deep Learning and Point-to-point Registration, to track the 6 degrees of freedom (DOF) pose of a metal suture needle from a robotic endoscope (an Endoscopic Camera Manipulator from the da Vinci Robotic Surgical Systems), without the help of any marker. The proposed approach was implemented and evaluated in a standard simulated surgical environment provided by the 2021–2022 AccelNet Surgical Robotics Challenge, thus demonstrates the potential to be translated into a real-world scenario. A customized dataset containing 836 images collected from the simulated scene with ground truth of poses and key points information was constructed to train the neural network model. The best pipeline achieved an average position error of 1.76 mm while the average orientation error is 8.55 degrees, and it can run up to 10 Hz on a PC.
自二十年前以来,机器人辅助手术的进展一直在迅速发展。最近,机器人手术任务的自动化已成为研究的焦点。在这一领域,检测和跟踪手术工具对于自主系统计划和执行手术至关重要。例如,了解针的位置和姿势是自动缝合系统掌握针并执行缝合任务的先决条件。在本文中,我们提出了一种基于深度学习和点对点配准的新方法,在没有任何标记的情况下,从机器人内窥镜(达芬奇机器人手术系统的内窥镜相机机械手)跟踪金属缝合线针的6个自由度(DOF)姿态。该方法在2021-2022年AccelNet外科机器人挑战赛提供的标准模拟手术环境中进行了实施和评估,从而证明了将其转化为现实世界场景的潜力。从模拟场景中采集836张图像,构建包含姿态和关键点信息的自定义数据集来训练神经网络模型。最佳管道的平均位置误差为1.76 mm,平均方向误差为8.55°,在PC机上运行频率可达10 Hz。
{"title":"Markerless Suture Needle Tracking From A Robotic Endoscope Based On Deep Learning","authors":"Yiwei Jiang, Haoying Zhou, G. Fischer","doi":"10.1109/ISMR57123.2023.10130199","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130199","url":null,"abstract":"Advancements in robot-assisted surgery have been rapidly growing since two decades ago. More recently, the automation of robotic surgical tasks has become the focus of research. In this area, the detection and tracking of a surgical tool are crucial for an autonomous system to plan and perform a procedure. For example, knowing the position and posture of a needle is a prerequisite for an automatic suturing system to grasp it and perform suturing tasks. In this paper, we proposed a novel method, based on Deep Learning and Point-to-point Registration, to track the 6 degrees of freedom (DOF) pose of a metal suture needle from a robotic endoscope (an Endoscopic Camera Manipulator from the da Vinci Robotic Surgical Systems), without the help of any marker. The proposed approach was implemented and evaluated in a standard simulated surgical environment provided by the 2021–2022 AccelNet Surgical Robotics Challenge, thus demonstrates the potential to be translated into a real-world scenario. A customized dataset containing 836 images collected from the simulated scene with ground truth of poses and key points information was constructed to train the neural network model. The best pipeline achieved an average position error of 1.76 mm while the average orientation error is 8.55 degrees, and it can run up to 10 Hz on a PC.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124067517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards the development of a MEMS-based force sensor for in vivo tumor tissue demarcation 基于mems的体内肿瘤组织标定力传感器的研制
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130220
Nidhi Malhotra, Kimberly Hoang, J. Desai
Surgical resection is one of the primary treatments for patients with brain tumors. The precise detection of tumor tissue margin during the resection procedure ensures safe maximal removal of the tumor tissue while protecting the surrounding healthy, functional tissue. Micro-electro-mechanical-system (MEMS)-based sensors with high sensitivity and small footprint can enable reliable intraoperative in vivo tumor margin assessment, quantitatively distinguishing between normal and abnormal tissue. In this paper, we present the design of a MEMS-based piezoresistive force sensor integrated into a steerable robotic probe. The sensor design optimization, microfabrication process flow, and packaging methodology are presented. The characterization process of the diaphragm-based piezoresistive sensor using a commercial force sensor and an indentation system is described. The sensor can measure forces in the range of 0-0.3N, and the packaged sensor is within 2 mm diameter. The sensor's output shows a linear response with force, and the sensor has a maximum hysteresis of 5.58 %.
手术切除是脑肿瘤患者的主要治疗方法之一。在切除过程中精确检测肿瘤组织边缘,确保最大限度地安全切除肿瘤组织,同时保护周围健康的功能组织。基于微机电系统(MEMS)的传感器灵敏度高,占地面积小,可实现可靠的术中活体肿瘤边缘评估,定量区分正常和异常组织。在本文中,我们提出了一个基于mems的压阻式力传感器集成到一个可操纵的机器人探针的设计。介绍了传感器的优化设计、微加工工艺流程和封装方法。描述了利用商用力传感器和压痕系统对膜片压阻式传感器进行表征的过程。该传感器可以测量0-0.3N范围内的力,封装的传感器直径在2mm以内。传感器的输出与力呈线性响应,传感器的最大迟滞为5.58%。
{"title":"Towards the development of a MEMS-based force sensor for in vivo tumor tissue demarcation","authors":"Nidhi Malhotra, Kimberly Hoang, J. Desai","doi":"10.1109/ISMR57123.2023.10130220","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130220","url":null,"abstract":"Surgical resection is one of the primary treatments for patients with brain tumors. The precise detection of tumor tissue margin during the resection procedure ensures safe maximal removal of the tumor tissue while protecting the surrounding healthy, functional tissue. Micro-electro-mechanical-system (MEMS)-based sensors with high sensitivity and small footprint can enable reliable intraoperative in vivo tumor margin assessment, quantitatively distinguishing between normal and abnormal tissue. In this paper, we present the design of a MEMS-based piezoresistive force sensor integrated into a steerable robotic probe. The sensor design optimization, microfabrication process flow, and packaging methodology are presented. The characterization process of the diaphragm-based piezoresistive sensor using a commercial force sensor and an indentation system is described. The sensor can measure forces in the range of 0-0.3N, and the packaged sensor is within 2 mm diameter. The sensor's output shows a linear response with force, and the sensor has a maximum hysteresis of 5.58 %.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129173862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards Reliable Colorectal Cancer Polyps Classification via Vision Based Tactile Sensing and Confidence-Calibrated Neural Networks 基于视觉触觉和置信度校准的神经网络对结直肠癌息肉的可靠分类
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130197
Siddhartha Kapuria, Tarunraj G. Mohanraj, Nethra Venkatayogi, Ozdemir Can Kara, Y. Hirata, P. Minot, Ariel Kapusta, N. Ikoma, F. Alambeigi
In this study, toward addressing the over-confident outputs of existing artificial intelligence-based colorectal cancer (CRC) polyp classification techniques, we propose a confidence-calibrated residual neural network. Utilizing a novel vision-based tactile sensing (VS-TS) system and unique CRC polyp phantoms, we demonstrate that traditional metrics such as accuracy and precision are not sufficient to encapsulate model performance for handling a sensitive CRC polyp diagnosis. To this end, we develop a residual neural network classifier and address its over-confident outputs for CRC polyps classification via the post-processing method of temperature scaling. To evaluate the proposed method, we introduce noise and blur to the obtained textural images of the VSTS and test the model's reliability for non-ideal inputs through reliability diagrams and other statistical metrics.
在本研究中,为了解决现有基于人工智能的结直肠癌(CRC)息肉分类技术的过度自信输出,我们提出了一个置信度校准的残差神经网络。利用一种新颖的基于视觉的触觉传感(VS-TS)系统和独特的CRC息肉幻象,我们证明了传统的指标,如准确性和精度不足以封装模型的性能,以处理敏感的CRC息肉诊断。为此,我们开发了一个残差神经网络分类器,并通过温度缩放的后处理方法解决了CRC息肉分类的过度自信输出。为了评估所提出的方法,我们在获得的VSTS纹理图像中引入噪声和模糊,并通过可靠性图和其他统计指标测试模型对非理想输入的可靠性。
{"title":"Towards Reliable Colorectal Cancer Polyps Classification via Vision Based Tactile Sensing and Confidence-Calibrated Neural Networks","authors":"Siddhartha Kapuria, Tarunraj G. Mohanraj, Nethra Venkatayogi, Ozdemir Can Kara, Y. Hirata, P. Minot, Ariel Kapusta, N. Ikoma, F. Alambeigi","doi":"10.1109/ISMR57123.2023.10130197","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130197","url":null,"abstract":"In this study, toward addressing the over-confident outputs of existing artificial intelligence-based colorectal cancer (CRC) polyp classification techniques, we propose a confidence-calibrated residual neural network. Utilizing a novel vision-based tactile sensing (VS-TS) system and unique CRC polyp phantoms, we demonstrate that traditional metrics such as accuracy and precision are not sufficient to encapsulate model performance for handling a sensitive CRC polyp diagnosis. To this end, we develop a residual neural network classifier and address its over-confident outputs for CRC polyps classification via the post-processing method of temperature scaling. To evaluate the proposed method, we introduce noise and blur to the obtained textural images of the VSTS and test the model's reliability for non-ideal inputs through reliability diagrams and other statistical metrics.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125528753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Development of Robot-assisted Ultrasound System for Fetoscopic Tracking in Twin to Twin Transfusion Syndrome Surgery 双胎输血综合征手术中胎儿镜跟踪机器人辅助超声系统的研制
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130208
Yuyu Cai, Ayoob Davoodi, Ruixuan Li, M. Ourak, K. Niu, J. Deprest, E. V. Poorten
Twin to Twin Transfusion Syndrome (TTTS) is one of the most severe conditions of congenital anomaly. Fetoscopic Laser Photocoagulation (FLP) has been shown as the preferred treatment for TTTS. The complicated intrauterine environment and limited incision diameter make FLP a very challenging surgery. Besides, the motion of the fetoscope is complex. Ultrasound (US) probe is used to offer a view of the anatomy as well as the relative pose of the fetoscope. However, keeping the fetoscope tip (FT) in view is difficult. A robotic US system could potentially solve the complex US probe handling and could improve the surgeon's view of the intrauterine scene. In this paper, an automatic fetoscope tracking algorithm was developed and ensured safe interactions between robot and fragile tissues for FLP surgery. The US probe attached to the robot was controlled by a hybrid position-force control strategy. For evaluation, four fetoscope motion profiles were investigated on a custom-designed phantom. The system achieved a 78.87% visibility rate for the US image evaluation. The contact force was 0.99± 0.68 N during the tracking to ensure the patient's safety. The proposed system demonstrates the capability of accurate real-time fetoscope tracking.
双胞胎输血综合征(TTTS)是最严重的先天性异常之一。胎儿镜激光光凝(FLP)已被证明是治疗TTTS的首选方法。复杂的宫内环境和有限的切口直径使FLP成为一种非常具有挑战性的手术。此外,胎儿镜的运动是复杂的。超声(US)探头用于提供解剖视图以及胎儿镜的相对姿势。然而,保持胎儿镜尖端(FT)在视线内是困难的。机器人美国系统可能解决复杂的美国探头操作,并可以改善外科医生对宫内场景的看法。本文开发了一种胎儿镜自动跟踪算法,保证了FLP手术中机器人与脆弱组织的安全交互。附着在机器人上的美国探针由位置-力混合控制策略控制。为了评估,在定制设计的假体上研究了四个胎儿镜运动曲线。该系统在美国图像评估中实现了78.87%的可见性。跟踪过程中接触力为0.99±0.68 N,确保患者安全。该系统显示了胎儿镜精确实时跟踪的能力。
{"title":"Development of Robot-assisted Ultrasound System for Fetoscopic Tracking in Twin to Twin Transfusion Syndrome Surgery","authors":"Yuyu Cai, Ayoob Davoodi, Ruixuan Li, M. Ourak, K. Niu, J. Deprest, E. V. Poorten","doi":"10.1109/ISMR57123.2023.10130208","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130208","url":null,"abstract":"Twin to Twin Transfusion Syndrome (TTTS) is one of the most severe conditions of congenital anomaly. Fetoscopic Laser Photocoagulation (FLP) has been shown as the preferred treatment for TTTS. The complicated intrauterine environment and limited incision diameter make FLP a very challenging surgery. Besides, the motion of the fetoscope is complex. Ultrasound (US) probe is used to offer a view of the anatomy as well as the relative pose of the fetoscope. However, keeping the fetoscope tip (FT) in view is difficult. A robotic US system could potentially solve the complex US probe handling and could improve the surgeon's view of the intrauterine scene. In this paper, an automatic fetoscope tracking algorithm was developed and ensured safe interactions between robot and fragile tissues for FLP surgery. The US probe attached to the robot was controlled by a hybrid position-force control strategy. For evaluation, four fetoscope motion profiles were investigated on a custom-designed phantom. The system achieved a 78.87% visibility rate for the US image evaluation. The contact force was 0.99± 0.68 N during the tracking to ensure the patient's safety. The proposed system demonstrates the capability of accurate real-time fetoscope tracking.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131742465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modelisation of a Human-Exoskeleton Interaction for Cerebral Palsy 脑性麻痹的人-外骨骼相互作用建模
Pub Date : 2023-04-19 DOI: 10.1109/ISMR57123.2023.10130232
Aurélie Bonnefoy, Sabrina Otmani, N. Mansard, O. Stasse, G. Michon, B. Watier
This paper presents a method to model a human-exoskeleton interaction for patients suffering from spastic cerebral palsy. We base our work on the Clinical Gait Analysis performed on two 9-year-old twin sisters. The first sister has a pathology called spastic cerebral palsy, while the second sister is non-pathological without any impairment. This paper aims at determining the proportion of the walking efforts that can be supported by an exoskeleton in order to allow a pathological child gait to converge toward a non-pathological one. Based on experimental data, a model of the pathological gait reconstructed using an optimal estimation. The model relies on mechanical differential equations of motion. The interaction between the human and the exoskeleton is then modelled using optimal control, while modelling ground contacts. Results show that the human produced joint torques are within the possible torque range of the child with cerebral palsy, which justifies the use of an exoskeleton to correct a pathological gait. The code for running the simulations is provided in open source.
本文提出了一种方法来模拟人外骨骼相互作用的患者患有痉挛性脑瘫。我们的工作基于对两个9岁双胞胎姐妹进行的临床步态分析。第一个姐姐有一种叫做痉挛性脑瘫的病理,而第二个姐姐没有任何损伤。本文旨在确定外骨骼可以支持的步行努力的比例,以便允许病理性儿童的步态收敛于非病理性儿童的步态。在实验数据的基础上,利用最优估计重构了病理步态模型。该模型依赖于运动的力学微分方程。人与外骨骼之间的相互作用,然后使用最优控制建模,同时模拟地面接触。结果表明,人类产生的关节扭矩在脑瘫儿童可能的扭矩范围内,这证明了使用外骨骼来纠正病理步态是合理的。运行模拟的代码是开源的。
{"title":"Modelisation of a Human-Exoskeleton Interaction for Cerebral Palsy","authors":"Aurélie Bonnefoy, Sabrina Otmani, N. Mansard, O. Stasse, G. Michon, B. Watier","doi":"10.1109/ISMR57123.2023.10130232","DOIUrl":"https://doi.org/10.1109/ISMR57123.2023.10130232","url":null,"abstract":"This paper presents a method to model a human-exoskeleton interaction for patients suffering from spastic cerebral palsy. We base our work on the Clinical Gait Analysis performed on two 9-year-old twin sisters. The first sister has a pathology called spastic cerebral palsy, while the second sister is non-pathological without any impairment. This paper aims at determining the proportion of the walking efforts that can be supported by an exoskeleton in order to allow a pathological child gait to converge toward a non-pathological one. Based on experimental data, a model of the pathological gait reconstructed using an optimal estimation. The model relies on mechanical differential equations of motion. The interaction between the human and the exoskeleton is then modelled using optimal control, while modelling ground contacts. Results show that the human produced joint torques are within the possible torque range of the child with cerebral palsy, which justifies the use of an exoskeleton to correct a pathological gait. The code for running the simulations is provided in open source.","PeriodicalId":276757,"journal":{"name":"2023 International Symposium on Medical Robotics (ISMR)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132728655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2023 International Symposium on Medical Robotics (ISMR)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1