首页 > 最新文献

2021 International Symposium on Medical Robotics (ISMR)最新文献

英文 中文
An Everting Emergency Airway Device 一种应急气道装置
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661552
Joel Hwee, Andrew Lewis, R. Bly, K. Moe, B. Hannaford
Emergency airway management is a challenging procedure essential in trauma settings. This paper proposes a dual balloon, everting airway device that autonomously deploys into the patient’s airway. Its compact size and reliable automatic deployment make it ideal for bystander use. The dual balloon design allows it to deploy into the esophagus or trachea. Everted tubes are growing soft robots that excel in the exploration of irregular and sensitive environments. Eversion gives the proposed device a passive mechanical intelligence allowing it to enter the patient’s airway without heading control. These initial studies aim to demonstrate the feasibility, safety, and efficacy of such a device by characterizing the following: minimum pressures and forces required to deploy individual components; the effects of airway anatomy on growth; and the ability to provide a seal using elastic balloons. Results show the device exerts 28% less force during insertion than laryngeal mask approaches and 82% less force than commercial laryngoscopes. In a simplified airway, the novel everted balloon configurations show 1:1 Cuff Pressure (CP) to Airway Pressure (AWP) sealing efficacy and supply airway pressures comparable with airway pressures supplied using a ventilator. Balloons are able to seal with cuff pressures that do not limit mucosal perfusion.
急诊气道管理是一个具有挑战性的程序必不可少的创伤设置。本文提出了一种双气囊,可自动部署到患者气道的气道装置。其紧凑的尺寸和可靠的自动部署使其成为旁观者使用的理想选择。双气囊的设计允许它进入食道或气管。凸出的管子是正在成长的软体机器人,它们擅长探索不规则和敏感的环境。Eversion为该设备提供了一种被动的机械智能,使其无需头部控制即可进入患者的气道。这些初步研究旨在通过以下特征来证明这种装置的可行性、安全性和有效性:部署单个组件所需的最小压力和力;气道解剖对生长的影响以及使用弹性气球提供密封的能力。结果表明,该装置在插入时施加的力比喉罩入路小28%,比商用喉镜小82%。在简化的气道中,新型的外翻气囊结构显示出1:1的袖带压力(CP)与气道压力(AWP)的密封效果,并且提供的气道压力与使用呼吸机提供的气道压力相当。气囊能够在不限制粘膜灌注的袖带压力下密封。
{"title":"An Everting Emergency Airway Device","authors":"Joel Hwee, Andrew Lewis, R. Bly, K. Moe, B. Hannaford","doi":"10.1109/ismr48346.2021.9661552","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661552","url":null,"abstract":"Emergency airway management is a challenging procedure essential in trauma settings. This paper proposes a dual balloon, everting airway device that autonomously deploys into the patient’s airway. Its compact size and reliable automatic deployment make it ideal for bystander use. The dual balloon design allows it to deploy into the esophagus or trachea. Everted tubes are growing soft robots that excel in the exploration of irregular and sensitive environments. Eversion gives the proposed device a passive mechanical intelligence allowing it to enter the patient’s airway without heading control. These initial studies aim to demonstrate the feasibility, safety, and efficacy of such a device by characterizing the following: minimum pressures and forces required to deploy individual components; the effects of airway anatomy on growth; and the ability to provide a seal using elastic balloons. Results show the device exerts 28% less force during insertion than laryngeal mask approaches and 82% less force than commercial laryngoscopes. In a simplified airway, the novel everted balloon configurations show 1:1 Cuff Pressure (CP) to Airway Pressure (AWP) sealing efficacy and supply airway pressures comparable with airway pressures supplied using a ventilator. Balloons are able to seal with cuff pressures that do not limit mucosal perfusion.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116703366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Towards an Active Ankle-Foot Prosthesis Powered by Dielectric Elastomer Actuators in Antagonistic Pairs 电介质弹性体作动器拮抗驱动的主动踝足假体研究
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661530
Guilherme L. Novelli, R. Andrade
The field of lower limb prosthetics is heading towards active devices, considering the complications that arise from their passive counterparts, such as higher metabolic consumption and abnormal gait patterns. Prosthetic devices, especially those ones subject to high impact, must exhibit a certain level of compliance and shock absorbance. Due to their inherent compliance, soft actuators are promising for applications in bionics. Among these, Dielectric Elastomer Actuators (DEAs) stand out, by virtue of their high energy density, high actuation strains, and fast response, making them suitable for applications as artificial muscles. In this work, we assessed the application of DEAs in an antagonistic pair configuration to an ankle-foot prosthesis. First, we modeled the nonlinear viscoelastic behavior of a single pair of coupled planar actuators. Then, artificial muscles constituted of several stacked DEAs were dimensioned to completely meet the ankle torque-angle curves, and therefore cover the range of ankle torsional stiffness in each phase of the gait cycle. A model-based approach combined with a proportional-integral (PI) controller performed well in simulations to reproduce the torque of the ankle joint by controlling the applied voltage in the antagonist muscle. The final structure enables remarkably lightweight prostheses when compared to conventional active transtibial prostheses.
考虑到被动假肢的并发症,如更高的代谢消耗和异常的步态模式,下肢假肢领域正朝着主动设备的方向发展。假体装置,特别是那些受到高冲击的,必须表现出一定程度的顺应性和减震性。由于其固有的顺应性,软致动器在仿生学中有着广阔的应用前景。其中,介电弹性体致动器(dea)因其高能量密度、高致动应变和快速响应而脱颖而出,使其适用于人造肌肉的应用。在这项工作中,我们评估了DEAs在拮抗对配置中对踝足假体的应用。首先,建立了单对耦合平面作动器的非线性粘弹性模型。然后,对由多个dea叠加而成的人工肌肉进行尺寸规划,使其完全满足踝关节扭角曲线,从而覆盖步态周期各阶段踝关节扭刚度的范围。基于模型的方法与比例积分(PI)控制器相结合,通过控制拮抗剂肌肉的施加电压来重现踝关节的扭矩,在仿真中表现良好。与传统的主动跨胫假体相比,最终的结构使假体非常轻。
{"title":"Towards an Active Ankle-Foot Prosthesis Powered by Dielectric Elastomer Actuators in Antagonistic Pairs","authors":"Guilherme L. Novelli, R. Andrade","doi":"10.1109/ismr48346.2021.9661530","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661530","url":null,"abstract":"The field of lower limb prosthetics is heading towards active devices, considering the complications that arise from their passive counterparts, such as higher metabolic consumption and abnormal gait patterns. Prosthetic devices, especially those ones subject to high impact, must exhibit a certain level of compliance and shock absorbance. Due to their inherent compliance, soft actuators are promising for applications in bionics. Among these, Dielectric Elastomer Actuators (DEAs) stand out, by virtue of their high energy density, high actuation strains, and fast response, making them suitable for applications as artificial muscles. In this work, we assessed the application of DEAs in an antagonistic pair configuration to an ankle-foot prosthesis. First, we modeled the nonlinear viscoelastic behavior of a single pair of coupled planar actuators. Then, artificial muscles constituted of several stacked DEAs were dimensioned to completely meet the ankle torque-angle curves, and therefore cover the range of ankle torsional stiffness in each phase of the gait cycle. A model-based approach combined with a proportional-integral (PI) controller performed well in simulations to reproduce the torque of the ankle joint by controlling the applied voltage in the antagonist muscle. The final structure enables remarkably lightweight prostheses when compared to conventional active transtibial prostheses.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130652231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Design and Evaluation of a Soft Robotic Catheter Tip Prototype with Self-Propulsion and Shape Changeable Teleoperation 具有自推进和可变形状遥操作的软机器人导管尖端原型设计与评价
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661537
A. Galvan, A. Madan, Meenakshi Narayan, S. Kalva, A. M. Fey
Intravascular procedures could benefit from the ability to control the overall shape of the distal end of the catheter. In this paper, we present the design of a fluid-controlled segmented catheter which enables independent curvature control of three distal segments of the catheter in a 2D plane. The catheter is controlled through a flexible master manipulator, allowing the interventional radiologist to define the shape of this distal tip through an intuitive control method. Finite element analysis was used to characterize the behavior of each segment of the catheter, and the simulation results were validated experimentally using an electromagnetic tracker. Furthermore, we find that the unique multi-chambered design of the catheter tip can be exploited to achieve additional unique and valuable features to the medical professional, including steering and forward propulsion. These are demonstrated by applying an algorithm for rectilinear locomotion for propulsion through a physical model.
血管内手术可以受益于控制导管远端整体形状的能力。在本文中,我们提出了一种流体控制的分段导管的设计,它可以在二维平面上对导管的三个远端段进行独立的曲率控制。导管通过一个灵活的主机械手控制,允许介入放射科医生通过直观的控制方法来定义这个远端尖端的形状。利用有限元分析方法对导管各节段的行为进行了表征,并利用电磁跟踪器对仿真结果进行了实验验证。此外,我们发现导管尖端独特的多腔设计可以为医疗专业人员提供额外的独特和有价值的功能,包括转向和向前推进。这些都是通过应用一个算法直线运动推进通过物理模型。
{"title":"Design and Evaluation of a Soft Robotic Catheter Tip Prototype with Self-Propulsion and Shape Changeable Teleoperation","authors":"A. Galvan, A. Madan, Meenakshi Narayan, S. Kalva, A. M. Fey","doi":"10.1109/ismr48346.2021.9661537","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661537","url":null,"abstract":"Intravascular procedures could benefit from the ability to control the overall shape of the distal end of the catheter. In this paper, we present the design of a fluid-controlled segmented catheter which enables independent curvature control of three distal segments of the catheter in a 2D plane. The catheter is controlled through a flexible master manipulator, allowing the interventional radiologist to define the shape of this distal tip through an intuitive control method. Finite element analysis was used to characterize the behavior of each segment of the catheter, and the simulation results were validated experimentally using an electromagnetic tracker. Furthermore, we find that the unique multi-chambered design of the catheter tip can be exploited to achieve additional unique and valuable features to the medical professional, including steering and forward propulsion. These are demonstrated by applying an algorithm for rectilinear locomotion for propulsion through a physical model.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123976196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tumor Detection In Breast Histopathological Images Using Faster R-CNN 快速R-CNN在乳腺组织病理图像中的肿瘤检测
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661483
Pratibha Harrison, Kihan Park
Breast cancer is the most common type of cancer in women, and it is crucial to detect it at an early stage for a better prognosis. There are various ways of detecting and confirming breast cancer that are highly dependent on the imaging modalities, such as mammograms, ultrasound, magnetic resonance imaging (MRI), and histopathological image analysis by pathologists. With the help of recent progress in machine vision and artificial intelligence, computational methods for image analysis such as deep learning have been widely applied for automated decision-making in breast cancer diagnosis using feature extraction and localization. This study utilizes Faster Region-based Convolutional Neural Network (Faster R-CNN), one of the deep learning algorithms for tumor detection in annotated breast histopathological images, and analyzes the effects of two pre-processing procedures (color normalization and patching) on the images for optimization of the Faster R-CNN model. It was observed that the model’s sensitivity drastically increased from 1 % to 60 % by patching the images. The effect of image color normalization was conditional and improved results for only a few cases.
乳腺癌是女性中最常见的癌症类型,在早期发现它对于更好的预后至关重要。检测和确认乳腺癌的方法多种多样,高度依赖于成像方式,如乳房x光检查、超声检查、磁共振成像(MRI)和病理学家的组织病理学图像分析。在机器视觉和人工智能的最新进展的帮助下,深度学习等图像分析的计算方法已广泛应用于使用特征提取和定位的乳腺癌诊断自动化决策。本研究利用用于乳腺组织病理学注释图像肿瘤检测的深度学习算法之一Faster Region-based Convolutional Neural Network (Faster R-CNN),分析颜色归一化和修补两种预处理程序对图像的影响,优化Faster R-CNN模型。通过对图像进行修补,模型的灵敏度从1%急剧提高到60%。图像颜色归一化的效果是有条件的,仅在少数情况下改善了结果。
{"title":"Tumor Detection In Breast Histopathological Images Using Faster R-CNN","authors":"Pratibha Harrison, Kihan Park","doi":"10.1109/ismr48346.2021.9661483","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661483","url":null,"abstract":"Breast cancer is the most common type of cancer in women, and it is crucial to detect it at an early stage for a better prognosis. There are various ways of detecting and confirming breast cancer that are highly dependent on the imaging modalities, such as mammograms, ultrasound, magnetic resonance imaging (MRI), and histopathological image analysis by pathologists. With the help of recent progress in machine vision and artificial intelligence, computational methods for image analysis such as deep learning have been widely applied for automated decision-making in breast cancer diagnosis using feature extraction and localization. This study utilizes Faster Region-based Convolutional Neural Network (Faster R-CNN), one of the deep learning algorithms for tumor detection in annotated breast histopathological images, and analyzes the effects of two pre-processing procedures (color normalization and patching) on the images for optimization of the Faster R-CNN model. It was observed that the model’s sensitivity drastically increased from 1 % to 60 % by patching the images. The effect of image color normalization was conditional and improved results for only a few cases.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128448477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Design and Characterization of a Miniature Dual-chamber Pneumatic Actuator for Minimally Invasive Surgical Devices 用于微创手术装置的微型双腔气动执行器的设计与表征
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661556
R. Lathrop, M. Ourak, F. Russo, J. Deprest, E. V. Poorten
Advances in minimally invasive surgery require the development of enhanced miniature steerable robotic surgical instruments. Novel actuator technologies are necessary to safely and accurately guide instruments to difficult-to-access anatomy to enable new surgical procedures. Concentric McKibben actuators have been introduced recently to actuate miniature surgical devices while enabling efficient use of space via a working channel integrated in the empty space of the muscle core. These muscles have shown initial promise for miniaturization and accurate control, but with some challenges in pneumatic sealing, stroke range, hysteresis characteristics, and generated force compared to traditional McKibben muscles. Initial concentric muscle designs focused on natural orifice surgical procedures where a certain level pneumatic leakage from the muscle was acceptable. The working channel of existing designs is also too small for surgical interventions requiring the introduction of relatively large (1.5 − 2 mm diameter) instruments. This article describes the design of an innovative multi-compartment McKibben muscle. This design is fully pneumatically sealed, enabling use in a wider range of surgical devices. The design is proposed and the obtained performance is evaluated. The prototype actuator is capable of producing up to 11.9 Newtons of force and 9.9 mm of displacement at a speed of 22.5 mm/sec. Directions for future work are sketched as well.
微创手术的进步需要开发增强的微型可操纵机器人手术器械。为了安全、准确地将器械引导到难以接近的解剖结构,从而实现新的外科手术,新型的致动器技术是必要的。同心McKibben致动器最近被引入到驱动微型手术装置,同时通过集成在肌肉核心空腔中的工作通道有效地利用空间。这些肌肉在小型化和精确控制方面表现出了初步的希望,但与传统的McKibben肌肉相比,在气动密封、行程范围、滞后特性和产生的力方面存在一些挑战。最初的同心肌肉设计集中在自然孔口手术过程中,在这种情况下,肌肉的一定程度的气动泄漏是可以接受的。现有设计的工作通道也太小,不适合需要引入相对较大(直径1.5 - 2mm)器械的手术干预。本文描述了一种创新的多室麦基本肌的设计。这种设计是完全气动密封的,可以在更广泛的手术设备中使用。提出了设计方案,并对所获得的性能进行了评价。原型驱动器能够以22.5毫米/秒的速度产生高达11.9牛顿的力和9.9毫米的位移。对未来的工作方向也进行了概述。
{"title":"Design and Characterization of a Miniature Dual-chamber Pneumatic Actuator for Minimally Invasive Surgical Devices","authors":"R. Lathrop, M. Ourak, F. Russo, J. Deprest, E. V. Poorten","doi":"10.1109/ismr48346.2021.9661556","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661556","url":null,"abstract":"Advances in minimally invasive surgery require the development of enhanced miniature steerable robotic surgical instruments. Novel actuator technologies are necessary to safely and accurately guide instruments to difficult-to-access anatomy to enable new surgical procedures. Concentric McKibben actuators have been introduced recently to actuate miniature surgical devices while enabling efficient use of space via a working channel integrated in the empty space of the muscle core. These muscles have shown initial promise for miniaturization and accurate control, but with some challenges in pneumatic sealing, stroke range, hysteresis characteristics, and generated force compared to traditional McKibben muscles. Initial concentric muscle designs focused on natural orifice surgical procedures where a certain level pneumatic leakage from the muscle was acceptable. The working channel of existing designs is also too small for surgical interventions requiring the introduction of relatively large (1.5 − 2 mm diameter) instruments. This article describes the design of an innovative multi-compartment McKibben muscle. This design is fully pneumatically sealed, enabling use in a wider range of surgical devices. The design is proposed and the obtained performance is evaluated. The prototype actuator is capable of producing up to 11.9 Newtons of force and 9.9 mm of displacement at a speed of 22.5 mm/sec. Directions for future work are sketched as well.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130506260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automated Motion Control of the COAST Robotic Guidewire under Fluoroscopic Guidance COAST机器人导丝在透视引导下的自动运动控制
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661508
Sharan R. Ravigopal, T. Brumfiel, J. Desai
Peripheral arterial disease is one of the most prevalent cardiovascular diseases; its treatment is often catheter-based and requires the surgeon to manually navigate a guidewire to the affected region within the artery, usually with fluoroscopic images. It requires extensive skill and experience to navigate the guidewire to the target location and delays can cause increased radiation exposure to the surgeon. To overcome these challenges, we propose a fully automated approach to perform navigation of the COaxially Aligned STeerable (COAST) guidewire under fluoroscopic imaging in 2D phantom models. We utilize fluoroscopic images to calculate the optimal path between two points using a modified hybrid A-star algorithm in the phantom vasculature. The modified hybrid A-star computes a trajectory which is used for the velocity kinematics of the guidewire robot. The experiments show that the robot is able to follow the pre-computed path to the destination with a mean error of 8.2 pixels (2.87 mm).
外周动脉疾病是最常见的心血管疾病之一;其治疗通常以导管为基础,需要外科医生手动将导丝引导到动脉内的受影响区域,通常使用透视图像。将导丝引导到目标位置需要丰富的技能和经验,延迟可能会增加外科医生的辐射暴露。为了克服这些挑战,我们提出了一种完全自动化的方法,在二维幻影模型的透视成像下对同轴对准可操纵(COAST)导丝进行导航。我们利用透视图像来计算两点之间的最佳路径,使用改进的混合a -star算法在幻影血管系统中。改进的混合a星计算轨迹,用于导丝机器人的速度运动学。实验表明,机器人能够按照预先计算的路径到达目的地,平均误差为8.2像素(2.87 mm)。
{"title":"Automated Motion Control of the COAST Robotic Guidewire under Fluoroscopic Guidance","authors":"Sharan R. Ravigopal, T. Brumfiel, J. Desai","doi":"10.1109/ismr48346.2021.9661508","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661508","url":null,"abstract":"Peripheral arterial disease is one of the most prevalent cardiovascular diseases; its treatment is often catheter-based and requires the surgeon to manually navigate a guidewire to the affected region within the artery, usually with fluoroscopic images. It requires extensive skill and experience to navigate the guidewire to the target location and delays can cause increased radiation exposure to the surgeon. To overcome these challenges, we propose a fully automated approach to perform navigation of the COaxially Aligned STeerable (COAST) guidewire under fluoroscopic imaging in 2D phantom models. We utilize fluoroscopic images to calculate the optimal path between two points using a modified hybrid A-star algorithm in the phantom vasculature. The modified hybrid A-star computes a trajectory which is used for the velocity kinematics of the guidewire robot. The experiments show that the robot is able to follow the pre-computed path to the destination with a mean error of 8.2 pixels (2.87 mm).","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133618690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Learning Soft-Tissue Simulation from Models and Observation 从模型和观察中学习软组织模拟
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661507
Jie Ying Wu, A. Munawar, M. Unberath, P. Kazanzides
Accurate soft-tissue simulation using biomechanical models is computationally expensive. This is unfortunate because accurate biomechanical models could model tool-tissue interaction during surgical procedures, thereby providing intra-operative guidance to surgeons. In this work, we present steps toward interactive soft-tissue simulation for specific models using a learning-based framework that learns from finite element method (FEM) simulations. We train a graph neural network that takes the position and velocity of a tracked tool as input and estimates the deformations of a base mesh at each time step. By using data augmentation, the network learns to self-correct for errors in estimation to maintain the stability of the simulation over time. This approach estimates soft tissue deformation with less than 1 mm mean error with respect to FEM simulation over an interaction sequence of 80 s. This error magnitude is within the accuracy of FEM in comparing to the in situ camera observations of the interaction. While the FEM took 15 h to simulate 80 s of interaction, the network-based simulator took 47 s. Despite several open challenges that will be the subject of our future work, this learning-based framework constitutes a step towards real-time biomechanics-based simulation for intraoperative surgical guidance.
使用生物力学模型进行精确的软组织模拟在计算上是昂贵的。这是不幸的,因为精确的生物力学模型可以模拟手术过程中工具与组织的相互作用,从而为外科医生提供术中指导。在这项工作中,我们提出了使用基于学习的框架(从有限元方法(FEM)模拟中学习)对特定模型进行交互式软组织模拟的步骤。我们训练了一个图神经网络,该网络以跟踪工具的位置和速度作为输入,并估计基网格在每个时间步长的变形。通过使用数据增强,网络学会自我纠正估计中的错误,以保持模拟随时间的稳定性。该方法估计的软组织变形相对于有限元模拟在80秒的相互作用序列的平均误差小于1毫米。与现场相机观测的相互作用相比,该误差幅度在有限元法的精度范围内。有限元法模拟80秒的相互作用需要15小时,而基于网络的模拟器只需要47秒。尽管有几个开放的挑战将是我们未来工作的主题,但这种基于学习的框架构成了面向术中手术指导的实时生物力学模拟的一步。
{"title":"Learning Soft-Tissue Simulation from Models and Observation","authors":"Jie Ying Wu, A. Munawar, M. Unberath, P. Kazanzides","doi":"10.1109/ismr48346.2021.9661507","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661507","url":null,"abstract":"Accurate soft-tissue simulation using biomechanical models is computationally expensive. This is unfortunate because accurate biomechanical models could model tool-tissue interaction during surgical procedures, thereby providing intra-operative guidance to surgeons. In this work, we present steps toward interactive soft-tissue simulation for specific models using a learning-based framework that learns from finite element method (FEM) simulations. We train a graph neural network that takes the position and velocity of a tracked tool as input and estimates the deformations of a base mesh at each time step. By using data augmentation, the network learns to self-correct for errors in estimation to maintain the stability of the simulation over time. This approach estimates soft tissue deformation with less than 1 mm mean error with respect to FEM simulation over an interaction sequence of 80 s. This error magnitude is within the accuracy of FEM in comparing to the in situ camera observations of the interaction. While the FEM took 15 h to simulate 80 s of interaction, the network-based simulator took 47 s. Despite several open challenges that will be the subject of our future work, this learning-based framework constitutes a step towards real-time biomechanics-based simulation for intraoperative surgical guidance.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115493380","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Estimation of Needle Puncturing Form Based on Force Data during Slight Needle Movement 基于针轻微运动力数据的针穿刺形式估计
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661566
T. Matsuno, Hikaru Murakami, T. Kamegawa, Takaaki Miyamoto, Nanako Sakai, M. Minami, T. Hiraki
We focused on a medical procedure, known as interventional radiology (IR), as the target of robotizing medical surgeries. IR is a general term for treatments that use devices to visualize patients’ bodies. Our developed robot, known as Zerobot, specializes in inserting a needle into patients under computer tomography (CT) guidance during surgery. Its surgery is less invasive, and effective in treating small cancer tumors by controlling the temperature of the tip of the inserted needle. Zerobot is originally designed to be remotely controlled by doctors, and has confirmed its surgical ability through first-in-human feasibility trials in 2018. As a current issue, we focus on the supporting function for the operator during the surgery. In an experiment with an animal, Zerobot could not insert the needle into the animal during IR surgery if the needle were bent. Thus, in this study, we aim to make the robot function automatically so that the needle does not bend during surgery. As the first step, we propose a method for estimating the form of the needle using a force sensor. There are three types of needle forms to be classified. The proposed method can distinguish these needle forms by measuring the difference in force sensor data when slightly moving the needle root. In addition, we experimented to confirm the effectiveness of the proposed method.
我们专注于一种医疗程序,被称为介入放射学(IR),作为机器人化医疗手术的目标。IR是一种使用设备可视化病人身体的治疗方法的总称。我们开发的机器人Zerobot专门在手术过程中在计算机断层扫描(CT)的指导下将针插入患者体内。它的手术侵入性较小,通过控制插入针头尖端的温度,可以有效治疗小的癌症肿瘤。Zerobot最初是为医生远程控制而设计的,并于2018年通过首次人体可行性试验证实了其手术能力。作为当前的问题,我们关注的是手术过程中对操作者的支持功能。在一项动物实验中,Zerobot无法在红外线手术期间将针头插入动物体内,如果针头是弯曲的。因此,在本研究中,我们的目标是使机器人自动工作,使针头在手术过程中不会弯曲。作为第一步,我们提出了一种使用力传感器估计针形的方法。针的形状有三种。所提出的方法可以通过测量轻微移动针根时力传感器数据的差异来区分这些针形。此外,我们还通过实验验证了所提出方法的有效性。
{"title":"Estimation of Needle Puncturing Form Based on Force Data during Slight Needle Movement","authors":"T. Matsuno, Hikaru Murakami, T. Kamegawa, Takaaki Miyamoto, Nanako Sakai, M. Minami, T. Hiraki","doi":"10.1109/ismr48346.2021.9661566","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661566","url":null,"abstract":"We focused on a medical procedure, known as interventional radiology (IR), as the target of robotizing medical surgeries. IR is a general term for treatments that use devices to visualize patients’ bodies. Our developed robot, known as Zerobot, specializes in inserting a needle into patients under computer tomography (CT) guidance during surgery. Its surgery is less invasive, and effective in treating small cancer tumors by controlling the temperature of the tip of the inserted needle. Zerobot is originally designed to be remotely controlled by doctors, and has confirmed its surgical ability through first-in-human feasibility trials in 2018. As a current issue, we focus on the supporting function for the operator during the surgery. In an experiment with an animal, Zerobot could not insert the needle into the animal during IR surgery if the needle were bent. Thus, in this study, we aim to make the robot function automatically so that the needle does not bend during surgery. As the first step, we propose a method for estimating the form of the needle using a force sensor. There are three types of needle forms to be classified. The proposed method can distinguish these needle forms by measuring the difference in force sensor data when slightly moving the needle root. In addition, we experimented to confirm the effectiveness of the proposed method.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124655213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Time-of-Flight Stereoscopic Endoscope for Anatomical 3D Reconstruction 用于解剖三维重建的飞行时间立体内窥镜
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661478
A. Roberti, Nicola Piccinelli, Fabio Falezza, Giacomo De Rossi, S. Bonora, F. Setti, P. Fiorini, R. Muradore
This paper presents a novel endoscope design for laparoscopic surgery that has been specifically tailored to provide both a stereoscopic view to the surgeon and a high-accuracy 3D reconstruction for an advanced visualization of the anatomical environment. The former helps the main surgeon in teleoperating a robotic minimally-invasive system (R-MIS) while the latter provides necessary data to upcoming autonomous surgical procedure implementations in a manner akin to the current development of autonomous driving systems. To this aim, we created an initial prototype that incorporates a pair of high-quality, chip-on-tip RGB cameras with a Time-of-Flight (ToF) 3D sensor in a sufficiently compact design to allow its usage in intra-luminal operations. The combination of these sensors provides a reliable 3D model of the anatomical structures at close and far distances within the workspace to effectively overcome the issues presented by current laparoscopy stereo endoscopes, for which the depth estimation is hindered by the reduced baseline distance between the cameras. Moreover, the application to current robotic platforms presents innate mathematical issues when applying hand-eye calibration techniques for localization. We finally developed a calibration procedure that merges both color and depth information. The endoscope design is fully validated through the reconstruction of a planar surface, achieving a depth, latitudinal, and longitudinal orientation precision of 3.3mm, −0.02rad, −0.025rad respectively.
本文介绍了一种用于腹腔镜手术的新型内窥镜设计,该内窥镜专门为外科医生提供立体视图和高精度3D重建,以实现解剖环境的高级可视化。前者帮助主外科医生远程操作机器人微创系统(R-MIS),而后者则以类似于当前自动驾驶系统开发的方式,为即将到来的自主手术程序实施提供必要的数据。为此,我们创建了一个初始原型,该原型结合了一对高质量的尖端芯片RGB相机和飞行时间(ToF) 3D传感器,其设计足够紧凑,可以用于腔内操作。这些传感器的组合提供了工作空间内近距离和远距离解剖结构的可靠3D模型,有效克服了目前腹腔镜立体内窥镜存在的问题,即由于相机之间的基线距离减小而阻碍了深度估计。此外,在当前机器人平台上应用手眼标定技术进行定位时,存在固有的数学问题。我们最终开发了一个校准程序,合并了颜色和深度信息。通过一个平面的重建,充分验证了内窥镜的设计,深度精度为3.3mm,纬度精度为- 0.02rad,纵向精度为- 0.025rad。
{"title":"A Time-of-Flight Stereoscopic Endoscope for Anatomical 3D Reconstruction","authors":"A. Roberti, Nicola Piccinelli, Fabio Falezza, Giacomo De Rossi, S. Bonora, F. Setti, P. Fiorini, R. Muradore","doi":"10.1109/ismr48346.2021.9661478","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661478","url":null,"abstract":"This paper presents a novel endoscope design for laparoscopic surgery that has been specifically tailored to provide both a stereoscopic view to the surgeon and a high-accuracy 3D reconstruction for an advanced visualization of the anatomical environment. The former helps the main surgeon in teleoperating a robotic minimally-invasive system (R-MIS) while the latter provides necessary data to upcoming autonomous surgical procedure implementations in a manner akin to the current development of autonomous driving systems. To this aim, we created an initial prototype that incorporates a pair of high-quality, chip-on-tip RGB cameras with a Time-of-Flight (ToF) 3D sensor in a sufficiently compact design to allow its usage in intra-luminal operations. The combination of these sensors provides a reliable 3D model of the anatomical structures at close and far distances within the workspace to effectively overcome the issues presented by current laparoscopy stereo endoscopes, for which the depth estimation is hindered by the reduced baseline distance between the cameras. Moreover, the application to current robotic platforms presents innate mathematical issues when applying hand-eye calibration techniques for localization. We finally developed a calibration procedure that merges both color and depth information. The endoscope design is fully validated through the reconstruction of a planar surface, achieving a depth, latitudinal, and longitudinal orientation precision of 3.3mm, −0.02rad, −0.025rad respectively.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122632601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Trajectory Tracking Impedance Controller in 6-DoF Lower-Limb Exoskeleton for Over-Ground Walking Training: Preliminary Results 用于地面行走训练的六自由度下肢外骨骼的轨迹跟踪阻抗控制器:初步结果
Pub Date : 2021-11-17 DOI: 10.1109/ismr48346.2021.9661558
R. Andrade, Stefano Sapienza, E. Fabara, P. Bonato
Rehabilitation strategies based on robotic systems, like lower-limb exoskeletons, is expected to reduce the burden of locomotor impairment in patients with neurological diseases. In this work, we present the preliminary results of a trajectory tracking impedance control method applied to the ExoRoboWalker, a six degree-of-freedom (DoF) exoskeleton. The wearable robot was developed as an over-ground gait trainer to aid children and young adults with Cerebral Palsy (CP) achieve physiological gait patterns. The experiments were carried out in three healthy adults walking over-ground with the system working in three different modes: First, with the exoskeleton’s motors unpowered, to assess the system’s backdrivability, user-robot interaction and subject gait pattern; second, with the exoskeleton working in "transparent" mode; and finally, with the system working with the proposed impedance controller. As expected, when the exoskeleton is unpowered, the system presents low backdrivability, thereby resulting in high user-robot interaction torques and a nonphysiological gait pattern. However, the results show that the system was able to partially restore the subjects gait pattern and reduce the user-robot interaction torque when set in "transparent" mode. Finally, while working with the trajectory tracking impedance controller, the ExoRoboWalker was able to guide the subject through a target trajectory. This is the first step towards use the system as an over-ground gait trainer in CP population.
基于机器人系统的康复策略,如下肢外骨骼,有望减轻神经系统疾病患者运动障碍的负担。在这项工作中,我们介绍了一种应用于六自由度外骨骼——ExoRoboWalker的轨迹跟踪阻抗控制方法的初步结果。该可穿戴机器人是作为一种地面步态训练器开发的,用于帮助患有脑瘫(CP)的儿童和年轻人实现生理步态模式。实验在三名健康成年人的地面行走中进行,该系统在三种不同的模式下工作:第一,在外骨骼的马达没有动力的情况下,评估系统的反向驾驶性、用户-机器人交互和受试者的步态模式;第二,外骨骼工作在“透明”模式;最后,系统与所提出的阻抗控制器一起工作。正如预期的那样,当外骨骼没有动力时,系统表现出较低的反向驾驶性,从而导致高用户-机器人交互扭矩和非生理步态模式。然而,结果表明,当设置为“透明”模式时,系统能够部分恢复受试者的步态模式并降低用户-机器人交互扭矩。最后,在与轨迹跟踪阻抗控制器一起工作时,ExoRoboWalker能够引导受试者通过目标轨迹。这是在CP人群中使用该系统作为地面步态训练器的第一步。
{"title":"Trajectory Tracking Impedance Controller in 6-DoF Lower-Limb Exoskeleton for Over-Ground Walking Training: Preliminary Results","authors":"R. Andrade, Stefano Sapienza, E. Fabara, P. Bonato","doi":"10.1109/ismr48346.2021.9661558","DOIUrl":"https://doi.org/10.1109/ismr48346.2021.9661558","url":null,"abstract":"Rehabilitation strategies based on robotic systems, like lower-limb exoskeletons, is expected to reduce the burden of locomotor impairment in patients with neurological diseases. In this work, we present the preliminary results of a trajectory tracking impedance control method applied to the ExoRoboWalker, a six degree-of-freedom (DoF) exoskeleton. The wearable robot was developed as an over-ground gait trainer to aid children and young adults with Cerebral Palsy (CP) achieve physiological gait patterns. The experiments were carried out in three healthy adults walking over-ground with the system working in three different modes: First, with the exoskeleton’s motors unpowered, to assess the system’s backdrivability, user-robot interaction and subject gait pattern; second, with the exoskeleton working in \"transparent\" mode; and finally, with the system working with the proposed impedance controller. As expected, when the exoskeleton is unpowered, the system presents low backdrivability, thereby resulting in high user-robot interaction torques and a nonphysiological gait pattern. However, the results show that the system was able to partially restore the subjects gait pattern and reduce the user-robot interaction torque when set in \"transparent\" mode. Finally, while working with the trajectory tracking impedance controller, the ExoRoboWalker was able to guide the subject through a target trajectory. This is the first step towards use the system as an over-ground gait trainer in CP population.","PeriodicalId":405817,"journal":{"name":"2021 International Symposium on Medical Robotics (ISMR)","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128810773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
期刊
2021 International Symposium on Medical Robotics (ISMR)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1