Pub Date : 2024-01-06DOI: 10.1007/s11370-023-00503-4
Yong Hae Heo, Seok Hun Lee, In Kwon Lee, Sang-Youn Kim
This paper proposes a flexible vibrotactile actuator based on a dielectric elastomer which is fabricated by mixing a PDMS-Ecoflex elastomer and PC (propylene carbonate) solution. The proposed flexible vibrotactile actuator is composed of a top electrode, an adhesive tape, the PDMS-Ecoflex-PC-based elastomer, and a bottom electrode. The applied electric field between two parallel electrodes (top and bottom electrodes) creates an electrostatic force in the actuator, resulting in the actuator being compressed. The performance of the vibrotactile actuator based on dielectric elastomers is affected by the mechanical and dielectric properties of the dielectric elastomer. So, in this paper, we experimentally optimize the design of the haptic actuator and then quantitatively evaluate the actuator. For evaluation, the six samples of PDMS-Ecoflex-PC elastomers having different mixing ratios are prepared and their material properties are investigated by experiments. We fabricate the haptic actuators based on PDMS-Ecoflex-PC elastomers and then measure the haptic behaviors of the proposed actuator as a function of the applied voltage amplitude and frequency. Furthermore, we inquire the response time of the proposed actuator. Maximum vibrational force of the optimized sample is about 0.556 N at 140 Hz which is strong enough to stimulate human finger, and the response time is 21 ms which is fast enough to obtain the touch feedback in real time. From the results, we show that the proposed vibrotactile actuator creates a variety of haptic sensations in real time.
{"title":"Enhanced flexible vibrotactile actuator based on dielectric elastomer with propylene carbonate","authors":"Yong Hae Heo, Seok Hun Lee, In Kwon Lee, Sang-Youn Kim","doi":"10.1007/s11370-023-00503-4","DOIUrl":"https://doi.org/10.1007/s11370-023-00503-4","url":null,"abstract":"<p>This paper proposes a flexible vibrotactile actuator based on a dielectric elastomer which is fabricated by mixing a PDMS-Ecoflex elastomer and PC (propylene carbonate) solution. The proposed flexible vibrotactile actuator is composed of a top electrode, an adhesive tape, the PDMS-Ecoflex-PC-based elastomer, and a bottom electrode. The applied electric field between two parallel electrodes (top and bottom electrodes) creates an electrostatic force in the actuator, resulting in the actuator being compressed. The performance of the vibrotactile actuator based on dielectric elastomers is affected by the mechanical and dielectric properties of the dielectric elastomer. So, in this paper, we experimentally optimize the design of the haptic actuator and then quantitatively evaluate the actuator. For evaluation, the six samples of PDMS-Ecoflex-PC elastomers having different mixing ratios are prepared and their material properties are investigated by experiments. We fabricate the haptic actuators based on PDMS-Ecoflex-PC elastomers and then measure the haptic behaviors of the proposed actuator as a function of the applied voltage amplitude and frequency. Furthermore, we inquire the response time of the proposed actuator. Maximum vibrational force of the optimized sample is about 0.556 N at 140 Hz which is strong enough to stimulate human finger, and the response time is 21 ms which is fast enough to obtain the touch feedback in real time. From the results, we show that the proposed vibrotactile actuator creates a variety of haptic sensations in real time.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"22 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139373055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-03DOI: 10.1007/s11370-023-00498-y
Sangwoo Jung, Hyesu Jang, Minwoo Jung, Ayoung Kim, Myung-Hwan Jeon
The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative transformation, between each sensor. The use of data fusion between complementary sensors, such as radar and LiDAR, can provide significant benefits, particularly in harsh environments where accurate depth data is required. However, noise included in radar sensor data can make the estimation of extrinsic calibration challenging. To address this issue, we present a novel framework for the extrinsic calibration of radar and LiDAR sensors, utilizing CycleGAN as a method of image-to-image translation. Our proposed method employs translating radar bird-eye-view images into LiDAR-style images to estimate the 3-DOF extrinsic parameters. The use of image registration techniques, as well as deskewing based on sensor odometry and B-spline interpolation, is employed to address the rolling shutter effect commonly present in spinning sensors. Our method demonstrates a notable improvement in extrinsic calibration compared to filter-based methods using the MulRan dataset.
在机器人技术领域,传感器数据的整合对于充分利用所使用的各种传感器至关重要。这种整合的一个关键方面是确定每个传感器之间的外在校准参数,如相对转换。使用雷达和激光雷达等互补传感器之间的数据融合可以带来显著的优势,尤其是在需要精确深度数据的恶劣环境中。然而,雷达传感器数据中包含的噪声会使外部校准的估算变得困难。为了解决这个问题,我们提出了一个新颖的雷达和激光雷达传感器外校准框架,利用 CycleGAN 作为图像到图像的转换方法。我们提出的方法采用将雷达鸟瞰图像转换为激光雷达式图像的方法来估算 3-DOF 外在参数。使用图像注册技术,以及基于传感器轨迹测量和 B 样条插值的纠偏技术,可以解决旋转传感器中常见的卷帘快门效应。与使用 MulRan 数据集的基于滤波器的方法相比,我们的方法在外差校准方面有显著改进。
{"title":"Imaging radar and LiDAR image translation for 3-DOF extrinsic calibration","authors":"Sangwoo Jung, Hyesu Jang, Minwoo Jung, Ayoung Kim, Myung-Hwan Jeon","doi":"10.1007/s11370-023-00498-y","DOIUrl":"https://doi.org/10.1007/s11370-023-00498-y","url":null,"abstract":"<p>The integration of sensor data is crucial in the field of robotics to take full advantage of the various sensors employed. One critical aspect of this integration is determining the extrinsic calibration parameters, such as the relative transformation, between each sensor. The use of data fusion between complementary sensors, such as radar and LiDAR, can provide significant benefits, particularly in harsh environments where accurate depth data is required. However, noise included in radar sensor data can make the estimation of extrinsic calibration challenging. To address this issue, we present a novel framework for the extrinsic calibration of radar and LiDAR sensors, utilizing CycleGAN as a method of image-to-image translation. Our proposed method employs translating radar bird-eye-view images into LiDAR-style images to estimate the 3-DOF extrinsic parameters. The use of image registration techniques, as well as deskewing based on sensor odometry and B-spline interpolation, is employed to address the rolling shutter effect commonly present in spinning sensors. Our method demonstrates a notable improvement in extrinsic calibration compared to filter-based methods using the MulRan dataset.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"150 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139105113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-02DOI: 10.1007/s11370-023-00500-7
Ali Ebrahimi, Mohammad Farrokhi
In this paper, a control method is proposed for the flocking of multi-agent systems in the presence of obstacles. One of the main contributions of this work is the introduction of a safety distance parameter that ensures agents do not enter this safety distance during the flocking process. To achieve this, a fuzzy logic-based gradient of the potential function is designed. Furthermore, it is demonstrated that no consensus term is necessary in the control signal when all agents are informed about the desired path. Additionally, stability analysis is conducted for the proposed algorithm in free space, which allows the extraction of the ultimate bound of the tracking error. Finally, the effectiveness of the proposed algorithm is demonstrated through simulations conducted in free space, space with obstacles, and in the presence of measurement noise. The results obtained from these simulations are compared with the existing methods in the literature.
{"title":"Multi-agent flocking with obstacle avoidance and safety distance preservation: a fuzzy potential-based approach","authors":"Ali Ebrahimi, Mohammad Farrokhi","doi":"10.1007/s11370-023-00500-7","DOIUrl":"https://doi.org/10.1007/s11370-023-00500-7","url":null,"abstract":"<p>In this paper, a control method is proposed for the flocking of multi-agent systems in the presence of obstacles. One of the main contributions of this work is the introduction of a safety distance parameter that ensures agents do not enter this safety distance during the flocking process. To achieve this, a fuzzy logic-based gradient of the potential function is designed. Furthermore, it is demonstrated that no consensus term is necessary in the control signal when all agents are informed about the desired path. Additionally, stability analysis is conducted for the proposed algorithm in free space, which allows the extraction of the ultimate bound of the tracking error. Finally, the effectiveness of the proposed algorithm is demonstrated through simulations conducted in free space, space with obstacles, and in the presence of measurement noise. The results obtained from these simulations are compared with the existing methods in the literature.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139077589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this work, Coyote optimization algorithm (COA) is used for inverse kinematics optimization of a 7 degrees-of-freedom Kuka robot. The Denavit–Hartenberg (D–H) Convention approach is used to compute the forward kinematics of the robotic arm. The fitness functions based on sum of squares of distance and torque are employed to compute the optimized inverse kinematics solution using the COA. A comparative analysis has been conducted with other optimization algorithms including genetic algorithm (GA), particle swarm optimization (PSO) and Grey wolf optimization (GWO), artificial bee colony (ABC) optimization, and whale optimization algorithm (WOA) to evaluate the performance of the proposed approach. The experimental results show that the COA leads to least computation error of (3.59 times 10^{-7}) and computation time of 1.405 s as compared to GA, PSO, GWO, ABC, and WOA algorithms. Further, jerk being control input has a major impact on the efficiency of robotic arm. COA is employed to obtain the optimal joint parameters, such as joint velocity, joint acceleration, and joint jerk, respectively. This leads to a minimum jerk trajectory which contributes to the smooth movement of Kuka arm. The simulation of Kuka robotic arm for pick and place operations is performed in CoppeliaSim, which further justifies its usage for real-time applications.
在这项工作中,Coyote 优化算法(COA)被用于 7 自由度库卡机器人的逆运动学优化。Denavit-Hartenberg (D-H) 公约方法用于计算机械臂的正向运动学。利用基于距离和扭矩平方和的拟合函数,使用 COA 计算出优化的逆运动学解决方案。与其他优化算法进行了比较分析,包括遗传算法(GA)、粒子群优化(PSO)和灰狼优化(GWO)、人工蜂群优化(ABC)以及鲸鱼优化算法(WOA),以评估所提出方法的性能。实验结果表明,与 GA、PSO、GWO、ABC 和 WOA 算法相比,COA 的计算误差最小(3.59 倍 10^{-7}),计算时间最短(1.405 秒)。此外,作为控制输入的 jerk 对机械臂的效率有很大影响。采用 COA 算法可分别获得最佳关节参数,如关节速度、关节加速度和关节颠簸。这样就能获得最小运动轨迹,从而使库卡机械臂的运动更加流畅。在 CoppeliaSim 中对用于取放操作的 Kuka 机械臂进行了仿真,这进一步证明了其在实时应用中的合理性。
{"title":"Trajectory planning and inverse kinematics solution of Kuka robot using COA along with pick and place application","authors":"Manpreet Kaur, Venkata Karteek Yanumula, Swati Sondhi","doi":"10.1007/s11370-023-00501-6","DOIUrl":"https://doi.org/10.1007/s11370-023-00501-6","url":null,"abstract":"<p>In this work, Coyote optimization algorithm (COA) is used for inverse kinematics optimization of a 7 degrees-of-freedom Kuka robot. The Denavit–Hartenberg (D–H) Convention approach is used to compute the forward kinematics of the robotic arm. The fitness functions based on sum of squares of distance and torque are employed to compute the optimized inverse kinematics solution using the COA. A comparative analysis has been conducted with other optimization algorithms including genetic algorithm (GA), particle swarm optimization (PSO) and Grey wolf optimization (GWO), artificial bee colony (ABC) optimization, and whale optimization algorithm (WOA) to evaluate the performance of the proposed approach. The experimental results show that the COA leads to least computation error of <span>(3.59 times 10^{-7})</span> and computation time of 1.405 s as compared to GA, PSO, GWO, ABC, and WOA algorithms. Further, jerk being control input has a major impact on the efficiency of robotic arm. COA is employed to obtain the optimal joint parameters, such as joint velocity, joint acceleration, and joint jerk, respectively. This leads to a minimum jerk trajectory which contributes to the smooth movement of Kuka arm. The simulation of Kuka robotic arm for pick and place operations is performed in CoppeliaSim, which further justifies its usage for real-time applications.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"10 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139077634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-29DOI: 10.1007/s11370-023-00497-z
Abstract
The accessible environment and locomotion performance of a robot are governed by the scale of the robot. The operating time and speed can be increased as the scale of the robot increases. However, the size of the robot does limit the accessible environment: the robot cannot pass through a space smaller than its size. Therefore, to explore an environment containing gaps, holes, and crevices, a small-scale robot is required. In this paper, we propose a sub-10 cm, sub-100 g scale jumping–crawling robot. The proposed robot consists of crawling, jumping, and self-righting mechanisms. The combination of crawling and jumping allowed the robot to overcome obstacles of various sizes. To reduce the weight and size of the robot, we employed a smart composite microstructures (SCM) design method and utilized a shape memory alloy (SMA) actuator. All the mechanisms and electronic components were compactly integrated into a single robot. The robot can crawl with the maximum speed of 3.94 cm/s (0.4 BL/s), and jump 19 cm which is 2.2 times its body height.
{"title":"Development of the sub-10 cm, sub-100 g jumping–crawling robot","authors":"","doi":"10.1007/s11370-023-00497-z","DOIUrl":"https://doi.org/10.1007/s11370-023-00497-z","url":null,"abstract":"<h3>Abstract</h3> <p>The accessible environment and locomotion performance of a robot are governed by the scale of the robot. The operating time and speed can be increased as the scale of the robot increases. However, the size of the robot does limit the accessible environment: the robot cannot pass through a space smaller than its size. Therefore, to explore an environment containing gaps, holes, and crevices, a small-scale robot is required. In this paper, we propose a sub-10 cm, sub-100 g scale jumping–crawling robot. The proposed robot consists of crawling, jumping, and self-righting mechanisms. The combination of crawling and jumping allowed the robot to overcome obstacles of various sizes. To reduce the weight and size of the robot, we employed a smart composite microstructures (SCM) design method and utilized a shape memory alloy (SMA) actuator. All the mechanisms and electronic components were compactly integrated into a single robot. The robot can crawl with the maximum speed of 3.94 cm/s (0.4 BL/s), and jump 19 cm which is 2.2 times its body height. </p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"33 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139067251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-27DOI: 10.1007/s11370-023-00509-y
Abstract
Rehabilitation of the upper and lower limbs is crucial for patients recovering from strokes, surgeries, or injuries. Traditional rehabilitation often takes place in hospitals under the guidance of a therapist, which can delay treatment due to various constraints. This paper proposes a soft robotic device designed to aid in the flexion and extension of both the elbow and knee. The device utilizes pneumatic artificial muscles, constructed from an elastomeric bladder with a threaded mesh exterior, as its actuating mechanism. It operates in two distinct modes: a continuous passive mode, where continuous, repetitive flexion, and extension of limbs are carried out, and an active intent-based assisted mode, which detects a patient's movement intention via surface electromyography (sEMG) and subsequently aids in the movement execution. To test the effectiveness of the device, sEMG electrodes were placed on upper and lower limbs of six healthy male subjects, range of motion, and muscle activity were recorded with and without the device. Also NASA task load index (NASA-TLX) was calculated for the usability of the device. The results indicate the required muscle activity and range of motions for both upper and lower limb rehabilitation are effectively generated in both the modes.
摘要 上肢和下肢的康复对中风、手术或受伤后的病人至关重要。传统的康复训练通常是在医院里由治疗师指导进行的,这可能会因各种限制因素而延误治疗。本文提出了一种软机器人装置,旨在帮助肘部和膝部的屈伸。该装置采用气动人工肌肉作为驱动机制,气动人工肌肉由弹性膀胱和带螺纹的网状外层构成。它有两种不同的工作模式:一种是连续被动模式,即进行连续、重复性的肢体屈伸运动;另一种是基于意图的主动辅助模式,即通过表面肌电图(sEMG)检测患者的运动意图,然后辅助患者进行运动。为了测试该装置的有效性,我们在六名健康男性受试者的上下肢上放置了 sEMG 电极,记录了使用和不使用该装置时的运动范围和肌肉活动。此外,还计算了 NASA 任务负荷指数(NASA-TLX),以确定该装置的可用性。结果表明,在这两种模式下,都能有效生成上肢和下肢康复所需的肌肉活动和运动范围。
{"title":"Pneumatic artificial muscle-based stroke rehabilitation device for upper and lower limbs","authors":"","doi":"10.1007/s11370-023-00509-y","DOIUrl":"https://doi.org/10.1007/s11370-023-00509-y","url":null,"abstract":"<h3>Abstract</h3> <p>Rehabilitation of the upper and lower limbs is crucial for patients recovering from strokes, surgeries, or injuries. Traditional rehabilitation often takes place in hospitals under the guidance of a therapist, which can delay treatment due to various constraints. This paper proposes a soft robotic device designed to aid in the flexion and extension of both the elbow and knee. The device utilizes pneumatic artificial muscles, constructed from an elastomeric bladder with a threaded mesh exterior, as its actuating mechanism. It operates in two distinct modes: a continuous passive mode, where continuous, repetitive flexion, and extension of limbs are carried out, and an active intent-based assisted mode, which detects a patient's movement intention via surface electromyography (sEMG) and subsequently aids in the movement execution. To test the effectiveness of the device, sEMG electrodes were placed on upper and lower limbs of six healthy male subjects, range of motion, and muscle activity were recorded with and without the device. Also NASA task load index (NASA-TLX) was calculated for the usability of the device. The results indicate the required muscle activity and range of motions for both upper and lower limb rehabilitation are effectively generated in both the modes.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"81 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139056010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-26DOI: 10.1007/s11370-023-00506-1
Abstract
Soft surgical robots represent a groundbreaking innovation in the field of medical technology. These robots utilize soft, deformable materials to navigate and interact with delicate structures inside the human body, such as organs and blood vessels, with enhanced safety. They have the potential to transform healthcare by expanding the capabilities of minimally invasive surgeries, targeted drug delivery, and precise diagnostics. They can also reduce patient discomfort, recovery times, and the risk of complications, infections, and accidental injuries. The key to the functionality of soft surgical robots lies in their actuation mechanisms. Various actuation methods have been developed, including pneumatic, magnetic, tendon-driven, smart materials (like shape memory alloys, dielectric elastomer actuators, and ionic polymer–metal composites), and hybrid combinations of these mechanisms. Each actuator type offers unique advantages and challenges, making the selection of the right actuation solution a complex task. This review paper aims to provide a comprehensive understanding of these soft actuation mechanisms and their applications in surgical robotics. It delves into the current state of the art in various applications, from endoscopes and catheters to cardiac support devices, bioinspired inchworm robots, and more. While significant progress has been made in the field of soft actuators for surgical robotics, this paper identifies several challenges that must still be overcome to effectively apply these innovations in real-life surgical procedures on human patients.
{"title":"Soft actuators in surgical robotics: a state-of-the-art review","authors":"","doi":"10.1007/s11370-023-00506-1","DOIUrl":"https://doi.org/10.1007/s11370-023-00506-1","url":null,"abstract":"<h3>Abstract</h3> <p>Soft surgical robots represent a groundbreaking innovation in the field of medical technology. These robots utilize soft, deformable materials to navigate and interact with delicate structures inside the human body, such as organs and blood vessels, with enhanced safety. They have the potential to transform healthcare by expanding the capabilities of minimally invasive surgeries, targeted drug delivery, and precise diagnostics. They can also reduce patient discomfort, recovery times, and the risk of complications, infections, and accidental injuries. The key to the functionality of soft surgical robots lies in their actuation mechanisms. Various actuation methods have been developed, including pneumatic, magnetic, tendon-driven, smart materials (like shape memory alloys, dielectric elastomer actuators, and ionic polymer–metal composites), and hybrid combinations of these mechanisms. Each actuator type offers unique advantages and challenges, making the selection of the right actuation solution a complex task. This review paper aims to provide a comprehensive understanding of these soft actuation mechanisms and their applications in surgical robotics. It delves into the current state of the art in various applications, from endoscopes and catheters to cardiac support devices, bioinspired inchworm robots, and more. While significant progress has been made in the field of soft actuators for surgical robotics, this paper identifies several challenges that must still be overcome to effectively apply these innovations in real-life surgical procedures on human patients.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"2 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139055867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-21DOI: 10.1007/s11370-023-00499-x
Jean Chagas Vaz, Nicolas Kosanovic, Paul Oh
Material handling loco-manipulation is heavily present in humanitarian assistance and disaster relief (HADR) efforts. Consider a scenario requiring human expertise to transcend the physical location of the human body; an approach—harnessing the innately long-range and precise abilities of robotic Avatar technologies—was successfully applied to material handling and loco-manipulation tasks, proving that humanoids may play an integral role in future disaster relief. Typically, first responders, such as firefighters and/or paramedics, must carry, push, pull, and handle objects, facilitating the transportation of goods. Hence, researchers have sought to enable full-sized humanoid robots to perform such essential material handling tasks. This work aims to tackle current limitations in humanoid object interaction capabilities, specifically with common objects such as carts, wheelbarrows, etc. Furthermore, this article compiles many methods to ensure stable gait during cart loco-manipulation. The examined objects range from simple carts (such as rolling and utility carts) to challenging carts (such as wheelbarrows). Thus, the authors present a comprehensive approach to address some of the most convoluted material handling and loco-manipulation challenges in the field of humanoid robotics. Finally, promising results are showcased when ART (Avatar Robotics Telepresence) and humanoid embodiment are applied in the context of loco-manipulation and material handling.
{"title":"ART: Avatar Robotics Telepresence—the future of humanoid material handling loco-manipulation","authors":"Jean Chagas Vaz, Nicolas Kosanovic, Paul Oh","doi":"10.1007/s11370-023-00499-x","DOIUrl":"https://doi.org/10.1007/s11370-023-00499-x","url":null,"abstract":"<p>Material handling loco-manipulation is heavily present in humanitarian assistance and disaster relief (HADR) efforts. Consider a scenario requiring human expertise to transcend the physical location of the human body; an approach—harnessing the innately long-range and precise abilities of robotic Avatar technologies—was successfully applied to material handling and loco-manipulation tasks, proving that humanoids may play an integral role in future disaster relief. Typically, first responders, such as firefighters and/or paramedics, must carry, push, pull, and handle objects, facilitating the transportation of goods. Hence, researchers have sought to enable full-sized humanoid robots to perform such essential material handling tasks. This work aims to tackle current limitations in humanoid object interaction capabilities, specifically with common objects such as carts, wheelbarrows, etc. Furthermore, this article compiles many methods to ensure stable gait during cart loco-manipulation. The examined objects range from simple carts (such as rolling and utility carts) to challenging carts (such as wheelbarrows). Thus, the authors present a comprehensive approach to address some of the most convoluted material handling and loco-manipulation challenges in the field of humanoid robotics. Finally, promising results are showcased when ART (Avatar Robotics Telepresence) and humanoid embodiment are applied in the context of loco-manipulation and material handling.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"37 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139029583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-19DOI: 10.1007/s11370-023-00495-1
Abstract
Robot-assisted navigation is a perfect example of a class of applications requiring flexible control approaches. When the human is reliable, the robot should concede space to their initiative. When the human makes inappropriate choices the robot controller should kick-in guiding them towards safer paths. Shared authority control is a way to achieve this behaviour by deciding online how much of the authority should be given to the human and how much should be retained by the robot. An open problem is how to evaluate the appropriateness of the human’s choices. One possible way is to consider the deviation from an ideal path computed by the robot. This choice is certainly safe and efficient, but it emphasises the importance of the robot’s decision and relegates the human to a secondary role. In this paper, we propose a different paradigm: a human’s behaviour is correct if, at every time, it bears a close resemblance to what other humans do in similar situations. This idea is implemented through the combination of machine learning and adaptive control. The map of the environment is decomposed into a grid. In each cell, we classify the possible motions that the human executes. We use a neural network classifier to classify the current motion, and the probability score is used as a hyperparameter in the control to vary the amount of intervention. The experiments collected for the paper show the feasibility of the idea. A qualitative evaluation, done by surveying the users after they have tested the robot, shows that the participants preferred our control method over a state-of-the-art visco-elastic control.
{"title":"Humanising robot-assisted navigation","authors":"","doi":"10.1007/s11370-023-00495-1","DOIUrl":"https://doi.org/10.1007/s11370-023-00495-1","url":null,"abstract":"<h3>Abstract</h3> <p>Robot-assisted navigation is a perfect example of a class of applications requiring flexible control approaches. When the human is reliable, the robot should concede space to their initiative. When the human makes inappropriate choices the robot controller should kick-in guiding them towards safer paths. Shared authority control is a way to achieve this behaviour by deciding online how much of the authority should be given to the human and how much should be retained by the robot. An open problem is how to evaluate the appropriateness of the human’s choices. One possible way is to consider the deviation from an ideal path computed by the robot. This choice is certainly safe and efficient, but it emphasises the importance of the robot’s decision and relegates the human to a secondary role. In this paper, we propose a different paradigm: a human’s behaviour is correct if, at every time, it bears a close resemblance to what other humans do in similar situations. This idea is implemented through the combination of machine learning and adaptive control. The map of the environment is decomposed into a grid. In each cell, we classify the possible motions that the human executes. We use a neural network classifier to classify the current motion, and the probability score is used as a hyperparameter in the control to vary the amount of intervention. The experiments collected for the paper show the feasibility of the idea. A qualitative evaluation, done by surveying the users after they have tested the robot, shows that the participants preferred our control method over a state-of-the-art visco-elastic control.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"1 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138745010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-19DOI: 10.1007/s11370-023-00496-0
Seongcheol Kim, Casey C. Bennett, Zachary Henkel, Jinjae Lee, Cedomir Stanojevic, Kenna Baugus, Cindy L. Bethel, Jennifer A. Piatt, Selma Šabanović
Deploying socially assistive robots (SARs) at home, such as robotic companion pets, can be useful for tracking behavioral and health-related changes in humans during lifestyle fluctuations over time, like those experienced during CoVID-19. However, a fundamental problem required when deploying autonomous agents such as SARs in people’s everyday living spaces is understanding how users interact with those robots when not observed by researchers. One way to address that is to utilize novel modeling methods based on the robot’s sensor data, combined with newer types of interaction evaluation such as ecological momentary assessment (EMA), to recognize behavior modalities. This paper presents such a study of human-specific behavior classification based on data collected through EMA and sensors attached onboard a SAR, which was deployed in user homes. Classification was conducted using generative replay models, which attempt to use encoding/decoding methods to emulate how human dreaming is thought to create perturbations of the same experience in order to learn more efficiently from less data. Both multi-class and binary classification were explored for comparison, using several types of generative replay (variational autoencoders, generative adversarial networks, semi-supervised GANs). The highest-performing binary model showed approximately 79% accuracy (AUC 0.83), though multi-class classification across all modalities only attained 33% accuracy (AUC 0.62, F1 0.25), despite various attempts to improve it. The paper here highlights the strengths and weaknesses of using generative replay for modeling during human–robot interaction in the real world and also suggests a number of research paths for future improvement.
在家中部署社交辅助机器人(SARs),如机器人伴侣宠物,有助于跟踪人类在生活方式随时间变化时的行为和健康相关变化,如 CoVID-19 期间所经历的变化。然而,在人们的日常生活空间部署 SAR 等自主代理时,需要解决的一个基本问题是了解用户在没有被研究人员观察到的情况下是如何与这些机器人互动的。解决这一问题的方法之一是利用基于机器人传感器数据的新型建模方法,并结合生态瞬间评估(EMA)等新型交互评估方法来识别行为模式。本文介绍了基于通过 EMA 和安装在用户家中的合成孔径雷达(SAR)上的传感器收集的数据进行的人类特定行为分类研究。该模型试图使用编码/解码方法来模拟人类做梦时如何对相同体验进行扰动,以便更有效地从更少的数据中学习。为了进行比较,我们使用几种类型的生成式重放(变异自动编码器、生成式对抗网络、半监督 GAN)对多类和二元分类进行了探索。表现最出色的二元模型显示了约 79% 的准确率(AUC 0.83),而所有模式的多类分类仅达到了 33% 的准确率(AUC 0.62,F1 0.25),尽管尝试了各种改进方法。本文强调了在现实世界中使用生成式重放进行人机交互建模的优缺点,并提出了一些未来改进的研究路径。
{"title":"Generative replay for multi-class modeling of human activities via sensor data from in-home robotic companion pets","authors":"Seongcheol Kim, Casey C. Bennett, Zachary Henkel, Jinjae Lee, Cedomir Stanojevic, Kenna Baugus, Cindy L. Bethel, Jennifer A. Piatt, Selma Šabanović","doi":"10.1007/s11370-023-00496-0","DOIUrl":"https://doi.org/10.1007/s11370-023-00496-0","url":null,"abstract":"<p>Deploying socially assistive robots (SARs) at home, such as robotic companion pets, can be useful for tracking behavioral and health-related changes in humans during lifestyle fluctuations over time, like those experienced during CoVID-19. However, a fundamental problem required when deploying autonomous agents such as SARs in people’s everyday living spaces is understanding how users interact with those robots when not observed by researchers. One way to address that is to utilize novel modeling methods based on the robot’s sensor data, combined with newer types of interaction evaluation such as ecological momentary assessment (EMA), to recognize behavior modalities. This paper presents such a study of human-specific behavior classification based on data collected through EMA and sensors attached onboard a SAR, which was deployed in user homes. Classification was conducted using <i>generative replay</i> models, which attempt to use encoding/decoding methods to emulate how human dreaming is thought to create perturbations of the same experience in order to learn more efficiently from less data. Both multi-class and binary classification were explored for comparison, using several types of generative replay (variational autoencoders, generative adversarial networks, semi-supervised GANs). The highest-performing binary model showed approximately 79% accuracy (AUC 0.83), though multi-class classification across all modalities only attained 33% accuracy (AUC 0.62, F1 0.25), despite various attempts to improve it. The paper here highlights the strengths and weaknesses of using generative replay for modeling during human–robot interaction in the real world and also suggests a number of research paths for future improvement.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"72 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138745015","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}