首页 > 最新文献

International Journal of Intelligent Robotics and Applications最新文献

英文 中文
Cross-pollination of knowledge for object detection in domain adaptation for industrial automation 工业自动化领域适应性对象检测知识的交叉渗透
IF 1.7 Q3 ROBOTICS Pub Date : 2024-09-09 DOI: 10.1007/s41315-024-00372-9
Anwar Ur Rehman, Ignazio Gallo

Artificial Intelligence is revolutionizing industries by enhancing efficiency through real-time Object Detection (OD) applications. Utilizing advanced computer vision techniques, OD systems automate processes, analyze complex visual data, and facilitate data-driven decisions, thus increasing productivity. Domain Adaptation for OD has recently gained prominence for its ability to recognize target objects without annotations. Innovative approaches that merge traditional cross-disciplinary domain modeling with cutting-edge deep learning have become essential in addressing complex AI challenges in real-time scenarios. Unlike traditional methods, this study proposes a novel, effective Cross-Pollination of Knowledge (CPK) strategy for domain adaptation inspired by botanical processes. The CPK approach involves merging target samples with source samples at the input stage. By incorporating a random and unique selection of a few target samples, the merging process enhances object detection results efficiently in domain adaptation, supporting detectors in aligning and generalizing features with the source domain. Additionally, this work presents the new Planeat digit recognition dataset, which includes 231 images. To ensure robust comparison, we employ a self-supervised Domain Adaptation (UDA) method that simultaneously trains target and source domains using unsupervised techniques. UDA method leverages target data to identify high-confidence regions, which are then cropped and augmented, adapting UDA for effective OD. The proposed CPK approach significantly outperforms existing UDA techniques, improving mean Average Precision (mAP) by 10.9% through rigorous testing on five diverse datasets across different conditions- cross-weather, cross-camera, and synthetic-to-real. Our code is publicly available https://github.com/anwaar0/CPK-Object-Detection

人工智能正在通过实时物体检测(OD)应用提高效率,从而为各行各业带来变革。利用先进的计算机视觉技术,OD 系统可实现流程自动化,分析复杂的视觉数据,促进数据驱动型决策,从而提高生产率。最近,用于 OD 的领域适应技术因其在没有注释的情况下识别目标对象的能力而备受瞩目。将传统的跨学科领域建模与前沿的深度学习相结合的创新方法,对于解决实时场景中复杂的人工智能挑战至关重要。与传统方法不同,本研究受植物学过程的启发,提出了一种新颖、有效的知识交叉渗透(CPK)领域适应策略。CPK 方法涉及在输入阶段将目标样本与源样本合并。通过随机、独特地选择一些目标样本,合并过程可在领域适应过程中有效增强目标检测结果,支持检测器根据源领域调整和概括特征。此外,这项工作还提出了新的 Planeat 数字识别数据集,其中包括 231 幅图像。为了确保比较的稳健性,我们采用了一种自监督域适应(UDA)方法,利用无监督技术同时训练目标域和源域。UDA 方法利用目标数据来识别高置信度区域,然后对这些区域进行裁剪和增强,调整 UDA 以实现有效的 OD。所提出的 CPK 方法明显优于现有的 UDA 技术,通过在跨天气、跨摄像头和合成到真实等不同条件的五个不同数据集上进行严格测试,平均精度 (mAP) 提高了 10.9%。我们的代码已公开 https://github.com/anwaar0/CPK-Object-Detection
{"title":"Cross-pollination of knowledge for object detection in domain adaptation for industrial automation","authors":"Anwar Ur Rehman, Ignazio Gallo","doi":"10.1007/s41315-024-00372-9","DOIUrl":"https://doi.org/10.1007/s41315-024-00372-9","url":null,"abstract":"<p>Artificial Intelligence is revolutionizing industries by enhancing efficiency through real-time Object Detection (OD) applications. Utilizing advanced computer vision techniques, OD systems automate processes, analyze complex visual data, and facilitate data-driven decisions, thus increasing productivity. Domain Adaptation for OD has recently gained prominence for its ability to recognize target objects without annotations. Innovative approaches that merge traditional cross-disciplinary domain modeling with cutting-edge deep learning have become essential in addressing complex AI challenges in real-time scenarios. Unlike traditional methods, this study proposes a novel, effective Cross-Pollination of Knowledge (CPK) strategy for domain adaptation inspired by botanical processes. The CPK approach involves merging target samples with source samples at the input stage. By incorporating a random and unique selection of a few target samples, the merging process enhances object detection results efficiently in domain adaptation, supporting detectors in aligning and generalizing features with the source domain. Additionally, this work presents the new Planeat digit recognition dataset, which includes 231 images. To ensure robust comparison, we employ a self-supervised Domain Adaptation (UDA) method that simultaneously trains target and source domains using unsupervised techniques. UDA method leverages target data to identify high-confidence regions, which are then cropped and augmented, adapting UDA for effective OD. The proposed CPK approach significantly outperforms existing UDA techniques, improving mean Average Precision (mAP) by 10.9% through rigorous testing on five diverse datasets across different conditions- cross-weather, cross-camera, and synthetic-to-real. Our code is publicly available https://github.com/anwaar0/CPK-Object-Detection</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Push or pull: grasping performance analysis between a pulling gripper inspired by Tetraonchus monenteron parasite versus an actively pushing gripper developed through many-objective design optimization 推还是拉:受四爪蝇寄生虫启发开发的拉式抓手与通过多目标优化设计开发的主动推式抓手的抓取性能分析
IF 1.7 Q3 ROBOTICS Pub Date : 2024-09-08 DOI: 10.1007/s41315-024-00377-4
Rituparna Datta, Akkarapakam Suneesh Jacob, Bishakh Bhattacharya

Investigation and subsequent abstraction of biological systems have become a popular approach to innovate new mechanisms. Robot gripper design is an active research area that seeks continuous improvements to cater to its wide spectrum of applications. Tetraonchus momenteron is an infamous parasite which has a robust gripping system (haptor) inserted into the fish-gills. We have redesigned this pull-based gripper for practical application by adjusting the link lengths using many-objective optimization. An existing pusher type of gripper mechanism is also selected to elucidate the similarities and dissimilarities between both the mechanisms. Both push and pull based grippers have been analyzed based on quasi static kinematics and are formulated as many objective optimization problems subjected to geometric-cum-force constraints. The goal of optimization is to find the best link lengths and joint angles for each configuration based on desired criteria. Four possible variants of piezoelectric actuator models are integrated into the optimization formulation to actuate the gripper models. These integrations have led to four different optimization problems for each case. Evolutionary many-objective optimization method is used to obtain non-dominated solutions. The optimized designs are compared based on objective function values to evaluate the performance of each gripper. The results of many-objective optimization are normalized and represented using parallel coordinate plots to aid the decision maker. Our comparative study reveals that while the new nature inspired pull based design has shown promising results in many cases, each gripper configuration has its own merits and requires decision maker’s intervention to choose a particular model based on specific requirement.

对生物系统的研究和随后的抽象已成为创新新机制的一种流行方法。机器人抓手设计是一个活跃的研究领域,它不断寻求改进,以满足其广泛的应用需求。Tetraonchus momenteron 是一种臭名昭著的寄生虫,它的鱼鳃上有一个坚固的抓取系统(触手)。我们通过多目标优化调整链节长度,重新设计了这种基于拉力的抓取器,以满足实际应用的需要。我们还选择了现有的推式机械手机制,以阐明两种机制之间的异同。基于准静态运动学对推式和拉式机械手进行了分析,并将其表述为受几何和力约束的多目标优化问题。优化的目标是根据所需的标准为每种配置找到最佳的链接长度和关节角度。压电致动器模型的四种可能变体被集成到优化公式中,以驱动机械手模型。这些集成为每种情况带来了四个不同的优化问题。进化多目标优化法用于获得非主导解。根据目标函数值对优化设计进行比较,以评估每个机械手的性能。多目标优化的结果被归一化,并用平行坐标图表示,以帮助决策者。我们的比较研究表明,虽然新的基于自然灵感的拉力设计在许多情况下都显示出了良好的效果,但每种机械手配置都有其自身的优点,需要决策者根据具体要求来选择特定的模型。
{"title":"Push or pull: grasping performance analysis between a pulling gripper inspired by Tetraonchus monenteron parasite versus an actively pushing gripper developed through many-objective design optimization","authors":"Rituparna Datta, Akkarapakam Suneesh Jacob, Bishakh Bhattacharya","doi":"10.1007/s41315-024-00377-4","DOIUrl":"https://doi.org/10.1007/s41315-024-00377-4","url":null,"abstract":"<p>Investigation and subsequent abstraction of biological systems have become a popular approach to innovate new mechanisms. Robot gripper design is an active research area that seeks continuous improvements to cater to its wide spectrum of applications. Tetraonchus momenteron is an infamous parasite which has a robust gripping system (haptor) inserted into the fish-gills. We have redesigned this pull-based gripper for practical application by adjusting the link lengths using many-objective optimization. An existing pusher type of gripper mechanism is also selected to elucidate the similarities and dissimilarities between both the mechanisms. Both push and pull based grippers have been analyzed based on quasi static kinematics and are formulated as many objective optimization problems subjected to geometric-cum-force constraints. The goal of optimization is to find the best link lengths and joint angles for each configuration based on desired criteria. Four possible variants of piezoelectric actuator models are integrated into the optimization formulation to actuate the gripper models. These integrations have led to four different optimization problems for each case. Evolutionary many-objective optimization method is used to obtain non-dominated solutions. The optimized designs are compared based on objective function values to evaluate the performance of each gripper. The results of many-objective optimization are normalized and represented using parallel coordinate plots to aid the decision maker. Our comparative study reveals that while the new nature inspired pull based design has shown promising results in many cases, each gripper configuration has its own merits and requires decision maker’s intervention to choose a particular model based on specific requirement.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Spider robot walking gait optimization using Jaya multi-objective optimization algorithm 使用 Jaya 多目标优化算法优化蜘蛛机器人的行走步态
IF 1.7 Q3 ROBOTICS Pub Date : 2024-09-06 DOI: 10.1007/s41315-024-00381-8
Nguyen Tien Dat, Ho Pham Huy Anh

The legs must move in a pattern to ensure that a four-legged robot walks organically and uses less energy. This is still a challenging issue today since four-legged creatures with incredibly complicated structures and precise motions are beyond the reach of current technology. This paper proposes a gait generation model for a spider robot that examines the guarantee between stability and speed. First, the robot spider’s movement rules are initiatively determined via four gait parameters—vertical step length, horizontal step length, leg lift, and knee bend. Meanwhile, the 3rd-order interpolation function determines the trajectory of the hips and feet at each leg. By applying analytical methods to solve the inverse kinematics issue, the orbits of the hips and feet at the four legs of the spider robot will be used to deduce twelve joint angle orbits at those locations. Then, a multi-objective function is proposed regarding both speed and stability based on the gait characteristics (gait parameters, CoP/ZMP trajectory) of the spider robot as to train the gait generation model by addressing the forward kinematics issue analytically. Finally, the multi-object MO-Jaya optimization technique is used to find four optimal gait parameters so that the spider robot performs a stable walking gait at the fastest speed. This proposal is implemented for the experiment B3-SBOT spider robot, simulation/experiment outcomes show that B3-SBOT moves at its fastest feasible speed while walking stably.

四条腿必须按照一定的模式运动,以确保四足机器人有条不紊地行走,并消耗更少的能量。这在今天仍然是一个具有挑战性的问题,因为结构极其复杂、运动极其精确的四足动物是现有技术无法实现的。本文提出了一种蜘蛛机器人步态生成模型,研究稳定性和速度之间的保证。首先,通过四个步态参数--垂直步长、水平步长、抬腿和屈膝,主动确定机器蜘蛛的运动规则。同时,三阶插值函数决定了每条腿的臀部和脚部的运动轨迹。通过应用分析方法解决逆运动学问题,将利用蜘蛛机器人四条腿的髋关节和脚的轨迹推导出这些位置的十二个关节角度轨迹。然后,根据蜘蛛机器人的步态特征(步态参数、CoP/ZMP 轨迹),提出速度和稳定性的多目标函数,通过分析解决正向运动学问题来训练步态生成模型。最后,利用多目标 MO-Jaya 优化技术找到四个最佳步态参数,使蜘蛛机器人以最快的速度执行稳定的行走步态。仿真/实验结果表明,B3-SBOT 在稳定行走的同时以最快的速度移动。
{"title":"Spider robot walking gait optimization using Jaya multi-objective optimization algorithm","authors":"Nguyen Tien Dat, Ho Pham Huy Anh","doi":"10.1007/s41315-024-00381-8","DOIUrl":"https://doi.org/10.1007/s41315-024-00381-8","url":null,"abstract":"<p>The legs must move in a pattern to ensure that a four-legged robot walks organically and uses less energy. This is still a challenging issue today since four-legged creatures with incredibly complicated structures and precise motions are beyond the reach of current technology. This paper proposes a gait generation model for a spider robot that examines the guarantee between stability and speed. First, the robot spider’s movement rules are initiatively determined via four gait parameters—vertical step length, horizontal step length, leg lift, and knee bend. Meanwhile, the 3rd-order interpolation function determines the trajectory of the hips and feet at each leg. By applying analytical methods to solve the inverse kinematics issue, the orbits of the hips and feet at the four legs of the spider robot will be used to deduce twelve joint angle orbits at those locations. Then, a multi-objective function is proposed regarding both speed and stability based on the gait characteristics (gait parameters, CoP/ZMP trajectory) of the spider robot as to train the gait generation model by addressing the forward kinematics issue analytically. Finally, the multi-object MO-Jaya optimization technique is used to find four optimal gait parameters so that the spider robot performs a stable walking gait at the fastest speed. This proposal is implemented for the experiment B3-SBOT spider robot, simulation/experiment outcomes show that B3-SBOT moves at its fastest feasible speed while walking stably.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179099","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Review on design, development, and implementation of an unmanned aerial vehicle for various applications 审查用于各种应用的无人驾驶飞行器的设计、开发和实施情况
IF 1.7 Q3 ROBOTICS Pub Date : 2024-09-04 DOI: 10.1007/s41315-024-00359-6
Mubina Shekh, Sushila Rani, Rituparna Datta

Drones are technically denoted as unmanned aerial vehicles (UAVs) or unmanned aerial systems (UAS). These are remotely or autonomously piloted aircraft and can fly without an onboard human pilot while being controlled from the ground. The need for UAVs is commonly found in wireless communication beyond human trajectory. Recently, drones have been used for a wide variety of tasks, including military operations, mining, agriculture, and general-purpose applications such as surveillance, exploration, rescue, arms and product delivery, mapping and surveying, entertainment, photography, etc. These UAVs are equipped with a range of Micro-electromechanical Systems (MEMS), including sensors, cameras, controllers, etc. In this manuscript, a novel taxonomy of flying drones with their explicitly defined applications, encompassing UAVs to smart sensors, has been reviewed. The paper also consists of a quick overview of various designing, controlling, and intelligent controller and navigation approaches of UAVs with possible applications. The goal of this study is to offer a review of the best techniques that the researcher can employ or suggest for various UAV-based applications. The paper highlights several challenges that are associated with the modeling, building, controlling, and navigating of UAVs. The article also attempts to suggest some lesser-explored areas that have the potential for future research work, such as battery refilling management, anti-theft devices, sensors to avoid collision, etc.

无人机在技术上被称为无人驾驶飞行器(UAV)或无人驾驶航空系统(UAS)。它们是遥控或自主驾驶的飞机,可以在没有机载人类飞行员的情况下飞行,同时由地面控制。对无人机的需求通常出现在人类轨迹之外的无线通信领域。最近,无人机已被广泛用于各种任务,包括军事行动、采矿、农业以及监视、勘探、救援、武器和产品运送、测绘、娱乐、摄影等通用应用。这些无人机配备了一系列微机电系统(MEMS),包括传感器、摄像头、控制器等。本手稿对飞行无人机及其明确定义的应用(从无人机到智能传感器)进行了新颖的分类。本文还快速概述了无人机的各种设计、控制、智能控制器和导航方法,以及可能的应用。本研究的目的是对研究人员可用于或建议用于各种无人机应用的最佳技术进行综述。本文强调了与无人机建模、构建、控制和导航相关的若干挑战。文章还试图提出一些探索较少的领域,这些领域具有未来研究工作的潜力,如电池补给管理、防盗装置、避免碰撞的传感器等。
{"title":"Review on design, development, and implementation of an unmanned aerial vehicle for various applications","authors":"Mubina Shekh, Sushila Rani, Rituparna Datta","doi":"10.1007/s41315-024-00359-6","DOIUrl":"https://doi.org/10.1007/s41315-024-00359-6","url":null,"abstract":"<p>Drones are technically denoted as unmanned aerial vehicles (UAVs) or unmanned aerial systems (UAS). These are remotely or autonomously piloted aircraft and can fly without an onboard human pilot while being controlled from the ground. The need for UAVs is commonly found in wireless communication beyond human trajectory. Recently, drones have been used for a wide variety of tasks, including military operations, mining, agriculture, and general-purpose applications such as surveillance, exploration, rescue, arms and product delivery, mapping and surveying, entertainment, photography, etc. These UAVs are equipped with a range of Micro-electromechanical Systems (MEMS), including sensors, cameras, controllers, etc. In this manuscript, a novel taxonomy of flying drones with their explicitly defined applications, encompassing UAVs to smart sensors, has been reviewed. The paper also consists of a quick overview of various designing, controlling, and intelligent controller and navigation approaches of UAVs with possible applications. The goal of this study is to offer a review of the best techniques that the researcher can employ or suggest for various UAV-based applications. The paper highlights several challenges that are associated with the modeling, building, controlling, and navigating of UAVs. The article also attempts to suggest some lesser-explored areas that have the potential for future research work, such as battery refilling management, anti-theft devices, sensors to avoid collision, etc.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
2D and 3D path planning for mobile robots based on improved SSA algorithm 基于改进 SSA 算法的移动机器人二维和三维路径规划
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-30 DOI: 10.1007/s41315-024-00374-7
Mailing Zhang, Pei Hao

In recent years, mobile robots have been widely used in industrial automation, logistics, military, medical, and service industries. However, traditional mobile robots face difficulties in complex path planning. To solve this problem, a robot 2D and 3D path planning method has been proposed. Based on improved sparrow search algorithm (SSA), this method introduces a parameter adaptive update strategy to balance search and development. To enhance the algorithm’s path search capability in 3D environments, this study innovatively introduces ant colony algorithm to generate initial paths based on SSA. It also introduces local search mechanism to help the algorithm select the optimal path. Experiments have shown that the improved algorithm can quickly plan the shortest path, with a length reduction of 3.37% and 6.82%. It has reduced the average length by 6.09% and 5.54%, respectively. To verify its search performance, the improved algorithm significantly improved its convergence accuracy, and improved its mean fitness by about 20.5%, 24%, and 27.5%, respectively. The proposed technology has good application effects and will provide important technical references for mobile robots’ path planning in load environments.

近年来,移动机器人已广泛应用于工业自动化、物流、军事、医疗和服务等行业。然而,传统的移动机器人在复杂的路径规划中面临着困难。为了解决这个问题,人们提出了一种机器人二维和三维路径规划方法。该方法基于改进的麻雀搜索算法(SSA),引入了参数自适应更新策略,以平衡搜索和开发。为了增强算法在三维环境中的路径搜索能力,本研究在 SSA 的基础上创新性地引入了蚁群算法来生成初始路径。它还引入了局部搜索机制,帮助算法选择最优路径。实验表明,改进后的算法可以快速规划出最短路径,长度缩短了 3.37% 和 6.82%。平均长度分别减少了 6.09% 和 5.54%。为了验证其搜索性能,改进算法显著提高了收敛精度,平均适合度分别提高了约 20.5%、24% 和 27.5%。所提出的技术具有良好的应用效果,将为移动机器人在负载环境中的路径规划提供重要的技术参考。
{"title":"2D and 3D path planning for mobile robots based on improved SSA algorithm","authors":"Mailing Zhang, Pei Hao","doi":"10.1007/s41315-024-00374-7","DOIUrl":"https://doi.org/10.1007/s41315-024-00374-7","url":null,"abstract":"<p>In recent years, mobile robots have been widely used in industrial automation, logistics, military, medical, and service industries. However, traditional mobile robots face difficulties in complex path planning. To solve this problem, a robot 2D and 3D path planning method has been proposed. Based on improved sparrow search algorithm (SSA), this method introduces a parameter adaptive update strategy to balance search and development. To enhance the algorithm’s path search capability in 3D environments, this study innovatively introduces ant colony algorithm to generate initial paths based on SSA. It also introduces local search mechanism to help the algorithm select the optimal path. Experiments have shown that the improved algorithm can quickly plan the shortest path, with a length reduction of 3.37% and 6.82%. It has reduced the average length by 6.09% and 5.54%, respectively. To verify its search performance, the improved algorithm significantly improved its convergence accuracy, and improved its mean fitness by about 20.5%, 24%, and 27.5%, respectively. The proposed technology has good application effects and will provide important technical references for mobile robots’ path planning in load environments.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179128","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Proxy-based guidance virtual fixtures with orientation constraints 基于代理的具有方向约束的导向虚拟夹具
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-29 DOI: 10.1007/s41315-024-00371-w
Weitao Hu, Xinan Pan, Hongguang Wang

Aiming at the problem of defining the shortest distance between poses in traditional virtual fixtures, this paper proposes a proxy-based guidance virtual fixtures with orientation constraints, which can assist operators in the path following task. By designing the dynamics of the proxy and then connecting it to the robot using a spring-damping model, the end-effector position can be constrained within the pipeline and cone, and the stiffness coefficients of the virtual forces can be adjusted linearly or nonlinearly. To overcome the cumulative errors, we then propose a discretized improved algorithm, which applies the virtual fixtures on a discretized reference curve. Furthermore, the orientation constraints are defined, and hence the end-effector orientation can also be constrained within a specific range to comply with ergonomics. An experiment was conducted using a Franka Emika Panda robot and involving 9 subjects. The results show that compared to the gravity compensation mode, the pipeline virtual fixtures and the virtual fixtures with the pipeline and cone, as proposed in this paper, reduced task completion time by 38% and 44.7%, respectively. Additionally, they reduced the total mental burden obtained from NASA-TLX by 29.96% and 47.42%, respectively.

针对传统虚拟夹具中姿势间最短距离的定义问题,本文提出了一种具有方向约束的基于代理的引导虚拟夹具,可以帮助操作员完成路径跟随任务。通过设计代理的动力学特性,然后使用弹簧阻尼模型将其与机器人连接,末端执行器的位置就可以被约束在管道和锥体内,虚拟力的刚度系数也可以进行线性或非线性调整。为了克服累积误差,我们随后提出了一种离散化改进算法,在离散化参考曲线上应用虚拟固定装置。此外,我们还定义了方向约束,从而将末端执行器的方向约束在特定范围内,以符合人体工程学。我们使用弗兰卡-埃米卡-熊猫机器人进行了一项实验,共有 9 名受试者参与。结果表明,与重力补偿模式相比,本文提出的管道式虚拟固定装置以及带有管道和锥体的虚拟固定装置分别缩短了 38% 和 44.7% 的任务完成时间。此外,它们还将从 NASA-TLX 获取的总心理负担分别减少了 29.96% 和 47.42%。
{"title":"Proxy-based guidance virtual fixtures with orientation constraints","authors":"Weitao Hu, Xinan Pan, Hongguang Wang","doi":"10.1007/s41315-024-00371-w","DOIUrl":"https://doi.org/10.1007/s41315-024-00371-w","url":null,"abstract":"<p>Aiming at the problem of defining the shortest distance between poses in traditional virtual fixtures, this paper proposes a proxy-based guidance virtual fixtures with orientation constraints, which can assist operators in the path following task. By designing the dynamics of the proxy and then connecting it to the robot using a spring-damping model, the end-effector position can be constrained within the pipeline and cone, and the stiffness coefficients of the virtual forces can be adjusted linearly or nonlinearly. To overcome the cumulative errors, we then propose a discretized improved algorithm, which applies the virtual fixtures on a discretized reference curve. Furthermore, the orientation constraints are defined, and hence the end-effector orientation can also be constrained within a specific range to comply with ergonomics. An experiment was conducted using a Franka Emika Panda robot and involving 9 subjects. The results show that compared to the gravity compensation mode, the pipeline virtual fixtures and the virtual fixtures with the pipeline and cone, as proposed in this paper, reduced task completion time by 38% and 44.7%, respectively. Additionally, they reduced the total mental burden obtained from NASA-TLX by 29.96% and 47.42%, respectively.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction to: Improving time and energy efficiency in multi‑UAV coverage operations by optimizing the UAVs’ initial positions 更正为通过优化无人飞行器的初始位置,提高多无人飞行器覆盖行动的时间和能源效率
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-29 DOI: 10.1007/s41315-024-00361-y
Aliki Stefanopoulou, Emmanuel K. Raptis, Savvas D. Apostolidis, Socratis Gkelios, Athanasios Ch. Kapoutsis, Savvas A. Chatzichristofis, Stefanos Vrochidis, Elias B. Kosmatopoulos
{"title":"Correction to: Improving time and energy efficiency in multi‑UAV coverage operations by optimizing the UAVs’ initial positions","authors":"Aliki Stefanopoulou, Emmanuel K. Raptis, Savvas D. Apostolidis, Socratis Gkelios, Athanasios Ch. Kapoutsis, Savvas A. Chatzichristofis, Stefanos Vrochidis, Elias B. Kosmatopoulos","doi":"10.1007/s41315-024-00361-y","DOIUrl":"https://doi.org/10.1007/s41315-024-00361-y","url":null,"abstract":"","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simplified autonomous object grasping in material handling process for human–robot collaboration 简化物料搬运过程中的自主物体抓取,实现人机协作
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-28 DOI: 10.1007/s41315-024-00375-6
Muhammad Farouk Setiawan, P. Paryanto, Joga Dharma Setiawan

The application of Human–Robot Collaboration (HRC) in the manufacturing sector, especially in the material handling process, is aimed at improving productivity through robots actively working alongside humans. In this condition, the robots need to understand how to handle the objects by themselves according to user preferences with an autonomous system. However, there have been challenges in the aspect of teaching robots to autonomously identify object grasp positions only using an RGB camera due to the effect of camera perspective on object visualization for robots. Therefore, this study aimed to propose a simplified method on an RGB camera for autonomous object grasping in the material handling process and implement it for the HRC concept. The method used a prototype robot manipulator with a computer vision system for object detection. During the execution of object grasping, the robot achieved a success rate of 86% for a single object and 76% for multiple objects. In the HRC concept, the robot achieved a success rate of 92% for placing objects one by one and 84% for placing objects continuously. The result also showed fast inference time when the robot in real-time detected the object, which was even just running on the CPU and in the planning process without complexity and requiring additional equipment aside from an RGB camera.

人机协作(HRC)在制造业中的应用,尤其是在材料处理过程中的应用,旨在通过机器人与人类一起积极工作来提高生产率。在这种情况下,机器人需要了解如何通过自主系统根据用户偏好自行处理物品。然而,由于摄像头视角对机器人物体可视化的影响,仅使用 RGB 摄像头教机器人自主识别物体抓取位置一直是个难题。因此,本研究旨在提出一种在材料处理过程中使用 RGB 摄像机自主抓取物体的简化方法,并将其应用于 HRC 概念。该方法使用带有计算机视觉系统的原型机器人机械手进行物体检测。在物体抓取过程中,机器人抓取单个物体的成功率为 86%,抓取多个物体的成功率为 76%。在 HRC 概念中,机器人逐个放置物体的成功率为 92%,连续放置物体的成功率为 84%。结果还显示,当机器人实时检测到物体时,推理时间很快,甚至只需在中央处理器上运行,在规划过程中,除了一个 RGB 摄像头外,无需复杂的额外设备。
{"title":"Simplified autonomous object grasping in material handling process for human–robot collaboration","authors":"Muhammad Farouk Setiawan, P. Paryanto, Joga Dharma Setiawan","doi":"10.1007/s41315-024-00375-6","DOIUrl":"https://doi.org/10.1007/s41315-024-00375-6","url":null,"abstract":"<p>The application of Human–Robot Collaboration (HRC) in the manufacturing sector, especially in the material handling process, is aimed at improving productivity through robots actively working alongside humans. In this condition, the robots need to understand how to handle the objects by themselves according to user preferences with an autonomous system. However, there have been challenges in the aspect of teaching robots to autonomously identify object grasp positions only using an RGB camera due to the effect of camera perspective on object visualization for robots. Therefore, this study aimed to propose a simplified method on an RGB camera for autonomous object grasping in the material handling process and implement it for the HRC concept. The method used a prototype robot manipulator with a computer vision system for object detection. During the execution of object grasping, the robot achieved a success rate of 86% for a single object and 76% for multiple objects. In the HRC concept, the robot achieved a success rate of 92% for placing objects one by one and 84% for placing objects continuously. The result also showed fast inference time when the robot in real-time detected the object, which was even just running on the CPU and in the planning process without complexity and requiring additional equipment aside from an RGB camera.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179129","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A biologically-inspired tube inspection robot with friction-based mobility 受生物启发的管道检测机器人,具有基于摩擦的移动能力
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-25 DOI: 10.1007/s41315-024-00370-x
Nihar Masurkar, Ankit Das, Manoj Rudraboina, Drake Morris-Sjolund, Fernando Alvidrez, Ehsan Dehghan-Niri, Hamid Marvi

The aging power plants are critical infrastructures that require regular inspection to ensure their longevity. Automated inspection, in particular, can save a significant amount of time and cost, and eliminate the safety concerns of manual inspection. For this purpose, we propose a biologically-inspired robot that integrates friction-based mobility and sensing. It is capable of traversing horizontal and vertical boiler tubes as well as tubes with a (45^{circ }) bend. Furthermore, the friction pads on the robot fingers allow for locomotion on the rough surfaces of the boiler tubes. These pads also provide grip on non-magnetic tubes enabling the robot to be deployed on tubes made of any material. In addition, this robot has electromagnetic acoustic transducers (EMAT) embedded in all of its fingers that enable defect detection during locomotion. The presented platform can inspect complex tubular structures and considerably reduce the time, cost, and hazards experienced in manual inspection.

老化的发电厂是重要的基础设施,需要定期检查以确保其使用寿命。自动检查尤其可以节省大量时间和成本,并消除人工检查的安全隐患。为此,我们提出了一种受生物启发的机器人,它集成了基于摩擦力的移动和传感功能。它能够穿越水平和垂直的锅炉管道,也能穿越有(45^{circ } )弯曲的管道。此外,机器人手指上的摩擦垫可以在锅炉管的粗糙表面上移动。这些摩擦垫还能在非磁性管道上提供抓力,使机器人能够在任何材料制成的管道上部署。此外,该机器人的所有手指上都嵌入了电磁声学传感器(EMAT),可在运动过程中进行缺陷检测。所介绍的平台可以检测复杂的管状结构,大大减少人工检测的时间、成本和危险。
{"title":"A biologically-inspired tube inspection robot with friction-based mobility","authors":"Nihar Masurkar, Ankit Das, Manoj Rudraboina, Drake Morris-Sjolund, Fernando Alvidrez, Ehsan Dehghan-Niri, Hamid Marvi","doi":"10.1007/s41315-024-00370-x","DOIUrl":"https://doi.org/10.1007/s41315-024-00370-x","url":null,"abstract":"<p>The aging power plants are critical infrastructures that require regular inspection to ensure their longevity. Automated inspection, in particular, can save a significant amount of time and cost, and eliminate the safety concerns of manual inspection. For this purpose, we propose a biologically-inspired robot that integrates friction-based mobility and sensing. It is capable of traversing horizontal and vertical boiler tubes as well as tubes with a <span>(45^{circ })</span> bend. Furthermore, the friction pads on the robot fingers allow for locomotion on the rough surfaces of the boiler tubes. These pads also provide grip on non-magnetic tubes enabling the robot to be deployed on tubes made of any material. In addition, this robot has electromagnetic acoustic transducers (EMAT) embedded in all of its fingers that enable defect detection during locomotion. The presented platform can inspect complex tubular structures and considerably reduce the time, cost, and hazards experienced in manual inspection.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179130","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction to: A human–robot interaction control strategy for teleoperation robot system under multi‑scenario applications 更正为多场景应用下远程操作机器人系统的人机交互控制策略
IF 1.7 Q3 ROBOTICS Pub Date : 2024-08-24 DOI: 10.1007/s41315-024-00366-7
Zhengyu Wang, Mingxin Hai, Xuchang Liu, Zongkun Pei, Sen Qian, Daoming Wang
{"title":"Correction to: A human–robot interaction control strategy for teleoperation robot system under multi‑scenario applications","authors":"Zhengyu Wang, Mingxin Hai, Xuchang Liu, Zongkun Pei, Sen Qian, Daoming Wang","doi":"10.1007/s41315-024-00366-7","DOIUrl":"https://doi.org/10.1007/s41315-024-00366-7","url":null,"abstract":"","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142179132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Intelligent Robotics and Applications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1