首页 > 最新文献

Journal of Robotics and Mechatronics最新文献

英文 中文
Robotic Forklift for Stacking Multiple Pallets with RGB-D Cameras 机器人叉车堆放多个托盘与RGB-D相机
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1265
R. Iinuma, Yusuke Hori, Hiroyuki Onoyama, Y. Kubo, T. Fukao
We propose a robotic forklift system for stacking multiple mesh pallets. The stacking of mesh pallets is an essential task for the shipping and storage of loads. However, stacking, the placement of pallet feet on pallet edges, is a complex problem owing to the small sizes of the feet and edges, leading to a complexity in the detection and the need for high accuracy in adjusting the pallets. To detect the pallets accurately, we utilize multiple RGB-D (RGB Depth) cameras that produce dense depth data under the limitations of the sensor position. However, the depth data contain noise. Hence, we implement a region growing-based algorithm to extract the pallet feet and edges without removing them. In addition, we design the control law based on path following control for the forklift to adjust the position and orientation of two pallets. To evaluate the performance of the proposed system, we conducted an experiment assuming a real task. The experimental results demonstrated that the proposed system can achieve a stacking operation with a real forklift and mesh pallets.
我们提出了一种机器人叉车系统,用于堆叠多个网格托盘。网状托盘的堆垛是货物运输和储存的一项重要任务。然而,由于托盘脚和托盘边缘的尺寸较小,托盘脚在托盘边缘上的放置是一个复杂的问题,导致检测的复杂性和对托盘调整精度的要求很高。为了准确地检测托盘,我们利用多个RGB- d (RGB深度)相机,在传感器位置的限制下产生密集的深度数据。然而,深度数据包含噪声。因此,我们实现了一种基于区域生长的算法来提取托盘脚和边缘而不移除它们。此外,我们设计了基于路径跟随控制的叉车控制律,以调整两个托盘的位置和方向。为了评估所提出的系统的性能,我们进行了一个假设真实任务的实验。实验结果表明,该系统可以实现真实叉车和网状托盘的堆垛作业。
{"title":"Robotic Forklift for Stacking Multiple Pallets with RGB-D Cameras","authors":"R. Iinuma, Yusuke Hori, Hiroyuki Onoyama, Y. Kubo, T. Fukao","doi":"10.20965/jrm.2021.p1265","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1265","url":null,"abstract":"We propose a robotic forklift system for stacking multiple mesh pallets. The stacking of mesh pallets is an essential task for the shipping and storage of loads. However, stacking, the placement of pallet feet on pallet edges, is a complex problem owing to the small sizes of the feet and edges, leading to a complexity in the detection and the need for high accuracy in adjusting the pallets. To detect the pallets accurately, we utilize multiple RGB-D (RGB Depth) cameras that produce dense depth data under the limitations of the sensor position. However, the depth data contain noise. Hence, we implement a region growing-based algorithm to extract the pallet feet and edges without removing them. In addition, we design the control law based on path following control for the forklift to adjust the position and orientation of two pallets. To evaluate the performance of the proposed system, we conducted an experiment assuming a real task. The experimental results demonstrated that the proposed system can achieve a stacking operation with a real forklift and mesh pallets.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1265-1273"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68078612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
An Optimal Design Methodology for the Trajectory of Hydraulic Excavators Based on Genetic Algorithm 基于遗传算法的液压挖掘机轨迹优化设计方法
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1248
Takamichi Yuasa, M. Ishikawa, Satoshi Ogawa
Hydraulic excavators are one type of construction equipment used in various construction sites worldwide, and their usage and scale are diverse. Generally, the work efficiency of a hydraulic excavator largely depends on human operation skills. If we can comprehend the experienced operation skills and utilize them for manual control assist, semi-automatic or automatic remote control, it would improve its work efficiency and suppress personnel costs, reduce the operator’s workload, and improve his/her safety. In this study, we propose a methodology to design efficient machine trajectories based on mathematical models and numerical optimization, focusing on ground-level excavation as a dominant task. First, we express its excavation trajectory using four parameters and assume the models for the amount of excavated soil and the reaction force based on our previous experiments. Next, we combine these models with a geometrical model for the hydraulic excavating machine. We then assign the amount of soil to a performance index preferably to be maximized and the amount of work to a cost index preferably to be minimized, both in the form of functions of the trajectory parameters, resulting in an optimization problem that trades them off. In particular, we formulate (1) a multi-objective optimization problem maximizing a weighted linear combination of the amount of soil and the amount of work as an objective function, and (2) a single-objective optimization problem maximizing the amount of soil under a given upper bound on the amount of work, so that we can solve these optimization problems using the genetic algorithm (GA). Finally, we conclude this paper by suggesting our notice on design methodology and discussing how we should provide the optimization method as mentioned above to the users who operate hydraulic excavators.
液压挖掘机是世界范围内各种建筑工地使用的一种施工设备,其用途和规模是多种多样的。一般来说,液压挖掘机的工作效率很大程度上取决于人的操作技能。如果我们能够理解经验丰富的操作技能,并将其用于手动控制辅助、半自动或自动遥控,将提高其工作效率,降低人员成本,减少操作人员的工作量,提高其安全性。在本研究中,我们提出了一种基于数学模型和数值优化的方法来设计高效的机器轨迹,并将地面开挖作为主要任务。首先,利用4个参数表示其开挖轨迹,并在前人实验的基础上建立了开挖土量和反作用力的模型。接下来,我们将这些模型与液压挖掘机的几何模型结合起来。然后,我们将土壤量分配给一个最好最大化的性能指标,将工作量分配给一个最好最小化的成本指标,两者都以轨迹参数函数的形式出现,从而产生一个权衡两者的优化问题。特别地,我们提出了(1)以土壤量和工作量的加权线性组合最大化为目标函数的多目标优化问题,以及(2)在给定工作量上界下最大化土壤量的单目标优化问题,以便我们可以使用遗传算法(GA)来解决这些优化问题。最后,我们对设计方法提出了我们的注意事项,并讨论了如何将上述优化方法提供给操作液压挖掘机的用户。
{"title":"An Optimal Design Methodology for the Trajectory of Hydraulic Excavators Based on Genetic Algorithm","authors":"Takamichi Yuasa, M. Ishikawa, Satoshi Ogawa","doi":"10.20965/jrm.2021.p1248","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1248","url":null,"abstract":"Hydraulic excavators are one type of construction equipment used in various construction sites worldwide, and their usage and scale are diverse. Generally, the work efficiency of a hydraulic excavator largely depends on human operation skills. If we can comprehend the experienced operation skills and utilize them for manual control assist, semi-automatic or automatic remote control, it would improve its work efficiency and suppress personnel costs, reduce the operator’s workload, and improve his/her safety. In this study, we propose a methodology to design efficient machine trajectories based on mathematical models and numerical optimization, focusing on ground-level excavation as a dominant task. First, we express its excavation trajectory using four parameters and assume the models for the amount of excavated soil and the reaction force based on our previous experiments. Next, we combine these models with a geometrical model for the hydraulic excavating machine. We then assign the amount of soil to a performance index preferably to be maximized and the amount of work to a cost index preferably to be minimized, both in the form of functions of the trajectory parameters, resulting in an optimization problem that trades them off. In particular, we formulate (1) a multi-objective optimization problem maximizing a weighted linear combination of the amount of soil and the amount of work as an objective function, and (2) a single-objective optimization problem maximizing the amount of soil under a given upper bound on the amount of work, so that we can solve these optimization problems using the genetic algorithm (GA). Finally, we conclude this paper by suggesting our notice on design methodology and discussing how we should provide the optimization method as mentioned above to the users who operate hydraulic excavators.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1248-1254"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
LPWAN-Based Real-Time 2D SLAM and Object Localization for Teleoperation Robot Control 基于lpwan的遥操作机器人实时二维SLAM与目标定位
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1326
Alfin Junaedy, H. Masuta, K. Sawai, T. Motoyoshi, Noboru Takagi
In this study, the teleoperation robot control on a mobile robot with 2D SLAM and object localization using LPWAN is proposed. The mobile robot is a technology gaining popularity due to flexibility and robustness in a variety of terrains. In search and rescue activities, the mobile robots can be used to perform some missions, assist and preserve human life. However, teleoperation control becomes a challenging problem for this implementation. The robust wireless communication not only allows the operator to stay away from dangerous area, but also increases the mobility of the mobile robot itself. Most of teleoperation mobile robots use Wi-Fi having high-bandwidth, yet short communication range. LoRa as LPWAN, on the other hand, has much longer range but low-bandwidth communication speed. Therefore, the combination of them complements each other’s weaknesses. The use of a two-LoRa configuration also enhances the teleoperation capabilities. All information from the mobile robot can be sent to the PC controller in relatively fast enough for real-time SLAM implementation. Furthermore, the mobile robot is also capable of real-time object detection, localization, and transmitting images. Another problem of LoRa communication is a timeout. We apply timeout recovery algorithms to handle this issue, resulting in more stable data. All data have been confirmed by real-time trials and the proposed method can approach the Wi-Fi performance with a low waiting time or delay.
在本研究中,提出了一种基于二维SLAM和目标定位的移动机器人远程操作控制方法。移动机器人由于其在各种地形上的灵活性和鲁棒性而越来越受欢迎。在搜救活动中,移动机器人可以执行一些任务,协助和保护人类的生命。然而,远程操作控制成为该实现的一个具有挑战性的问题。鲁棒的无线通信不仅使操作者远离危险区域,而且增加了移动机器人本身的机动性。大多数远程操作移动机器人使用的Wi-Fi带宽高,但通信距离短。另一方面,LoRa作为LPWAN具有更长的通信范围,但带宽速度较低。因此,两者的结合是互补的。使用双lora配置还增强了远程操作能力。移动机器人的所有信息都可以相对较快地发送到PC控制器,以便实时实现SLAM。此外,该移动机器人还具有实时目标检测、定位和传输图像的能力。LoRa通信的另一个问题是超时。我们采用超时恢复算法来处理这个问题,从而使数据更加稳定。所有数据均经过实时试验验证,该方法可以在较低的等待时间或延迟下接近Wi-Fi性能。
{"title":"LPWAN-Based Real-Time 2D SLAM and Object Localization for Teleoperation Robot Control","authors":"Alfin Junaedy, H. Masuta, K. Sawai, T. Motoyoshi, Noboru Takagi","doi":"10.20965/jrm.2021.p1326","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1326","url":null,"abstract":"In this study, the teleoperation robot control on a mobile robot with 2D SLAM and object localization using LPWAN is proposed. The mobile robot is a technology gaining popularity due to flexibility and robustness in a variety of terrains. In search and rescue activities, the mobile robots can be used to perform some missions, assist and preserve human life. However, teleoperation control becomes a challenging problem for this implementation. The robust wireless communication not only allows the operator to stay away from dangerous area, but also increases the mobility of the mobile robot itself. Most of teleoperation mobile robots use Wi-Fi having high-bandwidth, yet short communication range. LoRa as LPWAN, on the other hand, has much longer range but low-bandwidth communication speed. Therefore, the combination of them complements each other’s weaknesses. The use of a two-LoRa configuration also enhances the teleoperation capabilities. All information from the mobile robot can be sent to the PC controller in relatively fast enough for real-time SLAM implementation. Furthermore, the mobile robot is also capable of real-time object detection, localization, and transmitting images. Another problem of LoRa communication is a timeout. We apply timeout recovery algorithms to handle this issue, resulting in more stable data. All data have been confirmed by real-time trials and the proposed method can approach the Wi-Fi performance with a low waiting time or delay.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1326-1337"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68078607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
On the Geometric Featureless Visual Velocity of UGV in an Agriculture Scale 农业尺度下UGV几何无特征视觉速度研究
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1255
S. Sakai, Daiki Nakabayashi
The paper discusses a camera-based velocity estimation for unmanned ground vehicles in an agriculture scale. The proposed concept-based method does not require any geometric feature and focuses on a mapping between the captured images only. The paper provides three pilot experiments. First, we check an assumption of the proposed concept by a field experiment. Second, we check the verification by a set of numerical and laboratory experiments. Third, we check the verification by the field experiment. In the sense that the existence and sensitivity of a representation of the mapping are verified experimentally, the feasibility of the proposed concept is confirmed.
本文讨论了一种基于摄像机的农业规模无人地面车辆速度估计方法。提出的基于概念的方法不需要任何几何特征,只关注捕获图像之间的映射。本文提供了三个先导实验。首先,我们通过现场实验验证了所提出概念的一个假设。其次,我们通过一组数值和实验室实验来验证验证。第三,通过现场试验验证了理论的正确性。通过实验验证了映射表示的存在性和敏感性,从而证实了所提概念的可行性。
{"title":"On the Geometric Featureless Visual Velocity of UGV in an Agriculture Scale","authors":"S. Sakai, Daiki Nakabayashi","doi":"10.20965/jrm.2021.p1255","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1255","url":null,"abstract":"The paper discusses a camera-based velocity estimation for unmanned ground vehicles in an agriculture scale. The proposed concept-based method does not require any geometric feature and focuses on a mapping between the captured images only. The paper provides three pilot experiments. First, we check an assumption of the proposed concept by a field experiment. Second, we check the verification by a set of numerical and laboratory experiments. Third, we check the verification by the field experiment. In the sense that the existence and sensitivity of a representation of the mapping are verified experimentally, the feasibility of the proposed concept is confirmed.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1255-1264"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68078412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improved 3D Human Motion Capture Using Kinect Skeleton and Depth Sensor 使用Kinect骨骼和深度传感器改进的3D人体动作捕捉
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1408
Alireza Bilesan, S. Komizunai, T. Tsujita, A. Konno
Kinect has been utilized as a cost-effective, easy-to-use motion capture sensor using the Kinect skeleton algorithm. However, a limited number of landmarks and inaccuracies in tracking the landmarks’ positions restrict Kinect’s capability. In order to increase the accuracy of motion capturing using Kinect, joint use of the Kinect skeleton algorithm and Kinect-based marker tracking was applied to track the 3D coordinates of multiple landmarks on human. The motion’s kinematic parameters were calculated using the landmarks’ positions by applying the joint constraints and inverse kinematics techniques. The accuracy of the proposed method and OptiTrack (NaturalPoint, Inc., USA) was evaluated in capturing the joint angles of a humanoid (as ground truth) in a walking test. In order to evaluate the accuracy of the proposed method in capturing the kinematic parameters of a human, lower body joint angles of five healthy subjects were extracted using a Kinect, and the results were compared to Perception Neuron (Noitom Ltd., China) and OptiTrack data during ten gait trials. The absolute agreement and consistency between each optical system and the robot data in the robot test and between each motion capture system and OptiTrack data in the human gait test were determined using intraclass correlations coefficients (ICC3). The reproducibility between systems was evaluated using Lin’s concordance correlation coefficient (CCC). The correlation coefficients with 95% confidence intervals (95%CI) were interpreted substantial for both OptiTrack and proposed method (ICC > 0.75 and CCC > 0.95) in humanoid test. The results of the human gait experiments demonstrated the advantage of the proposed method (ICC > 0.75 and RMSE = 1.1460°) over the Kinect skeleton model (ICC < 0.4 and RMSE = 6.5843°).
Kinect已被用作使用Kinect骨架算法的成本效益高、易于使用的动作捕捉传感器。然而,有限数量的地标和追踪地标位置的不准确性限制了Kinect的功能。为了提高Kinect动作捕捉的精度,将Kinect骨架算法与基于Kinect的标记跟踪相结合,对人体多个地标的三维坐标进行跟踪。利用关节约束和逆运动学技术,利用地标位置计算运动参数。在步行测试中,对所提出的方法和OptiTrack (NaturalPoint, Inc., USA)在捕获人形关节角度(作为地面真值)方面的准确性进行了评估。为了评估所提出的方法在捕获人体运动学参数方面的准确性,使用Kinect提取了5名健康受试者的下体关节角度,并将结果与Perception Neuron (Noitom Ltd., China)和OptiTrack在10次步态试验中的数据进行了比较。利用类内相关系数(ICC3)确定机器人测试中各光学系统与机器人数据之间以及人体步态测试中各运动捕捉系统与OptiTrack数据之间的绝对一致性。采用Lin’s一致性相关系数(CCC)评价系统间的重复性。OptiTrack和提议的方法(ICC > 0.75和CCC > 0.95)在人形试验中的95%置信区间(95% ci)的相关系数被解释为实质性的。人体步态实验结果表明,该方法(ICC > 0.75, RMSE = 1.1460°)优于Kinect骨骼模型(ICC < 0.4, RMSE = 6.5843°)。
{"title":"Improved 3D Human Motion Capture Using Kinect Skeleton and Depth Sensor","authors":"Alireza Bilesan, S. Komizunai, T. Tsujita, A. Konno","doi":"10.20965/jrm.2021.p1408","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1408","url":null,"abstract":"Kinect has been utilized as a cost-effective, easy-to-use motion capture sensor using the Kinect skeleton algorithm. However, a limited number of landmarks and inaccuracies in tracking the landmarks’ positions restrict Kinect’s capability. In order to increase the accuracy of motion capturing using Kinect, joint use of the Kinect skeleton algorithm and Kinect-based marker tracking was applied to track the 3D coordinates of multiple landmarks on human. The motion’s kinematic parameters were calculated using the landmarks’ positions by applying the joint constraints and inverse kinematics techniques. The accuracy of the proposed method and OptiTrack (NaturalPoint, Inc., USA) was evaluated in capturing the joint angles of a humanoid (as ground truth) in a walking test. In order to evaluate the accuracy of the proposed method in capturing the kinematic parameters of a human, lower body joint angles of five healthy subjects were extracted using a Kinect, and the results were compared to Perception Neuron (Noitom Ltd., China) and OptiTrack data during ten gait trials. The absolute agreement and consistency between each optical system and the robot data in the robot test and between each motion capture system and OptiTrack data in the human gait test were determined using intraclass correlations coefficients (ICC3). The reproducibility between systems was evaluated using Lin’s concordance correlation coefficient (CCC). The correlation coefficients with 95% confidence intervals (95%CI) were interpreted substantial for both OptiTrack and proposed method (ICC > 0.75 and CCC > 0.95) in humanoid test. The results of the human gait experiments demonstrated the advantage of the proposed method (ICC > 0.75 and RMSE = 1.1460°) over the Kinect skeleton model (ICC < 0.4 and RMSE = 6.5843°).","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1408-1422"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68079778","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Attractive Force Estimation of a Magnetic Adsorption Unit for Inspection UAVs 一种用于检测无人机的磁吸附装置的吸引力估计
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1349
Yoshiyuki Higashi, Kenta Yamazaki, A. Masuda, N. Miura, Y. Sawada
This paper presents an attractive force estimation system and an automatic activation system for an electropermanent magnet (EPM) for an inspection UAV. Adsorption to infrastructures for inspection at a distance is extremely difficult to perform safely because the operator cannot detect the state of adsorption of the drone equipped with a magnetic adsorption device. Therefore, in this paper, we clarify the relationship between the magnetic flux density and attractive force of the EPM through experiments, and develop an estimation algorithm for the attractive force based on the results. An automatic activation system, using the induced voltage in the coil when the EPM approaches the magnetic substance, is developed and mounted on a quadrotor for a flight experiment along with the estimation system for the attractive force. The developed system is verified using flight and adsorption experiments on the quadrotor.
介绍了一种用于巡检无人机的电永磁体(EPM)的吸引力估计系统和自动激活系统。由于操作人员无法检测配备磁性吸附装置的无人机的吸附状态,因此对基础设施进行远距离吸附以进行安全检查是极其困难的。因此,本文通过实验阐明了EPM的磁通密度与引力之间的关系,并在此基础上开发了一种引力估计算法。研制了一种利用EPM接近磁性物质时线圈中感应电压的自动激活系统,并将其与引力估计系统一起安装在四旋翼飞行器上进行飞行实验。利用四旋翼飞行器的飞行和吸附实验对所开发的系统进行了验证。
{"title":"Attractive Force Estimation of a Magnetic Adsorption Unit for Inspection UAVs","authors":"Yoshiyuki Higashi, Kenta Yamazaki, A. Masuda, N. Miura, Y. Sawada","doi":"10.20965/jrm.2021.p1349","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1349","url":null,"abstract":"This paper presents an attractive force estimation system and an automatic activation system for an electropermanent magnet (EPM) for an inspection UAV. Adsorption to infrastructures for inspection at a distance is extremely difficult to perform safely because the operator cannot detect the state of adsorption of the drone equipped with a magnetic adsorption device. Therefore, in this paper, we clarify the relationship between the magnetic flux density and attractive force of the EPM through experiments, and develop an estimation algorithm for the attractive force based on the results. An automatic activation system, using the induced voltage in the coil when the EPM approaches the magnetic substance, is developed and mounted on a quadrotor for a flight experiment along with the estimation system for the attractive force. The developed system is verified using flight and adsorption experiments on the quadrotor.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1349-1358"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68079600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Development of an Automatic Tracking Camera System Integrating Image Processing and Machine Learning 集成图像处理和机器学习的自动跟踪摄像机系统的开发
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1303
Masato Fujitake, Makito Inoue, T. Yoshimi
This paper describes the development of a robust object tracking system that combines detection methods based on image processing and machine learning for automatic construction machine tracking cameras at unmanned construction sites. In recent years, unmanned construction technology has been developed to prevent secondary disasters from harming workers in hazardous areas. There are surveillance cameras on disaster sites that monitor the environment and movements of construction machines. By watching footage from the surveillance cameras, machine operators can control the construction machines from a safe remote site. However, to control surveillance cameras to follow the target machines, camera operators are also required to work next to machine operators. To improve efficiency, an automatic tracking camera system for construction machines is required. We propose a robust and scalable object tracking system and robust object detection algorithm, and present an accurate and robust tracking system for construction machines by integrating these two methods. Our proposed image-processing algorithm is able to continue tracking for a longer period than previous methods, and the proposed object detection method using machine learning detects machines robustly by focusing on their component parts of the target objects. Evaluations in real-world field scenarios demonstrate that our methods are more accurate and robust than existing off-the-shelf object tracking algorithms while maintaining practical real-time processing performance.
本文介绍了一种鲁棒目标跟踪系统的开发,该系统结合了基于图像处理和机器学习的检测方法,用于无人施工现场的自动施工机器跟踪摄像机。近年来,为了防止二次灾害对危险区域工人的伤害,无人施工技术得到了发展。灾难现场有监控摄像头,可以监控环境和建筑机械的移动。通过观看监控摄像头的画面,机器操作员可以从一个安全的远程地点控制施工机器。然而,为了控制监控摄像机跟随目标机器,摄像机操作员也需要在机器操作员旁边工作。为了提高效率,需要为施工机械安装自动跟踪摄像系统。提出了一种鲁棒、可扩展的目标跟踪系统和鲁棒目标检测算法,并将这两种方法相结合,提出了一种准确、鲁棒的工程机械跟踪系统。我们提出的图像处理算法能够比以前的方法持续跟踪更长的时间,并且我们提出的使用机器学习的对象检测方法通过关注目标物体的组成部分来鲁棒地检测机器。实际现场场景的评估表明,我们的方法比现有的现成目标跟踪算法更准确、更健壮,同时保持了实际的实时处理性能。
{"title":"Development of an Automatic Tracking Camera System Integrating Image Processing and Machine Learning","authors":"Masato Fujitake, Makito Inoue, T. Yoshimi","doi":"10.20965/jrm.2021.p1303","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1303","url":null,"abstract":"This paper describes the development of a robust object tracking system that combines detection methods based on image processing and machine learning for automatic construction machine tracking cameras at unmanned construction sites. In recent years, unmanned construction technology has been developed to prevent secondary disasters from harming workers in hazardous areas. There are surveillance cameras on disaster sites that monitor the environment and movements of construction machines. By watching footage from the surveillance cameras, machine operators can control the construction machines from a safe remote site. However, to control surveillance cameras to follow the target machines, camera operators are also required to work next to machine operators. To improve efficiency, an automatic tracking camera system for construction machines is required. We propose a robust and scalable object tracking system and robust object detection algorithm, and present an accurate and robust tracking system for construction machines by integrating these two methods. Our proposed image-processing algorithm is able to continue tracking for a longer period than previous methods, and the proposed object detection method using machine learning detects machines robustly by focusing on their component parts of the target objects. Evaluations in real-world field scenarios demonstrate that our methods are more accurate and robust than existing off-the-shelf object tracking algorithms while maintaining practical real-time processing performance.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1303-1314"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68078478","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Special Issue on Field Robotics with Vision Systems 视觉系统的野外机器人特刊
IF 1.1 Q4 ROBOTICS Pub Date : 2021-12-20 DOI: 10.20965/jrm.2021.p1215
T. Fukao, Y. Tsumaki, K. Kurashiki
Field robotics has been undergoing rapid progress in recent years. It addresses a wide range of activities performed in outdoor environments, and its applications are being developed in areas where it was previously considered difficult to apply. This rapid progress is largely supported by AI-based improvements in computer vision systems with monocular cameras, stereo cameras, RGB-D cameras, LiDAR systems, and/or other sensors. Field robotics is impelled by an application-driven approach by its nature, and it contributes to the resolution of social problems and the creation of new innovations, including autonomous driving to reduce casualties, autonomous working machines/robots to resolve the problems of labor shortages or dangers, disaster-response robots to aid rescue parties, various kinds of aerial robots to do searches or make deliveries, underwater robots to perform search missions, etc. In this special issue on “Field Robotics with Vision Systems,” we highlight sixteen interesting papers, including one review paper, fourteen research papers, and one development report. They cover various application areas, ranging from underwater to space environments, and they propose interesting integration methods or element technologies to use in outdoor environments where vision systems and robot systems have great difficulty performing robustly. We thank all authors and reviewers, and we hope that this special issue contributes to future research and development in area of field robotics, which promises new innovations.
近年来,野外机器人技术取得了飞速的发展。它解决了在户外环境中进行的广泛活动,并且正在开发其应用于以前认为难以应用的领域。这一快速发展在很大程度上得益于基于人工智能的计算机视觉系统的改进,包括单目摄像头、立体摄像头、RGB-D摄像头、激光雷达系统和/或其他传感器。野外机器人本质上是一种应用驱动的方法,它有助于解决社会问题和创造新的创新,包括减少人员伤亡的自动驾驶,解决劳动力短缺或危险问题的自主工作机器/机器人,帮助救援方的灾害响应机器人,各种空中机器人进行搜索或交付,水下机器人执行搜索任务等。在这期关于“野外机器人与视觉系统”的特刊中,我们重点介绍了16篇有趣的论文,包括一篇综述论文,14篇研究论文和一篇开发报告。它们涵盖了从水下到空间环境的各种应用领域,并提出了有趣的集成方法或元素技术,用于视觉系统和机器人系统难以稳定运行的户外环境。我们感谢所有的作者和审稿人,我们希望这一期特刊有助于未来在现场机器人领域的研究和发展,这将带来新的创新。
{"title":"Special Issue on Field Robotics with Vision Systems","authors":"T. Fukao, Y. Tsumaki, K. Kurashiki","doi":"10.20965/jrm.2021.p1215","DOIUrl":"https://doi.org/10.20965/jrm.2021.p1215","url":null,"abstract":"Field robotics has been undergoing rapid progress in recent years. It addresses a wide range of activities performed in outdoor environments, and its applications are being developed in areas where it was previously considered difficult to apply. This rapid progress is largely supported by AI-based improvements in computer vision systems with monocular cameras, stereo cameras, RGB-D cameras, LiDAR systems, and/or other sensors. Field robotics is impelled by an application-driven approach by its nature, and it contributes to the resolution of social problems and the creation of new innovations, including autonomous driving to reduce casualties, autonomous working machines/robots to resolve the problems of labor shortages or dangers, disaster-response robots to aid rescue parties, various kinds of aerial robots to do searches or make deliveries, underwater robots to perform search missions, etc.\u0000 In this special issue on “Field Robotics with Vision Systems,” we highlight sixteen interesting papers, including one review paper, fourteen research papers, and one development report. They cover various application areas, ranging from underwater to space environments, and they propose interesting integration methods or element technologies to use in outdoor environments where vision systems and robot systems have great difficulty performing robustly.\u0000 We thank all authors and reviewers, and we hope that this special issue contributes to future research and development in area of field robotics, which promises new innovations.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"33 1","pages":"1215"},"PeriodicalIF":1.1,"publicationDate":"2021-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077584","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Automating a Festo Manufacturing Machine with an Allen-Bradley PLC 用Allen-Bradley PLC自动化Festo制造机器
IF 1.1 Q4 ROBOTICS Pub Date : 2021-01-01 DOI: 10.3844/jmrsp.2021.23.32
P. Chand, Joven Sepulveda
Corresponding Author: Praneel Chand Centre for Engineering and Industrial Design, Waikato Institute of Technology, Hamilton, New Zealand Email: praneelchand10@yahoo.co.nz Abstract: Industry equipment such as machinery utilising Programmable Logic Controllers (PLCs) become outdated and obsolete over time. Support for older machines and controllers becomes limited and they become incompatible with new computer operating systems. In the end, they are no longer used by industry. However, obsolete machines can be refurbished and used for teaching or demonstration purposes. Hence, this study presents the reconditioning of a Festo manufacturing machine by replacing the old Festo PLC with an Allen-Bradley PLC so that it’s compatible with the miniindustrial network in the mechatronics lab. The machine is a Festo MPS storage and retrieval station featuring three axis electromechanical gantries, a gripper, DC motors with encoder feedback, reed switches and a pneumatic actuator. The I/O connections from these components to the old PLC is traced and a new interface to the Allen-Bradley PLC is established while keeping connectivity with the old Festo PLC for legacy control. This upgrade allows the machine to be used for student training in the automation courses. It also leaves an option for utilising the old Festo PLC if needed. A sample program has been developed to test and verify correct interfacing and operation of the Allen-Bradley PLC and Festo storage and retrieval station.
通讯作者:Praneel Chand工程与工业设计中心,怀卡托理工学院,汉密尔顿,新西兰Email: praneelchand10@yahoo.co.nz摘要:随着时间的推移,使用可编程逻辑控制器(plc)的机械等工业设备变得过时和过时。对旧机器和控制器的支持变得有限,并且与新的计算机操作系统不兼容。最终,它们不再被工业使用。然而,过时的机器可以翻新并用于教学或示范目的。因此,本研究提出了用Allen-Bradley PLC取代旧的Festo PLC来改造Festo制造机器,使其与机电一体化实验室的小型工业网络兼容。该机器是Festo MPS存储和检索站,具有三轴机电龙门,夹持器,带编码器反馈的直流电机,簧片开关和气动执行器。跟踪从这些组件到旧PLC的I/O连接,并建立到Allen-Bradley PLC的新接口,同时保持与旧Festo PLC的连接,以进行遗留控制。这次升级使机器可以用于自动化课程的学生培训。如果需要的话,也可以选择使用旧的Festo PLC。开发了一个示例程序来测试和验证艾伦-布拉德利PLC和Festo存储和检索站的正确接口和操作。
{"title":"Automating a Festo Manufacturing Machine with an Allen-Bradley PLC","authors":"P. Chand, Joven Sepulveda","doi":"10.3844/jmrsp.2021.23.32","DOIUrl":"https://doi.org/10.3844/jmrsp.2021.23.32","url":null,"abstract":"Corresponding Author: Praneel Chand Centre for Engineering and Industrial Design, Waikato Institute of Technology, Hamilton, New Zealand Email: praneelchand10@yahoo.co.nz Abstract: Industry equipment such as machinery utilising Programmable Logic Controllers (PLCs) become outdated and obsolete over time. Support for older machines and controllers becomes limited and they become incompatible with new computer operating systems. In the end, they are no longer used by industry. However, obsolete machines can be refurbished and used for teaching or demonstration purposes. Hence, this study presents the reconditioning of a Festo manufacturing machine by replacing the old Festo PLC with an Allen-Bradley PLC so that it’s compatible with the miniindustrial network in the mechatronics lab. The machine is a Festo MPS storage and retrieval station featuring three axis electromechanical gantries, a gripper, DC motors with encoder feedback, reed switches and a pneumatic actuator. The I/O connections from these components to the old PLC is traced and a new interface to the Allen-Bradley PLC is established while keeping connectivity with the old Festo PLC for legacy control. This upgrade allows the machine to be used for student training in the automation courses. It also leaves an option for utilising the old Festo PLC if needed. A sample program has been developed to test and verify correct interfacing and operation of the Allen-Bradley PLC and Festo storage and retrieval station.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"5 1","pages":""},"PeriodicalIF":1.1,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87485973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Iterative Feedforward Control for Bearing-Free Multibody Systems 无轴承多体系统的迭代前馈控制
IF 1.1 Q4 ROBOTICS Pub Date : 2021-01-01 DOI: 10.3844/jmrsp.2021.33.46
N. Bailey, C. Lusty, P. Keogh
Corresponding Author: Nicola Yvonne Bailey Department of Mechanical Engineering, University of Bath, United Kingdom E-mail: n.y.bailey@bath.ac.uk Abstract: Automated machinery and robotics are commonly conventional multibody systems containing bearing components, which exhibit uncertain, discontinuous and complex tribological characteristics. These generate wear and fundamentally limit the precision of small scale motion due to the tribological effects being difficult to compensate for using model-based active control. However, they can be eliminated through the replacement of traditional bearing joints with flexure couplings, which offers a potential increase in the performance envelope. Initially a plain flexure coupling capable of large deformation is investigated, with a representative mathematical model derived based on large deformation Euler-Bernoulli theory which is validated using a bespoke experimental facility; proof of concept for the design of empirical controllers utilising experimental data is presented. Various designs of novel compound flexure couplings are conceived, comprising of multiple sections of spring steel. The presented compound flexure couplings are then characterised experimentally. A focused study of a two-compound flexure coupling-rigid body system is presented and the feasibility of generating open-loop feedfoward controllers from identified models is demonstrated in terms of accurate large displacement control. Including path correction in the presented control methodology reduces tracking errors by at least 62% and 71% in (x, y) directions, respectively, for the cases considered.
摘要:自动化机械和机器人通常是包含轴承部件的传统多体系统,其摩擦学特性具有不确定性、不连续性和复杂性。这些产生磨损,并从根本上限制了小尺度运动的精度,因为使用基于模型的主动控制难以补偿摩擦效应。然而,它们可以通过用柔性联轴器替换传统的轴承接头来消除,这提供了性能范围的潜在增加。首先研究了具有大变形能力的平面弯曲耦合,并基于大变形欧拉-伯努利理论推导了具有代表性的数学模型,并使用定制的实验设备进行了验证;提出了利用实验数据设计经验控制器的概念证明。提出了由多段弹簧钢组成的新型复合式挠性联轴器的设计方案。然后对所提出的复合柔性联轴器进行了实验表征。重点研究了两复合柔性耦合刚体系统,并从精确大位移控制的角度证明了从已识别模型生成开环前馈控制器的可行性。在所考虑的情况下,在所提出的控制方法中包括路径校正,分别在(x, y)方向上减少至少62%和71%的跟踪误差。
{"title":"Iterative Feedforward Control for Bearing-Free Multibody Systems","authors":"N. Bailey, C. Lusty, P. Keogh","doi":"10.3844/jmrsp.2021.33.46","DOIUrl":"https://doi.org/10.3844/jmrsp.2021.33.46","url":null,"abstract":"Corresponding Author: Nicola Yvonne Bailey Department of Mechanical Engineering, University of Bath, United Kingdom E-mail: n.y.bailey@bath.ac.uk Abstract: Automated machinery and robotics are commonly conventional multibody systems containing bearing components, which exhibit uncertain, discontinuous and complex tribological characteristics. These generate wear and fundamentally limit the precision of small scale motion due to the tribological effects being difficult to compensate for using model-based active control. However, they can be eliminated through the replacement of traditional bearing joints with flexure couplings, which offers a potential increase in the performance envelope. Initially a plain flexure coupling capable of large deformation is investigated, with a representative mathematical model derived based on large deformation Euler-Bernoulli theory which is validated using a bespoke experimental facility; proof of concept for the design of empirical controllers utilising experimental data is presented. Various designs of novel compound flexure couplings are conceived, comprising of multiple sections of spring steel. The presented compound flexure couplings are then characterised experimentally. A focused study of a two-compound flexure coupling-rigid body system is presented and the feasibility of generating open-loop feedfoward controllers from identified models is demonstrated in terms of accurate large displacement control. Including path correction in the presented control methodology reduces tracking errors by at least 62% and 71% in (x, y) directions, respectively, for the cases considered.","PeriodicalId":51661,"journal":{"name":"Journal of Robotics and Mechatronics","volume":"40 1","pages":""},"PeriodicalIF":1.1,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87092997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Robotics and Mechatronics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1