首页 > 最新文献

2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)最新文献

英文 中文
Extended Kalman filter for payload state estimation utilizing aircraft inertial sensing 基于飞机惯性传感的载荷状态估计扩展卡尔曼滤波
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571038
Vicko Prkačin, Ivana Palunko, I. Petrović
In this paper we consider an aerial vehicle transporting a suspended payload and propose an Extended Kalman filter for payload state estimation. The filter is based on derived system dynamics and relies solely on onboard IMU measurements. Effectiveness of the method is verified in numerical simulations and experimentally.
本文考虑了一种悬浮载荷的飞行器,提出了一种用于载荷状态估计的扩展卡尔曼滤波器。该滤波器基于导出的系统动力学,仅依赖于板载IMU测量。通过数值模拟和实验验证了该方法的有效性。
{"title":"Extended Kalman filter for payload state estimation utilizing aircraft inertial sensing","authors":"Vicko Prkačin, Ivana Palunko, I. Petrović","doi":"10.1109/AIRPHARO52252.2021.9571038","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571038","url":null,"abstract":"In this paper we consider an aerial vehicle transporting a suspended payload and propose an Extended Kalman filter for payload state estimation. The filter is based on derived system dynamics and relies solely on onboard IMU measurements. Effectiveness of the method is verified in numerical simulations and experimentally.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131843077","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Preliminary design of an aerial cliff sampling system 空中悬崖取样系统初步设计
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571064
Hughes La Vigne, Guillaume Charron, Julien Rachiele Tremblay, B. Nyberg, Alexis Lussier Desbiens
Hawaiian cliffs present a unique flora that has been little studied until now mainly because of the difficulties to physically access this ecosystem. Recently, researchers have started using UAV imagery to analyze cliff flora, and to locate plant species of interest. The current techniques used to then reach these plants on cliffs (e.g., abseiling, helicopters) are dangerous and many sites remain completely inaccessible. This project aims at developing an aerial sampling system to support initiatives aimed at preserving this unique ecosystem. This article therefore presents the various challenges related to the environment where sampling must take place, considering the use of an aerial sampling system. Finally, the preliminary design of a platform suspended by cable under a UAV to collect plant samples on a cliff is presented.
夏威夷悬崖上有一种独特的植物群,直到现在人们对它的研究还很少,主要是因为很难从物理上进入这个生态系统。最近,研究人员已经开始使用无人机图像来分析悬崖植物群,并定位感兴趣的植物物种。目前用于到达这些悬崖上的植物的技术(例如,绳降、直升机)是危险的,许多地点仍然完全无法到达。该项目旨在开发一个空中采样系统,以支持旨在保护这一独特生态系统的举措。因此,本文提出了与必须进行采样的环境有关的各种挑战,考虑到使用航空采样系统。最后,给出了无人机悬索平台在悬崖上采集植物样本的初步设计。
{"title":"Preliminary design of an aerial cliff sampling system","authors":"Hughes La Vigne, Guillaume Charron, Julien Rachiele Tremblay, B. Nyberg, Alexis Lussier Desbiens","doi":"10.1109/AIRPHARO52252.2021.9571064","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571064","url":null,"abstract":"Hawaiian cliffs present a unique flora that has been little studied until now mainly because of the difficulties to physically access this ecosystem. Recently, researchers have started using UAV imagery to analyze cliff flora, and to locate plant species of interest. The current techniques used to then reach these plants on cliffs (e.g., abseiling, helicopters) are dangerous and many sites remain completely inaccessible. This project aims at developing an aerial sampling system to support initiatives aimed at preserving this unique ecosystem. This article therefore presents the various challenges related to the environment where sampling must take place, considering the use of an aerial sampling system. Finally, the preliminary design of a platform suspended by cable under a UAV to collect plant samples on a cliff is presented.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126011657","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Development of High-Pressure Washing Aerial Robot Employing Multirotor Platform with Add-on Planar Translational Driving System 多旋翼平台附加平面平移驱动系统的高空高压洗涤机器人研制
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571041
Ryo Miyazaki, Hannibal Paul, Takamasa Kominami, R. Martinez, Borwonpob Sumetheeprasit, K. Shimonomura
We propose a multirotor aerial robot for high-pressure washing task. The robot consists of a multi rotor platform, an add-on planar translational driving system(ATD) and a high-pressure washing system. The ATD is equipped on the multirotor and consists of three ducted fans that can generate the force on horizontal plane. The ATD also allows multirotor to suppress the reaction force generated by nozzle of high-pressure washing system and spray water accurately. In this study, we focus on the development of the proposed aerial robot system. Through experiment, we show the successful water spraying by suppressing the reaction force while flying.
提出了一种多旋翼高空高压洗涤机器人。该机器人由多转子平台、附加平面平移驱动系统(ATD)和高压清洗系统组成。ATD安装在多旋翼上,由三个管道风扇组成,可以在水平面上产生力。ATD还允许多转子抑制高压洗涤系统喷嘴产生的反作用力,准确喷水。在本研究中,我们着重于所提出的空中机器人系统的开发。通过实验证明,通过抑制飞行时的反作用力实现了成功的喷水。
{"title":"Development of High-Pressure Washing Aerial Robot Employing Multirotor Platform with Add-on Planar Translational Driving System","authors":"Ryo Miyazaki, Hannibal Paul, Takamasa Kominami, R. Martinez, Borwonpob Sumetheeprasit, K. Shimonomura","doi":"10.1109/AIRPHARO52252.2021.9571041","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571041","url":null,"abstract":"We propose a multirotor aerial robot for high-pressure washing task. The robot consists of a multi rotor platform, an add-on planar translational driving system(ATD) and a high-pressure washing system. The ATD is equipped on the multirotor and consists of three ducted fans that can generate the force on horizontal plane. The ATD also allows multirotor to suppress the reaction force generated by nozzle of high-pressure washing system and spray water accurately. In this study, we focus on the development of the proposed aerial robot system. Through experiment, we show the successful water spraying by suppressing the reaction force while flying.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126597499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Experimental Investigation of Soft-Landing of Quadrotors via Induced Wind Modeling Approach 基于诱导风模拟方法的四旋翼飞行器软着陆实验研究
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571054
S. R. Nekoo, P. J. Sánchez Cuevas, J. Acosta, G. Heredia, A. Ollero
This paper presents an experimental study of the soft-landing problem in quadrotors using the induced wind modeling approach. The landing phase has been typically one of the critical phases in drone flight. Landing complexity drastically increases when the drone needs to land on sensitive sites, such as platforms or rack of pipes in refineries (for inspection purposes), in which explosive material is running through or there exist flammable/explosive material in the environment. Multirotor unmanned aerial vehicles (UAV s) are usually lightweight platforms and they are significantly disturbed by the aerodynamic ground effect while landing; so, near the ground, those drones are subjected to an external disturbance in proximity to the ground. In this situation, the airflow can be reflected after reaching the ground, disturbing the performance of the rotors significantly. This paper aims to model the induced wind velocity, caused by the propellers to see and consider the ground effect during the landing. The reduction of the total thrust near the ground provides a smooth landing and avoids bumping. The complex wind modeling formulation and limitation of the commercialized autopilots make the implementation a challenging task. Herein we propose how to incorporate the proposed soft-landing algorithm within an existing UA V autopilot. Experimental results show that the proposed approach successfully replicates the wind modeling which leads to a soft-landing.
本文采用诱导风模拟方法对四旋翼飞行器软着陆问题进行了实验研究。着陆阶段一直是无人机飞行的关键阶段之一。当无人机需要降落在敏感地点时,着陆复杂性急剧增加,例如炼油厂的平台或管道架(用于检查目的),其中有爆炸性物质穿过或环境中存在易燃易爆物质。多旋翼无人机通常是轻型平台,在着陆过程中受到地面气动效应的显著干扰;所以,在地面附近,这些无人机受到地面附近的外部干扰。在这种情况下,气流到达地面后会被反射,对旋翼的性能影响很大。本文的目的是建立由螺旋桨引起的诱导风速模型,以观察和考虑着陆过程中的地面效应。靠近地面的总推力的减小提供了平稳着陆和避免碰撞。复杂的风建模公式和商业化自动驾驶仪的局限性使其实现成为一项具有挑战性的任务。在此,我们提出了如何将所提出的软着陆算法纳入现有的UA V自动驾驶仪中。实验结果表明,该方法成功地模拟了导致飞机软着陆的风场模型。
{"title":"Experimental Investigation of Soft-Landing of Quadrotors via Induced Wind Modeling Approach","authors":"S. R. Nekoo, P. J. Sánchez Cuevas, J. Acosta, G. Heredia, A. Ollero","doi":"10.1109/AIRPHARO52252.2021.9571054","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571054","url":null,"abstract":"This paper presents an experimental study of the soft-landing problem in quadrotors using the induced wind modeling approach. The landing phase has been typically one of the critical phases in drone flight. Landing complexity drastically increases when the drone needs to land on sensitive sites, such as platforms or rack of pipes in refineries (for inspection purposes), in which explosive material is running through or there exist flammable/explosive material in the environment. Multirotor unmanned aerial vehicles (UAV s) are usually lightweight platforms and they are significantly disturbed by the aerodynamic ground effect while landing; so, near the ground, those drones are subjected to an external disturbance in proximity to the ground. In this situation, the airflow can be reflected after reaching the ground, disturbing the performance of the rotors significantly. This paper aims to model the induced wind velocity, caused by the propellers to see and consider the ground effect during the landing. The reduction of the total thrust near the ground provides a smooth landing and avoids bumping. The complex wind modeling formulation and limitation of the commercialized autopilots make the implementation a challenging task. Herein we propose how to incorporate the proposed soft-landing algorithm within an existing UA V autopilot. Experimental results show that the proposed approach successfully replicates the wind modeling which leads to a soft-landing.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121266082","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Technical Program 技术项目
Pub Date : 2021-10-01 DOI: 10.1109/airpharo52252.2021.9571056
Hiroki Takada
{"title":"Technical Program","authors":"Hiroki Takada","doi":"10.1109/airpharo52252.2021.9571056","DOIUrl":"https://doi.org/10.1109/airpharo52252.2021.9571056","url":null,"abstract":"","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114975378","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Virtual Reality Simulation of Autonomous Solar Plants Inspections with Unmanned Aerial Systems 无人机系统自主太阳能电站检测的虚拟现实仿真
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571060
Fabio Augusto de Alcantara Andrade, A. Sivertsen, Carlos Alberto Moraes Correia, N. Belbachir, Lucas Costa Amaral De Sousa, Victor Müller Pereira Rufino, Eduardo Pimenta Petrópolis, Erick Rodrigues e Silva, Victor Hugo Rinaldi Fortes Henriques
This paper presents the development of a virtual reality simulation environment for Unmanned Aerial Systems (UAS) solar plant inspection. The objective of this work is to provide a tool to test autonomous inspection and computer vision algorithms and generate realistic synthetic data for deep learning. These techniques demand realistic synthetic data, which can be made available by high-quality graphics engines, such as the ones used for game development. In this work, Unreal Engine 4 is used to host the virtual solar plant. The solar panels were modeled using Blender and Photoshop. Microsoft's AirSim plugin is used to simulate the UAS motion, together with the ArduPilot Software-In- The-Loop flight controller. The environment was evaluated through a virtual autonomous inspection of a plant with 9200 panels, where a georeferencing algorithm was used to locate the defective solar panel in a raster plant layout, based on the pixel position of the defects in the aerial images. The virtual inspection resulted on more than 1000 images and the localization of the defective panels in the layout plant using the georeferencing algorithm had an error of 0.34 meters on the North axis and 0.26 meters on the East axis, which is acceptable for large solar plants with sparse modules' arrangement.
介绍了一种用于无人机太阳能电站巡检的虚拟现实仿真环境的开发。这项工作的目的是提供一种工具来测试自主检测和计算机视觉算法,并为深度学习生成真实的合成数据。这些技术需要真实的合成数据,这些数据可以通过高质量的图像引擎获得,例如用于游戏开发的图像引擎。在这项工作中,虚幻引擎4被用来托管虚拟太阳能发电厂。太阳能板是用Blender和Photoshop建模的。微软的AirSim插件用于模拟无人机运动,连同ArduPilot软件在环飞行控制器。通过对拥有9200块电池板的工厂进行虚拟自主检查来评估环境,其中基于航空图像中缺陷的像素位置,使用地理参考算法在光栅工厂布局中定位有缺陷的太阳能电池板。通过对1000多张图像进行虚拟检测,利用地理参考算法对布局厂缺陷板进行定位,其北轴误差为0.34米,东轴误差为0.26米,对于组件布置稀疏的大型太阳能电站来说,这是可以接受的。
{"title":"Virtual Reality Simulation of Autonomous Solar Plants Inspections with Unmanned Aerial Systems","authors":"Fabio Augusto de Alcantara Andrade, A. Sivertsen, Carlos Alberto Moraes Correia, N. Belbachir, Lucas Costa Amaral De Sousa, Victor Müller Pereira Rufino, Eduardo Pimenta Petrópolis, Erick Rodrigues e Silva, Victor Hugo Rinaldi Fortes Henriques","doi":"10.1109/AIRPHARO52252.2021.9571060","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571060","url":null,"abstract":"This paper presents the development of a virtual reality simulation environment for Unmanned Aerial Systems (UAS) solar plant inspection. The objective of this work is to provide a tool to test autonomous inspection and computer vision algorithms and generate realistic synthetic data for deep learning. These techniques demand realistic synthetic data, which can be made available by high-quality graphics engines, such as the ones used for game development. In this work, Unreal Engine 4 is used to host the virtual solar plant. The solar panels were modeled using Blender and Photoshop. Microsoft's AirSim plugin is used to simulate the UAS motion, together with the ArduPilot Software-In- The-Loop flight controller. The environment was evaluated through a virtual autonomous inspection of a plant with 9200 panels, where a georeferencing algorithm was used to locate the defective solar panel in a raster plant layout, based on the pixel position of the defects in the aerial images. The virtual inspection resulted on more than 1000 images and the localization of the defective panels in the layout plant using the georeferencing algorithm had an error of 0.34 meters on the North axis and 0.26 meters on the East axis, which is acceptable for large solar plants with sparse modules' arrangement.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128245014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
UAV human teleoperation using event-based and frame-based cameras 使用基于事件和基于帧的摄像机的无人机人类远程操作
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571049
J. P. Rodríguez-Gómez, R. Tapia, A. G. Eguíluz, J. R. Martínez-De Dios, A. Ollero
Teleoperation is a crucial aspect for human-robot interaction with unmanned aerial vehicles (UAV s) applications. Fast perception processing is required to ensure robustness, precision, and safety. Event cameras are neuromorphic sensors that provide low latency response, high dynamic range and low power consumption. Although classical image-based methods have been extensively used for human-robot interaction tasks, responsiveness is limited by their processing rates. This paper presents a human-robot teleoperation scheme for UAVs that exploits the advantages of both traditional and event cameras. The proposed scheme was tested in teleoperation missions where the pose of a multi rotor robot is controlled in real time using human gestures detected from events.
远程操作是无人机应用中人机交互的一个重要方面。为了保证鲁棒性、精度和安全性,需要快速的感知处理。事件相机是神经形态传感器,提供低延迟响应,高动态范围和低功耗。尽管经典的基于图像的方法已广泛用于人机交互任务,但其响应能力受到其处理速度的限制。本文提出了一种利用传统摄像机和事件摄像机优点的无人机人机远程操作方案。提出的方案在远程操作任务中进行了测试,其中多转子机器人的姿态是利用从事件中检测到的人类手势来实时控制的。
{"title":"UAV human teleoperation using event-based and frame-based cameras","authors":"J. P. Rodríguez-Gómez, R. Tapia, A. G. Eguíluz, J. R. Martínez-De Dios, A. Ollero","doi":"10.1109/AIRPHARO52252.2021.9571049","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571049","url":null,"abstract":"Teleoperation is a crucial aspect for human-robot interaction with unmanned aerial vehicles (UAV s) applications. Fast perception processing is required to ensure robustness, precision, and safety. Event cameras are neuromorphic sensors that provide low latency response, high dynamic range and low power consumption. Although classical image-based methods have been extensively used for human-robot interaction tasks, responsiveness is limited by their processing rates. This paper presents a human-robot teleoperation scheme for UAVs that exploits the advantages of both traditional and event cameras. The proposed scheme was tested in teleoperation missions where the pose of a multi rotor robot is controlled in real time using human gestures detected from events.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128907702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Keynote Lectures [2 abstracts] 主题演讲[2摘要]
Pub Date : 2021-10-01 DOI: 10.1109/airpharo52252.2021.9571063
{"title":"Keynote Lectures [2 abstracts]","authors":"","doi":"10.1109/airpharo52252.2021.9571063","DOIUrl":"https://doi.org/10.1109/airpharo52252.2021.9571063","url":null,"abstract":"","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123492235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Overview of Hand Gesture Languages for Autonomous UAV Handling 无人机自主操纵手势语言研究综述
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571027
Fotini Patrona, Ioannis Mademlis, I. Pitas
Camera-equipped Unmanned Aerial Vehicles (UAVs, or drones) have revolutionized several application domains, with a steadily increasing degree of cognitive autonomy in commercial drones paving the way for unprecedented robotization of daily life. Dynamic cooperation of UAV s with human collaborators is typically necessary during a mission; a fact that has led to various solutions for high-level UAV-operator interaction. Hand gestures are an effective way of facilitating this remote drone handling, giving rise to new gesture languages for visual communication between operators and autonomous UAV s. This paper reviews all the available languages which could be used or have been created for this purpose, as well as relevant gesture recognition datasets for training machine learning models. Moreover, a novel, generic, base gesture language for handling camera-equipped UAV s is proposed, along with a corresponding, large-scale, publicly available video dataset. The presented language can easily and consistently be extended in the future to more specific scenarios/profiles, tailored for particular application domains and/or additional UAV equipment (e.g., aerial manipulators/arms). Finally, we evaluate: a) the performance of state-of-the-art gesture recognition algorithms on the proposed dataset, in a quantitative and objective manner, and b) the intuitiveness, effectiveness and completeness of the proposed gesture language, in a qualitative and subjective manner.
配备摄像头的无人驾驶飞行器(uav,或无人机)已经彻底改变了几个应用领域,商用无人机的认知自主程度稳步提高,为前所未有的日常生活机器人化铺平了道路。在执行任务期间,无人机与人类合作者的动态合作通常是必要的;这一事实导致了各种解决方案的高层次无人机操作人员的互动。手势是促进这种远程无人机处理的有效方法,为操作员和自主无人机之间的视觉通信提供了新的手势语言。本文回顾了为此目的可以使用或已经创建的所有可用语言,以及用于训练机器学习模型的相关手势识别数据集。此外,提出了一种新的、通用的、用于处理配备摄像头的无人机的基本手势语言,以及相应的、大规模的、公开可用的视频数据集。所呈现的语言可以在未来轻松且一致地扩展到更具体的场景/配置文件,为特定的应用领域和/或额外的无人机设备(例如,空中操纵器/臂)量身定制。最后,我们以定量和客观的方式评估了最先进的手势识别算法在所提出数据集上的性能,以及b)以定性和主观的方式评估了所提出手势语言的直观性、有效性和完整性。
{"title":"An Overview of Hand Gesture Languages for Autonomous UAV Handling","authors":"Fotini Patrona, Ioannis Mademlis, I. Pitas","doi":"10.1109/AIRPHARO52252.2021.9571027","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571027","url":null,"abstract":"Camera-equipped Unmanned Aerial Vehicles (UAVs, or drones) have revolutionized several application domains, with a steadily increasing degree of cognitive autonomy in commercial drones paving the way for unprecedented robotization of daily life. Dynamic cooperation of UAV s with human collaborators is typically necessary during a mission; a fact that has led to various solutions for high-level UAV-operator interaction. Hand gestures are an effective way of facilitating this remote drone handling, giving rise to new gesture languages for visual communication between operators and autonomous UAV s. This paper reviews all the available languages which could be used or have been created for this purpose, as well as relevant gesture recognition datasets for training machine learning models. Moreover, a novel, generic, base gesture language for handling camera-equipped UAV s is proposed, along with a corresponding, large-scale, publicly available video dataset. The presented language can easily and consistently be extended in the future to more specific scenarios/profiles, tailored for particular application domains and/or additional UAV equipment (e.g., aerial manipulators/arms). Finally, we evaluate: a) the performance of state-of-the-art gesture recognition algorithms on the proposed dataset, in a quantitative and objective manner, and b) the intuitiveness, effectiveness and completeness of the proposed gesture language, in a qualitative and subjective manner.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"95 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127080414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Adaptively Leveling a UAV with Three-arm Aerial Manipulator System on Shifting Ground 基于三臂航空机械臂系统的无人机在移动地面上的自适应调平
Pub Date : 2021-10-01 DOI: 10.1109/AIRPHARO52252.2021.9571040
Hannibal Paul, Ryo Miyazaki, Takamasa Kominami, Robert Ladig, K. Shimonomura
Robot interaction with the environment is preferable to help and respond quickly during disasters. Unmanned aerial vehicles (UAV s) are among the quickest robotic platforms that can be deployed on the field. However, if a UAV lands on an unknown site, it will be unable to take-off if the UAV frame is not level, which might be due to shifting of the ground or unstable platforms. We examine the challenge of UAV takeoff from a sloped platform in this work, and we suggest the design and use of a three-arm aerial manipulator system to autonomously keep the UAV frame leveled at all times for safe take-off.
在灾难期间,机器人与环境的互动更有利于帮助和快速响应。无人驾驶飞行器(UAV)是可以在战场上部署的最快的机器人平台之一。然而,如果一架无人机降落在一个未知的地点,如果无人机框架不是水平的,它将无法起飞,这可能是由于地面的移动或不稳定的平台。在这项工作中,我们研究了无人机从倾斜平台起飞的挑战,并建议设计和使用三臂空中机械手系统,以自动保持无人机框架始终保持水平,以确保安全起飞。
{"title":"Adaptively Leveling a UAV with Three-arm Aerial Manipulator System on Shifting Ground","authors":"Hannibal Paul, Ryo Miyazaki, Takamasa Kominami, Robert Ladig, K. Shimonomura","doi":"10.1109/AIRPHARO52252.2021.9571040","DOIUrl":"https://doi.org/10.1109/AIRPHARO52252.2021.9571040","url":null,"abstract":"Robot interaction with the environment is preferable to help and respond quickly during disasters. Unmanned aerial vehicles (UAV s) are among the quickest robotic platforms that can be deployed on the field. However, if a UAV lands on an unknown site, it will be unable to take-off if the UAV frame is not level, which might be due to shifting of the ground or unstable platforms. We examine the challenge of UAV takeoff from a sloped platform in this work, and we suggest the design and use of a three-arm aerial manipulator system to autonomously keep the UAV frame leveled at all times for safe take-off.","PeriodicalId":415722,"journal":{"name":"2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126572550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2021 Aerial Robotic Systems Physically Interacting with the Environment (AIRPHARO)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1