首页 > 最新文献

2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)最新文献

英文 中文
VarNet: Exploring Variations for Unsupervised Video Prediction VarNet:探索无监督视频预测的变化
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8594264
Beibei Jin, Yu Hu, Yiming Zeng, Qiankun Tang, Shice Liu, Jing Ye
Unsupervised video prediction is a very challenging task due to the complexity and diversity in natural scenes. Prior works directly predicting pixels or optical flows either have the blurring problem or require additional assumptions. We highlight that the crux for video frame prediction lies in precisely capturing the inter-frame variations which encompass the movement of objects and the evolution of the surrounding environment. We then present an unsupervised video prediction framework — Variation Network (VarNet) to directly predict the variations between adjacent frames which are then fused with current frame to generate the future frame. In addition, we propose an adaptively re-weighting mechanism for loss function to offer each pixel a fair weight according to the amplitude of its variation. Extensive experiments for both short-term and long-term video prediction are implemented on two advanced datasets — KTH and KITTI with two evaluating metrics — PSNR and SSIM. For the KTH dataset, the VarNet outperforms the state-of-the-art works up to 11.9% on PSNR and 9.5% on SSIM. As for the KITTI dataset, the performance boosts are up to 55.1 % on PSNR and 15.9% on SSIM. Moreover, we verify that the generalization ability of our model excels other state-of-the-art methods by testing on the unseen CalTech Pedestrian dataset after being trained on the KITTI dataset. Source code and video are available at
由于自然场景的复杂性和多样性,无监督视频预测是一项非常具有挑战性的任务。先前直接预测像素或光流的工作要么有模糊问题,要么需要额外的假设。我们强调视频帧预测的关键在于精确捕捉帧间变化,这些变化包括物体的运动和周围环境的演变。然后,我们提出了一种无监督视频预测框架-变化网络(VarNet),直接预测相邻帧之间的变化,然后与当前帧融合以生成未来帧。此外,我们提出了一种损失函数的自适应重加权机制,根据其变化幅度为每个像素提供公平的权重。在KTH和KITTI两个高级数据集上进行了大量的短期和长期视频预测实验,并采用了两个评估指标- PSNR和SSIM。对于KTH数据集,VarNet在PSNR和SSIM上的表现分别达到11.9%和9.5%。对于KITTI数据集,性能提升在PSNR上达到55.1%,在SSIM上达到15.9%。此外,我们在KITTI数据集上进行训练后,通过在未见过的CalTech行人数据集上进行测试,验证了我们模型的泛化能力优于其他最先进的方法。源代码和视频可在
{"title":"VarNet: Exploring Variations for Unsupervised Video Prediction","authors":"Beibei Jin, Yu Hu, Yiming Zeng, Qiankun Tang, Shice Liu, Jing Ye","doi":"10.1109/IROS.2018.8594264","DOIUrl":"https://doi.org/10.1109/IROS.2018.8594264","url":null,"abstract":"Unsupervised video prediction is a very challenging task due to the complexity and diversity in natural scenes. Prior works directly predicting pixels or optical flows either have the blurring problem or require additional assumptions. We highlight that the crux for video frame prediction lies in precisely capturing the inter-frame variations which encompass the movement of objects and the evolution of the surrounding environment. We then present an unsupervised video prediction framework — Variation Network (VarNet) to directly predict the variations between adjacent frames which are then fused with current frame to generate the future frame. In addition, we propose an adaptively re-weighting mechanism for loss function to offer each pixel a fair weight according to the amplitude of its variation. Extensive experiments for both short-term and long-term video prediction are implemented on two advanced datasets — KTH and KITTI with two evaluating metrics — PSNR and SSIM. For the KTH dataset, the VarNet outperforms the state-of-the-art works up to 11.9% on PSNR and 9.5% on SSIM. As for the KITTI dataset, the performance boosts are up to 55.1 % on PSNR and 15.9% on SSIM. Moreover, we verify that the generalization ability of our model excels other state-of-the-art methods by testing on the unseen CalTech Pedestrian dataset after being trained on the KITTI dataset. Source code and video are available at","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"27 1","pages":"5801-5806"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76748513","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Temporally Smooth Privacy-Protected Airborne Videos 暂时平滑隐私保护机载视频
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8594493
Omair Sarwar, A. Cavallaro, B. Rinner
Recreational videography from small drones can capture bystanders who may be uncomfortable about appearing in those videos. Existing privacy filters, such as scrambling and hopping blur, address this issue through de-identification but generate temporal distortions that manifest themselves as flicker. To address this problem, we present a robust spatiotemporal hopping blur filter that protects privacy through de-identification of face regions. The proposed filter is meant for on-board installation and produces temporally smooth and pleasant videos. We apply hopping blur to protect each frame against identification attacks, and minimise artefacts and flicker introduced by the hopping blur. We evaluate the proposed filter against different identification attacks and by assessing the quality of the resulting videos using a subjective test and objective measures.
小型无人机拍摄的娱乐性视频可以捕捉到旁观者,他们可能对出现在这些视频中感到不舒服。现有的隐私过滤器,如混乱和跳跃模糊,通过去识别来解决这个问题,但会产生时间扭曲,表现为闪烁。为了解决这一问题,我们提出了一种鲁棒的时空跳变模糊滤波器,该滤波器通过去识别人脸区域来保护隐私。所提出的过滤器用于车载安装,并产生暂时平滑和愉快的视频。我们应用跳跃模糊来保护每一帧免受识别攻击,并最小化由跳跃模糊引入的伪影和闪烁。我们通过主观测试和客观测量来评估所提出的过滤器对不同识别攻击的影响。
{"title":"Temporally Smooth Privacy-Protected Airborne Videos","authors":"Omair Sarwar, A. Cavallaro, B. Rinner","doi":"10.1109/IROS.2018.8594493","DOIUrl":"https://doi.org/10.1109/IROS.2018.8594493","url":null,"abstract":"Recreational videography from small drones can capture bystanders who may be uncomfortable about appearing in those videos. Existing privacy filters, such as scrambling and hopping blur, address this issue through de-identification but generate temporal distortions that manifest themselves as flicker. To address this problem, we present a robust spatiotemporal hopping blur filter that protects privacy through de-identification of face regions. The proposed filter is meant for on-board installation and produces temporally smooth and pleasant videos. We apply hopping blur to protect each frame against identification attacks, and minimise artefacts and flicker introduced by the hopping blur. We evaluate the proposed filter against different identification attacks and by assessing the quality of the resulting videos using a subjective test and objective measures.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"7 1","pages":"6728-6733"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77076102","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Bidirectional Thrust for Multirotor MAVs with Fixed-Pitch Propellers 固定螺距多旋翼飞行器的双向推力
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8593836
M. Maier
This paper is devoted to the study of multirotor Micro Aerial Vehicles (MAVs) with fixed-pitch propellers and bidirectional thrust vector. The latter is realized by using dedicated motor controllers, which allow to invert the propellers' direction of rotation during flight (so-called 3D mode), and almost or fully symmetric propellers. We present a unified modeling, controller design, and control allocation approach that accounts for bidirectional thrust. Suitable propellers with the ability to produce thrust and torque in both directions are compared and their parameters are identified through a static thrust test. Furthermore, we discuss applications of bidirectional thrust, like inverted flight or surface slip reduction, which are impossible to realize with common unidirectional thrust vehicles. We generate suitable flight trajectories and evaluate our unified approach in experiments with a custom-built quadrotor.
本文研究了具有固定螺距螺旋桨和双向推力矢量的多旋翼微型飞行器。后者是通过使用专用的电机控制器来实现的,它允许在飞行过程中反转螺旋桨的旋转方向(所谓的3D模式),以及几乎或完全对称的螺旋桨。我们提出了一种统一的建模、控制器设计和控制分配方法,该方法考虑了双向推力。比较了具有双向推力和扭矩能力的合适螺旋桨,并通过静态推力试验确定了它们的参数。此外,我们还讨论了双向推力的应用,如倒飞或减少表面滑移,这是普通单向推力飞行器无法实现的。我们产生合适的飞行轨迹和评估我们的统一方法在实验与定制的四旋翼。
{"title":"Bidirectional Thrust for Multirotor MAVs with Fixed-Pitch Propellers","authors":"M. Maier","doi":"10.1109/IROS.2018.8593836","DOIUrl":"https://doi.org/10.1109/IROS.2018.8593836","url":null,"abstract":"This paper is devoted to the study of multirotor Micro Aerial Vehicles (MAVs) with fixed-pitch propellers and bidirectional thrust vector. The latter is realized by using dedicated motor controllers, which allow to invert the propellers' direction of rotation during flight (so-called 3D mode), and almost or fully symmetric propellers. We present a unified modeling, controller design, and control allocation approach that accounts for bidirectional thrust. Suitable propellers with the ability to produce thrust and torque in both directions are compared and their parameters are identified through a static thrust test. Furthermore, we discuss applications of bidirectional thrust, like inverted flight or surface slip reduction, which are impossible to realize with common unidirectional thrust vehicles. We generate suitable flight trajectories and evaluate our unified approach in experiments with a custom-built quadrotor.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"121 1","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82428355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Game-Theoretic Cooperative Lane Changing Using Data-Driven Models 基于数据驱动模型的博弈论协同变道
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8593725
Guohui Ding, Sina Aghli, C. Heckman, Lijun Chen
Self-driving vehicles are being increasingly deployed in the wild. One of the most important next hurdles for autonomous driving is how such vehicles will optimally interact with one another and with their surroundings. In this paper, we consider the lane changing problem that is fundamental to road-bound multi-vehicle systems, and approach it through a combination of deep reinforcement learning (DRL) and game theory. We introduce a proactive-passive lane changing framework and formulate the lane changing problem as a Markov game between the proactive and passive vehicles. Based on different approaches to carry out DRL to solve the Markov game, we propose an asynchronous lane changing scheme as in a single-agent RL setting and a synchronous cooperative lane changing scheme that takes into consideration the adaptive behavior of the other vehicle in a vehicle's decision. Experimental results show that the synchronous scheme can effectively create and find proper merging moment after sufficient training. The framework and solution developed here demonstrate the potential of using reinforcement learning to solve multi-agent autonomous vehicle tasks such as the lane changing as they are formulated as Markov games.
自动驾驶汽车正越来越多地部署在野外。自动驾驶的下一个最重要的障碍之一是,这些车辆如何与彼此以及与周围环境进行最佳互动。在本文中,我们考虑了道路行驶多车辆系统的基本变道问题,并通过深度强化学习(DRL)和博弈论的结合来解决它。我们引入了一个主动-被动变道框架,并将变道问题表述为主动和被动车辆之间的马尔可夫博弈。基于不同的DRL求解马尔可夫博弈的方法,我们提出了单智能体RL设置下的异步变道方案和考虑其他车辆在车辆决策中的自适应行为的同步协同变道方案。实验结果表明,经过充分的训练,该同步方案可以有效地创建并找到合适的合并力矩。这里开发的框架和解决方案展示了使用强化学习来解决多智能体自动驾驶车辆任务的潜力,例如变道,因为它们被表述为马尔可夫游戏。
{"title":"Game-Theoretic Cooperative Lane Changing Using Data-Driven Models","authors":"Guohui Ding, Sina Aghli, C. Heckman, Lijun Chen","doi":"10.1109/IROS.2018.8593725","DOIUrl":"https://doi.org/10.1109/IROS.2018.8593725","url":null,"abstract":"Self-driving vehicles are being increasingly deployed in the wild. One of the most important next hurdles for autonomous driving is how such vehicles will optimally interact with one another and with their surroundings. In this paper, we consider the lane changing problem that is fundamental to road-bound multi-vehicle systems, and approach it through a combination of deep reinforcement learning (DRL) and game theory. We introduce a proactive-passive lane changing framework and formulate the lane changing problem as a Markov game between the proactive and passive vehicles. Based on different approaches to carry out DRL to solve the Markov game, we propose an asynchronous lane changing scheme as in a single-agent RL setting and a synchronous cooperative lane changing scheme that takes into consideration the adaptive behavior of the other vehicle in a vehicle's decision. Experimental results show that the synchronous scheme can effectively create and find proper merging moment after sufficient training. The framework and solution developed here demonstrate the potential of using reinforcement learning to solve multi-agent autonomous vehicle tasks such as the lane changing as they are formulated as Markov games.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"8 1","pages":"3640-3647"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82559911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Airborne Docking for Multi-Rotor Aerial Manipulations 多旋翼空中操纵的机载对接
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8594513
Ryo Miyazaki, Rui Jiang, Hannibal Paul, Koji Ono, K. Shimonomura
We have proposed airborne docking using two multi-rotor aerial robots. This paper presents a transport multi-rotor UAV with winch mechanism and a small multi-rotor with onboard locolization and mobile manipulation system. The winch mechanism enables the UAV to lower and raise a bar to transport another UAV attached to it. The airborne docking method used in our work is chosen in order to avoid the effect of downwash generated by the multi-rotors. With experiments we have verified the possibility of airborne docking, and evaluated how it influences the transport multi-rotor UAV as the load is changed, using the IMU data of UAV.
我们提出了使用两个多旋翼空中机器人进行空中对接。提出了一种带绞车机构的运输多旋翼无人机和一种带有机载定位和移动操纵系统的小型多旋翼无人机。绞车机构使无人机能够降低和提高一根杆来运输附加到它的另一架无人机。为了避免多旋翼产生的下洗影响,本文选择了机载对接方式。利用无人机的IMU数据,通过实验验证了机载对接的可能性,并评估了载荷变化对运输多旋翼无人机的影响。
{"title":"Airborne Docking for Multi-Rotor Aerial Manipulations","authors":"Ryo Miyazaki, Rui Jiang, Hannibal Paul, Koji Ono, K. Shimonomura","doi":"10.1109/IROS.2018.8594513","DOIUrl":"https://doi.org/10.1109/IROS.2018.8594513","url":null,"abstract":"We have proposed airborne docking using two multi-rotor aerial robots. This paper presents a transport multi-rotor UAV with winch mechanism and a small multi-rotor with onboard locolization and mobile manipulation system. The winch mechanism enables the UAV to lower and raise a bar to transport another UAV attached to it. The airborne docking method used in our work is chosen in order to avoid the effect of downwash generated by the multi-rotors. With experiments we have verified the possibility of airborne docking, and evaluated how it influences the transport multi-rotor UAV as the load is changed, using the IMU data of UAV.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"42 1","pages":"4708-4714"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82329058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 19
SMA based wrist exoskeleton for rehabilitation therapy* 基于SMA的腕外骨骼康复治疗*
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8593987
David Serrano, D. Copaci, Luis Moreno, D. Blanco
This paper presents a rehabilitation wearable exoskeleton for wrist joint with two degrees of freedom (DOF), flexion-extension and adduction-abduction (radial and ulnar deviation), actuated with Shape Memory Alloy (SMA) based actuators. Thanks to this type of actuators, the proposed device presents a very light weight and noiseless operation, in comparison with similar devices. The preliminary results obtained over real tests with the wrist exoskeleton are presented. This prototype demonstrates that SMA actuator technology is a viable alternative when investigating possible improvement of rehabilitation robotic devices in terms of weight, size and cost.
本文介绍了一种康复可穿戴外骨骼,用于具有两个自由度(DOF),屈伸和内收外展(桡骨和尺侧偏差)的腕关节,由形状记忆合金(SMA)驱动。由于这种类型的执行器,与同类设备相比,所提出的设备具有非常轻的重量和无噪音的操作。介绍了腕部外骨骼在实际测试中获得的初步结果。该原型表明,在研究康复机器人设备在重量、尺寸和成本方面的可能改进时,SMA致动器技术是一种可行的替代方案。
{"title":"SMA based wrist exoskeleton for rehabilitation therapy*","authors":"David Serrano, D. Copaci, Luis Moreno, D. Blanco","doi":"10.1109/IROS.2018.8593987","DOIUrl":"https://doi.org/10.1109/IROS.2018.8593987","url":null,"abstract":"This paper presents a rehabilitation wearable exoskeleton for wrist joint with two degrees of freedom (DOF), flexion-extension and adduction-abduction (radial and ulnar deviation), actuated with Shape Memory Alloy (SMA) based actuators. Thanks to this type of actuators, the proposed device presents a very light weight and noiseless operation, in comparison with similar devices. The preliminary results obtained over real tests with the wrist exoskeleton are presented. This prototype demonstrates that SMA actuator technology is a viable alternative when investigating possible improvement of rehabilitation robotic devices in terms of weight, size and cost.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"68 1","pages":"2318-2323"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82340369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Vision-Based Autonomous Underwater Swimming in Dense Coral for Combined Collision Avoidance and Target Selection 基于视觉的密集珊瑚自主水下游泳避碰与目标选择
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8594410
Travis Manderson, J. A. G. Higuera, Ran Cheng, G. Dudek
We address the problem of learning vision-based, collision-avoiding, and target-selecting controllers in 3D, specifically in underwater environments densely populated with coral reefs. Using a highly maneuverable, dynamic, six-legged (or flippered) vehicle to swim underwater, we exploit real time visual feedback to make close-range navigation decisions that would be hard to achieve with other sensors. Our approach uses computer vision as the sole mechanism for both collision avoidance and visual target selection. In particular, we seek to swim close to the reef to make observations while avoiding both collisions and barren, coral-deprived regions. To carry out path selection while avoiding collisions, we use monocular image data processed in real time. The proposed system uses a convolutional neural network that takes an image from a forward-facing camera as input and predicts unscaled and relative path changes. The network is trained to encode our desired obstacle-avoidance and reef-exploration objectives via supervised learning from human-labeled data. The predictions from the network are transformed into absolute path changes via a combination of a temporally-smoothed proportional controller for heading targets and a low-level motor controller. This system enables safe and autonomous coral reef navigation in underwater environments. We validate our approach using an untethered and fully autonomous robot swimming through coral reef in the open ocean. Our robot successfully traverses 1000 m of the ocean floor collision-free while collecting close-up footage of coral reefs.
我们解决了在3D中学习基于视觉、避碰和目标选择控制器的问题,特别是在珊瑚礁密集的水下环境中。我们使用高度机动、动态的六足(或鳍状)潜水器在水下游泳,利用实时视觉反馈来做出近距离导航决策,这是其他传感器难以实现的。我们的方法使用计算机视觉作为避免碰撞和视觉目标选择的唯一机制。特别是,我们试图游到靠近珊瑚礁的地方进行观察,同时避免碰撞和贫瘠的珊瑚剥夺地区。为了在避免碰撞的同时进行路径选择,我们使用了实时处理的单眼图像数据。该系统使用卷积神经网络,将前置摄像头的图像作为输入,并预测未缩放的相对路径变化。该网络经过训练,通过对人类标记数据的监督学习来编码我们想要的避障和珊瑚礁探索目标。网络的预测通过一个用于航向目标的时间平滑比例控制器和一个低级电机控制器的组合转化为绝对路径变化。该系统可实现水下环境下安全自主的珊瑚礁导航。我们用一个无系绳的完全自主的机器人在开阔的海洋中穿过珊瑚礁来验证我们的方法。我们的机器人成功地穿越了1000米的海底无碰撞,同时收集了珊瑚礁的特写镜头。
{"title":"Vision-Based Autonomous Underwater Swimming in Dense Coral for Combined Collision Avoidance and Target Selection","authors":"Travis Manderson, J. A. G. Higuera, Ran Cheng, G. Dudek","doi":"10.1109/IROS.2018.8594410","DOIUrl":"https://doi.org/10.1109/IROS.2018.8594410","url":null,"abstract":"We address the problem of learning vision-based, collision-avoiding, and target-selecting controllers in 3D, specifically in underwater environments densely populated with coral reefs. Using a highly maneuverable, dynamic, six-legged (or flippered) vehicle to swim underwater, we exploit real time visual feedback to make close-range navigation decisions that would be hard to achieve with other sensors. Our approach uses computer vision as the sole mechanism for both collision avoidance and visual target selection. In particular, we seek to swim close to the reef to make observations while avoiding both collisions and barren, coral-deprived regions. To carry out path selection while avoiding collisions, we use monocular image data processed in real time. The proposed system uses a convolutional neural network that takes an image from a forward-facing camera as input and predicts unscaled and relative path changes. The network is trained to encode our desired obstacle-avoidance and reef-exploration objectives via supervised learning from human-labeled data. The predictions from the network are transformed into absolute path changes via a combination of a temporally-smoothed proportional controller for heading targets and a low-level motor controller. This system enables safe and autonomous coral reef navigation in underwater environments. We validate our approach using an untethered and fully autonomous robot swimming through coral reef in the open ocean. Our robot successfully traverses 1000 m of the ocean floor collision-free while collecting close-up footage of coral reefs.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"6 1","pages":"1885-1891"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78648465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 34
Long-Duration Autonomy for Small Rotorcraft UAS Including Recharging 包括充电在内的小型旋翼无人机长时间自主性研究
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8594111
Christian Brommer, Danylo Malyuta, Daniel Hentzen, R. Brockers
Many unmanned aerial vehicle surveillance and monitoring applications require observations at precise locations over long periods of time, ideally days or weeks at a time (e.g. ecosystem monitoring), which has been impractical due to limited endurance and the requirement of humans in the loop for operation. To overcome these limitations, we propose a fully autonomous small rotorcraft UAS that is capable of performing repeated sorties for long-term observation missions without any human intervention. We address two key technologies that are critical for such a system: full platform autonomy including emergency response to enable mission execution independently from human operators, and the ability of vision-based precision landing on a recharging station for automated energy replenishment. Experimental results of up to 11 hours of fully autonomous operation in indoor and outdoor environments illustrate the capability of our system.
许多无人机监视和监测应用需要长时间在精确位置进行观察,理想情况下是一次观察数天或数周(例如生态系统监测),由于有限的耐力和操作循环中对人类的要求,这是不切实际的。为了克服这些限制,我们提出了一种完全自主的小型旋翼无人机,它能够在没有任何人为干预的情况下执行长期观察任务的重复架次。我们解决了对这样一个系统至关重要的两项关键技术:包括应急响应在内的全平台自主性,使任务能够独立于人类操作员执行,以及基于视觉的精确降落在充电站上的能力,以实现自动能量补充。在室内和室外环境下长达11小时的完全自主运行的实验结果证明了我们的系统的能力。
{"title":"Long-Duration Autonomy for Small Rotorcraft UAS Including Recharging","authors":"Christian Brommer, Danylo Malyuta, Daniel Hentzen, R. Brockers","doi":"10.1109/IROS.2018.8594111","DOIUrl":"https://doi.org/10.1109/IROS.2018.8594111","url":null,"abstract":"Many unmanned aerial vehicle surveillance and monitoring applications require observations at precise locations over long periods of time, ideally days or weeks at a time (e.g. ecosystem monitoring), which has been impractical due to limited endurance and the requirement of humans in the loop for operation. To overcome these limitations, we propose a fully autonomous small rotorcraft UAS that is capable of performing repeated sorties for long-term observation missions without any human intervention. We address two key technologies that are critical for such a system: full platform autonomy including emergency response to enable mission execution independently from human operators, and the ability of vision-based precision landing on a recharging station for automated energy replenishment. Experimental results of up to 11 hours of fully autonomous operation in indoor and outdoor environments illustrate the capability of our system.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"28 1","pages":"7252-7258"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78943741","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Down the CLiFF: Flow-Aware Tralatory Planning Under Motion Pattern Uncertainty 下悬崖:运动模式不确定性下的流动感知的渐变计划
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8593905
Chittaranjan Srinivas Swaminathan, T. Kucner, Martin Magnusson, Luigi Palmieri, A. Lilienthal
In this paper we address the problem of flow-aware trajectory planning in dynamic environments considering flow model uncertainty. Flow-aware planning aims to plan trajectories that adhere to existing flow motion patterns in the environment, with the goal to make robots more efficient, less intrusive and safer. We use a statistical model called CLiFF-map that can map flow patterns for both continuous media and discrete objects. We propose novel cost and biasing functions for an RRT* planning algorithm, which exploits all the information available in the CLiFF-map model, including uncertainties due to flow variability or partial observability. Qualitatively, a benefit of our approach is that it can also be tuned to yield trajectories with different qualities such as exploratory or cautious, depending on application requirements. Quantitatively, we demonstrate that our approach produces more flow-compliant trajectories, compared to two baselines.
本文研究了动态环境下考虑流模型不确定性的流感知轨迹规划问题。流感知规划旨在规划符合环境中现有流运动模式的轨迹,目标是使机器人更高效、更少干扰和更安全。我们使用一种叫做CLiFF-map的统计模型,它可以映射连续介质和离散对象的流模式。我们为RRT*规划算法提出了新的成本和偏倚函数,该算法利用了CLiFF-map模型中可用的所有信息,包括由于流量可变性或部分可观测性引起的不确定性。从质量上讲,我们的方法的一个好处是,它也可以根据应用需求调整为具有不同质量的产出轨迹,例如探索性或谨慎性。定量地,我们证明了与两个基线相比,我们的方法产生了更多的流动顺应轨迹。
{"title":"Down the CLiFF: Flow-Aware Tralatory Planning Under Motion Pattern Uncertainty","authors":"Chittaranjan Srinivas Swaminathan, T. Kucner, Martin Magnusson, Luigi Palmieri, A. Lilienthal","doi":"10.1109/IROS.2018.8593905","DOIUrl":"https://doi.org/10.1109/IROS.2018.8593905","url":null,"abstract":"In this paper we address the problem of flow-aware trajectory planning in dynamic environments considering flow model uncertainty. Flow-aware planning aims to plan trajectories that adhere to existing flow motion patterns in the environment, with the goal to make robots more efficient, less intrusive and safer. We use a statistical model called CLiFF-map that can map flow patterns for both continuous media and discrete objects. We propose novel cost and biasing functions for an RRT* planning algorithm, which exploits all the information available in the CLiFF-map model, including uncertainties due to flow variability or partial observability. Qualitatively, a benefit of our approach is that it can also be tuned to yield trajectories with different qualities such as exploratory or cautious, depending on application requirements. Quantitatively, we demonstrate that our approach produces more flow-compliant trajectories, compared to two baselines.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"358 1","pages":"7403-7409"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76355224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Constrained Path Planning Using Quadratic Programming 基于二次规划的约束路径规划
Pub Date : 2018-10-01 DOI: 10.1109/IROS.2018.8593373
F. Fusco, Olivier Kermorgant, P. Martinet
Sampling-based planning algorithms have been extensively exploited to solve a wide variety of problems. In recent years, many efforts have been dedicated to extend these tools to solve problems involving constraints, such as geometric loop-closure, which lead the valid Configuration Space (CS) to collapse to a lower-dimensional manifold. One proposed solution considers an approximation of the constrained Configuration Space that is obtained by relaxing constraints up to a desired tolerance. The resulting set has then non-zero measure, allowing to exploit classical planning algorithms to search for a path connecting two given states. When constraints involve kinematic loops in the system, relaxation generally bears to undesired contact forces, which need to be compensated during execution by a proper control action. We propose a new tool that exploits relaxation to plan in presence of constraints. Local motions inside the approximated manifold are found as the result of an iterative scheme that uses Quadratic Optimization to proceed towards a new sample without falling outside the relaxed region. By properly guiding the exploration, paths are found with smaller relaxation factors and the need of a dedicated controller to compensate errors is reduced. We complete the analysis by showing the feasibility of the approach with experiments on a real platform.
基于抽样的规划算法已被广泛应用于解决各种各样的问题。近年来,许多人致力于扩展这些工具来解决涉及约束的问题,例如导致有效构型空间(CS)崩溃为低维流形的几何闭环。一种被提出的解决方案考虑了约束配置空间的近似值,该近似值是通过将约束放宽到所需的容差来获得的。结果集具有非零度量,允许利用经典规划算法来搜索连接两个给定状态的路径。当约束涉及系统中的运动回路时,松弛通常承受不期望的接触力,需要在执行过程中通过适当的控制动作进行补偿。我们提出了一个新的工具,利用放松来计划存在的约束。近似流形内的局部运动是一种迭代方案的结果,该方案使用二次优化方法在不落在松弛区域之外的情况下向新样本前进。通过适当地引导探索,可以找到具有较小松弛因子的路径,并且减少了对专用控制器进行误差补偿的需求。通过在实际平台上的实验证明了该方法的可行性,从而完成了分析。
{"title":"Constrained Path Planning Using Quadratic Programming","authors":"F. Fusco, Olivier Kermorgant, P. Martinet","doi":"10.1109/IROS.2018.8593373","DOIUrl":"https://doi.org/10.1109/IROS.2018.8593373","url":null,"abstract":"Sampling-based planning algorithms have been extensively exploited to solve a wide variety of problems. In recent years, many efforts have been dedicated to extend these tools to solve problems involving constraints, such as geometric loop-closure, which lead the valid Configuration Space (CS) to collapse to a lower-dimensional manifold. One proposed solution considers an approximation of the constrained Configuration Space that is obtained by relaxing constraints up to a desired tolerance. The resulting set has then non-zero measure, allowing to exploit classical planning algorithms to search for a path connecting two given states. When constraints involve kinematic loops in the system, relaxation generally bears to undesired contact forces, which need to be compensated during execution by a proper control action. We propose a new tool that exploits relaxation to plan in presence of constraints. Local motions inside the approximated manifold are found as the result of an iterative scheme that uses Quadratic Optimization to proceed towards a new sample without falling outside the relaxed region. By properly guiding the exploration, paths are found with smaller relaxation factors and the need of a dedicated controller to compensate errors is reduced. We complete the analysis by showing the feasibility of the approach with experiments on a real platform.","PeriodicalId":6640,"journal":{"name":"2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"57 1","pages":"8134-8139"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76407534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1