首页 > 最新文献

2022 International Conference on Robotics and Automation (ICRA)最新文献

英文 中文
Formation-containment tracking and scaling for multiple quadcopters with an application to choke-point navigation 基于阻塞点导航的多架四轴飞行器的地层控制跟踪和缩放
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9812172
Yuejiang Su, A. Lanzon
This paper investigates the cooperative control problem of choke-point navigation for multiple quadcopters when only their subgroup is equipped with obstacle detecting sensors. We define a quadcopter as a leader if it is equipped with an obstacle detecting sensor; otherwise, it is a follower. In addition, we introduce a virtual leader agent to create the group motion. First, we apply the leader-follower approach and propose a formation-containment tracking controller for multiple quadcopters to track the time-varying velocity of the virtual leader agent. At the same time, the leader quadcopters form the prescribed formation while the follower quadcopters converge inside a safe region, which is the convex hull spanned by those leaders. Then, we introduce a scaling vector into the displacement-based formation constraints. When the leader quadcopters identify the choke-point via their obstacle detecting sensors, they update the scaling variable to adjust the size of the formation (i.e. the safe region) and guide all quadcopters to safely pass through the choke-point. The proposed cooperative controllers are distributed because each quadcopter's control command only relies on the information states from its neighbours. Finally, two autonomous flight experiments, including formation-containment tracking and choke-point navigation, are provided to validate the effectiveness of the proposed cooperative control laws.
研究了多架四旋翼飞行器在仅配备障碍物检测传感器的情况下的阻塞点导航协同控制问题。如果配备了障碍物探测传感器,我们将四轴飞行器定义为领导者;否则,它就是追随者。此外,我们还引入了一个虚拟领导代理来创建群体运动。首先,我们应用leader-follower方法,提出了一种多四轴飞行器的包含队形的跟踪控制器来跟踪虚拟leader agent的时变速度。同时,领头四轴飞行器形成规定的队形,跟随四轴飞行器在一个安全区域内收敛,这个安全区域就是这些领头四轴飞行器所跨越的凸包。然后,将尺度向量引入到基于位移的地层约束中。当领先的四轴飞行器通过障碍物检测传感器识别出阻塞点时,它们会更新缩放变量来调整编队的大小(即安全区域),并引导所有四轴飞行器安全通过阻塞点。由于每个四轴飞行器的控制命令仅依赖于其邻居的信息状态,因此所提出的协作控制器是分布式的。最后,通过编队约束跟踪和阻塞点导航两个自主飞行实验验证了所提协同控制律的有效性。
{"title":"Formation-containment tracking and scaling for multiple quadcopters with an application to choke-point navigation","authors":"Yuejiang Su, A. Lanzon","doi":"10.1109/icra46639.2022.9812172","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9812172","url":null,"abstract":"This paper investigates the cooperative control problem of choke-point navigation for multiple quadcopters when only their subgroup is equipped with obstacle detecting sensors. We define a quadcopter as a leader if it is equipped with an obstacle detecting sensor; otherwise, it is a follower. In addition, we introduce a virtual leader agent to create the group motion. First, we apply the leader-follower approach and propose a formation-containment tracking controller for multiple quadcopters to track the time-varying velocity of the virtual leader agent. At the same time, the leader quadcopters form the prescribed formation while the follower quadcopters converge inside a safe region, which is the convex hull spanned by those leaders. Then, we introduce a scaling vector into the displacement-based formation constraints. When the leader quadcopters identify the choke-point via their obstacle detecting sensors, they update the scaling variable to adjust the size of the formation (i.e. the safe region) and guide all quadcopters to safely pass through the choke-point. The proposed cooperative controllers are distributed because each quadcopter's control command only relies on the information states from its neighbours. Finally, two autonomous flight experiments, including formation-containment tracking and choke-point navigation, are provided to validate the effectiveness of the proposed cooperative control laws.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114828299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent 从无到有:机器人素描代理的深度解耦分层强化学习
Pub Date : 2022-05-23 DOI: 10.1109/ICRA46639.2022.9811858
Ganghun Lee, Minji Kim, M. Lee, Byoung-Tak Zhang
We present an automated learning framework for a robotic sketching agent that is capable of learning stroke-based rendering and motor control simultaneously. We formulate the robotic sketching problem as a deep decoupled hierarchical reinforcement learning; two policies for stroke-based rendering and motor control are learned independently to achieve sub-tasks for drawing, and form a hierarchy when cooperating for real-world drawing. Without hand-crafted features, drawing sequences or trajectories, and inverse kinematics, the proposed method trains the robotic sketching agent from scratch. We performed experiments with a 6-DoF robot arm with 2F gripper to sketch doodles. Our experimental results show that the two policies successfully learned the sub-tasks and collaborated to sketch the target images. Also, the robustness and flexibility were examined by varying drawing tools and surfaces.
我们提出了一个机器人素描代理的自动学习框架,它能够同时学习基于笔画的绘制和电机控制。我们将机器人绘图问题表述为深度解耦分层强化学习;分别学习基于笔画的绘制策略和电机控制策略,实现绘图的子任务,并在实际绘图中形成层次结构。该方法不需要手工绘制特征、绘制序列或轨迹以及逆运动学,可以从头开始训练机器人素描代理。我们用带有2F夹持器的6自由度机械臂进行了涂鸦实验。实验结果表明,这两个策略成功地学习了子任务,并协同绘制了目标图像。此外,通过不同的绘图工具和表面来检查鲁棒性和灵活性。
{"title":"From Scratch to Sketch: Deep Decoupled Hierarchical Reinforcement Learning for Robotic Sketching Agent","authors":"Ganghun Lee, Minji Kim, M. Lee, Byoung-Tak Zhang","doi":"10.1109/ICRA46639.2022.9811858","DOIUrl":"https://doi.org/10.1109/ICRA46639.2022.9811858","url":null,"abstract":"We present an automated learning framework for a robotic sketching agent that is capable of learning stroke-based rendering and motor control simultaneously. We formulate the robotic sketching problem as a deep decoupled hierarchical reinforcement learning; two policies for stroke-based rendering and motor control are learned independently to achieve sub-tasks for drawing, and form a hierarchy when cooperating for real-world drawing. Without hand-crafted features, drawing sequences or trajectories, and inverse kinematics, the proposed method trains the robotic sketching agent from scratch. We performed experiments with a 6-DoF robot arm with 2F gripper to sketch doodles. Our experimental results show that the two policies successfully learned the sub-tasks and collaborated to sketch the target images. Also, the robustness and flexibility were examined by varying drawing tools and surfaces.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114886581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
APF-RL: Safe Mapless Navigation in Unknown Environments APF-RL:未知环境下的安全无地图导航
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9811537
Kemal Bektas, H. I. Bozma
This paper is focused on safe mapless navigation of mobile robots in unknown and possibly complex environments containing both internal and dynamic obstacles. We present a novel modular approach that combines the strengths of artificial potential functions (APF) with deep reinforcement learning. Differing from related work, the robot learns how to adjust the two input parameters of the APF controller as necessary through soft actor-critic algorithm. Environmental complexity measures are introduced in order to ensure that the robot's training covers a range of learning scenarios that vary in regard to maneuvering difficulty. Our experimental results show that differing from the classical navigation methods and end-to-end models, the robot can navigate successfully on its own even in complex scenarios with moving entities without requiring any maps.
本文主要研究移动机器人在包含内部和动态障碍物的未知和可能复杂环境中的安全无地图导航问题。我们提出了一种新的模块化方法,将人工势函数(APF)的优势与深度强化学习相结合。与相关工作不同的是,机器人通过软actor-critic算法学习如何根据需要调整APF控制器的两个输入参数。为了确保机器人的训练涵盖了一系列不同机动难度的学习场景,引入了环境复杂性措施。我们的实验结果表明,与传统的导航方法和端到端模型不同,即使在有移动实体的复杂场景中,机器人也可以在不需要任何地图的情况下成功地自主导航。
{"title":"APF-RL: Safe Mapless Navigation in Unknown Environments","authors":"Kemal Bektas, H. I. Bozma","doi":"10.1109/icra46639.2022.9811537","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9811537","url":null,"abstract":"This paper is focused on safe mapless navigation of mobile robots in unknown and possibly complex environments containing both internal and dynamic obstacles. We present a novel modular approach that combines the strengths of artificial potential functions (APF) with deep reinforcement learning. Differing from related work, the robot learns how to adjust the two input parameters of the APF controller as necessary through soft actor-critic algorithm. Environmental complexity measures are introduced in order to ensure that the robot's training covers a range of learning scenarios that vary in regard to maneuvering difficulty. Our experimental results show that differing from the classical navigation methods and end-to-end models, the robot can navigate successfully on its own even in complex scenarios with moving entities without requiring any maps.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114661600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Metareasoning for Safe Decision Making in Autonomous Systems 自主系统安全决策的元推理
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9811887
Justin Svegliato, Connor Basich, Sandhya Saisubramanian, S. Zilberstein
Although experts carefully specify the high-level decision-making models in autonomous systems, it is infeasible to guarantee safety across every scenario during operation. We therefore propose a safety metareasoning system that optimizes the severity of the system's safety concerns and the interference to the system's task: the system executes in parallel a task process that completes a specified task and safety processes that each address a specified safety concern with a conflict resolver for arbitration. This paper offers a formal definition of a safety metareasoning system, a recommendation algorithm for a safety process, an arbitration algorithm for a conflict resolver, an application of our approach to planetary rover exploration, and a demonstration that our approach is effective in simulation.
尽管专家们仔细地定义了自主系统的高层决策模型,但在运行过程中,保证每个场景的安全是不可行的。因此,我们提出了一种安全元推理系统,该系统优化了系统安全问题的严重性和对系统任务的干扰:系统并行执行一个任务进程,该任务进程完成了指定的任务,而每个安全进程都通过一个冲突解决器来解决指定的安全问题。本文给出了安全元推理系统的正式定义,安全过程的推荐算法,冲突解决器的仲裁算法,我们的方法在行星漫游者探测中的应用,并在仿真中证明了我们的方法是有效的。
{"title":"Metareasoning for Safe Decision Making in Autonomous Systems","authors":"Justin Svegliato, Connor Basich, Sandhya Saisubramanian, S. Zilberstein","doi":"10.1109/icra46639.2022.9811887","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9811887","url":null,"abstract":"Although experts carefully specify the high-level decision-making models in autonomous systems, it is infeasible to guarantee safety across every scenario during operation. We therefore propose a safety metareasoning system that optimizes the severity of the system's safety concerns and the interference to the system's task: the system executes in parallel a task process that completes a specified task and safety processes that each address a specified safety concern with a conflict resolver for arbitration. This paper offers a formal definition of a safety metareasoning system, a recommendation algorithm for a safety process, an arbitration algorithm for a conflict resolver, an application of our approach to planetary rover exploration, and a demonstration that our approach is effective in simulation.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117346715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Learning-Guided Exploration for Efficient Sampling-Based Motion Planning in High Dimensions 基于学习的高维高效采样运动规划探索
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9812184
Liam Schramm, Abdeslam Boularias
Optimal motion planning is a long-studied problem with a wide range of applications in robotics, from grasping to navigation. While sampling-based motion planning methods have made solving such problems significantly more feasible, these methods still often struggle in high-dimensional spaces wherein exploration is computationally costly. In this paper, we propose a new motion planning algorithm that reduces the computational burden of the exploration process. The proposed algorithm utilizes a guidance policy acquired offline through model-free reinforcement learning. The guidance policy is used to bias the exploration process in motion planning and to guide it toward promising regions of the state space. Moreover, we show that the gradients of the corresponding learned value function can be used to locally fine-tune the sampled states. We empirically demonstrate that the proposed approach can significantly reduce planning time and improve success rate and path quality.
最优运动规划是一个长期研究的问题,在机器人技术中有着广泛的应用,从抓取到导航。虽然基于采样的运动规划方法使得解决这类问题变得更加可行,但这些方法仍然经常在高维空间中挣扎,其中探索的计算成本很高。在本文中,我们提出了一种新的运动规划算法,减少了探索过程的计算负担。该算法利用无模型强化学习离线获取的引导策略。该引导策略用于对运动规划中的探索过程进行偏置,并将其引导到状态空间中有希望的区域。此外,我们还证明了相应的学习值函数的梯度可以用于局部微调采样状态。实证结果表明,该方法可以显著缩短规划时间,提高规划成功率和路径质量。
{"title":"Learning-Guided Exploration for Efficient Sampling-Based Motion Planning in High Dimensions","authors":"Liam Schramm, Abdeslam Boularias","doi":"10.1109/icra46639.2022.9812184","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9812184","url":null,"abstract":"Optimal motion planning is a long-studied problem with a wide range of applications in robotics, from grasping to navigation. While sampling-based motion planning methods have made solving such problems significantly more feasible, these methods still often struggle in high-dimensional spaces wherein exploration is computationally costly. In this paper, we propose a new motion planning algorithm that reduces the computational burden of the exploration process. The proposed algorithm utilizes a guidance policy acquired offline through model-free reinforcement learning. The guidance policy is used to bias the exploration process in motion planning and to guide it toward promising regions of the state space. Moreover, we show that the gradients of the corresponding learned value function can be used to locally fine-tune the sampled states. We empirically demonstrate that the proposed approach can significantly reduce planning time and improve success rate and path quality.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"122 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116413632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Maximum Likelihood Constraint Inference on Continuous State Spaces 连续状态空间的极大似然约束推理
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9811705
Kaylene C. Stocking, D. McPherson, R. Matthew, C. Tomlin
When a robot observes another agent unexpectedly modifying their behavior, inferring the most likely cause is a valuable tool for maintaining safety and reacting appropriately. In this work, we present a novel method for inferring constraints that works on continuous, possibly sub-optimal demonstrations. We first learn a representation of the continuous-state maximum entropy trajectory distribution using deep reinforcement learning. We then use Monte Carlo sampling from this distribution to generate expected constraint violation probabilities and perform constraint inference. When the demonstrator's dynamics and objective function are known in advance, this process can be performed offline, allowing for real-time constraint inference at the moment demonstrations are observed. We evaluate our approach on two continuous dynamical systems: a 2-dimensional inverted pendulum model, and a 4-dimensional unicycle model that was successfully used for fast constraint inference on a 1/10 scale car remote-controlled by a human.
当一个机器人观察到另一个代理意外地改变他们的行为时,推断最可能的原因是维护安全和适当反应的有价值的工具。在这项工作中,我们提出了一种推断约束的新方法,该方法适用于连续的,可能是次优的演示。我们首先使用深度强化学习学习连续状态最大熵轨迹分布的表示。然后,我们使用蒙特卡罗采样从该分布生成期望的约束违反概率和执行约束推理。当演示者的动力学和目标函数事先已知时,该过程可以离线执行,允许在观察演示时进行实时约束推理。我们在两个连续动力系统上对我们的方法进行了评估:一个是二维倒立摆模型,一个是四维独轮车模型,该模型成功地用于人类遥控的1/10比例汽车的快速约束推理。
{"title":"Maximum Likelihood Constraint Inference on Continuous State Spaces","authors":"Kaylene C. Stocking, D. McPherson, R. Matthew, C. Tomlin","doi":"10.1109/icra46639.2022.9811705","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9811705","url":null,"abstract":"When a robot observes another agent unexpectedly modifying their behavior, inferring the most likely cause is a valuable tool for maintaining safety and reacting appropriately. In this work, we present a novel method for inferring constraints that works on continuous, possibly sub-optimal demonstrations. We first learn a representation of the continuous-state maximum entropy trajectory distribution using deep reinforcement learning. We then use Monte Carlo sampling from this distribution to generate expected constraint violation probabilities and perform constraint inference. When the demonstrator's dynamics and objective function are known in advance, this process can be performed offline, allowing for real-time constraint inference at the moment demonstrations are observed. We evaluate our approach on two continuous dynamical systems: a 2-dimensional inverted pendulum model, and a 4-dimensional unicycle model that was successfully used for fast constraint inference on a 1/10 scale car remote-controlled by a human.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"75 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117190327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
On-chip Continuous Pairing, Separation and Electrofusion of Cells Using a Microdroplet 微滴细胞的片上连续配对、分离和电融合
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9812390
Naotomo Tottori, Sora Sadamichi, S. Sakuma, Tomomi Tsubouchi, Y. Yamanishi
Cell fusion has been widely applied in scientific research for cancer immunotherapy, antibody production, and nuclear reprogramming of somatic cells, and therefore the cell fusion technique that enable us to precisely control the fusion process with high throughput manner has been desired. Here, we present a novel microfluidic method for automatic cell pairing by microdroplets, separation of droplets containing cells, and electrofusion of cells inside a droplet. The proposed microfluidic device mainly composed of three sequential function parts for (i) encapsulation of cells into a droplet by microfluidic droplet generator, (ii) separation of droplets containing cells from empty droplets through a micropillar array, and (iii) electrofusion of cells inside the droplets by applying a voltage during the droplet passing over the pair of electrodes. In the microfluidic device, cell-encapsulated and empty droplets were generated at the upstream cross-junction; they then entered the micropillar array, separating the cell-encapsulated droplets from empty droplets continuously. After separation, they passed over the electrode pairs, and were collected the outside of the microchannel. This continuous process for cell fusion would enable us to observe and isolate the target fused cells for cell analysis.
细胞融合已广泛应用于癌症免疫治疗、抗体生产和体细胞核重编程等科学研究中,因此需要一种能够高通量精确控制融合过程的细胞融合技术。在这里,我们提出了一种新的微流体方法,用于通过微滴自动细胞配对,分离含有细胞的微滴,以及在微滴内电融合细胞。所提出的微流控装置主要由三个连续的功能部分组成:(i)通过微流控液滴发生器将细胞封装成液滴,(ii)通过微柱阵列将含有细胞的液滴与空液滴分离,以及(iii)在液滴通过对电极时施加电压将液滴内的细胞电熔。在微流控装置中,在上游交叉处产生细胞包封的空液滴;然后他们进入微柱阵列,连续分离细胞包裹的液滴和空液滴。分离后,它们通过电极对,并收集在微通道的外部。这种连续的细胞融合过程将使我们能够观察和分离目标融合细胞进行细胞分析。
{"title":"On-chip Continuous Pairing, Separation and Electrofusion of Cells Using a Microdroplet","authors":"Naotomo Tottori, Sora Sadamichi, S. Sakuma, Tomomi Tsubouchi, Y. Yamanishi","doi":"10.1109/icra46639.2022.9812390","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9812390","url":null,"abstract":"Cell fusion has been widely applied in scientific research for cancer immunotherapy, antibody production, and nuclear reprogramming of somatic cells, and therefore the cell fusion technique that enable us to precisely control the fusion process with high throughput manner has been desired. Here, we present a novel microfluidic method for automatic cell pairing by microdroplets, separation of droplets containing cells, and electrofusion of cells inside a droplet. The proposed microfluidic device mainly composed of three sequential function parts for (i) encapsulation of cells into a droplet by microfluidic droplet generator, (ii) separation of droplets containing cells from empty droplets through a micropillar array, and (iii) electrofusion of cells inside the droplets by applying a voltage during the droplet passing over the pair of electrodes. In the microfluidic device, cell-encapsulated and empty droplets were generated at the upstream cross-junction; they then entered the micropillar array, separating the cell-encapsulated droplets from empty droplets continuously. After separation, they passed over the electrode pairs, and were collected the outside of the microchannel. This continuous process for cell fusion would enable us to observe and isolate the target fused cells for cell analysis.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125794180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Opto-electrotactile Feedback Enabled Text-line Tracking Control for A Finger-wearable Reading Aid for the Blind 一种盲人手指可穿戴阅读辅助设备的光电触觉反馈文本线跟踪控制
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9811610
M. Rahimi, Yantao Shen, Cong Peng, Zhiming Liu, Fang Jiang
In this paper, to achieve the goal of aiding the blind and visually impaired (BVI) to read any text not written in Braille, a custom-built, finger-wearable, and electro-tactile based Braille reading system with its Rapid Optical Character Recognition (R-OCR) method is developed. The R-OCR is capable of processing text information in real time using a miniature fish-eye imaging device mounted at the finger-wearable system. This allows real-time translation of printed text to electro-Braille along with natural movement of user's fingertip as if reading any Braille sign or book. An electro-tactile neuro-stimulation feedback mechanism is further proposed and incorporated with the reading system, which facilitates a new opto-electrotactile-feedback-based text line tracking control approach that enables text line following by user's fingertip during reading. Extensive experiments were designed and conducted to test the ability of blindfolded participants to read through and follow the printed text lines based on this optoelectrotactile-feedback method. The experimental results show that as the outcome of the opto-electrotactile-feedback, the users who involved in the feedback loop were able to maintain their fingertips within a $2mm$ distance of the text while “reading” through a printed text line. Our work is a significant step to aid the BVI users with a portable means to read any printed texts to Braille through the following and the translation, whether in the digital realm or physically, on any surface.
为了帮助盲人和视障人士阅读任何非盲文文本,本文开发了一种定制的、手指可穿戴的、基于电触觉的盲文阅读系统,该系统具有快速光学字符识别(R-OCR)方法。R-OCR能够使用安装在手指可穿戴系统上的微型鱼眼成像设备实时处理文本信息。这允许实时翻译印刷文本到电子盲文随着用户的指尖自然运动,如果阅读任何盲文标志或书籍。进一步提出了一种电触觉神经刺激反馈机制,并将其与阅读系统相结合,实现了一种新的基于光电触觉反馈的文本行跟踪控制方法,使用户的指尖在阅读过程中跟踪文本行。基于这种光电触觉反馈方法,设计并进行了大量的实验来测试蒙上眼睛的参与者阅读和跟随打印文本行的能力。实验结果表明,作为光电触觉反馈的结果,参与反馈回路的用户能够在通过打印文本行“阅读”时将指尖保持在距离文本2毫米的范围内。我们的工作是重要的一步,帮助英属维尔京群岛用户通过以下和翻译的便携式手段来阅读任何印刷文本盲文,无论是在数字领域还是物理领域,在任何表面上。
{"title":"Opto-electrotactile Feedback Enabled Text-line Tracking Control for A Finger-wearable Reading Aid for the Blind","authors":"M. Rahimi, Yantao Shen, Cong Peng, Zhiming Liu, Fang Jiang","doi":"10.1109/icra46639.2022.9811610","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9811610","url":null,"abstract":"In this paper, to achieve the goal of aiding the blind and visually impaired (BVI) to read any text not written in Braille, a custom-built, finger-wearable, and electro-tactile based Braille reading system with its Rapid Optical Character Recognition (R-OCR) method is developed. The R-OCR is capable of processing text information in real time using a miniature fish-eye imaging device mounted at the finger-wearable system. This allows real-time translation of printed text to electro-Braille along with natural movement of user's fingertip as if reading any Braille sign or book. An electro-tactile neuro-stimulation feedback mechanism is further proposed and incorporated with the reading system, which facilitates a new opto-electrotactile-feedback-based text line tracking control approach that enables text line following by user's fingertip during reading. Extensive experiments were designed and conducted to test the ability of blindfolded participants to read through and follow the printed text lines based on this optoelectrotactile-feedback method. The experimental results show that as the outcome of the opto-electrotactile-feedback, the users who involved in the feedback loop were able to maintain their fingertips within a $2mm$ distance of the text while “reading” through a printed text line. Our work is a significant step to aid the BVI users with a portable means to read any printed texts to Braille through the following and the translation, whether in the digital realm or physically, on any surface.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126156345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Single User WiFi Structure from Motion in the Wild 单用户WiFi结构从运动在野外
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9812340
Yiming Qian, Hang Yan, Sachini Herath, Pyojin Kim, Yasutaka Furukawa
This paper proposes a novel motion estimation algorithm using WiFi networks and IMU sensor data in large uncontrolled environments, dubbed “WiFi Structure-from-Motion” (WiFi SfM). Given smartphone sensor data through day-to-day activities from a single user over a month, our WiFi SfM algorithm estimates smartphone motion tra-jectories and the structure of the environment represented as a WiFi radio map. The approach 1) establishes frame-to-frame correspondences based on WiFi fingerprints while exploiting our repetitive behavior patterns; 2) aligns trajectories via bundle adjustment; and 3) trains a self-supervised neural network to extract further motion constraints. We have col-lected 235 hours of smartphone data, spanning 38 days of daily activities in a university campus. Our experiments demonstrate the effectiveness of our approach over the competing methods with qualitative evaluations of the estimated motions and quantitative evaluations of indoor localization accuracy based on the reconstructed WiFi radio map. The WiFi SfM technology will potentially allow digital mapping companies to build better radio maps automatically by asking users to share WiFi/IMU sensor data in their daily activities.
本文提出了一种利用WiFi网络和IMU传感器数据在大型非受控环境下进行运动估计的新算法,称为“WiFi结构-来自运动”(WiFi SfM)。给定单个用户在一个月内的日常活动的智能手机传感器数据,我们的WiFi SfM算法估计智能手机的运动轨迹和以WiFi无线地图表示的环境结构。该方法1)利用我们的重复行为模式,建立基于WiFi指纹的帧对帧对应关系;2)通过束调整调整轨迹;3)训练自监督神经网络提取进一步的运动约束。我们收集了235小时的智能手机数据,涵盖了大学校园38天的日常活动。我们的实验证明了我们的方法与基于重建WiFi无线地图的估计运动的定性评估和室内定位精度的定量评估的竞争方法相比的有效性。WiFi SfM技术将允许数字地图公司通过要求用户在日常活动中共享WiFi/IMU传感器数据来自动构建更好的无线地图。
{"title":"Single User WiFi Structure from Motion in the Wild","authors":"Yiming Qian, Hang Yan, Sachini Herath, Pyojin Kim, Yasutaka Furukawa","doi":"10.1109/icra46639.2022.9812340","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9812340","url":null,"abstract":"This paper proposes a novel motion estimation algorithm using WiFi networks and IMU sensor data in large uncontrolled environments, dubbed “WiFi Structure-from-Motion” (WiFi SfM). Given smartphone sensor data through day-to-day activities from a single user over a month, our WiFi SfM algorithm estimates smartphone motion tra-jectories and the structure of the environment represented as a WiFi radio map. The approach 1) establishes frame-to-frame correspondences based on WiFi fingerprints while exploiting our repetitive behavior patterns; 2) aligns trajectories via bundle adjustment; and 3) trains a self-supervised neural network to extract further motion constraints. We have col-lected 235 hours of smartphone data, spanning 38 days of daily activities in a university campus. Our experiments demonstrate the effectiveness of our approach over the competing methods with qualitative evaluations of the estimated motions and quantitative evaluations of indoor localization accuracy based on the reconstructed WiFi radio map. The WiFi SfM technology will potentially allow digital mapping companies to build better radio maps automatically by asking users to share WiFi/IMU sensor data in their daily activities.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128755758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Secure Multi-Robot Information Sampling with Periodic and Opportunistic Connectivity 具有周期性和机会性连接的安全多机器人信息采样
Pub Date : 2022-05-23 DOI: 10.1109/icra46639.2022.9812211
Tamim Samman, Ayan Dutta, O. P. Kreidl, Swapnoneel Roy, Ladislau Bölöni
Multi-robot teams are becoming an increasingly popular approach for information gathering in large geographic areas, with applications in precision agriculture, surveying the aftermath of natural disasters or tracking pollution. These robot teams are often assembled from untrusted devices not owned by the user, making the maintenance of the integrity of the collected samples an important challenge. Furthermore, such robots often operate under conditions of opportunistic, or periodic connectivity and are limited in their energy budget and computational power. In this paper, we propose algorithms that build on blockchain technology to address the data integrity problem, but also take into account the limitations of the robots' resources and communication. We evaluate the proposed algorithms along the perspective of the tradeoffs between data integrity, model accuracy, and time consumption.
多机器人团队正在成为在大地理区域收集信息的一种日益流行的方法,应用于精准农业、调查自然灾害的后果或跟踪污染。这些机器人团队通常由不受用户信任的设备组装而成,这使得维护所收集样本的完整性成为一项重要挑战。此外,此类机器人通常在机会性或周期性连接的条件下运行,并且在能量预算和计算能力方面受到限制。在本文中,我们提出了基于区块链技术的算法来解决数据完整性问题,但也考虑到机器人资源和通信的局限性。我们从数据完整性、模型准确性和时间消耗之间的权衡的角度来评估所提出的算法。
{"title":"Secure Multi-Robot Information Sampling with Periodic and Opportunistic Connectivity","authors":"Tamim Samman, Ayan Dutta, O. P. Kreidl, Swapnoneel Roy, Ladislau Bölöni","doi":"10.1109/icra46639.2022.9812211","DOIUrl":"https://doi.org/10.1109/icra46639.2022.9812211","url":null,"abstract":"Multi-robot teams are becoming an increasingly popular approach for information gathering in large geographic areas, with applications in precision agriculture, surveying the aftermath of natural disasters or tracking pollution. These robot teams are often assembled from untrusted devices not owned by the user, making the maintenance of the integrity of the collected samples an important challenge. Furthermore, such robots often operate under conditions of opportunistic, or periodic connectivity and are limited in their energy budget and computational power. In this paper, we propose algorithms that build on blockchain technology to address the data integrity problem, but also take into account the limitations of the robots' resources and communication. We evaluate the proposed algorithms along the perspective of the tradeoffs between data integrity, model accuracy, and time consumption.","PeriodicalId":341244,"journal":{"name":"2022 International Conference on Robotics and Automation (ICRA)","volume":"214 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128169529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
2022 International Conference on Robotics and Automation (ICRA)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1