Robotic Grasping in Simulation Using Deep Reinforcement Learning

Musab Coskun, Ozal Yildirim, Y. Demir
{"title":"Robotic Grasping in Simulation Using Deep Reinforcement Learning","authors":"Musab Coskun, Ozal Yildirim, Y. Demir","doi":"10.1109/UBMK55850.2022.9919482","DOIUrl":null,"url":null,"abstract":"In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.","PeriodicalId":417604,"journal":{"name":"2022 7th International Conference on Computer Science and Engineering (UBMK)","volume":"9 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 7th International Conference on Computer Science and Engineering (UBMK)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/UBMK55850.2022.9919482","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In robotics, manipulators are recently becoming one of the prominent fields of interest for different types of applications. One of the usual functionalities performed by manipulators is grasping. Grasping means simply holding an object. In order to perform a grasping task, each manipulator needs a gripper mounted at the end effector of them. In this paper, a method based on deep reinforcement learning is presented to deal with the issue of robotic grasping employing only vision feedback. The combination of deep learning with dueling architecture, a variant of Q-learning, brings the complexity caused by the use of handcrafted features to a humbler state. Our method employs the Dueling Deep Q-learning Network(DDQN) to learn the grasping policy. Our proposed system employs a visual structure that uses a Kinect camera setup that spots the scene that possesses the object of interest. We realized our experiments by utilizing Webots simulator environment. The results show that our proposed dueling architecture enables our Reinforcement Learning(RL) agent to perform well enough to fulfill the grasping task.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度强化学习的机器人抓取仿真
在机器人技术中,操纵器最近成为不同类型应用的突出领域之一。机械手通常执行的功能之一是抓取。抓取意味着简单地握住一个物体。为了执行抓取任务,每个机械手都需要在其末端执行器上安装一个夹持器。本文提出了一种基于深度强化学习的方法来解决仅使用视觉反馈的机器人抓取问题。深度学习与决斗架构(Q-learning的一种变体)的结合,将使用手工特征所带来的复杂性降至较低的状态。我们的方法采用Dueling深度Q-learning Network(DDQN)来学习抓取策略。我们提出的系统采用了一种视觉结构,使用Kinect摄像头设置来发现拥有感兴趣对象的场景。我们利用Webots模拟器环境来实现我们的实验。结果表明,我们提出的决斗架构使我们的强化学习(RL)智能体能够很好地完成抓取任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Study on Power and Energy Measurement of NVIDIA Jetson Embedded GPUs Using Built-in Sensor Forecasting the Short-Term Electricity In Steel Manufacturing For Purchase Accuracy on Day-Ahead Market Adaptive Slot-Filling for Turkish Natural Language Understanding Design and Implementation of Basic Log Structured File System for Internal Flash on Embedded Systems Toolset of “Turkic Morpheme” Portal for Creation of Electronic Corpora of Turkic Languages in a Unified Conceptual Space
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1