J. Yang, Ui-Kai Chen, Kai-Chu Chang, Ying-Jen Chen
{"title":"A Novel Robotic Grasp Detection Technique by Integrating YOLO and Grasp Detection Deep Neural Networks *","authors":"J. Yang, Ui-Kai Chen, Kai-Chu Chang, Ying-Jen Chen","doi":"10.1109/ARIS50834.2020.9205791","DOIUrl":null,"url":null,"abstract":"This paper proposes a robotic grasp detection technique by integrating you only look once (YOLO) deep neural network (DNN) and a grasp detection DNN. In this world, there are many people who cannot move their own bodies. The reason may be an accident or physical deterioration. So we need to invest more human resources to assist their lives. With new technological advances, robots are gradually able to perfectly replicate human movements. Hence, we intend to design a remote-control fetching robot. The system combines internet of things (IoT) technology, and users can use intelligent devices to control this robot with robotic arm to get the items they want. This paper focus on detecting the grasp of robotic arm by integrating YOLO and grasp detection DNNs. At first, YOLO V-v3 is applied to achieve object detection. Then a robotic grasp detection DNN is proposed to detect the robotic grasp. After that, the point cloud information of this object is utilized to calculate the normal vector of the grasp position such that the robotic arm can fetch the target along the normal vector. Finally, experiment results are given to show the practicality of the proposed robotic grasp detection Technique.","PeriodicalId":423389,"journal":{"name":"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)","volume":"6 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference on Advanced Robotics and Intelligent Systems (ARIS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ARIS50834.2020.9205791","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
This paper proposes a robotic grasp detection technique by integrating you only look once (YOLO) deep neural network (DNN) and a grasp detection DNN. In this world, there are many people who cannot move their own bodies. The reason may be an accident or physical deterioration. So we need to invest more human resources to assist their lives. With new technological advances, robots are gradually able to perfectly replicate human movements. Hence, we intend to design a remote-control fetching robot. The system combines internet of things (IoT) technology, and users can use intelligent devices to control this robot with robotic arm to get the items they want. This paper focus on detecting the grasp of robotic arm by integrating YOLO and grasp detection DNNs. At first, YOLO V-v3 is applied to achieve object detection. Then a robotic grasp detection DNN is proposed to detect the robotic grasp. After that, the point cloud information of this object is utilized to calculate the normal vector of the grasp position such that the robotic arm can fetch the target along the normal vector. Finally, experiment results are given to show the practicality of the proposed robotic grasp detection Technique.
本文提出了一种将you only look once (YOLO)深度神经网络(DNN)与抓取检测深度神经网络相结合的机器人抓取检测技术。在这个世界上,有很多人无法移动自己的身体。原因可能是意外事故或身体恶化。所以我们需要投入更多的人力资源来帮助他们的生活。随着新技术的进步,机器人逐渐能够完美地复制人类的动作。因此,我们打算设计一个遥控抓取机器人。该系统结合了物联网(IoT)技术,用户可以使用智能设备控制机器人的机械臂,以获得他们想要的物品。本文将YOLO和抓取检测dnn相结合,对机械臂抓取进行检测。首先使用YOLO V-v3实现目标检测。然后提出了一种机器人抓取检测深度神经网络来检测机器人抓取。然后利用该目标的点云信息计算抓取位置的法向量,使机械臂沿着法向量获取目标。最后给出了实验结果,验证了所提机器人抓取检测技术的实用性。