基于视觉深度学习的塑料垃圾处理机器人设计

Le Tien Thanh, Le Hoang Lam, Thanh Nha Nguyen, D. Tran
{"title":"基于视觉深度学习的塑料垃圾处理机器人设计","authors":"Le Tien Thanh, Le Hoang Lam, Thanh Nha Nguyen, D. Tran","doi":"10.1109/ICSSE58758.2023.10227251","DOIUrl":null,"url":null,"abstract":"To address the issue of plastic waste, a robot using deep learning technology for visual recognition to classify plastic waste has been developed. This system includes a 3DOF robot arm, a conveyor, a camera, an electrical cabinet, and a computer. The object detection component of the system is designed using transfer learning with a pre-trained YOLOv5 model to ensure the system operates in real time. Selecting the best model by evaluating and comparing the results of models trained using labeling by bounding box and polygon methods. Then, the real-world coordinates for the origin of the robot arm are determined by utilizing matrices obtained from MATLAB through chessboard images. The computer processes the data and transmits commands to the robot arm system and conveyor, which is controlled by a PLC and 3 different Servo Drivers, for object sorting on the conveyor. The best-performing model has a Precision of 92.1% and a Recall of 87.3%, and the success rate of picking up an object is 91.5%. While the experimental results indicate complete stability in inter-device connectivity, implementing it would necessitate hardware improvements to leverage its potential.","PeriodicalId":280745,"journal":{"name":"2023 International Conference on System Science and Engineering (ICSSE)","volume":"70 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Designing of A Plastic Garbage Robot With Vision-Based Deep Learning Applications\",\"authors\":\"Le Tien Thanh, Le Hoang Lam, Thanh Nha Nguyen, D. Tran\",\"doi\":\"10.1109/ICSSE58758.2023.10227251\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"To address the issue of plastic waste, a robot using deep learning technology for visual recognition to classify plastic waste has been developed. This system includes a 3DOF robot arm, a conveyor, a camera, an electrical cabinet, and a computer. The object detection component of the system is designed using transfer learning with a pre-trained YOLOv5 model to ensure the system operates in real time. Selecting the best model by evaluating and comparing the results of models trained using labeling by bounding box and polygon methods. Then, the real-world coordinates for the origin of the robot arm are determined by utilizing matrices obtained from MATLAB through chessboard images. The computer processes the data and transmits commands to the robot arm system and conveyor, which is controlled by a PLC and 3 different Servo Drivers, for object sorting on the conveyor. The best-performing model has a Precision of 92.1% and a Recall of 87.3%, and the success rate of picking up an object is 91.5%. While the experimental results indicate complete stability in inter-device connectivity, implementing it would necessitate hardware improvements to leverage its potential.\",\"PeriodicalId\":280745,\"journal\":{\"name\":\"2023 International Conference on System Science and Engineering (ICSSE)\",\"volume\":\"70 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on System Science and Engineering (ICSSE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSSE58758.2023.10227251\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on System Science and Engineering (ICSSE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSSE58758.2023.10227251","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了解决塑料垃圾问题,开发了一种利用深度学习视觉识别技术对塑料垃圾进行分类的机器人。该系统包括一个三维机械臂、一个传送带、一个摄像机、一个电控箱和一台计算机。系统的目标检测组件采用迁移学习和预训练的YOLOv5模型进行设计,以确保系统的实时性。通过对边界框法和多边形法标记训练的模型结果进行评价和比较,选择最佳模型。然后,通过棋盘图像,利用MATLAB得到的矩阵,确定机器人手臂的真实原点坐标。计算机对数据进行处理,并将命令发送到由PLC和3个不同的伺服驱动器控制的机械臂系统和输送机,以便在输送机上对物体进行分类。表现最好的模型Precision为92.1%,Recall为87.3%,拾取物体的成功率为91.5%。虽然实验结果表明设备间连接完全稳定,但实现它将需要硬件改进以利用其潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Designing of A Plastic Garbage Robot With Vision-Based Deep Learning Applications
To address the issue of plastic waste, a robot using deep learning technology for visual recognition to classify plastic waste has been developed. This system includes a 3DOF robot arm, a conveyor, a camera, an electrical cabinet, and a computer. The object detection component of the system is designed using transfer learning with a pre-trained YOLOv5 model to ensure the system operates in real time. Selecting the best model by evaluating and comparing the results of models trained using labeling by bounding box and polygon methods. Then, the real-world coordinates for the origin of the robot arm are determined by utilizing matrices obtained from MATLAB through chessboard images. The computer processes the data and transmits commands to the robot arm system and conveyor, which is controlled by a PLC and 3 different Servo Drivers, for object sorting on the conveyor. The best-performing model has a Precision of 92.1% and a Recall of 87.3%, and the success rate of picking up an object is 91.5%. While the experimental results indicate complete stability in inter-device connectivity, implementing it would necessitate hardware improvements to leverage its potential.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Deep Q-Network (DQN) Approach for Automatic Vehicles Applied in the Intelligent Transportation System (ITS) Improvement in Proportional Energy Sharing and DC Bus Voltage Restoring for DC Microgrid in the Islanded Operation Mode A New Buck-Boost Converter Structure With Improved Efficiency Performance of Energy Harvesting Aided Multi-hop Mobile Relay Networks With and Without Using Cooperative Communication A New Novel of Prescribed Optimal Control and Its Application for Smart Damping System
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1