A Real-Time and Lightweight Monocular 3-D Object Detector on CPU-Based Edge Devices for UGV's Indoor SLAM Systems

IF 7.3 1区 工程技术 Q1 AUTOMATION & CONTROL SYSTEMS IEEE/ASME Transactions on Mechatronics Pub Date : 2024-11-15 DOI:10.1109/TMECH.2024.3484431
Bowen Chen;Yan Zhuang;Sen Wang
{"title":"A Real-Time and Lightweight Monocular 3-D Object Detector on CPU-Based Edge Devices for UGV's Indoor SLAM Systems","authors":"Bowen Chen;Yan Zhuang;Sen Wang","doi":"10.1109/TMECH.2024.3484431","DOIUrl":null,"url":null,"abstract":"In this article, we introduce RLMono3d, a real-time monocular 3-D object detector designed to run efficiently on edge devices with just one CPU. This approach is specifically applied to the indoor simultaneous localization and mapping (SLAM) system on the unmanned ground vehicle (UGV) platform. The spatial projection model for 3-D cuboids is proposed using projective geometry to determine the topological relationship between the cuboid projection and the bounding box (Bbox). Utilizing the theory above, we propose a real-time lightweight monocular 3-D object detector that is designed to be efficient and lightweight by using 2-D object and line segment detectors to generate 3-D object Bboxes. Furthermore, this approach is integrated into the SLAM system to create a complete semantic SLAM system, which is a typical application of our approach. Experimental results on multiple indoor benchmarking datasets show that the proposed monocular 3-D object detection algorithm outperforms benchmark methods. To validate our approach on the UGVs, we also conducted experiments using the quadruped robot platform. The results demonstrate that our approach can operate on edge devices of UGV platforms and accurately detect 3-D objects in real time.","PeriodicalId":13372,"journal":{"name":"IEEE/ASME Transactions on Mechatronics","volume":"30 5","pages":"3792-3802"},"PeriodicalIF":7.3000,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE/ASME Transactions on Mechatronics","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10754906/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In this article, we introduce RLMono3d, a real-time monocular 3-D object detector designed to run efficiently on edge devices with just one CPU. This approach is specifically applied to the indoor simultaneous localization and mapping (SLAM) system on the unmanned ground vehicle (UGV) platform. The spatial projection model for 3-D cuboids is proposed using projective geometry to determine the topological relationship between the cuboid projection and the bounding box (Bbox). Utilizing the theory above, we propose a real-time lightweight monocular 3-D object detector that is designed to be efficient and lightweight by using 2-D object and line segment detectors to generate 3-D object Bboxes. Furthermore, this approach is integrated into the SLAM system to create a complete semantic SLAM system, which is a typical application of our approach. Experimental results on multiple indoor benchmarking datasets show that the proposed monocular 3-D object detection algorithm outperforms benchmark methods. To validate our approach on the UGVs, we also conducted experiments using the quadruped robot platform. The results demonstrate that our approach can operate on edge devices of UGV platforms and accurately detect 3-D objects in real time.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于 UGV 室内 SLAM 系统的基于 CPU 边缘设备的实时轻量级单目三维物体检测器
在本文中,我们介绍了RLMono3d,一种实时单目3d目标检测器,设计用于仅使用一个CPU在边缘设备上高效运行。该方法具体应用于无人地面车辆(UGV)平台上的室内同步定位与测绘(SLAM)系统。利用射影几何方法建立了三维长方体的空间投影模型,确定了长方体投影与边界框(Bbox)之间的拓扑关系。利用上述理论,我们提出了一种实时轻量级单目三维物体检测器,该检测器通过使用二维物体和线段检测器来生成三维物体bbox,从而实现了高效轻量级的设计。此外,将该方法集成到SLAM系统中,形成完整的语义SLAM系统,这是我们方法的典型应用。在多个室内基准数据集上的实验结果表明,本文提出的单目三维目标检测算法优于基准方法。为了在ugv上验证我们的方法,我们还使用四足机器人平台进行了实验。结果表明,该方法可以在UGV平台的边缘设备上运行,并能实时准确地检测出三维物体。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE/ASME Transactions on Mechatronics
IEEE/ASME Transactions on Mechatronics 工程技术-工程:电子与电气
CiteScore
11.60
自引率
18.80%
发文量
527
审稿时长
7.8 months
期刊介绍: IEEE/ASME Transactions on Mechatronics publishes high quality technical papers on technological advances in mechatronics. A primary purpose of the IEEE/ASME Transactions on Mechatronics is to have an archival publication which encompasses both theory and practice. Papers published in the IEEE/ASME Transactions on Mechatronics disclose significant new knowledge needed to implement intelligent mechatronics systems, from analysis and design through simulation and hardware and software implementation. The Transactions also contains a letters section dedicated to rapid publication of short correspondence items concerning new research results.
期刊最新文献
Pump Flow Compensation and Variable-Gain Sliding Mode Control for Mitigating Temperature-Induced Degradation in Servo Pump-Controlled Systems Contrastive Feature Reasoning for EEG Classification in Asynchronous BCI-Controlled Humanoid Robot Integrated Stereo Vision and Compliance Control With an Underwater Manipulator for Hydraulic Structure Inspection and Maintenance IEEE/ASME Transactions on Mechatronics Publication Information Completely Split-KalmanNet: A Novel Hybrid Model-Based and Data-Driven Method for GNSS/IMU Integration
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1