Exploiting Motion Prior for Accurate Pose Estimation of Dashboard Cameras

IF 5.3 2区 计算机科学 Q2 ROBOTICS IEEE Robotics and Automation Letters Pub Date : 2024-12-04 DOI:10.1109/LRA.2024.3511381
Yipeng Lu;Yifan Zhao;Haiping Wang;Zhiwei Ruan;Yuan Liu;Zhen Dong;Bisheng Yang
{"title":"Exploiting Motion Prior for Accurate Pose Estimation of Dashboard Cameras","authors":"Yipeng Lu;Yifan Zhao;Haiping Wang;Zhiwei Ruan;Yuan Liu;Zhen Dong;Bisheng Yang","doi":"10.1109/LRA.2024.3511381","DOIUrl":null,"url":null,"abstract":"Dashboard cameras (dashcams) record millions of driving videos daily, offering a valuable potential data source for various applications, including driving map production and updates. A necessary step for utilizing these dashcam data involves the estimation of camera poses. However, the low-quality images captured by dashcams, characterized by motion blurs and dynamic objects, pose challenges for existing image-matching methods in accurately estimating camera poses. In this study, we propose a precise pose estimation method for dashcam images, leveraging the inherent camera motion prior. Typically, image sequences captured by dash cameras exhibit pronounced motion prior, such as forward movement or lateral turns, which serve as essential cues for correspondence estimation. Building upon this observation, we devise a pose regression module aimed at learning camera motion prior, subsequently integrating these prior into both correspondences and pose estimation processes. The experiment shows that, in real dashcams dataset, our method is 22% better than the baseline for pose estimation in AUC5°, and it can estimate poses for 19% more images with less reprojection error in Structure from Motion (SfM).","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 1","pages":"764-771"},"PeriodicalIF":5.3000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10777512/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Dashboard cameras (dashcams) record millions of driving videos daily, offering a valuable potential data source for various applications, including driving map production and updates. A necessary step for utilizing these dashcam data involves the estimation of camera poses. However, the low-quality images captured by dashcams, characterized by motion blurs and dynamic objects, pose challenges for existing image-matching methods in accurately estimating camera poses. In this study, we propose a precise pose estimation method for dashcam images, leveraging the inherent camera motion prior. Typically, image sequences captured by dash cameras exhibit pronounced motion prior, such as forward movement or lateral turns, which serve as essential cues for correspondence estimation. Building upon this observation, we devise a pose regression module aimed at learning camera motion prior, subsequently integrating these prior into both correspondences and pose estimation processes. The experiment shows that, in real dashcams dataset, our method is 22% better than the baseline for pose estimation in AUC5°, and it can estimate poses for 19% more images with less reprojection error in Structure from Motion (SfM).
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用运动先验来准确估计仪表盘摄像头的姿态
仪表盘摄像头(dashcams)每天记录数百万个驾驶视频,为各种应用提供了有价值的潜在数据源,包括驾驶地图的制作和更新。利用这些行车记录仪数据的一个必要步骤包括对相机姿势的估计。然而,行车记录仪捕获的低质量图像具有运动模糊和动态物体的特征,这给现有的图像匹配方法在准确估计相机姿态方面带来了挑战。在这项研究中,我们提出了一种精确的姿态估计方法,利用固有的相机运动先验。通常,由行车记录仪捕获的图像序列会显示出明显的运动,例如向前移动或横向转弯,这是通信估计的基本线索。基于这种观察,我们设计了一个姿态回归模块,旨在学习相机运动先验,随后将这些先验整合到对应和姿态估计过程中。实验表明,在真实的dashcams数据集中,我们的方法在AUC5°下的姿态估计比基线高22%,在SfM (Structure from Motion)中,它可以在更小的重投影误差下多估计19%的图像的姿态。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Robotics and Automation Letters
IEEE Robotics and Automation Letters Computer Science-Computer Science Applications
CiteScore
9.60
自引率
15.40%
发文量
1428
期刊介绍: The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.
期刊最新文献
A Multimodal Selective Fusion Approach for Robotic Grasp Detection Design and Control of a Parallel Elastic Actuator With Adjustable Equilibrium Position LED Pouch Motor: Wavelength Selective Wireless Actuation of Dyed Liquid-to-Gas Phase Change Actuators Using LEDs Direct Sparse Initialization for Stereo Visual-Inertial Odometry Adaptive Collision Detection via Impulse–Momentum Theorem for Safe Sensorless Physical Human-Robot Interaction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1