Yipeng Lu;Yifan Zhao;Haiping Wang;Zhiwei Ruan;Yuan Liu;Zhen Dong;Bisheng Yang
{"title":"Exploiting Motion Prior for Accurate Pose Estimation of Dashboard Cameras","authors":"Yipeng Lu;Yifan Zhao;Haiping Wang;Zhiwei Ruan;Yuan Liu;Zhen Dong;Bisheng Yang","doi":"10.1109/LRA.2024.3511381","DOIUrl":null,"url":null,"abstract":"Dashboard cameras (dashcams) record millions of driving videos daily, offering a valuable potential data source for various applications, including driving map production and updates. A necessary step for utilizing these dashcam data involves the estimation of camera poses. However, the low-quality images captured by dashcams, characterized by motion blurs and dynamic objects, pose challenges for existing image-matching methods in accurately estimating camera poses. In this study, we propose a precise pose estimation method for dashcam images, leveraging the inherent camera motion prior. Typically, image sequences captured by dash cameras exhibit pronounced motion prior, such as forward movement or lateral turns, which serve as essential cues for correspondence estimation. Building upon this observation, we devise a pose regression module aimed at learning camera motion prior, subsequently integrating these prior into both correspondences and pose estimation processes. The experiment shows that, in real dashcams dataset, our method is 22% better than the baseline for pose estimation in AUC5°, and it can estimate poses for 19% more images with less reprojection error in Structure from Motion (SfM).","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 1","pages":"764-771"},"PeriodicalIF":5.3000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Robotics and Automation Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10777512/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Dashboard cameras (dashcams) record millions of driving videos daily, offering a valuable potential data source for various applications, including driving map production and updates. A necessary step for utilizing these dashcam data involves the estimation of camera poses. However, the low-quality images captured by dashcams, characterized by motion blurs and dynamic objects, pose challenges for existing image-matching methods in accurately estimating camera poses. In this study, we propose a precise pose estimation method for dashcam images, leveraging the inherent camera motion prior. Typically, image sequences captured by dash cameras exhibit pronounced motion prior, such as forward movement or lateral turns, which serve as essential cues for correspondence estimation. Building upon this observation, we devise a pose regression module aimed at learning camera motion prior, subsequently integrating these prior into both correspondences and pose estimation processes. The experiment shows that, in real dashcams dataset, our method is 22% better than the baseline for pose estimation in AUC5°, and it can estimate poses for 19% more images with less reprojection error in Structure from Motion (SfM).
仪表盘摄像头(dashcams)每天记录数百万个驾驶视频,为各种应用提供了有价值的潜在数据源,包括驾驶地图的制作和更新。利用这些行车记录仪数据的一个必要步骤包括对相机姿势的估计。然而,行车记录仪捕获的低质量图像具有运动模糊和动态物体的特征,这给现有的图像匹配方法在准确估计相机姿态方面带来了挑战。在这项研究中,我们提出了一种精确的姿态估计方法,利用固有的相机运动先验。通常,由行车记录仪捕获的图像序列会显示出明显的运动,例如向前移动或横向转弯,这是通信估计的基本线索。基于这种观察,我们设计了一个姿态回归模块,旨在学习相机运动先验,随后将这些先验整合到对应和姿态估计过程中。实验表明,在真实的dashcams数据集中,我们的方法在AUC5°下的姿态估计比基线高22%,在SfM (Structure from Motion)中,它可以在更小的重投影误差下多估计19%的图像的姿态。
期刊介绍:
The scope of this journal is to publish peer-reviewed articles that provide a timely and concise account of innovative research ideas and application results, reporting significant theoretical findings and application case studies in areas of robotics and automation.