Incremental registration towards large-scale heterogeneous point clouds by hierarchical graph matching

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL ISPRS Journal of Photogrammetry and Remote Sensing Pub Date : 2024-05-31 DOI:10.1016/j.isprsjprs.2024.05.017
Shoujun Jia, Chun Liu, Hangbin Wu, Weihua Huan, Shufan Wang
{"title":"Incremental registration towards large-scale heterogeneous point clouds by hierarchical graph matching","authors":"Shoujun Jia,&nbsp;Chun Liu,&nbsp;Hangbin Wu,&nbsp;Weihua Huan,&nbsp;Shufan Wang","doi":"10.1016/j.isprsjprs.2024.05.017","DOIUrl":null,"url":null,"abstract":"<div><p>The increasing availability of point cloud acquisition techniques makes it possible to significantly increase 3D observation capacity by the registration of multi-sensor, multi-platform, and multi-temporal point clouds. However, there are geometric heterogeneities (point density variations and point distribution differences), small overlaps (30 % ∼ 50 %), and large data amounts (a few millions) among these large-scale heterogeneous point clouds, which pose great challenges for effective and efficient registration. In this paper, considering the structural representation capacity of graph model, we propose an incremental registration method for large-scale heterogeneous point clouds by hierarchical graph matching. More specifically, we first construct a novel graph model to discriminatively and robustly represent heterogeneous point clouds. In addition to conventional nodes and edges, our graph model particularly designs discriminative and robust feature descriptors for local node description and captures spatial relationships from both locations and orientations for global edge description. We further devise a matching strategy to accurately estimate node matches for our graph models with partial even small overlaps. This effectiveness benefits from the comprehensiveness of node and edge dissimilarities and the constraint of geometric consistency in the optimization objective. On this basis, we design a coarse-to-fine registration framework for effective and efficient point cloud registration. In this incremental framework, graph matching is hierarchically utilized to achieve sparse-to-dense point matching by global extraction and local propagation, which provides dense correspondences for robust coarse registration and predicts overlap ratio for accurate fine registration, and also avoids huge computation costs for large-scale point clouds. Extensive experiments on one benchmark and three changing self-built datasets with large scales, outliers, changing densities, and small overlaps show the excellent transformation and correspondence accuracies of our registration method for large-scale heterogeneous point clouds. Compared to the state-of-the-art methods (<em>i.e.,</em> TrimICP, CoBigICP, GROR, VPFBR, DPCR, and PRR), our registration method performs approximate even higher efficiency while achieves an improvement of 33 % − 88 % regarding registration accuracy (OE).</p></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":10.6000,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271624002156","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

Abstract

The increasing availability of point cloud acquisition techniques makes it possible to significantly increase 3D observation capacity by the registration of multi-sensor, multi-platform, and multi-temporal point clouds. However, there are geometric heterogeneities (point density variations and point distribution differences), small overlaps (30 % ∼ 50 %), and large data amounts (a few millions) among these large-scale heterogeneous point clouds, which pose great challenges for effective and efficient registration. In this paper, considering the structural representation capacity of graph model, we propose an incremental registration method for large-scale heterogeneous point clouds by hierarchical graph matching. More specifically, we first construct a novel graph model to discriminatively and robustly represent heterogeneous point clouds. In addition to conventional nodes and edges, our graph model particularly designs discriminative and robust feature descriptors for local node description and captures spatial relationships from both locations and orientations for global edge description. We further devise a matching strategy to accurately estimate node matches for our graph models with partial even small overlaps. This effectiveness benefits from the comprehensiveness of node and edge dissimilarities and the constraint of geometric consistency in the optimization objective. On this basis, we design a coarse-to-fine registration framework for effective and efficient point cloud registration. In this incremental framework, graph matching is hierarchically utilized to achieve sparse-to-dense point matching by global extraction and local propagation, which provides dense correspondences for robust coarse registration and predicts overlap ratio for accurate fine registration, and also avoids huge computation costs for large-scale point clouds. Extensive experiments on one benchmark and three changing self-built datasets with large scales, outliers, changing densities, and small overlaps show the excellent transformation and correspondence accuracies of our registration method for large-scale heterogeneous point clouds. Compared to the state-of-the-art methods (i.e., TrimICP, CoBigICP, GROR, VPFBR, DPCR, and PRR), our registration method performs approximate even higher efficiency while achieves an improvement of 33 % − 88 % regarding registration accuracy (OE).

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过分层图匹配实现大规模异构点云的增量注册
随着点云采集技术的日益普及,通过对多传感器、多平台和多时相点云进行注册,可显著提高三维观测能力。然而,这些大规模异构点云之间存在几何异质性(点密度变化和点分布差异)、小重叠(30% ∼ 50%)和大数据量(数百万),这给有效和高效的配准带来了巨大挑战。本文考虑到图模型的结构表示能力,提出了一种分层图匹配的大规模异构点云增量配准方法。更具体地说,我们首先构建了一个新颖的图模型,以区分并稳健地表示异构点云。除了传统的节点和边缘外,我们的图模型还特别设计了用于局部节点描述的辨别性和鲁棒性特征描述符,并从位置和方向两方面捕捉空间关系,用于全局边缘描述。我们还进一步设计了一种匹配策略,以准确估计具有部分甚至微小重叠的图模型的节点匹配情况。这种有效性得益于节点和边缘差异的全面性以及优化目标中的几何一致性约束。在此基础上,我们设计了一个从粗到细的注册框架,以实现高效的点云注册。在这个增量框架中,图匹配被分层利用,通过全局提取和局部传播实现从稀疏到密集的点匹配,从而为稳健的粗注册提供密集的对应关系,为精确的细注册预测重叠率,同时也避免了大规模点云的巨大计算成本。在一个基准数据集和三个不断变化的自建数据集上进行的大量实验表明,我们的配准方法在大规模异构点云上具有出色的变换和对应精度。与最先进的方法(即 TrimICP、CoBigICP、GROR、VPFBR、DPCR 和 PRR)相比,我们的配准方法效率更高,配准精度(OE)提高了 33% - 88%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
期刊最新文献
Nonlinear least-squares solutions to the TLS multi-station registration adjustment problem Joint block adjustment and variational optimization for global and local radiometric normalization toward multiple remote sensing image mosaicking Weather-aware autopilot: Domain generalization for point cloud semantic segmentation in diverse weather scenarios Reconstructing NDVI time series in cloud-prone regions: A fusion-and-fit approach with deep learning residual constraint MuSRFM: Multiple scale resolution fusion based precise and robust satellite derived bathymetry model for island nearshore shallow water regions using sentinel-2 multi-spectral imagery
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1