Automatic Extraction of Roads From Multisource Geospatial Data Using Fusion Attention Network and Regularization Algorithm

IF 8.6 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Transactions on Geoscience and Remote Sensing Pub Date : 2024-12-20 DOI:10.1109/TGRS.2024.3520610
Zejiao Wang;Longgang Xiang;Zhongyu Liu;Zhengxiang Wang
{"title":"Automatic Extraction of Roads From Multisource Geospatial Data Using Fusion Attention Network and Regularization Algorithm","authors":"Zejiao Wang;Longgang Xiang;Zhongyu Liu;Zhengxiang Wang","doi":"10.1109/TGRS.2024.3520610","DOIUrl":null,"url":null,"abstract":"Automatic extraction of roads from remote sensing imagery has numerous applications, such as urban planning and navigation. However, the quality of images is limited, and most existing road extraction methods suffer from discontinuity. Additionally, there remains a gap between pixel-based road segmentation and road vectorization. To address these challenges, we introduce a method that utilizes a multistage feature fusion attention network (MFFANet) and regularization algorithm to extract road surfaces, centerlines, edges, and intersections. MFFANet comprises three components. The complementary feature embedding module (CFEM) adaptively encodes remote sensing images, vehicle trajectories, and OpenStreetMap (OSM) points to capture specific modal features. The multistage feature fusion module (MFFM) is proposed to improve the completeness and connectivity of road extraction by integrating multisource geospatial features. The multilevel mask generation module (MMGM) enhances road segmentation results through a weighting mechanism that can simultaneously predict local road segments, road sections, and road network masks. Additionally, a novel joint loss function is introduced to balance local and global optimization. In the regularization stage, fused hierarchical masks generate road segments, with a skeleton refinement for centerlines and widths, followed by smooth segment reconstruction and extraction of edges and intersections. Experiments on different datasets demonstrate that our designed fusion attention network outperforms the latest road segmentation models; our regularization algorithm shows strong robustness and the comprehensive metrics of vectorized road line extraction exceeds 70%.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"63 ","pages":"1-17"},"PeriodicalIF":8.6000,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10810450/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Automatic extraction of roads from remote sensing imagery has numerous applications, such as urban planning and navigation. However, the quality of images is limited, and most existing road extraction methods suffer from discontinuity. Additionally, there remains a gap between pixel-based road segmentation and road vectorization. To address these challenges, we introduce a method that utilizes a multistage feature fusion attention network (MFFANet) and regularization algorithm to extract road surfaces, centerlines, edges, and intersections. MFFANet comprises three components. The complementary feature embedding module (CFEM) adaptively encodes remote sensing images, vehicle trajectories, and OpenStreetMap (OSM) points to capture specific modal features. The multistage feature fusion module (MFFM) is proposed to improve the completeness and connectivity of road extraction by integrating multisource geospatial features. The multilevel mask generation module (MMGM) enhances road segmentation results through a weighting mechanism that can simultaneously predict local road segments, road sections, and road network masks. Additionally, a novel joint loss function is introduced to balance local and global optimization. In the regularization stage, fused hierarchical masks generate road segments, with a skeleton refinement for centerlines and widths, followed by smooth segment reconstruction and extraction of edges and intersections. Experiments on different datasets demonstrate that our designed fusion attention network outperforms the latest road segmentation models; our regularization algorithm shows strong robustness and the comprehensive metrics of vectorized road line extraction exceeds 70%.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于融合关注网络和正则化算法的多源地理空间数据道路自动提取
从遥感影像中自动提取道路有许多应用,如城市规划和导航。然而,图像质量有限,现有的道路提取方法大多存在不连续的问题。此外,基于像素的道路分割和道路矢量化之间仍然存在差距。为了解决这些挑战,我们引入了一种利用多阶段特征融合注意网络(MFFANet)和正则化算法提取路面、中心线、边缘和交叉口的方法。MFFANet由三个部分组成。互补特征嵌入模块(CFEM)对遥感图像、车辆轨迹和OpenStreetMap (OSM)点进行自适应编码,以捕获特定的模态特征。为了提高道路提取的完整性和连通性,提出多级特征融合模块(MFFM)。多层掩码生成模块(MMGM)通过加权机制增强道路分割结果,该机制可以同时预测局部路段、路段和路网掩码。此外,还引入了一种新的联合损失函数来平衡局部和全局优化。在正则化阶段,融合的分层掩模生成道路段,对中心线和宽度进行骨架细化,然后进行平滑的路段重建和提取边缘和交叉点。在不同数据集上的实验表明,我们设计的融合注意网络优于最新的道路分割模型;我们的正则化算法具有较强的鲁棒性,矢量化道路线提取的综合指标超过70%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
期刊最新文献
Improve OMI Observations on Ground-Level NO 2 using Multiple Observations, Simulations and Machine Learning Estimation of carbon storage based on UAV multispectral photogrammetry: An offshore islands study in Pearl River Delta PVMD-Net: A Deep Network for Synchronization Error Compensation in Bistatic Imaging Radar DSCH-Net: Diffusion-State-Contextual Hybrid Network for Physics-Inspired and Direction-Aware Dehazing of Remote Sensing Imagery Monte Carlo Simulation-Based Echo Modeling of Inhomogeneous Ice-Phase Precipitation Particles for Airborne Dual-Polarization Weather Radar
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1