一种新颖的空间金字塔增强型室内视觉定位方法

IF 2.9 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC Digital Signal Processing Pub Date : 2024-10-28 DOI:10.1016/j.dsp.2024.104831
Jiaqiang Yang , Danyang Qin , Huapeng Tang , Sili Tao , Haoze Bie , Lin Ma
{"title":"一种新颖的空间金字塔增强型室内视觉定位方法","authors":"Jiaqiang Yang ,&nbsp;Danyang Qin ,&nbsp;Huapeng Tang ,&nbsp;Sili Tao ,&nbsp;Haoze Bie ,&nbsp;Lin Ma","doi":"10.1016/j.dsp.2024.104831","DOIUrl":null,"url":null,"abstract":"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"156 ","pages":"Article 104831"},"PeriodicalIF":2.9000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel spatial pyramid-enhanced indoor visual positioning method\",\"authors\":\"Jiaqiang Yang ,&nbsp;Danyang Qin ,&nbsp;Huapeng Tang ,&nbsp;Sili Tao ,&nbsp;Haoze Bie ,&nbsp;Lin Ma\",\"doi\":\"10.1016/j.dsp.2024.104831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"156 \",\"pages\":\"Article 104831\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200424004561\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200424004561","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

作为物联网(IoT)技术的一项重要应用,视觉定位在日常生活中发挥着重要作用。然而,图像中的行人会遮挡环境特征,对视觉定位系统的性能产生负面影响。针对这一问题,我们提出了一种空间金字塔增强混合VPR可视化定位方法(SPE-VL),旨在通过多尺度空间信息增强图像特征描述,从而减轻行人遮挡对定位精度的影响。SPE-VL 方法分为两个主要阶段:基于传感器的匹配范围约束和图像特征提取与匹配。在匹配范围约束阶段,我们提出了一种基于机器学习分类器的方向判定方法,利用智能手机传感器数据来限制图像匹配的方向,从而降低不匹配的可能性。在特征提取和匹配阶段,我们提出了一种基于变换器的特征交叉增强方法,利用局部特征和空间上下文信息来增强特征,从而提高图像检索准确率和定位精度。实验结果表明,与现有的先进方法相比,SPE-VL 方法具有更高的定位精度和鲁棒性,为复杂环境中的视觉定位应用提供了新的见解和解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A novel spatial pyramid-enhanced indoor visual positioning method
As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
期刊最新文献
Adaptive polarimetric persymmetric detection for distributed subspace targets in lognormal texture clutter MFFR-net: Multi-scale feature fusion and attentive recalibration network for deep neural speech enhancement PV-YOLO: A lightweight pedestrian and vehicle detection model based on improved YOLOv8 Efficient recurrent real video restoration IGGCN: Individual-guided graph convolution network for pedestrian trajectory prediction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1