Jiaqiang Yang , Danyang Qin , Huapeng Tang , Sili Tao , Haoze Bie , Lin Ma
{"title":"一种新颖的空间金字塔增强型室内视觉定位方法","authors":"Jiaqiang Yang , Danyang Qin , Huapeng Tang , Sili Tao , Haoze Bie , Lin Ma","doi":"10.1016/j.dsp.2024.104831","DOIUrl":null,"url":null,"abstract":"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"156 ","pages":"Article 104831"},"PeriodicalIF":2.9000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel spatial pyramid-enhanced indoor visual positioning method\",\"authors\":\"Jiaqiang Yang , Danyang Qin , Huapeng Tang , Sili Tao , Haoze Bie , Lin Ma\",\"doi\":\"10.1016/j.dsp.2024.104831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"156 \",\"pages\":\"Article 104831\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200424004561\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200424004561","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
A novel spatial pyramid-enhanced indoor visual positioning method
As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.
期刊介绍:
Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal.
The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as:
• big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,