Francesco Ioli, Niccolò Dematteis, Daniele Giordan, Francesco Nex, Livio Pinto
{"title":"用于 4D 短期冰川动态监测的深度学习低成本摄影测量技术","authors":"Francesco Ioli, Niccolò Dematteis, Daniele Giordan, Francesco Nex, Livio Pinto","doi":"10.1007/s41064-023-00272-w","DOIUrl":null,"url":null,"abstract":"<p>Short-term monitoring of alpine glaciers is crucial to understand their response to climate change. This paper presents a low-cost multi-camera system tailored for 4D glacier monitoring using deep learning stereo-photogrammetry. Our approach integrates multi-temporal 3D reconstruction from stereo cameras and surface velocity estimation from a monoscopic camera through digital image correlation. To address the challenges posed by wide camera baselines in complex environments, we have integrated state-of-the-art deep learning feature matching algorithms into ICEpy4D, a Python toolkit designed for 4D monitoring (https://github.com/franioli/icepy4d). In a pilot study conducted on the debris-covered Belvedere Glacier (Italian Alps), our stereoscopic setup, with a camera base–height ratio close to one, captured daily images from May to November 2022. Our approach utilized SuperPoint and SuperGlue for feature matching, resulting in a daily 3D reconstruction of the glacier terminus, as traditional SIFT-like feature matching fails in this scenario. Using dense point clouds with decimetric accuracy, we estimated daily ice volume loss and glacier retreat at the terminus. The total ice volume loss was <span>\\(63\\,000\\,\\text{m}\\)</span><span>\\({}^{3}\\)</span> and the retreat was <span>\\(17.8\\,\\text{m}\\)</span>. Surface kinematics revealed three times higher surface velocity during the warm season (May–September) than in the fall (September–November). Daily analyses revealed a significant short-term correlation between air temperature, glacier surface velocity and ice ablation, providing insight into the glacier’s response to external forces. The low cost and ease of deployment of the proposed system facilitates replication at other sites for short-term monitoring of glacier dynamics.</p>","PeriodicalId":56035,"journal":{"name":"PFG-Journal of Photogrammetry Remote Sensing and Geoinformation Science","volume":"51 1","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2024-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Learning Low-cost Photogrammetry for 4D Short-term Glacier Dynamics Monitoring\",\"authors\":\"Francesco Ioli, Niccolò Dematteis, Daniele Giordan, Francesco Nex, Livio Pinto\",\"doi\":\"10.1007/s41064-023-00272-w\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Short-term monitoring of alpine glaciers is crucial to understand their response to climate change. This paper presents a low-cost multi-camera system tailored for 4D glacier monitoring using deep learning stereo-photogrammetry. Our approach integrates multi-temporal 3D reconstruction from stereo cameras and surface velocity estimation from a monoscopic camera through digital image correlation. To address the challenges posed by wide camera baselines in complex environments, we have integrated state-of-the-art deep learning feature matching algorithms into ICEpy4D, a Python toolkit designed for 4D monitoring (https://github.com/franioli/icepy4d). In a pilot study conducted on the debris-covered Belvedere Glacier (Italian Alps), our stereoscopic setup, with a camera base–height ratio close to one, captured daily images from May to November 2022. Our approach utilized SuperPoint and SuperGlue for feature matching, resulting in a daily 3D reconstruction of the glacier terminus, as traditional SIFT-like feature matching fails in this scenario. Using dense point clouds with decimetric accuracy, we estimated daily ice volume loss and glacier retreat at the terminus. The total ice volume loss was <span>\\\\(63\\\\,000\\\\,\\\\text{m}\\\\)</span><span>\\\\({}^{3}\\\\)</span> and the retreat was <span>\\\\(17.8\\\\,\\\\text{m}\\\\)</span>. Surface kinematics revealed three times higher surface velocity during the warm season (May–September) than in the fall (September–November). Daily analyses revealed a significant short-term correlation between air temperature, glacier surface velocity and ice ablation, providing insight into the glacier’s response to external forces. The low cost and ease of deployment of the proposed system facilitates replication at other sites for short-term monitoring of glacier dynamics.</p>\",\"PeriodicalId\":56035,\"journal\":{\"name\":\"PFG-Journal of Photogrammetry Remote Sensing and Geoinformation Science\",\"volume\":\"51 1\",\"pages\":\"\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-02-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"PFG-Journal of Photogrammetry Remote Sensing and Geoinformation Science\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s41064-023-00272-w\",\"RegionNum\":4,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"IMAGING SCIENCE & PHOTOGRAPHIC TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"PFG-Journal of Photogrammetry Remote Sensing and Geoinformation Science","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s41064-023-00272-w","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"IMAGING SCIENCE & PHOTOGRAPHIC TECHNOLOGY","Score":null,"Total":0}
Deep Learning Low-cost Photogrammetry for 4D Short-term Glacier Dynamics Monitoring
Short-term monitoring of alpine glaciers is crucial to understand their response to climate change. This paper presents a low-cost multi-camera system tailored for 4D glacier monitoring using deep learning stereo-photogrammetry. Our approach integrates multi-temporal 3D reconstruction from stereo cameras and surface velocity estimation from a monoscopic camera through digital image correlation. To address the challenges posed by wide camera baselines in complex environments, we have integrated state-of-the-art deep learning feature matching algorithms into ICEpy4D, a Python toolkit designed for 4D monitoring (https://github.com/franioli/icepy4d). In a pilot study conducted on the debris-covered Belvedere Glacier (Italian Alps), our stereoscopic setup, with a camera base–height ratio close to one, captured daily images from May to November 2022. Our approach utilized SuperPoint and SuperGlue for feature matching, resulting in a daily 3D reconstruction of the glacier terminus, as traditional SIFT-like feature matching fails in this scenario. Using dense point clouds with decimetric accuracy, we estimated daily ice volume loss and glacier retreat at the terminus. The total ice volume loss was \(63\,000\,\text{m}\)\({}^{3}\) and the retreat was \(17.8\,\text{m}\). Surface kinematics revealed three times higher surface velocity during the warm season (May–September) than in the fall (September–November). Daily analyses revealed a significant short-term correlation between air temperature, glacier surface velocity and ice ablation, providing insight into the glacier’s response to external forces. The low cost and ease of deployment of the proposed system facilitates replication at other sites for short-term monitoring of glacier dynamics.
期刊介绍:
PFG is an international scholarly journal covering the progress and application of photogrammetric methods, remote sensing technology and the interconnected field of geoinformation science. It places special editorial emphasis on the communication of new methodologies in data acquisition and new approaches to optimized processing and interpretation of all types of data which were acquired by photogrammetric methods, remote sensing, image processing and the computer-aided interpretation of such data in general. The journal hence addresses both researchers and students of these disciplines at academic institutions and universities as well as the downstream users in both the private sector and public administration.
Founded in 1926 under the former name Bildmessung und Luftbildwesen, PFG is worldwide the oldest journal on photogrammetry. It is the official journal of the German Society for Photogrammetry, Remote Sensing and Geoinformation (DGPF).