Luca Morelli, G. Mazzacca, P. Trybała, F. Gaspari, F. Ioli, Zhenyu Ma, F. Remondino, Keith Challis, Andrew Poad, Alex Turner, Jon P. Mills
{"title":"The Legacy of Sycamore Gap: The Potential of Photogrammetric AI for Reverse Engineering Lost Heritage with Crowdsourced Data","authors":"Luca Morelli, G. Mazzacca, P. Trybała, F. Gaspari, F. Ioli, Zhenyu Ma, F. Remondino, Keith Challis, Andrew Poad, Alex Turner, Jon P. Mills","doi":"10.5194/isprs-archives-xlviii-2-2024-281-2024","DOIUrl":null,"url":null,"abstract":"Abstract. The orientation of crowdsourced and multi-temporal image datasets presents a challenging task for traditional photogrammetry. Indeed, traditional image matching approaches often struggle to find accurate and reliable tie points in images that appear significantly different from one another. In this paper, in order to preserve the memory of the Sycamore Gap tree, a symbol of Hadrian's Wall that was felled in an act of vandalism in September 2023, deep-learning-based features trained specifically on challenging image datasets were employed to overcome limitations of traditional matching approaches. We demonstrate how unordered crowdsourced images and UAV videos can be oriented and used for 3D reconstruction purposes, together with a recently acquired terrestrial laser scanner point cloud for scaling and referencing. This allows the memory of the Sycamore Gap tree to live on and exhibits the potential of photogrammetric AI (Artificial Intelligence) for reverse engineering lost heritage.\n","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"79 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5194/isprs-archives-xlviii-2-2024-281-2024","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract. The orientation of crowdsourced and multi-temporal image datasets presents a challenging task for traditional photogrammetry. Indeed, traditional image matching approaches often struggle to find accurate and reliable tie points in images that appear significantly different from one another. In this paper, in order to preserve the memory of the Sycamore Gap tree, a symbol of Hadrian's Wall that was felled in an act of vandalism in September 2023, deep-learning-based features trained specifically on challenging image datasets were employed to overcome limitations of traditional matching approaches. We demonstrate how unordered crowdsourced images and UAV videos can be oriented and used for 3D reconstruction purposes, together with a recently acquired terrestrial laser scanner point cloud for scaling and referencing. This allows the memory of the Sycamore Gap tree to live on and exhibits the potential of photogrammetric AI (Artificial Intelligence) for reverse engineering lost heritage.
摘要众包和多时态图像数据集的定位对传统摄影测量来说是一项具有挑战性的任务。事实上,传统的图像匹配方法往往难以在图像之间存在明显差异的情况下找到准确可靠的连接点。在本文中,为了保留哈德良长城的象征--梧桐树(Sycamore Gap tree)--的记忆,我们采用了基于深度学习的特征,专门针对具有挑战性的图像数据集进行训练,以克服传统匹配方法的局限性。我们展示了如何对无序的众包图像和无人机视频进行定向,并将其用于三维重建目的,同时利用最近获得的地面激光扫描仪点云进行缩放和参照。这让梧桐峡树的记忆得以延续,并展示了摄影测量 AI(人工智能)在逆向工程失落遗产方面的潜力。