Improved SfM-MVS approach using artificial backgrounds

IF 3.3 2区 工程技术 Q2 ENGINEERING, GEOLOGICAL Soils and Foundations Pub Date : 2024-08-13 DOI:10.1016/j.sandf.2024.101495
Danxi Sun , Wang Hailong , Komine Hideo , Tsunai Hiroshi , Ito Daichi , Pan Gaofeng , Ruan Kunlin
{"title":"Improved SfM-MVS approach using artificial backgrounds","authors":"Danxi Sun ,&nbsp;Wang Hailong ,&nbsp;Komine Hideo ,&nbsp;Tsunai Hiroshi ,&nbsp;Ito Daichi ,&nbsp;Pan Gaofeng ,&nbsp;Ruan Kunlin","doi":"10.1016/j.sandf.2024.101495","DOIUrl":null,"url":null,"abstract":"<div><p>With the development of computer vision technology, structure from motion and multiview-stereo (SfM-MVS) approach has been widely applied in the geotechnical field. However, as a method that utilizes a series of images to reconstruct a 3D model, errors often occur due to insufficient feature points in the images. In this study, soil blocks, rubber specimens, and a sand particle ranging in size from 10 cm to 0.3 mm were utilized for synthetizing 3D model by the SfM-MVS approach. Additionally, an artificial background containing various colored blocks was introduced during photographing process to improve this approach. Moreover, the application of this approach was extended to process optical microscope images and scanning electron microscope (SEM) images by using two artificial backgrounds. Experimental comparison suggested that using artificial backgrounds could optimize the depression areas between the specimen and sample holder of the three-dimensional (3D) model generated by the SfM-MVS approach, especially in the depression portions with acute angles. And the reconstructed model from the SfM-MVS approach was comparable to that generated by X-ray computed tomography (CT). It was also found that increasing the image resolution and decreasing voxel size can improve the accuracy of the 3D model. And these improvements have been quantitatively demonstrated by tests. When using optical microscopy and SEM, the application of artificial backgrounds significantly increased the success rate of constructing 3D models, compared to the near impossibility of achieving successful reconstruction without them in the practice. It was mainly attribute to sufficient feature points in artificial backgrounds can be captured from artificial backgrounds in the camera tracking and point-matching processes of the SfM-MVS approach. With the proposed method in this study, the applicability of the SfM-MVS approach was extended in laboratory geotechnical experiments.</p></div>","PeriodicalId":21857,"journal":{"name":"Soils and Foundations","volume":"64 5","pages":"Article 101495"},"PeriodicalIF":3.3000,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0038080624000738/pdfft?md5=4a31cfb165f2d0e7aa5d4bed6a1dda09&pid=1-s2.0-S0038080624000738-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Soils and Foundations","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0038080624000738","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, GEOLOGICAL","Score":null,"Total":0}
引用次数: 0

Abstract

With the development of computer vision technology, structure from motion and multiview-stereo (SfM-MVS) approach has been widely applied in the geotechnical field. However, as a method that utilizes a series of images to reconstruct a 3D model, errors often occur due to insufficient feature points in the images. In this study, soil blocks, rubber specimens, and a sand particle ranging in size from 10 cm to 0.3 mm were utilized for synthetizing 3D model by the SfM-MVS approach. Additionally, an artificial background containing various colored blocks was introduced during photographing process to improve this approach. Moreover, the application of this approach was extended to process optical microscope images and scanning electron microscope (SEM) images by using two artificial backgrounds. Experimental comparison suggested that using artificial backgrounds could optimize the depression areas between the specimen and sample holder of the three-dimensional (3D) model generated by the SfM-MVS approach, especially in the depression portions with acute angles. And the reconstructed model from the SfM-MVS approach was comparable to that generated by X-ray computed tomography (CT). It was also found that increasing the image resolution and decreasing voxel size can improve the accuracy of the 3D model. And these improvements have been quantitatively demonstrated by tests. When using optical microscopy and SEM, the application of artificial backgrounds significantly increased the success rate of constructing 3D models, compared to the near impossibility of achieving successful reconstruction without them in the practice. It was mainly attribute to sufficient feature points in artificial backgrounds can be captured from artificial backgrounds in the camera tracking and point-matching processes of the SfM-MVS approach. With the proposed method in this study, the applicability of the SfM-MVS approach was extended in laboratory geotechnical experiments.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用人工背景改进 SfM-MVS 方法
随着计算机视觉技术的发展,运动和多视图立体结构(SfM-MVS)方法已广泛应用于岩土工程领域。然而,作为一种利用一系列图像重建三维模型的方法,由于图像中的特征点不足,经常会出现误差。本研究采用 SfM-MVS 方法,利用土块、橡胶试样和粒径从 10 厘米到 0.3 毫米不等的沙粒合成三维模型。此外,在拍摄过程中还引入了包含各种颜色块的人工背景,以改进这种方法。此外,通过使用两种人造背景,该方法的应用还扩展到了光学显微镜图像和扫描电子显微镜(SEM)图像的处理。实验对比表明,使用人工背景可以优化 SfM-MVS 方法生成的三维(3D)模型中试样和试样夹具之间的凹陷区域,尤其是锐角凹陷部分。SfM-MVS 方法重建的模型与 X 射线计算机断层扫描(CT)生成的模型相当。研究还发现,提高图像分辨率和减小体素尺寸可以提高三维模型的精确度。这些改进已通过测试得到定量证明。在使用光学显微镜和扫描电子显微镜时,人工背景的应用大大提高了构建三维模型的成功率,而在实际应用中,如果没有人工背景,几乎不可能实现成功的重建。这主要归功于在 SfM-MVS 方法的相机跟踪和点匹配过程中,可以从人工背景中捕捉到足够的特征点。利用本研究提出的方法,SfM-MVS 方法的适用性在实验室岩土实验中得到了扩展。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Soils and Foundations
Soils and Foundations 工程技术-地球科学综合
CiteScore
6.40
自引率
8.10%
发文量
99
审稿时长
5 months
期刊介绍: Soils and Foundations is one of the leading journals in the field of soil mechanics and geotechnical engineering. It is the official journal of the Japanese Geotechnical Society (JGS)., The journal publishes a variety of original research paper, technical reports, technical notes, as well as the state-of-the-art reports upon invitation by the Editor, in the fields of soil and rock mechanics, geotechnical engineering, and environmental geotechnics. Since the publication of Volume 1, No.1 issue in June 1960, Soils and Foundations will celebrate the 60th anniversary in the year of 2020. Soils and Foundations welcomes theoretical as well as practical work associated with the aforementioned field(s). Case studies that describe the original and interdisciplinary work applicable to geotechnical engineering are particularly encouraged. Discussions to each of the published articles are also welcomed in order to provide an avenue in which opinions of peers may be fed back or exchanged. In providing latest expertise on a specific topic, one issue out of six per year on average was allocated to include selected papers from the International Symposia which were held in Japan as well as overseas.
期刊最新文献
Efficient reliability analysis of unsaturated slope stability under rapid drawdown using XGBoost-based surrogate model Advancement ratio effect on screw pile performance in the bearing layer Spatial earth pressure analysis of clayey fill behind retaining wall in V-shaped gully terrain Instability of sand under a lateral extrusion stress path with different drainage conditions Electrodeposition-based self-healing technique for structures with loosely compacted sand
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1