{"title":"Automatic image alignment and stitching for ultrasound-based robotic inspection of complex geometry components","authors":"Ekaterina Iakovleva, David Roué, Philippe Brédif","doi":"10.1016/j.ndteint.2024.103158","DOIUrl":null,"url":null,"abstract":"<div><p>Robotic inspection of complex geometry components using immersion ultrasonic techniques is relevant for many ultrasonic Non-Destructive Testing (NDT) applications in different industries. To image large component, ultrasonic probe is manipulated around the component immersed in water using a robotic guided system to create a tiled image of the entire component. Due to the mechanical vibrations of the high-speed robotic arm, the probe position coordinates provided by the robotic system are not precise enough to ensure an accurate reconstruction (stitching) of a composite image from all individual images. In this work, we propose a stitching method specifically designed to create a single 2D image of the surface of an inspected component from a stack of Total Focusing Method (TFM) images. This stitching method uses Iterative Closest Point (ICP) registration to estimate a 2D rigid transformation between two consecutive 2D images, by maximizing the overlap between the surface geometries extracted from each image. The capabilities of this imaging technique are illustrated by various simulated and experimental results carried out in a water tank. Significant improvements in surface image quality, leading to accurate surface reconstruction, are shown for vertical vibrations with displacements of more than two operating wavelengths and for rotational vibrations with deviation angles of less than 1°. The results also show that the resolving power of the ICP algorithm decreases for strong rotational vibrations.</p></div>","PeriodicalId":18868,"journal":{"name":"Ndt & E International","volume":"146 ","pages":"Article 103158"},"PeriodicalIF":4.1000,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0963869524001233/pdfft?md5=7ead7d1fc5b1d6e8aba31162f64a2fb6&pid=1-s2.0-S0963869524001233-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ndt & E International","FirstCategoryId":"88","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0963869524001233","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, CHARACTERIZATION & TESTING","Score":null,"Total":0}
引用次数: 0
Abstract
Robotic inspection of complex geometry components using immersion ultrasonic techniques is relevant for many ultrasonic Non-Destructive Testing (NDT) applications in different industries. To image large component, ultrasonic probe is manipulated around the component immersed in water using a robotic guided system to create a tiled image of the entire component. Due to the mechanical vibrations of the high-speed robotic arm, the probe position coordinates provided by the robotic system are not precise enough to ensure an accurate reconstruction (stitching) of a composite image from all individual images. In this work, we propose a stitching method specifically designed to create a single 2D image of the surface of an inspected component from a stack of Total Focusing Method (TFM) images. This stitching method uses Iterative Closest Point (ICP) registration to estimate a 2D rigid transformation between two consecutive 2D images, by maximizing the overlap between the surface geometries extracted from each image. The capabilities of this imaging technique are illustrated by various simulated and experimental results carried out in a water tank. Significant improvements in surface image quality, leading to accurate surface reconstruction, are shown for vertical vibrations with displacements of more than two operating wavelengths and for rotational vibrations with deviation angles of less than 1°. The results also show that the resolving power of the ICP algorithm decreases for strong rotational vibrations.
期刊介绍:
NDT&E international publishes peer-reviewed results of original research and development in all categories of the fields of nondestructive testing and evaluation including ultrasonics, electromagnetics, radiography, optical and thermal methods. In addition to traditional NDE topics, the emerging technology area of inspection of civil structures and materials is also emphasized. The journal publishes original papers on research and development of new inspection techniques and methods, as well as on novel and innovative applications of established methods. Papers on NDE sensors and their applications both for inspection and process control, as well as papers describing novel NDE systems for structural health monitoring and their performance in industrial settings are also considered. Other regular features include international news, new equipment and a calendar of forthcoming worldwide meetings. This journal is listed in Current Contents.