3D Remote Assistance for NDT Inspections

In this work, we present a system architecture that is especially designed for remote ultrasound testing inspections (UT). The system itself is realized using a real-time session service and a web service based on a REST API (REST: Representational State Transfer; API: application programming interface). This web service is used to store data persistently, e.g., sample geometries, raw nondestructive testing (NDT) data and derived inspection results in a shared dataspace. In the current development state, the results consist of textures mapped onto the sample geometry. This approach allows us to display the UT results directly on the real sample using mixed reality technologies. We also implemented a feature to assist the inspector remotely by making use of the availability of this digital representation. Hence, it is necessary to share additional data like the current UT-signal, temporary position marks, user and device positions, etc. between the different participants. A real-time distribution of this highly dynamic data is required to create an effective assistance environment. Therefore, a separate session service is used. The inspection data generated in this temporary session can also be transferred to the afore mentioned dataspace to be saved persistently. The system features mixed reality visualization for the inspector and optionally a virtual reality or a 3D Desktop environment for one or more remote assistants.