Sensorless End-to-End Freehand Three-dimensional Ultrasound Reconstruction with Physics Guided Deep Learning.

Abstract

Three-dimensional ultrasound (3D US) imaging with freehand scanning is utilized in cardiac, obstetric, abdominal, and vascular examinations. While 3D US using either a 'wobbler' or 'matrix' transducer suffers from a small field of view and low acquisition rates, freehand scanning offers significant advantages due to its ease of use. However, current 3D US volumetric reconstruction methods with freehand sweeps are limited by imaging plane shifts along the scanning path, i.e., out-of-plane (OOP) motion. Prior studies have incorporated motion sensors attached to the transducer, which is cumbersome and inconvenient in a clinical setting. Recent work has introduced deep neural networks (DNNs) with 3D convolutions to estimate the position of imaging planes from a series of input frames. These approaches, however, fall short for estimating OOP motion. The goal of this paper is to bridge the gap by designing a novel, physics inspired DNN for freehand 3D US reconstruction without motion sensors, aiming to improve the reconstruction quality, and at the same time, to reduce computational resources needed for training and inference. To this end, we present our physics guided learning-based prediction of pose information (PLPPI) model for 3D freehand US reconstruction without 3D convolution. PLPPI yields significantly more accurate reconstructions and offers a major reduction in computation time. It attains a performance increase in the double digits in terms of mean percentage error, with up to 106% speedup and 131% reduction in Graphic Processing Unit (GPU) memory usage, when compared to latest deep learning methods.