Mixed reality for minimally invasive Bone Tumor ablation

Abstract

Minimally invasive intervention requires accuracy and practice as it can be vital in complex and narrow places. In this paper we propose a solution based on augmented reality (AR) for the ablation of bone tumors. Our proposal deals with the preoperative and intraoperative phases of the procedure. The first part consists of the segmentation and 3D reconstruction of the structures of interest. The second part consists of the visualization in AR. This solution is intended to facilitate the tasks of surgeons and radiologists when planning RF needle insertion and trajectory in order to avoid excessive exposure to X-rays, which is a phase that requires more precision and knowledge of the morphology of the mass tumor. The second part offers AR assistance based on the planning of the preoperative phase. The solution we proposed is based on the use of HoloLens 2 headsets to provide better AR visualization and assistance.