An Augmented Reality Visor for Intraoperative Visualization, Guidance and Temperature Monitoring using Fluorescence

Abstract

Fluorescence-guided surgical techniques, including tumor resection and tissue soldering, are advancing the frontiers of surgical precision by offering enhanced control that minimizes tissue damage and improves recovery as well as outcomes. However, integrating the visualization of the fluorescent signal and temperature monitoring seamlessly into surgical workflows has not been fully realized and remains a challenge, thus limiting their effectiveness and wide-spread clinical adoption. To address this issue, we introduce an augmented reality (AR) visor designed to unite nanomaterial excitation along with fluorescence detection, and temperature monitoring during surgical procedures. The AR visor was evaluated using advanced fluorescent nanoparticles, such as indocyanine green-doped particles and singlewalled carbon nanotubes. By consolidating fluorescence visualization, excitation monitoring, and precise temperature control into a single AR platform, we equip surgeons with a comprehensive view of both the surgical field and sub-surface conditions invisible to the naked eye. This integration notably improves the safety and efficacy of fluorescence-guided surgeries, as well as emerging technologies including laser tissue soldering, by ensuring the soldering temperature stays within therapeutic thresholds and the laser is accurately guided by real-time fluorescence signals. The presented technology not only enhances existing surgical techniques but also supports the development of new strategies and sensing technologies in areas where traditional methods fall short, marking significant progress in precision surgery, which could ultimately improve patient care.