The application of machine learning to tasks involving volumetric biomedical imaging is constrained by the limited availability of annotated datasets of three-dimensional (3D) scans for model training. Here we report a deep-learning model pre-trained on 2D scans (for which annotated data are relatively abundant) that accurately predicts disease-risk factors from 3D medical-scan modalities. The model, which we named SLIViT (for ‘slice integration by vision transformer’), preprocesses a given volumetric scan into 2D images, extracts their feature map and integrates it into a single prediction. We evaluated the model in eight different learning tasks, including classification and regression for six datasets involving four volumetric imaging modalities (computed tomography, magnetic resonance imaging, optical coherence tomography and ultrasound). SLIViT consistently outperformed domain-specific state-of-the-art models and was typically as accurate as clinical specialists who had spent considerable time manually annotating the analysed scans. Automating diagnosis tasks involving volumetric scans may save valuable clinician hours, reduce data acquisition costs and duration, and help expedite medical research and clinical applications.
The clinical assessment of microvascular pathologies (in diabetes and in inflammatory skin diseases, for example) requires the visualization of superficial vascular anatomy. Photoacoustic tomography (PAT) scanners based on an all-optical Fabry–Perot ultrasound sensor can provide highly detailed 3D microvascular images, but minutes-long acquisition times have precluded their clinical use. Here we show that scan times can be reduced to a few seconds and even hundreds of milliseconds by parallelizing the optical architecture of the sensor readout, by using excitation lasers with high pulse-repetition frequencies and by exploiting compressed sensing. A PAT scanner with such fast acquisition minimizes motion-related artefacts and allows for the volumetric visualization of individual arterioles, venules, venous valves and millimetre-scale arteries and veins to depths approaching 15 mm, as well as for dynamic 3D images of time-varying tissue perfusion and other haemodynamic events. In exploratory case studies, we used the scanner to visualize and quantify microvascular changes associated with peripheral vascular disease, skin inflammation and rheumatoid arthritis. Fast all-optical PAT may prove useful in cardiovascular medicine, oncology, dermatology and rheumatology.
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：