Clinical performance review for 3-D Deep Learning segmentation of stroke infarct from diffusion-weighted images

Abstract

Introduction

During the subacute phase of ischemic stroke, MR diffusion-weighted imaging (DWI) is used to assess the extent of tissue injury. Segmentation of DWI infarct is challenging due to disease variability, but Deep Learning (DL) provides a solution, outperforming existing methods on small datasets. However, a lack of clinically meaningful performance evaluation hinders clinical translation. Here we develop a DL DWI segmentation tool and provide clinical performance review.

Methods

Subjects in this retrospective study presented with stroke symptoms and later underwent DWI imaging. DL architectures U-Net and DenseNet were used to develop a DWI segmentation tool. The Dice Similarly Coefficient (DSC) was used to select the best- and worst-performing model. Clinical experts reviewed these models on the clinical test set, agreeing with the model if no 'significant’ error was present. The average agreement with the model and interrater agreement was also derived.

Results

In total, 573 participants with an ischemic stroke were included. The DenseNet delivered the best model (DSC = 0.831 ± 0.064) with a mean inference time of 0.07 s. Clinicians compared this with the worst model (U-Net, DSC = 0.759 ± 0.122), agreeing with the DenseNet predictions more than the U-Net (83.8 % vs. 79.3 %). Clinicians also agreed with each other more over performance interpretation when evaluating the DenseNet over the U-Net (87.9 % vs. 72.7 %).

Conclusion

Our DWI segmentation tool achieved high performance with clinical review providing meaningful performance evaluation. Model development will continue towards prospective deployment before which clinical review will be repeated. This work will benefit physicians in assessing patient prognosis.