Development and prospective clinical validation of a convolutional neural network for automated detection and segmentation of focal cortical dysplasias
Vicky Chanra , Agata Chudzinska , Natalia Braniewska , Bartosz Silski , Brigitte Holst , Thomas Sauvigny , Stefan Stodieck , Sirko Pelzl , Patrick M. House
{"title":"Development and prospective clinical validation of a convolutional neural network for automated detection and segmentation of focal cortical dysplasias","authors":"Vicky Chanra , Agata Chudzinska , Natalia Braniewska , Bartosz Silski , Brigitte Holst , Thomas Sauvigny , Stefan Stodieck , Sirko Pelzl , Patrick M. House","doi":"10.1016/j.eplepsyres.2024.107357","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><p>Focal cortical dysplasias (FCDs) are a leading cause of drug-resistant epilepsy. Early detection and resection of FCDs have favorable prognostic implications for postoperative seizure freedom. Despite advancements in imaging methods, FCD detection remains challenging. House et al. (<em>2021</em>) introduced a convolutional neural network (CNN) for automated FCD detection and segmentation, achieving a sensitivity of 77.8%. However, its clinical applicability was limited due to a low specificity of 5.5%. The objective of this study was to improve the CNN’s performance through data-driven training and algorithm optimization, followed by a prospective validation on daily-routine MRIs.</p></div><div><h3>Material and methods</h3><p>A dataset of 300 3 T MRIs from daily clinical practice, including 3D T1 and FLAIR sequences, was prospectively compiled. The MRIs were visually evaluated by two neuroradiologists and underwent morphometric assessment by two epileptologists. The dataset included 30 FCD cases (11 female, mean age: 28.1 ± 10.1 years) and a control group of 150 normal cases (97 female, mean age: 32.8 ± 14.9 years), along with 120 non-FCD pathological cases (64 female, mean age: 38.4 ± 18.4 years). The dataset was divided into three subsets, each analyzed by the CNN. Subsequently, the CNN underwent a two-phase-training process, incorporating subset MRIs and expert-labeled FCD maps. This training employed both classical and continual learning techniques. The CNN’s performance was validated by comparing the baseline model with the trained models at two training levels.</p></div><div><h3>Results</h3><p>In prospective validation, the best model trained using continual learning achieved a sensitivity of 90.0%, specificity of 70.0%, and accuracy of 72.0%, with an average of 0.41 false positive clusters detected per MRI. For FCD segmentation, an average Dice coefficient of 0.56 was attained. The model’s performance improved in each training phase while maintaining a high level of sensitivity. Continual learning outperformed classical learning in this regard.</p></div><div><h3>Conclusions</h3><p>Our study presents a promising CNN for FCD detection and segmentation, exhibiting both high sensitivity and specificity. Furthermore, the model demonstrates continuous improvement with the inclusion of more clinical MRI data. We consider our CNN a valuable tool for automated, examiner-independent FCD detection in daily clinical practice, potentially addressing the underutilization of epilepsy surgery in drug-resistant focal epilepsy and thereby improving patient outcomes.</p></div>","PeriodicalId":11914,"journal":{"name":"Epilepsy Research","volume":"202 ","pages":"Article 107357"},"PeriodicalIF":2.0000,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Epilepsy Research","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S092012112400072X","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
Focal cortical dysplasias (FCDs) are a leading cause of drug-resistant epilepsy. Early detection and resection of FCDs have favorable prognostic implications for postoperative seizure freedom. Despite advancements in imaging methods, FCD detection remains challenging. House et al. (2021) introduced a convolutional neural network (CNN) for automated FCD detection and segmentation, achieving a sensitivity of 77.8%. However, its clinical applicability was limited due to a low specificity of 5.5%. The objective of this study was to improve the CNN’s performance through data-driven training and algorithm optimization, followed by a prospective validation on daily-routine MRIs.
Material and methods
A dataset of 300 3 T MRIs from daily clinical practice, including 3D T1 and FLAIR sequences, was prospectively compiled. The MRIs were visually evaluated by two neuroradiologists and underwent morphometric assessment by two epileptologists. The dataset included 30 FCD cases (11 female, mean age: 28.1 ± 10.1 years) and a control group of 150 normal cases (97 female, mean age: 32.8 ± 14.9 years), along with 120 non-FCD pathological cases (64 female, mean age: 38.4 ± 18.4 years). The dataset was divided into three subsets, each analyzed by the CNN. Subsequently, the CNN underwent a two-phase-training process, incorporating subset MRIs and expert-labeled FCD maps. This training employed both classical and continual learning techniques. The CNN’s performance was validated by comparing the baseline model with the trained models at two training levels.
Results
In prospective validation, the best model trained using continual learning achieved a sensitivity of 90.0%, specificity of 70.0%, and accuracy of 72.0%, with an average of 0.41 false positive clusters detected per MRI. For FCD segmentation, an average Dice coefficient of 0.56 was attained. The model’s performance improved in each training phase while maintaining a high level of sensitivity. Continual learning outperformed classical learning in this regard.
Conclusions
Our study presents a promising CNN for FCD detection and segmentation, exhibiting both high sensitivity and specificity. Furthermore, the model demonstrates continuous improvement with the inclusion of more clinical MRI data. We consider our CNN a valuable tool for automated, examiner-independent FCD detection in daily clinical practice, potentially addressing the underutilization of epilepsy surgery in drug-resistant focal epilepsy and thereby improving patient outcomes.
期刊介绍:
Epilepsy Research provides for publication of high quality articles in both basic and clinical epilepsy research, with a special emphasis on translational research that ultimately relates to epilepsy as a human condition. The journal is intended to provide a forum for reporting the best and most rigorous epilepsy research from all disciplines ranging from biophysics and molecular biology to epidemiological and psychosocial research. As such the journal will publish original papers relevant to epilepsy from any scientific discipline and also studies of a multidisciplinary nature. Clinical and experimental research papers adopting fresh conceptual approaches to the study of epilepsy and its treatment are encouraged. The overriding criteria for publication are novelty, significant clinical or experimental relevance, and interest to a multidisciplinary audience in the broad arena of epilepsy. Review articles focused on any topic of epilepsy research will also be considered, but only if they present an exceptionally clear synthesis of current knowledge and future directions of a research area, based on a critical assessment of the available data or on hypotheses that are likely to stimulate more critical thinking and further advances in an area of epilepsy research.