Face swapping in seizure videos for patient deidentification

Abstract

Objective

This study aimed to test different AI-based face-swapping models applied to videos of epileptic seizures, with the goal of protecting patient privacy while retaining clinically useful seizure semiology. We hypothesized that specific models would show differences in semiologic fidelity compared to the original clinical videos.

Methods

Three open-source models, SimSwap, MobileFaceSwap and GHOST were adopted for face-swapping. For every model, an AI generated male and female image were used to replace the original faces. One representative seizure per patient from three patients with epilepsy was chosen (3 seizure videos x 3 AI models x 2 M/F swap) and remade to 18 transformed video clips. To evaluate the performance of the three models, we used both objective (AI-based) and subjective (expert clinician) evaluation. The objective assessment included four metrics for facial appearance and four metrics for facial expression changes. Four experienced epileptologists reviewed the clips and scoring according to deidentification and preservation of semiology. Kruskal-Wallis H test was used for statistical analysis among the models.

Results

In the reproduced videos, the swapped face cannot be recognized as the original face, with no significant difference in scores of deidentification either by objective or subjective assessment. Regarding semiology preservation, no significant differences between models were observed in the objective evaluations. The subjective evaluations revealed that the GHOST model outperformed the other two models (p=0.028).

Conclusion

This is the first study evaluating AI face swapping models in epileptic seizure video clips. Optimization of AI face-swapping models could enhance the accessibility of seizure videos for education and research while protecting patient privacy and maintaining semiology.