Computational facial analysis for rare Mendelian disorders

With the advances in computer vision, computational facial analysis has become a powerful and effective tool for diagnosing rare disorders. This technology, also called next-generation phenotyping (NGP), has progressed significantly over the last decade. This review paper will introduce three key NGP approaches. In 2014, Ferry et al. first presented Clinical Face Phenotype Space (CFPS) trained on eight syndromes. After 5 years, Gurovich et al. proposed DeepGestalt, a deep convolutional neural network trained on more than 21,000 patient images with 216 disorders. It was considered a state-of-the-art disorder classification framework. In 2022, Hsieh et al. developed GestaltMatcher to support the ultra-rare and novel disorders not supported in DeepGestalt. It further enabled the analysis of facial similarity presented in a given cohort or multiple disorders. Moreover, this article will present the usage of NGP for variant prioritization and facial gestalt delineation. Although NGP approaches have proven their capability in assisting the diagnosis of many disorders, many limitations remain. This article will introduce two future directions to address two main limitations: enabling the global collaboration for a medical imaging database that fulfills the FAIR principles and synthesizing patient images to protect patient privacy. In the end, with more and more NGP approaches emerging, we envision that the NGP technology can assist clinicians and researchers in diagnosing patients and analyzing disorders in multiple directions in the near future.