Federated learning and deep learning framework for MRI image and speech signal-based multi-modal depression detection

Adolescence is a significant period for developing skills and knowledge and learning about managing relationships and emotions by gathering attributes for maturity. Recently, Depression arises as a common mental health issue in adolescents and this affects the daily life of the person. This leads to educational and social impairments and this acts as a major risk for suicide. As a result, the identification and treatment for this disorder are essential. By applying Deep learning (DL) algorithms to medical data, the mental condition of a person can be predicted. However, the traditional deep learning models face the challenge in processing the huge sized data. Hence, FL has emerged as an efficient solution for addressing the data size issue of DL. Here, Depression detection in adolescents is carried out by considering the FL framework, which comprises two modules, namely the local module and the Global module. The detection process is done in the local module using the proposed Exponential African Pelican Optimization based Deep Convolutional Neural Network (ExpAPO-DCNN), whereas the Global module produces the aggregated output of the local module. In this research, FL utilizes the DL model in producing the output, where the DL model considered two modalities of inputs, such as speech signal and Magnetic Resonance Imaging (MRI) image. The processing steps used for this research are pre-processing, feature extraction and detection. For MRI and speech signals, all the above processes are carried out individually. Finally, both the outputs are fused utilizing the overlap coefficient. The ExpAPO-DCNN obtained accuracy, Loss, Root mean Squared error (RMSE), Mean Squared error (MSE), True Negative rate (TNR), and True Positive rate (TPR) of 98.00 %, 0.023, 0.058, 0.240, 97.90 %, and 96.30 %, respectively.