Analysis on pulse rate variability for pilot workload assessment based on wearable sensor

Abstract

The workload levels of pilots directly affect their flight performance and the safety of the whole flight. To explore the real-time workload of pilots in different flight phases (takeoff, cruise, and landing), this paper leveraged National Aeronautics and Space Administration Task Load Index (NASA-TLX), a subjective evaluation scale, and PhotoPlethysmoGraphy (PPG) signals of 21 participants using a flight simulator and a wearable sensor. First, the workloads of pilots under different phases were explored by the NASA-TLX scales; secondly, the pulse rate variability (PRV) features were selected by variance analysis and random forest importance evaluation; finally, the performances of the k-nearest neighbor (KNN), random forest (RF), and support vector machine (SVM) were compared for workload levels identification. It is shown that the workloads are ranked as follows: landing > takeoff > cruise. SDNN, CVCD, CVNNI, LF, TP, SD2, and SD2/SD1 were used as selected features with significant differences in different flight phases. In addition, machine learning models can effectively identify pilot workloads, and feature selection enhances the performance of both KNN and RF classifiers. The best identification of workload was achieved using the selected PRV features as inputs to the KNN classifier, with an average accuracy of 88.9%. Our results indicate that the KNN classifier and PRV features are suitable for identifying pilot workload. The pilot workload is highest during the landing phase, which provides a reference for flight safety management. The findings from this research could contribute to developing a robust pilot workload detection system and improve current flight operation safety regulations.