A Music Playback Control System Based on Facial Expression Recognition

Abstract

An intelligent music playback control system, which can select the appropriate music to play according to the facial expression recognition result, is designed. The hardware system consists of PYNQ_Z2 development board, camera, HDMI display and audio. The software system performs face detection on the core chip of ARM + FPGA through Haar feature and Adaboost algorithm, and realizes expression recognition through LDA and K nearest neighbor algorithm. The expression recognition results are sub-classified by confidence, and the PID control algorithm is used to adjust the confidence to improve the robustness of the system during uneven illumination. The system has low delay, strong robustness and rich human-computer interaction, and has a wide range of application scenarios.