It is important to develop low-cost, fast and portable meat adulteration detection systems to ensure the meat authenticity and safety in complex market environments. A multi-channel spectral detection system for meat adulteration was developed in this study. The core hardware of the system mainly includes a designed spectral module and a Raspberry pi controller. The spectral module consists of three multi-channel spectral sensors and LED lamps with specific wavelengths, containing 18 channels covering a range of 410–940 nm. The software was developed based on PyQt5. After completing the construction of the system, the detection distance was discussed and determined to be 4 mm. Based on the spectral data collected by the developed system, the models for classifying pure mutton, pure pork, mutton flavour essence adulteration, colourant adulteration and adulterated mutton with pork were established and compared. Four intelligent optimisation algorithms were further used to improve the model performance. The results of the test set showed that the support vector classification (SVC) model optimised by a sparrow search algorithm (SSA) obtained the best classification performance, with an accuracy of 97.59% and a Kappa coefficient of 0.9696. After the SSA-SVC was incorporated into the sensor software, the system performance was evaluated using external validation samples. The overall accuracy of the system was 94.29%. The system took about 5.31 s to detect a sample, and the total weight of the system was 1.55 kg. Overall, the developed portable spectral system has considerable potential to rapidly and accurately discriminate adulterated mutton in the field.