FCS-Net: Feather condition scoring of broilers based on dense feature fusion of RGB and thermal infrared images

Assessing the feather condition of broilers is crucial for monitoring the animal welfare status and detecting the occurrence of feather pecking activities. Currently, the feather condition of individual broilers is manually scored by trained experts. To provide a more objective and efficient tool for feather condition scoring, a novel deep learning-based model, named Feather Condition Scoring Network (FCS-Net), was proposed based on RGB and thermal infrared images. The FCS-Net model combined the ResNet18 architecture with the proposed Dense Feature Fusion (DFF) module, which can effectively learn the feature mapping relationship between RGB and thermal infrared images. Before inputting the images into the network, an image registration process was conducted to align the RGB and thermal infrared images. The results showed that the FCS-Net model had a good performance for feather condition scoring, with the Accuracy of 97.02%, the Precision of 96.99%, the Recall of 97.04%, the F₁ of 97.01%, and the Inference speed of 15.34 fps. Compared to the ResNet18_RGB model, which only utilise RGB images, the FCS-Net model showed notable improvements in Accuracy by 4.02%, Precision by 3.90%, Recall by 4.08%, and F₁ by 4.01%. Moreover, it was observed that the FCS-Net model focused more on the back region of the broilers through heatmap visualization. Furthermore, the algorithm was compared with six typical image recognition algorithms including VGG16, ResNet18, SE-ResNet18, DenseNet121, Mobilenet_V2, and Shufflenet_V2_x1_0, as well as the state-of-the-art (SOTA) feather condition assessment methods. The results showed that the FCS-Net model achieved better performance than the six algorithms and the SOTA feather condition assessment methods. This study provided a valuable reference for automated monitoring of feather condition scoring of broilers in smart farming.