Re-identification for long-term tracking and management of health and welfare challenges in pigs

Abstract

The fine-grained management of farm animals using video analytics relies on long-term visual tracking of individual animals. When an individual is occluded or exits the camera's field of view, tracking can be lost. The problem of using visual features to re-assign identity after loss of tracking is known as re-identification. In the case of pigs, this problem is especially challenging due to the similar appearances of most individual animals within a pen.

To address this issue, an image-based pig re-identification method is developed that is invariant to pose, illumination, and camera viewpoint. This method allows pigs to be reidentified, enabling long-term monitoring. This approach uses a Vision-Transformer model (ViT) previously developed for person re-identification. The model was trained using specifically designed pig re-identification datasets with a diverse range of housing and management conditions. These datasets use overhead cameras, allowing an investigation of the effect of the detection approach on re-identification performance. Re-identification using a traditional axis-aligned pig detector was compared with a recently developed oriented pig detector that better matches the pig's pose when extracting the pig from the wider image. It was found that the use of an oriented detector led to improved performance. The proposed system achieved a peak rank-1 Cumulative Matching Characteristic (CMC) performance of 90.5%. Furthermore, it is shown that this model is capable of generalising across different farms, achieving an average rank-1 CMC 81.8% in the cross-farm setting. Finally, the proposed re-identification features can be incorporated into an existing multi-object tracking system to improve its performance at reacquiring pig identities when tracking is lost. Overall, this work demonstrates the potential of using visual re-identification features of pigs to enable individual-level animal management.