Crack instance segmentation using splittable transformer and position coordinates

Abstract

Vehicle and drone-mounted surveillance equipment face severe computational constraints, posing significant challenges for real-time, accurate crack segmentation. This paper introduces the crack location segmentation transformer (CLST) to address these issues. Images are processed to better resemble patches associated with cracks, enabling precise segmentation while significantly reducing the model’s computational load. To handle varying segmentation challenges, a range of models with different computational demands has been designed to suit diverse needs. The most lightweight model can be deployed for real-time use on edge devices. A module in the neck of the pipeline encodes crack coordinate information, and end-to-end training has resulted in state-of-the-art performance across multiple datasets.