Design of an AMR Using Image Processing and Deep Learning for Monitoring Safety Aspects in Warehouse

Abstract

The latest spinoffs in the field of Autonomous Vehicles have paved way for a revolution in mobility and transportation; particularly in the warehousing and distribution sector. AMRs, Autonomous Mobile Robots, are being deployed to assist in warehousing activities as they present multiple advantages. In this paper, an AMR coupled with image processing and deep learning is introduced as a novel approach to solve a two-fold problem: surveillance and disinfection. Deep learning will make use of real-time data collected by the AMR’s camera as a smart surveillance method for abnormal event detection. YOLOv4 is used to train a custom dataset for object detection on five different classes. The latter obtained a 74.40% accuracy. The vehicle will also be used to diffuse disinfecting agents as a mean to sanitize the stores and stocks against Covid-19. Moreover, autonomous navigation of the AMR will be based on image processing techniques for path track detection.