Study of a FPGA real-time multi-cameras cylindrical panorama video system with low latency and high performance

Abstract

This paper presents a method of real-time panoramic video system implemented by using FPGA. In order to meet the real-time and high-resolution requirements, a novel method based on pipeline CORDIC and look-up tables for simultaneous image transformations, such as lens distortion correction, perspective transformation and image cylinder projection has been developed. Taking the advantages of the high speed parallel architecture of FPGA and the developed novel algorithm modules, a real-time, low latency and high-performance panoramic video has been studied and developed. The video system presented in this paper could generate panoramic video of 5*1280(H)*720(V) @15FPS or 5*1280(H)*360(V) @30FPS in real-time. In order to display the panoramic video, a display module that can output the panoramic video in slide mode has also been built.