Quasi-Feature based Panoramic Video Creation for Multiview Object Tracking System

Abstract

In this paper we present an efficient approach to building a panoramic video from mutiview cameras and to tracking objects. The proposed panoramic video creation module consists of two functions: (i) selecting four quasi-feature points in two adjacent frames acquired by corresponding multiple cameras and (ii) mosaicing the two images. Four pairs of selected quasi-feature points play a role of similarity reference in registering two adjacent frames. The mosaicing step uses the direct linear transformation (DLT) algorithm. The proposed tracking algorithm uses the active contour model (ASM), which is robust against partial occlusion. The proposed tracking module consists of four functions: (i) landmark point assignment, (ii) principal component analysis (PCA), (iii) modeling of local structure, and (iv) model fitting. While most conventional panoramic image creation methods are pixel-based, the proposed feature-based method provides more accurate tracking result. In the experiment, the created panoramic images exhibit high quality, which enables robust, real-time video tracking.

Keywords

• Object tracking
• panoramic video
• Image mosaicing
• multiview camera.