Multi‐camera traffic scene mosaic based on camera calibration

Abstract

Abstract Recently, the traffic application based on vision in the single traffic‐monitoring scene has been widely studied and developed. However, cross‐regional research is still in its infancy. In order to help solve the application of cross‐regional traffic surveillance scenarios, this paper proposes a more reliable and accurate road scene mosaic method under multi‐camera surveillance. The mosaic road panorama contains physical information, which can be used to achieve a cross‐regional measurement. It also lays the foundation for vehicle spatial location, vehicle speed and traffic incident detection across regions. First, the mapping relationship between the three‐dimensional sub‐world coordinates and their corresponding two‐dimensional image coordinates is established by camera calibration. Second, the projection transformation relationship between two cameras is established by two sub‐world coordinate systems and their common information. Finally, we use the proposed inverse projection idea and translation vector relationship to complete the mosaic of two traffic‐monitoring road scenes. The experimental results show that the camera calibration accuracy can reach more than 97% in a single scene. The measurement accuracy of the mosaic block is over 95%. The experimental results show that the proposed method has a higher accuracy, which has great value in related theoretical research and practical applications.