Occluded Street Objects Perception Algorithm of Intelligent Vehicles Based on 3D Projection Model

Abstract

We present a super perception system of intelligent vehicles for perceiving occluded street objects by collecting images from neighbor front vehicles V2V (vehicle to vehicle) video streams based on 3D projection model. This super power can avoid some serious accidents of driver-assistant systems or automatic driving systems which can only detect visible objects. Our street perception system can “see through” the front vehicles to realize detecting of the occluded street objects only by analyzing the pair images received from front and host (back) vehicles. Upon the 3D projection model based on the pair images, the system uses affine transformation to achieve augmented reality method to increase the visibility perspective of driver system. Experimental results on different datasets are shown to validate our approach. Evaluation method was first introduced into our perception system.