The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Jun 2019)

FULLY CONVOLUTIONAL NETWORKS FOR STREET FURNITURE IDENTIFICATION IN PANORAMA IMAGES

  • Y. Ao,
  • J. Wang,
  • M. Zhou,
  • R. C. Lindenbergh,
  • M. Y. Yang

DOI
https://doi.org/10.5194/isprs-archives-XLII-2-W13-13-2019
Journal volume & issue
Vol. XLII-2-W13
pp. 13 – 20

Abstract

Read online

Panoramic images are widely used in many scenes, especially in virtual reality and street view capture. However, they are new for street furniture identification which is usually based on mobile laser scanning point cloud data or conventional 2D images. This study proposes to perform semantic segmentation on panoramic images and transformed images to separate light poles and traffic signs from background implemented by pre-trained Fully Convolutional Networks (FCN). FCN is the most important model for deep learning applied on semantic segmentation for its end to end training process and pixel-wise prediction. In this study, we use FCN-8s model that pre-trained on cityscape dataset and finetune it by our own data. The results show that in both pre-trained model and fine-tuning, transformed images have better prediction results than panoramic images.