IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (Jan 2023)

OFFS-Net: Optimal Feature Fusion-Based Spectral Information Network for Airborne Point Cloud Classification

  • Peipei He,
  • Kejia Gao,
  • Wenkai Liu,
  • Wei Song,
  • Qingfeng Hu,
  • Xingxing Cheng,
  • Shiming Li

DOI
https://doi.org/10.1109/JSTARS.2022.3223698
Journal volume & issue
Vol. 16
pp. 141 – 152

Abstract

Read online

Airborne laser scanning (ALS) point cloud classification is a necessary step for understanding 3-D scenes and their applications in various industries. However, the classification accuracy and efficiency are low: 1) point cloud classification methods lack effective filtering of the large number of traditional features, 2) significant category imbalance and coordinate scale problems in ALS point cloud classification. To address these problems, this article proposes an airborne LiDAR point cloud classification method based on deep learning network with optimal feature fusion-based spectral information. This method involves the following steps: First, multiscale point cloud features are extracted, and random forest method is used to filter the features, while spectral information is fused to obtain a point cloud feature dataset with less but better data. Second, to adapt to the characteristics of the airborne point cloud, the improved RandLA-Net can simultaneously retain the advantages of random sampling and learn deeper semantic information by fusing the constructed point cloud features with the local feature aggregation module in the network. Third, four fusion models are constructed to verify the effectiveness of the optimal feature fusion-based spectral information network (OFFS-Net) model for airborne point cloud classification. Last, these models are trained and tested on Vaihingen 3-D dataset. The OFFS-Net achieves overall accuracy score of 84.9% and F1-score of 72.3%, which are better than the mainstream methods. This also validates that the proposed OFFS-Net point cloud classification method, based on the advantages of geometric feature and spectral information is excellent.

Keywords