Point cloud completion by dynamic transformer with adaptive neighbourhood feature fusion

Abstract

Abstract Point cloud completion aims to reconstruct detailed structures from partial observations. However, previous methods often suffered from inaccurate neighbourhood feature extraction and rough reconstruction of complex structures, which is difficult to complete detailed semantic shapes. To solve this problem, we present a method that applies dynamic transformers with adaptive neighbourhood feature fusion operations to resume complete point clouds. Firstly, we propose an adaptive neighbourhood feature extraction module, which contains a learnable global neighbourhood selection strategy and a traditional local k‐nearest neighbour strategy to dynamically select neighbourhood points according to the shape of different objects. Secondly, we observed that traditional point generation methods based on folding‐series operations limit their capacity of generating complex and faithful shapes. Inspired by cell division, we regard the process of reconstructing as point splitting and propose a genetic hierarchical point generation module, which means current points can inherit shape features from previous points and generate more detailed structures of their own. Extensive experiments of point cloud completion are carried out on PCN and Completion3D datasets to verify the effectiveness of our method. The average category chamfer distances of our method are 7.17(×10−3) in PCN and 7.96(×10−4) in Completion3D, which has better completion performance than other methods.