Feature Rescaling and Fusion for Tiny Object Detection

Abstract

Recent years have witnessed rapid developments on computer vision, however, there are still challenges in detecting tiny objects in a large-scale background. The tiny objects knowledge become sparse and weak due to their tiny size, which makes the tiny objects difficult to be detected with the common approaches. In this paper, a new network named Specific Characteristics based Feature Rescaling and Fusion (SFRF) is designed to detect tiny persons in a broad horizon and massive background. Different from the methods in general, a Nonparametric Adaptive Dense Perceiving Algorithm (NADPA) is designed to automatically select and generate a new resized feature map with the high density distribution of tiny objects. Then, a method called Many-For-One strategy is used for feature fusion of the feature pyramid network (FPN) layers to improve the feature representation and detection. Finally, an ensemble model method named hierarchical Coarse-to-fine mechanism is designed based on the proposed methods to further improve the performance. The experiments demonstrate that the proposed approach achieves an obvious performance improvement on tiny object detection than the existing approaches, and our approach has been awarded as the 1st-place in the first large-scale Tiny Object Detection (TOD) challenge.

Keywords

• Tiny object detection
• nonparametric adaptive selection
• feature fusion
• feature pyramid network
• ensemble model