HafaNet: An Efficient Coarse-to-Fine Facial Landmark Detection Network

Abstract

Facial landmark detection can be applied in various facial analysis tasks. It is a challenging problem due to the various poses and high real-time requirements. To balance accuracy and computational efficiency, we propose an efficient coarse-to-fine network by combining heatmap regression and lightweight coordinate regression to detect facial landmarks. The heatmap regression network branch employs an efficient spatial pyramid and attention mechanism to regress to a better quality heatmap. The lightweight coordinate regression network branch introduces the local region perceptron to make the small network focus on the region of interest. Our method develops the advantages of heatmap regression and coordinate regression, which can improve landmark detection. Moreover, we propose a novel two-stage FTS loss function that can further effectively solve the outlier problem in facial landmark detection. The comprehensive experiments demonstrate the effectiveness of our approach.

Keywords

• Facial landmark detection
• heatmap regression
• spatial pyramid
• attention mechanism