IEEE Access (Jan 2022)

Facial Landmark Detection With Learnable Connectivity Graph Convolutional Network

  • Le Quan Nguyen,
  • Van Dung Pham,
  • Yanfen Li,
  • Hanxiang Wang,
  • L. Minh Dang,
  • Hyoung-Kyu Song,
  • Hyeonjoon Moon

DOI
https://doi.org/10.1109/ACCESS.2022.3200037
Journal volume & issue
Vol. 10
pp. 94354 – 94362

Abstract

Read online

The conventional heatmap regression with deep networks has become one of the mainstream approaches for landmark detection. Despite their success, these methods do not exploit the overall landmarks structure. We present a new landmark detection which is capable to capture the overall structure of landmarks by modeling these landmarks as a graph structure. Our method combines a deep heatmap regression network with Graph Convolutional Network (GCN) into an end-to-end differentiable model. The proposed method can utilize both visual information and overall landmarks structure to localize landmarks from an image. The ad hoc spatial relationships between landmarks are learned naturally with GCN network. Experiments on multiple datasets show the robustness of the proposed method.

Keywords