IEEE Access (Jan 2024)

Multi-Branch Feature Alignment Network for Misaligned and Occluded Person Re-Identification

  • Chunyan Lyu,
  • Hai Huang,
  • Lixi Zhang,
  • Wenting Zhu,
  • Zhengyang Wang,
  • Kejun Wang,
  • Caidong Jiao

DOI
https://doi.org/10.1109/ACCESS.2024.3492312
Journal volume & issue
Vol. 12
pp. 175445 – 175457

Abstract

Read online

As a pivotal computer vision technique, person re-identification (re-ID) assumes a paramount role in bolstering public security. During the process of computing feature similarities among person images, misaligned and occluded body parts may impede accurate identity retrieval. To mitigate these challenges, we introduce a Multi-Branch Feature Alignment Network (MBFA) comprising three distinct deep neural network branches. Primarily, the global feature branch is tailored to extract comprehensive features. Subsequently, the pose alignment branch is formulated to acquire segmented features via a specific feature-weighted fusion strategy. Finally, the semantic alignment branch is devised to derive high-order semantic features at a pixel level, enabling precise localization of visible parts in occluded pedestrians and focusing similarity computations on these regions. The integration of multi-scale feature information synergistically complements one another, resulting in feature alignment that augments the robustness and discrimination capabilities of the entire network. Consequently, MBFA adeptly mitigates the interferences caused by misalignment and occlusion. Across three prominent re-ID datasets and an occluded re-ID dataset, experimental results unequivocally affirm the superiority of our proposed methodology over existing state-of-the-art methods.

Keywords