Sensors (Sep 2024)

Latent Space Search-Based Adaptive Template Generation for Enhanced Object Detection in Bin-Picking Applications

  • Songtao Liu,
  • Yaonan Zhu,
  • Tadayoshi Aoyama,
  • Masayuki Nakaya,
  • Yasuhisa Hasegawa

DOI
https://doi.org/10.3390/s24186050
Journal volume & issue
Vol. 24, no. 18
p. 6050

Abstract

Read online

Template matching is a common approach in bin-picking tasks. However, it often struggles in complex environments, such as those with different object poses, various background appearances, and varying lighting conditions, due to the limited feature representation of a single template. Additionally, during the bin-picking process, the template needs to be frequently updated to maintain detection performance, and finding an adaptive template from a vast dataset poses another challenge. To address these challenges, we propose a novel template searching method in a latent space trained by a Variational Auto-Encoder (VAE), which generates an adaptive template dynamically based on the current environment. The proposed method was evaluated experimentally under various conditions, and in all scenarios, it successfully completed the tasks, demonstrating its effectiveness and robustness for bin-picking applications. Furthermore, we integrated our proposed method with YOLO, and the experimental results indicate that our method effectively improves YOLO’s detection performance.

Keywords