The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Aug 2020)

REINFORCEMENT LEARNING HELPS SLAM: LEARNING TO BUILD MAPS

  • N. Botteghi,
  • B. Sirmacek,
  • R. Schulte,
  • M. Poel,
  • C. Brune

DOI
https://doi.org/10.5194/isprs-archives-XLIII-B4-2020-329-2020
Journal volume & issue
Vol. XLIII-B4-2020
pp. 329 – 335

Abstract

Read online

In this research, we investigate the use of Reinforcement Learning (RL) for an effective and robust solution for exploring unknown and indoor environments and reconstructing their maps. We benefit from a Simultaneous Localization and Mapping (SLAM) algorithm for real-time robot localization and mapping. Three different reward functions are compared and tested in different environments with growing complexity. The performances of the three different RL-based path planners are assessed not only on the training environments, but also on an a priori unseen environment to test the generalization properties of the policies. The results indicate that RL-based planners trained to maximize the coverage of the map are able to consistently explore and construct the maps of different indoor environments.