Frontiers in Virtual Reality (Jul 2022)

PARTI-A Haptic Virtual Reality Control Station for Model-Mediated Robotic Applications

  • Jean Elsner,
  • Jean Elsner,
  • Gerhard Reinerth,
  • Gerhard Reinerth,
  • Luis Figueredo,
  • Abdeldjallil Naceri,
  • Ulrich Walter,
  • Sami Haddadin

DOI
https://doi.org/10.3389/frvir.2022.925794
Journal volume & issue
Vol. 3

Abstract

Read online

In this paper, we introduce a tele-robotic station called “PARTI” that leverages state-of-the-art robotics and virtual reality technology to enable immersive haptic interaction with simulated and remote environments through robotic avatars. Our hardware-in-the-loop framework integrates accurate multibody system dynamics and frictional contacts with digital twins of our robots in a virtual environment with real-time computational capabilities. This model mediated hardware-in-the-loop approach to robotic control allows a teleoperator to use the PARTI system to teach, evaluate, and control various robotic applications. In the current contribution, we focus on the general system description, integrated simulation and control framework, and a series of experiments highlighting the advantages of our approach.

Keywords