Particle System Parametrization with Bimanual Hand Gestures

Abstract

General approaches in computer graphics to compose visual effects (VFX) usually involve editing textual modules and parameters or constructing procedural node networks. These techniques are used in many game engine editors and digital contents creation (DCC) tools. However, contemporary interfaces arc not intuitive, especially for inexperienced users. Therefore, the main aim of this research is to develop an intuitive interface for visual effects design which is easy to use for beginners of design and creating DCC but still useful for advanced and expert VFX artists. In this project, we developed a particle system parametrization (to define a particle system) and instantiation interface with a hand gesture recognition system in a VR (virtual reality) environment. This project uses an HMD (head-mounted display) device that supports 6 degrees-of-frcedom (DoFs) and hand gesture recognition via its front cameras. In an immersive environment, the user composes a visual effect by answering questions shown on GUI with hand gestures. As a result of this project, we succeeded in developing an application, deployablc to Android-based HMDs, to compose visual effects in VR scenes. The application features an archiving system, so that an exported visual efTect can be imported into Unity Editor to use in other projects or game compositions. Therefore, our application can be easily integrated into a DCC production workflow (“pipeline”).