e-Prime: Advances in Electrical Engineering, Electronics and Energy (Mar 2023)

Toward universal texture synthesis by combining texton broadcasting with noise injection in StyleGAN-2

  • Jue Lin,
  • Gaurav Sharma,
  • Thrasyvoulos N. Pappas

Journal volume & issue
Vol. 3
p. 100092

Abstract

Read online

We present a universal texture synthesis approach that incorporates a novel multiscale texton broadcasting module in the StyleGAN-2 framework. The texton broadcasting module introduces an inductive bias, enabling generation of a broader range of textures, from those with regular structures to completely stochastic ones. To train and evaluate the proposed approach, we construct a comprehensive high-resolution dataset, NUUR-Texture500, that captures the diversity of natural textures as well as stochastic variations within each perceptually uniform texture. Experimental results demonstrate that the proposed approach yields significantly better quality textures than the state of the art. The ultimate goal of this work is a comprehensive understanding of texture space.

Keywords