IET Computer Vision (Oct 2020)

Stroke controllable style transfer based on dilated convolutions

  • Zhaopan Xu,
  • Juan Zhang,
  • Yu Zhang,
  • Mingquan Zhou,
  • Kang Li,
  • Shengling Geng,
  • Xiaojuan Zhang

DOI
https://doi.org/10.1049/iet-cvi.2019.0912
Journal volume & issue
Vol. 14, no. 7
pp. 505 – 516

Abstract

Read online

Transferring a photo to a stylised image with beautiful texture has become one of the most popular topics in computer vision and the application of image processing. Controlling the stroke size of the texture is one of the challenging problems in this task. Recent representative methods for such problem introduce a pyramid model to regulate receptive fields in the network. Meanwhile, dilated convolutions are proved to be a very efficient way to adjust receptive fields without losing resolution. By combining the advantages of both approaches and making special optimisation for VGG19 model for style transfer tasks, the authors propose to exploit dilated convolutions to extract texture information endowing the network with stroke controllable. Several sets of contrast experiments were conducted and results show that their algorithm can generate more attractive stylisation images and control stroke size flexibly. It demonstrates the superiority of applying dilated convolutions as a texture extraction method for maintaining more texture information and controlling stroke size.

Keywords