We introduce a novel approach to example-based stylization of portrait videos that preserves both the subject's identity and the visual richness of the input style exemplar. Unlike the current state-of-the-art based on neural style transfer [Selim et al. 2016], our method performs non-parametric texture synthesis that retains more of the local textural details of the artistic exemplar and does not suffer from image warping artifacts caused by aligning the style exemplar with the target face. Our method allows the creation of videos with less than full temporal coherence [Ruder et al. 2016]. By introducing a controllable amount of temporal dynamics, it more closely approximates the appearance of real hand-painted animation in which every frame was created independently. We demonstrate the practical utility of the proposed solution on a variety of style exemplars and target videos.

Full Text     Slides     Demo     BibTeX

ACM Transactions on Graphics 36(4):155, 2017

(SIGGRAPH 2017, Los Angeles, USA, July 2017)

U.S. Patent No. 10,504,267

Puppetron announced at Adobe MAX 2017

FaceStyle (demo) released at SIGGRAPH 2017

Comparison

Style Exemplar

Our Result

Style Exemplar

Our Result

Publicly available implementations

Media