Stylizing Video by Example

Ondřej Jamriška
CTU in Prague, FEE
 
Šárka Sochorová
CTU in Prague, FEE
 
Ondřej Texler
CTU in Prague, FEE
 
Michal Lukáč
Adobe Research
Jakub Fišer
Adobe Research
 
Jingwan Lu
Adobe Research
 
Eli Shechtman
Adobe Research
 
Daniel Sýkora
CTU in Prague, FEE



Abstract

We introduce a new example-based approach to video stylization, with a focus on preserving the visual quality of the style, user controllability and applicability to arbitrary video. Our method gets as input one or more keyframes that the artist chooses to stylize with standard painting tools. It then automatically propagates the stylization to the rest of the sequence. To facilitate this while preserving visual quality, we developed a new type of guidance for state-of-art patch-based synthesis, that can be applied to any type of video content and does not require any additional information besides the video itself and a user-specified mask of the region to be stylized. We further show a temporal blending approach for interpolating style between keyframes that preserves texture coherence, contrast and high frequency details. We evaluate our method on various scenes from real production setting and provide a thorough comparison with prior art.

Full Text     Supplementary Material     Demo     BibTeX

ACM Transactions on Graphics 38(4):107, 2019

(SIGGRAPH 2019, Los Angeles, USA, July 2019)

Publicly Available Implementation

EbSynth

Supplementary Videos





Exhibition

Media

 


=> Back to main page <=