Fast Example-Based Stylization with Local Guidance

Daniel Sýkora
CTU in Prague, FEE
 
Ondřej Jamriška
CTU in Prague, FEE
 
Ondřej Texler
CTU in Prague, FEE
Jakub Fišer
Adobe Research
 
Michal Lukáč
Adobe Research
 
Jingwan Lu
Adobe Research
   
Eli Shechtman
Adobe Research

New! StyleBlit Unity plugin v3.0 released including source code!



Abstract

We present StyleBlit—an efficient example-based style transfer algorithm that can deliver high-quality stylized renderings in real-time on a single-core CPU. Our technique is especially suitable for style transfer applications that use local guidance - descriptive guiding channels containing large spatial variations. Local guidance encourages transfer of content from the source exemplar to the target image in a semantically meaningful way. Typical local guidance includes, e.g., normal values, texture coordinates or a displacement field. Contrary to previous style transfer techniques, our approach does not involve any computationally expensive optimization. We demonstrate that when local guidance is used, optimization-based techniques converge to solutions that can be well approximated by simple pixel-level operations. Inspired by this observation, we designed an algorithm that produces results visually similar to, if not better than, the state-of-the-art, and is several orders of magnitude faster. Our approach is suitable for scenarios with low computational budget such as games and mobile applications.

Full Text     Supplementary Material     Slides     Source Code     Unity Plugin     BibTeX

Computer Graphics Forum 38(2):83–91, 2019

(Eurographics 2019, Genoa, Italy, May 2019)

Supplementary Video


=> Back to main page <=