Nautilus

Recovering Regional Symmetry Transformations for Image Editing

Michal Lukáč
CTU in Prague, FEE
 
Daniel Sýkora
CTU in Prague, FEE
 
Kalyan Sunkavalli
Adobe Research
Eli Shechtman
Adobe Research
 
Ondřej Jamriška
CTU in Prague, FEE
 
Nathan Carr
Adobe Research
   
Tomáš Pajdla
CTU in Prague, FEE
   


Abstract

Natural images often exhibit symmetries that should be taken into account when editing them. In this paper we present Nautilus — a method for automatically identifying symmetric regions in an image along with their corresponding symmetry transformations. We compute dense local similarity symmetry transformations using a novel variant of the Generalised PatchMatch algorithm that uses Metropolis-Hastings sampling. We combine and refine these local symmetries using an extended Lucas-Kanade algorithm to compute regional transformations and their spatial extents. Our approach produces dense estimates of complex symmetries that are combinations of translation, rotation, scale, and reflection under perspective distortion. This enables a number of automatic symmetry-aware image editing applications including inpainting, rectification, beautification, and segmentation, and we demonstrate state-of-the-art applications for each of them.

Full Text     BibTeX

ACM Transactions on Graphics 36(4):108, 2017

(SIGGRAPH 2017, Los Angeles, USA, July 2017)

U.S. Patent No. 10,546,212

=> Back to main page <=