Skip to main content
OSTI.GOVU.S. Department of Energy Office of Scientific and Technical Information
U.S. Department of Energy
Office of Scientific and Technical Information
 

A Nonlocal Feature-Driven Exemplar-Based Approach for Image Inpainting

Journal Article · · SIAM Journal on Imaging Sciences
DOI:https://doi.org/10.1137/20m1317864· OSTI ID:1756281
 [1];  [2];  [3]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  3. Univ. of Tennessee, Knoxville, TN (United States); Lirio LLC, Knoxville, TN (United States)
+ Show Author Affiliations
Here, we present a nonlocal variational image completion technique which admits simultaneous inpainting of multiple structures and textures in a unified framework. The recovery of geometric structures is achieved by using general convolution operators as a measure of behavior within an image. These are combined with a nonlocal exemplar-based approach to exploit the self-similarity of an image in the selected feature domains and to ensure the inpainting of textures. We also introduce an anisotropic patch distance metric to allow for better control of the feature selection within an image and present a nonlocal energy functional based on this metric. Finally, we derive an optimization algorithm for the proposed variational model and examine its validity experimentally with various test images.
Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
National Science Foundation (NSF); USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Grant/Contract Number:
AC04-94AL85000; AC05-00OR22725; NA0003525
OSTI ID:
1756281
Alternate ID(s):
OSTI ID: 1765740
Report Number(s):
SAND--2020-5690J
Journal Information:
SIAM Journal on Imaging Sciences, Journal Name: SIAM Journal on Imaging Sciences Journal Issue: 4 Vol. 13; ISSN 1936-4954
Publisher:
Society for Industrial and Applied MathematicsCopyright Statement
Country of Publication:
United States
Language:
English

References (31)

Filling-in by joint interpolation of vector fields and gray levels journal January 2001
Exemplar-Based Inpainting from a Variational Point of View journal January 2010
Geometrically Guided Exemplar-Based Inpainting journal January 2011
Low Dimensional Manifold Model for Image Processing journal January 2017
Image inpainting
  • Bertalmio, Marcelo; Sapiro, Guillermo; Caselles, Vincent
  • Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 https://doi.org/10.1145/344779.344972
conference January 2000
Non-local regularization of inverse problems journal January 2011
EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning preprint January 2019
Optimal approximations by piecewise smooth functions and associated variational problems journal July 1989
A Combined First and Second Order Variational Approach for Image Reconstruction journal May 2013
A Variational Framework for Exemplar-Based Image Inpainting journal January 2011
Nonlinear total variation based noise removal algorithms journal November 1992
Hitchhikerʼs guide to the fractional Sobolev spaces journal July 2012
Information Theory and Statistical Mechanics journal May 1957
Region Filling and Object Removal by Exemplar-Based Image Inpainting journal September 2004
Hierarchical Super-Resolution-Based Inpainting journal October 2013
Space-Time Completion of Video journal March 2007
A Review of Image Denoising Algorithms, with a New One journal January 2005
Analysis of a Two-Scale Cahn–Hilliard Model for Binary Image Inpainting journal January 2007
Nonlocal Linear Image Regularization and Supervised Segmentation journal January 2007
Nonlocal Operators with Applications to Image Processing journal January 2009
Cahn–Hilliard Inpainting and a Generalization for Grayvalue Images journal January 2009
Video Inpainting of Complex Scenes journal January 2014
Low Dimensional Manifold Model for Image Processing journal January 2017
Mathematical Models for Local Nontexture Inpaintings journal January 2002
Euler's Elastica and Curvature-Based Inpainting journal January 2003
A Nonlocal Vector Calculus, Nonlocal Volume-Constrained Problems, and Nonlocal Balance laws journal January 2013
PatchMatch: a randomized correspondence algorithm for structural image editing journal July 2009
Globally and locally consistent image completion journal July 2017
Combined First and Second Order Total Variation Inpainting using Split Bregman journal January 2013
Variational Framework for Non-Local Inpainting journal January 2015
Non-Local Patch-Based Image Inpainting journal January 2017

Similar Records

Inpainting with sparse linear combinations of exemplars
Journal Article · Mon Dec 31 23:00:00 EST 2007 · OSTI ID:960615
Coarse-to-fine Task-driven Inpainting for Geoscience Images
Journal Article · Mon May 15 20:00:00 EDT 2023 · IEEE Transactions on Circuits and Systems for Video Technology · OSTI ID:1993157

Related Subjects

97 MATHEMATICS AND COMPUTING
image inpainting
nonlocal
variational