CFP last date
20 January 2025
Reseach Article

A Hierarchical Search Space Refinement and Filling for Exemplar based Image Inpainting

by S. Padmavathi, K. P. Soman
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 52 - Number 4
Year of Publication: 2012
Authors: S. Padmavathi, K. P. Soman
10.5120/8192-1563

S. Padmavathi, K. P. Soman . A Hierarchical Search Space Refinement and Filling for Exemplar based Image Inpainting. International Journal of Computer Applications. 52, 4 ( August 2012), 31-37. DOI=10.5120/8192-1563

@article{ 10.5120/8192-1563,
author = { S. Padmavathi, K. P. Soman },
title = { A Hierarchical Search Space Refinement and Filling for Exemplar based Image Inpainting },
journal = { International Journal of Computer Applications },
issue_date = { August 2012 },
volume = { 52 },
number = { 4 },
month = { August },
year = { 2012 },
issn = { 0975-8887 },
pages = { 31-37 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume52/number4/8192-1563/ },
doi = { 10.5120/8192-1563 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T20:51:25.926055+05:30
%A S. Padmavathi
%A K. P. Soman
%T A Hierarchical Search Space Refinement and Filling for Exemplar based Image Inpainting
%J International Journal of Computer Applications
%@ 0975-8887
%V 52
%N 4
%P 31-37
%D 2012
%I Foundation of Computer Science (FCS), NY, USA
Abstract

There are many real world scenarios where a portion of the image is damaged or lost. Restoring such an image without prior knowledge or a reference image is a difficult task. Image inpainting is a method that focuses on reconstructing the damaged or missing portion of images based on the information available from undamaged areas of the same image. The existing methods fill the missing area from the boundary. Their performance varies while reconstructing structures and textures and many of them restrict the size of the area to be inpainted. In this paper exemplar based inpainting is adopted in a hierarchical framework. A hierarchical search space refinement and hierarchical filling are proposed in this paper which increases the accuracy and handles the extra cost due to multi resolution processing in a better way. The former tries to select an exemplar suitable at all resolution levels restricting the search space from the lower resolution level. The later fills the region at lower resolution level whose results are taken to the higher levels. This makes the non boundary pixels known in the higher resolution level which in turn helps in search space refinement while increasing accuracy.

References
  1. P. PERONA AND J. MALIK, "Scale-Space Edge Detection Using Anisotropic Diffusion", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 12, No. 7, July 1990. URL:http://www. cs. berkeley. edu/~malik/papers/MP-aniso. pdf
  2. D. J. HEEGER AND J. R. BERGEN "Pyramid-Based Texture Analysis/Synthesis" Proceedings of SIGGRAPH 1995, pp 229-238, September 1995. URL: http://www. cns. nyu. edu/~david/ftp/reprints/heeger-siggraph95. pdf
  3. A. C. KOKARAM, R. D. MORRIS, W. J. FITZGERALD AND P. J. W. RAYNER, "Interpolation of Missing Data in Image Sequences",IEEE Transactions on Image Processing. Vol. 4. No. 11, Nov. 1995, pp 1509-1519. URL: http://www. robinmorris. org/sigproc/interpolation. pdf
  4. H. IGEHY AND L. PEREIRA, "Image Replacement through Texture Synthesis", Proceedings of the IEEE International Conference on Image Processing, October 1997. URL: http://graphics. stanford. edu/papers/texture_replace/texture_replace. pdf
  5. J. S. DE BONET, "Multi resolution sampling procedure for analysis and synthesis of texture images", in Proc. ACM Conference Computer Graphics (SIGGRAPH), volume 31, pages 361–368, 1997.
  6. V. CASELLES, J. M. MOREL, AND C. SBERT, "An Axiomatic Approach to Image Interpolation", IEEE Transactions on Image Processing, 7, Issue 3, Mar 1998, Page(s): 376 - 386.
  7. M. TUCERYAN AND A. K. JAIN, "Texture Analysis," Handbook of Pattern Recognition and Computer Vision, C. H. Chan, L. F. Pau, and P. S. P. Wang (Eds. ), Ch. 2, pp. 235-276, Singapore: World Scientific, 1998.
  8. A. EFROS AND T. LEUNG. "Texture synthesis by non-parametric sampling" . In Proc. Int. Conf. Computer Vision, pages 1033–1038, Kerkyra, Greece, September 1999.
  9. M. BERTALMIO, G. SAPIRO, V. CASELLES, AND C. BALLESTER, "Image Inpainting" Proceedings of the ACM SIGGRAPH Conference on Computer Graphics, SIGGRAPH2000, New Orleans, USA. July 2000, pp 417-424. URL: http://www. iua. upf. es/~mbertalmio/bertalmi. pdf
  10. M. BERTALMIO, A. L. BERTOZZI AND G. SAPIRO, "Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting", Proc. IEEE Computer Vision and Pattern Recognition (CVPR'01), Hawaii, December 2001. http://www. iua. upf. es/~mbertalmio/final-cvpr. pdf
  11. C. BALLESTER, M. BERTALMIO, V. CASELLES, G. SAPIRO, AND J. VERDERA, "Filling-in by Joint Interpolation of Vector Fields and Gray Levels", IEEE Transaction on Image Processing, 10, Issue 8, Aug 2001, Page(s): 1200 - 1211.
  12. M. M. OLIVIEIRA, B. BOWEN, R. MCKENNA AND Y. S. CHUNG, "Fast Digital Image Inpainting", Proceedings of the International Conference on Visualization, Imaging and Image Processing (VIIP 2001), Marbella, Spain 2001. Sep. 3-5, 2001, pp 261-266. URL: http://www. cs. sunysb. edu/~oliveira/pubs/inpainting. pdf
  13. T. F. CHAN AND J. SHEN, "Non-Texture Inpainting by Curvature-Driven Diffusions (CDD)", Journal Visual Communication and Image Representation, 12, Number 4, 2001, Page(s): 436 - 449.
  14. M. ASHIKHMIN. "Synthesizing natural textures". In Proc. ACM Symposium on Interactive 3D Graphics, pages 217–226, Research Triangle Park, NC, March 2001.
  15. A. EFROS and W. T. FREEMAN, "Image quilting for texture synthesis and transfer". In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), pages 341–346, Eugene Fiume, August 2001.
  16. A. HERTZMANN, C. JACOBS, N. OLIVER, B. CURLESS, and D. SALESIN, "Image analogies". In Proc. ACM Conf. Comp. Graphics (SIGGRAPH), Eugene Fiume, August 2001.
  17. C. BALLESTER, V. CASELLES, J. VERDERA, M. BERTALMIO, and G. SAPIRO. "A variational model for filling-in gray level and color images". In Proc. Int. Conf. Computer Vision, pages I: 10–16, Vancouver, Canada, June 2001.
  18. P. HARRISON, "A non-hierarchical procedure for re-synthesis of complex texture", in Proc. Int. Conf. Central Europe Computer Graphics, Visualization And Computer Vision, Plzen, Czech Republic, February 2001.
  19. S. MASNOU, "Disocclusion: A Variational Approach using Level Lines", IEEE Transactions on Signal Processing, 11, Issue 2, Feb 2002, Page(s): 68- 76.
  20. R. BORNARD, E. LECAN, L. LABORELLI AND J-H. CHENOT, "Missing Data Correction in Still Images and Image Sequences", ACM Multimedia 2002, Juan-les-Pins, France, Dec. 2002. URL: http://brava. ina. fr/papers/INA_Raphael_Bornard/RBornard_mm2002_preprint. pdf
  21. T. F. CHAN, J. SHEN AND L. VESE, "Variational PDE Models in Image Processing", UCLA Computational and Applied Mathematics Reports 02-61, Dec. 2002.
  22. J. SHEN, "Inpainting and the Fundamental Problem of Image Processing", SIAM News 36(5), June 2003. http://www. math. ucla. edu/~imagers/htmls/internalreport/ShenSIAM. pdf
  23. M. BERTALMIO, L. VESE, G. SAPIRO AND S. OSHER, "Simultaneous Structure and Texture Image Inpainting",in Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'03), volume 2, June 2003. URL: http://www. math. ucla. edu/~lvese/PAPERS/01211536. pdf
  24. A. CRIMINISI, P. PÉRES AND K. TOYAMA, "Object Removal by Exemplar-Based Inpainting", Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'03). URL: http://research. microsoft. com/vision/Cambridge/papers/criminisi_cvpr03. pdf
  25. I. DRORI, D. COHEN-OR AND H. YESHURUN, "Fragment-Based Image Completion", ACM Transactions on Graphics (TOG), volume 22 issue 3, July 2003. URL: http://portal. acm. org
  26. R. C. GONZALES AND R. E. WOODS, "Digital Image Processing", Second Edition, Prentice Hall, Inc. 2002. ISBN: 0-201-18075-8
  27. M. SONKA, V. HLAVAC AND R. BOYLE, "Image Processing, Analysis and Machine Vision", Second Edition, Brooks/Cole Publishing Company, 1999. ISBN: 0-534-95393-X
Index Terms

Computer Science
Information Sciences

Keywords

Image inpainting Hierarchical inpainting exemplar based inpainting