573Accesses
12Citations
Abstract
Exemplar-based texture synthesis is defined as the process of generating, from an input texture sample, new texture images that are perceptually equivalent to the input. In the present work, we model texture self-similarity with conditional Gaussian distributions in the patch space in order to extend the use of stitching techniques. Then, a multiscale texture synthesis algorithm is introduced, where texture patches are modeled at each scale as spatially variable Gaussian vectors in the patch space. The Gaussian distribution for each patch is inferred from the set of its nearest neighbors in the patch space obtained from the input sample. This approach is tested over several real and synthetic texture images, and its results show the effectiveness of the proposed technique for a wide range of textures.
This is a preview of subscription content,log in via an institution to check access.
Access this article
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
Price includes VAT (Japan)
Instant access to the full article PDF.











Similar content being viewed by others
References
Aguerrebere, C., Gousseau, Y., Tartavel, G.: Exemplar-based texture synthesis: the efros-leung algorithm. Image Process. On Line2013, 213–231 (2013)
Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 217–226. ACM, New York (2001)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.: Patchmatch: a randomized correspondence algorithm for structural image editing. ACM Trans. Graph. TOG28(3), 24 (2009)
Briand, T., Vacher, J., Galerne, B., Rabin, J.: The Heeger & Bergen pyramid based texture synthesis algorithm. Image Process. On Line4, 276–299 (2014)
Efros, A., Leung, T.K., et al.: Texture synthesis by non-parametric sampling. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision, 1999, vol. 2, pp. 1033–1038. IEEE, Washington, DC(1999)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, pp. 341–346. ACM, New York (2001)
Fedorov, V., Facciolo, G., Arias, P.: Variational framework for non-local inpainting. Image Process. On Line5, 362–386 (2015). doi:10.5201/ipol.2015.136
Galerne, B., Gousseau, Y., Morel, J.M.: Micro-texture synthesis by phase randomization. Image Process. On Line (2011). doi:10.5201/ipol.2011.ggm_rpn
Galerne, B., Gousseau, Y., Morel, J.M.: Random phase textures: theory and synthesis. IEEE Trans. Image Process.20(1), 257–267 (2011)
Gatys, L.A., Ecker, A.S., Bethge, M.: Texture synthesis and the controlled generation of natural stimuli using convolutional neural networks. arXiv preprintarXiv:1505.07376 (2015)
Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, pp. 229–238. ACM, New York (1995)
Julesz, B.: Visual pattern discrimination. IRE Trans. Inf. Theory8(2), 84–92 (1962)
Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Trans. Graph. (TOG)24, 795–802 (2005)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. (TOG)22, 277–286 (2003)
Lebrun, M., Buades, A., Morel, J.M.: Implementation of the “Non-Local Bayes” (NL-Bayes) image denoising algorithm. Image Process. On Line3, 1–42 (2013). doi:10.5201/ipol.2013.16
Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Trans. Graph. (TOG)24(3), 777–786 (2005)
Levina, E., Bickel, P.J.: Texture synthesis and nonparametric resampling of random fields. Ann. Stat.34, 1751–1773 (2006)
Liang, L., Liu, C., Xu, Y.Q., Guo, B., Shum, H.Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. (ToG)20(3), 127–150 (2001)
Morrison, D.F.: Multivariate Statistical Methods. McGraw-Hill, New York (1990)
Peyré, G.: Sparse modeling of textures. J. Math. Imaging Vis.34(1), 17–31 (2009)
Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vis.40(1), 49–70 (2000)
Raad, L., Desolneux, A., Morel, J.M.: Locally gaussian exemplar based texture synthesis. In: 2014 IEEE International Conference on Image Processing (ICIP), pp. 4667–4671. IEEE, Paris (2014)
Raad, L., Desolneux, A., Morel, J.M.: Conditional gaussian models for texture synthesis. In: Scale Space and Variational Methods in Computer Vision, pp. 474–485. Springer, Berlin (2015)
Raad, L., Desolneux, A., Morel, J.M.: Multiscale exemplar based texture synthesis by locally gaussian models. In: Iberoamerican Congress on Pattern Recognition (CIARP) (2015)
Tartavel, G., Gousseau, Y., Peyré, G.: Variational texture synthesis with sparsity and spectrum constraints. J. Math. Imaging Vis.52(1), 124–144 (2014)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 479–488. ACM Press/Addison-Wesley Publishing Co., New York (2000)
Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Eurographics 2009, State of the Art Report, EG-STAR, pp. 93–117. Eurographics Association, Munich (2009)
Acknowledgments
Work partly founded by the European Research Council (advanced Grant Twelve Labors) and the Office of Naval research (ONR Grant N00014-14-1-0023).
Author information
Authors and Affiliations
Centre de Mathématiques et de Leurs Applications, Ecole Normale Supérieure de Cachan, Université Paris-Saclay, 61, avenue du Président Wilson, 94235, Cachan Cedex, France
Lara Raad, Agnès Desolneux & Jean-Michel Morel
- Lara Raad
You can also search for this author inPubMed Google Scholar
- Agnès Desolneux
You can also search for this author inPubMed Google Scholar
- Jean-Michel Morel
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toLara Raad.
Rights and permissions
About this article
Cite this article
Raad, L., Desolneux, A. & Morel, JM. A Conditional Multiscale Locally Gaussian Texture Synthesis Algorithm.J Math Imaging Vis56, 260–279 (2016). https://doi.org/10.1007/s10851-016-0656-6
Received:
Accepted:
Published:
Issue Date:
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative