Automatic Texture Guided Color Transfer and Colorization

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche

Reference

Benoit Arbelot, Romain Vergne, Thomas Hurtut, and Joëlle Thollot: Automatic Texture Guided Color Transfer and Colorization. In: Computational Aesthetics 2016 CAE'16, 21-32,

DOI

http://dx.doi.org/10.2312/exp.20161060

Abstract

This paper targets two related color manipulation problems: Color transfer for modifying an image's colors and colorization for adding colors to a grayscale image. Automatic methods for these two applications propose to modify the input image using a reference that contains the desired colors. Previous approaches usually do not target both applications and suffer from two main limitations: possible misleading associations between input and reference regions and poor spatial coherence around image structures. In this paper, we propose a unified framework that uses the textural content of the images to guide the color transfer and colorization. Our method introduces an edge-aware texture descriptor based on region covariance, allowing for local color transformations. We show that our approach is able to produce results comparable or better than state-of-the-art methods in both applications.

Extended Abstract

Bibtex

@inproceedings{Arbelot:2016:ATG:2981324.2981328, 

author = {Arbelot, B. and Vergne, R. and Hurtut, T. and Thollot, J.},
title = {Automatic Texture Guided Color Transfer and Colorization},
booktitle = {Proceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering},
series = {Expresive '16},
year = {2016},
location = {Lisbon, Portugal},
pages = {21--32},
numpages = {12},
url = {http://dx.doi.org/10.2312/exp.20161060 http://dl.acm.org/citation.cfm?id=2981324.2981328 http://de.evo-art.org/index.php?title=Automatic_Texture_Guided_Color_Transfer_and_Colorization},
ISSN = {1816-0859},
ISBN = {978-3-03868-000-0},
acmid = {2981328},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},

}

Used References

1 {AP10} An X., Pellacini F.: User-controllable color transfer. Computer Graphics Forum (2010). 2

2 Mathieu Aubry , Sylvain Paris , Samuel W. Hasinoff , Jan Kautz , Frédo Durand, Fast Local Laplacian Filters: Theory and Applications, ACM Transactions on Graphics (TOG), v.33 n.5, p.1-14, August 2014 http://doi.acm.org/10.1145/2629645

3 {Bal06} Balas B. J.: Texture synthesis and perception: using computational models to study texture representations in the human visual system. Vision Research 46, 3 (2006), 299--309. 2

4 Nicolas Bonneel , Kalyan Sunkavalli , Sylvain Paris , Hanspeter Pfister, Example-based video color grading, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://doi.acm.org/10.1145/2461912.2461939

5 {BT12} Bugeau A., Ta V.-T.: Patch-based image colorization. In Pattern Recognition (ICPR), 2012 21st International Conference on (2012), pp. 3058--3061. 2, 8, 9

6 Aurelie Bugeau , Vinh-Thong Ta , Nicolas Papadakis, Variational Exemplar-Based Image Colorization, IEEE Transactions on Image Processing, v.23 n.1, p.298-307, January 2014 http://dx.doi.org/10.1109/TIP.2013.2288929

7 Guillaume Charpiat , Matthias Hofmann , Bernhard Schölkopf, Automatic Image Colorization Via Multimodal Predictions, Proceedings of the 10th European Conference on Computer Vision: Part III, October 12-18, 2008, Marseille, France http://dx.doi.org/10.1007/978-3-540-88690-7_10

8 Hojin Cho , Hyunjoon Lee , Henry Kang , Seungyong Lee, Bilateral texture filtering, ACM Transactions on Graphics (TOG), v.33 n.4, July 2014 http://doi.acm.org/10.1145/2601097.2601188

9 {DX09} Dong Y., Xu D.: Interactive local color transfer based on coupled map lattices. In Proc. Computer-Aided Design and Computer Graphics (Aug 2009), pp. 146--149. 2

10 {FPC*15} Faridul H. S., Pouli T., Chamaret C., Stauder J., Reinhard E., Kuzovkin D., Tremeau A.: Colour mapping: A review of recent methods, extensions and applications. Computer Graphics Forum (2015). 2

11 {FSDH15} Frigo O., Sabater N., Demoulin V., Hellier P.: Optimal transportation for example-guided color transfer. In Computer Vision -- ACCV 2014, vol. 9005 of Lecture Notes in Computer Science. Springer International Publishing, 2015, pp. 655--670. 2, 8, 9

12 Raj Kumar Gupta , Alex Yong-Sang Chia , Deepu Rajan , Ee Sin Ng , Huang Zhiyong, Image colorization using similar images, Proceedings of the 20th ACM international conference on Multimedia, October 29-November 02, 2012, Nara, Japan http://doi.acm.org/10.1145/2393347.2393402

13 {HCS*09} Hong X., Chang H., Shan S., Chen X., Gao W.: Sigma set: A small second order statistical region descriptor. In Proc. IEEE CVPR (2009), pp. 1802--1809. 4, 6

14 Aaron Hertzmann , Charles E. Jacobs , Nuria Oliver , Brian Curless , David H. Salesin, Image analogies, Proceedings of the 28th annual conference on Computer graphics and interactive techniques, p.327-340, August 2001 http://doi.acm.org/10.1145/383259.383295

15 Hristina Hristova , Olivier Le Meur , Rémi Cozot , Kadi Bouatouch, Style-aware robust color transfer, Proceedings of the workshop on Computational Aesthetics, June 20-22, 2015, Istanbul, Turkey http://dl.acm.org/citation.cfm?id=2811244&CFID=558819604&CFTOKEN=68186175

16 Kaiming He , Jian Sun , Xiaoou Tang, Guided Image Filtering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.35 n.6, p.1397-1409, June 2013 http://dx.doi.org/10.1109/TPAMI.2012.213

17 Revital Irony , Daniel Cohen-Or , Dani Lischinski, Colorization by example, Proceedings of the Sixteenth Eurographics conference on Rendering Techniques, June 29-July 01, 2005, Konstanz, Germany http://dx.doi.org/10.2312/EGWR/EGSR05/201-210

18 Sou-Young Jin , Ho-Jin Choi , Yu-Wing Tai, A randomized algorithm for natural object colorization, Computer Graphics Forum, v.33 n.2, p.205-214, May 2014 http://dx.doi.org/10.1111/cgf.12294

19 {KCP15} Kuzovkin D., Chamaret C., Pouli T.: Descriptor-based image colorization and regularization. In Proc. Computational Color Imaging Workshop (2015), pp. 59--68. 2

20 Levent Karacan , Erkut Erdem , Aykut Erdem, Structure-preserving image smoothing via region covariances, ACM Transactions on Graphics (TOG), v.32 n.6, November 2013 http://doi.acm.org/10.1145/2508363.2508403

21 Anat Levin , Dani Lischinski , Yair Weiss, Colorization using optimization, ACM Transactions on Graphics (TOG), v.23 n.3, August 2004 http://doi.acm.org/10.1145/1015706.1015780

22 Shiguang Liu , Hanqiu Sun , Xiang Zhang, Selective color transferring via ellipsoid color mixture map, Journal of Visual Communication and Image Representation, v.23 n.1, p.173-181, January, 2012 http://dx.doi.org/10.1016/j.jvcir.2011.09.006

23 Fumio Okura , Kenneth Vanhoey , Adrien Bousseau , Alexei A. Efros , George Drettakis, Unifying color and texture transfer for predictive appearance manipulation, Proceedings of the 26th Eurographics Symposium on Rendering, June 24-26, 2015, Darmstadt, Germany http://dx.doi.org/10.1111/cgf.12678

24 {PAB*15} Pierre F., Aujol J.-F., Bugeau A., Papadakis N., Ta V.-T.: Luminance-chrominance model for image colorization. SIAM Journal on Imaging Sciences 8, 1 (2015), 536--563. 8, 9

25 François Pitié , Anil C. Kokaram , Rozenn Dahyot, Automated colour grading using colour distribution transfer, Computer Vision and Image Understanding, v.107 n.1-2, p.123-137, July, 2007 http://dx.doi.org/10.1016/j.cviu.2006.11.011

26 P. Perona , J. Malik, Scale-Space and Edge Detection Using Anisotropic Diffusion, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.7, p.629-639, July 1990 http://dx.doi.org/10.1109/34.56205

27 Tania Pouli , Erik Reinhard, Extended papers from NPAR 2010: Progressive color transfer for images of arbitrary dynamic range, Computers and Graphics, v.35 n.1, p.67-80, February, 2011 http://dx.doi.org/10.1016/j.cag.2010.11.003

28 Erik Reinhard , Michael Ashikhmin , Bruce Gooch , Peter Shirley, Color Transfer between Images, IEEE Computer Graphics and Applications, v.21 n.5, p.34-41, September 2001 http://dx.doi.org/10.1109/38.946629

29 Yichang Shih , Sylvain Paris , Frédo Durand , William T. Freeman, Data-driven hallucination of different times of day from a single outdoor photo, ACM Transactions on Graphics (TOG), v.32 n.6, November 2013 http://doi.acm.org/10.1145/2508363.2508419

30 Yu-Wing Tai , Jiaya Jia , Chi-Keung Tang, Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.747-754, June 20-26, 2005 http://dx.doi.org/10.1109/CVPR.2005.215

31 C. Tomasi , R. Manduchi, Bilateral Filtering for Gray and Color Images, Proceedings of the Sixth International Conference on Computer Vision, p.839, January 04-07, 1998 http://dl.acm.org/citation.cfm?id=939190&CFID=558819604&CFTOKEN=68186175

32 Oncel Tuzel , Fatih Porikli , Peter Meer, Region covariance: a fast descriptor for detection and classification, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria http://dx.doi.org/10.1007/11744047_45

33 Tomihisa Welsh , Michael Ashikhmin , Klaus Mueller, Transferring color to greyscale images, ACM Transactions on Graphics (TOG), v.21 n.3, July 2002 http://doi.acm.org/10.1145/566654.566576

34 Gui-Song Xia , Julie Delon , Yann Gousseau, Shape-based Invariant Texture Indexing, International Journal of Computer Vision, v.88 n.3, p.382-403, July 2010 http://dx.doi.org/10.1007/s11263-009-0312-3

35 Yong Xu , Sibin Huang , Hui Ji , Cornelia FermüLler, Scale-space texture description on SIFT-like textons, Computer Vision and Image Understanding, v.116 n.9, p.999-1013, September, 2012 http://dx.doi.org/10.1016/j.cviu.2012.05.003

36 Xuezhong Xiao , Lizhuang Ma, Color transfer in correlated color space, Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications, June 14-April 17, 2006, Hong Kong, China http://doi.acm.org/10.1145/1128923.1128974

37 Li Xu , Qiong Yan , Yang Xia , Jiaya Jia, Structure extraction from texture via relative total variation, ACM Transactions on Graphics (TOG), v.31 n.6, November 2012 http://doi.acm.org/10.1145/2366145.2366158

38 {YJ*93} Yellott Jr J. I., et al.: Implications of triple correlation uniqueness for texture statistics and the julesz conjecture. JOSA A 10, 5 (1993), 777--793. 2


Links

Full Text

intern file

Sonstige Links

http://dl.acm.org/citation.cfm?id=2981328&CFID=558819604&CFTOKEN=68186175

Abgerufen von „http://de.evo-art.org/index.php?title=Automatic_Texture_Guided_Color_Transfer_and_Colorization&oldid=33037“