Style-aware Robust Color Transfer
Inhaltsverzeichnis
Reference
Hristina Hristova, Olivier Le Meur, Rémi Cozot, and Kadi Bouatouch: Style-aware Robust Color Transfer. In: Computational Aesthetics 2015 CAE'15, 67-77.
DOI
http://dx.doi.org/10.2312/exp.20151180
Abstract
Transferring features, such as light and colors, between input and reference images is the main objective of color transfer methods. Current state-of-the-art methods focus mainly on the complete transfer of the light and color distributions. However, they do not successfully grasp specific light and color variations in image styles. In this paper, we propose a local method for carrying out a transfer of style between two images. Our method partitions both images to Gaussian distributed clusters by considering their main style features. These features are automatically determined by the classification step of our algorithm. Moreover, we present several novel policies for input/reference cluster mapping, which have not been tackled so far by previous methods. To complete the style transfer, for each pair of corresponding clusters, we apply a parametric color transfer method and a local chromatic adaptation transform. Results, subjective user evaluation as well as objective evaluation show that the proposed method obtains visually pleasing and artifact-free images, respecting the reference style.
Extended Abstract
Bibtex
@inproceedings{Hristova:2015:SRC:2811239.2811244,
author = {Hristova, Hristina and Le Meur, Olivier and Cozot, R{\'e}mi and Bouatouch, Kadi},
title = {Style-aware Robust Color Transfer},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAE '15},
year = {2015},
location = {Istanbul, Turkey},
pages = {67--77},
numpages = {11},
url = {http://dl.acm.org/citation.cfm?id=2811239.2811244 http://de.evo-art.org/index.php?title=Style-aware_Robust_Color_Transfer },
acmid = {2811244},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}
Used References
1 {ATR98} Aherne F. J., Thacker N. A., Rockett P. I.: The bhattacharyya metric as an absolute similarity measure for frequency coded data. Kybernetika 34, 4 (1998), 363--368. 10
2 {Bha46} Bhattacharyya A.: On a measure of divergence between two multinomial populations. Sankhyā: The Indian Journal of Statistics (1946), 401--406. 10
3 Nicolas Bonneel , Kalyan Sunkavalli , Sylvain Paris , Hanspeter Pfister, Example-based video color grading, ACM Transactions on Graphics (TOG), v.32 n.4, July 2013 http://dl.acm.org/citation.cfm?id=2461939&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2461912.2461939
4 {DL82} Dowson D., Landau B.: The frechet distance between multivariate normal distributions. Journal of multivariate analysis 12, 3 (1982), 450--455. 6
5 {DLR* 77} Dempster A. P., Laird N. M., Rubin D. B., et al.: Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal statistical Society 39, 1 (1977), 1--38. 3
6 {DMJRM00} De Maesschalck R., Jouan-Rimbaud D., Massart D. L.: The mahalanobis distance. Chemometrics and intelligent laboratory systems 50, 1 (2000), 1--18. 7
7 {Eva97} Evans L. C.: Partial differential equations and monge-kantorovich mass transfer. Current developments in mathematics 1999 (1997), 65--126. 3, 6
8 {FPC* 14} Faridul H. S., Pouli T., Chamaret C., Stauder J., Trémeau A., Reinhard E., et al.: A survey of color mapping and its applications. In Eurographics 2014-State of the Art Reports (2014), The Eurographics Association, pp. 43--67. 2
9 {FSDP14} Frigo O., Sabater N., Demoulin V., Pierre H.: Optimal transportation for example-guided color transfer. 12th Asian Conference on Computer Vision (ACCV) (2014). 2, 7, 10
10 Jun-yan Huo , Yi-lin Chang , Jing Wang , Xiao-xia Wei, Robust automatic white balance algorithm using gray color points in images, IEEE Transactions on Consumer Electronics, v.52 n.2, p.541-546, September 2006 http://dl.acm.org/citation.cfm?id=2278045&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TCE.2006.1649677
11 Youngbae Hwang , Joon-Young Lee , In So Kweon , Seon Joo Kim, Color Transfer Using Probabilistic Moving Least Squares, Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, p.3342-3349, June 23-28, 2014 http://dl.acm.org/citation.cfm?id=2679840&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/CVPR.2014.427
12 Jiangtao Kuang , Garrett M. Johnson , Mark D. Fairchild, iCAM06: A refined image appearance model for HDR image rendering, Journal of Visual Communication and Image Representation, v.18 n.5, p.406-414, October, 2007 http://dl.acm.org/citation.cfm?id=1287918&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.jvcir.2007.06.003
13 R. M. H. Nguyen , S. J. Kim , M. S. Brown, Illuminant Aware Gamut-Based Color Transfer, Computer Graphics Forum, v.33 n.7, p.319-328, October 2014 http://dl.acm.org/citation.cfm?id=2771667&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1111/cgf.12500
14 Richard Nock , Frank Nielsen, On Weighting Clustering, IEEE Transactions on Pattern Analysis and Machine Intelligence, v.28 n.8, p.1223-1235, August 2006 http://dl.acm.org/citation.cfm?id=1155427&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TPAMI.2006.168
15 I. Olkin , S. T. Rachev, Maximum submatrix traces for positive definite matrices, SIAM Journal on Matrix Analysis and Applications, v.14 n.2, p.390-397, April 1993 http://dl.acm.org/citation.cfm?id=153043&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1137/0614027
16 Francois Pitie , Anil C. Kokaram , Rozenn Dahyot, N-Dimensional Probablility Density Function Transfer and its Application to Colour Transfer, Proceedings of the Tenth IEEE International Conference on Computer Vision, p.1434-1439, October 17-20, 2005 http://dl.acm.org/citation.cfm?id=1097810&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/ICCV.2005.166
17 François Pitié , Anil C. Kokaram , Rozenn Dahyot, Automated colour grading using colour distribution transfer, Computer Vision and Image Understanding, v.107 n.1-2, p.123-137, July, 2007 http://dl.acm.org/citation.cfm?id=1266121&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.cviu.2006.11.011
18 Tania Pouli , Erik Reinhard, Progressive histogram reshaping for creative color transfer and tone reproduction, Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, June 07-10, 2010, Annecy, France http://dl.acm.org/citation.cfm?id=1809949&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/1809939.1809949
19 Tania Pouli , Erik Reinhard, Extended papers from NPAR 2010: Progressive color transfer for images of arbitrary dynamic range, Computers and Graphics, v.35 n.1, p.67-80, February, 2011 http://dl.acm.org/citation.cfm?id=1937406&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/j.cag.2010.11.003
20 Erik Reinhard , Michael Ashikhmin , Bruce Gooch , Peter Shirley, Color Transfer between Images, IEEE Computer Graphics and Applications, v.21 n.5, p.34-41, September 2001 http://dl.acm.org/citation.cfm?id=618848&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/38.946629
21 Yichang Shih , Sylvain Paris , Frédo Durand , William T. Freeman, Data-driven hallucination of different times of day from a single outdoor photo, ACM Transactions on Graphics (TOG), v.32 n.6, November 2013 http://dl.acm.org/citation.cfm?id=2508419&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1145/2508363.2508419
22 Maureen Stone, Field Guide to Digital Color, A. K. Peters, Ltd., Natick, MA, 2002 http://dl.acm.org/citation.cfm?id=863149&CFID=724111209&CFTOKEN=48939661
23 Yu-Wing Tai , Jiaya Jia , Chi-Keung Tang, Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization, Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1, p.747-754, June 20-26, 2005 http://dl.acm.org/citation.cfm?id=1068990&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/CVPR.2005.215
24 Zhou Wang , A. C. Bovik , H. R. Sheikh , E. P. Simoncelli, Image quality assessment: from error visibility to structural similarity, IEEE Transactions on Image Processing, v.13 n.4, p.600-612, April 2004 http://dl.acm.org/citation.cfm?id=2320551&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1109/TIP.2003.819861
25 {WDK* 13} Wu F., Dong W., Kong Y., Mei X., Paul J.-C., Zhang X.: Content-based colour transfer. In Computer Graphics Forum (2013), vol. 32, Wiley Online Library, pp. 190--203. 10
26 {Wis13} Wisslar V.: Illuminated Pixels: The Why, What, and How of Digital Lighting. Cengage Learning, 2013. 5
27 {XM09} Xiao X., Ma L.: Gradient-preserving color transfer. In Computer Graphics Forum (2009), vol. 28, Wiley Online Library, pp. 1879--1886. 2
28 M. -S. Yang, A survey of fuzzy clustering, Mathematical and Computer Modelling: An International Journal, v.18 n.11, p.1-16, December, 1993 http://dl.acm.org/citation.cfm?id=2262613&CFID=724111209&CFTOKEN=48939661 http://dx.doi.org/10.1016/0895-7177(93)90202-A
Links
Full Text
http://people.irisa.fr/Hristina.Hristova/styleCT_camera_ready.pdf
Sonstige Links
http://dl.acm.org/citation.cfm?id=2811244&CFID=724111209&CFTOKEN=48939661
