Collaborative Filtering of Color Aesthetics
Inhaltsverzeichnis
Reference
Peter O'Donovan, Aseem Agarwala and Aaron Hertzmann: Collaborative Filtering of Color Aesthetics. In: Computational Aesthetics 2014.
DOI
http://dx.doi.org/10.1145/2630099.2630100
Abstract
This paper investigates individual variation in aesthetic preferences, and learns models for predicting the preferences of individual users. Preferences for color aesthetics are learned using a collaborative filtering approach on a large dataset of rated color themes/palettes. To make predictions, matrix factorization is used to estimate latent vectors for users and color themes. We also propose two extensions to the probabilistic matrix factorization framework. We first describe a feature-based model using learned transformations from feature vectors to a latent space, then extend this model to non-linear transformations using a neural network. These extensions allow our model to predict preferences for color themes not present in the training set. We find that our approach for modelling user preferences outperforms an average aesthetic model which ignores personal variation. We also use the model for measuring theme similarity and visualizing the space of color themes.
Extended Abstract
Bibtex
@inproceedings{O'Donovan:2014:CFC:2630099.2630100,
author = {O'Donovan, Peter and Agarwala, Aseem and Hertzmann, Aaron},
title = {Collaborative Filtering of Color Aesthetics},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAe '14},
year = {2014},
isbn = {978-1-4503-3019-0},
location = {Vancouver, British Columbia, Canada},
pages = {33--40},
numpages = {8},
url = {http://doi.acm.org/10.1145/2630099.2630100 http://de.evo-art.org/index.php?title=Collaborative_Filtering_of_Color_Aesthetics },
doi = {10.1145/2630099.2630100},
acmid = {2630100},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {aesthetics, collaborative filtering, color, design, machine learning},
}
Used References
Adams, R. P., Dahl, G. E., and Murray, I. 2010. Incorporating Side Information Into Probabilistic Matrix Factorization Using Gaussian Processes. In Proc. UAI.
Chumki Basu , Haym Hirsh , William Cohen, Recommendation as classification: using social and content-based information in recommendation, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.714-720, July 1998, Madison, Wisconsin, USA http://dl.acm.org/citation.cfm?id=295795&CFID=588525319&CFTOKEN=29804931
V. Bychkovsky , S. Paris , E. Chan , F. Durand, Learning photographic global tonal adjustment with a database of input/output image pairs, Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, p.97-104, June 20-25, 2011 http://dx.doi.org/10.1109/CVPR.2011.5995413
Chen, T., Zheng, Z., Lu, Q., Z. W., and Yu, Y. 2011. Feature-based Matrix Factorization. Tech. rep., Apex Data and Knowledge Management Lab, Shanghai.
Ritendra Datta , Dhiraj Joshi , Jia Li , James Z. Wang, Studying aesthetics in photographic images using a computational approach, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria http://dx.doi.org/10.1007/11744078_23
Granger, G. W. 1952. Objectivity of Color Preferences. Nature 170, 4332.
Ashish Kapoor , Juan C. Caicedo , Dani Lischinski , Sing Bing Kang, Collaborative Personalization of Image Enhancement, International Journal of Computer Vision, v.108 n.1-2, p.148-164, May 2014 http://dx.doi.org/10.1007/s11263-013-0675-3
Yehuda Koren , Robert Bell , Chris Volinsky, Matrix Factorization Techniques for Recommender Systems, Computer, v.42 n.8, p.30-37, August 2009 http://dx.doi.org/10.1109/MC.2009.263
Landauer, T. K., and Dumais, S. T. 1997. A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. Psychological Review.
Li, C., and Chen, T. 2009. Aesthetic Visual Quality Assessment of Paintings. Sel. Topics in Signal Processing 3, 2.
Sharon Lin , Pat Hanrahan, Modeling how people extract color themes from images, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 27-May 02, 2013, Paris, France http://doi.acm.org/10.1145/2470654.2466424
Lin, S., Ritchie, D., Fisher, M., and Hanrahan, P. 2013. Probabilistic Color-by-Numbers: Suggesting Pattern Colorizations Using Factor Graphs.
Luca Marchesotti , Florent Perronnin , Diane Larlus , Gabriela Csurka, Assessing the aesthetic quality of photographs using generic image descriptors, Proceedings of the 2011 International Conference on Computer Vision, p.1784-1791, November 06-13, 2011 http://dx.doi.org/10.1109/ICCV.2011.6126444
Martindale, C., Moore, K., and Borkum, J. 1990. Aesthetic Preference. The American Journal of Psychology.
Anush K. Moorthy , Pere Obrador , Nuria Oliver, Towards computational models of the visual aesthetic appeal of consumer videos, Proceedings of the 11th European conference on Computer vision: Part V, September 05-11, 2010, Heraklion, Crete, Greece http://dl.acm.org/citation.cfm?id=1888152&CFID=588525319&CFTOKEN=29804931
Peter O'Donovan , Aseem Agarwala , Aaron Hertzmann, Color compatibility from large datasets, ACM Transactions on Graphics (TOG), v.30 n.4, July 2011 http://doi.acm.org/10.1145/2010324.1964958
Ou, L.-C., and Luo, M. R. 2006. A Color Harmony Model for Two-Color Combinations. Col. Res. Appl 31, 5, 191--204.
Palmer, S., and Griscom, W. 2013. Accounting for Taste: Individual Differences in Preference for Harmony. Psychon Bull Rev.
Prem Melville, R. M., and Nagarajan, R. 2001. Content-boosted Collaborative Filtering. In Proc. SIGIR Workshop on Recommender Systems.
Katharina Reinecke , Krzysztof Z. Gajos, Quantifying visual preferences around the world, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 26-May 01, 2014, Toronto, Ontario, Canada http://doi.acm.org/10.1145/2556288.2557052
Ruslan Salakhutdinov , Andriy Mnih, Bayesian probabilistic matrix factorization using Markov chain Monte Carlo, Proceedings of the 25th international conference on Machine learning, p.880-887, July 05-09, 2008, Helsinki, Finland http://doi.acm.org/10.1145/1390156.1390267
Salakhutdinov, R., and Mnih, A. 2008. Probabilistic Matrix Factorization. In Proc. NIPS.
Schloss, K. B., and Palmer, S. E. 2010. Aesthetics of Color Combinations. In Human Vision and Elec. Imaging, 752719.
Xiaoyuan Su , Taghi M. Khoshgoftaar, A survey of collaborative filtering techniques, Advances in Artificial Intelligence, 2009, p.2-2, January 2009 http://dx.doi.org/10.1155/2009/421425
Szabó, F., Bodrogi, P., and Schanda, J. 2010. Experimental Modeling of Colour Harmony. Col. Res. Appl 35, 1, 34--39.
Tibshirani, R. 1996. Regression Shrinkage and Selection Via the Lasso. Royal. Statist. Soc B 58, 1, 267--288.
van der Maaten, L., and Hinton, G. 2008. Visualizing High-Dimensional Data Using t-SNE. Journal of Machine Learning Research 9, 2579--2605.
Baoyuan Wang , Yizhou Yu , Tien-Tsin Wong , Chun Chen , Ying-Qing Xu, Data-driven image color theme enhancement, ACM Transactions on Graphics (TOG), v.29 n.6, December 2010 http://doi.acm.org/10.1145/1882261.1866172
Ou Wu , Weiming Hu , Jun Gao, Learning to predict the perceived visual quality of photos, Proceedings of the 2011 International Conference on Computer Vision, p.225-232, November 06-13, 2011 http://dx.doi.org/10.1109/ICCV.2011.6126246
Yu, L.-F., Yeung, S. K., Terzopoulos, D., and Chan, T. F. 2012. DressUp!: Outfit Synthesis Through Automatic Optimization.
Links
Full Text
http://www.dgp.toronto.edu/~donovan/cfcolor/cfcolor.pdf
