Collaborative Filtering of Color Aesthetics

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Peter O'Donovan, Aseem Agarwala and Aaron Hertzmann: Collaborative Filtering of Color Aesthetics. In: Computational Aesthetics 2014.



This paper investigates individual variation in aesthetic preferences, and learns models for predicting the preferences of individual users. Preferences for color aesthetics are learned using a collaborative filtering approach on a large dataset of rated color themes/palettes. To make predictions, matrix factorization is used to estimate latent vectors for users and color themes. We also propose two extensions to the probabilistic matrix factorization framework. We first describe a feature-based model using learned transformations from feature vectors to a latent space, then extend this model to non-linear transformations using a neural network. These extensions allow our model to predict preferences for color themes not present in the training set. We find that our approach for modelling user preferences outperforms an average aesthetic model which ignores personal variation. We also use the model for measuring theme similarity and visualizing the space of color themes.

Extended Abstract


author = {O'Donovan, Peter and Agarwala, Aseem and Hertzmann, Aaron},
title = {Collaborative Filtering of Color Aesthetics},
booktitle = {Proceedings of the Workshop on Computational Aesthetics},
series = {CAe '14},
year = {2014},
isbn = {978-1-4503-3019-0},
location = {Vancouver, British Columbia, Canada},
pages = {33--40},
numpages = {8},
url = { },
doi = {10.1145/2630099.2630100},
acmid = {2630100},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {aesthetics, collaborative filtering, color, design, machine learning},

Used References

Adams, R. P., Dahl, G. E., and Murray, I. 2010. Incorporating Side Information Into Probabilistic Matrix Factorization Using Gaussian Processes. In Proc. UAI.

Chumki Basu , Haym Hirsh , William Cohen, Recommendation as classification: using social and content-based information in recommendation, Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence, p.714-720, July 1998, Madison, Wisconsin, USA

V. Bychkovsky , S. Paris , E. Chan , F. Durand, Learning photographic global tonal adjustment with a database of input/output image pairs, Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, p.97-104, June 20-25, 2011

Chen, T., Zheng, Z., Lu, Q., Z. W., and Yu, Y. 2011. Feature-based Matrix Factorization. Tech. rep., Apex Data and Knowledge Management Lab, Shanghai.

Ritendra Datta , Dhiraj Joshi , Jia Li , James Z. Wang, Studying aesthetics in photographic images using a computational approach, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria

Granger, G. W. 1952. Objectivity of Color Preferences. Nature 170, 4332.

Ashish Kapoor , Juan C. Caicedo , Dani Lischinski , Sing Bing Kang, Collaborative Personalization of Image Enhancement, International Journal of Computer Vision, v.108 n.1-2, p.148-164, May 2014

Yehuda Koren , Robert Bell , Chris Volinsky, Matrix Factorization Techniques for Recommender Systems, Computer, v.42 n.8, p.30-37, August 2009

Landauer, T. K., and Dumais, S. T. 1997. A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. Psychological Review.

Li, C., and Chen, T. 2009. Aesthetic Visual Quality Assessment of Paintings. Sel. Topics in Signal Processing 3, 2.

Sharon Lin , Pat Hanrahan, Modeling how people extract color themes from images, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 27-May 02, 2013, Paris, France

Lin, S., Ritchie, D., Fisher, M., and Hanrahan, P. 2013. Probabilistic Color-by-Numbers: Suggesting Pattern Colorizations Using Factor Graphs.

Luca Marchesotti , Florent Perronnin , Diane Larlus , Gabriela Csurka, Assessing the aesthetic quality of photographs using generic image descriptors, Proceedings of the 2011 International Conference on Computer Vision, p.1784-1791, November 06-13, 2011

Martindale, C., Moore, K., and Borkum, J. 1990. Aesthetic Preference. The American Journal of Psychology.

Anush K. Moorthy , Pere Obrador , Nuria Oliver, Towards computational models of the visual aesthetic appeal of consumer videos, Proceedings of the 11th European conference on Computer vision: Part V, September 05-11, 2010, Heraklion, Crete, Greece

Peter O'Donovan , Aseem Agarwala , Aaron Hertzmann, Color compatibility from large datasets, ACM Transactions on Graphics (TOG), v.30 n.4, July 2011

Ou, L.-C., and Luo, M. R. 2006. A Color Harmony Model for Two-Color Combinations. Col. Res. Appl 31, 5, 191--204.

Palmer, S., and Griscom, W. 2013. Accounting for Taste: Individual Differences in Preference for Harmony. Psychon Bull Rev.

Prem Melville, R. M., and Nagarajan, R. 2001. Content-boosted Collaborative Filtering. In Proc. SIGIR Workshop on Recommender Systems.

Katharina Reinecke , Krzysztof Z. Gajos, Quantifying visual preferences around the world, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, April 26-May 01, 2014, Toronto, Ontario, Canada

Ruslan Salakhutdinov , Andriy Mnih, Bayesian probabilistic matrix factorization using Markov chain Monte Carlo, Proceedings of the 25th international conference on Machine learning, p.880-887, July 05-09, 2008, Helsinki, Finland

Salakhutdinov, R., and Mnih, A. 2008. Probabilistic Matrix Factorization. In Proc. NIPS.

Schloss, K. B., and Palmer, S. E. 2010. Aesthetics of Color Combinations. In Human Vision and Elec. Imaging, 752719.

Xiaoyuan Su , Taghi M. Khoshgoftaar, A survey of collaborative filtering techniques, Advances in Artificial Intelligence, 2009, p.2-2, January 2009

Szabó, F., Bodrogi, P., and Schanda, J. 2010. Experimental Modeling of Colour Harmony. Col. Res. Appl 35, 1, 34--39.

Tibshirani, R. 1996. Regression Shrinkage and Selection Via the Lasso. Royal. Statist. Soc B 58, 1, 267--288.

van der Maaten, L., and Hinton, G. 2008. Visualizing High-Dimensional Data Using t-SNE. Journal of Machine Learning Research 9, 2579--2605.

Baoyuan Wang , Yizhou Yu , Tien-Tsin Wong , Chun Chen , Ying-Qing Xu, Data-driven image color theme enhancement, ACM Transactions on Graphics (TOG), v.29 n.6, December 2010

Ou Wu , Weiming Hu , Jun Gao, Learning to predict the perceived visual quality of photos, Proceedings of the 2011 International Conference on Computer Vision, p.225-232, November 06-13, 2011

Yu, L.-F., Yeung, S. K., Terzopoulos, D., and Chan, T. F. 2012. DressUp!: Outfit Synthesis Through Automatic Optimization.


Full Text

intern file

Sonstige Links