Image Statistics for Clustering Paintings According to their Visual Appearance
Inhaltsverzeichnis
Reference
Marcel Spehr, Christian Wallraven, Roland W. Fleming: Image Statistics for Clustering Paintings According to their Visual Appearance. In: Oliver Deussen, Peter Hall (Eds.): Eurographics Workshop on Computational Aesthetics, 2009. 57-64
DOI
http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH09/057-064
Abstract
Untrained observers readily cluster paintings from different art periods into distinct groups according to their overall visual appearance or 'look' [WCF08]. These clusters are typically influenced by both the content of the paintings (e.g. portrait, landscape, still-life, etc.), and stylistic considerations (e.g. the 'flat' appearance of Gothic paintings, or the distinctive use of colour in Fauve works). Here we aim to identify a set of image measurements that can capture this 'naïve visual impression of art', and use these features to automatically cluster a database of images of paintings into appearance-based groups, much like an untrained observer. We combine a wide range of features from simple colour statistics, through mid-level spatial features to high-level properties, such as the output of face-detection algorithms, which are intended to correlate with semantic content. Together these features yield clusters of images that look similar to one another despite differences in historical period and content. In addition, we tested the performance of the feature library in several classification tasks yielding good results. Our work could be applied as a curatorial or research aid, and also provides insight into the image attributes that untrained subjects may attend to when judging works of art.
Extended Abstract
Bibtex
@inproceedings{Spehr:2009:ISC:2381286.2381297,
author = {Spehr, M. and Wallraven, C. and Fleming, R. W.},
title = {Image Statistics for Clustering Paintings According to Their Visual Appearance},
booktitle = {Proceedings of the Fifth Eurographics Conference on Computational Aesthetics in Graphics, Visualization and Imaging},
series = {Computational Aesthetics'09},
year = {2009},
isbn = {978-3-905674-17-0},
location = {Victoria, British Columbia, Canada},
pages = {57--64},
numpages = {8},
url = {http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH09/057-064, http://de.evo-art.org/index.php?title=Image_Statistics_for_Clustering_Paintings_According_to_their_Visual_Appearance },
doi = {10.2312/COMPAESTH/COMPAESTH09/057-064},
acmid = {2381297},
publisher = {Eurographics Association},
address = {Aire-la-Ville, Switzerland, Switzerland},
}
Used References
Christopher M. Bishop, Pattern Recognition and Machine Learning (Information Science and Statistics), Springer-Verlag New York, Inc., Secaucus, NJ, 2006 http://dl.acm.org/citation.cfm?id=1162264&CFID=588525319&CFTOKEN=29804931
Igor Berezhnoy , Eric Postma , Jaap van den Herik, Computer analysis of Van Gogh's complementary colours, Pattern Recognition Letters, v.28 n.6, p.703-709, April, 2007 http://dx.doi.org/10.1016/j.patrec.2006.08.002
Ana Ioana Deac , Jan van der Lubbe , Eric Backer, Feature selection for paintings classification by optimal tree pruning, Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security, September 11-13, 2006, Istanbul, Turkey http://dx.doi.org/10.1007/11848035_47
GRAHAM D., FIELD D.: Statistical regularities of art images and natural scenes: Spectra, sparseness and nonlinearities. Spatial Vision 21, 1 (2007), 149-164.
GOMBRICH E., HANS E.: The Story of Art. Phaidon Oxford, 1989.
HANCOCK P., BADDELEY R., SMITH L.: The principal components of natural images. Network: Computation in Neural Systems 3, 1 (1992), 61-70.
ICOGLU O., GUNSEL B., SARIEL S.: Arthistorian: An integrated indexing and personalized browsing system for art paintings.
ICOGLU O., GUNSEL B., SARIEL S.: Classification and indexing of paintings based on art movements. In Proc. of EUSIPCO, pp. 749-752.
OLIVA A., TORRALBA A.: Building the gist of a scene: the role of global image features in recognition. Visual Perception: Fundamentals of Awareness, Multi-Sensory Integration and High-Order Perception (2006).
Jaume Rigau , Miquel Feixas , Mateu Sbert, Informational dialogue with van Gogh's paintings, Proceedings of the Fourth Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, June 18-20, 2008, Lisbon, Portugal http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH08/115-122
Jianbo Shi , Jitendra Malik, Normalized Cuts and Image Segmentation, Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97), p.731, June 17-19, 1997 http://dl.acm.org/citation.cfm?id=794502&CFID=588525319&CFTOKEN=29804931
THORPE S., FIZE D., MARLOT C.: Speed of processing in the human visual system. Nature 381 (1996), 520-522.
Antonio Torralba , Kevin P. Murphy , William T. Freeman , Mark A. Rubin, Context-based vision system for place and object recognition, Proceedings of the Ninth IEEE International Conference on Computer Vision, p.273, October 13-16, 2003 http://dl.acm.org/citation.cfm?id=946665&CFID=588525319&CFTOKEN=29804931
TAYLOR R., MICOLICH A., JONAS D.: Fractal analysis of pollock's drip paintings. Nature (1999), 422-422.
VAN DER SCHAAF A., VAN HATEREN J.: Modelling the power spectra of natural images: Statistics and information. Vision Research 36, 17 (1996), 2759-2770.
Paul Viola , Michael J. Jones, Robust Real-Time Face Detection, International Journal of Computer Vision, v.57 n.2, p.137-154, May 2004 http://dx.doi.org/10.1023/B:VISI.0000013087.49260.fb
C. Wallraven , D. W. Cunningham , R. Fleming, Perceptual and computational categories in art, Proceedings of the Fourth Eurographics conference on Computational Aesthetics in Graphics, Visualization and Imaging, June 18-20, 2008, Lisbon, Portugal http://dx.doi.org/10.2312/COMPAESTH/COMPAESTH08/131-138
Links
Full Text
http://www.kyb.tuebingen.mpg.de/fileadmin/user_upload/files/publications/CAe2009_final_%5B0%5D.pdf
Sonstige Links
http://dl.acm.org/citation.cfm?id=2381286.2381297&coll=DL&dl=GUIDE&CFID=588525319&CFTOKEN=29804931
