Abstract Art by Shape Classification
Inhaltsverzeichnis
Reference
Yi-Zhe Song , David Pickup , Chuan Li , Paul Rosin , Peter Hall: Abstract Art by Shape Classification. IEEE Transactions on Visualization and Computer Graphics, v.19 n.8, p.1252-1263, August 2013
DOI
http://dx.doi.org/10.1109/TVCG.2013.13
Abstract
This paper shows that classifying shapes is a tool useful in nonphotorealistic rendering (NPR) from photographs. Our classifier inputs regions from an image segmentation hierarchy and outputs the "best” fitting simple shape such as a circle, square, or triangle. Other approaches to NPR have recognized the benefits of segmentation, but none have classified the shape of segments. By doing so, we can create artwork of a more abstract nature, emulating the style of modern artists such as Matisse and other artists who favored shape simplification in their artwork. The classifier chooses the shape that "best” represents the region. Since the classifier is trained by a user, the "best shape” has a subjective quality that can over-ride measurements such as minimum error and more importantly captures user preferences. Once trained, the system is fully automatic, although simple user interaction is also possible to allow for differences in individual tastes. A gallery of results shows how this classifier contributes to NPR from images by producing abstract artwork.
Extended Abstract
Bibtex
@ARTICLE{6461879,
author={Yi-Zhe Song and Pickup, D. and Chuan Li and Rosin, P. and Hall, P.},
journal={Visualization and Computer Graphics, IEEE Transactions on},
title={Abstract Art by Shape Classification},
year={2013},
volume={19},
number={8},
pages={1252-1263},
keywords={art;image classification;image segmentation;rendering (computer graphics);NPR;abstract art;classifier input region representation;classifier training;image segmentation hierarchy;nonphotorealistic rendering;shape classification;subjective quality;user interaction;user preferences;Art;Classification;Image segmentation;Rendering (computer graphics);Shape analysis;Nonphotorealistic rendering;abstract art;shape classification;shape fitting;Algorithms;Art;Humans;Image Processing, Computer-Assisted;Photography},
doi={10.1109/TVCG.2013.13},
url ={http://dx.doi.org/10.1109/TVCG.2013.13 http://de.evo-art.org/index.php?title=Abstract_Art_by_Shape_Classification },
ISSN={1077-2626},
month={Aug},
}
Used References
P. Haeberli "Paint by Numbers: Abstract Image Representations", Proc. 17th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), vol. 4, no. 24, pp.207 -214 http://dx.doi.org/10.1145/97879.97902
M.P. Salisbury, S.E. Anderson, R. Barzel and D.H. Salesin "Interactive Pen-and-Ink Illustration", Proc. 21st Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp.101 -108 http://dx.doi.org/10.1145/192161.192185
T. Cockshott, J. Patterson and D. England "Modelling the Texture of Paint", Computer Graphics Forum, vol. 11, no. 3, pp.217 -226 http://dx.doi.org/10.1111/1467-8659.1130217
P. Litwinowicz "Processing Images and Video for an IMP Ressionist Effect", Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH,), pp.407 -414 http://dx.doi.org/10.1145/258734.258893
M.P. Salisbury, M.T. Wong, J.F. Hughes and D.H. Salesin "Orientable Textures for Image-Based Pen-and-Ink Illustration", Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp.401 -406 http://dx.doi.org/10.1145/258734.258890
P. Hall "Non-Photorealistic Rendering by Q-Mapping", Computer Graphics Forum, vol. 1, no. 18, pp.27 -39
C. Curtis, S. Anderson, J. Seims, K. Fleischer and D.H. Salesin "Computer-Generated Watercolor", Proc. 24th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp.421 -430 http://dx.doi.org/10.1145/258734.258896
S. Brooks "Mixed Media Painting and Portraiture", IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 5, pp.1041 -1054 2007 http://dx.doi.org/10.1109/TVCG.2007.1025
R. Vergne, D. Vanderhaeghe, J. Chen, P. Barla, X. Granier and C. Schlick "Implicit Brushes for Stylized Line-Based Rendering", Eurographics, http://dx.doi.org/10.1111/j.1467-8659.2011.01892.x
A. Hertzmann "Painterly Rendering with Curved Brush Strokes of Multiple Sizes", Proc. 25th Int'l Conf. Computer Graphics and Interactive Techniques (ACM SIGGRAPH), pp.453 -460 http://dx.doi.org/10.1145/280814.280951
J.P. Collomosse and P.M. Hall "Salience-Adaptive Painterly Rendering Using Genetic Search", Int'l J. Artificial Intelligence Tools, vol. 15, no. 4, pp.551 -576 http://dx.doi.org/10.1142/S0218213006002813
H. Winnem?ller, S. Olson and B. Gooch "Real-Time Video Abstraction", Proc. ACM SIGGRAPH, pp.1221 -1226 http://dx.doi.org/10.1145/1179352.1142018
H. Kang, S. Lee, C.K. and Chui "Flow-Based Image Abstraction", IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp.62 -76 2009 http://dx.doi.org/10.1109/TVCG.2008.81
P.L. Rosin and Y.K. Lai "Towards Artistic Minimal Rendering", Proc. Int'l Symp. Non-Photorealistic Animation and Rendering (NPAR), pp.119 -127 http://dx.doi.org/10.1145/1809939.1809953
J.E. Kyprianidis and H. Kang "Image and Video Abstraction by Coherence-Enhancing Filtering", Eurographics, http://dx.doi.org/10.1111/j.1467-8659.2011.01882.x
S.M.F. Treavett and M. Chen "Statistical Techniques for the Automated Synthesis of Non-Photorealistic Images", Proc. 15th Eurographics UK Conf., pp.201 -210
S. Paris, S.W. Hasinoff and J. Kautz "Local Laplacian Filters: Edge-Aware Image Processing with a Laplacian Pyramid", Proc. ACM SIGGRAPH 2011 papers, pp.68:1 -68:12 http://dx.doi.org/10.1145/1964921.1964963
D. DeCarlo and A. Santella "Stylization and Abstraction of Photographs", ACM Trans. Graphics, vol. 21, pp.769 -776 2002 http://dx.doi.org/10.1145/566654.566650
J.P. Collomosse and P.M. Hall "Painterly Rendering Using Image Salience", Proc. 20th Eurographics UK Conf., pp.122 -128 http://dx.doi.org/10.1109/EGUK.2002.1011281
J. Bangham, S. Gibson and R. Harvey "The Art of Scale-Space", Proc. Conf. British Machine Vision Assoc., pp.569 -578 http://dx.doi.org/10.5244/C.17.58
B. Gooch, G. Coombe and P. Shirley "Artistic Vision: Painterly Rendering Using Computer Vision techniques", Proc. Second ACM Symp. Non-Photorealistic Animation and Rendering, pp.83 -90 http://dx.doi.org/10.1145/508530.508545
P. Arbelaez, M. Maire, C. Fowlkes and J. Malik "From Contours to Regions: An Empirical Evaluation", Proc. IEEE Conf. Computer Vision and Pattern Recognition, http://dx.doi.org/10.1109/CVPR.2009.5206707
Y.-Z. Song, P. Arbelaez, P. Hall, C. Li and A. Balikai "Finding Semantic Structures in Image Hierarchies Using Laplacian Graph Energy", Proc. European Conf. Computer Vision (ECCV '10), pp.694 -707 http://dx.doi.org/10.1007/978-3-642-15561-1_50
D. Mould "A Stained Glass Image Filter", Proc. 14th Eurographics Workshop Rendering Techniques, pp.20 -25
V. Setlur and S. Wilkinson "Automatic Stained Glass Rendering", Proc. 24th Int'l Conf. Advances Computer Graphics (CGI), pp.682 -691 http://dx.doi.org/10.1007/11784203_66
J.P. Collomosse and P.M. Hall "Cubist Style Rendering from Photographs", IEEE Trans. Visualization and Computer Graphics, vol. 4, no. 9, pp.443 -453 2003 http://dx.doi.org/10.1109/TVCG.2003.1260739
J. Xu and C. Kaplan "Artistic Thresholding", Proc. Int'l Symp. Non-Photorealistic Animation and Rendering, pp.39 -47
J. Orchard and C. Kaplan "Cut-Out Image Mosaics", Proc. Int'l Symp. Non-Photorealistic Animation and Rendering, pp.79 -87 http://dx.doi.org/10.1145/1377980.1377997
H. Huang, L. Zhang and H.-C. Zhang "Arcimboldo-Like Collage Using Internet Images", Proc. SIGGRAPH Asia Conf., pp.155:1 -155:8 http://dx.doi.org/10.1145/2024156.2024189
J. Wang, Y. Xu, H. Shum and M. Cohen "Video Tooning", ACM Trans. Graphics, vol. 3, no. 23, pp.574 -583 2004 http://dx.doi.org/10.1145/1015706.1015763
J.P. Collomosse, D. Rowntree and P.M. Hall "Stroke Surfaces: Temporally Coherent Artistic Animations from Video", IEEE Trans. Visualization and Computer Graphics, vol. 11, no. 5, pp.540 -549 2005 http://dx.doi.org/10.1109/TVCG.2005.85
D. Mould "Region-Based Abstraction", pp.125 -148
J. Shi and J. Malik "Normalized Cuts and Image Segmentation", Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '97), pp.731 -737 http://dx.doi.org/10.1109/CVPR.1997.609407
T. Cour, F. Benezit and J. Shi "Spectral Segmentation with Multiscale Graph Decomposition", Proc. IEEE CS Conf. Computer Vision and Pattern Recognition (CVPR '05), vol. 2, pp.1124 -1131 http://dx.doi.org/10.1109/CVPR.2005.332
D. Martin, C. Fowlkes and J. Malik "Learning to Detect Natural Image Boundaries Using Local Brightness, Color and Texture Cues", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp.530 -549 2004 http://dx.doi.org/10.1109/TPAMI.2004.1273918
K. Voss and H. S??e "Invariant fitting of planar objects by primitives", IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 1, pp.80 -84 1997 http://dx.doi.org/10.1109/34.566815
H. S??e and K. Voss "A New Efficient Algorithm for Fitting of Rectangles and Squares", Proc. Int'l Conf. Image Processing, pp.809 -812
P.L. Rosin and G.A.W. West "Curve Segmentation and Representation by Superellipses", Proc. IEE Vision, Image, and Signal Processing, vol. 142, pp.280 -288 http://dx.doi.org/10.1049/ip-vis:19952140
W.H. Press, B.P. Flannery, S.A. Teukolsky and W.T. Vettering Numerical Recipes in C, 1990 :Cambridge Univ. Press
P.L. Rosin and C.L. Mumford "A Symmetric Convexity Measure", Computer Vision and Image Understanding, vol. 103, no. 2, pp.101 -111 http://dx.doi.org/10.1016/j.cviu.2006.04.002
A. Kolesnikov and P. Fr?nti "Optimal Algorithm for Convexity Measure Calculation", Proc. Int'l Conf. Image Processing, pp.353 -356 http://dx.doi.org/10.1109/ICIP.2005.1529760
J.R. Quinlan C4.5: Programs for Machine Learning, :Morgan Kaufmann Publishers Inc.
G. Sharma Digital Color Imaging Handbook, 2003 :CRC Press
Links
Full Text
https://www.researchgate.net/publication/237070508_Abstract_Art_by_Shape_Classification
