Conveying Semantics through Visual Metaphor
Inhaltsverzeichnis
Referenz
Derrall Heath, David Norton, Dan Ventura: Conveying Semantics through Visual Metaphor. ACM Transactions on Intelligent Systems and Technology (TIST) - Special Issue on Linking Social Granularity and Functions: Volume 5 Issue 2, April 2014, 31:1--31:17.
DOI
http://dx.doi.org/10.1145/2589483
Abstract
In the field of visual art, metaphor is a way to communicate meaning to the viewer. We present a computational system for communicating visual metaphor that can identify adjectives for describing an image based on a low-level visual feature representation of the image. We show that the system can use this visual-linguistic association to render source images that convey the meaning of adjectives in a way consistent with human understanding. Our conclusions are based on a detailed analysis of how the system's artifacts cluster, how these clusters correspond to the semantic relationships of adjectives as documented in WordNet, and how these clusters correspond to human opinion.
Extended Abstract
Bibtex
@article{Heath:2014:CST:2611448.2589483,
author = {Heath, Derrall and Norton, David and Ventura, Dan},
title = {Conveying Semantics Through Visual Metaphor},
journal = {ACM Trans. Intell. Syst. Technol.},
issue_date = {April 2014},
volume = {5},
number = {2},
month = apr,
year = {2014},
issn = {2157-6904},
pages = {31:1--31:17},
articleno = {31},
numpages = {17},
url = {http://doi.acm.org/10.1145/2589483 http://axon.cs.byu.edu/papers/heath2012acmtist http://de.evo-art.org/index.php?title=Conveying_Semantics_through_Visual_Metaphor },
doi = {10.1145/2589483},
acmid = {2589483},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Visual metaphor, clustering, evolutionary art, neural networks},
}
Used References
1 Shumeet Baluja, Dean Pomerleau, and Todd Jochem. 1994. Towards automated artificial evolution for computer-generated images. Connect. Sci. 6, 325--354.
2 Blain Brown. 2011. Cinematography: Theory and Practice. Focal Press, Chapter 5, 67--75.
3 Ryszard S. Choras. 2007. Image feature extraction techniques and their applications for CBIR and biometrics systems. Int. J. Biol. Biomed. Eng. 1, 6--16.
4 Simon Colton, Jeremy Gow, Pedro Torres, and Paul Cairns. 2010. Experiments in objet trouvé browsing. In Proceedings of the 1st International Conference on Computational Creativity. 238--247.
5 Ritendra Datta , Dhiraj Joshi , Jia Li , James Z. Wang, Studying aesthetics in photographic images using a computational approach, Proceedings of the 9th European conference on Computer Vision, May 07-13, 2006, Graz, Austria http://dx.doi.org/10.1007/11744078_23
6 Steve Dipaola , Liane Gabora, Incorporating characteristics of human creativity into an evolutionary art algorithm, Genetic Programming and Evolvable Machines, v.10 n.2, p.97-110, June 2009 http://dx.doi.org/10.1007/s10710-008-9074-x
7 Christiane Fellbaum, Ed. 1998. WordNet: An Electronic Lexical Database. The MIT Press.
8 Charles Forceville. 1996. Pictorial Metaphor in Advertising. Routledge, New York.
9 John S. Gero. 1996. Creativity, emergence, and evolution in design. Knowl. Based Syst. 9, 435--448.
10 T. Gevers , A. W.M. Smeulders, PicToSeek: combining color and shape invariant features for image retrieval, IEEE Transactions on Image Processing, v.9 n.1, p.102-119, January 2000 http://dx.doi.org/10.1109/83.817602
11 Gary Greenfield. 2002. Color dependent computational aesthetics for evolving expressions. In Bridges: Mathematical Connections in Art, Music, and Science; Conference Proceedings, Reza Sarhangi, Ed., Central Plains Book Manufacturing, Winfield, KS, 9--16.
12 Gary Greenfield. 2007. Co-evolutionary methods in evolutionary art. In The Art of Artificial Evolution: A Handbook on Evolutionary Art and Music, Juan Romero and Penousal Machado, Eds., Springer, Berlin, 357--380.
13 Mark Hall , Eibe Frank , Geoffrey Holmes , Bernhard Pfahringer , Peter Reutemann , Ian H. Witten, The WEKA data mining software: an update, ACM SIGKDD Explorations Newsletter, v.11 n.1, June 2009 http://doi.acm.org/10.1145/1656274.1656278
14 Stuart Kaplan. 2005. Visual metaphors in print advertising for fashion products. In Handbook of Visual Communication: Theory, Methods, and Media, Ken Smith, Sandra Moriarty, Gretchen Barbatsis, and Keith Kenney, Eds., Lawrence Erlbaum Associates, Chapter 11, 167--177.
15 Irwin King , Cheuk Hang Ng , Ka Cheung Sia, Distributed content-based visual information retrieval system on peer-to-peer networks, ACM Transactions on Information Systems (TOIS), v.22 n.3, p.477-501, July 2004 http://doi.acm.org/10.1145/1010614.1010619
16 Congcong Li and Tsuhan Chen. 2009. Aesthetic visual quality assessment of paintings. IEEE J. Select. Topics Sig. Process. 3, 236--252.
17 Penousal Machado , Amílcar Cardoso, All the Truth About NEvAr, Applied Intelligence, v.16 n.2, p.101-118, March-April 2002 http://dx.doi.org/10.1023/A:1013662402341
18 David Norton, Derrall Heath, and Dan Ventura. 2010. Establishing appreciation in a creative system. In Proceedings of the 1st International Conference on Computational Creativity. 26--35.
19 David Norton, Derrall Heath, and Dan Ventura. 2011. Autonomously creating quality images. In Proceedings of the 2nd International Conference on Computational Creativity. 10--15.
20 David Oranchak, Evolutionary synthesis of photographic artwork using human fitness function derived from web-based social networks, Proceedings of the 9th annual conference on Genetic and evolutionary computation, July 07-11, 2007, London, England http://doi.acm.org/10.1145/1276958.1277399
21 Steven Rooke, Eons of genetically evolved algorithmic images, Creative evolutionary systems, Morgan Kaufmann Publishers Inc., San Francisco, CA, 2001
22 Jimmy Secretan , Nicholas Beato , David B. D'Ambrosio , Adelein Rodriguez , Adam Campbell , Jeremiah T. Folsom-Kovarik , Kenneth O. Stanley, Picbreeder: A case study in collaborative evolutionary exploration of design space, Evolutionary Computation, v.19 n.3, p.373-403, Fall 2011 http://dx.doi.org/10.1162/EVCO_a_00030
23 Karl Sims, Artificial evolution for computer graphics, ACM SIGGRAPH Computer Graphics, v.25 n.4, p.319-328, July 1991 http://doi.acm.org/10.1145/127719.122752
24 Stephen Todd , William Latham, Evolutionary Art and Computers, Academic Press, Inc., Orlando, FL, 1994 http://dl.acm.org/citation.cfm?id=561831&CFID=558819604&CFTOKEN=68186175
25 Grigorios Tsoumakas and Ioannis Katakis. 2007. Multi-label classification: An overview. Int. J. Data Warehousing Mining 3, 3, 1--13.
26 Tony Veale , Yanfen Hao, Comprehending and generating apt metaphors: a web-driven, case-based approach to figurative language, Proceedings of the 22nd national conference on Artificial intelligence, p.1471-1476, July 22-26, 2007, Vancouver, British Columbia, Canada http://dl.acm.org/citation.cfm?id=1619881&CFID=558819604&CFTOKEN=68186175
27 Tony Veale and Guofu Li. 1991. Creative introspection and knowledge acquisition: Learning about the world through introspective questions and exploratory metaphors. In Proceedings of the 25th AAAI Conference on Artificial Intelligence.
28 Wei-Ning Wang and Qianhua He. 2008. A survey on emotional semantic image retrieval. In Proceedings of the International Conference on Image Processing. 117--120.
29 Wei-Ning Wang, Ying-Lin Yu, and Sheng-Ming Jiang. 2006. Image retrieval by emotional semantics: A study of emotional space and feature extraction. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics 4, 3534--3539.
Links
Full Text
http://axon.cs.byu.edu/papers/heath2012acmtist
