Evolving Expression of Emotions Through Color In Virtual Humans Using Genetic Algorithms

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Celso M. de Melo, Jonathan Gratch: Evolving Expression of Emotions Through Color In Virtual Humans Using Genetic Algorithms. In: Computational Creativity 2010 ICCC 2010. 248-257.



For centuries artists have been exploring the formal elements of art (lines, space, mass, light, color, sound, etc.) to express emotions. This paper takes this insight to explore new forms of expression for virtual humans which go beyond the usual bodily, facial and vocal expression channels. In particular, the paper focuses on how to use color to influence the perception of emotions in virtual humans. First, a lighting model and filters are used to manipulate color. Next, an evolutionary model, based on genetic algorithms, is developed to learn novel associations between emotions and color. An experiment is then conducted where non-experts evolve mappings for joy and sadness, without being aware that genetic algorithms are used. In a second experiment, the mappings are analyzed with respect to its features and how general they are. Results indicate that the average fitness increases with each new generation, thus suggesting that people are succeeding in creating novel and useful mappings for the emotions. Moreover, the results show consistent differences between the evolved images of joy and the evolved images of sadness.

Extended Abstract


author = {Celso M. de Melo, Jonathan Gratch},
title = {Evolving Expression of Emotions Through Color In Virtual Humans Using Genetic Algorithms},
editor = {Dan Ventura, Alison Pease, Rafael P ́erez y P ́erez, Graeme Ritchie and Tony Veale},
booktitle = {Proceedings of the First International Conference on Computational Creativity},
series = {ICCC2010},
year = {2010},
month = {January},
location = {Lisbon, Portugal},
pages = {248-257},
url = {http://computationalcreativity.net/iccc2010/papers/de-melo-gratch.pdf, http://de.evo-art.org/index.php?title=Evolving_Expression_of_Emotions_Through_Color_In_Virtual_Humans_Using_Genetic_Algorithms },
publisher = {International Association for Computational Creativity},
keywords = {computational, creativity},

Used References

Gratch, J., Rickel, J., Andre, E., Badler, N., Cassell, J., Petajan, E.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems. IEEE Computer Society, 17(4): 54–63 (2002)

Sayre, H.: A World of Art, fifth ed. New Jersey, USA: Prentice Hall (2007)

Collingwood, R.. The Principles of Art. Oxford, UK: Clarendon Press (1938)

Tolstoy, L.: What is Art? Oxford, USA: Oxford University Press (1955)

Hospers, J.: Aesthetics, problems of. The Encyclopedia of Philosophy, P. Edwards. New York, USA: Ed. Macmillan Publishing Co (1967)

Fraser, T., Banks, A.: Designer’s Color Manual: The Complete Guide to Color Theory and Application. San Francisco, USA: Chronicle Books (2004)

Millerson, G.: Lighting for Television and film, 3rd ed. Oxford, UK: Focal Press (1999)

Birn, J.: [digital] Lighting and Rendering, 2nd ed. California, USA: New Riders (2006)

Zettl, H.: Sight, Sound, Motion: Applied Media Aesthetics. Belmont: Thomson/ Wadsworth (2008)

Akenine-Moller, T., Haines, E., Hoffman, N.: Real-Time Rendering. Wellesley, USA: AK Peters Ltd (2009)

Brown, B.: Motion Picture and Video Lighting, 2nd ed. Burlington, USA: Elsevier Inc. (2007)

Alton J.: Painting with Light. New York, USA: Macmillan Co. (1949)

Gross, L., Ward, L.: Digital Moviemaking, sixth ed. Belmont, USA: Thomson/Wadsworth (2007)

Mitchell, M.: An Introduction to Genetic Algorithms, 3rd ed. Massachusetts, USA: MIT Press. 1998

Patow, G., Pueyo, X.. A survey of inverse rendering problems. Comp. Graphics Forum 22(4):663–687 (2003)

Pelaccini, F., Battaglia, F., Morley, R., Finkelstein, A.. Lighting with paint. ACM Transactions on Graphics 26(2) (2007)

El-Nasr, M., Horswill, I.: Automatic lighting design for interactive entertainment. ACM Computers in Entertainment 2(2) (2004)

18. Tomlinson, B., Blumberg, B., Nain, D.: Expressive autonomous cinematography for interactive virtual environments. Proceedings of the Fourth International Conference on Autonomous Agents (2000)

19. St-Laurent, S.: Shaders for Game Programmers and Artists. Massachusetts, USA: Thomson/Course Technology (2004)

20. de Melo, C., Paiva, A.: Expression of Emotions in Virtual Humans using Lights, Shadows, Composition and Filters. Proceedings of Affective Computing Intelligent Interaction (ACII07) (2007)

21. de Melo, C., Paiva, A.: Evolutionary Expression of Emotions in Virtual Humans Using Lights and Pixels. J. tao, T.N. Tan (eds.): Affective Information Processing, pp.313–336, Springer Science+Business Media LLC (2008)

22. Hunt, R.: The Reproduction of Colour, Sixth ed. Hoboken, USA: John Wiley & Sons (2004)

23. Quinlan, J.: Induction on decision trees. Machine Learning, 1(1): 813–106 (1986)

24. Witten, I., Frank, E.: Data Mining: Practical machine learning tools and techniques, 2nd ed. San Francisco, USA: Morgan Kaufmann (2005)

25. de Melo, C., Gratch, J.: The Effect of Color on Expression of Joy and Sadness in Virtual Humans. Affective Computing and Intelligent Interaction 2009 Conference (ACII09) (2009)


Full Text


intern file

Sonstige Links