Nobody’s A Critic: On The Evaluation Of Creative Code Generators — A Case Study In Video Game Design

Aus de_evolutionary_art_org
Wechseln zu: Navigation, Suche


Michael Cook, Simon Colton and Jeremy Gow: Nobody’s A Critic: On The Evaluation Of Creative Code Generators — A Case Study In Video Game Design. In: Computational Creativity 2013 ICCC 2013, 123-130.



Application domains for Computational Creativity projects range from musical composition to recipe design, but despite all of these systems having computational methods in com- mon, we are aware of no projects to date that focus on pro- gram code as the created artefact. We present the Mechanic Miner tool for inventing new concepts for videogame inter- action which works by inspecting, modifying and executing code. We describe the system in detail and report on an eval- uation based on a large survey of people playing games using content it produced. We use this to raise issues regarding the assessment of code as a created artefact and to discuss future directions for Computational Creativity research.

Extended Abstract


author = {Michael Cook, Simon Colton and Jeremy Gow},
title = {Nobody’s A Critic: On The Evaluation Of Creative Code Generators — A Case Study In Video Game Design},
editor = {Simon Colton, Dan Ventura, Nada Lavrac, Michael Cook},
booktitle = {Proceedings of the Fourth International Conference on Computational Creativity},
series = {ICCC2013},
year = {2013},
month = {Jun},
location = {Sydney, New South Wales, Australia},
pages = {123-130},
url = {,’s_A_Critic:_On_The_Evaluation_Of_Creative_Code_Generators_—_A_Case_Study_In_Video_Game_Design },
publisher = {International Association for Computational Creativity},
keywords = {computational, creativity},

Used References

Anthropy, A. 2012. Rise of the Videogame Zinesters: How Freaks, Normals, Amateurs, Artists, Dreamers, Drop-outs, Queers, Housewives And People Like You Are Taking Back An Art Form. Seven Stories Press.

Biddle, J. 2012. Stealth bastard deluxe. Digitally distributed via

Bonchi, F., and Pous, D. 2012. Checking NFA equivalence with bisimulations up to congruence. In Proceedings of the 40th annual ACM SIGPLAN-SIGACT symposium on Princi- ples of programming languages, POPL ’13.

Browne, C., and Maire, F. 2010. Evolutionary Game Design. IEEE Transactions on Computational Intelligence and AI in Games 2(1):1–16.

Charnley, J.; Pease, A.; and Colton, S. 2012. On the notion of framing in Computational Creativity. In Proceedings of the Third International Conference on Computational Cre- ativity.

Colton, S.; Charnley, J.; and Pease, A. 2011. Computational Creativity Theory: The FACE and IDEA models. In Pro- ceedings of the Second International Conference on Com- putational Creativity.

Colton, S. 2002. Automated Theory Formation in Pure Mathematics. Springer.

Colton, S. 2008. Creativity versus the perception of creativ- ity in computational systems. In Proceedings of the AAAI Spring Symposiumo on Creative Intelligent Systems.

Cook, M., and Colton, S. 2012. Initial results from co- operative co-evolution for automated platformer design. In Proceedings of the Applications of Evolutionary Computa- tion (EvoGames workshop).

Cook, M.; Colton, S; Raad, A; and Gow, J 2013. Mechanic Miner: Reflection-Driven Game Mechanic Discovery and Level Design. In Proceedings of the Applications of Evolu- tionary Computation (EvoGames workshop).

Cook, D. 2006. What are game mechanics?

Johnson, C. 2012. The creative computer as romantic hero? or, what kind of creative personae do computational creativ- ity systems exemplify? In Proceedings of the Third Interna- tional Conference on Computational Creativity.

Kelly, T. 2010. Game dynamics vs game mechanics.

Muggleton, S., and de Raedt, L. 1994. Inductive logic pro- gramming: Theory and methods. Journal of Logic Program- ming 19(20).

Nelson, M. J., and Mateas, M. 2007. Towards automated game design. In Proceedings of the 10th Congress of the Italian Association for Artificial Intelligence.

Pell, B. 1992. Metagame in symmetric, chess-like games. In Heuristic Programming in Artificial Intelligence 3: The Third Computer Olympiad.

Ritchie, G. 2007. Some empirical criteria for attributing creativity to a computer program. Minds and Machines 17(1):67–99.

Sicart, M. 2008. Defining game mechanics. Game Studies 8(2).

Smith, A., and Mateas, M. 2010. Variations forever: Flex- ibly generating rulesets from a sculptable design space of mini-games. In Proceedings of the IEEE Conference on Computational Intelligence and Games, 273–280.

Togelius, J., and Schmidhuber, J. 2008. An experiment in automatic game design. In Proceedings of the IEEE Confer- ence on Computational Intelligence and Games.

Treanor, M.; Blackford, B.; Mateas, M.; and Bogost, I. 2012. Game-o-matic: Generating videogames that represent ideas. In Proceedings of the Third Workshop on Procedural Content Generation in Games.

Turon, A. J.; Thamsborg, J.; Ahmed, A.; Birkedal, L.; and Dreyer, D. 2013. Logical relations for fine-grained concur- rency. In Proceedings of the 40th annual ACM SIGPLAN- SIGACT symposium on Principles of programming lan- guages, POPL ’13.


Full Text

intern file

Sonstige Links