Interaction Evaluation for Human-Computer Co-creativity: A Case Study
Inhaltsverzeichnis
Reference
Anna Kantosalo, Jukka M. Toivanen and Hannu Toivonen: Interaction Evaluation for Human-Computer Co-creativity: A Case Study. In: Computational Creativity 2015 ICCC 2015, 276-283.
DOI
Abstract
Interaction design has been suggested as a framework for evaluating computational creativity by Bown (2014). Yet few practical accounts on using an Interaction Design based evaluation strategy in Computational Creativity Contexts have been reported in the literature. This study paper describes the evaluation process and results of a human-computer co-creative poetry writing tool intended for children in a school context. We specifically focus on one formative evaluation case utilizing Interaction Design evaluation methods, offering a suggestion on how to conduct Interaction Design based evaluation in a computational creativity context, as well as, report the results of the evaluation itself. The evaluation process is considered from the perspective of a computational creativity researcher and we focus on challenges and benefits of the interaction design evaluation approach within a computational creativity project context.
Extended Abstract
Bibtex
@inproceedings{
author = {Kantosalo, Anna and Toivanen, Jukka M. and Toivonen, Hannu},
title = {Interaction Evaluation for Human-Computer Co-creativity: A Case Study},
booktitle = {Proceedings of the Sixth International Conference on Computational Creativity},
series = {ICCC2015},
year = {2015},
month = {Jun},
location = {Park City, Utah, USA},
pages = {276-283},
url = {http://computationalcreativity.net/iccc2015/proceedings/13_2Kantosalo.pdf http://de.evo-art.org/index.php?title=Interaction_Evaluation_for_Human-Computer_Co-creativity:_A_Case_Study },
publisher = {International Association for Computational Creativity},
keywords = {computational, creativity},
}
Used References
Bown, O. 2014. Empirically grounding the evaluation of creative systems: Incorporating interaction design. In Proceedings of the Fifth International Conference on Computational Creativity, 112–119.
Carlson, K.; Schiphorst, T.; and Pasquier, P. 2011. Scuddle: Generating movement catalysts for computer-aided choreography. In Proceedings of the Second International Conference on Computational Creativity, 123–128.
Carroll, E. A. 2011. Convergence of self-report and physiological responses for evaluating creativity support tools. In Proceedings of the 8th ACM Conference on Creativity and Cognition, 455–456. ACM.
Colton, S., and Wiggins, G. A. 2012. Computational creativity: the final frontier? In ECAI 2012 : 20th European Conference on Artificial Intelligence, 21–26.
DiPaola, S.; McCaig, G.; Carlson, K.; Salevati, S.; and Sorenson, N. 2013. Adaptation of an autonomous creative evolutionary system for real-world design application based on creative cognition. In Proceedings of the Fourth International Conference on Computational Creativity, 40–47.
Edwards, H., and Benedyk, R. 2007. A comparison of usability evaluation methods for child participants in a school setting. In Proceedings of the 6th International Conference on Interaction Design and Children, 9–16. ACM.
Hanna, L.; Risden, K.; and Alexander, K. 1997. Guidelines for usability testing with children. interactions 4(5):9–14.
Hartson, H. R.; Andre, T. S.; and Williges, R. C. 2003. Criteria for evaluating usability evaluation methods. International Journal of Human-Computer Interaction 15(1):373– 410.
H¨oysniemi, J.; H¨am¨al¨ainen, P.; and Turkki, L. 2003. Using peer tutoring in evaluating the usability of a physically interactive computer game with children. Interacting with Computers 15(2):203–225.
ISO/IEC. 2010. Iso 9241-210 ergonomics of human-system interaction – part 210: Human-centered design for interactive systems.
Johnston, A.; Amitani, S.; and Edmonds, E. 2005. Amplifying reflective thinking in musical performance. In Proceedings of the 5th Conference on Creativity & Cognition, 166–175. ACM.
Jordanous, A. 2012. A standardised procedure for evaluating creative systems: Computational creativity evaluation based on what it is to be creative. Cognitive Computation 4(3):246–279.
Jordanous, A. 2014. Stepping back to progress forwards: Setting standards for meta-evaluation of computational creativity. In Proceedings of the Fifth International Conference on Computational Creativity, 129–136.
Kantosalo, A., and Riihiaho, S. 2014. Let’s play the feedback game. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, 943–946. ACM.
Kantosalo, A.; Toivanen, J. M.; Xiao, P.; and Toivonen, H. 2014. From isolation to involvement: Adapting machine creativity software to support human-computer cocreation. In Proceedings of the Fifth International Conference on Computational Creativity, 1–8.
Lewis, J. R. 2006. Sample sizes for usability tests: Mostly math, not magic. Interactions 13(6):29–33.
Mikolov, T.; Chen, K.; Corrado, G.; and Dean, J. 2013. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781.
Read, J.; MacFarlane, S.; and Casey, C. 2002. Endurability, engagement and expectations: Measuring children’s fun. In Interaction design and children, volume 2, 1–23. Shaker Publishing Eindhoven.
Rogers, Y.; Sharp, H.; and Preece, J. 2011. Interaction Design: Beyond Human Computer Interaction. Wiley, 3rd edition.
Ryokai, K.; Lee, M. J.; and Breitbart, J. M. 2009. Children’s storytelling and programming with robotic characters. In Proceedings of the Seventh ACM Conference on Creativity and Cognition, 19–28. ACM.
Shibata, H., and Hori, K. 2002. A system to support longterm creative thinking in daily life and its evaluation. In Proceedings of the 4th Conference on Creativity & Cognition, 142–149. ACM.
Sim, G.; MacFarlane, S.; and Read, J. 2006. All work and no play: Measuring fun, usability, and learning in software for children. Computers & Education 46(3):235–248.
Singh, V.; Latulipe, C.; Carroll, E.; and Lottridge, D. 2011. The choreographer’s notebook: A video annotation system for dancers and choreographers. In Proceedings of the 8th ACM Conference on Creativity and Cognition, 197–206. ACM.
Terry, M.; Mynatt, E. D.; Nakakoji, K.; and Yamamoto, Y. 2004. Variation in element and action: Supporting simultaneous development of alternative solutions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 711–718. ACM.
Toivanen, J. M.; Toivonen, H.; Valitutti, A.; and Gross, O. 2012. Corpus-based generation of content and form in poetry. In International Conference on Computational Creativity, 175–179.
Waller, A.; Black, R.; O’Mara, D. A.; Pain, H.; Ritchie, G.; and Manurung, R. 2009. Evaluating the standup pun generating software with children with cerebral palsy. ACM Transactions on Accessible Computing 1(3):16:1–16:27.
Warr, A., and O’Neill, E. 2007. Tool support for creativity using externalizations. In Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition, 127–136. ACM.
Yannakakis, G. N.; Liapis, A.; and Alexopoulos, C. 2014. Mixed-initiative co-creativity. In Proceedings of the 9th International Conference on the Foundations of Digital Games.
Links
Full Text
http://computationalcreativity.net/iccc2015/proceedings/13_2Kantosalo.pdf
