Abstract
This paper presents a simple framework for computational design creativity evaluation, presenting its components with rationale. Components are linked to recent computational creativity research in both art and design. The framework assumes that the product, not the process, is being evaluated, and that evaluation is done by comparison with descriptions of existing products using a set of aspects that each suggest creativity. Not every evaluation will use all of the components of the framework. It can be used to guide or assess design creativity research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boden MA (1994) What is creativity? In: Boden MA (ed) Dimensions of creativity. The MIT Press, Cambridge, MA, pp 75–117
Colton S, Charnley J, Pease A (2011) Computational creativity theory: the FACE and IDEA descriptive models. In: Proc. 2nd Int. conf. on computational creativity, Mexico City, pp 90–95
Hennessey BA, Amabile TA (2010) Creativity. Ann Rev Psychol 61:569–598
Amabile TM (1996) Creativity in context. Westview Press, Boulder
Grecu DL, Brown DC (2000) Expectation formation in multi-agent design systems. In: Gero JS (ed) Proc. artificial intelligence in design‘00. Kluwer, Dordrecht, pp 651–671
Cohen H, Nake F, Brown DC, Brown P, Galanter P, McCormack J, d’Inverno M (2012) Evaluation of creative aesthetics. In: McCormack J, d’Inverno M (eds) Computers and creativity. Springer-Verlag, Berlin, pp 95–111
Galanter P (2012) Computational aesthetic evaluation: past and future. In: McCormack J, d’Inverno M (eds) Computers and creativity. Springer-Verlag, Berlin, pp 255–293
Sosa R, Gero JS (2013) Multilevel computational creativity. In: Proc. 4th Int. conf. on computational creativity, Sydney, pp 198–204
Eysenck HJ (1994) The measurement of creativity. In: Boden MA (ed) Dimensions of creativity. The MIT Press, Cambridge, pp 199–242
Charyton C, Jagacinski RJ, Merrill JA (2008) CEDA: a research instrument for creative engineering design assessment. Psychol Aesthet Creat Arts 2(3):147–154
Romero J, Machado P, Carballal A, Correia J (2012) Computing aesthetics with image judgment systems. In: McCormack J, D’Inverno M (eds) Computers and creativity. Springer-Verlag, Berlin, pp 295–321
Candy L (2013) Evaluating creativity. In: Carroll JM (ed) Creativity and rationale: enhancing human experience. Springer-Verlag, London, pp 57–84
Candy L, Bilda Z (2009) Understanding and evaluating creativity. In: Bryan-Kinns N (ed) Creativity & cognition 2009. ACM, Berkeley, pp 497–498
Rhodes M (1961) An analysis of creativity. Phi Delta Kappan 42:305–310
Norman DA (2004) Emotional design: why we love (or hate) everyday things. Basic Books, New York
Ludden GDS, Schifferstein HNJ, Hekkert P (2008) Surprise as a design strategy. Design Issues 24(2):28–38
Besemer SP (2006) Creating products in the age of design. How to improve your new product ideas! New Forums Press, Stillwater
Norman DA (2008) THE WAY I SEE IT: signifiers, not affordances. Interactions magazine. ACM 15(6):18–19
Brown DC (1992) Design. In: Shapiro SC (ed) Encyclopedia of artificial intelligence, 2nd edn. Wiley, New York
Smithers T (1996) On knowledge level theories of design process. In: Gero JS, Sudweeks F (eds) Artificial intelligence in design‘96. Kluwer, Dordrecht, pp 561–579
Smithers T (1998) Towards a knowledge level theory of design process. In: Gero JS, Sudweeks F (eds) Artificial intelligence in design‘98. Springer, Netherlands, pp 3–21
Sim SK, Duffy AHB (2004) Knowledge transformers: a link between learning and creativity. AIEDAM 18(3):271–279
Erden MS, Komoto H, van Beek TJ, D’Amelio V, Echavarria E, Tomiyama T (2008) A review of function modeling: approaches and applications. In: Goel A, Davis R, Gero JS (eds) Special issue on multi-modal Design, AIEDAM 22(2)
Redelinghuys C (2000) Proposed criteria for the detection of invention in engineering design. J Eng Design 11(3):265–282
Wiggins GA (2006) A preliminary framework for description, analysis and comparison of creative systems. J Knowl Based Syst 19(7):449–458
Sosa R, Gero JS (2005) A computational study of creativity in design: the role of society. AIEDAM 19(4):229–244
Maher ML, Brady K, Fisher D (2013) Computational models of surprise in evaluating creative design. In: Proc. 4th Int. conf. on computational creativity, University of Sydney, pp 147–151
Sternberg RJ, Kaufman JC, Pretz JE (2002) The creativity conundrum: a propulsion model of kinds of creative contributions. Psychology Press, Philadelphia
Maher ML, Fisher DH (2012) Using AI to evaluate creative designs. In: Proc. 2nd Int. conf. on design creativity (ICDC2012), Mexico City, pp 45–54
Jagtap S, Larson A, Hiort V, Olander E, Warell A (2012) Ideation metrics: interdependency between average novelty and variety. Int. Design Conf., DESIGN 2012, pp 1881–1892
Oman SK, Tumer IY, Wood K, Seepersad C (2013) A comparison of creativity and innovation metrics and sample validation through in-class design projects. Res Eng Des 24(1):65–92
Shah JJ, Vargas Hernandez N, Smith SM (2003) Metrics for measuring ideation effectiveness. Des Stud 24:111–134
Kudrowitz BM, Wallace DR (2012) Assessing the quality of ideas from prolific, early-stage product ideation. J Eng Design, Special Issue on Design Creativity, (first online preview), 1–20
Christiaans HHCM (1992) Creativity in design: the role of domain knowledge in designing. Uitgeverij Lemma BV, Utrecht
Dean DL, Hender JM, Rodgers TL, Santanen EL (2006) Identifying quality, novel, and creative ideas: constructs and scales for idea evaluation. J Assoc Inf Syst 7(10):647
Horn D, Salvendy G (2006) Product creativity: conceptual model, measurement and characteristics. Theor Issues Ergon Sci 7(4):395–412
Ritchie G (2007) Some empirical criteria for attributing creativity to a computer program. Minds Mach 17:67–99
Srivathsavai R, Genco N, Hölttä-Otto K, Seepersad CC (2010) Study of existing metrics used in measurement of ideation effectiveness. Proc. ASME 2010 Int. IDETC & CIE Confs., DETC2010-28802
Liikkanen LA, Hämäläinen MM, Häggman A, Björklund T, Koskinen MP (2011) Quantitative evaluation of the effectiveness of idea generation in the wild. Human Cent Design Lect Notes Comp Sci 6776:120–129
Sarkar P, Chakrabarti A (2011) Assessing design creativity. Des Stud 32:348–383
Lu C-C, Luh D-B (2012) A comparison of assessment methods and raters in product creativity. Creat Res J 24(4):331–337
Cropley DH, Kaufman JC (2012) Measuring functional creativity: non-expert raters and the creative solution diagnosis scale. J Creat Behav 46(2):119–137
Brown DC (2013) Guiding computational design creativity research. Int J Design Creat Innov 1(1):1–42
Lopez-Mesa B, Vidal R (2006) Novelty metrics in engineering design experiments. Int. Design Conf., DESIGN 2006, 557–564
Shelton KA, Arciszewski T (2007) Formal innovation criteria. Int J Comp Appl Technol 30(1/2):21–32
Macedo L, Cardoso A, Reisenzein R, Lorini E, Castelfranchi C (2009) Artificial surprise. In: Vallverdu J, Casacuberta D (eds) Handbook of research on synthetic emotions and sociable robotics: new applications in affective computing and artificial intelligence. Information Science Reference (IGI Global), Hershey
Brown DC (2012) Creativity, surprise & design: an introduction and investigation. In: Proc. 2nd Int. Conf. on Design Creativity (ICDC2012), Mexico City
Nelson BA, Yen J, Wilson JO, Rosen D (2009) Refined metrics for measuring ideation effectiveness. Des Stud 30:737–743
Farzaneh HH, Kaiser MK, Schroer B, Srinivasan V, Lindemann U (2012) Evaluation of creativity: structuring solution ideas communicated in groups performing solution search. Int. Design Conf., DESIGN 2012, 1871–1880
Datta R, Joshi D, Li J, Wang JZ (2006) Studying aesthetics in photographic images using a computational approach. Lecture notes in computer science, 3953, In: Proc. European Conf. Computer Vision, Part III, Graz, Austria, pp 288–301
Fuge M, Stroud J, Agogino A (2013) Automatically inferring metrics for design creativity. ASME IDETC & CIE, DETC2013-12620
Ritchie G (2006) The transformational creativity hypothesis. N Gener Comput 24:241–266
Colton S (2008) Creativity versus the perception of creativity in computational systems. In: Proc. AAAI Spring Symp. on Creative Systems, Palo Alto, CA
McDonagh D, Denton H, Chapman J (eds) (2009) Special issue on ‘design and emotion’. J Eng Design 20(5)
Cropley DH (2009) Fostering and measuring creativity and innovation: individuals, organisations and products. In: Proc. Conf. Can Creativity be Measured? Section 17, Education and Culture DG, European Commission, http://ec.europa.eu/education/lifelong-learning-policy/creativity-conference_en.htm
Minsky M (2006) The emotion machine: commonsense thinking, artificial intelligence & the future of the human mind. Simon & Schuster, New York
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Brown, D.C. (2015). Computational Design Creativity Evaluation. In: Gero, J., Hanna, S. (eds) Design Computing and Cognition '14. Springer, Cham. https://doi.org/10.1007/978-3-319-14956-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-14956-1_12
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14955-4
Online ISBN: 978-3-319-14956-1
eBook Packages: EngineeringEngineering (R0)