What's creative about sentences?
- Evaluating creativity of verbal responses or texts is a challenging task due to psychometric issues associated with subjective ratings and the peculiarities of textual data. We explore an approach to objectively assess the creativity of responses in a sentence generation task to 1) better understand what language-related aspects are valued by human raters and 2) further advance the developments toward automating creativity evaluations. Over the course of two prior studies, participants generated 989 four-word sentences based on a four-letter prompt with the instruction to be creative. We developed an algorithm that scores each sentence on eight different metrics including 1) general word infrequency, 2) word combination infrequency, 3) context-specific word uniqueness, 4) syntax uniqueness, 5) rhyme, 6) phonetic similarity, and similarity of 7) sequence spelling and 8) semantic meaning to the cue. The text metrics were then used to explain the averaged creativity ratings of eight human raters. We found six metrics to be significantlyEvaluating creativity of verbal responses or texts is a challenging task due to psychometric issues associated with subjective ratings and the peculiarities of textual data. We explore an approach to objectively assess the creativity of responses in a sentence generation task to 1) better understand what language-related aspects are valued by human raters and 2) further advance the developments toward automating creativity evaluations. Over the course of two prior studies, participants generated 989 four-word sentences based on a four-letter prompt with the instruction to be creative. We developed an algorithm that scores each sentence on eight different metrics including 1) general word infrequency, 2) word combination infrequency, 3) context-specific word uniqueness, 4) syntax uniqueness, 5) rhyme, 6) phonetic similarity, and similarity of 7) sequence spelling and 8) semantic meaning to the cue. The text metrics were then used to explain the averaged creativity ratings of eight human raters. We found six metrics to be significantly correlated with the human ratings, explaining a total of 16% of their variance. We conclude that the creative impression of sentences is partly driven by different aspects of novelty in word choice and syntax, as well as rhythm and sound, which are amenable to objective assessment.…
Verfasserangaben: | Theresa Julia WeinsteinORCiD, Simon Majed CehORCiD, Christoph MeinelORCiDGND, Mathias BenedekORCiDGND |
---|---|
DOI: | https://doi.org/10.1080/10400419.2022.2124777 |
ISSN: | 1040-0419 |
ISSN: | 1532-6934 |
Titel des übergeordneten Werks (Englisch): | Creativity Research Journal |
Untertitel (Deutsch): | a computational approach to assessing creativity in a sentence generation task |
Verlag: | Routledge, Taylor & Francis Group |
Verlagsort: | Abingdon |
Publikationstyp: | Wissenschaftlicher Artikel |
Sprache: | Englisch |
Datum der Erstveröffentlichung: | 06.10.2022 |
Erscheinungsjahr: | 2022 |
Datum der Freischaltung: | 18.10.2023 |
Band: | 34 |
Ausgabe: | 4 |
Seitenanzahl: | 12 |
Erste Seite: | 419 |
Letzte Seite: | 430 |
Fördernde Institution: | Austrian Science Fund (FWF) [P29801] |
Organisationseinheiten: | An-Institute / Hasso-Plattner-Institut für Digital Engineering gGmbH |
DDC-Klassifikation: | 0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 000 Informatik, Informationswissenschaft, allgemeine Werke |
Peer Review: | Referiert |
Publikationsweg: | Open Access / Hybrid Open-Access |
Lizenz (Deutsch): | CC-BY - Namensnennung 4.0 International |