1
|
Johnson DR, Kaufman JC, Baker BS, Patterson JD, Barbot B, Green AE, van Hell J, Kennedy E, Sullivan GF, Taylor CL, Ward T, Beaty RE. Divergent semantic integration (DSI): Extracting creativity from narratives with distributional semantic modeling. Behav Res Methods 2023; 55:3726-3759. [PMID: 36253596 PMCID: PMC10615993 DOI: 10.3758/s13428-022-01986-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/21/2022] [Indexed: 11/08/2022]
Abstract
We developed a novel conceptualization of one component of creativity in narratives by integrating creativity theory and distributional semantics theory. We termed the new construct divergent semantic integration (DSI), defined as the extent to which a narrative connects divergent ideas. Across nine studies, 27 different narrative prompts, and over 3500 short narratives, we compared six models of DSI that varied in their computational architecture. The best-performing model employed Bidirectional Encoder Representations from Transformers (BERT), which generates context-dependent numerical representations of words (i.e., embeddings). BERT DSI scores demonstrated impressive predictive power, explaining up to 72% of the variance in human creativity ratings, even approaching human inter-rater reliability for some tasks. BERT DSI scores showed equivalently high predictive power for expert and nonexpert human ratings of creativity in narratives. Critically, DSI scores generalized across ethnicity and English language proficiency, including individuals identifying as Hispanic and L2 English speakers. The integration of creativity and distributional semantics theory has substantial potential to generate novel hypotheses about creativity and novel operationalizations of its underlying processes and components. To facilitate new discoveries across diverse disciplines, we provide a tutorial with code (osf.io/ath2s) on how to compute DSI and a web app ( osf.io/ath2s ) to freely retrieve DSI scores.
Collapse
Affiliation(s)
- Dan R Johnson
- Department of Cognitive and Behavioral Science, Washington and Lee University, Parmly Hall, 204 W. Washington St, Lexington, VA, 24450, USA.
| | - James C Kaufman
- Neag School of Education, University of Connecticut, Mansfield, CT, USA
| | - Brendan S Baker
- Department of Psychology, Pennsylvania State University, State College, PA, USA
| | - John D Patterson
- Department of Psychology, Pennsylvania State University, State College, PA, USA
| | - Baptiste Barbot
- Psychological Sciences Research Institute, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Adam E Green
- Department of Psychology, Georgetown University, Washington, DC, USA
| | - Janet van Hell
- Department of Psychology, Pennsylvania State University, State College, PA, USA
| | - Evan Kennedy
- Department of Psychology, Graceland University, Lamoni, IA, USA
| | - Grace F Sullivan
- Department of Cognitive and Behavioral Science, Washington and Lee University, Parmly Hall, 204 W. Washington St, Lexington, VA, 24450, USA
| | - Christa L Taylor
- Psychological Sciences Research Institute, Université catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Thomas Ward
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA
| | - Roger E Beaty
- Department of Psychology, Pennsylvania State University, State College, PA, USA
| |
Collapse
|
2
|
Abstract
Most creativity measures are either complex or language-dependent, hindering cross-cultural creativity assessment. We have therefore developed and tested a simple, language-independent insight task based on pictures in the style of the widely used verbal remote associate task (RAT). We demonstrate that the language-independent RAT (LI-RAT) allows assessment of different aspects of insight across large samples with different languages. It also correlates with other creativity and general problem-solving tasks. The entire stimulus set, including its preliminary normative data, is made freely available. This information can be used to select items based on accuracy, mean solution time, likelihood to produce an insight, or conceptual and perceptual similarity between the pictures per item.
Collapse
Affiliation(s)
- Maxi Becker
- Department of Psychology, Humboldt University Berlin, Unter den Linden 6, 10117, Berlin, Germany.
| | - Roberto Cabeza
- Center for Cognitive Neuroscience, Duke University, Durham, NC, 27708, USA
| |
Collapse
|
3
|
Abstract
Creativity is a multidimensional construct. Several different approaches have been developed to measure creativity, including psychometric scales. The Runco Ideational Behavior Scale (RIBS) is one such measure of creative ideation. The primary purpose of this paper was to assess the 23 items of the RIBS in the context of the Thai language and examine scale reliability and validity. Participants, consisting of 508 undergraduate students selected from five Thai public universities, were selected through a convenience sampling approach involving both exploratory and confirmatory factor analysis. Results suggested that the Thai version of the RIBS presented a valid measure to a certain extent. Factor analysis of the empirical data indicated a two-dimensional structure. Confirmatory factor analysis (CFA) results confirmed that the two-factor construct demonstrated a better fit with improved psychometric characteristics. Six items were eliminated from the Thai RIBS version inventory: five items during explanatory factor analysis (EFA) and one during the CFA process. Results will contribute to ascertaining that the Thai version of the RIBS instrument can be used as a self-assessment tool for measuring students’ creative ideation. Implications and limitations of this research are discussed with suggestions for future studies.
Collapse
Affiliation(s)
- Puthyrom Tep
- Learning Innovation and Technology Program, Faculty of Industrial Education and Technology, King Mongkut's University of Technology Thonburi, Bangkok, Thailand.
| | - Sorakrich Maneewan
- Department of Educational Communications and Technology, Faculty of Industrial Education and Technology, King Mongkut's University ofTechnology Thonburi, Bangkok, Thailand
| | - Saranya Chuathong
- Department of Educational Communications and Technology, Faculty of Industrial Education and Technology, King Mongkut's University ofTechnology Thonburi, Bangkok, Thailand
| |
Collapse
|