1
|
Tschense M, Wallot S. Using measures of reading time regularity (RTR) to quantify eye movement dynamics, and how they are shaped by linguistic information. J Vis 2022; 22:9. [PMID: 35612847 PMCID: PMC9165877 DOI: 10.1167/jov.22.6.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
In this article, we present the concept of reading time regularity (RTR) as a measure to capture reading process dynamics. The first study is concerned with examining one of the assumptions of RTR, namely, that process measures of reading, such as eye movement fluctuations and fixation durations, exhibit higher regularity when contingent on sequentially structured information, such as texts. To test this, eye movements of 26 German native speakers were recorded during reading-unrelated and reading-related tasks. To analyze the data, we used recurrence quantification analysis and sample entropy analysis to quantify the degree of temporal structure in time series of gaze steps and fixation durations. The results showed that eye movements become more regular in reading compared to nonreading conditions. These effects were most prominent when calculated on the basis of gaze step data. In a second study, eye movements of 27 native speakers of German were recorded for five conditions with increasing linguistic information. The results replicate the findings of the first study, verifying that these effects are not due to mere differences in task instructions between conditions. Implications for the concept of RTR and for future studies using these metrics in reading research are discussed.
Collapse
Affiliation(s)
- Monika Tschense
- Institute of Psychology, Leuphana University of Lüneburg, Lüneburg, Germany.,Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,https://orcid.org/0000-0002-2434-4516., https://www.leuphana.de/en/institutes/ifp/staff/monika-tschense.html
| | - Sebastian Wallot
- Institute of Psychology, Leuphana University of Lüneburg, Lüneburg, Germany.,Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany.,https://orcid.org/0000-0002-3626-3940., https://www.leuphana.de/en/institutes/ifp/staff/sebastian-wallot.html
| |
Collapse
|
2
|
Gauche G, Pfeiffer Flores E. The role of inferences in reading comprehension: A critical analysis. THEORY & PSYCHOLOGY 2021. [DOI: 10.1177/09593543211043805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The central role attributed to inferences in reading comprehension can be traced back to the Construction-Integration (CI) model, and many of its theoretical assumptions are still shared by current models. This article analyses recent research in terms of how inferences have been conceived, how they relate to comprehension, and how the CI model’s theoretical legacy has been articulated. The main issues found are that the way inferences are currently conceived doesn’t satisfactorily distinguish them from ordinary comprehension and that a series of assumptions which plausibly apply to computational models have been often mistakenly attributed to interpersonal processes. This, added to the widespread usage of lab-created texts in experiments, hinders the faithful capturing of personal comprehension processes. Finally, we propose recommendations for future research based on conceptual clarity, metatheoretical awareness, and a meaning-based approach on language, so as to improve interresearcher communication, theoretical consistency, and ecological validity.
Collapse
|
3
|
Wallot S, Lee JT, Kelty-Stephen DG. Switching between reading tasks leads to phase-transitions in reading times in L1 and L2 readers. PLoS One 2019; 14:e0211502. [PMID: 30721245 PMCID: PMC6363172 DOI: 10.1371/journal.pone.0211502] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Accepted: 01/15/2019] [Indexed: 11/19/2022] Open
Abstract
Reading research uses different tasks to investigate different levels of the reading process, such as word recognition, syntactic parsing, or semantic integration. It seems to be tacitly assumed that the underlying cognitive process that constitute reading are stable across those tasks. However, nothing is known about what happens when readers switch from one reading task to another. The stability assumptions of the reading process suggest that the cognitive system resolves this switching between two tasks quickly. Here, we present an alternative language-game hypothesis (LGH) of reading that begins by treating reading as a softly-assembled process and that assumes, instead of stability, context-sensitive flexibility of the reading process. LGH predicts that switching between two reading tasks leads to longer lasting phase-transition like patterns in the reading process. Using the nonlinear-dynamical tool of recurrence quantification analysis, we test these predictions by examining series of individual word reading times in self-paced reading tasks where native (L1) and second language readers (L2) transition between random word and ordered text reading tasks. We find consistent evidence for phase-transitions in the reading times when readers switch from ordered text to random-word reading, but we find mixed evidence when readers transition from random-word to ordered-text reading. In the latter case, L2 readers show moderately stronger signs for phase-transitions compared to L1 readers, suggesting that familiarity with a language influences whether and how such transitions occur. The results provide evidence for LGH and suggest that the cognitive processes underlying reading are not fully stable across tasks but exhibit soft-assembly in the interaction between task and reader characteristics.
Collapse
Affiliation(s)
- Sebastian Wallot
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| | - Jun Taek Lee
- Department of Psychology, Grinnell College, Grinnell, Iowa, United States of America
| | | |
Collapse
|
4
|
Interaction-Dominant Causation in Mind and Brain, and Its Implication for Questions of Generalization and Replication. Minds Mach (Dordr) 2017. [DOI: 10.1007/s11023-017-9455-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
5
|
Hollis G, Westbury C, Lefsrud L. Extrapolating human judgments from skip-gram vector representations of word meaning. Q J Exp Psychol (Hove) 2017; 70:1603-1619. [DOI: 10.1080/17470218.2016.1195417] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
There is a growing body of research in psychology that attempts to extrapolate human lexical judgments from computational models of semantics. This research can be used to help develop comprehensive norm sets for experimental research, it has applications to large-scale statistical modelling of lexical access and has broad value within natural language processing and sentiment analysis. However, the value of extrapolated human judgments has recently been questioned within psychological research. Of primary concern is the fact that extrapolated judgments may not share the same pattern of statistical relationship with lexical and semantic variables as do actual human judgments; often the error component in extrapolated judgments is not psychologically inert, making such judgments problematic to use for psychological research. We present a new methodology for extrapolating human judgments that partially addresses prior concerns of validity. We use this methodology to extrapolate human judgments of valence, arousal, dominance, and concreteness for 78,286 words. We also provide resources for users to extrapolate these human judgments for three million English words and short phrases. Applications for large sets of extrapolated human judgments are demonstrated and discussed.
Collapse
Affiliation(s)
- Geoff Hollis
- Department of Psychology, University of Alberta, Edmonton, AB, Canada
| | - Chris Westbury
- Department of Psychology, University of Alberta, Edmonton, AB, Canada
| | - Lianne Lefsrud
- Department of Material & Chemicals Engineering, University of Alberta, Edmonton, AB, Canada
| |
Collapse
|
6
|
Estimating the average need of semantic knowledge from distributional semantic models. Mem Cognit 2017; 45:1350-1370. [DOI: 10.3758/s13421-017-0732-1] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
7
|
Hermann J M, Thomas G, Franziska G, Jim K, Stella P. Reading English-Language Haiku: Processes of Meaning Construction Revealed by Eye Movements. J Eye Mov Res 2017; 10. [PMID: 33828648 PMCID: PMC7141095 DOI: 10.16910/jemr.10.1.4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
In the present study, poets and cognitive scientists came together to investigate the construction of meaning in the process of reading normative, 3-line English-language haiku (ELH), as found in leading ELH journals. The particular haiku which we presented to our readers consisted of two semantically separable parts, or images, that were set in a 'tense' relationship by the poet. In our sample of poems, the division, or cut, between the two parts was positioned either after line 1 or after line 2; and the images related to each other in terms of either a context-action association (context-action haiku) or a conceptually more abstract association (juxtaposition haiku). From a constructivist perspective, understanding such haiku would require the reader to integrate these parts into a coherent 'meaning Gestalt', mentally (re-)creating the pattern intended by the poet (or one from within the poem's meaning potential). To examine this process, we recorded readers' eye movements, and we obtained measures of memory for the read poems as well as subjective ratings of comprehension difficulty and understanding achieved. The results indicate that processes of meaning construction are reflected in patterns of eye movements during reading (1st-pass) and re-reading (2nd- and 3rd-pass). From those, the position of the cut (after line 1 vs. after line 2) and, to some extent, the type of haiku (context-action vs. juxtaposition) can be 'recovered'. Moreover, post-reading, readers tended to explicitly recognize a particular haiku they had read if they had been able to understand the poem, pointing to a role of actually resolving the haiku's meaning (rather than just attempting to resolve it) for memory consolidation and subsequent retrieval. Taken together, these first findings are promising, suggesting that haiku can be a paradigmatic material for studying meaning construction during poetry reading.
Collapse
Affiliation(s)
| | - Geyer Thomas
- General and Experimental Psychology, LMU, Munich Germany
| | | | - Kacian Jim
- The Haiku Foundation, Winchester, VA, USA
| | | |
Collapse
|
8
|
Teng DW, Wallot S, Kelty-Stephen DG. Single-Word Recognition Need Not Depend on Single-Word Features: Narrative Coherence Counteracts Effects of Single-Word Features that Lexical Decision Emphasizes. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2016; 45:1451-1472. [PMID: 26861216 DOI: 10.1007/s10936-016-9416-4] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Research on reading comprehension of connected text emphasizes reliance on single-word features that organize a stable, mental lexicon of words and that speed or slow the recognition of each new word. However, the time needed to recognize a word might not actually be as fixed as previous research indicates, and the stability of the mental lexicon may change with task demands. The present study explores the effects of narrative coherence in self-paced story reading to single-word feature effects in lexical decision. We presented single strings of letters to 24 participants, in both lexical decision and self-paced story reading. Both tasks included the same words composing a set of adjective-noun pairs. Reading times revealed that the tasks, and the order of the presentation of the tasks, changed and/or eliminated familiar effects of single-word features. Specifically, experiencing the lexical-decision task first gradually emphasized the role of single-word features, and experiencing the self-paced story-reading task afterwards counteracted the effect of single-word features. We discuss the implications that task-dependence and narrative coherence might have for the organization of the mental lexicon. Future work will need to consider what architectures suit the apparent flexibility with which task can accentuate or diminish effects of single-word features.
Collapse
Affiliation(s)
- Dan W Teng
- Psychology Department, Grinnell College, 1115 8th Ave., Grinnell, IA, 50112, USA
| | | | | |
Collapse
|
9
|
O'Brien BA, Wallot S. Silent Reading Fluency and Comprehension in Bilingual Children. Front Psychol 2016; 7:1265. [PMID: 27630590 PMCID: PMC5005424 DOI: 10.3389/fpsyg.2016.01265] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 08/09/2016] [Indexed: 11/16/2022] Open
Abstract
This paper focuses on reading fluency by bilingual primary school students, and the relation of text fluency to their reading comprehension. Group differences were examined in a cross-sectional design across the age range when fluency is posed to shift from word-level to text-level. One hundred five bilingual children from primary grades 3, 4, and 5 were assessed for English word reading and decoding fluency, phonological awareness, rapid symbol naming, and oral language proficiency with standardized measures. These skills were correlated with their silent reading fluency on a self-paced story reading task. Text fluency was quantified using non-linear analytic methods: recurrence quantification and fractal analyses. Findings indicate that more fluent text reading appeared by grade 4, similar to monolingual findings, and that different aspects of fluency characterized passage reading performance at different grade levels. Text fluency and oral language proficiency emerged as significant predictors of reading comprehension.
Collapse
Affiliation(s)
- Beth A O'Brien
- Education and Cognitive Development Lab, National Institute of Education, Nanyang Technological University Singapore, Singapore
| | - Sebastian Wallot
- Max Planck Institute for Empirical Aesthetics Frankfurt, Germany
| |
Collapse
|
10
|
|
11
|
Lüdtke J, Jacobs AM. The emotion potential of simple sentences: additive or interactive effects of nouns and adjectives? Front Psychol 2015; 6:1137. [PMID: 26321975 PMCID: PMC4531214 DOI: 10.3389/fpsyg.2015.01137] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2014] [Accepted: 07/21/2015] [Indexed: 11/17/2022] Open
Abstract
The vast majority of studies on affective processes in reading focus on single words. The most robust finding is a processing advantage for positively valenced words, which has been replicated in the rare studies investigating effects of affective features of words during sentence or story comprehension. Here we were interested in how the different valences of words in a sentence influence its processing and supralexical affective evaluation. Using a sentence verification task we investigated how comprehension of simple declarative sentences containing a noun and an adjective depends on the valences of both words. The results are in line with the assumed general processing advantage for positive words. We also observed a clear interaction effect, as can be expected from the affective priming literature: sentences with emotionally congruent words (e.g., The grandpa is clever) were verified faster than sentences containing emotionally incongruent words (e.g., The grandpa is lonely). The priming effect was most prominent for sentences with positive words suggesting that both, early processing as well as later meaning integration and situation model construction, is modulated by affective processing. In a second rating task we investigated how the emotion potential of supralexical units depends on word valence. The simplest hypothesis predicts that the supralexical affective structure is a linear combination of the valences of the nouns and adjectives (Bestgen, 1994). Overall, our results do not support this: The observed clear interaction effect on ratings indicate that especially negative adjectives dominated supralexical evaluation, i.e., a sort of negativity bias in sentence evaluation. Future models of sentence processing thus should take interactive affective effects into account.
Collapse
Affiliation(s)
- Jana Lüdtke
- Department of Education and Psychology, Experimental and Neurocognitive Psychology, Freie Universität Berlin Berlin, Germany ; Department of Psychiatry and Psychotherapy, Charité Universitätsmedizin Berlin Germany
| | - Arthur M Jacobs
- Department of Education and Psychology, Experimental and Neurocognitive Psychology, Freie Universität Berlin Berlin, Germany ; Languages of Emotion, Freie Universität Berlin Berlin, Germany ; Dahlem Institute for Neuroimaging of Emotion Berlin, Germany
| |
Collapse
|
12
|
Jacobs AM. Neurocognitive poetics: methods and models for investigating the neuronal and cognitive-affective bases of literature reception. Front Hum Neurosci 2015; 9:186. [PMID: 25932010 PMCID: PMC4399337 DOI: 10.3389/fnhum.2015.00186] [Citation(s) in RCA: 134] [Impact Index Per Article: 14.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2015] [Accepted: 03/20/2015] [Indexed: 11/24/2022] Open
Abstract
A long tradition of research including classical rhetoric, esthetics and poetics theory, formalism and structuralism, as well as current perspectives in (neuro)cognitive poetics has investigated structural and functional aspects of literature reception. Despite a wealth of literature published in specialized journals like Poetics, however, still little is known about how the brain processes and creates literary and poetic texts. Still, such stimulus material might be suited better than other genres for demonstrating the complexities with which our brain constructs the world in and around us, because it unifies thought and language, music and imagery in a clear, manageable way, most often with play, pleasure, and emotion (Schrott and Jacobs, 2011). In this paper, I discuss methods and models for investigating the neuronal and cognitive-affective bases of literary reading together with pertinent results from studies on poetics, text processing, emotion, or neuroaesthetics, and outline current challenges and future perspectives.
Collapse
Affiliation(s)
- Arthur M. Jacobs
- Department of Experimental and Neurocognitive Psychology, Freie Universität BerlinBerlin, Germany
- Center for Cognitive Neuroscience (CCNB), Freie Universität BerlinBerlin, Germany
- Dahlem Institute for Neuroimaging of Emotion (D.I.N.E.), Freie Universität BerlinBerlin, Germany
| |
Collapse
|