An Analysis of Reading Skill Development using E-Z Reader

Human attention during goal-directed reading comprehension relies on task optimization

The computational principles underlying attention allocation in complex goal-directed tasks remain elusive. Goal-directed reading, that is, reading a passage to answer a question in mind, is a common real-world task that strongly engages attention. Here, we investigate what computational models can explain attention distribution in this complex task. We show that the reading time on each word is predicted by the attention weights in transformer-based deep neural networks (DNNs) optimized to perform the same reading task. Eye tracking further reveals that readers separately attend to basic text features and question-relevant information during first-pass reading and rereading, respectively. Similarly, text features and question relevance separately modulate attention weights in shallow and deep DNN layers. Furthermore, when readers scan a passage without a question in mind, their reading time is predicted by DNNs optimized for a word prediction task. Therefore, we offer a computational account of how task optimization modulates attention distribution during real-world reading.

Eye movements during reading in beginning and skilled readers: Impact of reading level or physiological maturation?

We begin by presenting and examining relevant data in the literature on eye movements in reading, from childhood to adulthood. In particular, we discuss the differences found in eye movements during reading between children in different age groups and with different reading levels and skilled adult readers in terms of word recognition and sentence processing. We then critically discuss two hypotheses that account for the differences between children and adults' eye movement during reading: one being reading age itself - the changes in eye movement patterns in reading are regulated by the level of reading proficiency and its automatization - and the other being the role of maturation of oculomotor control and, consequently, its possible changes in eye movement patterns during reading. Finally, we list gaps in the research field and suggest that future research will benefit from investigating eye movements during reading in ex-illiterate adults who are in the process of learning to read in order to isolate both reading and maturational factors.

Individuals with dyslexia use a different visual sampling strategy to read text

Individuals with dyslexia present with reading-related deficits including inaccurate and/or less fluent word recognition and poor decoding abilities. Slow reading speed and worse text comprehension can occur as secondary consequences of these deficits. Reports of visual symptoms such as atypical eye movements during reading gave rise to a search for these deficits' underlying mechanisms. This study sought to replicate established behavioral deficits in reading and cognitive processing speed while investigating their underlying mechanisms in more detail by developing a comprehensive profile of eye movements specific to reading in adult dyslexia. Using a validated standardized reading assessment, our findings confirm a reading speed deficit among adults with dyslexia. We observed different eye movements in readers with dyslexia across numerous eye movement metrics including the duration of a stop (i.e., fixation), the length of jumps (i.e., saccades), and the number of times a reader's eyes expressed a jump atypical for reading. We conclude that individuals with dyslexia visually sample written information in a laborious and more effortful manner that is fundamentally different from those without dyslexia. Our findings suggest a mix of aberrant cognitive linguistic and oculomotor processes being present in adults with dyslexia.

Neurophysiological, Oculomotor, and Computational Modeling of Impaired Reading Ability in Schizophrenia

Schizophrenia (Sz) is associated with deficits in fluent reading ability that compromise functional outcomes. Here, we utilize a combined eye-tracking, neurophysiological, and computational modeling approach to analyze underlying visual and oculomotor processes. Subjects included 26 Sz patients (SzP) and 26 healthy controls. Eye-tracking and electroencephalography data were acquired continuously during the reading of passages from the Gray Oral Reading Tests reading battery, permitting between-group evaluation of both oculomotor activity and fixation-related potentials (FRP). Schizophrenia patients showed a marked increase in time required per word (d = 1.3, P < .0001), reflecting both a moderate increase in fixation duration (d = .7, P = .026) and a large increase in the total saccade number (d = 1.6, P < .0001). Simulation models that incorporated alterations in both lower-level visual and oculomotor function as well as higher-level lexical processing performed better than models that assumed either deficit-type alone. In neurophysiological analyses, amplitude of the fixation-related P1 potential (P1f) was significantly reduced in SzP (d = .66, P = .013), reflecting reduced phase reset of ongoing theta-alpha band activity (d = .74, P = .019). In turn, P1f deficits significantly predicted increased saccade number both across groups (P = .017) and within SzP alone (P = .042). Computational and neurophysiological methods provide increasingly important approaches for investigating sensory contributions to impaired cognition during naturalistic processing in Sz. Here, we demonstrate deficits in reading rate that reflect both sensory/oculomotor- and semantic-level impairments and that manifest, respectively, as alterations in saccade number and fixation duration. Impaired P1f generation reflects impaired fixation-related reset of ongoing brain rhythms and suggests inefficient information processing within the early visual system as a basis for oculomotor dyscontrol during fluent reading in Sz.

Mind Mapping Training's Effects on Reading Ability: Detection Based on Eye Tracking Sensors

As a reading comprehension strategy, mind mapping has a positive influence on the development of students’ reading ability. However, how mind mapping affects reading ability has not been well documented. In this study, we used eye tracking sensors to explore mind mapping’s effects on reading ability. The participants were foreign language learning university students in Dalian city, China. One group received foreign language reading teaching integrated with mind mapping training (experimental group), and the other group received regular foreign language reading teaching (control group). We analyzed eye movement indicators, including fixation-related indicators (number of fixations, fixation frequency, and mean fixation duration), regression count, saccade amplitude, and pupil diameter. In addition, the analysis of heat maps and fixation trajectory maps, which are specific tool for visualization of eye movement data and intuitive analysis of reading process, were explained. The results show that the number of fixations, fixation frequency, mean fixation duration, and regression count in the experimental group were all lower than in the control group, and the pupil diameter was larger than in the control group. The heat map and fixation trajectory map show convergence, mostly focusing on the position of keywords and key sentences, with relatively large saccade amplitude and more information obtained by one gaze. Moreover, they had a higher skipping reading rate, which enhanced reading speed to obtain information accurately and quickly. These empirical results indicate that mind mapping training was an effective method for improving students’ reading ability.

Undersweep fixations during reading in adults and children

Return sweeps take a reader's fixation from the end of one line to the start of the next. Return sweeps frequently undershoot their target and are followed by a corrective saccade toward the left margin. The pauses prior to corrective saccades are typically considered to be uninvolved in linguistic processing. However, recent findings indicate that these undersweep fixations influence skilled adult readers' subsequent reading pass across the line and provide preview of line-initial words. The current research examined these effects in children. First, a children's reading corpus analysis revealed that words receiving an undersweep fixation were more likely skipped and received shorter gaze durations during a subsequent pass. Second, a novel eye movement experiment that directly compared adults' and children's eye movements indicated that, during an undersweep fixation, readers very briefly allocate their attention to the fixated word-as indicated by inhibition of return effects during a subsequent pass-prior to deploying attention toward the line-initial word. We argue that prior to the redeployment of attention, readers extract information at the point of fixation that facilitates later encoding and saccade targeting. Given similar patterns of results for adults and children, we conclude that the mechanisms controlling for oculomotor coordination and attention necessary for reading across line boundaries are established from a very early point in reading development.

Contributions of reader- and text-level characteristics to eye-movement patterns during passage reading

The present research presents a novel method for investigating how characteristics of texts (words, sentences, and passages) and individuals (verbal and general cognitive skills) jointly influence eye-movement patterns over the time-course of reading, as well as comprehension accuracy. Fifty-one proficient readers read passages of varying complexity from the Gray Oral Reading Test, while their eye-movements were recorded. Participants also completed a large battery of tests assessing various components of reading comprehension ability (vocabulary size, decoding, phonological awareness, and experience with print), as well as general cognitive and executive skills. We used the Random Forests nonparametric regression technique to simultaneously estimate relative importance of all predictors. This method enabled us to trace the temporal engagement of individual predictors and entire predictor groups on eye-movements during reading, while avoiding the problems of model overfitting and collinearity, typical of parametric regression methods. Our findings both confirmed well-established results of prior research and pointed to a space of hypotheses that is as yet unexplored. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Do eye movements reveal differences between monolingual and bilingual children's first-language and second-language reading? A focus on word frequency effects

An extensive body of research has examined reading acquisition and performance in monolingual children. Surprisingly, however, much less is known about reading in bilingual children, who outnumber monolingual children globally. Here, we address this important imbalance in the literature by employing eye movement recordings to examine both global (i.e., text-level) and local (i.e., word-level) aspects of monolingual and bilingual children's reading performance across their first-language (L1) and second-language (L2). We also had a specific focus on lexical accessibility, indexed by word frequency effects. We had three main findings. First, bilingual children displayed reduced global and local L1 reading performance relative to monolingual children, including larger L1 word frequency effects. Second, bilingual children displayed reduced global and local L2 versus L1 reading performance, including larger L2 word frequency effects. Third, both groups of children displayed reduced global and local reading performance relative to adult comparison groups (across their known languages), including larger word frequency effects. Notably, our first finding was not captured by traditional offline measures of reading, such as standardized tests, suggesting that these measures may lack the sensitivity to detect such nuanced between-group differences in reading performance. Taken together, our findings demonstrate that bilingual children's simultaneous exposure to two reading systems leads to eye movement reading behavior that differs from that of monolingual children and has important consequences for how lexical information is accessed and integrated in both languages.

Orthographic processing: A ‘mid-level’ vision of reading: The 44th Sir Frederic Bartlett Lecture

I will describe how orthographic processing acts as a central interface between visual and linguistic processing during reading, and as such can be considered to be the ‘mid-level vision’ of reading research. In order to make this case, I first summarize the evidence in favour of letter-based word recognition before examining work investigating how orthographic similarities among words influence single word reading. I describe how evidence gradually accumulated against traditional measures of orthographic similarity and the associated theories of orthographic processing, forcing a reconsideration of how letter-position information is represented by skilled readers. Then, I present the theoretical framework that was developed to explain these findings, with a focus on the distinction between location-specific and location-invariant orthographic representations. Finally, I describe work extending this theoretical framework in two main directions: first, to the realm of reading development, with the aim to specify the key changes in the processing of letters and letter strings that accompany successful learning to read, and second, to the realm of sentence reading, in order to specify how orthographic information can be processed across several words in parallel, and how skilled readers keep track of which letters belong to which words.

The "risky" reading strategy revisited: New simulations using E-Z Reader

Eye-movement studies have demonstrated that, relative to college-aged readers, older readers of alphabetic languages like English and German tend to read more slowly, making more frequent and longer fixations and longer saccades, and skipping more words, but also making more frequent regressions. These findings have led to suggestions that older readers either adopt a "risky" strategy of using context to "guess" words as a way of compensating for slower rates of lexical processing, or have a smaller and more asymmetrical perceptual span. Unfortunately, neither of these hypotheses seemingly explains more recent observations that older readers of Chinese seem to adopt a more "conservative" strategy, making shorter saccades and skipping less often. In this paper, we use the E-Z Reader model of eye-movement control to examine several possible accounts of the differences between college-aged and older readers of both alphabetic and non-alphabetic languages. These simulations re-confirm that the "risky" strategy may be sufficient to explain age-related differences in reader's eye movements, with older readers of English versus Chinese being, respectively, more versus less inclined to guess upcoming words. The implications of these results for aging, reading, and models of eye-movement control are discussed.

Word skipping: Effects of word length, predictability, spelling and reading skill

Readers’ eyes often skip over words as they read. Skipping rates are largely determined by word length; short words are skipped more than long words. However, the predictability of a word in context also impacts skipping rates. Rayner, Slattery, Drieghe and Liversedge reported an effect of predictability on word skipping for even long words (10-13 characters) that extend beyond the word identification span. Recent research suggests that better readers and spellers have an enhanced perceptual span. We explored that whether reading and spelling skill interact with word length and predictability to impact word skipping rates in a large sample (N = 92) of average and poor adult readers. Participants read the items from Rayner et al., while their eye movements were recorded. Spelling skill (zSpell) was assessed using the dictation and recognition tasks developed by Sally Andrews and colleagues. Reading skill (zRead) was assessed from reading speed (words per minute) and comprehension accuracy of three 120 word passages each with 10 comprehension questions. We fit linear mixed models to the target gaze duration data and generalized linear mixed models to the target word skipping data. Target word gaze durations were significantly predicted by zRead, while the skipping likelihoods were significantly predicted by zSpell. Additionally, for gaze durations, zRead significantly interacted with word predictability as better readers relied less on context to support word processing. These effects are discussed in relation to the lexical quality hypothesis and eye movement models of reading.

An Analysis of the Time Course of Lexical Processing During Reading

Reingold, Reichle, Glaholt, and Sheridan (2012) reported a gaze-contingent eye-movement experiment in which survival-curve analyses were used to examine the effects of word frequency, the availability of parafoveal preview, and initial fixation location on the time course of lexical processing. The key results of these analyses suggest that lexical processing begins very rapidly (after approximately 120 ms) and is supported by substantial parafoveal processing (more than 100 ms). Because it is not immediately obvious that these results are congruent with the theoretical assumption that words are processed and identified in a strictly serial manner, we attempted to simulate the experiment using the E-Z Reader model of eye-movement control (Reichle, 2011). These simulations were largely consistent with the empirical results, suggesting that parafoveal processing does play an important functional role by allowing lexical processing to occur rapidly enough to mediate direct control over when the eyes move during reading.