Eye Movements and Fixation-Related Potentials in Reading: A Review

Looking for immediate and downstream evidence of lexical prediction in eye movements during reading

Previous investigations of whether readers make predictions about the full identity of upcoming words have focused on the extent to which there are processing consequences when readers encounter linguistic input that is incompatible with their expectations. To date, eye-movement studies have revealed inconsistent evidence of the processing costs that would be expected to accompany lexical prediction. This study investigated whether readers' lexical predictions were observable during or downstream from their initial point of activation. Three experiments assessed readers' eye movements to predictable and unpredictable words, and then to subsequent downstream words, which probed the lingering activation of previously expected words. The results showed novel evidence of processing costs for unexpected input but only when supported by a plausible linguistic environment, suggesting that readers could strategically modulate their predictive processing. However, there was limited evidence that their lexical predictions affected downstream processing. The implications of these findings for understanding the role of prediction in language processing are discussed.

Direct lexical control of eye movements in Chinese reading: Evidence from the co-registration of EEG and eye tracking

The direct-lexical-control hypothesis stipulates that some aspect of a word's processing determines the duration of the fixation on that word and/or the next. Although the direct lexical control is incorporated into most current models of eye-movement control in reading, the precise implementation varies and the assumptions of the hypothesis may not be feasible given that lexical processing must occur rapidly enough to influence fixation durations. Conclusive empirical evidence supporting this hypothesis is therefore lacking. In this article, we report the results of an eye-tracking experiment using the boundary paradigm in which native speakers of Chinese read sentences in which target words were either high- or low-frequency and preceded by a valid or invalid preview. Eye movements were co-registered with electroencephalography, allowing standard analyses of eye-movement measures, divergence point analyses of fixation-duration distributions, and fixated-related potentials on the target words. These analyses collectively provide strong behavioral and neural evidence of early lexical processing and thus strong support for the direct-lexical-control hypothesis. We discuss the implications of the findings for our understanding of how the hypothesis might be implemented, the neural systems that support skilled reading, and the nature of eye-movement control in the reading of Chinese versus alphabetic scripts.

Occlusal effects on text reading: an eye-tracker study

Introduction

Asymmetric electromyographic (EMG) activity during teeth clenching has been linked to cognitive impairment, as evaluated by the Spinnler-Tognoni matrices test, and to asymmetric pupil size (anisocoria). Anisocoria indicates an asymmetric Locus Coeruleus activity, leading to an asymmetric hemispheric excitability worsening cognitive performance. Bite splint wearing corrects EMG asymmetry, reduces anisocoria and improves cognitive performance. This study explores the possible effect of EMG asymmetry on oculomotor behavior during text reading.

Methods

In subjects showing different degrees of EMG asymmetry during clenching, the number and duration of fixation periods during a reading task, performed under two different occlusal conditions were analyzed. The first lecture was executed with a dental impression (imprint) interposed between the dental arches (corrected condition) and the second one with the arches in direct contact (habitual condition), without clenching effort. The imprint reduced the EMG asymmetries during clenching.

Results

In both occlusal conditions, total reading time correlated with duration of fixations, but not with their number. An inverse relation was observed between the number of fixations and their duration across individuals. Fixation frequency and duration were positively and negatively correlated with the amplitude of EMG asymmetry, respectively. Differently, total reading time was not related to the EMG asymmetry. When switching from the corrected to the habitual condition, an increase in the number of fixations and a reduction in their duration was observed, while total reading time could be either increased or decreased. An increased fixation frequency was observed in most of the subjects, while a reduced duration only among individuals with shorter reading times in habitual condition.

Discussion

In the habitual condition, EMG asymmetry influences reading patterns (more saccades/shorter fixations, less saccades/longer fixations) in our sample. The changes in text reading behavior elicited by occlusal correction can be explained by assuming that occlusal disharmony negatively interferes with the reading task by increasing the number of saccades necessary for text scanning. This finding may also indicate an increased difficulty in processing of visual information. The potential involvement of trigeminal pathways in the relation between occlusal factors and oculomotor control is discussed.

Neural correlates for word-frequency effect in Chinese natural reading

Word frequency effect has always been of interest for reading research because of its critical role in exploring mental processing underlying reading behaviors. Access to word frequency information has long been considered an indicator of the beginning of lexical processing and the most sensitive marker for studying when the brain begins to extract semantic information Sereno & Rayner, Brain and Cognition, 42, 78-81, (2000), Trends in Cognitive Sciences, 7, 489-493, (2003). While the word frequency effect has been extensively studied in numerous eye-tracking and traditional EEG research using the RSVP paradigm, there is a lack of corresponding evidence in studies of natural reading. To find the neural correlates of the word frequency effect, we conducted a study of Chinese natural reading using EEG and eye-tracking coregistration to examine the time course of lexical processing. Our results reliably showed that the word frequency effect first appeared in the N200 time window and the bilateral occipitotemporal regions. Additionally, the word frequency effect was reflected in the N400 time window, spreading from the occipital region to the central parietal and frontal regions. Our current study provides the first neural correlates for word-frequency effect in natural Chinese reading so far, shedding new light on understanding lexical processing in natural reading and could serve as an important basis for further reading study when considering neural correlates in a realistic manner.

An early effect of the parafoveal preview on post-saccadic processing of English words

A key aspect of efficient visual processing is to use current and previous information to make predictions about what we will see next. In natural viewing, and when looking at words, there is typically an indication of forthcoming visual information from extrafoveal areas of the visual field before we make an eye movement to an object or word of interest. This "preview effect" has been studied for many years in the word reading literature and, more recently, in object perception. Here, we integrated methods from word recognition and object perception to investigate the timing of the preview on neural measures of word recognition. Through a combined use of EEG and eye-tracking, a group of multilingual participants took part in a gaze-contingent, single-shot saccade experiment in which words appeared in their parafoveal visual field. In valid preview trials, the same word was presented during the preview and after the saccade, while in the invalid condition, the saccade target was a number string that turned into a word during the saccade. As hypothesized, the valid preview greatly reduced the fixation-related evoked response. Interestingly, multivariate decoding analyses revealed much earlier preview effects than previously reported for words, and individual decoding performance correlated with participant reading scores. These results demonstrate that a parafoveal preview can influence relatively early aspects of post-saccadic word processing and help to resolve some discrepancies between the word and object literatures.

Eye Movement Evidence for Simultaneous Cognitive Processing in Reading

Measuring simultaneous processing, a reliable predictor of reading development and reading difficulties (RDs), has traditionally involved cognitive tasks that test reaction or response time, which only capture the efficiency at the output processing stage and neglect the internal stages of information processing. However, with eye-tracking methodology, we can reveal the underlying temporal and spatial processes involved in simultaneous processing and investigate whether these processes are equivalent across chronological or reading age groups. This study used eye-tracking to investigate the simultaneous processing abilities of 15 Grade 6 and 15 Grade 3 children with RDs and their chronological-age controls (15 in each Grade). The Grade 3 typical readers were used as reading-level (RL) controls for the Grade 6 RD group. Participants were required to listen to a question and then point to a picture among four competing illustrations demonstrating the spatial relationship raised in the question. Two eye movements (fixations and saccades) were recorded using the EyeLink 1000 Plus eye-tracking system. The results showed that the Grade 3 RD group produced more and longer fixations than their CA controls, indicating that the pattern of eye movements of young children with RD is typically deficient compared to that of their typically developing counterparts when processing verbal and spatial stimuli simultaneously. However, no differences were observed between the Grade 6 groups in eye movement measures. Notably, the Grade 6 RD group outperformed the RL-matched Grade 3 group, yielding significantly fewer and shorter fixations. The discussion centers on the role of the eye-tracking method as a reliable means of deciphering the simultaneous cognitive processing involved in learning.

An eye on semantics: a study on the influence of concreteness and predictability on early fixation durations

We used eye-tracking during natural reading to study how semantic control and representation mechanisms interact for the successful comprehension of sentences, by manipulating sentence context and single-word meaning. Specifically, we examined whether a word's semantic characteristic (concreteness) affects first fixation and gaze durations (FFDs and GDs) and whether it interacts with the predictability of a word. We used a linear mixed effects model including several possible psycholinguistic covariates. We found a small but reliable main effect of concreteness and replicated a predictability effect on FFDs, but we found no interaction between the two. The results parallel previous findings of additive effects of predictability (context) and frequency (lexical level) in fixation times. Our findings suggest that the semantics of a word and the context created by the preceding words additively influence early stages of word processing in natural sentence reading.

Parallel word reading revealed by fixation-related brain potentials

During reading, the brain is confronted with many relevant objects at once. But does lexical processing occur for multiple words simultaneously? Cognitive science has yet to answer this prominent question. Recently it has been argued that the issue warrants supplementing the field's traditional toolbox (response times, eye-tracking) with neuroscientific techniques (EEG, fMRI). Indeed, according to the OB1-reader model, upcoming words need not impact oculomotor behavior per se, but parallel processing of these words must nonetheless be reflected in neural activity. Here we combined eye-tracking with EEG, time-locking the neural window of interest to the fixation on target words in sentence reading. During these fixations, we manipulated the identity of the subsequent word so that it posed either a syntactically legal or illegal continuation of the sentence. In line with previous research, oculomotor measures were unaffected. Yet, syntax impacted brain potentials as early as 100 ms after the target fixation onset. Given the EEG literature on syntax processing, the presently observed timings suggest parallel word reading. We reckon that parallel word processing typifies reading, and that OB1-reader offers a good platform for theorizing about the reading brain.

Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties

Neural correlates in reading and speech processing have been addressed extensively in the literature. While reading skills and speech perception have been shown to be associated with each other, their relationship remains debatable. In this study, we investigated reading skills, speech perception, reading, and their correlates with brain source activity in auditory and visual modalities. We used high-density event-related potentials (ERPs), fixation-related potentials (FRPs), and the source reconstruction method. The analysis was conducted on 12–13-year-old schoolchildren who had different reading levels. Brain ERP source indices were computed from frequently repeated Finnish speech stimuli presented in an auditory oddball paradigm. Brain FRP source indices were also computed for words within sentences presented in a reading task. The results showed significant correlations between speech ERP sources and reading scores at the P100 (P1) time range in the left hemisphere and the N250 time range in both hemispheres, and a weaker correlation for visual word processing N170 FRP source(s) in the posterior occipital areas, in the vicinity of the visual word form areas (VWFA). Furthermore, significant brain-to-brain correlations were found between the two modalities, where the speech brain sources of the P1 and N250 responses correlated with the reading N170 response. The results suggest that speech processes are linked to reading fluency and that brain activations to speech are linked to visual brain processes of reading. These results indicate that a relationship between language and reading systems is present even after several years of exposure to print.

Typical and Atypical Development of Visual Expertise for Print as Indexed by the Visual Word N1 (N170w): A Systematic Review

The visual word N1 (N170w) is an early brain ERP component that has been found to be a neurophysiological marker for print expertise, which is a prelexical requirement associated with reading development. To date, no other review has assimilated existing research on reading difficulties and atypical development of processes reflected in the N170w response. Hence, this systematic review synthesized results and evaluated neurophysiological and experimental procedures across different studies about visual print expertise in reading development. Literature databases were examined for relevant studies from 1995 to 2020 investigating the N170w response in individuals with or without reading disorders. To capture the development of the N170w related to reading, results were compared between three different age groups: pre-literate children, school-aged children, and young adults. The majority of available N170w studies (N = 69) investigated adults (n = 31) followed by children (school-aged: n = 21; pre-literate: n = 4) and adolescents (n = 1) while some studies investigated a combination of these age groups (n = 12). Most studies were conducted with German-speaking populations (n = 17), followed by English (n = 15) and Chinese (n = 14) speaking participants. The N170w was primarily investigated using a combination of words, pseudowords, and symbols (n = 20) and mostly used repetition-detection (n = 16) or lexical-decision tasks (n = 16). Different studies posed huge variability in selecting electrode sites for analysis; however, most focused on P7, P8, and O1 sites of the international 10–20 system. Most of the studies in adults have found a more negative N170w in controls than poor readers, whereas in children, the results have been mixed. In typical readers, N170w ranged from having a bilateral distribution to a left-hemispheric dominance throughout development, whereas in young, poor readers, the response was mainly right-lateralized and then remained in a bilateral distribution. Moreover, the N170w latency has varied according to age group, with adults having an earlier onset yet with shorter latency than school-aged and pre-literate children. This systematic review provides a comprehensive picture of the development of print expertise as indexed by the N170w across age groups and reading abilities and discusses theoretical and methodological differences and challenges in the field, aiming to guide future research.

Semantic parafoveal processing in natural reading: Insight from fixation-related potentials & eye movements

Prior research suggests that we may access the meaning of parafoveal words during reading. We explored how semantic-plausibility parafoveal processing takes place in natural reading through the co-registration of eye movements (EM) and fixation-related potentials (FRPs), using the boundary paradigm. We replicated previous evidence of semantic parafoveal processing from highly controlled reading situations, extending their findings to more ecologically valid reading scenarios. Additionally, and exploring the time-course of plausibility preview effects, we found distinct but complementary evidence from EM and FRPs measures. FRPs measures, showing a different trend than EM evidence, revealed that plausibility preview effects may be long-lasting. We highlight the importance of a co-registration set-up in ecologically valid scenarios to disentangle the mechanisms related to semantic-plausibility parafoveal processing.

Neural evidence for lexical parafoveal processing

In spite of the reduced visual acuity, parafoveal information plays an important role in natural reading. However, competing models on reading disagree on whether words are previewed parafoveally at the lexical level. We find neural evidence for lexical parafoveal processing by combining a rapid invisible frequency tagging (RIFT) approach with magnetoencephalography (MEG) and eye-tracking. In a silent reading task, target words are tagged (flickered) subliminally at 60 Hz. The tagging responses measured when fixating on the pre-target word reflect parafoveal processing of the target word. We observe stronger tagging responses during pre-target fixations when followed by low compared with high lexical frequency targets. Moreover, this lexical parafoveal processing is associated with individual reading speed. Our findings suggest that reading unfolds in the fovea and parafovea simultaneously to support fluent reading.