A Theoretical Analysis of the Perceptual Span based on SWIFT Simulations of the n + 2 Boundary Paradigm

Preview frequency effects in reading: evidence from Chinese

Studies about sentence reading have shown that visual and lexical information beyond the currently fixated word can be integrated across fixations. The gaze-contingent boundary paradigm has been used widely to explore the extent to which parafoveal information can be processed before a word is fixated on. However, a critical review of the current literature suggests that unrelated mask previews are an unlikely baseline control with zero lexical activation, blurring the nature of experimental effects observed in the paradigm. The present study, therefore, aimed at shedding light on the effect of parafoveal mask properties through a manipulation of preview word frequency. Low-frequency preview words that are unrelated to target words elicited a larger interference than high-frequency preview words. We discuss implications of the preview frequency effect for computational models of eye-movement control in reading.

The Beijing Sentence Corpus: A Chinese sentence corpus with eye movement data and predictability norms

This report introduces the Beijing Sentence Corpus (BSC). This is a Chinese sentence corpus of eye-tracking data with relatively clear word boundaries. In addition, we report predictability norms for each word in the corpus. Eye movement corpora are available in alphabetic scripts such as English, German, and French. However, there is no publicly available corpus for Chinese. Thus, to study predictive processes during reading in Chinese, it is necessary to establish such a corpus. Also, given the clear word boundaries in the sentences, BSC is especially useful to provide evidence relevant to the theoretical debate of saccade target selection in Chinese. With the large-scale predictability norms, we conducted new analyses based on 60 BSC readers, testing the influences of launch word and target word properties while controlling for visual and oculomotor constraints, as well as sentence and subject-level individual differences. We discuss implications for guidance of eye movements in Chinese reading.

Predictive modeling of parafoveal information processing during reading

Skilled reading requires information processing of the fixated and the not-yet-fixated words to generate precise control of gaze. Over the last 30 years, experimental research provided evidence that word processing is distributed across the perceptual span, which permits recognition of the fixated (foveal) word as well as preview of parafoveal words to the right of fixation. However, theoretical models have been unable to differentiate the specific influences of foveal and parafoveal information on saccade control. Here we show how parafoveal word difficulty modulates spatial and temporal control of gaze in a computational model to reproduce experimental results. In a fully Bayesian framework, we estimated model parameters for different models of parafoveal processing and carried out large-scale predictive simulations and model comparisons for a gaze-contingent reading experiment. We conclude that mathematical modeling of data from gaze-contingent experiments permits the precise identification of pathways from parafoveal information processing to gaze control, uncovering potential mechanisms underlying the parafoveal contribution to eye-movement control.

Parafoveal access to word stem during reading: An eye movement study

Previous studies (Hyönä, Yan, & Vainio, 2018; Yan et al., 2014) have demonstrated that in morphologically rich languages a word's morphological status is processed parafoveally to be used in modulating saccadic programming in reading. In the present parafoveal preview study conducted in Finnish, we examined the exact nature of this effect by comparing reading of morphologically complex words (a stem + two suffixes) to that of monomorphemic words. In the preview-change condition, the final 3-4 letters were replaced with other letters making the target word a pseudoword; for suffixed words, the word stem remained intact but the suffix information was unavailable; for monomorphemic words, only part of the stem was parafoveally available. Three alternative predictions were put forth. According to the first alternative, the morphological effect in initial fixation location is due to parafoveally perceiving the suffix as a highly frequent letter cluster and then adjusting the saccade program to land closer to the word beginning for suffixed than monomorphemic words. The second alternative, the processing difficulty hypothesis, assumes a morphological complexity effect: suffixed words are more complex than monomorphemic words. Therefore, the attentional window is narrower and the saccade is shorter. The third alternative posits that the effect reflects parafoveal access to the word's stem. The results for the initial fixation location and fixation durations were consistent with the parafoveal stem-access view.

Parafoveal degradation during reading reduces preview costs only when it is not perceptually distinct

There is a growing understanding that the parafoveal preview effect during reading may represent a combination of preview benefits and preview costs due to interference from parafoveal masks. It has been suggested that visually degrading the parafoveal masks may reduce their costs, but adult readers were later shown to be highly sensitive to degraded display changes. Four experiments examined how preview benefits and preview costs are influenced by the perception of distinct parafoveal degradation at the target word location. Participants read sentences with four preview types (identity, orthographic, phonological, and letter-mask preview) and two levels of visual degradation (0% vs. 20%). The distinctiveness of the target word degradation was either eliminated by degrading all words in the sentence (Experiments 1a–2a) or remained present, as in previous research (Experiments 1b–2b). Degrading the letter masks resulted in a reduction in preview costs, but only when all words in the sentence were degraded. When degradation at the target word location was perceptually distinct, it induced costs of its own, even for orthographically and phonologically related previews. These results confirm previous reports that traditional parafoveal masks introduce preview costs that overestimate the size of the true benefit. However, they also show that parafoveal degradation has the unintended consequence of introducing additional costs when participants are aware of distinct degradation on the target word. Parafoveal degradation appears to be easily perceived and may temporarily orient attention away from the reading task, thus delaying word processing.

The Role of Attention in Word Recognition: Results from OB1-Reader

When reading, orthographic information is extracted not only from the word the reader is looking at, but also from adjacent words in the parafovea. Here we examined, using the recently introduced OB1‐reader computational model, how orthographic information can be processed in parallel across multiple words and how orthographic information can be integrated across time and space. Although OB1‐reader is a model of text reading, here we used it to simulate single‐word recognition experiments in which parallel processing has been shown to play a role by manipulating the surrounding context in flanker and priming paradigms. In flanker paradigms, observers recognize a central word flanked by other letter strings located left and right of the target and separated from the target by a space. The model successfully accounts for the finding that such flankers can aid word recognition when they contain bigrams of the target word, independent of where those flankers are in the visual field. In priming experiments, in which the target word is preceded by a masked prime, the model accounts for the finding that priming occurs independent of whether the prime and target word are in the same location or not. Crucial to these successes is the key role that spatial attention plays within OB1‐reader, as it allows the model to receive visual input from multiple locations in parallel, while limiting the kinds of errors that can potentially occur under such spatial pooling of orthographic information.

Do Readers Integrate Phonological Codes Across Saccades? A Bayesian Meta-Analysis and a Survey of the Unpublished Literature

It is commonly accepted that phonological codes can be activated parafoveally during reading and later used to aid foveal word recognition- a finding known as the phonological preview benefit. However, a closer look at the literature shows that this effect may be less consistent than what is sometimes believed. To determine the extent to which phonology is processed parafoveally, a Bayesian meta-analysis of 27 experiments and a survey of the unpublished literature were conducted. While the results were generally consistent with the phonological preview benefit (>90% probability of a true effect in gaze durations), the size of the effect was small. Readers of alphabetical orthographies obtained a modest benefit of only 4 ms in gaze durations. Interestingly, Chinese readers showed a larger effect (6-14 ms in size). There was no difference in the magnitude of the phonological preview benefit between homophone and pseudo-homophone previews, thus suggesting that the modest processing advantage is indeed related to the activation of phonological codes from the parafoveal word. Simulations revealed that the results are relatively robust to missing studies, although the effects may be 19-22% smaller if all missing studies found a null effect. The results suggest that while phonology can be processed parafoveally, this happens only to a limited extent. Because phonological priming effects in single-word recognition are small (10-13 ms; Rastle & Brysbaert, 2006) and there is a loss of visual acuity in the parafovea, it is argued that large phonological preview benefit effects may be unlikely.

Stable preview difficulty effects in reading with an improved variant of the boundary paradigm

Using gaze-contingent display changes in the boundary paradigm during sentence reading, it has recently been shown that parafoveal word-processing difficulties affect fixations on words to the right of the boundary. Current interpretations of this post-boundary preview difficulty effect range from delayed parafoveal-on-foveal effects in parallel word-processing models to forced fixations in serial word-processing models. However, these findings are based on an experimental design that, while allowing to isolate preview difficulty effects, might have established a bias with respect to asymmetries in parafoveal preview benefit for high-frequent and low-frequent target words. Here, we present a revision of this paradigm varying the preview's lexical frequency and keeping the target word constant. We found substantial effects of the preview difficulty in fixation durations after the boundary confirming that preview processing affects the oculomotor decisions not only via trans-saccadic integration of preview and target word information. An additional time-course analysis showed that the preview difficulty effect was significant across the full fixation duration distribution on the target word without any evidence on the pretarget word before the boundary. We discuss implications of the accumulating evidence of post-boundary preview difficulty effects for models of eye movement control during reading.

Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian

This article introduces a new corpus of eye movements in silent reading-the Russian Sentence Corpus (RSC). Russian uses the Cyrillic script, which has not yet been investigated in cross-linguistic eye movement research. As in every language studied so far, we confirmed the expected effects of low-level parameters, such as word length, frequency, and predictability, on the eye movements of skilled Russian readers. These findings allow us to add Slavic languages using Cyrillic script (exemplified by Russian) to the growing number of languages with different orthographies, ranging from the Roman-based European languages to logographic Asian ones, whose basic eye movement benchmarks conform to the universal comparative science of reading (Share, 2008). We additionally report basic descriptive corpus statistics and three exploratory investigations of the effects of Russian morphology on the basic eye movement measures, which illustrate the kinds of questions that researchers can answer using the RSC. The annotated corpus is freely available from its project page at the Open Science Framework: https://osf.io/x5q2r/ .

Parafoveal preview effects from word N + 1 and word N + 2 during reading: A critical review and Bayesian meta-analysis

The use of gaze-contingent display techniques to study reading has shown that readers attend not only the currently fixated word, but also the word to the right of the current fixation. However, a critical look at the literature shows that a number of questions cannot be readily answered from the available literature reviews on the topic. First, there is no consensus as to whether readers also attend the second word to the right of fixation. Second, it is not clear whether parafoveal processing is more efficient in languages such as Chinese. Third, it is not well understood whether the measured effects are confounded by the properties of the parafoveal mask. In the present study, we addressed these issues by performing a Bayesian meta-analysis of 93 experiments that used the boundary paradigm (Rayner, Cognitive Psychology, 7, 65-81. doi: 10.1016/0010-028590005-5 , 1975). We describe three main findings: (1) The advantage of previewing the second word to the right is modest in size and likely is not centered on zero; (2) Chinese readers do seem to make more efficient use of parafoveal processing, but this is mostly evident in gaze durations; and (3) there are interference effects associated with using different parafoveal masks that roughly increase when the mask is less word-like.

Linked linear mixed models: A joint analysis of fixation locations and fixation durations in natural reading

The complexity of eye-movement control during reading allows measurement of many dependent variables, the most prominent ones being fixation durations and their locations in words. In current practice, either variable may serve as dependent variable or covariate for the other in linear mixed models (LMMs) featuring also psycholinguistic covariates of word recognition and sentence comprehension. Rather than analyzing fixation location and duration with separate LMMs, we propose linking the two according to their sequential dependency. Specifically, we include predicted fixation location (estimated in the first LMM from psycholinguistic covariates) and its associated residual fixation location as covariates in the second, fixation-duration LMM. This linked LMM affords a distinction between direct and indirect effects (mediated through fixation location) of psycholinguistic covariates on fixation durations. Results confirm the robustness of distributed processing in the perceptual span. They also offer a resolution of the paradox of the inverted optimal viewing position (IOVP) effect (i.e., longer fixation durations in the center than at the beginning and end of words) although the opposite (i.e., an OVP effect) is predicted from default assumptions of psycholinguistic processing efficiency: The IOVP effect in fixation durations is due to the residual fixation-location covariate, presumably driven primarily by saccadic error, and the OVP effect (at least the left part of it) is uncovered with the predicted fixation-location covariate, capturing the indirect effects of psycholinguistic covariates. We expect that linked LMMs will be useful for the analysis of other dynamically related multiple outcomes, a conundrum of most psychonomic research.

Evidence for simultaneous syntactic processing of multiple words during reading

A hotly debated issue in reading research concerns the extent to which readers process parafoveal words, and how parafoveal information might influence foveal word recognition. We investigated syntactic word processing both in sentence reading and in reading isolated foveal words when these were flanked by parafoveal words. In Experiment 1 we found a syntactic parafoveal preview benefit in sentence reading, meaning that fixation durations on target words were decreased when there was a syntactically congruent preview word at the target location (n) during the fixation on the pre-target (n-1). In Experiment 2 we used a flanker paradigm in which participants had to classify foveal target words as either noun or verb, when those targets were flanked by syntactically congruent or incongruent words (stimulus on-time 170 ms). Lower response times and error rates in the congruent condition suggested that higher-order (syntactic) information can be integrated across foveal and parafoveal words. Although higher-order parafoveal-on-foveal effects have been elusive in sentence reading, results from our flanker paradigm show that the reading system can extract higher-order information from multiple words in a single glance. We propose a model of reading to account for the present findings.

Reversed preview benefit effects: Forced fixations emphasize the importance of parafoveal vision for efficient reading

Current theories of eye movement control in reading posit that processing of an upcoming parafoveal preview word is used to facilitate processing of that word once it is fixated (i.e., as a foveal target word). This preview benefit is demonstrated by shorter fixation durations in the case of valid (i.e., identical or linguistically similar) compared with invalid (i.e., dissimilar) preview conditions. However, we suggest that processing of the preview can directly influence fixation behavior on the target, independent of similarity between them. In Experiment 1, unrelated high and low frequency words were used as orthogonally crossed previews and targets and we observed a reversed preview benefit for low frequency targets-shorter fixation durations with an invalid, higher frequency preview compared with a valid, low frequency preview. In Experiment 2, the target words were replaced with orthographically legal and illegal nonwords and we found a similar effect of preview frequency on fixation durations on the targets, as well as a bimodal distribution in the illegal nonword target conditions with a denser early peak for high than low frequency previews. In Experiment 3, nonwords were used as previews for high and low frequency targets, replicating standard findings that "denied" preview increases fixation durations and the influence of target properties. These effects can be explained by forced fixations, cases in which fixations on the target were shortened as a consequence of the timing of word recognition of the preview relative to the time course of saccade programming to that word from the prior one. That is, the preview word was (at least partially) recognized so that it should have been skipped, but the word could not be skipped because the saccade to that word was in a nonlabile stage. In these cases, the system preinitiates the subsequent saccade off the upcoming word to the following word and the intervening fixation is short. (PsycINFO Database Record

Parafoveal preview effects from word N + 1 and word N + 2 during reading: A critical review and Bayesian meta-analysis

The use of gaze-contingent display techniques to study reading has shown that readers attend not only the currently fixated word, but also the word to the right of the current fixation. However, a critical look at the literature shows that a number of questions cannot be readily answered from the available literature reviews on the topic. First, there is no consensus as to whether readers also attend the second word to the right of fixation. Second, it is not clear whether parafoveal processing is more efficient in languages such as Chinese. Third, it is not well understood whether the measured effects are confounded by the properties of the parafoveal mask. In the present study, we addressed these issues by performing a Bayesian meta-analysis of 93 experiments that used the boundary paradigm (Rayner, Cognitive Psychology, 7, 65-81. doi: 10.1016/0010-028590005-5 , 1975). We describe three main findings: (1) The advantage of previewing the second word to the right is modest in size and likely is not centered on zero; (2) Chinese readers do seem to make more efficient use of parafoveal processing, but this is mostly evident in gaze durations; and (3) there are interference effects associated with using different parafoveal masks that roughly increase when the mask is less word-like.

Oscillatory Brain Dynamics during Sentence Reading: A Fixation-Related Spectral Perturbation Analysis

The present study investigated oscillatory brain dynamics during self-paced sentence-level processing. Participants read fully correct sentences, sentences containing a semantic violation and "sentences" in which the order of the words was randomized. At the target word level, fixations on semantically unrelated words elicited a lower-beta band (13-18 Hz) desynchronization. At the sentence level, gamma power (31-55 Hz) increased linearly for syntactically correct sentences, but not when the order of the words was randomized. In the 300-900 ms time window after sentence onsets, theta power (4-7 Hz) was greater for syntactically correct sentences as compared to sentences where no syntactic structure was preserved (random words condition). We interpret our results as conforming with a recently formulated predictive-coding framework for oscillatory neural dynamics during sentence-level language comprehension. Additionally, we discuss how our results relate to previous findings with serial visual presentation vs. self-paced reading.

An Analysis of the Time Course of Lexical Processing During Reading

Reingold, Reichle, Glaholt, and Sheridan (2012) reported a gaze-contingent eye-movement experiment in which survival-curve analyses were used to examine the effects of word frequency, the availability of parafoveal preview, and initial fixation location on the time course of lexical processing. The key results of these analyses suggest that lexical processing begins very rapidly (after approximately 120 ms) and is supported by substantial parafoveal processing (more than 100 ms). Because it is not immediately obvious that these results are congruent with the theoretical assumption that words are processed and identified in a strictly serial manner, we attempted to simulate the experiment using the E-Z Reader model of eye-movement control (Reichle, 2011). These simulations were largely consistent with the empirical results, suggesting that parafoveal processing does play an important functional role by allowing lexical processing to occur rapidly enough to mediate direct control over when the eyes move during reading.

On forward inferences of fast and slow readers. An eye movement study

Unimpaired readers process words incredibly fast and hence it was assumed that top-down processing, such as predicting upcoming words, would be too slow to play an appreciable role in reading. This runs counter the major postulate of the predictive coding framework that our brain continually predicts probable upcoming sensory events. This means, it may generate predictions about the probable upcoming word during reading (dubbed forward inferences). Trying to asses these contradictory assumptions, we evaluated the effect of the predictability of words in sentences on eye movement control during silent reading. Participants were a group of fluent (i.e., fast) and a group of speed-impaired (i.e., slow) readers. The findings indicate that fast readers generate forward inferences, whereas speed-impaired readers do so to a reduced extent - indicating a significant role of predictive coding for fluent reading.

Word frequency in fast priming: Evidence for immediate cognitive control of eye-movements during reading

Numerous studies have demonstrated effects of word frequency on eye movements during reading, but the precise timing of this influence has remained unclear. The fast priming paradigm (Sereno & Rayner, 1992) was previously used to study influences of related versus unrelated primes on the target word. Here, we used this procedure to investigate whether the frequency of the prime word has a direct influence on eye movements during reading when the prime-target relation is not manipulated. We found that with average prime intervals of 32 ms readers made longer single fixation durations on the target word in the low than in the high frequency prime condition. Distributional analyses demonstrated that the effect of prime frequency on single fixation durations occurred very early, supporting theories of immediate cognitive control of eye movements. Finding prime frequency effects only 207 ms after visibility of the prime and for prime durations of 32 ms yields new time constraints for cognitive processes controlling eye movements during reading. Our variant of the fast priming paradigm provides a new approach to test early influences of word processing on eye movement control during reading.