Tracking the mind during reading: the influence of past, present, and future words on fixation durations

Role of Expectation and Working Memory Constraints in Hindi Comprehension: An Eye-tracking Corpus Analysis

We used the Potsdam-Allahabad Hindi eye-tracking corpus to investigate the role of wordlevel and sentence-level factors during sentence comprehension in Hindi. Extending previous work that used this eye-tracking data, we investigate the role of surprisal and retrieval cost metrics during sentence processing. While controlling for word-level predictors (word complexity, syllable length, unigram and bigram frequencies) as well as sentence-level predictors such as integration and storage costs, we find a significant effect of surprisal on first-pass reading times (higher surprisal value leads to increase in FPRT). Effect of retrieval cost was only found for a higher degree of parser parallelism. Interestingly, while surprisal has a significant effect on FPRT, storage cost (another predictionbased metric) does not. A significant effect of storage cost shows up only in total fixation time (TFT), thus indicating that these two measures perhaps capture different aspects of prediction. The study replicates previous findings that both prediction-based and memorybased metrics are required to account for processing patterns during sentence comprehension. The results also show that parser model assumptions are critical in order to draw generalizations about the utility of a metric (e.g. surprisal) across various phenomena in a language.

Comprehension demands modulate re-reading, but not first pass reading behavior

Several studies have examined effects of explicit task demands on eye movements in reading. However, there is relatively little prior research investigating the influence of implicit processing demands. In the present study, processing demands were manipulated by means of a between-subject manipulation of comprehension question difficulty. Consistent with previous results from Wotschack and Kliegl (2013), the question difficulty manipulation influenced the probability of regressing from late in sentences and re-reading earlier regions; readers who expected difficult comprehension questions were more likely to re-read. However, this manipulation had no reliable influence on eye movements during first pass reading of earlier sentence regions. Moreover, for the subset of sentences that contained a plausibility manipulation, the disruption induced by implausibility was not modulated by the question manipulation. We interpret these results as suggesting that comprehension demands influence reading behavior primarily by modulating a criterion for comprehension that readers apply after completing first-pass processing.

Foveal processing difficulty does not affect parafoveal preprocessing in young readers

Recent evidence suggested that parafoveal preprocessing develops early during reading acquisition, that is, young readers profit from valid parafoveal information and exhibit a resultant preview benefit. For young readers, however, it is unknown whether the processing demands of the currently fixated word modulate the extent to which the upcoming word is parafoveally preprocessed - as it has been postulated (for adult readers) by the foveal load hypothesis. The present study used the novel incremental boundary technique to assess whether 4^th and 6^th Graders exhibit an effect of foveal load. Furthermore, we attempted to distinguish the foveal load effect from the spillover effect. These effects are hard to differentiate with respect to the expected pattern of results, but are conceptually different. The foveal load effect is supposed to reflect modulations of the extent of parafoveal preprocessing, whereas the spillover effect reflects the ongoing processing of the previous word whilst the reader's fixation is already on the next word. The findings revealed that the young readers did not exhibit an effect of foveal load, but a substantial spillover effect. The implications for previous studies with adult readers and for models of eye movement control in reading are discussed.

Morphological structure influences the initial landing position in words during reading Finnish

The preferred viewing location in words [Rayner, K. (1979). Eye guidance in reading: Fixation locations within words. Perception, 8, 21-30] during reading is near the word centre. Parafoveal word length information is utilized to guide the eyes toward it. A recent study by Yan and colleagues [Yan, M., Zhou, W., Shu, H., Yusupu, R., Miao, D., Krügel, A., & Kliegl, R. (2014). Eye movements guided by morphological structure: Evidence from the Uighur language. Cognition, 132, 181-215] demonstrated that the word's morphological structure may also be used in saccadic targeting. The study was conducted in a morphologically rich language, Uighur. The present study aimed at replicating their main findings in another morphologically rich language, Finnish. Similarly to Yan et al., it was found that the initial fixation landed closer to the word beginning for morphologically complex than for monomorphemic words. Word frequency, saccade launch site, and word length were also found to influence the initial landing position. It is concluded that in addition to low-level factors (word length and saccade launch site), also higher level factors related to the word's morphological structure and frequency may be utilized in saccade programming during reading.

Exploring eye movements of experienced and novice readers of medical texts concerning the cardiovascular system in making a diagnosis

This study used the eye-tracking method to explore how the level of expertise influences reading, and solving, two written patient cases on cardiac failure and pulmonary embolus. Eye-tracking is a fairly commonly used method in medical education research, but it has been primarily applied to studies analyzing the processing of visualizations, such as medical images or patient video cases. Third-year medical students (n = 39) and residents (n = 13) read two patient case texts in an eye-tracking laboratory. The analysis focused on the diagnosis made, the total visit duration per text slide, and eye-movement indicators regarding task-relevant and task-redundant areas of the patient case text. The results showed that almost all participants (48/52) made the correct diagnosis of the first patient case, whereas all the residents, but only 17 students, correctly diagnosed the second case. The residents were efficient patient-case-solvers: they reached the correct diagnoses, and processed the cases faster and with a lower number of fixations than did the students. Further, the students and residents demonstrated different reading patterns with regard to which slides they proportionally paid most attention. The observed differences could be utilized in medical education to model expert reasoning and to teach the manner in which a good medical text is constructed. Eye-tracking methodology appears to have a great deal of potential in evaluating performance and growing diagnostic expertise in reading medical texts. However, further research using medical texts as stimuli is required. Anat Sci Educ 10: 23-33. © 2016 American Association of Anatomists.

Character Decomposition and Transposition of Chinese Compound Words in the Right and Left Visual Fields

This study investigated the character decomposition and transposition processes of Chinese two-character compound words (canonical and transposed words) and pseudowords in the right and left visual fields using a dual-target rapid serial visual presentation paradigm. The results confirmed a right visual field superiority for canonical words, but this advantage vanished for transposed words. The findings further indicated that the same quality of lexical processing could be obtained from the foveal and parafoveal regions of the right and left visual fields, regardless of the character order, but not in the periphery of the right visual field. Moreover, the proportion of order reversals peaked at the central position and the shortest exposure time, but it declined with increasing eccentricity and time interval. We concluded that the character transposition of Chinese compound words was significantly sensitive in the periphery of the right visual field. Furthermore, the character order errors were mainly encoded in the foveal vision with a duration of 100 ms, which suggested that the order of the foveally presented Chinese characters was more likely to be reversed at the early stage of visual word processing.

Patients with Mild Alzheimer's Disease Fail When Using Their Working Memory: Evidence from the Eye Tracking Technique

Patients with Alzheimer's disease (AD) develop progressive language, visuoperceptual, attentional, and oculomotor changes that can have an impact on their reading comprehension. However, few studies have examined reading behavior in AD, and none have examined the contribution of predictive cueing in reading performance. For this purpose we analyzed the eye movement behavior of 35 healthy readers (Controls) and 35 patients with probable AD during reading of regular and high-predictable sentences. The cloze predictability of words N - 1, and N + 1 exerted an influence on the reader's gaze duration. The predictabilities of preceding words in high-predictable sentences served as task-appropriate cues that were used by Control readers. In contrast, these effects were not present in AD patients. In Controls, changes in predictability significantly affected fixation duration along the sentence; noteworthy, these changes did not affect fixation durations in AD patients. Hence, only in healthy readers did predictability of upcoming words influence fixation durations via memory retrieval. Our results suggest that Controls used stored information of familiar texts for enhancing their reading performance and imply that contextual-word predictability, whose processing is proposed to require memory retrieval, only affected reading behavior in healthy subjects. In AD patients, this loss reveals impairments in brain areas such as those corresponding to working memory and memory retrieval. These findings might be relevant for expanding the options for the early detection and monitoring in the early stages of AD. Furthermore, evaluation of eye movements during reading could provide a new tool for measuring drug impact on patients' behavior.

The word frequency effect during sentence reading: A linear or nonlinear effect of log frequency?

The effect of word frequency on eye movement behaviour during reading has been reported in many experimental studies. However, the vast majority of these studies compared only two levels of word frequency (high and low). Here we assess whether the effect of log word frequency on eye movement measures is linear, in an experiment in which a critical target word in each sentence was at one of three approximately equally spaced log frequency levels. Separate analyses treated log frequency as a categorical or a continuous predictor. Both analyses showed only a linear effect of log frequency on the likelihood of skipping a word, and on first fixation duration. Ex-Gaussian analyses of first fixation duration showed similar effects on distributional parameters in comparing high- and medium-frequency words, and medium- and low-frequency words. Analyses of gaze duration and the probability of a refixation suggested a nonlinear pattern, with a larger effect at the lower end of the log frequency scale. However, the nonlinear effects were small, and Bayes Factor analyses favoured the simpler linear models for all measures. The possible roles of lexical and post-lexical factors in producing nonlinear effects of log word frequency during sentence reading are discussed.

Benefits from Vergence Rehabilitation: Evidence for Improvement of Reading Saccades and Fixations

We hypothesize that binocular coordination of saccades is based on continuous neuroplasticity involving interactions of saccades and vergence. To test this hypothesis we study reading saccades in young students who were diagnosed for vergence disorders before and after vergence rehabilitation. Following orthoptic evaluation and symptomatology screening, 5 weekly sessions of vergence rehabilitation were applied with the REMOBI vergence double step protocole (see Kapoula et al., 2016). Using the Eyeseecam videoculography device we measured vergence as well as saccades and fixations during a reading test four times: at the beginning and at the end of the first and of the fifth vergence rehabilitation session. The results show elimination of symptoms, improvement of clinical orthoptic scores, and importantly increase of measured vergence gain and reduction of inter-trial variability. Improvement of the vergence was associated to a decrease of the disconjugacy of saccades during reading but also to shortening of fixation durations, to reduction of the number of regressive saccades and to a better correction of the intra-saccadic disconjugacy during the following fixation. The results corroborate the hypothesis of neuroplasticity based on saccade vergence interaction in young adults. It validates the clinical validity of the vergence double-step REMOBI method as a means to improve both, vergence and reading performances. It opens a new research approach on the link between fine binocular coordination of saccades, quality of the vergence response, attention, cognition and reading.

Dissociating parafoveal preview benefit and parafovea-on-fovea effects during reading: A combined eye tracking and EEG study

During reading, the parafoveal processing of an upcoming word n+1 can influence word recognition in two ways: It can affect fixation behavior during the preceding fixation on word n (parafovea-on-fovea effect, POF), and it can facilitate subsequent foveal processing once word n+1 is fixated (preview benefit). While preview benefits are established, evidence for POF effects is mixed. Recently, it has been suggested that POF effects exist, but have a delayed impact on saccade planning and thus coincide with preview benefits measured on word n+1. We combined eye movement and EEG recordings to investigate and separate neural correlates of POF and preview benefit effects. Participants read lists of nouns either in a boundary paradigm or the RSVP-with-flankers paradigm, while we recorded fixation- or event-related potentials (FRPs/ERPs), respectively. The validity and lexical frequency of the word shown as preview for the upcoming word n+1 were orthogonally manipulated. Analyses focused on the first fixation on word n+1. Preview validity (correct vs. incorrect preview) strongly modulated fixation times and electrophysiological N1 amplitudes, replicating previous findings. Importantly, gaze durations and FRPs measured on word n+1 were also affected by the frequency of the word shown as preview, with low-frequency previews eliciting a sustained, N400-like centroparietal negativity. Results support the idea that POF effects exist but affect word recognition with a delay. Lastly, once word n+1 was fixated, its frequency also modulated N1 amplitudes in ERPs and FRPs. Taken together, we separated immediate and delayed effects of parafoveal processing on brain correlates of word recognition.

Contextual predictability enhances reading performance in patients with schizophrenia

In the present work we analyzed fixation duration in 40 healthy individuals and 18 patients with chronic, stable SZ during reading of regular sentences and proverbs. While they read, their eye movements were recorded. We used lineal mixed models to analyze fixation durations. The predictability of words N-1, N, and N+1 exerted a strong influence on controls and SZ patients. The influence of the predictabilities of preceding, current, and upcoming words on SZ was clearly reduced for proverbs in comparison to regular sentences. Both controls and SZ readers were able to use highly predictable fixated words for an easier reading. Our results suggest that SZ readers might compensate attentional and working memory deficiencies by using stored information of familiar texts for enhancing their reading performance. The predictabilities of words in proverbs serve as task-appropriate cues that are used by SZ readers. To the best of our knowledge, this is the first study using eyetracking for measuring how patients with SZ process well-defined words embedded in regular sentences and proverbs. Evaluation of the resulting changes in fixation durations might provide a useful tool for understanding how SZ patients could enhance their reading performance.

Word processing during reading sentences in patients with schizophrenia: evidences from the eyetracking technique

PURPOSE

The current study analyze the effect of word properties (i.e., word length, word frequency and word predictability) on the eye movement behavior of patients with schizophrenia (SZ) compared to age-matched controls.

METHOD

18 SZ patients and 40 age matched controls participated in the study. Eye movements were recorded during reading regular sentences by using the eyetracking technique. Eye movement analyses were performed using linear mixed models.

FINDINGS

Analysis of eye movements revealed that patients with SZ decreased the amount of single fixations, increased their total number of second pass fixations compared with healthy individuals (Controls). In addition, SZ patients showed an increase in gaze duration, compared to Controls. Interestingly, the effects of current word frequency and current word length processing were similar in Controls and SZ patients. The high rate of second pass fixations and its low rate in single fixation might reveal impairments in working memory when integrating neighbor words. In contrast, word frequency and length processing might require less complex mechanisms, which were functioning in SZ patients.

CONCLUSION

To the best of our knowledge, this is the first study measuring how patients with SZ process dynamically well-defined words embedded in regular sentences. The findings suggest that evaluation of the resulting changes in eye movement behavior may supplement current symptom-based diagnosis.

Words in Context: The Effects of Length, Frequency, and Predictability on Brain Responses During Natural Reading

Word length, frequency, and predictability count among the most influential variables during reading. Their effects are well-documented in eye movement studies, but pertinent evidence from neuroimaging primarily stem from single-word presentations. We investigated the effects of these variables during reading of whole sentences with simultaneous eye-tracking and functional magnetic resonance imaging (fixation-related fMRI). Increasing word length was associated with increasing activation in occipital areas linked to visual analysis. Additionally, length elicited a U-shaped modulation (i.e., least activation for medium-length words) within a brain stem region presumably linked to eye movement control. These effects, however, were diminished when accounting for multiple fixation cases. Increasing frequency was associated with decreasing activation within left inferior frontal, superior parietal, and occipito-temporal regions. The function of the latter region—hosting the putative visual word form area—was originally considered as limited to sublexical processing. An exploratory analysis revealed that increasing predictability was associated with decreasing activation within middle temporal and inferior frontal regions previously implicated in memory access and unification. The findings are discussed with regard to their correspondence with findings from single-word presentations and with regard to neurocognitive models of visual word recognition, semantic processing, and eye movement control during reading.

An Extension of a Parallel-Distributed Processing Framework of Reading Aloud in Japanese: Human Nonword Reading Accuracy Does Not Require a Sequential Mechanism

Humans can pronounce a nonword (e.g., rint). Some researchers have interpreted this behavior as requiring a sequential mechanism by which a grapheme-phoneme correspondence rule is applied to each grapheme in turn. However, several parallel-distributed processing (PDP) models in English have simulated human nonword reading accuracy without a sequential mechanism. Interestingly, the Japanese psycholinguistic literature went partly in the same direction, but it has since concluded that a sequential parsing mechanism is required to reproduce human nonword reading accuracy. In this study, by manipulating the list composition (i.e., pure word/nonword list vs. mixed list), we demonstrated that past psycholinguistic studies in Japanese have overestimated human nonword reading accuracy. When the more fairly reevaluated human performance was targeted, a newly implemented Japanese PDP model simulated the target accuracy as well as the error patterns. These findings suggest that PDP models are a more parsimonious way of explaining reading across various languages.

Oscillatory Brain Dynamics during Sentence Reading: A Fixation-Related Spectral Perturbation Analysis

The present study investigated oscillatory brain dynamics during self-paced sentence-level processing. Participants read fully correct sentences, sentences containing a semantic violation and "sentences" in which the order of the words was randomized. At the target word level, fixations on semantically unrelated words elicited a lower-beta band (13-18 Hz) desynchronization. At the sentence level, gamma power (31-55 Hz) increased linearly for syntactically correct sentences, but not when the order of the words was randomized. In the 300-900 ms time window after sentence onsets, theta power (4-7 Hz) was greater for syntactically correct sentences as compared to sentences where no syntactic structure was preserved (random words condition). We interpret our results as conforming with a recently formulated predictive-coding framework for oscillatory neural dynamics during sentence-level language comprehension. Additionally, we discuss how our results relate to previous findings with serial visual presentation vs. self-paced reading.

An Analysis of the Time Course of Lexical Processing During Reading

Reingold, Reichle, Glaholt, and Sheridan (2012) reported a gaze-contingent eye-movement experiment in which survival-curve analyses were used to examine the effects of word frequency, the availability of parafoveal preview, and initial fixation location on the time course of lexical processing. The key results of these analyses suggest that lexical processing begins very rapidly (after approximately 120 ms) and is supported by substantial parafoveal processing (more than 100 ms). Because it is not immediately obvious that these results are congruent with the theoretical assumption that words are processed and identified in a strictly serial manner, we attempted to simulate the experiment using the E-Z Reader model of eye-movement control (Reichle, 2011). These simulations were largely consistent with the empirical results, suggesting that parafoveal processing does play an important functional role by allowing lexical processing to occur rapidly enough to mediate direct control over when the eyes move during reading.

The Influence of Content Meaningfulness on Eye Movements across Tasks: Evidence from Scene Viewing and Reading

The present study investigated the influence of content meaningfulness on eye-movement control in reading and scene viewing. Texts and scenes were manipulated to make them uninterpretable, and then eye-movements in reading and scene-viewing were compared to those in pseudo-reading and pseudo-scene viewing. Fixation durations and saccade amplitudes were greater for pseudo-stimuli. The effect of the removal of meaning was seen exclusively in the tail of the fixation duration distribution in both tasks, and the size of this effect was the same across tasks. These findings suggest that eye movements are controlled by a common mechanism in reading and scene viewing. They also indicate that not all eye movements are responsive to the meaningfulness of stimulus content. Implications for models of eye movement control are discussed.

Toward FRP-Based Brain-Machine Interfaces-Single-Trial Classification of Fixation-Related Potentials

The co-registration of eye tracking and electroencephalography provides a holistic measure of ongoing cognitive processes. Recently, fixation-related potentials have been introduced to quantify the neural activity in such bi-modal recordings. Fixation-related potentials are time-locked to fixation onsets, just like event-related potentials are locked to stimulus onsets. Compared to existing electroencephalography-based brain-machine interfaces that depend on visual stimuli, fixation-related potentials have the advantages that they can be used in free, unconstrained viewing conditions and can also be classified on a single-trial level. Thus, fixation-related potentials have the potential to allow for conceptually different brain-machine interfaces that directly interpret cortical activity related to the visual processing of specific objects. However, existing research has investigated fixation-related potentials only with very restricted and highly unnatural stimuli in simple search tasks while participant’s body movements were restricted. We present a study where we relieved many of these restrictions while retaining some control by using a gaze-contingent visual search task. In our study, participants had to find a target object out of 12 complex and everyday objects presented on a screen while the electrical activity of the brain and eye movements were recorded simultaneously. Our results show that our proposed method for the classification of fixation-related potentials can clearly discriminate between fixations on relevant, non-relevant and background areas. Furthermore, we show that our classification approach generalizes not only to different test sets from the same participant, but also across participants. These results promise to open novel avenues for exploiting fixation-related potentials in electroencephalography-based brain-machine interfaces and thus providing a novel means for intuitive human-machine interaction.

Distinguishing Target From Distractor in Stroop, Picture-Word, and Word-Word Interference Tasks

Lexical selection-both during reading aloud and speech production-involves selecting an intended word, while ignoring irrelevant lexical activation. This process has been studied by the use of interference tasks. Examples are the Stroop task, where participants ignore the written color word and name the color of the ink, picture-word interference tasks, where participants name a picture while ignoring a super-imposed written word, or word-word interference (WWI) tasks, where two words are presented and the participants need to respond to only one, based on an pre-determined visual feature (e.g., color, position). Here, we focus on the WWI task: it is theoretically impossible for existing models to explain how the cognitive system can respond to one stimulus and block the other, when they are presented by the same modality (i.e., they are both words). We describe a solution that can explain performance on the WWI task: drawing on the literature on visual attention, we propose that the system creates an object file for each perceived object, which is continuously updated with increasingly complete information about the stimulus, such as the task-relevant visual feature. Such a model can account for performance on all three tasks.

Patients with mild Alzheimer's disease produced shorter outgoing saccades when reading sentences

In the present work we analyzed forward saccades of thirty five elderly subjects (Controls) and of thirty five mild Alzheimer's disease (AD) during reading regular and high-predictable sentences. While they read, their eye movements were recorded. The pattern of forward saccade amplitudes as a function of word predictability was clearly longer in Controls. Our results suggest that Controls might use stored information of words for enhancing their reading performance. Further, cloze predictability increased outgoing saccades amplitudes, as this increase stronger in high-predictable sentences. Quite the contrary, patients with mild AD evidenced reduced forward saccades even at early stages of the disease. This reduction might reveal impairments in brain areas such as those corresponding to working memory, memory retrieval, and semantic memory functions that are already present at early stages of AD. Our findings might be relevant for expanding the options for the early detection and monitoring of in the early stages of AD. Furthermore, eye movements during reading could provide a new tool for measuring a drug's impact on patient's behavior.

The eye-voice span during reading aloud

Although eye movements during reading are modulated by cognitive processing demands, they also reflect visual sampling of the input, and possibly preparation of output for speech or the inner voice. By simultaneously recording eye movements and the voice during reading aloud, we obtained an output measure that constrains the length of time spent on cognitive processing. Here we investigate the dynamics of the eye-voice span (EVS), the distance between eye and voice. We show that the EVS is regulated immediately during fixation of a word by either increasing fixation duration or programming a regressive eye movement against the reading direction. EVS size at the beginning of a fixation was positively correlated with the likelihood of regressions and refixations. Regression probability was further increased if the EVS was still large at the end of a fixation: if adjustment of fixation duration did not sufficiently reduce the EVS during a fixation, then a regression rather than a refixation followed with high probability. We further show that the EVS can help understand cognitive influences on fixation duration during reading: in mixed model analyses, the EVS was a stronger predictor of fixation durations than either word frequency or word length. The EVS modulated the influence of several other predictors on single fixation durations (SFDs). For example, word-N frequency effects were larger with a large EVS, especially when word N-1 frequency was low. Finally, a comparison of SFDs during oral and silent reading showed that reading is governed by similar principles in both reading modes, although EVS maintenance and articulatory processing also cause some differences. In summary, the EVS is regulated by adjusting fixation duration and/or by programming a regressive eye movement when the EVS gets too large. Overall, the EVS appears to be directly related to updating of the working memory buffer during reading.

Eyes on words: A fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent reading of words and pseudowords

The predominant finding of studies assessing the response of the left ventral occipito-temporal cortex (vOT) to familiar words and to unfamiliar, but pronounceable letter strings (pseudowords) is higher activation for pseudowords. One explanation for this finding is that readers automatically generate predictions about a letter string's identity - pseudowords mismatch these predictions and the higher vOT activation is interpreted as reflecting the resultant prediction errors. The majority of studies, however, administered tasks which imposed demands above and beyond the intrinsic requirements of visual word recognition. The present study assessed the response of the left vOT to words and pseudowords by using the onset of the first fixation on a stimulus as time point for modeling the BOLD signal (fixation-related fMRI). This method allowed us to assess the neural correlates of self-paced silent reading with minimal task demands and natural exposure durations. In contrast to the predominantly reported higher vOT activation for pseudowords, we found higher activation for words. This finding is at odds with the expectation of higher vOT activation for pseudowords due to automatically generated predictions and the accompanying elevation of prediction errors. Our finding conforms to an alternative explanation which considers such top-down processing to be non-automatic and task-dependent.

Word length and frequency effects on children's eye movements during silent reading

In the present study we measured the eye movements of a large sample of 2nd grade German speaking children and a control group of adults during a silent reading task. To be able to directly investigate the interaction of word length and frequency effects we employed controlled sentence frames with embedded target words in an experimental design in which length and frequency were manipulated independently of one another. Unlike previous studies which have investigated the interaction of word length and frequency effects in children, we used age-appropriate word frequencies for children. We found significant effects of word length and frequency for both children and adults while effects were generally greater for children. The interaction of word length and frequency was significant for children in gaze duration and total viewing time eye movement measures but not for adults. Our results suggest that children rely on sublexical decoding of infrequent words, leading to greater length effects for infrequent than frequent words while adults do not show this effect when reading children's reading materials.

ICAT: a computational model for the adaptive control of fixation durations

Eye movements depend on cognitive processes related to visual information processing. Much has been learned about the spatial selection of fixation locations, while the principles governing the temporal control (fixation durations) are less clear. Here, we review current theories for the control of fixation durations in tasks like visual search, scanning, scene perception, and reading and propose a new model for the control of fixation durations. We distinguish two local principles from one global principle of control. First, an autonomous saccade timer initiates saccades after random time intervals (local-I). Second, foveal inhibition permits immediate prolongation of fixation durations by ongoing processing (local-II). Third, saccade timing is adaptive, so that the mean timer value depends on task requirements and fixation history (Global). We demonstrate by numerical simulations that our model qualitatively reproduces patterns of mean fixation durations and fixation duration distributions observed in typical experiments. When combined with assumptions of saccade target selection and oculomotor control, the model accounts for both temporal and spatial aspects of eye movement control in two versions of a visual search task. We conclude that the model provides a promising framework for the control of fixation durations in saccadic tasks.

Smoothing spline ANOVA decomposition of arbitrary splines: an application to eye movements in reading

The Smoothing Spline ANOVA (SS-ANOVA) requires a specialized construction of basis and penalty terms in order to incorporate prior knowledge about the data to be fitted. Typically, one resorts to the most general approach using tensor product splines. This implies severe constraints on the correlation structure, i.e. the assumption of isotropy of smoothness can not be incorporated in general. This may increase the variance of the spline fit, especially if only a relatively small set of observations are given. In this article, we propose an alternative method that allows to incorporate prior knowledge without the need to construct specialized bases and penalties, allowing the researcher to choose the spline basis and penalty according to the prior knowledge of the observations rather than choosing them according to the analysis to be done. The two approaches are compared with an artificial example and with analyses of fixation durations during reading.

On forward inferences of fast and slow readers. An eye movement study

Unimpaired readers process words incredibly fast and hence it was assumed that top-down processing, such as predicting upcoming words, would be too slow to play an appreciable role in reading. This runs counter the major postulate of the predictive coding framework that our brain continually predicts probable upcoming sensory events. This means, it may generate predictions about the probable upcoming word during reading (dubbed forward inferences). Trying to asses these contradictory assumptions, we evaluated the effect of the predictability of words in sentences on eye movement control during silent reading. Participants were a group of fluent (i.e., fast) and a group of speed-impaired (i.e., slow) readers. The findings indicate that fast readers generate forward inferences, whereas speed-impaired readers do so to a reduced extent - indicating a significant role of predictive coding for fluent reading.

A Legibility Study of Chinese Character Complicacy and Eye Movement Data

This study investigated the correlations between the complicacy and legibility of Chinese characters by using eye tracking analyzed with structural equation modeling. 13 university students, 6 men and 7 women, with a mean age of 21 yr. ( SD = 1.7) participated. The results indicated that block types affected legibility and that saccade amplitude, number of fixations, and complicacy differed due to diverse character structures. Structural Equation Modeling showed that the number of strokes, number of nodes, and image density in stroke complicacy affected the number of fixations and saccade amplitude in eye movement data. Constructing a character complicacy and eye tracking information model to investigate the correlations between Chinese character features and human viewing behavior can provide guidance for Chinese character recognizability and type design.

Parafoveal processing affects outgoing saccade length during the reading of Chinese

Participants' eye movements were measured while reading Chinese sentences in which target-word frequency and the availability of parafoveal processing were manipulated using a gaze-contingent boundary paradigm. The results of this study indicate that preview availability and its interaction with word frequency modulated the length of the saccades exiting the target words, suggesting important functional roles for parafoveal processing in determining where the eyes move during reading. The theoretical significance of these findings is discussed in relation to 2 current models of eye-movement control during reading, both of which assume that saccades are directed toward default targets (e.g., the center of the next unidentified word). A possible method for addressing these limitations (i.e., dynamic attention allocation) is also discussed.

Regression-based estimation of ERP waveforms: I. The rERP framework

ERP averaging is an extraordinarily successful method, but can only be applied to a limited range of experimental designs. We introduce the regression-based rERP framework, which extends ERP averaging to handle arbitrary combinations of categorical and continuous covariates, partial confounding, nonlinear effects, and overlapping responses to distinct events, all within a single unified system. rERPs enable a richer variety of paradigms (including high-N naturalistic designs) while preserving the advantages of traditional ERPs. This article provides an accessible introduction to what rERPs are, why they are useful, how they are computed, and when we should expect them to be effective, particularly in cases of partial confounding. A companion article discusses how nonlinear effects and overlap correction can be handled within this framework, as well as practical considerations around baselining, filtering, statistical testing, and artifact rejection. Free software implementing these techniques is available.

Effects of anomalous characters and small stroke omissions on eye movements during the reading of Chinese sentences

We investigated the influence of typographical errors (typos) on eye movements and word recognition in Chinese reading. Participants' eye movements were tracked as they read sentences in which the target words were presented (1) normally, (2) with the initial stroke of the first characters removed (the omitted stroke condition) or (3) the first characters replaced by anomalous characters (the anomalous character condition). The results indicated that anomalous characters caused longer fixation durations and shorter outgoing forward saccade lengths than the correct words. This finding is consistent with the prediction of the theory of the processing-based strategy. Additionally, anomalous characters strongly disrupted lexical processing and whole sentence comprehension, but small stroke omissions did not. Implications of the effect of processing difficulty on forward saccade targeting for models of eye movement control during Chinese reading are discussed.

No association between autistic traits and contextual influences on eye-movements during reading

Individuals with autism spectrum disorders are claimed to show a local cognitive bias, termed “weak central coherence”, which manifests in a reduced influence of contextual information on linguistic processing. Here, we investigated whether this bias might also be demonstrated by individuals who exhibit sub-clinical levels of autistic traits, as has been found for other aspects of autistic cognition. The eye-movements of 71 university students were monitored as they completed a reading comprehension task. Consistent with previous studies, participants made shorter fixations on words that were highly predicted on the basis of preceding sentence context. However, contrary to the weak central coherence account, this effect was not reduced amongst individuals with high levels of autistic traits, as measured by the Autism Spectrum Quotient (AQ). Further exploratory analyses revealed that participants with high AQ scores fixated longer on words that resolved the meaning of an earlier homograph. However, this was only the case for sentences where the two potential meanings of the homograph result in different pronunciations. The results provide tentative evidence for differences in reading style that are associated with autistic traits, but fail to support the notion of weak central coherence extending into the non-autistic population.

Using E-Z Reader to examine the consequences of fixation-location measurement error

There is an ongoing debate about whether fixation durations during reading are only influenced by the processing difficulty of the words being fixated (i.e., the serial-attention hypothesis) or whether they are also influenced by the processing difficulty of the previous and/or upcoming words (i.e., the attention-gradient hypothesis). This article reports the results of 3 simulations that examine how systematic and random errors in the measurement of fixation locations can generate 2 phenomena that support the attention-gradient hypothesis: parafoveal-on-foveal effects and large spillover effects. These simulations demonstrate how measurement error can produce these effects within the context of a computational model of eye-movement control during reading (E-Z Reader; Reichle, 2011) that instantiates strictly serial allocation of attention, thus demonstrating that these effects do not necessarily provide strong evidence against the serial-attention hypothesis.

Developmental Changes in Eye Movements and Visual Information Encoding Associated With Learning to Read

A great deal of eye-movement research has resulted in sophisticated computational models of skilled adult reading. As yet, insufficient eye-movement research has been conducted with children to allow a more thorough understanding of the developmental trajectory leading up to this end state. I argue that, in order to fully understand how children progress to skilled adult reading, it is necessary to consider changes in both cognitive processing and eye-movement behavior. By recording children’s eye movements during reading, researchers can document how printed text is encoded and incrementally delivered for subsequent cognitive processing, and understand how developmental changes in these two aspects of reading are interdependent.

The effect of high- and low-frequency previews and sentential fit on word skipping during reading

In a previous gaze-contingent boundary experiment, Angele and Rayner (2013) found that readers are likely to skip a word that appears to be the definite article the even when syntactic constraints do not allow for articles to occur in that position. In the present study, we investigated whether the word frequency of the preview of a 3-letter target word influences a reader's decision to fixate or skip that word. We found that the word frequency rather than the felicitousness (syntactic fit) of the preview affected how often the upcoming word was skipped. These results indicate that visual information about the upcoming word trumps information from the sentence context when it comes to making a skipping decision. Skipping parafoveal instances of the therefore may simply be an extreme case of skipping high-frequency words.

How embodied is action language? Neurological evidence from motor diseases

Although motor-language coupling is now being extensively studied, its underlying mechanisms are not fully understood. In this sense, a crucial opposition has emerged between the non-representational and the representational views of embodiment. The former posits that action language is grounded on the non-brain motor system directly engaged by musculoskeletal activity - i.e., peripheral involvement of ongoing actions. Conversely, the latter proposes that such grounding is afforded by the brain's motor system - i.e., activation of neural areas representing motor action. We addressed this controversy through the action-sentence compatibility effect (ACE) paradigm, which induces a contextual coupling of motor actions and verbal processing. ACEs were measured in three patient groups - early Parkinson's disease (EPD), neuromyelitis optica (NMO), and acute transverse myelitis (ATM) patients - as well as their respective healthy controls. NMO and ATM constitute models of injury to non-brain motor areas and the peripheral motor system, whereas EPD provides a model of brain motor system impairment. In our study, EPD patients exhibited impaired ACE and verbal processing relative to healthy participants, NMO, and ATM patients. These results indicate that the processing of action-related words is mainly subserved by a cortico-subcortical motor network system, thus supporting a brain-based embodied view on action language. More generally, our findings are consistent with contemporary perspectives for which action/verb processing depends on distributed brain networks supporting context-sensitive motor-language coupling.