Estimating the divergence point: a novel distributional analysis procedure for determining the onset of the influence of experimental variables

A beginner's guide to eye tracking for psycholinguistic studies of reading

Eye tracking has been a popular methodology used to study the visual, cognitive, and linguistic processes underlying word recognition and sentence parsing during reading for several decades. However, the successful use of eye tracking requires researchers to make deliberate choices about how they apply this technique, and there is wide variability across labs and fields with respect to which choices are "standard." We aim to provide an easy-to-reference guideline that can help new researchers with their entrée into eye-tracking-while-reading research. Because the standards do - and should - vary from field to field or study to study as is appropriate for the research question, we do not set a rigid recipe for handling eye tracking data, but rather provide a conceptual framework within which researchers can make informed decisions about how to treat their data so that it is most informative for their research question. Therefore, this paper provides a description of eye movements in reading and an overview of psycholinguistic research on the topic, an overview of experiment design considerations, a description of the data processing pipeline and important choice points and implications, an overview of common dependent measures and their calculation, and a summary of resources for data analysis.

Direct lexical control of eye movements in Chinese reading: Evidence from the co-registration of EEG and eye tracking

The direct-lexical-control hypothesis stipulates that some aspect of a word's processing determines the duration of the fixation on that word and/or the next. Although the direct lexical control is incorporated into most current models of eye-movement control in reading, the precise implementation varies and the assumptions of the hypothesis may not be feasible given that lexical processing must occur rapidly enough to influence fixation durations. Conclusive empirical evidence supporting this hypothesis is therefore lacking. In this article, we report the results of an eye-tracking experiment using the boundary paradigm in which native speakers of Chinese read sentences in which target words were either high- or low-frequency and preceded by a valid or invalid preview. Eye movements were co-registered with electroencephalography, allowing standard analyses of eye-movement measures, divergence point analyses of fixation-duration distributions, and fixated-related potentials on the target words. These analyses collectively provide strong behavioral and neural evidence of early lexical processing and thus strong support for the direct-lexical-control hypothesis. We discuss the implications of the findings for our understanding of how the hypothesis might be implemented, the neural systems that support skilled reading, and the nature of eye-movement control in the reading of Chinese versus alphabetic scripts.

Auditory distraction during reading: Investigating the effects of background sounds on parafoveal processing

Previous research suggests that unexpected (deviant) sounds negatively affect reading performance by inhibiting saccadic planning, which models of reading agree takes place simultaneous to parafoveal processing. This study examined the effect of deviant sounds on foveal and parafoveal processing. Participants read single sentences in quiet, standard (repeated sounds), or deviant sound conditions (a new sound within a repeated sound sequence). Sounds were presented with a variable delay coincident with the onset of fixations on target words during a period when saccadic programming and parafoveal processing occurred. We used the moving window paradigm to manipulate the amount of information readers could extract from the parafovea (the entire sentence or a 13-character window of text). Global, sentence-level analyses showed typical disruption to reading by the window, and under quiet conditions similar effects were observed at the target and post-target word in the local analyses. Standard and deviant sounds also produced clear distraction effects of differing magnitudes at the target and post-target words, though at both regions, these effects were qualified by interactions. Effects at the target word suggested that with sounds, readers engaged in less effective parafoveal processing than under quiet. Similar patterns of effects due to standard and deviant sounds, each with a different time course, occurred at the post-target word. We conclude that distraction via auditory deviation causes disruption to parafoveal processing during reading, with such effects being modulated by the degree to which a sound's characteristics are more or less unique.

Neural correlates for word-frequency effect in Chinese natural reading

Word frequency effect has always been of interest for reading research because of its critical role in exploring mental processing underlying reading behaviors. Access to word frequency information has long been considered an indicator of the beginning of lexical processing and the most sensitive marker for studying when the brain begins to extract semantic information Sereno & Rayner, Brain and Cognition, 42, 78-81, (2000), Trends in Cognitive Sciences, 7, 489-493, (2003). While the word frequency effect has been extensively studied in numerous eye-tracking and traditional EEG research using the RSVP paradigm, there is a lack of corresponding evidence in studies of natural reading. To find the neural correlates of the word frequency effect, we conducted a study of Chinese natural reading using EEG and eye-tracking coregistration to examine the time course of lexical processing. Our results reliably showed that the word frequency effect first appeared in the N200 time window and the bilateral occipitotemporal regions. Additionally, the word frequency effect was reflected in the N400 time window, spreading from the occipital region to the central parietal and frontal regions. Our current study provides the first neural correlates for word-frequency effect in natural Chinese reading so far, shedding new light on understanding lexical processing in natural reading and could serve as an important basis for further reading study when considering neural correlates in a realistic manner.

Fine-grained time course of verb aspect processing

Sentence processing is known to be highly incremental. Speakers make incremental commitments as the sentence unfolds, dynamically updating their representations based on the smallest pieces of information from the incoming speech stream. Less is known about linguistic processing on the sub-word level, especially with regard to abstract grammatical information. This study employs the Visual World Paradigm to investigate the processing of grammatical aspect by Russian-speaking adults (n = 124). Aspectual information is encoded relatively early within the Russian verb which makes this an ideal testing ground to investigate the incrementality of grammatical processing on the sub-word level. Participants showed preference for pictures of ongoing events when they heard sentences involving Imperfective verbs, and for pictures of completed events when they heard sentences involving Perfective verbs. Crucially, the analysis of the participants’ eye-movements showed that they exhibited preference for the target picture already before they heard the end of the verb. Moreover, the latency of this effect depended on where the aspectual information was encoded within the verb. These results indicate that the processing and integration of grammatical aspect information can happen rapidly and incrementally on a fine-grained word-internal level. Methodologically, the study draws together a set of analytical techniques which can be fruitfully applied to the analysis of effect latencies in a wide range of studies within the Visual World eye-tracking paradigm.

Percentile rank pooling: A simple nonparametric method for comparing group reaction time distributions with few trials

Although many studies of reaction time (RT) focus on a single measure of central tendency such as the mean RT, a more detailed picture of the underlying processes can be gained by looking at full distributions of RTs. Unfortunately, for practical reasons it is sometimes difficult to obtain enough trials per participant in a condition of interest to construct such a distribution with existing methods. The purpose of this article is to propose a method of forming group RT distributions that can be used to compare the full distributions of RTs even in an infrequent condition with only a few trials per participant. In brief, the percentile ranks of each participant's infrequent-condition RTs are scored relative to a larger pool including that participant's RTs in other conditions, and a histogram of the infrequent-condition's percentile ranks is then formed by pooling across participants. The resulting histogram of infrequent-condition RT ranks shows where the RTs in that condition tend to fall relative to the other conditions, and this histogram can reveal systematic patterns in the infrequent-condition's RT distribution. To illustrate the method, I present histograms of the ranks of infrequent error RTs (~ 5% of trials), ranked relative to correct responses, in real data sets from Simon and lexical decision tasks.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented (“standard”), while on the remaining occasions (p = .1) a new sound was presented (“novel”). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Are divergence point analyses suitable for response time data?

Estimating the time course of the influence of different factors in human performance is one of the major topics of research in cognitive psychology/neuroscience. Over the past decades, researchers have proposed several methods to tackle this question using latency data. Here we examine a recently proposed procedure that employs survival analyses on latency data to provide precise estimates of the timing of the first discernible influence of a given factor (e.g., word frequency on lexical access) on performance (e.g., fixation durations or response times). A number of articles have used this method in recent years, and hence an exploration of its strengths and its potential weaknesses is in order. Unfortunately, our analysis revealed that the technique has conceptual flaws, and it might lead researchers into believing that they are obtaining a measurement of processing components when, in fact, they are obtaining an uninterpretable measurement.

The time course of age-of-acquisition effects on eye movements during reading: Evidence from survival analyses

Adults process words that are rated as being learned earlier in life faster than words that are rated as being acquired later in life. This age-of-acquisition (AoA) effect has been observed in a variety of word-recognition tasks when word frequency is controlled. AoA has also previously been found to influence fixation durations when words are embedded into sentences and eye movements are recorded. However, the time course of AoA effects during reading has been inconsistent across studies. The current study further explored the time course of AoA effects on distributions of first-fixation durations during reading. Early and late acquired words were embedded into matched neutral sentence frames. Participants read the sentences while their eye movements were recorded. AoA effects were observed in both early and late fixation duration measures, suggesting that AoA has an early and long-lasting effect on word-recognition processes during reading. Survival analysis revealed that the earliest discernable effect of AoA on distributions of first-fixation durations emerged beginning at 158 ms. This rapid influence of AoA was confirmed through the use of Vincentile plots, which demonstrated that the effect of AoA occurred early and was relatively consistent across the distribution of fixations. This pattern of results provides support for the direct lexical-control hypothesis, as well as the viewpoint that AoA may exert an influence at multiple loci within the mental lexicon.

Shared mechanisms underlying the location-, word- and arrow-based Simon effects

A left or right keypress response to a relevant stimulus attribute (e.g., color) is faster when irrelevant left or right stimulus-location information corresponds with the correct response than when it does not. This phenomenon, known as the Simon effect, is obtained not only for physical locations, but also location words "left" and "right" and left- or right-pointing arrows. However, these location-, word-, and arrow-based Simon effects show different patterns in the reaction-time (RT) distributions, as evident in delta plots. In the present study, we employed procedures, analysis of survival curves and divergence point analysis, which have not previously been applied to the Simon effect, to investigate differences in time course of these various Simon effects in more detail. Also, we examined whether the diffusion model for conflict tasks (DMC), which assumes that automatic activation of task-irrelevant information occurs in a pulse-like function, can capture not only features of the RT distributions for the location-based Simon effect, to which it has been fit previously, but also features of the word- and arrow-based Simon effects, to which it has not. Results showed different survival curves and earliest, maximum, and latest divergence points for the three Simon effects, but DMC was able to capture the basic features of the RT distributions reflected by delta plot and survival curves for all effects. The results imply that the location-, word-, and arrow-based Simon effects have shared mechanisms, although they have different RT distributions.

Distraction by deviant sounds during reading: An eye-movement study

Oddball studies have shown that sounds unexpectedly deviating from an otherwise repeated sequence capture attention away from the task at hand. While such distraction is typically regarded as potentially important in everyday life, previous work has so far not examined how deviant sounds affect performance on more complex daily tasks. In this study, we developed a new method to examine whether deviant sounds can disrupt reading performance by recording participants’ eye movements. Participants read single sentences in silence and while listening to task-irrelevant sounds. In the latter condition, a 50-ms sound was played contingent on the fixation of five target words in the sentence. On most occasions, the same tone was presented (standard sound), whereas on rare and unexpected occasions it was replaced by white noise (deviant sound). The deviant sound resulted in significantly longer fixation durations on the target words relative to the standard sound. A time-course analysis showed that the deviant sound began to affect fixation durations around 180 ms after fixation onset. Furthermore, deviance distraction was not modulated by the lexical frequency of target words. In summary, fixation durations on the target words were longer immediately after the presentation of the deviant sound, but there was no evidence that it interfered with the lexical processing of these words. The present results are in line with the recent proposition that deviant sounds yield a temporary motor suppression and suggest that deviant sounds likely inhibit the programming of the next saccade.

Understanding Moment-to-Moment Processing of Visual Narratives

What role do moment‐to‐moment comprehension processes play in visual attentional selection in picture stories? The current work uniquely tested the role of bridging inference generation processes on eye movements while participants viewed picture stories. Specific components of the Scene Perception and Event Comprehension Theory (SPECT) were tested. Bridging inference generation was induced by manipulating the presence of highly inferable actions embedded in picture stories. When inferable actions are missing, participants have increased viewing times for the immediately following critical image (Magliano, Larson, Higgs, & Loschky, 2016). This study used eye‐tracking to test competing hypotheses about the increased viewing time: (a) Computational Load: inference generation processes increase overall computational load, producing longer fixation durations; (b) Visual Search: inference generation processes guide eye‐movements to pick up inference‐relevant information, producing more fixations. Participants had similar fixation durations, but they made more fixations while generating inferences, with that process starting from the fifth fixation. A follow‐up hypothesis predicted that when generating inferences, participants fixate scene regions important for generating the inference. A separate group of participants rated the inferential‐relevance of regions in the critical images, and results showed that these inferentially relevant regions predicted differences in other viewers’ eye movements. Thus, viewers’ event models in working memory affect visual attentional selection while viewing visual narratives.

A paradox of apparent brainless behavior: The time-course of compound word recognition

A review of the behavioral and neurophysiological estimates of the time-course of compound word recognition brings to light a paradox whereby temporal activity associated with lexical variables in behavioral studies predates temporal activity of seemingly comparable lexical processing in neuroimaging studies. However, under the assumption that brain activity is a cause of behavior, the earliest reliable behavioral effect of a lexical variable must represent an upper temporal bound for the origin of that effect in the neural record. The present research provides these behavioral bounds for lexical variables involved in compound word processing. We report data from five naturalistic reading studies in which participants read sentences containing English compound words, and apply a distributional technique of survival analysis to resulting eye-movement fixation durations (Reingold & Sheridan, 2014). The results of the survival analysis of the eye-movement record place a majority of the earliest discernible onsets of orthographic, morphological, and semantic effects at less than 200 ms (with a range of 138-269 ms). Our results place constraints on the absolute time-course of effects reported in the neurolinguistic literature, and support theories of complex word recognition which posit early simultaneous access of form and meaning.

Survival analyses reveal how early phonological processing affects eye movements during reading

Numerous studies have provided evidence that readers generate phonological codes while reading. However, a central question in much of this research has been how early these codes are generated. Answering this question has implications for the roles that phonological coding might play for skilled readers, especially whether phonological codes affect the identification of most words, which can only be the case if these codes are generated rapidly. To investigate the time course of phonological coding during silent reading, the present series of experiments examined survival analyses of first-fixation durations on phonologically related (homophones, pseudohomophones) and orthographic control (orthographically matched words and nonwords) stimuli that were either embedded in sentences in place of correct targets (Experiments 1 and 2) or presented as parafoveal previews for correct targets using the boundary paradigm (Experiments 3 and 4). Survival analyses revealed a discernible difference between processing the phonologically related versus the orthographic control items by as early as 160 ms from the start of fixation on average (160-173 ms across experiments). Because only approximately 18% of first fixation durations were shorter than these mean estimates and follow-up tests revealed that earlier divergence point estimates were associated with shorter gaze durations (e.g., more rapid word identification), results suggest that skilled readers rapidly generate phonological codes during normal, silent reading and that these codes may affect the identification of most words. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Using eye movements to understand the leakage of information during Chinese reading

How is attention allocated during reading? The present eye-movement experiment used a paradigm developed by Liu and Reichle (Psychological Science, 29, 278-287, 2018) to examine object-based attention during reading: Participants were instructed to read one of two spatially overlapping sentences containing colocated target/distractor words of varying frequency. Although target-word frequency modulated fixation-duration measures on the target word, the distractor-word frequency also had a smaller, independent effect. Survival analyses indicate that the distractor-word effect occurred later than the target-word effect, suggesting that subtle orthographic cues were noticed either later or occasionally, thereby modulating decisions about when to move the eyes. The theoretical ramifications of this "leakage" of information are discussed with respect to the general question of attention allocation during reading and possible differences between the reading of Chinese versus English.

The onset and time course of semantic priming during rapid recognition of visual words

In 2 experiments, we assessed the effects of response latency and task-induced goals on the onset and time course of semantic priming during rapid processing of visual words as revealed by ocular response tasks. In Experiment 1 (ocular lexical decision task), participants performed a lexical decision task using eye movement responses on a sequence of 4 words. In Experiment 2, the same words were encoded for an episodic recognition memory task that did not require a metalinguistic judgment. For both tasks, survival analyses showed that the earliest observable effect (divergence point [DP]) of semantic priming on target-word reading times occurred at approximately 260 ms, and ex-Gaussian distribution fits revealed that the magnitude of the priming effect increased as a function of response time. Together, these distributional effects of semantic priming suggest that the influence of the prime increases when target processing is more effortful. This effect does not require that the task include a metalinguistic judgment; manipulation of the task goals across experiments affected the overall response speed but not the location of the DP or the overall distributional pattern of the priming effect. These results are more readily explained as the result of a retrospective, rather than a prospective, priming mechanism and are consistent with compound-cue models of semantic priming. (PsycINFO Database Record

Surviving blind decomposition: A distributional analysis of the time-course of complex word recognition

The current study addresses a discrepancy in the psycholinguistic literature about the chronology of information processing during the visual recognition of morphologically complex words. Form-then-meaning accounts of complex word recognition claim that morphemes are processed as units of form prior to any influence of their meanings, whereas form-and-meaning models posit that recognition of complex word forms involves the simultaneous access of morphological and semantic information. The study reported here addresses this theoretical discrepancy by applying a nonparametric distributional technique of survival analysis (Reingold & Sheridan, 2014) to 2 behavioral measures of complex word processing. Across 7 experiments reported here, this technique is employed to estimate the point in time at which orthographic, morphological, and semantic variables exert their earliest discernible influence on lexical decision RTs and eye movement fixation durations. Contrary to form-then-meaning predictions, Experiments 1-4 reveal that surface frequency is the earliest lexical variable to exert a demonstrable influence on lexical decision RTs for English and Dutch derived words (e.g., badness; bad + ness), English pseudoderived words (e.g., wander; wand + er) and morphologically simple control words (e.g., ballad; ball + ad). Furthermore, for derived word processing across lexical decision and eye-tracking paradigms (Experiments 1-2; 5-7), semantic effects emerge early in the time-course of word recognition, and their effects either precede or emerge simultaneously with morphological effects. These results are not consistent with the premises of the form-then-meaning view of complex word recognition, but are convergent with a form-and-meaning account of complex word recognition. (PsycINFO Database Record

On using distributional analysis techniques for determining the onset of the influence of experimental variables

Much of the investigation of eye-movement control in visual cognition has focused on the influence of experimental variables on mean fixation durations. In the present paper we explored the convergence between two distributional analysis techniques that were recently introduced in this domain. First, Staub, White, Drieghe, Hollway and Rayner, (2010) proposed fitting the ex-Gaussian distribution to individual participants' data in order to ascertain whether a variable has a rapid or a slow influence on fixation durations. Second, the Divergence Point Analysis (DPA) procedure was introduced by Reingold, Reichle, Glaholt and Sheridan (2012, Reingold & Sheridan, 2014) in order to determine more precisely the earliest discernible impact of a variable on the distribution of fixation durations by contrasting survival curves across two experimental conditions and determining the point at which the two curves begin to diverge. In the present paper we introduced a new version of the DPA procedure which is based on ex-Gaussian fitting. We evaluated this procedure by re-analysing data obtained in previous empirical investigations as well as by conducting a simulation study. We demonstrated that the new ex-Gaussian DPA technique produced estimates that were consistent with estimates produced by prior versions of DPA procedure, and in the present simulation, the ex-Gaussian DPA procedure produced somewhat more accurate individual participant divergence point estimates. Based on the present findings we also suggest guidelines for best practices in the use of DPA techniques.

The Word Frequency Effect on Saccade Targeting during Chinese Reading: Evidence from a Survival Analysis of Saccade Length

Our study employs distributional analysis (i.e., survival analysis) to examine how the frequency of target words influences saccade lengths into and out of these target words in Chinese reading. The results of survival analysis indicate the survival curves in the high- and low-frequency conditions diverge for a short saccade length, with more than 80% of the lengths of incoming and outgoing saccades being larger than the divergence points. These results as well as simulations using the novel Dynamic-adjustment Model of saccadic targeting (Liu et al., 2016) are consistent with previous mean-based results and provide more precise information to support this novel model. The implications for saccade target selection during the reading of Chinese are discussed.

An Analysis of the Time Course of Lexical Processing During Reading

Reingold, Reichle, Glaholt, and Sheridan (2012) reported a gaze-contingent eye-movement experiment in which survival-curve analyses were used to examine the effects of word frequency, the availability of parafoveal preview, and initial fixation location on the time course of lexical processing. The key results of these analyses suggest that lexical processing begins very rapidly (after approximately 120 ms) and is supported by substantial parafoveal processing (more than 100 ms). Because it is not immediately obvious that these results are congruent with the theoretical assumption that words are processed and identified in a strictly serial manner, we attempted to simulate the experiment using the E-Z Reader model of eye-movement control (Reichle, 2011). These simulations were largely consistent with the empirical results, suggesting that parafoveal processing does play an important functional role by allowing lexical processing to occur rapidly enough to mediate direct control over when the eyes move during reading.