The effect of word position on eye-movements in sentence and paragraph reading

Column setting and text justification influence return-sweep eye movement behavior during Chinese multi-line reading

People regularly read multi-line texts in different formats and publishers, internationally, must decide how to present text to make reading most effective and efficient. Relatively few studies have examined multi-line reading, and fewer still Chinese multi-line reading. Here, we examined whether texts presented in single or double columns, and either left-justified or fully-justified affect Chinese reading. Text format had minimal influence on overall reading time; however, it significantly impacted return-sweeps (large saccades moving the eyes from the end of one line of text to the beginning of the next). Return-sweeps were launched and landed further away from margins and involved more corrective saccades in single- than double-column format. For left- compared to fully-justified format, return-sweeps were launched and landed closer to margins. More corrective saccades also occurred. Our results showed more efficient return-sweep behavior for fully- than left-justified text. Moreover, there were clear trade-off effects such that formats requiring increased numbers of shorter return-sweeps produced more accurate targeting and reduced numbers of corrective fixations, whereas formats requiring reduced numbers of longer return-sweeps caused less accurate targeting and an increased rate of corrective fixations. Overall, our results demonstrate that text formats substantially affect return-sweep eye movement behavior during Chinese reading without affecting efficiency and effectiveness, that is, the overall time it takes to read and understand the text.

Do linguistic stimuli activate experiential colour traces related to the entities they refer to and, if so, under what circumstances?

The simulation view of language comprehension holds that lexical-semantic access prompts the re-enactment of sensorimotor experiences that regularly accompany word use. For the colour domain, this suggests that reading about a stop sign reactivates experiences involving the perception of the stop sign and hence experiences involving the colour red. However, it is still not clear what circumstances would limit reactivation of colour experiences during comprehension, if the activation takes place. To address this question, we varied in our study the conditions in which the target colour stimuli appeared. The experimental stimuli were individual words (Experiment (Exp.) 1, Exp. 7, 8) or sentences (Exp. 2-6) referring to objects with a typical colour of either green or red (e.g., cucumber or raspberry). Across experiments, we manipulated the presence of fillers (present or not), and whether fillers referred to objects with other colour (e.g., honey) or objects without any particular colour (e.g., car). The stimuli were presented along with two clickable "yes" and "no" buttons, one of which was red and the other green. Location and button colour varied from trial to trial. The tasks were lexical decision (Exp. 1, Exp. 7-8) and sensibility judgement (Exp. 2-6). We observed faster response times in the match vs mismatch condition in all word-based experiments, but only in those sentence-based experiments that did not have fillers. This suggests that comprehenders indeed reactivate colour experiences when processing linguistic stimuli referring to objects with a typical colour, but this activation seems to occur only under certain circumstances.

Delayed onset facilitates subsequent retrieval of words during language comprehension

Prior research has shown that during language comprehension, memory representations associated with premodified words (e.g., the injured and dangerous bear) are retrieved faster from memory than those associated with unmodified words (e.g., the bear). Current explanations attribute this effect to the semantic richness of modified words. However, it is not clear whether the presence of modifying words are in fact necessary for a retrieval benefit. Premodifiers necessarily delay the onset of the target word (i.e., bear), and temporal delays may heighten attention to upcoming stimuli, and/or strengthen encoding by producing free time during encoding, facilitating subsequent retrieval. We therefore examined whether a simple delay in the onset of the target can produce a retrieval benefit. Our results show that delayed onset facilitates the subsequent retrieval of target words in the absence of any modifying information. These results lend support to models of language comprehension according to which delays may enhance attention to upcoming words, and also to models of working memory based on which free time replenishes encoding resources, strengthening the memory trace of encoded information and facilitating its retrieval at a subsequent point. Our results also contribute to current memory-based theories of sentence comprehension by showing that retrieval from memory may be affected by nonlinguistic factors such as delay-induced attention enhancement, or free time during encoding.

Investigating the effect of emoji position on eye movements and subjective evaluations on Chinese sarcasm comprehension

Evidence indicated that emojis could influence sarcasm comprehension and sentence processing in English. However, the effect of emojis on Chinese sarcasm comprehension remains unclear. Therefore, this study investigated the impact of the smiley emoji position and semantics on eye movements and subjective assessments during Chinese online communication. Our results showed that the presence of a smiley emoji improved participants' interpretation and perception of sarcasm. We also found shorter dwell times on sarcastic words compared to literal words under the comment-final emoji condition. Additionally, we clarified the time course of emojified sentence processing during Chinese reading: the presence of emoji initially decreased first fixation durations compared to the absence of emoji and then the comment-final emoji shortened dwell times on sarcastic words compared to literal words in the critical area of interest. Our findings suggested that the comment-final emoji was the preferable choice for avoiding semantic comprehension bias in China.

Individual word representations dissociate from linguistic context along a cortical unimodal to heteromodal gradient

Language comprehension involves multiple hierarchical processing stages across time, space, and levels of representation. When processing a word, the sensory input is transformed into increasingly abstract representations that need to be integrated with the linguistic context. Thus, language comprehension involves both input-driven as well as context-dependent processes. While neuroimaging research has traditionally focused on mapping individual brain regions to the distinct underlying processes, recent studies indicate that whole-brain distributed patterns of cortical activation might be highly relevant for cognitive functions, including language. One such pattern, based on resting-state connectivity, is the 'principal cortical gradient', which dissociates sensory from heteromodal brain regions. The present study investigated the extent to which this gradient provides an organizational principle underlying language function, using a multimodal neuroimaging dataset of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) recordings from 102 participants during sentence reading. We found that the brain response to individual representations of a word (word length, orthographic distance, and word frequency), which reflect visual; orthographic; and lexical properties, gradually increases towards the sensory end of the gradient. Although these properties showed opposite effect directions in fMRI and MEG, their association with the sensory end of the gradient was consistent across both neuroimaging modalities. In contrast, MEG revealed that properties reflecting a word's relation to its linguistic context (semantic similarity and position within the sentence) involve the heteromodal end of the gradient to a stronger extent. This dissociation between individual word and contextual properties was stable across earlier and later time windows during word presentation, indicating interactive processing of word representations and linguistic context at opposing ends of the principal gradient. To conclude, our findings indicate that the principal gradient underlies the organization of a range of linguistic representations while supporting a gradual distinction between context-independent and context-dependent representations. Furthermore, the gradient reveals convergent patterns across neuroimaging modalities (similar location along the gradient) in the presence of divergent responses (opposite effect directions).

Hong Kong Corpus of Chinese Sentence and Passage Reading

Recent years have witnessed a mushrooming of reading corpora that have been built by means of eye tracking. This article showcases the Hong Kong Corpus of Chinese Sentence and Passage Reading (HKC for brevity), featured by a natural reading of logographic scripts and unspaced words. It releases 28 eye-movement measures of 98 native speakers reading simplified Chinese in two scenarios: 300 one-line single sentences and 7 multiline passages of 5,250 and 4,967 word tokens, respectively. To verify its validity and reusability, we carried out (generalised) linear mixed-effects modelling on the capacity of visual complexity, word frequency, and reading scenario to predict eye-movement measures. The outcomes manifest significant impacts of these typical (sub)lexical factors on eye movements, replicating previous findings and giving novel ones. The HKC provides a valuable resource for exploring eye movement control; the study contrasts the different scenarios of single-sentence and passage reading in hopes of shedding new light on both the universal nature of reading and the unique characteristics of Chinese reading.

Dark mode vogue: Do light-on-dark displays have measurable benefits to users?

This work investigates the effect of display polarity on cognitive load, using eye-tracking and subjective measures, and emotional reactions to assess whether the popularity of negative polarity displays is related to affective qualities or true physiological benefits. Younger and older adults tested positive and negative polarities under bright and dim environments for writing and search tasks. Eye-tracking results showed higher cognitive load using negative polarity, reflected in increased search time and pupil diameter for older adults in a bright environment and younger adults in a dim environment. For older adults, mental effort scores were higher using negative polarity for the search task in a bright environment. This group reported more positive emotions using positive polarity, while younger adults expressed more interest in negative polarity. These results suggest that older adults use positive polarity to avoid mental fatigue, while younger adults use negative polarity in a dim environment for aesthetic reasons. Practitioner summary: The effects of negative polarity on cognitive load and users' preferences are often unclear. Eye-tracking and subjective data reveals that negative polarity displays elicit higher cognitive load for older adults in a bright environment and younger adults in a dim environment, suggesting older adults prioritise reduced fatigue while younger adults prioritise the feel of the interface.

GECO-CN: Ghent Eye-tracking COrpus of sentence reading for Chinese-English bilinguals

The current work presents the very first eye-tracking corpus of natural reading by Chinese-English bilinguals, whose two languages entail different writing systems and orthographies. Participants read an entire novel in these two languages, presented in paragraphs on screen. Half of the participants first read half of the novel in their native language (Simplified Chinese) and then the rest of the novel in their second language (English), while the other half read in the reverse language order. This article presents some important basic descriptive statistics of reading times and compares the difference between reading in the two languages. However, this unique eye-tracking corpus also allows the exploration of theories of language processing and bilingualism. Importantly, it provides a solid and reliable ground for studying the difference between Eastern and Western languages, understanding the impact and consequences of having a completely different first language on bilingual processing. The materials are freely available for use by researchers interested in (bilingual) reading.

Dimensionality and Ramping: Signatures of Sentence Integration in the Dynamics of Brains and Deep Language Models

A sentence is more than the sum of its words: its meaning depends on how they combine with one another. The brain mechanisms underlying such semantic composition remain poorly understood. To shed light on the neural vector code underlying semantic composition, we introduce two hypotheses: (1) the intrinsic dimensionality of the space of neural representations should increase as a sentence unfolds, paralleling the growing complexity of its semantic representation; and (2) this progressive integration should be reflected in ramping and sentence-final signals. To test these predictions, we designed a dataset of closely matched normal and jabberwocky sentences (composed of meaningless pseudo words) and displayed them to deep language models and to 11 human participants (5 men and 6 women) monitored with simultaneous MEG and intracranial EEG. In both deep language models and electrophysiological data, we found that representational dimensionality was higher for meaningful sentences than jabberwocky. Furthermore, multivariate decoding of normal versus jabberwocky confirmed three dynamic patterns: (1) a phasic pattern following each word, peaking in temporal and parietal areas; (2) a ramping pattern, characteristic of bilateral inferior and middle frontal gyri; and (3) a sentence-final pattern in left superior frontal gyrus and right orbitofrontal cortex. These results provide a first glimpse into the neural geometry of semantic integration and constrain the search for a neural code of linguistic composition.SIGNIFICANCE STATEMENT Starting from general linguistic concepts, we make two sets of predictions in neural signals evoked by reading multiword sentences. First, the intrinsic dimensionality of the representation should grow with additional meaningful words. Second, the neural dynamics should exhibit signatures of encoding, maintaining, and resolving semantic composition. We successfully validated these hypotheses in deep neural language models, artificial neural networks trained on text and performing very well on many natural language processing tasks. Then, using a unique combination of MEG and intracranial electrodes, we recorded high-resolution brain data from human participants while they read a controlled set of sentences. Time-resolved dimensionality analysis showed increasing dimensionality with meaning, and multivariate decoding allowed us to isolate the three dynamical patterns we had hypothesized.

Emoji-SP, the Spanish emoji database: Visual complexity, familiarity, frequency of use, clarity, and emotional valence and arousal norms for 1031 emojis

This article presents subjective norms for 1031 emojis in six dimensions: visual complexity, familiarity, frequency of use, clarity, emotional valence, and emotional arousal. This is the largest normative study conducted so far that relies on subjective ratings. Unlike the few existing normative studies, which mainly comprise face emojis, here we present a wide range of emoji categories. We also examine the correlations between the dimensions assessed. Our results show that, in terms of their affective properties, emojis are analogous to other stimuli, such as words, showing the expected U-shaped relationship between valence and arousal. The relationship between affective properties and other dimensions (e.g., between valence and familiarity) is also similar to the relationship observed in words, in the sense that positively valenced emojis are more familiar than negative ones. These findings suggest that emojis are suitable stimuli for studying affective processing. Emoji-SP will be highly valuable for researchers of various fields interested in emojis, including computer science, communication, linguistics, and psychology. The full set of norms is available at: https://osf.io/dtfjv/ .

Neural bases of predictions during natural reading of known statements: An EEG and eye movements co-registration study

Predictions of incoming words performed during reading have an impact on how the reader moves their eyes and on the electrical brain potentials. Eye tracking (ET) experiments show that less predictable words are fixated for longer periods of times. Electroencephalography (EEG) experiments show that these words elicit a more negative potential around 400ms (N400) after the word onset when reading one word at a time (foveated reading). Nevertheless, there was no N400 potential during the foveated reading of previously known sentences (memory-encoded), which suggests that the prediction of words from memory-encoded sentences is based on different mechanisms than predictions performed on common sentences. Here, we performed an ET-EEG co-registration experiment where participants read common and memory-encoded sentences. Our results show that the N400 potential disappear when the reader recognises the sentence. Furthermore, time-frequency analyses show a larger alpha lateralisation and a beta power increase for memory-encoded sentences. This suggests a more distributed attention and an active maintenance of the cognitive set, in concordance to the predictive coding framework.

Return-sweep saccades in oral reading

Recent research on return-sweep saccades has improved our understanding of eye movements when reading paragraphs. However, these saccades, which take our gaze from the end of one line to the start of the next line, have been studied only within the context of silent reading. Articulatory demands and the coordination of the eye-voice span (EVS) at line boundaries suggest that the execution of this saccade may be different in oral reading. We compared launch and landing positions of return-sweeps, corrective saccade probability and fixations adjacent to return-sweeps in skilled adult readers while reading paragraphs aloud and silently. Compared to silent reading, return-sweeps were launched from closer to the end of the line and landed closer to the start of the next line when reading aloud. The probability of making a corrective saccade was higher for oral reading than silent reading. These indicate that oral reading may compel readers to rely more on foveal processing at the expense of parafoveal processing. We found an interaction between reading modality and fixation type on fixation durations. The reading modality effect (i.e., increased fixation durations in oral compared to silent reading) was greater for accurate line-initial fixations and marginally greater for line-final fixations compared to intra-line fixations. This suggests that readers may use the fixations adjacent to return-sweeps as natural pause locations to modulate the EVS.

Lexicality effects on orthographic learning in beginning and advanced readers of Dutch: An eye-tracking study

Orthographic learning is the topic of many recent studies about reading, but much is still unknown about conditions that affect orthographic learning and their influence on reading fluency development over time. This study investigated lexicality effects on orthographic learning in beginning and relatively advanced readers of Dutch. Eye movements of 131 children in Grades 2 and 5 were monitored during an orthographic learning task. Children read sentences containing pseudowords or low-frequency real words that varied in number of exposures. We examined both offline learning outcomes (i.e., orthographic choice and spelling dictation) of target items and online gaze durations on target words. The results showed general effects of exposure, lexicality, and reading-skill level. Also, a two-way interaction was found between the number of exposures and lexicality when detailed orthographic representations were required, consistent with a larger overall effect of exposure on learning the spellings of pseudowords. Moreover, lexicality and reading-skill level were found to affect the learning rate across exposures based on a decrease in gaze durations, indicating a larger learning effect for pseudowords in Grade 5 children. Yet, further interactions between exposure and reading-skill level were not present, indicating largely similar learning curves for beginning and advanced readers. We concluded that the reading system of more advanced readers may cope somewhat better with words varying in lexicality, but is not more efficient than that of beginning readers in building up orthographic knowledge of specific words across repeated exposures.

Spelling ability influences early letter encoding during reading: Evidence from return-sweep eye movements

In recent years, there has been an increase in research concerning individual differences in readers' eye movements. However, this body of work is almost exclusively concerned with the reading of single-line texts. While spelling and reading ability have been reported to influence saccade targeting and fixation times during intra-line reading, where upcoming words are available for parafoveal processing, it is unclear how these variables affect fixations adjacent to return-sweeps. We, therefore, examined the influence of spelling and reading ability on return-sweep and corrective saccade parameters for 120 participants engaged in multiline text reading. Less-skilled readers and spellers tended to launch their return-sweeps closer to the end of the line, prefer a viewing location closer to the start of the next, and made more return-sweep undershoot errors. We additionally report several skill-related differences in readers' fixation durations across multiline texts. Reading ability influenced all fixations except those resulting from return-sweep error. In contrast, spelling ability influenced only those fixations following accurate return-sweeps-where parafoveal processing was not possible prior to fixation. This stands in contrasts to an established body of work where fixation durations are related to reading but not spelling ability. These results indicate that lexical quality shapes the rate at which readers access meaning from the text by enhancing early letter encoding, and influences saccade targeting even in the absence of parafoveal target information.

Literacy skill and intra-individual variability in eye-fixation durations during reading: Evidence from a diverse community-based adult sample

To understand the effects of literacy on fundamental processes involved in reading, we report a secondary data analysis examining individual differences in global eye-movement measures and first-pass eye-movement distributions in a diverse sample of community-dwelling adults aged 16 to 64. Participants (n = 80) completed an assessment battery probing verbal and non-verbal cognitive abilities and read simple two-sentence passages while their eye movements were recorded. Analyses were focused on characterising the effects of literacy skill on both global indices of eye-fixation distributions and distributional differences in the sensitivity to lexical features. Global reading measures showed that lower literate adults read more slowly on average. However, distributional analyses of fixation durations revealed that the first-pass fixation durations of adults with lower literacy skill were not slower in general (i.e., there was no shift in the fixation duration distribution among lower literate adults). Instead, lower literacy was associated with greater intra-individual variability in first-pass fixation durations, including an increased proportion of extremely long fixations, differentially skewing the distribution of both first-fixation and gaze durations. Exploratory repeated-measures quantile regression analyses of gaze duration revealed differentially greater influences of word length among lower literate readers and greater activation of phonological and orthographic neighbours among higher literate readers, particularly in the tail of the distribution. Collectively, these findings suggest that literacy skill in adulthood is associated with systematic differences in both global and lexically driven eye-movement control during reading.

From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.

Cognitive engagement during reading on digital tablet: Evidence from concurrent recordings of postural and eye movements

The present study utilised a novel combination of eye movement and motion capture recordings to examine cognitive engagement during reading on a hand-held tablet computer. Participants read a multiple-page text with a specific task in mind and after reading recalled the main contents of text from memory. The results showed that head distance from screen was slightly shorter, and readers spent longer time reading task-relevant than irrelevant segments of text and had better memory for task-relevant than irrelevant text information, indicating that there are task-induced momentary changes in engagement during reading. Moreover, head motion and individual fixation durations decreased during the course of reading of relevant segments, and even though there was an overall increase in table motion during reading, the slope of this increase was steeper for irrelevant than relevant text segments. These results suggest that readers become more engaged with relevant and less engaged with irrelevant text segments across the text. The novel methodological combination of eye and postural movements seems to provide valuable information about cognitive engagement during reading in digital environments. The cumulation of evidence from this and previous studies suggests that reading on a tablet affords different interactions between the reader and the text than reading on a computer screen. Reading on a tablet might be more similar to reading on paper, and this may impact the attentional processes during reading.

Exploring and Exploiting Uncertainty: Statistical Learning Ability Affects How We Learn to Process Language Along Multiple Dimensions of Experience

While the effects of pattern learning on language processing are well known, the way in which pattern learning shapes exploratory behavior has long gone unnoticed. We report on the way in which individual differences in statistical pattern learning affect performance in the domain of language along multiple dimensions. Analyzing data from healthy monolingual adults' performance on a serial reaction time task and a self-paced reading task, we show how individual differences in statistical pattern learning are reflected in readers' knowledge of linguistic co-occurrence patterns and in their exploration and exploitation of content-specific and task-general information. First, we investigated the extent to which an individual's pattern learning correlates with his or her sensitivity to systematic morphological and syntactic co-occurrences, as evidenced while reading authentic sentences. We found that the stream of morphological and syntactic information has a more pronounced effect on the reading speed of, as we will label them, content-sensitive learners in that the more probable the co-occurrence pattern, the faster their reading of that pattern will be. Next, we investigated how differences in pattern learning are reflected in the ways in which individuals approach the reading task itself and adapt to it. Casting this relation in terms of exploration/exploitation strategies, known from Reinforcement Learning, we conclude that content-sensitive learners are also more likely to initially probe (explore) a wider range of directly relevant patterns, which they can later use (exploit) to optimize their reading performance further. By affecting exploratory behavior, pattern learning influences the information that is gathered and becomes available for exploitation, thereby increasing the effect pattern learning has on language cognition.

What Is the Difference? Rereading Shakespeare's Sonnets -An Eye Tracking Study

Texts are often reread in everyday life, but most studies of rereading have been based on expository texts, not on literary ones such as poems, though literary texts may be reread more often than others. To correct this bias, the present study is based on two of Shakespeare's sonnets. Eye movements were recorded, as participants read a sonnet then read it again after a few minutes. After each reading, comprehension and appreciation were measured with the help of a questionnaire. In general, compared to the first reading, rereading improved the fluency of reading (shorter total reading times, shorter regression times, and lower fixation probability) and the depth of comprehension. Contrary to the other rereading studies using literary texts, no increase in appreciation was apparent. Moreover, results from a predictive modeling analysis showed that readers' eye movements were determined by the same critical psycholinguistic features throughout the two sessions. Apparently, even in the case of poetry, the eye movement control in reading is determined mainly by surface features of the text, unaffected by repetition.

How well do word recognition measures correlate? Effects of language context and repeated presentations

In the present study we assessed the extent to which different word recognition time measures converge, using large databases of lexical decision times and eyetracking measures. We observed a low proportion of shared variance between these measures, which limits the validity of lexical decision times to real-life reading. We further investigated and compared the role of word frequency and length, two important predictors of word-processing latencies in these paradigms, and found that they influenced the measures to different extents. A second analysis of two different eyetracking corpora compared the eyetracking reading times for short paragraphs with those from reading of an entire book. Our results revealed that the correlations between eyetracking reading times of identical words in two different corpora are also low, suggesting that the higher-order language context in which words are presented plays a crucial role. Finally, our findings indicate that lexical decision times better resemble the average processing time of multiple presentations of the same word, across different language contexts.

Perceptual salience of derivational suffixes in visual word recognition

This study analyzes the role of derivational suffixes in visual word recognition, tracking the eye movements of 31 participants in a sentence-reading task in Spanish. Perceptual salience of suffixes was operationalized as the proportion of letters represented by the suffixes with respect to the full words, that is, we relate the number of letters comprising the suffixes to the number of letters in the words in which they appear. The results reveal a significant role in first fixation duration of both word frequency - the more frequent the word, the shorter the fixations, and perceptual salience - the more salient the suffix, the longer the fixations. Moreover, in gaze duration, our results show a main effect of word length - the longer the word, the longer the fixations; word frequency; and significant interactions between word frequency and perceptual salience of suffixes on the one hand - the effect of word frequency is only significant when perceptual salience of suffixes is high, and between word frequency and word length on the other hand - the frequency effect decreases as word length increases. Overall results are interpreted in the light of the dual route models by which full-form and morphological processing interactively cooperate in visual word recognition.

Return sweeps in reading: Processing implications of undersweep-fixations

Models of eye-movement control during reading focus on reading single lines of text. However, with multiline texts, return sweeps, which bring fixation from the end of one line to the beginning of the next, occur regularly and influence ~20% of all reading fixations. Our understanding of return sweeps is still limited. One common feature of return sweeps is the prevalence of oculomotor errors. Return sweeps, often initially undershoot the start of the line. Corrective saccades then bring fixation closer to the line start. The fixation occurring between the undershoot and the corrective saccade (undersweep-fixation) has important theoretical implications for the serial nature of lexical processing during reading, as they occur on words ahead of the intended attentional target. Furthermore, since the attentional target of a return sweep will lie far outside the parafovea during the prior fixation, it cannot be lexically preprocessed during this prior fixation. We explore the implications of undersweep-fixations for ongoing processing and models of eye movements during reading by analysing two existing eye-movement data sets of multiline reading.

Reading Shakespeare Sonnets: Combining Quantitative Narrative Analysis and Predictive Modeling -an Eye Tracking Study

As a part of a larger interdisciplinary project on Shakespeare sonnets' reception (1, 2), the present study analyzed the eye movement behavior of participants reading three of the 154 sonnets as a function of seven lexical features extracted via Quantitative Narrative Analysis (QNA). Using a machine learning-based predictive modeling approach five 'surface' features (word length, orthographic neighborhood density, word frequency, orthographic dissimilarity and sonority score) were detected as important predictors of total reading time and fixation probability in poetry reading. The fact that one phonological feature, i.e., sonority score, also played a role is in line with current theorizing on poetry reading. Our approach opens new ways for future eye movement research on reading poetic texts and other complex literary materials(3).

Contributions of reader- and text-level characteristics to eye-movement patterns during passage reading

The present research presents a novel method for investigating how characteristics of texts (words, sentences, and passages) and individuals (verbal and general cognitive skills) jointly influence eye-movement patterns over the time-course of reading, as well as comprehension accuracy. Fifty-one proficient readers read passages of varying complexity from the Gray Oral Reading Test, while their eye-movements were recorded. Participants also completed a large battery of tests assessing various components of reading comprehension ability (vocabulary size, decoding, phonological awareness, and experience with print), as well as general cognitive and executive skills. We used the Random Forests nonparametric regression technique to simultaneously estimate relative importance of all predictors. This method enabled us to trace the temporal engagement of individual predictors and entire predictor groups on eye-movements during reading, while avoiding the problems of model overfitting and collinearity, typical of parametric regression methods. Our findings both confirmed well-established results of prior research and pointed to a space of hypotheses that is as yet unexplored. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

The perception of text triggers reflexive oculomotor orienting

As you read this text, your brain is busy integrating numerous different processes-perceptual, cognitive and motor. While you acquire the semantic and linguistic contents of this abstract, your eyes traverse its lines with speed and coordination. The oculomotor response to text is so rapid and precise that it is hypothesized it to be partially based on reflexive orienting mechanisms. In this study we examined the hypothesis that the presentation of written text triggers reflexive orienting toward the direction of reading, similarly to the effect of peripheral stimulation or that of symbolic directional cues (arrows or gazing eyes). In three experiments, participants (N = 120) were presented with task-irrelevant text, shortly followed by a left/right pro-saccade task. The first experiment confirmed the hypothesis by showing that saccades which are congruent with the direction of reading are faster than those which are incongruent. This was observed both in right-to-left (Hebrew) and in left-to-right (English) reading-systems and similarly in native-Hebrew and native-English readers. A second experiment showed that this directional bias is found not only for readable text but also for meaningless strings of letters. This confirmed that the bias is driven pre-reading non-lexical processes. The third experiment examined the time-course of this effect. We conclude that text-perception actives early reflexive eye-movements programs and suggest that this link is an essential building-block of fast and effortless reading.

Russian Sentence Corpus: Benchmark measures of eye movements in reading in Russian

This article introduces a new corpus of eye movements in silent reading-the Russian Sentence Corpus (RSC). Russian uses the Cyrillic script, which has not yet been investigated in cross-linguistic eye movement research. As in every language studied so far, we confirmed the expected effects of low-level parameters, such as word length, frequency, and predictability, on the eye movements of skilled Russian readers. These findings allow us to add Slavic languages using Cyrillic script (exemplified by Russian) to the growing number of languages with different orthographies, ranging from the Roman-based European languages to logographic Asian ones, whose basic eye movement benchmarks conform to the universal comparative science of reading (Share, 2008). We additionally report basic descriptive corpus statistics and three exploratory investigations of the effects of Russian morphology on the basic eye movement measures, which illustrate the kinds of questions that researchers can answer using the RSC. The annotated corpus is freely available from its project page at the Open Science Framework: https://osf.io/x5q2r/ .

Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading

This article introduces GECO, the Ghent Eye-Tracking Corpus, a monolingual and bilingual corpus of the eyetracking data of participants reading a complete novel. English monolinguals and Dutch-English bilinguals read an entire novel, which was presented in paragraphs on the screen. The bilinguals read half of the novel in their first language, and the other half in their second language. In this article, we describe the distributions and descriptive statistics of the most important reading time measures for the two groups of participants. This large eyetracking corpus is perfectly suited for both exploratory purposes and more directed hypothesis testing, and it can guide the formulation of ideas and theories about naturalistic reading processes in a meaningful context. Most importantly, this corpus has the potential to evaluate the generalizability of monolingual and bilingual language theories and models to the reading of long texts and narratives. The corpus is freely available at http://expsy.ugent.be/downloads/geco .

Fixation durations in scene viewing: Modeling the effects of local image features, oculomotor parameters, and task

Scene perception requires the orchestration of image- and task-related processes with oculomotor constraints. The present study was designed to investigate how these factors influence how long the eyes remain fixated on a given location. Linear mixed models (LMMs) were used to test whether local image statistics (including luminance, luminance contrast, edge density, visual clutter, and the number of homogeneous segments), calculated for 1° circular regions around fixation locations, modulate fixation durations, and how these effects depend on task-related control. Fixation durations and locations were recorded from 72 participants, each viewing 135 scenes under three different viewing instructions (memorization, preference judgment, and search). Along with the image-related predictors, the LMMs simultaneously considered a number of oculomotor and spatiotemporal covariates, including the amplitudes of the previous and next saccades, and viewing time. As a key finding, the local image features around the current fixation predicted this fixation’s duration. For instance, greater luminance was associated with shorter fixation durations. Such immediacy effects were found for all three viewing tasks. Moreover, in the memorization and preference tasks, some evidence for successor effects emerged, such that some image characteristics of the upcoming location influenced how long the eyes stayed at the current location. In contrast, in the search task, scene processing was not distributed across fixation durations within the visual span. The LMM-based framework of analysis, applied to the control of fixation durations in scenes, suggests important constraints for models of scene perception and search, and for visual attention in general.

Readers generalize adaptation to newly-encountered dialectal structures to other unfamiliar structures

Growing evidence suggests that syntactic processing may be guided in part by expectations about the statistics of the input that comprehenders have encountered; however, these statistics and even the syntactic structures themselves vary from situation to situation. Some recent work suggests that readers can adapt to variability in the frequencies of known, but infrequent syntactic structures. But, the relation between adaptation to altered frequencies of familiar structures and learning to process unfamiliar, never-before-seen structures is under-explored. In two self-paced reading experiments, we investigated readers' adaptation to an unfamiliar structure used in some regional dialects of American English: the needs+past participle structure, such as using The car needs washed to mean The car needs to be washed. Study 1 used a novel Web-based recruitment method to target regions where participants were likely to be familiar (Ohio, western Pennsylvania) or unfamiliar (Colorado) with the needs+past participle structure. Participants unfamiliar with the structure initially read the structure more slowly, but over the course of the experiment came to read it more like the familiar participants. Study 2 further demonstrated that participants who have adapted to needs+past participle generalize this adaptation to a different, but related structure. These results suggest (a) that readers adapt to unfamiliar syntactic structures, (b) that, in doing so, they become more like existing users of those structures, and (c) that they can generalize this other structures that they may also be more likely to encounter. We discuss these results in the context of implicit learning accounts of exposure effects on syntactic processing.

Cross-script orthographic and phonological preview benefits

The present experiment examined the use of parafoveally presented first-language (L1) orthographic and phonological codes during reading of second-language (L2) sentences in proficient Russian-English bilinguals. Participants read English sentences containing a Russian preview word that was replaced by the English target word when the participant's eyes crossed an invisible boundary located before the preview word. The use of English and Russian allowed us to manipulate orthographic and phonological preview effects independently of one another. The Russian preview words overlapped with English target words in (a) orthography (ВЕЛЮР [vʲɪ'lʲʉr]-BERRY), (b) phonology (БЛАНК [blank]-BLOOD), or (c) had no orthographic or phonological overlap (КАЛАЧ [kɐ'lat͡ɕ]-BERRY; ГЖЕЛЬ [ɡʐϵlʲ]-BLOOD). The results of this study showed a clear and strong benefit of the parafoveal preview of Russian words that shared either orthography or phonology with English target words. This study is the first demonstration of cross-script orthographic and phonological parafoveal preview benefit effects. Bilinguals integrate orthographic and phonological information across eye fixations in reading, even when this information comes from different languages.

Evidence for a global oculomotor program in reading

Recent corpus studies of eye-movements in reading revealed a substantial increase in saccade amplitudes and fixation durations as the eyes move over the first words of a sentence. This start-up effect suggests a global oculomotor program, which operates on the level of an entire line, in addition to the well-established local programs operating within the visual span. The present study investigates the nature of this global program experimentally and examines whether the start-up effect is predicated on generic visual or specific linguistic characteristics and whether it is mainly reflected in saccade amplitudes, fixation durations or both measures. Eye movements were recorded while 38 participants read (a) normal sentences, (b) sequences of randomly shuffled words and (c) sequences of z-strings. The stimuli were, therefore, similar in their visual features, but varied in the amount of syntactic and lexical information. Further, the stimuli were composed of words or strings that either varied naturally in length (Nonequal condition) or were all restricted to a specific length within a sentence (Equal). The latter condition constrained the variability of saccades and served to dissociate effects of word position in line on saccade amplitudes and fixation durations. A robust start-up effect emerged in saccade amplitudes in all Nonequal stimuli, and-in an attenuated form-in Equal sentences. A start-up effect in single fixation durations was observed in Nonequal and Equal normal sentences, but not in z-strings. These findings support the notion of a global oculomotor program in reading particularly for the spatial characteristics of motor planning, which rely on visual rather than linguistic information.

Word processing during reading sentences in patients with schizophrenia: evidences from the eyetracking technique

PURPOSE

The current study analyze the effect of word properties (i.e., word length, word frequency and word predictability) on the eye movement behavior of patients with schizophrenia (SZ) compared to age-matched controls.

METHOD

18 SZ patients and 40 age matched controls participated in the study. Eye movements were recorded during reading regular sentences by using the eyetracking technique. Eye movement analyses were performed using linear mixed models.

FINDINGS

Analysis of eye movements revealed that patients with SZ decreased the amount of single fixations, increased their total number of second pass fixations compared with healthy individuals (Controls). In addition, SZ patients showed an increase in gaze duration, compared to Controls. Interestingly, the effects of current word frequency and current word length processing were similar in Controls and SZ patients. The high rate of second pass fixations and its low rate in single fixation might reveal impairments in working memory when integrating neighbor words. In contrast, word frequency and length processing might require less complex mechanisms, which were functioning in SZ patients.

CONCLUSION

To the best of our knowledge, this is the first study measuring how patients with SZ process dynamically well-defined words embedded in regular sentences. The findings suggest that evaluation of the resulting changes in eye movement behavior may supplement current symptom-based diagnosis.

Revisiting the incremental effects of context on word processing: Evidence from single-word event-related brain potentials

The amplitude of the N400-an event-related potential (ERP) component linked to meaning processing and initial access to semantic memory-is inversely related to the incremental buildup of semantic context over the course of a sentence. We revisited the nature and scope of this incremental context effect, adopting a word-level linear mixed-effects modeling approach, with the goal of probing the continuous and incremental effects of semantic and syntactic context on multiple aspects of lexical processing during sentence comprehension (i.e., effects of word frequency and orthographic neighborhood). First, we replicated the classic word-position effect at the single-word level: Open-class words showed reductions in N400 amplitude with increasing word position in semantically congruent sentences only. Importantly, we found that accruing sentence context had separable influences on the effects of frequency and neighborhood on the N400. Word frequency effects were reduced with accumulating semantic context. However, orthographic neighborhood was unaffected by accumulating context, showing robust effects on the N400 across all words, even within congruent sentences. Additionally, we found that N400 amplitudes to closed-class words were reduced with incrementally constraining syntactic context in sentences that provided only syntactic constraints. Taken together, our findings indicate that modeling word-level variability in ERPs reveals mechanisms by which different sources of information simultaneously contribute to the unfolding neural dynamics of comprehension.

Aging and individual differences in binding during sentence understanding: evidence from temporary and global syntactic attachment ambiguities

We report an investigation of aging and individual differences in binding information during sentence understanding. An age-continuous sample of adults (N=91), ranging from 18 to 81 years of age, read sentences in which a relative clause could be attached high to a head noun NP1, attached low to its modifying prepositional phrase NP2 (e.g., The son of the princess who scratched himself/herself in public was humiliated), or in which the attachment site of the relative clause was ultimately indeterminate (e.g., The maid of the princess who scratched herself in public was humiliated). Word-by-word reading times and comprehension (e.g., who scratched?) were measured. A series of mixed-effects models were fit to the data, revealing: (1) that, on average, NP1-attached sentences were harder to process and comprehend than NP2-attached sentences; (2) that these average effects were independently moderated by verbal working memory capacity and reading experience, with effects that were most pronounced in the oldest participants and; (3) that readers on average did not allocate extra time to resolve global ambiguities, though older adults with higher working memory span did. Findings are discussed in relation to current models of lifespan cognitive development, working memory, language experience, and the role of prosodic segmentation strategies in reading. Collectively, these data suggest that aging brings differences in sentence understanding, and these differences may depend on independent influences of verbal working memory capacity and reading experience.

How strongly do word reading times and lexical decision times correlate? Combining data from eye movement corpora and megastudies

We assess the amount of shared variance between three measures of visual word recognition latencies: eye movement latencies, lexical decision times, and naming times. After partialling out the effects of word frequency and word length, two well-documented predictors of word recognition latencies, we see that 7–44% of the variance is uniquely shared between lexical decision times and naming times, depending on the frequency range of the words used. A similar analysis of eye movement latencies shows that the percentage of variance they uniquely share either with lexical decision times or with naming times is much lower. It is 5–17% for gaze durations and lexical decision times in studies with target words presented in neutral sentences, but drops to 0.2% for corpus studies in which eye movements to all words are analysed. Correlations between gaze durations and naming latencies are lower still. These findings suggest that processing times in isolated word processing and continuous text reading are affected by specific task demands and presentation format, and that lexical decision times and naming times are not very informative in predicting eye movement latencies in text reading once the effect of word frequency and word length are taken into account. The difference between controlled experiments and natural reading suggests that reading strategies and stimulus materials may determine the degree to which the immediacy-of-processing assumption and the eye–mind assumption apply. Fixation times are more likely to exclusively reflect the lexical processing of the currently fixated word in controlled studies with unpredictable target words rather than in natural reading of sentences or texts.

Eye movements in reading: some theoretical context

The study of eye movements has proven to be one of the most successful approaches in research on reading. In this overview, it is argued that a major reason for this success is that eye movement measurement is not just a methodology--the control of eye movements is actually part and parcel of the dynamics of information processing within the task of reading itself. Some major developments over the last decade are discussed with a focus on the issue of spatially distributed word processing and its relation to the development of reading models. The survey ends with a description of two newly emerging trends in the field: the study of continuous reading in non-Roman writing systems and the broadening of the scope of research to encompass individual differences and developmental issues.

Effects of individual differences in verbal skills on eye-movement patterns during sentence reading

This study is a large-scale exploration of the influence that individual reading skills exert on eye-movement behavior in sentence reading. Seventy one non-college-bound 16-24 year-old speakers of English completed a battery of 18 verbal and cognitive skill assessments, and read a series of sentences as their eye movements were monitored. Statistical analyses were performed to establish what tests of reading abilities were predictive of eye-movement patterns across this population and how strong the effects were. We found that individual scores in rapid automatized naming and word identification tests (i) were the only participant variables with reliable predictivity throughout the time-course of reading; (ii) elicited effects that superceded in magnitude the effects of established predictors like word length or frequency; and (iii) strongly modulated the influence of word length and frequency on fixation times. We discuss implications of our findings for testing reading ability, as well as for research of eye-movements in reading.