1
|
Eye movements during text reading align with the rate of speech production. Nat Hum Behav 2021; 6:429-442. [PMID: 34873275 DOI: 10.1038/s41562-021-01215-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Accepted: 09/10/2021] [Indexed: 11/08/2022]
Abstract
Across languages, the speech signal is characterized by a predominant modulation of the amplitude spectrum between about 4.3 and 5.5 Hz, reflecting the production and processing of linguistic information chunks (syllables and words) every ~200 ms. Interestingly, ~200 ms is also the typical duration of eye fixations during reading. Prompted by this observation, we demonstrate that German readers sample written text at ~5 Hz. A subsequent meta-analysis of 142 studies from 14 languages replicates this result and shows that sampling frequencies vary across languages between 3.9 Hz and 5.2 Hz. This variation systematically depends on the complexity of the writing systems (character-based versus alphabetic systems and orthographic transparency). Finally, we empirically demonstrate a positive correlation between speech spectrum and eye movement sampling in low-skilled non-native readers, with tentative evidence from post hoc analysis suggesting the same relationship in low-skilled native readers. On the basis of this convergent evidence, we propose that during reading, our brain's linguistic processing systems imprint a preferred processing rate-that is, the rate of spoken language production and perception-onto the oculomotor system.
Collapse
|
2
|
Abstract
The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
Collapse
Affiliation(s)
- Jason D Yeatman
- Graduate School of Education, Stanford University, Stanford, California 93405, USA; .,Division of Developmental-Behavioral Pediatrics, Stanford University School of Medicine, Stanford, California 94305, USA.,Department of Psychology, Stanford University, Stanford, California 94305, USA
| | - Alex L White
- Graduate School of Education, Stanford University, Stanford, California 93405, USA; .,Division of Developmental-Behavioral Pediatrics, Stanford University School of Medicine, Stanford, California 94305, USA.,Department of Neuroscience and Behavior, Barnard College, New York, New York 10027, USA
| |
Collapse
|
3
|
Liu X, Vermeylen L, Wisniewski D, Brysbaert M. The contribution of phonological information to visual word recognition: Evidence from Chinese phonetic radicals. Cortex 2020; 133:48-64. [PMID: 33099075 DOI: 10.1016/j.cortex.2020.09.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Revised: 07/09/2020] [Accepted: 09/17/2020] [Indexed: 11/28/2022]
Abstract
Lateralization is a critical characteristic of language production and also plays a role in visual word recognition. However, the neural mechanisms underlying the interactions between visual input and spoken word representations are still unclear. We investigated the contribution of sub-lexical phonological information in visual word processing by exploiting the fact that Chinese characters can contain phonetic radicals in either the left or right half of the character. FMRI data were collected while 39 Chinese participants read words in search of target color words. On the basis of whole-brain analysis and three laterality analyses of regions of interest, we argue that visual information from centrally presented Chinese characters is split in the fovea and projected to the contralateral visual cortex, from which phonological information can be extracted rapidly if the character contains a phonetic radical. Extra activation, suggestive of more effortful processing, is observed when the phonetic radical is situated in the left half of the character and therefore initially sent to the visual cortex in the right hemisphere that is less specialized for language processing. Our results are in line with the proposal that phonological information helps written word processing by means of top-down feedback.
Collapse
Affiliation(s)
- Xiaodong Liu
- Department of Experimental Psychology, Ghent University, Belgium.
| | - Luc Vermeylen
- Department of Experimental Psychology, Ghent University, Belgium
| | - David Wisniewski
- Department of Experimental Psychology, Ghent University, Belgium
| | - Marc Brysbaert
- Department of Experimental Psychology, Ghent University, Belgium
| |
Collapse
|
4
|
Van der Haegen L, Brysbaert M. The relationship between behavioral language laterality, face laterality and language performance in left-handers. PLoS One 2018; 13:e0208696. [PMID: 30576313 PMCID: PMC6303078 DOI: 10.1371/journal.pone.0208696] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2018] [Accepted: 11/21/2018] [Indexed: 01/20/2023] Open
Abstract
Left-handers provide unique information about the relationship between cognitive functions because of their larger variability in hemispheric dominance. This study presents the laterality distribution of, correlations between and test-retest reliability of behavioral lateralized language tasks (speech production, reading and speech perception), face recognition tasks, handedness measures and language performance tests based on data from 98 left-handers. The results show that a behavioral test battery leads to percentages of (a)typical dominance that are similar to those found in neuropsychological studies even though the incidence of clear atypical lateralization (about 20%) may be overestimated at the group level. Significant correlations were found between the language tasks for both reaction time and accuracy lateralization indices. The degree of language laterality could however not be linked to face laterality, handedness or language performance. Finally, individuals were classified less consistently than expected as being typical, bilateral or atypical across all tasks. This may be due to the often good (speech production and perception tasks) but sometimes weak (reading and face tasks) test-retest reliabilities. The lack of highly reliable and valid test protocols for functions unrelated to speech remains one of the largest impediments for individual analysis and cross-task investigations in laterality research.
Collapse
Affiliation(s)
- Lise Van der Haegen
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- * E-mail:
| | - Marc Brysbaert
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| |
Collapse
|
5
|
Danna J, Massendari D, Furnari B, Ducrot S. The optimal viewing position effect in printed versus cursive words: Evidence of a reading cost for the cursive font. Acta Psychol (Amst) 2018; 188:110-121. [PMID: 29908365 DOI: 10.1016/j.actpsy.2018.06.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Revised: 06/08/2018] [Accepted: 06/08/2018] [Indexed: 10/28/2022] Open
Abstract
Two eye-movement experiments were conducted to examine the effects of font type on the recognition of words presented in central vision, using a variable-viewing-position technique. Two main questions were addressed: (1) Is the optimal viewing position (OVP) for word recognition modulated by font type? (2) Is the cursive font more appropriate than the printed font in word recognition in children who exclusively write using a cursive script? In order to disentangle the role of perceptual difficulty associated with the cursive font and the impact of writing habits, we tested French adults (Experiment 1) and second-grade French children, the latter having exclusively learned to write in cursive (Experiment 2). Results revealed that the printed font is more appropriate than the cursive for recognizing words in both adults and children: adults were slightly less accurate in cursive than in printed stimuli recognition and children were slower to identify cursive stimuli than printed stimuli. Eye-movement measures also revealed that the OVP curves were flattened in cursive font in both adults and children. We concluded that the perceptual difficulty of the cursive font degrades word recognition by impacting the OVP stability.
Collapse
Affiliation(s)
- Jérémy Danna
- Aix Marseille Univ, CNRS, LNC, Marseille, France; Aix Marseille Univ, CNRS, Fédération 3C, Marseille, France.
| | - Delphine Massendari
- Université Paris Descartes, CNRS, LPP, Laboratoire Psychologie de la Perception, Paris, France; Aix Marseille Univ, CNRS, LPL, Marseille, France
| | | | | |
Collapse
|
6
|
Sun X, Song S, Liang X, Xie Y, Zhao C, Zhang Y, Shu H, Gong G. ROBO1 polymorphisms, callosal connectivity, and reading skills. Hum Brain Mapp 2017; 38:2616-2626. [PMID: 28240421 PMCID: PMC6866921 DOI: 10.1002/hbm.23546] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2017] [Revised: 02/10/2017] [Accepted: 02/10/2017] [Indexed: 11/10/2022] Open
Abstract
The genetic effects on specific behavioral phenotypes are putatively mediated by specific neural functions. It remains unexplored how the axon-guidance-receptor gene ROBO1 influences reading performance through the neural system despite the identification of ROBO1 as a susceptibility gene for dyslexia. To address this issue, the present study recruited a group of children with a wide range of reading abilities. Two previously identified reading-related ROBO1 polymorphisms were genotyped, and diffusion and structural MRI were acquired to measure the fiber microstructure of the corpus callosum (CC), the major white-matter tract that connects inter-hemispheric cortical regions. The results confirmed the significant influence of the ROBO1 polymorphisms on reading scores. The fiber microstructures of the midline-CC segments around the genu and splenium were also affected by the ROBO1 polymorphisms. Moreover, a mediation analysis further revealed that the genu could significantly mediate the effects of the ROBO1 polymorphisms on word-list reading performance, which suggests a ROBO1-to-genu-to-reading pathway. The genu-linked cortical morphology, however, was not associated with either the ROBO1 polymorphisms or reading performance. These findings offer direct evidence supporting ROBO1-callosum association in humans and also provide valuable insight into the functions of ROBO1 and the gene-to-brain mechanisms that underlie human reading. Hum Brain Mapp 38:2616-2626, 2017. © 2017 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Xiaochen Sun
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Shuang Song
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Xinyu Liang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Yachao Xie
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Chenxi Zhao
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Yuping Zhang
- Department of PsychologyChengdu Medical CollegeChengdu610550China
| | - Hua Shu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| | - Gaolang Gong
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain ResearchBeijing Normal UniversityBeijing100875China
| |
Collapse
|
7
|
Abstract
User evaluations of interactive and dynamic applications face various challenges related to the active nature of these displays. For example, users can often zoom and pan on digital products, and these interactions cause changes in the extent and/or level of detail of the stimulus. Therefore, in eye tracking studies, when a user's gaze is at a particular screen position (gaze position) over a period of time, the information contained in this particular position may have changed. Such digital activities are commonplace in modern life, yet it has been difficult to automatically compare the changing information at the viewed position, especially across many participants. Existing solutions typically involve tedious and time-consuming manual work. In this article, we propose a methodology that can overcome this problem. By combining eye tracking with user logging (mouse and keyboard actions) with cartographic products, we are able to accurately reference screen coordinates to geographic coordinates. This referencing approach allows researchers to know which geographic object (location or attribute) corresponds to the gaze coordinates at all times. We tested the proposed approach through two case studies, and discuss the advantages and disadvantages of the applied methodology. Furthermore, the applicability of the proposed approach is discussed with respect to other fields of research that use eye tracking-namely, marketing, sports and movement sciences, and experimental psychology. From these case studies and discussions, we conclude that combining eye tracking and user-logging data is an essential step forward in efficiently studying user behavior with interactive and static stimuli in multiple research fields.
Collapse
|
8
|
Abstract
Numerous studies have shown that a visually presented word is processed most easily when participants initially fixate just to the left of the word's center. Fixating on this optimal viewing position (OVP) results in shorter response times and a lower probability of making additional within-word refixations (OVP effects), but also longer initial-fixation durations (an inverted-OVP or I-OVP effect), as compared to initially fixating at the beginning or the end of the word. Thus, typical curves are u-shaped (or inverted-u-shaped), with a leftward bias. Most researchers explain the u-shape in terms of visual constraints, and the leftward bias in terms of language constraints. Previous studies have demonstrated that (I)-OVP effects are not specific to words, but generalize to object viewing. We further investigated this by comparing the strength and (a)symmetry of (I-)OVP effects for words and objects. To this purpose, we gave participants an object- versus word-naming task in which we manipulated the position at which they initially fixated the stimulus (i.e., a line drawing or the written name of an object). Our results showed that object viewing, just as word viewing, resulted in u-shaped (I-)OVP curves. However, the effect was weaker than for words. Furthermore, for words, the curves were biased to the left, whereas they were symmetrical for objects. This might indicate that part of the (I-)OVP effect for words is language specific, and that (I-)OVP effects for objects are a purer measure of the effect of visual constraints.
Collapse
|
9
|
Demopoulos C, Yu N, Paul LK, Sherr EH, Marco EJ. Corpus callosum in cognitive and sensory processing: insights into autism. FUTURE NEUROLOGY 2015. [DOI: 10.2217/fnl.14.70] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
ABSTRACT Atypical corpus callosum size and functional connectivity have been repeatedly implicated in autism spectrum disorders (ASDs). Conversely, individuals with agenesis of the corpus callosum often present with diagnostic features characteristic of autism. An emerging literature has identified genetic and environmental factors which may contribute to both ASD symptomatology and the neuroanatomic finding of altered white matter in the corpus callosum. In this review, we consider what is known about the structure and function of the corpus callosum and provide an update on research identifying corpus callosum abnormalities in individuals with ASD. We also review the literature on behaviors characteristic of autism that are observed in individuals with agenesis of the corpus callosum in an effort to identify some of the neuropathology that is likely to be associated with these behaviors. Finally, we suggest a conceptual model of ‘sensory processing inefficiency’ for future research aimed at elucidating some of the phenotypic variation in individuals with social communication challenges.
Collapse
Affiliation(s)
- Carly Demopoulos
- Department of Radiology & Biomedical Imaging, University of California-San Francisco, 513 Parnassus Avenue, S362, San Francisco, CA 94143-0628, USA
| | - Nina Yu
- Department of Neurology, University of California-San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94143, USA
| | - Lynn K Paul
- Division of Humanities & Social Sciences, California Institute of Technology, Caltech MC 228-77, Pasadena, CA 91125, USA
| | - Elliott H Sherr
- Department of Neurology, University of California-San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94143, USA
- Department of Pediatrics, University of California-San Francisco, 400 Parnassus Avenue, San Francisco, CA 94143, USA
| | - Elysa J Marco
- Department of Neurology, University of California-San Francisco, 675 Nelson Rising Lane, San Francisco, CA 94143, USA
- Department of Pediatrics, University of California-San Francisco, 400 Parnassus Avenue, San Francisco, CA 94143, USA
- Department of Psychiatry, University of California-San Francisco, 401 Parnassus Avenue, San Francisco, CA 94143, USA
| |
Collapse
|
10
|
Kayser J, Tenke CE. Hemifield-dependent N1 and event-related theta/delta oscillations: An unbiased comparison of surface Laplacian and common EEG reference choices. Int J Psychophysiol 2015; 97:258-70. [PMID: 25562833 DOI: 10.1016/j.ijpsycho.2014.12.011] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2014] [Revised: 11/17/2014] [Accepted: 12/21/2014] [Indexed: 11/28/2022]
Abstract
Surface Laplacian methodology has been used to reduce the impact of volume conduction and arbitrary choice of EEG recording reference for the analysis of surface potentials. However, the empirical implications of employing these different transformations to the same EEG data remain obscure. This study directly compared the statistical effects of four commonly-used (nose, linked mastoids, average) or recommended (reference electrode standardization technique [REST]) references and their spherical spline current source density (CSD) transformation for a large data set stemming from a well-understood experimental manipulation. ERPs (72 sites) recorded from 130 individuals during a visual half-field paradigm with highly-controlled emotional stimuli were characterized by mid-parietooccipital N1 (125 ms peak latency) and event-related synchronization (ERS) of theta/delta (160 ms), which were most robust over the contralateral hemisphere. All five data transformations were rescaled to the same covariance and submitted to a single temporal or time-frequency PCA (Varimax) to yield simplified estimates of N1 or theta/delta ERS. Unbiased nonparametric permutation tests revealed that these hemifield-dependent asymmetries were by far most focal and prominent for CSD data, despite all transformations showing maximum effects at mid-parietooccipital sites. Employing smaller subsamples (signal-to-noise) or window-based ERP/ERS amplitudes did not affect these comparisons. Furthermore, correlations between N1 and theta/delta ERS at these sites were strongest for CSD and weakest for nose-referenced data. Contrary to the common notion that the spatial high pass filter properties of a surface Laplacian reduce important contributions of neuronal generators to the EEG signal, the present findings demonstrate that instead volume conduction inherent in surface potentials weakens the representation of neuronal activation patterns at scalp that directly reflect regional brain activity.
Collapse
Affiliation(s)
- Jürgen Kayser
- Division of Cognitive Neuroscience, New York State Psychiatric Institute, New York, NY, USA; Department of Psychiatry, Columbia University College of Physicians & Surgeons, New York, NY, USA.
| | - Craig E Tenke
- Division of Cognitive Neuroscience, New York State Psychiatric Institute, New York, NY, USA; Department of Psychiatry, Columbia University College of Physicians & Surgeons, New York, NY, USA
| |
Collapse
|
11
|
Carey DP, Johnstone LT. Quantifying cerebral asymmetries for language in dextrals and adextrals with random-effects meta analysis. Front Psychol 2014; 5:1128. [PMID: 25408673 PMCID: PMC4219560 DOI: 10.3389/fpsyg.2014.01128] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2014] [Accepted: 09/16/2014] [Indexed: 12/31/2022] Open
Abstract
Speech and language-related functions tend to depend on the left hemisphere more than the right in most right-handed (dextral) participants. This relationship is less clear in non-right handed (adextral) people, resulting in surprisingly polarized opinion on whether or not they are as lateralized as right handers. The present analysis investigates this issue by largely ignoring methodological differences between the different neuroscientific approaches to language lateralization, as well as discrepancies in how dextral and adextral participants were recruited or defined. Here we evaluate the tendency for dextrals to be more left hemisphere dominant than adextrals, using random effects meta analyses. In spite of several limitations, including sample size (in the adextrals in particular), missing details on proportions of groups who show directional effects in many experiments, and so on, the different paradigms all point to proportionally increased left hemispheric dominance in the dextrals. These results are analyzed in light of the theoretical importance of these subtle differences for understanding the cognitive neuroscience of language, as well as the unusual asymmetry in most adextrals.
Collapse
Affiliation(s)
- David P Carey
- Perception, Action and Memory Research Group, School of Psychology, Bangor University Bangor, UK
| | - Leah T Johnstone
- Perception, Action and Memory Research Group, School of Psychology, Bangor University Bangor, UK
| |
Collapse
|
12
|
Śmigasiewicz K, Weinrich J, Reinhardt B, Verleger R. Deployment and release of interhemispheric inhibition in dual-stream rapid serial visual presentation. Biol Psychol 2014; 99:47-59. [DOI: 10.1016/j.biopsycho.2014.02.008] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2013] [Revised: 01/17/2014] [Accepted: 02/13/2014] [Indexed: 11/29/2022]
|