1
|
Eisenhauer S, Gonzalez Alam TRDJ, Cornelissen PL, Smallwood J, Jefferies E. Individual word representations dissociate from linguistic context along a cortical unimodal to heteromodal gradient. Hum Brain Mapp 2024; 45:e26607. [PMID: 38339897 PMCID: PMC10836172 DOI: 10.1002/hbm.26607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 11/30/2023] [Accepted: 01/15/2024] [Indexed: 02/12/2024] Open
Abstract
Language comprehension involves multiple hierarchical processing stages across time, space, and levels of representation. When processing a word, the sensory input is transformed into increasingly abstract representations that need to be integrated with the linguistic context. Thus, language comprehension involves both input-driven as well as context-dependent processes. While neuroimaging research has traditionally focused on mapping individual brain regions to the distinct underlying processes, recent studies indicate that whole-brain distributed patterns of cortical activation might be highly relevant for cognitive functions, including language. One such pattern, based on resting-state connectivity, is the 'principal cortical gradient', which dissociates sensory from heteromodal brain regions. The present study investigated the extent to which this gradient provides an organizational principle underlying language function, using a multimodal neuroimaging dataset of functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) recordings from 102 participants during sentence reading. We found that the brain response to individual representations of a word (word length, orthographic distance, and word frequency), which reflect visual; orthographic; and lexical properties, gradually increases towards the sensory end of the gradient. Although these properties showed opposite effect directions in fMRI and MEG, their association with the sensory end of the gradient was consistent across both neuroimaging modalities. In contrast, MEG revealed that properties reflecting a word's relation to its linguistic context (semantic similarity and position within the sentence) involve the heteromodal end of the gradient to a stronger extent. This dissociation between individual word and contextual properties was stable across earlier and later time windows during word presentation, indicating interactive processing of word representations and linguistic context at opposing ends of the principal gradient. To conclude, our findings indicate that the principal gradient underlies the organization of a range of linguistic representations while supporting a gradual distinction between context-independent and context-dependent representations. Furthermore, the gradient reveals convergent patterns across neuroimaging modalities (similar location along the gradient) in the presence of divergent responses (opposite effect directions).
Collapse
Affiliation(s)
- Susanne Eisenhauer
- Department of PsychologyUniversity of YorkYorkUK
- York Neuroimaging Centre, Innovation WayYorkUK
| | | | | | | | - Elizabeth Jefferies
- Department of PsychologyUniversity of YorkYorkUK
- York Neuroimaging Centre, Innovation WayYorkUK
| |
Collapse
|
2
|
De Simone E, Moll K, Feldmann L, Schmalz X, Beyersmann E. The role of syllables and morphemes in silent reading: An eye-tracking study. Q J Exp Psychol (Hove) 2023; 76:2493-2513. [PMID: 36803303 PMCID: PMC10585950 DOI: 10.1177/17470218231160638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 11/08/2022] [Accepted: 12/07/2022] [Indexed: 02/23/2023]
Abstract
German skilled readers have been found to engage in morphological and syllable-based processing in visual word recognition. However, the relative reliance on syllables and morphemes in reading multi-syllabic complex words is still unresolved. This study aimed to unveil which of these sublexical units are the preferred units of reading by employing eye-tracking technology. Participants silently read sentences while their eye-movements were recorded. Words were visually marked using colour alternation (Experiment 1) or hyphenation (Experiment 2)-at syllable boundary (e.g., Kir-schen), at morpheme boundary (e.g., Kirsch-en), or within the units themselves (e.g., Ki-rschen). A control condition without disruptions was used as a baseline (e.g., Kirschen). The results of Experiment 1 showed that eye-movements were not modulated by colour alternations. The results of Experiment 2 indicated that hyphens disrupting syllables had a larger inhibitory effect on reading times than hyphens disrupting morphemes, suggesting that eye-movements in German skilled readers are more influenced by syllabic than morphological structure.
Collapse
Affiliation(s)
- Elisabetta De Simone
- School of Psychological Sciences and Macquarie Centre for Reading, Macquarie University, Sydney, NSW, Australia
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Hospital of the Ludwig-Maximilians-University (LMU) Munich, Munich, Germany
| | - Kristina Moll
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Hospital of the Ludwig-Maximilians-University (LMU) Munich, Munich, Germany
| | - Lisa Feldmann
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Hospital of the Ludwig-Maximilians-University (LMU) Munich, Munich, Germany
| | - Xenia Schmalz
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Hospital of the Ludwig-Maximilians-University (LMU) Munich, Munich, Germany
| | - Elisabeth Beyersmann
- School of Psychological Sciences and Macquarie Centre for Reading, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
3
|
Weiss KL, Hawelka S, Hutzler F, Schuster S. Stronger functional connectivity during reading contextually predictable words in slow readers. Sci Rep 2023; 13:5989. [PMID: 37045976 PMCID: PMC10097649 DOI: 10.1038/s41598-023-33231-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 04/10/2023] [Indexed: 04/14/2023] Open
Abstract
The effect of word predictability is well-documented in terms of local brain activation, but less is known about the functional connectivity among those regions associated with processing predictable words. Evidence from eye movement studies showed that the effect is much more pronounced in slow than in fast readers, suggesting that speed-impaired readers rely more on sentence context to compensate for their difficulties with visual word recognition. The present study aimed to investigate differences in functional connectivity of fast and slow readers within core regions associated with processing predictable words. We hypothesize a stronger synchronization between higher-order language areas, such as the left middle temporal (MTG) and inferior frontal gyrus (IFG), and the left occipito-temporal cortex (OTC) in slow readers. Our results show that slow readers exhibit more functional correlations among these connections; especially between the left IFG and OTC. We interpret our results in terms of the lexical quality hypothesis which postulates a stronger involvement of semantics on orthographic processing in (speed-)impaired readers.
Collapse
Affiliation(s)
| | - Stefan Hawelka
- Department of Psychology, Centre for Cognitive Neuroscience, Paris-Lodron-University of Salzburg, Hellbrunnerstr. 34, 5020, Salzburg, Austria
| | - Florian Hutzler
- Department of Psychology, Centre for Cognitive Neuroscience, Paris-Lodron-University of Salzburg, Hellbrunnerstr. 34, 5020, Salzburg, Austria
| | - Sarah Schuster
- Department of Psychology, Centre for Cognitive Neuroscience, Paris-Lodron-University of Salzburg, Hellbrunnerstr. 34, 5020, Salzburg, Austria.
| |
Collapse
|
4
|
Dołżycka JD, Nikadon J, Formanowicz M. Constructing Pseudowords with Constraints on Morphological Features - Application for Polish Pseudonouns and Pseudoverbs. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2022; 51:1247-1265. [PMID: 35930208 PMCID: PMC9646586 DOI: 10.1007/s10936-022-09884-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 04/26/2022] [Indexed: 06/15/2023]
Abstract
Pseudowords allow researchers to investigate multiple grammatical or syntactic aspects of language processing. In order to serve that purpose, pseudoword stimuli need to preserve certain properties of real language. We provide a Python-based pipeline for the generation of pseudoword stimuli that sound/read naturally in a given language. The pseudowords are designed to resemble real words and clearly indicate their grammatical class for languages that use specific suffixes from parts of speech. We also provide two sets of pseudonouns and pseudoverbs in Polish that are outcomes of the applied pipeline. The sets are equipped with psycholinguistically relevant properties of words, such as orthographic Levenshtein distance 20. We also performed two studies (overall N = 640) to test the validity of the algorithmically constructed stimuli in a human sample. Thus, we present stimuli that were deprived of direct meaning yet are clearly classifiable as grammatical categories while being orthographically and phonologically plausible.
Collapse
Affiliation(s)
- Joanna Daria Dołżycka
- Nicolaus Copernicus University, Toruń, Poland.
- Department of Applied Emotion and Motivation Psychology, Ulm University, Ulm, Germany.
- Institut für Psychologie und Pädagogik, Abteilung Angewandte Emotions- und Motivationspsychologie, Albert-Einstein-Allee 47, D-89081, Ulm, Germany.
| | - Jan Nikadon
- Nicolaus Copernicus University, Toruń, Poland
- SWPS University of Social Sciences and Humanities, Warsaw, Poland
| | - Magdalena Formanowicz
- Nicolaus Copernicus University, Toruń, Poland
- SWPS University of Social Sciences and Humanities, Warsaw, Poland
| |
Collapse
|
5
|
Vignali L, Hawelka S, Hutzler F, Richlan F. Processing of parafoveally presented words. An fMRI study. Neuroimage 2018; 184:1-9. [PMID: 30165250 DOI: 10.1016/j.neuroimage.2018.08.061] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2017] [Revised: 07/06/2018] [Accepted: 08/25/2018] [Indexed: 11/28/2022] Open
Abstract
The present fMRI study investigated neural correlates of parafoveal preprocessing during reading and the type of information that is accessible from the upcoming - not yet fixated - word. Participants performed a lexical decision flanker task while the constraints imposed by the first three letters (the initial trigram) of parafoveally presented words were controlled. Behavioral results evidenced that the amount of information extracted from parafoveal stimuli, was affected by the difficulty of the foveal stimulus. Easy to process foveal stimuli (i.e., high frequency nouns) allowed parafoveal information to be extracted up to the lexical level. Conversely, when foveal stimuli were difficult to process (orthographically legal nonwords) only constraining trigrams modulated the task performance. Neuroimaging findings showed no effects of lexicality (i.e., difference between words and pseudowords) in the parafovea independently from the difficulty of the foveal stimulus. The constraints imposed by the initial trigrams, however, modulated the hemodynamic response in the left supramarginal gyrus. We interpreted the supramarginal activation as reflecting sublexical (phonological) processes. The missing parafoveal lexicality effect was discussed in relation to findings of experiments which observed effects of parafoveal semantic congruency on electrophysiological correlates.
Collapse
Affiliation(s)
- Lorenzo Vignali
- Center for Mind/Brain Sciences (CIMeC), University of Trento, 38068 Rovereto, TN, Italy; International School for Advanced Studies (SISSA), 34136 Trieste, Italy; Centre for Cognitive Neuroscience, University of Salzburg, Hellbrunnerstr. 34, 5020 Salzburg, Austria.
| | - Stefan Hawelka
- Centre for Cognitive Neuroscience, University of Salzburg, Hellbrunnerstr. 34, 5020 Salzburg, Austria
| | - Florian Hutzler
- Centre for Cognitive Neuroscience, University of Salzburg, Hellbrunnerstr. 34, 5020 Salzburg, Austria
| | - Fabio Richlan
- Centre for Cognitive Neuroscience, University of Salzburg, Hellbrunnerstr. 34, 5020 Salzburg, Austria
| |
Collapse
|
6
|
Krieber M, Bartl-Pokorny KD, Pokorny FB, Einspieler C, Langmann A, Körner C, Falck-Ytter T, Marschik PB. The Relation between Reading Skills and Eye Movement Patterns in Adolescent Readers: Evidence from a Regular Orthography. PLoS One 2016; 11:e0145934. [PMID: 26727255 PMCID: PMC4699816 DOI: 10.1371/journal.pone.0145934] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2015] [Accepted: 12/10/2015] [Indexed: 11/28/2022] Open
Abstract
Over the past decades, the relation between reading skills and eye movement behavior has been well documented in English-speaking cohorts. As English and German differ substantially with regard to orthographic complexity (i.e. grapheme-phoneme correspondence), we aimed to delineate specific characteristics of how reading speed and reading comprehension interact with eye movements in typically developing German-speaking (Austrian) adolescents. Eye movements of 22 participants (14 females; mean age = 13;6 years;months) were tracked while they were performing three tasks, namely silently reading words, texts, and pseudowords. Their reading skills were determined by means of a standardized German reading speed and reading comprehension assessment (Lesegeschwindigkeits- und -verständnistest für Klassen 6−12). We found that (a) reading skills were associated with various eye movement parameters in each of the three reading tasks; (b) better reading skills were associated with an increased efficiency of eye movements, but were primarily linked to spatial reading parameters, such as the number of fixations per word, the total number of saccades and saccadic amplitudes; (c) reading speed was a more reliable predictor for eye movement parameters than reading comprehension; (d) eye movements were highly correlated across reading tasks, which indicates consistent reading performances. Contrary to findings in English-speaking cohorts, the reading skills neither consistently correlated with temporal eye movement parameters nor with the number or percentage of regressions made while performing any of the three reading tasks. These results indicate that, although reading skills are associated with eye movement patterns irrespective of language, the temporal and spatial characteristics of this association may vary with orthographic consistency.
Collapse
Affiliation(s)
- Magdalena Krieber
- Research Unit iDN–interdisciplinary Developmental Neuroscience, Institute of Physiology, Center for Physiological Medicine, Medical University of Graz, Graz, Austria
| | - Katrin D. Bartl-Pokorny
- Research Unit iDN–interdisciplinary Developmental Neuroscience, Institute of Physiology, Center for Physiological Medicine, Medical University of Graz, Graz, Austria
| | - Florian B. Pokorny
- Research Unit iDN–interdisciplinary Developmental Neuroscience, Institute of Physiology, Center for Physiological Medicine, Medical University of Graz, Graz, Austria
- Machine Intelligence & Signal Processing Group, Technische Universität München, Munich, Germany
- BEE-PRI: Brain, Ears & Eyes–Pattern Recognition Initiative, BioTechMed-Graz, Graz, Austria
| | - Christa Einspieler
- Research Unit iDN–interdisciplinary Developmental Neuroscience, Institute of Physiology, Center for Physiological Medicine, Medical University of Graz, Graz, Austria
| | - Andrea Langmann
- Department of Strabism, Pediatric Ophthalmology and Rehabilitation of Visually Impaired, Medical University of Graz, Graz, Austria
| | - Christof Körner
- Cognitive Psychology & Neuroscience, Department of Psychology, University of Graz, Graz, Austria
| | - Terje Falck-Ytter
- Center of Neurodevelopmental Disorders (KIND), Department of Women’s and Children’s Health, Karolinska Institutet, Stockholm, Sweden
- Department of Psychology, Uppsala University, Uppsala, Sweden
| | - Peter B. Marschik
- Research Unit iDN–interdisciplinary Developmental Neuroscience, Institute of Physiology, Center for Physiological Medicine, Medical University of Graz, Graz, Austria
- BEE-PRI: Brain, Ears & Eyes–Pattern Recognition Initiative, BioTechMed-Graz, Graz, Austria
- Center of Neurodevelopmental Disorders (KIND), Department of Women’s and Children’s Health, Karolinska Institutet, Stockholm, Sweden
- * E-mail:
| |
Collapse
|
7
|
Braun M, Jacobs AM, Richlan F, Hawelka S, Hutzler F, Kronbichler M. Many neighbors are not silent. fMRI evidence for global lexical activity in visual word recognition. Front Hum Neurosci 2015; 9:423. [PMID: 26257634 PMCID: PMC4510423 DOI: 10.3389/fnhum.2015.00423] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2015] [Accepted: 07/10/2015] [Indexed: 12/03/2022] Open
Abstract
Many neurocognitive studies investigated the neural correlates of visual word recognition, some of which manipulated the orthographic neighborhood density of words and nonwords believed to influence the activation of orthographically similar representations in a hypothetical mental lexicon. Previous neuroimaging research failed to find evidence for such global lexical activity associated with neighborhood density. Rather, effects were interpreted to reflect semantic or domain general processing. The present fMRI study revealed effects of lexicality, orthographic neighborhood density and a lexicality by orthographic neighborhood density interaction in a silent reading task. For the first time we found greater activity for words and nonwords with a high number of neighbors. We propose that this activity in the dorsomedial prefrontal cortex reflects activation of orthographically similar codes in verbal working memory thus providing evidence for global lexical activity as the basis of the neighborhood density effect. The interaction of lexicality by neighborhood density in the ventromedial prefrontal cortex showed lower activity in response to words with a high number compared to nonwords with a high number of neighbors. In the light of these results the facilitatory effect for words and inhibitory effect for nonwords with many neighbors observed in previous studies can be understood as being due to the operation of a fast-guess mechanism for words and a temporal deadline mechanism for nonwords as predicted by models of visual word recognition. Furthermore, we propose that the lexicality effect with higher activity for words compared to nonwords in inferior parietal and middle temporal cortex reflects the operation of an identification mechanism based on local lexico-semantic activity.
Collapse
Affiliation(s)
- Mario Braun
- Neurocognition Lab, Centre for Cognitive Neuroscience, Universität SalzburgSalzburg, Austria
- Department of Experimental and Neurocognitive Psychology, Freie Universität BerlinBerlin, Germany
| | - Arthur M. Jacobs
- Department of Experimental and Neurocognitive Psychology, Freie Universität BerlinBerlin, Germany
- Center for Cognitive Neuroscience BerlinBerlin, Germany
- Dahlem Institute for Neuroimaging of Emotion, BerlinGermany
| | - Fabio Richlan
- Neurocognition Lab, Centre for Cognitive Neuroscience, Universität SalzburgSalzburg, Austria
| | - Stefan Hawelka
- Neurocognition Lab, Centre for Cognitive Neuroscience, Universität SalzburgSalzburg, Austria
| | - Florian Hutzler
- Neurocognition Lab, Centre for Cognitive Neuroscience, Universität SalzburgSalzburg, Austria
| | - Martin Kronbichler
- Neurocognition Lab, Centre for Cognitive Neuroscience, Universität SalzburgSalzburg, Austria
- Christian-Doppler-Klinik, Paracelsus Medical University, SalzburgAustria
| |
Collapse
|
8
|
Braun M, Hutzler F, Münte TF, Rotte M, Dambacher M, Richlan F, Jacobs AM. The neural bases of the pseudohomophone effect: Phonological constraints on lexico-semantic access in reading. Neuroscience 2015; 295:151-63. [PMID: 25805695 DOI: 10.1016/j.neuroscience.2015.03.035] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2015] [Revised: 03/13/2015] [Accepted: 03/17/2015] [Indexed: 11/30/2022]
Abstract
We investigated phonological processing in normal readers to answer the question to what extent phonological recoding is active during silent reading and if or how it guides lexico-semantic access. We addressed this issue by looking at pseudohomophone and baseword frequency effects in lexical decisions with event-related functional magnetic resonance imaging (fMRI). The results revealed greater activation in response to pseudohomophones than for well-controlled pseudowords in the left inferior/superior frontal and middle temporal cortex, left insula, and left superior parietal lobule. Furthermore, we observed a baseword frequency effect for pseudohomophones (e.g., FEAL) but not for pseudowords (e.g., FEEP). This baseword frequency effect was qualified by activation differences in bilateral angular and left supramarginal, and bilateral middle temporal gyri for pseudohomophones with low- compared to high-frequency basewords. We propose that lexical decisions to pseudohomophones involves phonology-driven lexico-semantic activation of their basewords and that this is converging neuroimaging evidence for automatically activated phonological representations during silent reading in experienced readers.
Collapse
Affiliation(s)
- M Braun
- Centre for Cognitive Neuroscience, University of Salzburg, Austria.
| | - F Hutzler
- Centre for Cognitive Neuroscience, University of Salzburg, Austria
| | - T F Münte
- Dept. of Neurology and Institute of Psychology II, University of Lübeck, Germany
| | - M Rotte
- Novartis Pharma, Basle, Switzerland
| | - M Dambacher
- Institute of Psychology, Freie Universität Berlin, Germany; Dept. of Psychology, University of Konstanz, Germany
| | - F Richlan
- Centre for Cognitive Neuroscience, University of Salzburg, Austria
| | - A M Jacobs
- Institute of Psychology, Freie Universität Berlin, Germany; Dahlem Institute for Neuroimaging of Emotion, Berlin, Germany
| |
Collapse
|
9
|
Marx C, Hawelka S, Schuster S, Hutzler F. An incremental boundary study on parafoveal preprocessing in children reading aloud: Parafoveal masks overestimate the preview benefit. JOURNAL OF COGNITIVE PSYCHOLOGY 2015; 27:549-561. [PMID: 26246890 PMCID: PMC4487581 DOI: 10.1080/20445911.2015.1008494] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Parafoveal preprocessing is an important factor for efficient reading and, in eye-movement studies, is typically investigated by means of parafoveal masking: Valid previews are compared to instances in which masks prevent preprocessing. A long-held assumption was that parafoveal preprocessing, as assessed by this technique, only reflects facilitation (i.e., a preview benefit). Recent studies, however, suggested that the benefit estimate is inflated due to interference of the parafoveal masks, i.e., the masks inflict processing costs. With children from Grades 4 and 6, we administered the novel incremental priming technique. The technique manipulates the salience of the previews by systematically varying its perceptibility (i.e., by visually degrading the previews). This technique does not require a baseline condition, but makes it possible to determine whether a preview induces facilitation or interference. Our salience manipulation of valid previews revealed a preview benefit in the children of both Grades. For two commonly used parafoveal masks, we observed interference corroborating the notion that masks are not a proper baseline. With the novel incremental boundary technique, in contrast, one can achieve an accurate estimate of the preview benefit.
Collapse
Affiliation(s)
- Christina Marx
- Centre for Cognitive Neuroscience, University of Salzburg , Salzburg , Austria
| | - Stefan Hawelka
- Centre for Cognitive Neuroscience, University of Salzburg , Salzburg , Austria
| | - Sarah Schuster
- Centre for Cognitive Neuroscience, University of Salzburg , Salzburg , Austria
| | - Florian Hutzler
- Centre for Cognitive Neuroscience, University of Salzburg , Salzburg , Austria
| |
Collapse
|