1
|
Cometa A, Battaglini C, Artoni F, Greco M, Frank R, Repetto C, Bottoni F, Cappa SF, Micera S, Ricciardi E, Moro A. Brain and grammar: revealing electrophysiological basic structures with competing statistical models. Cereb Cortex 2024; 34:bhae317. [PMID: 39098819 DOI: 10.1093/cercor/bhae317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 07/08/2024] [Accepted: 07/24/2024] [Indexed: 08/06/2024] Open
Abstract
Acoustic, lexical, and syntactic information are simultaneously processed in the brain requiring complex strategies to distinguish their electrophysiological activity. Capitalizing on previous works that factor out acoustic information, we could concentrate on the lexical and syntactic contribution to language processing by testing competing statistical models. We exploited electroencephalographic recordings and compared different surprisal models selectively involving lexical information, part of speech, or syntactic structures in various combinations. Electroencephalographic responses were recorded in 32 participants during listening to affirmative active declarative sentences. We compared the activation corresponding to basic syntactic structures, such as noun phrases vs. verb phrases. Lexical and syntactic processing activates different frequency bands, partially different time windows, and different networks. Moreover, surprisal models based on part of speech inventory only do not explain well the electrophysiological data, while those including syntactic information do. By disentangling acoustic, lexical, and syntactic information, we demonstrated differential brain sensitivity to syntactic information. These results confirm and extend previous measures obtained with intracranial recordings, supporting our hypothesis that syntactic structures are crucial in neural language processing. This study provides a detailed understanding of how the brain processes syntactic information, highlighting the importance of syntactic surprisal in shaping neural responses during language comprehension.
Collapse
Affiliation(s)
- Andrea Cometa
- MoMiLab, IMT School for Advanced Studies Lucca, Piazza S.Francesco, 19, Lucca 55100, Italy
- The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, Pontedera 56025, Italy
- Cognitive Neuroscience (ICoN) Center, University School for Advanced Studies IUSS, Piazza Vittoria 15, Pavia 27100, Italy
| | - Chiara Battaglini
- Neurolinguistics and Experimental Pragmatics (NEP) Lab, University School for Advanced Studies IUSS Pavia, Piazza della Vittoria 15, Pavia 27100, Italy
| | - Fiorenzo Artoni
- Department of Clinical Neurosciences, Faculty of Medicine, University of Geneva, 1, rue Michel-Servet, Genéve 1211, Switzerland
| | - Matteo Greco
- Cognitive Neuroscience (ICoN) Center, University School for Advanced Studies IUSS, Piazza Vittoria 15, Pavia 27100, Italy
| | - Robert Frank
- Department of Linguistics, Yale University, 370 Temple St, New Haven, CT 06511, United States
| | - Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Largo A. Gemelli 1, Milan 20123, Italy
| | - Franco Bottoni
- Istituto Clinico Humanitas, IRCCS, Via Alessandro Manzoni 56, Rozzano 20089, Italy
| | - Stefano F Cappa
- Cognitive Neuroscience (ICoN) Center, University School for Advanced Studies IUSS, Piazza Vittoria 15, Pavia 27100, Italy
- Dementia Research Center, IRCCS Mondino Foundation National Institute of Neurology, Via Mondino 2, Pavia 27100, Italy
| | - Silvestro Micera
- The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio 34, Pontedera 56025, Italy
- Bertarelli Foundation Chair in Translational NeuroEngineering, Center for Neuroprosthetics and School of Engineering, Ecole Polytechnique Federale de Lausanne, Campus Biotech, Chemin des Mines 9, Geneva, GE CH 1202, Switzerland
| | - Emiliano Ricciardi
- MoMiLab, IMT School for Advanced Studies Lucca, Piazza S.Francesco, 19, Lucca 55100, Italy
| | - Andrea Moro
- Cognitive Neuroscience (ICoN) Center, University School for Advanced Studies IUSS, Piazza Vittoria 15, Pavia 27100, Italy
| |
Collapse
|
2
|
Lewis AG, Schoffelen JM, Bastiaansen M, Schriefers H. Is beta in agreement with the relatives? Using relative clause sentences to investigate MEG beta power dynamics during sentence comprehension. Psychophysiology 2023; 60:e14332. [PMID: 37203219 DOI: 10.1111/psyp.14332] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Revised: 03/20/2023] [Accepted: 04/27/2023] [Indexed: 05/20/2023]
Abstract
There remains some debate about whether beta power effects observed during sentence comprehension reflect ongoing syntactic unification operations (beta-syntax hypothesis), or instead reflect maintenance or updating of the sentence-level representation (beta-maintenance hypothesis). In this study, we used magnetoencephalography to investigate beta power neural dynamics while participants read relative clause sentences that were initially ambiguous between a subject- or an object-relative reading. An additional condition included a grammatical violation at the disambiguation point in the relative clause sentences. The beta-maintenance hypothesis predicts a decrease in beta power at the disambiguation point for unexpected (and less preferred) object-relative clause sentences and grammatical violations, as both signal a need to update the sentence-level representation. While the beta-syntax hypothesis also predicts a beta power decrease for grammatical violations due to a disruption of syntactic unification operations, it instead predicts an increase in beta power for the object-relative clause condition because syntactic unification at the point of disambiguation becomes more demanding. We observed decreased beta power for both the agreement violation and object-relative clause conditions in typical left hemisphere language regions, which provides compelling support for the beta-maintenance hypothesis. Mid-frontal theta power effects were also present for grammatical violations and object-relative clause sentences, suggesting that violations and unexpected sentence interpretations are registered as conflicts by the brain's domain-general error detection system.
Collapse
Affiliation(s)
- Ashley Glen Lewis
- Neurobiology of Language Department, Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Jan-Mathijs Schoffelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Marcel Bastiaansen
- Academy for Leisure and Events, Breda University of Applied Sciences, Breda, the Netherlands
- Department of Cognitive Neuropsychology, School of Social and Behavioural Sciences, Tilburg University, Tilburg, the Netherlands
| | - Herbert Schriefers
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
3
|
Zeller J, Bylund E, Lewis AG. The parser consults the lexicon in spite of transparent gender marking: EEG evidence from noun class agreement processing in Zulu. Cognition 2022; 226:105148. [DOI: 10.1016/j.cognition.2022.105148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 02/22/2022] [Accepted: 04/22/2022] [Indexed: 11/03/2022]
|
4
|
Egurtzegi A, Blasi DE, Bornkessel-Schlesewsky I, Laka I, Meyer M, Bickel B, Sauppe S. Cross-linguistic differences in case marking shape neural power dynamics and gaze behavior during sentence planning. BRAIN AND LANGUAGE 2022; 230:105127. [PMID: 35605312 DOI: 10.1016/j.bandl.2022.105127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 04/07/2022] [Accepted: 04/21/2022] [Indexed: 06/15/2023]
Abstract
Languages differ in how they mark the dependencies between verbs and arguments, e.g., by case. An eye tracking and EEG picture description study examined the influence of case marking on the time course of sentence planning in Basque and Swiss German. While German assigns an unmarked (nominative) case to subjects, Basque specifically marks agent arguments through ergative case. Fixations to agents and event-related synchronization (ERS) in the theta and alpha frequency bands, as well as desynchronization (ERD) in the alpha and beta bands revealed multiple effects of case marking on the time course of early sentence planning. Speakers decided on case marking under planning early when preparing sentences with ergative-marked agents in Basque, whereas sentences with unmarked agents allowed delaying structural commitment across languages. These findings support hierarchically incremental accounts of sentence planning and highlight how cross-linguistic differences shape the neural dynamics underpinning language use.
Collapse
Affiliation(s)
- Aitor Egurtzegi
- Department of Comparative Language Science, University of Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Switzerland; English Department, University of Zurich, Switzerland
| | - Damián E Blasi
- Department of Human Evolutionary Biology, Harvard University, United States; Department of Linguistic and Cultural Evolution, Max Planck Institute for Evolutionary Anthropology, Germany
| | - Ina Bornkessel-Schlesewsky
- School of Psychology, Social Work and Social Policy, University of South Australia, Australia; Cognitive and Systems Neuroscience Research Hub, University of South Australia, Australia
| | - Itziar Laka
- Department of Linguistics and Basque Studies, University of the Basque Country (UPV/EHU), Spain
| | - Martin Meyer
- Department of Comparative Language Science, University of Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Switzerland; Cognitive Psychology Unit, Psychological Institute, University of Klagenfurt, Austria
| | - Balthasar Bickel
- Department of Comparative Language Science, University of Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Switzerland
| | - Sebastian Sauppe
- Department of Comparative Language Science, University of Zurich, Switzerland; Center for the Interdisciplinary Study of Language Evolution, University of Zurich, Switzerland.
| |
Collapse
|
5
|
Lum JAG, Clark GM, Bigelow FJ, Enticott PG. Resting state electroencephalography (EEG) correlates with children's language skills: Evidence from sentence repetition. BRAIN AND LANGUAGE 2022; 230:105137. [PMID: 35576738 DOI: 10.1016/j.bandl.2022.105137] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 05/02/2022] [Accepted: 05/02/2022] [Indexed: 06/15/2023]
Abstract
Spontaneous neural oscillatory activity reflects the brain's functional architecture and has previously been shown to correlate with perceptual, motor and executive skills. The current study used resting state electroencephalography to examine the relationship between spontaneous neural oscillatory activity and children's language skills. Participants in the study were 52 English-speaking children aged around 10-years. Language was assessed using a sentence repetition task. The main analysis revealed resting state theta power negatively correlated with this task. No significant correlations were found in the other studied frequency bands (delta, alpha, beta, gamma). As part of typical brain development, spontaneous theta power declines across childhood and adolescence. The negative correlation observed in this study may therefore be indicating children's language skills are related to the maturation of theta oscillations. More generally, the study provides further evidence that oscillatory activity in the developing brain, even at rest, is reliably associated with children's language skills.
Collapse
Affiliation(s)
- Jarrad A G Lum
- School of Psychology, Cognitive Neuroscience Unit, Deakin University, Geelong, Australia.
| | - Gillian M Clark
- School of Psychology, Cognitive Neuroscience Unit, Deakin University, Geelong, Australia
| | - Felicity J Bigelow
- School of Psychology, Cognitive Neuroscience Unit, Deakin University, Geelong, Australia
| | - Peter G Enticott
- School of Psychology, Cognitive Neuroscience Unit, Deakin University, Geelong, Australia
| |
Collapse
|
6
|
Cross ZR, Corcoran AW, Schlesewsky M, Kohler MJ, Bornkessel-Schlesewsky I. Oscillatory and Aperiodic Neural Activity Jointly Predict Language Learning. J Cogn Neurosci 2022; 34:1630-1649. [PMID: 35640095 DOI: 10.1162/jocn_a_01878] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Memory formation involves the synchronous firing of neurons in task-relevant networks, with recent models postulating that a decrease in low-frequency oscillatory activity underlies successful memory encoding and retrieval. However, to date, this relationship has been investigated primarily with face and image stimuli; considerably less is known about the oscillatory correlates of complex rule learning, as in language. Furthermore, recent work has shown that nonoscillatory (1/ƒ) activity is functionally relevant to cognition, yet its interaction with oscillatory activity during complex rule learning remains unknown. Using spectral decomposition and power-law exponent estimation of human EEG data (17 females, 18 males), we show for the first time that 1/ƒ and oscillatory activity jointly influence the learning of word order rules of a miniature artificial language system. Flexible word-order rules were associated with a steeper 1/ƒ slope, whereas fixed word-order rules were associated with a shallower slope. We also show that increased theta and alpha power predicts fixed relative to flexible word-order rule learning and behavioral performance. Together, these results suggest that 1/ƒ activity plays an important role in higher-order cognition, including language processing, and that grammar learning is modulated by different word-order permutations, which manifest in distinct oscillatory profiles.
Collapse
|
7
|
McLoughlin G, Gyurkovics M, Palmer J, Makeig S. Midfrontal Theta Activity in Psychiatric Illness: An Index of Cognitive Vulnerabilities Across Disorders. Biol Psychiatry 2022; 91:173-182. [PMID: 34756560 DOI: 10.1016/j.biopsych.2021.08.020] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 08/16/2021] [Accepted: 08/18/2021] [Indexed: 12/21/2022]
Abstract
There is an urgent need to identify the mechanisms that contribute to atypical thinking and behavior associated with psychiatric illness. Behavioral and brain measures of cognitive control are associated with a variety of psychiatric disorders and conditions as well as daily life functioning. Recognition of the importance of cognitive control in human behavior has led to intensive research into behavioral and neurobiological correlates. Oscillations in the theta band (4-8 Hz) over medial frontal recording sites are becoming increasingly established as a direct neural index of certain aspects of cognitive control. In this review, we point toward evidence that theta acts to coordinate multiple neural processes in disparate brain regions during task processing to optimize behavior. Theta-related signals in human electroencephalography include the N2, the error-related negativity, and measures of theta power in the (time-)frequency domain. We investigate how these theta signals are affected in a wide range of psychiatric conditions with known deficiencies in cognitive control: anxiety, obsessive-compulsive disorder, attention-deficit/hyperactivity disorder, and substance abuse. Theta-related control signals and their temporal consistency were found to differ in most patient groups compared with healthy control subjects, suggesting fundamental deficits in reactive and proactive control. Notably, however, clinical studies directly investigating the role of theta in the coordination of goal-directed processes across different brain regions are uncommon and are encouraged in future research. A finer-grained analysis of flexible, subsecond-scale functional networks in psychiatric disorders could contribute to a dimensional understanding of psychopathology.
Collapse
Affiliation(s)
- Gráinne McLoughlin
- Social, Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom.
| | - Máté Gyurkovics
- Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, Illinois
| | - Jason Palmer
- Department of Neurological Diagnosis and Restoration, Osaka University Graduate School of Medicine, Osaka, Japan
| | - Scott Makeig
- Institute for Neural Computation, University of California San Diego, La Jolla, California
| |
Collapse
|
8
|
Momsen JP, Abel AD. Neural oscillations reflect meaning identification for novel words in context. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:132-148. [PMID: 36340747 PMCID: PMC9632687 DOI: 10.1162/nol_a_00052] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Accepted: 07/27/2021] [Indexed: 05/21/2023]
Abstract
During language processing, people make rapid use of contextual information to promote comprehension of upcoming words. When new words are learned implicitly, information contained in the surrounding context can provide constraints on their possible meaning. In the current study, EEG was recorded as participants listened to a series of three sentences, each containing an identical target pseudoword, with the aim of using contextual information in the surrounding language to identify a meaning representation for the novel word. In half of trials, sentences were semantically coherent so that participants could develop a single representation for the novel word that fit all contexts. Other trials contained unrelated sentence contexts so that meaning associations were not possible. We observed greater theta band enhancement over the left-hemisphere across central and posterior electrodes in response to pseudowords processed across semantically related compared to unrelated contexts. Additionally, relative alpha and beta band suppression was increased prior to pseudoword onset in trials where contextual information more readily promoted pseudoword-meaning associations. Under the hypothesis that theta enhancement indexes processing demands during lexical access, the current study provides evidence for selective online memory retrieval to novel words learned implicitly in a spoken context.
Collapse
Affiliation(s)
- Jacob Pohaku Momsen
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University and UC San Diego, San Diego, CA, USA
- * Corresponding Author:
| | - Alyson D. Abel
- School of Speech, Language, and Hearing Sciences, San Diego State University, San Diego, CA, USA
| |
Collapse
|
9
|
Abstract
This study investigated emoji semantic processing by measuring changes in event-related electroencephalogram (EEG) power. The last segment of experimental sentences was designed as either words or emojis consistent or inconsistent with the sentential context. The results showed that incongruent emojis led to a conspicuous increase of theta power (4–7 Hz), while incongruent words induced a decrease. Furthermore, the theta power increase was observed at midfrontal, occipital and bilateral temporal lobes with emojis. This suggests a higher working memory load for monitoring errors, difficulty of form recognition and concept retrieval in emoji semantic processing. It implies different neuro-cognitive processes involved in the semantic processing of emojis and words.
Collapse
|
10
|
Neural signatures of syntactic variation in speech planning. PLoS Biol 2021; 19:e3001038. [PMID: 33497384 PMCID: PMC7837500 DOI: 10.1371/journal.pbio.3001038] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2020] [Accepted: 12/31/2020] [Indexed: 11/20/2022] Open
Abstract
Planning to speak is a challenge for the brain, and the challenge varies between and within languages. Yet, little is known about how neural processes react to these variable challenges beyond the planning of individual words. Here, we examine how fundamental differences in syntax shape the time course of sentence planning. Most languages treat alike (i.e., align with each other) the 2 uses of a word like “gardener” in “the gardener crouched” and in “the gardener planted trees.” A minority keeps these formally distinct by adding special marking in 1 case, and some languages display both aligned and nonaligned expressions. Exploiting such a contrast in Hindi, we used electroencephalography (EEG) and eye tracking to suggest that this difference is associated with distinct patterns of neural processing and gaze behavior during early planning stages, preceding phonological word form preparation. Planning sentences with aligned expressions induces larger synchronization in the theta frequency band, suggesting higher working memory engagement, and more visual attention to agents than planning nonaligned sentences, suggesting delayed commitment to the relational details of the event. Furthermore, plain, unmarked expressions are associated with larger desynchronization in the alpha band than expressions with special markers, suggesting more engagement in information processing to keep overlapping structures distinct during planning. Our findings contrast with the observation that the form of aligned expressions is simpler, and they suggest that the global preference for alignment is driven not by its neurophysiological effect on sentence planning but by other sources, possibly by aspects of production flexibility and fluency or by sentence comprehension. This challenges current theories on how production and comprehension may affect the evolution and distribution of syntactic variants in the world’s languages. Little is known about the neural processes involved in planning to speak. This study uses eye-tracking and EEG to show that speakers prepare sentence structures in different ways and rely on alpha and theta oscillations differently when planning sentences with and without agent case marking, challenging theories on how production and comprehension affect language evolution.
Collapse
|
11
|
Poulisse C, Wheeldon L, Limachya R, Mazaheri A, Segaert K. The oscillatory mechanisms associated with syntactic binding in healthy ageing. Neuropsychologia 2020; 146:107523. [PMID: 32553723 DOI: 10.1016/j.neuropsychologia.2020.107523] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Revised: 06/02/2020] [Accepted: 06/04/2020] [Indexed: 01/02/2023]
Abstract
Older adults frequently display differential patterns of brain activity compared to young adults in the same task, alongside widespread neuroanatomical changes. Differing functional activity patterns in older adults are commonly interpreted as being compensatory (e.g., Cabeza et al., 2002). We examined the oscillatory activity in the EEG during syntactic binding in young and older adults, as well as the relationship between oscillatory activity and behavioural performance on a syntactic judgement task within the older adults. 19 young and 41 older adults listened to two-word sentences that differentially load onto morpho-syntactic binding: correct syntactic binding (morpho-syntactically correct, e.g., "I dotch"); incorrect syntactic binding (morpho-syntactic agreement violation, e.g., "they dotches") and no syntactic binding (minimizing morpho-syntactic binding, e.g., "dotches spuff"). Behavioural performance, assessed in a syntactic judgement task, was characterized by inter-individual variability especially in older adults, with accuracy ranging from 76 to 100% in young adults and 58-100% in older adults. Compared to young adults, older adults were slower, but not less accurate. Functional neural signatures for syntactic binding were assessed as the difference in oscillatory power between the correct and no syntactic binding condition. In older adults, syntactic binding was associated with a smaller increase in theta (4-7 Hz), alpha (8-12 Hz) and beta (15-20 Hz) power in a time window surrounding the second word. There was a significant difference between the older and young adults: in the alpha range, the condition difference seemed to be in the opposite direction for older versus young adults. Our findings thus suggest that the neural signature associated with syntactic binding in older adults is different from young adults. However, we found no evidence of a significant association between behavioural performance and the neural signatures of syntactic binding for older adults, which does not readily support the predictions of compensatory models of language and ageing.
Collapse
Affiliation(s)
- Charlotte Poulisse
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2SA, United Kingdom.
| | - Linda Wheeldon
- Department of Foreign Languages and Translation, University of Agder, Varemottak Universitetsveien 25 D, 4630, Kristiansand, Norway.
| | - Rupali Limachya
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2SA, United Kingdom.
| | - Ali Mazaheri
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2SA, United Kingdom; Centre for Human Brain Health, University of Birmingham, Birmingham, B15 2SA, United Kingdom.
| | - Katrien Segaert
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, B15 2SA, United Kingdom; Centre for Human Brain Health, University of Birmingham, Birmingham, B15 2SA, United Kingdom.
| |
Collapse
|
12
|
Cao S, Wang Y, Wang H, Chen H, Zhang G, Kritikos A. A Facilitatory Effect of Perceptual Incongruity on Target-Source Matching in Pictorial Metaphors of Chinese Advertising: EEG Evidence. Adv Cogn Psychol 2020; 16:1-12. [PMID: 32537039 PMCID: PMC7278523 DOI: 10.5709/acp-0279-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Using evoked response potentials, we investigated the implicit detection of incongruity during target-source matching in pictorial metaphors of Chinese advertising. Participants saw an image of a product (the target in a visual metaphorical relationship), and then made a same-different judgment in response to a second image (the source in a visual metaphorical relationship) which was (in)congruous to the first image in terms of shape and/or function. We collected behavioral (button-press reaction time and accuracy), and neural (N270, delta and theta band activity) measures. The time-frequency analysis showed faster processing of incongruous visual information. Moreover, shape and conceptual incongruity were associated with increased N270 amplitude as well as delta (1-3 Hz) and theta (4-8 Hz) band power. Noticeably, compared with conceptual incongruity, shape incongruity evoked a larger N270 amplitude and stronger delta and theta band oscillation. In addition, the average topographical analysis revealed a frontal and central distribution of the power activity. The analysis of attitudes towards the advertising metaphor pictures also proved the supportive role played by incongruity. In conclusion, incongruity facilitates target-source matching in pictorial metaphors of Chinese advertising. The findings obtained from the study are important to metaphor designs of advertising pictures.
Collapse
Affiliation(s)
- Shuo Cao
- School of Foreign Languages, Dalian University of Technology, Dalian, China
| | - Yanzhang Wang
- School of Economics and Management, Dalian University of Technology, Dalian, China
| | - Huili Wang
- School of Foreign Languages, Dalian University of Technology, Dalian, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian, China
| | - Guanghui Zhang
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, Finland
| | - Ada Kritikos
- School of Psychology, University of Queensland, Australia
| |
Collapse
|
13
|
Covert Intention to Answer "Yes" or "No" Can Be Decoded from Single-Trial Electroencephalograms (EEGs). COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2020; 2019:4259369. [PMID: 31379934 PMCID: PMC6652077 DOI: 10.1155/2019/4259369] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/19/2019] [Revised: 05/14/2019] [Accepted: 06/13/2019] [Indexed: 11/18/2022]
Abstract
Interpersonal communication is based on questions and answers, and the most useful and simplest case is the binary “yes or no” question and answer. The purpose of this study is to show that it is possible to decode intentions on “yes” or “no” answers from multichannel single-trial electroencephalograms, which were recorded while covertly answering to self-referential questions with either “yes” or “no.” The intention decoding algorithm consists of a common spatial pattern and support vector machine, which are employed for the feature extraction and pattern classification, respectively, after dividing the overall time-frequency range into subwindows of 200 ms × 2 Hz. The decoding accuracy using the information within each subwindow was investigated to find useful temporal and spectral ranges and found to be the highest for 800–1200 ms in the alpha band or 200–400 ms in the theta band. When the features from multiple subwindows were utilized together, the accuracy was significantly increased up to ∼86%. The most useful features for the “yes/no” discrimination was found to be focused in the right frontal region in the theta band and right centroparietal region in the alpha band, which may reflect the violation of autobiographic facts and higher cognitive load for “no” compared to “yes.” Our task requires the subjects to answer self-referential questions just as in interpersonal conversation without any self-regulation of the brain signals or high cognitive efforts, and the “yes” and “no” answers are decoded directly from the brain activities. This implies that the “mind reading” in a true sense is feasible. Beyond its contribution in fundamental understanding of the neural mechanism of human intention, the decoding of “yes” or “no” from brain activities may eventually lead to a natural brain-computer interface.
Collapse
|
14
|
Prystauka Y, Lewis AG. THE POWER OF NEURAL OSCILLATIONS TO INFORM SENTENCE COMPREHENSION: A LINGUISTIC PERSPECTIVE. LANGUAGE AND LINGUISTICS COMPASS 2019; 13:e12347. [PMID: 33042211 PMCID: PMC7546279 DOI: 10.1111/lnc3.12347] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
The field of psycholinguistics is currently experiencing an explosion of interest in the analysis of neural oscillations - rhythmic brain activity synchronized at different temporal and spatial levels. Given that language comprehension relies on a myriad of processes, which are carried out in parallel in distributed brain networks, there is hope that this methodology might bring the field closer to understanding some of the more basic (spatially and temporally distributed, yet at the same time often overlapping) neural computations that support language function. In this review we discuss existing proposals linking oscillatory dynamics in different frequency bands to basic neural computations, and review relevant theories suggesting associations between band-specific oscillations and higher-level cognitive processes. More or less consistent patterns of oscillatory activity related to certain types of linguistic processing can already be derived from the evidence that has accumulated over the past few decades. The centerpiece of the current review is a synthesis of such patterns grouped by linguistic phenomenon. We restrict our review to evidence linking measures of oscillatory power to the comprehension of sentences, as well as linguistically (and/or pragmatically) more complex structures. For each grouping, we provide a brief summary and a table of associated oscillatory signatures that a psycholinguist might expect to find when employing a particular linguistic task. Summarizing across different paradigms, we conclude that a handful of basic neural oscillatory mechanisms are likely recruited in different ways and at different times for carrying out a variety of linguistic computations.
Collapse
Affiliation(s)
- Yanina Prystauka
- Department of Psychological Sciences, University of Connecticut
- Connecticut Institute for the Brain and Cognitive Sciences
| | - Ashley Glen Lewis
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Nijmegen, the Netherlands
- Haskins Laboratories, New Haven, CT 06510, USA
| |
Collapse
|
15
|
Frequency-specific brain dynamics related to prediction during language comprehension. Neuroimage 2019; 198:283-295. [DOI: 10.1016/j.neuroimage.2019.04.083] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2018] [Revised: 04/17/2019] [Accepted: 04/19/2019] [Indexed: 12/28/2022] Open
|
16
|
Beese C, Vassileiou B, Friederici AD, Meyer L. Age Differences in Encoding-Related Alpha Power Reflect Sentence Comprehension Difficulties. Front Aging Neurosci 2019; 11:183. [PMID: 31379561 PMCID: PMC6654000 DOI: 10.3389/fnagi.2019.00183] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Accepted: 07/04/2019] [Indexed: 12/29/2022] Open
Abstract
When sentence processing taxes verbal working memory, comprehension difficulties arise. This is specifically the case when processing resources decline with advancing adult age. Such decline likely affects the encoding of sentences into working memory, which constitutes the basis for successful comprehension. To assess age differences in encoding-related electrophysiological activity, we recorded the electroencephalogram from three age groups (24, 43, and 65 years). Using an auditory sentence comprehension task, age differences in encoding-related oscillatory power were examined with respect to the accuracy of the given response. That is, the difference in oscillatory power between correctly and incorrectly encoded sentences, yielding subsequent memory effects (SME), was compared across age groups. Across age groups, we observed an age-related SME inversion in the alpha band from a power decrease in younger adults to a power increase in older adults. We suggest that this SME inversion underlies age-related comprehension difficulties. With alpha being commonly linked to inhibitory processes, this shift may reflect a change in the cortical inhibition-disinhibition balance. A cortical disinhibition may imply enriched sentence encoding in younger adults. In contrast, resource limitations in older adults may necessitate an increase in cortical inhibition during sentence encoding to avoid an information overload. Overall, our findings tentatively suggest that age-related comprehension difficulties are associated with alterations to the electrophysiological dynamics subserving general higher cognitive functions.
Collapse
Affiliation(s)
- Caroline Beese
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Benedict Vassileiou
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Lars Meyer
- Research Group Language Cycles, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
17
|
Vilas MG, Santilli M, Mikulan E, Adolfi F, Martorell Caro M, Manes F, Herrera E, Sedeño L, Ibáñez A, García AM. Reading Shakespearean tropes in a foreign tongue: Age of L2 acquisition modulates neural responses to functional shifts. Neuropsychologia 2019; 124:79-86. [PMID: 30664853 DOI: 10.1016/j.neuropsychologia.2019.01.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2018] [Revised: 12/21/2018] [Accepted: 01/11/2019] [Indexed: 11/25/2022]
Abstract
Functional shifts (FSs) - morphosyntactically marked words evoking coherent but novel meanings - are ubiquitous in English and, specially, in Shakespearean literature. While their neural signatures have been explored in native speakers, no study has targeted foreign-language users, let alone comparing early and late bilinguals. Here, we administered a validated FS paradigm to subjects from both populations and evaluated time-frequency modulations evoked by FS and control sentences. Early bilinguals exhibited greater sensitivity towards FSs, indexed by reduced fronto-posterior theta-band oscillations across semantic- and structural-integration windows. Such oscillatory modulations may represent a key marker of age-of-acquisition effects during foreign-language wordplay processing.
Collapse
Affiliation(s)
- Martina G Vilas
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
| | - Micaela Santilli
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina
| | - Ezequiel Mikulan
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
| | - Federico Adolfi
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
| | - Miguel Martorell Caro
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina
| | - Facundo Manes
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina
| | - Eduar Herrera
- Universidad ICESI, Departamento de Estudios Psicológicos, Cali, Colombia
| | - Lucas Sedeño
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
| | - Agustín Ibáñez
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina; Universidad Autónoma del Caribe, Barranquilla, Colombia; Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez, Santiago de Chile, Chile; Centre of Excellence in Cognition and its Disorders, Australian Research Council (ACR), Sydney, Australia
| | - Adolfo M García
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University, Buenos Aires, Argentina; National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina; Faculty of Education, National University of Cuyo (UNCuyo), Mendoza, Argentina.
| |
Collapse
|
18
|
Schneider JM, Abel AD, Ogiela DA, McCord C, Maguire MJ. Developmental differences in the neural oscillations underlying auditory sentence processing in children and adults. BRAIN AND LANGUAGE 2018; 186:17-25. [PMID: 30199760 DOI: 10.1016/j.bandl.2018.09.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2017] [Revised: 08/21/2018] [Accepted: 09/03/2018] [Indexed: 06/08/2023]
Abstract
Although very young children seem to process ongoing language quickly and effortlessly, neuroimaging and behavioral studies reveal that children continue to mature in their language skills through adolescence. During this prolonged development, children likely engage the same basic cognitive processes and neural mechanisms to perform language tasks as adults, but in somewhat different ways. In this study we used time frequency analysis of EEG to identify developmental differences in the engagement of neural oscillations between children (ages 10-12) and adults while listening to naturally-paced sentences. Adults displayed consistent beta changes throughout the sentence compared to children, thought to be related to efficient syntactic integration, and children displayed more broadly distributed theta changes than adults, thought to be related to more effortful semantic integration. Few differences in alpha, related to verbal working memory, existed between groups. These findings shed new light on developmental changes in the neuronal processes underlying language comprehension.
Collapse
|
19
|
White EJ, Nayman C, Dunkley BT, Keller AE, Valiante TA, Pang EW. Addressing the Language Binding Problem With Dynamic Functional Connectivity During Meaningful Spoken Language Comprehension. Front Psychol 2018; 9:1960. [PMID: 30369900 PMCID: PMC6194231 DOI: 10.3389/fpsyg.2018.01960] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2018] [Accepted: 09/24/2018] [Indexed: 11/18/2022] Open
Abstract
During speech, how does the brain integrate information processed on different timescales and in separate brain areas so we can understand what is said? This is the language binding problem. Dynamic functional connectivity (brief periods of synchronization in the phase of EEG oscillations) may provide some answers. Here we investigate time and frequency characteristics of oscillatory power and phase synchrony (dynamic functional connectivity) during speech comprehension. Twenty adults listened to meaningful English sentences and non-sensical “Jabberwocky” sentences in which pseudo-words replaced all content words, while EEG was recorded. Results showed greater oscillatory power and global connectivity strength (mean phase lag index) in the gamma frequency range (30–80 Hz) for English compared to Jabberwocky. Increased power and connectivity relative to baseline was also seen in the theta frequency range (4–7 Hz), but was similar for English and Jabberwocky. High-frequency gamma oscillations may reflect a mechanism by which the brain transfers and integrates linguistic information so we can extract meaning and understand what is said. Slower frequency theta oscillations may support domain-general processing of the rhythmic features of speech. Our findings suggest that constructing a meaningful representation of speech involves dynamic interactions among distributed brain regions that communicate through frequency-specific functional networks.
Collapse
Affiliation(s)
- Erin J White
- Neurosciences and Mental Health, Sick Kids Research Institute, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Epilespy Research Program of the Ontario Brain Institute, Toronto, ON, Canada
| | - Candace Nayman
- Neurosciences and Mental Health, Sick Kids Research Institute, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada
| | - Benjamin T Dunkley
- Neurosciences and Mental Health, Sick Kids Research Institute, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON, Canada.,Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
| | - Anne E Keller
- Neurosciences and Mental Health, Sick Kids Research Institute, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Epilespy Research Program of the Ontario Brain Institute, Toronto, ON, Canada
| | - Taufik A Valiante
- Epilespy Research Program of the Ontario Brain Institute, Toronto, ON, Canada.,Krembil Research Institute, University Health Network and Toronto Western Hospital, Toronto, ON, Canada.,Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, ON, Canada
| | - Elizabeth W Pang
- Neurosciences and Mental Health, Sick Kids Research Institute, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, Toronto, ON, Canada.,Epilespy Research Program of the Ontario Brain Institute, Toronto, ON, Canada.,Division of Neurology, The Hospital for Sick Children, Toronto, ON, Canada
| |
Collapse
|
20
|
Effectiveness of Neurofeedback on Executive Functions and Tendency Toward High-Risk Behaviors in Adolescents with Attention Deficit Hyperactivity Disorder. INTERNATIONAL JOURNAL OF HIGH RISK BEHAVIORS AND ADDICTION 2018. [DOI: 10.5812/ijhrba.82012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
21
|
Valadez EA, Simons RF. The power of frontal midline theta and post-error slowing to predict performance recovery: Evidence for compensatory mechanisms. Psychophysiology 2017; 55. [DOI: 10.1111/psyp.13010] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2016] [Revised: 08/23/2017] [Accepted: 08/23/2017] [Indexed: 11/28/2022]
Affiliation(s)
- Emilio A. Valadez
- Department of Psychological and Brain Sciences; University of Delaware; Newark Delaware USA
| | - Robert F. Simons
- Department of Psychological and Brain Sciences; University of Delaware; Newark Delaware USA
| |
Collapse
|
22
|
Temporally and spatially distinct theta oscillations dissociate a language-specific from a domain-general processing mechanism across the age trajectory. Sci Rep 2017; 7:11202. [PMID: 28894235 PMCID: PMC5593879 DOI: 10.1038/s41598-017-11632-z] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2017] [Accepted: 08/29/2017] [Indexed: 01/14/2023] Open
Abstract
The cognitive functionality of neural oscillations is still highly debated, as different functions have been associated with identical frequency ranges. Theta band oscillations, for instance, were proposed to underlie both language comprehension and domain-general cognitive abilities. Here we show that the ageing brain can provide an answer to the open question whether it is one and the same theta oscillation underlying those functions, thereby resolving a long-standing paradox. While better cognitive functioning is predicted by low theta power in the brain at rest, resting state (RS) theta power declines with age, but sentence comprehension deteriorates in old age. We resolve this paradox showing that sentence comprehension declines due to changes in RS theta power within domain-general brain networks known to support successful sentence comprehension, while low RS theta power within the left-hemispheric dorso-frontal language network predicts intact sentence comprehension. The two RS theta networks were also found to functionally decouple relative to their independent internal coupling. Thus, both temporally and spatially distinct RS theta oscillations dissociate a language-specific from a domain-general processing mechanism.
Collapse
|
23
|
Bonhage CE, Meyer L, Gruber T, Friederici AD, Mueller JL. Oscillatory EEG dynamics underlying automatic chunking during sentence processing. Neuroimage 2017; 152:647-657. [PMID: 28288909 DOI: 10.1016/j.neuroimage.2017.03.018] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2016] [Revised: 03/02/2017] [Accepted: 03/09/2017] [Indexed: 10/20/2022] Open
Abstract
Sentences are easier to remember than random word sequences, likely because linguistic regularities facilitate chunking of words into meaningful groups. The present electroencephalography study investigated the neural oscillations modulated by this so-called sentence superiority effect during the encoding and maintenance of sentence fragments versus word lists. We hypothesized a chunking-related modulation of neural processing during the encoding and retention of sentences (i.e., sentence fragments) as compared to word lists. Time-frequency analysis revealed a two-fold oscillatory pattern for the memorization of sentences: Sentence encoding was accompanied by higher delta amplitude (4Hz), originating both from regions processing syntax as well as semantics (bilateral superior/middle temporal regions and fusiform gyrus). Subsequent sentence retention was reflected in decreased theta (6Hz) and beta/gamma (27-32Hz) amplitude instead. Notably, whether participants simply read or properly memorized the sentences did not impact chunking-related activity during encoding. Therefore, we argue that the sentence superiority effect is grounded in highly automatized language processing mechanisms, which generate meaningful memory chunks irrespective of task demands.
Collapse
Affiliation(s)
- Corinna E Bonhage
- Max Planck Institute for Human Cognitive and Brain Sciences, Neuropsychology Department, Leipzig, Germany; Max Planck Institute for Empirical Aesthetics, Neuroscience Department, Frankfurt a. M., Germany.
| | - Lars Meyer
- Max Planck Institute for Human Cognitive and Brain Sciences, Neuropsychology Department, Leipzig, Germany
| | - Thomas Gruber
- Institute of Psychology, Osnabrueck University, Osnabrueck, Germany
| | - Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Neuropsychology Department, Leipzig, Germany
| | - Jutta L Mueller
- Max Planck Institute for Human Cognitive and Brain Sciences, Neuropsychology Department, Leipzig, Germany; Institute of Cognitive Science, Osnabrueck University, Osnabrueck, Germany
| |
Collapse
|
24
|
Neural correlates of multimodal metaphor comprehension: Evidence from event-related potentials and time-frequency decompositions. Int J Psychophysiol 2016; 109:81-91. [DOI: 10.1016/j.ijpsycho.2016.09.007] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2016] [Revised: 08/12/2016] [Accepted: 09/09/2016] [Indexed: 11/19/2022]
|
25
|
Gender agreement violations modulate beta oscillatory dynamics during sentence comprehension: A comparison of second language learners and native speakers. Neuropsychologia 2016; 89:254-272. [DOI: 10.1016/j.neuropsychologia.2016.06.031] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2016] [Revised: 06/21/2016] [Accepted: 06/23/2016] [Indexed: 11/21/2022]
|
26
|
Mai G, Minett JW, Wang WSY. Delta, theta, beta, and gamma brain oscillations index levels of auditory sentence processing. Neuroimage 2016; 133:516-528. [DOI: 10.1016/j.neuroimage.2016.02.064] [Citation(s) in RCA: 63] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2015] [Revised: 02/05/2016] [Accepted: 02/21/2016] [Indexed: 11/30/2022] Open
|
27
|
Lam NHL, Schoffelen JM, Uddén J, Hultén A, Hagoort P. Neural activity during sentence processing as reflected in theta, alpha, beta, and gamma oscillations. Neuroimage 2016; 142:43-54. [PMID: 26970187 DOI: 10.1016/j.neuroimage.2016.03.007] [Citation(s) in RCA: 67] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2015] [Revised: 02/04/2016] [Accepted: 03/03/2016] [Indexed: 12/14/2022] Open
Abstract
We used magnetoencephalography (MEG) to explore the spatiotemporal dynamics of neural oscillations associated with sentence processing in 102 participants. We quantified changes in oscillatory power as the sentence unfolded, and in response to individual words in the sentence. For words early in a sentence compared to those late in the same sentence, we observed differences in left temporal and frontal areas, and bilateral frontal and right parietal regions for the theta, alpha, and beta frequency bands. The neural response to words in a sentence differed from the response to words in scrambled sentences in left-lateralized theta, alpha, beta, and gamma. The theta band effects suggest that a sentential context facilitates lexical retrieval, and that this facilitation is stronger for words late in the sentence. Effects in the alpha and beta bands may reflect the unification of semantic and syntactic information, and are suggestive of easier unification late in a sentence. The gamma oscillations are indicative of predicting the upcoming word during sentence processing. In conclusion, changes in oscillatory neuronal activity capture aspects of sentence processing. Our results support earlier claims that language (sentence) processing recruits areas distributed across both hemispheres, and extends beyond the classical language regions.
Collapse
Affiliation(s)
- Nietzsche H L Lam
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Jan-Mathijs Schoffelen
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.
| | - Julia Uddén
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Annika Hultén
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Peter Hagoort
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, Netherlands; Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands.
| |
Collapse
|
28
|
Boudewyn MA, Long DL, Traxler MJ, Lesh TA, Dave S, Mangun GR, Carter CS, Swaab TY. Sensitivity to Referential Ambiguity in Discourse: The Role of Attention, Working Memory, and Verbal Ability. J Cogn Neurosci 2015; 27:2309-23. [PMID: 26401815 PMCID: PMC4794274 DOI: 10.1162/jocn_a_00837] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
The establishment of reference is essential to language comprehension. The goal of this study was to examine listeners' sensitivity to referential ambiguity as a function of individual variation in attention, working memory capacity, and verbal ability. Participants listened to stories in which two entities were introduced that were either very similar (e.g., two oaks) or less similar (e.g., one oak and one elm). The manipulation rendered an anaphor in a subsequent sentence (e.g., oak) ambiguous or unambiguous. EEG was recorded as listeners comprehended the story, after which participants completed tasks to assess working memory, verbal ability, and the ability to use context in task performance. Power in the alpha and theta frequency bands when listeners received critical information about the discourse entities (e.g., oaks) was used to index attention and the involvement of the working memory system in processing the entities. These measures were then used to predict an ERP component that is sensitive to referential ambiguity, the Nref, which was recorded when listeners received the anaphor. Nref amplitude at the anaphor was predicted by alpha power during the earlier critical sentence: Individuals with increased alpha power in ambiguous compared with unambiguous stories were less sensitive to the anaphor's ambiguity. Verbal ability was also predictive of greater sensitivity to referential ambiguity. Finally, increased theta power in the ambiguous compared with unambiguous condition was associated with higher working-memory span. These results highlight the role of attention and working memory in referential processing during listening comprehension.
Collapse
|
29
|
Complex brain network properties in late L2 learners and native speakers. Neuropsychologia 2015; 68:209-17. [PMID: 25598315 DOI: 10.1016/j.neuropsychologia.2015.01.021] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2014] [Revised: 01/12/2015] [Accepted: 01/14/2015] [Indexed: 11/22/2022]
Abstract
Whether the neural mechanisms that underlie the processing of a second language in highly proficient late bilinguals (L2 late learners) are similar or not to those that underlie the processing of the first language (L1) is still an issue under debate. In this study, a group of late learners of Spanish whose native language is English and a group of Spanish monolinguals were compared while they read sentences, some of which contained syntactic violations. A brain complex network analysis approach was used to assess the time-varying topological properties of the functional networks extracted from the electroencephalography (EEG) recording. Late L2 learners showed a lower degree of parallel information transfer and a slower propagation between regions of the brain functional networks while processing sentences containing a gender mismatch condition as compared with a standard sentence configuration. In contrast, no such differences between these conditions were detected in the Spanish monolinguals. This indicates that when a morphosyntactic language incongruence that does not exist in the native language is presented in the second language, the neural activation pattern is configured differently in highly proficient late bilinguals than in monolinguals.
Collapse
|
30
|
Oscillatory correlates of autobiographical memory. Int J Psychophysiol 2014; 95:322-32. [PMID: 25523347 DOI: 10.1016/j.ijpsycho.2014.12.006] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2014] [Revised: 12/06/2014] [Accepted: 12/09/2014] [Indexed: 12/29/2022]
Abstract
Recollection of events from one's own life is referred to as autobiographical memory. Autobiographical memory is an important part of our self. Neuroimaging findings link self-referential processes with the default mode network (DMN). Much evidence coming primarily from functional magnetic resonance imaging studies shows that autobiographical memory and DMN have a common neural base. In this study, electroencephalographic data collected in 47 participants during recollection of autobiographical episodes were analyzed using temporal and spatial independent component analyses in combination with source localization. Autobiographical remembering was associated with an increase of spectral power in alpha and beta and a decrease in delta band. The increase of alpha power, as estimated by sLORETA, was most prominent in the posterior DMN, but was also observed in visual and motor cortices, prompting an assumption that it is associated with activation of DMN and inhibition of irrelevant sensory and motor areas. In line with data linking delta oscillations with aversive states, decrease of delta power was more pronounced in episodes associated with positive emotions, whereas episodes associated with negative emotions were accompanied by an increase of delta power. Vividness of recollection correlated positively with theta oscillations. These results highlight the leading role of alpha oscillations and the DMN in the processes accompanying autobiographical remembering.
Collapse
|
31
|
Brauns I, Teixeira S, Velasques B, Bittencourt J, Machado S, Cagy M, Gongora M, Bastos VH, Machado D, Sandoval-Carrillo A, Salas-Pacheco J, Piedade R, Ribeiro P, Arias-Carrión O. Changes in the theta band coherence during motor task after hand immobilization. Int Arch Med 2014; 7:51. [PMID: 25838843 PMCID: PMC4363202 DOI: 10.1186/1755-7682-7-51] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2014] [Accepted: 12/02/2014] [Indexed: 11/10/2022] Open
Abstract
Many different factors can temporarily or permanently impair movement and impairs cortical organization, e.g. hand immobilization. Such changes have been widely studied using electroencephalography. Within this context, we have investigated the immobilization effects through the theta band coherence analysis, in order to find out whether the immobilization period causes any changes in the inter and intra-hemispheric coherence within the cerebral cortex, as well as to observe whether the theta band provides any information about the neural mechanisms involved during the motor act. We analyzed the cortical changes that occurred after 48 hours of hand immobilization. The theta band coherence was study through electroencephalography in 30 healthy subjects, divided into two groups (control and experimental). Within both groups, the subjects executed a task involving flexion and extension of the index finger, before and after 48 hours. The experimental group, however, was actually submitted to hand immobilization. We were able to observe an increase in the coupling within the experimental group in the frontal, parietal and temporal regions, and a decrease in the motor area. In order to execute manual tasks after some time of movement restriction, greater coherence is present in areas related to attention, movement preparation and sensorimotor integration processes. These results may contribute to a detailed assessment of involved neurophysiological mechanism in motor act execution.
Collapse
Affiliation(s)
- Igor Brauns
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil
| | - Silmar Teixeira
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil ; Unidad de Trastornos del Movimiento y Sueño (TMS), Hospital General Dr. Manuel Gea González/IFC-UNAM, Mexico City, Mexico ; Unidad de Trastornos del Movimiento y Sueño (TMS), Hospital General Ajusco Medio, Secretaria de Salud Mexico City, Mexico
| | - Bruna Velasques
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil ; Institute of Applied Neuroscience (INA), Rio de Janeiro, Brazil ; National Institute of Traumatology and Orthopaedics (INTO), Neuromuscular Research Laboratory, Rio de Janeiro, Brazil
| | - Juliana Bittencourt
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil
| | - Sergio Machado
- Institute of Psychiatry of Federal University of Rio de Janeiro, Panic and Respiration, Rio de Janeiro, Brazil ; National Institute for Translational Medicine (INCT-TM), Rio de Janeiro, Brazil ; Physical Activity Neuroscience, Physical Activity Sciences Postgraduate Program, Salgado de Oliveira University, Niterói, Brazil
| | - Mauricio Cagy
- Biomedical Engineering Program, COPPE, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
| | - Mariana Gongora
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil
| | - Victor Hugo Bastos
- Brain Mapping and Functionality Laboratory, Federal University of Piauí, UFPI, Parnaiba, Brazil ; Brain Mapping and Plasticity Laboratory, Federal University of Piauí, UFPI, Parnaiba, Brazil
| | - Dionis Machado
- Brain Mapping and Functionality Laboratory, Federal University of Piauí, UFPI, Parnaiba, Brazil ; Brain Mapping and Plasticity Laboratory, Federal University of Piauí, UFPI, Parnaiba, Brazil
| | - Ada Sandoval-Carrillo
- Instituto de Investigación Científica, Universidad Juárez del Estado de Durango, Durango, Durango, México
| | - Jose Salas-Pacheco
- Instituto de Investigación Científica, Universidad Juárez del Estado de Durango, Durango, Durango, México
| | - Roberto Piedade
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil
| | - Pedro Ribeiro
- Brain Mapping and Sensory Motor Integration, Institute of Psychiatry of Federal University of Rio de Janeiro (IPUB/UFRJ), Rio de Janeiro, Brazil ; School of Physical Education, Bioscience Department (EEFD/UFRJ), Rio de Janeiro, Brazil ; Institute of Applied Neuroscience (INA), Rio de Janeiro, Brazil
| | - Oscar Arias-Carrión
- Unidad de Trastornos del Movimiento y Sueño (TMS), Hospital General Dr. Manuel Gea González/IFC-UNAM, Mexico City, Mexico ; Unidad de Trastornos del Movimiento y Sueño (TMS), Hospital General Ajusco Medio, Secretaria de Salud Mexico City, Mexico
| |
Collapse
|
32
|
Bai W, Yi H, Liu T, Wei J, Tian X. Incoordination between spikes and LFPs in Aβ1-42-mediated memory deficits in rats. Front Behav Neurosci 2014; 8:411. [PMID: 25505877 PMCID: PMC4245911 DOI: 10.3389/fnbeh.2014.00411] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2014] [Accepted: 11/12/2014] [Indexed: 01/23/2023] Open
Abstract
Alzheimer's disease (AD) is a neurodegenerative disease that gradually induces cognitive deficits. Impairments of working memory have been typically observed in AD. It is well known that spikes and local field potentials (LFPs) as well as the coordination between them encode information in normal brain function. However, the abnormal coordination between spikes and LFPs in the cognitive deficits of AD has remained largely unexplored. As amyloid-β peptide (Aβ) is a causative factor for the cognitive impairments of AD, developing a mechanistic understanding of the contribution of Aβ to cognitive impairments may yield important insights into the pathophysiology of AD. In the present study, we simultaneously recorded spikes and LFPs from multiple electrodes implanted in the prefrontal cortex of rats (control and intra-hippocampal Aβ injection group) that performed a Y-maze working memory task. The information changes in spikes and LFPs during the task were assessed by calculation of entropy. Then the coordination between spikes and LFPs was estimated by the correlation of LFP entropy and spike entropy. Compared with the control group, the Aβ group showed significantly weaker coordination between spikes and LFPs. Our results indicate that the incoordination between spikes and LFPs may provide a potential mechanism for the cognitive deficits in working memory of AD.
Collapse
Affiliation(s)
- Wenwen Bai
- Department of Biomedical Engineering, School of Biomedical Engineering and Technology, Tianjin Medical University Tianjin, China
| | - Hu Yi
- Department of Biomedical Engineering, School of Biomedical Engineering and Technology, Tianjin Medical University Tianjin, China
| | - Tiaotiao Liu
- Department of Biomedical Engineering, School of Biomedical Engineering and Technology, Tianjin Medical University Tianjin, China
| | - Jing Wei
- Department of Biomedical Engineering, School of Biomedical Engineering and Technology, Tianjin Medical University Tianjin, China
| | - Xin Tian
- Department of Biomedical Engineering, School of Biomedical Engineering and Technology, Tianjin Medical University Tianjin, China
| |
Collapse
|
33
|
Kielar A, Panamsky L, Links KA, Meltzer JA. Localization of electrophysiological responses to semantic and syntactic anomalies in language comprehension with MEG. Neuroimage 2014; 105:507-24. [PMID: 25463470 DOI: 10.1016/j.neuroimage.2014.11.016] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2014] [Revised: 10/02/2014] [Accepted: 11/07/2014] [Indexed: 10/24/2022] Open
Abstract
Syntactically and semantically anomalous words encountered during sentence comprehension are known to elicit dissociable electrophysiological responses, which are thought to reflect distinct aspects of language processing. However, the sources of these responses have not been well characterized. We used beamforming analysis of magnetoencephalography (MEG) data to map generators of electrophysiological responses to linguistic anomalies. Anomalous words occurred in the context of a sentence acceptability judgement task conducted in both visual and auditory modalities. Time-frequency analysis revealed that both kinds of violations elicited event-related synchronization (ERS) in the delta-theta frequency range (1-5 Hz), and desynchronization (ERD) in the alpha-beta range (8-30 Hz). In addition, these responses were differentially modulated by violation type and presentation modality. 1-5 Hz responses were consistently localized within medial prefrontal cortex and did not vary significantly across violation types, but were stronger for visual presentation. In contrast, 8-30 Hz ERD occurred in different regions for different violation types. For semantic violations the distribution was predominantly in the bilateral occipital cortex and left temporal and inferior frontal regions, and these effects did not differ for visual and auditory presentation. In contrast, syntactic responses were strongly affected by presentation modality. Under visual presentation, syntactic violations elicited bilateral 8-30 Hz ERD extending into dorsal parietal and frontal regions, whereas effects were much weaker and mostly statistically insignificant in the auditory modality. These results suggest that delta-theta ERS reflects generalized increases in working memory demands related to linguistic anomaly detection, while alpha-beta ERD reflects specific activation of cortical regions involved in distinct aspects of linguistic processing, such as semantic vs. phonological short-term memory. Beamforming analysis of time-domain average signals (ERFs) revealed an N400m effect for semantic anomalies in both modalities, localized to left superior temporal and posterior frontal regions, and a later P600-like effect for syntactic anomalies in both modalities, widespread over bilateral frontal, posterior temporal, and parietal regions. These results indicate that time-domain averaged responses and induced oscillatory responses have distinct properties, including localization and modality dependence, and likely reflect dissociable and complementary aspects of neural activity related to language comprehension and additional task-related processes.
Collapse
Affiliation(s)
- Aneta Kielar
- Rotman Research Institute, Toronto, Ontario, Canada; Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Lilia Panamsky
- Rotman Research Institute, Toronto, Ontario, Canada; Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Kira A Links
- Rotman Research Institute, Toronto, Ontario, Canada; Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Jed A Meltzer
- Rotman Research Institute, Toronto, Ontario, Canada; Department of Psychology, University of Toronto, Toronto, Ontario, Canada.
| |
Collapse
|
34
|
Bögels S, Barr DJ, Garrod S, Kessler K. Conversational Interaction in the Scanner: Mentalizing during Language Processing as Revealed by MEG. Cereb Cortex 2014; 25:3219-34. [PMID: 24904076 PMCID: PMC4537451 DOI: 10.1093/cercor/bhu116] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Humans are especially good at taking another's perspective-representing what others might be thinking or experiencing. This "mentalizing" capacity is apparent in everyday human interactions and conversations. We investigated its neural basis using magnetoencephalography. We focused on whether mentalizing was engaged spontaneously and routinely to understand an utterance's meaning or largely on-demand, to restore "common ground" when expectations were violated. Participants conversed with 1 of 2 confederate speakers and established tacit agreements about objects' names. In a subsequent "test" phase, some of these agreements were violated by either the same or a different speaker. Our analysis of the neural processing of test phase utterances revealed recruitment of neural circuits associated with language (temporal cortex), episodic memory (e.g., medial temporal lobe), and mentalizing (temporo-parietal junction and ventromedial prefrontal cortex). Theta oscillations (3-7 Hz) were modulated most prominently, and we observed phase coupling between functionally distinct neural circuits. The episodic memory and language circuits were recruited in anticipation of upcoming referring expressions, suggesting that context-sensitive predictions were spontaneously generated. In contrast, the mentalizing areas were recruited on-demand, as a means for detecting and resolving perceived pragmatic anomalies, with little evidence they were activated to make partner-specific predictions about upcoming linguistic utterances.
Collapse
Affiliation(s)
- Sara Bögels
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Dale J Barr
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Simon Garrod
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Klaus Kessler
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK Aston Brain Centre, Aston University, Birmingham, UK
| |
Collapse
|
35
|
Kielar A, Meltzer JA, Moreno S, Alain C, Bialystok E. Oscillatory responses to semantic and syntactic violations. J Cogn Neurosci 2014; 26:2840-62. [PMID: 24893735 DOI: 10.1162/jocn_a_00670] [Citation(s) in RCA: 51] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
EEG studies employing time-frequency analysis have revealed changes in theta and alpha power in a variety of language and memory tasks. Semantic and syntactic violations embedded in sentences evoke well-known ERPs, but little is known about the oscillatory responses to these violations. We investigated oscillatory responses to both kinds of violations, while monolingual and bilingual participants performed an acceptability judgment task. Both violations elicited power decreases (event-related desynchronization, ERD) in the 8-30 Hz frequency range, but with different scalp topographies. In addition, semantic anomalies elicited power increases (event-related synchronization, ERS) in the 1-5 Hz frequency band. The 1-5 Hz ERS was strongly phase-locked to stimulus onset and highly correlated with time domain averages, whereas the 8-30 Hz ERD response varied independently of these. In addition, the results showed that language expertise modulated 8-30 Hz ERD for syntactic violations as a function of the executive demands of the task. When the executive function demands were increased using a grammaticality judgment task, bilinguals but not monolinguals demonstrated reduced 8-30 Hz ERD for syntactic violations. These findings suggest a putative role of the 8-30 Hz ERD response as a marker of linguistic processing that likely represents a separate neural process from those underlying ERPs.
Collapse
Affiliation(s)
- Aneta Kielar
- Rotman Research Institute, Toronto, Ontario, Canada
| | | | | | | | | |
Collapse
|
36
|
Regel S, Meyer L, Gunter TC. Distinguishing neurocognitive processes reflected by P600 effects: evidence from ERPs and neural oscillations. PLoS One 2014; 9:e96840. [PMID: 24844290 PMCID: PMC4028180 DOI: 10.1371/journal.pone.0096840] [Citation(s) in RCA: 53] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2013] [Accepted: 04/13/2014] [Indexed: 11/19/2022] Open
Abstract
Research on language comprehension using event-related potentials (ERPs) reported distinct ERP components reliably related to the processing of semantic (N400) and syntactic information (P600). Recent ERP studies have challenged this well-defined distinction by showing P600 effects for semantic and pragmatic anomalies. So far, it is still unresolved whether the P600 reflects specific or rather common processes. The present study addresses this question by investigating ERPs in response to a syntactic and pragmatic (irony) manipulation, as well as a combined syntactic and pragmatic manipulation. For the syntactic condition, a morphosyntactic violation was applied, whereas for the pragmatic condition, such as “That is rich”, either an ironic or literal interpretation was achieved, depending on the prior context. The ERPs at the critical word showed a LAN-P600 pattern for syntactically incorrect sentences relative to correct ones. For ironic compared to literal sentences, ERPs showed a P200 effect followed by a P600 component. In comparison of the syntax-related P600 to the irony-related P600, distributional differences were found. Moreover, for the P600 time window (i.e., 500–900 ms), different changes in theta power between the syntax and pragmatics effects were found, suggesting that different patterns of neural activity contributed to each respective effect. Thus, both late positivities seem to be differently sensitive to these two types of linguistic information, and might reflect distinct neurocognitive processes, such as reanalysis of the sentence structure versus pragmatic reanalysis.
Collapse
Affiliation(s)
- Stefanie Regel
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Saxony, Germany
- * E-mail:
| | - Lars Meyer
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Saxony, Germany
| | - Thomas C. Gunter
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Saxony, Germany
| |
Collapse
|
37
|
Molinaro N, Barber HA, Pérez A, Parkkonen L, Carreiras M. Left fronto-temporal dynamics during agreement processing: Evidence for feature-specific computations. Neuroimage 2013; 78:339-52. [DOI: 10.1016/j.neuroimage.2013.04.025] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2013] [Revised: 03/18/2013] [Accepted: 04/10/2013] [Indexed: 11/28/2022] Open
|
38
|
Kretzschmar F, Pleimling D, Hosemann J, Füssel S, Bornkessel-Schlesewsky I, Schlesewsky M. Subjective impressions do not mirror online reading effort: concurrent EEG-eyetracking evidence from the reading of books and digital media. PLoS One 2013; 8:e56178. [PMID: 23405265 PMCID: PMC3566074 DOI: 10.1371/journal.pone.0056178] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2012] [Accepted: 01/09/2013] [Indexed: 11/30/2022] Open
Abstract
In the rapidly changing circumstances of our increasingly digital world, reading is also becoming an increasingly digital experience: electronic books (e-books) are now outselling print books in the United States and the United Kingdom. Nevertheless, many readers still view e-books as less readable than print books. The present study thus used combined EEG and eyetracking measures in order to test whether reading from digital media requires higher cognitive effort than reading conventional books. Young and elderly adults read short texts on three different reading devices: a paper page, an e-reader and a tablet computer and answered comprehension questions about them while their eye movements and EEG were recorded. The results of a debriefing questionnaire replicated previous findings in that participants overwhelmingly chose the paper page over the two electronic devices as their preferred reading medium. Online measures, by contrast, showed shorter mean fixation durations and lower EEG theta band voltage density – known to covary with memory encoding and retrieval – for the older adults when reading from a tablet computer in comparison to the other two devices. Young adults showed comparable fixation durations and theta activity for all three devices. Comprehension accuracy did not differ across the three media for either group. We argue that these results can be explained in terms of the better text discriminability (higher contrast) produced by the backlit display of the tablet computer. Contrast sensitivity decreases with age and degraded contrast conditions lead to longer reading times, thus supporting the conclusion that older readers may benefit particularly from the enhanced contrast of the tablet. Our findings thus indicate that people's subjective evaluation of digital reading media must be dissociated from the cognitive and neural effort expended in online information processing while reading from such devices.
Collapse
Affiliation(s)
- Franziska Kretzschmar
- Department of English and Linguistics, Johannes Gutenberg-University, Mainz, Germany
| | | | | | | | | | | |
Collapse
|
39
|
Steele VR, Bernat EM, van den Broek P, Collins PF, Patrick CJ, Marsolek CJ. Separable processes before, during, and after the N400 elicited by previously inferred and new information: evidence from time-frequency decompositions. Brain Res 2013; 1492:92-107. [PMID: 23165117 PMCID: PMC3534777 DOI: 10.1016/j.brainres.2012.11.016] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2012] [Revised: 10/18/2012] [Accepted: 11/11/2012] [Indexed: 10/27/2022]
Abstract
Successful comprehension during reading often requires inferring information not explicitly presented. This information is readily accessible when subsequently encountered, and a neural correlate of this is an attenuation of the N400 event-related potential (ERP). We used ERPs and time-frequency (TF) analysis to investigate neural correlates of processing inferred information after a causal coherence inference had been generated during text comprehension. Participants read short texts, some of which promoted inference generation. After each text, they performed lexical decisions to target words that were unrelated or inference-related to the preceding text. Consistent with previous findings, inference-related words elicited an attenuated N400 relative to unrelated words. TF analyses revealed unique contributions to the N400 from activity occurring at 1-6 Hz (theta) and 0-2 Hz (delta), supporting the view that multiple, sequential processes underlie the N400.
Collapse
Affiliation(s)
- Vaughn R Steele
- The Mind Research Network, Albuquerque, NM 87106, United States; Lovelace Biomedical and Environmental Research Institute, Albuquerque, NM 87108, United States.
| | | | | | | | | | | |
Collapse
|
40
|
Weber P, Kozel N, Purgstaller C, Kargl R, Schwab D, Fink A. First and second language in the brain: neuronal correlates of language processing and spelling strategies. BRAIN AND LANGUAGE 2013; 124:22-33. [PMID: 23274421 DOI: 10.1016/j.bandl.2012.11.010] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2011] [Revised: 11/09/2012] [Accepted: 11/13/2012] [Indexed: 06/01/2023]
Abstract
This study explores oscillatory brain activity by means of event-related synchronization and desynchronization (%ERS/ERD) of EEG activity during the use of phonological and orthographic-morphological spelling strategies in L2 (English) and L1 (German) in native German speaking children. EEG was recorded while 33 children worked on a task requiring either phonological or orthographic-morphological spelling strategies. L2 processing elicited more theta %ERS than L1 processing (particularly at bilateral frontal and right posterior parietal sites) which might suggest a stronger involvement of semantic encoding and retrieval of the less familiar L2. The highest level of theta %ERS was revealed for the orthographic-morphological strategy in L2 which might indicate a more intense way of lexical retrieval compared to the phonological strategy in L2 and the orthographic-morphological strategy in L1. Analyses moreover revealed that phonological processing (both in L1 and L2) was associated with comparatively strong left-hemispheric %ERD in the upper alpha frequency band.
Collapse
|
41
|
Brown SR. Emergence in the central nervous system. Cogn Neurodyn 2012; 7:173-95. [PMID: 24427200 DOI: 10.1007/s11571-012-9229-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2012] [Revised: 10/04/2012] [Accepted: 11/20/2012] [Indexed: 11/30/2022] Open
Abstract
"Emergence" is an idea that has received much attention in consciousness literature, but it is difficult to find characterizations of that concept which are both specific and useful. I will precisely define and characterize a type of epistemic ("weak") emergence and show that it is a property of some neural circuits throughout the CNS, on micro-, meso- and macroscopic levels. I will argue that possession of this property can result in profoundly altered neural dynamics on multiple levels in cortex and other systems. I will first describe emergent neural entities (ENEs) abstractly. I will then show how ENEs function specifically and concretely, and demonstrate some implications of this type of emergence for the CNS.
Collapse
Affiliation(s)
- Steven Ravett Brown
- Department of Neuroscience, Mt. Sinai School of Medicine, Icahn Medical Institute, 1425 Madison Ave, Rm 10-70E, New York, NY 10029 USA ; 158 W 23rd St, Fl 3, New York, NY 10011 USA
| |
Collapse
|
42
|
Pérez A, Molinaro N, Mancini S, Barraza P, Carreiras M. Oscillatory dynamics related to the Unagreement pattern in Spanish. Neuropsychologia 2012; 50:2584-97. [DOI: 10.1016/j.neuropsychologia.2012.07.009] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2011] [Revised: 06/02/2012] [Accepted: 07/10/2012] [Indexed: 10/28/2022]
|
43
|
Wang L, Zhu Z, Bastiaansen M. Integration or predictability? A further specification of the functional role of gamma oscillations in language comprehension. Front Psychol 2012; 3:187. [PMID: 22701443 PMCID: PMC3372880 DOI: 10.3389/fpsyg.2012.00187] [Citation(s) in RCA: 66] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2011] [Accepted: 05/22/2012] [Indexed: 11/13/2022] Open
Abstract
Gamma-band neuronal synchronization during sentence-level language comprehension has previously been linked with semantic unification. Here, we attempt to further narrow down the functional significance of gamma during language comprehension, by distinguishing between two aspects of semantic unification: successful integration of word meaning into the sentence context, and prediction of upcoming words. We computed event-related potentials (ERPs) and frequency band-specific electroencephalographic (EEG) power changes while participants read sentences that contained a critical word (CW) that was (1) both semantically congruent and predictable (high cloze, HC), (2) semantically congruent but unpredictable (low cloze, LC), or (3) semantically incongruent (and therefore also unpredictable; semantic violation, SV). The ERP analysis showed the expected parametric N400 modulation (HC < LC < SV). The time-frequency analysis showed qualitatively different results. In the gamma-frequency range, we observed a power increase in response to the CW in the HC condition, but not in the LC and the SV conditions. Additionally, in the theta frequency range we observed a power increase in the SV condition only. Our data provide evidence that gamma power increases are related to the predictability of an upcoming word based on the preceding sentence context, rather than to the integration of the incoming word's semantics into the preceding context. Further, our theta band data are compatible with the notion that theta band synchronization in sentence comprehension might be related to the detection of an error in the language input.
Collapse
Affiliation(s)
- Lin Wang
- Max Planck Institute for Psycholinguistics Nijmegen, Netherlands
| | | | | |
Collapse
|
44
|
Abstract
Abstract
Spoken sentence comprehension relies on rapid and effortless temporal integration of speech units displayed at different rates. Temporal integration refers to how chunks of information perceived at different time scales are linked together by the listener in mapping speech sounds onto meaning. The neural implementation of this integration remains unclear. This study explores the role of short and long windows of integration in accessing meaning from long samples of speech. In a cross-linguistic study, we explore the time course of oscillatory brain activity between 1 and 100 Hz, recorded using EEG, during the processing of native and foreign languages. We compare oscillatory responses in a group of Italian and Spanish native speakers while they attentively listen to Italian, Japanese, and Spanish utterances, played either forward or backward. The results show that both groups of participants display a significant increase in gamma band power (55–75 Hz) only when they listen to their native language played forward. The increase in gamma power starts around 1000 msec after the onset of the utterance and decreases by its end, resembling the time course of access to meaning during speech perception. In contrast, changes in low-frequency power show similar patterns for both native and foreign languages. We propose that gamma band power reflects a temporal binding phenomenon concerning the coordination of neural assemblies involved in accessing meaning of long samples of speech.
Collapse
Affiliation(s)
- Marcela Peña
- 1Scuola Internazionale Superiore di Studi Avanzati, Trieste, Italy
- 2Pontificia Universidad Católica de Chile
| | - Lucia Melloni
- 2Pontificia Universidad Católica de Chile
- 3Max Planck Institute for Brain Research, Frankfurt am Main, Germany
| |
Collapse
|
45
|
Interaction between long-term potentiation and depression in CA1 synapses: temporal constrains, functional compartmentalization and protein synthesis. PLoS One 2012; 7:e29865. [PMID: 22272255 PMCID: PMC3260185 DOI: 10.1371/journal.pone.0029865] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2011] [Accepted: 12/05/2011] [Indexed: 12/17/2022] Open
Abstract
Information arriving at a neuron via anatomically defined pathways undergoes spatial and temporal encoding. A proposed mechanism by which temporally and spatially segregated information is encoded at the cellular level is based on the interactive properties of synapses located within and across functional dendritic compartments. We examined cooperative and interfering interactions between long-term synaptic potentiation (LTP) and depression (LTD), two forms of synaptic plasticity thought to be key in the encoding of information in the brain. Two approaches were used in CA1 pyramidal neurons of the mouse hippocampus: (1) induction of LTP and LTD in two separate synaptic pathways within the same apical dendritic compartment and across the basal and apical dendritic compartments; (2) induction of LTP and LTD separated by various time intervals (0–90 min). Expression of LTP/LTD interactions was spatially and temporally regulated. While they were largely restricted within the same dendritic compartment (compartmentalized), the nature of the interaction (cooperation or interference) depended on the time interval between inductions. New protein synthesis was found to regulate the expression of the LTP/LTD interference. We speculate that mechanisms for compartmentalization and protein synthesis confer the spatial and temporal modulation by which neurons encode multiplex information in plastic synapses.
Collapse
|
46
|
Abstract
Older individuals often find it hard to communicate under difficult listening conditions, for example, in the presence of background noise or competing speakers. However, there is increasing evidence that this age-related decline in speech perception can be – at least in part – compensated by an increased recruitment of more general cognitive functions. The interplay of age-related declines and compensatory mechanisms in spoken language understanding under naturalistic and demanding listening conditions was tested here in a word detection task. Pairs of different coherent stories were presented dichotically to 14 younger and 14 older listeners (age ranges 19–25 and 54–64 years, respectively). The listeners had to respond to target words in one story, while suppressing distracting information in the other. In addition, the listeners had to pay attention to the content of the attended story. Older listeners outperformed the younger listeners in target detection and produced less missing responses. However, high performance in target detection came along with low performance in text recall. The analyses of event-related potentials indicated a reduction in parietal P3b of older, relative to younger, listeners. In turn, older listeners showed a prominent frontal P3a that was absent in younger listeners. In line with the so-called decline-compensation hypothesis, these results support the idea that, in order to perform well, older listeners compensate a potential decline by extra allocation of mental resources. One potential mechanism of compensation could be a selective attentional orientation to the target stimuli.
Collapse
Affiliation(s)
- Stephan Getzmann
- Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| |
Collapse
|
47
|
Carrus E, Koelsch S, Bhattacharya J. Shadows of music-language interaction on low frequency brain oscillatory patterns. BRAIN AND LANGUAGE 2011; 119:50-57. [PMID: 21683995 DOI: 10.1016/j.bandl.2011.05.009] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2010] [Revised: 05/15/2011] [Accepted: 05/23/2011] [Indexed: 05/30/2023]
Abstract
Electrophysiological studies investigating similarities between music and language perception have relied exclusively on the signal averaging technique, which does not adequately represent oscillatory aspects of electrical brain activity that are relevant for higher cognition. The current study investigated the patterns of brain oscillations during simultaneous processing of music and language using visually presented sentences and auditorily presented chord sequences. Music-syntactically regular or irregular chord functions were presented in sync with syntactically or semantically correct or incorrect words. Irregular chord functions (presented simultaneously with a syntactically correct word) produced an early (150-250 ms) spectral power decrease over anterior frontal regions in the theta band (5-7 Hz) and a late (350-700 ms) power increase in both the delta and the theta band (2-7 Hz) over parietal regions. Syntactically incorrect words (presented simultaneously with a regular chord) elicited a similar late power increase in delta-theta band over parietal sites, but no early effect. Interestingly, the late effect was significantly diminished when the language-syntactic and music-syntactic irregularities occurred at the same time. Further, the presence of a semantic violation occurring simultaneously with regular chords produced a significant increase in later delta-theta power at posterior regions; this effect was marginally decreased when the identical semantic violation occurred simultaneously with a music syntactical violation. Altogether, these results show that low frequency oscillatory networks get activated during the syntactic processing of both music and language, and further, these networks may possibly be shared.
Collapse
Affiliation(s)
- Elisa Carrus
- Department of Psychology, Goldsmiths, University of London, London, UK.
| | | | | |
Collapse
|
48
|
de Diego-Balaguer R, Fuentemilla L, Rodriguez-Fornells A. Brain dynamics sustaining rapid rule extraction from speech. J Cogn Neurosci 2011; 23:3105-20. [PMID: 21268670 DOI: 10.1162/jocn.2011.21636] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Language acquisition is a complex process that requires the synergic involvement of different cognitive functions, which include extracting and storing the words of the language and their embedded rules for progressive acquisition of grammatical information. As has been shown in other fields that study learning processes, synchronization mechanisms between neuronal assemblies might have a key role during language learning. In particular, studying these dynamics may help uncover whether different oscillatory patterns sustain more item-based learning of words and rule-based learning from speech input. Therefore, we tracked the modulation of oscillatory neural activity during the initial exposure to an artificial language, which contained embedded rules. We analyzed both spectral power variations, as a measure of local neuronal ensemble synchronization, as well as phase coherence patterns, as an index of the long-range coordination of these local groups of neurons. Synchronized activity in the gamma band (20-40 Hz), previously reported to be related to the engagement of selective attention, showed a clear dissociation of local power and phase coherence between distant regions. In this frequency range, local synchrony characterized the subjects who were focused on word identification and was accompanied by increased coherence in the theta band (4-8 Hz). Only those subjects who were able to learn the embedded rules showed increased gamma band phase coherence between frontal, temporal, and parietal regions.
Collapse
|
49
|
Abstract
A widely discussed hypothesis in neuroscience is that transiently active ensembles of neurons, known as "cell assemblies," underlie numerous operations of the brain, from encoding memories to reasoning. However, the mechanisms responsible for the formation and disbanding of cell assemblies and temporal evolution of cell assembly sequences are not well understood. I introduce and review three interconnected topics, which could facilitate progress in defining cell assemblies, identifying their neuronal organization, and revealing causal relationships between assembly organization and behavior. First, I hypothesize that cell assemblies are best understood in light of their output product, as detected by "reader-actuator" mechanisms. Second, I suggest that the hierarchical organization of cell assemblies may be regarded as a neural syntax. Third, constituents of the neural syntax are linked together by dynamically changing constellations of synaptic weights ("synapsembles"). The existing support for this tripartite framework is reviewed and strategies for experimental testing of its predictions are discussed.
Collapse
Affiliation(s)
- György Buzsáki
- Center for Molecular and Behavioral Neuroscience, Rutgers, The State University of New Jersey, 197 University Avenue, Newark, NJ 07102, USA.
| |
Collapse
|
50
|
Bastiaansen M, Magyari L, Hagoort P. Syntactic unification operations are reflected in oscillatory dynamics during on-line sentence comprehension. J Cogn Neurosci 2010; 22:1333-47. [PMID: 19580386 DOI: 10.1162/jocn.2009.21283] [Citation(s) in RCA: 118] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
There is growing evidence suggesting that synchronization changes in the oscillatory neuronal dynamics in the EEG or MEG reflect the transient coupling and uncoupling of functional networks related to different aspects of language comprehension. In this work, we examine how sentence-level syntactic unification operations are reflected in the oscillatory dynamics of the MEG. Participants read sentences that were either correct, contained a word category violation, or were constituted of random word sequences devoid of syntactic structure. A time-frequency analysis of MEG power changes revealed three types of effects. The first type of effect was related to the detection of a (word category) violation in a syntactically structured sentence, and was found in the alpha and gamma frequency bands. A second type of effect was maximally sensitive to the syntactic manipulations: A linear increase in beta power across the sentence was present for correct sentences, was disrupted upon the occurrence of a word category violation, and was absent in syntactically unstructured random word sequences. We therefore relate this effect to syntactic unification operations. Thirdly, we observed a linear increase in theta power across the sentence for all syntactically structured sentences. The effects are tentatively related to the building of a working memory trace of the linguistic input. In conclusion, the data seem to suggest that syntactic unification is reflected by neuronal synchronization in the lower-beta frequency band.
Collapse
|