1
|
Alekseeva M, Myachykov A, Bermudez-Margaretto B, Shtyrov Y. Morphosyntactic prediction in automatic neural processing of spoken language: EEG evidence. Brain Res 2024; 1836:148949. [PMID: 38641266 DOI: 10.1016/j.brainres.2024.148949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2023] [Revised: 03/29/2024] [Accepted: 04/16/2024] [Indexed: 04/21/2024]
Abstract
Automatic parsing of syntactic information by the human brain is a well-established phenomenon, but its mechanisms remain poorly understood. Its best-known neurophysiological reflection is the so-called early left-anterior negativity (ELAN) component of event-related potentials (ERPs), with two alternative hypotheses for its origin: (1) error detection, or (2) morphosyntactic prediction/priming. To test these alternatives, we conducted two experiments using a non-attend passive design with visual distraction and recorded ERPs to spoken pronoun-verb phrases with/without agreement violations and to the same critical verbs presented in isolation without preceding pronouns. The results revealed an ELAN at ∼130-220 ms for pronoun-verb gender agreement violations, confirming a high degree of automaticity in early morphosyntactic parsing. Critically, the strongest ELAN was elicited by verbs outside phrasal context, which suggests that the typical ELAN pattern is underpinned by a reduction of ERP amplitudes for felicitous combinations, reflecting syntactic priming/predictability between related words/morphemes (potentially mediated by associative links formed during previous linguistic experience) rather than specialised error-detection processes.
Collapse
Affiliation(s)
- Maria Alekseeva
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, Higher School of Economics, Moscow, Russian Federation.
| | | | - Beatriz Bermudez-Margaretto
- Instituto de Integración en la Comunidad (INICO), Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark
| |
Collapse
|
2
|
Bezsudnova Y, Quinn AJ, Wynn SC, Jensen O. Spatiotemporal Properties of Common Semantic Categories for Words and Pictures. J Cogn Neurosci 2024; 36:1760-1769. [PMID: 38739567 DOI: 10.1162/jocn_a_02182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
The timing of semantic processing during object recognition in the brain is a topic of ongoing discussion. One way of addressing this question is by applying multivariate pattern analysis to human electrophysiological responses to object images of different semantic categories. However, although multivariate pattern analysis can reveal whether neuronal activity patterns are distinct for different stimulus categories, concerns remain on whether low-level visual features also contribute to the classification results. To circumvent this issue, we applied a cross-decoding approach to magnetoencephalography data from stimuli from two different modalities: images and their corresponding written words. We employed items from three categories and presented them in a randomized order. We show that if the classifier is trained on words, pictures are classified between 150 and 430 msec after stimulus onset, and when training on pictures, words are classified between 225 and 430 msec. The topographical map, identified using a searchlight approach for cross-modal activation in both directions, showed left lateralization, confirming the involvement of linguistic representations. These results point to semantic activation of pictorial stimuli occurring at ∼150 msec, whereas for words, the semantic activation occurs at ∼230 msec.
Collapse
Affiliation(s)
| | | | - Syanah C Wynn
- University of Birmingham
- Gutenberg University Medical Center Mainz
| | | |
Collapse
|
3
|
Schroën JAM, Gunter TC, Numssen O, Kroczek LOH, Hartwigsen G, Friederici AD. Causal evidence for a coordinated temporal interplay within the language network. Proc Natl Acad Sci U S A 2023; 120:e2306279120. [PMID: 37963247 PMCID: PMC10666120 DOI: 10.1073/pnas.2306279120] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 10/06/2023] [Indexed: 11/16/2023] Open
Abstract
Recent neurobiological models on language suggest that auditory sentence comprehension is supported by a coordinated temporal interplay within a left-dominant brain network, including the posterior inferior frontal gyrus (pIFG), posterior superior temporal gyrus and sulcus (pSTG/STS), and angular gyrus (AG). Here, we probed the timing and causal relevance of the interplay between these regions by means of concurrent transcranial magnetic stimulation and electroencephalography (TMS-EEG). Our TMS-EEG experiments reveal region- and time-specific causal evidence for a bidirectional information flow from left pSTG/STS to left pIFG and back during auditory sentence processing. Adapting a condition-and-perturb approach, our findings further suggest that the left pSTG/STS can be supported by the left AG in a state-dependent manner.
Collapse
Affiliation(s)
- Joëlle A. M. Schroën
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Thomas C. Gunter
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Ole Numssen
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Leon O. H. Kroczek
- Department of Psychology, Clinical Psychology and Psychotherapy, Universität Regensburg, Regensburg93053, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
- Cognitive and Biological Psychology, Wilhelm Wundt Institute for Psychology, Leipzig04109, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| |
Collapse
|
4
|
Jensen M, Hyder R, Westner BU, Højlund A, Shtyrov Y. Speech comprehension across time, space, frequency, and age: MEG-MVPA classification of intertrial phase coherence. Neuropsychologia 2023; 188:108602. [PMID: 37270028 DOI: 10.1016/j.neuropsychologia.2023.108602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Revised: 04/24/2023] [Accepted: 05/31/2023] [Indexed: 06/05/2023]
Abstract
Language is a key part of human cognition, essential for our well-being at all stages of our lives. Whereas many neurocognitive abilities decline with age, for language the picture is much less clear, and how exactly speech comprehension changes with ageing is still unknown. To investigate this, we employed magnetoencephalography (MEG) and recorded neuromagnetic brain responses to auditory linguistic stimuli in healthy participants of younger and older age using a passive task-free paradigm and a range of different linguistic stimulus contrasts, which enabled us to assess neural processing of spoken language at multiple levels (lexical, semantic, morphosyntactic). Using machine learning-based classification algorithms to scrutinise intertrial phase coherence of MEG responses in cortical source space, we found that patterns of oscillatory neural activity diverged between younger and older participants across several frequency bands (alpha, beta, gamma) for all tested linguistic information types. The results suggest multiple age-related changes in the brain's neurolinguistic circuits, which may be due to both healthy ageing in general and compensatory processes in particular.
Collapse
Affiliation(s)
- Mads Jensen
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; Research Unit for Robophilosophy and Integrative Social Robotics, School of Culture and Society, Aarhus University, Aarhus, Denmark; Interacting Minds Centre, School of Culture and Society, Aarhus University, Aarhus, Denmark.
| | - Rasha Hyder
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - Britta U Westner
- Radboud University, Donders Centre for Cognition, Nijmegen, the Netherlands
| | - Andreas Højlund
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark; Department of Linguistics, Cognitive Science and Semiotics, School of Communication and Culture, Aarhus University, Aarhus, Denmark
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark.
| |
Collapse
|
5
|
Dirani J, Pylkkänen L. The time course of cross-modal representations of conceptual categories. Neuroimage 2023; 277:120254. [PMID: 37391047 DOI: 10.1016/j.neuroimage.2023.120254] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 05/29/2023] [Accepted: 06/27/2023] [Indexed: 07/02/2023] Open
Abstract
To what extent does language production activate cross-modal conceptual representations? In picture naming, we view specific exemplars of concepts and then name them with a label, like "dog". In overt reading, the written word does not express a specific exemplar. Here we used a decoding approach with magnetoencephalography (MEG) to address whether picture naming and overt word reading involve shared representations of superordinate categories (e.g., animal). This addresses a fundamental question about the modality-generality of conceptual representations and their temporal evolution. Crucially, we do this using a language production task that does not require explicit categorization judgment and that controls for word form properties across semantic categories. We trained our models to classify the animal/tool distinction using MEG data of one modality at each time point and then tested the generalization of those models on the other modality. We obtained evidence for the automatic activation of cross-modal semantic category representations for both pictures and words later than their respective modality-specific representations. Cross-modal representations were activated at 150 ms and lasted until around 450 ms. The time course of lexical activation was also assessed revealing that semantic category is represented before lexical access for pictures but after lexical access for words. Notably, this earlier activation of semantic category in pictures occurred simultaneously with visual representations. We thus show evidence for the spontaneous activation of cross-modal semantic categories in picture naming and word reading. These results serve to anchor a more comprehensive spatio-temporal delineation of the semantic feature space during production planning.
Collapse
Affiliation(s)
- Julien Dirani
- Department of Psychology, New York University, New York, NY, 10003, USA.
| | - Liina Pylkkänen
- Department of Psychology, New York University, New York, NY, 10003, USA; Department of Linguistics, New York University, New York, NY, 10003, USA; NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, 129188, UAE
| |
Collapse
|
6
|
Sinha S, Del Goleto S, Kostova M, Debruille JB. Unveiling the need of interactions for social N400s and supporting the N400 inhibition hypothesis. Sci Rep 2023; 13:12613. [PMID: 37537222 PMCID: PMC10400652 DOI: 10.1038/s41598-023-39345-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 07/24/2023] [Indexed: 08/05/2023] Open
Abstract
When participants (Pps) are presented with stimuli in the presence of another person, they may consider that person's perspective. Indeed, five recent ERP studies show that the amplitudes of their N400s are increased. The two most recent ones reveal that these social-N400 increases occur even when instructions do not require a focus on the other's perspective. These increases also happen when Pps know that this other person has the same stimulus information as they have. However, in all these works, Pps could see the other person. Here, we tested whether the interaction occurring with this sight is important or whether these social N400 increases also occur when the other person is seated a bit behind Pps, who are aware of it. All had to decide whether the word ending short stories was coherent, incoherent, or equivocal. No social N400 increase was observed: N400s elicited by those words in Pps who were with a confederate (n = 50) were similar to those of Pps who were alone (n = 51). On the other hand, equivocal endings did not elicit larger N400s than coherent ones but triggered larger late posterior positivities (LPPs), like in previous studies. The discussion focuses on the circumstances in which perspective-taking occurs and on the functional significance of the N400 and the LPP.
Collapse
Affiliation(s)
- Sujata Sinha
- Department of Neurosciences, Faculty of Medicine, McGill University, Montréal, Canada
- Research Center of the Douglas Mental Health University Institute, Montréal, Canada
| | - Sarah Del Goleto
- UR Paragraphe, Université Paris 8 Vincennes-Saint-Denis, Saint-Denis, France
| | - Milena Kostova
- UR Paragraphe, Université Paris 8 Vincennes-Saint-Denis, Saint-Denis, France
| | - J Bruno Debruille
- Department of Neurosciences, Faculty of Medicine, McGill University, Montréal, Canada.
- Research Center of the Douglas Mental Health University Institute, Montréal, Canada.
- Department of Psychiatry, Faculty of Medicine, McGill University, Montréal, Canada.
| |
Collapse
|
7
|
Biswas S, Bagchi A. Analysis of the structural dynamics of the mutations in the kinase domain of PINK1 protein associated with Parkinson's disease. Gene 2023; 857:147183. [PMID: 36623675 DOI: 10.1016/j.gene.2023.147183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 12/19/2022] [Accepted: 01/04/2023] [Indexed: 01/09/2023]
Abstract
Parkinson's disease (PD) is a very common neurodegenerative disorder and is considered to be one of the most severe disorders worldwide. Mutations in some PD causing genes are responsible for the early onset of the disease. Pathogenic variants in parkin, PINK1 and DJ1 genes can cause early-onset of PD. Many PINK1 gene mutations have been reported, but not all variants are pathogenic. The gene product of PINK1, also known as PINK1 protein, has 581 amino acid residues in it. Several different mutations are present throughout the kinase domain of PINK1 protein. In this work, we used in silico approaches to analyze the different types of mutations that are distributed in the kinase domain of the PINK1 protein. Based on our results, we categorized the mutations as high, moderate and low pathogenic variants. Furthermore, we performed molecular dynamics simulations of the pathogenic PINK1 variants to decipher their possible impacts on the structure and made a comparison with the wild type PINK1. In conclusion, we suggested the possible mechanistic roles of the pathogenic variants of PINK1 kinase domain that can affect its function. These pathogenic variants are the causative agents of early onset of PD called autosomal recessive Parkinson disease.
Collapse
Affiliation(s)
- Sima Biswas
- Department of Biochemistry and Biophysics, University of Kalyani, Kalyani - 741235, Nadia, West Bengal, India
| | - Angshuman Bagchi
- Department of Biochemistry and Biophysics, University of Kalyani, Kalyani - 741235, Nadia, West Bengal, India.
| |
Collapse
|
8
|
Bayram M, Palluel-Germain R, Lebon F, Durand E, Harquel S, Perrone-Bertolotti M. Motor imagery training to improve language processing: What are the arguments? Front Hum Neurosci 2023; 17:982849. [PMID: 36816506 PMCID: PMC9929469 DOI: 10.3389/fnhum.2023.982849] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 01/09/2023] [Indexed: 02/04/2023] Open
Abstract
Studies showed that motor expertise was found to induce improvement in language processing. Grounded and situated approaches attributed this effect to an underlying automatic simulation of the motor experience elicited by action words, similar to motor imagery (MI), and suggest shared representations of action conceptualization. Interestingly, recent results also suggest that the mental simulation of action by MI training induces motor-system modifications and improves motor performance. Consequently, we hypothesize that, since MI training can induce motor-system modifications, it could be used to reinforce the functional connections between motor and language system, and could thus lead to improved language performance. Here, we explore these potential interactions by reviewing recent fundamental and clinical literature in the action-language and MI domains. We suggested that exploiting the link between action language and MI could open new avenues for complementary language improvement programs. We summarize the current literature to evaluate the rationale behind this novel training and to explore the mechanisms underlying MI and its impact on language performance.
Collapse
Affiliation(s)
- Mariam Bayram
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France
| | | | - Florent Lebon
- Laboratoire INSERM U1093 Cognition, Action, et Plasticité Sensorimotrice, Université de Bourgogne, Faculté des Sciences du Sport (UFR STAPS), Dijon, France,Institut Universitaire de France (IUF), Paris, France
| | - Edith Durand
- Département d’Orthophonie, Université du Québec à Trois-Rivières, Trois-Rivières, QC, Canada
| | - Sylvain Harquel
- Defitech Chair of Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
| | - Marcela Perrone-Bertolotti
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France,Institut Universitaire de France (IUF), Paris, France,*Correspondence: Marcela Perrone-Bertolotti,
| |
Collapse
|
9
|
Dekydtspotter L, Miller AK, Iverson M, Xiong Y, Swanson K, Gilbert C. The timing versus resource problem in nonnative sentence processing: Evidence from a time-frequency analysis of anaphora resolution in successive wh-movement in native and nonnative speakers of French. PLoS One 2023; 18:e0275305. [PMID: 36701328 PMCID: PMC9879400 DOI: 10.1371/journal.pone.0275305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Accepted: 09/14/2022] [Indexed: 01/27/2023] Open
Abstract
Nonnative processing has been argued to reflect either reduced processing capacity or delayed timing of structural analysis compared to the extraction of lexical/semantic information. The current study simultaneously investigates timing and resource allocation through a time-frequency analysis of the intrinsic neural activity during syntactic processing in native and English-speaking nonnative speakers of French. It involved structurally constrained anaphora resolution in bi-clausal wh-filler-gap dependencies such as Quelle décision à propos de lui est-ce que Paul a dit que Lydie avait rejetée sans hésitation? 'Which decision about him did Paul say that Lydie rejected without hesitation?'. We tested the hypothesis that nonnative speakers may allocate greater resources than native speakers to the computation of syntactic representations based on the grammatical specifications encoded in lexical entries, though both native and nonnative processing involves the immediate application of structural constraints. This distinct resource allocation is likely to arise in response to higher activation thresholds for nonnative knowledge acquired after the first language grammar has been fully acquired. To examine this bias in nonnative neurocognitive processing, we manipulated the wh-filler to contain either a lexically specified noun complement such as à propos de lui 'about him' or a non-lexcially specified noun phrase modifier such as le concernant 'concerning him'. We focused on processing at the intermediate gap site, that is, the point of information exchange between the matrix and the embedded clauses by adopting a measurement window corresponding to the bridge verb dit 'said' and subordinator que 'that' introducing the embedded clause. Our results showed that structural constraints on anaphora produced event-related spectral perturbations at 13-14Hz early into the presentation of the bridge verb across groups. An interaction of structural constraints on anaphora with group was found at 18-19Hz early into the presentation of the bridge verb. In this interaction, the nonnative-speaker activity at 18-19Hz echoed the concurrent general patterns at 13-14Hz, whereas the native-speaker activity revealed distinct power at 18-19Hz and at 13-14Hz. There was no evidence of delay of structural constraints on intermediate gaps with respect to lexical access to the bridge verb and subordinator. However, nonnative speakers' allocation of power in cell assembly synchronizations of fillers and gaps at the intermediate gap site reflected the grammatical specifications lexically encoded in the fillers.
Collapse
Affiliation(s)
- Laurent Dekydtspotter
- Department of French & Italian, Indiana University, Bloomington, Indiana, United States of America
- Department of Second Language Studies, Indiana University, Bloomington, Indiana, United States of America
| | - A. Kate Miller
- Department of World Languages and Cultures, Indiana University–Purdue University Indianapolis, Indianapolis, Indiana, United States of America
| | - Mike Iverson
- Department of Second Language Studies, Indiana University, Bloomington, Indiana, United States of America
| | - Yanyu Xiong
- Alabama Life Research Institute, University of Alabama, Birmingham, Alabama, United States of America
| | - Kyle Swanson
- Department of English, Purdue University, West Lafayette, Indiana, United States of America
| | - Charlène Gilbert
- Department of French & Italian, Indiana University, Bloomington, Indiana, United States of America
| |
Collapse
|
10
|
Zhang K, Gu F, Yu H. Early lexical processing of Chinese one-character words and Mongolian words: A comparative study using event-related potentials. Front Psychol 2023; 13:1061990. [PMID: 36733864 PMCID: PMC9887120 DOI: 10.3389/fpsyg.2022.1061990] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 12/28/2022] [Indexed: 01/18/2023] Open
Abstract
Logographic language and alphabetic language differ significantly in orthography. Investigating the commonality and particularity of visual word recognition between the two distinct writing systems is informative for understating the neural mechanisms underlying visual word recognition. In the present study, we compared the chronometry of early lexical processing and the brain regions involved in early lexical processing between Chinese (logographic language) and Mongolian (alphabetic language) by recording event-related potentials (ERPs) using both implicit and explicit reading tasks. Familiar Chinese one-character words (lexical) and unknown Chinese one-character words (non-lexical) were pseudorandomly presented to native Chinese readers in Experiment 1. Mongolian words (lexical) and pseudowords (non-lexical) were pseudorandomly presented to native Mongolian readers in Experiment 2. In the color decision task, participants were asked to decide the color (black or blue) of each stimulus. In the lexical recognition task, participants were asked to report whether they could recognize each stimulus. The results showed that in both experiments and both tasks, ERPs to lexical items differed significantly from those to non-lexical items in the parietooccipital scalp region approximately 250 ms after stimulus onset, reflecting the early lexical processing, which likely originated from the ventral occipitotemporal cortex as revealed by source analysis. These results indicated that although Chinese and Mongolian differed markedly in orthographic features, the neural mechanisms underlying early lexical processing are similar between the two languages.
Collapse
Affiliation(s)
- Kai Zhang
- Department of Chinese Language and Literature, Northwest Minzu University, Lanzhou, China,Key Laboratory of China’s Ethnic Languages and Intelligent Processing of Gansu Province, Northwest Minzu University, Lanzhou, China
| | - Feng Gu
- Neurocognitive Laboratory for Linguistics and Semiotics, College of Literature and Journalism, Sichuan University, Chengdu, China
| | - Hongzhi Yu
- Department of Chinese Language and Literature, Northwest Minzu University, Lanzhou, China,Key Laboratory of China’s Ethnic Languages and Information Technology of Ministry of Education, Northwest Minzu University, Lanzhou, China,*Correspondence: Hongzhi Yu, ✉
| |
Collapse
|
11
|
Hardy SM, Jensen O, Wheeldon L, Mazaheri A, Segaert K. Modulation in alpha band activity reflects syntax composition: an MEG study of minimal syntactic binding. Cereb Cortex 2023; 33:497-511. [PMID: 35311899 PMCID: PMC9890467 DOI: 10.1093/cercor/bhac080] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 02/06/2022] [Accepted: 02/07/2022] [Indexed: 02/05/2023] Open
Abstract
Successful sentence comprehension requires the binding, or composition, of multiple words into larger structures to establish meaning. Using magnetoencephalography, we investigated the neural mechanisms involved in binding at the syntax level, in a task where contributions from semantics were minimized. Participants were auditorily presented with minimal sentences that required binding (pronoun and pseudo-verb with the corresponding morphological inflection; "she grushes") and pseudo-verb wordlists that did not require binding ("cugged grushes"). Relative to no binding, we found that syntactic binding was associated with a modulation in alpha band (8-12 Hz) activity in left-lateralized language regions. First, we observed a significantly smaller increase in alpha power around the presentation of the target word ("grushes") that required binding (-0.05 to 0.1 s), which we suggest reflects an expectation of binding to occur. Second, during binding of the target word (0.15-0.25 s), we observed significantly decreased alpha phase-locking between the left inferior frontal gyrus and the left middle/inferior temporal cortex, which we suggest reflects alpha-driven cortical disinhibition serving to strengthen communication within the syntax composition neural network. Altogether, our findings highlight the critical role of rapid spatial-temporal alpha band activity in controlling the allocation, transfer, and coordination of the brain's resources during syntax composition.
Collapse
Affiliation(s)
- Sophie M Hardy
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- Department of Psychology, University of Warwick, Coventry CV4 7AL, UK
| | - Ole Jensen
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
| | - Linda Wheeldon
- Department of Foreign Languages and Translations, University of Agder, Kristiansand 4630, Norway
| | - Ali Mazaheri
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- School of Psychology, University of Birmingham, Birmingham B15 2TT, UK
| | - Katrien Segaert
- Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, UK
- School of Psychology, University of Birmingham, Birmingham B15 2TT, UK
| |
Collapse
|
12
|
Schneider P, Groß C, Bernhofs V, Christiner M, Benner J, Turker S, Zeidler BM, Seither‐Preisler A. Short-term plasticity of neuro-auditory processing induced by musical active listening training. Ann N Y Acad Sci 2022; 1517:176-190. [PMID: 36114664 PMCID: PMC9826140 DOI: 10.1111/nyas.14899] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Although there is strong evidence for the positive effects of musical training on auditory perception, processing, and training-induced neuroplasticity, there is still little knowledge on the auditory and neurophysiological short-term plasticity through listening training. In a sample of 37 adolescents (20 musicians and 17 nonmusicians) that was compared to a control group matched for age, gender, and musical experience, we conducted a 2-week active listening training (AULOS: Active IndividUalized Listening OptimizationS). Using magnetoencephalography and psychoacoustic tests, the short-term plasticity of auditory evoked fields and auditory skills were examined in a pre-post design, adapted to the individual neuro-auditory profiles. We found bilateral, but more pronounced plastic changes in the right auditory cortex. Moreover, we observed synchronization of the auditory evoked P1, N1, and P2 responses and threefold larger amplitudes of the late P2 response, similar to the reported effects of musical long-term training. Auditory skills and thresholds benefited largely from the AULOS training. Remarkably, after training, the mean thresholds improved by 12 dB for bone conduction and by 3-4 dB for air conduction. Thus, our findings indicate a strong positive influence of active listening training on neural auditory processing and perception in adolescence, when the auditory system is still developing.
Collapse
Affiliation(s)
- Peter Schneider
- Division of NeuroradiologyUniversity of Heidelberg Medical SchoolHeidelbergGermany,Department of Neurology, Section of BiomagnetismUniversity of Heidelberg Medical SchoolHeidelbergGermany,Jazeps Vitols Latvian Academy of MusicRigaLatvia,Centre for Systematic MusicologyUniversity of GrazGrazAustria
| | - Christine Groß
- Division of NeuroradiologyUniversity of Heidelberg Medical SchoolHeidelbergGermany,Jazeps Vitols Latvian Academy of MusicRigaLatvia
| | | | - Markus Christiner
- Jazeps Vitols Latvian Academy of MusicRigaLatvia,Centre for Systematic MusicologyUniversity of GrazGrazAustria
| | - Jan Benner
- Division of NeuroradiologyUniversity of Heidelberg Medical SchoolHeidelbergGermany,Department of Neurology, Section of BiomagnetismUniversity of Heidelberg Medical SchoolHeidelbergGermany
| | - Sabrina Turker
- Lise Meitner Research Group “Cognition and Plasticity”Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | | | | |
Collapse
|
13
|
Skipper JI. A voice without a mouth no more: The neurobiology of language and consciousness. Neurosci Biobehav Rev 2022; 140:104772. [PMID: 35835286 DOI: 10.1016/j.neubiorev.2022.104772] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Revised: 05/18/2022] [Accepted: 07/05/2022] [Indexed: 11/26/2022]
Abstract
Most research on the neurobiology of language ignores consciousness and vice versa. Here, language, with an emphasis on inner speech, is hypothesised to generate and sustain self-awareness, i.e., higher-order consciousness. Converging evidence supporting this hypothesis is reviewed. To account for these findings, a 'HOLISTIC' model of neurobiology of language, inner speech, and consciousness is proposed. It involves a 'core' set of inner speech production regions that initiate the experience of feeling and hearing words. These take on affective qualities, deriving from activation of associated sensory, motor, and emotional representations, involving a largely unconscious dynamic 'periphery', distributed throughout the whole brain. Responding to those words forms the basis for sustained network activity, involving 'default mode' activation and prefrontal and thalamic/brainstem selection of contextually relevant responses. Evidence for the model is reviewed, supporting neuroimaging meta-analyses conducted, and comparisons with other theories of consciousness made. The HOLISTIC model constitutes a more parsimonious and complete account of the 'neural correlates of consciousness' that has implications for a mechanistic account of mental health and wellbeing.
Collapse
|
14
|
Politzer-Ahles S, Lin J, Pan L, Lee KK. N400 Evidence That the Early Stages of Lexical Access Ignore Knowledge About Phonological Alternations. LANGUAGE AND SPEECH 2022; 65:354-376. [PMID: 34080466 PMCID: PMC9014668 DOI: 10.1177/00238309211020026] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Hearing a word that was already expected often facilitates comprehension, attenuating the amplitude of the N400 event-related brain potential component. On the other hand, hearing a word that was not expected elicits a larger N400. In the present study, we examined whether the N400 would be attenuated when a person hears something that is not exactly what they expected but is a viable alternative pronunciation of the morpheme they expected. This was done using Mandarin syllables, some of which can be pronounced with different lexical tones depending on the context. In two large-sample experiments (total n = 160) testing syllables in isolation and in phonologically viable contexts, we found little evidence that hearing an alternative pronunciation of the expected word attenuates the N400. These results suggest that comprehenders do not take advantage of their knowledge about systematic phonological alternations during the early stages of prediction or discrimination.
Collapse
Affiliation(s)
- Stephen Politzer-Ahles
- Stephen Politzer-Ahles, Department of
Chinese and Bilingual Studies, Hong Kong Polytechnic University, Hong Kong.
| | - Jueyao Lin
- Hong Kong Polytechnic University, Hong
Kong
| | - Lei Pan
- Hong Kong Polytechnic University, Hong
Kong
- Nanyang Technological University,
Singapore
| | | |
Collapse
|
15
|
Romero-Rivas C, Costa A. On the flexibility of the sound-to-meaning mapping when listening to native and foreign-accented speech. Cortex 2022; 149:1-15. [DOI: 10.1016/j.cortex.2022.01.009] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Revised: 10/11/2021] [Accepted: 01/12/2022] [Indexed: 11/29/2022]
|
16
|
Gosselke Berthelsen S, Horne M, Shtyrov Y, Roll M. Native language experience shapes pre-attentive foreign tone processing and guides rapid memory trace build-up: An ERP study. Psychophysiology 2022; 59:e14042. [PMID: 35294788 PMCID: PMC9539634 DOI: 10.1111/psyp.14042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 02/17/2022] [Accepted: 02/21/2022] [Indexed: 12/01/2022]
Abstract
Language experience, particularly from our native language (L1), shapes our perception of other languages around us. The present study examined how L1 experience moulds the initial processing of foreign (L2) tone during acquisition. In particular, we investigated whether learners were able to rapidly forge new neural memory traces for novel tonal words, which was tracked by recording learners’ ERP responses during two word acquisition sessions. We manipulated the degree of L1–L2 familiarity by comparing learners with a nontonal L1 (German) and a tonal L1 (Swedish) and by using tones that were similar (fall) or dissimilar (high, low, rise) to those occurring in Swedish. Our results indicate that a rapid, pre‐attentive memory trace build‐up for tone manifests in an early ERP component at ~50 ms but only at particularly high levels of L1–L2 similarity. Specifically, early processing was facilitated for an L2 tone that had a familiar pitch shape (fall) and word‐level function (inflection). This underlines the importance of these L1 properties for the early processing of L2 tone. In comparison, a later anterior negativity related to the processing of the tones’ grammatical content was unaffected by native language experience but was instead influenced by lexicality, pitch prominence, entrenchment, and successful learning. Behaviorally, learning effects emerged for all learners and tone types, regardless of L1–L2 familiarity or pitch prominence. Together, the findings suggest that while L1‐based facilitation effects occur, they mainly affect early processing stages and do not necessarily result in more successful L2 acquisition at behavioral level. Our findings add important evidence that contributes to answering the open question of how similarity between native and target language influences target language processing and acquisition. We found facilitative effects of similarity only at pre‐attentive levels and only when the degree of similarity was high. Late processing and successful acquisition, on the other hand, were unaffected by the target words’ similarity to native language properties.
Collapse
Affiliation(s)
- Sabine Gosselke Berthelsen
- Department of Linguistics and Phonetics, Lund University, Lund, Sweden.,Department of Nordic Studies and Linguistics, University of Copenhagen, Copenhagen, Denmark
| | - Merle Horne
- Department of Linguistics and Phonetics, Lund University, Lund, Sweden
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark.,Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
| | - Mikael Roll
- Department of Linguistics and Phonetics, Lund University, Lund, Sweden
| |
Collapse
|
17
|
Bermúdez-Margaretto B, Gallo F, Novitskiy N, Myachykov A, Petrova A, Shtyrov Y. Ultra-rapid and automatic interplay between L1 and L2 semantics in late bilinguals: EEG evidence. Cortex 2022; 151:147-161. [DOI: 10.1016/j.cortex.2022.03.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2021] [Revised: 01/17/2022] [Accepted: 03/03/2022] [Indexed: 11/03/2022]
|
18
|
Hestvik A, Epstein B, Schwartz RG, Shafer VL. Developmental Language Disorder as Syntactic Prediction Impairment. FRONTIERS IN COMMUNICATION 2022; 6:637585. [PMID: 35237682 PMCID: PMC8887879 DOI: 10.3389/fcomm.2021.637585] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
We provide evidence that children with Developmental Language Disorder (DLD) are impaired in predictive syntactic processing. In the current study, children listened passively to auditorily-presented sentences, where the critical condition included an unexpected "filled gap" in the direct object position of the relative clause verb. A filled gap is illustrated by the underlined phrase in "The zebra that the hippo kissed the camel on the nose…", rather than the expected "the zebra that the hippo kissed [e] on the nose", where [e] denotes the gap. Brain responses to the filled gap were compared to a control condition using adverb-relative clauses with identical substrings: "The weekend that the hippo kissed the camel on the nose [e]…". Here, the same noun phrase is not unexpected because the adverb gap occurs later in the structure. We hypothesized that a filled gap would elicit a prediction error brain signal in the form of an early anterior negativity, as we have previously observed in adults. We found an early (bilateral) anterior negativity to the filled gap in a control group of children with Typical Development (TD), but the children with DLD exhibited no brain response to the filled gap during the same early time window. This suggests that children with DLD fail to predict that a relativized object should correspond to an empty position after the relative clause verb, suggesting an impairment in predictive processing. We discuss how this lack of a prediction error signal can interact with language acquisition and result in DLD.
Collapse
Affiliation(s)
- Arild Hestvik
- Department of Linguistics and Cognitive Science, University of Delaware, Newark, DE, United States
| | - Baila Epstein
- Communication Arts, Sciences, and Disorders, Brooklyn College, Boylan Hall, Brooklyn, NY, United States
| | - Richard G. Schwartz
- PhD Program in Speech-Language-Hearing Sciences, The Graduate Center, City University of New York, New York, NY, United States
| | - Valerie L. Shafer
- PhD Program in Speech-Language-Hearing Sciences, The Graduate Center, City University of New York, New York, NY, United States
| |
Collapse
|
19
|
Palacios Alvarez S, Gomez P, Coop S, Zamora-Zamora R, Mazzinghi C, Mitchell MW. Single-domain Bose condensate magnetometer achieves energy resolution per bandwidth below ℏ. Proc Natl Acad Sci U S A 2022; 119:e2115339119. [PMID: 35131850 PMCID: PMC8833174 DOI: 10.1073/pnas.2115339119] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Accepted: 12/13/2021] [Indexed: 11/18/2022] Open
Abstract
We present a magnetic sensor with energy resolution per bandwidth [Formula: see text] We show how a 87Rb single-domain spinor Bose-Einstein condensate, detected by nondestructive Faraday rotation probing, achieves single-shot low-frequency magnetic sensitivity of 72(8) fT measuring a volume [Formula: see text] for 3.5 s, and thus, [Formula: see text] We measure experimentally the condensate volume, spin coherence time, and readout noise and use phase space methods, backed by three-dimensional mean-field simulations, to compute the spin noise. Contributions to the spin noise include one-body and three-body losses and shearing of the projection noise distribution, due to competition of ferromagnetic contact interactions and quadratic Zeeman shifts. Nonetheless, the fully coherent nature of the single-domain, ultracold two-body interactions allows the system to escape the coherence vs. density trade-off that imposes an energy resolution limit on traditional spin precession sensors. We predict that other Bose-condensed alkalis, especially the antiferromagnetic 23Na, can further improve the energy resolution of this method.
Collapse
Affiliation(s)
- Silvana Palacios Alvarez
- ICFO - Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, 08860 Castelldefels (Barcelona), Spain
| | - Pau Gomez
- ICFO - Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, 08860 Castelldefels (Barcelona), Spain
| | - Simon Coop
- ICFO - Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, 08860 Castelldefels (Barcelona), Spain
| | - Roberto Zamora-Zamora
- Quantum Computing and Devices (QCD) Labs, Department of Applied Physics, Aalto University and Quantum Technology Finland (QTF) Centre of Excellence, FI-00076 Aalto, Finland
| | - Chiara Mazzinghi
- ICFO - Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, 08860 Castelldefels (Barcelona), Spain
| | - Morgan W Mitchell
- ICFO - Institut de Ciencies Fotoniques, The Barcelona Institute of Science and Technology, 08860 Castelldefels (Barcelona), Spain;
- ICREA - Institució Catalana de Recerca i Estudis Avançats, 08010 Barcelona, Spain
| |
Collapse
|
20
|
Wang YC, Sohoglu E, Gilbert RA, Henson RN, Davis MH. Predictive Neural Computations Support Spoken Word Recognition: Evidence from MEG and Competitor Priming. J Neurosci 2021; 41:6919-6932. [PMID: 34210777 PMCID: PMC8360690 DOI: 10.1523/jneurosci.1685-20.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 05/22/2021] [Accepted: 05/25/2021] [Indexed: 11/24/2022] Open
Abstract
Human listeners achieve quick and effortless speech comprehension through computations of conditional probability using Bayes rule. However, the neural implementation of Bayesian perceptual inference remains unclear. Competitive-selection accounts (e.g., TRACE) propose that word recognition is achieved through direct inhibitory connections between units representing candidate words that share segments (e.g., hygiene and hijack share /haidʒ/). Manipulations that increase lexical uncertainty should increase neural responses associated with word recognition when words cannot be uniquely identified. In contrast, predictive-selection accounts (e.g., Predictive-Coding) propose that spoken word recognition involves comparing heard and predicted speech sounds and using prediction error to update lexical representations. Increased lexical uncertainty in words, such as hygiene and hijack, will increase prediction error and hence neural activity only at later time points when different segments are predicted. We collected MEG data from male and female listeners to test these two Bayesian mechanisms and used a competitor priming manipulation to change the prior probability of specific words. Lexical decision responses showed delayed recognition of target words (hygiene) following presentation of a neighboring prime word (hijack) several minutes earlier. However, this effect was not observed with pseudoword primes (higent) or targets (hijure). Crucially, MEG responses in the STG showed greater neural responses for word-primed words after the point at which they were uniquely identified (after /haidʒ/ in hygiene) but not before while similar changes were again absent for pseudowords. These findings are consistent with accounts of spoken word recognition in which neural computations of prediction error play a central role.SIGNIFICANCE STATEMENT Effective speech perception is critical to daily life and involves computations that combine speech signals with prior knowledge of spoken words (i.e., Bayesian perceptual inference). This study specifies the neural mechanisms that support spoken word recognition by testing two distinct implementations of Bayes perceptual inference. Most established theories propose direct competition between lexical units such that inhibition of irrelevant candidates leads to selection of critical words. Our results instead support predictive-selection theories (e.g., Predictive-Coding): by comparing heard and predicted speech sounds, neural computations of prediction error can help listeners continuously update lexical probabilities, allowing for more rapid word identification.
Collapse
Affiliation(s)
- Yingcan Carol Wang
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, United Kingdom
| | - Ediz Sohoglu
- School of Psychology, University of Sussex, Brighton, BN1 9RH, United Kingdom
| | - Rebecca A Gilbert
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, United Kingdom
| | - Richard N Henson
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, United Kingdom
| | - Matthew H Davis
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, United Kingdom
| |
Collapse
|
21
|
Hyder R, Højlund A, Jensen M, Johnsen EL, Østergaard K, Shtyrov Y. STN-DBS affects language processing differentially in Parkinson's disease: Multiple-case MEG study. Acta Neurol Scand 2021; 144:132-141. [PMID: 33961289 DOI: 10.1111/ane.13423] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Revised: 03/02/2021] [Accepted: 03/10/2021] [Indexed: 12/01/2022]
Abstract
OBJECTIVES In this study, we investigated the effects of bilateral and unilateral deep brain stimulation of the subthalamic nucleus (STN-DBS) in PD patients on neural responses associated with two aspects of spoken language processing: semantics of action-related verbs and morphosyntactic processing. MATERIALS AND METHODS Using a passive unattended paradigm to present spoken linguistic stimuli, we recorded magnetoencephalographic (MEG) responses in three PD patients in four DBS conditions: left unilateral STN-DBS, right unilateral STN-DBS, bilateral STN-DBS, and no STN-DBS. To ensure that any observed effects of DBS on the neuromagnetic responses could be attributed to the linguistic context per se and were not merely induced by the electrical stimulation, we assessed the effects of STN-DBS on linguistic contrasts within each stimulation condition. Hence, we contrasted the processing of action vs. abstract verbs as well as the processing of correct vs. incorrect morphosyntactic inflections within each DBS condition. RESULTS The results revealed that, compared to the DBS-off state, both bilateral and right unilateral stimulation of the STN yielded significant dissociations in the processing of action and abstract verbs, with greater neuromagnetic responses for action verbs compared to abstract verbs. For morphosyntax processing, only left unilateral stimulation yielded significant dissociations (relative to the DBS-off state), with greater neuromagnetic responses to the incorrect inflections compared to the correct inflections. CONCLUSION The results reflect differential effects of unilateral and bilateral STN-DBS on neuromagnetic responses associated with the processing of spoken language. They suggest that different specific aspects of linguistic information processing in PD are affected differently by STN-DBS.
Collapse
Affiliation(s)
- Rasha Hyder
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
- Institute of Clinical Neuroscience and Medical Psychology Medical Faculty Heinrich‐Heine University Düsseldorf Germany
| | - Andreas Højlund
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
| | - Mads Jensen
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
- Research Unit for Robophilosophy and Integrative Social Robotics Interacting Minds Centre Aarhus University Aarhus Denmark
| | - Erik L. Johnsen
- Department of Neurology Aarhus University Hospital Aarhus Denmark
| | - Karen Østergaard
- Department of Neurology Aarhus University Hospital Aarhus Denmark
- Sano Private Hospital Denmark
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN) Department of Clinical Medicine Aarhus University Aarhus Denmark
- Centre for Cognition and Decision Making Institute for Cognitive Neuroscience HSE University Moscow Russian Federation
| |
Collapse
|
22
|
Fairs A, Michelas A, Dufour S, Strijkers K. The Same Ultra-Rapid Parallel Brain Dynamics Underpin the Production and Perception of Speech. Cereb Cortex Commun 2021; 2:tgab040. [PMID: 34296185 PMCID: PMC8262084 DOI: 10.1093/texcom/tgab040] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 05/28/2021] [Accepted: 06/03/2021] [Indexed: 11/20/2022] Open
Abstract
The temporal dynamics by which linguistic information becomes available is one of the key properties to understand how language is organized in the brain. An unresolved debate between different brain language models is whether words, the building blocks of language, are activated in a sequential or parallel manner. In this study, we approached this issue from a novel perspective by directly comparing the time course of word component activation in speech production versus perception. In an overt object naming task and a passive listening task, we analyzed with mixed linear models at the single-trial level the event-related brain potentials elicited by the same lexico-semantic and phonological word knowledge in the two language modalities. Results revealed that both word components manifested simultaneously as early as 75 ms after stimulus onset in production and perception; differences between the language modalities only became apparent after 300 ms of processing. The data provide evidence for ultra-rapid parallel dynamics of language processing and are interpreted within a neural assembly framework where words recruit the same integrated cell assemblies across production and perception. These word assemblies ignite early on in parallel and only later on reverberate in a behavior-specific manner.
Collapse
Affiliation(s)
- Amie Fairs
- Aix-Marseille University & CNRS, LPL, 13100 Aix-en-Provence, France
| | | | - Sophie Dufour
- Aix-Marseille University & CNRS, LPL, 13100 Aix-en-Provence, France
| | | |
Collapse
|
23
|
Shtyrov Y, Filippova M, Blagovechtchenski E, Kirsanov A, Nikiforova E, Shcherbakova O. Electrophysiological Evidence of Dissociation Between Explicit Encoding and Fast Mapping of Novel Spoken Words. Front Psychol 2021; 12:571673. [PMID: 33746814 PMCID: PMC7969714 DOI: 10.3389/fpsyg.2021.571673] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Accepted: 01/12/2021] [Indexed: 11/13/2022] Open
Abstract
Existing behavioral, neuropsychological and functional neuroimaging data suggest that at least two major cognitive strategies are used for new word learning: fast mapping (FM) via context-dependent inference and explicit encoding (EE) via direct instruction. However, these distinctions remain debated at both behavioral and neurophysiological levels, not least due to confounds related to diverging experimental settings. Furthermore, the neural dynamics underpinning these two putative processes remain poorly understood. To tackle this, we designed a paradigm presenting 20 new spoken words in association with pictures in either FM or EE settings, closely matched for auditory and visual features and overall task demands. We tested word acquisition using a range of behavioral measures as well as passive event-related potential (ERP) responses, an established measure of word memory trace activation, and compared brain activity elicited by novel FM and EE words before and after the learning session. Behavioral data obtained in free recall, recognition and semantic word-picture matching tasks indicated successful acquisition of new words after just 10 exposures. Crucially, we found no behavioral evidence of different acquisition outcomes between FM and EE learning. ERP data, which exhibited the main response peaks at ~170, 250, and 520 ms, also indicated successful learning, with statistically different responses between novel and familiar words present only before, but not after the training, suggesting rapid formation of new neural memory circuits matching in activation those for previously known words. Furthermore, already at the earliest peak, we found different topographic distributions for the two learning types, with left-lateralized FM dynamics, suggestive of core language system involvement, and more diffuse activity for EE items, possibly suggesting the role of attention/executive control network. A similar effect also manifested later, at ~520 ms. Our data suggest that while both EE and FM learning can be successful for rapid word acquisition at the behavioral level, the diverging electrophysiological patterns suggest a dissociation between the neural systems underpinning these learning strategies.
Collapse
Affiliation(s)
- Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark.,Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Margarita Filippova
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia.,Department of General Psychology, Faculty of Psychology, Saint Petersburg State University, Saint Petersburg, Russia
| | - Evgeni Blagovechtchenski
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Alexander Kirsanov
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Elizaveta Nikiforova
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Olga Shcherbakova
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia.,Department of General Psychology, Faculty of Psychology, Saint Petersburg State University, Saint Petersburg, Russia
| |
Collapse
|
24
|
Gow DW, Schoenhaut A, Avcu E, Ahlfors SP. Behavioral and Neurodynamic Effects of Word Learning on Phonotactic Repair. Front Psychol 2021; 12:590155. [PMID: 33776832 PMCID: PMC7987836 DOI: 10.3389/fpsyg.2021.590155] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 02/04/2021] [Indexed: 11/22/2022] Open
Abstract
Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user's lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, we observed the effects of learning new words that violate English phonotactic constraints (e.g., srigin) on phonotactic perceptual repair processes in nonword consonant-consonant-vowel (CCV) stimuli (e.g., /sre/). Subjects who learned such words were less likely to "repair" illegal onset clusters (/sr/) and report them as legal ones (/∫r/). Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography (MEG) and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing.
Collapse
Affiliation(s)
- David W. Gow
- Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
- Department of Psychology, Salem State University, Salem, MA, United States
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, United States
- Harvard-MIT Division of Health Sciences and Technology, Cambridge, MA, United States
| | - Adriana Schoenhaut
- Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
| | - Enes Avcu
- Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
| | - Seppo P. Ahlfors
- Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United States
| |
Collapse
|
25
|
Du J, Palaniyappan L, Liu Z, Cheng W, Gong W, Zhu M, Wang J, Zhang J, Feng J. The genetic determinants of language network dysconnectivity in drug-naïve early stage schizophrenia. NPJ SCHIZOPHRENIA 2021; 7:18. [PMID: 33658499 PMCID: PMC7930279 DOI: 10.1038/s41537-021-00141-8] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 01/12/2021] [Indexed: 01/31/2023]
Abstract
Schizophrenia is a neurocognitive illness of synaptic and brain network-level dysconnectivity that often reaches a persistent chronic stage in many patients. Subtle language deficits are a core feature even in the early stages of schizophrenia. However, the primacy of language network dysconnectivity and language-related genetic variants in the observed phenotype in early stages of illness remains unclear. This study used two independent schizophrenia dataset consisting of 138 and 53 drug-naïve first-episode schizophrenia (FES) patients, and 112 and 56 healthy controls, respectively. A brain-wide voxel-level functional connectivity analysis was conducted to investigate functional dysconnectivity and its relationship with illness duration. We also explored the association between critical language-related genetic (such as FOXP2) mutations and the altered functional connectivity in patients. We found elevated functional connectivity involving Broca's area, thalamus and temporal cortex that were replicated in two FES datasets. In particular, Broca's area - anterior cingulate cortex dysconnectivity was more pronounced for patients with shorter illness duration, while thalamic dysconnectivity was predominant in those with longer illness duration. Polygenic risk scores obtained from FOXP2-related genes were strongly associated with functional dysconnectivity identified in patients with shorter illness duration. Our results highlight the criticality of language network dysconnectivity, involving the Broca's area in early stages of schizophrenia, and the role of language-related genes in this aberration, providing both imaging and genetic evidence for the association between schizophrenia and the determinants of language.
Collapse
Affiliation(s)
- Jingnan Du
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China
| | - Lena Palaniyappan
- Department of Psychiatry and Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Lawson Health Research Institute, London, ON, Canada
| | - Zhaowen Liu
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Wei Cheng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China
| | - Weikang Gong
- Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| | - Mengmeng Zhu
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Jijun Wang
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jie Zhang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China.
| | - Jianfeng Feng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China.
- Department of Computer Science, University of Warwick, Coventry, UK.
| |
Collapse
|
26
|
Özkan DG, Broersma M, Bekkering H, Bultena S. Observed and Performed Error Signals in Auditory Lexical Decisions. Neuroscience 2021; 486:46-61. [PMID: 33577954 DOI: 10.1016/j.neuroscience.2021.02.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 01/29/2021] [Accepted: 02/01/2021] [Indexed: 11/30/2022]
Abstract
This study investigates the error processing components in the EEG signal of Performers and Observers using an auditory lexical decision task, in which participants heard spoken items and decided for each item if it was a real word or not. Pairs of participants were tested in both the role of the Performer and the Observer. In the literature, an Error Related Negativity (ERN)-Error Positivity (Pe) complex has been identified for performed (ERN-Pe) and observed (oERN-oPe) errors. While these effects have been widely studied for performance errors in speeded decision tasks relying on visual input, relatively little is known about the performance monitoring signatures in observed language processing based on auditory input. In the lexical decision task, native Dutch speakers listened to real Dutch Words, Non-Words, and crucially, long Pseudowords that resembled words until the final syllable and were shown to be error-prone in a pilot study, because they were responded to too soon. We hypothesised that the errors in the task would result in a response locked ERN-Pe pattern both for the Performer and for the Observer. Our hypothesis regarding the ERN was not supported, however a Pe-like effect, as well as a P300 were present. Analyses to disentangle lexical and error processing similarly indicated a P300 for errors, and the results furthermore pointed to differences between responses before and after word offset. The findings are interpreted as marking attention during error processing during auditory word recognition.
Collapse
Affiliation(s)
- Duru G Özkan
- Department of Psychology, Sapienza University of Rome, Italy; Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Netherlands.
| | - Mirjam Broersma
- Centre for Language Studies, Radboud University Nijmegen, Netherlands
| | - Harold Bekkering
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Netherlands
| | - Sybrine Bultena
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Netherlands; Centre for Language Studies, Radboud University Nijmegen, Netherlands
| |
Collapse
|
27
|
Jang KI, Kim S, Kim SY, Lee C, Chae JH. Machine Learning-Based Electroencephalographic Phenotypes of Schizophrenia and Major Depressive Disorder. Front Psychiatry 2021; 12:745458. [PMID: 34721112 PMCID: PMC8549692 DOI: 10.3389/fpsyt.2021.745458] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Accepted: 09/14/2021] [Indexed: 12/03/2022] Open
Abstract
Background: Psychiatric diagnosis is formulated by symptomatic classification; disease-specific neurophysiological phenotyping could help with its fundamental treatment. Here, we investigated brain phenotyping in patients with schizophrenia (SZ) and major depressive disorder (MDD) by using electroencephalography (EEG) and conducted machine-learning-based classification of the two diseases by using EEG components. Materials and Methods: We enrolled healthy controls (HCs) (n = 30) and patients with SZ (n = 34) and MDD (n = 33). An auditory P300 (AP300) task was performed, and the N1 and P3 components were extracted. Two-group classification was conducted using linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. Positive and negative symptoms and depression and/or anxiety symptoms were evaluated. Results: Considering both the results of statistical comparisons and machine learning-based classifications, patients and HCs showed significant differences in AP300, with SZ and MDD showing lower N1 and P3 than HCs. In the sum of amplitudes and cortical sources, the findings for LDA with classification accuracy (SZ vs. HCs: 71.31%, MDD vs. HCs: 74.55%), sensitivity (SZ vs. HCs: 77.67%, MDD vs. HCs: 79.00%), and specificity (SZ vs. HCs: 64.00%, MDD vs. HCs: 69.67%) supported these results. The SVM classifier showed reasonable scores between SZ and HCs and/or MDD and HCs. The comparison between SZ and MDD showed low classification accuracy (59.71%), sensitivity (65.08%), and specificity (54.83%). Conclusions: Patients with SZ and MDD showed deficiencies in N1 and P3 components in the sum of amplitudes and cortical sources, indicating attentional dysfunction in both early and late sensory/cognitive gating input. The LDA and SVM classifiers in the AP300 are useful to distinguish patients with SZ and HCs and/or MDD and HCs.
Collapse
Affiliation(s)
- Kuk-In Jang
- Department of Cognitive Science Research, Korea Brain Research Institute (KBRI), Daegu, South Korea
| | - Sungkean Kim
- Department of Human-Computer Interaction, Hanyang University, Ansan, South Korea
| | - Soo Young Kim
- Department of Psychiatry, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| | - Chany Lee
- Department of Cognitive Science Research, Korea Brain Research Institute (KBRI), Daegu, South Korea
| | - Jeong-Ho Chae
- Department of Psychiatry, College of Medicine, The Catholic University of Korea, Seoul, South Korea
| |
Collapse
|
28
|
Grisoni L, Tomasello R, Pulvermüller F. Correlated Brain Indexes of Semantic Prediction and Prediction Error: Brain Localization and Category Specificity. Cereb Cortex 2020; 31:1553-1568. [PMID: 33108460 PMCID: PMC7869099 DOI: 10.1093/cercor/bhaa308] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 08/11/2020] [Accepted: 09/17/2020] [Indexed: 11/12/2022] Open
Abstract
With strong and valid predictions, grasping a message is easy, whereas more demanding processing is required in the absence of robust expectations. We here demonstrate that brain correlates of the interplay between prediction and perception mechanisms in the understanding of meaningful sentences. Sentence fragments that strongly predict subsequent words induced anticipatory brain activity preceding the expected words; this potential was absent if context did not strongly predict subsequent words. Subjective reports of certainty about upcoming words and objective corpus-based measures correlated with the size of the anticipatory signal, thus establishing its status as a semantic prediction potential (SPP). Crucially, there was an inverse correlation between the SPP and the N400 brain response. The main cortical generators of SPP and N400 were found in inferior prefrontal cortex and posterior temporal cortex, respectively. Interestingly, sentence meaning was reflected by both measures, with additional category-specific sources of SPPs and N400s falling into parieto-temporo-occipital (visual) and frontocentral (sensorimotor) areas for animal- and tool-related words, respectively. These results show that the well-known brain index of semantic comprehension, N400, has an antecedent with different brain localization but similar semantic discriminatory function. We discuss whether N400 dynamics may causally depend on mechanisms underlying SPP size and sources.
Collapse
Affiliation(s)
- Luigi Grisoni
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany
| | - Rosario Tomasello
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany
| | - Friedemann Pulvermüller
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany.,Einstein Center for Neurosciences, 10117 Berlin, Germany
| |
Collapse
|
29
|
Razorenova AM, Chernyshev BV, Nikolaeva AY, Butorina AV, Prokofyev AO, Tyulenev NB, Stroganova TA. Rapid Cortical Plasticity Induced by Active Associative Learning of Novel Words in Human Adults. Front Neurosci 2020; 14:895. [PMID: 33013296 PMCID: PMC7516206 DOI: 10.3389/fnins.2020.00895] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Accepted: 07/31/2020] [Indexed: 11/29/2022] Open
Abstract
Human speech requires that new words are routinely memorized, yet neurocognitive mechanisms of such acquisition of memory remain highly debatable. Major controversy concerns the question whether cortical plasticity related to word learning occurs in neocortical speech-related areas immediately after learning, or neocortical plasticity emerges only on the second day after a prolonged time required for consolidation after learning. The functional spatiotemporal pattern of cortical activity related to such learning also remains largely unknown. In order to address these questions, we examined magnetoencephalographic responses elicited in the cerebral cortex by passive presentations of eight novel pseudowords before and immediately after an operant conditioning task. This associative procedure forced participants to perform an active search for unique meaning of four pseudowords that referred to movements of left and right hands and feet. The other four pseudowords did not require any movement and thus were not associated with any meaning. Familiarization with novel pseudowords led to a bilateral repetition suppression of cortical responses to them; the effect started before or around the uniqueness point and lasted for more than 500 ms. After learning, response amplitude to pseudowords that acquired meaning was greater compared with response amplitude to pseudowords that were not assigned meaning; the effect was significant within 144-362 ms after the uniqueness point, and it was found only in the left hemisphere. Within this time interval, a learning-related selective response initially emerged in cortical areas surrounding the Sylvian fissure: anterior superior temporal sulcus, ventral premotor cortex, the anterior part of intraparietal sulcus and insula. Later within this interval, activation additionally spread to more anterior higher-tier brain regions, and reached the left temporal pole and the triangular part of the left inferior frontal gyrus extending to its orbital part. Altogether, current findings evidence rapid plastic changes in cortical representations of meaningful auditory word-forms occurring almost immediately after learning. Additionally, our results suggest that familiarization resulting from stimulus repetition and semantic acquisition resulting from an active learning procedure have separable effects on cortical activity.
Collapse
Affiliation(s)
- Alexandra M Razorenova
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Center for Computational and Data-Intensive Science and Engineering (CDISE), Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Boris V Chernyshev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Department of Psychology, Higher School of Economics, Moscow, Russia
- Department of Higher Nervous Activity, Lomonosov Moscow State University, Moscow, Russia
| | - Anastasia Yu Nikolaeva
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Anna V Butorina
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Center for Computational and Data-Intensive Science and Engineering (CDISE), Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Andrey O Prokofyev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Nikita B Tyulenev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Tatiana A Stroganova
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| |
Collapse
|
30
|
Møller MLH, Højlund A, Jensen M, Gansonre C, Shtyrov Y. Applied potential of task-free event-related paradigms for assessing neurocognitive functions in disorders of consciousness. Brain Commun 2020; 2:fcaa087. [PMID: 33134912 PMCID: PMC7585695 DOI: 10.1093/braincomms/fcaa087] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Revised: 04/21/2020] [Accepted: 04/29/2020] [Indexed: 12/17/2022] Open
Abstract
Diagnosing patients with disorders of consciousness is immensely difficult and often results in misdiagnoses, which can have fatal consequences. Despite the severity of this well-known issue, a reliable assessment tool has not yet been developed and implemented in the clinic. The main aim of this focused review is to evaluate the various event-related potential paradigms, recorded using EEG, which may be used to improve the assessment of patients with disorders of consciousness; we also provide a brief comparison of these paradigms with other measures. Notably, most event-related potential studies on the topic have focused on testing a small set of components, or even just a single component. However, to be of practical use, we argue that an assessment should probe a range of cognitive and linguistic functions at once. We suggest a novel approach that combines a set of well-tested auditory event-related potential components: N100, mismatch negativity, P3a, N400, early left anterior negativity and lexical response enhancement. Combining these components in a single, task-free design will provide a multidimensional assessment of cognitive and linguistic processes, which may help physicians make a more precise diagnosis.
Collapse
Affiliation(s)
- Marie Louise Holm Møller
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Andreas Højlund
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Mads Jensen
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Christelle Gansonre
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| |
Collapse
|
31
|
Zhang LL, Zhong YQ, Sun JW, Chen L, Sun JQ, Hou XY, Chen JW, Guo XT. Deficit of long-term memory traces for words in children with cochlear implants. Clin Neurophysiol 2020; 131:1323-1331. [DOI: 10.1016/j.clinph.2020.03.012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Revised: 03/04/2020] [Accepted: 03/09/2020] [Indexed: 01/06/2023]
|
32
|
Cope TE, Shtyrov Y, MacGregor LJ, Holland R, Pulvermüller F, Rowe JB, Patterson K. Anterior temporal lobe is necessary for efficient lateralised processing of spoken word identity. Cortex 2020; 126:107-118. [PMID: 32065956 PMCID: PMC7253293 DOI: 10.1016/j.cortex.2019.12.025] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2019] [Revised: 10/22/2019] [Accepted: 12/19/2019] [Indexed: 12/11/2022]
Abstract
In the healthy human brain, the processing of language is strongly lateralised, usually to the left hemisphere, while the processing of complex non-linguistic sounds recruits brain regions bilaterally. Here we asked whether the anterior temporal lobes, strongly implicated in semantic processing, are critical to this special treatment of spoken words. Nine patients with semantic dementia (SD) and fourteen age-matched controls underwent magnetoencephalography and structural MRI. Voxel based morphometry demonstrated the stereotypical pattern of SD: severe grey matter loss restricted to the anterior temporal lobes, with the left side more affected. During magnetoencephalography, participants listened to word sets in which identity and meaning were ambiguous until word completion, for example PLAYED versus PLATE. Whereas left-hemispheric responses were similar across groups, patients demonstrated increased right hemisphere activity 174-294 msec after stimulus disambiguation. Source reconstructions confirmed recruitment of right-sided analogues of language regions in SD: atrophy of anterior temporal lobes was associated with increased activity in right temporal pole, middle temporal gyrus, inferior frontal gyrus and supramarginal gyrus. Overall, the results indicate that anterior temporal lobes are necessary for normal and efficient lateralised processing of word identity by the language network.
Collapse
Affiliation(s)
- Thomas E Cope
- Department of Clinical Neurosciences, University of Cambridge, UK; MRC Cognition and Brain Sciences Unit, University of Cambridge, UK.
| | - Yury Shtyrov
- MRC Cognition and Brain Sciences Unit, University of Cambridge, UK; Center of Functionally Integrative Neuroscience, Aarhus University, Denmark; Institute for Cognitive Neuroscience, NRU Higher School of Economics, Moscow, Russia
| | - Lucy J MacGregor
- MRC Cognition and Brain Sciences Unit, University of Cambridge, UK
| | - Rachel Holland
- MRC Cognition and Brain Sciences Unit, University of Cambridge, UK; Division of Language and Communication Science, City University London, UK
| | - Friedemann Pulvermüller
- MRC Cognition and Brain Sciences Unit, University of Cambridge, UK; Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Germany
| | - James B Rowe
- Department of Clinical Neurosciences, University of Cambridge, UK; MRC Cognition and Brain Sciences Unit, University of Cambridge, UK
| | - Karalyn Patterson
- Department of Clinical Neurosciences, University of Cambridge, UK; MRC Cognition and Brain Sciences Unit, University of Cambridge, UK
| |
Collapse
|
33
|
Liu Z, Shu S, Lu L, Ge J, Gao JH. Spatiotemporal dynamics of predictive brain mechanisms during speech processing: an MEG study. BRAIN AND LANGUAGE 2020; 203:104755. [PMID: 32007671 DOI: 10.1016/j.bandl.2020.104755] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 12/09/2019] [Accepted: 01/15/2020] [Indexed: 06/10/2023]
Abstract
Rapid and efficient speech processing benefits from the prediction derived from prior expectations based on the identification of individual words. It is known that speech processing is carried out within a distributed frontotemporal network. However, the spatiotemporal causal dynamics of predictive brain mechanisms in sound-to-meaning mapping within this network remain unclear. Using magnetoencephalography, we adopted a semantic anomaly paradigm which consists of expected, unexpected and time-reversed Mandarin Chinese speech, and localized the effects of violated expectation in frontotemporal brain regions, the sensorimotor cortex and the supramarginal gyrus from 250 ms relative to the target words. By further investigating the causal cortical dynamics, we provided the description of the causal dynamic network within the framework of the dual stream model, and highlighted the importance of the connections within the ventral pathway, the top-down modulation from the left inferior frontal gyrus and the cross-stream integration during the speech processing of violated expectation.
Collapse
Affiliation(s)
- Zhaowei Liu
- Beijing City Key Lab for Medical Physics and Engineering, Institution of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Su Shu
- Beijing City Key Lab for Medical Physics and Engineering, Institution of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Lingxi Lu
- Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China
| | - Jianqiao Ge
- Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China.
| | - Jia-Hong Gao
- Beijing City Key Lab for Medical Physics and Engineering, Institution of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China.
| |
Collapse
|
34
|
Balkenhol T, Wallhäusser-Franke E, Rotter N, Servais JJ. Changes in Speech-Related Brain Activity During Adaptation to Electro-Acoustic Hearing. Front Neurol 2020; 11:161. [PMID: 32300327 PMCID: PMC7145411 DOI: 10.3389/fneur.2020.00161] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Accepted: 02/19/2020] [Indexed: 12/17/2022] Open
Abstract
Objectives: Hearing improves significantly with bimodal provision, i.e., a cochlear implant (CI) at one ear and a hearing aid (HA) at the other, but performance shows a high degree of variability resulting in substantial uncertainty about the performance that can be expected by the individual CI user. The objective of this study was to explore how auditory event-related potentials (AERPs) of bimodal listeners in response to spoken words approximate the electrophysiological response of normal hearing (NH) listeners. Study Design: Explorative prospective analysis during the first 6 months of bimodal listening using a within-subject repeated measures design. Setting: Academic tertiary care center. Participants: Twenty-seven adult participants with bilateral sensorineural hearing loss who received a HiRes 90K CI and continued use of a HA at the non-implanted ear. Age-matched NH listeners served as controls. Intervention: Cochlear implantation. Main Outcome Measures: Obligatory auditory evoked potentials N1 and P2, and the event-related N2 potential in response to monosyllabic words and their reversed sound traces before, as well as 3 and 6 months post-implantation. The task required word/non-word classification. Stimuli were presented within speech-modulated noise. Loudness of word/non-word signals was adjusted individually to achieve the same intelligibility across groups and assessments. Results: Intelligibility improved significantly with bimodal hearing, and the N1-P2 response approximated the morphology seen in NH with enhanced and earlier responses to the words compared to their reversals. For bimodal listeners, a prominent negative deflection was present between 370 and 570 ms post stimulus onset (N2), irrespective of stimulus type. This was absent for NH controls; hence, this response did not approximate the NH response during the study interval. N2 source localization evidenced extended activation of general cognitive areas in frontal and prefrontal brain areas in the CI group. Conclusions: Prolonged and spatially extended processing in bimodal CI users suggests employment of additional auditory-cognitive mechanisms during speech processing. This does not reduce within 6 months of bimodal experience and may be a correlate of the enhanced listening effort described by CI listeners.
Collapse
|
35
|
López Zunini RA, Baart M, Samuel AG, Armstrong BC. Lexical access versus lexical decision processes for auditory, visual, and audiovisual items: Insights from behavioral and neural measures. Neuropsychologia 2020; 137:107305. [PMID: 31838100 DOI: 10.1016/j.neuropsychologia.2019.107305] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Revised: 09/17/2019] [Accepted: 12/11/2019] [Indexed: 11/30/2022]
Abstract
In two experiments, we investigated the relationship between lexical access processes, and processes that are specifically related to making lexical decisions. In Experiment 1, participants performed a standard lexical decision task in which they had to respond as quickly and as accurately as possible to visual (written), auditory (spoken) and audiovisual (written + spoken) items. In Experiment 2, a different group of participants performed the same task but were required to make responses after a delay. Linear mixed effect models on reaction times and single trial Event-Related Potentials (ERPs) revealed that ERP lexicality effects started earlier in the visual than auditory modality, and that effects were driven by the written input in the audiovisual modality. More negative ERP amplitudes predicted slower reaction times in all modalities in both experiments. However, these predictive amplitudes were mainly observed within the window of the lexicality effect in Experiment 1 (the speeded task), and shifted to post-response-probe time windows in Experiment 2 (the delayed task). The lexicality effects lasted longer in Experiment 1 than in Experiment 2, and in the delayed task, we additionally observed a "re-instantiation" of the lexicality effect related to the delayed response. Delaying the response in an otherwise identical lexical decision task thus allowed us to separate lexical access processes from processes specific to lexical decision.
Collapse
Affiliation(s)
| | - Martijn Baart
- BCBL, Basque Center on Cognition, Brain and Language, San Sebastian, Spain; Tilburg University, Dept. of Cognitive Neuropsychology, Tilburg, the Netherlands
| | - Arthur G Samuel
- BCBL, Basque Center on Cognition, Brain and Language, San Sebastian, Spain; IKERBASQUE, Basque Foundation for Science, Spain; Stony Brook University, Dept. of Psychology, Stony Brook, NY, United States
| | - Blair C Armstrong
- BCBL, Basque Center on Cognition, Brain and Language, San Sebastian, Spain; University of Toronto, Dept. of Psychology and Centre for French & Linguistics, Toronto, ON, Canada
| |
Collapse
|
36
|
Niesen M, Vander Ghinst M, Bourguignon M, Wens V, Bertels J, Goldman S, Choufani G, Hassid S, De Tiège X. Tracking the Effects of Top-Down Attention on Word Discrimination Using Frequency-tagged Neuromagnetic Responses. J Cogn Neurosci 2020; 32:877-888. [PMID: 31933439 DOI: 10.1162/jocn_a_01522] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Discrimination of words from nonspeech sounds is essential in communication. Still, how selective attention can influence this early step of speech processing remains elusive. To answer that question, brain activity was recorded with magnetoencephalography in 12 healthy adults while they listened to two sequences of auditory stimuli presented at 2.17 Hz, consisting of successions of one randomized word (tagging frequency = 0.54 Hz) and three acoustically matched nonverbal stimuli. Participants were instructed to focus their attention on the occurrence of a predefined word in the verbal attention condition and on a nonverbal stimulus in the nonverbal attention condition. Steady-state neuromagnetic responses were identified with spectral analysis at sensor and source levels. Significant sensor responses peaked at 0.54 and 2.17 Hz in both conditions. Sources at 0.54 Hz were reconstructed in supratemporal auditory cortex, left superior temporal gyrus (STG), left middle temporal gyrus, and left inferior frontal gyrus. Sources at 2.17 Hz were reconstructed in supratemporal auditory cortex and STG. Crucially, source strength in the left STG at 0.54 Hz was significantly higher in verbal attention than in nonverbal attention condition. This study demonstrates speech-sensitive responses at primary auditory and speech-related neocortical areas. Critically, it highlights that, during word discrimination, top-down attention modulates activity within the left STG. This area therefore appears to play a crucial role in selective verbal attentional processes for this early step of speech processing.
Collapse
|
37
|
Gao X, Yan TT, Tang DL, Huang T, Shu H, Nan Y, Zhang YX. What Makes Lexical Tone Special: A Reverse Accessing Model for Tonal Speech Perception. Front Psychol 2020; 10:2830. [PMID: 31920863 PMCID: PMC6930229 DOI: 10.3389/fpsyg.2019.02830] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Accepted: 11/29/2019] [Indexed: 11/13/2022] Open
Abstract
Previous studies of tonal speech perception have generally suggested harder or later access to lexical tone than segmental information, but the mechanism underlying the lexical tone disadvantage is unclear. Using a speeded discrimination paradigm free of context information, we confirmed multiple lines of evidence for the lexical tone disadvantage as well as revealed a distinctive advantage of word and atonal syllable judgments over phoneme and lexical tone judgments. The results led us to propose a Reverse Accessing Model (RAM) for tonal speech perception. The RAM is an extension of the influential TRACE model, with two additional processing levels specialized for tonal speech: lexical tone and atonal syllable. Critically, information accessing is assumed to be in reverse order of information processing, and only information at the syllable level and up is maintained active for immediate use. We tested and confirmed the predictions of the RAM on discrimination of each type of phonological component under different stimulus conditions. The current results have thus demonstrated the capability of the RAM as a general framework for tonal speech perception to provide a united account for empirical observations as well as to generate testable predictions.
Collapse
Affiliation(s)
- Xiang Gao
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Ting-Ting Yan
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Ding-Lan Tang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Ting Huang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Hua Shu
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Yun Nan
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Yu-Xuan Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| |
Collapse
|
38
|
Conner CR, Kadipasaoglu CM, Shouval HZ, Hickok G, Tandon N. Network dynamics of Broca's area during word selection. PLoS One 2019; 14:e0225756. [PMID: 31860640 PMCID: PMC6924671 DOI: 10.1371/journal.pone.0225756] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2018] [Accepted: 11/12/2019] [Indexed: 11/18/2022] Open
Abstract
Current models of word-production in Broca's area (i.e. left ventro-lateral prefrontal cortex, VLPFC) posit that sequential and staggered semantic, lexical, phonological and articulatory processes precede articulation. Using millisecond-resolution intra-cranial recordings, we evaluated spatiotemporal dynamics and high frequency functional interconnectivity between left VLPFC regions during single-word production. Through the systematic variation of retrieval, selection, and phonological loads, we identified specific activation profiles and functional coupling patterns between these regions that fit within current psycholinguistic theories of word production. However, network interactions underpinning these processes activate in parallel (not sequentially), while the processes themselves are indexed by specific changes in network state. We found evidence that suggests that pars orbitalis is coupled with pars triangularis during lexical retrieval, while lexical selection is terminated via coupled activity with M1 at articulation onset. Taken together, this work reveals that speech production relies on very specific inter-regional couplings in rapid sequence in the language dominant hemisphere.
Collapse
Affiliation(s)
- Christopher R. Conner
- Vivian L Smith Department of Neurosurgery, University of Texas Medical School at Houston, Houston, TX, United States of America
- Mischer Neuroscience Institute, Memorial Hermann Hospital, Houston, Texas, United States of America
| | - Cihan M. Kadipasaoglu
- Vivian L Smith Department of Neurosurgery, University of Texas Medical School at Houston, Houston, TX, United States of America
| | - Harel Z. Shouval
- Department of Neurobiology and Anatomy, University of Texas Medical School at Houston, Houston, TX, United States of America
| | - Gregory Hickok
- Department of Cognitive Sciences, University of California, Irvine, CA, United States of America
| | - Nitin Tandon
- Vivian L Smith Department of Neurosurgery, University of Texas Medical School at Houston, Houston, TX, United States of America
- Mischer Neuroscience Institute, Memorial Hermann Hospital, Houston, Texas, United States of America
| |
Collapse
|
39
|
Kowialiewski B, Van Calster L, Attout L, Phillips C, Majerus S. Neural Patterns in Linguistic Cortices Discriminate the Content of Verbal Working Memory. Cereb Cortex 2019; 30:2997-3014. [PMID: 31813984 DOI: 10.1093/cercor/bhz290] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Revised: 09/16/2019] [Accepted: 06/17/2019] [Indexed: 01/11/2023] Open
Abstract
An influential theoretical account of working memory (WM) considers that WM is based on direct activation of long-term memory knowledge. While there is empirical support for this position in the visual WM domain, direct evidence is scarce in the verbal WM domain. This question is critical for models of verbal WM, as the question of whether short-term maintenance of verbal information relies on direct activation within the long-term linguistic knowledge base or not is still debated. In this study, we examined the extent to which short-term maintenance of lexico-semantic knowledge relies on neural activation patterns in linguistic cortices, and this by using a fast encoding running span task for word and nonword stimuli minimizing strategic encoding mechanisms. Multivariate analyses showed specific neural patterns for the encoding and maintenance of word versus nonword stimuli. These patterns were not detectable anymore when participants were instructed to stop maintaining the memoranda. The patterns involved specific regions within the dorsal and ventral pathways, which are considered to support phonological and semantic processing to various degrees. This study provides novel evidence for a role of linguistic cortices in the representation of long-term memory linguistic knowledge during WM processing.
Collapse
Affiliation(s)
- Benjamin Kowialiewski
- University of Liège, Liège, Belgium.,Fund for Scientific Research-F.R.S.-FNRS, Brussels, Belgium
| | - Laurens Van Calster
- University of Liège, Liège, Belgium.,University of Geneva, Geneva, Switzerland
| | | | - Christophe Phillips
- University of Liège, Liège, Belgium.,Fund for Scientific Research-F.R.S.-FNRS, Brussels, Belgium
| | - Steve Majerus
- University of Liège, Liège, Belgium.,Fund for Scientific Research-F.R.S.-FNRS, Brussels, Belgium
| |
Collapse
|
40
|
Grisoni L, Moseley RL, Motlagh S, Kandia D, Sener N, Pulvermüller F, Roepke S, Mohr B. Prediction and Mismatch Negativity Responses Reflect Impairments in Action Semantic Processing in Adults With Autism Spectrum Disorders. Front Hum Neurosci 2019; 13:395. [PMID: 31798432 PMCID: PMC6868096 DOI: 10.3389/fnhum.2019.00395] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Accepted: 10/22/2019] [Indexed: 02/05/2023] Open
Abstract
The neurophysiological mechanisms underlying motor and language difficulties in autism spectrum disorders (ASD) are still largely unclear. The present work investigates biological indicators of sound processing, (action-) semantic understanding and predictive coding and their correlation with clinical symptoms of ASD. Twenty-two adults with high-functioning ASD and 25 typically developed (TD) participants engaged in an auditory, passive listening, Mismatch Negativity (MMN) task while high-density electroencephalography (EEG) was recorded. Action and non-action words were presented in the context of sounds, which were either semantically congruent with regard to the body part they relate to or semantically incongruent or unrelated. The anticipatory activity before sound onset, the Prediction Potential (PP), was significantly reduced in the ASD group specifically for action, but not for non-action sounds. The early-MMN-like responses to words (latency: 120 ms) were differentially modulated across groups: controls showed larger amplitudes for words in action-sound compared to non-action contexts, whereas ASD participants demonstrated enlarged early-MMN-like responses only in a pure tone context, with no other modulation dependent on action sound context. Late-MMN-like responses around 560 ms post-stimulus onset revealed body-part-congruent action-semantic priming for words in control participants, but not in the ASD group. Importantly, neurophysiological indices of semantic priming in ASD participants correlated with the extent of autistic traits as revealed by the Autism Spectrum Quotient (AQ). The data suggest that high-functioning adults with ASD show a specific deficit in semantic processing and predictive coding of sounds and words related to action, which is absent for neutral, non-action, sounds.
Collapse
Affiliation(s)
- Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany
| | - Rachel L Moseley
- Department of Psychology, University of Bournemouth, Poole, United Kingdom
| | - Shiva Motlagh
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany
| | - Dimitra Kandia
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany.,Department of Neurology, Max Planck Institute for Human and Brain Sciences, Leipzig, Germany
| | - Neslihan Sener
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany.,Einstein Center for Neurosciences, Berlin, Germany
| | - Stefan Roepke
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, Campus Benjamin Franklin, Berlin, Germany
| | - Bettina Mohr
- Department of Psychiatry, Charité-Universitätsmedizin Berlin, Campus Benjamin Franklin, Berlin, Germany.,Zentrum für Neuropsychologie und Intensive Sprachtherapie (ZeNIS), Berlin, Germany
| |
Collapse
|
41
|
Zhang G, Si Y, Dang J. Revealing the Dynamic Brain Connectivity from Perception of Speech Sound to Semantic Processing by EEG. Neuroscience 2019; 415:70-76. [PMID: 31330232 DOI: 10.1016/j.neuroscience.2019.07.023] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Revised: 06/25/2019] [Accepted: 07/11/2019] [Indexed: 01/10/2023]
Abstract
Understanding brain processing mechanisms from the perception of speech sounds to high-level semantic processing is vital for effective human-robot communication. In this study, 128-channel electroencephalograph (EEG) signals were recorded when subjects were listening to real and pseudowords in Mandarin. By using an EEG source reconstruction method and a sliding-window Granger causality analysis, we analyzed the dynamic brain connectivity patterns. Results showed that the bilateral temporal cortex (lTC and rTC), the bilateral motor cortex (lMC and rMC), the frontal cortex (FC), and the occipital cortex (OC) were recruited in the process, with complex patterns in the real word condition than in the pseudoword condition. The spatial pattern is basically consistent with previous functional MRI studies on the understanding of spoken Chinese. For the real word condition, speech perception and processing involved different connection patterns in the initial phoneme perception and processing phase, the phonological processing and lexical selection phase, and the semantic integration phase. Specifically, compared with pseudowords, a hub region in the FC and unique patterns of lMC → rMC and lTC → FC connectivity were found during processing real words after 180 ms, while a distributed network of temporal, motor, and frontal brain areas was involved after 300 ms. This may be related to semantic processing and integration. The involvement of both bottom-up input and top-down modulation in real word processing may support the previously proposed TRACE model. In sum, the findings of this study suggest that representations of speech involve dynamic interactions among distributed brain regions that communicate through time-specific functional networks.
Collapse
Affiliation(s)
- Gaoyan Zhang
- College of Intelligence and Computing, Tianjin Key lab of Cognitive Computing and Application, Tianjin University, Tianjin, China.
| | - Yuke Si
- College of Intelligence and Computing, Tianjin Key lab of Cognitive Computing and Application, Tianjin University, Tianjin, China
| | - Jianwu Dang
- College of Intelligence and Computing, Tianjin Key lab of Cognitive Computing and Application, Tianjin University, Tianjin, China; School of Information Science, Japan Advanced Institute of Science and Technology, Japan.
| |
Collapse
|
42
|
Jensen M, Hyder R, Shtyrov Y. MVPA Analysis of Intertrial Phase Coherence of Neuromagnetic Responses to Words Reliably Classifies Multiple Levels of Language Processing in the Brain. eNeuro 2019; 6:ENEURO.0444-18.2019. [PMID: 31383728 PMCID: PMC6709219 DOI: 10.1523/eneuro.0444-18.2019] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Revised: 05/30/2019] [Accepted: 06/28/2019] [Indexed: 11/21/2022] Open
Abstract
Neural processing of language is still among the most poorly understood functions of the human brain, whereas a need to objectively assess the neurocognitive status of the language function in a participant-friendly and noninvasive fashion arises in various situations. Here, we propose a solution for this based on a short task-free recording of MEG responses to a set of spoken linguistic contrasts. We used spoken stimuli that diverged lexically (words/pseudowords), semantically (action-related/abstract), or morphosyntactically (grammatically correct/ungrammatical). Based on beamformer source reconstruction we investigated intertrial phase coherence (ITPC) in five canonical bands (α, β, and low, medium, and high γ) using multivariate pattern analysis (MVPA). Using this approach, we could successfully classify brain responses to meaningful words from meaningless pseudowords, correct from incorrect syntax, as well as semantic differences. The best classification results indicated distributed patterns of activity dominated by core temporofrontal language circuits and complemented by other areas. They varied between the different neurolinguistic properties across frequency bands, with lexical processes classified predominantly by broad γ, semantic distinctions by α and β, and syntax by low γ feature patterns. Crucially, all types of processing commenced in a near-parallel fashion from ∼100 ms after the auditory information allowed for disambiguating the spoken input. This shows that individual neurolinguistic processes take place simultaneously and involve overlapping yet distinct neuronal networks that operate at different frequency bands. This brings further hope that brain imaging can be used to assess neurolinguistic processes objectively and noninvasively in a range of populations.
Collapse
Affiliation(s)
- Mads Jensen
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark
| | - Rasha Hyder
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, St. Petersburg, 199034, Russia
| |
Collapse
|
43
|
Emotional prosody Stroop effect in Hindi: An event related potential study. PROGRESS IN BRAIN RESEARCH 2019. [PMID: 31196434 DOI: 10.1016/bs.pbr.2019.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register]
Abstract
Prosody processing is an important aspect of language comprehension. Previous research on emotional word-prosody conflict has shown that participants are worse when emotional prosody and word meaning are incongruent. Studies with event-related potentials have shown a congruency effect in N400 component. There has been no study on emotional processing in Hindi language in the context of conflict between emotional word meaning and prosody. We used happy and angry words spoken using happy and angry prosody. Participants had to identify whether the word had a happy or angry word meaning. The results showed a congruency effect with worse performance in incongruent trials indicating an emotional Stroop effect in Hindi. The ERP results showed that prosody information is detected very early, which can be seen in the N1 component. In addition, there was a congruency effect in N400. The results show that prosody is processed very early and emotional meaning-prosody congruency effect is obtained with Hindi. Further studies would be needed to investigate similarities and differences in cognitive control associated with language processing.
Collapse
|
44
|
Shtyrov Y, Kirsanov A, Shcherbakova O. Explicitly Slow, Implicitly Fast, or the Other Way Around? Brain Mechanisms for Word Acquisition. Front Hum Neurosci 2019; 13:116. [PMID: 31080410 PMCID: PMC6497805 DOI: 10.3389/fnhum.2019.00116] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2018] [Accepted: 03/19/2019] [Indexed: 11/13/2022] Open
Affiliation(s)
- Yury Shtyrov
- Department of Clinical Medicine, Center of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
| | - Alexander Kirsanov
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
- Department of General Psychology, Faculty of Psychology, Saint Petersburg State University, Saint Petersburg, Russia
| | - Olga Shcherbakova
- Laboratory of Behavioural Neurodynamics, Saint Petersburg State University, Saint Petersburg, Russia
- Department of General Psychology, Faculty of Psychology, Saint Petersburg State University, Saint Petersburg, Russia
| |
Collapse
|
45
|
Silva S, Vigário M, Fernandez BL, Jerónimo R, Alter K, Frota S. The Sense of Sounds: Brain Responses to Phonotactic Frequency, Phonological Grammar and Lexical Meaning. Front Psychol 2019; 10:681. [PMID: 30984081 PMCID: PMC6447827 DOI: 10.3389/fpsyg.2019.00681] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2018] [Accepted: 03/11/2019] [Indexed: 11/13/2022] Open
Abstract
Two outstanding questions in spoken-language comprehension concern (1) the interplay of phonological grammar (legal vs. illegal sound sequences), phonotactic frequency (high- vs. low-frequency sound sequences) and lexicality (words vs. other sound sequences) in a meaningful context, and (2) how the properties of phonological sequences determine their inclusion or exclusion from lexical-semantic processing. In the present study, we used a picture-sound priming paradigm to examine the ERP responses of adult listeners to grammatically illegal sound sequences, to grammatically legal sound sequences (pseudowords) with low- vs. high-frequency, and to real words that were either congruent or incongruent to the picture context. Results showed less negative N1-P2 responses for illegal sequences and low-frequency pseudowords (with differences in topography), but not high-frequency ones. Low-frequency pseudowords also showed an increased P3 component. However, just like illegal sequences, neither low- nor high-frequency pseudowords differed from congruent words in the N400. Thus, phonotactic frequency had an impact before, but not during lexical-semantic processing. Our results also suggest that phonological grammar, phonotactic frequency and lexicality may follow each other in this order during word processing.
Collapse
Affiliation(s)
- Susana Silva
- Neurocognition and Language Group, Center for Psychology at University of Porto, Porto, Portugal
| | - Marina Vigário
- Center of Linguistics, School of Arts and Humanities, University of Lisbon, Lisbon, Portugal
| | | | - Rita Jerónimo
- Instituto Universitário de Lisboa (ISCTE-IUL), CIS-IUL, Lisbon, Portugal
| | - Kai Alter
- Center of Linguistics, School of Arts and Humanities, University of Lisbon, Lisbon, Portugal
- Institute of Neuroscience, Newcastle University, Newcastle upon Tyne, United Kingdom
| | - Sónia Frota
- Center of Linguistics, School of Arts and Humanities, University of Lisbon, Lisbon, Portugal
| |
Collapse
|
46
|
Casadei E, Salinas I. Comparative models for human nasal infections and immunity. DEVELOPMENTAL AND COMPARATIVE IMMUNOLOGY 2019; 92:212-222. [PMID: 30513304 PMCID: PMC7102639 DOI: 10.1016/j.dci.2018.11.022] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/01/2018] [Revised: 11/30/2018] [Accepted: 11/30/2018] [Indexed: 05/09/2023]
Abstract
The human olfactory system is a mucosal surface and a major portal of entry for respiratory and neurotropic pathogens into the body. Understanding how the human nasopharynx-associated lymphoid tissue (NALT) halts the progression of pathogens into the lower respiratory tract or the central nervous system is key for developing effective cures. Although traditionally mice have been used as the gold-standard model for the study of human nasal diseases, mouse models present important caveats due to major anatomical and functional differences of the human and murine olfactory system and NALT. We summarize the NALT anatomy of different animal groups that have thus far been used to study host-pathogen interactions at the olfactory mucosa and to test nasal vaccines. The goal of this review is to highlight the strengths and limitations of each animal model of nasal immunity and to identify the areas of research that require further investigation to advance human health.
Collapse
Affiliation(s)
- Elisa Casadei
- University of New Mexico, Department of Biology, Center for Evolutionary and Theoretical Immunology (CETI), Albuquerque, NM, USA.
| | - Irene Salinas
- University of New Mexico, Department of Biology, Center for Evolutionary and Theoretical Immunology (CETI), Albuquerque, NM, USA
| |
Collapse
|
47
|
Do ‘early’ brain responses reveal word form prediction during language comprehension? A critical review. Neurosci Biobehav Rev 2019; 96:367-400. [DOI: 10.1016/j.neubiorev.2018.11.019] [Citation(s) in RCA: 63] [Impact Index Per Article: 12.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2018] [Revised: 10/01/2018] [Accepted: 11/27/2018] [Indexed: 11/23/2022]
|
48
|
Diminished brain responses to second-language words are linked with native-language literacy skills in dyslexia. Neuropsychologia 2019; 122:105-115. [DOI: 10.1016/j.neuropsychologia.2018.11.005] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Revised: 11/02/2018] [Accepted: 11/07/2018] [Indexed: 11/18/2022]
|
49
|
Partanen EJ, Leminen A, Cook C, Shtyrov Y. Formation of neocortical memory circuits for unattended written word forms: neuromagnetic evidence. Sci Rep 2018; 8:15829. [PMID: 30361630 PMCID: PMC6202413 DOI: 10.1038/s41598-018-34029-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2018] [Accepted: 10/08/2018] [Indexed: 11/22/2022] Open
Abstract
To master linguistic communication, humans must acquire large vocabularies quickly and effortlessly. Efficient word learning might be facilitated by the ability to rapidly acquire novel word forms even outside the focus of attention, occurring within minutes of repetitive exposure and suggesting fast and automatic lexicon acquisition. However, this phenomenon has been studied in the auditory modality only, and it is unknown whether similar mechanisms also exist in the visual domain. We tested this by presenting participants with novel written word forms while the focus of their attention was on a non-linguistic dual colour-detection task. Matched familiar word forms served as a control. Using magnetoencephalography (MEG), we scrutinised changes in neuromagnetic responses to familiar and to novel word forms over approximately 15 minutes of exposure. We found, for the first time, a visual analogue of automatic rapid build-up of neural memory circuits for unattended novel lexical items, seen as a rapid enhancement of early (~100 ms post-onset) activation in the left anterior-superior temporal lobe. Our results suggest that the brain quickly forms cortical representations for new written forms, and indicate that the automatic neural mechanisms subserving rapid online acquisition of novel linguistic information might be shared by both auditory and visual modalities.
Collapse
Affiliation(s)
- Eino J Partanen
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University Hospital, Denmark (Aarhus University Hospital, Nørrebrogade 44, Building 10G, 5th floor, 8000, Aarhus C, Denmark. .,Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland (PO Box 9 (Haartmaninkatu 3), FI-00014, Helsinki, Finland.
| | - Alina Leminen
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University Hospital, Denmark (Aarhus University Hospital, Nørrebrogade 44, Building 10G, 5th floor, 8000, Aarhus C, Denmark.,Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland (PO Box 9 (Haartmaninkatu 3), FI-00014, Helsinki, Finland
| | - Clare Cook
- MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, England
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University Hospital, Denmark (Aarhus University Hospital, Nørrebrogade 44, Building 10G, 5th floor, 8000, Aarhus C, Denmark.,St. Petersburg State University, St. Petersburg, Russian Federation.,MRC Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, England
| |
Collapse
|
50
|
Koppehele-Gossel J, Schnuerch R, Gibbons H. The posterior semantic asymmetry (PSA): specific to written not auditory semantic word processing. Exp Brain Res 2018; 236:3327-3340. [PMID: 30255197 DOI: 10.1007/s00221-018-5379-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Accepted: 09/18/2018] [Indexed: 01/23/2023]
Abstract
The present study replicates the finding of a posterior semantic asymmetry (PSA; Koppehele-Gossel et al., Brain Lang 157-158:35-43, 2016), a lateralized event-related potential (ERP) suggested to reflect semantic activation from visually presented single words. This ERP negativity, derived from the subtraction of right-side from left-side scalp activity, again peaked around 300 ms at temporoparietal electrodes and was more pronounced in a semantic task, compared to both a silent naming task and a passive viewing task. With analogous tasks, no comparable negativity was found for auditorily presented words. This suggests that the PSA specifically reflects visual-verbal semantic activation. For auditory words, a later variation with the demands on semantic processing was observed for a left-lateralized late positive potential (500-800 ms), which, however, showed a remarkably similar topography as the PSA. Thus, while semantic processing of visual and auditory words converges on left temporoparietal brain areas, the exact patterns of brain electrical activation in terms of time course and polarity are different.
Collapse
Affiliation(s)
| | - Robert Schnuerch
- Department of Psychology, University of Bonn, Kaiser-Karl-Ring 9, 53111, Bonn, Germany
| | - Henning Gibbons
- Department of Psychology, University of Bonn, Kaiser-Karl-Ring 9, 53111, Bonn, Germany
| |
Collapse
|