51
|
Catani M. The connectional anatomy of the temporal lobe. HANDBOOK OF CLINICAL NEUROLOGY 2022; 187:3-16. [PMID: 35964979 DOI: 10.1016/b978-0-12-823493-8.00001-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The idea of a temporal lobe separated from the rest of the hemisphere by reason of its unique structural and functional properties is a clinically useful artifact. While the temporal lobe can be safely defined as the portion of the cerebrum lodged in the middle cranial fossa, the pattern of its connections is a more revealing description of its functional subdivisions and specific contribution to higher cognitive functions. This chapter provides an historical overview of the anatomy of the temporal lobe and an updated framework of temporal lobe connections based on tractography studies of human and nonhuman primates and patients with brain disorders. Compared to monkeys, the human temporal lobe shows a relatively increased connectivity with perisylvian frontal and parietal regions and a set of unique intrinsic connections, which may have supported the evolution of working memory, semantic representation, and language in our species. Conversely, the decreased volume of the anterior (limbic) interhemispheric temporal connections in humans is related to a reduced reliance on olfaction and a partial transference of functions from the anterior commissure to the posterior corpus callosum. Overall the novel data from tractography suggest a revision of current dual stream models for visual and auditory processing.
Collapse
Affiliation(s)
- Marco Catani
- Natbrainlab, Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, London, United Kingdom; Department of Neuroimaging Sciences, Institute of Psychiatry, Psychology and Neuroscience, London, United Kingdom.
| |
Collapse
|
52
|
The Differences of Functional Brain Network in Processing Auditory Phonological Tasks between Cantonese-Mandarin Bilinguals and Mandarin Monolinguals. Brain Res 2022; 1780:147801. [DOI: 10.1016/j.brainres.2022.147801] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 01/18/2022] [Accepted: 01/19/2022] [Indexed: 11/18/2022]
|
53
|
Cohen L. Acquired dyslexias following temporal lesions. HANDBOOK OF CLINICAL NEUROLOGY 2022; 187:277-285. [PMID: 35964977 DOI: 10.1016/b978-0-12-823493-8.00003-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The acquisition of reading by children is supported by deep changes in the brain systems devoted to vision and language. The left temporal lobe contributes critically to both systems, and lesions affecting it may therefore cause both peripheral vision-related and central language-related reading impairments. The diversity of peripheral dyslexias reflects the anatomical and functional division of the visual cortex into early visual regions, whose lesions have a limited impact on reading; ventral regions, whose lesions are mostly associated to Pure Alexia; and dorsal regions, whose lesions may yield spatial, neglect-related, and attentional dyslexias. Similarly, central alexias reflect the broad distinction, within language processes, between phonological and lexico-semantic components. Phonological and surface dyslexias roughly result from impairment of the former and the latter processes, respectively, while deep dyslexia may be seen as the association of both. In this chapter, we review such types of acquired dyslexias, their clinical features, pathophysiology, and anatomical correlates.
Collapse
Affiliation(s)
- Laurent Cohen
- Paris Brain Institute, Hôpital de la Pitié-Salpêtrière, Paris, France.
| |
Collapse
|
54
|
Del Maschio N, Fedeli D, Garofalo G, Buccino G. Evidence for the Concreteness of Abstract Language: A Meta-Analysis of Neuroimaging Studies. Brain Sci 2021; 12:32. [PMID: 35053776 PMCID: PMC8773921 DOI: 10.3390/brainsci12010032] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 12/06/2021] [Accepted: 12/13/2021] [Indexed: 11/17/2022] Open
Abstract
The neural mechanisms subserving the processing of abstract concepts remain largely debated. Even within the embodiment theoretical framework, most authors suggest that abstract concepts are coded in a linguistic propositional format, although they do not completely deny the role of sensorimotor and emotional experiences in coding it. To our knowledge, only one recent proposal puts forward that the processing of concrete and abstract concepts relies on the same mechanisms, with the only difference being in the complexity of the underlying experiences. In this paper, we performed a meta-analysis using the Activation Likelihood Estimates (ALE) method on 33 functional neuroimaging studies that considered activations related to abstract and concrete concepts. The results suggest that (1) concrete and abstract concepts share the recruitment of the temporo-fronto-parietal circuits normally involved in the interactions with the physical world, (2) processing concrete concepts recruits fronto-parietal areas better than abstract concepts, and (3) abstract concepts recruit Broca's region more strongly than concrete ones. Based on anatomical and physiological evidence, Broca's region is not only a linguistic region mainly devoted to speech production, but it is endowed with complex motor representations of different biological effectors. Hence, we propose that the stronger recruitment of this region for abstract concepts is expression of the complex sensorimotor experiences underlying it, rather than evidence of a purely linguistic format of its processing.
Collapse
Affiliation(s)
- Nicola Del Maschio
- Faculty of Psychology, Università Vita-Salute San Raffaele, 20132 Milano, Italy; (N.D.M.); (D.F.)
| | - Davide Fedeli
- Faculty of Psychology, Università Vita-Salute San Raffaele, 20132 Milano, Italy; (N.D.M.); (D.F.)
| | - Gioacchino Garofalo
- Divisione di Neuroscienze, Università Vita-Salute San Raffaele, 20132 Milano, Italy;
- IRCCS San Raffaele, 20132 Milano, Italy
| | - Giovanni Buccino
- Divisione di Neuroscienze, Università Vita-Salute San Raffaele, 20132 Milano, Italy;
- IRCCS San Raffaele, 20132 Milano, Italy
| |
Collapse
|
55
|
Schmitt LM, Erb J, Tune S, Rysop AU, Hartwigsen G, Obleser J. Predicting speech from a cortical hierarchy of event-based time scales. SCIENCE ADVANCES 2021. [PMID: 34860554 DOI: 10.1101/2020.12.19.423616] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/05/2023]
Abstract
How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.
Collapse
Affiliation(s)
- Lea-Maria Schmitt
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Julia Erb
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Sarah Tune
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Anna U Rysop
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1 A, 04103 Leipzig, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1 A, 04103 Leipzig, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| |
Collapse
|
56
|
Schmitt LM, Erb J, Tune S, Rysop AU, Hartwigsen G, Obleser J. Predicting speech from a cortical hierarchy of event-based time scales. SCIENCE ADVANCES 2021; 7:eabi6070. [PMID: 34860554 PMCID: PMC8641937 DOI: 10.1126/sciadv.abi6070] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Accepted: 10/15/2021] [Indexed: 05/30/2023]
Abstract
How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.
Collapse
Affiliation(s)
- Lea-Maria Schmitt
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Julia Erb
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Sarah Tune
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| | - Anna U. Rysop
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1 A, 04103 Leipzig, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1 A, 04103 Leipzig, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23562 Lübeck, Germany
| |
Collapse
|
57
|
Common Grey Matter Reductions in Alcohol Use and Obsessive-Compulsive Disorders: A Metanalysis. BIOLOGICAL PSYCHIATRY GLOBAL OPEN SCIENCE 2021; 2:421-431. [DOI: 10.1016/j.bpsgos.2021.11.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Revised: 11/09/2021] [Accepted: 11/13/2021] [Indexed: 12/21/2022] Open
|
58
|
Stripeikyte G, Pereira M, Rognini G, Potheegadoo J, Blanke O, Faivre N. Increased Functional Connectivity of the Intraparietal Sulcus Underlies the Attenuation of Numerosity Estimations for Self-Generated Words. J Neurosci 2021; 41:8917-8927. [PMID: 34497152 PMCID: PMC8549530 DOI: 10.1523/jneurosci.3164-20.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 06/29/2021] [Accepted: 07/01/2021] [Indexed: 11/21/2022] Open
Abstract
Previous studies have shown that self-generated stimuli in auditory, visual, and somatosensory domains are attenuated, producing decreased behavioral and neural responses compared with the same stimuli that are externally generated. Yet, whether such attenuation also occurs for higher-level cognitive functions beyond sensorimotor processing remains unknown. In this study, we assessed whether cognitive functions such as numerosity estimations are subject to attenuation in 56 healthy participants (32 women). We designed a task allowing the controlled comparison of numerosity estimations for self-generated (active condition) and externally generated (passive condition) words. Our behavioral results showed a larger underestimation of self-generated compared with externally generated words, suggesting that numerosity estimations for self-generated words are attenuated. Moreover, the linear relationship between the reported and actual number of words was stronger for self-generated words, although the ability to track errors about numerosity estimations was similar across conditions. Neuroimaging results revealed that numerosity underestimation involved increased functional connectivity between the right intraparietal sulcus and an extended network (bilateral supplementary motor area, left inferior parietal lobule, and left superior temporal gyrus) when estimating the number of self-generated versus externally generated words. We interpret our results in light of two models of attenuation and discuss their perceptual versus cognitive origins.SIGNIFICANCE STATEMENT We perceive sensory events as less intense when they are self-generated compared with when they are externally generated. This phenomenon, called attenuation, enables us to distinguish sensory events from self and external origins. Here, we designed a novel fMRI paradigm to assess whether cognitive processes such as numerosity estimations are also subject to attenuation. When asking participants to estimate the number of words they had generated or passively heard, we found bigger underestimation in the former case, providing behavioral evidence of attenuation. Attenuation was associated with increased functional connectivity of the intraparietal sulcus, a region involved in numerosity processing. Together, our results indicate that the attenuation of self-generated stimuli is not limited to sensory consequences but is also impact cognitive processes such as numerosity estimations.
Collapse
Affiliation(s)
- Giedre Stripeikyte
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
| | - Michael Pereira
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
- Laboratoire de Psychologie et NeuroCognition, CNRS, Univ. Grenoble Alpes, CNRS, LPNC, 38000 Grenoble, France
| | - Giulio Rognini
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
| | - Jevita Potheegadoo
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
| | - Olaf Blanke
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
- Department of Neurology, University of Geneva, CH-1211 Geneva, Switzerland
| | - Nathan Faivre
- Center for Neuroprosthetics, Swiss Federal Institute of Technology (EPFL), CH-1202 Geneva, Switzerland
- Brain Mind Institute, Faculty of Life Sciences, Swiss Federal Institute of Technology (EPFL), CH-1015 Lausanne, Switzerland
- Laboratoire de Psychologie et NeuroCognition, CNRS, Univ. Grenoble Alpes, CNRS, LPNC, 38000 Grenoble, France
| |
Collapse
|
59
|
Ito T, Ohashi H, Gracco VL. Somatosensory contribution to audio-visual speech processing. Cortex 2021; 143:195-204. [PMID: 34450567 DOI: 10.1016/j.cortex.2021.07.013] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 07/20/2021] [Accepted: 07/28/2021] [Indexed: 10/20/2022]
Abstract
Recent studies have demonstrated that the auditory speech perception of a listener can be modulated by somatosensory input applied to the facial skin suggesting that perception is an embodied process. However, speech perception is a multisensory process involving both the auditory and visual modalities. It is unknown whether and to what extent somatosensory stimulation to the facial skin modulates audio-visual speech perception. If speech perception is an embodied process, then somatosensory stimulation applied to the perceiver should influence audio-visual speech processing. Using the McGurk effect (the perceptual illusion that occurs when a sound is paired with the visual representation of a different sound, resulting in the perception of a third sound) we tested the prediction using a simple behavioral paradigm and at the neural level using event-related potentials (ERPs) and their cortical sources. We recorded ERPs from 64 scalp sites in response to congruent and incongruent audio-visual speech randomly presented with and without somatosensory stimulation associated with facial skin deformation. Subjects judged whether the production was /ba/ or not under all stimulus conditions. In the congruent audio-visual condition subjects identifying the sound as /ba/, but not in the incongruent condition consistent with the McGurk effect. Concurrent somatosensory stimulation improved the ability of participants to more correctly identify the production as /ba/ relative to the non-somatosensory condition in both congruent and incongruent conditions. ERP in response to the somatosensory stimulation for the incongruent condition reliably diverged 220 msec after stimulation onset. Cortical sources were estimated around the left anterior temporal gyrus, the right middle temporal gyrus, the right posterior superior temporal lobe and the right occipital region. The results demonstrate a clear multisensory convergence of somatosensory and audio-visual processing in both behavioral and neural processing consistent with the perspective that speech perception is a self-referenced, sensorimotor process.
Collapse
Affiliation(s)
- Takayuki Ito
- University Grenoble-Alpes, CNRS, Grenoble-INP, GIPSA-Lab, Saint Martin D'heres Cedex, France; Haskins Laboratories, New Haven, CT, USA.
| | | | - Vincent L Gracco
- Haskins Laboratories, New Haven, CT, USA; McGill University, Montréal, QC, Canada
| |
Collapse
|
60
|
Dickens JV, DeMarco AT, van der Stelt CM, Snider SF, Lacey EH, Medaglia JD, Friedman RB, Turkeltaub PE. Two types of phonological reading impairment in stroke aphasia. Brain Commun 2021; 3:fcab194. [PMID: 34522884 PMCID: PMC8432944 DOI: 10.1093/braincomms/fcab194] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Revised: 07/18/2021] [Accepted: 07/26/2021] [Indexed: 11/12/2022] Open
Abstract
Alexia is common in the context of aphasia. It is widely agreed that damage to phonological and semantic systems not specific to reading causes co-morbid alexia and aphasia. Studies of alexia to date have only examined phonology and semantics as singular processes or axes of impairment, typically in the context of stereotyped alexia syndromes. However, phonology, in particular, is known to rely on subprocesses, including sensory-phonological processing, motor-phonological processing, and sensory-motor integration. Moreover, many people with stroke aphasia demonstrate mild or mixed patterns of reading impairment that do not fit neatly with one syndrome. This cross-sectional study tested whether the hallmark symptom of phonological reading impairment, the lexicality effect, emerges from damage to a specific subprocess of phonology in stroke patients not selected for alexia syndromes. Participants were 30 subjects with left-hemispheric stroke and 37 age- and education-matched controls. A logistic mixed-effects model tested whether post-stroke impairments in sensory phonology, motor phonology, or sensory-motor integration modulated the effect of item lexicality on patient accuracy in reading aloud. Support vector regression voxel-based lesion-symptom mapping localized brain regions necessary for reading and non-orthographic phonological processing. Additionally, a novel support vector regression structural connectome-symptom mapping method identified the contribution of both lesioned and spared but disconnected, brain regions to reading accuracy and non-orthographic phonological processing. Specifically, we derived whole-brain structural connectomes using constrained spherical deconvolution-based probabilistic tractography and identified lesioned connections based on comparisons between patients and controls. Logistic mixed-effects regression revealed that only greater motor-phonological impairment related to lower accuracy reading aloud pseudowords versus words. Impaired sensory-motor integration was related to lower overall accuracy in reading aloud. No relationship was identified between sensory-phonological impairment and reading accuracy. Voxel-based and structural connectome lesion-symptom mapping revealed that lesioned and disconnected left ventral precentral gyrus related to both greater motor-phonological impairment and lower sublexical reading accuracy. In contrast, lesioned and disconnected left temporoparietal cortex is related to both impaired sensory-motor integration and reduced overall reading accuracy. These results clarify that at least two dissociable phonological processes contribute to the pattern of reading impairment in aphasia. First, impaired sensory-motor integration, caused by lesions disrupting the left temporoparietal cortex and its structural connections, non-selectively reduces accuracy in reading aloud. Second, impaired motor-phonological processing, caused at least partially by lesions disrupting left ventral premotor cortex and structural connections, selectively reduces sublexical reading accuracy. These results motivate a revised cognitive model of reading aloud that incorporates a sensory-motor phonological circuit.
Collapse
Affiliation(s)
- Jonathan Vivian Dickens
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Aphasia Research and Rehabilitation, Georgetown University Medical Center, Washington, DC 20007, USA
| | - Andrew T DeMarco
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Aphasia Research and Rehabilitation, Georgetown University Medical Center, Washington, DC 20007, USA.,Department of Rehabilitation Medicine, Georgetown University Medical Center, Washington, DC 20007, USA
| | - Candace M van der Stelt
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC 20007, USA
| | - Sarah F Snider
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Aphasia Research and Rehabilitation, Georgetown University Medical Center, Washington, DC 20007, USA
| | - Elizabeth H Lacey
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC 20007, USA
| | - John D Medaglia
- Drexel University, Philadelphia, PA 19104, USA.,University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Rhonda B Friedman
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Aphasia Research and Rehabilitation, Georgetown University Medical Center, Washington, DC 20007, USA
| | - Peter E Turkeltaub
- Department of Neurology, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC 20007, USA.,Center for Aphasia Research and Rehabilitation, Georgetown University Medical Center, Washington, DC 20007, USA.,Department of Rehabilitation Medicine, Georgetown University Medical Center, Washington, DC 20007, USA.,Research Division, MedStar National Rehabilitation Hospital, Washington, DC 20001, USA
| |
Collapse
|
61
|
Di Dona G, Scaltritti M, Sulpizio S. Early differentiation of memory retrieval processes for newly learned voices and phonemes as indexed by the MMN. BRAIN AND LANGUAGE 2021; 220:104981. [PMID: 34166941 DOI: 10.1016/j.bandl.2021.104981] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 05/31/2021] [Accepted: 06/01/2021] [Indexed: 06/13/2023]
Abstract
Linguistic and vocal information are thought to be differentially processed since the early stages of speech perception, but it remains unclear if this differentiation also concerns automatic processes of memory retrieval. The aim of this ERP study was to compare the automatic retrieval processes for newly learned voices vs phonemes. In a longitudinal experiment, two groups of participants were trained in learning either a new phoneme or a new voice. The MMN elicited by the presentation of the two was measured before and after the training. An enhanced MMN was elicited by the presentation of the learned phoneme, reflecting the activation of an automatic memory retrieval process. Instead, a reduced MMN was elicited by the learned voice, indicating that the voice was perceived as a typical member of the learned voice identity. This suggests that the automatic processes that retrieve linguistic and vocal information are differently affected by experience.
Collapse
Affiliation(s)
- Giuseppe Di Dona
- Dipartimento di Psicologia e Scienze Cognitive, Università degli Studi di Trento, Corso Bettini 84, 38068 Rovereto (TN), Italy.
| | - Michele Scaltritti
- Dipartimento di Psicologia e Scienze Cognitive, Università degli Studi di Trento, Corso Bettini 84, 38068 Rovereto (TN), Italy.
| | - Simone Sulpizio
- Dipartimento di Psicologia, Università degli Studi di Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milano (MI), Italy; Milan Center for Neuroscience (NeuroMi), Università degli Studi di Milano-Bicocca, Piazza dell'Ateneo Nuovo 1, 20126 Milano (MI), Italy.
| |
Collapse
|
62
|
Li J, Hong B, Nolte G, Engel AK, Zhang D. Preparatory delta phase response is correlated with naturalistic speech comprehension performance. Cogn Neurodyn 2021; 16:337-352. [PMID: 35401861 PMCID: PMC8934811 DOI: 10.1007/s11571-021-09711-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 07/09/2021] [Accepted: 08/12/2021] [Indexed: 01/07/2023] Open
Abstract
While human speech comprehension is thought to be an active process that involves top-down predictions, it remains unclear how predictive information is used to prepare for the processing of upcoming speech information. We aimed to identify the neural signatures of the preparatory processing of upcoming speech. Participants selectively attended to one of two competing naturalistic, narrative speech streams, and a temporal response function (TRF) method was applied to derive event-related-like neural responses from electroencephalographic data. The phase responses to the attended speech at the delta band (1-4 Hz) were correlated with the comprehension performance of individual participants, with a latency of - 200-0 ms relative to the onset of speech amplitude envelope fluctuations over the fronto-central and left-lateralized parietal electrodes. The phase responses to the attended speech at the alpha band also correlated with comprehension performance but with a latency of 650-980 ms post-onset over the fronto-central electrodes. Distinct neural signatures were found for the attentional modulation, taking the form of TRF-based amplitude responses at a latency of 240-320 ms post-onset over the left-lateralized fronto-central and occipital electrodes. Our findings reveal how the brain gets prepared to process an upcoming speech in a continuous, naturalistic speech context.
Collapse
Affiliation(s)
- Jiawei Li
- Department of Psychology, School of Social Sciences, Tsinghua University, Room 334, Mingzhai Building, Beijing, China
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China
| | - Bo Hong
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China
| | - Guido Nolte
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg Eppendorf, Hamburg, Germany
| | - Andreas K. Engel
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg Eppendorf, Hamburg, Germany
| | - Dan Zhang
- Department of Psychology, School of Social Sciences, Tsinghua University, Room 334, Mingzhai Building, Beijing, China
- Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing, China
| |
Collapse
|
63
|
Kline AM, Aponte DA, Tsukano H, Giovannucci A, Kato HK. Inhibitory gating of coincidence-dependent sensory binding in secondary auditory cortex. Nat Commun 2021; 12:4610. [PMID: 34326331 PMCID: PMC8322099 DOI: 10.1038/s41467-021-24758-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 07/05/2021] [Indexed: 11/09/2022] Open
Abstract
Integration of multi-frequency sounds into a unified perceptual object is critical for recognizing syllables in speech. This "feature binding" relies on the precise synchrony of each component's onset timing, but little is known regarding its neural correlates. We find that multi-frequency sounds prevalent in vocalizations, specifically harmonics, preferentially activate the mouse secondary auditory cortex (A2), whose response deteriorates with shifts in component onset timings. The temporal window for harmonics integration in A2 was broadened by inactivation of somatostatin-expressing interneurons (SOM cells), but not parvalbumin-expressing interneurons (PV cells). Importantly, A2 has functionally connected subnetworks of neurons preferentially encoding harmonic over inharmonic sounds. These subnetworks are stable across days and exist prior to experimental harmonics exposure, suggesting their formation during development. Furthermore, A2 inactivation impairs performance in a discrimination task for coincident harmonics. Together, we propose A2 as a locus for multi-frequency integration, which may form the circuit basis for vocal processing.
Collapse
Affiliation(s)
- Amber M Kline
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.,Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Destinee A Aponte
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.,Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Hiroaki Tsukano
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.,Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Andrea Giovannucci
- Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.,Joint Department of Biomedical Engineering, University of North Carolina at Chapel Hill and North Carolina State University, Chapel Hill, NC, USA
| | - Hiroyuki K Kato
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA. .,Neuroscience Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA. .,Carolina Institute for Developmental Disabilities, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.
| |
Collapse
|
64
|
Khalighinejad B, Patel P, Herrero JL, Bickel S, Mehta AD, Mesgarani N. Functional characterization of human Heschl's gyrus in response to natural speech. Neuroimage 2021; 235:118003. [PMID: 33789135 PMCID: PMC8608271 DOI: 10.1016/j.neuroimage.2021.118003] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 03/23/2021] [Accepted: 03/25/2021] [Indexed: 01/11/2023] Open
Abstract
Heschl's gyrus (HG) is a brain area that includes the primary auditory cortex in humans. Due to the limitations in obtaining direct neural measurements from this region during naturalistic speech listening, the functional organization and the role of HG in speech perception remain uncertain. Here, we used intracranial EEG to directly record neural activity in HG in eight neurosurgical patients as they listened to continuous speech stories. We studied the spatial distribution of acoustic tuning and the organization of linguistic feature encoding. We found a main gradient of change from posteromedial to anterolateral parts of HG. We also observed a decrease in frequency and temporal modulation tuning and an increase in phonemic representation, speaker normalization, speech sensitivity, and response latency. We did not observe a difference between the two brain hemispheres. These findings reveal a functional role for HG in processing and transforming simple to complex acoustic features and inform neurophysiological models of speech processing in the human auditory cortex.
Collapse
Affiliation(s)
- Bahar Khalighinejad
- Mortimer B. Zuckerman Brain Behavior Institute, Columbia University, New York, NY, United States,Department of Electrical Engineering, Columbia University, New York, NY, United States
| | - Prachi Patel
- Mortimer B. Zuckerman Brain Behavior Institute, Columbia University, New York, NY, United States,Department of Electrical Engineering, Columbia University, New York, NY, United States
| | - Jose L. Herrero
- Hofstra Northwell School of Medicine, Manhasset, NY, United States,The Feinstein Institutes for Medical Research, Manhasset, NY, United States
| | - Stephan Bickel
- Hofstra Northwell School of Medicine, Manhasset, NY, United States,The Feinstein Institutes for Medical Research, Manhasset, NY, United States
| | - Ashesh D. Mehta
- Hofstra Northwell School of Medicine, Manhasset, NY, United States,The Feinstein Institutes for Medical Research, Manhasset, NY, United States
| | - Nima Mesgarani
- Mortimer B. Zuckerman Brain Behavior Institute, Columbia University, New York, NY, United States,Department of Electrical Engineering, Columbia University, New York, NY, United States,Corresponding author at: Department of Electrical Engineering, Columbia University, New York, NY, United States. (B. Khalighinejad), (P. Patel), (J.L. Herrero), (S. Bickel), (A.D. Mehta), (N. Mesgarani)
| |
Collapse
|
65
|
Zhang G, Xu LC, Zhang MF, Zou Y, He LM, Cheng YF, Zhang DS, Zhao WB, Wang XY, Wang PC, Zhang GY. Changes of the Brain Causal Connectivity Networks in Patients With Long-Term Bilateral Hearing Loss. Front Neurosci 2021; 15:628866. [PMID: 34276277 PMCID: PMC8280322 DOI: 10.3389/fnins.2021.628866] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 04/20/2021] [Indexed: 11/13/2022] Open
Abstract
It remains poorly understood how brain causal connectivity networks change following hearing loss and their effects on cognition. In the current study, we investigated this issue. Twelve patients with long-term bilateral sensorineural hearing loss [mean age, 55.7 ± 2.0; range, 39–63 years; threshold of hearing level (HL): left ear, 49.0 ± 4.1 dB HL, range, 31.25–76.25 dB HL; right ear, 55.1 ± 7.1 dB HL, range, 35–115 dB HL; the duration of hearing loss, 16.67 ± 4.5, range, 3–55 years] and 12 matched normally hearing controls (mean age, 52.3 ± 1.8; range, 42–63 years; threshold of hearing level: left ear, 17.6 ± 1.3 dB HL, range, 11.25–26.25 dB HL; right ear, 19.7 ± 1.3 dB HL, range, 8.75–26.25 dB HL) participated in this experiment. We constructed and analyzed the causal connectivity networks based on functional magnetic resonance imaging data of these participants. Two-sample t-tests revealed significant changes of causal connections and nodal degrees in the right secondary visual cortex, associative visual cortex, right dorsolateral prefrontal cortex, left subgenual cortex, and the left cingulate cortex, as well as the shortest causal connectivity paths from the right secondary visual cortex to Broca’s area in hearing loss patients. Neuropsychological tests indicated that hearing loss patients presented significant cognitive decline. Pearson’s correlation analysis indicated that changes of nodal degrees and the shortest causal connectivity paths were significantly related with poor cognitive performances. We also found a cross-modal reorganization between associative visual cortex and auditory cortex in patients with hearing loss. Additionally, we noted that visual and auditory signals had different effects on neural activities of Broca’s area, respectively. These results suggest that changes in brain causal connectivity network are an important neuroimaging mark of cognitive decline. Our findings provide some implications for rehabilitation of hearing loss patients.
Collapse
Affiliation(s)
- Gang Zhang
- Department of Otorhinolaryngology and Head-Neck Surgery, The Second Affiliated Hospital, Shandong First Medical University, Tai'an, China
| | - Long-Chun Xu
- Department of Radiology, The Second Affiliated Hospital, Shandong First Medical University, Tai'an, China
| | - Min-Feng Zhang
- Department of Radiology, The Second Affiliated Hospital, Shandong First Medical University, Tai'an, China
| | - Yue Zou
- Department of Otorhinolaryngology and Head-Neck Surgery, The Second Affiliated Hospital, Shandong First Medical University, Tai'an, China
| | - Le-Min He
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| | - Yun-Fu Cheng
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| | - Dong-Sheng Zhang
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| | - Wen-Bo Zhao
- Department of Otorhinolaryngology and Head-Neck Surgery, The Second Affiliated Hospital, Shandong First Medical University, Tai'an, China
| | - Xiao-Yan Wang
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| | - Peng-Cheng Wang
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| | - Guang-Yu Zhang
- Department of Radiology, Shandong First Medical University & Shandong Academy of Medical Sciences, Tai'an, China
| |
Collapse
|
66
|
Levy DF, Wilson SM. Categorical Encoding of Vowels in Primary Auditory Cortex. Cereb Cortex 2021; 30:618-627. [PMID: 31241149 DOI: 10.1093/cercor/bhz112] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Revised: 04/05/2019] [Accepted: 05/02/2019] [Indexed: 11/14/2022] Open
Abstract
Speech perception involves mapping from a continuous and variable acoustic speech signal to discrete, linguistically meaningful units. However, it is unclear where in the auditory processing stream speech sound representations cease to be veridical (faithfully encoding precise acoustic properties) and become categorical (encoding sounds as linguistic categories). In this study, we used functional magnetic resonance imaging and multivariate pattern analysis to determine whether tonotopic primary auditory cortex (PAC), defined as tonotopic voxels falling within Heschl's gyrus, represents one class of speech sounds-vowels-veridically or categorically. For each of 15 participants, 4 individualized synthetic vowel stimuli were generated such that the vowels were equidistant in acoustic space, yet straddled a categorical boundary (with the first 2 vowels perceived as [i] and the last 2 perceived as [i]). Each participant's 4 vowels were then presented in a block design with an irrelevant but attention-demanding level change detection task. We found that in PAC bilaterally, neural discrimination between pairs of vowels that crossed the categorical boundary was more accurate than neural discrimination between equivalently spaced vowel pairs that fell within a category. These findings suggest that PAC does not represent vowel sounds veridically, but that encoding of vowels is shaped by linguistically relevant phonemic categories.
Collapse
Affiliation(s)
- Deborah F Levy
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| | - Stephen M Wilson
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN 37232, USA
| |
Collapse
|
67
|
O'Sullivan AE, Crosse MJ, Liberto GMD, de Cheveigné A, Lalor EC. Neurophysiological Indices of Audiovisual Speech Processing Reveal a Hierarchy of Multisensory Integration Effects. J Neurosci 2021; 41:4991-5003. [PMID: 33824190 PMCID: PMC8197638 DOI: 10.1523/jneurosci.0906-20.2021] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Revised: 03/16/2021] [Accepted: 03/22/2021] [Indexed: 12/27/2022] Open
Abstract
Seeing a speaker's face benefits speech comprehension, especially in challenging listening conditions. This perceptual benefit is thought to stem from the neural integration of visual and auditory speech at multiple stages of processing, whereby movement of a speaker's face provides temporal cues to auditory cortex, and articulatory information from the speaker's mouth can aid recognizing specific linguistic units (e.g., phonemes, syllables). However, it remains unclear how the integration of these cues varies as a function of listening conditions. Here, we sought to provide insight on these questions by examining EEG responses in humans (males and females) to natural audiovisual (AV), audio, and visual speech in quiet and in noise. We represented our speech stimuli in terms of their spectrograms and their phonetic features and then quantified the strength of the encoding of those features in the EEG using canonical correlation analysis (CCA). The encoding of both spectrotemporal and phonetic features was shown to be more robust in AV speech responses than what would have been expected from the summation of the audio and visual speech responses, suggesting that multisensory integration occurs at both spectrotemporal and phonetic stages of speech processing. We also found evidence to suggest that the integration effects may change with listening conditions; however, this was an exploratory analysis and future work will be required to examine this effect using a within-subject design. These findings demonstrate that integration of audio and visual speech occurs at multiple stages along the speech processing hierarchy.SIGNIFICANCE STATEMENT During conversation, visual cues impact our perception of speech. Integration of auditory and visual speech is thought to occur at multiple stages of speech processing and vary flexibly depending on the listening conditions. Here, we examine audiovisual (AV) integration at two stages of speech processing using the speech spectrogram and a phonetic representation, and test how AV integration adapts to degraded listening conditions. We find significant integration at both of these stages regardless of listening conditions. These findings reveal neural indices of multisensory interactions at different stages of processing and provide support for the multistage integration framework.
Collapse
Affiliation(s)
- Aisling E O'Sullivan
- School of Engineering, Trinity Centre for Biomedical Engineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
| | - Michael J Crosse
- X, The Moonshot Factory, Mountain View, CA and Department of Neuroscience, Albert Einstein College of Medicine, Bronx, New York 10461
| | - Giovanni M Di Liberto
- Laboratoire des Systèmes Perceptifs, Département d'Études Cognitives, École Normale Supérieure, Paris Sciences et Lettres University, Centre National de la Recherche Scientifique, Paris 75005, France
| | - Alain de Cheveigné
- Laboratoire des Systèmes Perceptifs, Département d'Études Cognitives, École Normale Supérieure, Paris Sciences et Lettres University, Centre National de la Recherche Scientifique, Paris 75005, France
- University College London Ear Institute, University College London, London WC1X 8EE, United Kingdom
| | - Edmund C Lalor
- School of Engineering, Trinity Centre for Biomedical Engineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland
- Department of Biomedical Engineering and Department of Neuroscience, University of Rochester, Rochester, New York 14627
| |
Collapse
|
68
|
Alho J, Bharadwaj H, Khan S, Mamashli F, Perrachione TK, Losh A, McGuiggan NM, Joseph RM, Hämäläinen MS, Kenet T. Altered maturation and atypical cortical processing of spoken sentences in autism spectrum disorder. Prog Neurobiol 2021; 203:102077. [PMID: 34033856 DOI: 10.1016/j.pneurobio.2021.102077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 04/14/2021] [Accepted: 05/19/2021] [Indexed: 10/21/2022]
Abstract
Autism spectrum disorder (ASD) is associated with widespread receptive language impairments, yet the neural mechanisms underlying these deficits are poorly understood. Neuroimaging has shown that processing of socially-relevant sounds, including speech and non-speech, is atypical in ASD. However, it is unclear how the presence of lexical-semantic meaning affects speech processing in ASD. Here, we recorded magnetoencephalography data from individuals with ASD (N = 22, ages 7-17, 4 females) and typically developing (TD) peers (N = 30, ages 7-17, 5 females) during unattended listening to meaningful auditory speech sentences and meaningless jabberwocky sentences. After adjusting for age, ASD individuals showed stronger responses to meaningless jabberwocky sentences than to meaningful speech sentences in the same left temporal and parietal language regions where TD individuals exhibited stronger responses to meaningful speech. Maturational trajectories of meaningful speech responses were atypical in temporal, but not parietal, regions in ASD. Temporal responses were associated with ASD severity, while parietal responses were associated with aberrant involuntary attentional shifting in ASD. Our findings suggest a receptive speech processing dysfunction in ASD, wherein unattended meaningful speech elicits abnormal engagement of the language system, while unattended meaningless speech, filtered out in TD individuals, engages the language system through involuntary attention capture.
Collapse
Affiliation(s)
- Jussi Alho
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
| | - Hari Bharadwaj
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Speech, Language, and Hearing Sciences, and Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, USA
| | - Sheraz Khan
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Fahimeh Mamashli
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Tyler K Perrachione
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA, USA
| | - Ainsley Losh
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Graduate School of Education, University of California, Riverside, CA, USA
| | - Nicole M McGuiggan
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Robert M Joseph
- Department of Anatomy and Neurobiology, Boston University School of Medicine, Boston, MA, USA
| | - Matti S Hämäläinen
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Tal Kenet
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|
69
|
Hertrich I, Dietrich S, Blum C, Ackermann H. The Role of the Dorsolateral Prefrontal Cortex for Speech and Language Processing. Front Hum Neurosci 2021; 15:645209. [PMID: 34079444 PMCID: PMC8165195 DOI: 10.3389/fnhum.2021.645209] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2020] [Accepted: 04/06/2021] [Indexed: 11/24/2022] Open
Abstract
This review article summarizes various functions of the dorsolateral prefrontal cortex (DLPFC) that are related to language processing. To this end, its connectivity with the left-dominant perisylvian language network was considered, as well as its interaction with other functional networks that, directly or indirectly, contribute to language processing. Language-related functions of the DLPFC comprise various aspects of pragmatic processing such as discourse management, integration of prosody, interpretation of nonliteral meanings, inference making, ambiguity resolution, and error repair. Neurophysiologically, the DLPFC seems to be a key region for implementing functional connectivity between the language network and other functional networks, including cortico-cortical as well as subcortical circuits. Considering clinical aspects, damage to the DLPFC causes psychiatric communication deficits rather than typical aphasic language syndromes. Although the number of well-controlled studies on DLPFC language functions is still limited, the DLPFC might be an important target region for the treatment of pragmatic language disorders.
Collapse
Affiliation(s)
- Ingo Hertrich
- Department of Neurology and Stroke, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Susanne Dietrich
- Evolutionary Cognition, Department of Psychology, University of Tübingen, Tübingen, Germany
| | - Corinna Blum
- Department of Neurology and Stroke, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Hermann Ackermann
- Department of Neurology and Stroke, Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| |
Collapse
|
70
|
Boos M, Lücke J, Rieger JW. Generalizable dimensions of human cortical auditory processing of speech in natural soundscapes: A data-driven ultra high field fMRI approach. Neuroimage 2021; 237:118106. [PMID: 33991696 DOI: 10.1016/j.neuroimage.2021.118106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 04/25/2021] [Indexed: 11/27/2022] Open
Abstract
Speech comprehension in natural soundscapes rests on the ability of the auditory system to extract speech information from a complex acoustic signal with overlapping contributions from many sound sources. Here we reveal the canonical processing of speech in natural soundscapes on multiple scales by using data-driven modeling approaches to characterize sounds to analyze ultra high field fMRI recorded while participants listened to the audio soundtrack of a movie. We show that at the functional level the neuronal processing of speech in natural soundscapes can be surprisingly low dimensional in the human cortex, highlighting the functional efficiency of the auditory system for a seemingly complex task. Particularly, we find that a model comprising three functional dimensions of auditory processing in the temporal lobes is shared across participants' fMRI activity. We further demonstrate that the three functional dimensions are implemented in anatomically overlapping networks that process different aspects of speech in natural soundscapes. One is most sensitive to complex auditory features present in speech, another to complex auditory features and fast temporal modulations, that are not specific to speech, and one codes mainly sound level. These results were derived with few a-priori assumptions and provide a detailed and computationally reproducible account of the cortical activity in the temporal lobe elicited by the processing of speech in natural soundscapes.
Collapse
Affiliation(s)
- Moritz Boos
- Applied Neurocognitive Psychology Lab, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany.
| | - Jörg Lücke
- Machine Learning Division, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany
| | - Jochem W Rieger
- Applied Neurocognitive Psychology Lab, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
71
|
Yao JD, Sanes DH. Temporal Encoding is Required for Categorization, But Not Discrimination. Cereb Cortex 2021; 31:2886-2897. [PMID: 33429423 DOI: 10.1093/cercor/bhaa396] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 10/26/2020] [Accepted: 11/03/2020] [Indexed: 11/14/2022] Open
Abstract
Core auditory cortex (AC) neurons encode slow fluctuations of acoustic stimuli with temporally patterned activity. However, whether temporal encoding is necessary to explain auditory perceptual skills remains uncertain. Here, we recorded from gerbil AC neurons while they discriminated between a 4-Hz amplitude modulation (AM) broadband noise and AM rates >4 Hz. We found a proportion of neurons possessed neural thresholds based on spike pattern or spike count that were better than the recorded session's behavioral threshold, suggesting that spike count could provide sufficient information for this perceptual task. A population decoder that relied on temporal information outperformed a decoder that relied on spike count alone, but the spike count decoder still remained sufficient to explain average behavioral performance. This leaves open the possibility that more demanding perceptual judgments require temporal information. Thus, we asked whether accurate classification of different AM rates between 4 and 12 Hz required the information contained in AC temporal discharge patterns. Indeed, accurate classification of these AM stimuli depended on the inclusion of temporal information rather than spike count alone. Overall, our results compare two different representations of time-varying acoustic features that can be accessed by downstream circuits required for perceptual judgments.
Collapse
Affiliation(s)
- Justin D Yao
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Dan H Sanes
- Center for Neural Science, New York University, New York, NY 10003, USA.,Department of Psychology, New York University, New York, NY 10003, USA.,Department of Biology, New York University, New York, NY 10003, USA.,Neuroscience Institute, NYU Langone Medical Center, New York University, New York, NY 10016, USA
| |
Collapse
|
72
|
Panachakel JT, Ramakrishnan AG. Decoding Covert Speech From EEG-A Comprehensive Review. Front Neurosci 2021; 15:642251. [PMID: 33994922 PMCID: PMC8116487 DOI: 10.3389/fnins.2021.642251] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2020] [Accepted: 03/18/2021] [Indexed: 11/13/2022] Open
Abstract
Over the past decade, many researchers have come up with different implementations of systems for decoding covert or imagined speech from EEG (electroencephalogram). They differ from each other in several aspects, from data acquisition to machine learning algorithms, due to which, a comparison between different implementations is often difficult. This review article puts together all the relevant works published in the last decade on decoding imagined speech from EEG into a single framework. Every important aspect of designing such a system, such as selection of words to be imagined, number of electrodes to be recorded, temporal and spatial filtering, feature extraction and classifier are reviewed. This helps a researcher to compare the relative merits and demerits of the different approaches and choose the one that is most optimal. Speech being the most natural form of communication which human beings acquire even without formal education, imagined speech is an ideal choice of prompt for evoking brain activity patterns for a BCI (brain-computer interface) system, although the research on developing real-time (online) speech imagery based BCI systems is still in its infancy. Covert speech based BCI can help people with disabilities to improve their quality of life. It can also be used for covert communication in environments that do not support vocal communication. This paper also discusses some future directions, which will aid the deployment of speech imagery based BCI for practical applications, rather than only for laboratory experiments.
Collapse
Affiliation(s)
- Jerrin Thomas Panachakel
- Medical Intelligence and Language Engineering Laboratory, Department of Electrical Engineering, Indian Institute of Science, Bangalore, India
| | | |
Collapse
|
73
|
Du J, Palaniyappan L, Liu Z, Cheng W, Gong W, Zhu M, Wang J, Zhang J, Feng J. The genetic determinants of language network dysconnectivity in drug-naïve early stage schizophrenia. NPJ SCHIZOPHRENIA 2021; 7:18. [PMID: 33658499 PMCID: PMC7930279 DOI: 10.1038/s41537-021-00141-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Accepted: 01/12/2021] [Indexed: 01/31/2023]
Abstract
Schizophrenia is a neurocognitive illness of synaptic and brain network-level dysconnectivity that often reaches a persistent chronic stage in many patients. Subtle language deficits are a core feature even in the early stages of schizophrenia. However, the primacy of language network dysconnectivity and language-related genetic variants in the observed phenotype in early stages of illness remains unclear. This study used two independent schizophrenia dataset consisting of 138 and 53 drug-naïve first-episode schizophrenia (FES) patients, and 112 and 56 healthy controls, respectively. A brain-wide voxel-level functional connectivity analysis was conducted to investigate functional dysconnectivity and its relationship with illness duration. We also explored the association between critical language-related genetic (such as FOXP2) mutations and the altered functional connectivity in patients. We found elevated functional connectivity involving Broca's area, thalamus and temporal cortex that were replicated in two FES datasets. In particular, Broca's area - anterior cingulate cortex dysconnectivity was more pronounced for patients with shorter illness duration, while thalamic dysconnectivity was predominant in those with longer illness duration. Polygenic risk scores obtained from FOXP2-related genes were strongly associated with functional dysconnectivity identified in patients with shorter illness duration. Our results highlight the criticality of language network dysconnectivity, involving the Broca's area in early stages of schizophrenia, and the role of language-related genes in this aberration, providing both imaging and genetic evidence for the association between schizophrenia and the determinants of language.
Collapse
Affiliation(s)
- Jingnan Du
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China
| | - Lena Palaniyappan
- Department of Psychiatry and Robarts Research Institute, University of Western Ontario, London, ON, Canada
- Lawson Health Research Institute, London, ON, Canada
| | - Zhaowen Liu
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Wei Cheng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China
| | - Weikang Gong
- Centre for Functional MRI of the Brain (FMRIB), Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| | - Mengmeng Zhu
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Jijun Wang
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jie Zhang
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China.
| | - Jianfeng Feng
- Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai, China.
- Key Laboratory of Computational Neuroscience and Brain Inspired Intelligence (Fudan University), Ministry of Education, Shanghai, China.
- Department of Computer Science, University of Warwick, Coventry, UK.
| |
Collapse
|
74
|
Joo SJ, Tavabi K, Caffarra S, Yeatman JD. Automaticity in the reading circuitry. BRAIN AND LANGUAGE 2021; 214:104906. [PMID: 33516066 PMCID: PMC7878427 DOI: 10.1016/j.bandl.2020.104906] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Accepted: 12/23/2020] [Indexed: 06/12/2023]
Abstract
Skilled reading requires years of practice associating visual symbols with speech sounds. Over the course of the learning process, this association becomes effortless and automatic. Here we test whether automatic activation of spoken-language circuits in response to visual words is a hallmark of skilled reading. Magnetoencephalography was used to measure word-selective responses under multiple cognitive tasks (N = 42, 7-12 years of age). Even when attention was drawn away from the words by performing an attention-demanding fixation task, strong word-selective responses were found in a language region (i.e., superior temporal gyrus) starting at ~300 ms after stimulus onset. Critically, this automatic word-selective response was indicative of reading skill: the magnitude of word-selective responses correlated with individual reading skill. Our results suggest that automatic recruitment of spoken-language circuits is a hallmark of skilled reading; with practice, reading becomes effortless as the brain learns to automatically translate letters into sounds and meaning.
Collapse
Affiliation(s)
- Sung Jun Joo
- Department of Psychology, Pusan National University, Busan, Republic of Korea; Institute for Learning & Brain Sciences, University of Washington, Seattle, WA 98195, USA; Graduate School of Education, Stanford University, Stanford, CA 94305, USA.
| | - Kambiz Tavabi
- Institute for Learning & Brain Sciences, University of Washington, Seattle, WA 98195, USA
| | - Sendy Caffarra
- Graduate School of Education, Stanford University, Stanford, CA 94305, USA; Division of Developmental-Behavioral Pediatrics, Stanford University School of Medicine, Stanford, CA 94305, USA; Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain
| | - Jason D Yeatman
- Graduate School of Education, Stanford University, Stanford, CA 94305, USA; Division of Developmental-Behavioral Pediatrics, Stanford University School of Medicine, Stanford, CA 94305, USA
| |
Collapse
|
75
|
Wang J, Joanisse MF, Booth JR. Letter fluency in 7-8-year-old children is related to the anterior, but not posterior, ventral occipito-temporal cortex during an auditory phonological task. Dev Cogn Neurosci 2021; 47:100898. [PMID: 33341533 PMCID: PMC7750687 DOI: 10.1016/j.dcn.2020.100898] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2020] [Revised: 11/25/2020] [Accepted: 11/30/2020] [Indexed: 11/29/2022] Open
Abstract
Previous studies have shown that reading skill in 3- to 6-year-old children is related to the automatic activation of the posterior left ventral occipitotemporal cortex (vOT) during spoken language processing, whereas 8- to 15-year-old children and adult readers activate the anterior vOT. However, it is unknown how children who are between these two age groups automatically activate orthographic representations in vOT for spoken language. In the current study, we recruited 153 7- to 8-year-old children to fill the age gap from previous studies. Using functional magnetic resonance imaging (fMRI), we measured children's reading-related skills and brain activity during an auditory phonological task with both a small (i.e. onset) and a large (i.e. rhyme) grain size condition. We found that letter fluency, but not reading accuracy, was correlated with activation in the anterior vOT for the rhyme condition. There were no reading-related skill correlations for the posterior vOT or for activation during the onset condition in this age group. Our findings reveal that automatic activation in the anterior vOT during spoken language processing already occurs in higher skilled 7- to 8-year-old children. In addition, increases in naming automaticity is the primary determinant of the engagement of vOT during phonological awareness tasks.
Collapse
Affiliation(s)
- Jin Wang
- Department of Psychology and Human Development, Vanderbilt University, Nashville, TN, USA.
| | - Marc F Joanisse
- Department of Psychology & Brain and Mind Institute, The University of Western Ontario, London, Ontario, Canada
| | - James R Booth
- Department of Psychology and Human Development, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
76
|
Michaelis K, Miyakoshi M, Norato G, Medvedev AV, Turkeltaub PE. Motor engagement relates to accurate perception of phonemes and audiovisual words, but not auditory words. Commun Biol 2021; 4:108. [PMID: 33495548 PMCID: PMC7835217 DOI: 10.1038/s42003-020-01634-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 12/15/2020] [Indexed: 11/12/2022] Open
Abstract
A longstanding debate has surrounded the role of the motor system in speech perception, but progress in this area has been limited by tasks that only examine isolated syllables and conflate decision-making with perception. Using an adaptive task that temporally isolates perception from decision-making, we examined an EEG signature of motor activity (sensorimotor μ/beta suppression) during the perception of auditory phonemes, auditory words, audiovisual words, and environmental sounds while holding difficulty constant at two levels (Easy/Hard). Results revealed left-lateralized sensorimotor μ/beta suppression that was related to perception of speech but not environmental sounds. Audiovisual word and phoneme stimuli showed enhanced left sensorimotor μ/beta suppression for correct relative to incorrect trials, while auditory word stimuli showed enhanced suppression for incorrect trials. Our results demonstrate that motor involvement in perception is left-lateralized, is specific to speech stimuli, and it not simply the result of domain-general processes. These results provide evidence for an interactive network for speech perception in which dorsal stream motor areas are dynamically engaged during the perception of speech depending on the characteristics of the speech signal. Crucially, this motor engagement has different effects on the perceptual outcome depending on the lexicality and modality of the speech stimulus. Michaelis et al. used extra-cranial EEG during a forced-choice identification task to investigate the role of the motor system in speech perception. Their findings suggest that left hemisphere dorsal stream motor areas are dynamically engaged during speech perception based on the properties of the stimulus.
Collapse
Affiliation(s)
- Kelly Michaelis
- Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC, USA.,Human Cortical Physiology and Stroke Neurorehabilitation Section, National Institute for Neurological Disorders and Stroke (NINDS), National Institutes of Health, Bethesda, MD, USA
| | - Makoto Miyakoshi
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, San Diego, CA, USA
| | - Gina Norato
- Clinical Trials Unit, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Andrei V Medvedev
- Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC, USA
| | - Peter E Turkeltaub
- Center for Brain Plasticity and Recovery, Georgetown University Medical Center, Washington, DC, USA. .,Research Division, Medstar National Rehabilitation Hospital, Washington, DC, USA.
| |
Collapse
|
77
|
Friston KJ, Sajid N, Quiroga-Martinez DR, Parr T, Price CJ, Holmes E. Active listening. Hear Res 2021; 399:107998. [PMID: 32732017 PMCID: PMC7812378 DOI: 10.1016/j.heares.2020.107998] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Revised: 05/11/2020] [Accepted: 05/13/2020] [Indexed: 11/27/2022]
Abstract
This paper introduces active listening, as a unified framework for synthesising and recognising speech. The notion of active listening inherits from active inference, which considers perception and action under one universal imperative: to maximise the evidence for our (generative) models of the world. First, we describe a generative model of spoken words that simulates (i) how discrete lexical, prosodic, and speaker attributes give rise to continuous acoustic signals; and conversely (ii) how continuous acoustic signals are recognised as words. The 'active' aspect involves (covertly) segmenting spoken sentences and borrows ideas from active vision. It casts speech segmentation as the selection of internal actions, corresponding to the placement of word boundaries. Practically, word boundaries are selected that maximise the evidence for an internal model of how individual words are generated. We establish face validity by simulating speech recognition and showing how the inferred content of a sentence depends on prior beliefs and background noise. Finally, we consider predictive validity by associating neuronal or physiological responses, such as the mismatch negativity and P300, with belief updating under active listening, which is greatest in the absence of accurate prior beliefs about what will be heard next.
Collapse
Affiliation(s)
- Karl J Friston
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK.
| | - Noor Sajid
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK.
| | | | - Thomas Parr
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK.
| | - Cathy J Price
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK.
| | - Emma Holmes
- The Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK.
| |
Collapse
|
78
|
Gupta A, Padma Srivastava MV. Newer Paradigms in Language Neurobiology. Ann Indian Acad Neurol 2020; 23:S73-S81. [PMID: 33343130 PMCID: PMC7731670 DOI: 10.4103/aian.aian_487_20] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Accepted: 05/22/2020] [Indexed: 11/23/2022] Open
Abstract
The field of language research has seen tremendous progress in the last two decades. Advances in neuro-imaging and stimulation mapping have changed the way we conceive the neural basis of speech and language processing. In the past, the Wernicke-Lichtheim model was the most influential model explaining the neuro-anatomical basis of language. More recently, the concept of dual stream language processing has emerged, wherein separate dorsal and ventral networks are synergistically involved in phonological (sound to articulation) and semantic (sound to meaning) processing respectively. In this review article, we highlight new insights and approaches to the neurobiology of language, across different aspects of language processing like perception, comprehension, production, hemisphere lateralization, role of subcortical structures and effect of damage to language networks.
Collapse
Affiliation(s)
- Anu Gupta
- Department of Neurology, All India Institute of Medical Sciences, New Delhi, India
| | - M V Padma Srivastava
- Department of Neurology, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
79
|
Wu Y, Ma J, Cai L, Wang Z, Fan M, Chu J, Zhang Y, Li X. Brain Activity during Visual and Auditory Word Rhyming Tasks in Cantonese-Mandarin-English Trilinguals. Brain Sci 2020; 10:brainsci10120936. [PMID: 33291662 PMCID: PMC7761916 DOI: 10.3390/brainsci10120936] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 12/02/2020] [Indexed: 11/16/2022] Open
Abstract
It is unclear whether the brain activity during phonological processing of second languages (L2) is similar to that of the first language (L1) in trilingual individuals, especially when the L1 is logographic, and the L2s are logographic and alphabetic, respectively. To explore this issue, this study examined brain activity during visual and auditory word rhyming tasks in Cantonese–Mandarin–English trilinguals. Thirty Chinese college students whose L1 was Cantonese and L2s were Mandarin and English were recruited. Functional magnetic resonance imaging (fMRI) was conducted while subjects performed visual and auditory word rhyming tasks in three languages (Cantonese, Mandarin, and English). The results revealed that in Cantonese–Mandarin–English trilinguals, whose L1 is logographic and the orthography of their L2 is the same as L1—i.e., Mandarin and Cantonese, which share the same set of Chinese characters—the brain regions for the phonological processing of L2 are different from those of L1; when the orthography of L2 is quite different from L1, i.e., English and Cantonese who belong to different writing systems, the brain regions for the phonological processing of L2 are similar to those of L1. A significant interaction effect was observed between language and modality in bilateral lingual gyri. Regions of interest (ROI) analysis at lingual gyri revealed greater activation of this region when using English than Cantonese and Mandarin in visual tasks.
Collapse
Affiliation(s)
- Yujia Wu
- Department of Maternal and Child Health, School of Public Health, Sun Yat-sen University, Guangzhou 510080, China; (Y.W.); (J.M.); (L.C.); (Z.W.)
| | - Jingwen Ma
- Department of Maternal and Child Health, School of Public Health, Sun Yat-sen University, Guangzhou 510080, China; (Y.W.); (J.M.); (L.C.); (Z.W.)
| | - Lei Cai
- Department of Maternal and Child Health, School of Public Health, Sun Yat-sen University, Guangzhou 510080, China; (Y.W.); (J.M.); (L.C.); (Z.W.)
| | - Zengjian Wang
- Department of Maternal and Child Health, School of Public Health, Sun Yat-sen University, Guangzhou 510080, China; (Y.W.); (J.M.); (L.C.); (Z.W.)
| | - Miao Fan
- Sun Yat-sen University First Affiliated Hospital, Guangzhou 510080, China; (M.F.); (J.C.)
| | - Jianping Chu
- Sun Yat-sen University First Affiliated Hospital, Guangzhou 510080, China; (M.F.); (J.C.)
| | - Yue Zhang
- Department of Children’s Health Care, National Center for Women and Children’s Health, Chinese Center for Disease Control and Prevention, Beijing 100081, China;
| | - Xiuhong Li
- Department of Maternal and Child Health, School of Public Health, Sun Yat-sen University, Guangzhou 510080, China; (Y.W.); (J.M.); (L.C.); (Z.W.)
- Correspondence: ; Tel.: +86-136-3135-7869
| |
Collapse
|
80
|
Fleming V, Brownsett S, Krason A, Maegli MA, Coley-Fisher H, Ong YH, Nardo D, Leach R, Howard D, Robson H, Warburton E, Ashburner J, Price CJ, Crinion JT, Leff AP. Efficacy of spoken word comprehension therapy in patients with chronic aphasia: a cross-over randomised controlled trial with structural imaging. J Neurol Neurosurg Psychiatry 2020; 92:jnnp-2020-324256. [PMID: 33154182 PMCID: PMC7611712 DOI: 10.1136/jnnp-2020-324256] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/15/2020] [Revised: 09/17/2020] [Accepted: 10/07/2020] [Indexed: 11/03/2022]
Abstract
OBJECTIVE The efficacy of spoken language comprehension therapies for persons with aphasia remains equivocal. We investigated the efficacy of a self-led therapy app, 'Listen-In', and examined the relation between brain structure and therapy response. METHODS A cross-over randomised repeated measures trial with five testing time points (12-week intervals), conducted at the university or participants' homes, captured baseline (T1), therapy (T2-T4) and maintenance (T5) effects. Participants with chronic poststroke aphasia and spoken language comprehension impairments completed consecutive Listen-In and standard care blocks (both 12 weeks with order randomised). Repeated measures analyses of variance compared change in spoken language comprehension on two co-primary outcomes over therapy versus standard care. Three structural MRI scans (T2-T4) for each participant (subgroup, n=25) were analysed using cross-sectional and longitudinal voxel-based morphometry. RESULTS Thirty-five participants completed, on average, 85 hours (IQR=70-100) of Listen-In (therapy first, n=18). The first study-specific co-primary outcome (Auditory Comprehension Test (ACT)) showed large and significant improvements for trained spoken words over therapy versus standard care (11%, Cohen's d=1.12). Gains were largely maintained at 12 and 24 weeks. There were no therapy effects on the second standardised co-primary outcome (Comprehensive Aphasia Test: Spoken Words and Sentences). Change on ACT trained words was associated with volume of pretherapy right hemisphere white matter and post-therapy grey matter tissue density changes in bilateral temporal lobes. CONCLUSIONS Individuals with chronic aphasia can improve their spoken word comprehension many years after stroke. Results contribute to hemispheric debates implicating the right hemisphere in therapy-driven language recovery. Listen-In will soon be available on GooglePlay. TRIAL REGISTRATION NUMBER NCT02540889.
Collapse
Affiliation(s)
- Victoria Fleming
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Sonia Brownsett
- School of Health and Rehabilitation Sciences, The University of Queensland, Saint Lucia, Queensland, Australia
- Centre of Research Excellence in Aphasia Recovery and Rehabilitation, La Trobe University, Melbourne, Victoria, Australia
| | - Anna Krason
- Department of Psychology and Language Sciences, University College London, London, UK
| | - Maria A Maegli
- Department of Psychology, Universidad del Valle de Guatemala, Guatemala, Guatemala
| | - Henry Coley-Fisher
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Yean-Hoon Ong
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Davide Nardo
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, Cambridgeshire, UK
| | - Rupert Leach
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - David Howard
- School of Education, Communication and Language Sciences, Newcastle University, Newcastle upon Tyne, Tyne and Wear, UK
| | - Holly Robson
- Psychology and Clinical Language Sciences, University of Reading, Reading, Berkshire, UK
| | - Elizabeth Warburton
- Department of Medicine, University of Cambridge, Cambridge, Cambridgeshire, UK
| | - John Ashburner
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Cathy J Price
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Jenny T Crinion
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Alexander P Leff
- UCL Queen Square Institute of Neurology, University College London, London, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
| |
Collapse
|
81
|
Single-cell activity in human STG during perception of phonemes is organized according to manner of articulation. Neuroimage 2020; 226:117499. [PMID: 33186717 DOI: 10.1016/j.neuroimage.2020.117499] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2020] [Revised: 09/29/2020] [Accepted: 10/21/2020] [Indexed: 11/23/2022] Open
Abstract
One of the central tasks of the human auditory system is to extract sound features from incoming acoustic signals that are most critical for speech perception. Specifically, phonological features and phonemes are the building blocks for more complex linguistic entities, such as syllables, words and sentences. Previous ECoG and EEG studies showed that various regions in the superior temporal gyrus (STG) exhibit selective responses to specific phonological features. However, electrical activity recorded by ECoG or EEG grids reflects average responses of large neuronal populations and is therefore limited in providing insights into activity patterns of single neurons. Here, we recorded spiking activity from 45 units in the STG from six neurosurgical patients who performed a listening task with phoneme stimuli. Fourteen units showed significant responsiveness to the stimuli. Using a Naïve-Bayes model, we find that single-cell responses to phonemes are governed by manner-of-articulation features and are organized according to sonority with two main clusters for sonorants and obstruents. We further find that 'neural similarity' (i.e. the similarity of evoked spiking activity between pairs of phonemes) is comparable to the 'perceptual similarity' (i.e. to what extent two phonemes are judged as sounding similar) based on perceptual confusion, assessed behaviorally in healthy subjects. Thus, phonemes that were perceptually similar also had similar neural responses. Taken together, our findings indicate that manner-of-articulation is the dominant organization dimension of phoneme representations at the single-cell level, suggesting a remarkable consistency across levels of analyses, from the single neuron level to that of large neuronal populations and behavior.
Collapse
|
82
|
Regev M, Simony E, Lee K, Tan KM, Chen J, Hasson U. Propagation of Information Along the Cortical Hierarchy as a Function of Attention While Reading and Listening to Stories. Cereb Cortex 2020; 29:4017-4034. [PMID: 30395174 DOI: 10.1093/cercor/bhy282] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Revised: 08/21/2018] [Accepted: 10/17/2018] [Indexed: 11/12/2022] Open
Abstract
How does attention route information from sensory to high-order areas as a function of task, within the relatively fixed topology of the brain? In this study, participants were simultaneously presented with 2 unrelated stories-one spoken and one written-and asked to attend one while ignoring the other. We used fMRI and a novel intersubject correlation analysis to track the spread of information along the processing hierarchy as a function of task. Processing the unattended spoken (written) information was confined to auditory (visual) cortices. In contrast, attending to the spoken (written) story enhanced the stimulus-selective responses in sensory regions and allowed it to spread into higher-order areas. Surprisingly, we found that the story-specific spoken (written) responses for the attended story also reached secondary visual (auditory) regions of the unattended sensory modality. These results demonstrate how attention enhances the processing of attended input and allows it to propagate across brain areas.
Collapse
Affiliation(s)
- Mor Regev
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.,Department of Psychology, Princeton University, Princeton, NJ, USA.,Montreal Neurological Institute, McGill University, Montréal, Quebec, Canada
| | - Erez Simony
- Faculty of Electrical Engineering, Holon Institute of Technology, Holon, Israel.,Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | - Katherine Lee
- Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ, USA
| | - Kean Ming Tan
- School of Statistics, University of Minnesota, Minneapolis, MN, USA
| | - Janice Chen
- Department of Psychology & Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Uri Hasson
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA.,Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
83
|
Feng G, Yi HG, Chandrasekaran B. The Role of the Human Auditory Corticostriatal Network in Speech Learning. Cereb Cortex 2020; 29:4077-4089. [PMID: 30535138 DOI: 10.1093/cercor/bhy289] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2018] [Revised: 08/30/2018] [Indexed: 01/26/2023] Open
Abstract
We establish a mechanistic account of how the mature human brain functionally reorganizes to acquire and represent new speech sounds. Native speakers of English learned to categorize Mandarin lexical tone categories produced by multiple talkers using trial-by-trial feedback. We hypothesized that the corticostriatal system is a key intermediary in mediating temporal lobe plasticity and the acquisition of new speech categories in adulthood. We conducted a functional magnetic resonance imaging experiment in which participants underwent a sound-to-category mapping task. Diffusion tensor imaging data were collected, and probabilistic fiber tracking analysis was employed to assay the auditory corticostriatal pathways. Multivariate pattern analysis showed that talker-invariant novel tone category representations emerged in the left superior temporal gyrus (LSTG) within a few hundred training trials. Univariate analysis showed that the putamen, a subregion of the striatum, was sensitive to positive feedback in correctly categorized trials. With learning, functional coupling between the putamen and LSTG increased during error processing. Furthermore, fiber tractography demonstrated robust structural connectivity between the feedback-sensitive striatal regions and the LSTG regions that represent the newly learned tone categories. Our convergent findings highlight a critical role for the auditory corticostriatal circuitry in mediating the acquisition of new speech categories.
Collapse
Affiliation(s)
- Gangyi Feng
- Department of Linguistics and Modern Languages, The Chinese University of Hong Kong, Hong Kong SAR, China.,Brain and Mind Institute, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Han Gyol Yi
- Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA 94158, USA
| | - Bharath Chandrasekaran
- Department of Communication Science and Disorders, School of Health and Rehabilitation Sciences, University of Pittsburgh, Pittsburgh, PA 15260, USA
| |
Collapse
|
84
|
Novén M, Schremm A, Horne M, Roll M. Cortical thickness and surface area of left anterior temporal areas affects processing of phonological cues to morphosyntax. Brain Res 2020; 1750:147150. [PMID: 33039411 DOI: 10.1016/j.brainres.2020.147150] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Revised: 09/04/2020] [Accepted: 10/05/2020] [Indexed: 11/26/2022]
Abstract
Lack of methods to experimentally assess the perceptual processing of sound features and allow one to measure differences in phonological proficiency has been a limitation for speech processing studies in native speakers. Tonal features associated with Swedish word-stems, word accents, which cue grammatical suffixes, constitute, however, such sound features that can be exploited to generate measures of reliance on morphosyntactically relevant phonological information during word processing. Specifically, there is a natural variance between native speakers in response time (RT) difference between phonologically valid and invalid word accent-suffix combinations that can be used to quantify perceptual phonological proficiency. This study uses ultra-high field magnetic resonance imaging (MRI) to investigate word accents as phonological cues to morphosyntactic meaning. The study adds to the understanding of the neural basis for both morphosyntactically relevant phonological cues by reporting correlations between differences in listeners' RT for validly and invalidly cued suffixes and cortical thickness in left anterior and middle temporal gyrus, and the left anterior superior temporal sulcus as well as cortical surface area in the left middle and inferior temporal gyri. The cortical areas studied are known constituents of the ventral speech processing stream, necessary for word and phrase recognition.
Collapse
Affiliation(s)
- Mikael Novén
- Centre for Languages and Literature, Lund University, Box 201 221 00, Lund, Sweden.
| | - Andrea Schremm
- Centre for Languages and Literature, Lund University, Box 201 221 00, Lund, Sweden
| | - Merle Horne
- Centre for Languages and Literature, Lund University, Box 201 221 00, Lund, Sweden
| | - Mikael Roll
- Centre for Languages and Literature, Lund University, Box 201 221 00, Lund, Sweden
| |
Collapse
|
85
|
Razorenova AM, Chernyshev BV, Nikolaeva AY, Butorina AV, Prokofyev AO, Tyulenev NB, Stroganova TA. Rapid Cortical Plasticity Induced by Active Associative Learning of Novel Words in Human Adults. Front Neurosci 2020; 14:895. [PMID: 33013296 PMCID: PMC7516206 DOI: 10.3389/fnins.2020.00895] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Accepted: 07/31/2020] [Indexed: 11/29/2022] Open
Abstract
Human speech requires that new words are routinely memorized, yet neurocognitive mechanisms of such acquisition of memory remain highly debatable. Major controversy concerns the question whether cortical plasticity related to word learning occurs in neocortical speech-related areas immediately after learning, or neocortical plasticity emerges only on the second day after a prolonged time required for consolidation after learning. The functional spatiotemporal pattern of cortical activity related to such learning also remains largely unknown. In order to address these questions, we examined magnetoencephalographic responses elicited in the cerebral cortex by passive presentations of eight novel pseudowords before and immediately after an operant conditioning task. This associative procedure forced participants to perform an active search for unique meaning of four pseudowords that referred to movements of left and right hands and feet. The other four pseudowords did not require any movement and thus were not associated with any meaning. Familiarization with novel pseudowords led to a bilateral repetition suppression of cortical responses to them; the effect started before or around the uniqueness point and lasted for more than 500 ms. After learning, response amplitude to pseudowords that acquired meaning was greater compared with response amplitude to pseudowords that were not assigned meaning; the effect was significant within 144-362 ms after the uniqueness point, and it was found only in the left hemisphere. Within this time interval, a learning-related selective response initially emerged in cortical areas surrounding the Sylvian fissure: anterior superior temporal sulcus, ventral premotor cortex, the anterior part of intraparietal sulcus and insula. Later within this interval, activation additionally spread to more anterior higher-tier brain regions, and reached the left temporal pole and the triangular part of the left inferior frontal gyrus extending to its orbital part. Altogether, current findings evidence rapid plastic changes in cortical representations of meaningful auditory word-forms occurring almost immediately after learning. Additionally, our results suggest that familiarization resulting from stimulus repetition and semantic acquisition resulting from an active learning procedure have separable effects on cortical activity.
Collapse
Affiliation(s)
- Alexandra M Razorenova
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Center for Computational and Data-Intensive Science and Engineering (CDISE), Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Boris V Chernyshev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Department of Psychology, Higher School of Economics, Moscow, Russia
- Department of Higher Nervous Activity, Lomonosov Moscow State University, Moscow, Russia
| | - Anastasia Yu Nikolaeva
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Anna V Butorina
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
- Center for Computational and Data-Intensive Science and Engineering (CDISE), Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Andrey O Prokofyev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Nikita B Tyulenev
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| | - Tatiana A Stroganova
- Center for Neurocognitive Research (MEG Center), Moscow State University of Psychology and Education, Moscow, Russia
| |
Collapse
|
86
|
Yao JD, Gimoto J, Constantinople CM, Sanes DH. Parietal Cortex Is Required for the Integration of Acoustic Evidence. Curr Biol 2020; 30:3293-3303.e4. [PMID: 32619478 DOI: 10.1016/j.cub.2020.06.017] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 05/12/2020] [Accepted: 06/04/2020] [Indexed: 01/31/2023]
Abstract
Sensory-driven decisions are formed by accumulating information over time. Although parietal cortex activity is thought to represent accumulated evidence for sensory-based decisions, recent perturbation studies in rodents and non-human primates have challenged the hypothesis that these representations actually influence behavior. Here, we asked whether the parietal cortex integrates acoustic features from auditory cortical inputs during a perceptual decision-making task. If so, we predicted that selective inactivation of this projection should impair subjects' ability to accumulate sensory evidence. We trained gerbils to perform an auditory discrimination task and obtained measures of integration time as a readout of evidence accumulation capability. Minimum integration time was calculated behaviorally as the shortest stimulus duration for which subjects could discriminate the acoustic signals. Direct pharmacological inactivation of parietal cortex increased minimum integration times, suggesting its role in the behavior. To determine the specific impact of sensory evidence, we chemogenetically inactivated the excitatory projections from auditory cortex to parietal cortex and found this was sufficient to increase minimum behavioral integration times. Our signal-detection-theory-based model accurately replicated behavioral outcomes and indicated that the deficits in task performance were plausibly explained by elevated sensory noise. Together, our findings provide causal evidence that parietal cortex plays a role in the network that integrates auditory features for perceptual judgments.
Collapse
Affiliation(s)
- Justin D Yao
- Center for Neural Science, New York University, New York, NY 10003, USA.
| | - Justin Gimoto
- Center for Neural Science, New York University, New York, NY 10003, USA
| | - Christine M Constantinople
- Center for Neural Science, New York University, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, New York University, New York, NY 10016, USA
| | - Dan H Sanes
- Center for Neural Science, New York University, New York, NY 10003, USA; Department of Psychology, New York University, New York, NY 10003, USA; Department of Biology, New York University, New York, NY 10003, USA; Neuroscience Institute, NYU Langone Medical Center, New York University, New York, NY 10016, USA
| |
Collapse
|
87
|
Fox NP, Leonard M, Sjerps MJ, Chang EF. Transformation of a temporal speech cue to a spatial neural code in human auditory cortex. eLife 2020; 9:e53051. [PMID: 32840483 PMCID: PMC7556862 DOI: 10.7554/elife.53051] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Accepted: 08/21/2020] [Indexed: 11/28/2022] Open
Abstract
In speech, listeners extract continuously-varying spectrotemporal cues from the acoustic signal to perceive discrete phonetic categories. Spectral cues are spatially encoded in the amplitude of responses in phonetically-tuned neural populations in auditory cortex. It remains unknown whether similar neurophysiological mechanisms encode temporal cues like voice-onset time (VOT), which distinguishes sounds like /b/ and/p/. We used direct brain recordings in humans to investigate the neural encoding of temporal speech cues with a VOT continuum from /ba/ to /pa/. We found that distinct neural populations respond preferentially to VOTs from one phonetic category, and are also sensitive to sub-phonetic VOT differences within a population's preferred category. In a simple neural network model, simulated populations tuned to detect either temporal gaps or coincidences between spectral cues captured encoding patterns observed in real neural data. These results demonstrate that a spatial/amplitude neural code underlies the cortical representation of both spectral and temporal speech cues.
Collapse
Affiliation(s)
- Neal P Fox
- Department of Neurological Surgery, University of California, San FranciscoSan FranciscoUnited States
| | - Matthew Leonard
- Department of Neurological Surgery, University of California, San FranciscoSan FranciscoUnited States
| | - Matthias J Sjerps
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud UniversityNijmegenNetherlands
- Max Planck Institute for PsycholinguisticsNijmegenNetherlands
| | - Edward F Chang
- Department of Neurological Surgery, University of California, San FranciscoSan FranciscoUnited States
- Weill Institute for Neurosciences, University of California, San FranciscoSan FranciscoUnited States
| |
Collapse
|
88
|
Multilevel fMRI adaptation for spoken word processing in the awake dog brain. Sci Rep 2020; 10:11968. [PMID: 32747731 PMCID: PMC7398925 DOI: 10.1038/s41598-020-68821-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2020] [Accepted: 06/30/2020] [Indexed: 01/08/2023] Open
Abstract
Human brains process lexical meaning separately from emotional prosody of speech at higher levels of the processing hierarchy. Recently we demonstrated that dog brains can also dissociate lexical and emotional prosodic information in human spoken words. To better understand the neural dynamics of lexical processing in the dog brain, here we used an event-related design, optimized for fMRI adaptation analyses on multiple time scales. We investigated repetition effects in dogs’ neural (BOLD) responses to lexically marked (praise) words and to lexically unmarked (neutral) words, in praising and neutral prosody. We identified temporally and anatomically distinct adaptation patterns. In a subcortical auditory region, we found both short- and long-term fMRI adaptation for emotional prosody, but not for lexical markedness. In multiple cortical auditory regions, we found long-term fMRI adaptation for lexically marked compared to unmarked words. This lexical adaptation showed right-hemisphere bias and was age-modulated in a near-primary auditory region and was independent of prosody in a secondary auditory region. Word representations in dogs’ auditory cortex thus contain more than just the emotional prosody they are typically associated with. These findings demonstrate multilevel fMRI adaptation effects in the dog brain and are consistent with a hierarchical account of spoken word processing.
Collapse
|
89
|
Abrams DA, Kochalka J, Bhide S, Ryali S, Menon V. Intrinsic functional architecture of the human speech processing network. Cortex 2020; 129:41-56. [PMID: 32428761 DOI: 10.1016/j.cortex.2020.03.013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Revised: 02/12/2020] [Accepted: 03/26/2020] [Indexed: 11/20/2022]
Abstract
Speech engages distributed temporo-fronto-parietal brain regions, however a comprehensive understanding of its intrinsic functional network architecture is lacking. Here we investigate the human speech processing network using the largest sample to date, high temporal resolution resting-state fMRI data, network stability analysis, and theoretically informed models. Network consensus analysis revealed three stable functional modules encompassing: (1) superior temporal plane (STP) and Area Spt, (2) superior temporal sulcus (STS) + ventral frontoparietal cortex, and (3) dorsal frontoparietal cortex. The STS + ventral frontoparietal cortex module showed the highest participation coefficient, and a hub-like organization linking STP with frontoparietal cortical nodes. Node-wise analysis revealed key connectivity features underlying this modular architecture, including a leftward asymmetric connectivity profile, and differential connectivity of STS and STP, with frontoparietal cortex. Our findings, replicated across cohorts, reveal a tripartite functional network architecture supporting speech processing and provide a novel template for future studies.
Collapse
Affiliation(s)
- Daniel A Abrams
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA.
| | - John Kochalka
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Sayuli Bhide
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Srikanth Ryali
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Vinod Menon
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA; Program in Neuroscience, Stanford University School of Medicine, Stanford, CA, USA; Department of Neurology and Neurological Sciences, Stanford University School of Medicine, Stanford, CA, USA.
| |
Collapse
|
90
|
Archakov D, DeWitt I, Kuśmierek P, Ortiz-Rios M, Cameron D, Cui D, Morin EL, VanMeter JW, Sams M, Jääskeläinen IP, Rauschecker JP. Auditory representation of learned sound sequences in motor regions of the macaque brain. Proc Natl Acad Sci U S A 2020; 117:15242-15252. [PMID: 32541016 PMCID: PMC7334521 DOI: 10.1073/pnas.1915610117] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
Human speech production requires the ability to couple motor actions with their auditory consequences. Nonhuman primates might not have speech because they lack this ability. To address this question, we trained macaques to perform an auditory-motor task producing sound sequences via hand presses on a newly designed device ("monkey piano"). Catch trials were interspersed to ascertain the monkeys were listening to the sounds they produced. Functional MRI was then used to map brain activity while the animals listened attentively to the sound sequences they had learned to produce and to two control sequences, which were either completely unfamiliar or familiar through passive exposure only. All sounds activated auditory midbrain and cortex, but listening to the sequences that were learned by self-production additionally activated the putamen and the hand and arm regions of motor cortex. These results indicate that, in principle, monkeys are capable of forming internal models linking sound perception and production in motor regions of the brain, so this ability is not special to speech in humans. However, the coupling of sounds and actions in nonhuman primates (and the availability of an internal model supporting it) seems not to extend to the upper vocal tract, that is, the supralaryngeal articulators, which are key for the production of speech sounds in humans. The origin of speech may have required the evolution of a "command apparatus" similar to the control of the hand, which was crucial for the evolution of tool use.
Collapse
Affiliation(s)
- Denis Archakov
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-02150 Espoo, Finland
| | - Iain DeWitt
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - Paweł Kuśmierek
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - Michael Ortiz-Rios
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - Daniel Cameron
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - Ding Cui
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - Elyse L Morin
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057
| | - John W VanMeter
- Center for Functional and Molecular Imaging, Georgetown University Medical Center, Washington, DC 20057
| | - Mikko Sams
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-02150 Espoo, Finland
| | - Iiro P Jääskeläinen
- Brain and Mind Laboratory, Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, FI-02150 Espoo, Finland
| | - Josef P Rauschecker
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057;
| |
Collapse
|
91
|
Conant LL, Liebenthal E, Desai A, Seidenberg MS, Binder JR. Differential activation of the visual word form area during auditory phoneme perception in youth with dyslexia. Neuropsychologia 2020; 146:107543. [PMID: 32598966 DOI: 10.1016/j.neuropsychologia.2020.107543] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2019] [Revised: 03/16/2020] [Accepted: 06/21/2020] [Indexed: 12/12/2022]
Abstract
Developmental dyslexia is a learning disorder characterized by difficulties reading words accurately and/or fluently. Several behavioral studies have suggested the presence of anomalies at an early stage of phoneme processing, when the complex spectrotemporal patterns in the speech signal are analyzed and assigned to phonemic categories. In this study, fMRI was used to compare brain responses associated with categorical discrimination of speech syllables (P) and acoustically matched nonphonemic stimuli (N) in children and adolescents with dyslexia and in typically developing (TD) controls, aged 8-17 years. The TD group showed significantly greater activation during the P condition relative to N in an area of the left ventral occipitotemporal cortex that corresponds well with the region referred to as the "visual word form area" (VWFA). Regression analyses using reading performance as a continuous variable across the full group of participants yielded similar results. Overall, the findings are consistent with those of previous neuroimaging studies using print stimuli in individuals with dyslexia that found reduced activation in left occipitotemporal regions; however, the current study shows that these activation differences seen during reading are apparent during auditory phoneme discrimination in youth with dyslexia, suggesting that the primary deficit in at least a subset of children may lie early in the speech processing stream and that categorical perception may be an important target of early intervention in children at risk for dyslexia.
Collapse
Affiliation(s)
- Lisa L Conant
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA.
| | - Einat Liebenthal
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA; Department of Psychiatry, McLean Hospital, Harvard Medical School, Boston, MA, USA
| | - Anjali Desai
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| | - Mark S Seidenberg
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA
| | - Jeffrey R Binder
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI, USA
| |
Collapse
|
92
|
DeRamus T, Silva R, Iraji A, Damaraju E, Belger A, Ford J, McEwen S, Mathalon D, Mueller B, Pearlson G, Potkin S, Preda A, Turner J, Vaidya J, van Erp T, Calhoun V. Covarying structural alterations in laterality of the temporal lobe in schizophrenia: A case for source-based laterality. NMR IN BIOMEDICINE 2020; 33:e4294. [PMID: 32207187 PMCID: PMC8311554 DOI: 10.1002/nbm.4294] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/10/2020] [Revised: 02/21/2020] [Accepted: 02/24/2020] [Indexed: 06/10/2023]
Abstract
The human brain is asymmetrically lateralized for certain functions (such as language processing) to regions in one hemisphere relative to the other. Asymmetries are measured with a laterality index (LI). However, traditional LI measures are limited by a lack of consensus on metrics used for its calculation. To address this limitation, source-based laterality (SBL) leverages an independent component analysis for the identification of laterality-specific alterations, identifying covarying components between hemispheres across subjects. SBL is successfully implemented with simulated data with inherent differences in laterality. SBL is then compared with a voxel-wise analysis utilizing structural data from a sample of patients with schizophrenia and controls without schizophrenia. SBL group comparisons identified three distinct temporal regions and one cerebellar region with significantly altered laterality in patients with schizophrenia relative to controls. Previous work highlights reductions in laterality (ie, reduced left gray matter volume) in patients with schizophrenia compared with controls without schizophrenia. Results from this pilot SBL project are the first, to our knowledge, to identify covarying laterality differences within discrete temporal brain regions. The authors argue SBL provides a unique focus to detect covarying laterality differences in patients with schizophrenia, facilitating the discovery of laterality aspects undetected in previous work.
Collapse
Affiliation(s)
- T.P. DeRamus
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
| | - R.F. Silva
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
| | - A. Iraji
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
| | - E. Damaraju
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
| | - A. Belger
- Department of Psychiatry, University of North Carolina Chapel Hill, North Carolina, USA
| | - J.M. Ford
- Department of Psychiatry, University of California San Francisco, San Francisco, CA, USA
| | - S. McEwen
- Pacific Neuroscience Institute Foundation, Santa Monica, CA, USA
| | - D.H. Mathalon
- Department of Psychiatry, University of California San Francisco, San Francisco, CA, USA
| | - B.A. Mueller
- Department of Psychiatry, University of Minnesota, Minneapolis, MN, USA
| | - G.D. Pearlson
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
- Institute of Living, Olin Neuropsychiatry Research Center, Hartford, CT, USA
| | - S.G. Potkin
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - A. Preda
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - J.A. Turner
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
- Department of Psychology, Georgia State University, GA, USA
| | - J.G. Vaidya
- Department of Psychiatry, University of Iowa, IA, USA
| | - T.G.M. van Erp
- Department of Psychiatry and Human Behavior, University of California Irvine, Irvine, CA, USA
| | - V.D. Calhoun
- Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, Georgia, USA
- Department of Psychiatry, Yale University School of Medicine, New Haven, CT, USA
- Department of Psychology, Georgia State University, GA, USA
- Department of Electrical and Computer Engineering, Georgia Tech, GA, USA
| |
Collapse
|
93
|
Le Guen Y, Leroy F, Philippe C, Mangin JF, Dehaene-Lambertz G, Frouin V. Enhancer Locus in ch14q23.1 Modulates Brain Asymmetric Temporal Regions Involved in Language Processing. Cereb Cortex 2020; 30:5322-5332. [DOI: 10.1093/cercor/bhaa112] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2019] [Revised: 04/07/2020] [Accepted: 04/08/2020] [Indexed: 12/15/2022] Open
Abstract
Abstract
Identifying the genes that contribute to the variability in brain regions involved in language processing may shed light on the evolution of brain structures essential to the emergence of language in Homo sapiens. The superior temporal asymmetrical pit (STAP), which is not observed in chimpanzees, represents an ideal phenotype to investigate the genetic variations that support human communication. The left STAP depth was significantly associated with a predicted enhancer annotation located in the 14q23.1 locus, between DACT1 and KIAA0586, in the UK Biobank British discovery sample (N = 16 515). This association was replicated in the IMAGEN cohort (N = 1726) and the UK Biobank non-British validation sample (N = 2161). This genomic region was also associated to a lesser extent with the right STAP depth and the formation of sulcal interruptions, “plis de passage,” in the bilateral STAP but not with other structural brain MRI phenotypes, highlighting its notable association with the superior temporal regions. Diffusion MRI emphasized an association with the fractional anisotropy of the left auditory fibers of the corpus callosum and with networks involved in linguistic processing in resting-state functional MRI. Overall, this evidence demonstrates a specific relationship between this locus and the establishment of the superior temporal regions that support human communication.
Collapse
Affiliation(s)
- Yann Le Guen
- UNATI, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | - François Leroy
- Cognitive Neuroimaging Unit, U992, INSERM, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | - Cathy Philippe
- UNATI, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | - Jean-François Mangin
- UNATI, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | - Ghislaine Dehaene-Lambertz
- Cognitive Neuroimaging Unit, U992, INSERM, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | - Vincent Frouin
- UNATI, Neurospin, Institut Joliot, CEA, Université Paris-Saclay, Gif-sur-Yvette 91191, France
| | | |
Collapse
|
94
|
Blank IA, Fedorenko E. No evidence for differences among language regions in their temporal receptive windows. Neuroimage 2020; 219:116925. [PMID: 32407994 DOI: 10.1016/j.neuroimage.2020.116925] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Revised: 03/20/2020] [Accepted: 05/06/2020] [Indexed: 10/24/2022] Open
Abstract
The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.
Collapse
Affiliation(s)
- Idan A Blank
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA.
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences and McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| |
Collapse
|
95
|
Zachlod D, Rüttgers B, Bludau S, Mohlberg H, Langner R, Zilles K, Amunts K. Four new cytoarchitectonic areas surrounding the primary and early auditory cortex in human brains. Cortex 2020; 128:1-21. [PMID: 32298845 DOI: 10.1016/j.cortex.2020.02.021] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Revised: 10/15/2019] [Accepted: 02/21/2020] [Indexed: 01/01/2023]
Abstract
The architectonical organization of putatively higher auditory areas in the human superior temporal gyrus and sulcus is not yet well understood. To provide a coherent map of this part of the brain, which is involved in language and other functions, we examined the cytoarchitecture and cortical parcellation of this region in histological sections of ten human postmortem brains using an observer-independent mapping approach. Two new areas were identified in the temporo-insular region (areas TeI, TI). TeI is medially adjacent to the primary auditory cortex (area Te1). TI is located between TeI and the insular cortex. Laterally adjacent to previously mapped areas Te2 and Te3, two new areas (STS1, STS2) were identified in the superior temporal sulcus. All four areas were mapped over their whole extent in serial, cell-body stained sections, and their cytoarchitecture was analyzed using quantitative image analysis and multivariate statistics. Interestingly, area TeI, which is located between area Te1 and area TI at the transition to the insula, was more similar in cytoarchitecture to lateral area Te2.1 than to the directly adjacent areas TI and Te1. Such structural similarity of areas medially and laterally to Te1 would be in line with the core-belt-parabelt concept in macaques. The cytoarchitectonic probabilistic maps of all areas show the localization of the areas and their interindividual variability. The new maps are publicly available and provide a basis to further explore structural-functional relationship of the language network in the temporal cortex.
Collapse
Affiliation(s)
- Daniel Zachlod
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany.
| | - Britta Rüttgers
- C. & O. Vogt Institute for Brain Research, University Hospital Düsseldorf, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany
| | - Sebastian Bludau
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | - Hartmut Mohlberg
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany
| | - Robert Langner
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany; Institute of Neuroscience and Medicine (INM-7), Research Centre Jülich, Jülich, Germany
| | - Karl Zilles
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany; JARA-BRAIN, Jülich-Aachen Research Alliance, Jülich, Germany
| | - Katrin Amunts
- Institute of Neuroscience and Medicine (INM-1), Research Centre Jülich, Jülich, Germany; C. & O. Vogt Institute for Brain Research, University Hospital Düsseldorf, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany; JARA-BRAIN, Jülich-Aachen Research Alliance, Jülich, Germany
| |
Collapse
|
96
|
Abstract
Syntax, the structure of sentences, enables humans to express an infinite range of meanings through finite means. The neurobiology of syntax has been intensely studied but with little consensus. Two main candidate regions have been identified: the posterior inferior frontal gyrus (pIFG) and the posterior middle temporal gyrus (pMTG). Integrating research in linguistics, psycholinguistics, and neuroscience, we propose a neuroanatomical framework for syntax that attributes distinct syntactic computations to these regions in a unified model. The key theoretical advances are adopting a modern lexicalized view of syntax in which the lexicon and syntactic rules are intertwined, and recognizing a computational asymmetry in the role of syntax during comprehension and production. Our model postulates a hierarchical lexical-syntactic function to the pMTG, which interconnects previously identified speech perception and conceptual-semantic systems in the temporal and inferior parietal lobes, crucial for both sentence production and comprehension. These relational hierarchies are transformed via the pIFG into morpho-syntactic sequences, primarily tied to production. We show how this architecture provides a better account of the full range of data and is consistent with recent proposals regarding the organization of phonological processes in the brain.
Collapse
Affiliation(s)
- William Matchin
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, 29208, USA
| | - Gregory Hickok
- Department of Cognitive Sciences, University of California, Irvine, Irvine, CA, 92697, USA
- Department of Language Science, University of California, Irvine, Irvine, CA, 92697, USA
| |
Collapse
|
97
|
Repetition enhancement to voice identities in the dog brain. Sci Rep 2020; 10:3989. [PMID: 32132562 PMCID: PMC7055288 DOI: 10.1038/s41598-020-60395-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Accepted: 02/06/2020] [Indexed: 01/19/2023] Open
Abstract
In the human speech signal, cues of speech sounds and voice identities are conflated, but they are processed separately in the human brain. The processing of speech sounds and voice identities is typically performed by non-primary auditory regions in humans and non-human primates. Additionally, these processes exhibit functional asymmetry in humans, indicating the involvement of distinct mechanisms. Behavioural studies indicate analogue side biases in dogs, but neural evidence for this functional dissociation is missing. In two experiments, using an fMRI adaptation paradigm, we presented awake dogs with natural human speech that either varied in segmental (change in speech sound) or suprasegmental (change in voice identity) content. In auditory regions, we found a repetition enhancement effect for voice identity processing in a secondary auditory region - the caudal ectosylvian gyrus. The same region did not show repetition effects for speech sounds, nor did the primary auditory cortex exhibit sensitivity to changes either in the segmental or in the suprasegmental content. Furthermore, we did not find evidence for functional asymmetry neither in the processing of speech sounds or voice identities. Our results in dogs corroborate former human and non-human primate evidence on the role of secondary auditory regions in the processing of suprasegmental cues, suggesting similar neural sensitivity to the identity of the vocalizer across the mammalian order.
Collapse
|
98
|
Houweling T, Becker R, Hervais-Adelman A. The noise-resilient brain: Resting-state oscillatory activity predicts words-in-noise recognition. BRAIN AND LANGUAGE 2020; 202:104727. [PMID: 31918321 DOI: 10.1016/j.bandl.2019.104727] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Revised: 12/09/2019] [Accepted: 12/13/2019] [Indexed: 06/10/2023]
Abstract
The role of neuronal oscillations in the processing of speech has recently come to prominence. Since resting-state (RS) brain activity has been shown to predict both task-related brain activation and behavioural performance, we set out to establish whether inter-individual differences in spectrally-resolved RS-MEG power are associated with variations in words-in-noise recognition in a sample of 88 participants made available by the Human Connectome Project. Positive associations with resilience to noise were observed with power in the range 21 and 29 Hz in a number of areas along the left temporal gyrus and temporo-parietal association areas peaking in left posterior superior temporal gyrus (pSTG). Significant associations were also found in the right posterior superior temporal gyrus in the frequency range 30-40 Hz. We propose that individual differences in words-in-noise performance are related to baseline excitability levels of the neural substrates of phonological processing.
Collapse
Affiliation(s)
- Thomas Houweling
- Neurolinguistics, Department of Psychology, University of Zürich, Binzmühlestrasse 14, 8050 Zürich, Switzerland.
| | - Robert Becker
- Neurolinguistics, Department of Psychology, University of Zürich, Binzmühlestrasse 14, 8050 Zürich, Switzerland
| | - Alexis Hervais-Adelman
- Neurolinguistics, Department of Psychology, University of Zürich, Binzmühlestrasse 14, 8050 Zürich, Switzerland
| |
Collapse
|
99
|
Bidelman GM, Bush LC, Boudreaux AM. Effects of Noise on the Behavioral and Neural Categorization of Speech. Front Neurosci 2020; 14:153. [PMID: 32180700 PMCID: PMC7057933 DOI: 10.3389/fnins.2020.00153] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2019] [Accepted: 02/10/2020] [Indexed: 02/02/2023] Open
Abstract
We investigated whether the categorical perception (CP) of speech might also provide a mechanism that aids its perception in noise. We varied signal-to-noise ratio (SNR) [clear, 0 dB, -5 dB] while listeners classified an acoustic-phonetic continuum (/u/ to /a/). Noise-related changes in behavioral categorization were only observed at the lowest SNR. Event-related brain potentials (ERPs) differentiated category vs. category-ambiguous speech by the P2 wave (~180-320 ms). Paralleling behavior, neural responses to speech with clear phonetic status (i.e., continuum endpoints) were robust to noise down to -5 dB SNR, whereas responses to ambiguous tokens declined with decreasing SNR. Results demonstrate that phonetic speech representations are more resistant to degradation than corresponding acoustic representations. Findings suggest the mere process of binning speech sounds into categories provides a robust mechanism to aid figure-ground speech perception by fortifying abstract categories from the acoustic signal and making the speech code more resistant to external interferences.
Collapse
Affiliation(s)
- Gavin M Bidelman
- Institute for Intelligent Systems, University of Memphis, Memphis, TN, United States.,School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, United States.,Department of Anatomy and Neurobiology, University of Tennessee Health Sciences Center, Memphis, TN, United States
| | - Lauren C Bush
- School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, United States
| | - Alex M Boudreaux
- School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, United States
| |
Collapse
|
100
|
Fei N, Ge J, Wang Y, Gao JH. Aging-related differences in the cortical network subserving intelligible speech. BRAIN AND LANGUAGE 2020; 201:104713. [PMID: 31759299 DOI: 10.1016/j.bandl.2019.104713] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2019] [Revised: 10/29/2019] [Accepted: 10/30/2019] [Indexed: 06/10/2023]
Abstract
Language communication is crucial throughout the lifespan. The current study investigated how aging affects the brain network subserving intelligible speech. Using functional magnetic resonance imaging, we compared brain responses to intelligible and unintelligible speech between older and young adults. Univariate and multivariate analyses revealed reduced brain activation and lower regional pattern distinctions in response to intelligible versus unintelligible speech in the left anterior superior temporal gyrus (aSTG) and the left inferior frontal gyrus (IFG) in the older compared with young adults. Notably, the functional connectivity between the left IFG and the left angular gyrus (AG) was increased and a significantly enhanced bidirectional effective connectivity between the left aSTG and the left AG was observed in the older adults for processing speech intelligibility. Our study revealed aging-related differences in the cortical activity for intelligible speech and suggested that increased frontal-temporal-parietal functional integration may help facilitate spoken language processing in older adults.
Collapse
Affiliation(s)
- Nanxi Fei
- Beijing City Key Lab for Medical Physics and Engineering, Institute of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China
| | - Jianqiao Ge
- Beijing City Key Lab for Medical Physics and Engineering, Institute of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China.
| | - Yi Wang
- Public Health Science and Engineering College, Tianjin University of Traditional Chinese Medicine, Tianjin, China
| | - Jia-Hong Gao
- Beijing City Key Lab for Medical Physics and Engineering, Institute of Heavy Ion Physics, School of Physics, Peking University, Beijing, China; Center for MRI Research, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing, China; McGovern Institute for Brain Research, Peking University, Beijing, China.
| |
Collapse
|