1
|
Kausel L, Michon M, Soto-Icaza P, Aboitiz F. A multimodal interface for speech perception: the role of the left superior temporal sulcus in social cognition and autism. Cereb Cortex 2024; 34:84-93. [PMID: 38696598 DOI: 10.1093/cercor/bhae066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 01/17/2024] [Accepted: 02/03/2024] [Indexed: 05/04/2024] Open
Abstract
Multimodal integration is crucial for human interaction, in particular for social communication, which relies on integrating information from various sensory modalities. Recently a third visual pathway specialized in social perception was proposed, which includes the right superior temporal sulcus (STS) playing a key role in processing socially relevant cues and high-level social perception. Importantly, it has also recently been proposed that the left STS contributes to audiovisual integration of speech processing. In this article, we propose that brain areas along the right STS that support multimodal integration for social perception and cognition can be considered homologs to those in the left, language-dominant hemisphere, sustaining multimodal integration of speech and semantic concepts fundamental for social communication. Emphasizing the significance of the left STS in multimodal integration and associated processes such as multimodal attention to socially relevant stimuli, we underscore its potential relevance in comprehending neurodevelopmental conditions characterized by challenges in social communication such as autism spectrum disorder (ASD). Further research into this left lateral processing stream holds the promise of enhancing our understanding of social communication in both typical development and ASD, which may lead to more effective interventions that could improve the quality of life for individuals with atypical neurodevelopment.
Collapse
Affiliation(s)
- Leonie Kausel
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Chile, Vergara 275, 8370076 Santiago, Chile
| | - Maëva Michon
- Praxiling Laboratory, Joint Research Unit (UMR 5267), Centre National de la Recherche Scientifique (CNRS), Université Paul Valéry, Montpellier, France, Route de Mende, 34199 Montpellier cedex 5, France
- Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Chile, Marcoleta 391, 2do piso, 8330024 Santiago, Chile
- Laboratorio de Neurociencia Cognitiva y Evolutiva, Facultad de Medicina, Pontificia Universidad Católica de Chile, Chile, Marcoleta 391, 2do piso, 8330024 Santiago, Chile
| | - Patricia Soto-Icaza
- Centro de Investigación en Complejidad Social (CICS), Facultad de Gobierno, Universidad del Desarrollo, Chile, Av. Las Condes 12461, edificio 3, piso 3, 7590943, Las Condes Santiago, Chile
| | - Francisco Aboitiz
- Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Chile, Marcoleta 391, 2do piso, 8330024 Santiago, Chile
- Laboratorio de Neurociencia Cognitiva y Evolutiva, Facultad de Medicina, Pontificia Universidad Católica de Chile, Chile, Marcoleta 391, 2do piso, 8330024 Santiago, Chile
| |
Collapse
|
2
|
Rennig J, Beauchamp MS. Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex. Neuroimage 2022; 247:118796. [PMID: 34906712 PMCID: PMC8819942 DOI: 10.1016/j.neuroimage.2021.118796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 11/18/2021] [Accepted: 12/08/2021] [Indexed: 11/18/2022] Open
Abstract
Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech.
Collapse
Affiliation(s)
- Johannes Rennig
- Division of Neuropsychology, Center of Neurology, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Michael S Beauchamp
- Department of Neurosurgery, Perelman School of Medicine, University of Pennsylvania, Richards Medical Research Building, A607, 3700 Hamilton Walk, Philadelphia, PA 19104-6016, United States.
| |
Collapse
|
3
|
Zhang C, Cai H, Xu X, Li Q, Li X, Zhao W, Qian Y, Zhu J, Yu Y. Genetic Architecture Underlying Differential Resting-state Functional Connectivity of Subregions Within the Human Visual Cortex. Cereb Cortex 2021; 32:2063-2078. [PMID: 34607357 DOI: 10.1093/cercor/bhab335] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 08/17/2021] [Accepted: 08/22/2021] [Indexed: 11/12/2022] Open
Abstract
The human visual cortex is a heterogeneous entity that has multiple subregions showing substantial variability in their functions and connections. We aimed to identify genes associated with resting-state functional connectivity (rsFC) of visual subregions using transcriptome-neuroimaging spatial correlations in discovery and validation datasets. Results showed that rsFC of eight visual subregions were associated with expression measures of eight gene sets, which were specifically expressed in brain tissue and showed the strongest correlations with visual behavioral processes. Moreover, there was a significant divergence in these gene sets and their functional features between medial and lateral visual subregions. Relative to those associated with lateral subregions, more genes associated with medial subregions were found to be enriched for neuropsychiatric diseases and more diverse biological functions and pathways, and to be specifically expressed in multiple types of neurons and immune cells and during the middle and late stages of cortical development. In addition to shared behavioral processes, lateral subregion associated genes were uniquely correlated with high-order cognition. These findings of commonalities and differences in the identified rsFC-related genes and their functional features across visual subregions may improve our understanding of the functional heterogeneity of the visual cortex from the perspective of underlying genetic architecture.
Collapse
Affiliation(s)
- Cun Zhang
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Huanhuan Cai
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Xiaotao Xu
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Qian Li
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Xueying Li
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Wenming Zhao
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Yinfeng Qian
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Jiajia Zhu
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| | - Yongqiang Yu
- Department of Radiology, The First Affiliated Hospital of Anhui Medical University, Hefei 230022, China.,Research Center of Clinical Medical Imaging, Anhui Province, Hefei 230032, China.,Anhui Provincial Institute of Translational Medicine, Hefei 230032, China
| |
Collapse
|
4
|
Maguinness C, von Kriegstein K. Visual mechanisms for voice-identity recognition flexibly adjust to auditory noise level. Hum Brain Mapp 2021; 42:3963-3982. [PMID: 34043249 PMCID: PMC8288083 DOI: 10.1002/hbm.25532] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 04/26/2021] [Accepted: 05/02/2021] [Indexed: 11/24/2022] Open
Abstract
Recognising the identity of voices is a key ingredient of communication. Visual mechanisms support this ability: recognition is better for voices previously learned with their corresponding face (compared to a control condition). This so‐called ‘face‐benefit’ is supported by the fusiform face area (FFA), a region sensitive to facial form and identity. Behavioural findings indicate that the face‐benefit increases in noisy listening conditions. The neural mechanisms for this increase are unknown. Here, using functional magnetic resonance imaging, we examined responses in face‐sensitive regions while participants recognised the identity of auditory‐only speakers (previously learned by face) in high (SNR −4 dB) and low (SNR +4 dB) levels of auditory noise. We observed a face‐benefit in both noise levels, for most participants (16 of 21). In high‐noise, the recognition of face‐learned speakers engaged the right posterior superior temporal sulcus motion‐sensitive face area (pSTS‐mFA), a region implicated in the processing of dynamic facial cues. The face‐benefit in high‐noise also correlated positively with increased functional connectivity between this region and voice‐sensitive regions in the temporal lobe in the group of 16 participants with a behavioural face‐benefit. In low‐noise, the face‐benefit was robustly associated with increased responses in the FFA and to a lesser extent the right pSTS‐mFA. The findings highlight the remarkably adaptive nature of the visual network supporting voice‐identity recognition in auditory‐only listening conditions.
Collapse
Affiliation(s)
- Corrina Maguinness
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Katharina von Kriegstein
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
5
|
Chung S, Son JW. Visual Perception in Autism Spectrum Disorder: A Review of Neuroimaging Studies. Soa Chongsonyon Chongsin Uihak 2020; 31:105-120. [PMID: 32665755 PMCID: PMC7350544 DOI: 10.5765/jkacap.200018] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Revised: 05/31/2020] [Accepted: 06/05/2020] [Indexed: 12/13/2022] Open
Abstract
Although autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by social impairments, patients with ASD frequently manifest atypical sensory behaviors. Recently, atypical sensory perception in ASD has received much attention, yet little is known about its cause or neurobiology. Herein, we review the findings from neuroimaging studies related to visual perception in ASD. Specifically, we examined the neural underpinnings of visual detection, motion perception, and face processing in ASD. Results from neuroimaging studies indicate that atypical visual perception in ASD may be influenced by attention or higher order cognitive mechanisms, and atypical face perception may be affected by disrupted social brain network. However, there is considerable evidence for atypical early visual processing in ASD. It is likely that visual perceptual abnormalities are independent of deficits of social functions or cognition. Importantly, atypical visual perception in ASD may enhance difficulties in dealing with complex and subtle social stimuli, or improve outstanding abilities in certain fields in individuals with Savant syndrome. Thus, future research is required to elucidate the characteristics and neurobiology of autistic visual perception to effectively apply these findings in the interventions of ASD.
Collapse
Affiliation(s)
- Seungwon Chung
- Department of Psychiatry, Chungbuk National University Hospital, Cheongju, Korea
| | - Jung-Woo Son
- Department of Neuropsychiatry, College of Medicine, Chungbuk National University, Cheongju, Korea
| |
Collapse
|
6
|
Borowiak K, Maguinness C, von Kriegstein K. Dorsal-movement and ventral-form regions are functionally connected during visual-speech recognition. Hum Brain Mapp 2020; 41:952-972. [PMID: 31749219 PMCID: PMC7267922 DOI: 10.1002/hbm.24852] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Revised: 09/03/2019] [Accepted: 10/21/2019] [Indexed: 01/17/2023] Open
Abstract
Faces convey social information such as emotion and speech. Facial emotion processing is supported via interactions between dorsal-movement and ventral-form visual cortex regions. Here, we explored, for the first time, whether similar dorsal-ventral interactions (assessed via functional connectivity), might also exist for visual-speech processing. We then examined whether altered dorsal-ventral connectivity is observed in adults with high-functioning autism spectrum disorder (ASD), a disorder associated with impaired visual-speech recognition. We acquired functional magnetic resonance imaging (fMRI) data with concurrent eye tracking in pairwise matched control and ASD participants. In both groups, dorsal-movement regions in the visual motion area 5 (V5/MT) and the temporal visual speech area (TVSA) were functionally connected to ventral-form regions (i.e., the occipital face area [OFA] and the fusiform face area [FFA]) during the recognition of visual speech, in contrast to the recognition of face identity. Notably, parts of this functional connectivity were decreased in the ASD group compared to the controls (i.e., right V5/MT-right OFA, left TVSA-left FFA). The results confirmed our hypothesis that functional connectivity between dorsal-movement and ventral-form regions exists during visual-speech processing. Its partial dysfunction in ASD might contribute to difficulties in the recognition of dynamic face information relevant for successful face-to-face communication.
Collapse
Affiliation(s)
- Kamila Borowiak
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Berlin School of Mind and Brain, Humboldt University of BerlinBerlinGermany
| | - Corrina Maguinness
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Katharina von Kriegstein
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| |
Collapse
|