1
|
Clarke S, Da Costa S, Crottaz-Herbette S. Dual Representation of the Auditory Space. Brain Sci 2024; 14:535. [PMID: 38928534 PMCID: PMC11201621 DOI: 10.3390/brainsci14060535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Revised: 05/19/2024] [Accepted: 05/21/2024] [Indexed: 06/28/2024] Open
Abstract
Auditory spatial cues contribute to two distinct functions, of which one leads to explicit localization of sound sources and the other provides a location-linked representation of sound objects. Behavioral and imaging studies demonstrated right-hemispheric dominance for explicit sound localization. An early clinical case study documented the dissociation between the explicit sound localizations, which was heavily impaired, and fully preserved use of spatial cues for sound object segregation. The latter involves location-linked encoding of sound objects. We review here evidence pertaining to brain regions involved in location-linked representation of sound objects. Auditory evoked potential (AEP) and functional magnetic resonance imaging (fMRI) studies investigated this aspect by comparing encoding of individual sound objects, which changed their locations or remained stationary. Systematic search identified 1 AEP and 12 fMRI studies. Together with studies of anatomical correlates of impaired of spatial-cue-based sound object segregation after focal brain lesions, the present evidence indicates that the location-linked representation of sound objects involves strongly the left hemisphere and to a lesser degree the right hemisphere. Location-linked encoding of sound objects is present in several early-stage auditory areas and in the specialized temporal voice area. In these regions, emotional valence benefits from location-linked encoding as well.
Collapse
Affiliation(s)
- Stephanie Clarke
- Neuropsychology and Neurorehabilitation Service, Centre Hospitalier Universitaire Vaudois (CHUV), University of Lausanne, Av. Pierre-Decker 5, 1011 Lausanne, Switzerland; (S.D.C.); (S.C.-H.)
| | | | | |
Collapse
|
2
|
Wu J, Nie S, Li C, Wang X, Peng Y, Shang J, Diao L, Ding H, Si Q, Wang S, Tong R, Li Y, Sun L, Zhang J. Sound-localization-related activation and functional connectivity of dorsal auditory pathway in relation to demographic, cognitive, and behavioral characteristics in age-related hearing loss. Front Neurosci 2024; 18:1353413. [PMID: 38562303 PMCID: PMC10982313 DOI: 10.3389/fnins.2024.1353413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 02/26/2024] [Indexed: 04/04/2024] Open
Abstract
Background Patients with age-related hearing loss (ARHL) often struggle with tracking and locating sound sources, but the neural signature associated with these impairments remains unclear. Materials and methods Using a passive listening task with stimuli from five different horizontal directions in functional magnetic resonance imaging, we defined functional regions of interest (ROIs) of the auditory "where" pathway based on the data of previous literatures and young normal hearing listeners (n = 20). Then, we investigated associations of the demographic, cognitive, and behavioral features of sound localization with task-based activation and connectivity of the ROIs in ARHL patients (n = 22). Results We found that the increased high-level region activation, such as the premotor cortex and inferior parietal lobule, was associated with increased localization accuracy and cognitive function. Moreover, increased connectivity between the left planum temporale and left superior frontal gyrus was associated with increased localization accuracy in ARHL. Increased connectivity between right primary auditory cortex and right middle temporal gyrus, right premotor cortex and left anterior cingulate cortex, and right planum temporale and left lingual gyrus in ARHL was associated with decreased localization accuracy. Among the ARHL patients, the task-dependent brain activation and connectivity of certain ROIs were associated with education, hearing loss duration, and cognitive function. Conclusion Consistent with the sensory deprivation hypothesis, in ARHL, sound source identification, which requires advanced processing in the high-level cortex, is impaired, whereas the right-left discrimination, which relies on the primary sensory cortex, is compensated with a tendency to recruit more resources concerning cognition and attention to the auditory sensory cortex. Overall, this study expanded our understanding of the neural mechanisms contributing to sound localization deficits associated with ARHL and may serve as a potential imaging biomarker for investigating and predicting anomalous sound localization.
Collapse
Affiliation(s)
- Junzhi Wu
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Shuai Nie
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Chunlin Li
- School of Biomedical Engineering, Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Xing Wang
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Ye Peng
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Jiaqi Shang
- Center of Clinical Hearing, Shandong Second Provincial General Hospital, Jinan, Shandong, China
| | - Linan Diao
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Hongping Ding
- College of Special Education, Binzhou Medical University, Yantai, Shandong, China
| | - Qian Si
- School of Cyber Science and Technology, Beihang University, Beijing, China
| | - Songjian Wang
- Key Laboratory of Otolaryngology, Head and Neck Surgery, Ministry of Education, Beijing Institute of Otolaryngology, Beijing, China
- Department of Otolaryngology, Head and Neck Surgery, Beijing Tongren Hospital, Capital Medical University, Beijing, China
| | - Renjie Tong
- School of Biomedical Engineering, Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Yutang Li
- School of Biomedical Engineering, Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Liwei Sun
- School of Biomedical Engineering, Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Juan Zhang
- Department of Otorhinolaryngology Head and Neck Surgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
3
|
Jin J, Pan N, Chen J, Benesty J, Yang Y. A binaural heterophasic adaptive beamformer and its deep learning assisted implementation. Pattern Recognit Lett 2023. [DOI: 10.1016/j.patrec.2023.02.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
|
4
|
Aller M, Mihalik A, Noppeney U. Audiovisual adaptation is expressed in spatial and decisional codes. Nat Commun 2022; 13:3924. [PMID: 35798733 PMCID: PMC9262908 DOI: 10.1038/s41467-022-31549-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Accepted: 06/21/2022] [Indexed: 11/09/2022] Open
Abstract
The brain adapts dynamically to the changing sensory statistics of its environment. Recent research has started to delineate the neural circuitries and representations that support this cross-sensory plasticity. Combining psychophysics and model-based representational fMRI and EEG we characterized how the adult human brain adapts to misaligned audiovisual signals. We show that audiovisual adaptation is associated with changes in regional BOLD-responses and fine-scale activity patterns in a widespread network from Heschl's gyrus to dorsolateral prefrontal cortices. Audiovisual recalibration relies on distinct spatial and decisional codes that are expressed with opposite gradients and time courses across the auditory processing hierarchy. Early activity patterns in auditory cortices encode sounds in a continuous space that flexibly adapts to misaligned visual inputs. Later activity patterns in frontoparietal cortices code decisional uncertainty consistent with these spatial transformations. Our findings suggest that regions within the auditory processing hierarchy multiplex spatial and decisional codes to adapt flexibly to the changing sensory statistics in the environment.
Collapse
Affiliation(s)
- Máté Aller
- Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, UK.
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK.
| | - Agoston Mihalik
- Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, UK
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - Uta Noppeney
- Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, UK
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| |
Collapse
|
5
|
Luke R, Innes-Brown H, Undurraga JA, McAlpine D. Human cortical processing of interaural coherence. iScience 2022; 25:104181. [PMID: 35494228 PMCID: PMC9051632 DOI: 10.1016/j.isci.2022.104181] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2021] [Revised: 11/29/2021] [Accepted: 03/29/2022] [Indexed: 11/17/2022] Open
Abstract
Sounds reach the ears as a mixture of energy generated by different sources. Listeners extract cues that distinguish different sources from one another, including how similar sounds arrive at the two ears, the interaural coherence (IAC). Here, we find listeners cannot reliably distinguish two completely interaurally coherent sounds from a single sound with reduced IAC. Pairs of sounds heard toward the front were readily confused with single sounds with high IAC, whereas those heard to the sides were confused with single sounds with low IAC. Sounds that hold supra-ethological spatial cues are perceived as more diffuse than can be accounted for by their IAC, and this is accounted for by a computational model comprising a restricted, and sound-frequency dependent, distribution of auditory-spatial detectors. We observed elevated cortical hemodynamic responses for sounds with low IAC, suggesting that the ambiguity elicited by sounds with low interaural similarity imposes elevated cortical load.
Collapse
Affiliation(s)
- Robert Luke
- Macquarie University, Sydney, NSW, Australia
- The Bionics Institute, Melbourne, VIC, Australia
| | | | | | | |
Collapse
|
6
|
Wang C, Wang Z, Xie B, Shi X, Yang P, Liu L, Qu T, Qin Q, Xing Y, Zhu W, Teipel SJ, Jia J, Zhao G, Li L, Tang Y. Binaural processing deficit and cognitive impairment in Alzheimer's disease. Alzheimers Dement 2021; 18:1085-1099. [PMID: 34569690 DOI: 10.1002/alz.12464] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 07/07/2021] [Accepted: 08/05/2021] [Indexed: 01/08/2023]
Abstract
Speech comprehension in noisy environments depends on central auditory functions, which are vulnerable in Alzheimer's disease (AD). Binaural processing exploits two ear sounds to optimally process degraded sound information; its characteristics are poorly understood in AD. We studied behavioral and electrophysiological alterations in binaural processing among 121 participants (AD = 27; amnestic mild cognitive impairment [aMCI] = 33; subjective cognitive decline [SCD] = 30; cognitively normal [CN] = 31). We observed impairment of binaural processing in AD and aMCI, and detected a U-shaped curve change in phase synchrony (declining from CN to SCD and to aMCI, but increasing from aMCI to AD). This improvement in phase synchrony accompanying more severe cognitive stages could reflect neural adaptation for binaural processing. Moreover, increased phase synchrony is associated with worse memory during the stages when neural adaptation apparently occurs. These findings support a hypothesis that neural adaptation for binaural processing deficit may exacerbate cognitive impairment, which could help identify biomarkers and therapeutic targets in AD.
Collapse
Affiliation(s)
- Changming Wang
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Zhibin Wang
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Beijia Xie
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Xinrui Shi
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Pengcheng Yang
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,Speech and Hearing Research Center, Peking University, Beijing, China
| | - Lei Liu
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,Speech and Hearing Research Center, Peking University, Beijing, China
| | - Tianshu Qu
- Speech and Hearing Research Center, Peking University, Beijing, China.,Key Laboratory on Machine Perception (Ministry of Education), Peking University, Beijing, China
| | - Qi Qin
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Yi Xing
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China.,Key Laboratory of Neurodegenerative Diseases, Ministry of Education of the People's Republic of China, Beijing, China
| | - Wei Zhu
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Stefan J Teipel
- Department of Psychosomatic Medicine, University Medicine Rostock, Rostock, Germany.,DZNE, German Center for Neurodegenerative Diseases, Rostock, Germany
| | - Jianping Jia
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China.,Key Laboratory of Neurodegenerative Diseases, Ministry of Education of the People's Republic of China, Beijing, China.,Center of Alzheimer's Disease, Beijing Institute for Brain Disorders, Beijing, China.,Beijing Key Laboratory of Geriatric Cognitive Disorders, Beijing, China.,National Clinical Research Center for Geriatric Disorders, Beijing, China
| | - Guoguang Zhao
- Department of Neurosurgery, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China
| | - Liang Li
- School of Psychological and Cognitive Sciences, Peking University, Beijing, China.,Speech and Hearing Research Center, Peking University, Beijing, China.,Key Laboratory on Machine Perception (Ministry of Education), Peking University, Beijing, China.,Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China.,Beijing Institute for Brain Disorders, Beijing, China
| | - Yi Tang
- Innovation Center for Neurological Disorders, Department of Neurology, Xuanwu Hospital, Capital Medical University, National Center for Neurological Disorders, Beijing, China.,Key Laboratory of Neurodegenerative Diseases, Ministry of Education of the People's Republic of China, Beijing, China
| |
Collapse
|
7
|
Zheng Y, Liu L, Li R, Wu Z, Chen L, Li J, Wu C, Kong L, Zhang C, Lei M, She S, Ning Y, Li L. Impaired interaural correlation processing in people with schizophrenia. Eur J Neurosci 2021; 54:6646-6662. [PMID: 34494695 DOI: 10.1111/ejn.15449] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 08/19/2021] [Accepted: 09/03/2021] [Indexed: 01/05/2023]
Abstract
Detection of transient changes in interaural correlation is based on the temporal precision of the central representations of acoustic signals. Whether schizophrenia impairs the temporal precision in the interaural correlation process is not clear. In both participants with schizophrenia and matched healthy-control participants, this study examined the detection of a break in interaural correlation (BIC, a change in interaural correlation from 1 to 0 and back to 1), including the longest interaural delay at which a BIC was just audible, representing the temporal extent of the primitive auditory memory (PAM). Moreover, BIC-induced electroencephalograms (EEGs) and the relationships between the early binaural psychoacoustic processing and higher cognitive functions, which were assessed by the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), were examined. The results showed that compared to healthy controls, participants with schizophrenia exhibited poorer BIC detection, PAM and RBANS score. Both the BIC-detection accuracy and the PAM extent were correlated with the RBANS score. Moreover, participants with schizophrenia showed weaker BIC-induced N1-P2 amplitude which was correlated with both theta-band power and inter-trial phase coherence. These results suggested that schizophrenia impairs the temporal precision of the central representations of acoustic signals, affecting both interaural correlation processing and higher-order cognitions.
Collapse
Affiliation(s)
- Yingjun Zheng
- The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, China
| | - Lei Liu
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Ruikeng Li
- The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, China
| | - Zhemeng Wu
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Liangjie Chen
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Juanhua Li
- The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, China
| | - Chao Wu
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Lingzhi Kong
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Changxin Zhang
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Ming Lei
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| | - Shenglin She
- The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, China
| | - Yuping Ning
- The Affiliated Brain Hospital of Guangzhou Medical University, Guangzhou, China
| | - Liang Li
- School of Psychological and Cognitive Sciences, Key Laboratory on Machine Perception (Ministry of Education), Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China
| |
Collapse
|
8
|
Han JH, Lee J, Lee HJ. Ear-Specific Hemispheric Asymmetry in Unilateral Deafness Revealed by Auditory Cortical Activity. Front Neurosci 2021; 15:698718. [PMID: 34393711 PMCID: PMC8363420 DOI: 10.3389/fnins.2021.698718] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Accepted: 07/12/2021] [Indexed: 12/14/2022] Open
Abstract
Profound unilateral deafness reduces the ability to localize sounds achieved via binaural hearing. Furthermore, unilateral deafness promotes a substantial change in cortical processing to binaural stimulation, thereby leading to reorganization over the whole brain. Although distinct patterns in the hemispheric laterality depending on the side and duration of deafness have been suggested, the neurological mechanisms underlying the difference in relation to behavioral performance when detecting spatially varied cues remain unknown. To elucidate the mechanism, we compared N1/P2 auditory cortical activities and the pattern of hemispheric asymmetry of normal hearing, unilaterally deaf (UD), and simulated acute unilateral hearing loss groups while passively listening to speech sounds delivered from different locations under open free field condition. The behavioral performances of the participants concerning sound localization were measured by detecting sound sources in the azimuth plane. The results reveal a delayed reaction time in the right-sided UD (RUD) group for the sound localization task and prolonged P2 latency compared to the left-sided UD (LUD) group. Moreover, the RUD group showed adaptive cortical reorganization evidenced by increased responses in the hemisphere ipsilateral to the intact ear for individuals with better sound localization whereas left-sided unilateral deafness caused contralateral dominance in activity from the hearing ear. The brain dynamics of right-sided unilateral deafness indicate greater capability of adaptive change to compensate for impairment in spatial hearing. In addition, cortical N1 responses to spatially varied speech sounds in unilateral deaf people were inversely related to the duration of deafness in the area encompassing the right auditory cortex, indicating that early intervention would be needed to protect from maladaptation of the central auditory system following unilateral deafness.
Collapse
Affiliation(s)
- Ji-Hye Han
- Laboratory of Brain & Cognitive Sciences for Convergence Medicine, Hallym University College of Medicine, Anyang-si, South Korea
| | - Jihyun Lee
- Laboratory of Brain & Cognitive Sciences for Convergence Medicine, Hallym University College of Medicine, Anyang-si, South Korea
| | - Hyo-Jeong Lee
- Laboratory of Brain & Cognitive Sciences for Convergence Medicine, Hallym University College of Medicine, Anyang-si, South Korea.,Department of Otorhinolaryngology-Head and Neck Surgery, Hallym University College of Medicine, Chuncheon-si, South Korea
| |
Collapse
|
9
|
Akama H, Yuan Y, Awazu S. Task-induced brain functional connectivity as a representation of schema for mediating unsupervised and supervised learning dynamics in language acquisition. Brain Behav 2021; 11:e02157. [PMID: 33951344 PMCID: PMC8213930 DOI: 10.1002/brb3.2157] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 03/12/2021] [Accepted: 04/02/2021] [Indexed: 11/08/2022] Open
Abstract
INTRODUCTION Based on the schema theory advanced by Rumelhart and Norman, we shed light on the individual variability in brain dynamics induced by hybridization of learning methodologies, particularly alternating unsupervised learning and supervised learning in language acquisition. The concept of "schema" implies a latent knowledge structure that a learner holds and updates as intrinsic to his or her cognitive space for guiding the processing of newly arriving information. METHODS We replicated the cognitive experiment of Onnis and Thiessen on implicit statistical learning ability in language acquisition but included additional factors of prosodic variables and explicit supervised learning. Functional magnetic resonance imaging was performed to identify the functional network connections for schema updating by alternately using unsupervised and supervised artificial grammar learning tasks to segment potential words. RESULTS Regardless of the quality of task performance, the default mode network represented the first stage of spontaneous unsupervised learning, and the wrap-up accomplishment for successful subjects of the whole hybrid learning in concurrence with the task-related auditory language networks. Furthermore, subjects who could easily "tune" the schema for recording a high task precision rate resorted even at an early stage to a self-supervised learning, or "superlearning," as a set of different learning mechanisms that act in synergy to trigger widespread neuro-transformation with a focus on the cerebellum. CONCLUSIONS Investigation of the brain dynamics revealed by functional connectivity imaging analysis was able to differentiate the synchronized neural responses with respect to learning methods and the order effect that affects hybrid learning.
Collapse
Affiliation(s)
- Hiroyuki Akama
- Institute of Liberal Arts/Department of Life Science and Technology, Tokyo Institute of Technology, Tokyo, Japan
| | - Yixin Yuan
- Marcus Autism Center, Children's Healthcare of Atlanta, Atlanta, GA, USA.,Division of Autism & Related Disabilities, Department of Pediatrics, Emory University School of Medicine, Atlanta, GA, USA
| | - Shunji Awazu
- Faculty of Humanities and Social Sciences, Jissen Women's University, Tokyo, Japan
| |
Collapse
|
10
|
Leng X, Chen J, Benesty J. On the compromise between noise reduction and speech/noise spatial information preservation in binaural speech enhancement. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2021; 149:3151. [PMID: 34241094 DOI: 10.1121/10.0004854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 04/13/2021] [Indexed: 06/13/2023]
Abstract
Spatial information is important for human perception of speech and sound signals. However, this information is often either distorted or completely neglected in noise reduction because it is challenging, to say the least, to achieve optimal noise reduction and accurate spatial information preservation at the same time. This paper studies the problem of binaural speech enhancement. By jointly diagonalizing the speech and noise correlation matrices, we present a method to construct the noise reduction filter as a linear combination of different eigenvectors, which span a certain subspace of the entire space. A different dimension of the subspace gives a different trade-off between noise reduction and speech/noise spatial information preservation. On the one side, if the dimension is equal to 1, maximum noise reduction is achieved but at the price of significant spatial information distortion. On the other extreme, if the dimension of the subspace is equal to that of the entire space, spatial information is accurately preserved but at the cost of no noise reduction. Therefore, one can achieve different levels of compromises between the amount of noise reduction and the level of speech/noise spatial information preservation by adjusting the dimension of the used subspace.
Collapse
Affiliation(s)
- Xin Leng
- Center of Intelligent Acoustics and Immersive Communications and School of Marine Science and Technology, Northwestern Polytechnical University, Xi'an, Shaanxi 710072, China
| | - Jingdong Chen
- Center of Intelligent Acoustics and Immersive Communications, Northwestern Polytechnical University, Xi'an, Shaanxi 710072, China
| | - Jacob Benesty
- Institut National de la Recherche Scientifique-Énergie, Matériaux et Télécommunications, University of Quebec, Montreal, Québec H5A 1K6, Canada
| |
Collapse
|
11
|
Wang Y, Chen J, Benesty J, Jin J, Huang G. Binaural Heterophasic Superdirective Beamforming. SENSORS (BASEL, SWITZERLAND) 2020; 21:s21010074. [PMID: 33375543 PMCID: PMC7794733 DOI: 10.3390/s21010074] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/31/2020] [Revised: 12/16/2020] [Accepted: 12/22/2020] [Indexed: 06/12/2023]
Abstract
The superdirective beamformer, while attractive for processing broadband acoustic signals, often suffers from the problem of white noise amplification. So, its application requires well-designed acoustic arrays with sensors of extremely low self-noise level, which is difficult if not impossible to attain. In this paper, a new binaural superdirective beamformer is proposed, which is divided into two sub-beamformers. Based on studies and facts in psychoacoustics, these two filters are designed in such a way that they are orthogonal to each other to make the white noise components in the binaural beamforming outputs incoherent while maximizing the output interaural coherence of the diffuse noise, which is important for the brain to localize the sound source of interest. As a result, the signal of interest in the binaural superdirective beamformer's outputs is in phase but the white noise components in the outputs are random phase, so the human auditory system can better separate the acoustic signal of interest from white noise by listening to the outputs of the proposed approach. Experimental results show that the derived binaural superdirective beamformer is superior to its conventional monaural counterpart.
Collapse
Affiliation(s)
- Yuzhu Wang
- Center of Intelligent Acoustics and Immersive Communications, Northwestern Polytechnical University, 127 Youyi West Road, Xi’an 710072, China; (Y.W.); (J.J.)
| | - Jingdong Chen
- Center of Intelligent Acoustics and Immersive Communications, Northwestern Polytechnical University, 127 Youyi West Road, Xi’an 710072, China; (Y.W.); (J.J.)
| | - Jacob Benesty
- INRS-EMT, University of Quebec, 800 de la Gauchetiere Ouest, Montreal, QC H5A 1K6, Canada;
| | - Jilu Jin
- Center of Intelligent Acoustics and Immersive Communications, Northwestern Polytechnical University, 127 Youyi West Road, Xi’an 710072, China; (Y.W.); (J.J.)
| | - Gongping Huang
- Andrew and Erna Viterby Faculty of Electrical Engineering, Technion-Israel Institute of Technology, Technion City, Haifa 32000, Israel;
| |
Collapse
|
12
|
Soeta Y, Ariki A. Subjective Salience of Birdsong and Insect Song with Equal Sound Pressure Level and Loudness. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E8858. [PMID: 33260514 PMCID: PMC7731388 DOI: 10.3390/ijerph17238858] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 11/24/2020] [Accepted: 11/25/2020] [Indexed: 11/16/2022]
Abstract
Birdsong is used to communicate the position of stairwells to visually impaired people in train stations in Japan. However, more than 40% of visually impaired people reported that such sounds were difficult to identify. Train companies seek to present the sounds at a sound pressure level that is loud enough to be detected, but not so loud as to be annoying. Therefore, salient birdsongs with relatively low sound pressure levels are required. In the current study, we examined the salience of different types of birdsong and insect song, and determined the dominant physical parameters related to salience. We considered insect songs because both birdsongs and insect songs have been found to have positive effects on soundscapes. We evaluated subjective saliences of birdsongs and insect songs using paired comparison methods, and examined the relationships between subjective salience and physical parameters. In total, 62 participants evaluated 18 types of bird songs and 16 types of insect sounds. The results indicated that the following features significantly influenced subjective salience: the maximum peak amplitude of the autocorrelation function, which signifies pitch strength; the interaural cross-correlation coefficient, which signifies apparent source width; the amplitude fluctuation component; and spectral content, such as flux and skewness.
Collapse
Affiliation(s)
- Yoshiharu Soeta
- Biomedical Research Institute, National Institute of Advanced Industrial Science and Technology (AIST), Osaka 563-8577, Japan;
| | | |
Collapse
|
13
|
Liang Y, Liu B, Li X, Wang P, Wang B. Revealing the differences of the representations of sounds from different directions in the human brain using functional connectivity. Neurosci Lett 2020; 718:134746. [PMID: 31923522 DOI: 10.1016/j.neulet.2020.134746] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2019] [Revised: 01/03/2020] [Accepted: 01/06/2020] [Indexed: 11/24/2022]
Abstract
Many studies have focused on the processing mechanism of sound directions in the human brain, however, as far as we know, it remains unclear whether the representations of sounds from different directions are different. In the present study, 28 subjects were scanned while listening to sounds from different directions. We used the whole-brain functional connectivity (FC) analysis to explore which brain regions had significant changes. Our results revealed that sounds from different directions affected the FC in the widely distributed regions. Importantly, all regions showed significant differences in FC between the central and eccentric directions, while few regions showed a difference between the left and right directions. These findings revealed the differences in the representations of sounds from different directions.
Collapse
Affiliation(s)
- Yaping Liang
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, PR China; College of Intelligence and Computing, Tianjin University, Tianjin, 300350, PR China
| | - Baolin Liu
- School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, 100083, PR China.
| | - Xianglin Li
- Medical Imaging Research Institute, Binzhou Medical University, Yantai, Shandong, 264003, PR China
| | - Peiyuan Wang
- Department of Radiology, Yantai Affiliated Hospital of Binzhou Medical University, Yantai, Shandong, 264003, PR China
| | - Bin Wang
- Medical Imaging Research Institute, Binzhou Medical University, Yantai, Shandong, 264003, PR China
| |
Collapse
|
14
|
Kalyvas A, Koutsarnakis C, Komaitis S, Karavasilis E, Christidi F, Skandalakis GP, Liouta E, Papakonstantinou O, Kelekis N, Duffau H, Stranjalis G. Mapping the human middle longitudinal fasciculus through a focused anatomo-imaging study: shifting the paradigm of its segmentation and connectivity pattern. Brain Struct Funct 2019; 225:85-119. [PMID: 31773331 DOI: 10.1007/s00429-019-01987-6] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Accepted: 11/14/2019] [Indexed: 12/11/2022]
Abstract
Τhe middle longitudinal fasciculus (MdLF) was initially identified in humans as a discrete subcortical pathway connecting the superior temporal gyrus (STG) to the angular gyrus (AG). Further anatomo-imaging studies, however, proposed more sophisticated but conflicting connectivity patterns and have created a vague perception on its functional anatomy. Our aim was, therefore, to investigate the ambiguous structural architecture of this tract through focused cadaveric dissections augmented by a tailored DTI protocol in healthy participants from the Human Connectome dataset. Three segments and connectivity patterns were consistently recorded: the MdLF-I, connecting the dorsolateral Temporal Pole (TP) and STG to the Superior Parietal Lobule/Precuneus, through the Heschl's gyrus; the MdLF-II, connecting the dorsolateral TP and the STG with the Parieto-occipital area through the posterior transverse gyri and the MdLF-III connecting the most anterior part of the TP to the posterior border of the occipital lobe through the AG. The lack of an established termination pattern to the AG and the fact that no significant leftward asymmetry is disclosed tend to shift the paradigm away from language function. Conversely, the theory of "where" and "what" auditory pathways, the essential relationship of the MdLF with the auditory cortex and the functional role of the cortical areas implicated in its connectivity tend to shift the paradigm towards auditory function. Allegedly, the MdLF-I and MdLF-II segments could underpin the perception of auditory representations; whereas, the MdLF-III could potentially subserve the integration of auditory and visual information.
Collapse
Affiliation(s)
- Aristotelis Kalyvas
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece.,Department of Neurosurgery, Evangelismos Hospital, National and Kapodistrian University of Athens, Athens, Greece.,Department of Anatomy, Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Christos Koutsarnakis
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece. .,Department of Neurosurgery, Evangelismos Hospital, National and Kapodistrian University of Athens, Athens, Greece. .,Department of Anatomy, Medical School, National and Kapodistrian University of Athens, Athens, Greece.
| | - Spyridon Komaitis
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece.,Department of Neurosurgery, Evangelismos Hospital, National and Kapodistrian University of Athens, Athens, Greece.,Department of Anatomy, Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Efstratios Karavasilis
- Second Department of Radiology, Attikon Hospital, National and Kapodistrian University of Athens, Athens, Greece
| | - Foteini Christidi
- First Department of Neurology, Aeginition Hospital, National and Kapodistrian University of Athens, Athens, Greece
| | - Georgios P Skandalakis
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece.,Department of Anatomy, Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Evangelia Liouta
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece.,Hellenic Center for Neurosurgical Research, "PetrosKokkalis", Athens, Greece
| | - Olympia Papakonstantinou
- Second Department of Radiology, Attikon Hospital, National and Kapodistrian University of Athens, Athens, Greece
| | - Nikolaos Kelekis
- Second Department of Radiology, Attikon Hospital, National and Kapodistrian University of Athens, Athens, Greece
| | - Hugues Duffau
- Department of Neurosurgery, Montpellier University Medical Center, Gui de Chauliac Hospital, Montpellier, France
| | - George Stranjalis
- Athens Microneurosurgery Laboratory, Evangelismos Hospital, Athens, Greece.,Department of Neurosurgery, Evangelismos Hospital, National and Kapodistrian University of Athens, Athens, Greece.,Hellenic Center for Neurosurgical Research, "PetrosKokkalis", Athens, Greece
| |
Collapse
|
15
|
Park H, Kayser C. Shared neural underpinnings of multisensory integration and trial-by-trial perceptual recalibration in humans. eLife 2019; 8:47001. [PMID: 31246172 PMCID: PMC6660215 DOI: 10.7554/elife.47001] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2019] [Accepted: 06/26/2019] [Indexed: 01/05/2023] Open
Abstract
Perception adapts to mismatching multisensory information, both when different cues appear simultaneously and when they appear sequentially. While both multisensory integration and adaptive trial-by-trial recalibration are central for behavior, it remains unknown whether they are mechanistically linked and arise from a common neural substrate. To relate the neural underpinnings of sensory integration and recalibration, we measured whole-brain magnetoencephalography while human participants performed an audio-visual ventriloquist task. Using single-trial multivariate analysis, we localized the perceptually-relevant encoding of multisensory information within and between trials. While we found neural signatures of multisensory integration within temporal and parietal regions, only medial superior parietal activity encoded past and current sensory information and mediated the perceptual recalibration within and between trials. These results highlight a common neural substrate of sensory integration and perceptual recalibration, and reveal a role of medial parietal regions in linking present and previous multisensory evidence to guide adaptive behavior. A good ventriloquist will make their audience experience an illusion. The speech the spectators hear appears to come from the mouth of the puppet and not from the puppeteer. Moviegoers experience the same illusion: they perceive dialogue as coming from the mouths of the actors on screen, rather than from the loudspeakers mounted on the walls. Known as the ventriloquist effect, this ‘trick’ exists because the brain assumes that sights and sounds which occur at the same time have the same origin, and it therefore combines the two sets of sensory stimuli. A version of the ventriloquist effect can be induced in the laboratory. Participants hear a sound while watching a simple visual stimulus (for instance, a circle) appear on a screen. When asked to pinpoint the origin of the noise, volunteers choose a location shifted towards the circle, even if this was not where the sound came from. In addition, this error persists when the visual stimulus is no longer present: if a standard trial is followed by a trial that features a sound but no circle, participants perceive the sound in the second test as ‘drawn’ towards the direction of the former shift. This is known as the ventriloquist aftereffect. By scanning the brains of healthy volunteers performing this task, Park and Kayser show that a number of brain areas contribute to the ventriloquist effect. All of these regions help to combine what we see with what we hear, but only one maintains representations of the combined sensory inputs over time. Called the medial superior parietal cortex, this area is unique in contributing to both the ventriloquist effect and its aftereffect. We must constantly use past and current sensory information to adapt our behavior to the environment. The results by Park and Kayser shed light on the brain structures that underpin our capacity to combine information from several senses, as well as our ability to encode memories. Such knowledge should be useful to explore how we can make flexible decisions.
Collapse
Affiliation(s)
- Hame Park
- Department for Cognitive Neuroscience, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Center of Excellence Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany.,Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
| | - Christoph Kayser
- Department for Cognitive Neuroscience, Faculty of Biology, Bielefeld University, Bielefeld, Germany.,Center of Excellence Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany
| |
Collapse
|
16
|
Active Sound Localization Sharpens Spatial Tuning in Human Primary Auditory Cortex. J Neurosci 2018; 38:8574-8587. [PMID: 30126968 DOI: 10.1523/jneurosci.0587-18.2018] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2018] [Revised: 07/09/2018] [Accepted: 07/19/2018] [Indexed: 11/21/2022] Open
Abstract
Spatial hearing sensitivity in humans is dynamic and task-dependent, but the mechanisms in human auditory cortex that enable dynamic sound location encoding remain unclear. Using functional magnetic resonance imaging (fMRI), we assessed how active behavior affects encoding of sound location (azimuth) in primary auditory cortical areas and planum temporale (PT). According to the hierarchical model of auditory processing and cortical functional specialization, PT is implicated in sound location ("where") processing. Yet, our results show that spatial tuning profiles in primary auditory cortical areas (left primary core and right caudo-medial belt) sharpened during a sound localization ("where") task compared with a sound identification ("what") task. In contrast, spatial tuning in PT was sharp but did not vary with task performance. We further applied a population pattern decoder to the measured fMRI activity patterns, which confirmed the task-dependent effects in the left core: sound location estimates from fMRI patterns measured during active sound localization were most accurate. In PT, decoding accuracy was not modulated by task performance. These results indicate that changes of population activity in human primary auditory areas reflect dynamic and task-dependent processing of sound location. As such, our findings suggest that the hierarchical model of auditory processing may need to be revised to include an interaction between primary and functionally specialized areas depending on behavioral requirements.SIGNIFICANCE STATEMENT According to a purely hierarchical view, cortical auditory processing consists of a series of analysis stages from sensory (acoustic) processing in primary auditory cortex to specialized processing in higher-order areas. Posterior-dorsal cortical auditory areas, planum temporale (PT) in humans, are considered to be functionally specialized for spatial processing. However, this model is based mostly on passive listening studies. Our results provide compelling evidence that active behavior (sound localization) sharpens spatial selectivity in primary auditory cortex, whereas spatial tuning in functionally specialized areas (PT) is narrow but task-invariant. These findings suggest that the hierarchical view of cortical functional specialization needs to be extended: our data indicate that active behavior involves feedback projections from higher-order regions to primary auditory cortex.
Collapse
|
17
|
The role of auditory cortex in the spatial ventriloquism aftereffect. Neuroimage 2017; 162:257-268. [PMID: 28889003 DOI: 10.1016/j.neuroimage.2017.09.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2017] [Revised: 08/15/2017] [Accepted: 09/01/2017] [Indexed: 11/21/2022] Open
Abstract
Cross-modal recalibration allows the brain to maintain coherent sensory representations of the world. Using functional magnetic resonance imaging (fMRI), the present study aimed at identifying the neural mechanisms underlying recalibration in an audiovisual ventriloquism aftereffect paradigm. Participants performed a unimodal sound localization task, before and after they were exposed to adaptation blocks, in which sounds were paired with spatially disparate visual stimuli offset by 14° to the right. Behavioral results showed a significant rightward shift in sound localization following adaptation, indicating a ventriloquism aftereffect. Regarding fMRI results, left and right planum temporale (lPT/rPT) were found to respond more to contralateral sounds than to central sounds at pretest. Contrasting posttest with pretest blocks revealed significantly enhanced fMRI-signals in space-sensitive lPT after adaptation, matching the behavioral rightward shift in sound localization. Moreover, a region-of-interest analysis in lPT/rPT revealed that the lPT activity correlated positively with the localization shift for right-side sounds, whereas rPT activity correlated negatively with the localization shift for left-side and central sounds. Finally, using functional connectivity analysis, we observed enhanced coupling of the lPT with left and right inferior parietal areas as well as left motor regions following adaptation and a decoupling of lPT/rPT with contralateral auditory cortex, which scaled with participants' degree of adaptation. Together, the fMRI results suggest that cross-modal spatial recalibration is accomplished by an adjustment of unisensory representations in low-level auditory cortex. Such persistent adjustments of low-level sensory representations seem to be mediated by the interplay with higher-level spatial representations in parietal cortex.
Collapse
|
18
|
Shrem T, Murray MM, Deouell LY. Auditory-visual integration modulates location-specific repetition suppression of auditory responses. Psychophysiology 2017; 54:1663-1675. [PMID: 28752567 DOI: 10.1111/psyp.12955] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2016] [Revised: 05/10/2017] [Accepted: 06/03/2017] [Indexed: 11/28/2022]
Abstract
Space is a dimension shared by different modalities, but at what stage spatial encoding is affected by multisensory processes is unclear. Early studies observed attenuation of N1/P2 auditory evoked responses following repetition of sounds from the same location. Here, we asked whether this effect is modulated by audiovisual interactions. In two experiments, using a repetition-suppression paradigm, we presented pairs of tones in free field, where the test stimulus was a tone presented at a fixed lateral location. Experiment 1 established a neural index of auditory spatial sensitivity, by comparing the degree of attenuation of the response to test stimuli when they were preceded by an adapter sound at the same location versus 30° or 60° away. We found that the degree of attenuation at the P2 latency was inversely related to the spatial distance between the test stimulus and the adapter stimulus. In Experiment 2, the adapter stimulus was a tone presented from the same location or a more medial location than the test stimulus. The adapter stimulus was accompanied by a simultaneous flash displayed orthogonally from one of the two locations. Sound-flash incongruence reduced accuracy in a same-different location discrimination task (i.e., the ventriloquism effect) and reduced the location-specific repetition-suppression at the P2 latency. Importantly, this multisensory effect included topographic modulations, indicative of changes in the relative contribution of underlying sources across conditions. Our findings suggest that the auditory response at the P2 latency is affected by spatially selective brain activity, which is affected crossmodally by visual information.
Collapse
Affiliation(s)
- Talia Shrem
- Human Cognitive Neuroscience Lab, Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Micah M Murray
- Laboratory for Investigative Neurophysiology (The LINE), Department of Radiology, and Neuropsychology and Neurorehabilitation Service, University Hospital Center and University of Lausanne, Lausanne, Switzerland.,EEG Brain Mapping Core, Center for Biomedical Imaging (CIBM), Lausanne, Switzerland.,Department of Ophthalmology, University of Lausanne, Jules Gonin Eye Hospital, Lausanne, Switzerland.,Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, Tennessee, USA
| | - Leon Y Deouell
- Human Cognitive Neuroscience Lab, Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel.,The Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
19
|
Callan A, Callan D, Ando H. The Importance of Spatiotemporal Information in Biological Motion Perception: White Noise Presented with a Step-like Motion Activates the Biological Motion Area. J Cogn Neurosci 2016; 29:277-285. [PMID: 27647281 DOI: 10.1162/jocn_a_01046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Humans can easily recognize the motion of living creatures using only a handful of point-lights that describe the motion of the main joints (biological motion perception). This special ability to perceive the motion of animate objects signifies the importance of the spatiotemporal information in perceiving biological motion. The posterior STS (pSTS) and posterior middle temporal gyrus (pMTG) region have been established by many functional neuroimaging studies as a locus for biological motion perception. Because listening to a walking human also activates the pSTS/pMTG region, the region has been proposed to be supramodal in nature. In this study, we investigated whether the spatiotemporal information from simple auditory stimuli is sufficient to activate this biological motion area. We compared spatially moving white noise, having a running-like tempo that was consistent with biological motion, with stationary white noise. The moving-minus-stationary contrast showed significant differences in activation of the pSTS/pMTG region. Our results suggest that the spatiotemporal information of the auditory stimuli is sufficient to activate the biological motion area.
Collapse
Affiliation(s)
- Akiko Callan
- CiNet, National Institute of Information and Communication Technology, and Osaka University
| | - Daniel Callan
- CiNet, National Institute of Information and Communication Technology, and Osaka University
| | - Hiroshi Ando
- CiNet, National Institute of Information and Communication Technology, and Osaka University
| |
Collapse
|
20
|
Zimmer U, Höfler M, Koschutnig K, Ischebeck A. Neuronal interactions in areas of spatial attention reflect avoidance of disgust, but orienting to danger. Neuroimage 2016; 134:94-104. [PMID: 27039145 DOI: 10.1016/j.neuroimage.2016.03.050] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2015] [Revised: 03/14/2016] [Accepted: 03/20/2016] [Indexed: 12/26/2022] Open
Abstract
For survival, it is necessary to attend quickly towards dangerous objects, but to turn away from something that is disgusting. We tested whether fear and disgust sounds direct spatial attention differently. Using fMRI, a sound cue (disgust, fear or neutral) was presented to the left or right ear. The cue was followed by a visual target (a small arrow) which was located on the same (valid) or opposite (invalid) side as the cue. Participants were required to decide whether the arrow pointed up- or downwards while ignoring the sound cue. Behaviorally, responses were faster for invalid compared to valid targets when cued by disgust, whereas the opposite pattern was observed for targets after fearful and neutral sound cues. During target presentation, activity in the visual cortex and IPL increased for targets invalidly cued with disgust, but for targets validly cued with fear which indicated a general modulation of activation due to attention. For the TPJ, an interaction in the opposite direction was observed, consistent with its role in detecting targets at unattended positions and in relocating attention. As a whole our results indicate that a disgusting sound directs spatial attention away from its location, in contrast to fearful and neutral sounds.
Collapse
Affiliation(s)
- Ulrike Zimmer
- Department of Psychology, University of Graz, Austria; Biotechmed Graz, Austria.
| | - Margit Höfler
- Department of Psychology, University of Graz, Austria
| | - Karl Koschutnig
- Department of Psychology, University of Graz, Austria; Biotechmed Graz, Austria
| | - Anja Ischebeck
- Department of Psychology, University of Graz, Austria; Biotechmed Graz, Austria
| |
Collapse
|
21
|
Häkkinen S, Ovaska N, Rinne T. Processing of pitch and location in human auditory cortex during visual and auditory tasks. Front Psychol 2015; 6:1678. [PMID: 26594185 PMCID: PMC4635202 DOI: 10.3389/fpsyg.2015.01678] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2015] [Accepted: 10/19/2015] [Indexed: 01/22/2023] Open
Abstract
The relationship between stimulus-dependent and task-dependent activations in human auditory cortex (AC) during pitch and location processing is not well understood. In the present functional magnetic resonance imaging study, we investigated the processing of task-irrelevant and task-relevant pitch and location during discrimination, n-back, and visual tasks. We tested three hypotheses: (1) According to prevailing auditory models, stimulus-dependent processing of pitch and location should be associated with enhanced activations in distinct areas of the anterior and posterior superior temporal gyrus (STG), respectively. (2) Based on our previous studies, task-dependent activation patterns during discrimination and n-back tasks should be similar when these tasks are performed on sounds varying in pitch or location. (3) Previous studies in humans and animals suggest that pitch and location tasks should enhance activations especially in those areas that also show activation enhancements associated with stimulus-dependent pitch and location processing, respectively. Consistent with our hypotheses, we found stimulus-dependent sensitivity to pitch and location in anterolateral STG and anterior planum temporale (PT), respectively, in line with the view that these features are processed in separate parallel pathways. Further, task-dependent activations during discrimination and n-back tasks were associated with enhanced activations in anterior/posterior STG and posterior STG/inferior parietal lobule (IPL) irrespective of stimulus features. However, direct comparisons between pitch and location tasks performed on identical sounds revealed no significant activation differences. These results suggest that activations during pitch and location tasks are not strongly affected by enhanced stimulus-dependent activations to pitch or location. We also found that activations in PT were strongly modulated by task requirements and that areas in the inferior parietal lobule (IPL) showed task-dependent activation modulations, but no systematic activations to pitch or location. Based on these results, we argue that activations during pitch and location tasks cannot be explained by enhanced stimulus-specific processing alone, but rather that activations in human AC depend in a complex manner on the requirements of the task at hand.
Collapse
Affiliation(s)
- Suvi Häkkinen
- Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Noora Ovaska
- Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Teemu Rinne
- Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland ; Advanced Magnetic Imaging Centre, Aalto University School of Science Espoo, Finland
| |
Collapse
|
22
|
Zhang X, Zhang Q, Hu X, Zhang B. Neural representation of three-dimensional acoustic space in the human temporal lobe. Front Hum Neurosci 2015; 9:203. [PMID: 25932011 PMCID: PMC4399328 DOI: 10.3389/fnhum.2015.00203] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2015] [Accepted: 03/27/2015] [Indexed: 11/13/2022] Open
Abstract
Sound localization is an important function of the human brain, but the underlying cortical mechanisms remain unclear. In this study, we recorded auditory stimuli in three-dimensional space and then replayed the stimuli through earphones during functional magnetic resonance imaging (fMRI). By employing a machine learning algorithm, we successfully decoded sound location from the blood oxygenation level-dependent signals in the temporal lobe. Analysis of the data revealed that different cortical patterns were evoked by sounds from different locations. Specifically, discrimination of sound location along the abscissa axis evoked robust responses in the left posterior superior temporal gyrus (STG) and right mid-STG, discrimination along the elevation (EL) axis evoked robust responses in the left posterior middle temporal lobe (MTL) and right STG, and discrimination along the ordinate axis evoked robust responses in the left mid-MTL and right mid-STG. These results support a distributed representation of acoustic space in human cortex.
Collapse
Affiliation(s)
- Xiaolu Zhang
- State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Computer Science and Technology, Tsinghua University Beijing, China
| | - Qingtian Zhang
- State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Computer Science and Technology, Tsinghua University Beijing, China
| | - Xiaolin Hu
- State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Computer Science and Technology, Tsinghua University Beijing, China ; Center for Brain-Inspired Computing Research (CBICR), Tsinghua University Beijing, China
| | - Bo Zhang
- State Key Laboratory of Intelligent Technology and Systems, Tsinghua National Laboratory for Information Science and Technology (TNList), Department of Computer Science and Technology, Tsinghua University Beijing, China ; Center for Brain-Inspired Computing Research (CBICR), Tsinghua University Beijing, China
| |
Collapse
|
23
|
Wallmeier L, Kish D, Wiegrebe L, Flanagin VL. Aural localization of silent objects by active human biosonar: neural representations of virtual echo-acoustic space. Eur J Neurosci 2015; 41:533-45. [PMID: 25728174 DOI: 10.1111/ejn.12843] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2014] [Revised: 12/17/2014] [Accepted: 12/22/2014] [Indexed: 02/04/2023]
Abstract
Some blind humans have developed the remarkable ability to detect and localize objects through the auditory analysis of self-generated tongue clicks. These echolocation experts show a corresponding increase in 'visual' cortex activity when listening to echo-acoustic sounds. Echolocation in real-life settings involves multiple reflections as well as active sound production, neither of which has been systematically addressed. We developed a virtualization technique that allows participants to actively perform such biosonar tasks in virtual echo-acoustic space during magnetic resonance imaging (MRI). Tongue clicks, emitted in the MRI scanner, are picked up by a microphone, convolved in real time with the binaural impulse responses of a virtual space, and presented via headphones as virtual echoes. In this manner, we investigated the brain activity during active echo-acoustic localization tasks. Our data show that, in blind echolocation experts, activations in the calcarine cortex are dramatically enhanced when a single reflector is introduced into otherwise anechoic virtual space. A pattern-classification analysis revealed that, in the blind, calcarine cortex activation patterns could discriminate left-side from right-side reflectors. This was found in both blind experts, but the effect was significant for only one of them. In sighted controls, 'visual' cortex activations were insignificant, but activation patterns in the planum temporale were sufficient to discriminate left-side from right-side reflectors. Our data suggest that blind and echolocation-trained, sighted subjects may recruit different neural substrates for the same active-echolocation task.
Collapse
Affiliation(s)
- Ludwig Wallmeier
- Graduate School of Systemic Neuroscience, Ludwig-Maximilians-Universität München, Großhaderner Str. 2, 82152, Planegg-Martinsried, Germany; German Center for Vertigo and Balance Disorders, Ludwig-Maximilians-Universität München, Munich, Germany; Division of Neurobiology, Department Biologie II, Ludwig-Maximilians-Universität München, Großhaderner Str. 2, 82152, Planegg-Martinsried, Germany
| | | | | | | |
Collapse
|
24
|
Salminen NH, Altoè A, Takanen M, Santala O, Pulkki V. Human cortical sensitivity to interaural time difference in high-frequency sounds. Hear Res 2015; 323:99-106. [PMID: 25668126 DOI: 10.1016/j.heares.2015.01.014] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/18/2014] [Revised: 01/22/2015] [Accepted: 01/27/2015] [Indexed: 11/18/2022]
Abstract
Human sound source localization relies on various acoustical cues one of the most important being the interaural time difference (ITD). ITD is best detected in the fine structure of low-frequency sounds but it may also contribute to spatial hearing at higher frequencies if extracted from the sound envelope. The human brain mechanisms related to this envelope ITD cue remain unexplored. Here, we tested the sensitivity of the human auditory cortex to envelope ITD in magnetoencephalography (MEG) recordings. We found two types of sensitivity to envelope ITD. First, the amplitude of the auditory cortical N1m response was smaller for zero envelope ITD than for long envelope ITDs corresponding to the sound being in opposite phase in the two ears. Second, the N1m response amplitude showed ITD-specific adaptation for both fine-structure and for envelope ITD. The auditory cortical sensitivity was weaker for envelope ITD in high-frequency sounds than for fine-structure ITD in low-frequency sounds but occurred within a range of ITDs that are encountered in natural conditions. Finally, the participants were briefly tested for their behavioral ability to detect envelope ITD. Interestingly, we found a correlation between the behavioral performance and the neural sensitivity to envelope ITD. In conclusion, our findings show that the human auditory cortex is sensitive to ITD in the envelope of high-frequency sounds and this sensitivity may have behavioral relevance.
Collapse
Affiliation(s)
- Nelli H Salminen
- Brain and Mind Laboratory, Department of Biomedical Engineering and Computational Science, Aalto University School of Science, P.O. Box 12200, FI-00076 Aalto, Finland; MEG Core, Aalto NeuroImaging, Aalto University School of Science, Finland.
| | - Alessandro Altoè
- Department of Signal Processing and Acoustics, Aalto University School of Electrical Engineering, P.O. Box 13000, FI-00076 Aalto, Finland
| | - Marko Takanen
- Department of Signal Processing and Acoustics, Aalto University School of Electrical Engineering, P.O. Box 13000, FI-00076 Aalto, Finland
| | - Olli Santala
- Department of Signal Processing and Acoustics, Aalto University School of Electrical Engineering, P.O. Box 13000, FI-00076 Aalto, Finland
| | - Ville Pulkki
- Department of Signal Processing and Acoustics, Aalto University School of Electrical Engineering, P.O. Box 13000, FI-00076 Aalto, Finland
| |
Collapse
|
25
|
Abstract
In spatial perception, visual information has higher acuity than auditory information and we often misperceive sound-source locations when spatially disparate visual stimuli are presented simultaneously. Ventriloquists make good use of this auditory illusion. In this study, we investigated neural substrates of the ventriloquism effect to understand the neural mechanism of multimodal integration. This study was performed in 2 steps. First, we investigated how sound locations were represented in the auditory cortex. Secondly, we investigated how simultaneous presentation of spatially disparate visual stimuli affects neural processing of sound locations. Based on the population rate code hypothesis that assumes monotonic sensitivity to sound azimuth across populations of broadly tuned neurons, we expected a monotonic increase of blood oxygenation level-dependent (BOLD) signals for more contralateral sounds. Consistent with this hypothesis, we found that BOLD signals in the posterior superior temporal gyrus increased monotonically as a function of sound azimuth. We also observed attenuation of the monotonic azimuthal sensitivity by spatially disparate visual stimuli. The alteration of the neural pattern was considered to reflect the neural mechanism of the ventriloquism effect. Our findings indicate that conflicting audiovisual spatial information of an event is associated with an attenuation of neural processing of auditory spatial localization.
Collapse
Affiliation(s)
- Akiko Callan
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka University, Suita, Osaka 565-0871, Japan
| | - Daniel Callan
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka University, Suita, Osaka 565-0871, Japan
| | - Hiroshi Ando
- Center for Information and Neural Networks (CiNet), National Institute of Information and Communications Technology, Osaka University, Suita, Osaka 565-0871, Japan
| |
Collapse
|
26
|
Abstract
The auditory cortex is a network of areas in the part of the brain that receives inputs from the subcortical auditory pathways in the brainstem and thalamus. Through an elaborate network of intrinsic and extrinsic connections, the auditory cortex is thought to bring about the conscious perception of sound and provide a basis for the comprehension and production of meaningful utterances. In this chapter, the organization of auditory cortex is described with an emphasis on its anatomic features and the flow of information within the network. These features are then used to introduce key neurophysiologic concepts that are being intensively studied in humans and animal models. The discussion is presented in the context of our working model of the primate auditory cortex and extensions to humans. The material is presented in the context of six underlying principles, which reflect distinct, but related, aspects of anatomic and physiologic organization: (1) the division of auditory cortex into regions; (2) the subdivision of regions into areas; (3) tonotopic organization of areas; (4) thalamocortical connections; (5) serial and parallel organization of connections; and (6) topographic relationships between auditory and auditory-related areas. Although the functional roles of the various components of this network remain poorly defined, a more complete understanding is emerging from ongoing studies that link auditory behavior to its anatomic and physiologic substrates.
Collapse
Affiliation(s)
- Troy A Hackett
- Department of Hearing and Speech Sciences, Vanderbilt University School of Medicine and Department of Psychology, Vanderbilt University, Nashville, TN, USA.
| |
Collapse
|
27
|
Jones H, Kan A, Litovsky RY. Comparing sound localization deficits in bilateral cochlear-implant users and vocoder simulations with normal-hearing listeners. Trends Hear 2014; 18:18/0/2331216514554574. [PMID: 25385244 PMCID: PMC4271768 DOI: 10.1177/2331216514554574] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Bilateral cochlear-implant (BiCI) users are less accurate at localizing free-field (FF) sound sources than normal-hearing (NH) listeners. This performance gap is not well understood but is likely due to a combination of compromises in acoustic signal representation by the two independent speech processors and neural degradation of auditory pathways associated with a patient's hearing loss. To exclusively investigate the effect of CI speech encoding on horizontal-plane sound localization, the present study measured sound localization performance in NH subjects listening to vocoder processed and nonvocoded virtual acoustic space (VAS) stimuli. Various aspects of BiCI stimulation such as independently functioning devices, variable across-ear channel selection, and pulsatile stimulation were simulated using uncorrelated noise (Nu), correlated noise (N0), or Gaussian-enveloped tone (GET) carriers during vocoder processing. Additionally, FF sound localization in BiCI users was measured in the same testing environment for comparison. Distinct response patterns across azimuthal locations were evident for both listener groups and were analyzed using a multilevel regression analysis. Simulated implant speech encoding, regardless of carrier, was detrimental to NH localization and the GET vocoder best simulated BiCI FF performance in NH listeners. Overall, the detrimental effect of vocoder processing on NH performance suggests that sound localization deficits may persist even for BiCI patients who have minimal neural degradation associated with their hearing loss and indicates that CI speech encoding plays a significant role in the sound localization deficits experienced by BiCI users.
Collapse
Affiliation(s)
- Heath Jones
- Waisman Center, University of Wisconsin-Madison, WI, USA
| | - Alan Kan
- Waisman Center, University of Wisconsin-Madison, WI, USA
| | | |
Collapse
|
28
|
Shrem T, Deouell LY. Frequency-dependent auditory space representation in the human planum temporale. Front Hum Neurosci 2014; 8:524. [PMID: 25100973 PMCID: PMC4106454 DOI: 10.3389/fnhum.2014.00524] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2014] [Accepted: 06/27/2014] [Indexed: 12/04/2022] Open
Abstract
Functional magnetic resonance imaging (fMRI) findings suggest that a part of the planum temporale (PT) is involved in representing spatial properties of acoustic information. Here, we tested whether this representation of space is frequency-dependent or generalizes across spectral content, as required from high order sensory representations. Using sounds with two different spectral content and two spatial locations in individually tailored virtual acoustic environment, we compared three conditions in a sparse-fMRI experiment: Single Location, in which two sounds were both presented from one location; Fixed Mapping, in which there was one-to-one mapping between two sounds and two locations; and Mixed Mapping, in which the two sounds were equally likely to appear at either one of the two locations. We surmised that only neurons tuned to both location and frequency should be differentially adapted by the Mixed and Fixed mappings. Replicating our previous findings, we found adaptation to spatial location in the PT. Importantly, activation was higher for Mixed Mapping than for Fixed Mapping blocks, even though the two sounds and the two locations appeared equally in both conditions. These results show that spatially tuned neurons in the human PT are not invariant to the spectral content of sounds.
Collapse
Affiliation(s)
- Talia Shrem
- Human Cognitive Neuroscience Lab, Department of Psychology, Social Sciences Faculty, The Hebrew University of Jerusalem Jerusalem, Israel
| | - Leon Y Deouell
- Human Cognitive Neuroscience Lab, Department of Psychology, Social Sciences Faculty, The Hebrew University of Jerusalem Jerusalem, Israel ; Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem Jerusalem, Israel
| |
Collapse
|
29
|
Kusmierek P, Rauschecker JP. Selectivity for space and time in early areas of the auditory dorsal stream in the rhesus monkey. J Neurophysiol 2014; 111:1671-85. [PMID: 24501260 DOI: 10.1152/jn.00436.2013] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The respective roles of ventral and dorsal cortical processing streams are still under discussion in both vision and audition. We characterized neural responses in the caudal auditory belt cortex, an early dorsal stream region of the macaque. We found fast neural responses with elevated temporal precision as well as neurons selective to sound location. These populations were partly segregated: Neurons in a caudomedial area more precisely followed temporal stimulus structure but were less selective to spatial location. Response latencies in this area were even shorter than in primary auditory cortex. Neurons in a caudolateral area showed higher selectivity for sound source azimuth and elevation, but responses were slower and matching to temporal sound structure was poorer. In contrast to the primary area and other regions studied previously, latencies in the caudal belt neurons were not negatively correlated with best frequency. Our results suggest that two functional substreams may exist within the auditory dorsal stream.
Collapse
Affiliation(s)
- Pawel Kusmierek
- Department of Neuroscience, Georgetown University Medical Center, Washington, District of Columbia
| | | |
Collapse
|
30
|
DeWitt I, Rauschecker JP. Wernicke's area revisited: parallel streams and word processing. BRAIN AND LANGUAGE 2013; 127:181-91. [PMID: 24404576 PMCID: PMC4098851 DOI: 10.1016/j.bandl.2013.09.014] [Citation(s) in RCA: 87] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Auditory word-form recognition was originally proposed by Wernicke to occur within left superior temporal gyrus (STG), later further specified to be in posterior STG. To account for clinical observations (specifically paraphasia), Wernicke proposed his sensory speech center was also essential for correcting output from frontal speech-motor regions. Recent work, in contrast, has established a role for anterior STG, part of the auditory ventral stream, in the recognition of species-specific vocalizations in nonhuman primates and word-form recognition in humans. Recent work also suggests monitoring self-produced speech and motor control are associated with posterior STG, part of the auditory dorsal stream. Working without quantitative methods or evidence of sensory cortex' hierarchical organization, Wernicke co-localized functions that today appear dissociable. "Wernicke's area" thus may be better construed as two cortical modules, an auditory word-form area (AWFA) in the auditory ventral stream and an "inner speech area" in the auditory dorsal stream.
Collapse
|
31
|
Ogawa A, Bordier C, Macaluso E. Audio-visual perception of 3D cinematography: an fMRI study using condition-based and computation-based analyses. PLoS One 2013; 8:e76003. [PMID: 24194828 PMCID: PMC3806767 DOI: 10.1371/journal.pone.0076003] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2013] [Accepted: 08/18/2013] [Indexed: 11/19/2022] Open
Abstract
The use of naturalistic stimuli to probe sensory functions in the human brain is gaining increasing interest. Previous imaging studies examined brain activity associated with the processing of cinematographic material using both standard "condition-based" designs, as well as "computational" methods based on the extraction of time-varying features of the stimuli (e.g. motion). Here, we exploited both approaches to investigate the neural correlates of complex visual and auditory spatial signals in cinematography. In the first experiment, the participants watched a piece of a commercial movie presented in four blocked conditions: 3D vision with surround sounds (3D-Surround), 3D with monaural sound (3D-Mono), 2D-Surround, and 2D-Mono. In the second experiment, they watched two different segments of the movie both presented continuously in 3D-Surround. The blocked presentation served for standard condition-based analyses, while all datasets were submitted to computation-based analyses. The latter assessed where activity co-varied with visual disparity signals and the complexity of auditory multi-sources signals. The blocked analyses associated 3D viewing with the activation of the dorsal and lateral occipital cortex and superior parietal lobule, while the surround sounds activated the superior and middle temporal gyri (S/MTG). The computation-based analyses revealed the effects of absolute disparity in dorsal occipital and posterior parietal cortices and of disparity gradients in the posterior middle temporal gyrus plus the inferior frontal gyrus. The complexity of the surround sounds was associated with activity in specific sub-regions of S/MTG, even after accounting for changes of sound intensity. These results demonstrate that the processing of naturalistic audio-visual signals entails an extensive set of visual and auditory areas, and that computation-based analyses can track the contribution of complex spatial aspects characterizing such life-like stimuli.
Collapse
Affiliation(s)
- Akitoshi Ogawa
- Neuroimaging Laboratory, Istituto di Ricovero e Cura a Carattere Scientifico, Santa Lucia Foundation, Rome, Italy
- * E-mail:
| | - Cecile Bordier
- Neuroimaging Laboratory, Istituto di Ricovero e Cura a Carattere Scientifico, Santa Lucia Foundation, Rome, Italy
| | - Emiliano Macaluso
- Neuroimaging Laboratory, Istituto di Ricovero e Cura a Carattere Scientifico, Santa Lucia Foundation, Rome, Italy
| |
Collapse
|
32
|
Monaghan JJM, Krumbholz K, Seeber BU. Factors affecting the use of envelope interaural time differences in reverberation. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2013; 133:2288-300. [PMID: 23556596 DOI: 10.1121/1.4793270] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
At high frequencies, interaural time differences (ITDs) are conveyed by the sound envelope. Sensitivity to envelope ITDs depends crucially on the envelope shape. Reverberation degrades the envelope shape, reducing the modulation depth of the envelope and the slope of its flanks. Reverberation also reduces the envelope interaural coherence (i.e., the similarity of the envelopes at two ears). The current study investigates the extent to which these changes affect sensitivity to envelope ITDs. The first experiment measured ITD discrimination thresholds at low and high frequencies in a simulated room. The stimulus was either a low-frequency narrowband noise or the same noise transposed to a higher frequency. The results suggest that the effect of reverberation on ITD thresholds was multiplicative. Given that the threshold without reverberation was larger for the transposed than for the low-frequency stimulus, this meant that, in absolute terms, the thresholds for the transposed stimulus showed a much greater increase due to reverberation than those for the low-frequency stimulus. Three further experiments indicated that the effect of reverberation on the envelope ITD thresholds was due to the combined effect of the reduction in the envelope modulation depth and slopes, as well as the decrease in the envelope interaural coherence.
Collapse
Affiliation(s)
- Jessica J M Monaghan
- MRC Institute of Hearing Research, University Park, Nottingham NG7 2RD, United Kingdom.
| | | | | |
Collapse
|
33
|
Neural correlates of sound externalization. Neuroimage 2013; 66:22-7. [DOI: 10.1016/j.neuroimage.2012.10.057] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2012] [Revised: 09/26/2012] [Accepted: 10/12/2012] [Indexed: 11/18/2022] Open
|
34
|
Rauschecker JP. Processing Streams in Auditory Cortex. NEURAL CORRELATES OF AUDITORY COGNITION 2013. [DOI: 10.1007/978-1-4614-2350-8_2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
|
35
|
The effects of aging and interaural delay on the detection of a break in the interaural correlation between two sounds. Ear Hear 2010; 30:273-86. [PMID: 19194287 DOI: 10.1097/aud.0b013e318198703d] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVES In noisy, reverberant environments, older adults often find it difficult to process acoustic signals, possibly because their ability to differentiate reflected waves that belong to a source from those generated by other sources diminishes with age. Therefore, older adults may be less efficient than younger adults at parsing the auditory scene into its component sound sources. To parse the auditory scene into its component sources the listener has to be able to group correlated waves coming from different directions (the direct wave and its reflections off of environmental surfaces). Because detecting a change in correlation is an important component of scene parsing, this study examined whether there is an age-related deficit in detecting break in correlation (BIC) between the noises presented over left and right headphones or over left and right loudspeakers, where a BIC refers to a change in interaural correlation from 1 to zero and then a return to 1. DESIGN In experiment 1, we determined the shortest BIC duration at which 10 younger and 10 older adults could detect the BIC in the middle of identical noises (bandwidth = 10 kHz; duration = 1 sec) presented simultaneously to the left and right ears over headphones or played simultaneously over loudspeakers positioned 45 degrees to the left and right of the listeners. In experiment 2, we determined the longest delay between the left-side noise and the right-side noise, at which a 100 ms BIC presented in the middle of the noise could be detected in 10 younger and 8 older adults. RESULTS The results of experiment 1 show that younger participants could detect significantly shorter BICs than older participants independent of whether the noises were presented over headphones or loudspeakers. The results of experiment 2 show that younger participants could detect the 100 ms BIC at significantly longer interaural delays than older participants. Also, for both age groups, detecting the BIC was easier under the loudspeaker-stimulation condition than the headphone-stimulation condition. Moreover, in the loudspeaker condition, the spectral cues arising from interactions between correlated sound sources seemed to be of greater benefit to younger than to older participants. CONCLUSIONS The age-related decrease in sensitivity to a BIC indicates that older adults are less able than younger adults to detect a change in correlation in an ongoing sound. The inability of older adults to detect the 100 ms BIC as readily as younger adults, when the noise arriving at one ear is delayed relative to the noise arriving at the other ear, suggests that the representation of aspects of the sound's waveform decays more rapidly in older adult than in younger adult listeners. Moreover, these age-related deficits are not related to listeners' audiograms. In addition, younger adults seem to be much better than older adults at using the spectral cue provided by comb filtering to detect the BIC when there is a delay between the noises presented over loudspeakers. The more rapid decay of waveform details, combined with the lesser sensitivity to change in correlation and to spectral cues, suggest that older adults may not be as capable as younger adults in parsing auditory scenes.
Collapse
|
36
|
Rauschecker JP. An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hear Res 2010; 271:16-25. [PMID: 20850511 DOI: 10.1016/j.heares.2010.09.001] [Citation(s) in RCA: 186] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/15/2010] [Revised: 08/08/2010] [Accepted: 09/05/2010] [Indexed: 11/30/2022]
Abstract
The dual-pathway model of auditory cortical processing assumes that two largely segregated processing streams originating in the lateral belt subserve the two main functions of hearing: identification of auditory "objects", including speech; and localization of sounds in space (Rauschecker and Tian, 2000). Evidence has accumulated, chiefly from work in humans and nonhuman primates, that an antero-ventral pathway supports the former function, whereas a postero-dorsal stream supports the latter, i.e processing of space and motion-in-space. In addition, the postero-dorsal stream has also been postulated to subserve some functions of speech and language in humans. A recent review (Rauschecker and Scott, 2009) has proposed the possibility that both functions of the postero-dorsal pathway can be subsumed under the same structural forward model: an efference copy sent from prefrontal and premotor cortex provides the basis for "optimal state estimation" in the inferior parietal lobe and in sensory areas of the posterior auditory cortex. The current article corroborates this model by adding and discussing recent evidence.
Collapse
Affiliation(s)
- Josef P Rauschecker
- Department of Physiology and Biophysics, Laboratory of Integrative Neuroscience and Cognition, Georgetown University Medical Center, New Research Building, Room WP19, Washington, DC 20057-1460, USA.
| |
Collapse
|
37
|
Johnson BW, Hautus MJ. Processing of binaural spatial information in human auditory cortex: Neuromagnetic responses to interaural timing and level differences. Neuropsychologia 2010; 48:2610-9. [DOI: 10.1016/j.neuropsychologia.2010.05.008] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2009] [Revised: 04/30/2010] [Accepted: 05/01/2010] [Indexed: 11/29/2022]
|
38
|
Murray MM, Spierer L. Auditory spatio-temporal brain dynamics and their consequences for multisensory interactions in humans. Hear Res 2009; 258:121-33. [DOI: 10.1016/j.heares.2009.04.022] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2009] [Revised: 04/28/2009] [Accepted: 04/28/2009] [Indexed: 11/24/2022]
|
39
|
Zimmer U, Macaluso E. Interaural temporal and coherence cues jointly contribute to successful sound movement perception and activation of parietal cortex. Neuroimage 2009; 46:1200-8. [PMID: 19303934 DOI: 10.1016/j.neuroimage.2009.03.022] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2008] [Revised: 01/27/2009] [Accepted: 03/08/2009] [Indexed: 11/24/2022] Open
Abstract
The perception of movement in the auditory modality requires dynamic changes in the input that reaches the two ears (e.g. sequential changes of interaural time differences; dynamic ITDs). However, it is still unclear as to what extent these temporal cues interact with other interaural cues to determine successful movement perception, and which brain regions are involved in sound movement processing. Here, we presented trains of white-noise bursts containing either static or dynamic ITDs, and we varied parametrically the level of binaural coherence (BC) of both types of stimuli. Behaviorally, we found that movement discrimination sensitivity decreased with decreasing levels of BC. fMRI analyses highlighted a network of temporal, frontal and parietal regions where activity decreased with decreasing BC. Critically, in the intra-parietal sulcus and the supra-marginal gyrus brain activity decreased with decreasing BC, but only for dynamic-ITD sounds (BC by ITD interaction). Thus, these regions activated selectively when the sounds contained both dynamic ITDs and high levels of BC; i.e. when subjects perceived sound movement. We conclude that sound movement perception requires both dynamic changes of the auditory input and effective sound-source localization, and that parietal cortex utilizes interaural temporal and coherence cues for the successful perception of sound movement.
Collapse
Affiliation(s)
- U Zimmer
- NeuroImaging Laboratory, Santa Lucia Foundation, Italy.
| | | |
Collapse
|
40
|
Abstract
Background Recent neuroimaging studies have revealed that putatively unimodal regions of visual cortex can be activated during auditory tasks in sighted as well as in blind subjects. However, the task determinants and functional significance of auditory occipital activations (AOAs) remains unclear. Methodology/Principal Findings We examined AOAs in an intermodal selective attention task to distinguish whether they were stimulus-bound or recruited by higher-level cognitive operations associated with auditory attention. Cortical surface mapping showed that auditory occipital activations were localized to retinotopic visual cortex subserving the far peripheral visual field. AOAs depended strictly on the sustained engagement of auditory attention and were enhanced in more difficult listening conditions. In contrast, unattended sounds produced no AOAs regardless of their intensity, spatial location, or frequency. Conclusions/Significance Auditory attention, but not passive exposure to sounds, routinely activated peripheral regions of visual cortex when subjects attended to sound sources outside the visual field. Functional connections between auditory cortex and visual cortex subserving the peripheral visual field appear to underlie the generation of AOAs, which may reflect the priming of visual regions to process soon-to-appear objects associated with unseen sound sources.
Collapse
|
41
|
A rate code for sound azimuth in monkey auditory cortex: implications for human neuroimaging studies. J Neurosci 2008; 28:3747-58. [PMID: 18385333 DOI: 10.1523/jneurosci.5044-07.2008] [Citation(s) in RCA: 79] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Is sound location represented in the auditory cortex of humans and monkeys? Human neuroimaging experiments have had only mixed success at demonstrating sound location sensitivity in primary auditory cortex. This is in apparent conflict with studies in monkeys and other animals, in which single-unit recording studies have found stronger evidence for spatial sensitivity. Does this apparent discrepancy reflect a difference between humans and animals, or does it reflect differences in the sensitivity of the methods used for assessing the representation of sound location? The sensitivity of imaging methods such as functional magnetic resonance imaging depends on the following two key aspects of the underlying neuronal population: (1) what kind of spatial sensitivity individual neurons exhibit and (2) whether neurons with similar response preferences are clustered within the brain. To address this question, we conducted a single-unit recording study in monkeys. We investigated the nature of spatial sensitivity in individual auditory cortical neurons to determine whether they have receptive fields (place code) or monotonic (rate code) sensitivity to sound azimuth. Second, we tested how strongly the population of neurons favors contralateral locations. We report here that the majority of neurons show predominantly monotonic azimuthal sensitivity, forming a rate code for sound azimuth, but that at the population level the degree of contralaterality is modest. This suggests that the weakness of the evidence for spatial sensitivity in human neuroimaging studies of auditory cortex may be attributable to limited lateralization at the population level, despite what may be considerable spatial sensitivity in individual neurons.
Collapse
|
42
|
Abstract
Language processing involves multiple neuronal structures in the human auditory cortex. Although a variety of neuroimaging and mapping techniques have been implemented to better understand language processing at the level of the auditory cortex, much is unknown regarding how and by what pathways these structures interact during essential tasks such as sentence comprehension. In this study, the effective and structural connectivity at the level of the auditory cortex were investigated. First, blood oxygenation level-dependent (BOLD) responses were measured with time-resolved functional magnetic resonance imaging (fMRI) during audition of short sentences. Once BOLD activation maps were obtained, the effective connectivity between primary auditory cortex and the surrounding auditory regions on the supratemporal plane and superior temporal gyrus (STG) were investigated using Granger causality mapping (GCM). Effective connectivity was observed between the primary auditory cortex and (1) the lateral planum polare and anterior STG, and (2) the lateral planum temporale and posterior STG. By using diffusion tensor probabilistic mapping (DTPM), rostral and caudal fiber pathways were detected between regions depicting effective connectivity. The effective and structural connectivity results of the present study provide further insight as to how auditory stimuli (i.e., human language) is processed at the level of the auditory cortex. Furthermore, combining BOLD fMRI-based GCM and DTPM analysis could provide a novel means to study effective and structural connectivity not only in the auditory cortex, but also in other cortical regions.
Collapse
|
43
|
Abstract
Interest has recently surged in the neural mechanisms of audition, particularly with regard to functional imaging studies in human subjects. This review emphasizes recent work on two aspects of auditory processing. The first explores auditory spatial processing and the role of the auditory cortex in both nonhuman primates and human subjects. The interactions with visual stimuli, the ventriloquism effect, and the ventriloquism aftereffect are also reviewed. The second aspect is temporal processing. Studies investigating temporal integration, forward masking, and gap detection are reviewed, as well as examples from the birdsong system and echolocating bats.
Collapse
|
44
|
Krumbholz K, Eickhoff SB, Fink GR. Feature- and object-based attentional modulation in the human auditory "where" pathway. J Cogn Neurosci 2008; 19:1721-33. [PMID: 18271742 DOI: 10.1162/jocn.2007.19.10.1721] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Attending to a visual stimulus feature, such as color or motion, enhances the processing of that feature in the visual cortex. Moreover, the processing of the attended object's other, unattended, features is also enhanced. Here, we used functional magnetic resonance imaging to show that attentional modulation in the auditory system may also exhibit such feature- and object-specific effects. Specifically, we found that attending to auditory motion increases activity in nonprimary motion-sensitive areas of the auditory cortical "where" pathway. Moreover, activity in these motion-sensitive areas was also increased when attention was directed to a moving rather than a stationary sound object, even when motion was not the attended feature. An analysis of effective connectivity revealed that the motion-specific attentional modulation was brought about by an increase in connectivity between the primary auditory cortex and nonprimary motion-sensitive areas, which, in turn, may have been mediated by the paracingulate cortex in the frontal lobe. The current results indicate that auditory attention can select both objects and features. The finding of feature-based attentional modulation implies that attending to one feature of a sound object does not necessarily entail an exhaustive processing of the object's unattended features.
Collapse
Affiliation(s)
- Katrin Krumbholz
- MRC Institute of Hearing Research, University Park Nottingham NG-7 2RD, UK.
| | | | | |
Collapse
|
45
|
Spierer L, Murray MM, Tardif E, Clarke S. The path to success in auditory spatial discrimination: electrical neuroimaging responses within the supratemporal plane predict performance outcome. Neuroimage 2008; 41:493-503. [PMID: 18420424 DOI: 10.1016/j.neuroimage.2008.02.038] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2007] [Revised: 01/29/2008] [Accepted: 02/19/2008] [Indexed: 10/22/2022] Open
Abstract
Auditory scene analysis requires the accurate encoding and comparison of the perceived spatial positions of sound sources. The electrophysiological correlates of auditory spatial discrimination and their relationship to performance accuracy were studied in humans by applying electrical neuroimaging analyses to auditory evoked potentials (AEPs) that were recorded during the completion of a near-threshold S1-S2 paradigm within the right hemispace. Data were sorted as a function of performance accuracy, and AEP responses 75-117 ms after the presentation of the first sound differed topographically between trials leading to correct and incorrect spatial discrimination. Distributed source estimations revealed that this followed from significantly stronger activity within the left (i.e. contralateral) supratemporal plane (STP) and the left inferior parietal lobule prior to correct versus incorrect discrimination performance. Successful spatial discrimination thus depends on the activity of distinct configurations of active brain networks within the contralateral temporo-parietal cortex over a time period when the first sound position is being encoded. Furthermore, significant positive correlations were observed between performance accuracy and the intracranial activity estimated within the left STP. The efficacy of S1 processing within the STP is thus predictive of behavioral performance outcome during auditory spatial discrimination. Our data support a model wherein refinement of spatial representations occurs within the STP and that interactions with parietal structures allow for transformations into coordinate frames that are required for higher-order computations including absolute localization of sound sources.
Collapse
Affiliation(s)
- Lucas Spierer
- Neuropsychology and Neurorehabilitation Service, Centre Hospitalier Universitaire Vaudois and University of Lausanne, Lausanne, Switzerland.
| | | | | | | |
Collapse
|
46
|
Deouell LY, Heller AS, Malach R, D'Esposito M, Knight RT. Cerebral responses to change in spatial location of unattended sounds. Neuron 2007; 55:985-96. [PMID: 17880900 DOI: 10.1016/j.neuron.2007.08.019] [Citation(s) in RCA: 89] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2006] [Revised: 07/01/2007] [Accepted: 08/20/2007] [Indexed: 11/20/2022]
Abstract
The neural basis of spatial processing in the auditory cortex has been controversial. Human fMRI studies suggest that a part of the planum temporale (PT) is involved in auditory spatial processing, but it was recently argued that this region is active only when the task requires voluntary spatial localization. If this is the case, then this region cannot harbor an ongoing spatial representation of the acoustic environment. In contrast, we show in three fMRI experiments that a region in the human medial PT is sensitive to background auditory spatial changes, even when subjects are not engaged in a spatial localization task, and in fact attend the visual modality. During such times, this area responded to rare location shifts, and even more so when spatial variation increased, consistent with spatially selective adaptation. Thus, acoustic space is represented in the human PT even when sound processing is not required by the ongoing task.
Collapse
Affiliation(s)
- Leon Y Deouell
- Department of Psychology and the Interdisciplinary Center for Neural Computation, The Hebrew University of Jerusalem, Jerusalem 91905, Israel.
| | | | | | | | | |
Collapse
|
47
|
Soeta Y, Nakagawa S. Auditory evoked magnetic fields in relation to interaural time delay and interaural correlation. Hear Res 2006; 220:106-15. [PMID: 16934951 DOI: 10.1016/j.heares.2006.07.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/28/2005] [Revised: 07/06/2006] [Accepted: 07/13/2006] [Indexed: 11/26/2022]
Abstract
The detection of interaural time differences (ITD) for sound localization depends on the similarity between the left and right ear signals, namely interaural correlation (IAC). Human localization performance deteriorates with decreasing IACs. In order to examine activity related to localization performance in the human cortex, auditory evoked magnetic fields to the ITD of bandpass noises with different IACs were analyzed. When the IAC was 0.95, the N1m amplitudes, i.e., the estimated equivalent current dipole moments, increased with increasing ITD. However the effect of ITD on the N1m amplitudes was not significant when the IAC was 0.5. When the ITD was 0.7 ms, the N1m amplitudes decreased with decreasing IACs. There were no systematic changes in the source location of N1m in the auditory cortex related to changes in ITD or IAC. The results suggest that localization performance is reflected in N1m amplitudes.
Collapse
Affiliation(s)
- Yoshiharu Soeta
- Institute for Human Science and Biomedical Engineering, National Institute of Advanced Industrial Science and Technology (AIST), 1-8-31Midorigaoka, Ikeda, Osaka 563-8577, Japan.
| | | |
Collapse
|
48
|
Ahveninen J, Jääskeläinen IP, Raij T, Bonmassar G, Devore S, Hämäläinen M, Levänen S, Lin FH, Sams M, Shinn-Cunningham BG, Witzel T, Belliveau JW. Task-modulated "what" and "where" pathways in human auditory cortex. Proc Natl Acad Sci U S A 2006; 103:14608-13. [PMID: 16983092 PMCID: PMC1600007 DOI: 10.1073/pnas.0510480103] [Citation(s) in RCA: 245] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2005] [Indexed: 11/18/2022] Open
Abstract
Human neuroimaging studies suggest that localization and identification of relevant auditory objects are accomplished via parallel parietal-to-lateral-prefrontal "where" and anterior-temporal-to-inferior-frontal "what" pathways, respectively. Using combined hemodynamic (functional MRI) and electromagnetic (magnetoencephalography) measurements, we investigated whether such dual pathways exist already in the human nonprimary auditory cortex, as suggested by animal models, and whether selective attention facilitates sound localization and identification by modulating these pathways in a feature-specific fashion. We found a double dissociation in response adaptation to sound pairs with phonetic vs. spatial sound changes, demonstrating that the human nonprimary auditory cortex indeed processes speech-sound identity and location in parallel anterior "what" (in anterolateral Heschl's gyrus, anterior superior temporal gyrus, and posterior planum polare) and posterior "where" (in planum temporale and posterior superior temporal gyrus) pathways as early as approximately 70-150 ms from stimulus onset. Our data further show that the "where" pathway is activated approximately 30 ms earlier than the "what" pathway, possibly enabling the brain to use top-down spatial information in auditory object perception. Notably, selectively attending to phonetic content modulated response adaptation in the "what" pathway, whereas attending to sound location produced analogous effects in the "where" pathway. This finding suggests that selective-attention effects are feature-specific in the human nonprimary auditory cortex and that they arise from enhanced tuning of receptive fields of task-relevant neuronal populations.
Collapse
Affiliation(s)
- Jyrki Ahveninen
- Harvard Medical School-Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, CNY 149 13th Street, Charlestown, MA 02129, USA.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
49
|
Woods TM, Lopez SE, Long JH, Rahman JE, Recanzone GH. Effects of stimulus azimuth and intensity on the single-neuron activity in the auditory cortex of the alert macaque monkey. J Neurophysiol 2006; 96:3323-37. [PMID: 16943318 DOI: 10.1152/jn.00392.2006] [Citation(s) in RCA: 132] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
It has been hypothesized that the primate auditory cortex is composed of at least two processing streams, one of which is believed to selectively process spatial information. To test whether spatial information is differentially encoded in different auditory cortical fields, we recorded the responses of single neurons in the auditory cortex of alert macaque monkeys to broadband noise stimuli presented from 360 degrees in azimuth at four different absolute intensities. Cortical areas tested were core areas A1 and rostral (R), caudal belt fields caudomedial and caudolateral, and more rostral belt fields middle lateral and middle medial (MM). We found that almost all neurons encountered showed some spatial tuning. However, spatial selectivity measures showed that the caudal belt fields had the sharpest spatial tuning, A1 had intermediate spatial tuning, and areas R and MM had the least spatial tuning. Although most neurons showed their best responses to contralateral space, best azimuths were observed across the entire 360 degrees of tested space. We also noted that although the responses of many neurons were significantly influenced by eye position, eye position did not systematically influence any of the spatially dependent responses that we measured. These data are consistent with the hypothesis that caudal auditory cortical fields in the primate process spatial features more accurately than the core and more rostral belt fields.
Collapse
Affiliation(s)
- Timothy M Woods
- Center for Neuroscience, University of California-Davis, 1544 Newton Court, Davis, CA 95616, USA
| | | | | | | | | |
Collapse
|
50
|
|