1
|
Fujitani S, Kunii N, Nagata K, Takasago M, Shimada S, Tada M, Kirihara K, Komatsu M, Uka T, Kasai K, Saito N. Auditory prediction and prediction error responses evoked through a novel cascade roving paradigm: a human ECoG study. Cereb Cortex 2024; 34:bhad508. [PMID: 38183184 DOI: 10.1093/cercor/bhad508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 11/27/2023] [Accepted: 11/27/2023] [Indexed: 01/07/2024] Open
Abstract
Auditory sensory processing is assumed to occur in a hierarchical structure including the primary auditory cortex (A1), superior temporal gyrus, and frontal areas. These areas are postulated to generate predictions for incoming stimuli, creating an internal model of the surrounding environment. Previous studies on mismatch negativity have indicated the involvement of the superior temporal gyrus in this processing, whereas reports have been mixed regarding the contribution of the frontal cortex. We designed a novel auditory paradigm, the "cascade roving" paradigm, which incorporated complex structures (cascade sequences) into a roving paradigm. We analyzed electrocorticography data from six patients with refractory epilepsy who passively listened to this novel auditory paradigm and detected responses to deviants mainly in the superior temporal gyrus and inferior frontal gyrus. Notably, the inferior frontal gyrus exhibited broader distribution and sustained duration of deviant-elicited responses, seemingly differing in spatio-temporal characteristics from the prediction error responses observed in the superior temporal gyrus, compared with conventional oddball paradigms performed on the same participants. Moreover, we observed that the deviant responses were enhanced through stimulus repetition in the high-gamma range mainly in the superior temporal gyrus. These features of the novel paradigm may aid in our understanding of auditory predictive coding.
Collapse
Affiliation(s)
- Shigeta Fujitani
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
| | - Naoto Kunii
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
- Department of Neurosurgery, Jichi Medical University, Shimotsuke 329-0498, Japan
| | - Keisuke Nagata
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
| | - Megumi Takasago
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
| | - Seijiro Shimada
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
| | - Mariko Tada
- Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
- Office for Mental Health Support, Center for Research on Counseling and Support Services, The University of Tokyo, Tokyo 113-0033, Japan
| | - Kenji Kirihara
- Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
- Disability Services Office, The University of Tokyo, Tokyo 113-0033, Japan
| | - Misako Komatsu
- Institution of Innovative Research, Tokyo Institute of Technology, Tokyo 226-8503, Japan
- Laboratory for Molecular Analysis of Higher Brain Function, Center for Brain Science, RIKEN, Saitama 351-0198, Japan
| | - Takanori Uka
- Department of Integrative Physiology, Graduate School of Medicine, University of Yamanashi, Yamanashi 409-3898, Japan
| | - Kiyoto Kasai
- Department of Neuropsychiatry, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
- International Research Center for Neurointelligence at University of Tokyo Institutes for Advanced Study, Tokyo 113-0033, Japan
| | - Nobuhito Saito
- Department of Neurosurgery, Graduate School of Medicine, The University of Tokyo, Tokyo 113-0033, Japan
| |
Collapse
|
2
|
Molnár H, Marosi C, Becske M, Békési E, Farkas K, Stefanics G, Czigler I, Csukly G. A comparison of visual and acoustic mismatch negativity as potential biomarkers in schizophrenia. Sci Rep 2024; 14:992. [PMID: 38200103 PMCID: PMC10782025 DOI: 10.1038/s41598-023-49983-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Accepted: 12/14/2023] [Indexed: 01/12/2024] Open
Abstract
Mismatch negativity (MMN) is an event-related potential (ERP) component generated when an unexpected deviant stimulus occurs in a pattern of standard stimuli. Several studies showed that the MMN response to both auditory and visual stimuli is attenuated in schizophrenia. While previous studies investigated auditory and visual MMN in different cohorts, here we examined the potential clinical utility of MMN responses to auditory and visual stimuli within the same group of patients. Altogether 39 patients with schizophrenia and 39 healthy controls matched in age, gender, and education were enrolled. We recorded EEG using 64 channels in eight experimental blocks where we presented auditory and visual stimulus sequences. Mismatch responses were obtained by subtracting responses to standard from the physically identical deviant stimuli. We found a significant MMN response to the acoustic stimuli in the control group, whereas no significant mismatch response was observed in the patient group. The group difference was significant for the acoustic stimuli. The 12 vane windmill pattern evoked a significant MMN response in the early time window in the control group but not in the patient group. The 6 vane windmill pattern evoked MMN only in the patient group. However, we found no significant difference between the groups. Furthermore, we found no correlation between the clinical variables and the MMN amplitudes. Our results suggest that predictive processes underlying mismatch generation in patients with schizophrenia may be more affected in the acoustic compared to the visual domain. Acoustic MMN tends to be a more promising biomarker in schizophrenia.
Collapse
Affiliation(s)
- Hajnalka Molnár
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Csilla Marosi
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Melinda Becske
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Emese Békési
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Kinga Farkas
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - Gábor Stefanics
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary
| | - István Czigler
- Institute of Cognitive Neuroscience and Psychology, RCNS, HU-RES, Budapest, Hungary
| | - Gábor Csukly
- Department of Psychiatry and Psychotherapy, Semmelweis University, Budapest, Hungary.
| |
Collapse
|
3
|
Csaky R, van Es MWJ, Jones OP, Woolrich M. Interpretable many-class decoding for MEG. Neuroimage 2023; 282:120396. [PMID: 37805019 PMCID: PMC10938061 DOI: 10.1016/j.neuroimage.2023.120396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 09/11/2023] [Accepted: 09/27/2023] [Indexed: 10/09/2023] Open
Abstract
Multivariate pattern analysis (MVPA) of Magnetoencephalography (MEG) and Electroencephalography (EEG) data is a valuable tool for understanding how the brain represents and discriminates between different stimuli. Identifying the spatial and temporal signatures of stimuli is typically a crucial output of these analyses. Such analyses are mainly performed using linear, pairwise, sliding window decoding models. These allow for relative ease of interpretation, e.g. by estimating a time-course of decoding accuracy, but have limited decoding performance. On the other hand, full epoch multiclass decoding models, commonly used for brain-computer interface (BCI) applications, can provide better decoding performance. However interpretation methods for such models have been designed with a low number of classes in mind. In this paper, we propose an approach that combines a multiclass, full epoch decoding model with supervised dimensionality reduction, while still being able to reveal the contributions of spatiotemporal and spectral features using permutation feature importance. Crucially, we introduce a way of doing supervised dimensionality reduction of input features within a neural network optimised for the classification task, improving performance substantially. We demonstrate the approach on 3 different many-class task-MEG datasets using image presentations. Our results demonstrate that this approach consistently achieves higher accuracy than the peak accuracy of a sliding window decoder while estimating the relevant spatiotemporal features in the MEG signal.
Collapse
Affiliation(s)
- Richard Csaky
- Oxford Centre for Human Brain Activity, Department of Psychiatry, University of Oxford, OX3 7JX, Oxford, UK; Wellcome Centre for Integrative Neuroimaging, OX3 9DU, Oxford, UK; Christ Church, OX1 1DP, Oxford, UK.
| | - Mats W J van Es
- Oxford Centre for Human Brain Activity, Department of Psychiatry, University of Oxford, OX3 7JX, Oxford, UK; Wellcome Centre for Integrative Neuroimaging, OX3 9DU, Oxford, UK.
| | - Oiwi Parker Jones
- Wellcome Centre for Integrative Neuroimaging, OX3 9DU, Oxford, UK; Department of Engineering Science, University of Oxford, OX1 3PJ, Oxford, UK; Jesus College, OX1 3DW, Oxford, UK.
| | - Mark Woolrich
- Oxford Centre for Human Brain Activity, Department of Psychiatry, University of Oxford, OX3 7JX, Oxford, UK; Wellcome Centre for Integrative Neuroimaging, OX3 9DU, Oxford, UK.
| |
Collapse
|
4
|
Wagner L, Ladek AS, Plontke SK, Rahne T. Electrically evoked mismatch negativity responses to loudness and pitch cues in cochlear implant users. Sci Rep 2023; 13:2413. [PMID: 36765122 PMCID: PMC9918473 DOI: 10.1038/s41598-023-29422-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Accepted: 02/03/2023] [Indexed: 02/12/2023] Open
Abstract
Objective measurements could improve cochlear implant (CI) fitting, especially for CI users who have difficulty assessing their hearing impressions. In this study, we investigated the electrically evoked mismatch negativity (eMMN) brain potential as a mainly preattentive response to pitch and loudness changes. In an electrophysiological exploratory study with 21 CI users, pitch and loudness cues were presented in controlled oddball paradigms that directly electrically stimulated the CI via software. Out of them 17 valid data sets were analyzed. A pitch cue was produced by changing the stimulating CI electrodes (pairs of adjacent electrodes). A loudness cue originated from changing the stimulation amplitude on one CI electrode. MMN responses were measured unsing clinical electroencephalography recording according to a standard recording protocol. At the group level, significant eMMN responses were elicited for loudness cues and for pitch cues at basal electrode pairs but not at apical electrode pairs. The effect of deviance direction was not significant and no stimulus artifacts were observed. Recording an electrically evoked MMN in response to loudness changes in CI users is generally feasible, and is, therefore, promising to support CI fitting procedures in the future. Detection of pitch cues would require a greater electrode distance between selected electrodes for standard and deviant stimuli, especially in apical regions. A routine clinical setup can be used to measure eMMN.
Collapse
Affiliation(s)
- Luise Wagner
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medicine Halle (Saale), University Hospital Halle (Saale), Ernst-Grube-Straße 40, 06120, Halle (Saale), Germany.
| | - Anna S Ladek
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medicine Halle (Saale), University Hospital Halle (Saale), Ernst-Grube-Straße 40, 06120, Halle (Saale), Germany
| | - Stefan K Plontke
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medicine Halle (Saale), University Hospital Halle (Saale), Ernst-Grube-Straße 40, 06120, Halle (Saale), Germany
| | - Torsten Rahne
- Department of Otorhinolaryngology, Head and Neck Surgery, University Medicine Halle (Saale), University Hospital Halle (Saale), Ernst-Grube-Straße 40, 06120, Halle (Saale), Germany
| |
Collapse
|
5
|
Lecaignard F, Bertrand R, Brunner P, Caclin A, Schalk G, Mattout J. Dynamics of Oddball Sound Processing: Trial-by-Trial Modeling of ECoG Signals. Front Hum Neurosci 2022; 15:794654. [PMID: 35221952 PMCID: PMC8866734 DOI: 10.3389/fnhum.2021.794654] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 12/07/2021] [Indexed: 11/21/2022] Open
Abstract
Recent computational models of perception conceptualize auditory oddball responses as signatures of a (Bayesian) learning process, in line with the influential view of the mismatch negativity (MMN) as a prediction error signal. Novel MMN experimental paradigms have put an emphasis on neurophysiological effects of manipulating regularity and predictability in sound sequences. This raises the question of the contextual adaptation of the learning process itself, which on the computational side speaks to the mechanisms of gain-modulated (or precision-weighted) prediction error. In this study using electrocorticographic (ECoG) signals, we manipulated the predictability of oddball sound sequences with two objectives: (i) Uncovering the computational process underlying trial-by-trial variations of the cortical responses. The fluctuations between trials, generally ignored by approaches based on averaged evoked responses, should reflect the learning involved. We used a general linear model (GLM) and Bayesian Model Reduction (BMR) to assess the respective contributions of experimental manipulations and learning mechanisms under probabilistic assumptions. (ii) To validate and expand on previous findings regarding the effect of changes in predictability using simultaneous EEG-MEG recordings. Our trial-by-trial analysis revealed only a few stimulus-responsive sensors but the measured effects appear to be consistent over subjects in both time and space. In time, they occur at the typical latency of the MMN (between 100 and 250 ms post-stimulus). In space, we found a dissociation between time-independent effects in more anterior temporal locations and time-dependent (learning) effects in more posterior locations. However, we could not observe any clear and reliable effect of our manipulation of predictability modulation onto the above learning process. Overall, these findings clearly demonstrate the potential of trial-to-trial modeling to unravel perceptual learning processes and their neurophysiological counterparts.
Collapse
Affiliation(s)
- Françoise Lecaignard
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR 5292, Lyon, France
- University Lyon 1, Lyon, France
| | - Raphaëlle Bertrand
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR 5292, Lyon, France
- University Lyon 1, Lyon, France
| | - Peter Brunner
- Department of Neurosurgery, Washington University School of Medicine, St. Louis, MO, United States
- Department of Neurology, Albany Medical College, Albany, NY, United States
- National Center for Adaptive Neurotechnologies, Albany, NY, United States
| | - Anne Caclin
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR 5292, Lyon, France
- University Lyon 1, Lyon, France
| | - Gerwin Schalk
- National Center for Adaptive Neurotechnologies, Albany, NY, United States
| | - Jérémie Mattout
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR 5292, Lyon, France
- University Lyon 1, Lyon, France
| |
Collapse
|
6
|
Benhamou E, Zhao S, Sivasathiaseelan H, Johnson JCS, Requena-Komuro MC, Bond RL, van Leeuwen JEP, Russell LL, Greaves CV, Nelson A, Nicholas JM, Hardy CJD, Rohrer JD, Warren JD. Decoding expectation and surprise in dementia: the paradigm of music. Brain Commun 2021; 3:fcab173. [PMID: 34423301 PMCID: PMC8376684 DOI: 10.1093/braincomms/fcab173] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/31/2021] [Indexed: 01/08/2023] Open
Abstract
Making predictions about the world and responding appropriately to unexpected events are essential functions of the healthy brain. In neurodegenerative disorders, such as frontotemporal dementia and Alzheimer's disease, impaired processing of 'surprise' may underpin a diverse array of symptoms, particularly abnormalities of social and emotional behaviour, but is challenging to characterize. Here, we addressed this issue using a novel paradigm: music. We studied 62 patients (24 female; aged 53-88) representing major syndromes of frontotemporal dementia (behavioural variant, semantic variant primary progressive aphasia, non-fluent-agrammatic variant primary progressive aphasia) and typical amnestic Alzheimer's disease, in relation to 33 healthy controls (18 female; aged 54-78). Participants heard famous melodies containing no deviants or one of three types of deviant note-acoustic (white-noise burst), syntactic (key-violating pitch change) or semantic (key-preserving pitch change). Using a regression model that took elementary perceptual, executive and musical competence into account, we assessed accuracy detecting melodic deviants and simultaneously recorded pupillary responses and related these to deviant surprise value (information-content) and carrier melody predictability (entropy), calculated using an unsupervised machine learning model of music. Neuroanatomical associations of deviant detection accuracy and coupling of detection to deviant surprise value were assessed using voxel-based morphometry of patients' brain MRI. Whereas Alzheimer's disease was associated with normal deviant detection accuracy, behavioural and semantic variant frontotemporal dementia syndromes were associated with strikingly similar profiles of impaired syntactic and semantic deviant detection accuracy and impaired behavioural and autonomic sensitivity to deviant information-content (all P < 0.05). On the other hand, non-fluent-agrammatic primary progressive aphasia was associated with generalized impairment of deviant discriminability (P < 0.05) due to excessive false-alarms, despite retained behavioural and autonomic sensitivity to deviant information-content and melody predictability. Across the patient cohort, grey matter correlates of acoustic deviant detection accuracy were identified in precuneus, mid and mesial temporal regions; correlates of syntactic deviant detection accuracy and information-content processing, in inferior frontal and anterior temporal cortices, putamen and nucleus accumbens; and a common correlate of musical salience coding in supplementary motor area (all P < 0.05, corrected for multiple comparisons in pre-specified regions of interest). Our findings suggest that major dementias have distinct profiles of sensory 'surprise' processing, as instantiated in music. Music may be a useful and informative paradigm for probing the predictive decoding of complex sensory environments in neurodegenerative proteinopathies, with implications for understanding and measuring the core pathophysiology of these diseases.
Collapse
Affiliation(s)
- Elia Benhamou
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Sijia Zhao
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK
| | - Harri Sivasathiaseelan
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Jeremy C S Johnson
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Maï-Carmen Requena-Komuro
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Rebecca L Bond
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Janneke E P van Leeuwen
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Lucy L Russell
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Caroline V Greaves
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Annabel Nelson
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Jennifer M Nicholas
- Department of Medical Statistics, Faculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK
| | - Chris J D Hardy
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Jonathan D Rohrer
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| | - Jason D Warren
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London WC1N 3AR, UK
| |
Collapse
|
7
|
胡 萍, 朱 斌, 孟 子, 袁 玲, 曹 诗, 关 兵. [A preliminary study on the negative wave mismatch in patients with unilateral total sudden deafness]. LIN CHUANG ER BI YAN HOU TOU JING WAI KE ZA ZHI = JOURNAL OF CLINICAL OTORHINOLARYNGOLOGY, HEAD, AND NECK SURGERY 2021; 35:391-394. [PMID: 34304460 PMCID: PMC10128486 DOI: 10.13201/j.issn.2096-7993.2021.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Indexed: 11/12/2022]
Abstract
Objective:To observe the characteristics of different negativity negativity (MMN) in patients with unilateral sudden deafness, and compare them with normal MMN, in order to provide theoretical reference for discussing the pathogenesis of unilateral sudden deafness and their relationship with the auditory centers, and to provide theoretical basis for the treatment of sudden deafness in the future. Methods:Twenty-six cases of unilateral total sudden deafness were recruited as experimental group, 25 cases of normal healthy people as control group, the MMN inspections was performed respectively, the two groups using classical mode of oddball, standard and deviation stimulate with 1000 Hz and 2000 Hz short pure tone test MMN respectively, to observe the MMN latency and amplitude characteristics, and compare the latent period and amplitude difference between the two groups. Results:Among the 51 subjects, only 1 patient with unilateral total sudden deafness did not elicit MMN waveform, while the rest were all induced. The average incubation period of MMN in the experimental group was (162.03±38.64) ms, the average amplitude was (2.83±1.14)μV, and the mean age was (48.64±10.27) y. While the average incubation period of MMN in the control group was (197.52±27.43) ms, the average amplitude was (2.58±1.07)μV, and the mean age was (45.00±8.20) y. The MMN latency was significantly different between the two groups (P<0.01). There was no statistical difference in amplitude between the two groups (P>0.05). There was no statistical difference in age between the two groups (P>0.05). Conclusion:The latency period of MMN of unilateral total sudden deafness is shorter than that of the control group. It suggests that the auditory center function of patients with acute sudden deafness has changed, and we speculate that the auditory center of patients with acute sudden deafness may have corresponding emergency changes, so as to make its function have adaptive changes, which will provide further reference for the discussion of the pathophysiological mechanism and treatment of sudden deafness in the future.We speculated that acute unilateral auditory deprivation caused by unilateral total deafness sudden deafness has an impact on cerebral cortical auditory function, which provides further reference for the discussion of pathophysiological mechanism and treatment plan of sudden deafness in the future.
Collapse
Affiliation(s)
- 萍萍 胡
- 大连医科大学(辽宁大连,116000)Dalian Medical University, Dalian, 116000, China
| | - 斌 朱
- 扬州大学临床医学院附属苏北人民医院耳鼻咽喉头颈外科Department of Otolaryngology Head and Neck Surgery, North Jiangsu People's Hospital Affiliated to Clinical Medical College of Yangzhou University
| | - 子珅 孟
- 大连医科大学(辽宁大连,116000)Dalian Medical University, Dalian, 116000, China
| | - 玲 袁
- 扬州大学临床医学院附属苏北人民医院耳鼻咽喉头颈外科Department of Otolaryngology Head and Neck Surgery, North Jiangsu People's Hospital Affiliated to Clinical Medical College of Yangzhou University
| | - 诗瑶 曹
- 扬州大学临床医学院附属苏北人民医院耳鼻咽喉头颈外科Department of Otolaryngology Head and Neck Surgery, North Jiangsu People's Hospital Affiliated to Clinical Medical College of Yangzhou University
| | - 兵 关
- 扬州大学临床医学院附属苏北人民医院耳鼻咽喉头颈外科Department of Otolaryngology Head and Neck Surgery, North Jiangsu People's Hospital Affiliated to Clinical Medical College of Yangzhou University
| |
Collapse
|
8
|
Lecaignard F, Bertrand O, Caclin A, Mattout J. Empirical Bayes evaluation of fused EEG-MEG source reconstruction: Application to auditory mismatch evoked responses. Neuroimage 2020; 226:117468. [PMID: 33075561 DOI: 10.1016/j.neuroimage.2020.117468] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Revised: 09/08/2020] [Accepted: 10/09/2020] [Indexed: 12/12/2022] Open
Abstract
We here turn the general and theoretical question of the complementarity of EEG and MEG for source reconstruction, into a practical empirical one. Precisely, we address the challenge of evaluating multimodal data fusion on real data. For this purpose, we build on the flexibility of Parametric Empirical Bayes, namely for EEG-MEG data fusion, group level inference and formal hypothesis testing. The proposed approach follows a two-step procedure by first using unimodal or multimodal inference to derive a cortical solution at the group level; and second by using this solution as a prior model for single subject level inference based on either unimodal or multimodal data. Interestingly, for inference based on the same data (EEG, MEG or both), one can then formally compare, as alternative hypotheses, the relative plausibility of the two unimodal and the multimodal group priors. Using auditory data, we show that this approach enables to draw important conclusions, namely on (i) the superiority of multimodal inference, (ii) the greater spatial sensitivity of MEG compared to EEG, (iii) the ability of EEG data alone to source reconstruct temporal lobe activity, (iv) the usefulness of EEG to improve MEG based source reconstruction. Importantly, we largely reproduce those findings over two different experimental conditions. We here focused on Mismatch Negativity (MMN) responses for which generators have been extensively investigated with little homogeneity in the reported results. Our multimodal inference at the group level revealed spatio-temporal activity within the supratemporal plane with a precision which, to our knowledge, has never been achieved before with non-invasive recordings.
Collapse
Affiliation(s)
- Françoise Lecaignard
- Lyon Neuroscience Research Center, CRNL; INSERM, U1028; CNRS, UMR5292; Brain Dynamics and Cognition Team, Lyon, F-69000, France; University Lyon 1, Lyon, F-69000, France.
| | - Olivier Bertrand
- Lyon Neuroscience Research Center, CRNL; INSERM, U1028; CNRS, UMR5292; Brain Dynamics and Cognition Team, Lyon, F-69000, France; University Lyon 1, Lyon, F-69000, France
| | - Anne Caclin
- Lyon Neuroscience Research Center, CRNL; INSERM, U1028; CNRS, UMR5292; Brain Dynamics and Cognition Team, Lyon, F-69000, France; University Lyon 1, Lyon, F-69000, France
| | - Jérémie Mattout
- Lyon Neuroscience Research Center, CRNL; INSERM, U1028; CNRS, UMR5292; Brain Dynamics and Cognition Team, Lyon, F-69000, France; University Lyon 1, Lyon, F-69000, France
| |
Collapse
|
9
|
Auditory mismatch processing: Role of paradigm and stimulus characteristics as detected by fMRI. Biol Psychol 2020; 154:107887. [DOI: 10.1016/j.biopsycho.2020.107887] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 01/14/2020] [Accepted: 04/06/2020] [Indexed: 11/23/2022]
|
10
|
Fasano MC, Glerean E, Gold BP, Sheng D, Sams M, Vuust P, Rauschecker JP, Brattico E. Inter-subject Similarity of Brain Activity in Expert Musicians After Multimodal Learning: A Behavioral and Neuroimaging Study on Learning to Play a Piano Sonata. Neuroscience 2020; 441:102-116. [PMID: 32569807 DOI: 10.1016/j.neuroscience.2020.06.015] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Revised: 06/11/2020] [Accepted: 06/14/2020] [Indexed: 11/26/2022]
Abstract
Human behavior is inherently multimodal and relies on sensorimotor integration. This is evident when pianists exhibit activity in motor and premotor cortices, as part of a dorsal pathway, while listening to a familiar piece of music, or when naïve participants learn to play simple patterns on the piano. Here we investigated the interaction between multimodal learning and dorsal-stream activity over the course of four weeks in ten skilled pianists by adopting a naturalistic data-driven analysis approach. We presented the pianists with audio-only, video-only and audiovisual recordings of a piano sonata during functional magnetic resonance imaging (fMRI) before and after they had learned to play the sonata by heart for a total of four weeks. We followed the learning process and its outcome with questionnaires administered to the pianists, one piano instructor following their training, and seven external expert judges. The similarity of the pianists' brain activity during stimulus presentations was examined before and after learning by means of inter-subject correlation (ISC) analysis. After learning, an increased ISC was found in the pianists while watching the audiovisual performance, particularly in motor and premotor regions of the dorsal stream. While these brain structures have previously been associated with learning simple audio-motor sequences, our findings are the first to suggest their involvement in learning a complex and demanding audiovisual-motor task. Moreover, the most motivated learners and the best performers of the sonata showed ISC in the dorsal stream and in the reward brain network.
Collapse
Affiliation(s)
- Maria C Fasano
- Department of Psychology and Behavioural Sciences, Aarhus University, Aarhus, Denmark
| | - Enrico Glerean
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; International Laboratory of Social Neurobiology, Institute of Cognitive Neuroscience, National Research University Higher School of Economics, Moscow, Russia
| | - Benjamin P Gold
- Montreal Neurological Institute, McGill University, Montreál, Canada
| | - Dana Sheng
- Department of Neuroscience, Georgetown University Medical Center, Washington, USA
| | - Mikko Sams
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland; Department of Computer Science, Alto University, Espoo, Finland; Advanced Magnetic Imaging (AMI) Centre, Aalto University School of Science, Espoo, Finland
| | - Peter Vuust
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| | - Josef P Rauschecker
- Department of Neuroscience, Georgetown University Medical Center, Washington, USA; Institute for Advanced Study, TUM, Munich, Germany
| | - Elvira Brattico
- Center for Music in the Brain (MIB), Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark; Department of Education, Psychology, Communication, University of Bari Aldo Moro, Bari, Italy.
| |
Collapse
|
11
|
Midline frontal and occipito-temporal activity during error monitoring in dyadic motor interactions. Cortex 2020; 127:131-149. [PMID: 32197149 DOI: 10.1016/j.cortex.2020.01.020] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Revised: 12/17/2019] [Accepted: 01/07/2020] [Indexed: 12/18/2022]
Abstract
Discrepancies between sensory predictions and action outcome are at the base of error coding. However, these phenomena have mainly been studied focussing on individual performance. Here, we explored EEG responses to motor prediction errors during a human-avatar interaction and show that Theta/Alpha activity of the frontal error-monitoring system works in phase with activity of the occipito-temporal node of the action observation network. Our motor interaction paradigm required healthy individuals to synchronize their reach-to-grasp movements with those of a virtual partner in conditions that did (Interactive) or did not require (Cued) movement prediction and adaptation to the partner's actions. Crucially, in 30% of the trials the virtual partner suddenly and unpredictably changed its movement trajectory thereby violating the human participant's expectation. These changes elicited error-related neuromarkers (ERN/Pe - Theta/Alpha modulations) over fronto-central electrodes during the Interactive condition. Source localization and connectivity analyses showed that the frontal Theta/Alpha activity induced by violations of the expected interactive movements was in phase with occipito-temporal Theta/Alpha activity. These results expand current knowledge about the neural correlates of on-line interpersonal motor interactions linking the frontal error-monitoring system to visual, body motion-related, responses.
Collapse
|
12
|
Fong CY, Law WHC, Uka T, Koike S. Auditory Mismatch Negativity Under Predictive Coding Framework and Its Role in Psychotic Disorders. Front Psychiatry 2020; 11:557932. [PMID: 33132932 PMCID: PMC7511529 DOI: 10.3389/fpsyt.2020.557932] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Accepted: 08/18/2020] [Indexed: 12/13/2022] Open
Abstract
Traditional neuroscience sees sensory perception as a simple feedforward process. This view is challenged by the predictive coding model in recent years due to the robust evidence researchers had found on how our prediction could influence perception. In the first half of this article, we reviewed the concept of predictive brain and some empirical evidence of sensory prediction in visual and auditory processing. The predictive function along the auditory pathway was mainly studied by mismatch negativity (MMN)-a brain response to an unexpected disruption of regularity. We summarized a range of MMN paradigms and discussed how they could contribute to the theoretical development of the predictive coding neural network by the mechanism of adaptation and deviance detection. Such methodological and conceptual evolution sharpen MMN as a tool to better understand the structural and functional brain abnormality for neuropsychiatric disorder such as schizophrenia.
Collapse
Affiliation(s)
- Chun Yuen Fong
- Center for Evolutionary Cognitive Sciences, Graduate School of Art and Sciences, The University of Tokyo, Meguro-ku, Japan
| | - Wai Him Crystal Law
- Center for Evolutionary Cognitive Sciences, Graduate School of Art and Sciences, The University of Tokyo, Meguro-ku, Japan
| | - Takanori Uka
- Department of Integrative Physiology, Graduate School of Medicine, University of Yamanashi, Chuo, Yamanashi, Japan
| | - Shinsuke Koike
- Center for Evolutionary Cognitive Sciences, Graduate School of Art and Sciences, The University of Tokyo, Meguro-ku, Japan.,University of Tokyo Institute for Diversity & Adaptation of Human Mind (UTIDAHM), Meguro-ku, Japan.,University of Tokyo Center for Integrative Science of Human Behavior (CiSHuB), 3-8-1 Komaba, Meguro-ku, Japan.,The International Research Center for Neurointelligence (WPI-IRCN), Institutes for Advanced Study (UTIAS), University of Tokyo, Bunkyo-ku, Japan
| |
Collapse
|
13
|
Omigie D, Pearce M, Lehongre K, Hasboun D, Navarro V, Adam C, Samson S. Intracranial Recordings and Computational Modeling of Music Reveal the Time Course of Prediction Error Signaling in Frontal and Temporal Cortices. J Cogn Neurosci 2019; 31:855-873. [PMID: 30883293 DOI: 10.1162/jocn_a_01388] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
Prediction is held to be a fundamental process underpinning perception, action, and cognition. To examine the time course of prediction error signaling, we recorded intracranial EEG activity from nine presurgical epileptic patients while they listened to melodies whose information theoretical predictability had been characterized using a computational model. We examined oscillatory activity in the superior temporal gyrus (STG), the middle temporal gyrus (MTG), and the pars orbitalis of the inferior frontal gyrus, lateral cortical areas previously implicated in auditory predictive processing. We also examined activity in anterior cingulate gyrus (ACG), insula, and amygdala to determine whether signatures of prediction error signaling may also be observable in these subcortical areas. Our results demonstrate that the information content (a measure of unexpectedness) of musical notes modulates the amplitude of low-frequency oscillatory activity (theta to beta power) in bilateral STG and right MTG from within 100 and 200 msec of note onset, respectively. Our results also show this cortical activity to be accompanied by low-frequency oscillatory modulation in ACG and insula-areas previously associated with mediating physiological arousal. Finally, we showed that modulation of low-frequency activity is followed by that of high-frequency (gamma) power from approximately 200 msec in the STG, between 300 and 400 msec in the left insula, and between 400 and 500 msec in the ACG. We discuss these results with respect to models of neural processing that emphasize gamma activity as an index of prediction error signaling and highlight the usefulness of musical stimuli in revealing the wide-reaching neural consequences of predictive processing.
Collapse
Affiliation(s)
- Diana Omigie
- Max Planck Institute for Empirical Aesthetics.,Goldsmiths, University of London
| | | | - Katia Lehongre
- AP-HP, GH Pitié-Salpêtrière-Charles Foix.,Inserm U 1127, CNRS UMR 7225, Sorbonne Université, UMPC Univ Paris 06 UMR 5 1127, Institut du Cerveau et de la Moelle épinière, ICM, F-75013
| | | | - Vincent Navarro
- AP-HP, GH Pitié-Salpêtrière-Charles Foix.,Inserm U 1127, CNRS UMR 7225, Sorbonne Université, UMPC Univ Paris 06 UMR 5 1127, Institut du Cerveau et de la Moelle épinière, ICM, F-75013
| | | | - Severine Samson
- AP-HP, GH Pitié-Salpêtrière-Charles Foix.,University of Lille
| |
Collapse
|
14
|
Gifford AM, Sperling MR, Sharan A, Gorniak RJ, Williams RB, Davis K, Kahana MJ, Cohen YE. Neuronal phase consistency tracks dynamic changes in acoustic spectral regularity. Eur J Neurosci 2018; 49:1268-1287. [PMID: 30402926 DOI: 10.1111/ejn.14263] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2018] [Revised: 10/15/2018] [Accepted: 10/23/2018] [Indexed: 11/28/2022]
Abstract
The brain parses the auditory environment into distinct sounds by identifying those acoustic features in the environment that have common relationships (e.g., spectral regularities) with one another and then grouping together the neuronal representations of these features. Although there is a large literature that tests how the brain tracks spectral regularities that are predictable, it is not known how the auditory system tracks spectral regularities that are not predictable and that change dynamically over time. Furthermore, the contribution of brain regions downstream of the auditory cortex to the coding of spectral regularity is unknown. Here, we addressed these two issues by recording electrocorticographic activity, while human patients listened to tone-burst sequences with dynamically varying spectral regularities, and identified potential neuronal mechanisms of the analysis of spectral regularities throughout the brain. We found that the degree of oscillatory stimulus phase consistency (PC) in multiple neuronal-frequency bands tracked spectral regularity. In particular, PC in the delta-frequency band seemed to be the best indicator of spectral regularity. We also found that these regularity representations existed in multiple regions throughout cortex. This widespread reliable modulation in PC - both in neuronal-frequency space and in cortical space - suggests that phase-based modulations may be a general mechanism for tracking regularity in the auditory system specifically and other sensory systems more generally. Our findings also support a general role for the delta-frequency band in processing the regularity of auditory stimuli.
Collapse
Affiliation(s)
- Adam M Gifford
- Neuroscience Graduate Group, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Michael R Sperling
- Jefferson Comprehensive Epilepsy Center, Department of Neurology, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Ashwini Sharan
- Jefferson Comprehensive Epilepsy Center, Department of Neurology, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Richard J Gorniak
- Department of Radiology, Sidney Kimmel Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania
| | - Ryan B Williams
- Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Kathryn Davis
- Department of Neurology, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Michael J Kahana
- Neuroscience Graduate Group, University of Pennsylvania, Philadelphia, Pennsylvania.,Department of Psychology, University of Pennsylvania, Philadelphia, Pennsylvania
| | - Yale E Cohen
- Neuroscience Graduate Group, University of Pennsylvania, Philadelphia, Pennsylvania.,Departments of Otorhinolaryngology, Neuroscience, and Bioengineering, University of Pennsylvania, Philadelphia, Pennsylvania
| |
Collapse
|
15
|
Tse CY, Yip LY, Lui TKY, Xiao XZ, Wang Y, Chu WCW, Parks NA, Chan SSM, Neggers SFW. Establishing the functional connectivity of the frontotemporal network in pre-attentive change detection with Transcranial Magnetic Stimulation and event-related optical signal. Neuroimage 2018; 179:403-413. [DOI: 10.1016/j.neuroimage.2018.06.053] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Revised: 06/05/2018] [Accepted: 06/17/2018] [Indexed: 11/16/2022] Open
|
16
|
Yoshimura Y, Kikuchi M, Hayashi N, Hiraishi H, Hasegawa C, Takahashi T, Oi M, Remijn GB, Ikeda T, Saito DN, Kumazaki H, Minabe Y. Altered human voice processing in the frontal cortex and a developmental language delay in 3- to 5-year-old children with autism spectrum disorder. Sci Rep 2017; 7:17116. [PMID: 29215027 PMCID: PMC5719344 DOI: 10.1038/s41598-017-17058-x] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Accepted: 11/15/2017] [Indexed: 11/21/2022] Open
Abstract
The inferior frontal and superior temporal areas in the left hemisphere are crucial for human language processing. In the present study, we investigated the magnetic mismatch field (MMF) evoked by voice stimuli in 3- to 5-year-old typically developing (TD) children and children with autism spectrum disorder (ASD) using child-customized magnetoencephalography (MEG). The children with ASD exhibited significantly decreased activation in the left superior temporal gyrus compared with the TD children for the MMF amplitude. If we classified the children with ASD according to the presence of a speech onset delay (ASD - SOD and ASD - NoSOD, respectively) and compared them with the TD children, both ASD groups exhibited decreased activation in the left superior temporal gyrus compared with the TD children. In contrast, the ASD - SOD group exhibited increased activity in the left frontal cortex (i.e., pars orbitalis) compared with the other groups. For all children with ASD, there was a significant negative correlation between the MMF amplitude in the left pars orbitalis and language performance. This investigation is the first to show a significant difference in two distinct MMF regions in ASD – SOD children compared with TD children.
Collapse
Affiliation(s)
- Yuko Yoshimura
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Mitsuru Kikuchi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan.
| | - Norio Hayashi
- Gunma Prefectural College of Health Science, Maebashi, 371-0052, Japan
| | - Hirotoshi Hiraishi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Chiaki Hasegawa
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Tetsuya Takahashi
- Health Administration Center, University of Fukui, Fukui, 910-1193, Japan
| | - Manabu Oi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Gerard B Remijn
- International Education Center, Kyushu University, Fukuoka, 815-8540, Japan
| | - Takashi Ikeda
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Daisuke N Saito
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Hirokazu Kumazaki
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| | - Yoshio Minabe
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, 920-8640, Japan
| |
Collapse
|
17
|
Florin E, Vuvan D, Peretz I, Baillet S. Pre-target neural oscillations predict variability in the detection of small pitch changes. PLoS One 2017; 12:e0177836. [PMID: 28542644 PMCID: PMC5436812 DOI: 10.1371/journal.pone.0177836] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2017] [Accepted: 05/03/2017] [Indexed: 11/18/2022] Open
Abstract
Pitch discrimination is important for language or music processing. Previous studies indicate that auditory perception depends on pre-target neural activity. However, so far the pre-target electrophysiological conditions which enable the detection of small pitch changes are not well studied, but might yield important insights into pitch-processing. We used magnetoencephalography (MEG) source imaging to reveal the pre-target effects of successful auditory detection of small pitch deviations from a sequence of standard tones. Participants heard a sequence of four pure tones and had to determine whether the last target tone was different or identical to the first three standard sounds. We found that successful pitch change detection could be predicted from the amplitude of theta (4-8 Hz) oscillatory activity in the right inferior frontal gyrus (IFG) as well as beta (12-30 Hz) oscillatory activity in the right auditory cortex. These findings confirm and extend evidence for the involvement of theta as well as beta-band activity in auditory perception.
Collapse
Affiliation(s)
- Esther Florin
- McConnell Brain Imaging Center, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany
| | - Dominique Vuvan
- Centre for Research on Brain, Language and Music, Montreal, Quebec, Canada
- Psychology Department, Skidmore College, Saratoga Springs, NY, United States of America
| | - Isabelle Peretz
- Centre for Research on Brain, Language and Music, Montreal, Quebec, Canada
- Department of Psychology, International Laboratory of Brain, Music, and Sound Research, University of Montreal, Montreal, Quebec, Canada
| | - Sylvain Baillet
- McConnell Brain Imaging Center, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
18
|
Lappe C, Bodeck S, Lappe M, Pantev C. Shared Neural Mechanisms for the Prediction of Own and Partner Musical Sequences after Short-term Piano Duet Training. Front Neurosci 2017; 11:165. [PMID: 28420951 PMCID: PMC5378800 DOI: 10.3389/fnins.2017.00165] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2016] [Accepted: 03/13/2017] [Indexed: 11/22/2022] Open
Abstract
Predictive mechanisms in the human brain can be investigated using markers for prediction violations like the mismatch negativity (MMN). Short-term piano training increases the MMN for melodic and rhythmic deviations in the training material. This increase occurs only when the material is actually played, not when it is only perceived through listening, suggesting that learning predictions about upcoming musical events are derived from motor involvement. However, music is often performed in concert with others. In this case, predictions about upcoming actions from a partner are a crucial part of the performance. In the present experiment, we use magnetoencephalography (MEG) to measure MMNs to deviations in one's own and a partner's musical material after both engaged in musical duet training. Event-related field (ERF) results revealed that the MMN increased significantly for own and partner material suggesting a neural representation of the partner's part in a duet situation. Source analysis using beamforming revealed common activations in auditory, inferior frontal, and parietal areas, similar to previous results for single players, but also a pronounced contribution from the cerebellum. In addition, activation of the precuneus and the medial frontal cortex was observed, presumably related to the need to distinguish between own and partner material.
Collapse
Affiliation(s)
- Claudia Lappe
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| | - Sabine Bodeck
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| | - Markus Lappe
- Department of Psychology, University of MünsterMünster, Germany
| | - Christo Pantev
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of MünsterMünster, Germany
| |
Collapse
|
19
|
Sugata H, Hirata M, Tamura Y, Onishi H, Goto T, Araki T, Yorifuji S. Frequency-dependent oscillatory neural profiles during imitation. Sci Rep 2017; 7:45806. [PMID: 28393878 PMCID: PMC5385530 DOI: 10.1038/srep45806] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2016] [Accepted: 03/06/2017] [Indexed: 11/21/2022] Open
Abstract
Imitation is a complex process that includes higher-order cognitive and motor function. This process requires an observation-execution matching system that transforms an observed action into an identical movement. Although the low-gamma band is thought to reflect higher cognitive processes, no studies have focused on it. Here, we used magnetoencephalography (MEG) to examine the neural oscillatory changes including the low-gamma band during imitation. Twelve healthy, right-handed participants performed a finger task consisting of four conditions (imitation, execution, observation, and rest). During the imitation and execution conditions, significant event-related desynchronizations (ERDs) were observed at the left frontal, central, and parietal MEG sensors in the alpha, beta, and low-gamma bands. Functional connectivity analysis at the sensor level revealed an imitation-related connectivity between a group of frontal sensors and a group of parietal sensors in the low-gamma band. Furthermore, source reconstruction with synthetic aperture magnetometry showed significant ERDs in the low-gamma band in the left sensorimotor area and the middle frontal gyrus (MFG) during the imitation condition when compared with the other three conditions. Our results suggest that the oscillatory neural activities of the low-gamma band at the sensorimotor area and MFG play an important role in the observation-execution matching system related to imitation.
Collapse
Affiliation(s)
- Hisato Sugata
- Department of Neurosurgery, Osaka University Medical School, 2-2 E6 Yamadaoka, Suita, Osaka, 565-0871, Japan.,Faculty of Welfare and Health Science, Oita University, 700 Dannoharu, Oita, 870-1192, Japan
| | - Masayuki Hirata
- Department of Neurosurgery, Osaka University Medical School, 2-2 E6 Yamadaoka, Suita, Osaka, 565-0871, Japan.,Endowed Research Department of Clinical Neuroengineering, Global Center for Medical Engineering and Informatics, Osaka University, Suita, Osaka, Japan
| | - Yuichi Tamura
- Division of Functional Diagnostic Science, Osaka University Graduate School of Medicine, 1-7 Yamadaka, Suita, Osaka, 565-0871, Japan
| | - Hisao Onishi
- Department of Occupational Therapy, Osaka Prefecture University, 3-7-30 Habikino, Habikino, Osaka, 583-8555, Japan
| | - Tetsu Goto
- Department of Neurosurgery, Osaka University Medical School, 2-2 E6 Yamadaoka, Suita, Osaka, 565-0871, Japan.,Division of Functional Diagnostic Science, Osaka University Graduate School of Medicine, 1-7 Yamadaka, Suita, Osaka, 565-0871, Japan
| | - Toshihiko Araki
- Division of Functional Diagnostic Science, Osaka University Graduate School of Medicine, 1-7 Yamadaka, Suita, Osaka, 565-0871, Japan
| | - Shiro Yorifuji
- Division of Functional Diagnostic Science, Osaka University Graduate School of Medicine, 1-7 Yamadaka, Suita, Osaka, 565-0871, Japan
| |
Collapse
|
20
|
Royal I, Vuvan DT, Zendel BR, Robitaille N, Schönwiesner M, Peretz I. Activation in the Right Inferior Parietal Lobule Reflects the Representation of Musical Structure beyond Simple Pitch Discrimination. PLoS One 2016; 11:e0155291. [PMID: 27195523 PMCID: PMC4873218 DOI: 10.1371/journal.pone.0155291] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2015] [Accepted: 04/27/2016] [Indexed: 11/25/2022] Open
Abstract
Pitch discrimination tasks typically engage the superior temporal gyrus and the right inferior frontal gyrus. It is currently unclear whether these regions are equally involved in the processing of incongruous notes in melodies, which requires the representation of musical structure (tonality) in addition to pitch discrimination. To this aim, 14 participants completed two tasks while undergoing functional magnetic resonance imaging, one in which they had to identify a pitch change in a series of non-melodic repeating tones and a second in which they had to identify an incongruous note in a tonal melody. In both tasks, the deviants activated the right superior temporal gyrus. A contrast between deviants in the melodic task and deviants in the non-melodic task (melodic > non-melodic) revealed additional activity in the right inferior parietal lobule. Activation in the inferior parietal lobule likely represents processes related to the maintenance of tonal pitch structure in working memory during pitch discrimination.
Collapse
Affiliation(s)
- Isabelle Royal
- Département de psychologie, Université de Montréal, Québec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
- Center of Research on Brain, Language and Music (CRBLM), McGill University, Québec, Canada
- * E-mail:
| | - Dominique T. Vuvan
- Département de psychologie, Université de Montréal, Québec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
- Center of Research on Brain, Language and Music (CRBLM), McGill University, Québec, Canada
| | - Benjamin Rich Zendel
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
- Faculty of Medicine, Division of Community Health and Humanities, Memorial University of Newfoundland
| | - Nicolas Robitaille
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
| | - Marc Schönwiesner
- Département de psychologie, Université de Montréal, Québec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
- Center of Research on Brain, Language and Music (CRBLM), McGill University, Québec, Canada
| | - Isabelle Peretz
- Département de psychologie, Université de Montréal, Québec, Canada
- International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Québec, Canada
- Center of Research on Brain, Language and Music (CRBLM), McGill University, Québec, Canada
| |
Collapse
|
21
|
Scharinger M, Monahan PJ, Idsardi WJ. Linguistic category structure influences early auditory processing: Converging evidence from mismatch responses and cortical oscillations. Neuroimage 2016; 128:293-301. [PMID: 26780574 DOI: 10.1016/j.neuroimage.2016.01.003] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2015] [Revised: 12/30/2015] [Accepted: 01/02/2016] [Indexed: 10/22/2022] Open
Abstract
While previous research has established that language-specific knowledge influences early auditory processing, it is still controversial as to what aspects of speech sound representations determine early speech perception. Here, we propose that early processing primarily depends on information propagated top-down from abstractly represented speech sound categories. In particular, we assume that mid-vowels (as in 'bet') exert less top-down effects than the high-vowels (as in 'bit') because of their less specific (default) tongue height position as compared to either high- or low-vowels (as in 'bat'). We tested this assumption in a magnetoencephalography (MEG) study where we contrasted mid- and high-vowels, as well as the low- and high-vowels in a passive oddball paradigm. Overall, significant differences between deviants and standards indexed reliable mismatch negativity (MMN) responses between 200 and 300ms post-stimulus onset. MMN amplitudes differed in the mid/high-vowel contrasts and were significantly reduced when a mid-vowel standard was followed by a high-vowel deviant, extending previous findings. Furthermore, mid-vowel standards showed reduced oscillatory power in the pre-stimulus beta-frequency band (18-26Hz), compared to high-vowel standards. We take this as converging evidence for linguistic category structure to exert top-down influences on auditory processing. The findings are interpreted within the linguistic model of underspecification and the neuropsychological predictive coding framework.
Collapse
Affiliation(s)
- Mathias Scharinger
- Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany; Department of Linguistics, University of Maryland, College Park, MD, USA; Biological incl. Cognitive Psychology, Institute for Psychology, University of Leipzig, Germany.
| | - Philip J Monahan
- Centre for French and Linguistics, University of Toronto Scarborough, Canada; Department of Linguistics, University of Toronto, Canada
| | - William J Idsardi
- Department of Linguistics, University of Maryland, College Park, MD, USA
| |
Collapse
|
22
|
Lappe C, Lappe M, Pantev C. Differential processing of melodic, rhythmic and simple tone deviations in musicians -an MEG study. Neuroimage 2016; 124:898-905. [DOI: 10.1016/j.neuroimage.2015.09.059] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2015] [Revised: 09/20/2015] [Accepted: 09/29/2015] [Indexed: 01/08/2023] Open
|
23
|
Christison-Lagay KL, Gifford AM, Cohen YE. Neural correlates of auditory scene analysis and perception. Int J Psychophysiol 2015; 95:238-245. [PMID: 24681354 PMCID: PMC4176604 DOI: 10.1016/j.ijpsycho.2014.03.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2013] [Revised: 01/13/2014] [Accepted: 03/14/2014] [Indexed: 11/16/2022]
Abstract
The auditory system is designed to transform acoustic information from low-level sensory representations into perceptual representations. These perceptual representations are the computational result of the auditory system's ability to group and segregate spectral, spatial and temporal regularities in the acoustic environment into stable perceptual units (i.e., sounds or auditory objects). Current evidence suggests that the cortex-specifically, the ventral auditory pathway-is responsible for the computations most closely related to perceptual representations. Here, we discuss how the transformations along the ventral auditory pathway relate to auditory percepts, with special attention paid to the processing of vocalizations and categorization, and explore recent models of how these areas may carry out these computations.
Collapse
Affiliation(s)
- Kate L. Christison-Lagay
- Neuroscience Graduate Group, Perelman School of Medicine, University of Pennsylvania, Philadelphia, 19104
| | - Adam M. Gifford
- Neuroscience Graduate Group, Perelman School of Medicine, University of Pennsylvania, Philadelphia, 19104
| | - Yale E. Cohen
- Department of Otorhinolaryngology, University of Pennsylvania, Philadelphia, 19104
- Neuroscience, Perelman School of Medicine, University of Pennsylvania, Philadelphia, 19104
- Department of Bioengineering University of Pennsylvania, Philadelphia, 19104
| |
Collapse
|
24
|
Effects of aging on the neuromagnetic mismatch detection to speech sounds. Biol Psychol 2015; 104:48-55. [DOI: 10.1016/j.biopsycho.2014.11.003] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2012] [Revised: 06/30/2014] [Accepted: 11/09/2014] [Indexed: 11/21/2022]
|
25
|
Fulham WR, Michie PT, Ward PB, Rasser PE, Todd J, Johnston PJ, Thompson PM, Schall U. Mismatch negativity in recent-onset and chronic schizophrenia: a current source density analysis. PLoS One 2014; 9:e100221. [PMID: 24949859 PMCID: PMC4064992 DOI: 10.1371/journal.pone.0100221] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2013] [Accepted: 05/23/2014] [Indexed: 01/09/2023] Open
Abstract
Mismatch negativity (MMN) is a component of the event-related potential elicited by deviant auditory stimuli. It is presumed to index pre-attentive monitoring of changes in the auditory environment. MMN amplitude is smaller in groups of individuals with schizophrenia compared to healthy controls. We compared duration-deviant MMN in 16 recent-onset and 19 chronic schizophrenia patients versus age- and sex-matched controls. Reduced frontal MMN was found in both patient groups, involved reduced hemispheric asymmetry, and was correlated with Global Assessment of Functioning (GAF) and negative symptom ratings. A cortically-constrained LORETA analysis, incorporating anatomical data from each individual's MRI, was performed to generate a current source density model of the MMN response over time. This model suggested MMN generation within a temporal, parietal and frontal network, which was right hemisphere dominant only in controls. An exploratory analysis revealed reduced CSD in patients in superior and middle temporal cortex, inferior and superior parietal cortex, precuneus, anterior cingulate, and superior and middle frontal cortex. A region of interest (ROI) analysis was performed. For the early phase of the MMN, patients had reduced bilateral temporal and parietal response and no lateralisation in frontal ROIs. For late MMN, patients had reduced bilateral parietal response and no lateralisation in temporal ROIs. In patients, correlations revealed a link between GAF and the MMN response in parietal cortex. In controls, the frontal response onset was 17 ms later than the temporal and parietal response. In patients, onset latency of the MMN response was delayed in secondary, but not primary, auditory cortex. However amplitude reductions were observed in both primary and secondary auditory cortex. These latency delays may indicate relatively intact information processing upstream of the primary auditory cortex, but impaired primary auditory cortex or cortico-cortical or thalamo-cortical communication with higher auditory cortices as a core deficit in schizophrenia.
Collapse
Affiliation(s)
- W. Ross Fulham
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, New South Wales, Australia
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- Hunter Medical Research Institute, Newcastle, New South Wales, Australia
| | - Patricia T. Michie
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, New South Wales, Australia
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- School of Psychology, The University of Newcastle, Newcastle, New South Wales, Australia
| | - Philip B. Ward
- School of Psychiatry, University of New South Wales, Sydney, New South Wales, Australia
- Schizophrenia Research Unit, South Western Sydney Local Health District, Sydney, New South Wales, Australia
| | - Paul E. Rasser
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, New South Wales, Australia
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- Hunter Medical Research Institute, Newcastle, New South Wales, Australia
| | - Juanita Todd
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, New South Wales, Australia
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- School of Psychology, The University of Newcastle, Newcastle, New South Wales, Australia
| | - Patrick J. Johnston
- Department of Psychology and York Neuroimaging Centre, University of York, Heslington, United Kingdom
| | - Paul M. Thompson
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- Imaging Genetics Center, Institute for Neuroimaging and Informatics, Keck School of Medicine, University of Southern California, Los Angeles, California, United States of America
- Departments of Neurology, Psychiatry, Radiology, Engineering, Pediatrics, and Ophthalmology, University of Southern California, Los Angeles, California, United States of America
| | - Ulrich Schall
- Centre for Translational Neuroscience and Mental Health, The University of Newcastle, Newcastle, New South Wales, Australia
- Schizophrenia Research Institute, Darlinghurst, New South Wales, Australia
- Hunter Medical Research Institute, Newcastle, New South Wales, Australia
| |
Collapse
|
26
|
Okamoto H, Kakigi R. Hemispheric asymmetry of auditory mismatch negativity elicited by spectral and temporal deviants: a magnetoencephalographic study. Brain Topogr 2013; 28:471-8. [PMID: 24366694 PMCID: PMC4408358 DOI: 10.1007/s10548-013-0347-1] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2013] [Accepted: 12/16/2013] [Indexed: 11/06/2022]
Abstract
One of the major challenges in human brain science is the functional hemispheric asymmetry of auditory processing. Behavioral and neurophysiological studies have demonstrated that speech processing is dominantly handled in the left hemisphere, whereas music processing dominantly occurs in the right. Using magnetoencephalography, we measured the auditory mismatch negativity elicited by band-pass filtered click-trains, which deviated from frequently presented standard sound signals in a spectral or temporal domain. The results showed that spectral and temporal deviants were dominantly processed in the right and left hemispheres, respectively. Hemispheric asymmetry was not limited to high-level cognitive processes, but also originated from the pre-attentive neural processing stage represented by mismatch negativity.
Collapse
Affiliation(s)
- Hidehiko Okamoto
- Department of Integrative Physiology, National Institute for Physiological Sciences, 38 Nishigo-Naka, Myodaiji, Okazaki, 444-8585, Japan,
| | | |
Collapse
|
27
|
The Mechanisms and Meaning of the Mismatch Negativity. Brain Topogr 2013; 27:500-26. [DOI: 10.1007/s10548-013-0337-3] [Citation(s) in RCA: 69] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2013] [Accepted: 11/15/2013] [Indexed: 10/26/2022]
|
28
|
Lappe C, Steinsträter O, Pantev C. Rhythmic and melodic deviations in musical sequences recruit different cortical areas for mismatch detection. Front Hum Neurosci 2013; 7:260. [PMID: 23759929 PMCID: PMC3675320 DOI: 10.3389/fnhum.2013.00260] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2013] [Accepted: 05/23/2013] [Indexed: 01/05/2023] Open
Abstract
The mismatch negativity (MMN), an event-related potential (ERP) representing the violation of an acoustic regularity, is considered as a pre-attentive change detection mechanism at the sensory level on the one hand and as a prediction error signal on the other hand, suggesting that bottom-up as well as top-down processes are involved in its generation. Rhythmic and melodic deviations within a musical sequence elicit a MMN in musically trained subjects, indicating that acquired musical expertise leads to better discrimination accuracy of musical material and better predictions about upcoming musical events. Expectation violations to musical material could therefore recruit neural generators that reflect top-down processes that are based on musical knowledge. We describe the neural generators of the musical MMN for rhythmic and melodic material after a short-term sensorimotor-auditory (SA) training. We compare the localization of musical MMN data from two previous MEG studies by applying beamformer analysis. One study focused on the melodic harmonic progression whereas the other study focused on rhythmic progression. The MMN to melodic deviations revealed significant right hemispheric neural activation in the superior temporal gyrus (STG), inferior frontal cortex (IFC), and the superior frontal (SFG) and orbitofrontal (OFG) gyri. IFC and SFG activation was also observed in the left hemisphere. In contrast, beamformer analysis of the data from the rhythm study revealed bilateral activation within the vicinity of auditory cortices and in the inferior parietal lobule (IPL), an area that has recently been implied in temporal processing. We conclude that different cortical networks are activated in the analysis of the temporal and the melodic content of musical material, and discuss these networks in the context of the dual-pathway model of auditory processing.
Collapse
Affiliation(s)
- Claudia Lappe
- Department of Medicine, Institute for Biomagnetism and Biosignalanalysis, University of Münster Münster, Germany
| | | | | |
Collapse
|