1
|
Bouwer FL, Háden GP, Honing H. Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:227-256. [PMID: 38918355 DOI: 10.1007/978-3-031-60183-5_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.
Collapse
Affiliation(s)
- Fleur L Bouwer
- Cognitive Psychology Unit, Institute of Psychology, Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.
- Department of Psychology, Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands.
| | - Gábor P Háden
- Institute of Cognitive Neuroscience and Psychology, Budapest, Hungary
- Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Henkjan Honing
- Music Cognition group (MCG), Institute for Logic, Language and Computation (ILLC), Amsterdam Brain and Cognition (ABC), University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
2
|
Poublan-Couzardot A, Lecaignard F, Fucci E, Davidson RJ, Mattout J, Lutz A, Abdoun O. Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response. PLoS Comput Biol 2023; 19:e1010557. [PMID: 38091350 PMCID: PMC10752554 DOI: 10.1371/journal.pcbi.1010557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 12/27/2023] [Accepted: 11/20/2023] [Indexed: 12/28/2023] Open
Abstract
Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.
Collapse
Affiliation(s)
- Arnaud Poublan-Couzardot
- Cente de Recherche en Neurosciences de Lyon (CRNL), CNRS UMRS5292, INSERM U1028, Université Claude Bernard Lyon 1, Bron, France
| | - Françoise Lecaignard
- Cente de Recherche en Neurosciences de Lyon (CRNL), CNRS UMRS5292, INSERM U1028, Université Claude Bernard Lyon 1, Bron, France
| | - Enrico Fucci
- 2 Institute for Globally Distributed Open Research and Education (IGDORE), Sweden
| | - Richard J. Davidson
- Center for Healthy Minds, University of Wisconsin, Madison, Wisconsin, United States of America
- Department of Psychology, University of Wisconsin, Madison, Wisconsin, United States of America
- Waisman Laboratory for Brain Imaging and Behavior, University of Wisconsin, Madison, Wisconsin, United States of America
- Department of Psychiatry, University of Wisconsin, Madison, Wisconsin, United States of America
| | - Jérémie Mattout
- Cente de Recherche en Neurosciences de Lyon (CRNL), CNRS UMRS5292, INSERM U1028, Université Claude Bernard Lyon 1, Bron, France
| | - Antoine Lutz
- Cente de Recherche en Neurosciences de Lyon (CRNL), CNRS UMRS5292, INSERM U1028, Université Claude Bernard Lyon 1, Bron, France
| | - Oussama Abdoun
- Cente de Recherche en Neurosciences de Lyon (CRNL), CNRS UMRS5292, INSERM U1028, Université Claude Bernard Lyon 1, Bron, France
| |
Collapse
|
3
|
Wu L, Mei S, Yu S, Han S, Zhang YQ. Shank3 mutations enhance early neural responses to deviant tones in dogs. Cereb Cortex 2023; 33:10546-10557. [PMID: 37585733 DOI: 10.1093/cercor/bhad302] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 07/26/2023] [Accepted: 07/27/2023] [Indexed: 08/18/2023] Open
Abstract
Both enhanced discrimination of low-level features of auditory stimuli and mutations of SHANK3 (a gene that encodes a synaptic scaffolding protein) have been identified in autism spectrum disorder patients. However, experimental evidence regarding whether SHANK3 mutations lead to enhanced neural processing of low-level features of auditory stimuli is lacking. The present study investigated this possibility by examining effects of Shank3 mutations on early neural processing of pitch (tone frequency) in dogs. We recorded electrocorticograms from wild-type and Shank3 mutant dogs using an oddball paradigm in which deviant tones of different frequencies or probabilities were presented along with other tones in a repetitive stream (standards). We found that, relative to wild-type dogs, Shank3 mutant dogs exhibited larger amplitudes of early neural responses to deviant tones and greater sensitivity to variations of deviant frequencies within 100 ms after tone onsets. In addition, the enhanced early neural responses to deviant tones in Shank3 mutant dogs were observed independently of the probability of deviant tones. Our findings highlight an essential functional role of Shank3 in modulations of early neural detection of novel sounds and offer new insights into the genetic basis of the atypical auditory information processing in autism patients.
Collapse
Affiliation(s)
- Liang Wu
- State Key Laboratory for Molecular and Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
- College of Life Sciences, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Shuting Mei
- School of Psychological and Cognitive Sciences, PKU-IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
| | - Shan Yu
- Brainnetome Center and State Key Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Shihui Han
- School of Psychological and Cognitive Sciences, PKU-IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China
| | - Yong Q Zhang
- State Key Laboratory for Molecular and Developmental Biology, Institute of Genetics and Developmental Biology, Chinese Academy of Sciences, Beijing 100101, China
- College of Life Sciences, University of Chinese Academy of Sciences, Beijing 100049, China
| |
Collapse
|
4
|
Han C, English G, Saal HP, Indiveri G, Gilra A, von der Behrens W, Vasilaki E. Modelling novelty detection in the thalamocortical loop. PLoS Comput Biol 2023; 19:e1009616. [PMID: 37186588 DOI: 10.1371/journal.pcbi.1009616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 05/25/2023] [Accepted: 02/21/2023] [Indexed: 05/17/2023] Open
Abstract
In complex natural environments, sensory systems are constantly exposed to a large stream of inputs. Novel or rare stimuli, which are often associated with behaviorally important events, are typically processed differently than the steady sensory background, which has less relevance. Neural signatures of such differential processing, commonly referred to as novelty detection, have been identified on the level of EEG recordings as mismatch negativity (MMN) and on the level of single neurons as stimulus-specific adaptation (SSA). Here, we propose a multi-scale recurrent network with synaptic depression to explain how novelty detection can arise in the whisker-related part of the somatosensory thalamocortical loop. The "minimalistic" architecture and dynamics of the model presume that neurons in cortical layer 6 adapt, via synaptic depression, specifically to a frequently presented stimulus, resulting in reduced population activity in the corresponding cortical column when compared with the population activity evoked by a rare stimulus. This difference in population activity is then projected from the cortex to the thalamus and amplified through the interaction between neurons of the primary and reticular nuclei of the thalamus, resulting in rhythmic oscillations. These differentially activated thalamic oscillations are forwarded to cortical layer 4 as a late secondary response that is specific to rare stimuli that violate a particular stimulus pattern. Model results show a strong analogy between this late single neuron activity and EEG-based mismatch negativity in terms of their common sensitivity to presentation context and timescales of response latency, as observed experimentally. Our results indicate that adaptation in L6 can establish the thalamocortical dynamics that produce signatures of SSA and MMN and suggest a mechanistic model of novelty detection that could generalize to other sensory modalities.
Collapse
Affiliation(s)
- Chao Han
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| | - Gwendolyn English
- Institute of Neuroinformatics, ETH Zurich & University of Zurich, Switzerland
- ZNZ Neuroscience Center Zurich, ETH Zurich & University of Zurich, Switzerland
| | - Hannes P Saal
- Department of Psychology, University of Sheffield, Sheffield, United Kingdom
| | - Giacomo Indiveri
- Institute of Neuroinformatics, ETH Zurich & University of Zurich, Switzerland
- ZNZ Neuroscience Center Zurich, ETH Zurich & University of Zurich, Switzerland
| | - Aditya Gilra
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
- Machine Learning Group, Centrum Wiskunde & Informatica, Amsterdam, The Netherlands
| | - Wolfger von der Behrens
- Institute of Neuroinformatics, ETH Zurich & University of Zurich, Switzerland
- ZNZ Neuroscience Center Zurich, ETH Zurich & University of Zurich, Switzerland
| | - Eleni Vasilaki
- Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
- Institute of Neuroinformatics, ETH Zurich & University of Zurich, Switzerland
| |
Collapse
|
5
|
Ito Y, Shiramatsu TI, Ishida N, Oshima K, Magami K, Takahashi H. Spontaneous beat synchronization in rats: Neural dynamics and motor entrainment. SCIENCE ADVANCES 2022; 8:eabo7019. [PMID: 36367945 PMCID: PMC9651867 DOI: 10.1126/sciadv.abo7019] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Accepted: 09/26/2022] [Indexed: 06/16/2023]
Abstract
Beat perception and synchronization within 120 to 140 beats/min (BPM) are common in humans and frequently used in music composition. Why beat synchronization is uncommon in some species and the mechanism determining the optimal tempo are unclear. Here, we examined physical movements and neural activities in rats to determine their beat sensitivity. Close inspection of head movements and neural recordings revealed that rats displayed prominent beat synchronization and activities in the auditory cortex within 120 to 140 BPM. Mathematical modeling suggests that short-term adaptation underlies this beat tuning. Our results support the hypothesis that the optimal tempo for beat synchronization is determined by the time constant of neural dynamics conserved across species, rather than the species-specific time constant of physical movements. Thus, latent neural propensity for auditory motor entrainment may provide a basis for human entrainment that is much more widespread than currently thought. Further studies comparing humans and animals will offer insights into the origins of music and dancing.
Collapse
|
6
|
Oddball-irrelevant visual stimuli cross-modally attenuate auditory mismatch negativity in rats. Neuroreport 2022; 33:363-368. [DOI: 10.1097/wnr.0000000000001793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
7
|
Janz P, Nicolas MJ, Redondo RL, Valencia M.
GABA
B
R
activation partially normalizes acute
NMDAR
hypofunction oscillatory abnormalities but fails to rescue sensory processing deficits. J Neurochem 2022; 161:417-434. [DOI: 10.1111/jnc.15602] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 01/21/2022] [Accepted: 02/12/2022] [Indexed: 12/01/2022]
Affiliation(s)
- Philipp Janz
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann‐La Roche Ltd, Grenzacherstrasse 124, 4070 Basel Switzerland
| | - Maria Jesus Nicolas
- Universidad de Navarra, CIMA, Program of Neuroscience, 31080 Pamplona Spain
- IdiSNA Navarra Institute for Health Research, 31080 Pamplona Spain
| | - Roger L. Redondo
- Roche Pharma Research and Early Development, Neuroscience and Rare Diseases, Roche Innovation Center Basel, F. Hoffmann‐La Roche Ltd, Grenzacherstrasse 124, 4070 Basel Switzerland
| | - Miguel Valencia
- Universidad de Navarra, CIMA, Program of Neuroscience, 31080 Pamplona Spain
- IdiSNA Navarra Institute for Health Research, 31080 Pamplona Spain
| |
Collapse
|
8
|
Mori C, Okanoya K. Mismatch Responses Evoked by Sound Pattern Violation in the Songbird Forebrain Suggest Common Auditory Processing With Human. Front Physiol 2022; 13:822098. [PMID: 35309047 PMCID: PMC8927687 DOI: 10.3389/fphys.2022.822098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 02/01/2022] [Indexed: 11/13/2022] Open
Abstract
Learning sound patterns in the natural auditory scene and detecting deviant patterns are adaptive behaviors that aid animals in predicting future events and behaving accordingly. Mismatch negativity (MMN) is a component of the event-related potential (ERP) that is reported in humans when they are exposed to unexpected or rare stimuli. MMN has been studied in several non-human animals using an oddball task by presenting deviant pure tones that were interspersed within a sequence of standard pure tones and comparing the neural responses. While accumulating evidence suggests the homology of non-human animal MMN-like responses (MMRs) and human MMN, it is still not clear whether the function and neural mechanisms of MMRs and MMN are comparable. The Java sparrow (Lonchura oryzivora) is a songbird that is a vocal learner, is highly social, and maintains communication with flock members using frequently repeated contact calls and song. We expect that the songbird is a potentially useful animal model that will broaden our understanding of the characterization of MMRs. Due to this, we chose this species to explore MMRs to the deviant sounds in the single sound oddball task using both pure tones and natural vocalizations. MMRs were measured in the caudomedial nidopallium (NCM), a higher-order auditory area. We recorded local field potentials under freely moving conditions. Significant differences were observed in the negative component between deviant and standard ERPs, both to pure tones and natural vocalizations in the oddball sequence. However, the subsequent experiments using the randomized standard sequence and regular pattern sequence suggest the possibility that MMR elicited in the oddball paradigm reflects the adaptation to a repeated standard sound but not the genuine deviance detection. Furthermore, we presented contact call triplet sequences and investigated MMR in the NCM in response to sound sequence order. We found a significant negative shift in response to a difference in sequence pattern. This demonstrates MMR elicited by violation of the pattern of the triplet sequence and the ability to extract sound sequence information in the songbird auditory forebrain. Our study sheds light on the electrophysiological properties of auditory sensory memory processing, expanding the scope of characterization of MMN-like responses beyond simple deviance detection, and provides a comparative perspective on syntax processing in human.
Collapse
Affiliation(s)
- Chihiro Mori
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| | - Kazuo Okanoya
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
- RIKEN Center for Brain Science, Wako, Japan
- *Correspondence: Kazuo Okanoya,
| |
Collapse
|
9
|
Shiramatsu TI, Mori K, Ishizu K, Takahashi H. Auditory, Visual, and Cross-Modal Mismatch Negativities in the Rat Auditory and Visual Cortices. Front Hum Neurosci 2021; 15:721476. [PMID: 34602996 PMCID: PMC8484534 DOI: 10.3389/fnhum.2021.721476] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 08/24/2021] [Indexed: 12/04/2022] Open
Abstract
When the brain tries to acquire an elaborate model of the world, multisensory integration should contribute to building predictions based on the various pieces of information, and deviance detection should repeatedly update these predictions by detecting “errors” from the actual sensory inputs. Accumulating evidence such as a hierarchical organization of the deviance-detection system indicates that the deviance-detection system can be interpreted in the predictive coding framework. Herein, we targeted mismatch negativity (MMN) as a type of prediction-error signal and investigated the relationship between multisensory integration and MMN. In particular, we studied whether and how cross-modal information processing affected MMN in rodents. We designed a new surface microelectrode array and simultaneously recorded visual and auditory evoked potentials from the visual and auditory cortices of rats under anesthesia. Then, we mapped MMNs for five types of deviant stimuli: single-modal deviants in (i) the visual oddball and (ii) auditory oddball paradigms, eliciting single-modal MMN; (iii) congruent audio-visual deviants, (iv) incongruent visual deviants, and (v) incongruent auditory deviants in the audio-visual oddball paradigm, eliciting cross-modal MMN. First, we demonstrated that visual MMN exhibited deviance detection properties and that the first-generation focus of visual MMN was localized in the visual cortex, as previously reported in human studies. Second, a comparison of MMN amplitudes revealed a non-linear relationship between single-modal and cross-modal MMNs. Moreover, congruent audio-visual MMN exhibited characteristics of both visual and auditory MMNs—its latency was similar to that of auditory MMN, whereas local blockage of N-methyl-D-aspartic acid receptors in the visual cortex diminished it as well as visual MMN. These results indicate that cross-modal information processing affects MMN without involving strong top-down effects, such as those of prior knowledge and attention. The present study is the first electrophysiological evidence of cross-modal MMN in animal models, and future studies on the neural mechanisms combining multisensory integration and deviance detection are expected to provide electrophysiological evidence to confirm the links between MMN and predictive coding theory.
Collapse
Affiliation(s)
| | - Kanato Mori
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Kotaro Ishizu
- Institute for Quantitative Biosciences, The University of Tokyo, Tokyo, Japan
| | - Hirokazu Takahashi
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| |
Collapse
|