1
|
Yang T, Kurkela JLO, Chen K, Liu Y, Shu H, Cong F, Hämäläinen JA, Astikainen P. Native language advantage in electrical brain responses to speech sound changes in passive and active listening condition. Neuropsychologia 2024; 201:108936. [PMID: 38851314 DOI: 10.1016/j.neuropsychologia.2024.108936] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Revised: 04/24/2024] [Accepted: 06/06/2024] [Indexed: 06/10/2024]
Abstract
It is not clear whether the brain can detect changes in native and non-native speech sounds in both unattended and attended conditions, but this information would be important to understand the nature of potential native language advantage in speech perception. We recorded event-related potentials (ERPs) for changes in duration and in Chinese lexical tone in a repeated vowel /a/ in native speakers of Finnish and Chinese in passive and active listening conditions. ERP amplitudes reflecting deviance detection (mismatch negativity; MMN and N2b) and attentional shifts towards changes in speech sounds (P3a and P3b) were investigated. In the passive listening condition, duration changes elicited increased amplitude in the MMN latency window for both standard and deviant sounds in the Finnish speakers compared to the Chinese speakers, but no group differences were observed for P3a. In passive listening to lexical tones, P3a was increased in amplitude for both standard and deviant stimuli in Chinese speakers compared to Finnish speakers, but the groups did not differ in MMN. In active listening, both tone and duration changes elicited N2b and P3b, but the groups differed only in pattern of results for the deviant type. The results thus suggest an overall increased sensitivity to native speech sounds, especially in passive listening, while the mechanisms of change detection and attentional shifting seem to work well for both native and non-native speech sounds in the attentive mode.
Collapse
Affiliation(s)
- Tiantian Yang
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland.
| | - Jari L O Kurkela
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland.
| | - Kecheng Chen
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| | - Youyi Liu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| | - Hua Shu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.
| | - Fengyu Cong
- Department of Mathematical Information Technology, University of Jyväskylä, Jyväskylä, Finland; Department of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian, China.
| | - Jarmo A Hämäläinen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland.
| | - Piia Astikainen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland.
| |
Collapse
|
2
|
Cosper SH, Männel C, Mueller JL. Auditory associative word learning in adults: The effects of musical experience and stimulus ordering. Brain Cogn 2024; 180:106207. [PMID: 39053199 DOI: 10.1016/j.bandc.2024.106207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 06/18/2024] [Accepted: 07/16/2024] [Indexed: 07/27/2024]
Abstract
Evidence for sequential associative word learning in the auditory domain has been identified in infants, while adults have shown difficulties. To better understand which factors may facilitate adult auditory associative word learning, we assessed the role of auditory expertise as a learner-related property and stimulus order as a stimulus-related manipulation in the association of auditory objects and novel labels. We tested in the first experiment auditorily-trained musicians versus athletes (high-level control group) and in the second experiment stimulus ordering, contrasting object-label versus label-object presentation. Learning was evaluated from Event-Related Potentials (ERPs) during training and subsequent testing phases using a cluster-based permutation approach, as well as accuracy-judgement responses during test. Results revealed for musicians a late positive component in the ERP during testing, but neither an N400 (400-800 ms) nor behavioral effects were found at test, while athletes did not show any effect of learning. Moreover, the object-label-ordering group only exhibited emerging association effects during training, while the label-object-ordering group showed a trend-level late ERP effect (800-1200 ms) during test as well as above chance accuracy-judgement scores. Thus, our results suggest the learner-related property of auditory expertise and stimulus-related manipulation of stimulus ordering modulate auditory associative word learning in adults.
Collapse
Affiliation(s)
- Samuel H Cosper
- Chair of Lifespan Developmental Neuroscience, Faculty of Psychology, Technische Universität Dresden, Dresden, Germany.
| | - Claudia Männel
- Department of Audiology and Phoniatrics, Charité-Universitätsmedizin Berlin, Berlin, Germany; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Jutta L Mueller
- Department of Linguistics, University of Vienna, Vienna, Austria
| |
Collapse
|
3
|
Alho K, Escera C, Kujala T, Schröger E, Tervaniemi M, Winkler I, Yabe H. Risto Näätänen (1939-2023). Psychophysiology 2024; 61:e14504. [PMID: 38108528 DOI: 10.1111/psyp.14504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 12/07/2023] [Indexed: 12/19/2023]
Affiliation(s)
- Kimmo Alho
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
| | - Carles Escera
- Department of Clinical Psychology and Psychobiology, University of Barcelona, Barcelona, Spain
- Institute of Neurosciences, University of Barcelona, Barcelona, Spain
- Institut de Recerca Sant Joan de Déu (IRSJD), Barcelona, Spain
| | - Teija Kujala
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
- Cognitive Brain Research Unit, University of Helsinki, Helsinki, Finland
| | - Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Mari Tervaniemi
- Cognitive Brain Research Unit, University of Helsinki, Helsinki, Finland
- Department of Education, University of Helsinki, Helsinki, Finland
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
| | - Hirooki Yabe
- Department of Mind & Brain Medicine, Fukushima Medical University (FMU), Fukushima, Japan
| |
Collapse
|
4
|
Wagner-Altendorf TA, Rein M, Skeries VM, Cirkel A, Münte TF, Heldmann M. Tracking the habituation of the event-related EEG potential in automatic change detection using an auditory two-tone oddball paradigm. Cereb Cortex 2024; 34:bhae157. [PMID: 38615240 DOI: 10.1093/cercor/bhae157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 03/21/2024] [Accepted: 03/28/2024] [Indexed: 04/15/2024] Open
Abstract
The mismatch negativity and the P3a of the event-related EEG potential reflect the electrocortical response to a deviant stimulus in a series of stimuli. Although both components have been investigated in various paradigms, these paradigms usually incorporate many repetitions of the same deviant, thus leaving open whether both components vary as a function of the deviant's position in a series of deviant stimuli-i.e. whether they are subject to qualitative/quantitative habituation from one instantiation of a deviant to the next. This is so because the detection of mismatch negativity/P3a in the event-related EEG potential requires an averaging over dozens or hundreds of stimuli, i.e. over many instantiations of the deviant per participant. The present study addresses this research gap. We used a two-tone oddball paradigm implementing only a small number of (deviant) stimuli per participant, but applying it to a large number of participants (n > 230). Our data show that the mismatch negativity amplitude exhibits no decrease as a function of the deviant's position in a series of (standard and) deviant stimuli. Importantly, only after the very first deviant stimulus, a distinct P3a could be detected, indicative of an orienting reaction and an attention shift, and thus documenting a dissociation of mismatch negativity and P3a.
Collapse
Affiliation(s)
| | - Marlitt Rein
- Department of Neurology, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Valentina M Skeries
- Department of Neurology, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Anna Cirkel
- Department of Neurology, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Thomas F Münte
- Department of Neurology, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| | - Marcus Heldmann
- Department of Neurology, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
- Center of Brain, Behavior and Metabolism, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany
| |
Collapse
|
5
|
López-Caballero F, Auksztulewicz R, Howard Z, Rosch RE, Todd J, Salisbury DF. Computational Synaptic Modeling of Pitch and Duration Mismatch Negativity in First-Episode Psychosis Reveals Selective Dysfunction of the N-Methyl-D-Aspartate Receptor. Clin EEG Neurosci 2024:15500594241238294. [PMID: 38533562 DOI: 10.1177/15500594241238294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/28/2024]
Abstract
Mismatch negativity (MMN) to pitch (pMMN) and to duration (dMMN) deviant stimuli is significantly more attenuated in long-term psychotic illness compared to first-episode psychosis (FEP). It was recently shown that source-modeling of magnetically recorded MMN increases the detection of left auditory cortex MMN deficits in FEP, and that computational circuit modeling of electrically recorded MMN also reveals left-hemisphere auditory cortex abnormalities. Computational modeling using dynamic causal modeling (DCM) can also be used to infer synaptic activity from EEG-based scalp recordings. We measured pMMN and dMMN with EEG from 26 FEP and 26 matched healthy controls (HCs) and used a DCM conductance-based neural mass model including α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid, N-methyl-D-Aspartate (NMDA), and Gamma-aminobutyric acid receptors to identify any changes in effective connectivity and receptor rate constants in FEP. We modeled MMN sources in bilateral A1, superior temporal gyrus, and inferior frontal gyrus (IFG). No model parameters distinguished groups for pMMN. For dMMN, reduced NMDA receptor activity in right IFG in FEP was detected. This finding is in line with literature of prefrontal NMDA receptor hypofunction in chronic schizophrenia and suggests impaired NMDA-induced synaptic plasticity may be present at psychosis onset where scalp dMMN is only moderately reduced. To the best of our knowledge, this is the first report of impaired NMDA receptor activity in FEP found through computational modeling of dMMN and shows the potential of DCM to non-invasively reveal synaptic-level abnormalities that underly subtle functional auditory processing deficits in early psychosis.
Collapse
Affiliation(s)
- F López-Caballero
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - R Auksztulewicz
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| | - Z Howard
- School of Psychological Science, University of Western Australia, Perth, Australia
| | - R E Rosch
- Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, London, UK
| | - J Todd
- School of Psychological Sciences, University of Newcastle, Callaghan, Australia
| | - D F Salisbury
- Clinical Neurophysiology Research Laboratory, Western Psychiatric Hospital, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| |
Collapse
|
6
|
Csépe V, Honbolygó F. From psychophysiology to brain imaging: forty-five years MMN history of investigating acoustic change sensitivity. Biol Futur 2024; 75:117-128. [PMID: 38607546 DOI: 10.1007/s42977-024-00216-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Accepted: 03/18/2024] [Indexed: 04/13/2024]
Abstract
Forty-five years have passed since the first publication of the mismatch negativity (MMN) event-related brain potential (ERP) component. The first 10 years of research hardly gained any particular attention of the scientific community interested in acoustic perception. Debates on the nature of sensation versus perception were going on, and the technical possibilities to record ERPs, called in general evoked potentials, were very limited. Subtle changes in pure tone frequency or intensity giving rise to the MMN component were first investigated in humans. The background of the theoretical model developed by Risto Näätänen was the orientation reaction model of E.N. Sokolov published in 1963 so that the MMN was seen first as an electrophysiological correlate of auditory change detection. This fundamental ability of the auditory system seen as crucial for survival led to the development of the first animal model of the MMN (Csépe et al. in Clin Neurophysiol 66: 571-578, 1987). Indeed, it was confirmed that the MMN was the brain correlate of subtle changes detected that might alert to potential threats in the environment and direct the behavioral orientation. The investigations performed after 2000 introduced complex models and more sophisticated methods, both in animal and human studies, so that the MMN method was on the way to become a tool on the first place and not the main goal of research. This approach was further strengthened by the increasing number of studies on different clinical populations aiming at future applications. The aim of our review is to describe and redefine what the MMN may reflect in auditory perception and to show why and how this brain correlate of changes in the auditory scene can be used as a valuable tool in cognitive neuroscience research. We refer to publications selected to underly the argument the MMN cannot be classified anymore as a sign of simple change detection and not all the indicators used to confirm how genuine the MMN elicited by variations of tones are valid for those to speech contrasts. We provide a fresh view on the broadly used MMN models, provided by some influential publications as well as on the unwritten history of MMN research aiming to give revised picture on what the MMN may truly reflect. We show how the focus and terminology of the MMN research have changed and what kind of misunderstandings and seemingly contradictive results prevent the MMN community to accept a generally usable cognitive model.
Collapse
Affiliation(s)
- Valéria Csépe
- Brain Imaging Centre, HUN-REN Research Centre of Natural Sciences, Magyar Tudósok Krt. 2, Budapest, 1117, Hungary.
- University of Pannonia, Veszprém, Hungary.
| | - Ferenc Honbolygó
- Brain Imaging Centre, HUN-REN Research Centre of Natural Sciences, Magyar Tudósok Krt. 2, Budapest, 1117, Hungary
- Eötvös Loránd University, Budapest, Hungary
| |
Collapse
|
7
|
White PA. The perceptual timescape: Perceptual history on the sub-second scale. Cogn Psychol 2024; 149:101643. [PMID: 38452720 DOI: 10.1016/j.cogpsych.2024.101643] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 02/27/2024] [Accepted: 02/28/2024] [Indexed: 03/09/2024]
Abstract
There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.
Collapse
Affiliation(s)
- Peter A White
- School of Psychology, Cardiff University, Tower Building, Park Place, Cardiff, Wales CF10 3YG, United Kingdom.
| |
Collapse
|
8
|
Honbolygó F, Zulauf B, Zavogianni MI, Csépe V. Investigating the neurocognitive background of speech perception with a fast multi-feature MMN paradigm. Biol Futur 2024; 75:145-158. [PMID: 38805154 DOI: 10.1007/s42977-024-00219-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 04/11/2024] [Indexed: 05/29/2024]
Abstract
The speech multi-feature MMN (Mismatch Negativity) offers a means to explore the neurocognitive background of the processing of multiple speech features in a short time, by capturing the time-locked electrophysiological activity of the brain known as event-related brain potentials (ERPs). Originating from Näätänen et al. (Clin Neurophysiol 115:140-144, 2004) pioneering work, this paradigm introduces several infrequent deviant stimuli alongside standard ones, each differing in various speech features. In this study, we aimed to refine the multi-feature MMN paradigm used previously to encompass both segmental and suprasegmental (prosodic) features of speech. In the experiment, a two-syllable long pseudoword was presented as a standard, and the deviant stimuli included alterations in consonants (deviation by place or place and mode of articulation), vowels (deviation by place or mode of articulation), and stress pattern in the first syllable of the pseudoword. Results indicated the emergence of MMN components across all segmental and prosodic contrasts, with the expected fronto-central amplitude distribution. Subsequent analyses revealed subtle differences in MMN responses to the deviants, suggesting varying sensitivity to phonetic contrasts. Furthermore, individual differences in MMN amplitudes were noted, partially attributable to participants' musical and language backgrounds. These findings underscore the utility of the multi-feature MMN paradigm for rapid and efficient investigation of the neurocognitive mechanisms underlying speech processing. Moreover, the paradigm demonstrated the potential to be used in further research to study the speech processing abilities in various populations.
Collapse
Affiliation(s)
- Ferenc Honbolygó
- HUN-REN Research Centre for Natural Sciences, Budapest, Hungary.
- Institute of Psychology, Eötvös Loránd University, Budapest, Hungary.
| | - Borbála Zulauf
- Institute of Psychology, Eötvös Loránd University, Budapest, Hungary
| | - Maria Ioanna Zavogianni
- HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Modern Philology and Social Sciences, Multilingualism Doctoral School, University of Pannonia, Veszprém, Hungary
| | - Valéria Csépe
- HUN-REN Research Centre for Natural Sciences, Budapest, Hungary
- University of Pannonia, Veszprém, Hungary
| |
Collapse
|
9
|
Zora H, Wester J, Csépe V. Predictions about prosody facilitate lexical access: Evidence from P50/N100 and MMN components. Int J Psychophysiol 2023; 194:112262. [PMID: 37924955 DOI: 10.1016/j.ijpsycho.2023.112262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 08/23/2023] [Accepted: 10/28/2023] [Indexed: 11/06/2023]
Abstract
Research into the neural foundation of perception asserts a model where top-down predictions modulate the bottom-up processing of sensory input. Despite becoming increasingly influential in cognitive neuroscience, the precise account of this predictive coding framework remains debated. In this study, we aim to contribute to this debate by investigating how predictions about prosody facilitate speech perception, and to shed light especially on lexical access influenced by simultaneous predictions in different domains, inter alia, prosodic and semantic. Using a passive auditory oddball paradigm, we examined neural responses to prosodic changes, leading to a semantic change as in Dutch nouns canon ['kaːnɔn] 'canon' vs kanon [kaː'nɔn] 'cannon', and used acoustically identical pseudowords as controls. Results from twenty-eight native speakers of Dutch (age range 18-32 years) indicated an enhanced P50/N100 complex to prosodic change in pseudowords as well as an MMN response to both words and pseudowords. The enhanced P50/N100 response to pseudowords is claimed to indicate that all relevant auditory information is still processed by the brain, whereas the reduced response to words might reflect the suppression of information that has already been encoded. The MMN response to pseudowords and words, on the other hand, is best justified by the unification of previously established prosodic representations with sensory and semantic input respectively. This pattern of results is in line with the predictive coding framework acting on multiple levels and is of crucial importance to indicate that predictions about linguistic prosodic information are utilized by the brain as early as 50 ms.
Collapse
Affiliation(s)
- Hatice Zora
- Max Planck Institute for Psycholinguistics, P.O. Box 310 6500, AH, Nijmegen, the Netherlands.
| | - Janniek Wester
- Max Planck Institute for Psycholinguistics, P.O. Box 310 6500, AH, Nijmegen, the Netherlands
| | - Valéria Csépe
- HUN-REN Research Centre of Natural Sciences, Brain Imaging Centre, P.O. Box 286 1519, Budapest, Hungary
| |
Collapse
|
10
|
Coy N, Bendixen A, Grimm S, Roeber U, Schröger E. Deviants violating higher-order auditory regularities can become predictive and facilitate behaviour. Atten Percept Psychophys 2023; 85:2731-2750. [PMID: 37532882 PMCID: PMC10600044 DOI: 10.3758/s13414-023-02763-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/07/2023] [Indexed: 08/04/2023]
Abstract
The human auditory system is believed to represent regularities inherent in auditory information in internal models. Sounds not matching the standard regularity (deviants) elicit prediction error, alerting the system to information not explainable within currently active models. Here, we examine the widely neglected characteristic of deviants bearing predictive information themselves. In a modified version of the oddball paradigm, using higher-order regularities, we set up different expectations regarding the sound following a deviant. Higher-order regularities were defined by the relation of pitch within tone pairs (rather than absolute pitch of individual tones). In a deviant detection task participants listened to oddball sequences including two deviant types following diametrically opposed rules: one occurred mostly in succession (high repetition probability) and the other mostly in isolation (low repetition probability). Participants in Experiment 1 were not informed (naïve), whereas in Experiment 2 they were made aware of the repetition rules. Response times significantly decreased from first to second deviant when repetition probability was high-albeit more in the presence of explicit rule knowledge. There was no evidence of a facilitation effect when repetition probability was low. Significantly more false alarms occurred in response to standards following high compared with low repetition probability deviants, but only in participants aware of the repetition rules. These findings provide evidence that not only deviants violating lower- but also higher-order regularities can inform predictions about auditory events. More generally, they confirm the utility of this new paradigm to gather further insights into the predictive properties of the human brain.
Collapse
Affiliation(s)
- Nina Coy
- Wilhelm-Wundt-Institute of Psychology, University of Leipzig, Leipzig, Germany.
- Max Planck School of Cognition, Leipzig, Germany.
| | - Alexandra Bendixen
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Sabine Grimm
- Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
- Physics of Cognition Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Urte Roeber
- Wilhelm-Wundt-Institute of Psychology, University of Leipzig, Leipzig, Germany
| | - Erich Schröger
- Wilhelm-Wundt-Institute of Psychology, University of Leipzig, Leipzig, Germany
- Max Planck School of Cognition, Leipzig, Germany
| |
Collapse
|
11
|
Tóth B, Velősy PK, Kovács P, Háden GP, Polver S, Sziller I, Winkler I. Auditory learning of recurrent tone sequences is present in the newborn's brain. Neuroimage 2023; 281:120384. [PMID: 37739198 DOI: 10.1016/j.neuroimage.2023.120384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 08/13/2023] [Accepted: 09/19/2023] [Indexed: 09/24/2023] Open
Abstract
The seemingly effortless ability of our auditory system to rapidly detect new events in a dynamic environment is crucial for survival. Whether the underlying brain processes are innate is unknown. To answer this question, electroencephalography was recorded while regularly patterned (REG) versus random (RAND) tone sequences were presented to sleeping neonates. Regular relative to random sequences elicited differential neural responses after only a single repetition of the pattern indicating the existence of an innate capacity of the auditory system to detect auditory sequential regularities. We show that the newborn auditory system accumulates evidence only somewhat longer than the minimum amount determined by the ideal Bayesian observer model (the prediction from a variable-order Markov chain model) before detecting a repeating pattern. Thus, newborns can quickly form representations for regular features of the sound input, preparing the way for learning the contingencies of the environment.
Collapse
Affiliation(s)
- Brigitta Tóth
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary.
| | - Péter Kristóf Velősy
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary; Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary
| | - Petra Kovács
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary; Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary
| | - Gábor Peter Háden
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary; Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Silvia Polver
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| | - Istvan Sziller
- Division of Obstetrics and Gynecology, DBC - Szent Imre University Teaching Hospital, Budapest, Hungary
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
12
|
Schröger E, Roeber U, Coy N. Markov chains as a proxy for the predictive memory representations underlying mismatch negativity. Front Hum Neurosci 2023; 17:1249413. [PMID: 37771348 PMCID: PMC10525344 DOI: 10.3389/fnhum.2023.1249413] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Accepted: 08/22/2023] [Indexed: 09/30/2023] Open
Abstract
Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.
Collapse
Affiliation(s)
- Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Urte Roeber
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Nina Coy
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
- Max Planck School of Cognition, Leipzig, Germany
| |
Collapse
|
13
|
Kujala T, Partanen E, Virtala P, Winkler I. Prerequisites of language acquisition in the newborn brain. Trends Neurosci 2023; 46:726-737. [PMID: 37344237 DOI: 10.1016/j.tins.2023.05.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 04/13/2023] [Accepted: 05/24/2023] [Indexed: 06/23/2023]
Abstract
Learning to decode and produce speech is one of the most demanding tasks faced by infants. Nevertheless, infants typically utter their first words within a year, and phrases soon follow. Here we review cognitive abilities of newborn infants that promote language acquisition, focusing primarily on studies tapping neural activity. The results of these studies indicate that infants possess core adult auditory abilities already at birth, including statistical learning and rule extraction from variable speech input. Thus, the neonatal brain is ready to categorize sounds, detect word boundaries, learn words, and separate speech streams: in short, to acquire language quickly and efficiently from everyday linguistic input.
Collapse
Affiliation(s)
- Teija Kujala
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland.
| | - Eino Partanen
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - Paula Virtala
- Cognitive Brain Research Unit, Centre of Excellence in Music, Mind, Body and Brain, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Finland
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
14
|
Todd J, Salisbury D, Michie PT. Why mismatch negativity continues to hold potential in probing altered brain function in schizophrenia. PCN REPORTS : PSYCHIATRY AND CLINICAL NEUROSCIENCES 2023; 2:e144. [PMID: 38867817 PMCID: PMC11114358 DOI: 10.1002/pcn5.144] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 08/21/2023] [Accepted: 08/30/2023] [Indexed: 06/14/2024]
Abstract
The brain potential known as mismatch negativity (MMN) is one of the most studied indices of altered brain function in schizophrenia. This review looks at what has been learned about MMN in schizophrenia over the last three decades and why the level of interest and activity in this field of research remains strong. A diligent consideration of available evidence suggests that MMN can serve as a biomarker in schizophrenia, but perhaps not the kind of biomarker that early research supposed. This review concludes that MMN measurement is likely to be most useful as a monitoring and response biomarker enabling tracking of an underlying pathology and efficacy of interventions, respectively. The role of, and challenges presented by, pre-clinical models is discussed as well as the merits of different methodologies that can be brought to bear in pursuing a deeper understanding of pathophysiology that might explain smaller MMN in schizophrenia.
Collapse
Affiliation(s)
- Juanita Todd
- School of Psychological SciencesUniversity of NewcastleNewcastleNew South WalesAustralia
| | - Dean Salisbury
- Department of PsychiatryUniversity of Pittsburgh School of MedicinePittsburghPennsylvaniaUSA
| | - Patricia T. Michie
- School of Psychological SciencesUniversity of NewcastleNewcastleNew South WalesAustralia
| |
Collapse
|
15
|
Grifoni J, Pagani M, Persichilli G, Bertoli M, Bevacqua MG, L'Abbate T, Flamini I, Brancucci A, Cerniglia L, Paulon L, Tecchio F. Auditory Personalization of EMDR Treatment to Relieve Trauma Effects: A Feasibility Study [EMDR+]. Brain Sci 2023; 13:1050. [PMID: 37508982 PMCID: PMC10377614 DOI: 10.3390/brainsci13071050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 07/02/2023] [Accepted: 07/04/2023] [Indexed: 07/30/2023] Open
Abstract
According to the WHO (World Health Organization), Eye Movement Desensitization and Reprocessing (EMDR) is an elective therapy to treat people with post-traumatic stress disorders (PTSD). In line with the personalization of therapeutic strategies, through this pilot study, we assessed in people suffering from the effects of trauma the feasibility, safety, acceptance, and efficacy of EMDR enriched with sound stimulation (by administering neutral sounds synchronized with the guided bilateral alternating stimulation of the gaze) and musical reward (musical listening based on the patients' predisposition and personal tastes). Feasibility, quantified by the number of patients who completed the treatment, was excellent as this was the case in 12 out of the 12 enrolled people with psychological trauma. Safety and acceptance, assessed by self-compiled questionnaires, were excellent, with an absence of side effects and high satisfaction. Efficacy, quantified by the number of EMDR treatment sessions required to reach the optimal scores on the Subjective Units of Disturbance (SUD) and Validity of Cognition (VOC) scales typical of EMDR protocols, revealed an average duration of 8.5 (SD 1.2) sessions, which is well below the 12 sessions considered a standard EMDR treatment duration. EMDR+ appears to be a relevant personalization of EMDR, particularly in music-sensitive people, consolidating the therapeutic alliance through a multisensory communicative bond for trauma treatment.
Collapse
Affiliation(s)
- Joy Grifoni
- International Telematic University Uninettuno, 00186 Rome, Italy
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| | - Marco Pagani
- International Telematic University Uninettuno, 00186 Rome, Italy
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| | - Giada Persichilli
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| | - Massimo Bertoli
- International Telematic University Uninettuno, 00186 Rome, Italy
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| | | | - Teresa L'Abbate
- International Telematic University Uninettuno, 00186 Rome, Italy
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| | | | - Alfredo Brancucci
- Dipartimento di Scienze Motorie, Umane e della Salute, Università di Roma 'Foro Italico', 00135 Rome, Italy
| | - Luca Cerniglia
- International Telematic University Uninettuno, 00186 Rome, Italy
| | - Luca Paulon
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
- Luca Paulon, Engineer Freelance, 00159 Rome, Italy
| | - Franca Tecchio
- LET'S and LABSS, Institute of Cognitive Sciences and Technologies ISTC, Consiglio Nazionale delle Ricerche CNR, 00185 Rome, Italy
| |
Collapse
|
16
|
Bonmassar C, Scharf F, Widmann A, Wetzel N. On the relationship of arousal and attentional distraction by emotional novel sounds. Cognition 2023; 237:105470. [PMID: 37150156 DOI: 10.1016/j.cognition.2023.105470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2022] [Revised: 04/23/2023] [Accepted: 04/24/2023] [Indexed: 05/09/2023]
Abstract
Unexpected and task-irrelevant sounds can impair performance in a task. It has been shown that highly arousing emotional distractor sounds impaired performance less compared to moderately arousing neutral distractor sounds. The present study tests whether these differential emotion-related distraction effects are directly related to an enhancement of arousal evoked by processing of emotional distractor sounds. We disentangled costs of orienting of attention and benefits of increased arousal levels during the presentation of highly arousing emotional and moderately arousing neutral novel sounds that were embedded in a sequence of repeated standard sounds. We used sound-related pupil dilation responses as a marker of arousal and RTs as a marker of distraction in a visual categorization task in 57 healthy young adults. Multilevel analyses revealed increased RT and increased pupil dilation in response to novel vs. standard sounds. Emotional novel sounds reduced distraction effects on the behavioral level and increased pupil dilation responses compared to neutral novel sounds. Bayes Factors revealed strong evidence against an inverse proportional relationship between behavioral distraction effects and sound-related pupil dilation responses for emotional sounds. Given that the activity of the locus coeruleus has been linked to both changes in pupil diameter and arousal, it may embody an indirect relationship as a common antecedent by the release of norepinephrine into brain networks involved in attention control and control of the pupil. The present study provides new insights into the relation of changes in arousal and attentional distraction during the processing of emotional task-irrelevant novel sounds.
Collapse
Affiliation(s)
| | | | - Andreas Widmann
- Leibniz Institute for Neurobiology, Magdeburg, Germany; Leipzig University, Germany
| | - Nicole Wetzel
- Leibniz Institute for Neurobiology, Magdeburg, Germany; Center for Behavioral Brain Sciences Magdeburg, Germany; University of Applied Sciences Magdeburg-, Stendal, Germany
| |
Collapse
|
17
|
Weise A, Grimm S, Maria Rimmele J, Schröger E. Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations. BRAIN AND LANGUAGE 2023; 237:105221. [PMID: 36623340 DOI: 10.1016/j.bandl.2022.105221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Revised: 12/26/2022] [Accepted: 12/27/2022] [Indexed: 06/17/2023]
Abstract
The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.
Collapse
Affiliation(s)
- Annekathrin Weise
- Department of Psychology, Ludwig-Maximilians-University Munich, Germany; Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| | - Sabine Grimm
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| | - Johanna Maria Rimmele
- Department of Neuroscience, Max-Planck-Institute for Empirical Aesthetics, Germany; Center for Language, Music and Emotion, New York University, Max Planck Institute, Department of Psychology, 6 Washington Place, New York, NY 10003, United States.
| | - Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| |
Collapse
|
18
|
Widmann A, Schröger E. Intention-based predictive information modulates auditory deviance processing. Front Neurosci 2022; 16:995119. [PMID: 36248631 PMCID: PMC9554204 DOI: 10.3389/fnins.2022.995119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Accepted: 09/08/2022] [Indexed: 11/26/2022] Open
Abstract
The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.
Collapse
Affiliation(s)
- Andreas Widmann
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
- Leibniz Institute for Neurobiology, Magdeburg, Germany
- *Correspondence: Andreas Widmann,
| | - Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
- Erich Schröger,
| |
Collapse
|
19
|
Eckert D, Reichert C, Bien CG, Heinze HJ, Knight RT, Deouell LY, Dürschmid S. Distinct interacting cortical networks for stimulus-response and repetition-suppression. Commun Biol 2022; 5:909. [PMID: 36064744 PMCID: PMC9445181 DOI: 10.1038/s42003-022-03861-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 08/19/2022] [Indexed: 11/29/2022] Open
Abstract
Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.
Collapse
Affiliation(s)
- David Eckert
- Department of Neurology, Otto-von-Guericke University of Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany
| | - Christoph Reichert
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany
| | - Christian G Bien
- Department. of Epileptology, Krankenhaus Mara, Bielefeld University, Maraweg 21, 33617, Bielefeld, Germany
| | - Hans-Jochen Heinze
- Department of Neurology, Otto-von-Guericke University of Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany
- Forschungscampus STIMULATE, Otto-von-Guericke University of Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany
- CBBS - center of behavioral brain sciences, Otto-von-Guericke University of Magdeburg, Universitätsplatz 2, 39106, Magdeburg, Germany
- German Center for Neurodegenerative Diseases (DZNE), Leipziger Str. 44, 39120, Magdeburg, Germany
| | - Robert T Knight
- Department of Psychology, University of California Berkeley, 130 Barker Hall, Berkeley, 94720, CA, USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, 94720, CA, USA
| | - Leon Y Deouell
- Department of Psychology and Edmond and Lily Safra Center for brain sciences, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Stefan Dürschmid
- Department of Neurology, Otto-von-Guericke University of Magdeburg, Leipziger Str. 44, 39120, Magdeburg, Germany.
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, 39120, Magdeburg, Germany.
| |
Collapse
|
20
|
Suppanen E, Winkler I, Kujala T, Ylinen S. More efficient formation of longer-term representations for word forms at birth can be linked to better language skills at 2 years. Dev Cogn Neurosci 2022; 55:101113. [PMID: 35605476 PMCID: PMC9130088 DOI: 10.1016/j.dcn.2022.101113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Revised: 04/03/2022] [Accepted: 05/09/2022] [Indexed: 11/15/2022] Open
Abstract
Infants are able to extract words from speech early in life. Here we show that the quality of forming longer-term representations for word forms at birth predicts expressive language ability at the age of two years. Seventy-five neonates were familiarized with two spoken disyllabic pseudowords. We then tested whether the neonate brain predicts the second syllable from the first one by presenting a familiarized pseudoword frequently, and occasionally violating the learned syllable combination by different rare pseudowords. Distinct brain responses were elicited by predicted and unpredicted word endings, suggesting that the neonates had learned the familiarized pseudowords. The difference between responses to predicted and unpredicted pseudowords indexing the quality of word-form learning during familiarization significantly correlated with expressive language scores (the mean length of utterance) at 24 months in the same infant. These findings suggest that 1) neonates can memorize disyllabic words so that a learned first syllable generates predictions for the word ending, and 2) early individual differences in the quality of word-form learning correlate with language skills. This relationship helps early identification of infants at risk for language impairment.
Collapse
Affiliation(s)
- Emma Suppanen
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland.
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Hungary
| | - Teija Kujala
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Sari Ylinen
- Cognitive Brain Research Unit, Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland; Logopedics, Welfare Sciences, Faculty of Social Sciences, Tampere University, Finland
| |
Collapse
|
21
|
Neubert CR, Förstel AP, Debener S, Bendixen A. Predictability-Based Source Segregation and Sensory Deviance Detection in Auditory Aging. Front Hum Neurosci 2021; 15:734231. [PMID: 34776906 PMCID: PMC8586071 DOI: 10.3389/fnhum.2021.734231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Accepted: 10/08/2021] [Indexed: 11/30/2022] Open
Abstract
When multiple sound sources are present at the same time, auditory perception is often challenged with disentangling the resulting mixture and focusing attention on the target source. It has been repeatedly demonstrated that background (distractor) sound sources are easier to ignore when their spectrotemporal signature is predictable. Prior evidence suggests that this ability to exploit predictability for foreground-background segregation degrades with age. On a theoretical level, this has been related with an impairment in elderly adults’ capabilities to detect certain types of sensory deviance in unattended sound sequences. Yet the link between those two capacities, deviance detection and predictability-based sound source segregation, has not been empirically demonstrated. Here we report on a combined behavioral-EEG study investigating the ability of elderly listeners (60–75 years of age) to use predictability as a cue for sound source segregation, as well as their sensory deviance detection capacities. Listeners performed a detection task on a target stream that can only be solved when a concurrent distractor stream is successfully ignored. We contrast two conditions whose distractor streams differ in their predictability. The ability to benefit from predictability was operationalized as performance difference between the two conditions. Results show that elderly listeners can use predictability for sound source segregation at group level, yet with a high degree of inter-individual variation in this ability. In a further, passive-listening control condition, we measured correlates of deviance detection in the event-related brain potential (ERP) elicited by occasional deviations from the same spectrotemporal pattern as used for the predictable distractor sequence during the behavioral task. ERP results confirmed neural signatures of deviance detection in terms of mismatch negativity (MMN) at group level. Correlation analyses at single-subject level provide no evidence for the hypothesis that deviance detection ability (measured by MMN amplitude) is related to the ability to benefit from predictability for sound source segregation. These results are discussed in the frameworks of sensory deviance detection and predictive coding.
Collapse
Affiliation(s)
- Christiane R Neubert
- Cognitive Systems Lab, Faculty of Natural Sciences, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Alexander P Förstel
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Alexandra Bendixen
- Cognitive Systems Lab, Faculty of Natural Sciences, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
22
|
Mishra AP, Peng F, Li K, Harper NS, Schnupp JWH. Sensitivity of neural responses in the inferior colliculus to statistical features of sound textures. Hear Res 2021; 412:108357. [PMID: 34739889 DOI: 10.1016/j.heares.2021.108357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 09/04/2021] [Accepted: 09/21/2021] [Indexed: 11/16/2022]
Abstract
Previous psychophysical studies have identified a hierarchy of time-averaged statistics which determine the identity of natural sound textures. However, it is unclear whether the neurons in the inferior colliculus (IC) are sensitive to each of these statistical features in the natural sound textures. We used 13 representative sound textures spanning the space of 3 statistics extracted from over 200 natural textures. The synthetic textures were generated by incorporating the statistical features in a step-by-step manner, in which a particular statistical feature was changed while the other statistical features remain unchanged. The extracellular activity in response to the synthetic texture stimuli was recorded in the IC of anesthetized rats. Analysis of the transient and sustained multiunit activity after each transition of statistical feature showed that the IC units were sensitive to the changes of all types of statistics, although to a varying extent. For example, we found that more neurons were sensitive to the changes in variance than that in the modulation correlations. Our results suggest that the sensitivity of the statistical features in the subcortical levels contributes to the identification and discrimination of natural sound textures.
Collapse
Affiliation(s)
- Ambika P Mishra
- Department of Neuroscience, City University of Hong Kong, Hong Kong SAR.
| | - Fei Peng
- Department of Neuroscience, City University of Hong Kong, Hong Kong SAR.
| | - Kongyan Li
- Department of Neuroscience, City University of Hong Kong, Hong Kong SAR
| | - Nicol S Harper
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, UK.
| | - Jan W H Schnupp
- Department of Neuroscience, City University of Hong Kong, Hong Kong SAR.
| |
Collapse
|
23
|
Todd J, Yeark MD, Paton B, Jermyn A, Winkler I. Shorter Contextual Timescale Rather Than Memory Deficit in Aging. Cereb Cortex 2021; 32:2412-2423. [PMID: 34564713 DOI: 10.1093/cercor/bhab344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 08/23/2021] [Accepted: 08/25/2021] [Indexed: 11/14/2022] Open
Abstract
Many aspects of cognitive ability and brain function that change as we age look like deficits on account of measurable differences in comparison to younger adult groups. One such difference occurs in auditory sensory responses that index perceptual learning. Meta-analytic findings show reliable age-related differences in auditory responses to repetitive patterns of sound and to rare violations of those patterns, variously attributed to deficits in auditory sensory memory and inhibition. Here, we determine whether proposed deficits would render older adults less prone to primacy effects, robustly observed in young adults, which present as a tendency for first learning to have a disproportionate influence over later perceptual inference. The results confirm this reduced sensitivity to primacy effects but do not support impairment in auditory sensory memory as the origin of this difference. Instead, the aging brain produces data consistent with shorter timescales of contextual reference. In conclusion, age-related differences observed previously for perceptual inference appear highly context-specific necessitating reconsideration of whether and to what function the notion of deficit should be attributed, and even whether the notion of deficit is appropriate at all.
Collapse
Affiliation(s)
- Juanita Todd
- School of Psychology, University of Newcastle, University Drive, Callaghan, NSW 2308, USA
| | - Mattsen D Yeark
- School of Psychology, University of Newcastle, University Drive, Callaghan, NSW 2308, USA
| | - Bryan Paton
- School of Psychology, University of Newcastle, University Drive, Callaghan, NSW 2308, USA
| | - Alexandra Jermyn
- School of Psychology, University of Newcastle, University Drive, Callaghan, NSW 2308, USA
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest H-1117, Hungary
| |
Collapse
|
24
|
The auditory brain in action: Intention determines predictive processing in the auditory system-A review of current paradigms and findings. Psychon Bull Rev 2021; 29:321-342. [PMID: 34505988 PMCID: PMC9038838 DOI: 10.3758/s13423-021-01992-z] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/29/2021] [Indexed: 11/08/2022]
Abstract
According to the ideomotor theory, action may serve to produce desired sensory outcomes. Perception has been widely described in terms of sensory predictions arising due to top-down input from higher order cortical areas. Here, we demonstrate that the action intention results in reliable top-down predictions that modulate the auditory brain responses. We bring together several lines of research, including sensory attenuation, active oddball, and action-related omission studies: Together, the results suggest that the intention-based predictions modulate several steps in the sound processing hierarchy, from preattentive to evaluation-related processes, also when controlling for additional prediction sources (i.e., sound regularity). We propose an integrative theoretical framework—the extended auditory event representation system (AERS), a model compatible with the ideomotor theory, theory of event coding, and predictive coding. Initially introduced to describe regularity-based auditory predictions, we argue that the extended AERS explains the effects of action intention on auditory processing while additionally allowing studying the differences and commonalities between intention- and regularity-based predictions—we thus believe that this framework could guide future research on action and perception.
Collapse
|
25
|
Bader M, Schröger E, Grimm S. Auditory Pattern Representations Under Conditions of Uncertainty-An ERP Study. Front Hum Neurosci 2021; 15:682820. [PMID: 34305553 PMCID: PMC8299531 DOI: 10.3389/fnhum.2021.682820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Accepted: 06/11/2021] [Indexed: 11/13/2022] Open
Abstract
The auditory system is able to recognize auditory objects and is thought to form predictive models of them even though the acoustic information arriving at our ears is often imperfect, intermixed, or distorted. We investigated implicit regularity extraction for acoustically intact versus disrupted six-tone sound patterns via event-related potentials (ERPs). In an exact-repetition condition, identical patterns were repeated; in two distorted-repetition conditions, one randomly chosen segment in each sound pattern was replaced either by white noise or by a wrong pitch. In a roving-standard paradigm, sound patterns were repeated 1-12 times (standards) in a row before a new pattern (deviant) occurred. The participants were not informed about the roving rule and had to detect rarely occurring loudness changes. Behavioral detectability of pattern changes was assessed in a subsequent behavioral task. Pattern changes (standard vs. deviant) elicited mismatch negativity (MMN) and P3a, and were behaviorally detected above the chance level in all conditions, suggesting that the auditory system extracts regularities despite distortions in the acoustic input. However, MMN and P3a amplitude were decreased by distortions. At the level of MMN, both types of distortions caused similar impairments, suggesting that auditory regularity extraction is largely determined by the stimulus statistics of matching information. At the level of P3a, wrong-pitch distortions caused larger decreases than white-noise distortions. Wrong-pitch distortions likely prevented the engagement of restoration mechanisms and the segregation of disrupted from true pattern segments, causing stronger informational interference with the relevant pattern information.
Collapse
Affiliation(s)
- Maria Bader
- Cognitive and Biological Psychology, Institute of Psychology-Wilhelm Wundt, Faculty of Life Sciences, Leipzig University, Leipzig, Germany
| | - Erich Schröger
- Cognitive and Biological Psychology, Institute of Psychology-Wilhelm Wundt, Faculty of Life Sciences, Leipzig University, Leipzig, Germany
| | - Sabine Grimm
- Cognitive and Biological Psychology, Institute of Psychology-Wilhelm Wundt, Faculty of Life Sciences, Leipzig University, Leipzig, Germany
| |
Collapse
|
26
|
Jacobsen T, Bäß P, Roye A, Winkler I, Schröger E, Horváth J. Word class and word frequency in the MMN looking glass. BRAIN AND LANGUAGE 2021; 218:104964. [PMID: 33964668 DOI: 10.1016/j.bandl.2021.104964] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Revised: 03/15/2021] [Accepted: 04/20/2021] [Indexed: 06/12/2023]
Abstract
The effects of lexical meaning and lexical familiarity on auditory deviance detection were investigated by presenting oddball sequences of words, while participants ignored the stimuli. Stimulus sequences were composed of words that were varied in word class (nouns vs. functions words) and frequency of language use (high vs. low frequency) in a factorial design with the roles of frequently presented stimuli (Standards) and infrequently presented ones (Deviants) were fully crossed. Deviants elicited the Mismatch Negativity component of the event-related brain potential. Modulating effects of lexical meaning were obtained, revealing processing advantages for denotationally meaningful items. However, no effect of word frequency was observed. These results demonstrate that an apparently low-level function, such as auditory deviance detection utilizes information from the mental lexicon even for task-irrelevant stimuli.
Collapse
Affiliation(s)
- Thomas Jacobsen
- Experimental Psychology Unit, Helmut Schmidt University / University of the Federal Armed Forces Hamburg, Hamburg, Germany.
| | - Pamela Bäß
- Institute of Psychology, University of Hildesheim, Hildesheim, Germany
| | - Anja Roye
- Institute of Psychology, Leipzig University, Leipzig, Germany
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary
| | - Erich Schröger
- Institute of Psychology, Leipzig University, Leipzig, Germany
| | - János Horváth
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Budapest, Hungary; Institute of Psychology, Károli Gáspár University of the Reformed Church in Hungary, Budapest, Hungary
| |
Collapse
|
27
|
German B, Honbolygó F, Csépe V, Kóbor A. Working memory contributes to word stress processing in a fixed-stress language. JOURNAL OF COGNITIVE PSYCHOLOGY 2021. [DOI: 10.1080/20445911.2021.1898411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Borbála German
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary
| | - Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Modern Philology and Social Sciences, University of Pannonia, Veszprém, Hungary
| | - Andrea Kóbor
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
28
|
Skerritt-Davis B, Elhilali M. Computational framework for investigating predictive processing in auditory perception. J Neurosci Methods 2021; 360:109177. [PMID: 33839191 DOI: 10.1016/j.jneumeth.2021.109177] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Revised: 03/07/2021] [Accepted: 03/25/2021] [Indexed: 11/24/2022]
Abstract
BACKGROUND The brain tracks sound sources as they evolve in time, collecting contextual information to predict future sensory inputs. Previous work in predictive coding typically focuses on the perception of predictable stimuli, leaving the implementation of these same neural processes in more complex, real-world environments containing randomness and uncertainty up for debate. NEW METHOD To facilitate investigation into the perception of less tightly-controlled listening scenarios, we present a computational model as a tool to ask targeted questions about the underlying predictive processes that connect complex sensory inputs to listener behavior and neural responses. In the modeling framework, observed sound features (e.g. pitch) are tracked sequentially using Bayesian inference. Sufficient statistics are inferred from past observations at multiple time scales and used to make predictions about future observation while tracking the statistical structure of the sensory input. RESULTS Facets of the model are discussed in terms of their application to perceptual research, and examples taken from real-world audio demonstrate the model's flexibility to capture a variety of statistical structures along various perceptual dimensions. COMPARISON WITH EXISTING METHODS Previous models are often targeted toward interpreting a particular experimental paradigm (e.g., oddball paradigm), perceptual dimension (e.g., pitch processing), or task (e.g., speech segregation), thus limiting their ability to generalize to other domains. The presented model is designed as a flexible and practical tool for broad application. CONCLUSION The model is presented as a general framework for generating new hypotheses and guiding investigation into the neural processes underlying predictive coding of complex scenes.
Collapse
Affiliation(s)
| | - Mounya Elhilali
- Johns Hopkins University, 3400 N Charles St, Baltimore, MD, USA.
| |
Collapse
|
29
|
Distraction of attention by novel sounds in children declines fast. Sci Rep 2021; 11:5308. [PMID: 33674634 PMCID: PMC7935912 DOI: 10.1038/s41598-021-83528-y] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Accepted: 02/03/2021] [Indexed: 11/27/2022] Open
Abstract
New task-irrelevant sounds can distract attention. This study specifies the impact of stimulus novelty and of learning on attention control in three groups of children aged 6–7, 8, and 9–10 years and an adult control group. Participants (N = 179) were instructed to ignore a sound sequence including standard sounds and novel or repeated distractor sounds, while performing a visual categorization task. Distractor sounds impaired performance in children more than in adult controls, demonstrating the long-term development of attention control. Children, but not adults, were more distracted by novel than by repeated sounds, indicating increased sensitivity to novel information. Children, in particular younger children, were highly distracted during the first presentations of novel sounds compared to adults, while no age differences were observed for the last presentations. Results highlight the age-related impact of auditory novel information on attention and characterize the rapid development of attention control mechanisms as a function of age and exposure to irrelevant novel sounds.
Collapse
|
30
|
Vasilev MR, Parmentier FB, Kirkby JA. Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution. Q J Exp Psychol (Hove) 2020; 74:826-842. [PMID: 33283659 PMCID: PMC8054167 DOI: 10.1177/1747021820982267] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Novel or unexpected sounds that deviate from an otherwise repetitive
sequence of the same sound cause behavioural distraction. Recent work
has suggested that distraction also occurs during reading as fixation
durations increased when a deviant sound was presented at the fixation
onset of words. The present study tested the hypothesis that this
increase in fixation durations occurs due to saccadic inhibition. This
was done by manipulating the temporal onset of sounds relative to the
fixation onset of words in the text. If novel sounds cause saccadic
inhibition, they should be more distracting when presented during the
second half of fixations when saccade programming usually takes place.
Participants read single sentences and heard a 120 ms sound when they
fixated five target words in the sentence. On most occasions
(p = .9), the same sine wave tone was presented
(“standard”), while on the remaining occasions (p =
.1) a new sound was presented (“novel”). Critically, sounds were
played, on average, either during the first half of the fixation (0 ms
delay) or during the second half of the fixation (120 ms delay).
Consistent with the saccadic inhibition hypothesis (SIH), novel sounds
led to longer fixation durations in the 120 ms compared to the 0 ms
delay condition. However, novel sounds did not generally influence the
execution of the subsequent saccade. These results suggest that
unexpected sounds have a rapid influence on saccade planning, but not
saccade execution.
Collapse
Affiliation(s)
| | - Fabrice Br Parmentier
- Department of Psychology and Research Institute for Health Sciences (iUNICS), University of the Balearic Islands, Palma, Spain.,Balearic Islands Health Research Institute (IdISBa), Palma, Spain.,School of Psychology, The University of Western Australia, Perth, WA, Australia
| | - Julie A Kirkby
- Department of Psychology, Bournemouth University, Poole, UK
| |
Collapse
|
31
|
Dürschmid S, Reichert C, Hinrichs H, Heinze HJ, Kirsch HE, Knight RT, Deouell LY. Direct Evidence for Prediction Signals in Frontal Cortex Independent of Prediction Error. Cereb Cortex 2020; 29:4530-4538. [PMID: 30590422 DOI: 10.1093/cercor/bhy331] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2018] [Revised: 11/27/2018] [Accepted: 11/29/2018] [Indexed: 12/13/2022] Open
Abstract
Predictive coding (PC) has been suggested as one of the main mechanisms used by brains to interact with complex environments. PC theories posit top-down prediction signals, which are compared with actual outcomes, yielding in turn prediction error (PE) signals, which are used, bottom-up, to modify the ensuing predictions. However, disentangling prediction from PE signals has been challenging. Critically, while many studies found indirect evidence for PC in the form of PE signals, direct evidence for the prediction signal is mostly lacking. Here, we provide clear evidence, obtained from intracranial cortical recordings in human surgical patients, that the human lateral prefrontal cortex evinces prediction signals while anticipating an event. Patients listened to task-irrelevant sequences of repetitive tones including infrequent predictable or unpredictable pitch deviants. The broadband high-frequency amplitude (HFA) was decreased prior to the onset of expected relative to unexpected deviants in the frontal cortex only, and its amplitude was sensitive to the increasing likelihood of deviants following longer trains of standards in the unpredictable condition. Single-trial HFA predicted deviations and correlated with poststimulus response to deviations. These results provide direct evidence for frontal cortex prediction signals independent of PE signals.
Collapse
Affiliation(s)
- Stefan Dürschmid
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, Magdeburg, Germany.,Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, Magdeburg, Germany
| | - Christoph Reichert
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, Magdeburg, Germany.,CBBS-Center of Behavioral Brain Sciences, Otto-von-Guericke University, Universitätsplatz 2, Magdeburg, Germany
| | - Hermann Hinrichs
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, Magdeburg, Germany.,Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, Magdeburg, Germany.,Stereotactic Neurosurgery, Otto-von-Guericke University, Leipziger Str. 44, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipziger Str. 44, Magdeburg, Germany.,Forschungscampus STIMULATE, Otto-von-Guericke University, Universitätsplatz 2, Magdeburg, Germany.,CBBS-Center of Behavioral Brain Sciences, Otto-von-Guericke University, Universitätsplatz 2, Magdeburg, Germany
| | - Hans-Jochen Heinze
- Department of Behavioral Neurology, Leibniz Institute for Neurobiology, Brenneckestr. 6, Magdeburg, Germany.,Department of Neurology, Otto-von-Guericke University, Leipziger Str. 44, Magdeburg, Germany.,Stereotactic Neurosurgery, Otto-von-Guericke University, Leipziger Str. 44, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipziger Str. 44, Magdeburg, Germany.,Forschungscampus STIMULATE, Otto-von-Guericke University, Universitätsplatz 2, Magdeburg, Germany.,CBBS-Center of Behavioral Brain Sciences, Otto-von-Guericke University, Universitätsplatz 2, Magdeburg, Germany
| | - Heidi E Kirsch
- Department of Neurology, University of California, 400 Parnassus Avenue, San Francisco, CA, USA
| | - Robert T Knight
- Helen Wills Neuroscience Institute and Department of Psychology, University of California, Berkeley, CA, USA
| | - Leon Y Deouell
- Edmond and Lily Safra Center for Brain Sciences and Department of Psychology, The Hebrew University of Jerusalem, Mount Scopus, Jerusalem, Israel
| |
Collapse
|
32
|
Xiao X, Shum Y, Lui TK, Wang Y, Cheung AT, Chu WCW, Neggers SFW, Chan SS, Tse C. Functional connectivity of the frontotemporal network in preattentive detection of abstract changes: Perturbs and observes with transcranial magnetic stimulation and event-related optical signal. Hum Brain Mapp 2020; 41:2883-2897. [PMID: 32170910 PMCID: PMC7336140 DOI: 10.1002/hbm.24984] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2019] [Revised: 02/20/2020] [Accepted: 03/03/2020] [Indexed: 11/10/2022] Open
Abstract
Current theories of automatic or preattentive change detection suggest a regularity or prediction violation mechanism involving functional connectivity between the inferior frontal cortex (IFC) and the superior temporal cortex (STC). By disrupting the IFC function with transcranial magnetic stimulation (TMS) and recording the later STC mismatch response with event-related optical signal (EROS), previous study demonstrated a causal IFC-to-STC functional connection in detecting a pitch or physical change. However, physical change detection can be achieved by memory comparison of the physical features and may not necessarily involve regularity/rule extraction and prediction. The current study investigated the IFC-STC functional connectivity in detecting rule violation (i.e., an abstract change). Frequent standard tone pairs with a constant relative pitch difference, but varying pitches, were presented to establish a pitch interval rule. This abstract rule was violated by deviants with reduced relative pitch intervals. The EROS STC mismatch response to the deviants was abolished by the TMS applied at the IFC 80 ms after deviance onset, but preserved in the spatial (TMS on vertex), auditory (TMS sound), and temporal (200 ms after deviance onset) control conditions. These results demonstrate the IFC-STC connection in preattentive abstract change detection and support the regularity or prediction violation account.
Collapse
Affiliation(s)
- Xue‐Zhen Xiao
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| | - Yu‐Hei Shum
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| | - Troby K.‐Y. Lui
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| | - Yang Wang
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| | - Alexandra T.‐C. Cheung
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| | - Winnie C. W. Chu
- Department of Imaging and Interventional RadiologyThe Chinese University of Hong KongHong Kong SARChina
| | - Sebastiaan F. W. Neggers
- Department of Psychiatry, Brain Center Rudolf MagnusUniversity Medical Center UtrechtUtrechtThe Netherlands
| | - Sandra S.‐M. Chan
- Department of PsychiatryThe Chinese University of Hong KongHong Kong SARChina
| | - Chun‐Yu Tse
- Department of Psychology and Center for Cognition and Brain StudiesThe Chinese University of Hong KongHong Kong SARChina
| |
Collapse
|
33
|
Canales-Johnson A, Billig AJ, Olivares F, Gonzalez A, Garcia MDC, Silva W, Vaucheret E, Ciraolo C, Mikulan E, Ibanez A, Huepe D, Noreika V, Chennu S, Bekinschtein TA. Dissociable Neural Information Dynamics of Perceptual Integration and Differentiation during Bistable Perception. Cereb Cortex 2020; 30:4563-4580. [PMID: 32219312 PMCID: PMC7325715 DOI: 10.1093/cercor/bhaa058] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
At any given moment, we experience a perceptual scene as a single whole and yet we may distinguish a variety of objects within it. This phenomenon instantiates two properties of conscious perception: integration and differentiation. Integration is the property of experiencing a collection of objects as a unitary percept and differentiation is the property of experiencing these objects as distinct from each other. Here, we evaluated the neural information dynamics underlying integration and differentiation of perceptual contents during bistable perception. Participants listened to a sequence of tones (auditory bistable stimuli) experienced either as a single stream (perceptual integration) or as two parallel streams (perceptual differentiation) of sounds. We computed neurophysiological indices of information integration and information differentiation with electroencephalographic and intracranial recordings. When perceptual alternations were endogenously driven, the integrated percept was associated with an increase in neural information integration and a decrease in neural differentiation across frontoparietal regions, whereas the opposite pattern was observed for the differentiated percept. However, when perception was exogenously driven by a change in the sound stream (no bistability), neural oscillatory power distinguished between percepts but information measures did not. We demonstrate that perceptual integration and differentiation can be mapped to theoretically motivated neural information signatures, suggesting a direct relationship between phenomenology and neurophysiology.
Collapse
Affiliation(s)
- Andrés Canales-Johnson
- Department of Psychology, University of Cambridge, CB2 3EB Cambridge, UK
- Vicerectoria de Investigacion y Posgrado, Universidad Catolica del Maule, Talca 3480112, Chile
| | - Alexander J Billig
- Brain and Mind Institute, University of Western Ontario, London, N6A 3K7, Canada
- UCL Ear Institute, University College London, London, UK
| | - Francisco Olivares
- Facultad de Psicologia, Universidad Diego Portales, Santiago 8370076, Chile
| | - Andrés Gonzalez
- Facultad de Psicologia, Universidad Diego Portales, Santiago 8370076, Chile
| | - María del Carmen Garcia
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, Buenos Aires C1199ABB, Argentina
| | - Walter Silva
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, Buenos Aires C1199ABB, Argentina
| | - Esteban Vaucheret
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, Buenos Aires C1199ABB, Argentina
| | - Carlos Ciraolo
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, Buenos Aires C1199ABB, Argentina
| | - Ezequiel Mikulan
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCyT), INECO Foundation, Favaloro University, Buenos Aires 1126, Argentina
| | - Agustín Ibanez
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCyT), INECO Foundation, Favaloro University, Buenos Aires 1126, Argentina
- National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina
- School of Psychology, Center for Social and Cognitive Neuroscience (CSCN), Universidad Adolfo Ibáñez, Santiago 2485, Chile
| | - David Huepe
- School of Psychology, Center for Social and Cognitive Neuroscience (CSCN), Universidad Adolfo Ibáñez, Santiago 2485, Chile
| | - Valdas Noreika
- Department of Psychology, University of Cambridge, CB2 3EB Cambridge, UK
| | - Srivas Chennu
- School of Computing, University of Kent, ME4 4AG Chatham, UK
- Department of Clinical Neurosciences, University of Cambridge, CB2 3EB Cambridge, UK
| | | |
Collapse
|
34
|
Honbolygó F, Kóbor A, German B, Csépe V. Word stress representations are language‐specific: Evidence from event‐related brain potentials. Psychophysiology 2020; 57:e13541. [DOI: 10.1111/psyp.13541] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Revised: 01/07/2020] [Accepted: 01/15/2020] [Indexed: 12/01/2022]
Affiliation(s)
- Ferenc Honbolygó
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Institute of Psychology ELTE Eötvös Loránd University Budapest Hungary
| | - Andrea Kóbor
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
| | - Borbála German
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Department of Cognitive Science Budapest University of Technology and Economics Budapest Hungary
| | - Valéria Csépe
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Faculty of Modern Philology and Social Sciences University of Pannonia Budapest Hungary
| |
Collapse
|
35
|
Szalárdy O, Tóth B, Farkas D, Orosz G, Honbolygó F, Winkler I. Linguistic predictability influences auditory stimulus classification within two concurrent speech streams. Psychophysiology 2020; 57:e13547. [DOI: 10.1111/psyp.13547] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Revised: 01/20/2020] [Accepted: 01/22/2020] [Indexed: 11/30/2022]
Affiliation(s)
- Orsolya Szalárdy
- Faculty of Medicine Institute of Behavioural Sciences Semmelweis University Budapest Hungary
- Institute of Cognitive Neuroscience and Psychology Research Centre for Natural Sciences Hungarian Academy of Sciences Budapest Hungary
| | - Brigitta Tóth
- Institute of Cognitive Neuroscience and Psychology Research Centre for Natural Sciences Hungarian Academy of Sciences Budapest Hungary
| | - Dávid Farkas
- Analytics Development, Performance Management and Analytics, Business Development, Integrated Supply Chain Management, Nokia Business Services, Nokia Operations, Nokia Budapest Hungary
| | - Gábor Orosz
- Department of Psychology Stanford University Stanford CA USA
| | - Ferenc Honbolygó
- Brain Imaging Centre Research Centre for Natural Sciences Hungarian Academy of Sciences Budapest Hungary
- Institute of Psychology ELTE Eötvös Loránd University Budapest Hungary
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology Research Centre for Natural Sciences Hungarian Academy of Sciences Budapest Hungary
| |
Collapse
|
36
|
Schröger E, Roeber U. Encoding of deterministic and stochastic auditory rules in the human brain: The mismatch negativity mechanism does not reflect basic probability. Hear Res 2020; 399:107907. [PMID: 32143958 DOI: 10.1016/j.heares.2020.107907] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Revised: 01/11/2020] [Accepted: 02/02/2020] [Indexed: 10/25/2022]
Abstract
Regularities in a sequence of sounds can be automatically encoded in a predictive model by the auditory system. When a sound deviates from the one predicted by the model, a mismatch negativity (MMN) is elicited, which is taken to reflect a prediction error at a particular level of the model hierarchy. Although there are many studies on deterministic regularities, only a few have investigated the brain's ability to encode non-deterministic regularities. We studied a simple stochastic regularity: two tone pitches (standards, each occurring on 45% of trials); this regularity was occasionally violated by another tone pitch (deviant, occurring on 10% of trials). We found MMN when the deviant's pitch was outside those of the standards, but not when it was between them. Importantly, when we alternated the occurrence of the same two standards, making them deterministic, the deviant elicited MMN, even when its pitch was between those of the standards. Thus, although the MMN system is extremely powerful in establishing even quite complex deterministic regularities, it fails with a simple stochastic regularity. We argue that the MMN system does not know basic probability.
Collapse
Affiliation(s)
- Erich Schröger
- Institute for Psychology, Leipzig University, Neumarkt 9-19, D-04109, Leipzig, Germany.
| | - Urte Roeber
- Institute for Psychology, Leipzig University, Neumarkt 9-19, D-04109, Leipzig, Germany.
| |
Collapse
|
37
|
Todd J, Frost J, Fitzgerald K, Winkler I. Setting precedent: Initial feature variability affects the subsequent precision of regularly varying sound contexts. Psychophysiology 2020; 57:e13528. [DOI: 10.1111/psyp.13528] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2019] [Revised: 12/11/2019] [Accepted: 12/12/2019] [Indexed: 11/28/2022]
Affiliation(s)
- Juanita Todd
- School of Psychology University of Newcastle Callaghan NSW Australia
| | - Jade Frost
- School of Psychology University of Newcastle Callaghan NSW Australia
| | | | - István Winkler
- Institute of Cognitive Neuroscience and Psychology Research Centre for Natural Sciences Budapest Hungary
| |
Collapse
|
38
|
Vidal Y, Brusini P, Bonfieni M, Mehler J, Bekinschtein TA. Neural Signal to Violations of Abstract Rules Using Speech-Like Stimuli. eNeuro 2019; 6:ENEURO.0128-19.2019. [PMID: 31551251 PMCID: PMC6787344 DOI: 10.1523/eneuro.0128-19.2019] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Revised: 07/27/2019] [Accepted: 07/27/2019] [Indexed: 11/30/2022] Open
Abstract
As the evidence of predictive processes playing a role in a wide variety of cognitive domains increases, the brain as a predictive machine becomes a central idea in neuroscience. In auditory processing, a considerable amount of progress has been made using variations of the Oddball design, but most of the existing work seems restricted to predictions based on physical features or conditional rules linking successive stimuli. To characterize the predictive capacity of the brain to abstract rules, we present here two experiments that use speech-like stimuli to overcome limitations and avoid common confounds. Pseudowords were presented in isolation, intermixed with infrequent deviants that contained unexpected phoneme sequences. As hypothesized, the occurrence of unexpected sequences of phonemes reliably elicited an early prediction error signal. These prediction error signals do not seemed to be modulated by attentional manipulations due to different task instructions, suggesting that the predictions are deployed even when the task at hand does not volitionally involve error detection. In contrast, the amount of syllables congruent with a standard pseudoword presented before the point of deviance exerted a strong modulation. Prediction error's amplitude doubled when two congruent syllables were presented instead of one, despite keeping local transitional probabilities constant. This suggests that auditory predictions can be built integrating information beyond the immediate past. In sum, the results presented here further contribute to the understanding of the predictive capabilities of the human auditory system when facing complex stimuli and abstract rules.
Collapse
Affiliation(s)
- Yamil Vidal
- Cognitive Neuroscience Sector, International School for Advanced Studies (SISSA), Trieste 34136, Italy
| | - Perrine Brusini
- Cognitive Neuroscience Sector, International School for Advanced Studies (SISSA), Trieste 34136, Italy
- Institute of Psychology, Health and Society, University of Liverpool, Liverpool L69 7ZA, United Kingdom
| | - Michela Bonfieni
- Cognitive Neuroscience Sector, International School for Advanced Studies (SISSA), Trieste 34136, Italy
- The University of Edinburgh, Edinburgh EH8 9AD, United Kingdom
| | - Jacques Mehler
- Cognitive Neuroscience Sector, International School for Advanced Studies (SISSA), Trieste 34136, Italy
| | | |
Collapse
|
39
|
Varga Z, Garami L, Ragó A, Honbolygó F, Csépe V. Does intra-uterine language experience modulate word stress processing? An ERP study. RESEARCH IN DEVELOPMENTAL DISABILITIES 2019; 90:59-71. [PMID: 31078864 DOI: 10.1016/j.ridd.2019.04.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2018] [Revised: 04/08/2019] [Accepted: 04/15/2019] [Indexed: 06/09/2023]
Abstract
BACKGROUND Preterm birth is associated with various risks, including delayed or atypical language development. The prenatal start of prosodic tuning may affect the processing of word stress, an important suprasegmental feature of spoken utterances. AIM Our study focused on the expected contribution of intra-uterine experience to word stress processing. We aimed to demonstrate the hypothesized effect of intra-uterine sound exposition on stress sensitivity. METHOD We recorded ERP responses of 34 preterm infants elicited by bisyllabic pseudo-words in two oddball conditions by switching the stress pattern (legal vs. illegal) and role (standard vs. deviant). RESULTS The mismatch responses found were synchronized to each syllable of the illegally stressed stimuli with no difference between pre- and full-term infants. However, the clear role of the preterm status was demonstrated by the exaggerated processing of the native stress information. The impact of intra-uterine exposure to prosody was confirmed by our finding that moderate-late preterm infants outperformed the very preterm ones. CONCLUSION Intra-uterine exposition to prosodic features appears to contribute to the emergence of stable long-term stress representation. When this tuning is missing it is considered a risk for the language acquisition process.
Collapse
Affiliation(s)
- Zsuzsanna Varga
- Neonatal Intensive Care Unit, Semmelweis University 1st Department of Paediatrics, Bókay János utca 53-54., H- 1083, Budapest, Hungary; Doctoral School of Psychology, Budapest University of Technology and Economics, Egry József utca 1., H-1111, Budapest, Hungary.
| | - Linda Garami
- Doctoral School of Psychology, Eötvös Lorand University, Izabella utca 46., H-1064, Budapest, Hungary; Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary.
| | - Anett Ragó
- Department of Cognitive Psychology, Eötvös Loránd University, Izabella utca 46., H-1064, Budapest, Hungary.
| | - Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary; Department of Cognitive Psychology, Eötvös Loránd University, Izabella utca 46., H-1064, Budapest, Hungary.
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary; Department of Cognitive Sciences, Budapest University of Technology and Economics, Egry József utca 1., H-1111, Budapest, Hungary; University of Pannonia, Institute of Hungarian and Applied Linguistics, Vár utca 39., H-8200, Veszprém, Hungary.
| |
Collapse
|
40
|
Kojouharova P, File D, Sulykos I, Czigler I. Visual mismatch negativity and stimulus-specific adaptation: the role of stimulus complexity. Exp Brain Res 2019; 237:1179-1194. [PMID: 30806740 PMCID: PMC6557884 DOI: 10.1007/s00221-019-05494-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2018] [Accepted: 02/15/2019] [Indexed: 01/29/2023]
Abstract
The present study investigated the function of the brain activity underlying the visual mismatch negativity (vMMN) event-related potential (ERP) component. Snowflake patterns (complex stimuli) were presented as deviants and oblique bar patterns (simple stimuli) as standards, and vice versa in a passive oddball paradigm. Control (equiprobable) sequences of either complex shape patterns or oblique bar patterns with various orientations were also presented. VMMN appeared as the difference between the ERP to the oddball deviant and the ERP to the control (deviant minus control ERP difference). Apart from the shorter latency of the vMMN to the oblique bar pattern as deviant, vMMN to both deviants was similar, i.e., there was no amplitude difference. We attributed the function of the brain processes underlying vMMN to the detection of the infrequent stimulus type (also represented in memory) instead of a call for further processing (a possibility for acquiring more precise representation) of the deviant. An unexpected larger adaptation (control minus standard ERP difference) to the snowflake pattern was also obtained. We suggest that this was due to the acquisition of a more elaborate memory representation of the more complex stimulus.
Collapse
Affiliation(s)
- Petia Kojouharova
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, P.O. Box 286, Budapest, 1519, Hungary.
- Doctoral School of Psychology, Eötvös Loránd University, Budapest, Hungary.
| | - Domonkos File
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, P.O. Box 286, Budapest, 1519, Hungary
- Doctoral School of Psychology, Eötvös Loránd University, Budapest, Hungary
- Institute of Psychology, Eötvös Loránd University, Budapest, Hungary
| | - István Sulykos
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, P.O. Box 286, Budapest, 1519, Hungary
| | - István Czigler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, P.O. Box 286, Budapest, 1519, Hungary
| |
Collapse
|
41
|
Mohebbi M, Daneshi A, Asadpour A, Mohsen S, Farhadi M, Mahmoudian S. The potential role of auditory prediction error in decompensated tinnitus: An auditory mismatch negativity study. Brain Behav 2019; 9:e01242. [PMID: 30895749 PMCID: PMC6456780 DOI: 10.1002/brb3.1242] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 12/08/2018] [Accepted: 12/10/2018] [Indexed: 01/25/2023] Open
Abstract
INTRODUCTION Some tinnitus subjects habituate to their tinnitus but some others do not and complain of its annoyance tremendously. Normal sensory memory and change detection processes are needed for detecting the tinnitus signal as a prediction error and habituation to tinnitus. The purpose of this study was to compare auditory mismatch negativity as the index of sensory memory and change detection among the studied groups to search for the factors involving in the perception of tinnitus and preventing habituation in decompensated tinnitus subjects. METHODS Electroencephalography was recorded from scalp electrodes in compensated tinnitus, decompensated tinnitus, and no tinnitus control subjects. Mismatch negativity was obtained using the oddball paradigm with frequency, duration, and silent gap deviants. Amplitude, latency, and area under the curve of mismatch negativities were compared among the three studied groups. RESULTS The results showed lower mismatch negativity amplitude and area under the curve for the higher frequency deviant and for the silent gap deviant in decompensated tinnitus group compared to normal control and compensated tinnitus group. CONCLUSIONS This study revealed a deficit in sensory memory and change detection processing in decompensated tinnitus subjects. This causes persistent prediction errors; tinnitus signal is consistently detected as a new signal and activates the brain salience network and consequently prevents habituation to tinnitus. Mismatch negativity is proposed as an index for monitoring tinnitus rehabilitation.
Collapse
Affiliation(s)
- Mehrnaz Mohebbi
- ENT and Head & Neck Research Center and Department, The Five Senses InstituteHazrat Rasoul Akram Hospital, Iran University of Medical SciencesTehranIran
| | - Ahmad Daneshi
- ENT and Head & Neck Research Center and Department, The Five Senses InstituteHazrat Rasoul Akram Hospital, Iran University of Medical SciencesTehranIran
| | - Abdoreza Asadpour
- Department of Electrical EngineeringSharif University of TechnologyTehranIran
| | - Samer Mohsen
- Department of Otolaryngology, Faculty of MedicineDamascus UniversityDamascusSyria
| | - Mohammad Farhadi
- ENT and Head & Neck Research Center and Department, The Five Senses InstituteHazrat Rasoul Akram Hospital, Iran University of Medical SciencesTehranIran
| | - Saeid Mahmoudian
- ENT and Head & Neck Research Center and Department, The Five Senses InstituteHazrat Rasoul Akram Hospital, Iran University of Medical SciencesTehranIran
- Department of OtorhinolaryngologyHannover Medical University (MHH)HannoverGermany
| |
Collapse
|
42
|
Carbajal GV, Malmierca MS. The Neuronal Basis of Predictive Coding Along the Auditory Pathway: From the Subcortical Roots to Cortical Deviance Detection. Trends Hear 2019; 22:2331216518784822. [PMID: 30022729 PMCID: PMC6053868 DOI: 10.1177/2331216518784822] [Citation(s) in RCA: 79] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/31/2023] Open
Abstract
In this review, we attempt to integrate the empirical evidence regarding stimulus-specific adaptation (SSA) and mismatch negativity (MMN) under a predictive coding perspective (also known as Bayesian or hierarchical-inference model). We propose a renewed methodology for SSA study, which enables a further decomposition of deviance detection into repetition suppression and prediction error, thanks to the use of two controls previously introduced in MMN research: the many-standards and the cascade sequences. Focusing on data obtained with cellular recordings, we explain how deviance detection and prediction error are generated throughout hierarchical levels of processing, following two vectors of increasing computational complexity and abstraction along the auditory neuraxis: from subcortical toward cortical stations and from lemniscal toward nonlemniscal divisions. Then, we delve into the particular characteristics and contributions of subcortical and cortical structures to this generative mechanism of hierarchical inference, analyzing what is known about the role of neuromodulation and local microcircuitry in the emergence of mismatch signals. Finally, we describe how SSA and MMN are occurring at similar time frame and cortical locations, and both are affected by the manipulation of N-methyl- D-aspartate receptors. We conclude that there is enough empirical evidence to consider SSA and MMN, respectively, as the microscopic and macroscopic manifestations of the same physiological mechanism of deviance detection in the auditory cortex. Hence, the development of a common theoretical framework for SSA and MMN is all the more recommendable for future studies. In this regard, we suggest a shared nomenclature based on the predictive coding interpretation of deviance detection.
Collapse
Affiliation(s)
- Guillermo V Carbajal
- 1 Auditory Neuroscience Laboratory (Lab 1), Institute of Neuroscience of Castile and León, University of Salamanca, Salamanca, Spain.,2 Salamanca Institute for Biomedical Research, Spain
| | - Manuel S Malmierca
- 1 Auditory Neuroscience Laboratory (Lab 1), Institute of Neuroscience of Castile and León, University of Salamanca, Salamanca, Spain.,2 Salamanca Institute for Biomedical Research, Spain.,3 Department of Cell Biology and Pathology, Faculty of Medicine, University of Salamanca, Spain
| |
Collapse
|
43
|
The cognitive resource and foreknowledge dependence of auditory perceptual inference. Neuropsychologia 2018; 117:379-388. [DOI: 10.1016/j.neuropsychologia.2018.07.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2018] [Revised: 07/02/2018] [Accepted: 07/03/2018] [Indexed: 11/19/2022]
|
44
|
Wetzel N, Scharf F, Widmann A. Can't Ignore-Distraction by Task-Irrelevant Sounds in Early and Middle Childhood. Child Dev 2018; 90:e819-e830. [PMID: 29943436 DOI: 10.1111/cdev.13109] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
Attention control abilities are relevant for learning success. Little is known about the development of audio-visual attention in early childhood. Four groups of children between the ages of 4 and 10 years and adults performed an audio-visual distraction paradigm (N = 106). Multilevel analyses revealed increased reaction times in a visual categorization task when task-irrelevant novel sounds were presented, demonstrating involuntary distraction of attention. This distraction effect decreased with age and significantly differed between age groups. In addition, the two youngest age groups responded with a delay in trials following a distractor trial, indicating delayed reallocation of attention to the task at hand. Results indicate a significant maturation of audio-visual attention control within a few years during early childhood that continues throughout middle childhood.
Collapse
Affiliation(s)
- Nicole Wetzel
- Leibniz Institute for Neurobiology.,Center for Behavioral Brain Sciences Magdeburg
| | | | | |
Collapse
|
45
|
Skerritt-Davis B, Elhilali M. Detecting change in stochastic sound sequences. PLoS Comput Biol 2018; 14:e1006162. [PMID: 29813049 PMCID: PMC5993325 DOI: 10.1371/journal.pcbi.1006162] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Revised: 06/08/2018] [Accepted: 04/30/2018] [Indexed: 01/18/2023] Open
Abstract
Our ability to parse our acoustic environment relies on the brain's capacity to extract statistical regularities from surrounding sounds. Previous work in regularity extraction has predominantly focused on the brain's sensitivity to predictable patterns in sound sequences. However, natural sound environments are rarely completely predictable, often containing some level of randomness, yet the brain is able to effectively interpret its surroundings by extracting useful information from stochastic sounds. It has been previously shown that the brain is sensitive to the marginal lower-order statistics of sound sequences (i.e., mean and variance). In this work, we investigate the brain's sensitivity to higher-order statistics describing temporal dependencies between sound events through a series of change detection experiments, where listeners are asked to detect changes in randomness in the pitch of tone sequences. Behavioral data indicate listeners collect statistical estimates to process incoming sounds, and a perceptual model based on Bayesian inference shows a capacity in the brain to track higher-order statistics. Further analysis of individual subjects' behavior indicates an important role of perceptual constraints in listeners' ability to track these sensory statistics with high fidelity. In addition, the inference model facilitates analysis of neural electroencephalography (EEG) responses, anchoring the analysis relative to the statistics of each stochastic stimulus. This reveals both a deviance response and a change-related disruption in phase of the stimulus-locked response that follow the higher-order statistics. These results shed light on the brain's ability to process stochastic sound sequences.
Collapse
Affiliation(s)
- Benjamin Skerritt-Davis
- Electrical & Computer Engineering, Johns Hopkins University, Baltimore, Maryland, United States of America
| | - Mounya Elhilali
- Electrical & Computer Engineering, Johns Hopkins University, Baltimore, Maryland, United States of America
| |
Collapse
|
46
|
Denham SL, Winkler I. Predictive coding in auditory perception: challenges and unresolved questions. Eur J Neurosci 2018; 51:1151-1160. [PMID: 29250827 DOI: 10.1111/ejn.13802] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2017] [Revised: 09/03/2017] [Accepted: 11/20/2017] [Indexed: 11/30/2022]
Abstract
Predictive coding is arguably the currently dominant theoretical framework for the study of perception. It has been employed to explain important auditory perceptual phenomena, and it has inspired theoretical, experimental and computational modelling efforts aimed at describing how the auditory system parses the complex sound input into meaningful units (auditory scene analysis). These efforts have uncovered some vital questions, addressing which could help to further specify predictive coding and clarify some of its basic assumptions. The goal of the current review is to motivate these questions and show how unresolved issues in explaining some auditory phenomena lead to general questions of the theoretical framework. We focus on experimental and computational modelling issues related to sequential grouping in auditory scene analysis (auditory pattern detection and bistable perception), as we believe that this is the research topic where predictive coding has the highest potential for advancing our understanding. In addition to specific questions, our analysis led us to identify three more general questions that require further clarification: (1) What exactly is meant by prediction in predictive coding? (2) What governs which generative models make the predictions? and (3) What (if it exists) is the correlate of perceptual experience within the predictive coding framework?
Collapse
Affiliation(s)
- Susan L Denham
- School of Psychology, University of Plymouth, Drake Circus, Plymouth, PL4 8AA, UK
| | - István Winkler
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Budapest, Hungary
| |
Collapse
|
47
|
Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex? Neuroscience 2017; 389:54-73. [PMID: 28782642 DOI: 10.1016/j.neuroscience.2017.07.061] [Citation(s) in RCA: 179] [Impact Index Per Article: 25.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Accepted: 07/26/2017] [Indexed: 11/21/2022]
Abstract
Predictive coding is possibly one of the most influential, comprehensive, and controversial theories of neural function. While proponents praise its explanatory potential, critics object that key tenets of the theory are untested or even untestable. The present article critically examines existing evidence for predictive coding in the auditory modality. Specifically, we identify five key assumptions of the theory and evaluate each in the light of animal, human and modeling studies of auditory pattern processing. For the first two assumptions - that neural responses are shaped by expectations and that these expectations are hierarchically organized - animal and human studies provide compelling evidence. The anticipatory, predictive nature of these expectations also enjoys empirical support, especially from studies on unexpected stimulus omission. However, for the existence of separate error and prediction neurons, a key assumption of the theory, evidence is lacking. More work exists on the proposed oscillatory signatures of predictive coding, and on the relation between attention and precision. However, results on these latter two assumptions are mixed or contradictory. Looking to the future, more collaboration between human and animal studies, aided by model-based analyses will be needed to test specific assumptions and implementations of predictive coding - and, as such, help determine whether this popular grand theory can fulfill its expectations.
Collapse
|
48
|
Wetzel N, Schröger E, Widmann A. Distraction by Novel and Pitch-Deviant Sounds in Children. Front Psychol 2016; 7:1949. [PMID: 28018281 PMCID: PMC5156737 DOI: 10.3389/fpsyg.2016.01949] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Accepted: 11/28/2016] [Indexed: 11/28/2022] Open
Abstract
The control of attention is an important part of our executive functions and enables us to focus on relevant information and to ignore irrelevant information. The ability to shield against distraction by task-irrelevant sounds is suggested to mature during school age. The present study investigated the developmental time course of distraction in three groups of children aged 7–10 years. Two different types of distractor sounds that have been frequently used in auditory attention research—novel environmental and pitch-deviant sounds—were presented within an oddball paradigm while children performed a visual categorization task. Reaction time measurements revealed decreasing distractor-related impairment with age. Novel environmental sounds impaired performance in the categorization task more than pitch-deviant sounds. The youngest children showed a pronounced decline of novel-related distraction effects throughout the experimental session. Such a significant decline as a result of practice was not observed in the pitch-deviant condition and not in older children. We observed no correlation between cross-modal distraction effects and performance in standardized tests of concentration and visual distraction. Results of the cross-modal distraction paradigm indicate that separate mechanisms underlying the processing of novel environmental and pitch-deviant sounds develop with different time courses and that these mechanisms develop considerably within a few years in middle childhood.
Collapse
Affiliation(s)
- Nicole Wetzel
- Cognitive and Biological Psychology, Institute of Psychology, University of Leipzig Leipzig, Germany
| | - Erich Schröger
- Cognitive and Biological Psychology, Institute of Psychology, University of Leipzig Leipzig, Germany
| | - Andreas Widmann
- Cognitive and Biological Psychology, Institute of Psychology, University of Leipzig Leipzig, Germany
| |
Collapse
|
49
|
Maes PJ, Buhmann J, Leman M. 3Mo: A Model for Music-Based Biofeedback. Front Neurosci 2016; 10:548. [PMID: 27994535 PMCID: PMC5133250 DOI: 10.3389/fnins.2016.00548] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2016] [Accepted: 11/15/2016] [Indexed: 01/18/2023] Open
Abstract
In the domain of sports and motor rehabilitation, it is of major importance to regulate and control physiological processes and physical motion in most optimal ways. For that purpose, real-time auditory feedback of physiological and physical information based on sound signals, often termed “sonification,” has been proven particularly useful. However, the use of music in biofeedback systems has been much less explored. In the current article, we assert that the use of music, and musical principles, can have a major added value, on top of mere sound signals, to the benefit of psychological and physical optimization of sports and motor rehabilitation tasks. In this article, we present the 3Mo model to describe three main functions of music that contribute to these benefits. These functions relate the power of music to Motivate, and to Monitor and Modify physiological and physical processes. The model brings together concepts and theories related to human sensorimotor interaction with music, and specifies the underlying psychological and physiological principles. This 3Mo model is intended to provide a conceptual framework that guides future research on musical biofeedback systems in the domain of sports and motor rehabilitation.
Collapse
Affiliation(s)
- Pieter-Jan Maes
- Department of Art, Music and Theatre Sciences, Institute for Psychoacoustics and Electronic Music, Ghent University Ghent, Belgium
| | - Jeska Buhmann
- Department of Art, Music and Theatre Sciences, Institute for Psychoacoustics and Electronic Music, Ghent University Ghent, Belgium
| | - Marc Leman
- Department of Art, Music and Theatre Sciences, Institute for Psychoacoustics and Electronic Music, Ghent University Ghent, Belgium
| |
Collapse
|
50
|
Steinberg J, Jacobsen TK, Jacobsen T. Repair or Violation Detection? Pre-Attentive Processing Strategies of Phonotactic Illegality Demonstrated on the Constraint of g-Deletion in German. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2016; 59:557-571. [PMID: 27138594 DOI: 10.1044/2015_jslhr-h-15-0062] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2015] [Accepted: 10/11/2015] [Indexed: 06/05/2023]
Abstract
PURPOSE Effects of categorical phonotactic knowledge on pre-attentive speech processing were investigated by presenting illegal speech input that violated a phonotactic constraint in German called "g-deletion." The present study aimed to extend previous findings of automatic processing of phonotactic violations and to investigate the role of stimulus context in triggering either an automatic phonotactic repair or a detection of the violation. METHOD The mismatch negativity event-related potential component was obtained in 2 identical cross-sectional experiments with speaker variation and 16 healthy adult participants each. Four pseudowords were used as stimuli, 3 of them phonotactically legal and 1 illegal. Stimuli were contrasted pairwise in passive oddball conditions and presented binaurally via headphones. Results were analyzed by means of mixed design analyses of variance. RESULTS Phonotactically illegal stimuli were found to be processed differently compared to legal ones. Results indicate evidence for both automatic repair and detection of the phonotactic violation depending on the linguistic context the illegal stimulus was embedded in. CONCLUSIONS These findings corroborate notions that categorical phonotactic knowledge is activated and applied even in the absence of attention. Thus, our findings contribute to the general understanding of sublexical phonological processing and may be of use for further developing speech recognition models.
Collapse
|